-- Logs begin at Sun 2022-08-28 17:34:10 UTC, end at Sun 2022-08-28 20:17:13 UTC. -- Aug 28 18:02:18.468139 n-d-850468-20 systemd[1]: Starting Devstack devstack@keystone.service... Aug 28 18:02:18.476642 n-d-850468-20 devstack@keystone.service[82154]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 28 18:02:18.478629 n-d-850468-20 devstack@keystone.service[82154]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 28 18:02:18 2022] *** Aug 28 18:02:18.478629 n-d-850468-20 devstack@keystone.service[82154]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 28 18:02:18.478629 n-d-850468-20 devstack@keystone.service[82154]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 28 18:02:18.478629 n-d-850468-20 devstack@keystone.service[82154]: nodename: n-d-850468-20 Aug 28 18:02:18.478629 n-d-850468-20 devstack@keystone.service[82154]: machine: x86_64 Aug 28 18:02:18.478629 n-d-850468-20 devstack@keystone.service[82154]: clock source: unix Aug 28 18:02:18.478629 n-d-850468-20 devstack@keystone.service[82154]: pcre jit disabled Aug 28 18:02:18.478629 n-d-850468-20 devstack@keystone.service[82154]: detected number of CPU cores: 4 Aug 28 18:02:18.478629 n-d-850468-20 devstack@keystone.service[82154]: current working directory: / Aug 28 18:02:18.478629 n-d-850468-20 devstack@keystone.service[82154]: detected binary path: /usr/bin/uwsgi-core Aug 28 18:02:18.478629 n-d-850468-20 devstack@keystone.service[82154]: your processes number limit is 47680 Aug 28 18:02:18.478629 n-d-850468-20 devstack@keystone.service[82154]: your memory page size is 4096 bytes Aug 28 18:02:18.478629 n-d-850468-20 devstack@keystone.service[82154]: detected max file descriptor number: 2048 Aug 28 18:02:18.478629 n-d-850468-20 devstack@keystone.service[82154]: lock engine: pthread robust mutexes Aug 28 18:02:18.480249 n-d-850468-20 devstack@keystone.service[82154]: thunder lock: enabled Aug 28 18:02:18.480249 n-d-850468-20 devstack@keystone.service[82154]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 28 18:02:18.480249 n-d-850468-20 devstack@keystone.service[82154]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 28 18:02:18.518251 n-d-850468-20 devstack@keystone.service[82154]: Python main interpreter initialized at 0x5608583e39c0 Aug 28 18:02:18.518251 n-d-850468-20 devstack@keystone.service[82154]: python threads support enabled Aug 28 18:02:18.518251 n-d-850468-20 devstack@keystone.service[82154]: your server socket listen backlog is limited to 100 connections Aug 28 18:02:18.518251 n-d-850468-20 devstack@keystone.service[82154]: your mercy for graceful operations on workers is 90 seconds Aug 28 18:02:18.518659 n-d-850468-20 devstack@keystone.service[82154]: mapped 403077 bytes (393 KB) for 2 cores Aug 28 18:02:18.518659 n-d-850468-20 devstack@keystone.service[82154]: *** Operational MODE: preforking *** Aug 28 18:02:18.518988 n-d-850468-20 devstack@keystone.service[82154]: *** uWSGI is running in multiple interpreter mode *** Aug 28 18:02:18.518988 n-d-850468-20 devstack@keystone.service[82154]: spawned uWSGI master process (pid: 82154) Aug 28 18:02:18.519217 n-d-850468-20 systemd[1]: Started Devstack devstack@keystone.service. Aug 28 18:02:18.520687 n-d-850468-20 devstack@keystone.service[82154]: spawned uWSGI worker 1 (pid: 82160, cores: 1) Aug 28 18:02:18.520687 n-d-850468-20 devstack@keystone.service[82154]: spawned uWSGI worker 2 (pid: 82161, cores: 1) Aug 28 18:02:18.520687 n-d-850468-20 devstack@keystone.service[82154]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 28 18:02:22.868382 n-d-850468-20 devstack@keystone.service[82161]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 18:02:22.868382 n-d-850468-20 devstack@keystone.service[82161]: from cryptography.utils import int_from_bytes Aug 28 18:02:22.869252 n-d-850468-20 devstack@keystone.service[82161]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 18:02:22.869252 n-d-850468-20 devstack@keystone.service[82161]: from cryptography.utils import int_from_bytes Aug 28 18:02:22.869381 n-d-850468-20 devstack@keystone.service[82160]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 18:02:22.869381 n-d-850468-20 devstack@keystone.service[82160]: from cryptography.utils import int_from_bytes Aug 28 18:02:22.869381 n-d-850468-20 devstack@keystone.service[82160]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 18:02:22.869381 n-d-850468-20 devstack@keystone.service[82160]: from cryptography.utils import int_from_bytes Aug 28 18:02:22.918903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 18:02:22.919096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 18:02:22.919293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] command line args: [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 18:02:22.919423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 18:02:22.919576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 18:02:22.919669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 18:02:22.919748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ================================================================================ {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 18:02:22.919825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] command line args: [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 18:02:22.920042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] admin_token = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.920130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 18:02:22.920262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ================================================================================ {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 18:02:22.920367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] config_dir = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.920488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.920610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] admin_token = **** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.920749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] config_source = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.920857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] config_dir = [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.920971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] debug = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.921079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.921193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.921578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] config_source = [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.921578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] debug = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.921807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.921919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.922065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.922185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.922306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.922424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.922537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.922621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.922693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.922758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.922821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_config_append = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.922821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.922932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] list_limit = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.922988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_dir = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.923055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] log_config_append = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.923117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_file = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.923179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.923179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] log_dir = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.923316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.923376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] log_file = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.923447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.923511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.923749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.923955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.924037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.924111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.924186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.924186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.924369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.924369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.924551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.924633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.924711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.924829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.924947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.925027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.925104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.925226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.925301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.925452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.925574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.925691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.925794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.925930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.926021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.926183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.926271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.926435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.926715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.926809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.926932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] publish_errors = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.927168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.927290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.927501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] publish_errors = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.927583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.927656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.927723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.927860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.927945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.928086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.928241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.928401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.928565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] standard_threads = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.928740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.928917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.929109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] standard_threads = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.929284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.929564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.929757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.929757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] use_journal = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.929956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.930062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] use_json = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.930186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.930319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] use_stderr = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.930440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] use_journal = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.930556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] use_syslog = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.930663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] use_json = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.930663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] use_stderr = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.930922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.931059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] use_syslog = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.931184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.931310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:02:22.931385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.931468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.931541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.931674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.931796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.931908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.932025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.932137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.932247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.932368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.932480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.932598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.932709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.932819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.932929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.933048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.933160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.933276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.933431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.933572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.933686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.933809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.933922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.934035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.934145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.934262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.934373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.934496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.934615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.934727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.934844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.934961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.935079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.935312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.935433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.935566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.935771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.935897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.936010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.936133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.936245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.936356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.936465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.936577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.936687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.936806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.936922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.937034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.937151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.937151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.937367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.937486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.937600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.937716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.937826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.937826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.938044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.938157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.938268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.938268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.938475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.938586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.938712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.938825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.938942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.939053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.939226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.939360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.939485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.939599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.939717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.939828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.939938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.940054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.940174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.940292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.940404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.940514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.940624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.940742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.940930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.941045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.941155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.941255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.941355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.941449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.941561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.941675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.941788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.941898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.942008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.942118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.942229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.942339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.942439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.942550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.942661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.942777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.942897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.943024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.943143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.943274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.943388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.943499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.943622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.943740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.943854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.943963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.944073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.944214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.944338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.944451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.944563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.944673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.944789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.944902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.945022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.945136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.945247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.945359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.945470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.945590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.945715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.945829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.945942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.946062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.946181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.946306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.946419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.946536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.946657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.946770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.946884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.947004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.947116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.947236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.947435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.947550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.947661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.947773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.947884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.948003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.948117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.948220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.948220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.948479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.948479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.948820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.948999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.949174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.949307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.949428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.949428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.949728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.949845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.949940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.950033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.950127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.950219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.950330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.950425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.950518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.950610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.950703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.950796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.950905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.951001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.951118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.951269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.951380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.951380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.951611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.951716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.951825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.951825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.952040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.952153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.952343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.952459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.952578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.952691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.952802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.952912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.953032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.953154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.953279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.953392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.953502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.953614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.953725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.953836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.953959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.954074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.954186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.954297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.954409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.954511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.954629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.954742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.954854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.954956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.955055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.955164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.955365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.955483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.955595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.955714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.955828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.955948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.956060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.956171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.external = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.956283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.956421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.956545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.956658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.956780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.956906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.957020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] auth.external = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.957132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.password = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.957249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.957361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.token = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.957474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.957596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.957716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.957830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.957943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] auth.password = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.958039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.958178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] auth.token = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.958314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.958430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.958551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.958665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.958778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.958890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.959010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.959124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.959237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.959367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.959480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.959593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.959724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.959840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.959952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.960063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] credential.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.960175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.960287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.960407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.960521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.960634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.960737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.960850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.960962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.961083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.961197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.961324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.961438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.961550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.961665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.961786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.961900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.962011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.962122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.962234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.962345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.962465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.962578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.962697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.962810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.962922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.963034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.963154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.964239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.964902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.965027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.965176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.965281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] federation.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.965397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.965498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.965593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.965688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.965781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.965876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.965979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.966077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.966180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.966276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.966378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.966473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.966576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.967116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.967240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.967381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.967495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.967607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.967805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.967922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.968037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.968149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.968262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.968384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.968499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.968612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.968724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.968836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.968956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.969080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.969195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.969320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.969425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.969537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.969649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.969773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.969887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.970000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.970114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.970114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.970324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.970445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.970559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.970671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.970790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.970903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.971016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.971016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.971238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.971416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.971530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.971642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.971754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.971879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.972001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.972115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.972230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.972230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.972441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.972563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.972677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.972790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.972893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.973978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.974890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.975011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.975125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.975339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.976170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.976292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.976391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.976507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.976607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.976702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.976804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.976904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.976999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.977102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.977200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.977294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.977294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.977485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.977485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.977737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.977737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.978025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.978179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.978338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.978512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.978668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.978816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.979062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.979175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.979289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.979391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.979511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.979609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.979703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.979797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.979892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.979997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.980094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.980196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.980293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.980388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.980483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.980586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.980586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.980765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.980858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.980858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.981032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.981134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.981134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.981338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.981451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.981569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.981683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.981683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.981903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.982015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.982015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.982224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.982335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.982335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.982650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.982770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.982770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.982980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.983092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.983092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.983330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.983444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.983557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.983669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.983669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.983891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.984006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.984118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.984229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.984348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.984348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.984348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.984348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.984763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.984874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.984985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.985096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.985216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.985329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.985441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.985552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.985663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.985775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.985894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.986008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.986119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.986238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.986351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.986463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.986583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.986696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.986811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.986924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.987043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.987155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.987381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.987499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.987611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.987722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.987917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.988334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.988476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.988593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.988704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] role.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.988815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.988928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] role.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.989039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.989159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.989272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.989383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.989497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.989608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.989720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.989840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.989961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.990075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.990187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.990298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.990410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.990595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.990709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.990821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.990933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.991046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.991158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.991296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.991412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.991524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.991636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.991746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.991871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] resource.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.991986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.992107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.992221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.992333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.992445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.992622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.992740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.992853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.992964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.993102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.993220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.993340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.993454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.993609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.993731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.993842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.993954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.994075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.994191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] role.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.994302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.994539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] role.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.994655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.994768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.994888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.995002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.995152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.995289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.995443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.995561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.995707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.995825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.995965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.996080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.996219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.996336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.996458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.996571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.996683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.996794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.996905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.997017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.997140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.997255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.997368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.997479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.997590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.997701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.997822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.997935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.998064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.998191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.998373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.998608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.998735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.998913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.999031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.999499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.999614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.999742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.999742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:22.999957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.000068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.000180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.000292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.000413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.000528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.000639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.000750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.000861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.000973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.001097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.001219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.001341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.001454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.001568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.001568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.001778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.connection = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.001890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.002017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.002132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.002244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.002244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.002453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.002566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.002687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.002800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.002911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.003023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.003134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.003246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.003389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.003504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.003620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.003848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.004096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.004336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.004588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.004828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.005074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.005308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.005550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.005786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.005960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 18:02:23.015278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] token.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.015278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.015278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.015278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.015278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.015278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.015278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.015278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.015278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.016331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.016331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.016331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.016331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.016331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.016331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.016331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.016331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.016331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.017235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.connection = **** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.017235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.017235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.017235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.017235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.017235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.017235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.017235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.017235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.018129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.018129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.018129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.018609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.019050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.019740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.020185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.020593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.021007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.021427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:02:23.021764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 18:02:23.036197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.036460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.036648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.045685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.048526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.048960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.049355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.058410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.074649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.074885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.082178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.082759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.130859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.132676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.181129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.181350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.195688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.195928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.342499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.342753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.342895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.343182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.343376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.343582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.349037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.349271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.349493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.349718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.349941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.350166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.367145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.367366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.367596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.367846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.368054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.368206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.368290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.368363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.368435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.368508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.368724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.368948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.369168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.369387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.379841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.380323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.393545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.393746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.393869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.394028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.394141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.394278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.394388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.394501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.394611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.394730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.394856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.394965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.395121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.395390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:02:23.411865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.412112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 18:02:23.412274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.412397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.412514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 18:02:23.412631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 18:02:23.412842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.413016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.413131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 18:02:23.413250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.413365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.413480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.413607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.413716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.413830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.414049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.423460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.423752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.424037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.424240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.424375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.424489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.424796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.425083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.431362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.432165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.434275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.434567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.434857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.435058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.435181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.435350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.435435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.435743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.435887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.435972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.436046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.436279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.436403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.436566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.436692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.436827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.436939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.437073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.437170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.437351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.437621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.438003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.459840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.460634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.461345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.461633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.462125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.462413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.466211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.466498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.466786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.467158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.467500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.467791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.473363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.473624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.474111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.474397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.477728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.478043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.478331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.478533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.478632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.478814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.478941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.479082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.479399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.479682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.479958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.480231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.480504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.481140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.481425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.481715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.497605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.497898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.498015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.498363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.501893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.502250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.505049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.505350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.505508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.505790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.510029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.510328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.513198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.513499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.516506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.516811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.516900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.517106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.517253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.517375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.517498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.517672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.517819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.517945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.518067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.518229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.533966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.534160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.534253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.534328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.534514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.534638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.534799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.535007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.541639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.541804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.543275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.543396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.544827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.544973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.545183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.545318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.547861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.547998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.548098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.548166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.548423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.548551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.548648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.548731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.548961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.549090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.560348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.560493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.560790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.560921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.561055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.561135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.561317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.561443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.561622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.561715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.561925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.562063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.562200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.562280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.577665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.577838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.580606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.580735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.583501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.583636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.584967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.585112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.586440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.586567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.586702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.586781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.587047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.587184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.593648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.593815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.595146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.595318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.598074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.598430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.598674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.598808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.599002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.599126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.599437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.599733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.606955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.607269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.607571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.607720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.607861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.608133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.614463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.614751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.615039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.615183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:02:23.615352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.615436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.615606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.615733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.615892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.615976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.616139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.616288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.616476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.616563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.616660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.616748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.616959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.617103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.617240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.617323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.617480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.617609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.617769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.617915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.618001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.618077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.618297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.618565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:02:23.652769 n-d-850468-20 devstack@keystone.service[82161]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5608583e39c0 pid: 82161 (default app) Aug 28 18:02:23.653606 n-d-850468-20 devstack@keystone.service[82160]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5608583e39c0 pid: 82160 (default app) Aug 28 18:02:23.656594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f151b72-c717-4893-a54e-f2aec6c60616 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:23.656883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f151b72-c717-4893-a54e-f2aec6c60616 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:23.657156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f151b72-c717-4893-a54e-f2aec6c60616 None None] PATH_INFO: `/v3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:23.661318 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Sun Aug 28 18:02:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:30.341406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a695d-31b2-49c4-9d5f-12e0ded01070 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:30.342027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a695d-31b2-49c4-9d5f-12e0ded01070 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:30.342027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a695d-31b2-49c4-9d5f-12e0ded01070 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:30.346322 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:30.352045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1881908-b029-4dde-bfd4-3f1a8165fe89 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:30.352637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1881908-b029-4dde-bfd4-3f1a8165fe89 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:30.352637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1881908-b029-4dde-bfd4-3f1a8165fe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:30.422309 n-d-850468-20 devstack@keystone.service[82161]: INFO dbcounter [None req-b1881908-b029-4dde-bfd4-3f1a8165fe89 None None] Registered counter for database keystone Aug 28 18:02:30.442285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG oslo_db.sqlalchemy.engines [None req-b1881908-b029-4dde-bfd4-3f1a8165fe89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 18:02:30.449412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writer thread running {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 18:02:30.633835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG passlib.handlers.bcrypt [None req-b1881908-b029-4dde-bfd4-3f1a8165fe89 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=82161) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 28 18:02:30.634162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG passlib.handlers.bcrypt [None req-b1881908-b029-4dde-bfd4-3f1a8165fe89 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82161) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 28 18:02:30.690181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b1881908-b029-4dde-bfd4-3f1a8165fe89 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:30.691848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b1881908-b029-4dde-bfd4-3f1a8165fe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:30.869233 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 28 18:02:31.345079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a695d-31b2-49c4-9d5f-12e0ded01070 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:31.414264 n-d-850468-20 devstack@keystone.service[82160]: INFO dbcounter [None req-545a695d-31b2-49c4-9d5f-12e0ded01070 None None] Registered counter for database keystone Aug 28 18:02:31.440429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG oslo_db.sqlalchemy.engines [None req-545a695d-31b2-49c4-9d5f-12e0ded01070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 18:02:31.451022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writer thread running {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 18:02:31.571213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a695d-31b2-49c4-9d5f-12e0ded01070 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:31.575500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2148d-a858-4c0f-a086-5aaa6e49e636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:31.576142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2148d-a858-4c0f-a086-5aaa6e49e636 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:31.576487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2148d-a858-4c0f-a086-5aaa6e49e636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:31.576756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2148d-a858-4c0f-a086-5aaa6e49e636 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:31.585883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2148d-a858-4c0f-a086-5aaa6e49e636 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:31.637522 n-d-850468-20 devstack@keystone.service[82160]: WARNING keystone.common.rbac_enforcer.enforcer [None req-49e2148d-a858-4c0f-a086-5aaa6e49e636 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 28 18:02:31.637754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2148d-a858-4c0f-a086-5aaa6e49e636 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:31.648582 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Sun Aug 28 18:02:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:02:31.655055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1881908-b029-4dde-bfd4-3f1a8165fe89 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:31.669803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1881908-b029-4dde-bfd4-3f1a8165fe89 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:31.675303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8194234-2dcb-4e68-8e34-e7dbd5ccc32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:31.676458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8194234-2dcb-4e68-8e34-e7dbd5ccc32e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:31.676736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8194234-2dcb-4e68-8e34-e7dbd5ccc32e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:31.677004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8194234-2dcb-4e68-8e34-e7dbd5ccc32e admin admin] PATH_INFO: `/v3/projects/2e232b8348b844fbb8b30d77b02f1872` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:31.678630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8194234-2dcb-4e68-8e34-e7dbd5ccc32e admin admin] RBAC: Authorizing `identity:get_project(project_id=2e232b8348b844fbb8b30d77b02f1872)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:31.731234 n-d-850468-20 devstack@keystone.service[82161]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d8194234-2dcb-4e68-8e34-e7dbd5ccc32e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 28 18:02:31.731607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8194234-2dcb-4e68-8e34-e7dbd5ccc32e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:31.736522 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Sun Aug 28 18:02:31 2022] GET /identity/v3/projects/2e232b8348b844fbb8b30d77b02f1872 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:02:33.612660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f06bf-a302-45cd-a27b-b051fd78b2fa None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:33.613551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f06bf-a302-45cd-a27b-b051fd78b2fa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:33.613551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f06bf-a302-45cd-a27b-b051fd78b2fa None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:33.620626 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:33 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:33.630483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589484-b914-41f8-9c4e-fdccbbac9fae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:33.631284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589484-b914-41f8-9c4e-fdccbbac9fae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:33.631461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589484-b914-41f8-9c4e-fdccbbac9fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:33.656912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1c589484-b914-41f8-9c4e-fdccbbac9fae None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:33.658440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c589484-b914-41f8-9c4e-fdccbbac9fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:33.668005 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 28 18:02:33.934018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f06bf-a302-45cd-a27b-b051fd78b2fa None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:33.947772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f06bf-a302-45cd-a27b-b051fd78b2fa None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:33.952877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e223a30-1845-4098-8aed-6d401596f99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:33.953497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e223a30-1845-4098-8aed-6d401596f99c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:33.953784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e223a30-1845-4098-8aed-6d401596f99c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:33.954041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e223a30-1845-4098-8aed-6d401596f99c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:33.962264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e223a30-1845-4098-8aed-6d401596f99c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:33.964166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e223a30-1845-4098-8aed-6d401596f99c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:33.973206 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Sun Aug 28 18:02:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:02:33.979215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c589484-b914-41f8-9c4e-fdccbbac9fae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:33.989090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c589484-b914-41f8-9c4e-fdccbbac9fae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:33.994845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4076f-06ca-455d-915f-572adfc5f611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:33.995530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4076f-06ca-455d-915f-572adfc5f611 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:33.995795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4076f-06ca-455d-915f-572adfc5f611 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:33.996074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4076f-06ca-455d-915f-572adfc5f611 admin admin] PATH_INFO: `/v3/users/14ad14eb111e4774a71609d695e07661` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:33.997528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4076f-06ca-455d-915f-572adfc5f611 admin admin] RBAC: Authorizing `identity:get_user(user_id=14ad14eb111e4774a71609d695e07661)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:33.999758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4076f-06ca-455d-915f-572adfc5f611 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:34.001369 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Sun Aug 28 18:02:33 2022] GET /identity/v3/users/14ad14eb111e4774a71609d695e07661 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:35.978878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbcbb4-38ee-4ff5-8257-d4f564cb47e4 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:35.979479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbcbb4-38ee-4ff5-8257-d4f564cb47e4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:35.979479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbcbb4-38ee-4ff5-8257-d4f564cb47e4 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:35.980812 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:35.986260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4462b-b638-406c-8a86-6d2e711b9c98 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:35.986708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4462b-b638-406c-8a86-6d2e711b9c98 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:35.986895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4462b-b638-406c-8a86-6d2e711b9c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:36.006620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8ff4462b-b638-406c-8a86-6d2e711b9c98 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:36.008024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ff4462b-b638-406c-8a86-6d2e711b9c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:36.022912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ea3c4-4ea1-46be-9429-4eab4210a161 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:36.023196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ea3c4-4ea1-46be-9429-4eab4210a161 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:36.023507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ea3c4-4ea1-46be-9429-4eab4210a161 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:36.024853 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:02:36.030460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7781f-05a3-4299-ab8a-c070a50d4dee None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:36.030747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7781f-05a3-4299-ab8a-c070a50d4dee None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:36.031022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7781f-05a3-4299-ab8a-c070a50d4dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:36.074241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG passlib.handlers.bcrypt [None req-48a7781f-05a3-4299-ab8a-c070a50d4dee None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=82160) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 28 18:02:36.074656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG passlib.handlers.bcrypt [None req-48a7781f-05a3-4299-ab8a-c070a50d4dee None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82160) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 28 18:02:36.093050 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:02:36.122807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-48a7781f-05a3-4299-ab8a-c070a50d4dee None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:36.124581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-48a7781f-05a3-4299-ab8a-c070a50d4dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:36.237479 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:02:36.356800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4462b-b638-406c-8a86-6d2e711b9c98 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:36.382655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:36.467245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4462b-b638-406c-8a86-6d2e711b9c98 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:36.502571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d1c6b-7b7f-4594-9292-2dbe96b38f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:36.503135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d1c6b-7b7f-4594-9292-2dbe96b38f04 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:36.503448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d1c6b-7b7f-4594-9292-2dbe96b38f04 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:36.503602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7781f-05a3-4299-ab8a-c070a50d4dee None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:36.503733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d1c6b-7b7f-4594-9292-2dbe96b38f04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:36.515554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d1c6b-7b7f-4594-9292-2dbe96b38f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:02:36.524792 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a45d1c6b-7b7f-4594-9292-2dbe96b38f04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:02:36.524792 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:02:36.524792 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:02:36.524792 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:02:36.524792 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:02:36.524792 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:02:36.524792 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:02:36.524792 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:02:36.524792 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:02:36.524792 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:02:36.524792 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:02:36.524792 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:02:36.524792 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:02:36.524792 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:02:36.524792 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:02:36.524792 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:02:36.525743 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:02:36.525743 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:02:36.525743 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:02:36.525743 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:02:36.525743 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:02:36.525743 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:02:36.525743 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:02:36.525743 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:02:36.525743 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:02:36.525743 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:02:36.525743 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:02:36.525743 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:02:36.525743 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:02:36.525743 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:02:36.525743 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:02:36.525743 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:02:36.526735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:02:36.526735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:02:36.526735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:02:36.526735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:02:36.526735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:02:36.526735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:02:36.526735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:02:36.526735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:02:36.526735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:02:36.526735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:02:36.526735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:02:36.526735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:02:36.526735 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:02:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:02:36.531849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d1c6b-7b7f-4594-9292-2dbe96b38f04 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:36.618518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7781f-05a3-4299-ab8a-c070a50d4dee None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:36.620970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:36.621403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:36.642325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d1c6b-7b7f-4594-9292-2dbe96b38f04 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:36.659661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b790ebe-0d8b-4b52-830c-b54d9fee8c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:36.660787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b790ebe-0d8b-4b52-830c-b54d9fee8c5e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:36.661067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b790ebe-0d8b-4b52-830c-b54d9fee8c5e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:36.661379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b790ebe-0d8b-4b52-830c-b54d9fee8c5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:36.689748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187595e-3088-4d9e-937a-2f7881ed4789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:36.690361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187595e-3088-4d9e-937a-2f7881ed4789 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:36.690637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187595e-3088-4d9e-937a-2f7881ed4789 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:36.690907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187595e-3088-4d9e-937a-2f7881ed4789 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:36.691613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187595e-3088-4d9e-937a-2f7881ed4789 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:36.691912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187595e-3088-4d9e-937a-2f7881ed4789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:36.693325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187595e-3088-4d9e-937a-2f7881ed4789 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:36.706364 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:02:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:02:36.712161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187595e-3088-4d9e-937a-2f7881ed4789 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:36.734123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b790ebe-0d8b-4b52-830c-b54d9fee8c5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:36.735759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b790ebe-0d8b-4b52-830c-b54d9fee8c5e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:36.829351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187595e-3088-4d9e-937a-2f7881ed4789 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:36.849224 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:02:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:02:36.855148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b790ebe-0d8b-4b52-830c-b54d9fee8c5e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:36.858070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:36.869966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d00abc-75a5-4fa1-a1b4-bb6546b9ea06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:36.870611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d00abc-75a5-4fa1-a1b4-bb6546b9ea06 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:36.870890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d00abc-75a5-4fa1-a1b4-bb6546b9ea06 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:36.871170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d00abc-75a5-4fa1-a1b4-bb6546b9ea06 None admin] PATH_INFO: `/v3/users/14ad14eb111e4774a71609d695e07661` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:36.872373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d00abc-75a5-4fa1-a1b4-bb6546b9ea06 None admin] RBAC: Authorizing `identity:get_user(user_id=14ad14eb111e4774a71609d695e07661)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:36.873936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d00abc-75a5-4fa1-a1b4-bb6546b9ea06 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:36.875570 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:02:36 2022] GET /identity/v3/users/14ad14eb111e4774a71609d695e07661 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:02:36.881443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d00abc-75a5-4fa1-a1b4-bb6546b9ea06 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:36.897659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:36.959853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b790ebe-0d8b-4b52-830c-b54d9fee8c5e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:36.992245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d00abc-75a5-4fa1-a1b4-bb6546b9ea06 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:37.003234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64b89d-8ba0-4be9-8f38-e62f2144d64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:37.004093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64b89d-8ba0-4be9-8f38-e62f2144d64e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:37.004288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64b89d-8ba0-4be9-8f38-e62f2144d64e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:37.004689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64b89d-8ba0-4be9-8f38-e62f2144d64e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:37.030512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8439b-1ee6-4230-8260-435be9590f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:37.031887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8439b-1ee6-4230-8260-435be9590f55 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:37.032195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8439b-1ee6-4230-8260-435be9590f55 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:37.032563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8439b-1ee6-4230-8260-435be9590f55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:37.033868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8439b-1ee6-4230-8260-435be9590f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:37.034659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64b89d-8ba0-4be9-8f38-e62f2144d64e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:37.035390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8439b-1ee6-4230-8260-435be9590f55 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:37.037052 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:02:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:02:37.037248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64b89d-8ba0-4be9-8f38-e62f2144d64e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:37.046353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8439b-1ee6-4230-8260-435be9590f55 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:37.061837 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-5e64b89d-8ba0-4be9-8f38-e62f2144d64e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:02:37.061837 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:02:37.061837 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:02:37.061837 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:02:37.061837 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:02:37.061837 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:02:37.061837 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:02:37.061837 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:02:37.061837 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:02:37.061837 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:02:37.061837 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:02:37.061837 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:02:37.061837 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:02:37.061837 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:02:37.061837 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:02:37.061837 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:02:37.063022 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:02:37.063022 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:02:37.063022 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:02:37.063022 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:02:37.063022 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:02:37.063022 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:02:37.063022 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:02:37.063022 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:02:37.063022 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:02:37.063022 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:02:37.063022 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:02:37.063022 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:02:37.063022 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:02:37.063022 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:02:37.063022 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:02:37.063022 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:02:37.063022 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:02:37.063986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:02:37.063986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:02:37.063986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:02:37.063986 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:02:37.069085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64b89d-8ba0-4be9-8f38-e62f2144d64e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:37.138084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:37.160498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:37.188380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8439b-1ee6-4230-8260-435be9590f55 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:37.206103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64b89d-8ba0-4be9-8f38-e62f2144d64e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:37.223211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f536d-c28d-433e-bb03-05c669665a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:37.223851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f536d-c28d-433e-bb03-05c669665a3d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:37.224127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f536d-c28d-433e-bb03-05c669665a3d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:37.224400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f536d-c28d-433e-bb03-05c669665a3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:37.225166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f536d-c28d-433e-bb03-05c669665a3d None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.domain.id=default, user.id=14ad14eb111e4774a71609d695e07661) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:37.225470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f536d-c28d-433e-bb03-05c669665a3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:37.226917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f536d-c28d-433e-bb03-05c669665a3d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:37.236800 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Sun Aug 28 18:02:37 2022] GET /identity/v3/role_assignments?user.id=14ad14eb111e4774a71609d695e07661&scope.domain.id=default&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 233 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:02:37.246168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fe083-5b72-472c-888a-f74f5e7f25bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:37.246801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fe083-5b72-472c-888a-f74f5e7f25bb None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:37.247080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fe083-5b72-472c-888a-f74f5e7f25bb None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:37.247382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fe083-5b72-472c-888a-f74f5e7f25bb None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:37.248060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fe083-5b72-472c-888a-f74f5e7f25bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:37.248441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fe083-5b72-472c-888a-f74f5e7f25bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:37.249843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fe083-5b72-472c-888a-f74f5e7f25bb None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:37.273830 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:39.452667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9338519-f6c5-42ce-9b3a-536c49f80e55 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:39.453684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9338519-f6c5-42ce-9b3a-536c49f80e55 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:39.454154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9338519-f6c5-42ce-9b3a-536c49f80e55 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:39.455710 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:39.476929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21a769-794b-48dc-8247-053235e12916 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:39.477846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21a769-794b-48dc-8247-053235e12916 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:39.478323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21a769-794b-48dc-8247-053235e12916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:39.508829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0c21a769-794b-48dc-8247-053235e12916 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:39.510674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0c21a769-794b-48dc-8247-053235e12916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:39.630244 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 11/23] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:02:39.680540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ddaa-9981-45ca-b93a-ea422e88eed0 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:39.681272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ddaa-9981-45ca-b93a-ea422e88eed0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:39.681796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ddaa-9981-45ca-b93a-ea422e88eed0 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:39.683709 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:39.689856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242d488-caa2-4c41-9962-b9055a985bc6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:39.690181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242d488-caa2-4c41-9962-b9055a985bc6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:39.690450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242d488-caa2-4c41-9962-b9055a985bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:39.721896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9242d488-caa2-4c41-9962-b9055a985bc6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:39.723118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9242d488-caa2-4c41-9962-b9055a985bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:39.733432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b12146-ca88-4a40-9e4b-442796c9d5f9 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:39.734142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b12146-ca88-4a40-9e4b-442796c9d5f9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:39.734627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b12146-ca88-4a40-9e4b-442796c9d5f9 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:39.736318 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 14/25] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:39.754620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45042042-cc65-4ef4-9199-03f788a5a209 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:39.755527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45042042-cc65-4ef4-9199-03f788a5a209 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:39.756033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45042042-cc65-4ef4-9199-03f788a5a209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:39.788385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:39.812343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-45042042-cc65-4ef4-9199-03f788a5a209 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:39.813897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-45042042-cc65-4ef4-9199-03f788a5a209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:39.823341 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 12/26] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:02:39.941908 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 15/27] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 28 18:02:40.136502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242d488-caa2-4c41-9962-b9055a985bc6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:40.282513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242d488-caa2-4c41-9962-b9055a985bc6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:40.324177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcff70-08ff-4e10-a40f-741f3ccf4bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:40.324826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcff70-08ff-4e10-a40f-741f3ccf4bf9 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:40.325106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcff70-08ff-4e10-a40f-741f3ccf4bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:40.325376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcff70-08ff-4e10-a40f-741f3ccf4bf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:40.342993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcff70-08ff-4e10-a40f-741f3ccf4bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:02:40.348748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45042042-cc65-4ef4-9199-03f788a5a209 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:40.349817 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-5bdcff70-08ff-4e10-a40f-741f3ccf4bf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:02:40.349817 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:02:40.349817 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:02:40.349817 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:02:40.349817 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:02:40.349817 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:02:40.349817 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:02:40.349817 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:02:40.349817 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:02:40.349817 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:02:40.349817 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:02:40.349817 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:02:40.349817 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:02:40.349817 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:02:40.349817 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:02:40.349817 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:02:40.350623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:02:40.350623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:02:40.350623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:02:40.350623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:02:40.350623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:02:40.350623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:02:40.350623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:02:40.350623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:02:40.350623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:02:40.350623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:02:40.350623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:02:40.350623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:02:40.350623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:02:40.350623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:02:40.350623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:02:40.350623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:02:40.351412 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:02:40.351412 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:02:40.351412 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:02:40.351412 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:02:40.351412 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:02:40.351412 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:02:40.351412 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:02:40.351412 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:02:40.351412 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:02:40.351412 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:02:40.351412 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:02:40.351412 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:02:40.351412 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 13/28] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:02:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:02:40.362937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcff70-08ff-4e10-a40f-741f3ccf4bf9 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:40.419739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:40.500727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcff70-08ff-4e10-a40f-741f3ccf4bf9 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:40.505590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:40.549502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45042042-cc65-4ef4-9199-03f788a5a209 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:40.586114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989cad5-13be-4904-b270-cd5ddb50d918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:40.587308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989cad5-13be-4904-b270-cd5ddb50d918 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:40.587977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989cad5-13be-4904-b270-cd5ddb50d918 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:40.588976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989cad5-13be-4904-b270-cd5ddb50d918 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:40.590278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989cad5-13be-4904-b270-cd5ddb50d918 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:40.591028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989cad5-13be-4904-b270-cd5ddb50d918 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:40.593226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989cad5-13be-4904-b270-cd5ddb50d918 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:40.594175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d3253-b9ab-432b-be44-5fb6acc46654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:40.594867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d3253-b9ab-432b-be44-5fb6acc46654 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:40.595213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d3253-b9ab-432b-be44-5fb6acc46654 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:40.595592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d3253-b9ab-432b-be44-5fb6acc46654 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:40.596552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d3253-b9ab-432b-be44-5fb6acc46654 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:40.598035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d3253-b9ab-432b-be44-5fb6acc46654 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:40.611697 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 14/29] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:02:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:40.613207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989cad5-13be-4904-b270-cd5ddb50d918 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:40.761282 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 16/30] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Aug 28 18:02:40 2022] POST /identity/v3/roles => generated 219 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:02:40.763368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7145f62-7ef7-434a-8865-94c59c4ab2f3 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:40.763927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7145f62-7ef7-434a-8865-94c59c4ab2f3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:40.764499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7145f62-7ef7-434a-8865-94c59c4ab2f3 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:40.766314 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 17/31] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:40.767514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7145f62-7ef7-434a-8865-94c59c4ab2f3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:40.772631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:40.781284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989cad5-13be-4904-b270-cd5ddb50d918 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:40.857564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32118288-7080-4950-a8ee-67dcba52afb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:40.858227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32118288-7080-4950-a8ee-67dcba52afb2 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:40.858525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32118288-7080-4950-a8ee-67dcba52afb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:40.858912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32118288-7080-4950-a8ee-67dcba52afb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:40.882126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32118288-7080-4950-a8ee-67dcba52afb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:40.883642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32118288-7080-4950-a8ee-67dcba52afb2 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:40.913672 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-32118288-7080-4950-a8ee-67dcba52afb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:02:40.913672 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:02:40.913672 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:02:40.913672 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:02:40.913672 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:02:40.913672 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:02:40.913672 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:02:40.913672 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:02:40.913672 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:02:40.913672 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:02:40.913672 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:02:40.913672 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:02:40.913672 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:02:40.913672 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:02:40.913672 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:02:40.913672 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:02:40.914597 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:02:40.914597 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:02:40.914597 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:02:40.914597 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:02:40.914597 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:02:40.914597 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:02:40.914597 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:02:40.914597 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:02:40.914597 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:02:40.914597 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:02:40.914597 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:02:40.914597 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:02:40.914597 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:02:40.914597 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:02:40.914597 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:02:40.914597 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:02:40.914597 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:02:40.915433 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:02:40.915433 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:02:40.915433 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:02:40.922690 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 15/32] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:02:40.928569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13e2e5-cd8e-490a-8486-2aa8d33319c7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:40.931139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13e2e5-cd8e-490a-8486-2aa8d33319c7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:40.932159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13e2e5-cd8e-490a-8486-2aa8d33319c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:40.979135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fb13e2e5-cd8e-490a-8486-2aa8d33319c7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:40.980387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fb13e2e5-cd8e-490a-8486-2aa8d33319c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:40.982835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7145f62-7ef7-434a-8865-94c59c4ab2f3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:41.031363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06394e7-f549-4960-b1ee-0a901a43ce2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:41.032876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06394e7-f549-4960-b1ee-0a901a43ce2d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:41.033643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06394e7-f549-4960-b1ee-0a901a43ce2d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:41.034129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06394e7-f549-4960-b1ee-0a901a43ce2d None admin] PATH_INFO: `/v3/users/14ad14eb111e4774a71609d695e07661` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:41.036277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06394e7-f549-4960-b1ee-0a901a43ce2d None admin] RBAC: Authorizing `identity:get_user(user_id=14ad14eb111e4774a71609d695e07661)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:41.038182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06394e7-f549-4960-b1ee-0a901a43ce2d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:41.040628 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 18/33] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:02:40 2022] GET /identity/v3/users/14ad14eb111e4774a71609d695e07661 => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:41.041706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06394e7-f549-4960-b1ee-0a901a43ce2d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:41.046750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:41.064329 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 16/34] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:02:41.065627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13e2e5-cd8e-490a-8486-2aa8d33319c7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:41.161828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:41.183090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13e2e5-cd8e-490a-8486-2aa8d33319c7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:41.209835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06394e7-f549-4960-b1ee-0a901a43ce2d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:41.234262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3684e2-33ec-4a14-abc4-1dcdf63c499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:41.234847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3684e2-33ec-4a14-abc4-1dcdf63c499b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:41.235123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3684e2-33ec-4a14-abc4-1dcdf63c499b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:41.235465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3684e2-33ec-4a14-abc4-1dcdf63c499b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:41.237831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3684e2-33ec-4a14-abc4-1dcdf63c499b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:41.239751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3684e2-33ec-4a14-abc4-1dcdf63c499b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:41.241801 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 17/35] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:02:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:41.244568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026c153-8211-4d41-b9d8-de9a75546efe None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:41.244870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026c153-8211-4d41-b9d8-de9a75546efe None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:41.245120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026c153-8211-4d41-b9d8-de9a75546efe None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:41.246508 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 18/36] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:41.250936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026c153-8211-4d41-b9d8-de9a75546efe None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:41.260776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb30cb-40df-4fd3-a10f-891ffc1d4bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:41.261901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb30cb-40df-4fd3-a10f-891ffc1d4bd4 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:41.262669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb30cb-40df-4fd3-a10f-891ffc1d4bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:41.263087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb30cb-40df-4fd3-a10f-891ffc1d4bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:41.263994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb30cb-40df-4fd3-a10f-891ffc1d4bd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:41.264447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb30cb-40df-4fd3-a10f-891ffc1d4bd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:41.267537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb30cb-40df-4fd3-a10f-891ffc1d4bd4 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:41.290953 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 19/37] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:41.293578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b92fa5-4953-42f3-994c-1ea4ba90d5ee None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:41.294091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b92fa5-4953-42f3-994c-1ea4ba90d5ee None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:41.294622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b92fa5-4953-42f3-994c-1ea4ba90d5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:41.322370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b0b92fa5-4953-42f3-994c-1ea4ba90d5ee None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:41.331077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0b92fa5-4953-42f3-994c-1ea4ba90d5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:41.413513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026c153-8211-4d41-b9d8-de9a75546efe None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:41.422100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:41.441724 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 20/38] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:02:41.448419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b92fa5-4953-42f3-994c-1ea4ba90d5ee None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:41.469457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c5391-a213-4849-beeb-e07c69c9b7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:41.470865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c5391-a213-4849-beeb-e07c69c9b7bf None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:41.471514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c5391-a213-4849-beeb-e07c69c9b7bf None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:41.472108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c5391-a213-4849-beeb-e07c69c9b7bf None admin] PATH_INFO: `/v3/domains/default/users/14ad14eb111e4774a71609d695e07661/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:41.476600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c5391-a213-4849-beeb-e07c69c9b7bf None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=14ad14eb111e4774a71609d695e07661, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:41.480151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c5391-a213-4849-beeb-e07c69c9b7bf None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:41.617865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b92fa5-4953-42f3-994c-1ea4ba90d5ee None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:41.656823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509226fd-1949-4260-8626-279f3af9bc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:41.657450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509226fd-1949-4260-8626-279f3af9bc66 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:41.657732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509226fd-1949-4260-8626-279f3af9bc66 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:41.658008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509226fd-1949-4260-8626-279f3af9bc66 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:41.658675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509226fd-1949-4260-8626-279f3af9bc66 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:41.660183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509226fd-1949-4260-8626-279f3af9bc66 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:41.675309 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 19/39] 10.222.0.27 () {58 vars in 1361 bytes} [Sun Aug 28 18:02:41 2022] PUT /identity/v3/domains/default/users/14ad14eb111e4774a71609d695e07661/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:02:41.675309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c5391-a213-4849-beeb-e07c69c9b7bf None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:41.688306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:41.712619 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 18:02:41 2022] POST /identity/v3/projects => generated 301 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:02:41.714299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea50e1-9e62-42b7-b493-819eb3cc6ef3 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:41.715647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea50e1-9e62-42b7-b493-819eb3cc6ef3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:41.716012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea50e1-9e62-42b7-b493-819eb3cc6ef3 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:41.717997 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 22/41] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:41.724193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516503a2-450a-4bc4-934b-6c96c6eee357 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:41.724705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516503a2-450a-4bc4-934b-6c96c6eee357 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:41.725059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516503a2-450a-4bc4-934b-6c96c6eee357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:41.863997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c5391-a213-4849-beeb-e07c69c9b7bf None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:41.901767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-516503a2-450a-4bc4-934b-6c96c6eee357 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:41.904854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-516503a2-450a-4bc4-934b-6c96c6eee357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:41.913936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06889e-6e88-4a0e-9e51-d15e22a93fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:41.914576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06889e-6e88-4a0e-9e51-d15e22a93fdd None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:41.914850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06889e-6e88-4a0e-9e51-d15e22a93fdd None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:41.915122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06889e-6e88-4a0e-9e51-d15e22a93fdd None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:41.915906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06889e-6e88-4a0e-9e51-d15e22a93fdd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:41.917454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06889e-6e88-4a0e-9e51-d15e22a93fdd None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:41.942275 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 20/42] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Aug 28 18:02:41 2022] POST /identity/v3/roles => generated 225 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:02:41.942880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06889e-6e88-4a0e-9e51-d15e22a93fdd None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:41.975147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:42.024025 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 23/43] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:02:42.041641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:42.086112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06889e-6e88-4a0e-9e51-d15e22a93fdd None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:42.126780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3594ed4-6da2-4e3c-b8d5-11e06819163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:42.127359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3594ed4-6da2-4e3c-b8d5-11e06819163e None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:42.127645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3594ed4-6da2-4e3c-b8d5-11e06819163e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:42.127919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3594ed4-6da2-4e3c-b8d5-11e06819163e None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:42.128601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3594ed4-6da2-4e3c-b8d5-11e06819163e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:42.130015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3594ed4-6da2-4e3c-b8d5-11e06819163e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:42.151445 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 21/44] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Aug 28 18:02:41 2022] POST /identity/v3/roles => generated 223 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:02:42.325445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516503a2-450a-4bc4-934b-6c96c6eee357 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:42.459823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516503a2-450a-4bc4-934b-6c96c6eee357 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:42.500146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5ca37-6904-42bc-99bb-86bdae6abb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:42.500816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ca37-6904-42bc-99bb-86bdae6abb59 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:42.501089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ca37-6904-42bc-99bb-86bdae6abb59 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:42.501380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ca37-6904-42bc-99bb-86bdae6abb59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:42.502535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5ca37-6904-42bc-99bb-86bdae6abb59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:42.504048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5ca37-6904-42bc-99bb-86bdae6abb59 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:42.505690 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 24/45] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:02:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:42.512025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3594ed4-6da2-4e3c-b8d5-11e06819163e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:42.632051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3594ed4-6da2-4e3c-b8d5-11e06819163e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:42.662289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:42.672065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09711cae-9133-46ec-b43d-8dbc1e138de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:42.672691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09711cae-9133-46ec-b43d-8dbc1e138de4 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:42.672974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09711cae-9133-46ec-b43d-8dbc1e138de4 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:42.673247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09711cae-9133-46ec-b43d-8dbc1e138de4 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:42.673906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09711cae-9133-46ec-b43d-8dbc1e138de4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:42.675418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09711cae-9133-46ec-b43d-8dbc1e138de4 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:42.708918 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 22/46] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 18:02:42 2022] POST /identity/v3/projects => generated 312 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:02:43.695192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7765e90-0437-46bd-ac1b-a9b95f8cb1c0 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:43.695750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7765e90-0437-46bd-ac1b-a9b95f8cb1c0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:43.695750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7765e90-0437-46bd-ac1b-a9b95f8cb1c0 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:43.697120 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 25/47] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:43.702920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699c20d-dfc9-45cd-b974-d7bf02c39e86 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:43.703904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699c20d-dfc9-45cd-b974-d7bf02c39e86 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:43.703904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699c20d-dfc9-45cd-b974-d7bf02c39e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:43.722873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c699c20d-dfc9-45cd-b974-d7bf02c39e86 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:43.724450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c699c20d-dfc9-45cd-b974-d7bf02c39e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:43.794366 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 23/48] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:02:44.068686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7765e90-0437-46bd-ac1b-a9b95f8cb1c0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:44.119066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:44.181745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7765e90-0437-46bd-ac1b-a9b95f8cb1c0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:44.217598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fce703-f143-4a48-b615-904bf3acde43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:44.218236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fce703-f143-4a48-b615-904bf3acde43 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:44.218509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fce703-f143-4a48-b615-904bf3acde43 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:44.218780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fce703-f143-4a48-b615-904bf3acde43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:44.229086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fce703-f143-4a48-b615-904bf3acde43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:02:44.234088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e7fce703-f143-4a48-b615-904bf3acde43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:02:44.234088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:02:44.234088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:02:44.234088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:02:44.234088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:02:44.234088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:02:44.234088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:02:44.234088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:02:44.234088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:02:44.234088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:02:44.234088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:02:44.234088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:02:44.234088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:02:44.234088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:02:44.234088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:02:44.234088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:02:44.234995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:02:44.234995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:02:44.234995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:02:44.234995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:02:44.234995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:02:44.234995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:02:44.234995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:02:44.234995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:02:44.234995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:02:44.234995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:02:44.234995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:02:44.234995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:02:44.234995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:02:44.234995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:02:44.234995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:02:44.234995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:02:44.235850 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:02:44.235850 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:02:44.235850 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:02:44.235850 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:02:44.235850 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:02:44.235850 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:02:44.235850 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:02:44.235850 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:02:44.235850 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:02:44.235850 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:02:44.235850 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:02:44.235850 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:02:44.235850 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 26/49] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:02:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:02:44.241253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699c20d-dfc9-45cd-b974-d7bf02c39e86 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:44.340859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699c20d-dfc9-45cd-b974-d7bf02c39e86 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:44.353210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:44.378850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358f273-322d-43a3-8434-7c199afc8050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:44.379497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358f273-322d-43a3-8434-7c199afc8050 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:44.379776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358f273-322d-43a3-8434-7c199afc8050 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:44.380046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358f273-322d-43a3-8434-7c199afc8050 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:44.380722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358f273-322d-43a3-8434-7c199afc8050 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:44.381022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358f273-322d-43a3-8434-7c199afc8050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:44.382410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358f273-322d-43a3-8434-7c199afc8050 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:44.391159 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 24/50] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:02:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:44.397371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fce703-f143-4a48-b615-904bf3acde43 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:44.498862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fce703-f143-4a48-b615-904bf3acde43 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:44.500477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:44.534437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45eb4a0-a2d6-4c70-811e-42f13f350b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:44.535070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eb4a0-a2d6-4c70-811e-42f13f350b57 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:44.535383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eb4a0-a2d6-4c70-811e-42f13f350b57 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:44.535661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eb4a0-a2d6-4c70-811e-42f13f350b57 None admin] PATH_INFO: `/v3/users/14ad14eb111e4774a71609d695e07661` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:44.536819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45eb4a0-a2d6-4c70-811e-42f13f350b57 None admin] RBAC: Authorizing `identity:get_user(user_id=14ad14eb111e4774a71609d695e07661)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:44.538275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45eb4a0-a2d6-4c70-811e-42f13f350b57 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:44.539890 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 27/51] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:02:44 2022] GET /identity/v3/users/14ad14eb111e4774a71609d695e07661 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:44.545602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358f273-322d-43a3-8434-7c199afc8050 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:44.633881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8225b2-f656-4139-b9f2-0e5e0289a578 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:44.634204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8225b2-f656-4139-b9f2-0e5e0289a578 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:44.634494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8225b2-f656-4139-b9f2-0e5e0289a578 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:44.636207 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 28/52] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:44.641246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed4e62-0722-4f3c-84d9-3ca48548d4b6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:44.641596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed4e62-0722-4f3c-84d9-3ca48548d4b6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:44.641826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed4e62-0722-4f3c-84d9-3ca48548d4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:44.651729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358f273-322d-43a3-8434-7c199afc8050 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:44.660249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8fed4e62-0722-4f3c-84d9-3ca48548d4b6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:44.661451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8fed4e62-0722-4f3c-84d9-3ca48548d4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:44.686620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b9181-8ffd-45e1-9375-4c91e242c8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:44.687336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b9181-8ffd-45e1-9375-4c91e242c8c1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:44.687748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b9181-8ffd-45e1-9375-4c91e242c8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:44.688077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b9181-8ffd-45e1-9375-4c91e242c8c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:44.689663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b9181-8ffd-45e1-9375-4c91e242c8c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:44.691698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b9181-8ffd-45e1-9375-4c91e242c8c1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:44.694100 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 25/53] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:02:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:02:44.702601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b9181-8ffd-45e1-9375-4c91e242c8c1 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:44.741966 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 29/54] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:02:44.748172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:44.807976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b9181-8ffd-45e1-9375-4c91e242c8c1 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:44.842209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbdbdd-1481-478f-a234-6f43bd877ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:44.842810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbdbdd-1481-478f-a234-6f43bd877ede None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:44.843092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbdbdd-1481-478f-a234-6f43bd877ede None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:44.843408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbdbdd-1481-478f-a234-6f43bd877ede None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:44.844135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbdbdd-1481-478f-a234-6f43bd877ede None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.domain.id=default, user.id=14ad14eb111e4774a71609d695e07661) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:44.844444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbdbdd-1481-478f-a234-6f43bd877ede None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:44.847070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbdbdd-1481-478f-a234-6f43bd877ede None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:44.855275 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 26/55] 10.222.0.27 () {56 vars in 1322 bytes} [Sun Aug 28 18:02:44 2022] GET /identity/v3/role_assignments?user.id=14ad14eb111e4774a71609d695e07661&scope.domain.id=default&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:02:45.009486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed4e62-0722-4f3c-84d9-3ca48548d4b6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:45.112917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:45.115973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed4e62-0722-4f3c-84d9-3ca48548d4b6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:45.154059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e9a7d-43d5-4efa-be13-09a73efc1469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:45.154806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e9a7d-43d5-4efa-be13-09a73efc1469 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:45.155119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e9a7d-43d5-4efa-be13-09a73efc1469 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:45.155476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e9a7d-43d5-4efa-be13-09a73efc1469 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:45.156654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e9a7d-43d5-4efa-be13-09a73efc1469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:45.158111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e9a7d-43d5-4efa-be13-09a73efc1469 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:45.159724 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 30/56] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:02:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:45.166187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbdbdd-1481-478f-a234-6f43bd877ede None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:45.287696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbdbdd-1481-478f-a234-6f43bd877ede None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:45.290067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:45.327930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ce321-ac37-4ad1-a74d-5d08716f57ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:45.328550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ce321-ac37-4ad1-a74d-5d08716f57ca None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:45.328834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ce321-ac37-4ad1-a74d-5d08716f57ca None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:45.329118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ce321-ac37-4ad1-a74d-5d08716f57ca None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:45.329973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ce321-ac37-4ad1-a74d-5d08716f57ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:45.331480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ce321-ac37-4ad1-a74d-5d08716f57ca None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:45.362618 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 27/57] 10.222.0.27 () {60 vars in 1140 bytes} [Sun Aug 28 18:02:45 2022] POST /identity/v3/projects => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:02:47.294529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d80b15-bec4-45d5-a27c-387a54c38206 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:47.295222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d80b15-bec4-45d5-a27c-387a54c38206 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:47.295377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d80b15-bec4-45d5-a27c-387a54c38206 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:47.296889 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 31/58] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:02:47.302592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2de0bc-07f0-4142-a3de-b1b45f5de56b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:47.303001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2de0bc-07f0-4142-a3de-b1b45f5de56b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:47.303172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2de0bc-07f0-4142-a3de-b1b45f5de56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:47.322850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fc2de0bc-07f0-4142-a3de-b1b45f5de56b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:47.324160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fc2de0bc-07f0-4142-a3de-b1b45f5de56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:47.395273 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 28/59] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:02:47.670027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d80b15-bec4-45d5-a27c-387a54c38206 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:47.784193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d80b15-bec4-45d5-a27c-387a54c38206 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:47.825812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f51c70-5275-4092-ae3f-47f2b4b3a12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:47.826565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f51c70-5275-4092-ae3f-47f2b4b3a12f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:47.826869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f51c70-5275-4092-ae3f-47f2b4b3a12f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:47.827141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f51c70-5275-4092-ae3f-47f2b4b3a12f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:47.828396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f51c70-5275-4092-ae3f-47f2b4b3a12f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:47.829848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f51c70-5275-4092-ae3f-47f2b4b3a12f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:47.831462 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 32/60] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:02:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:47.837388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2de0bc-07f0-4142-a3de-b1b45f5de56b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:47.938013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:47.960436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2de0bc-07f0-4142-a3de-b1b45f5de56b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:48.001533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3c131-ab8d-4c04-b2e0-858fae5dd0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:48.002143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3c131-ab8d-4c04-b2e0-858fae5dd0db None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:48.002419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3c131-ab8d-4c04-b2e0-858fae5dd0db None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:48.002689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3c131-ab8d-4c04-b2e0-858fae5dd0db None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:48.003368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3c131-ab8d-4c04-b2e0-858fae5dd0db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:48.004817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3c131-ab8d-4c04-b2e0-858fae5dd0db None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:48.034665 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 29/61] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:02:47 2022] POST /identity/v3/users => generated 275 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:02:51.260871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92b4f7-ee19-4962-8c52-057d9d9821c7 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:51.261912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92b4f7-ee19-4962-8c52-057d9d9821c7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:51.262395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92b4f7-ee19-4962-8c52-057d9d9821c7 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:51.264105 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 33/62] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:51.268449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86e0c5-1047-496f-ab95-11161dea4eb8 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:51.269267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90619f3e-51df-4f32-a322-c59959e26092 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:51.269502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86e0c5-1047-496f-ab95-11161dea4eb8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:51.269612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90619f3e-51df-4f32-a322-c59959e26092 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:51.269820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90619f3e-51df-4f32-a322-c59959e26092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:51.270253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86e0c5-1047-496f-ab95-11161dea4eb8 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:51.272045 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 30/63] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:51.278043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e238ffc-db5d-4700-bc22-fafbe9f1bc4b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:51.278621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e238ffc-db5d-4700-bc22-fafbe9f1bc4b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:51.279239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e238ffc-db5d-4700-bc22-fafbe9f1bc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:51.293134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-90619f3e-51df-4f32-a322-c59959e26092 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:51.294464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-90619f3e-51df-4f32-a322-c59959e26092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:51.356688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:51.409314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9e238ffc-db5d-4700-bc22-fafbe9f1bc4b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:51.410847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9e238ffc-db5d-4700-bc22-fafbe9f1bc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:51.441122 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 34/64] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:02:51.443614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24502483-f774-40ed-954f-b70ab42a2c9e None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:51.444087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24502483-f774-40ed-954f-b70ab42a2c9e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:51.444539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24502483-f774-40ed-954f-b70ab42a2c9e None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:51.446302 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 35/65] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:51.456931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036512f-5dc7-4903-9212-7ab4c10fcc98 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:51.457475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036512f-5dc7-4903-9212-7ab4c10fcc98 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:51.457953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036512f-5dc7-4903-9212-7ab4c10fcc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:51.482042 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 31/66] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:02:51.496388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1036512f-5dc7-4903-9212-7ab4c10fcc98 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:51.497796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1036512f-5dc7-4903-9212-7ab4c10fcc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:51.547933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3d863-491a-403e-9e8c-f2d6b691a9e4 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:51.548525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3d863-491a-403e-9e8c-f2d6b691a9e4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:51.548991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3d863-491a-403e-9e8c-f2d6b691a9e4 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:51.550783 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 32/67] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:51.562515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b996e46-89ce-4511-b291-595dbd288bde None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:51.563053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b996e46-89ce-4511-b291-595dbd288bde None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:51.563611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b996e46-89ce-4511-b291-595dbd288bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:51.585374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7b996e46-89ce-4511-b291-595dbd288bde None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:51.586905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7b996e46-89ce-4511-b291-595dbd288bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:51.618338 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 36/68] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 28 18:02:51.620289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213bcc3-20f1-47ec-95dc-69319c80c37c None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:51.620744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213bcc3-20f1-47ec-95dc-69319c80c37c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:51.621174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213bcc3-20f1-47ec-95dc-69319c80c37c None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:51.622613 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 37/69] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:51.628262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbab9c-2120-427d-a88c-5095cd68cb2d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:51.628742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbab9c-2120-427d-a88c-5095cd68cb2d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:51.629217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbab9c-2120-427d-a88c-5095cd68cb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:51.649169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1fbbab9c-2120-427d-a88c-5095cd68cb2d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:51.650700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1fbbab9c-2120-427d-a88c-5095cd68cb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:51.722098 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 33/70] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:02:51.730274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b996e46-89ce-4511-b291-595dbd288bde None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:51.733517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:51.755451 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 38/71] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:02:51.844910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b996e46-89ce-4511-b291-595dbd288bde None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:51.879140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d07ace-b381-4525-8a05-ae2f69b543f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:51.879814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d07ace-b381-4525-8a05-ae2f69b543f1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:51.880099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d07ace-b381-4525-8a05-ae2f69b543f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:51.880382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d07ace-b381-4525-8a05-ae2f69b543f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:51.891687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d07ace-b381-4525-8a05-ae2f69b543f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:02:51.896896 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-52d07ace-b381-4525-8a05-ae2f69b543f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:02:51.896896 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:02:51.896896 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:02:51.896896 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:02:51.896896 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:02:51.896896 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:02:51.896896 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:02:51.896896 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:02:51.896896 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:02:51.896896 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:02:51.896896 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:02:51.896896 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:02:51.896896 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:02:51.896896 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:02:51.896896 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:02:51.896896 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:02:51.897719 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:02:51.897719 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:02:51.897719 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:02:51.897719 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:02:51.897719 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:02:51.897719 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:02:51.897719 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:02:51.897719 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:02:51.897719 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:02:51.897719 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:02:51.897719 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:02:51.897719 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:02:51.897719 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:02:51.897719 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:02:51.897719 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:02:51.897719 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:02:51.898457 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:02:51.898457 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:02:51.898457 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:02:51.898457 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:02:51.898457 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:02:51.898457 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:02:51.898457 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:02:51.898457 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:02:51.898457 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:02:51.898457 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:02:51.898457 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:02:51.898457 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:02:51.898457 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 34/72] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:02:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:02:51.905612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbab9c-2120-427d-a88c-5095cd68cb2d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:51.917121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d07ace-b381-4525-8a05-ae2f69b543f1 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:51.938858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:51.997897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:52.019934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbab9c-2120-427d-a88c-5095cd68cb2d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:52.041124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d07ace-b381-4525-8a05-ae2f69b543f1 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:52.056449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c064b1-7621-4f51-9d53-f5b5ab136955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:52.057450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c064b1-7621-4f51-9d53-f5b5ab136955 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:52.057741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c064b1-7621-4f51-9d53-f5b5ab136955 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:52.058024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c064b1-7621-4f51-9d53-f5b5ab136955 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:52.058702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c064b1-7621-4f51-9d53-f5b5ab136955 None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:52.059010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c064b1-7621-4f51-9d53-f5b5ab136955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:52.060612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c064b1-7621-4f51-9d53-f5b5ab136955 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:52.071151 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 39/73] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:02:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:52.075948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c064b1-7621-4f51-9d53-f5b5ab136955 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:52.080932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b21934-80d0-4406-958c-5110425a8f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:52.081584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b21934-80d0-4406-958c-5110425a8f4b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:52.081862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b21934-80d0-4406-958c-5110425a8f4b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:52.082134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b21934-80d0-4406-958c-5110425a8f4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:52.092996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b21934-80d0-4406-958c-5110425a8f4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:02:52.098283 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-f8b21934-80d0-4406-958c-5110425a8f4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:02:52.098283 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:02:52.098283 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:02:52.098283 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:02:52.098283 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:02:52.098283 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:02:52.098283 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:02:52.098283 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:02:52.098283 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:02:52.098283 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:02:52.098283 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:02:52.098283 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:02:52.098283 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:02:52.098283 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:02:52.098283 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:02:52.098283 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:02:52.099108 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:02:52.099108 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:02:52.099108 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:02:52.099108 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:02:52.099108 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:02:52.099108 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:02:52.099108 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:02:52.099108 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:02:52.099108 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:02:52.099108 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:02:52.099108 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:02:52.099108 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:02:52.099108 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:02:52.099108 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:02:52.099108 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:02:52.099108 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:02:52.099897 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:02:52.099897 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:02:52.099897 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:02:52.099897 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:02:52.099897 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:02:52.099897 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:02:52.099897 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:02:52.099897 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:02:52.099897 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:02:52.099897 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:02:52.099897 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:02:52.099897 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:02:52.099897 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 35/74] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:02:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:02:52.100511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b21934-80d0-4406-958c-5110425a8f4b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:52.172172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:52.184350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c064b1-7621-4f51-9d53-f5b5ab136955 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:52.202545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b21934-80d0-4406-958c-5110425a8f4b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:52.218673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a5530-de5f-445f-bdd1-8ca06739337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:52.219355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a5530-de5f-445f-bdd1-8ca06739337b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:52.219621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a5530-de5f-445f-bdd1-8ca06739337b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:52.219923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a5530-de5f-445f-bdd1-8ca06739337b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:52.225955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:52.230401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a5530-de5f-445f-bdd1-8ca06739337b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:02:52.235971 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b34a5530-de5f-445f-bdd1-8ca06739337b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:02:52.235971 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:02:52.235971 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:02:52.235971 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:02:52.235971 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:02:52.235971 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:02:52.235971 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:02:52.235971 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:02:52.235971 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:02:52.235971 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:02:52.235971 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:02:52.235971 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:02:52.235971 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:02:52.235971 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:02:52.235971 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:02:52.235971 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:02:52.236807 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:02:52.236807 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:02:52.236807 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:02:52.236807 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:02:52.236807 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:02:52.236807 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:02:52.236807 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:02:52.236807 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:02:52.236807 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:02:52.236807 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:02:52.236807 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:02:52.236807 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:02:52.236807 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:02:52.236807 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:02:52.236807 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:02:52.236807 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:02:52.237565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:02:52.237565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:02:52.237565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:02:52.237565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:02:52.237565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:02:52.237565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:02:52.237565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:02:52.237565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:02:52.237565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:02:52.237565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:02:52.237565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:02:52.237565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:02:52.237565 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 40/75] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:02:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:02:52.238181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a5530-de5f-445f-bdd1-8ca06739337b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:52.241433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedce50-13c3-4715-8ad5-35ad4cfac196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:52.243122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedce50-13c3-4715-8ad5-35ad4cfac196 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:52.243455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedce50-13c3-4715-8ad5-35ad4cfac196 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:52.243734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedce50-13c3-4715-8ad5-35ad4cfac196 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:52.254251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedce50-13c3-4715-8ad5-35ad4cfac196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:02:52.259575 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-9eedce50-13c3-4715-8ad5-35ad4cfac196 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:02:52.259575 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:02:52.259575 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:02:52.259575 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:02:52.259575 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:02:52.259575 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:02:52.259575 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:02:52.259575 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:02:52.259575 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:02:52.259575 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:02:52.259575 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:02:52.259575 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:02:52.259575 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:02:52.259575 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:02:52.259575 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:02:52.259575 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:02:52.260928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:02:52.260928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:02:52.260928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:02:52.260928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:02:52.260928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:02:52.260928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:02:52.260928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:02:52.260928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:02:52.260928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:02:52.260928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:02:52.260928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:02:52.260928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:02:52.260928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:02:52.260928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:02:52.260928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:02:52.260928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:02:52.261826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:02:52.261826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:02:52.261826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:02:52.261826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:02:52.261826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:02:52.261826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:02:52.261826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:02:52.261826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:02:52.261826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:02:52.261826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:02:52.261826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:02:52.261826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:02:52.261826 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 36/76] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:02:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:02:52.261826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedce50-13c3-4715-8ad5-35ad4cfac196 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:52.344966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a5530-de5f-445f-bdd1-8ca06739337b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:52.361928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedce50-13c3-4715-8ad5-35ad4cfac196 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:52.380282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087d1ad-3b4f-4f7a-917f-7946eeacd706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:52.380930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087d1ad-3b4f-4f7a-917f-7946eeacd706 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:52.381212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087d1ad-3b4f-4f7a-917f-7946eeacd706 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:52.381490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087d1ad-3b4f-4f7a-917f-7946eeacd706 None admin] PATH_INFO: `/v3/users/4190655e461b49b0932d472dd67ff9f0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:52.395165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087d1ad-3b4f-4f7a-917f-7946eeacd706 None admin] RBAC: Authorizing `identity:get_user(user_id=4190655e461b49b0932d472dd67ff9f0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:52.396711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087d1ad-3b4f-4f7a-917f-7946eeacd706 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:52.397090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61109542-3387-40a8-bfcc-5b711c7f3340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:52.397706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61109542-3387-40a8-bfcc-5b711c7f3340 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:52.397989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61109542-3387-40a8-bfcc-5b711c7f3340 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:52.398268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61109542-3387-40a8-bfcc-5b711c7f3340 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:52.398360 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 41/77] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:02:52 2022] GET /identity/v3/users/4190655e461b49b0932d472dd67ff9f0 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:52.398954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61109542-3387-40a8-bfcc-5b711c7f3340 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:52.399093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087d1ad-3b4f-4f7a-917f-7946eeacd706 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:52.399242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61109542-3387-40a8-bfcc-5b711c7f3340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:52.400676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61109542-3387-40a8-bfcc-5b711c7f3340 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:52.408933 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 37/78] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:02:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:52.409734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61109542-3387-40a8-bfcc-5b711c7f3340 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:52.412023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:52.457808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:52.506499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087d1ad-3b4f-4f7a-917f-7946eeacd706 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:52.513682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61109542-3387-40a8-bfcc-5b711c7f3340 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:52.541267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67a1bb-a49d-44df-b6be-88a33ac5809d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:52.541905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67a1bb-a49d-44df-b6be-88a33ac5809d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:52.542176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67a1bb-a49d-44df-b6be-88a33ac5809d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:52.542467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67a1bb-a49d-44df-b6be-88a33ac5809d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:52.543651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67a1bb-a49d-44df-b6be-88a33ac5809d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:52.545268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67a1bb-a49d-44df-b6be-88a33ac5809d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:52.546830 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 42/79] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:02:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:52.547621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67a1bb-a49d-44df-b6be-88a33ac5809d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:52.547882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36172a56-64fe-4df8-99af-d40e2318a853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:52.548502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36172a56-64fe-4df8-99af-d40e2318a853 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:52.548777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36172a56-64fe-4df8-99af-d40e2318a853 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:52.549049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36172a56-64fe-4df8-99af-d40e2318a853 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:52.549714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36172a56-64fe-4df8-99af-d40e2318a853 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:52.550018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36172a56-64fe-4df8-99af-d40e2318a853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:52.552336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36172a56-64fe-4df8-99af-d40e2318a853 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:52.560552 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 38/80] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:02:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:52.561403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36172a56-64fe-4df8-99af-d40e2318a853 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:52.625646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:52.650800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67a1bb-a49d-44df-b6be-88a33ac5809d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:52.665377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36172a56-64fe-4df8-99af-d40e2318a853 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:52.672330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:52.684591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501da6c-b95c-48ff-b557-5ca59a322d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:52.685214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501da6c-b95c-48ff-b557-5ca59a322d02 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:52.685610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501da6c-b95c-48ff-b557-5ca59a322d02 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:52.685887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501da6c-b95c-48ff-b557-5ca59a322d02 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:52.686563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501da6c-b95c-48ff-b557-5ca59a322d02 None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:52.686865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501da6c-b95c-48ff-b557-5ca59a322d02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:52.688303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501da6c-b95c-48ff-b557-5ca59a322d02 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:52.696522 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 43/81] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:02:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:52.697308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501da6c-b95c-48ff-b557-5ca59a322d02 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:52.704283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a5010-3a6d-412a-a8e9-8972f30b9ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:52.704913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a5010-3a6d-412a-a8e9-8972f30b9ee1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:52.705199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a5010-3a6d-412a-a8e9-8972f30b9ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:52.705479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a5010-3a6d-412a-a8e9-8972f30b9ee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:52.775323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a5010-3a6d-412a-a8e9-8972f30b9ee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:52.776812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a5010-3a6d-412a-a8e9-8972f30b9ee1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:52.800161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501da6c-b95c-48ff-b557-5ca59a322d02 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:52.835862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f22aa6-4565-4794-8d61-8f0826f58603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:52.836498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f22aa6-4565-4794-8d61-8f0826f58603 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:52.836777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f22aa6-4565-4794-8d61-8f0826f58603 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:52.837051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f22aa6-4565-4794-8d61-8f0826f58603 None admin] PATH_INFO: `/v3/users/4190655e461b49b0932d472dd67ff9f0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:52.838198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f22aa6-4565-4794-8d61-8f0826f58603 None admin] RBAC: Authorizing `identity:get_user(user_id=4190655e461b49b0932d472dd67ff9f0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:52.839686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f22aa6-4565-4794-8d61-8f0826f58603 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:52.841285 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 44/82] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:02:52 2022] GET /identity/v3/users/4190655e461b49b0932d472dd67ff9f0 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:52.842147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f22aa6-4565-4794-8d61-8f0826f58603 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:52.847236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:52.878347 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 39/83] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:02:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:02:52.878964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a5010-3a6d-412a-a8e9-8972f30b9ee1 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:52.887519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:52.951973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f22aa6-4565-4794-8d61-8f0826f58603 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:52.978977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a5010-3a6d-412a-a8e9-8972f30b9ee1 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:52.984773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd993dcc-9c09-4d71-a9ab-a876aa3a4654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:52.985399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd993dcc-9c09-4d71-a9ab-a876aa3a4654 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:52.985684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd993dcc-9c09-4d71-a9ab-a876aa3a4654 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:52.985965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd993dcc-9c09-4d71-a9ab-a876aa3a4654 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:52.986627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd993dcc-9c09-4d71-a9ab-a876aa3a4654 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:52.988123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd993dcc-9c09-4d71-a9ab-a876aa3a4654 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:53.014494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2db34-1f92-40a6-b670-0d6ce56f7d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:53.015126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2db34-1f92-40a6-b670-0d6ce56f7d4f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:53.015448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2db34-1f92-40a6-b670-0d6ce56f7d4f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:53.015575 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 45/84] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:02:52 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:02:53.015729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2db34-1f92-40a6-b670-0d6ce56f7d4f None admin] PATH_INFO: `/v3/users/14ad14eb111e4774a71609d695e07661` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:53.016829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2db34-1f92-40a6-b670-0d6ce56f7d4f None admin] RBAC: Authorizing `identity:get_user(user_id=14ad14eb111e4774a71609d695e07661)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:53.018310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2db34-1f92-40a6-b670-0d6ce56f7d4f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:53.020025 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 40/85] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:02:52 2022] GET /identity/v3/users/14ad14eb111e4774a71609d695e07661 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:53.020286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd993dcc-9c09-4d71-a9ab-a876aa3a4654 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:53.020812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2db34-1f92-40a6-b670-0d6ce56f7d4f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:53.091921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:53.107989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:53.136368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2db34-1f92-40a6-b670-0d6ce56f7d4f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:53.140889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd993dcc-9c09-4d71-a9ab-a876aa3a4654 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:53.177476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc044e2-e9a6-4c0e-bd03-4842d7b0fe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:53.178129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc044e2-e9a6-4c0e-bd03-4842d7b0fe1f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:53.178409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc044e2-e9a6-4c0e-bd03-4842d7b0fe1f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:53.178689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc044e2-e9a6-4c0e-bd03-4842d7b0fe1f None admin] PATH_INFO: `/v3/users/4190655e461b49b0932d472dd67ff9f0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:53.179729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7f0a1-4365-403d-a6e1-d96b735512a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:53.179913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc044e2-e9a6-4c0e-bd03-4842d7b0fe1f None admin] RBAC: Authorizing `identity:get_user(user_id=4190655e461b49b0932d472dd67ff9f0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:53.180210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7f0a1-4365-403d-a6e1-d96b735512a6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:53.180486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7f0a1-4365-403d-a6e1-d96b735512a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:53.180757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7f0a1-4365-403d-a6e1-d96b735512a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:53.181384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc044e2-e9a6-4c0e-bd03-4842d7b0fe1f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:53.183175 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 46/86] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:02:53 2022] GET /identity/v3/users/4190655e461b49b0932d472dd67ff9f0 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:53.184408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc044e2-e9a6-4c0e-bd03-4842d7b0fe1f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:53.264901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7f0a1-4365-403d-a6e1-d96b735512a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:53.265085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7f0a1-4365-403d-a6e1-d96b735512a6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:53.312561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc044e2-e9a6-4c0e-bd03-4842d7b0fe1f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:53.346442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:53.355855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c0e27-8848-4464-8284-54ab72de3c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:53.356500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0e27-8848-4464-8284-54ab72de3c02 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:53.356777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0e27-8848-4464-8284-54ab72de3c02 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:53.357049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0e27-8848-4464-8284-54ab72de3c02 None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:53.358208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c0e27-8848-4464-8284-54ab72de3c02 None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:53.358476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:53.359789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c0e27-8848-4464-8284-54ab72de3c02 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:53.361680 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 47/87] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:02:53 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:53.362472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c0e27-8848-4464-8284-54ab72de3c02 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:53.392026 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 41/88] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:02:53.393493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7f0a1-4365-403d-a6e1-d96b735512a6 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:53.489080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c0e27-8848-4464-8284-54ab72de3c02 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:53.508640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7f0a1-4365-403d-a6e1-d96b735512a6 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:53.526749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86d271-1567-47c9-b89f-ced800b2f88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:53.527419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86d271-1567-47c9-b89f-ced800b2f88a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:53.527705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86d271-1567-47c9-b89f-ced800b2f88a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:53.527986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86d271-1567-47c9-b89f-ced800b2f88a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:53.545639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d8475-7bc0-4029-8808-2aa1c699f21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:53.546499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d8475-7bc0-4029-8808-2aa1c699f21a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:53.546916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d8475-7bc0-4029-8808-2aa1c699f21a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:53.547349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d8475-7bc0-4029-8808-2aa1c699f21a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:53.592868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:53.599085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:53.607733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86d271-1567-47c9-b89f-ced800b2f88a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:53.609351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86d271-1567-47c9-b89f-ced800b2f88a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:53.620939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d8475-7bc0-4029-8808-2aa1c699f21a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:53.622668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d8475-7bc0-4029-8808-2aa1c699f21a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:53.722679 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 48/89] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:02:53.728058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86d271-1567-47c9-b89f-ced800b2f88a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:53.728874 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 42/90] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:02:53.730004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d8475-7bc0-4029-8808-2aa1c699f21a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:53.817107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:53.839159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:53.845122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d8475-7bc0-4029-8808-2aa1c699f21a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:53.846817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86d271-1567-47c9-b89f-ced800b2f88a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:53.882079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b796fc-5af2-4d89-a7dd-1b16a14e529e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:53.882814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b796fc-5af2-4d89-a7dd-1b16a14e529e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:53.883090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468a043-e302-4d78-bb25-18e12704c66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:53.883233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b796fc-5af2-4d89-a7dd-1b16a14e529e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:53.883564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b796fc-5af2-4d89-a7dd-1b16a14e529e None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:53.883763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468a043-e302-4d78-bb25-18e12704c66a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:53.884052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468a043-e302-4d78-bb25-18e12704c66a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:53.884438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468a043-e302-4d78-bb25-18e12704c66a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:53.885255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b796fc-5af2-4d89-a7dd-1b16a14e529e None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:53.885495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468a043-e302-4d78-bb25-18e12704c66a None admin] RBAC: Adding query filter params (role.id=dcabcc9bd3bf42149eed3abc0d4799c8, scope.project.id=1be8f0e040484baab23f1815ce704594, user.id=4190655e461b49b0932d472dd67ff9f0) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:53.885866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468a043-e302-4d78-bb25-18e12704c66a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:53.886903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b796fc-5af2-4d89-a7dd-1b16a14e529e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:53.887424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468a043-e302-4d78-bb25-18e12704c66a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:53.888958 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 43/91] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:02:53 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:53.889640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b796fc-5af2-4d89-a7dd-1b16a14e529e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:53.903571 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 49/92] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:02:53 2022] GET /identity/v3/role_assignments?user.id=4190655e461b49b0932d472dd67ff9f0&scope.project.id=1be8f0e040484baab23f1815ce704594&role.id=dcabcc9bd3bf42149eed3abc0d4799c8 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:53.904472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468a043-e302-4d78-bb25-18e12704c66a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:53.998515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b796fc-5af2-4d89-a7dd-1b16a14e529e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:54.045147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd551f89-4300-4e1a-9a24-316957d967e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:54.045780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd551f89-4300-4e1a-9a24-316957d967e5 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:54.046063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd551f89-4300-4e1a-9a24-316957d967e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:54.046339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd551f89-4300-4e1a-9a24-316957d967e5 None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:54.047668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd551f89-4300-4e1a-9a24-316957d967e5 None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:54.049147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd551f89-4300-4e1a-9a24-316957d967e5 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:54.051047 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 44/93] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:02:53 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:54.051692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd551f89-4300-4e1a-9a24-316957d967e5 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:54.082267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:54.095054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468a043-e302-4d78-bb25-18e12704c66a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:54.147950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c015a0-3096-4d42-b6ce-1ce0a447a04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:54.148983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c015a0-3096-4d42-b6ce-1ce0a447a04f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:54.149267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c015a0-3096-4d42-b6ce-1ce0a447a04f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:54.149541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c015a0-3096-4d42-b6ce-1ce0a447a04f None admin] PATH_INFO: `/v3/projects/a126df3b78f349f5a943fdf96f8da737` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:54.150671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c015a0-3096-4d42-b6ce-1ce0a447a04f None admin] RBAC: Authorizing `identity:get_project(project_id=a126df3b78f349f5a943fdf96f8da737)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:54.152185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c015a0-3096-4d42-b6ce-1ce0a447a04f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:54.154522 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 50/94] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:02:53 2022] GET /identity/v3/projects/a126df3b78f349f5a943fdf96f8da737 => generated 312 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:54.155474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c015a0-3096-4d42-b6ce-1ce0a447a04f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:54.203641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:54.269002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd551f89-4300-4e1a-9a24-316957d967e5 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:54.333617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c015a0-3096-4d42-b6ce-1ce0a447a04f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:54.338742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195c72b-df00-426f-b457-64b21d03aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:54.339410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195c72b-df00-426f-b457-64b21d03aca2 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:54.339688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195c72b-df00-426f-b457-64b21d03aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:54.339961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195c72b-df00-426f-b457-64b21d03aca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:54.340705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195c72b-df00-426f-b457-64b21d03aca2 None admin] RBAC: Adding query filter params (role.id=81040db4535e417891c10dd996b1eac5, scope.project.id=1be8f0e040484baab23f1815ce704594, user.id=4190655e461b49b0932d472dd67ff9f0) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:54.341014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195c72b-df00-426f-b457-64b21d03aca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:54.342527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195c72b-df00-426f-b457-64b21d03aca2 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:54.357050 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 45/95] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:02:54 2022] GET /identity/v3/role_assignments?user.id=4190655e461b49b0932d472dd67ff9f0&scope.project.id=1be8f0e040484baab23f1815ce704594&role.id=81040db4535e417891c10dd996b1eac5 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:54.357986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195c72b-df00-426f-b457-64b21d03aca2 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:54.409462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577d76d-eee8-4af5-931b-ed7ebb7683c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:54.411178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577d76d-eee8-4af5-931b-ed7ebb7683c7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:54.411483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577d76d-eee8-4af5-931b-ed7ebb7683c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:54.411757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577d76d-eee8-4af5-931b-ed7ebb7683c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:54.414293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577d76d-eee8-4af5-931b-ed7ebb7683c7 None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=1be8f0e040484baab23f1815ce704594, user.id=14ad14eb111e4774a71609d695e07661) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:54.414608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577d76d-eee8-4af5-931b-ed7ebb7683c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:54.417400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577d76d-eee8-4af5-931b-ed7ebb7683c7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:54.434531 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 51/96] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:02:54 2022] GET /identity/v3/role_assignments?user.id=14ad14eb111e4774a71609d695e07661&scope.project.id=1be8f0e040484baab23f1815ce704594&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:54.478464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:54.506656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195c72b-df00-426f-b457-64b21d03aca2 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:54.545567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cf5d9-e738-48e9-a85b-38d4179e7e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:54.546107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cf5d9-e738-48e9-a85b-38d4179e7e4a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:54.546432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cf5d9-e738-48e9-a85b-38d4179e7e4a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:54.546712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cf5d9-e738-48e9-a85b-38d4179e7e4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:54.547521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cf5d9-e738-48e9-a85b-38d4179e7e4a None admin] RBAC: Adding query filter params (role.id=dcabcc9bd3bf42149eed3abc0d4799c8, scope.project.id=a126df3b78f349f5a943fdf96f8da737, user.id=4190655e461b49b0932d472dd67ff9f0) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:54.547834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cf5d9-e738-48e9-a85b-38d4179e7e4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:54.549284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cf5d9-e738-48e9-a85b-38d4179e7e4a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:54.556396 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 46/97] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:02:54 2022] GET /identity/v3/role_assignments?user.id=4190655e461b49b0932d472dd67ff9f0&scope.project.id=a126df3b78f349f5a943fdf96f8da737&role.id=dcabcc9bd3bf42149eed3abc0d4799c8 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:55.597455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d5660-fe66-44b9-b35d-ccd6cd19761f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:55.598438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d5660-fe66-44b9-b35d-ccd6cd19761f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:55.598912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d5660-fe66-44b9-b35d-ccd6cd19761f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:55.600498 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 52/98] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:02:55.608576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04813b07-ca08-49d3-9f4b-574be7e863d4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:55.609459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04813b07-ca08-49d3-9f4b-574be7e863d4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:55.609949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04813b07-ca08-49d3-9f4b-574be7e863d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:55.635050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-04813b07-ca08-49d3-9f4b-574be7e863d4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:55.636614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-04813b07-ca08-49d3-9f4b-574be7e863d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:55.741537 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 47/99] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:02:55.854663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392bb22-22cc-4437-aea5-dc88e193100b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:55.855765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392bb22-22cc-4437-aea5-dc88e193100b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:55.856504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392bb22-22cc-4437-aea5-dc88e193100b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:55.859536 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 53/100] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:55.867584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a932493-b381-4f6a-91df-f3c5f8edbcdd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:55.868422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a932493-b381-4f6a-91df-f3c5f8edbcdd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:55.869185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a932493-b381-4f6a-91df-f3c5f8edbcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:55.909472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1a932493-b381-4f6a-91df-f3c5f8edbcdd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:55.911860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1a932493-b381-4f6a-91df-f3c5f8edbcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:56.057350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:56.065718 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 48/101] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:02:56.318274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392bb22-22cc-4437-aea5-dc88e193100b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:56.428308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:56.439316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392bb22-22cc-4437-aea5-dc88e193100b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:56.487788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722db79f-4258-4bbc-aa0f-46825f655b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:56.488603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722db79f-4258-4bbc-aa0f-46825f655b4a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:56.488923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a932493-b381-4f6a-91df-f3c5f8edbcdd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:56.489034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722db79f-4258-4bbc-aa0f-46825f655b4a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:56.489492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722db79f-4258-4bbc-aa0f-46825f655b4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:56.514670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722db79f-4258-4bbc-aa0f-46825f655b4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:02:56.520479 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-722db79f-4258-4bbc-aa0f-46825f655b4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:02:56.520479 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:02:56.520479 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:02:56.520479 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:02:56.520479 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:02:56.520479 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:02:56.520479 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:02:56.520479 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:02:56.520479 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:02:56.520479 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:02:56.520479 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:02:56.520479 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:02:56.520479 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:02:56.520479 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:02:56.520479 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:02:56.520479 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:02:56.522102 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:02:56.522102 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:02:56.522102 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:02:56.522102 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:02:56.522102 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:02:56.522102 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:02:56.522102 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:02:56.522102 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:02:56.522102 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:02:56.522102 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:02:56.522102 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:02:56.522102 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:02:56.522102 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:02:56.522102 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:02:56.522102 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:02:56.522102 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:02:56.523468 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:02:56.523468 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:02:56.523468 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:02:56.523468 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:02:56.523468 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:02:56.523468 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:02:56.523468 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:02:56.523468 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:02:56.523468 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:02:56.523468 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:02:56.523468 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:02:56.523468 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:02:56.523468 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 54/102] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:02:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:02:56.535611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722db79f-4258-4bbc-aa0f-46825f655b4a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:56.720613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a932493-b381-4f6a-91df-f3c5f8edbcdd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:56.759154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a706a-3b18-4799-9afc-a778e624c3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:56.760554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a706a-3b18-4799-9afc-a778e624c3b9 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:56.761134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a706a-3b18-4799-9afc-a778e624c3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:56.761598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a706a-3b18-4799-9afc-a778e624c3b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:56.762926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a706a-3b18-4799-9afc-a778e624c3b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:56.765067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a706a-3b18-4799-9afc-a778e624c3b9 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:56.767890 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 49/103] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:02:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:02:56.773691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a706a-3b18-4799-9afc-a778e624c3b9 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:56.779745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722db79f-4258-4bbc-aa0f-46825f655b4a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:56.876693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1ad93-cb7d-46ef-8451-567c01b62d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:56.877266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ad93-cb7d-46ef-8451-567c01b62d3e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:56.877545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ad93-cb7d-46ef-8451-567c01b62d3e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:56.877819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ad93-cb7d-46ef-8451-567c01b62d3e None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:56.878571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1ad93-cb7d-46ef-8451-567c01b62d3e None admin] RBAC: Adding query filter params (name=reader) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:56.878800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1ad93-cb7d-46ef-8451-567c01b62d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:56.880250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1ad93-cb7d-46ef-8451-567c01b62d3e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:56.899708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:56.913549 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 55/104] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:02:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:02:56.920420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1ad93-cb7d-46ef-8451-567c01b62d3e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:56.932969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a706a-3b18-4799-9afc-a778e624c3b9 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:56.968548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:56.980503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98914d-4646-4b29-8f72-15a7907627ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:56.981243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98914d-4646-4b29-8f72-15a7907627ad None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:56.981542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98914d-4646-4b29-8f72-15a7907627ad None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:56.981824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98914d-4646-4b29-8f72-15a7907627ad None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:56.982555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98914d-4646-4b29-8f72-15a7907627ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:56.984320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98914d-4646-4b29-8f72-15a7907627ad None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:57.023879 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 50/105] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 18:02:56 2022] POST /identity/v3/projects => generated 302 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:02:57.105384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1ad93-cb7d-46ef-8451-567c01b62d3e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:57.153741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0370134-fd5b-4eb8-8e21-a81496aa54da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:57.154355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0370134-fd5b-4eb8-8e21-a81496aa54da None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:57.154644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0370134-fd5b-4eb8-8e21-a81496aa54da None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:57.154916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0370134-fd5b-4eb8-8e21-a81496aa54da None admin] PATH_INFO: `/v3/users/35a281fffb81466f9b5284b21b6b67d3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:57.179346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0370134-fd5b-4eb8-8e21-a81496aa54da None admin] RBAC: Authorizing `identity:get_user(user_id=35a281fffb81466f9b5284b21b6b67d3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:57.180877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0370134-fd5b-4eb8-8e21-a81496aa54da None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:57.182905 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 56/106] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:02:56 2022] GET /identity/v3/users/35a281fffb81466f9b5284b21b6b67d3 => generated 289 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:57.188788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98914d-4646-4b29-8f72-15a7907627ad None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:57.283593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416604-edb3-4d86-9022-537c880bb4df None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:57.283908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416604-edb3-4d86-9022-537c880bb4df None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:57.284160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416604-edb3-4d86-9022-537c880bb4df None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:57.285662 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 57/107] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:57.294001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537558c-e40a-4a9b-9734-a4c043935637 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:57.294375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537558c-e40a-4a9b-9734-a4c043935637 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:57.294643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537558c-e40a-4a9b-9734-a4c043935637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:57.323218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3537558c-e40a-4a9b-9734-a4c043935637 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:57.324650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3537558c-e40a-4a9b-9734-a4c043935637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:57.358928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98914d-4646-4b29-8f72-15a7907627ad None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:57.406555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:57.438513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f48dd-63d6-4e12-bf05-2da85a8798cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:57.439527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f48dd-63d6-4e12-bf05-2da85a8798cc None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:57.439832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f48dd-63d6-4e12-bf05-2da85a8798cc None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:57.440161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f48dd-63d6-4e12-bf05-2da85a8798cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:57.510100 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 58/108] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:02:57.512283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ba7ed-6763-49bd-beb2-3681111a7a77 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:57.512773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ba7ed-6763-49bd-beb2-3681111a7a77 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:57.513250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ba7ed-6763-49bd-beb2-3681111a7a77 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:57.515815 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 59/109] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:57.522277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee75a11-a760-46b2-9715-622f7efba2c1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:57.522700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee75a11-a760-46b2-9715-622f7efba2c1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:57.523043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee75a11-a760-46b2-9715-622f7efba2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:57.530219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:57.545847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8ee75a11-a760-46b2-9715-622f7efba2c1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:57.549263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ee75a11-a760-46b2-9715-622f7efba2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:57.596340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f48dd-63d6-4e12-bf05-2da85a8798cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:57.597963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f48dd-63d6-4e12-bf05-2da85a8798cc None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:57.729180 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 60/110] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:02:57.730886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834888d-ffe8-4bcc-9905-0c1afd0dde25 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:57.731181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834888d-ffe8-4bcc-9905-0c1afd0dde25 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:57.731594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834888d-ffe8-4bcc-9905-0c1afd0dde25 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:57.733008 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 61/111] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:57.738620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b1e77-1d83-444d-9698-7b6769d6d9f7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:57.738920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b1e77-1d83-444d-9698-7b6769d6d9f7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:57.739183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b1e77-1d83-444d-9698-7b6769d6d9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:57.749088 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 51/112] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:02:57.756473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f48dd-63d6-4e12-bf05-2da85a8798cc None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:57.783245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-302b1e77-1d83-444d-9698-7b6769d6d9f7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:57.785250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-302b1e77-1d83-444d-9698-7b6769d6d9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:57.797982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:57.901581 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 62/113] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 28 18:02:57.923725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa74f0-9a8a-47b4-ad05-ec098ebcdecb None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:57.924223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa74f0-9a8a-47b4-ad05-ec098ebcdecb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:57.924631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa74f0-9a8a-47b4-ad05-ec098ebcdecb None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:57.926195 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 63/114] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:57.931396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfbf82-114d-4f90-a99b-3365191609b7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:57.931917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfbf82-114d-4f90-a99b-3365191609b7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:57.932448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfbf82-114d-4f90-a99b-3365191609b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:57.936535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f48dd-63d6-4e12-bf05-2da85a8798cc None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:57.961228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-45dfbf82-114d-4f90-a99b-3365191609b7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:57.962844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-45dfbf82-114d-4f90-a99b-3365191609b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:57.981105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f542d-6a46-4fad-bb8f-94d9d749b80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:57.981740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f542d-6a46-4fad-bb8f-94d9d749b80f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:57.982049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f542d-6a46-4fad-bb8f-94d9d749b80f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:57.982329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f542d-6a46-4fad-bb8f-94d9d749b80f None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:57.983577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f542d-6a46-4fad-bb8f-94d9d749b80f None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:57.985038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f542d-6a46-4fad-bb8f-94d9d749b80f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:57.986836 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 52/115] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:02:57 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:02:58.005290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f542d-6a46-4fad-bb8f-94d9d749b80f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:58.045943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:58.061556 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 64/116] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:02:58.062644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfbf82-114d-4f90-a99b-3365191609b7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:58.107305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:58.125477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f542d-6a46-4fad-bb8f-94d9d749b80f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:58.176053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdbe56-8ecb-46ea-ac10-cd97b9f53a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:58.176963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdbe56-8ecb-46ea-ac10-cd97b9f53a35 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:58.177381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdbe56-8ecb-46ea-ac10-cd97b9f53a35 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:58.177790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdbe56-8ecb-46ea-ac10-cd97b9f53a35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:58.178665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdbe56-8ecb-46ea-ac10-cd97b9f53a35 None admin] RBAC: Adding query filter params (role.id=3e7c7ed373dc46829d37081c99a331a0, scope.project.id=1be8f0e040484baab23f1815ce704594, user.id=35a281fffb81466f9b5284b21b6b67d3) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:58.179108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdbe56-8ecb-46ea-ac10-cd97b9f53a35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:58.180732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdbe56-8ecb-46ea-ac10-cd97b9f53a35 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:58.187270 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 53/117] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:02:58 2022] GET /identity/v3/role_assignments?user.id=35a281fffb81466f9b5284b21b6b67d3&scope.project.id=1be8f0e040484baab23f1815ce704594&role.id=3e7c7ed373dc46829d37081c99a331a0 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:02:58.191365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdbe56-8ecb-46ea-ac10-cd97b9f53a35 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:58.247040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfbf82-114d-4f90-a99b-3365191609b7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:58.311422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee1794-40c2-4c1a-b7b0-f6a92994f31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:58.312250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee1794-40c2-4c1a-b7b0-f6a92994f31e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:58.312373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee1794-40c2-4c1a-b7b0-f6a92994f31e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:58.312606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee1794-40c2-4c1a-b7b0-f6a92994f31e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:58.330811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee1794-40c2-4c1a-b7b0-f6a92994f31e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:02:58.337763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdbe56-8ecb-46ea-ac10-cd97b9f53a35 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:58.344157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-65ee1794-40c2-4c1a-b7b0-f6a92994f31e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:02:58.344157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:02:58.344157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:02:58.344157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:02:58.344157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:02:58.344157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:02:58.344157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:02:58.344157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:02:58.344157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:02:58.344157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:02:58.344157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:02:58.344157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:02:58.344157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:02:58.344157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:02:58.344157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:02:58.344157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:02:58.345173 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:02:58.345173 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:02:58.345173 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:02:58.345173 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:02:58.345173 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:02:58.345173 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:02:58.345173 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:02:58.345173 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:02:58.345173 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:02:58.345173 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:02:58.345173 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:02:58.345173 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:02:58.345173 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:02:58.345173 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:02:58.345173 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:02:58.345173 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:02:58.346371 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:02:58.346371 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:02:58.346371 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:02:58.346371 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:02:58.346371 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:02:58.346371 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:02:58.346371 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:02:58.346371 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:02:58.346371 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:02:58.346371 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:02:58.346371 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:02:58.346371 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:02:58.346371 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 65/118] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:02:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:02:58.351376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee1794-40c2-4c1a-b7b0-f6a92994f31e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:58.386825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70f97f-60af-4f18-ac96-439d66b32c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:58.387973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70f97f-60af-4f18-ac96-439d66b32c57 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:58.388518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70f97f-60af-4f18-ac96-439d66b32c57 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:58.388977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70f97f-60af-4f18-ac96-439d66b32c57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:58.405932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70f97f-60af-4f18-ac96-439d66b32c57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:02:58.411836 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-ce70f97f-60af-4f18-ac96-439d66b32c57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:02:58.411836 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:02:58.411836 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:02:58.411836 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:02:58.411836 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:02:58.411836 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:02:58.411836 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:02:58.411836 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:02:58.411836 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:02:58.411836 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:02:58.411836 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:02:58.411836 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:02:58.411836 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:02:58.411836 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:02:58.411836 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:02:58.411836 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:02:58.412650 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:02:58.412650 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:02:58.412650 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:02:58.412650 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:02:58.412650 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:02:58.412650 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:02:58.412650 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:02:58.412650 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:02:58.412650 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:02:58.412650 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:02:58.412650 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:02:58.412650 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:02:58.412650 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:02:58.412650 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:02:58.412650 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:02:58.412650 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:02:58.413406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:02:58.413406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:02:58.413406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:02:58.413406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:02:58.413406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:02:58.413406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:02:58.413406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:02:58.413406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:02:58.413406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:02:58.413406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:02:58.413406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:02:58.413406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:02:58.415723 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 54/119] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:02:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:02:58.421025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:58.421790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70f97f-60af-4f18-ac96-439d66b32c57 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:58.443294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:58.476494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee1794-40c2-4c1a-b7b0-f6a92994f31e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:58.520635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d648507-47b9-45d5-91df-cb71d73a0166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:58.521482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d648507-47b9-45d5-91df-cb71d73a0166 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:58.521892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d648507-47b9-45d5-91df-cb71d73a0166 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:58.522303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d648507-47b9-45d5-91df-cb71d73a0166 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:58.523135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d648507-47b9-45d5-91df-cb71d73a0166 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:58.523591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d648507-47b9-45d5-91df-cb71d73a0166 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:58.525194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d648507-47b9-45d5-91df-cb71d73a0166 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:58.539889 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 66/120] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:02:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:02:58.541052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d648507-47b9-45d5-91df-cb71d73a0166 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:58.546964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70f97f-60af-4f18-ac96-439d66b32c57 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:58.581842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffc601-1a72-4323-838f-930bdaac7527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:58.582526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffc601-1a72-4323-838f-930bdaac7527 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:58.582809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffc601-1a72-4323-838f-930bdaac7527 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:58.583080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffc601-1a72-4323-838f-930bdaac7527 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:58.583781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ffc601-1a72-4323-838f-930bdaac7527 None admin] RBAC: Adding query filter params (name=member) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:58.584094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ffc601-1a72-4323-838f-930bdaac7527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:58.585463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ffc601-1a72-4323-838f-930bdaac7527 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:58.594213 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 55/121] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:02:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:02:58.595126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffc601-1a72-4323-838f-930bdaac7527 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:58.655121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d648507-47b9-45d5-91df-cb71d73a0166 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:58.667731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:58.669903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:58.692518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4b62b-56ed-4a5e-ae9f-46695dca3b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:58.693167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4b62b-56ed-4a5e-ae9f-46695dca3b0d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:58.693625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4b62b-56ed-4a5e-ae9f-46695dca3b0d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:58.693733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4b62b-56ed-4a5e-ae9f-46695dca3b0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:58.702956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffc601-1a72-4323-838f-930bdaac7527 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:58.704655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4b62b-56ed-4a5e-ae9f-46695dca3b0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:02:58.710135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b6c4b62b-56ed-4a5e-ae9f-46695dca3b0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:02:58.710135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:02:58.710135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:02:58.710135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:02:58.710135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:02:58.710135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:02:58.710135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:02:58.710135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:02:58.710135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:02:58.710135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:02:58.710135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:02:58.710135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:02:58.710135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:02:58.710135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:02:58.710135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:02:58.710135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:02:58.711432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:02:58.711432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:02:58.711432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:02:58.711432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:02:58.711432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:02:58.711432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:02:58.711432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:02:58.711432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:02:58.711432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:02:58.711432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:02:58.711432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:02:58.711432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:02:58.711432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:02:58.711432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:02:58.711432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:02:58.711432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:02:58.715970 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:02:58.715970 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:02:58.715970 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:02:58.715970 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:02:58.715970 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:02:58.715970 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:02:58.715970 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:02:58.715970 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:02:58.715970 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:02:58.715970 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:02:58.715970 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:02:58.715970 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:02:58.715970 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 67/122] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:02:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:02:58.715970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4b62b-56ed-4a5e-ae9f-46695dca3b0d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:58.751459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ada0b9-30c2-433e-8335-dd130b48ced4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:58.752731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ada0b9-30c2-433e-8335-dd130b48ced4 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:58.753182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ada0b9-30c2-433e-8335-dd130b48ced4 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:58.753587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ada0b9-30c2-433e-8335-dd130b48ced4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:58.765733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ada0b9-30c2-433e-8335-dd130b48ced4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:02:58.771849 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-67ada0b9-30c2-433e-8335-dd130b48ced4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:02:58.771849 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:02:58.771849 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:02:58.771849 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:02:58.771849 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:02:58.771849 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:02:58.771849 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:02:58.771849 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:02:58.771849 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:02:58.771849 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:02:58.771849 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:02:58.771849 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:02:58.771849 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:02:58.771849 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:02:58.771849 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:02:58.771849 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:02:58.772964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:02:58.772964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:02:58.772964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:02:58.772964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:02:58.772964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:02:58.772964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:02:58.772964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:02:58.772964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:02:58.772964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:02:58.772964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:02:58.772964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:02:58.772964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:02:58.772964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:02:58.772964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:02:58.772964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:02:58.772964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:02:58.773825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:02:58.773825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:02:58.773825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:02:58.773825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:02:58.773825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:02:58.773825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:02:58.773825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:02:58.773825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:02:58.773825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:02:58.773825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:02:58.773825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:02:58.773825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:02:58.775709 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 56/123] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:02:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:02:58.776785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ada0b9-30c2-433e-8335-dd130b48ced4 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:58.826066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4b62b-56ed-4a5e-ae9f-46695dca3b0d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:58.861236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb140952-373a-4d1d-b4f4-7439a7037a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:58.862153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb140952-373a-4d1d-b4f4-7439a7037a48 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:58.862532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb140952-373a-4d1d-b4f4-7439a7037a48 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:58.862909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb140952-373a-4d1d-b4f4-7439a7037a48 None admin] PATH_INFO: `/v3/users/4190655e461b49b0932d472dd67ff9f0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:58.864203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb140952-373a-4d1d-b4f4-7439a7037a48 None admin] RBAC: Authorizing `identity:get_user(user_id=4190655e461b49b0932d472dd67ff9f0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:58.865801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb140952-373a-4d1d-b4f4-7439a7037a48 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:58.867569 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 68/124] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:02:58 2022] GET /identity/v3/users/4190655e461b49b0932d472dd67ff9f0 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:58.868497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb140952-373a-4d1d-b4f4-7439a7037a48 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:58.885170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ada0b9-30c2-433e-8335-dd130b48ced4 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:58.917372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:58.924325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b65d3c-7331-4d44-a950-6c96cbbd033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:58.925143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65d3c-7331-4d44-a950-6c96cbbd033a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:58.925562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65d3c-7331-4d44-a950-6c96cbbd033a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:58.926035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65d3c-7331-4d44-a950-6c96cbbd033a None admin] PATH_INFO: `/v3/users/4190655e461b49b0932d472dd67ff9f0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:58.927506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b65d3c-7331-4d44-a950-6c96cbbd033a None admin] RBAC: Authorizing `identity:get_user(user_id=4190655e461b49b0932d472dd67ff9f0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:58.929218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b65d3c-7331-4d44-a950-6c96cbbd033a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:58.931037 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 57/125] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:02:58 2022] GET /identity/v3/users/4190655e461b49b0932d472dd67ff9f0 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:58.932242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b65d3c-7331-4d44-a950-6c96cbbd033a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:58.939665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:58.980221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb140952-373a-4d1d-b4f4-7439a7037a48 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:59.025704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d04ac-dc33-4648-ac56-60538a41b10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:59.026243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d04ac-dc33-4648-ac56-60538a41b10a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:59.026527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d04ac-dc33-4648-ac56-60538a41b10a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:59.026803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d04ac-dc33-4648-ac56-60538a41b10a None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:59.027517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d04ac-dc33-4648-ac56-60538a41b10a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:59.027825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d04ac-dc33-4648-ac56-60538a41b10a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:59.029274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d04ac-dc33-4648-ac56-60538a41b10a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:59.039465 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 69/126] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:02:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:59.040669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d04ac-dc33-4648-ac56-60538a41b10a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:59.053981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b65d3c-7331-4d44-a950-6c96cbbd033a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:59.106425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c8ee0-d3c7-4967-b0c8-a5e12fea40d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:59.107115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c8ee0-d3c7-4967-b0c8-a5e12fea40d3 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:59.107459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c8ee0-d3c7-4967-b0c8-a5e12fea40d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:59.108011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c8ee0-d3c7-4967-b0c8-a5e12fea40d3 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:59.108440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c8ee0-d3c7-4967-b0c8-a5e12fea40d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:02:59.108750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c8ee0-d3c7-4967-b0c8-a5e12fea40d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:59.110206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c8ee0-d3c7-4967-b0c8-a5e12fea40d3 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:59.118732 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 58/127] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:02:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:59.119569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c8ee0-d3c7-4967-b0c8-a5e12fea40d3 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:59.169503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d04ac-dc33-4648-ac56-60538a41b10a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:59.173493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:59.186345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:59.220800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4005ec2-40a7-41e2-a3db-343344d3089e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:59.221453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4005ec2-40a7-41e2-a3db-343344d3089e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:59.221724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4005ec2-40a7-41e2-a3db-343344d3089e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:59.221999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4005ec2-40a7-41e2-a3db-343344d3089e None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:59.223199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4005ec2-40a7-41e2-a3db-343344d3089e None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:59.224878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4005ec2-40a7-41e2-a3db-343344d3089e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:59.226420 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 70/128] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:02:59 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:59.227187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4005ec2-40a7-41e2-a3db-343344d3089e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:59.237482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c8ee0-d3c7-4967-b0c8-a5e12fea40d3 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:59.284667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d695a39-5d3c-476c-8922-8fffaed500d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:59.286194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d695a39-5d3c-476c-8922-8fffaed500d5 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:59.286656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d695a39-5d3c-476c-8922-8fffaed500d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:59.287360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d695a39-5d3c-476c-8922-8fffaed500d5 None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:59.288973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d695a39-5d3c-476c-8922-8fffaed500d5 None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:59.291310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d695a39-5d3c-476c-8922-8fffaed500d5 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:59.293673 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 59/129] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:02:59 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:59.294700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d695a39-5d3c-476c-8922-8fffaed500d5 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:59.346357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4005ec2-40a7-41e2-a3db-343344d3089e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:59.396161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7b775-85d6-4071-a6b0-42ddc2484582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:59.397589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7b775-85d6-4071-a6b0-42ddc2484582 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:59.398193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7b775-85d6-4071-a6b0-42ddc2484582 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:59.398763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7b775-85d6-4071-a6b0-42ddc2484582 None admin] PATH_INFO: `/v3/users/14ad14eb111e4774a71609d695e07661` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:59.400455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7b775-85d6-4071-a6b0-42ddc2484582 None admin] RBAC: Authorizing `identity:get_user(user_id=14ad14eb111e4774a71609d695e07661)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:59.402831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7b775-85d6-4071-a6b0-42ddc2484582 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:59.405509 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 71/130] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:02:59 2022] GET /identity/v3/users/14ad14eb111e4774a71609d695e07661 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:59.406547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7b775-85d6-4071-a6b0-42ddc2484582 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:59.420035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d695a39-5d3c-476c-8922-8fffaed500d5 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:59.458170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:59.462043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:59.469572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37773c-3d87-4591-82ed-9cb579f7b61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:59.470528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37773c-3d87-4591-82ed-9cb579f7b61b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:59.471010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37773c-3d87-4591-82ed-9cb579f7b61b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:59.471617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37773c-3d87-4591-82ed-9cb579f7b61b None admin] PATH_INFO: `/v3/users/4190655e461b49b0932d472dd67ff9f0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:59.472954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37773c-3d87-4591-82ed-9cb579f7b61b None admin] RBAC: Authorizing `identity:get_user(user_id=4190655e461b49b0932d472dd67ff9f0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:59.474747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37773c-3d87-4591-82ed-9cb579f7b61b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:59.481291 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 60/131] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:02:59 2022] GET /identity/v3/users/4190655e461b49b0932d472dd67ff9f0 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:59.482484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37773c-3d87-4591-82ed-9cb579f7b61b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:59.521647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7b775-85d6-4071-a6b0-42ddc2484582 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:59.558230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039dcdf-f9fa-4ff2-bd60-d77df1d209c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:59.558834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039dcdf-f9fa-4ff2-bd60-d77df1d209c2 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:59.559118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039dcdf-f9fa-4ff2-bd60-d77df1d209c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:59.559443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039dcdf-f9fa-4ff2-bd60-d77df1d209c2 None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594/users/4190655e461b49b0932d472dd67ff9f0/roles/81040db4535e417891c10dd996b1eac5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:59.568898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039dcdf-f9fa-4ff2-bd60-d77df1d209c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1be8f0e040484baab23f1815ce704594, user_id=4190655e461b49b0932d472dd67ff9f0, role_id=81040db4535e417891c10dd996b1eac5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:59.568898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039dcdf-f9fa-4ff2-bd60-d77df1d209c2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:59.581044 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 72/132] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:02:59 2022] PUT /identity/v3/projects/1be8f0e040484baab23f1815ce704594/users/4190655e461b49b0932d472dd67ff9f0/roles/81040db4535e417891c10dd996b1eac5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:02:59.581855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039dcdf-f9fa-4ff2-bd60-d77df1d209c2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:59.618856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37773c-3d87-4591-82ed-9cb579f7b61b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:59.703866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fd5e1-dd09-44ca-b343-0cab275d324c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:59.704637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fd5e1-dd09-44ca-b343-0cab275d324c None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:59.704922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fd5e1-dd09-44ca-b343-0cab275d324c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:59.705201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fd5e1-dd09-44ca-b343-0cab275d324c None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594/users/4190655e461b49b0932d472dd67ff9f0/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:59.710231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fd5e1-dd09-44ca-b343-0cab275d324c None admin] RBAC: Authorizing `identity:create_grant(project_id=1be8f0e040484baab23f1815ce704594, user_id=4190655e461b49b0932d472dd67ff9f0, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:59.711887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fd5e1-dd09-44ca-b343-0cab275d324c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:59.739571 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 61/133] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:02:59 2022] PUT /identity/v3/projects/1be8f0e040484baab23f1815ce704594/users/4190655e461b49b0932d472dd67ff9f0/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:02:59.740227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fd5e1-dd09-44ca-b343-0cab275d324c None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:59.792006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:59.798037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039dcdf-f9fa-4ff2-bd60-d77df1d209c2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:59.840685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff544c-dbaa-4c64-9068-9ca211c84675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:59.841351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff544c-dbaa-4c64-9068-9ca211c84675 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:59.841635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff544c-dbaa-4c64-9068-9ca211c84675 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:59.841907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff544c-dbaa-4c64-9068-9ca211c84675 None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:59.843099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff544c-dbaa-4c64-9068-9ca211c84675 None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:59.844311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:02:59.844782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff544c-dbaa-4c64-9068-9ca211c84675 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:59.850688 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 73/134] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:02:59 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:59.852441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee630e-cd49-4afa-94ff-f30f581bebb6 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:59.852731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee630e-cd49-4afa-94ff-f30f581bebb6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:59.853011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee630e-cd49-4afa-94ff-f30f581bebb6 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:59.854486 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 74/135] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:02:59.861839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41c9aa-d4cb-4f93-bfdf-edf7f1352dfd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:59.862139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41c9aa-d4cb-4f93-bfdf-edf7f1352dfd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:59.862423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41c9aa-d4cb-4f93-bfdf-edf7f1352dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:59.885795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0c41c9aa-d4cb-4f93-bfdf-edf7f1352dfd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:02:59.887012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0c41c9aa-d4cb-4f93-bfdf-edf7f1352dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:02:59.905787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fd5e1-dd09-44ca-b343-0cab275d324c None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:02:59.974680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34894d-28f0-41a3-b854-4aa553b7349e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:02:59.975381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34894d-28f0-41a3-b854-4aa553b7349e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:02:59.975654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34894d-28f0-41a3-b854-4aa553b7349e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:02:59.975935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34894d-28f0-41a3-b854-4aa553b7349e None admin] PATH_INFO: `/v3/projects/a126df3b78f349f5a943fdf96f8da737` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:02:59.977103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34894d-28f0-41a3-b854-4aa553b7349e None admin] RBAC: Authorizing `identity:get_project(project_id=a126df3b78f349f5a943fdf96f8da737)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:02:59.978555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34894d-28f0-41a3-b854-4aa553b7349e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:02:59.980287 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 62/136] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:02:59 2022] GET /identity/v3/projects/a126df3b78f349f5a943fdf96f8da737 => generated 312 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:02:59.981055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34894d-28f0-41a3-b854-4aa553b7349e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:02:59.997323 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 75/137] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:02:59.999033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41c9aa-d4cb-4f93-bfdf-edf7f1352dfd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:00.105007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34894d-28f0-41a3-b854-4aa553b7349e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:00.120574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:00.124935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41c9aa-d4cb-4f93-bfdf-edf7f1352dfd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:00.143326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:00.169594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae15bd1-3232-4643-97f6-f5b90963f38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:00.170680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae15bd1-3232-4643-97f6-f5b90963f38d None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:00.171160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae15bd1-3232-4643-97f6-f5b90963f38d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:00.171661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae15bd1-3232-4643-97f6-f5b90963f38d None admin] PATH_INFO: `/v3/projects/a126df3b78f349f5a943fdf96f8da737/users/4190655e461b49b0932d472dd67ff9f0/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:00.174018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae15bd1-3232-4643-97f6-f5b90963f38d None admin] RBAC: Authorizing `identity:create_grant(project_id=a126df3b78f349f5a943fdf96f8da737, user_id=4190655e461b49b0932d472dd67ff9f0, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:00.175787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae15bd1-3232-4643-97f6-f5b90963f38d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:00.175979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3af444-dbc1-49a7-ba71-adb7cf5d224b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:00.176684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3af444-dbc1-49a7-ba71-adb7cf5d224b None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:00.176976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3af444-dbc1-49a7-ba71-adb7cf5d224b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:00.177265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3af444-dbc1-49a7-ba71-adb7cf5d224b None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594/users/14ad14eb111e4774a71609d695e07661/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:00.180282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3af444-dbc1-49a7-ba71-adb7cf5d224b None admin] RBAC: Authorizing `identity:create_grant(project_id=1be8f0e040484baab23f1815ce704594, user_id=14ad14eb111e4774a71609d695e07661, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:00.181858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3af444-dbc1-49a7-ba71-adb7cf5d224b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:00.199005 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 76/138] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:02:59 2022] PUT /identity/v3/projects/a126df3b78f349f5a943fdf96f8da737/users/4190655e461b49b0932d472dd67ff9f0/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:03:00.209909 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 63/139] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:02:59 2022] PUT /identity/v3/projects/1be8f0e040484baab23f1815ce704594/users/14ad14eb111e4774a71609d695e07661/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:03:00.377416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75224-8859-4825-81df-f582807de619 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:00.378081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75224-8859-4825-81df-f582807de619 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:00.378566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75224-8859-4825-81df-f582807de619 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:00.380225 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 77/140] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:00.386448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae00381-9690-475e-9523-41f2ee212302 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:00.386690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae00381-9690-475e-9523-41f2ee212302 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:00.386970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae00381-9690-475e-9523-41f2ee212302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:00.407576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bae00381-9690-475e-9523-41f2ee212302 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:00.408803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bae00381-9690-475e-9523-41f2ee212302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:00.437249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee75224-8859-4825-81df-f582807de619 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:00.488579 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 64/141] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:00.573032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee75224-8859-4825-81df-f582807de619 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:00.613924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc946697-614d-4800-926e-44cca0e87550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:00.614621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc946697-614d-4800-926e-44cca0e87550 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:00.614907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc946697-614d-4800-926e-44cca0e87550 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:00.615180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc946697-614d-4800-926e-44cca0e87550 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:00.618397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc946697-614d-4800-926e-44cca0e87550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:00.619969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc946697-614d-4800-926e-44cca0e87550 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:00.621886 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 78/142] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:00.627690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae00381-9690-475e-9523-41f2ee212302 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:00.778211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae00381-9690-475e-9523-41f2ee212302 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:00.798544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:00.821141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb955f-e0f2-4d3d-9235-755f8be090ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:00.821760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb955f-e0f2-4d3d-9235-755f8be090ad None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:00.822047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb955f-e0f2-4d3d-9235-755f8be090ad None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:00.822323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb955f-e0f2-4d3d-9235-755f8be090ad None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:00.822988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb955f-e0f2-4d3d-9235-755f8be090ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:00.824498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb955f-e0f2-4d3d-9235-755f8be090ad None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:00.855336 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 65/143] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:03:00 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:03:01.038727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc946697-614d-4800-926e-44cca0e87550 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:01.073225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:01.175534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc946697-614d-4800-926e-44cca0e87550 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:01.219525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeef190-5a23-4df1-80b6-a0b74700fcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:01.220600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeef190-5a23-4df1-80b6-a0b74700fcc6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:01.220600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeef190-5a23-4df1-80b6-a0b74700fcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:01.220760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeef190-5a23-4df1-80b6-a0b74700fcc6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:01.239060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeef190-5a23-4df1-80b6-a0b74700fcc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:01.244616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-5aeef190-5a23-4df1-80b6-a0b74700fcc6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:03:01.244616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:01.244616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:01.244616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:01.244616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:01.244616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:01.244616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:01.244616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:01.244616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:01.244616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:01.244616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:01.244616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:01.244616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:01.244616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:01.244616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:01.244616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:01.245453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:01.245453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:01.245453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:01.245453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:01.245453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:01.245453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:01.245453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:01.245453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:01.245453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:01.245453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:01.245453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:01.245453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:01.245453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:01.245453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:01.245453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:01.245453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:01.246226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:01.246226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:01.246226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:01.246226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:01.246226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:01.246226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:01.246226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:01.246226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:01.246226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:01.246226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:01.246226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:03:01.246226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:01.246226 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 79/144] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:01.252499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb955f-e0f2-4d3d-9235-755f8be090ad None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:01.366546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb955f-e0f2-4d3d-9235-755f8be090ad None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:01.410241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250f704-230e-46c8-822b-6c704441853d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:01.410881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250f704-230e-46c8-822b-6c704441853d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:01.411166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250f704-230e-46c8-822b-6c704441853d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:01.411494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250f704-230e-46c8-822b-6c704441853d None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:01.412165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250f704-230e-46c8-822b-6c704441853d None admin] RBAC: Adding query filter params (name=reader) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:01.412473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250f704-230e-46c8-822b-6c704441853d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:01.413866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250f704-230e-46c8-822b-6c704441853d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:01.423148 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 66/145] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:01.429230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeef190-5a23-4df1-80b6-a0b74700fcc6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:01.558780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:01.577100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeef190-5a23-4df1-80b6-a0b74700fcc6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:01.623115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df3c93-ccf8-4706-ba54-6673ef13167a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:01.623719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df3c93-ccf8-4706-ba54-6673ef13167a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:01.624001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df3c93-ccf8-4706-ba54-6673ef13167a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:01.624271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df3c93-ccf8-4706-ba54-6673ef13167a None admin] PATH_INFO: `/v3/users/35a281fffb81466f9b5284b21b6b67d3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:01.625448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df3c93-ccf8-4706-ba54-6673ef13167a None admin] RBAC: Authorizing `identity:get_user(user_id=35a281fffb81466f9b5284b21b6b67d3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:01.626919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df3c93-ccf8-4706-ba54-6673ef13167a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:01.628546 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 80/146] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:01 2022] GET /identity/v3/users/35a281fffb81466f9b5284b21b6b67d3 => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:01.634418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250f704-230e-46c8-822b-6c704441853d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:01.691697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:01.777536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250f704-230e-46c8-822b-6c704441853d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:01.819515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fcb2c-3750-4776-9e10-175a9e5cda55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:01.820173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fcb2c-3750-4776-9e10-175a9e5cda55 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:01.820457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fcb2c-3750-4776-9e10-175a9e5cda55 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:01.820734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fcb2c-3750-4776-9e10-175a9e5cda55 None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:01.822603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fcb2c-3750-4776-9e10-175a9e5cda55 None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:01.824123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fcb2c-3750-4776-9e10-175a9e5cda55 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:01.826282 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 67/147] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:01 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:01.832134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df3c93-ccf8-4706-ba54-6673ef13167a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:01.982947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df3c93-ccf8-4706-ba54-6673ef13167a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:02.025475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1fcda-bf74-44a8-abe6-4c90fe023766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:02.026162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1fcda-bf74-44a8-abe6-4c90fe023766 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:02.026442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1fcda-bf74-44a8-abe6-4c90fe023766 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:02.026717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1fcda-bf74-44a8-abe6-4c90fe023766 None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594/users/35a281fffb81466f9b5284b21b6b67d3/roles/3e7c7ed373dc46829d37081c99a331a0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:02.032625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1fcda-bf74-44a8-abe6-4c90fe023766 None admin] RBAC: Authorizing `identity:create_grant(project_id=1be8f0e040484baab23f1815ce704594, user_id=35a281fffb81466f9b5284b21b6b67d3, role_id=3e7c7ed373dc46829d37081c99a331a0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:02.034116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1fcda-bf74-44a8-abe6-4c90fe023766 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:02.054447 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 81/148] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:03:01 2022] PUT /identity/v3/projects/1be8f0e040484baab23f1815ce704594/users/35a281fffb81466f9b5284b21b6b67d3/roles/3e7c7ed373dc46829d37081c99a331a0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:03:02.490238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7727bb-2269-4bbf-9ce5-fee7a86ea108 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:02.490780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7727bb-2269-4bbf-9ce5-fee7a86ea108 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:02.490780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7727bb-2269-4bbf-9ce5-fee7a86ea108 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:02.492197 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 68/149] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:02.499952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9706bc-c73d-4df9-8320-a203ae5dcac5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:02.500230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9706bc-c73d-4df9-8320-a203ae5dcac5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:02.500514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9706bc-c73d-4df9-8320-a203ae5dcac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:02.524277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-db9706bc-c73d-4df9-8320-a203ae5dcac5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:02.525492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db9706bc-c73d-4df9-8320-a203ae5dcac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:02.536953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:02.550159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86b447-3902-4205-bbe0-49bf34509154 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:02.550447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86b447-3902-4205-bbe0-49bf34509154 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:02.550718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86b447-3902-4205-bbe0-49bf34509154 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:02.552118 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 69/150] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:02.562832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe0600-4178-4f20-a372-e547b4b96f05 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:02.563113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe0600-4178-4f20-a372-e547b4b96f05 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:02.563417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe0600-4178-4f20-a372-e547b4b96f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:02.592258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6ebe0600-4178-4f20-a372-e547b4b96f05 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:02.594017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6ebe0600-4178-4f20-a372-e547b4b96f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:02.670698 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 82/151] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:02.717423 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 70/152] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:03:03.000216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9706bc-c73d-4df9-8320-a203ae5dcac5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:03.119397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9706bc-c73d-4df9-8320-a203ae5dcac5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:03.166777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e71ba6-34b6-47e4-9d17-0fae05b8a08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:03.167454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e71ba6-34b6-47e4-9d17-0fae05b8a08d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:03.167733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e71ba6-34b6-47e4-9d17-0fae05b8a08d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:03.168005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e71ba6-34b6-47e4-9d17-0fae05b8a08d None admin] PATH_INFO: `/v3/roles/member` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:03.190446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e71ba6-34b6-47e4-9d17-0fae05b8a08d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:03.195400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-36e71ba6-34b6-47e4-9d17-0fae05b8a08d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:03.195400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:03.195400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:03.195400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:03.195400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:03.195400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:03.195400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:03.195400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:03.195400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:03.195400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:03.195400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:03.195400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:03.195400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:03.195400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:03.195400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:03.195400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:03.196294 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:03.196294 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:03.196294 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:03.196294 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:03.196294 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:03.196294 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:03.196294 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:03.196294 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:03.196294 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:03.196294 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:03.196294 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:03.196294 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:03.196294 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:03.196294 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:03.196294 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:03.196294 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:03.197065 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:03.197065 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:03.197065 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:03.197065 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:03.197065 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:03.197065 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:03.197065 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:03.197065 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:03.197065 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:03.197065 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:03.197065 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:03.197065 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:03.197065 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 83/153] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:03:03.203836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe0600-4178-4f20-a372-e547b4b96f05 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:03.252113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:03.336125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe0600-4178-4f20-a372-e547b4b96f05 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:03.339197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e71ba6-34b6-47e4-9d17-0fae05b8a08d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:03.349793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:03.386813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1c516-d4c1-4888-9616-46e07ec4a855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:03.387861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1c516-d4c1-4888-9616-46e07ec4a855 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:03.388417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1c516-d4c1-4888-9616-46e07ec4a855 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:03.388899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1c516-d4c1-4888-9616-46e07ec4a855 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:03.389801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1c516-d4c1-4888-9616-46e07ec4a855 None admin] RBAC: Adding query filter params (name=member) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:03.390307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1c516-d4c1-4888-9616-46e07ec4a855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:03.395314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1c516-d4c1-4888-9616-46e07ec4a855 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:03.420850 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 71/154] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:03.422876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99878723-ff7b-4cfe-9dce-03f45edf2608 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:03.423346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99878723-ff7b-4cfe-9dce-03f45edf2608 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:03.423783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99878723-ff7b-4cfe-9dce-03f45edf2608 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:03.426218 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 72/155] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:03.427519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99878723-ff7b-4cfe-9dce-03f45edf2608 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:03.537775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e71ba6-34b6-47e4-9d17-0fae05b8a08d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:03.617591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67c045-20ce-4fa3-92db-8b8b604c1ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:03.618261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67c045-20ce-4fa3-92db-8b8b604c1ce0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:03.618539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67c045-20ce-4fa3-92db-8b8b604c1ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:03.618812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67c045-20ce-4fa3-92db-8b8b604c1ce0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:03.630443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67c045-20ce-4fa3-92db-8b8b604c1ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:03.636639 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-9d67c045-20ce-4fa3-92db-8b8b604c1ce0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:03.636639 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:03.636639 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:03.636639 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:03.636639 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:03.636639 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:03.636639 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:03.636639 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:03.636639 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:03.636639 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:03.636639 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:03.636639 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:03.636639 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:03.636639 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:03.636639 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:03.636639 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:03.637819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:03.637819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:03.637819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:03.637819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:03.637819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:03.637819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:03.637819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:03.637819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:03.637819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:03.637819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:03.637819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:03.637819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:03.637819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:03.637819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:03.637819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:03.637819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:03.638785 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:03.638785 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:03.638785 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:03.638785 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:03.638785 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:03.638785 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:03.638785 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:03.638785 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:03.638785 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:03.638785 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:03.638785 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:03.638785 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:03.638785 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 84/156] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:03:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:03:03.639460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094240e0-77d3-4d3f-b87f-cd7bb6a3af64 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:03.640069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094240e0-77d3-4d3f-b87f-cd7bb6a3af64 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:03.640069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094240e0-77d3-4d3f-b87f-cd7bb6a3af64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:03.658696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-094240e0-77d3-4d3f-b87f-cd7bb6a3af64 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:03.659947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-094240e0-77d3-4d3f-b87f-cd7bb6a3af64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:03.695317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:03.723613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:03.726455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99878723-ff7b-4cfe-9dce-03f45edf2608 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:03.741138 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 85/157] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:03.742498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375b28b-fd20-4e9d-b5d8-d551afac4925 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:03.742781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375b28b-fd20-4e9d-b5d8-d551afac4925 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:03.743055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375b28b-fd20-4e9d-b5d8-d551afac4925 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:03.745615 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 86/158] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:03.752174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375b28b-fd20-4e9d-b5d8-d551afac4925 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:03.805630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3027a3-6d0c-423e-b424-153429068b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:03.806194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3027a3-6d0c-423e-b424-153429068b53 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:03.806473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3027a3-6d0c-423e-b424-153429068b53 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:03.806744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3027a3-6d0c-423e-b424-153429068b53 None admin] PATH_INFO: `/v3/users/4190655e461b49b0932d472dd67ff9f0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:03.809096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3027a3-6d0c-423e-b424-153429068b53 None admin] RBAC: Authorizing `identity:get_user(user_id=4190655e461b49b0932d472dd67ff9f0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:03.810601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3027a3-6d0c-423e-b424-153429068b53 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:03.812271 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 73/159] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:03 2022] GET /identity/v3/users/4190655e461b49b0932d472dd67ff9f0 => generated 275 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:03.813461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392eaff-ba78-4083-931f-c76a70d90f74 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:03.819000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392eaff-ba78-4083-931f-c76a70d90f74 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:03.819306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392eaff-ba78-4083-931f-c76a70d90f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:03.862042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d392eaff-ba78-4083-931f-c76a70d90f74 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:03.863383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d392eaff-ba78-4083-931f-c76a70d90f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:03.970144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375b28b-fd20-4e9d-b5d8-d551afac4925 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:04.004361 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 74/160] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:04.005262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392eaff-ba78-4083-931f-c76a70d90f74 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:04.036653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a93886-7e96-46ff-8e90-faa954ce7d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:04.037705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a93886-7e96-46ff-8e90-faa954ce7d42 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:04.037996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a93886-7e96-46ff-8e90-faa954ce7d42 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:04.038327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a93886-7e96-46ff-8e90-faa954ce7d42 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:04.039024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a93886-7e96-46ff-8e90-faa954ce7d42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:04.039394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a93886-7e96-46ff-8e90-faa954ce7d42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:04.040918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a93886-7e96-46ff-8e90-faa954ce7d42 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:04.056796 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 87/161] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:03:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:04.063445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a93886-7e96-46ff-8e90-faa954ce7d42 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:04.157056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:04.224592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:04.244802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392eaff-ba78-4083-931f-c76a70d90f74 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:04.253804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a93886-7e96-46ff-8e90-faa954ce7d42 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:04.317444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4c46e-fe5b-46fa-ad49-81119bb0cb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:04.317977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4c46e-fe5b-46fa-ad49-81119bb0cb5e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:04.318258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4c46e-fe5b-46fa-ad49-81119bb0cb5e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:04.318537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4c46e-fe5b-46fa-ad49-81119bb0cb5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:04.324320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286561e1-6fc7-4e05-b298-8590f499ce6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:04.324974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286561e1-6fc7-4e05-b298-8590f499ce6e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:04.325253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286561e1-6fc7-4e05-b298-8590f499ce6e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:04.325530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286561e1-6fc7-4e05-b298-8590f499ce6e None admin] PATH_INFO: `/v3/users/4190655e461b49b0932d472dd67ff9f0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:04.331465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286561e1-6fc7-4e05-b298-8590f499ce6e None admin] RBAC: Authorizing `identity:get_user(user_id=4190655e461b49b0932d472dd67ff9f0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:04.332963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286561e1-6fc7-4e05-b298-8590f499ce6e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:04.334641 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 88/162] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:04 2022] GET /identity/v3/users/4190655e461b49b0932d472dd67ff9f0 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:04.341738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286561e1-6fc7-4e05-b298-8590f499ce6e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:04.476265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4c46e-fe5b-46fa-ad49-81119bb0cb5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:04.477866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4c46e-fe5b-46fa-ad49-81119bb0cb5e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:04.556907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286561e1-6fc7-4e05-b298-8590f499ce6e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:04.619615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:04.650447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39191414-4534-414b-ba2f-283def896777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:04.651201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39191414-4534-414b-ba2f-283def896777 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:04.651510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39191414-4534-414b-ba2f-283def896777 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:04.651833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39191414-4534-414b-ba2f-283def896777 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:04.684509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:04.705579 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 75/163] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:04.707200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4c46e-fe5b-46fa-ad49-81119bb0cb5e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:04.828448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39191414-4534-414b-ba2f-283def896777 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:04.831020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39191414-4534-414b-ba2f-283def896777 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:04.865157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4c46e-fe5b-46fa-ad49-81119bb0cb5e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:04.910061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168b2b5-0522-421a-a1d6-8af1917226e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:04.910686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168b2b5-0522-421a-a1d6-8af1917226e7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:04.910968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168b2b5-0522-421a-a1d6-8af1917226e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:04.911239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168b2b5-0522-421a-a1d6-8af1917226e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:04.931309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168b2b5-0522-421a-a1d6-8af1917226e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:04.936793 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-6168b2b5-0522-421a-a1d6-8af1917226e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:04.936793 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:04.936793 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:04.936793 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:04.936793 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:04.936793 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:04.936793 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:04.936793 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:04.936793 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:04.936793 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:04.936793 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:04.936793 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:04.936793 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:04.936793 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:04.936793 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:04.936793 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:04.937677 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:04.937677 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:04.937677 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:04.937677 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:04.937677 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:04.937677 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:04.937677 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:04.937677 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:04.937677 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:04.937677 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:04.937677 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:04.937677 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:04.937677 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:04.937677 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:04.937677 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:04.937677 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:04.938435 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:04.938435 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:04.938435 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:04.938435 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:04.938435 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:04.938435 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:04.938435 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:04.938435 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:04.938435 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:04.938435 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:04.938435 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:04.938435 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:04.938435 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 76/164] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:04.939355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168b2b5-0522-421a-a1d6-8af1917226e7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:05.034491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:05.107920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168b2b5-0522-421a-a1d6-8af1917226e7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:05.124236 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 89/165] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 783 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 18:03:05.125138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39191414-4534-414b-ba2f-283def896777 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:05.164181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8868f1-74c8-481b-882f-c22a1806f15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:05.164752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8868f1-74c8-481b-882f-c22a1806f15a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:05.165032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8868f1-74c8-481b-882f-c22a1806f15a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:05.165307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8868f1-74c8-481b-882f-c22a1806f15a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:05.186169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8868f1-74c8-481b-882f-c22a1806f15a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:05.188693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:05.196128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-8e8868f1-74c8-481b-882f-c22a1806f15a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:03:05.196128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:05.196128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:05.196128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:05.196128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:05.196128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:05.196128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:05.196128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:05.196128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:05.196128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:05.196128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:05.196128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:05.196128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:05.196128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:05.196128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:05.196128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:05.197073 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:05.197073 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:05.197073 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:05.197073 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:05.197073 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:05.197073 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:05.197073 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:05.197073 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:05.197073 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:05.197073 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:05.197073 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:05.197073 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:05.197073 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:05.197073 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:05.197073 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:05.197073 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:05.197841 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:05.197841 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:05.197841 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:05.197841 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:05.197841 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:05.197841 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:05.197841 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:05.197841 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:05.197841 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:05.197841 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:05.197841 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:03:05.197841 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:05.200575 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 77/166] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:03:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:05.201484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8868f1-74c8-481b-882f-c22a1806f15a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:05.279566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39191414-4534-414b-ba2f-283def896777 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:05.355657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9192c1b-6550-4aba-b9f3-b9d46635ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:05.356306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9192c1b-6550-4aba-b9f3-b9d46635ade2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:05.356585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9192c1b-6550-4aba-b9f3-b9d46635ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:05.356861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9192c1b-6550-4aba-b9f3-b9d46635ade2 None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:05.358768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9192c1b-6550-4aba-b9f3-b9d46635ade2 None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:05.360322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9192c1b-6550-4aba-b9f3-b9d46635ade2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:05.363793 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 90/167] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:05 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:05.365416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9192c1b-6550-4aba-b9f3-b9d46635ade2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:05.397147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8868f1-74c8-481b-882f-c22a1806f15a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:05.422337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:05.469068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaaf1a-e612-47f1-9c1b-3e48c10186dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:05.469689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaaf1a-e612-47f1-9c1b-3e48c10186dc None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:05.470079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaaf1a-e612-47f1-9c1b-3e48c10186dc None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:05.470494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaaf1a-e612-47f1-9c1b-3e48c10186dc None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:05.471340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deaaf1a-e612-47f1-9c1b-3e48c10186dc None admin] RBAC: Adding query filter params (name=member) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:05.471649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deaaf1a-e612-47f1-9c1b-3e48c10186dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:05.473048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deaaf1a-e612-47f1-9c1b-3e48c10186dc None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:05.491196 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 78/168] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:05.495699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaaf1a-e612-47f1-9c1b-3e48c10186dc None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:05.548611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:05.567164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9192c1b-6550-4aba-b9f3-b9d46635ade2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:05.634257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63731cda-2fbd-4444-acdc-90a61674515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:05.635227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63731cda-2fbd-4444-acdc-90a61674515f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:05.635528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63731cda-2fbd-4444-acdc-90a61674515f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:05.635800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63731cda-2fbd-4444-acdc-90a61674515f None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:05.639279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63731cda-2fbd-4444-acdc-90a61674515f None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:05.640760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63731cda-2fbd-4444-acdc-90a61674515f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:05.642766 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 91/169] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:05 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:05.645954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63731cda-2fbd-4444-acdc-90a61674515f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:05.690758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaaf1a-e612-47f1-9c1b-3e48c10186dc None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:05.730014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8f7ae-a108-4177-bfde-d2f5102955bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:05.730669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8f7ae-a108-4177-bfde-d2f5102955bc None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:05.730941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8f7ae-a108-4177-bfde-d2f5102955bc None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:05.731148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8f7ae-a108-4177-bfde-d2f5102955bc None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:05.732027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8f7ae-a108-4177-bfde-d2f5102955bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:05.732329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8f7ae-a108-4177-bfde-d2f5102955bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:05.733696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8f7ae-a108-4177-bfde-d2f5102955bc None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:05.743346 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 79/170] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:05.748661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e914372-9700-4f56-8343-3fcbd30f141d None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:05.748952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e914372-9700-4f56-8343-3fcbd30f141d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:05.749228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e914372-9700-4f56-8343-3fcbd30f141d None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:05.750834 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 80/171] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:05.751205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e914372-9700-4f56-8343-3fcbd30f141d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:05.761303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63731cda-2fbd-4444-acdc-90a61674515f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:05.790882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:05.800450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e2ff6-67e1-4841-ac14-7b2d61d95cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:05.801000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e2ff6-67e1-4841-ac14-7b2d61d95cf8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:05.801282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e2ff6-67e1-4841-ac14-7b2d61d95cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:05.801556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e2ff6-67e1-4841-ac14-7b2d61d95cf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:05.802288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e2ff6-67e1-4841-ac14-7b2d61d95cf8 None admin] RBAC: Adding query filter params (role.id=dcabcc9bd3bf42149eed3abc0d4799c8, scope.project.id=1be8f0e040484baab23f1815ce704594, user.id=4190655e461b49b0932d472dd67ff9f0) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:05.802595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e2ff6-67e1-4841-ac14-7b2d61d95cf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:05.804076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e2ff6-67e1-4841-ac14-7b2d61d95cf8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:05.815300 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 92/172] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:03:05 2022] GET /identity/v3/role_assignments?user.id=4190655e461b49b0932d472dd67ff9f0&scope.project.id=1be8f0e040484baab23f1815ce704594&role.id=dcabcc9bd3bf42149eed3abc0d4799c8 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:05.815300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e2ff6-67e1-4841-ac14-7b2d61d95cf8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:05.849519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:05.880870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e914372-9700-4f56-8343-3fcbd30f141d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:05.920518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877d318-8848-46a0-a518-e085729c20bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:05.921164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877d318-8848-46a0-a518-e085729c20bb None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:05.921446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877d318-8848-46a0-a518-e085729c20bb None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:05.921721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877d318-8848-46a0-a518-e085729c20bb None admin] PATH_INFO: `/v3/users/4190655e461b49b0932d472dd67ff9f0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:05.923013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877d318-8848-46a0-a518-e085729c20bb None admin] RBAC: Authorizing `identity:get_user(user_id=4190655e461b49b0932d472dd67ff9f0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:05.924640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877d318-8848-46a0-a518-e085729c20bb None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:05.931463 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 81/173] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:05 2022] GET /identity/v3/users/4190655e461b49b0932d472dd67ff9f0 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:05.933100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15cf2d-317b-495e-b118-fc4154cc4f99 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:05.933382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15cf2d-317b-495e-b118-fc4154cc4f99 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:05.933655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15cf2d-317b-495e-b118-fc4154cc4f99 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:05.935300 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 82/174] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:05.936487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3905d-01cf-45a7-a77a-1d8133daf728 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:05.936761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3905d-01cf-45a7-a77a-1d8133daf728 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:05.937030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3905d-01cf-45a7-a77a-1d8133daf728 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:05.943159 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 83/175] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:05.944085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3905d-01cf-45a7-a77a-1d8133daf728 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:05.957645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e2ff6-67e1-4841-ac14-7b2d61d95cf8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:06.001217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2abe10-d6b0-46b2-aa8a-f3efb42804ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:06.001856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2abe10-d6b0-46b2-aa8a-f3efb42804ae None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:06.002127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2abe10-d6b0-46b2-aa8a-f3efb42804ae None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:06.002406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2abe10-d6b0-46b2-aa8a-f3efb42804ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:06.003153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2abe10-d6b0-46b2-aa8a-f3efb42804ae None admin] RBAC: Adding query filter params (role.id=81040db4535e417891c10dd996b1eac5, scope.project.id=1be8f0e040484baab23f1815ce704594, user.id=4190655e461b49b0932d472dd67ff9f0) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:06.003483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2abe10-d6b0-46b2-aa8a-f3efb42804ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:06.004956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2abe10-d6b0-46b2-aa8a-f3efb42804ae None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:06.011613 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 93/176] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:03:05 2022] GET /identity/v3/role_assignments?user.id=4190655e461b49b0932d472dd67ff9f0&scope.project.id=1be8f0e040484baab23f1815ce704594&role.id=81040db4535e417891c10dd996b1eac5 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:06.012866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0309e-dee5-441c-b0c2-7728c95e72b5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:06.013176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0309e-dee5-441c-b0c2-7728c95e72b5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:06.014332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0309e-dee5-441c-b0c2-7728c95e72b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:06.034432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fcc0309e-dee5-441c-b0c2-7728c95e72b5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:06.036624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fcc0309e-dee5-441c-b0c2-7728c95e72b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:06.103118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3905d-01cf-45a7-a77a-1d8133daf728 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:06.105940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:06.132552 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 94/177] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:06.133835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0309e-dee5-441c-b0c2-7728c95e72b5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:06.146377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52497b05-561c-4046-b7ef-e5cd14dac893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:06.147198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52497b05-561c-4046-b7ef-e5cd14dac893 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:06.147516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52497b05-561c-4046-b7ef-e5cd14dac893 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:06.147796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52497b05-561c-4046-b7ef-e5cd14dac893 None admin] PATH_INFO: `/v3/users/14ad14eb111e4774a71609d695e07661` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:06.149081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52497b05-561c-4046-b7ef-e5cd14dac893 None admin] RBAC: Authorizing `identity:get_user(user_id=14ad14eb111e4774a71609d695e07661)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:06.150826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52497b05-561c-4046-b7ef-e5cd14dac893 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:06.152579 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 84/178] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:05 2022] GET /identity/v3/users/14ad14eb111e4774a71609d695e07661 => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:06.154020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e894ada-1047-4bdf-85ad-ca45d6f9b96d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:06.154282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e894ada-1047-4bdf-85ad-ca45d6f9b96d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:06.154559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e894ada-1047-4bdf-85ad-ca45d6f9b96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:06.169349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:06.178838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8e894ada-1047-4bdf-85ad-ca45d6f9b96d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:06.180487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8e894ada-1047-4bdf-85ad-ca45d6f9b96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:06.268952 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 85/179] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:06.269958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106dab2-e10c-4b1e-983a-f52955b83a46 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:06.270242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106dab2-e10c-4b1e-983a-f52955b83a46 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:06.270515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106dab2-e10c-4b1e-983a-f52955b83a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:06.284207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0309e-dee5-441c-b0c2-7728c95e72b5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:06.289830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3106dab2-e10c-4b1e-983a-f52955b83a46 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:06.291057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3106dab2-e10c-4b1e-983a-f52955b83a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:06.336577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd468b-fb73-4f3e-ac42-c4558e2d177f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:06.337198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd468b-fb73-4f3e-ac42-c4558e2d177f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:06.337472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd468b-fb73-4f3e-ac42-c4558e2d177f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:06.337741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd468b-fb73-4f3e-ac42-c4558e2d177f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:06.393061 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 86/180] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:06.399277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dafa2-3fca-40dd-a905-1e493e62768f None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:06.400091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dafa2-3fca-40dd-a905-1e493e62768f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:06.400573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dafa2-3fca-40dd-a905-1e493e62768f None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:06.402899 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 87/181] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:06.404009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dafa2-3fca-40dd-a905-1e493e62768f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:06.433341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd468b-fb73-4f3e-ac42-c4558e2d177f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:06.434818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd468b-fb73-4f3e-ac42-c4558e2d177f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:06.447945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:06.457579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:06.528449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dafa2-3fca-40dd-a905-1e493e62768f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:06.569815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d9ffa-e206-47a9-b349-4314e3431afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:06.570775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d9ffa-e206-47a9-b349-4314e3431afa None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:06.571240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d9ffa-e206-47a9-b349-4314e3431afa None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:06.571680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d9ffa-e206-47a9-b349-4314e3431afa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:06.572255 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 95/182] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:06.573343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbf5d8-3557-4dcc-8fab-c4e5a6a5b940 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:06.573626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbf5d8-3557-4dcc-8fab-c4e5a6a5b940 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:06.573897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbf5d8-3557-4dcc-8fab-c4e5a6a5b940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:06.593491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7edbf5d8-3557-4dcc-8fab-c4e5a6a5b940 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:06.594682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7edbf5d8-3557-4dcc-8fab-c4e5a6a5b940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:06.649615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d9ffa-e206-47a9-b349-4314e3431afa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:06.651612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d9ffa-e206-47a9-b349-4314e3431afa None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:06.668843 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 96/183] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:06.669739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbf5d8-3557-4dcc-8fab-c4e5a6a5b940 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:06.697633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:06.732179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:06.774653 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 88/184] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:06.775553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d9ffa-e206-47a9-b349-4314e3431afa None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:06.784478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbf5d8-3557-4dcc-8fab-c4e5a6a5b940 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:06.822014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d81236-f331-4a16-ba0f-2e6272925be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:06.822657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d81236-f331-4a16-ba0f-2e6272925be8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:06.822933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d81236-f331-4a16-ba0f-2e6272925be8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:06.823211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d81236-f331-4a16-ba0f-2e6272925be8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:06.838168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d81236-f331-4a16-ba0f-2e6272925be8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:06.843155 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-74d81236-f331-4a16-ba0f-2e6272925be8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:03:06.843155 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:06.843155 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:06.843155 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:06.843155 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:06.843155 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:06.843155 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:06.843155 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:06.843155 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:06.843155 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:06.843155 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:06.843155 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:06.843155 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:06.843155 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:06.843155 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:06.843155 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:06.844126 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:06.844126 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:06.844126 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:06.844126 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:06.844126 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:06.844126 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:06.844126 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:06.844126 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:06.844126 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:06.844126 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:06.844126 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:06.844126 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:06.844126 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:06.844126 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:06.844126 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:06.844126 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:06.846113 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:06.846113 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:06.846113 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:06.846113 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:06.846113 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:06.846113 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:06.846113 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:06.846113 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:06.846113 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:06.846113 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:06.846113 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:03:06.846113 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:06.846113 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 97/185] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:03:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:06.848074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d81236-f331-4a16-ba0f-2e6272925be8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:06.890126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d9ffa-e206-47a9-b349-4314e3431afa None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:06.921606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:06.927756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a424599-01bd-4cfc-b3cd-0f2735364883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:06.928394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a424599-01bd-4cfc-b3cd-0f2735364883 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:06.928666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a424599-01bd-4cfc-b3cd-0f2735364883 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:06.928929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a424599-01bd-4cfc-b3cd-0f2735364883 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:06.940415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a424599-01bd-4cfc-b3cd-0f2735364883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:06.945310 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-7a424599-01bd-4cfc-b3cd-0f2735364883 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:06.945310 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:06.945310 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:06.945310 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:06.945310 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:06.945310 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:06.945310 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:06.945310 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:06.945310 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:06.945310 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:06.945310 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:06.945310 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:06.945310 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:06.945310 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:06.945310 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:06.945310 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:06.946256 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:06.946256 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:06.946256 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:06.946256 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:06.946256 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:06.946256 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:06.946256 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:06.946256 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:06.946256 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:06.946256 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:06.946256 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:06.946256 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:06.946256 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:06.946256 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:06.946256 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:06.946256 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:06.947136 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:06.947136 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:06.947136 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:06.947136 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:06.947136 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:06.947136 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:06.947136 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:06.947136 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:06.947136 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:06.947136 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:06.947136 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:06.947136 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:06.947136 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 89/186] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:03:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:06.947995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a424599-01bd-4cfc-b3cd-0f2735364883 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:06.966153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d81236-f331-4a16-ba0f-2e6272925be8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:06.976024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:07.000899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050beae-14c5-4fe4-8f26-44bfd7b658cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:07.001642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050beae-14c5-4fe4-8f26-44bfd7b658cd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:07.002021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050beae-14c5-4fe4-8f26-44bfd7b658cd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:07.002398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050beae-14c5-4fe4-8f26-44bfd7b658cd None admin] PATH_INFO: `/v3/projects/a126df3b78f349f5a943fdf96f8da737` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:07.003977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050beae-14c5-4fe4-8f26-44bfd7b658cd None admin] RBAC: Authorizing `identity:get_project(project_id=a126df3b78f349f5a943fdf96f8da737)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:07.005550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050beae-14c5-4fe4-8f26-44bfd7b658cd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:07.007213 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 98/187] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:06 2022] GET /identity/v3/projects/a126df3b78f349f5a943fdf96f8da737 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:07.012485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050beae-14c5-4fe4-8f26-44bfd7b658cd None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:07.052257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a424599-01bd-4cfc-b3cd-0f2735364883 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:07.088022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d711b0-bb0d-409d-913e-6005aa2f72c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:07.088647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d711b0-bb0d-409d-913e-6005aa2f72c5 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:07.088918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d711b0-bb0d-409d-913e-6005aa2f72c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:07.089221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d711b0-bb0d-409d-913e-6005aa2f72c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:07.099649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d711b0-bb0d-409d-913e-6005aa2f72c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:07.104485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-c4d711b0-bb0d-409d-913e-6005aa2f72c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:03:07.104485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:07.104485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:07.104485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:07.104485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:07.104485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:07.104485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:07.104485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:07.104485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:07.104485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:07.104485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:07.104485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:07.104485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:07.104485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:07.104485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:07.104485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:07.105325 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:07.105325 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:07.105325 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:07.105325 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:07.105325 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:07.105325 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:07.105325 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:07.105325 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:07.105325 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:07.105325 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:07.105325 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:07.105325 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:07.105325 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:07.105325 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:07.105325 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:07.105325 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:07.106491 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:07.106491 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:07.106491 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:07.106491 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:07.106491 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:07.106491 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:07.106491 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:07.106491 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:07.106491 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:07.106491 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:07.106491 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:03:07.106491 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:07.106491 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 90/188] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:07.106491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d711b0-bb0d-409d-913e-6005aa2f72c5 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:07.114223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050beae-14c5-4fe4-8f26-44bfd7b658cd None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:07.150987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f0f52-aecb-4fc5-8eb2-3acd648d32a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:07.151883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f0f52-aecb-4fc5-8eb2-3acd648d32a6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:07.152115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f0f52-aecb-4fc5-8eb2-3acd648d32a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:07.152379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f0f52-aecb-4fc5-8eb2-3acd648d32a6 None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:07.153625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f0f52-aecb-4fc5-8eb2-3acd648d32a6 None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:07.155164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f0f52-aecb-4fc5-8eb2-3acd648d32a6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:07.156857 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 99/189] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:07 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:07.157699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f0f52-aecb-4fc5-8eb2-3acd648d32a6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:07.165723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:07.203642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:07.215551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d711b0-bb0d-409d-913e-6005aa2f72c5 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:07.250627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5aca94-b359-4674-ac73-079c0488488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:07.251521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5aca94-b359-4674-ac73-079c0488488a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:07.251823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5aca94-b359-4674-ac73-079c0488488a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:07.252100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5aca94-b359-4674-ac73-079c0488488a None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:07.252785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5aca94-b359-4674-ac73-079c0488488a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:07.253094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5aca94-b359-4674-ac73-079c0488488a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:07.254513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5aca94-b359-4674-ac73-079c0488488a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:07.262508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f0f52-aecb-4fc5-8eb2-3acd648d32a6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:07.267858 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 91/190] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:07.267858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5aca94-b359-4674-ac73-079c0488488a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:07.301381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95766d-cc64-4aff-adc1-6df61814a1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:07.302013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95766d-cc64-4aff-adc1-6df61814a1cc None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:07.302344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95766d-cc64-4aff-adc1-6df61814a1cc None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:07.302561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95766d-cc64-4aff-adc1-6df61814a1cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:07.303706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95766d-cc64-4aff-adc1-6df61814a1cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:07.305175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95766d-cc64-4aff-adc1-6df61814a1cc None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:07.306737 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 100/191] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:07.311450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95766d-cc64-4aff-adc1-6df61814a1cc None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:07.367685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5aca94-b359-4674-ac73-079c0488488a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:07.381473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:07.403153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b406cf9-5b05-475f-b51b-9c5270ddb597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:07.403853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b406cf9-5b05-475f-b51b-9c5270ddb597 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:07.404130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b406cf9-5b05-475f-b51b-9c5270ddb597 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:07.404401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b406cf9-5b05-475f-b51b-9c5270ddb597 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:07.405068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b406cf9-5b05-475f-b51b-9c5270ddb597 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:07.405366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b406cf9-5b05-475f-b51b-9c5270ddb597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:07.406748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b406cf9-5b05-475f-b51b-9c5270ddb597 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:07.411443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95766d-cc64-4aff-adc1-6df61814a1cc None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:07.414819 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 92/192] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:03:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:07.415653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b406cf9-5b05-475f-b51b-9c5270ddb597 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:07.424666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:07.446323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe88e5-db2e-43a7-87ed-1c35ad6d5a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:07.446937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe88e5-db2e-43a7-87ed-1c35ad6d5a79 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:07.447214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe88e5-db2e-43a7-87ed-1c35ad6d5a79 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:07.447520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe88e5-db2e-43a7-87ed-1c35ad6d5a79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:07.448249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe88e5-db2e-43a7-87ed-1c35ad6d5a79 None admin] RBAC: Adding query filter params (role.id=dcabcc9bd3bf42149eed3abc0d4799c8, scope.project.id=a126df3b78f349f5a943fdf96f8da737, user.id=4190655e461b49b0932d472dd67ff9f0) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:07.448555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe88e5-db2e-43a7-87ed-1c35ad6d5a79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:07.450018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe88e5-db2e-43a7-87ed-1c35ad6d5a79 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:07.456200 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 101/193] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:03:07 2022] GET /identity/v3/role_assignments?user.id=4190655e461b49b0932d472dd67ff9f0&scope.project.id=a126df3b78f349f5a943fdf96f8da737&role.id=dcabcc9bd3bf42149eed3abc0d4799c8 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:07.457084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe88e5-db2e-43a7-87ed-1c35ad6d5a79 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:07.537021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b406cf9-5b05-475f-b51b-9c5270ddb597 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:07.578767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decf489-1f83-4a07-9463-f89e10cbda09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:07.579545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decf489-1f83-4a07-9463-f89e10cbda09 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:07.579932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decf489-1f83-4a07-9463-f89e10cbda09 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:07.580208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decf489-1f83-4a07-9463-f89e10cbda09 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:07.580931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decf489-1f83-4a07-9463-f89e10cbda09 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:07.581199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decf489-1f83-4a07-9463-f89e10cbda09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:07.582602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decf489-1f83-4a07-9463-f89e10cbda09 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:07.587465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe88e5-db2e-43a7-87ed-1c35ad6d5a79 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:07.592052 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 93/194] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:07.597500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decf489-1f83-4a07-9463-f89e10cbda09 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:07.630563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e420c56-a99d-4b21-84b4-f7a04380c1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:07.631192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e420c56-a99d-4b21-84b4-f7a04380c1e2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:07.631557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e420c56-a99d-4b21-84b4-f7a04380c1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:07.631924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e420c56-a99d-4b21-84b4-f7a04380c1e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:07.632665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e420c56-a99d-4b21-84b4-f7a04380c1e2 None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=1be8f0e040484baab23f1815ce704594, user.id=14ad14eb111e4774a71609d695e07661) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:07.632971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e420c56-a99d-4b21-84b4-f7a04380c1e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:07.634551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e420c56-a99d-4b21-84b4-f7a04380c1e2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:07.641176 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 102/195] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:03:07 2022] GET /identity/v3/role_assignments?user.id=14ad14eb111e4774a71609d695e07661&scope.project.id=1be8f0e040484baab23f1815ce704594&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:07.641783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e420c56-a99d-4b21-84b4-f7a04380c1e2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:07.646570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:07.705710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:07.735337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decf489-1f83-4a07-9463-f89e10cbda09 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:07.772762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012e7ef-2b73-4142-83d1-91ae15b9f14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:07.773408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012e7ef-2b73-4142-83d1-91ae15b9f14b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:07.773660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012e7ef-2b73-4142-83d1-91ae15b9f14b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:07.773956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012e7ef-2b73-4142-83d1-91ae15b9f14b None admin] PATH_INFO: `/v3/users/2860e5eefe5345518a39cf0fa184f95f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:07.787940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e420c56-a99d-4b21-84b4-f7a04380c1e2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:07.790885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012e7ef-2b73-4142-83d1-91ae15b9f14b None admin] RBAC: Authorizing `identity:get_user(user_id=2860e5eefe5345518a39cf0fa184f95f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:07.792396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012e7ef-2b73-4142-83d1-91ae15b9f14b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:07.799020 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 94/196] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:07 2022] GET /identity/v3/users/2860e5eefe5345518a39cf0fa184f95f => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:07.799020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012e7ef-2b73-4142-83d1-91ae15b9f14b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:07.832829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cf021-961a-44a8-a28c-ce211301ba7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:07.833776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cf021-961a-44a8-a28c-ce211301ba7e None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:07.834141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cf021-961a-44a8-a28c-ce211301ba7e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:07.834410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cf021-961a-44a8-a28c-ce211301ba7e None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:07.834962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cf021-961a-44a8-a28c-ce211301ba7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:07.836451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cf021-961a-44a8-a28c-ce211301ba7e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:07.862512 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 103/197] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:03:07 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:03:07.863417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cf021-961a-44a8-a28c-ce211301ba7e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:07.911939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:07.918733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012e7ef-2b73-4142-83d1-91ae15b9f14b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:07.960923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d3fb9-22d0-4ff9-86ca-1e3190512169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:07.961954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d3fb9-22d0-4ff9-86ca-1e3190512169 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:07.962432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d3fb9-22d0-4ff9-86ca-1e3190512169 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:07.962948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d3fb9-22d0-4ff9-86ca-1e3190512169 None admin] PATH_INFO: `/v3/users/2860e5eefe5345518a39cf0fa184f95f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:07.964396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d3fb9-22d0-4ff9-86ca-1e3190512169 None admin] RBAC: Authorizing `identity:get_user(user_id=2860e5eefe5345518a39cf0fa184f95f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:07.966125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d3fb9-22d0-4ff9-86ca-1e3190512169 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:07.968104 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 95/198] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:07 2022] GET /identity/v3/users/2860e5eefe5345518a39cf0fa184f95f => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:07.969152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d3fb9-22d0-4ff9-86ca-1e3190512169 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:07.991430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:07.999083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cf021-961a-44a8-a28c-ce211301ba7e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:08.041032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2c539-e5be-438a-be2a-b49895a50deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:08.041692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c539-e5be-438a-be2a-b49895a50deb None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:08.041972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c539-e5be-438a-be2a-b49895a50deb None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:08.042248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c539-e5be-438a-be2a-b49895a50deb None admin] PATH_INFO: `/v3/users/35a281fffb81466f9b5284b21b6b67d3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:08.043969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2c539-e5be-438a-be2a-b49895a50deb None admin] RBAC: Authorizing `identity:get_user(user_id=35a281fffb81466f9b5284b21b6b67d3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:08.045760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2c539-e5be-438a-be2a-b49895a50deb None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:08.047896 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 104/199] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:07 2022] GET /identity/v3/users/35a281fffb81466f9b5284b21b6b67d3 => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:08.048994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2c539-e5be-438a-be2a-b49895a50deb None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:08.091299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d3fb9-22d0-4ff9-86ca-1e3190512169 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:08.134433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93dca-b6b2-4789-a94d-52754bbf6574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:08.136358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93dca-b6b2-4789-a94d-52754bbf6574 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:08.136642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93dca-b6b2-4789-a94d-52754bbf6574 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:08.136915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93dca-b6b2-4789-a94d-52754bbf6574 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:08.168744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2c539-e5be-438a-be2a-b49895a50deb None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:08.174937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:08.209862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac971d-b6f0-46f6-9a91-7826cb8cbcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:08.210489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac971d-b6f0-46f6-9a91-7826cb8cbcd8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:08.210771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac971d-b6f0-46f6-9a91-7826cb8cbcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:08.211046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac971d-b6f0-46f6-9a91-7826cb8cbcd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:08.227486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f93dca-b6b2-4789-a94d-52754bbf6574 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:08.228965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f93dca-b6b2-4789-a94d-52754bbf6574 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:08.249582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:08.301253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac971d-b6f0-46f6-9a91-7826cb8cbcd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:08.303844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac971d-b6f0-46f6-9a91-7826cb8cbcd8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:08.358109 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 96/200] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:08.359424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93dca-b6b2-4789-a94d-52754bbf6574 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:08.436253 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 105/201] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:08.436440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac971d-b6f0-46f6-9a91-7826cb8cbcd8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:08.446473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:08.491819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93dca-b6b2-4789-a94d-52754bbf6574 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:08.501195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:08.532695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be22b5-e4aa-4422-97c6-b5b2def1fb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:08.533668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be22b5-e4aa-4422-97c6-b5b2def1fb5d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:08.534131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be22b5-e4aa-4422-97c6-b5b2def1fb5d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:08.534601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be22b5-e4aa-4422-97c6-b5b2def1fb5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:08.541441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac971d-b6f0-46f6-9a91-7826cb8cbcd8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:08.576348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a3b1f-3f70-49e7-92b5-fe8c3dee7d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:08.576914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a3b1f-3f70-49e7-92b5-fe8c3dee7d9e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:08.577193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a3b1f-3f70-49e7-92b5-fe8c3dee7d9e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:08.577466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a3b1f-3f70-49e7-92b5-fe8c3dee7d9e None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:08.578598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a3b1f-3f70-49e7-92b5-fe8c3dee7d9e None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:08.580236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a3b1f-3f70-49e7-92b5-fe8c3dee7d9e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:08.581822 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 106/202] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:08 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:08.582571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a3b1f-3f70-49e7-92b5-fe8c3dee7d9e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:08.636443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be22b5-e4aa-4422-97c6-b5b2def1fb5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:08.638250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be22b5-e4aa-4422-97c6-b5b2def1fb5d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:08.691243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a3b1f-3f70-49e7-92b5-fe8c3dee7d9e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:08.721317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:08.723640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:08.731162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a342b52-f83e-45ca-8d7d-c1b28cc5221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:08.732487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a342b52-f83e-45ca-8d7d-c1b28cc5221b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:08.733780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a342b52-f83e-45ca-8d7d-c1b28cc5221b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:08.734245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a342b52-f83e-45ca-8d7d-c1b28cc5221b None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:08.735621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a342b52-f83e-45ca-8d7d-c1b28cc5221b None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:08.737267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a342b52-f83e-45ca-8d7d-c1b28cc5221b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:08.745324 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 107/203] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:08 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:08.745324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a342b52-f83e-45ca-8d7d-c1b28cc5221b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:08.776470 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 97/204] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:08.777325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be22b5-e4aa-4422-97c6-b5b2def1fb5d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:08.863181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a342b52-f83e-45ca-8d7d-c1b28cc5221b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:08.899006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f37d6-0ac2-43c6-ad48-f3f71e07892e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:08.900021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f37d6-0ac2-43c6-ad48-f3f71e07892e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:08.900129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f37d6-0ac2-43c6-ad48-f3f71e07892e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:08.900352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f37d6-0ac2-43c6-ad48-f3f71e07892e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:08.901306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f37d6-0ac2-43c6-ad48-f3f71e07892e None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8, user.id=2860e5eefe5345518a39cf0fa184f95f) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:08.901568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f37d6-0ac2-43c6-ad48-f3f71e07892e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:08.903051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f37d6-0ac2-43c6-ad48-f3f71e07892e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:08.903967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be22b5-e4aa-4422-97c6-b5b2def1fb5d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:08.909106 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 108/205] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:03:08 2022] GET /identity/v3/role_assignments?user.id=2860e5eefe5345518a39cf0fa184f95f&scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:08.910081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f37d6-0ac2-43c6-ad48-f3f71e07892e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:08.953799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a878a-3461-4870-ab64-e0a92dc8b949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:08.954881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a878a-3461-4870-ab64-e0a92dc8b949 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:08.956024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a878a-3461-4870-ab64-e0a92dc8b949 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:08.956502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a878a-3461-4870-ab64-e0a92dc8b949 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:08.957867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a878a-3461-4870-ab64-e0a92dc8b949 None admin] RBAC: Adding query filter params (role.id=81040db4535e417891c10dd996b1eac5, scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8, user.id=2860e5eefe5345518a39cf0fa184f95f) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:08.958397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a878a-3461-4870-ab64-e0a92dc8b949 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:08.960990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a878a-3461-4870-ab64-e0a92dc8b949 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:08.975940 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 98/206] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:03:08 2022] GET /identity/v3/role_assignments?user.id=2860e5eefe5345518a39cf0fa184f95f&scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8&role.id=81040db4535e417891c10dd996b1eac5 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:09.003707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:09.031081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f37d6-0ac2-43c6-ad48-f3f71e07892e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:09.074389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edb78e-ee73-433b-a97a-e3894cd8671f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:09.075074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edb78e-ee73-433b-a97a-e3894cd8671f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:09.075399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edb78e-ee73-433b-a97a-e3894cd8671f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:09.075728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edb78e-ee73-433b-a97a-e3894cd8671f None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:09.077071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47edb78e-ee73-433b-a97a-e3894cd8671f None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:09.078857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47edb78e-ee73-433b-a97a-e3894cd8671f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:09.082072 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 109/207] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:08 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:09.088105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a878a-3461-4870-ab64-e0a92dc8b949 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:09.136439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:09.223300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a878a-3461-4870-ab64-e0a92dc8b949 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:09.262804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43472e25-e56d-4f4a-ba1f-a865836f624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:09.263472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43472e25-e56d-4f4a-ba1f-a865836f624e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:09.263751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43472e25-e56d-4f4a-ba1f-a865836f624e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:09.264022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43472e25-e56d-4f4a-ba1f-a865836f624e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:09.264757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43472e25-e56d-4f4a-ba1f-a865836f624e None admin] RBAC: Adding query filter params (role.id=3e7c7ed373dc46829d37081c99a331a0, scope.project.id=1be8f0e040484baab23f1815ce704594, user.id=35a281fffb81466f9b5284b21b6b67d3) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:09.265061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43472e25-e56d-4f4a-ba1f-a865836f624e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:09.266519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43472e25-e56d-4f4a-ba1f-a865836f624e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:09.273427 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 99/208] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:03:09 2022] GET /identity/v3/role_assignments?user.id=35a281fffb81466f9b5284b21b6b67d3&scope.project.id=1be8f0e040484baab23f1815ce704594&role.id=3e7c7ed373dc46829d37081c99a331a0 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:09.982905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfb1d4-36a9-49a2-9b14-d137181a5525 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:09.983463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfb1d4-36a9-49a2-9b14-d137181a5525 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:09.983463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfb1d4-36a9-49a2-9b14-d137181a5525 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:09.985073 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 110/209] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:09.990761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8815a1-292f-4f96-ae1c-554f5feb1089 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:09.991237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8815a1-292f-4f96-ae1c-554f5feb1089 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:09.991364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8815a1-292f-4f96-ae1c-554f5feb1089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:10.014050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2a8815a1-292f-4f96-ae1c-554f5feb1089 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:10.015568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2a8815a1-292f-4f96-ae1c-554f5feb1089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:10.091542 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 100/210] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:10.236726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218906a-4bd2-40cb-b9a1-60d9b9b53f3b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:10.236973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218906a-4bd2-40cb-b9a1-60d9b9b53f3b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:10.237483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218906a-4bd2-40cb-b9a1-60d9b9b53f3b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:10.239032 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 111/211] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:10.244553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7ff80-9487-4ed3-a0c9-6f61f928c0f8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:10.244837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7ff80-9487-4ed3-a0c9-6f61f928c0f8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:10.245337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7ff80-9487-4ed3-a0c9-6f61f928c0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:10.271127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-60f7ff80-9487-4ed3-a0c9-6f61f928c0f8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:10.272704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-60f7ff80-9487-4ed3-a0c9-6f61f928c0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:10.291618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:10.344219 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 101/212] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:10.364764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218906a-4bd2-40cb-b9a1-60d9b9b53f3b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:10.468468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218906a-4bd2-40cb-b9a1-60d9b9b53f3b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:10.499735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:10.505071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cf9b4-055f-4d3c-8d9c-49306f641d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:10.505726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cf9b4-055f-4d3c-8d9c-49306f641d2e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:10.506121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cf9b4-055f-4d3c-8d9c-49306f641d2e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:10.506392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cf9b4-055f-4d3c-8d9c-49306f641d2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:10.518543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cf9b4-055f-4d3c-8d9c-49306f641d2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:10.523517 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-385cf9b4-055f-4d3c-8d9c-49306f641d2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:10.523517 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:10.523517 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:10.523517 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:10.523517 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:10.523517 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:10.523517 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:10.523517 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:10.523517 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:10.523517 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:10.523517 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:10.523517 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:10.523517 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:10.523517 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:10.523517 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:10.523517 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:10.524378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:10.524378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:10.524378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:10.524378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:10.524378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:10.524378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:10.524378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:10.524378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:10.524378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:10.524378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:10.524378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:10.524378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:10.524378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:10.524378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:10.524378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:10.524378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:10.525171 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:10.525171 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:10.525171 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:10.525171 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:10.525171 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:10.525171 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:10.525171 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:10.525171 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:10.525171 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:10.525171 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:10.525171 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:10.525171 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:10.525171 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 112/213] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:10.531127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7ff80-9487-4ed3-a0c9-6f61f928c0f8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:10.618511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cf9b4-055f-4d3c-8d9c-49306f641d2e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:10.644483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7ff80-9487-4ed3-a0c9-6f61f928c0f8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:10.681392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93aad4-5d5c-4f48-b33f-c197c9696793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:10.682069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93aad4-5d5c-4f48-b33f-c197c9696793 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:10.682351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93aad4-5d5c-4f48-b33f-c197c9696793 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:10.682695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93aad4-5d5c-4f48-b33f-c197c9696793 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:10.683471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93aad4-5d5c-4f48-b33f-c197c9696793 None admin] RBAC: Adding query filter params (name=member) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:10.683870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93aad4-5d5c-4f48-b33f-c197c9696793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:10.685404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93aad4-5d5c-4f48-b33f-c197c9696793 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:10.699955 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 102/214] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:10.700944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93aad4-5d5c-4f48-b33f-c197c9696793 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:10.720600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:10.749252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cf9b4-055f-4d3c-8d9c-49306f641d2e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:10.792816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4baf96e-d94c-4587-95a9-d1885de22321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:10.793509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4baf96e-d94c-4587-95a9-d1885de22321 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:10.793796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4baf96e-d94c-4587-95a9-d1885de22321 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:10.794071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4baf96e-d94c-4587-95a9-d1885de22321 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:10.795351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4baf96e-d94c-4587-95a9-d1885de22321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:10.796854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4baf96e-d94c-4587-95a9-d1885de22321 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:10.803236 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 113/215] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:10.804178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4baf96e-d94c-4587-95a9-d1885de22321 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:10.829025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93aad4-5d5c-4f48-b33f-c197c9696793 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:10.873980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebdb18-073b-4795-8de8-93e36c19a374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:10.874892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebdb18-073b-4795-8de8-93e36c19a374 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:10.875172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebdb18-073b-4795-8de8-93e36c19a374 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:10.875474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebdb18-073b-4795-8de8-93e36c19a374 None admin] PATH_INFO: `/v3/users/081951afe4134865b91174ed238fe09c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:10.877047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:10.899468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebdb18-073b-4795-8de8-93e36c19a374 None admin] RBAC: Authorizing `identity:get_user(user_id=081951afe4134865b91174ed238fe09c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:10.902714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebdb18-073b-4795-8de8-93e36c19a374 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:10.905125 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 103/216] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:10 2022] GET /identity/v3/users/081951afe4134865b91174ed238fe09c => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:10.911577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebdb18-073b-4795-8de8-93e36c19a374 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:10.932101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4baf96e-d94c-4587-95a9-d1885de22321 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:10.979739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0292562-8d62-42b5-adbd-92cdea4df9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:10.980608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0292562-8d62-42b5-adbd-92cdea4df9a1 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:10.980889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0292562-8d62-42b5-adbd-92cdea4df9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:10.981398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0292562-8d62-42b5-adbd-92cdea4df9a1 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:10.982507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0292562-8d62-42b5-adbd-92cdea4df9a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:10.984256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0292562-8d62-42b5-adbd-92cdea4df9a1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:10.991315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:11.018475 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 114/217] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:03:10 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:03:11.035587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebdb18-073b-4795-8de8-93e36c19a374 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:11.039454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e67d6-b0e9-4349-9ebd-ca55d977c4b5 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:11.039771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e67d6-b0e9-4349-9ebd-ca55d977c4b5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:11.040049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e67d6-b0e9-4349-9ebd-ca55d977c4b5 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:11.041774 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 115/218] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:11.047725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b95441-dff7-469f-a7ec-6f939f029552 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:11.048234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b95441-dff7-469f-a7ec-6f939f029552 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:11.048758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b95441-dff7-469f-a7ec-6f939f029552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:11.071772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b7b95441-dff7-469f-a7ec-6f939f029552 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:11.073311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7b95441-dff7-469f-a7ec-6f939f029552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:11.082137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f08f5-f554-40ee-a0af-284e91c5a2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:11.082777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f08f5-f554-40ee-a0af-284e91c5a2e4 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:11.083110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f08f5-f554-40ee-a0af-284e91c5a2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:11.083422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f08f5-f554-40ee-a0af-284e91c5a2e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:11.162398 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 116/219] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:11.163899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752ac66-50a3-4cbe-8def-4b175f9a70da None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:11.164168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752ac66-50a3-4cbe-8def-4b175f9a70da None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:11.164436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752ac66-50a3-4cbe-8def-4b175f9a70da None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:11.165951 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 117/220] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:11.175420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80393ee8-7306-41e9-b538-449b0f71e90d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:11.175420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80393ee8-7306-41e9-b538-449b0f71e90d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:11.175420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80393ee8-7306-41e9-b538-449b0f71e90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:11.182638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f08f5-f554-40ee-a0af-284e91c5a2e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:11.184164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f08f5-f554-40ee-a0af-284e91c5a2e4 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:11.201196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-80393ee8-7306-41e9-b538-449b0f71e90d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:11.203697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80393ee8-7306-41e9-b538-449b0f71e90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:11.258179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:11.281304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:11.294185 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 118/221] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:11.324983 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 104/222] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 18:03:11.330637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80393ee8-7306-41e9-b538-449b0f71e90d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:11.445145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80393ee8-7306-41e9-b538-449b0f71e90d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:11.453101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f08f5-f554-40ee-a0af-284e91c5a2e4 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:11.484718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e55f2-be6e-4896-8223-36bf965f5641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:11.485367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e55f2-be6e-4896-8223-36bf965f5641 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:11.485650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e55f2-be6e-4896-8223-36bf965f5641 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:11.485925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e55f2-be6e-4896-8223-36bf965f5641 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:11.487076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e55f2-be6e-4896-8223-36bf965f5641 None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:11.488602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e55f2-be6e-4896-8223-36bf965f5641 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:11.491214 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 119/223] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:11 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:11.496074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e55f2-be6e-4896-8223-36bf965f5641 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:11.570598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:11.583038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f08f5-f554-40ee-a0af-284e91c5a2e4 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:11.629066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffbfa2-a0df-498c-bee1-54c48cad7dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:11.629752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffbfa2-a0df-498c-bee1-54c48cad7dec None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:11.630452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffbfa2-a0df-498c-bee1-54c48cad7dec None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:11.630737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffbfa2-a0df-498c-bee1-54c48cad7dec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:11.640081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e55f2-be6e-4896-8223-36bf965f5641 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:11.649558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ffbfa2-a0df-498c-bee1-54c48cad7dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:11.656601 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-07ffbfa2-a0df-498c-bee1-54c48cad7dec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:03:11.656601 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:11.656601 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:11.656601 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:11.656601 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:11.656601 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:11.656601 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:11.656601 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:11.656601 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:11.656601 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:11.656601 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:11.656601 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:11.656601 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:11.656601 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:11.656601 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:11.656601 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:11.657492 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:11.657492 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:11.657492 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:11.657492 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:11.657492 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:11.657492 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:11.657492 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:11.657492 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:11.657492 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:11.657492 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:11.657492 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:11.657492 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:11.657492 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:11.657492 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:11.657492 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:11.657492 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:11.658264 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:11.658264 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:11.658264 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:11.658264 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:11.658264 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:11.658264 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:11.658264 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:11.658264 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:11.658264 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:11.658264 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:11.658264 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:03:11.658264 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:11.658264 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 105/224] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:03:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:03:11.658921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffbfa2-a0df-498c-bee1-54c48cad7dec None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:11.682568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105b298-905d-44e7-9a0c-9c06cf3ac594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:11.683214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105b298-905d-44e7-9a0c-9c06cf3ac594 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:11.683534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105b298-905d-44e7-9a0c-9c06cf3ac594 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:11.683772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105b298-905d-44e7-9a0c-9c06cf3ac594 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:11.684586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105b298-905d-44e7-9a0c-9c06cf3ac594 None admin] RBAC: Adding query filter params (role.id=dcabcc9bd3bf42149eed3abc0d4799c8, scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8, user.id=081951afe4134865b91174ed238fe09c) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:11.684931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105b298-905d-44e7-9a0c-9c06cf3ac594 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:11.686447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105b298-905d-44e7-9a0c-9c06cf3ac594 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:11.692567 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 120/225] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:03:11 2022] GET /identity/v3/role_assignments?user.id=081951afe4134865b91174ed238fe09c&scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8&role.id=dcabcc9bd3bf42149eed3abc0d4799c8 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:11.699613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105b298-905d-44e7-9a0c-9c06cf3ac594 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:11.717745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:11.877112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105b298-905d-44e7-9a0c-9c06cf3ac594 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:11.880863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffbfa2-a0df-498c-bee1-54c48cad7dec None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:11.890276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:11.920088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108b2d0-1f6c-4a59-8f12-23f3b58805c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:11.921127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108b2d0-1f6c-4a59-8f12-23f3b58805c6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:11.921691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108b2d0-1f6c-4a59-8f12-23f3b58805c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:11.922168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108b2d0-1f6c-4a59-8f12-23f3b58805c6 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:11.923048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108b2d0-1f6c-4a59-8f12-23f3b58805c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:11.923662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108b2d0-1f6c-4a59-8f12-23f3b58805c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:11.925477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108b2d0-1f6c-4a59-8f12-23f3b58805c6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:11.932059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84037c8-9693-45be-86ce-57164eac6b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:11.932769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84037c8-9693-45be-86ce-57164eac6b4b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:11.933051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84037c8-9693-45be-86ce-57164eac6b4b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:11.933323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84037c8-9693-45be-86ce-57164eac6b4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:11.936021 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 121/226] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:11.945835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108b2d0-1f6c-4a59-8f12-23f3b58805c6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:11.956704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84037c8-9693-45be-86ce-57164eac6b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:11.961996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-a84037c8-9693-45be-86ce-57164eac6b4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:11.961996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:11.961996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:11.961996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:11.961996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:11.961996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:11.961996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:11.961996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:11.961996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:11.961996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:11.961996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:11.961996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:11.961996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:11.961996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:11.961996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:11.961996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:11.962904 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:11.962904 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:11.962904 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:11.962904 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:11.962904 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:11.962904 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:11.962904 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:11.962904 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:11.962904 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:11.962904 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:11.962904 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:11.962904 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:11.962904 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:11.962904 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:11.962904 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:11.962904 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:11.964752 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:11.964752 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:11.964752 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:11.964752 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:11.964752 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:11.964752 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:11.964752 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:11.964752 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:11.964752 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:11.964752 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:11.964752 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:11.964752 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:11.967546 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 106/227] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:03:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:11.974573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84037c8-9693-45be-86ce-57164eac6b4b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:12.078697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108b2d0-1f6c-4a59-8f12-23f3b58805c6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:12.123381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d47d78-c9f1-4bb4-ae54-ef858fb703e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:12.124034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d47d78-c9f1-4bb4-ae54-ef858fb703e7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:12.124309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d47d78-c9f1-4bb4-ae54-ef858fb703e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:12.124579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d47d78-c9f1-4bb4-ae54-ef858fb703e7 None admin] PATH_INFO: `/v3/users/2860e5eefe5345518a39cf0fa184f95f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:12.126454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d47d78-c9f1-4bb4-ae54-ef858fb703e7 None admin] RBAC: Authorizing `identity:get_user(user_id=2860e5eefe5345518a39cf0fa184f95f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:12.128042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d47d78-c9f1-4bb4-ae54-ef858fb703e7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:12.132283 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 122/228] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:11 2022] GET /identity/v3/users/2860e5eefe5345518a39cf0fa184f95f => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:12.139277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d47d78-c9f1-4bb4-ae54-ef858fb703e7 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:12.200313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:12.201772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:12.229393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84037c8-9693-45be-86ce-57164eac6b4b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:12.264524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d47d78-c9f1-4bb4-ae54-ef858fb703e7 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:12.319804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d97ebd-ff73-4cd5-a177-72a4064bff36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:12.320429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d97ebd-ff73-4cd5-a177-72a4064bff36 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:12.320708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d97ebd-ff73-4cd5-a177-72a4064bff36 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:12.320987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d97ebd-ff73-4cd5-a177-72a4064bff36 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:12.321669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d97ebd-ff73-4cd5-a177-72a4064bff36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:12.321973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d97ebd-ff73-4cd5-a177-72a4064bff36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:12.323396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d97ebd-ff73-4cd5-a177-72a4064bff36 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:12.337473 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 107/229] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:03:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:12.342938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d97ebd-ff73-4cd5-a177-72a4064bff36 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:12.344963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80ee67-7d83-4bc9-8d7c-ee560430e344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:12.345923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80ee67-7d83-4bc9-8d7c-ee560430e344 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:12.346213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80ee67-7d83-4bc9-8d7c-ee560430e344 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:12.346493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80ee67-7d83-4bc9-8d7c-ee560430e344 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:12.347925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80ee67-7d83-4bc9-8d7c-ee560430e344 None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:12.350351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80ee67-7d83-4bc9-8d7c-ee560430e344 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:12.358442 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 123/230] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:12 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:12.363032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80ee67-7d83-4bc9-8d7c-ee560430e344 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:12.515524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80ee67-7d83-4bc9-8d7c-ee560430e344 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:12.526622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:12.551763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523927f-3b0d-430d-9ec7-15ec0dd5be31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:12.552446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523927f-3b0d-430d-9ec7-15ec0dd5be31 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:12.552724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523927f-3b0d-430d-9ec7-15ec0dd5be31 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:12.552989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523927f-3b0d-430d-9ec7-15ec0dd5be31 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8/users/2860e5eefe5345518a39cf0fa184f95f/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:12.563286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523927f-3b0d-430d-9ec7-15ec0dd5be31 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a529bd5dd924e93a8b2eb90a47878d8, user_id=2860e5eefe5345518a39cf0fa184f95f, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:12.563286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523927f-3b0d-430d-9ec7-15ec0dd5be31 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:12.565730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d97ebd-ff73-4cd5-a177-72a4064bff36 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:12.590262 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 124/231] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:03:12 2022] PUT /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8/users/2860e5eefe5345518a39cf0fa184f95f/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:03:12.635935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45abee8-eb8a-4113-bcdc-6552069a5554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:12.636616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45abee8-eb8a-4113-bcdc-6552069a5554 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:12.636898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45abee8-eb8a-4113-bcdc-6552069a5554 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:12.637175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45abee8-eb8a-4113-bcdc-6552069a5554 None admin] PATH_INFO: `/v3/users/2860e5eefe5345518a39cf0fa184f95f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:12.638739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45abee8-eb8a-4113-bcdc-6552069a5554 None admin] RBAC: Authorizing `identity:get_user(user_id=2860e5eefe5345518a39cf0fa184f95f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:12.640368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45abee8-eb8a-4113-bcdc-6552069a5554 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:12.642453 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 108/232] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:12 2022] GET /identity/v3/users/2860e5eefe5345518a39cf0fa184f95f => generated 283 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:12.648021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523927f-3b0d-430d-9ec7-15ec0dd5be31 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:12.790516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523927f-3b0d-430d-9ec7-15ec0dd5be31 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:12.830523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f263141-cc61-4bd2-9b26-114e7ff43110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:12.831577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f263141-cc61-4bd2-9b26-114e7ff43110 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:12.832043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f263141-cc61-4bd2-9b26-114e7ff43110 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:12.832518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f263141-cc61-4bd2-9b26-114e7ff43110 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:12.833838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f263141-cc61-4bd2-9b26-114e7ff43110 None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:12.835534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f263141-cc61-4bd2-9b26-114e7ff43110 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:12.837670 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 125/233] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:12 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:12.843212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45abee8-eb8a-4113-bcdc-6552069a5554 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:12.870908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:12.951337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45abee8-eb8a-4113-bcdc-6552069a5554 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:12.999991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d1b3d-c12b-4b73-b01e-36c3cd29fda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:13.001089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d1b3d-c12b-4b73-b01e-36c3cd29fda8 None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:13.001628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d1b3d-c12b-4b73-b01e-36c3cd29fda8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:13.002120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d1b3d-c12b-4b73-b01e-36c3cd29fda8 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8/users/2860e5eefe5345518a39cf0fa184f95f/roles/81040db4535e417891c10dd996b1eac5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:13.008021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d1b3d-c12b-4b73-b01e-36c3cd29fda8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a529bd5dd924e93a8b2eb90a47878d8, user_id=2860e5eefe5345518a39cf0fa184f95f, role_id=81040db4535e417891c10dd996b1eac5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:13.010111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d1b3d-c12b-4b73-b01e-36c3cd29fda8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:13.027939 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 109/234] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:03:12 2022] PUT /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8/users/2860e5eefe5345518a39cf0fa184f95f/roles/81040db4535e417891c10dd996b1eac5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:03:13.580698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61d85f-a811-4c5a-84cc-527fb5934f00 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:13.581667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61d85f-a811-4c5a-84cc-527fb5934f00 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:13.582138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61d85f-a811-4c5a-84cc-527fb5934f00 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:13.584036 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 126/235] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:13.589763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df5893-0ad2-4a07-8cc0-eab84e607f1c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:13.590617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df5893-0ad2-4a07-8cc0-eab84e607f1c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:13.591122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df5893-0ad2-4a07-8cc0-eab84e607f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:13.613899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-30df5893-0ad2-4a07-8cc0-eab84e607f1c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:13.615455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-30df5893-0ad2-4a07-8cc0-eab84e607f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:13.709933 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 110/236] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:13.770790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bdd7c-523c-4586-937f-9a0ef3912af9 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:13.771658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bdd7c-523c-4586-937f-9a0ef3912af9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:13.772300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bdd7c-523c-4586-937f-9a0ef3912af9 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:13.773864 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 127/237] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:13.784735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d031d9-39fa-40fa-9ff4-574dbd7beb58 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:13.785318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d031d9-39fa-40fa-9ff4-574dbd7beb58 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:13.785805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d031d9-39fa-40fa-9ff4-574dbd7beb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:13.813532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-18d031d9-39fa-40fa-9ff4-574dbd7beb58 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:13.815651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-18d031d9-39fa-40fa-9ff4-574dbd7beb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:13.828016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:13.894004 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 111/238] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:14.022587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be6af9-d1d2-403c-bfd0-73f4df371107 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:14.022911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be6af9-d1d2-403c-bfd0-73f4df371107 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:14.023147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be6af9-d1d2-403c-bfd0-73f4df371107 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:14.024813 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 128/239] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:14.030177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e53f1-cb6b-4615-b660-ab33190100fe None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:14.030544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e53f1-cb6b-4615-b660-ab33190100fe None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:14.030823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e53f1-cb6b-4615-b660-ab33190100fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:14.050029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8e6e53f1-cb6b-4615-b660-ab33190100fe None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:14.051735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8e6e53f1-cb6b-4615-b660-ab33190100fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:14.066317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be6af9-d1d2-403c-bfd0-73f4df371107 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:14.130418 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 112/240] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:03:14.148571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:14.180073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e53f1-cb6b-4615-b660-ab33190100fe None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:14.250127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be6af9-d1d2-403c-bfd0-73f4df371107 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:14.316045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:14.322510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368ccbf-1b10-4f58-9db0-38067357a193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:14.325304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368ccbf-1b10-4f58-9db0-38067357a193 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:14.325863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368ccbf-1b10-4f58-9db0-38067357a193 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:14.326333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368ccbf-1b10-4f58-9db0-38067357a193 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:14.350564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368ccbf-1b10-4f58-9db0-38067357a193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:14.363472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-5368ccbf-1b10-4f58-9db0-38067357a193 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:03:14.363472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:14.363472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:14.363472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:14.363472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:14.363472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:14.363472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:14.363472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:14.363472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:14.363472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:14.363472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:14.363472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:14.363472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:14.363472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:14.363472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:14.363472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:14.364409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:14.364409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:14.364409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:14.364409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:14.364409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:14.364409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:14.364409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:14.364409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:14.364409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:14.364409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:14.364409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:14.364409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:14.364409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:14.364409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:14.364409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:14.364409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:14.365595 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:14.365595 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:14.365595 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:14.365595 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:14.365595 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:14.365595 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:14.365595 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:14.365595 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:14.365595 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:14.365595 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:14.365595 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:03:14.365595 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:14.365595 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 129/241] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:14.372197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368ccbf-1b10-4f58-9db0-38067357a193 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:14.376204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e53f1-cb6b-4615-b660-ab33190100fe None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:14.416552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aed8e4-1657-42c5-bcb3-aa7e5bffb88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:14.417251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aed8e4-1657-42c5-bcb3-aa7e5bffb88d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:14.417530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aed8e4-1657-42c5-bcb3-aa7e5bffb88d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:14.417806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aed8e4-1657-42c5-bcb3-aa7e5bffb88d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:14.420822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aed8e4-1657-42c5-bcb3-aa7e5bffb88d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:14.422293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aed8e4-1657-42c5-bcb3-aa7e5bffb88d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:14.426580 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 113/242] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:14.434227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aed8e4-1657-42c5-bcb3-aa7e5bffb88d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:14.538796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:14.547771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368ccbf-1b10-4f58-9db0-38067357a193 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:14.561111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aed8e4-1657-42c5-bcb3-aa7e5bffb88d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:14.586175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2331fa3-0823-4fdd-9388-99caa6caa278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:14.587486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2331fa3-0823-4fdd-9388-99caa6caa278 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:14.588054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2331fa3-0823-4fdd-9388-99caa6caa278 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:14.588548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2331fa3-0823-4fdd-9388-99caa6caa278 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:14.589467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2331fa3-0823-4fdd-9388-99caa6caa278 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:14.590005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2331fa3-0823-4fdd-9388-99caa6caa278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:14.591918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2331fa3-0823-4fdd-9388-99caa6caa278 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:14.600191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d93323-8992-4ab7-84b5-4fed9f95c97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:14.600873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93323-8992-4ab7-84b5-4fed9f95c97b None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:14.601087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93323-8992-4ab7-84b5-4fed9f95c97b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:14.601355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93323-8992-4ab7-84b5-4fed9f95c97b None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:14.602027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d93323-8992-4ab7-84b5-4fed9f95c97b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:14.603559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d93323-8992-4ab7-84b5-4fed9f95c97b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:14.603692 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 130/243] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:14.610171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2331fa3-0823-4fdd-9388-99caa6caa278 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:14.615467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:14.630918 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 114/244] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:03:14 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:03:14.631854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d93323-8992-4ab7-84b5-4fed9f95c97b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:14.749205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d93323-8992-4ab7-84b5-4fed9f95c97b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:14.790239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a176cad-1c32-4323-b2e0-e8731d55e439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:14.791653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a176cad-1c32-4323-b2e0-e8731d55e439 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:14.791653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a176cad-1c32-4323-b2e0-e8731d55e439 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:14.791653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a176cad-1c32-4323-b2e0-e8731d55e439 None admin] PATH_INFO: `/v3/users/d763afa2271b45b4ad785b3a0b392f8d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:14.807108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a176cad-1c32-4323-b2e0-e8731d55e439 None admin] RBAC: Authorizing `identity:get_user(user_id=d763afa2271b45b4ad785b3a0b392f8d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:14.808785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a176cad-1c32-4323-b2e0-e8731d55e439 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:14.810754 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 115/245] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:14 2022] GET /identity/v3/users/d763afa2271b45b4ad785b3a0b392f8d => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:14.813936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2331fa3-0823-4fdd-9388-99caa6caa278 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:14.817717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a176cad-1c32-4323-b2e0-e8731d55e439 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:14.861038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f66e7c-939b-4a35-b023-74e78a94050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:14.862055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f66e7c-939b-4a35-b023-74e78a94050f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:14.862559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f66e7c-939b-4a35-b023-74e78a94050f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:14.863028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f66e7c-939b-4a35-b023-74e78a94050f None admin] PATH_INFO: `/v3/roles/member` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:14.886658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f66e7c-939b-4a35-b023-74e78a94050f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:14.892501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e5f66e7c-939b-4a35-b023-74e78a94050f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:14.892501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:14.892501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:14.892501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:14.892501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:14.892501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:14.892501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:14.892501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:14.892501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:14.892501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:14.892501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:14.892501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:14.892501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:14.892501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:14.892501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:14.892501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:14.893433 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:14.893433 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:14.893433 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:14.893433 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:14.893433 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:14.893433 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:14.893433 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:14.893433 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:14.893433 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:14.893433 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:14.893433 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:14.893433 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:14.893433 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:14.893433 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:14.893433 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:14.893433 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:14.894319 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:14.894319 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:14.894319 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:14.894319 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:14.894319 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:14.894319 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:14.894319 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:14.894319 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:14.894319 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:14.894319 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:14.894319 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:14.894319 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:14.894319 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 131/246] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:14.905709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:14.907560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f66e7c-939b-4a35-b023-74e78a94050f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:14.932444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:14.966132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a176cad-1c32-4323-b2e0-e8731d55e439 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:15.010317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d0947-d2a8-40c2-b753-fc6dfcb616f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:15.011177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d0947-d2a8-40c2-b753-fc6dfcb616f8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:15.011498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d0947-d2a8-40c2-b753-fc6dfcb616f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:15.012239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d0947-d2a8-40c2-b753-fc6dfcb616f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:15.036847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f66e7c-939b-4a35-b023-74e78a94050f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:15.072448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5055d-f09d-4d87-be90-0b3a22afa7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:15.073072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5055d-f09d-4d87-be90-0b3a22afa7fd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:15.073350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5055d-f09d-4d87-be90-0b3a22afa7fd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:15.073623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5055d-f09d-4d87-be90-0b3a22afa7fd None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:15.074296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5055d-f09d-4d87-be90-0b3a22afa7fd None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:15.074597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5055d-f09d-4d87-be90-0b3a22afa7fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:15.078783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5055d-f09d-4d87-be90-0b3a22afa7fd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:15.092631 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 132/247] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:15.099289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5055d-f09d-4d87-be90-0b3a22afa7fd None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:15.114226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d0947-d2a8-40c2-b753-fc6dfcb616f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:15.116059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d0947-d2a8-40c2-b753-fc6dfcb616f8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:15.193524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:15.218760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:15.254473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5055d-f09d-4d87-be90-0b3a22afa7fd None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:15.265838 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 116/248] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 18:03:15.268081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bdf6d-203b-4b9b-aa83-056ac5c31bcc None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:15.268367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bdf6d-203b-4b9b-aa83-056ac5c31bcc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:15.268644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bdf6d-203b-4b9b-aa83-056ac5c31bcc None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:15.275285 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 117/249] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:15.275285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bdf6d-203b-4b9b-aa83-056ac5c31bcc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:15.304913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b584d21-cc98-498e-8b6f-70ae8424770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:15.306005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b584d21-cc98-498e-8b6f-70ae8424770c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:15.306379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b584d21-cc98-498e-8b6f-70ae8424770c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:15.306747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b584d21-cc98-498e-8b6f-70ae8424770c None admin] PATH_INFO: `/v3/users/081951afe4134865b91174ed238fe09c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:15.308532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b584d21-cc98-498e-8b6f-70ae8424770c None admin] RBAC: Authorizing `identity:get_user(user_id=081951afe4134865b91174ed238fe09c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:15.310552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b584d21-cc98-498e-8b6f-70ae8424770c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:15.315340 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 133/250] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:15 2022] GET /identity/v3/users/081951afe4134865b91174ed238fe09c => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:15.317381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f069dfe-dcd5-4361-b222-893fd89d5322 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:15.318167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f069dfe-dcd5-4361-b222-893fd89d5322 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:15.319058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f069dfe-dcd5-4361-b222-893fd89d5322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:15.340351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7f069dfe-dcd5-4361-b222-893fd89d5322 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:15.341758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7f069dfe-dcd5-4361-b222-893fd89d5322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:15.406486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bdf6d-203b-4b9b-aa83-056ac5c31bcc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:15.442057 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 134/251] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:15.443353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f069dfe-dcd5-4361-b222-893fd89d5322 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:15.456010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10011f8d-23c5-4214-b0d4-cab490eacc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:15.456682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10011f8d-23c5-4214-b0d4-cab490eacc2b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:15.456970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10011f8d-23c5-4214-b0d4-cab490eacc2b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:15.457242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10011f8d-23c5-4214-b0d4-cab490eacc2b None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:15.458639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10011f8d-23c5-4214-b0d4-cab490eacc2b None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:15.459942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10011f8d-23c5-4214-b0d4-cab490eacc2b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:15.466542 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 118/252] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:15 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:15.486751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10011f8d-23c5-4214-b0d4-cab490eacc2b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:15.545409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:15.563612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:15.606565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f069dfe-dcd5-4361-b222-893fd89d5322 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:15.681463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10011f8d-23c5-4214-b0d4-cab490eacc2b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:15.704129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49433b-2d89-47f5-a016-f6fba34e726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:15.705136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49433b-2d89-47f5-a016-f6fba34e726e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:15.705600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49433b-2d89-47f5-a016-f6fba34e726e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:15.706056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49433b-2d89-47f5-a016-f6fba34e726e None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:15.707482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49433b-2d89-47f5-a016-f6fba34e726e None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:15.709248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49433b-2d89-47f5-a016-f6fba34e726e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:15.712911 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 135/253] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:15 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:15.718779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba5765-fe57-4537-a9e1-f8e1b5b794fe None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:15.721639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba5765-fe57-4537-a9e1-f8e1b5b794fe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:15.722225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba5765-fe57-4537-a9e1-f8e1b5b794fe None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:15.724024 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 136/254] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:15.724565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89eb47-97f1-469c-8cc5-768a695d708a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:15.725139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba5765-fe57-4537-a9e1-f8e1b5b794fe None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:15.725356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89eb47-97f1-469c-8cc5-768a695d708a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:15.725722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89eb47-97f1-469c-8cc5-768a695d708a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:15.730172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89eb47-97f1-469c-8cc5-768a695d708a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:15.731062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89eb47-97f1-469c-8cc5-768a695d708a None admin] RBAC: Adding query filter params (role.id=3e7c7ed373dc46829d37081c99a331a0, scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8, user.id=d763afa2271b45b4ad785b3a0b392f8d) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:15.733020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89eb47-97f1-469c-8cc5-768a695d708a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:15.735614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89eb47-97f1-469c-8cc5-768a695d708a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:15.745520 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 119/255] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:03:15 2022] GET /identity/v3/role_assignments?user.id=d763afa2271b45b4ad785b3a0b392f8d&scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8&role.id=3e7c7ed373dc46829d37081c99a331a0 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:15.755212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5fb2e-049d-4d56-bc8b-0b418027d6da None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:15.755707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5fb2e-049d-4d56-bc8b-0b418027d6da None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:15.758073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5fb2e-049d-4d56-bc8b-0b418027d6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:15.791749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ebe5fb2e-049d-4d56-bc8b-0b418027d6da None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:15.793059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ebe5fb2e-049d-4d56-bc8b-0b418027d6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:15.947076 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 120/256] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:15.951128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5fb2e-049d-4d56-bc8b-0b418027d6da None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:15.974055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:16.053901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba5765-fe57-4537-a9e1-f8e1b5b794fe None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:16.154455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f146364-ace6-4132-987a-f62b810bbf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:16.155691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146364-ace6-4132-987a-f62b810bbf97 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:16.156172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146364-ace6-4132-987a-f62b810bbf97 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:16.157252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146364-ace6-4132-987a-f62b810bbf97 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8/users/081951afe4134865b91174ed238fe09c/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:16.165601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f146364-ace6-4132-987a-f62b810bbf97 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a529bd5dd924e93a8b2eb90a47878d8, user_id=081951afe4134865b91174ed238fe09c, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:16.168809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f146364-ace6-4132-987a-f62b810bbf97 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:16.195971 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 137/257] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:03:15 2022] PUT /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8/users/081951afe4134865b91174ed238fe09c/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:03:16.215903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5fb2e-049d-4d56-bc8b-0b418027d6da None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:16.268981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f89463-6f54-4c6b-9593-52096dbddee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:16.269936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f89463-6f54-4c6b-9593-52096dbddee8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:16.270387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f89463-6f54-4c6b-9593-52096dbddee8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:16.270860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f89463-6f54-4c6b-9593-52096dbddee8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:16.289510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f89463-6f54-4c6b-9593-52096dbddee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:16.295055 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-83f89463-6f54-4c6b-9593-52096dbddee8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:03:16.295055 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:16.295055 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:16.295055 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:16.295055 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:16.295055 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:16.295055 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:16.295055 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:16.295055 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:16.295055 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:16.295055 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:16.295055 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:16.295055 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:16.295055 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:16.295055 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:16.295055 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:16.296306 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:16.296306 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:16.296306 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:16.296306 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:16.296306 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:16.296306 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:16.296306 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:16.296306 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:16.296306 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:16.296306 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:16.296306 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:16.296306 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:16.296306 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:16.296306 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:16.296306 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:16.296306 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:16.297085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:16.297085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:16.297085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:16.297085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:16.297085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:16.297085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:16.297085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:16.297085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:16.297085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:16.297085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:16.297085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:03:16.297085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:16.299056 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 121/258] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:03:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:16.308877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f146364-ace6-4132-987a-f62b810bbf97 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:16.317134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:16.507811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f146364-ace6-4132-987a-f62b810bbf97 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:16.556765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ce516-b1a5-4186-b7d1-0c0c9734ec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:16.557398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ce516-b1a5-4186-b7d1-0c0c9734ec07 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:16.557676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ce516-b1a5-4186-b7d1-0c0c9734ec07 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:16.557945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ce516-b1a5-4186-b7d1-0c0c9734ec07 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:16.558692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ce516-b1a5-4186-b7d1-0c0c9734ec07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:16.558995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ce516-b1a5-4186-b7d1-0c0c9734ec07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:16.560479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ce516-b1a5-4186-b7d1-0c0c9734ec07 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:16.575305 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 138/259] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:16.592022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f89463-6f54-4c6b-9593-52096dbddee8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:16.723184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ce516-b1a5-4186-b7d1-0c0c9734ec07 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:16.750064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:16.793414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f89463-6f54-4c6b-9593-52096dbddee8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:16.881296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffc1f9-ad72-4b60-a26f-e1a5de1d1755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:16.882098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc1f9-ad72-4b60-a26f-e1a5de1d1755 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:16.882403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc1f9-ad72-4b60-a26f-e1a5de1d1755 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:16.882684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc1f9-ad72-4b60-a26f-e1a5de1d1755 None admin] PATH_INFO: `/v3/users/2860e5eefe5345518a39cf0fa184f95f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:16.884241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffc1f9-ad72-4b60-a26f-e1a5de1d1755 None admin] RBAC: Authorizing `identity:get_user(user_id=2860e5eefe5345518a39cf0fa184f95f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:16.886149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffc1f9-ad72-4b60-a26f-e1a5de1d1755 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:16.895739 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 122/260] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:16 2022] GET /identity/v3/users/2860e5eefe5345518a39cf0fa184f95f => generated 283 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:16.905039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffc1f9-ad72-4b60-a26f-e1a5de1d1755 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:16.984405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:17.093516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ce516-b1a5-4186-b7d1-0c0c9734ec07 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:17.205050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4034023-eacf-4b3b-8e0b-a80a1f807950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:17.205741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034023-eacf-4b3b-8e0b-a80a1f807950 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:17.206027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034023-eacf-4b3b-8e0b-a80a1f807950 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:17.206306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034023-eacf-4b3b-8e0b-a80a1f807950 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:17.209658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffc1f9-ad72-4b60-a26f-e1a5de1d1755 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:17.230383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4034023-eacf-4b3b-8e0b-a80a1f807950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:17.236844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e4034023-eacf-4b3b-8e0b-a80a1f807950 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:17.236844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:17.236844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:17.236844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:17.236844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:17.236844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:17.236844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:17.236844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:17.236844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:17.236844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:17.236844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:17.236844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:17.236844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:17.236844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:17.236844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:17.236844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:17.238546 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:17.238546 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:17.238546 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:17.238546 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:17.238546 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:17.238546 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:17.238546 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:17.238546 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:17.238546 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:17.238546 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:17.238546 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:17.238546 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:17.238546 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:17.238546 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:17.238546 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:17.238546 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:17.240146 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:17.240146 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:17.240146 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:17.240146 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:17.240146 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:17.240146 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:17.240146 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:17.240146 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:17.240146 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:17.240146 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:17.240146 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:17.240146 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:17.240146 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 139/261] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:03:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 516 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:03:17.250892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4034023-eacf-4b3b-8e0b-a80a1f807950 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:17.328680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e859e-adc4-456d-92cc-77ed2f4fd3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:17.329369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e859e-adc4-456d-92cc-77ed2f4fd3d3 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:17.329655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e859e-adc4-456d-92cc-77ed2f4fd3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:17.329925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e859e-adc4-456d-92cc-77ed2f4fd3d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:17.355700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:17.416751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4034023-eacf-4b3b-8e0b-a80a1f807950 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:17.434306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e859e-adc4-456d-92cc-77ed2f4fd3d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:17.435903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e859e-adc4-456d-92cc-77ed2f4fd3d3 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:17.463630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:17.484094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0ce02-eee4-45f1-8c51-270f11a28876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:17.484809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0ce02-eee4-45f1-8c51-270f11a28876 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:17.485146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0ce02-eee4-45f1-8c51-270f11a28876 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:17.485483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0ce02-eee4-45f1-8c51-270f11a28876 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:17.486227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0ce02-eee4-45f1-8c51-270f11a28876 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:17.486537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0ce02-eee4-45f1-8c51-270f11a28876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:17.488282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0ce02-eee4-45f1-8c51-270f11a28876 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:17.508245 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 140/262] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:03:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:17.517843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0ce02-eee4-45f1-8c51-270f11a28876 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:17.653815 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 123/263] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 749 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:17.660284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e859e-adc4-456d-92cc-77ed2f4fd3d3 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:17.795645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:17.808931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0ce02-eee4-45f1-8c51-270f11a28876 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:17.923197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd017d-321e-4a90-8ae0-8dfedfde69f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:17.923807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd017d-321e-4a90-8ae0-8dfedfde69f9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:17.924083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd017d-321e-4a90-8ae0-8dfedfde69f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:17.924351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd017d-321e-4a90-8ae0-8dfedfde69f9 None admin] PATH_INFO: `/v3/users/2860e5eefe5345518a39cf0fa184f95f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:17.928025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd017d-321e-4a90-8ae0-8dfedfde69f9 None admin] RBAC: Authorizing `identity:get_user(user_id=2860e5eefe5345518a39cf0fa184f95f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:17.929564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd017d-321e-4a90-8ae0-8dfedfde69f9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:17.931466 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 141/264] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:17 2022] GET /identity/v3/users/2860e5eefe5345518a39cf0fa184f95f => generated 283 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:17.938220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd017d-321e-4a90-8ae0-8dfedfde69f9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:17.988995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e859e-adc4-456d-92cc-77ed2f4fd3d3 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:18.076039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:18.092950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bd5f0-b9d1-4b39-8a0b-8955741f53e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:18.093903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bd5f0-b9d1-4b39-8a0b-8955741f53e2 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:18.094325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bd5f0-b9d1-4b39-8a0b-8955741f53e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:18.094741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bd5f0-b9d1-4b39-8a0b-8955741f53e2 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:18.100422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145bd5f0-b9d1-4b39-8a0b-8955741f53e2 None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:18.102875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145bd5f0-b9d1-4b39-8a0b-8955741f53e2 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:18.106217 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 124/265] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:17 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:18.121868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bd5f0-b9d1-4b39-8a0b-8955741f53e2 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:18.161602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd017d-321e-4a90-8ae0-8dfedfde69f9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:18.240032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006ca59-7c95-44ed-a0bb-8d54f50632dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:18.240032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006ca59-7c95-44ed-a0bb-8d54f50632dc None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:18.240032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006ca59-7c95-44ed-a0bb-8d54f50632dc None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:18.240032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006ca59-7c95-44ed-a0bb-8d54f50632dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:18.318412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bd5f0-b9d1-4b39-8a0b-8955741f53e2 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:18.343034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:18.344551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006ca59-7c95-44ed-a0bb-8d54f50632dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:18.346376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006ca59-7c95-44ed-a0bb-8d54f50632dc None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:18.375377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6e9ef-d17f-431d-b954-fe1bbf2dd810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:18.376748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6e9ef-d17f-431d-b954-fe1bbf2dd810 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:18.378186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6e9ef-d17f-431d-b954-fe1bbf2dd810 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:18.378793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6e9ef-d17f-431d-b954-fe1bbf2dd810 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:18.379995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6e9ef-d17f-431d-b954-fe1bbf2dd810 None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8, user.id=2860e5eefe5345518a39cf0fa184f95f) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:18.380681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6e9ef-d17f-431d-b954-fe1bbf2dd810 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:18.383159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6e9ef-d17f-431d-b954-fe1bbf2dd810 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:18.393480 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 125/266] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:03:18 2022] GET /identity/v3/role_assignments?user.id=2860e5eefe5345518a39cf0fa184f95f&scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:18.395329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053d991-0186-439a-9a99-5d41bf932eaf None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:18.395807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053d991-0186-439a-9a99-5d41bf932eaf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:18.396273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053d991-0186-439a-9a99-5d41bf932eaf None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:18.403278 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 126/267] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:18.405456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7d86e-eaeb-4da5-b34a-6057272cfaa6 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:18.405976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7d86e-eaeb-4da5-b34a-6057272cfaa6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:18.406438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7d86e-eaeb-4da5-b34a-6057272cfaa6 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:18.408446 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 127/268] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:18.411055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130363ea-1d29-43b6-a1b9-4e494ccca37c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:18.411610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130363ea-1d29-43b6-a1b9-4e494ccca37c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:18.412070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130363ea-1d29-43b6-a1b9-4e494ccca37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:18.437760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-130363ea-1d29-43b6-a1b9-4e494ccca37c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:18.439587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-130363ea-1d29-43b6-a1b9-4e494ccca37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:18.457555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:18.565722 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 128/269] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:18.569528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef4549-613c-4f2d-bc07-3542569db6ff None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:18.569528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef4549-613c-4f2d-bc07-3542569db6ff None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:18.569528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef4549-613c-4f2d-bc07-3542569db6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:18.591510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-adef4549-613c-4f2d-bc07-3542569db6ff None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:18.592749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-adef4549-613c-4f2d-bc07-3542569db6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:18.615486 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 142/270] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 18:03:18.621442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006ca59-7c95-44ed-a0bb-8d54f50632dc None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:18.695529 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 129/271] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:18.860328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006ca59-7c95-44ed-a0bb-8d54f50632dc None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:18.914703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2a734-6cbe-4206-98a9-e0e3a9a44c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:18.915406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2a734-6cbe-4206-98a9-e0e3a9a44c99 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:18.915740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2a734-6cbe-4206-98a9-e0e3a9a44c99 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:18.916012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2a734-6cbe-4206-98a9-e0e3a9a44c99 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:18.917256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2a734-6cbe-4206-98a9-e0e3a9a44c99 None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:18.918811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2a734-6cbe-4206-98a9-e0e3a9a44c99 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:18.920700 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 143/272] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:18 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:18.927581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef4549-613c-4f2d-bc07-3542569db6ff None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:18.984574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:19.052473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2a734-6cbe-4206-98a9-e0e3a9a44c99 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:19.087310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:19.088346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef4549-613c-4f2d-bc07-3542569db6ff None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:19.131166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17532d-39ae-45ef-96ac-478a5521d847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:19.132664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17532d-39ae-45ef-96ac-478a5521d847 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:19.132946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17532d-39ae-45ef-96ac-478a5521d847 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:19.133224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17532d-39ae-45ef-96ac-478a5521d847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:19.133996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17532d-39ae-45ef-96ac-478a5521d847 None admin] RBAC: Adding query filter params (role.id=81040db4535e417891c10dd996b1eac5, scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8, user.id=2860e5eefe5345518a39cf0fa184f95f) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:19.134306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17532d-39ae-45ef-96ac-478a5521d847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:19.136239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17532d-39ae-45ef-96ac-478a5521d847 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:19.154073 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 130/273] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:03:18 2022] GET /identity/v3/role_assignments?user.id=2860e5eefe5345518a39cf0fa184f95f&scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8&role.id=81040db4535e417891c10dd996b1eac5 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:19.222114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2a734-6cbe-4206-98a9-e0e3a9a44c99 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:19.244507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17532d-39ae-45ef-96ac-478a5521d847 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:19.295152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc57e4-2ac5-457f-9a22-858c2a25c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:19.295851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc57e4-2ac5-457f-9a22-858c2a25c348 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:19.296137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc57e4-2ac5-457f-9a22-858c2a25c348 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:19.296412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc57e4-2ac5-457f-9a22-858c2a25c348 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:19.337295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc57e4-2ac5-457f-9a22-858c2a25c348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:19.359297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-edbc57e4-2ac5-457f-9a22-858c2a25c348 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:19.359297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:19.359297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:19.359297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:19.359297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:19.359297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:19.359297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:19.359297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:19.359297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:19.359297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:19.359297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:19.359297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:19.359297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:19.359297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:19.359297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:19.359297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:19.360237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:19.360237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:19.360237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:19.360237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:19.360237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:19.360237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:19.360237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:19.360237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:19.360237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:19.360237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:19.360237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:19.360237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:19.360237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:19.360237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:19.360237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:19.360237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:19.361002 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:19.361002 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:19.361002 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:19.361002 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:19.361002 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:19.361002 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:19.361002 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:19.361002 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:19.361002 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:19.361002 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:19.361002 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:19.361002 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:19.363324 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 144/274] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:03:19.369625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc57e4-2ac5-457f-9a22-858c2a25c348 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:19.412187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:19.417666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17532d-39ae-45ef-96ac-478a5521d847 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:19.484297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808fd3e-0e66-461d-943f-1973baf2eae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:19.485580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808fd3e-0e66-461d-943f-1973baf2eae7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:19.486100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808fd3e-0e66-461d-943f-1973baf2eae7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:19.487309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808fd3e-0e66-461d-943f-1973baf2eae7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:19.489459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808fd3e-0e66-461d-943f-1973baf2eae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:19.491540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808fd3e-0e66-461d-943f-1973baf2eae7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:19.493352 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 131/275] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:19.496498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5660a-4101-4eea-8be8-10cb9a905eb1 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:19.496498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5660a-4101-4eea-8be8-10cb9a905eb1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:19.496498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5660a-4101-4eea-8be8-10cb9a905eb1 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:19.497401 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 132/276] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:19.504412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5660a-4101-4eea-8be8-10cb9a905eb1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:19.570542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:19.602427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc57e4-2ac5-457f-9a22-858c2a25c348 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:19.649830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657016b-fb6e-45e0-87e5-ea4254e1ef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:19.650477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657016b-fb6e-45e0-87e5-ea4254e1ef96 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:19.650752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657016b-fb6e-45e0-87e5-ea4254e1ef96 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:19.651028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657016b-fb6e-45e0-87e5-ea4254e1ef96 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:19.651723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657016b-fb6e-45e0-87e5-ea4254e1ef96 None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:19.652270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657016b-fb6e-45e0-87e5-ea4254e1ef96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:19.653524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657016b-fb6e-45e0-87e5-ea4254e1ef96 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:19.668259 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 145/277] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:19.670469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a49fa-329d-4b61-b151-fdec02e9c95b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:19.670960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a49fa-329d-4b61-b151-fdec02e9c95b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:19.671484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a49fa-329d-4b61-b151-fdec02e9c95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:19.683701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5660a-4101-4eea-8be8-10cb9a905eb1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:19.698481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-381a49fa-329d-4b61-b151-fdec02e9c95b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:19.699744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-381a49fa-329d-4b61-b151-fdec02e9c95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:19.731575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01bbb0-804c-4aa5-af6b-9e31673733cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:19.732794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01bbb0-804c-4aa5-af6b-9e31673733cd None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:19.732794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01bbb0-804c-4aa5-af6b-9e31673733cd None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:19.732976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01bbb0-804c-4aa5-af6b-9e31673733cd None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:19.733818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01bbb0-804c-4aa5-af6b-9e31673733cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:19.734992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01bbb0-804c-4aa5-af6b-9e31673733cd None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:19.767101 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 133/278] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:03:19 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:03:19.768847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d393-1aed-4624-a717-7117ca428552 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:19.769562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d393-1aed-4624-a717-7117ca428552 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:19.769562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d393-1aed-4624-a717-7117ca428552 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:19.771484 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 134/279] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:19.772829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0d393-1aed-4624-a717-7117ca428552 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:19.807001 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 146/280] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:19.807730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:19.809627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7681d-a39e-406a-97ef-fbcb3f3a0132 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:19.810072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7681d-a39e-406a-97ef-fbcb3f3a0132 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:19.810436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7681d-a39e-406a-97ef-fbcb3f3a0132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:19.843136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5cb7681d-a39e-406a-97ef-fbcb3f3a0132 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:19.844965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5cb7681d-a39e-406a-97ef-fbcb3f3a0132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:19.945059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0d393-1aed-4624-a717-7117ca428552 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:19.966317 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 147/281] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:19.999518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf79f6-fe86-4e28-9cbd-587ee018a67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:19.999518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf79f6-fe86-4e28-9cbd-587ee018a67c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:19.999518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf79f6-fe86-4e28-9cbd-587ee018a67c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:19.999518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf79f6-fe86-4e28-9cbd-587ee018a67c None admin] PATH_INFO: `/v3/users/d14628f201b74916b4625a0f313017bd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:20.023432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf79f6-fe86-4e28-9cbd-587ee018a67c None admin] RBAC: Authorizing `identity:get_user(user_id=d14628f201b74916b4625a0f313017bd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:20.025381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf79f6-fe86-4e28-9cbd-587ee018a67c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:20.027571 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 135/282] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:19 2022] GET /identity/v3/users/d14628f201b74916b4625a0f313017bd => generated 293 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:20.036770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7681d-a39e-406a-97ef-fbcb3f3a0132 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:20.052252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:20.118154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf79f6-fe86-4e28-9cbd-587ee018a67c None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:20.218896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7681d-a39e-406a-97ef-fbcb3f3a0132 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:20.267720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:20.274925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bc76b-5a3f-49e0-9c7a-65fa5babae1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:20.275591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bc76b-5a3f-49e0-9c7a-65fa5babae1e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:20.277807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bc76b-5a3f-49e0-9c7a-65fa5babae1e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:20.277807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bc76b-5a3f-49e0-9c7a-65fa5babae1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:20.277807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bc76b-5a3f-49e0-9c7a-65fa5babae1e None admin] RBAC: Adding query filter params (role.id=dcabcc9bd3bf42149eed3abc0d4799c8, user.id=d14628f201b74916b4625a0f313017bd, scope.system=all) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:20.278218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bc76b-5a3f-49e0-9c7a-65fa5babae1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:20.280243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bc76b-5a3f-49e0-9c7a-65fa5babae1e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:20.291337 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 148/283] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Aug 28 18:03:20 2022] GET /identity/v3/role_assignments?user.id=d14628f201b74916b4625a0f313017bd&scope.system=all&role.id=dcabcc9bd3bf42149eed3abc0d4799c8 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:20.292297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bc76b-5a3f-49e0-9c7a-65fa5babae1e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:20.293521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf79f6-fe86-4e28-9cbd-587ee018a67c None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:20.369863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb26a0-eb3d-462d-a096-e1e56e5be8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:20.371218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb26a0-eb3d-462d-a096-e1e56e5be8ea None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:20.371671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb26a0-eb3d-462d-a096-e1e56e5be8ea None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:20.372097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb26a0-eb3d-462d-a096-e1e56e5be8ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:20.395717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb26a0-eb3d-462d-a096-e1e56e5be8ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:20.405122 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-fbbb26a0-eb3d-462d-a096-e1e56e5be8ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:03:20.405122 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:20.405122 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:20.405122 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:20.405122 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:20.405122 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:20.405122 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:20.405122 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:20.405122 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:20.405122 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:20.405122 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:20.405122 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:20.405122 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:20.405122 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:20.405122 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:20.405122 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:20.406085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:20.406085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:20.406085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:20.406085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:20.406085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:20.406085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:20.406085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:20.406085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:20.406085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:20.406085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:20.406085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:20.406085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:20.406085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:20.406085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:20.406085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:20.406085 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:20.406859 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:20.406859 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:20.406859 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:20.406859 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:20.406859 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:20.406859 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:20.406859 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:20.406859 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:20.406859 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:20.406859 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:20.406859 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:03:20.406859 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:20.407969 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 136/284] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:20.414921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb26a0-eb3d-462d-a096-e1e56e5be8ea None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:20.433390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:20.497702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bc76b-5a3f-49e0-9c7a-65fa5babae1e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:20.573745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce731b8-de2e-4afc-879f-680fdb1c8a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:20.574730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce731b8-de2e-4afc-879f-680fdb1c8a74 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:20.575179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce731b8-de2e-4afc-879f-680fdb1c8a74 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:20.575685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce731b8-de2e-4afc-879f-680fdb1c8a74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:20.604776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce731b8-de2e-4afc-879f-680fdb1c8a74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:20.622751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb26a0-eb3d-462d-a096-e1e56e5be8ea None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:20.628405 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-fce731b8-de2e-4afc-879f-680fdb1c8a74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:20.628405 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:20.628405 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:20.628405 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:20.628405 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:20.628405 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:20.628405 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:20.628405 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:20.628405 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:20.628405 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:20.628405 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:20.628405 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:20.628405 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:20.628405 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:20.628405 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:20.628405 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:20.630367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:20.630367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:20.630367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:20.630367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:20.630367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:20.630367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:20.630367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:20.630367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:20.630367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:20.630367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:20.630367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:20.630367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:20.630367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:20.630367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:20.630367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:20.630367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:20.632276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:20.632276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:20.632276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:20.632276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:20.632276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:20.632276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:20.632276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:20.632276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:20.632276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:20.632276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:20.632276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:20.632276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:20.632276 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 149/285] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:20.640716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce731b8-de2e-4afc-879f-680fdb1c8a74 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:20.688355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb0d78-f5b3-44dc-af04-0f65fb94babe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:20.689311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb0d78-f5b3-44dc-af04-0f65fb94babe None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:20.689749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb0d78-f5b3-44dc-af04-0f65fb94babe None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:20.690152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb0d78-f5b3-44dc-af04-0f65fb94babe None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:20.691007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb0d78-f5b3-44dc-af04-0f65fb94babe None admin] RBAC: Adding query filter params (name=reader) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:20.691467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb0d78-f5b3-44dc-af04-0f65fb94babe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:20.693124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb0d78-f5b3-44dc-af04-0f65fb94babe None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:20.703667 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 137/286] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:20.713756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb0d78-f5b3-44dc-af04-0f65fb94babe None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:20.725900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:20.889636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce731b8-de2e-4afc-879f-680fdb1c8a74 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:20.940975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb0d78-f5b3-44dc-af04-0f65fb94babe None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:20.955601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:20.962318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0ffcd-94c2-483d-83f7-79594bd9dc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:20.962945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0ffcd-94c2-483d-83f7-79594bd9dc89 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:20.963222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0ffcd-94c2-483d-83f7-79594bd9dc89 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:20.963516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0ffcd-94c2-483d-83f7-79594bd9dc89 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:20.964189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0ffcd-94c2-483d-83f7-79594bd9dc89 None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:20.964487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0ffcd-94c2-483d-83f7-79594bd9dc89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:20.965894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0ffcd-94c2-483d-83f7-79594bd9dc89 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:20.988766 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 150/287] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:20.995288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0ffcd-94c2-483d-83f7-79594bd9dc89 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:21.024928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81327d-1040-42a1-bc77-7a5d9a0026ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:21.025656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81327d-1040-42a1-bc77-7a5d9a0026ee None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:21.025943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81327d-1040-42a1-bc77-7a5d9a0026ee None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:21.026214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81327d-1040-42a1-bc77-7a5d9a0026ee None admin] PATH_INFO: `/v3/users/d763afa2271b45b4ad785b3a0b392f8d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:21.032524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81327d-1040-42a1-bc77-7a5d9a0026ee None admin] RBAC: Authorizing `identity:get_user(user_id=d763afa2271b45b4ad785b3a0b392f8d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:21.034142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81327d-1040-42a1-bc77-7a5d9a0026ee None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:21.035917 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 138/288] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:20 2022] GET /identity/v3/users/d763afa2271b45b4ad785b3a0b392f8d => generated 297 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:21.042162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81327d-1040-42a1-bc77-7a5d9a0026ee None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:21.108504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0ffcd-94c2-483d-83f7-79594bd9dc89 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:21.164754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32243df1-9e35-4fbe-abb2-915645e46f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:21.165307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32243df1-9e35-4fbe-abb2-915645e46f56 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:21.165572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32243df1-9e35-4fbe-abb2-915645e46f56 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:21.165838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32243df1-9e35-4fbe-abb2-915645e46f56 None admin] PATH_INFO: `/v3/users/081951afe4134865b91174ed238fe09c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:21.167075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32243df1-9e35-4fbe-abb2-915645e46f56 None admin] RBAC: Authorizing `identity:get_user(user_id=081951afe4134865b91174ed238fe09c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:21.168567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32243df1-9e35-4fbe-abb2-915645e46f56 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:21.170530 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 151/289] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:20 2022] GET /identity/v3/users/081951afe4134865b91174ed238fe09c => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:21.179336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32243df1-9e35-4fbe-abb2-915645e46f56 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:21.213319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:21.250874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81327d-1040-42a1-bc77-7a5d9a0026ee None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:21.338164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc73d32-ca2f-4983-83ce-8d8a51f43902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:21.339203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc73d32-ca2f-4983-83ce-8d8a51f43902 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:21.339696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc73d32-ca2f-4983-83ce-8d8a51f43902 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:21.340160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc73d32-ca2f-4983-83ce-8d8a51f43902 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:21.347181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc73d32-ca2f-4983-83ce-8d8a51f43902 None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:21.351524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc73d32-ca2f-4983-83ce-8d8a51f43902 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:21.360579 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 139/290] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:21 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:21.369794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc73d32-ca2f-4983-83ce-8d8a51f43902 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:21.388196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:21.465844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32243df1-9e35-4fbe-abb2-915645e46f56 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:21.544471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cec70-3415-4a0c-a546-f73b242e4685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:21.545537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cec70-3415-4a0c-a546-f73b242e4685 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:21.546016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cec70-3415-4a0c-a546-f73b242e4685 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:21.546485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cec70-3415-4a0c-a546-f73b242e4685 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:21.575930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc73d32-ca2f-4983-83ce-8d8a51f43902 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:21.613012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ade7c4-bf99-4889-82bc-d56fd83032fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:21.614062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ade7c4-bf99-4889-82bc-d56fd83032fd None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:21.614533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ade7c4-bf99-4889-82bc-d56fd83032fd None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:21.615004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ade7c4-bf99-4889-82bc-d56fd83032fd None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8/users/d763afa2271b45b4ad785b3a0b392f8d/roles/3e7c7ed373dc46829d37081c99a331a0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:21.618576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ade7c4-bf99-4889-82bc-d56fd83032fd None admin] RBAC: Authorizing `identity:create_grant(project_id=0a529bd5dd924e93a8b2eb90a47878d8, user_id=d763afa2271b45b4ad785b3a0b392f8d, role_id=3e7c7ed373dc46829d37081c99a331a0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:21.621012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ade7c4-bf99-4889-82bc-d56fd83032fd None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:21.647946 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 140/291] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:03:21 2022] PUT /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8/users/d763afa2271b45b4ad785b3a0b392f8d/roles/3e7c7ed373dc46829d37081c99a331a0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:03:21.648830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:21.719520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cec70-3415-4a0c-a546-f73b242e4685 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:21.721205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cec70-3415-4a0c-a546-f73b242e4685 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:21.820590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:21.878555 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 152/292] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:21.885669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ade7c4-bf99-4889-82bc-d56fd83032fd None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:22.055115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ade7c4-bf99-4889-82bc-d56fd83032fd None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:22.117337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d1fc0-79f8-4699-ab78-299182a97902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:22.117997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d1fc0-79f8-4699-ab78-299182a97902 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:22.118331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d1fc0-79f8-4699-ab78-299182a97902 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:22.118756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d1fc0-79f8-4699-ab78-299182a97902 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:22.120528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d1fc0-79f8-4699-ab78-299182a97902 None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:22.122022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d1fc0-79f8-4699-ab78-299182a97902 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:22.124475 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 141/293] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:21 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:22.130838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cec70-3415-4a0c-a546-f73b242e4685 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:22.257566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cec70-3415-4a0c-a546-f73b242e4685 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:22.301436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3353f4e-6c26-45f9-9f97-6057a710c668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:22.302067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3353f4e-6c26-45f9-9f97-6057a710c668 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:22.302348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3353f4e-6c26-45f9-9f97-6057a710c668 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:22.302619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3353f4e-6c26-45f9-9f97-6057a710c668 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:22.303457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3353f4e-6c26-45f9-9f97-6057a710c668 None admin] RBAC: Adding query filter params (role.id=dcabcc9bd3bf42149eed3abc0d4799c8, scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8, user.id=081951afe4134865b91174ed238fe09c) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:22.303879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3353f4e-6c26-45f9-9f97-6057a710c668 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:22.305526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3353f4e-6c26-45f9-9f97-6057a710c668 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:22.312754 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 153/294] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:03:22 2022] GET /identity/v3/role_assignments?user.id=081951afe4134865b91174ed238fe09c&scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8&role.id=dcabcc9bd3bf42149eed3abc0d4799c8 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:22.392124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da7677-155c-4522-af75-330f58b58c2c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:22.392440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da7677-155c-4522-af75-330f58b58c2c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:22.392714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da7677-155c-4522-af75-330f58b58c2c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:22.394343 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 142/295] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:22.400285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874955a2-f1dc-4316-8304-f8b3d6187f6b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:22.400566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874955a2-f1dc-4316-8304-f8b3d6187f6b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:22.400846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874955a2-f1dc-4316-8304-f8b3d6187f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:22.431337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-874955a2-f1dc-4316-8304-f8b3d6187f6b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:22.432568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-874955a2-f1dc-4316-8304-f8b3d6187f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:22.454907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:22.542023 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 154/296] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:22.822422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da7677-155c-4522-af75-330f58b58c2c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:22.913382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:22.980185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da7677-155c-4522-af75-330f58b58c2c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:23.036691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf62084-bf61-49b7-8ee4-61b180d6cdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:23.037662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf62084-bf61-49b7-8ee4-61b180d6cdf0 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:23.038089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf62084-bf61-49b7-8ee4-61b180d6cdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:23.038515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf62084-bf61-49b7-8ee4-61b180d6cdf0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:23.056423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf62084-bf61-49b7-8ee4-61b180d6cdf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:23.065878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-baf62084-bf61-49b7-8ee4-61b180d6cdf0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:03:23.065878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:23.065878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:23.065878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:23.065878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:23.065878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:23.065878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:23.065878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:23.065878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:23.065878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:23.065878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:23.065878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:23.065878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:23.065878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:23.065878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:23.065878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:23.067406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:23.067406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:23.067406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:23.067406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:23.067406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:23.067406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:23.067406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:23.067406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:23.067406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:23.067406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:23.067406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:23.067406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:23.067406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:23.067406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:23.067406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:23.067406 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:23.068452 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:23.068452 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:23.068452 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:23.068452 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:23.068452 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:23.068452 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:23.068452 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:23.068452 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:23.068452 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:23.068452 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:23.068452 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:03:23.068452 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:23.068452 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 143/297] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:23.073681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874955a2-f1dc-4316-8304-f8b3d6187f6b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:23.097830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1408ee-1722-494e-90be-b7c52b7cd3fa None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:23.098240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1408ee-1722-494e-90be-b7c52b7cd3fa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:23.098438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1408ee-1722-494e-90be-b7c52b7cd3fa None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:23.100109 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 144/298] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:23.105469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c399-ae92-4c07-b87f-28be89f1557c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:23.105794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c399-ae92-4c07-b87f-28be89f1557c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:23.106004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c399-ae92-4c07-b87f-28be89f1557c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:23.126103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1654c399-ae92-4c07-b87f-28be89f1557c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:23.127828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1654c399-ae92-4c07-b87f-28be89f1557c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:23.200705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874955a2-f1dc-4316-8304-f8b3d6187f6b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:23.227727 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 145/299] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:03:23.229704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa92c5-a41f-43c4-8f8b-a8cd613e6a17 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:23.229993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa92c5-a41f-43c4-8f8b-a8cd613e6a17 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:23.230270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa92c5-a41f-43c4-8f8b-a8cd613e6a17 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:23.235781 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 146/300] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:23.237996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756c54e-82b6-4c3f-b779-8b3d44fcf71d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:23.238473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756c54e-82b6-4c3f-b779-8b3d44fcf71d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:23.238944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756c54e-82b6-4c3f-b779-8b3d44fcf71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:23.255174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdb42f-03e2-45e2-8ba2-0b41a7e74c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:23.256405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdb42f-03e2-45e2-8ba2-0b41a7e74c97 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:23.256940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdb42f-03e2-45e2-8ba2-0b41a7e74c97 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:23.257463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdb42f-03e2-45e2-8ba2-0b41a7e74c97 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:23.258484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbdb42f-03e2-45e2-8ba2-0b41a7e74c97 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:23.259353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbdb42f-03e2-45e2-8ba2-0b41a7e74c97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:23.260507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7756c54e-82b6-4c3f-b779-8b3d44fcf71d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:23.261709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7756c54e-82b6-4c3f-b779-8b3d44fcf71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:23.262008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbdb42f-03e2-45e2-8ba2-0b41a7e74c97 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:23.273705 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 155/301] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:23.288425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdb42f-03e2-45e2-8ba2-0b41a7e74c97 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:23.340475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:23.373753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:23.423703 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 147/302] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:23.517545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756c54e-82b6-4c3f-b779-8b3d44fcf71d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:23.611487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdb42f-03e2-45e2-8ba2-0b41a7e74c97 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:23.707839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6483c38-4e4c-4008-acd9-0e14f6ac5133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:23.708492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6483c38-4e4c-4008-acd9-0e14f6ac5133 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:23.708771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6483c38-4e4c-4008-acd9-0e14f6ac5133 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:23.709042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6483c38-4e4c-4008-acd9-0e14f6ac5133 None admin] PATH_INFO: `/v3/users/89a186601ca0438badf8c40e23b43b55` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:23.721007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756c54e-82b6-4c3f-b779-8b3d44fcf71d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:23.741357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6483c38-4e4c-4008-acd9-0e14f6ac5133 None admin] RBAC: Authorizing `identity:get_user(user_id=89a186601ca0438badf8c40e23b43b55)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:23.742860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6483c38-4e4c-4008-acd9-0e14f6ac5133 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:23.749507 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 156/303] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:23 2022] GET /identity/v3/users/89a186601ca0438badf8c40e23b43b55 => generated 293 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:23.757482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6483c38-4e4c-4008-acd9-0e14f6ac5133 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:23.797624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af4b74-8365-44e5-ae31-fdf94192b488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:23.798286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af4b74-8365-44e5-ae31-fdf94192b488 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:23.798568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af4b74-8365-44e5-ae31-fdf94192b488 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:23.798841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af4b74-8365-44e5-ae31-fdf94192b488 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:23.834161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af4b74-8365-44e5-ae31-fdf94192b488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:23.842939 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-38af4b74-8365-44e5-ae31-fdf94192b488 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:23.842939 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:23.842939 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:23.842939 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:23.842939 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:23.842939 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:23.842939 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:23.842939 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:23.842939 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:23.842939 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:23.842939 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:23.842939 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:23.842939 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:23.842939 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:23.842939 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:23.842939 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:23.844966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:23.844966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:23.844966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:23.844966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:23.844966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:23.844966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:23.844966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:23.844966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:23.844966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:23.844966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:23.844966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:23.844966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:23.844966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:23.844966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:23.844966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:23.844966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:23.846602 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:23.846602 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:23.846602 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:23.846602 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:23.846602 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:23.846602 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:23.846602 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:23.846602 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:23.846602 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:23.846602 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:23.846602 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:23.846602 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:23.846602 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 148/304] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:03:23.846602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af4b74-8365-44e5-ae31-fdf94192b488 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:23.929514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:23.932324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:23.966973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6483c38-4e4c-4008-acd9-0e14f6ac5133 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:24.016859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc9db3-4d3f-4e49-9548-b7c572f02dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:24.017640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9db3-4d3f-4e49-9548-b7c572f02dde None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:24.017640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9db3-4d3f-4e49-9548-b7c572f02dde None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:24.017905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9db3-4d3f-4e49-9548-b7c572f02dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:24.018643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc9db3-4d3f-4e49-9548-b7c572f02dde None admin] RBAC: Adding query filter params (role.id=3e7c7ed373dc46829d37081c99a331a0, user.id=89a186601ca0438badf8c40e23b43b55, scope.system=all) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:24.018950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc9db3-4d3f-4e49-9548-b7c572f02dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:24.020213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af4b74-8365-44e5-ae31-fdf94192b488 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:24.020455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc9db3-4d3f-4e49-9548-b7c572f02dde None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:24.026407 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 157/305] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Aug 28 18:03:23 2022] GET /identity/v3/role_assignments?user.id=89a186601ca0438badf8c40e23b43b55&scope.system=all&role.id=3e7c7ed373dc46829d37081c99a331a0 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:24.033778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc9db3-4d3f-4e49-9548-b7c572f02dde None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:24.063792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b8eac-86df-4f2d-b88a-2118490ae0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:24.064536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b8eac-86df-4f2d-b88a-2118490ae0de None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:24.064815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b8eac-86df-4f2d-b88a-2118490ae0de None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:24.065085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b8eac-86df-4f2d-b88a-2118490ae0de None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:24.066343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b8eac-86df-4f2d-b88a-2118490ae0de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:24.067975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b8eac-86df-4f2d-b88a-2118490ae0de None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:24.074639 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 149/306] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:24.076056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b8eac-86df-4f2d-b88a-2118490ae0de None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:24.172985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc9db3-4d3f-4e49-9548-b7c572f02dde None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:24.196866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b8eac-86df-4f2d-b88a-2118490ae0de None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:24.215851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:24.223330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3877f2-e8ce-4d66-b2f6-d5973977def2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:24.225286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3877f2-e8ce-4d66-b2f6-d5973977def2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:24.226141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3877f2-e8ce-4d66-b2f6-d5973977def2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:24.226924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3877f2-e8ce-4d66-b2f6-d5973977def2 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:24.228351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3877f2-e8ce-4d66-b2f6-d5973977def2 None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:24.229159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3877f2-e8ce-4d66-b2f6-d5973977def2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:24.232303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3877f2-e8ce-4d66-b2f6-d5973977def2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:24.235183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c0660-4bfc-4ce9-b39f-2b1de184225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:24.235953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c0660-4bfc-4ce9-b39f-2b1de184225a None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:24.236225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c0660-4bfc-4ce9-b39f-2b1de184225a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:24.236495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c0660-4bfc-4ce9-b39f-2b1de184225a None admin] PATH_INFO: `/v3/groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:24.237133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c0660-4bfc-4ce9-b39f-2b1de184225a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:24.238577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c0660-4bfc-4ce9-b39f-2b1de184225a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:24.240197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:24.249764 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 158/307] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:24.251380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3877f2-e8ce-4d66-b2f6-d5973977def2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:24.262820 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 150/308] 10.222.0.27 () {60 vars in 1134 bytes} [Sun Aug 28 18:03:24 2022] POST /identity/v3/groups => generated 229 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:03:24.341335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6f943-fdf9-49b9-a061-3c6aabdafe9e None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:24.342033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6f943-fdf9-49b9-a061-3c6aabdafe9e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:24.342650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6f943-fdf9-49b9-a061-3c6aabdafe9e None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:24.344481 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 151/309] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:03:24.350312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836404d-f4a2-4c9a-88f0-4293fd6c8b87 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:24.350672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836404d-f4a2-4c9a-88f0-4293fd6c8b87 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:24.351027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836404d-f4a2-4c9a-88f0-4293fd6c8b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:24.372182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9836404d-f4a2-4c9a-88f0-4293fd6c8b87 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:24.373537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9836404d-f4a2-4c9a-88f0-4293fd6c8b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:24.376401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3877f2-e8ce-4d66-b2f6-d5973977def2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:24.419501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08d5c9-458f-40b7-8e1c-23aefd9563d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:24.420706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08d5c9-458f-40b7-8e1c-23aefd9563d1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:24.421174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08d5c9-458f-40b7-8e1c-23aefd9563d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:24.421584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08d5c9-458f-40b7-8e1c-23aefd9563d1 None admin] PATH_INFO: `/v3/users/d14628f201b74916b4625a0f313017bd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:24.425074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08d5c9-458f-40b7-8e1c-23aefd9563d1 None admin] RBAC: Authorizing `identity:get_user(user_id=d14628f201b74916b4625a0f313017bd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:24.428503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08d5c9-458f-40b7-8e1c-23aefd9563d1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:24.439386 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 159/310] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:24 2022] GET /identity/v3/users/d14628f201b74916b4625a0f313017bd => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:24.441596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08d5c9-458f-40b7-8e1c-23aefd9563d1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:24.484128 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 152/311] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:03:24.554475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:24.589994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08d5c9-458f-40b7-8e1c-23aefd9563d1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:24.636893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79a073-1d21-4b79-a463-6bfc375475ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:24.637575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79a073-1d21-4b79-a463-6bfc375475ce None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:24.637861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79a073-1d21-4b79-a463-6bfc375475ce None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:24.638144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79a073-1d21-4b79-a463-6bfc375475ce None admin] PATH_INFO: `/v3/system/users/d14628f201b74916b4625a0f313017bd/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:24.639700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79a073-1d21-4b79-a463-6bfc375475ce None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d14628f201b74916b4625a0f313017bd, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:24.641113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79a073-1d21-4b79-a463-6bfc375475ce None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:24.652480 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 160/312] 10.222.0.27 () {58 vars in 1334 bytes} [Sun Aug 28 18:03:24 2022] PUT /identity/v3/system/users/d14628f201b74916b4625a0f313017bd/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:03:24.767829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836404d-f4a2-4c9a-88f0-4293fd6c8b87 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:24.896526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836404d-f4a2-4c9a-88f0-4293fd6c8b87 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:24.909444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:24.950022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700fe60-7a10-44c3-81d8-c1414f7c05e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:24.950922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700fe60-7a10-44c3-81d8-c1414f7c05e6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:24.951378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700fe60-7a10-44c3-81d8-c1414f7c05e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:24.951699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700fe60-7a10-44c3-81d8-c1414f7c05e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:24.965080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700fe60-7a10-44c3-81d8-c1414f7c05e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:24.970289 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-1700fe60-7a10-44c3-81d8-c1414f7c05e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:03:24.970289 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:24.970289 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:24.970289 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:24.970289 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:24.970289 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:24.970289 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:24.970289 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:24.970289 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:24.970289 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:24.970289 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:24.970289 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:24.970289 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:24.970289 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:24.970289 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:24.970289 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:24.971178 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:24.971178 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:24.971178 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:24.971178 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:24.971178 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:24.971178 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:24.971178 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:24.971178 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:24.971178 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:24.971178 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:24.971178 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:24.971178 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:24.971178 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:24.971178 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:24.971178 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:24.971178 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:24.972009 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:24.972009 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:24.972009 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:24.972009 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:24.972009 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:24.972009 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:24.972009 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:24.972009 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:24.972009 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:24.972009 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:24.972009 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:03:24.972009 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:24.972593 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 153/313] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:24.979720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79a073-1d21-4b79-a463-6bfc375475ce None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:25.142852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79a073-1d21-4b79-a463-6bfc375475ce None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:25.181857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:25.187641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc2591-fd66-4a47-94fb-9e068659869d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:25.188625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc2591-fd66-4a47-94fb-9e068659869d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:25.188939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc2591-fd66-4a47-94fb-9e068659869d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:25.189363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc2591-fd66-4a47-94fb-9e068659869d None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:25.190181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc2591-fd66-4a47-94fb-9e068659869d None admin] RBAC: Adding query filter params (name=reader) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:25.190887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc2591-fd66-4a47-94fb-9e068659869d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:25.192693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc2591-fd66-4a47-94fb-9e068659869d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:25.202690 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 161/314] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:25.208371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700fe60-7a10-44c3-81d8-c1414f7c05e6 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:25.322116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700fe60-7a10-44c3-81d8-c1414f7c05e6 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:25.357978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaa390-544d-46cb-a9fc-aef6cb78d0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:25.359021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa390-544d-46cb-a9fc-aef6cb78d0f1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:25.359537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa390-544d-46cb-a9fc-aef6cb78d0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:25.360000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa390-544d-46cb-a9fc-aef6cb78d0f1 None admin] PATH_INFO: `/v3/users/d763afa2271b45b4ad785b3a0b392f8d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:25.361593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbaa390-544d-46cb-a9fc-aef6cb78d0f1 None admin] RBAC: Authorizing `identity:get_user(user_id=d763afa2271b45b4ad785b3a0b392f8d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:25.363451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbaa390-544d-46cb-a9fc-aef6cb78d0f1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:25.365691 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 154/315] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:25 2022] GET /identity/v3/users/d763afa2271b45b4ad785b3a0b392f8d => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:25.371557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc2591-fd66-4a47-94fb-9e068659869d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:25.490516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc2591-fd66-4a47-94fb-9e068659869d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:25.529813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771228c5-d6fb-4654-b83e-4068272a843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:25.530745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771228c5-d6fb-4654-b83e-4068272a843d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:25.531087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771228c5-d6fb-4654-b83e-4068272a843d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:25.531439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771228c5-d6fb-4654-b83e-4068272a843d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:25.598453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:25.608160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771228c5-d6fb-4654-b83e-4068272a843d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:25.609712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771228c5-d6fb-4654-b83e-4068272a843d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:25.726488 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 162/316] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:25.734651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaa390-544d-46cb-a9fc-aef6cb78d0f1 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:25.783620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:25.879282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaa390-544d-46cb-a9fc-aef6cb78d0f1 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:25.921188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82200083-aea7-4e51-ae09-82958c0766c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:25.922182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82200083-aea7-4e51-ae09-82958c0766c5 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:25.922649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82200083-aea7-4e51-ae09-82958c0766c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:25.923123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82200083-aea7-4e51-ae09-82958c0766c5 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:25.924477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82200083-aea7-4e51-ae09-82958c0766c5 None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:25.926128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82200083-aea7-4e51-ae09-82958c0766c5 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:25.928654 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 155/317] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:25 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:25.941452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771228c5-d6fb-4654-b83e-4068272a843d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:26.080742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:26.084570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771228c5-d6fb-4654-b83e-4068272a843d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:26.127228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f9bcd-4dfa-46fc-b9b4-8d7a7e816295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:26.128289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f9bcd-4dfa-46fc-b9b4-8d7a7e816295 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:26.128758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f9bcd-4dfa-46fc-b9b4-8d7a7e816295 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:26.129221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f9bcd-4dfa-46fc-b9b4-8d7a7e816295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:26.130140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f9bcd-4dfa-46fc-b9b4-8d7a7e816295 None admin] RBAC: Adding query filter params (role.id=3e7c7ed373dc46829d37081c99a331a0, scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8, user.id=d763afa2271b45b4ad785b3a0b392f8d) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:26.130716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f9bcd-4dfa-46fc-b9b4-8d7a7e816295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:26.132970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f9bcd-4dfa-46fc-b9b4-8d7a7e816295 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:26.147549 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 163/318] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:03:25 2022] GET /identity/v3/role_assignments?user.id=d763afa2271b45b4ad785b3a0b392f8d&scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8&role.id=3e7c7ed373dc46829d37081c99a331a0 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:26.232320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b28c08-5bb9-4c74-bb04-f77b33dc4218 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:26.232835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b28c08-5bb9-4c74-bb04-f77b33dc4218 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:26.232835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b28c08-5bb9-4c74-bb04-f77b33dc4218 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:26.234436 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 156/319] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:26.240473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420ff9c-0d6f-4b19-8727-4bddae069317 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:26.240726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420ff9c-0d6f-4b19-8727-4bddae069317 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:26.241008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420ff9c-0d6f-4b19-8727-4bddae069317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:26.264878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5420ff9c-0d6f-4b19-8727-4bddae069317 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:26.266615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5420ff9c-0d6f-4b19-8727-4bddae069317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:26.382654 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 164/320] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:26.679849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b28c08-5bb9-4c74-bb04-f77b33dc4218 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:26.737025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039ac3a-0643-46ac-b914-dfa270bf0ece None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:26.737284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039ac3a-0643-46ac-b914-dfa270bf0ece None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:26.737572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039ac3a-0643-46ac-b914-dfa270bf0ece None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:26.738961 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 165/321] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:03:26.745804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0d6e3-754b-4b35-bebb-061bc19ebfbc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:26.746115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0d6e3-754b-4b35-bebb-061bc19ebfbc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:26.746364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0d6e3-754b-4b35-bebb-061bc19ebfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:26.766209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-24a0d6e3-754b-4b35-bebb-061bc19ebfbc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:26.767459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24a0d6e3-754b-4b35-bebb-061bc19ebfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:26.813207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b28c08-5bb9-4c74-bb04-f77b33dc4218 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:26.815161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:26.850990 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 166/322] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:03:26.852351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1204247-7e9f-4dd1-bd38-bb84c14ff8e6 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:26.852628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1204247-7e9f-4dd1-bd38-bb84c14ff8e6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:26.852922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1204247-7e9f-4dd1-bd38-bb84c14ff8e6 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:26.854488 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 167/323] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:26.858530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8ea2f-18f7-4bb0-a5b4-bb00e3d4e4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:26.859492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8ea2f-18f7-4bb0-a5b4-bb00e3d4e4ad None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:26.859727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969ba59-e0ed-4171-9ec1-1e431ad3e2e2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:26.860010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969ba59-e0ed-4171-9ec1-1e431ad3e2e2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:26.860284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969ba59-e0ed-4171-9ec1-1e431ad3e2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:26.860545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8ea2f-18f7-4bb0-a5b4-bb00e3d4e4ad None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:26.861021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8ea2f-18f7-4bb0-a5b4-bb00e3d4e4ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:26.874575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8ea2f-18f7-4bb0-a5b4-bb00e3d4e4ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:26.879681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6969ba59-e0ed-4171-9ec1-1e431ad3e2e2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:26.880941 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-72e8ea2f-18f7-4bb0-a5b4-bb00e3d4e4ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:03:26.880941 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:26.880941 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:26.880941 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:26.880941 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:26.880941 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:26.880941 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:26.880941 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:26.880941 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:26.880941 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:26.880941 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:26.880941 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:26.880941 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:26.880941 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:26.880941 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:26.880941 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:26.882088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:26.882088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:26.882088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:26.882088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:26.882088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:26.882088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:26.882088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:26.882088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:26.882088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:26.882088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:26.882088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:26.882088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:26.882088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:26.882088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:26.882088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:26.882088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:26.883087 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:26.883087 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:26.883087 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:26.883087 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:26.883087 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:26.883087 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:26.883087 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:26.883087 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:26.883087 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:26.883087 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:26.883087 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:03:26.883087 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:26.883749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6969ba59-e0ed-4171-9ec1-1e431ad3e2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:26.883819 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 157/324] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:26.888520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8ea2f-18f7-4bb0-a5b4-bb00e3d4e4ad None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:26.898138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:26.963379 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 168/325] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:27.007675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8ea2f-18f7-4bb0-a5b4-bb00e3d4e4ad None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:27.042703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7affc-bac8-4feb-98ed-40241ddfeb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:27.043342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7affc-bac8-4feb-98ed-40241ddfeb24 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:27.043619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7affc-bac8-4feb-98ed-40241ddfeb24 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:27.043922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7affc-bac8-4feb-98ed-40241ddfeb24 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:27.044618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7affc-bac8-4feb-98ed-40241ddfeb24 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:27.044914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7affc-bac8-4feb-98ed-40241ddfeb24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:27.046283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7affc-bac8-4feb-98ed-40241ddfeb24 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:27.055418 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 158/326] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:27.063674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969ba59-e0ed-4171-9ec1-1e431ad3e2e2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:27.118504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7affc-bac8-4feb-98ed-40241ddfeb24 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:27.145771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:27.178839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969ba59-e0ed-4171-9ec1-1e431ad3e2e2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:27.220898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a7533-b033-4c8b-967b-d5ed9b7fdc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:27.221468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a7533-b033-4c8b-967b-d5ed9b7fdc55 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:27.221796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a7533-b033-4c8b-967b-d5ed9b7fdc55 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:27.222124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a7533-b033-4c8b-967b-d5ed9b7fdc55 None admin] PATH_INFO: `/v3/users/89a186601ca0438badf8c40e23b43b55` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:27.223707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a7533-b033-4c8b-967b-d5ed9b7fdc55 None admin] RBAC: Authorizing `identity:get_user(user_id=89a186601ca0438badf8c40e23b43b55)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:27.225289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a7533-b033-4c8b-967b-d5ed9b7fdc55 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:27.231421 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 169/327] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:27 2022] GET /identity/v3/users/89a186601ca0438badf8c40e23b43b55 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:27.233675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a7533-b033-4c8b-967b-d5ed9b7fdc55 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:27.240217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7affc-bac8-4feb-98ed-40241ddfeb24 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:27.253592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:27.276426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad582b5-8466-4638-a193-6bf92ee14774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:27.277165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad582b5-8466-4638-a193-6bf92ee14774 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:27.277439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad582b5-8466-4638-a193-6bf92ee14774 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:27.277709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad582b5-8466-4638-a193-6bf92ee14774 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:27.278904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad582b5-8466-4638-a193-6bf92ee14774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:27.280534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad582b5-8466-4638-a193-6bf92ee14774 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:27.282116 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 159/328] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:27.283028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad582b5-8466-4638-a193-6bf92ee14774 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:27.351036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a7533-b033-4c8b-967b-d5ed9b7fdc55 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:27.387811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:27.392817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1968aaf-c203-4c3c-bee3-087659d0f941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:27.393496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1968aaf-c203-4c3c-bee3-087659d0f941 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:27.393775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1968aaf-c203-4c3c-bee3-087659d0f941 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:27.394080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1968aaf-c203-4c3c-bee3-087659d0f941 None admin] PATH_INFO: `/v3/system/users/89a186601ca0438badf8c40e23b43b55/roles/3e7c7ed373dc46829d37081c99a331a0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:27.395583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1968aaf-c203-4c3c-bee3-087659d0f941 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=89a186601ca0438badf8c40e23b43b55, role_id=3e7c7ed373dc46829d37081c99a331a0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:27.396991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1968aaf-c203-4c3c-bee3-087659d0f941 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:27.398864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad582b5-8466-4638-a193-6bf92ee14774 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:27.405676 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 170/329] 10.222.0.27 () {58 vars in 1334 bytes} [Sun Aug 28 18:03:27 2022] PUT /identity/v3/system/users/89a186601ca0438badf8c40e23b43b55/roles/3e7c7ed373dc46829d37081c99a331a0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:03:27.406541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1968aaf-c203-4c3c-bee3-087659d0f941 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:27.447196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbac7a-9df9-4493-b000-3eeed8ab161d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:27.447893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbac7a-9df9-4493-b000-3eeed8ab161d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:27.448454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbac7a-9df9-4493-b000-3eeed8ab161d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:27.449266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbac7a-9df9-4493-b000-3eeed8ab161d None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:27.465403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbac7a-9df9-4493-b000-3eeed8ab161d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:27.471184 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-dffbac7a-9df9-4493-b000-3eeed8ab161d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:27.471184 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:27.471184 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:27.471184 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:27.471184 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:27.471184 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:27.471184 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:27.471184 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:27.471184 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:27.471184 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:27.471184 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:27.471184 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:27.471184 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:27.471184 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:27.471184 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:27.471184 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:27.472367 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:27.472367 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:27.472367 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:27.472367 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:27.472367 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:27.472367 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:27.472367 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:27.472367 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:27.472367 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:27.472367 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:27.472367 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:27.472367 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:27.472367 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:27.472367 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:27.472367 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:27.472367 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:27.473165 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:27.473165 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:27.473165 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:27.473165 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:27.473165 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:27.473165 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:27.473165 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:27.473165 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:27.473165 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:27.473165 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:27.473165 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:27.473165 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:27.473165 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 160/330] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:27.480044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbac7a-9df9-4493-b000-3eeed8ab161d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:27.529731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:27.574371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1968aaf-c203-4c3c-bee3-087659d0f941 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:27.614504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76069bc5-3590-4ee4-b3d6-b2812dddde83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:27.615143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76069bc5-3590-4ee4-b3d6-b2812dddde83 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:27.615449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76069bc5-3590-4ee4-b3d6-b2812dddde83 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:27.615725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76069bc5-3590-4ee4-b3d6-b2812dddde83 None admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:27.616358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76069bc5-3590-4ee4-b3d6-b2812dddde83 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:27.617830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76069bc5-3590-4ee4-b3d6-b2812dddde83 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:27.635934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbac7a-9df9-4493-b000-3eeed8ab161d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:27.636827 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 171/331] 10.222.0.27 () {60 vars in 1134 bytes} [Sun Aug 28 18:03:27 2022] POST /identity/v3/groups => generated 226 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:03:27.691961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e5fbd-e43f-45d0-af95-401693252bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:27.692596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e5fbd-e43f-45d0-af95-401693252bcc None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:27.692895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e5fbd-e43f-45d0-af95-401693252bcc None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:27.693169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e5fbd-e43f-45d0-af95-401693252bcc None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:27.693883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e5fbd-e43f-45d0-af95-401693252bcc None admin] RBAC: Adding query filter params (name=member) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:27.694191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e5fbd-e43f-45d0-af95-401693252bcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:27.695657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e5fbd-e43f-45d0-af95-401693252bcc None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:27.706093 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 161/332] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:27.712061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76069bc5-3590-4ee4-b3d6-b2812dddde83 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:27.847080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76069bc5-3590-4ee4-b3d6-b2812dddde83 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:27.889679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbada79-0e3c-44f8-a3a5-cb4cfb0d17fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:27.890236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbada79-0e3c-44f8-a3a5-cb4cfb0d17fd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:27.890726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbada79-0e3c-44f8-a3a5-cb4cfb0d17fd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:27.891210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbada79-0e3c-44f8-a3a5-cb4cfb0d17fd None admin] PATH_INFO: `/v3/users/d14628f201b74916b4625a0f313017bd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:27.892519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbada79-0e3c-44f8-a3a5-cb4cfb0d17fd None admin] RBAC: Authorizing `identity:get_user(user_id=d14628f201b74916b4625a0f313017bd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:27.894028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbada79-0e3c-44f8-a3a5-cb4cfb0d17fd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:27.896049 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 172/333] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:27 2022] GET /identity/v3/users/d14628f201b74916b4625a0f313017bd => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:27.902258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e5fbd-e43f-45d0-af95-401693252bcc None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:27.921571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:28.043460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e5fbd-e43f-45d0-af95-401693252bcc None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:28.096889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358cb80-65aa-438e-85f4-b996c9f7ab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:28.098149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358cb80-65aa-438e-85f4-b996c9f7ab78 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:28.098741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358cb80-65aa-438e-85f4-b996c9f7ab78 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:28.099375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358cb80-65aa-438e-85f4-b996c9f7ab78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:28.100690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358cb80-65aa-438e-85f4-b996c9f7ab78 None admin] RBAC: Adding query filter params (role.id=dcabcc9bd3bf42149eed3abc0d4799c8, user.id=d14628f201b74916b4625a0f313017bd, scope.system=all) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:28.101368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358cb80-65aa-438e-85f4-b996c9f7ab78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:28.103825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358cb80-65aa-438e-85f4-b996c9f7ab78 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:28.121246 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 162/334] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Aug 28 18:03:27 2022] GET /identity/v3/role_assignments?user.id=d14628f201b74916b4625a0f313017bd&scope.system=all&role.id=dcabcc9bd3bf42149eed3abc0d4799c8 => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:29.413240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69f01c-7e8e-4640-a6d2-2127553c5c30 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:29.413792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69f01c-7e8e-4640-a6d2-2127553c5c30 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:29.413792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69f01c-7e8e-4640-a6d2-2127553c5c30 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:29.415425 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 173/335] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:29.421926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325311c-17e4-49a0-b27c-715be7a3f2e4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:29.422464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325311c-17e4-49a0-b27c-715be7a3f2e4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:29.422464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325311c-17e4-49a0-b27c-715be7a3f2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:29.441840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5325311c-17e4-49a0-b27c-715be7a3f2e4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:29.443054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5325311c-17e4-49a0-b27c-715be7a3f2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:29.524702 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 163/336] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:29.862543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69f01c-7e8e-4640-a6d2-2127553c5c30 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:29.880771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:29.999364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69f01c-7e8e-4640-a6d2-2127553c5c30 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:30.046944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e09e14-3f39-4d8e-92d8-967fa530baff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:30.047625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e09e14-3f39-4d8e-92d8-967fa530baff None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:30.047904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e09e14-3f39-4d8e-92d8-967fa530baff None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:30.048175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e09e14-3f39-4d8e-92d8-967fa530baff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:30.058298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f62707-146d-42f9-8a25-34ccd8605d4b None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:30.058614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f62707-146d-42f9-8a25-34ccd8605d4b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:30.058897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f62707-146d-42f9-8a25-34ccd8605d4b None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:30.061062 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 164/337] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:30.065443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e09e14-3f39-4d8e-92d8-967fa530baff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:30.074276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-33e09e14-3f39-4d8e-92d8-967fa530baff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:03:30.074276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:30.074276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:30.074276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:30.074276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:30.074276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:30.074276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:30.074276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:30.074276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:30.074276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:30.074276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:30.074276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:30.074276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:30.074276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:30.074276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:30.074276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:30.075289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:30.075289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:30.075289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:30.075289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:30.075289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:30.075289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:30.075289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:30.075289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:30.075289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:30.075289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:30.075289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:30.075289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:30.075289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:30.075289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:30.075289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:30.075289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:30.076736 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:30.076736 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:30.076736 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:30.076736 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:30.076736 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:30.076736 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:30.076736 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:30.076736 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:30.076736 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:30.076736 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:30.076736 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:03:30.076736 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:30.077322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0eb99-5f28-414e-8696-0e2a368f99ea None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:30.077393 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 174/338] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:30.077464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0eb99-5f28-414e-8696-0e2a368f99ea None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:30.077464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0eb99-5f28-414e-8696-0e2a368f99ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:30.082180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e09e14-3f39-4d8e-92d8-967fa530baff None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:30.092418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:30.116265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-caa0eb99-5f28-414e-8696-0e2a368f99ea None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:30.117819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-caa0eb99-5f28-414e-8696-0e2a368f99ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:30.232876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:30.250241 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 165/339] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:30.306237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e09e14-3f39-4d8e-92d8-967fa530baff None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:30.364096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38afe5-413d-473c-928f-bc7a66be0d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:30.364778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38afe5-413d-473c-928f-bc7a66be0d1b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:30.365052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38afe5-413d-473c-928f-bc7a66be0d1b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:30.365321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38afe5-413d-473c-928f-bc7a66be0d1b None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:30.365990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38afe5-413d-473c-928f-bc7a66be0d1b None admin] RBAC: Adding query filter params (name=reader) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:30.366342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38afe5-413d-473c-928f-bc7a66be0d1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:30.367708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38afe5-413d-473c-928f-bc7a66be0d1b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:30.384182 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 175/340] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:30.390393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0eb99-5f28-414e-8696-0e2a368f99ea None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:30.543314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0eb99-5f28-414e-8696-0e2a368f99ea None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:30.602414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:30.611877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bf7be-0f59-4fb7-8aa9-a4d5e0eb48a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:30.612948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bf7be-0f59-4fb7-8aa9-a4d5e0eb48a5 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:30.613415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bf7be-0f59-4fb7-8aa9-a4d5e0eb48a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:30.613871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bf7be-0f59-4fb7-8aa9-a4d5e0eb48a5 None admin] PATH_INFO: `/v3/users/89a186601ca0438badf8c40e23b43b55` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:30.615335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127bf7be-0f59-4fb7-8aa9-a4d5e0eb48a5 None admin] RBAC: Authorizing `identity:get_user(user_id=89a186601ca0438badf8c40e23b43b55)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:30.617130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127bf7be-0f59-4fb7-8aa9-a4d5e0eb48a5 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:30.619309 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 166/341] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:03:30 2022] GET /identity/v3/users/89a186601ca0438badf8c40e23b43b55 => generated 293 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:30.628399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38afe5-413d-473c-928f-bc7a66be0d1b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:30.677244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7486697-a6dc-4985-9ca9-4430b5b44ebe None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:30.677865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7486697-a6dc-4985-9ca9-4430b5b44ebe None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:30.678324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7486697-a6dc-4985-9ca9-4430b5b44ebe None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:30.679985 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 167/342] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:03:30.685681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d8aa3-c72c-447b-b05f-bfa66cc795cf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:30.686266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d8aa3-c72c-447b-b05f-bfa66cc795cf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:30.686729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d8aa3-c72c-447b-b05f-bfa66cc795cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:30.724662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4e0d8aa3-c72c-447b-b05f-bfa66cc795cf None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:30.726308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4e0d8aa3-c72c-447b-b05f-bfa66cc795cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:30.845835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38afe5-413d-473c-928f-bc7a66be0d1b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:30.863164 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 168/343] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:03:30.863837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d8aa3-c72c-447b-b05f-bfa66cc795cf None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:30.923201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:30.932489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a244319-8b5a-4982-bed3-c1e40859bf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:30.933497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a244319-8b5a-4982-bed3-c1e40859bf59 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:30.933962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a244319-8b5a-4982-bed3-c1e40859bf59 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:30.934448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a244319-8b5a-4982-bed3-c1e40859bf59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:30.935445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a244319-8b5a-4982-bed3-c1e40859bf59 None admin] RBAC: Adding query filter params (role.id=3e7c7ed373dc46829d37081c99a331a0, user.id=89a186601ca0438badf8c40e23b43b55, scope.system=all) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:30.935968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a244319-8b5a-4982-bed3-c1e40859bf59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:30.938107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a244319-8b5a-4982-bed3-c1e40859bf59 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:30.962484 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 176/344] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Aug 28 18:03:30 2022] GET /identity/v3/role_assignments?user.id=89a186601ca0438badf8c40e23b43b55&scope.system=all&role.id=3e7c7ed373dc46829d37081c99a331a0 => generated 510 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:31.079055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d8aa3-c72c-447b-b05f-bfa66cc795cf None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:31.123349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:31.130787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54e746-289d-472a-b3d3-d3f3c3386246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:31.131465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54e746-289d-472a-b3d3-d3f3c3386246 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:31.131753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54e746-289d-472a-b3d3-d3f3c3386246 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:31.132023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54e746-289d-472a-b3d3-d3f3c3386246 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:31.148209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54e746-289d-472a-b3d3-d3f3c3386246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:31.152686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094c1c-457c-4752-a29e-918b674365cb None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:31.153633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094c1c-457c-4752-a29e-918b674365cb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:31.154134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094c1c-457c-4752-a29e-918b674365cb None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:31.154299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-2c54e746-289d-472a-b3d3-d3f3c3386246 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:31.154299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:31.154299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:31.154299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:31.154299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:31.154299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:31.154299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:31.154299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:31.154299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:31.154299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:31.154299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:31.154299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:31.154299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:31.154299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:31.154299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:31.154299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:31.155124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:31.155124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:31.155124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:31.155124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:31.155124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:31.155124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:31.155124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:31.155124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:31.155124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:31.155124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:31.155124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:31.155124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:31.155124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:31.155124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:31.155124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:31.155124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:31.155958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:31.155958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:31.155958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:31.155958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:31.155958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:31.155958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:31.155958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:31.155958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:31.155958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:31.155958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:31.155958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:31.155958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:31.155958 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 169/345] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:31.156596 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 177/346] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:31.162137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54e746-289d-472a-b3d3-d3f3c3386246 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:31.162822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982279b-a0fa-427f-9865-e549aafb1121 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:31.163106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982279b-a0fa-427f-9865-e549aafb1121 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:31.163430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982279b-a0fa-427f-9865-e549aafb1121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:31.203756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c982279b-a0fa-427f-9865-e549aafb1121 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:31.204965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c982279b-a0fa-427f-9865-e549aafb1121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:31.321129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54e746-289d-472a-b3d3-d3f3c3386246 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:31.357642 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 178/347] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:03:31.361255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37661640-ab41-4c0f-96ef-27755551c591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:31.362148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37661640-ab41-4c0f-96ef-27755551c591 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:31.362621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37661640-ab41-4c0f-96ef-27755551c591 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:31.363096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37661640-ab41-4c0f-96ef-27755551c591 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:31.368326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37661640-ab41-4c0f-96ef-27755551c591 None admin] RBAC: Adding query filter params (name=member) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:31.368942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37661640-ab41-4c0f-96ef-27755551c591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:31.370675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37661640-ab41-4c0f-96ef-27755551c591 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:31.380954 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 170/348] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:31.386840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982279b-a0fa-427f-9865-e549aafb1121 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:31.417734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37661640-ab41-4c0f-96ef-27755551c591 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:31.494137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:31.552553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37661640-ab41-4c0f-96ef-27755551c591 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:31.577799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982279b-a0fa-427f-9865-e549aafb1121 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:31.600240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca838fc-b097-4459-bfdd-e20407319651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:31.601485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca838fc-b097-4459-bfdd-e20407319651 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:31.602028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca838fc-b097-4459-bfdd-e20407319651 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:31.602596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca838fc-b097-4459-bfdd-e20407319651 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:31.615007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca838fc-b097-4459-bfdd-e20407319651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:31.622002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-0ca838fc-b097-4459-bfdd-e20407319651 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:31.622002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:31.622002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:31.622002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:31.622002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:31.622002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:31.622002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:31.622002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:31.622002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:31.622002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:31.622002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:31.622002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:31.622002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:31.622002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:31.622002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:31.622002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:31.622952 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:31.622952 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:31.622952 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:31.622952 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:31.622952 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:31.622952 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:31.622952 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:31.622952 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:31.622952 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:31.622952 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:31.622952 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:31.622952 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:31.622952 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:31.622952 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:31.622952 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:31.622952 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:31.623785 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:31.623785 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:31.623785 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:31.623785 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:31.623785 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:31.623785 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:31.623785 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:31.623785 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:31.623785 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:31.623785 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:31.623785 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:31.623785 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:31.627093 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 171/349] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:03:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:03:31.627239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:31.633904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca838fc-b097-4459-bfdd-e20407319651 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:31.700043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95677f-99a0-4332-93d9-e38b35788e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:31.700740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95677f-99a0-4332-93d9-e38b35788e99 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:31.701058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95677f-99a0-4332-93d9-e38b35788e99 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:31.701329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95677f-99a0-4332-93d9-e38b35788e99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:31.752010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca838fc-b097-4459-bfdd-e20407319651 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:31.791421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1aa12-38b8-4043-9414-9fb7dc11d4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:31.792436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1aa12-38b8-4043-9414-9fb7dc11d4a3 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:31.792929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1aa12-38b8-4043-9414-9fb7dc11d4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:31.793792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1aa12-38b8-4043-9414-9fb7dc11d4a3 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:31.794730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1aa12-38b8-4043-9414-9fb7dc11d4a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:31.795229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1aa12-38b8-4043-9414-9fb7dc11d4a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:31.803496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:31.804068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1aa12-38b8-4043-9414-9fb7dc11d4a3 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:31.816587 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 172/350] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:03:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:31.826638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1aa12-38b8-4043-9414-9fb7dc11d4a3 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:31.901763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95677f-99a0-4332-93d9-e38b35788e99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:31.904578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95677f-99a0-4332-93d9-e38b35788e99 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:31.996763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1aa12-38b8-4043-9414-9fb7dc11d4a3 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:32.036421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e18a8-f7b0-4bbe-857f-9e2ca6914011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:32.036924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e18a8-f7b0-4bbe-857f-9e2ca6914011 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:32.037202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e18a8-f7b0-4bbe-857f-9e2ca6914011 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:32.037474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e18a8-f7b0-4bbe-857f-9e2ca6914011 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:32.044467 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 179/351] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:32.045647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95677f-99a0-4332-93d9-e38b35788e99 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:32.067096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:32.091221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:32.122535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e18a8-f7b0-4bbe-857f-9e2ca6914011 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:32.124456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e18a8-f7b0-4bbe-857f-9e2ca6914011 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:32.189369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95677f-99a0-4332-93d9-e38b35788e99 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:32.247110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972180ad-f959-4f25-9afa-e39e73135575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:32.248138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972180ad-f959-4f25-9afa-e39e73135575 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:32.249081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972180ad-f959-4f25-9afa-e39e73135575 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:32.249565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972180ad-f959-4f25-9afa-e39e73135575 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:32.267185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972180ad-f959-4f25-9afa-e39e73135575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:32.272514 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 173/352] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:32.273564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e18a8-f7b0-4bbe-857f-9e2ca6914011 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:32.275497 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-972180ad-f959-4f25-9afa-e39e73135575 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:32.275497 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:32.275497 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:32.275497 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:32.275497 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:32.275497 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:32.275497 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:32.275497 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:32.275497 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:32.275497 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:32.275497 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:32.275497 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:32.275497 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:32.275497 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:32.275497 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:32.275497 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:32.276577 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:32.276577 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:32.276577 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:32.276577 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:32.276577 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:32.276577 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:32.276577 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:32.276577 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:32.276577 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:32.276577 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:32.276577 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:32.276577 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:32.276577 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:32.276577 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:32.276577 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:32.276577 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:32.277390 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:32.277390 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:32.277390 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:32.277390 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:32.277390 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:32.277390 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:32.277390 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:32.277390 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:32.277390 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:32.277390 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:32.277390 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:32.277390 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:32.280009 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 180/353] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:32.281030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972180ad-f959-4f25-9afa-e39e73135575 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:32.402200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:32.404387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:32.434989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972180ad-f959-4f25-9afa-e39e73135575 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:32.454961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e18a8-f7b0-4bbe-857f-9e2ca6914011 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:32.499015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80d03b-d14b-402a-9df8-f9a1af0a1927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:32.500068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80d03b-d14b-402a-9df8-f9a1af0a1927 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:32.500517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80d03b-d14b-402a-9df8-f9a1af0a1927 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:32.500957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80d03b-d14b-402a-9df8-f9a1af0a1927 None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:32.502558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80d03b-d14b-402a-9df8-f9a1af0a1927 None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:32.508362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80d03b-d14b-402a-9df8-f9a1af0a1927 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:32.508362 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 181/354] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:32 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:32.508362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53af0c-79e0-47f9-bc46-e4278cc7257c None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:32.508362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53af0c-79e0-47f9-bc46-e4278cc7257c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:32.508362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53af0c-79e0-47f9-bc46-e4278cc7257c None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:32.510375 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 182/355] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:32.511144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53af0c-79e0-47f9-bc46-e4278cc7257c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:32.532518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2e07b-4748-42fc-b408-dc06e1d5fb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:32.533452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2e07b-4748-42fc-b408-dc06e1d5fb90 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:32.533766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2e07b-4748-42fc-b408-dc06e1d5fb90 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:32.534082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2e07b-4748-42fc-b408-dc06e1d5fb90 None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:32.535679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2e07b-4748-42fc-b408-dc06e1d5fb90 None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:32.537777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2e07b-4748-42fc-b408-dc06e1d5fb90 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:32.540145 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 174/356] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:32 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:32.546083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb65764-55f6-4061-9f57-60532711fff3 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:32.546389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb65764-55f6-4061-9f57-60532711fff3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:32.546642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb65764-55f6-4061-9f57-60532711fff3 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:32.548138 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 175/357] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:32.549438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894390be-dbcc-4c20-9326-778fc610b353 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:32.549692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894390be-dbcc-4c20-9326-778fc610b353 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:32.549961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894390be-dbcc-4c20-9326-778fc610b353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:32.576861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-894390be-dbcc-4c20-9326-778fc610b353 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:32.578952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-894390be-dbcc-4c20-9326-778fc610b353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:32.686263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53af0c-79e0-47f9-bc46-e4278cc7257c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:32.691303 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 176/358] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:32.691303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894390be-dbcc-4c20-9326-778fc610b353 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:32.750069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae6e6d-7e16-45e3-8ac9-7eac9af13d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:32.750778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae6e6d-7e16-45e3-8ac9-7eac9af13d0b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:32.750974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae6e6d-7e16-45e3-8ac9-7eac9af13d0b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:32.751248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae6e6d-7e16-45e3-8ac9-7eac9af13d0b None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:32.752037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae6e6d-7e16-45e3-8ac9-7eac9af13d0b None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:32.752333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae6e6d-7e16-45e3-8ac9-7eac9af13d0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:32.753720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae6e6d-7e16-45e3-8ac9-7eac9af13d0b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:32.767287 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 183/359] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:32.767287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae6e6d-7e16-45e3-8ac9-7eac9af13d0b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:32.777241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:32.797616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:32.841896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894390be-dbcc-4c20-9326-778fc610b353 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:32.896159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bd078-c1cc-48e8-a700-a74100f3b6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:32.896159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bd078-c1cc-48e8-a700-a74100f3b6b2 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:32.896464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bd078-c1cc-48e8-a700-a74100f3b6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:32.896966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bd078-c1cc-48e8-a700-a74100f3b6b2 None admin] PATH_INFO: `/v3/groups/10fca9e8d32541f7831341e321e111be` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:32.911468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bd078-c1cc-48e8-a700-a74100f3b6b2 None admin] RBAC: Authorizing `identity:get_group(group_id=10fca9e8d32541f7831341e321e111be)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:32.913109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bd078-c1cc-48e8-a700-a74100f3b6b2 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:32.915083 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 177/360] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 18:03:32 2022] GET /identity/v3/groups/10fca9e8d32541f7831341e321e111be => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:32.916321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388afc0-1111-4754-aca7-9c2400590057 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:32.916675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388afc0-1111-4754-aca7-9c2400590057 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:32.916961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388afc0-1111-4754-aca7-9c2400590057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:32.921685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae6e6d-7e16-45e3-8ac9-7eac9af13d0b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:32.941340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b388afc0-1111-4754-aca7-9c2400590057 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:32.942502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b388afc0-1111-4754-aca7-9c2400590057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:32.974888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec840a8a-ca56-4659-a573-49d1a3cbb921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:32.975573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec840a8a-ca56-4659-a573-49d1a3cbb921 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:32.975848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec840a8a-ca56-4659-a573-49d1a3cbb921 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:32.976120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec840a8a-ca56-4659-a573-49d1a3cbb921 None admin] PATH_INFO: `/v3/groups/10fca9e8d32541f7831341e321e111be` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:32.978251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec840a8a-ca56-4659-a573-49d1a3cbb921 None admin] RBAC: Authorizing `identity:get_group(group_id=10fca9e8d32541f7831341e321e111be)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:32.978727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec840a8a-ca56-4659-a573-49d1a3cbb921 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:32.980375 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 184/361] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 18:03:32 2022] GET /identity/v3/groups/10fca9e8d32541f7831341e321e111be => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:32.981148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec840a8a-ca56-4659-a573-49d1a3cbb921 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:33.033729 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 178/362] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:33.035741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388afc0-1111-4754-aca7-9c2400590057 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:33.106045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:33.126112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:33.138213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec840a8a-ca56-4659-a573-49d1a3cbb921 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:33.178549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388afc0-1111-4754-aca7-9c2400590057 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:33.192263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b93c3-4047-486f-bf4c-818967208b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:33.192846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b93c3-4047-486f-bf4c-818967208b27 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:33.193385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b93c3-4047-486f-bf4c-818967208b27 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:33.193385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b93c3-4047-486f-bf4c-818967208b27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:33.242794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb453030-7491-46fd-ab94-4925a065d97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:33.243461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb453030-7491-46fd-ab94-4925a065d97c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:33.243736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb453030-7491-46fd-ab94-4925a065d97c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:33.244005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb453030-7491-46fd-ab94-4925a065d97c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:33.244739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb453030-7491-46fd-ab94-4925a065d97c None admin] RBAC: Adding query filter params (group.id=10fca9e8d32541f7831341e321e111be, role.id=81040db4535e417891c10dd996b1eac5, scope.project.id=1be8f0e040484baab23f1815ce704594) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:33.245042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb453030-7491-46fd-ab94-4925a065d97c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:33.246482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb453030-7491-46fd-ab94-4925a065d97c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:33.253479 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 179/363] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 18:03:33 2022] GET /identity/v3/role_assignments?group.id=10fca9e8d32541f7831341e321e111be&scope.project.id=1be8f0e040484baab23f1815ce704594&role.id=81040db4535e417891c10dd996b1eac5 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:33.254751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb453030-7491-46fd-ab94-4925a065d97c None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:33.284559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b93c3-4047-486f-bf4c-818967208b27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:33.286323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b93c3-4047-486f-bf4c-818967208b27 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:33.406488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:33.408625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb453030-7491-46fd-ab94-4925a065d97c None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:33.440800 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 185/364] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:33.443076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b93c3-4047-486f-bf4c-818967208b27 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:33.452514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:33.465290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da86f2-d427-49dd-b422-202acb8ac4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:33.466018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da86f2-d427-49dd-b422-202acb8ac4d7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:33.466286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da86f2-d427-49dd-b422-202acb8ac4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:33.466548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da86f2-d427-49dd-b422-202acb8ac4d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:33.481348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da86f2-d427-49dd-b422-202acb8ac4d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:33.486824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-b4da86f2-d427-49dd-b422-202acb8ac4d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:33.486824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:33.486824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:33.486824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:33.486824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:33.486824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:33.486824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:33.486824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:33.486824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:33.486824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:33.486824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:33.486824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:33.486824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:33.486824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:33.486824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:33.486824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:33.488630 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:33.488630 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:33.488630 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:33.488630 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:33.488630 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:33.488630 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:33.488630 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:33.488630 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:33.488630 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:33.488630 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:33.488630 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:33.488630 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:33.488630 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:33.488630 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:33.488630 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:33.488630 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:33.490084 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:33.490084 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:33.490084 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:33.490084 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:33.490084 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:33.490084 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:33.490084 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:33.490084 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:33.490084 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:33.490084 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:33.490084 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:33.490084 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:33.490084 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 180/365] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:03:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:33.490084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da86f2-d427-49dd-b422-202acb8ac4d7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:33.618288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b93c3-4047-486f-bf4c-818967208b27 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:33.668873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da86f2-d427-49dd-b422-202acb8ac4d7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:33.687589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bb6b9-677c-4752-a371-906db321f329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:33.688219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bb6b9-677c-4752-a371-906db321f329 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:33.688767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bb6b9-677c-4752-a371-906db321f329 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:33.689079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bb6b9-677c-4752-a371-906db321f329 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:33.690350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bb6b9-677c-4752-a371-906db321f329 None admin] RBAC: Adding query filter params (group.id=10fca9e8d32541f7831341e321e111be, role.id=dcabcc9bd3bf42149eed3abc0d4799c8, scope.project.id=1be8f0e040484baab23f1815ce704594) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:33.690681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bb6b9-677c-4752-a371-906db321f329 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:33.692712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bb6b9-677c-4752-a371-906db321f329 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:33.700608 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 186/366] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 18:03:33 2022] GET /identity/v3/role_assignments?group.id=10fca9e8d32541f7831341e321e111be&scope.project.id=1be8f0e040484baab23f1815ce704594&role.id=dcabcc9bd3bf42149eed3abc0d4799c8 => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:33.701388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bb6b9-677c-4752-a371-906db321f329 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:33.720297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4007b2-76b6-4eaa-80df-e787865f9b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:33.720984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4007b2-76b6-4eaa-80df-e787865f9b47 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:33.721262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4007b2-76b6-4eaa-80df-e787865f9b47 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:33.721530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4007b2-76b6-4eaa-80df-e787865f9b47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:33.739516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4007b2-76b6-4eaa-80df-e787865f9b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:33.744993 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-0e4007b2-76b6-4eaa-80df-e787865f9b47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:03:33.744993 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:33.744993 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:33.744993 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:33.744993 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:33.744993 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:33.744993 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:33.744993 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:33.744993 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:33.744993 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:33.744993 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:33.744993 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:33.744993 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:33.744993 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:33.744993 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:33.744993 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:33.746021 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:33.746021 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:33.746021 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:33.746021 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:33.746021 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:33.746021 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:33.746021 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:33.746021 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:33.746021 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:33.746021 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:33.746021 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:33.746021 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:33.746021 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:33.746021 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:33.746021 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:33.746021 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:33.747369 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:33.747369 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:33.747369 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:33.747369 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:33.747369 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:33.747369 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:33.747369 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:33.747369 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:33.747369 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:33.747369 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:33.747369 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:03:33.747369 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:33.747369 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 181/367] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:03:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:33.752201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4007b2-76b6-4eaa-80df-e787865f9b47 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:33.783103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:33.816765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:33.847780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bb6b9-677c-4752-a371-906db321f329 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:33.890178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4007b2-76b6-4eaa-80df-e787865f9b47 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:33.896074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3a184-59b2-44ec-92e5-6b38ec1b4761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:33.896822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3a184-59b2-44ec-92e5-6b38ec1b4761 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:33.897172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3a184-59b2-44ec-92e5-6b38ec1b4761 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:33.897534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3a184-59b2-44ec-92e5-6b38ec1b4761 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:33.899570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3a184-59b2-44ec-92e5-6b38ec1b4761 None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:33.901755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3a184-59b2-44ec-92e5-6b38ec1b4761 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:33.904370 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 187/368] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:33 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:33.905182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3a184-59b2-44ec-92e5-6b38ec1b4761 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:33.933825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615f45f-5f85-4d1a-8ada-c52927c70dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:33.935050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f45f-5f85-4d1a-8ada-c52927c70dba None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:33.935534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f45f-5f85-4d1a-8ada-c52927c70dba None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:33.936019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f45f-5f85-4d1a-8ada-c52927c70dba None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:33.936891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615f45f-5f85-4d1a-8ada-c52927c70dba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:33.937386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615f45f-5f85-4d1a-8ada-c52927c70dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:33.940115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615f45f-5f85-4d1a-8ada-c52927c70dba None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:33.950520 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 182/369] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:03:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:33.951936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615f45f-5f85-4d1a-8ada-c52927c70dba None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:34.068558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3a184-59b2-44ec-92e5-6b38ec1b4761 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:34.085902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:34.099160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615f45f-5f85-4d1a-8ada-c52927c70dba None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:34.118729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:34.119418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7ac64-f5bc-464d-8f6a-0a55e01f11f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:34.120428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7ac64-f5bc-464d-8f6a-0a55e01f11f3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:34.120976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7ac64-f5bc-464d-8f6a-0a55e01f11f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:34.121447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7ac64-f5bc-464d-8f6a-0a55e01f11f3 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:34.122584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7ac64-f5bc-464d-8f6a-0a55e01f11f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:34.123040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7ac64-f5bc-464d-8f6a-0a55e01f11f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:34.125590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7ac64-f5bc-464d-8f6a-0a55e01f11f3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:34.138225 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 188/370] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:34.140047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7ac64-f5bc-464d-8f6a-0a55e01f11f3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:34.147105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8cb53-53a3-4207-ae88-b30d9f6a1e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:34.148015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8cb53-53a3-4207-ae88-b30d9f6a1e6b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:34.148424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8cb53-53a3-4207-ae88-b30d9f6a1e6b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:34.148699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8cb53-53a3-4207-ae88-b30d9f6a1e6b None admin] PATH_INFO: `/v3/groups/10fca9e8d32541f7831341e321e111be` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:34.149882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8cb53-53a3-4207-ae88-b30d9f6a1e6b None admin] RBAC: Authorizing `identity:get_group(group_id=10fca9e8d32541f7831341e321e111be)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:34.152479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8cb53-53a3-4207-ae88-b30d9f6a1e6b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:34.154999 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 183/371] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 18:03:33 2022] GET /identity/v3/groups/10fca9e8d32541f7831341e321e111be => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:34.155881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8cb53-53a3-4207-ae88-b30d9f6a1e6b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:34.265637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7ac64-f5bc-464d-8f6a-0a55e01f11f3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:34.295694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8cb53-53a3-4207-ae88-b30d9f6a1e6b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:34.302408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571ece8-e69a-489e-8c28-fe9488e5432d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:34.303031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ece8-e69a-489e-8c28-fe9488e5432d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:34.303336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ece8-e69a-489e-8c28-fe9488e5432d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:34.303613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ece8-e69a-489e-8c28-fe9488e5432d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:34.352223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf23ac-6fb2-405a-8873-08552c445dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:34.353244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf23ac-6fb2-405a-8873-08552c445dc9 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:34.354058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf23ac-6fb2-405a-8873-08552c445dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:34.354544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf23ac-6fb2-405a-8873-08552c445dc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:34.362422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:34.404976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571ece8-e69a-489e-8c28-fe9488e5432d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:34.406821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571ece8-e69a-489e-8c28-fe9488e5432d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:34.440889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:34.470021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf23ac-6fb2-405a-8873-08552c445dc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:34.471735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf23ac-6fb2-405a-8873-08552c445dc9 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:34.533306 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 189/372] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:34.534859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571ece8-e69a-489e-8c28-fe9488e5432d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:34.620633 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 184/373] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:34.621455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf23ac-6fb2-405a-8873-08552c445dc9 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:34.634525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:34.673214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571ece8-e69a-489e-8c28-fe9488e5432d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:34.725415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5049715-9549-4550-9ade-be81523ce47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:34.726372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5049715-9549-4550-9ade-be81523ce47c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:34.726847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5049715-9549-4550-9ade-be81523ce47c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:34.727334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5049715-9549-4550-9ade-be81523ce47c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:34.728261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5049715-9549-4550-9ade-be81523ce47c None admin] RBAC: Adding query filter params (group.id=10fca9e8d32541f7831341e321e111be, role.id=dcabcc9bd3bf42149eed3abc0d4799c8, scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:34.728765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5049715-9549-4550-9ade-be81523ce47c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:34.730415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5049715-9549-4550-9ade-be81523ce47c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:34.737167 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 190/374] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 18:03:34 2022] GET /identity/v3/role_assignments?group.id=10fca9e8d32541f7831341e321e111be&scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8&role.id=dcabcc9bd3bf42149eed3abc0d4799c8 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:34.737785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:34.738769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5049715-9549-4550-9ade-be81523ce47c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:34.785797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf23ac-6fb2-405a-8873-08552c445dc9 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:34.853437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76b7e3-7901-47cd-a4e5-5e58fe9978a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:34.854638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76b7e3-7901-47cd-a4e5-5e58fe9978a0 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:34.855007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76b7e3-7901-47cd-a4e5-5e58fe9978a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:34.855408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76b7e3-7901-47cd-a4e5-5e58fe9978a0 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:34.856982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76b7e3-7901-47cd-a4e5-5e58fe9978a0 None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:34.859420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76b7e3-7901-47cd-a4e5-5e58fe9978a0 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:34.861939 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 185/375] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:34 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:34.869866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76b7e3-7901-47cd-a4e5-5e58fe9978a0 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:34.964827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5049715-9549-4550-9ade-be81523ce47c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:35.013310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76b7e3-7901-47cd-a4e5-5e58fe9978a0 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:35.056756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1f51d-62cc-45a5-9642-803e67ea1497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:35.057776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1f51d-62cc-45a5-9642-803e67ea1497 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:35.058265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1f51d-62cc-45a5-9642-803e67ea1497 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:35.058740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1f51d-62cc-45a5-9642-803e67ea1497 None admin] PATH_INFO: `/v3/projects/2e232b8348b844fbb8b30d77b02f1872` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:35.063308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c385243-ac9e-4c2d-a7ca-2cde00b0b232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:35.063308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c385243-ac9e-4c2d-a7ca-2cde00b0b232 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:35.063308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c385243-ac9e-4c2d-a7ca-2cde00b0b232 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:35.063308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c385243-ac9e-4c2d-a7ca-2cde00b0b232 None admin] PATH_INFO: `/v3/groups/10fca9e8d32541f7831341e321e111be` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:35.063670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c385243-ac9e-4c2d-a7ca-2cde00b0b232 None admin] RBAC: Authorizing `identity:get_group(group_id=10fca9e8d32541f7831341e321e111be)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:35.064221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c385243-ac9e-4c2d-a7ca-2cde00b0b232 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:35.064861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1f51d-62cc-45a5-9642-803e67ea1497 None admin] RBAC: Authorizing `identity:get_project(project_id=2e232b8348b844fbb8b30d77b02f1872)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:35.065858 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 186/376] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 18:03:34 2022] GET /identity/v3/groups/10fca9e8d32541f7831341e321e111be => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:35.066817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1f51d-62cc-45a5-9642-803e67ea1497 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:35.069103 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 191/377] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:34 2022] GET /identity/v3/projects/2e232b8348b844fbb8b30d77b02f1872 => generated 344 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:35.074618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1f51d-62cc-45a5-9642-803e67ea1497 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:35.074917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c385243-ac9e-4c2d-a7ca-2cde00b0b232 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:35.082128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:35.102231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:35.208604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c385243-ac9e-4c2d-a7ca-2cde00b0b232 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:35.262813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9f2b4-2565-47ea-819e-c2f3c96e4c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:35.263544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9f2b4-2565-47ea-819e-c2f3c96e4c60 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:35.263824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9f2b4-2565-47ea-819e-c2f3c96e4c60 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:35.264100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9f2b4-2565-47ea-819e-c2f3c96e4c60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:35.264915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9f2b4-2565-47ea-819e-c2f3c96e4c60 None admin] RBAC: Adding query filter params (group.id=10fca9e8d32541f7831341e321e111be, role.id=81040db4535e417891c10dd996b1eac5, scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:35.265231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9f2b4-2565-47ea-819e-c2f3c96e4c60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:35.266700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9f2b4-2565-47ea-819e-c2f3c96e4c60 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:35.274276 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 187/378] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 18:03:35 2022] GET /identity/v3/role_assignments?group.id=10fca9e8d32541f7831341e321e111be&scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8&role.id=81040db4535e417891c10dd996b1eac5 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:35.328290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1f51d-62cc-45a5-9642-803e67ea1497 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:35.380860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186b980-0237-4b11-bd40-c5c8cfc3ed2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:35.381507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186b980-0237-4b11-bd40-c5c8cfc3ed2d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:35.381778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186b980-0237-4b11-bd40-c5c8cfc3ed2d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:35.382044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186b980-0237-4b11-bd40-c5c8cfc3ed2d None admin] PATH_INFO: `/v3/groups/8f34c89248894775ae0b02e1404dd83c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:35.394525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186b980-0237-4b11-bd40-c5c8cfc3ed2d None admin] RBAC: Authorizing `identity:get_group(group_id=8f34c89248894775ae0b02e1404dd83c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:35.396047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186b980-0237-4b11-bd40-c5c8cfc3ed2d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:35.398066 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 192/379] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 18:03:35 2022] GET /identity/v3/groups/8f34c89248894775ae0b02e1404dd83c => generated 229 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:35.404795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9f2b4-2565-47ea-819e-c2f3c96e4c60 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:35.538860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:35.573439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9f2b4-2565-47ea-819e-c2f3c96e4c60 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:35.623801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d5caa-b9f6-4c23-bdd3-ac047dabcb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:35.624351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d5caa-b9f6-4c23-bdd3-ac047dabcb1d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:35.624632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d5caa-b9f6-4c23-bdd3-ac047dabcb1d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:35.624908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d5caa-b9f6-4c23-bdd3-ac047dabcb1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:35.625652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d5caa-b9f6-4c23-bdd3-ac047dabcb1d None admin] RBAC: Adding query filter params (group.id=8f34c89248894775ae0b02e1404dd83c, role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=2e232b8348b844fbb8b30d77b02f1872) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:35.625963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d5caa-b9f6-4c23-bdd3-ac047dabcb1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:35.627475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d5caa-b9f6-4c23-bdd3-ac047dabcb1d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:35.635982 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 188/380] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 18:03:35 2022] GET /identity/v3/role_assignments?group.id=8f34c89248894775ae0b02e1404dd83c&scope.project.id=2e232b8348b844fbb8b30d77b02f1872&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:35.875165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee633d1-b5a1-4ba8-9996-ad2242292b54 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:35.875412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee633d1-b5a1-4ba8-9996-ad2242292b54 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:35.875774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee633d1-b5a1-4ba8-9996-ad2242292b54 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:35.877176 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 193/381] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:35.882865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4d02e-deeb-4589-b2ec-def1859becf7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:35.883784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4d02e-deeb-4589-b2ec-def1859becf7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:35.884254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4d02e-deeb-4589-b2ec-def1859becf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:35.904730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b5a4d02e-deeb-4589-b2ec-def1859becf7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:35.906346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b5a4d02e-deeb-4589-b2ec-def1859becf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:35.998456 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 189/382] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:36.177841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765bec6-bf17-4f2c-a52a-d3f566873a56 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:36.178815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765bec6-bf17-4f2c-a52a-d3f566873a56 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:36.179342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765bec6-bf17-4f2c-a52a-d3f566873a56 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:36.181191 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 194/383] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:36.186609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5c751-fbfd-4a10-b663-0aed54e12169 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:36.186897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5c751-fbfd-4a10-b663-0aed54e12169 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:36.187175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5c751-fbfd-4a10-b663-0aed54e12169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:36.216769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5fd5c751-fbfd-4a10-b663-0aed54e12169 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:36.218063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5fd5c751-fbfd-4a10-b663-0aed54e12169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:36.298643 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 190/384] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:36.444088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765bec6-bf17-4f2c-a52a-d3f566873a56 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:36.530521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:36.587408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765bec6-bf17-4f2c-a52a-d3f566873a56 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:36.626136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5fe1c-2249-4859-81bf-08954a9e207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:36.626785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5fe1c-2249-4859-81bf-08954a9e207b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:36.627063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5fe1c-2249-4859-81bf-08954a9e207b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:36.627420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5fe1c-2249-4859-81bf-08954a9e207b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:36.641656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5fe1c-2249-4859-81bf-08954a9e207b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:36.644011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5c751-fbfd-4a10-b663-0aed54e12169 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:36.647765 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-0dd5fe1c-2249-4859-81bf-08954a9e207b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:36.647765 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:36.647765 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:36.647765 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:36.647765 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:36.647765 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:36.647765 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:36.647765 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:36.647765 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:36.647765 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:36.647765 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:36.647765 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:36.647765 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:36.647765 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:36.647765 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:36.647765 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:36.648799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:36.648799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:36.648799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:36.648799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:36.648799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:36.648799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:36.648799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:36.648799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:36.648799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:36.648799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:36.648799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:36.648799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:36.648799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:36.648799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:36.648799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:36.648799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:36.649573 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:36.649573 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:36.649573 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:36.649573 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:36.649573 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:36.649573 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:36.649573 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:36.649573 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:36.649573 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:36.649573 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:36.649573 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:36.649573 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:36.649573 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 195/385] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:03:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:36.651917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:36.662134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5fe1c-2249-4859-81bf-08954a9e207b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:36.789622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5fe1c-2249-4859-81bf-08954a9e207b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:36.819897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:36.829612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45672ba-f1aa-4cdc-8f09-8513736f990f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:36.830240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45672ba-f1aa-4cdc-8f09-8513736f990f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:36.830516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45672ba-f1aa-4cdc-8f09-8513736f990f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:36.830786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45672ba-f1aa-4cdc-8f09-8513736f990f None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:36.831900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45672ba-f1aa-4cdc-8f09-8513736f990f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:36.832419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45672ba-f1aa-4cdc-8f09-8513736f990f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:36.833818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45672ba-f1aa-4cdc-8f09-8513736f990f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:36.844597 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 196/386] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:03:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:36.850144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45672ba-f1aa-4cdc-8f09-8513736f990f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:36.861893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5c751-fbfd-4a10-b663-0aed54e12169 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:36.940928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970945a9-7944-443e-8074-6bccb2ccbdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:36.941719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970945a9-7944-443e-8074-6bccb2ccbdbe None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:36.941884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970945a9-7944-443e-8074-6bccb2ccbdbe None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:36.942090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970945a9-7944-443e-8074-6bccb2ccbdbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:36.960725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45672ba-f1aa-4cdc-8f09-8513736f990f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:36.964381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970945a9-7944-443e-8074-6bccb2ccbdbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:36.976049 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-970945a9-7944-443e-8074-6bccb2ccbdbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:36.976049 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:36.976049 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:36.976049 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:36.976049 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:36.976049 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:36.976049 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:36.976049 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:36.976049 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:36.976049 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:36.976049 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:36.976049 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:36.976049 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:36.976049 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:36.976049 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:36.976049 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:36.978111 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:36.978111 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:36.978111 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:36.978111 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:36.978111 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:36.978111 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:36.978111 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:36.978111 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:36.978111 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:36.978111 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:36.978111 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:36.978111 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:36.978111 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:36.978111 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:36.978111 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:36.978111 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:36.980034 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:36.980034 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:36.980034 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:36.980034 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:36.980034 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:36.980034 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:36.980034 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:36.980034 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:36.980034 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:36.980034 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:36.980034 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:36.980034 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:36.980034 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 191/387] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:03:36.988523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970945a9-7944-443e-8074-6bccb2ccbdbe None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:36.997891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adf49b-0826-4240-9bab-7ced276974ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:36.998667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adf49b-0826-4240-9bab-7ced276974ad None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:36.998948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adf49b-0826-4240-9bab-7ced276974ad None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:36.999224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adf49b-0826-4240-9bab-7ced276974ad None admin] PATH_INFO: `/v3/groups/10fca9e8d32541f7831341e321e111be` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:37.000520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19adf49b-0826-4240-9bab-7ced276974ad None admin] RBAC: Authorizing `identity:get_group(group_id=10fca9e8d32541f7831341e321e111be)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:37.001982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19adf49b-0826-4240-9bab-7ced276974ad None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:37.004066 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 197/388] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 18:03:36 2022] GET /identity/v3/groups/10fca9e8d32541f7831341e321e111be => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:37.010350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adf49b-0826-4240-9bab-7ced276974ad None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:37.107638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:37.129914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:37.197165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adf49b-0826-4240-9bab-7ced276974ad None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:37.210042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970945a9-7944-443e-8074-6bccb2ccbdbe None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:37.255940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ef171-6840-4ae7-8899-204f0702e0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:37.256635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ef171-6840-4ae7-8899-204f0702e0e6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:37.256911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ef171-6840-4ae7-8899-204f0702e0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:37.257177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ef171-6840-4ae7-8899-204f0702e0e6 None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:37.259476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ef171-6840-4ae7-8899-204f0702e0e6 None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:37.262763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ef171-6840-4ae7-8899-204f0702e0e6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:37.270052 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 198/389] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:37 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:37.270932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ef171-6840-4ae7-8899-204f0702e0e6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:37.284119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c29dd-aa9b-41a2-a9b2-bd1bc23563ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:37.284762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c29dd-aa9b-41a2-a9b2-bd1bc23563ce None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:37.285037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c29dd-aa9b-41a2-a9b2-bd1bc23563ce None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:37.285306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c29dd-aa9b-41a2-a9b2-bd1bc23563ce None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:37.285994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c29dd-aa9b-41a2-a9b2-bd1bc23563ce None admin] RBAC: Adding query filter params (name=member) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:37.286297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c29dd-aa9b-41a2-a9b2-bd1bc23563ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:37.287731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c29dd-aa9b-41a2-a9b2-bd1bc23563ce None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:37.301201 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 192/390] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:37.308183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c29dd-aa9b-41a2-a9b2-bd1bc23563ce None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:37.458449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ef171-6840-4ae7-8899-204f0702e0e6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:37.484733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:37.499241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f406bf3-054b-473c-88ea-779e333b81f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:37.500134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f406bf3-054b-473c-88ea-779e333b81f7 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:37.500562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f406bf3-054b-473c-88ea-779e333b81f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:37.500837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f406bf3-054b-473c-88ea-779e333b81f7 None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594/groups/10fca9e8d32541f7831341e321e111be/roles/81040db4535e417891c10dd996b1eac5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:37.503483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f406bf3-054b-473c-88ea-779e333b81f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1be8f0e040484baab23f1815ce704594, group_id=10fca9e8d32541f7831341e321e111be, role_id=81040db4535e417891c10dd996b1eac5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:37.503796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c29dd-aa9b-41a2-a9b2-bd1bc23563ce None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:37.505480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f406bf3-054b-473c-88ea-779e333b81f7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:37.524962 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 199/391] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Aug 28 18:03:37 2022] PUT /identity/v3/projects/1be8f0e040484baab23f1815ce704594/groups/10fca9e8d32541f7831341e321e111be/roles/81040db4535e417891c10dd996b1eac5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:03:37.526394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a6cd7-6e38-4ff9-88be-bcb9db206a78 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:37.526675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a6cd7-6e38-4ff9-88be-bcb9db206a78 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:37.526947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a6cd7-6e38-4ff9-88be-bcb9db206a78 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:37.528523 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 200/392] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:37.538314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b194bf5-ea94-4f7c-8d90-79633d047976 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:37.538637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b194bf5-ea94-4f7c-8d90-79633d047976 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:37.539625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b194bf5-ea94-4f7c-8d90-79633d047976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:37.558449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:37.574628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8b194bf5-ea94-4f7c-8d90-79633d047976 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:37.576644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8b194bf5-ea94-4f7c-8d90-79633d047976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:37.586042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438da059-6c69-45be-b6fe-b1cb33c19b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:37.586970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438da059-6c69-45be-b6fe-b1cb33c19b93 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:37.587286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438da059-6c69-45be-b6fe-b1cb33c19b93 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:37.587758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438da059-6c69-45be-b6fe-b1cb33c19b93 None admin] PATH_INFO: `/v3/groups/10fca9e8d32541f7831341e321e111be` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:37.590936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438da059-6c69-45be-b6fe-b1cb33c19b93 None admin] RBAC: Authorizing `identity:get_group(group_id=10fca9e8d32541f7831341e321e111be)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:37.592640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438da059-6c69-45be-b6fe-b1cb33c19b93 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:37.595860 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 193/393] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 18:03:37 2022] GET /identity/v3/groups/10fca9e8d32541f7831341e321e111be => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:37.601698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438da059-6c69-45be-b6fe-b1cb33c19b93 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:37.743430 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 201/394] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:37.744917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5be9d3-d97b-406f-9d85-d9e4ec5dfc61 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:37.745559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5be9d3-d97b-406f-9d85-d9e4ec5dfc61 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:37.745559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5be9d3-d97b-406f-9d85-d9e4ec5dfc61 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:37.746958 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 202/395] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:37.752863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1c04-778b-467b-993c-03841f849e08 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:37.753142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1c04-778b-467b-993c-03841f849e08 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:37.753419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1c04-778b-467b-993c-03841f849e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:37.776559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-43cc1c04-778b-467b-993c-03841f849e08 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:37.777819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-43cc1c04-778b-467b-993c-03841f849e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:37.799699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438da059-6c69-45be-b6fe-b1cb33c19b93 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:37.857512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b9947-30c7-4ba2-b17e-ef09cde39a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:37.858593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b9947-30c7-4ba2-b17e-ef09cde39a86 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:37.858876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b9947-30c7-4ba2-b17e-ef09cde39a86 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:37.859363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b9947-30c7-4ba2-b17e-ef09cde39a86 None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:37.860892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b9947-30c7-4ba2-b17e-ef09cde39a86 None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:37.862592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b9947-30c7-4ba2-b17e-ef09cde39a86 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:37.865370 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 194/396] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:37 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:37.873509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b9947-30c7-4ba2-b17e-ef09cde39a86 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:37.884158 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 203/397] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:03:37.949647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:37.993684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b9947-30c7-4ba2-b17e-ef09cde39a86 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:38.041730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068417f-b4c5-4ad0-bfc7-c6edee70fb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:38.042992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068417f-b4c5-4ad0-bfc7-c6edee70fb16 None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:38.043812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068417f-b4c5-4ad0-bfc7-c6edee70fb16 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:38.044608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068417f-b4c5-4ad0-bfc7-c6edee70fb16 None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594/groups/10fca9e8d32541f7831341e321e111be/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:38.047794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068417f-b4c5-4ad0-bfc7-c6edee70fb16 None admin] RBAC: Authorizing `identity:create_grant(project_id=1be8f0e040484baab23f1815ce704594, group_id=10fca9e8d32541f7831341e321e111be, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:38.049608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068417f-b4c5-4ad0-bfc7-c6edee70fb16 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:38.058976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0daaf-9d2a-41d6-8206-bcb05fe3fa92 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:38.059337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0daaf-9d2a-41d6-8206-bcb05fe3fa92 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:38.059762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0daaf-9d2a-41d6-8206-bcb05fe3fa92 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:38.062177 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 204/398] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:38.069474 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 195/399] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Aug 28 18:03:37 2022] PUT /identity/v3/projects/1be8f0e040484baab23f1815ce704594/groups/10fca9e8d32541f7831341e321e111be/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:03:38.069790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee47fc-a88d-46f6-8477-1744c9113945 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:38.070275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee47fc-a88d-46f6-8477-1744c9113945 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:38.070744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee47fc-a88d-46f6-8477-1744c9113945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:38.080768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068417f-b4c5-4ad0-bfc7-c6edee70fb16 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:38.098521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cfee47fc-a88d-46f6-8477-1744c9113945 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:38.100525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cfee47fc-a88d-46f6-8477-1744c9113945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:38.180672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:38.238832 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 205/400] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:38.279871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068417f-b4c5-4ad0-bfc7-c6edee70fb16 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:38.293279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee47fc-a88d-46f6-8477-1744c9113945 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:38.311841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:38.329909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15bd35-c6cb-4d47-abe4-41cc8f9aa350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:38.331218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15bd35-c6cb-4d47-abe4-41cc8f9aa350 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:38.331744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15bd35-c6cb-4d47-abe4-41cc8f9aa350 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:38.332447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15bd35-c6cb-4d47-abe4-41cc8f9aa350 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:38.348230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15bd35-c6cb-4d47-abe4-41cc8f9aa350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:38.355775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-3d15bd35-c6cb-4d47-abe4-41cc8f9aa350 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:38.355775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:38.355775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:38.355775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:38.355775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:38.355775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:38.355775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:38.355775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:38.355775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:38.355775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:38.355775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:38.355775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:38.355775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:38.355775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:38.355775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:38.355775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:38.356931 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:38.356931 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:38.356931 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:38.356931 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:38.356931 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:38.356931 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:38.356931 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:38.356931 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:38.356931 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:38.356931 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:38.356931 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:38.356931 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:38.356931 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:38.356931 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:38.356931 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:38.356931 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:38.357887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:38.357887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:38.357887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:38.357887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:38.357887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:38.357887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:38.357887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:38.357887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:38.357887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:38.357887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:38.357887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:38.357887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:38.361056 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 196/401] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:38.367082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15bd35-c6cb-4d47-abe4-41cc8f9aa350 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:38.463619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee47fc-a88d-46f6-8477-1744c9113945 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:38.534951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2a8d7-9f5e-4f44-883e-83d30881021c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:38.535895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2a8d7-9f5e-4f44-883e-83d30881021c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:38.536185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2a8d7-9f5e-4f44-883e-83d30881021c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:38.536466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2a8d7-9f5e-4f44-883e-83d30881021c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:38.550630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2a8d7-9f5e-4f44-883e-83d30881021c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:38.553528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15bd35-c6cb-4d47-abe4-41cc8f9aa350 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:38.557110 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-0fa2a8d7-9f5e-4f44-883e-83d30881021c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:38.557110 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:38.557110 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:38.557110 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:38.557110 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:38.557110 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:38.557110 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:38.557110 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:38.557110 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:38.557110 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:38.557110 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:38.557110 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:38.557110 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:38.557110 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:38.557110 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:38.557110 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:38.558015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:38.558015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:38.558015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:38.558015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:38.558015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:38.558015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:38.558015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:38.558015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:38.558015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:38.558015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:38.558015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:38.558015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:38.558015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:38.558015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:38.558015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:38.558015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:38.558817 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:38.558817 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:38.558817 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:38.558817 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:38.558817 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:38.558817 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:38.558817 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:38.558817 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:38.558817 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:38.558817 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:38.558817 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:38.558817 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:38.558817 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 206/402] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:03:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:03:38.559594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2a8d7-9f5e-4f44-883e-83d30881021c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:38.599420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f537b7-ada5-4cbe-a33c-3df130c0ad24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:38.600600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f537b7-ada5-4cbe-a33c-3df130c0ad24 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:38.601236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f537b7-ada5-4cbe-a33c-3df130c0ad24 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:38.601546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f537b7-ada5-4cbe-a33c-3df130c0ad24 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:38.602329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f537b7-ada5-4cbe-a33c-3df130c0ad24 None admin] RBAC: Adding query filter params (name=member) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:38.602685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f537b7-ada5-4cbe-a33c-3df130c0ad24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:38.604344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f537b7-ada5-4cbe-a33c-3df130c0ad24 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:38.613970 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 197/403] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:38.614634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:38.615833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f537b7-ada5-4cbe-a33c-3df130c0ad24 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:38.669414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:38.710504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2a8d7-9f5e-4f44-883e-83d30881021c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:38.738967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f537b7-ada5-4cbe-a33c-3df130c0ad24 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:38.756628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6680b0b-b2bd-4564-93ab-49c9aa6c60eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:38.757705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680b0b-b2bd-4564-93ab-49c9aa6c60eb None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:38.758191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680b0b-b2bd-4564-93ab-49c9aa6c60eb None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:38.758648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680b0b-b2bd-4564-93ab-49c9aa6c60eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:38.773375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6680b0b-b2bd-4564-93ab-49c9aa6c60eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:38.779966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b76ef-fe07-4f50-81e6-93884f619efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:38.780532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a6680b0b-b2bd-4564-93ab-49c9aa6c60eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:03:38.780532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:38.780532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:38.780532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:38.780532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:38.780532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:38.780532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:38.780532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:38.780532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:38.780532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:38.780532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:38.780532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:38.780532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:38.780532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:38.780532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:38.780532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:38.781373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:38.781373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:38.781373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:38.781373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:38.781373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:38.781373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:38.781373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:38.781373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:38.781373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:38.781373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:38.781373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:38.781373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:38.781373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:38.781373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:38.781373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:38.781373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:38.782193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:38.782193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:38.782193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:38.782193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:38.782193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:38.782193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:38.782193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:38.782193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:38.782193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:38.782193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:38.782193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:03:38.782193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:38.782784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b76ef-fe07-4f50-81e6-93884f619efe None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:38.782784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b76ef-fe07-4f50-81e6-93884f619efe None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:38.782784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b76ef-fe07-4f50-81e6-93884f619efe None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:38.782784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b76ef-fe07-4f50-81e6-93884f619efe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:38.782784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b76ef-fe07-4f50-81e6-93884f619efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:38.783629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b76ef-fe07-4f50-81e6-93884f619efe None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:38.790212 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 207/404] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:03:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:38.791432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6680b0b-b2bd-4564-93ab-49c9aa6c60eb None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:38.793054 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 198/405] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:03:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:38.799759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b76ef-fe07-4f50-81e6-93884f619efe None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:38.905116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:38.915136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6680b0b-b2bd-4564-93ab-49c9aa6c60eb None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:38.949483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b76ef-fe07-4f50-81e6-93884f619efe None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:38.958584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:38.968158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bea0a-53b4-4456-8d15-30e9dbe0c6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:38.969594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bea0a-53b4-4456-8d15-30e9dbe0c6dc None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:38.970089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bea0a-53b4-4456-8d15-30e9dbe0c6dc None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:38.970777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bea0a-53b4-4456-8d15-30e9dbe0c6dc None admin] PATH_INFO: `/v3/groups/10fca9e8d32541f7831341e321e111be` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:38.972361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bea0a-53b4-4456-8d15-30e9dbe0c6dc None admin] RBAC: Authorizing `identity:get_group(group_id=10fca9e8d32541f7831341e321e111be)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:38.974355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bea0a-53b4-4456-8d15-30e9dbe0c6dc None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:38.981597 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 208/406] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 18:03:38 2022] GET /identity/v3/groups/10fca9e8d32541f7831341e321e111be => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:38.981597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bea0a-53b4-4456-8d15-30e9dbe0c6dc None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:39.003753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c85b7c-59e7-4eea-8c73-7d79b797afeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:39.004893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c85b7c-59e7-4eea-8c73-7d79b797afeb None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:39.005416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c85b7c-59e7-4eea-8c73-7d79b797afeb None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:39.005892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c85b7c-59e7-4eea-8c73-7d79b797afeb None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:39.006799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c85b7c-59e7-4eea-8c73-7d79b797afeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:39.007502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c85b7c-59e7-4eea-8c73-7d79b797afeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:39.009244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c85b7c-59e7-4eea-8c73-7d79b797afeb None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:39.021408 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 199/407] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:39.022898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c85b7c-59e7-4eea-8c73-7d79b797afeb None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:39.094112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bea0a-53b4-4456-8d15-30e9dbe0c6dc None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:39.134951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c85b7c-59e7-4eea-8c73-7d79b797afeb None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:39.139201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c6fb5-da68-48a9-9802-068b939b98b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:39.139895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c6fb5-da68-48a9-9802-068b939b98b8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:39.140174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c6fb5-da68-48a9-9802-068b939b98b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:39.140445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c6fb5-da68-48a9-9802-068b939b98b8 None admin] PATH_INFO: `/v3/groups/10fca9e8d32541f7831341e321e111be` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:39.141559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c6fb5-da68-48a9-9802-068b939b98b8 None admin] RBAC: Authorizing `identity:get_group(group_id=10fca9e8d32541f7831341e321e111be)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:39.143078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c6fb5-da68-48a9-9802-068b939b98b8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:39.144913 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 209/408] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 18:03:38 2022] GET /identity/v3/groups/10fca9e8d32541f7831341e321e111be => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:39.145671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c6fb5-da68-48a9-9802-068b939b98b8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:39.176273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e2a95-99df-457f-b0c2-d11b6934d0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:39.177542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e2a95-99df-457f-b0c2-d11b6934d0a4 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:39.178021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e2a95-99df-457f-b0c2-d11b6934d0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:39.178492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e2a95-99df-457f-b0c2-d11b6934d0a4 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:39.178962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:39.181191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e2a95-99df-457f-b0c2-d11b6934d0a4 None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:39.184571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e2a95-99df-457f-b0c2-d11b6934d0a4 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:39.192199 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 200/409] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:39 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:39.194158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e2a95-99df-457f-b0c2-d11b6934d0a4 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:39.236560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:39.262540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c6fb5-da68-48a9-9802-068b939b98b8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:39.302416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f17466-6113-4c92-9ea4-53dcb62b7072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:39.303137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f17466-6113-4c92-9ea4-53dcb62b7072 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:39.303579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f17466-6113-4c92-9ea4-53dcb62b7072 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:39.303938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f17466-6113-4c92-9ea4-53dcb62b7072 None admin] PATH_INFO: `/v3/groups/8f34c89248894775ae0b02e1404dd83c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:39.305677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f17466-6113-4c92-9ea4-53dcb62b7072 None admin] RBAC: Authorizing `identity:get_group(group_id=8f34c89248894775ae0b02e1404dd83c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:39.307792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f17466-6113-4c92-9ea4-53dcb62b7072 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:39.310316 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 210/410] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 18:03:39 2022] GET /identity/v3/groups/8f34c89248894775ae0b02e1404dd83c => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:39.311147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f17466-6113-4c92-9ea4-53dcb62b7072 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:39.316519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e2a95-99df-457f-b0c2-d11b6934d0a4 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:39.355602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f8e02-7e97-4101-ae7c-d8467c8047c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:39.356350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f8e02-7e97-4101-ae7c-d8467c8047c6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:39.356734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f8e02-7e97-4101-ae7c-d8467c8047c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:39.357263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f8e02-7e97-4101-ae7c-d8467c8047c6 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:39.358759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f8e02-7e97-4101-ae7c-d8467c8047c6 None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:39.360449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f8e02-7e97-4101-ae7c-d8467c8047c6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:39.362893 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 201/411] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:39 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:39.363992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f8e02-7e97-4101-ae7c-d8467c8047c6 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:39.427207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:39.431494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f17466-6113-4c92-9ea4-53dcb62b7072 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:39.471004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a02c45-4ee8-406c-839b-46243edcc62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:39.471792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a02c45-4ee8-406c-839b-46243edcc62c None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:39.472211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a02c45-4ee8-406c-839b-46243edcc62c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:39.472566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a02c45-4ee8-406c-839b-46243edcc62c None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8/groups/10fca9e8d32541f7831341e321e111be/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:39.475055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a02c45-4ee8-406c-839b-46243edcc62c None admin] RBAC: Authorizing `identity:create_grant(project_id=0a529bd5dd924e93a8b2eb90a47878d8, group_id=10fca9e8d32541f7831341e321e111be, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:39.476647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a02c45-4ee8-406c-839b-46243edcc62c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:39.496069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f8e02-7e97-4101-ae7c-d8467c8047c6 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:39.499307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:39.500864 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 211/412] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Aug 28 18:03:39 2022] PUT /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8/groups/10fca9e8d32541f7831341e321e111be/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:03:39.502852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a02c45-4ee8-406c-839b-46243edcc62c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:39.555698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fd70d-7612-4d66-811d-de3b4400e6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:39.557223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fd70d-7612-4d66-811d-de3b4400e6ae None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:39.557829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fd70d-7612-4d66-811d-de3b4400e6ae None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:39.558395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fd70d-7612-4d66-811d-de3b4400e6ae None admin] PATH_INFO: `/v3/projects/2e232b8348b844fbb8b30d77b02f1872` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:39.560904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fd70d-7612-4d66-811d-de3b4400e6ae None admin] RBAC: Authorizing `identity:get_project(project_id=2e232b8348b844fbb8b30d77b02f1872)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:39.563782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fd70d-7612-4d66-811d-de3b4400e6ae None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:39.566354 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 202/413] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:39 2022] GET /identity/v3/projects/2e232b8348b844fbb8b30d77b02f1872 => generated 344 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:39.574616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fd70d-7612-4d66-811d-de3b4400e6ae None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:39.646687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a02c45-4ee8-406c-839b-46243edcc62c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:39.714630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65aa608-485c-41ee-954c-9c3c4bf93990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:39.715957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65aa608-485c-41ee-954c-9c3c4bf93990 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:39.716314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65aa608-485c-41ee-954c-9c3c4bf93990 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:39.716806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65aa608-485c-41ee-954c-9c3c4bf93990 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8/groups/10fca9e8d32541f7831341e321e111be/roles/81040db4535e417891c10dd996b1eac5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:39.720791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65aa608-485c-41ee-954c-9c3c4bf93990 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a529bd5dd924e93a8b2eb90a47878d8, group_id=10fca9e8d32541f7831341e321e111be, role_id=81040db4535e417891c10dd996b1eac5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:39.723447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65aa608-485c-41ee-954c-9c3c4bf93990 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:39.755175 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 212/414] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Aug 28 18:03:39 2022] PUT /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8/groups/10fca9e8d32541f7831341e321e111be/roles/81040db4535e417891c10dd996b1eac5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:03:39.769660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fd70d-7612-4d66-811d-de3b4400e6ae None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:39.824363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37bb49-866b-4c9a-b536-ba52e59bc71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:39.825173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37bb49-866b-4c9a-b536-ba52e59bc71a None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:39.825484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37bb49-866b-4c9a-b536-ba52e59bc71a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:39.825759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37bb49-866b-4c9a-b536-ba52e59bc71a None admin] PATH_INFO: `/v3/projects/2e232b8348b844fbb8b30d77b02f1872/groups/8f34c89248894775ae0b02e1404dd83c/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:39.828132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37bb49-866b-4c9a-b536-ba52e59bc71a None admin] RBAC: Authorizing `identity:create_grant(project_id=2e232b8348b844fbb8b30d77b02f1872, group_id=8f34c89248894775ae0b02e1404dd83c, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:39.829667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37bb49-866b-4c9a-b536-ba52e59bc71a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:39.852523 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 203/415] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Aug 28 18:03:39 2022] PUT /identity/v3/projects/2e232b8348b844fbb8b30d77b02f1872/groups/8f34c89248894775ae0b02e1404dd83c/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:03:40.040327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d300a-2999-4bec-9feb-bb9d284dc483 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:40.040805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d300a-2999-4bec-9feb-bb9d284dc483 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:40.041101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d300a-2999-4bec-9feb-bb9d284dc483 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:40.043669 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 213/416] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:40.050202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdef3c-1129-4b00-b43d-a3813bb11d88 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:40.050757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdef3c-1129-4b00-b43d-a3813bb11d88 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:40.050833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdef3c-1129-4b00-b43d-a3813bb11d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:40.082355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-26bdef3c-1129-4b00-b43d-a3813bb11d88 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:40.083654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-26bdef3c-1129-4b00-b43d-a3813bb11d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:40.121539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:40.192941 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 204/417] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:40.596447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d300a-2999-4bec-9feb-bb9d284dc483 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:40.628991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:40.666848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b9ba1-4e1f-47e7-b5bb-b86bb6e53574 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:40.667856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b9ba1-4e1f-47e7-b5bb-b86bb6e53574 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:40.668508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b9ba1-4e1f-47e7-b5bb-b86bb6e53574 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:40.671140 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 205/418] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:40.679183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75fbea-abb0-4645-b33a-77cdb6f9caca None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:40.680219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75fbea-abb0-4645-b33a-77cdb6f9caca None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:40.680796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75fbea-abb0-4645-b33a-77cdb6f9caca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:40.731541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fe75fbea-abb0-4645-b33a-77cdb6f9caca None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:40.732697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fe75fbea-abb0-4645-b33a-77cdb6f9caca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:40.750210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d300a-2999-4bec-9feb-bb9d284dc483 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:40.790875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae78d6-f607-4277-b57d-413b5d9599a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:40.792060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae78d6-f607-4277-b57d-413b5d9599a8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:40.792533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae78d6-f607-4277-b57d-413b5d9599a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:40.793003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae78d6-f607-4277-b57d-413b5d9599a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:40.812507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae78d6-f607-4277-b57d-413b5d9599a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:40.822534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-8aae78d6-f607-4277-b57d-413b5d9599a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:40.822534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:40.822534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:40.822534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:40.822534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:40.822534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:40.822534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:40.822534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:40.822534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:40.822534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:40.822534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:40.822534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:40.822534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:40.822534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:40.822534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:40.822534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:40.823532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:40.823532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:40.823532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:40.823532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:40.823532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:40.823532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:40.823532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:40.823532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:40.823532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:40.823532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:40.823532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:40.823532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:40.823532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:40.823532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:40.823532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:40.823532 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:40.824315 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:40.824315 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:40.824315 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:40.824315 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:40.824315 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:40.824315 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:40.824315 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:40.824315 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:40.824315 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:40.824315 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:40.824315 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:40.824315 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:40.834749 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 214/419] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:03:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:40.842267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae78d6-f607-4277-b57d-413b5d9599a8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:40.905189 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 206/420] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:03:40.970291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:41.000607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae78d6-f607-4277-b57d-413b5d9599a8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:41.061185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86f06e-671c-48c1-ba4f-67c65d65fa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:41.061861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86f06e-671c-48c1-ba4f-67c65d65fa35 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:41.062135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86f06e-671c-48c1-ba4f-67c65d65fa35 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:41.062453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86f06e-671c-48c1-ba4f-67c65d65fa35 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:41.063193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86f06e-671c-48c1-ba4f-67c65d65fa35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:41.063504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86f06e-671c-48c1-ba4f-67c65d65fa35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:41.065393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86f06e-671c-48c1-ba4f-67c65d65fa35 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:41.079465 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 215/421] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:03:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:41.088527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75fbea-abb0-4645-b33a-77cdb6f9caca None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:41.315457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:41.322918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86f06e-671c-48c1-ba4f-67c65d65fa35 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:41.341614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75fbea-abb0-4645-b33a-77cdb6f9caca None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:41.418805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4e313-1ce1-4ac2-9c98-03c9b76af4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:41.419464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4e313-1ce1-4ac2-9c98-03c9b76af4c7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:41.419740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4e313-1ce1-4ac2-9c98-03c9b76af4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:41.420006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4e313-1ce1-4ac2-9c98-03c9b76af4c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:41.561889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86f06e-671c-48c1-ba4f-67c65d65fa35 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:41.581830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4e313-1ce1-4ac2-9c98-03c9b76af4c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:41.583925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4e313-1ce1-4ac2-9c98-03c9b76af4c7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:41.639457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2904c-8a5f-432d-bb02-72d2265e342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:41.640381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2904c-8a5f-432d-bb02-72d2265e342f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:41.640775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2904c-8a5f-432d-bb02-72d2265e342f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:41.641053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2904c-8a5f-432d-bb02-72d2265e342f None admin] PATH_INFO: `/v3/roles/member` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:41.666097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:41.676213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2904c-8a5f-432d-bb02-72d2265e342f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:41.691607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-fab2904c-8a5f-432d-bb02-72d2265e342f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:41.691607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:41.691607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:41.691607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:41.691607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:41.691607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:41.691607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:41.691607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:41.691607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:41.691607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:41.691607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:41.691607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:41.691607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:41.691607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:41.691607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:41.691607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:41.692877 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:41.692877 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:41.692877 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:41.692877 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:41.692877 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:41.692877 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:41.692877 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:41.692877 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:41.692877 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:41.692877 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:41.692877 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:41.692877 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:41.692877 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:41.692877 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:41.692877 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:41.692877 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:41.693888 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:41.693888 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:41.693888 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:41.693888 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:41.693888 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:41.693888 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:41.693888 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:41.693888 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:41.693888 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:41.693888 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:41.693888 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:41.693888 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:41.693888 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 216/422] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:03:41.704618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2904c-8a5f-432d-bb02-72d2265e342f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:41.800715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:41.814562 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 207/423] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 727 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:41.821319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4e313-1ce1-4ac2-9c98-03c9b76af4c7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:41.840112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2904c-8a5f-432d-bb02-72d2265e342f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:41.886490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2f794-129c-42a6-a781-36e6b46e226e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:41.887896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2f794-129c-42a6-a781-36e6b46e226e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:41.888442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2f794-129c-42a6-a781-36e6b46e226e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:41.889177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2f794-129c-42a6-a781-36e6b46e226e None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:41.890385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2f794-129c-42a6-a781-36e6b46e226e None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:41.891014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2f794-129c-42a6-a781-36e6b46e226e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:41.893724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2f794-129c-42a6-a781-36e6b46e226e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:41.909366 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 217/424] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:41.917110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2f794-129c-42a6-a781-36e6b46e226e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:42.024718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:42.063784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4e313-1ce1-4ac2-9c98-03c9b76af4c7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:42.072319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2f794-129c-42a6-a781-36e6b46e226e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:42.122208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71803a7c-b706-4f4c-abef-0833db535518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:42.123834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71803a7c-b706-4f4c-abef-0833db535518 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:42.124668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71803a7c-b706-4f4c-abef-0833db535518 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:42.128085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71803a7c-b706-4f4c-abef-0833db535518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:42.168467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d08e19-0ac4-4e88-b38b-417ec230a1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:42.176093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d08e19-0ac4-4e88-b38b-417ec230a1e7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:42.176964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d08e19-0ac4-4e88-b38b-417ec230a1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:42.177695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d08e19-0ac4-4e88-b38b-417ec230a1e7 None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:42.181206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d08e19-0ac4-4e88-b38b-417ec230a1e7 None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:42.184915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d08e19-0ac4-4e88-b38b-417ec230a1e7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:42.190051 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 208/425] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:41 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:42.197424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d08e19-0ac4-4e88-b38b-417ec230a1e7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:42.276341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71803a7c-b706-4f4c-abef-0833db535518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:42.279445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71803a7c-b706-4f4c-abef-0833db535518 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:42.363688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:42.448149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:42.454543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d08e19-0ac4-4e88-b38b-417ec230a1e7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:42.497596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a997b-3bef-4372-aca3-be315db61c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:42.498543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a997b-3bef-4372-aca3-be315db61c0a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:42.498817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a997b-3bef-4372-aca3-be315db61c0a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:42.499317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a997b-3bef-4372-aca3-be315db61c0a None admin] PATH_INFO: `/v3/groups/10fca9e8d32541f7831341e321e111be` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:42.501250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a997b-3bef-4372-aca3-be315db61c0a None admin] RBAC: Authorizing `identity:get_group(group_id=10fca9e8d32541f7831341e321e111be)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:42.503467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a997b-3bef-4372-aca3-be315db61c0a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:42.513239 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 209/426] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 18:03:42 2022] GET /identity/v3/groups/10fca9e8d32541f7831341e321e111be => generated 226 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:42.514340 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 218/427] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 18:03:42.515368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089b25b-488f-4be6-9a56-f093897ee7b9 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:42.515704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089b25b-488f-4be6-9a56-f093897ee7b9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:42.516162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089b25b-488f-4be6-9a56-f093897ee7b9 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:42.516323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4700d-0196-4997-b3db-0ab4c6c22fa2 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:42.516758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4700d-0196-4997-b3db-0ab4c6c22fa2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:42.517199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4700d-0196-4997-b3db-0ab4c6c22fa2 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:42.518145 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 210/428] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:42.519422 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 219/429] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:42.524960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4700d-0196-4997-b3db-0ab4c6c22fa2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:42.526523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089b25b-488f-4be6-9a56-f093897ee7b9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:42.666107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089b25b-488f-4be6-9a56-f093897ee7b9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:42.674659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4700d-0196-4997-b3db-0ab4c6c22fa2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:42.705038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:42.714749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba1931-0269-4612-ba20-c3f76f0227be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:42.715488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba1931-0269-4612-ba20-c3f76f0227be None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:42.716104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba1931-0269-4612-ba20-c3f76f0227be None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:42.716226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba1931-0269-4612-ba20-c3f76f0227be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:42.717271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba1931-0269-4612-ba20-c3f76f0227be None admin] RBAC: Adding query filter params (group.id=10fca9e8d32541f7831341e321e111be, role.id=81040db4535e417891c10dd996b1eac5, scope.project.id=1be8f0e040484baab23f1815ce704594) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:42.717692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba1931-0269-4612-ba20-c3f76f0227be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:42.720127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba1931-0269-4612-ba20-c3f76f0227be None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:42.723739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755619a7-85fa-4170-be10-2c34253f7db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:42.724695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755619a7-85fa-4170-be10-2c34253f7db7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:42.725035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755619a7-85fa-4170-be10-2c34253f7db7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:42.725447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755619a7-85fa-4170-be10-2c34253f7db7 None admin] PATH_INFO: `/v3/projects/1be8f0e040484baab23f1815ce704594` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:42.726971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755619a7-85fa-4170-be10-2c34253f7db7 None admin] RBAC: Authorizing `identity:get_project(project_id=1be8f0e040484baab23f1815ce704594)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:42.728961 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 211/430] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 18:03:42 2022] GET /identity/v3/role_assignments?group.id=10fca9e8d32541f7831341e321e111be&scope.project.id=1be8f0e040484baab23f1815ce704594&role.id=81040db4535e417891c10dd996b1eac5 => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:42.729074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755619a7-85fa-4170-be10-2c34253f7db7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:42.736798 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 220/431] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:42 2022] GET /identity/v3/projects/1be8f0e040484baab23f1815ce704594 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:42.737012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720f873-997c-4090-870b-e7b41e42b885 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:42.737133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f15b7-a694-4921-84a6-62e9095a6a69 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:42.737232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720f873-997c-4090-870b-e7b41e42b885 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:42.737232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720f873-997c-4090-870b-e7b41e42b885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:42.737384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f15b7-a694-4921-84a6-62e9095a6a69 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:42.737384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f15b7-a694-4921-84a6-62e9095a6a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:42.755801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3720f873-997c-4090-870b-e7b41e42b885 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:42.756070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b42f15b7-a694-4921-84a6-62e9095a6a69 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:42.757120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3720f873-997c-4090-870b-e7b41e42b885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:42.757310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b42f15b7-a694-4921-84a6-62e9095a6a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:42.793577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:42.849962 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 212/432] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:42.852340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bfadf-459a-4c69-bc7a-48d9e52f5bb6 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:42.852825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bfadf-459a-4c69-bc7a-48d9e52f5bb6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:42.853573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bfadf-459a-4c69-bc7a-48d9e52f5bb6 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:42.856117 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 213/433] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:42.857450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bfadf-459a-4c69-bc7a-48d9e52f5bb6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:42.876318 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 221/434] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:42.878062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e3504-02f9-4470-967b-fc06f26e623d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:42.878354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e3504-02f9-4470-967b-fc06f26e623d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:42.878777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e3504-02f9-4470-967b-fc06f26e623d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:42.912370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fa2e3504-02f9-4470-967b-fc06f26e623d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:42.915827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fa2e3504-02f9-4470-967b-fc06f26e623d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:43.026168 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 222/435] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:43.046855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bfadf-459a-4c69-bc7a-48d9e52f5bb6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:43.082243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:43.101582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376ab9e-d319-4bb8-a303-2ecf484f4a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:43.102450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376ab9e-d319-4bb8-a303-2ecf484f4a47 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:43.102815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376ab9e-d319-4bb8-a303-2ecf484f4a47 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:43.103205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376ab9e-d319-4bb8-a303-2ecf484f4a47 None admin] PATH_INFO: `/v3/groups/10fca9e8d32541f7831341e321e111be` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:43.104611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376ab9e-d319-4bb8-a303-2ecf484f4a47 None admin] RBAC: Authorizing `identity:get_group(group_id=10fca9e8d32541f7831341e321e111be)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:43.106755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376ab9e-d319-4bb8-a303-2ecf484f4a47 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:43.117281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e3504-02f9-4470-967b-fc06f26e623d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:43.129268 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 214/436] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 18:03:42 2022] GET /identity/v3/groups/10fca9e8d32541f7831341e321e111be => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:43.166575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376ab9e-d319-4bb8-a303-2ecf484f4a47 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:43.232422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:43.246094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e3504-02f9-4470-967b-fc06f26e623d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:43.289310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376ab9e-d319-4bb8-a303-2ecf484f4a47 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:43.302719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473ae28-490a-459f-85b3-eb58f4cf7187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:43.303564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473ae28-490a-459f-85b3-eb58f4cf7187 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:43.303977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473ae28-490a-459f-85b3-eb58f4cf7187 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:43.304255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473ae28-490a-459f-85b3-eb58f4cf7187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:43.305036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473ae28-490a-459f-85b3-eb58f4cf7187 None admin] RBAC: Adding query filter params (group.id=10fca9e8d32541f7831341e321e111be, role.id=dcabcc9bd3bf42149eed3abc0d4799c8, scope.project.id=1be8f0e040484baab23f1815ce704594) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:43.305389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473ae28-490a-459f-85b3-eb58f4cf7187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:43.307052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473ae28-490a-459f-85b3-eb58f4cf7187 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:43.316036 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 223/437] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 18:03:43 2022] GET /identity/v3/role_assignments?group.id=10fca9e8d32541f7831341e321e111be&scope.project.id=1be8f0e040484baab23f1815ce704594&role.id=dcabcc9bd3bf42149eed3abc0d4799c8 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:43.317046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473ae28-490a-459f-85b3-eb58f4cf7187 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:43.361712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396e494-7fbc-4d90-aa29-78c26e37921e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:43.362811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396e494-7fbc-4d90-aa29-78c26e37921e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:43.363136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396e494-7fbc-4d90-aa29-78c26e37921e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:43.363446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396e494-7fbc-4d90-aa29-78c26e37921e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:43.378708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396e494-7fbc-4d90-aa29-78c26e37921e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:43.384885 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-1396e494-7fbc-4d90-aa29-78c26e37921e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:03:43.384885 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:43.384885 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:43.384885 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:43.384885 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:43.384885 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:43.384885 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:43.384885 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:43.384885 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:43.384885 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:43.384885 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:43.384885 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:43.384885 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:43.384885 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:43.384885 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:43.384885 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:43.385940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:43.385940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:43.385940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:43.385940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:43.385940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:43.385940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:43.385940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:43.385940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:43.385940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:43.385940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:43.385940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:43.385940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:43.385940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:43.385940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:43.385940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:43.385940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:43.386824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:43.386824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:43.386824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:43.386824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:43.386824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:43.386824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:43.386824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:43.386824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:43.386824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:43.386824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:43.386824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:03:43.386824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:43.386824 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 215/438] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:03:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:03:43.387642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396e494-7fbc-4d90-aa29-78c26e37921e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:43.459742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:43.474690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473ae28-490a-459f-85b3-eb58f4cf7187 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:43.528137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396e494-7fbc-4d90-aa29-78c26e37921e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:43.539181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95545c5-5e18-42df-9f66-dc90a0a41b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:43.540037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95545c5-5e18-42df-9f66-dc90a0a41b96 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:43.540287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95545c5-5e18-42df-9f66-dc90a0a41b96 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:43.540643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95545c5-5e18-42df-9f66-dc90a0a41b96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:43.558256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95545c5-5e18-42df-9f66-dc90a0a41b96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:43.565572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e95545c5-5e18-42df-9f66-dc90a0a41b96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:43.565572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:43.565572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:43.565572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:43.565572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:43.565572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:43.565572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:43.565572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:43.565572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:43.565572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:43.565572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:43.565572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:43.565572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:43.565572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:43.565572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:43.565572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:43.567054 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:43.567054 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:43.567054 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:43.567054 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:43.567054 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:43.567054 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:43.567054 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:43.567054 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:43.567054 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:43.567054 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:43.567054 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:43.567054 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:43.567054 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:43.567054 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:43.567054 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:43.567054 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:43.569073 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:43.569073 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:43.569073 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:43.569073 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:43.569073 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:43.569073 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:43.569073 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:43.569073 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:43.569073 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:43.569073 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:43.569073 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:43.569073 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:43.569073 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 224/439] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:03:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:43.569073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95545c5-5e18-42df-9f66-dc90a0a41b96 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:43.592755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:43.599013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4254c-2d33-4d27-a72e-b3237d0940e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:43.599990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4254c-2d33-4d27-a72e-b3237d0940e1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:43.600771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4254c-2d33-4d27-a72e-b3237d0940e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:43.603773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4254c-2d33-4d27-a72e-b3237d0940e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:43.615873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac4254c-2d33-4d27-a72e-b3237d0940e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:43.624188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-0ac4254c-2d33-4d27-a72e-b3237d0940e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:43.624188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:43.624188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:43.624188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:43.624188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:43.624188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:43.624188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:43.624188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:43.624188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:43.624188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:43.624188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:43.624188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:43.624188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:43.624188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:43.624188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:43.624188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:43.625508 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:43.625508 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:43.625508 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:43.625508 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:43.625508 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:43.625508 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:43.625508 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:43.625508 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:43.625508 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:43.625508 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:43.625508 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:43.625508 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:43.625508 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:43.625508 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:43.625508 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:43.625508 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:43.626718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:43.626718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:43.626718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:43.626718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:43.626718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:43.626718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:43.626718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:43.626718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:43.626718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:43.626718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:43.626718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:03:43.626718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:43.626718 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 216/440] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:43.628099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4254c-2d33-4d27-a72e-b3237d0940e1 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:43.717231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95545c5-5e18-42df-9f66-dc90a0a41b96 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:43.768709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76552f8c-b6c3-44b9-a1dc-cf678f9482e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:43.770352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76552f8c-b6c3-44b9-a1dc-cf678f9482e6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:43.771364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76552f8c-b6c3-44b9-a1dc-cf678f9482e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:43.771580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76552f8c-b6c3-44b9-a1dc-cf678f9482e6 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:43.772675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76552f8c-b6c3-44b9-a1dc-cf678f9482e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:43.775556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76552f8c-b6c3-44b9-a1dc-cf678f9482e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:43.775556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76552f8c-b6c3-44b9-a1dc-cf678f9482e6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:43.786204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4254c-2d33-4d27-a72e-b3237d0940e1 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:43.787921 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 225/441] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:43.789286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76552f8c-b6c3-44b9-a1dc-cf678f9482e6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:43.799105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:43.835843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b571ac-a79b-4e30-89d8-5b013f6890ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:43.837083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b571ac-a79b-4e30-89d8-5b013f6890ee None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:43.837655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b571ac-a79b-4e30-89d8-5b013f6890ee None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:43.837801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b571ac-a79b-4e30-89d8-5b013f6890ee None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:43.838897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b571ac-a79b-4e30-89d8-5b013f6890ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:43.839432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b571ac-a79b-4e30-89d8-5b013f6890ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:43.842165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b571ac-a79b-4e30-89d8-5b013f6890ee None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:43.863302 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 217/442] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:03:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:43.863302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b571ac-a79b-4e30-89d8-5b013f6890ee None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:43.906414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:43.952489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76552f8c-b6c3-44b9-a1dc-cf678f9482e6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:43.998085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b571ac-a79b-4e30-89d8-5b013f6890ee None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:44.005680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c4005-8ac4-45fd-928e-f80d63204f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:44.006315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c4005-8ac4-45fd-928e-f80d63204f03 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:44.006591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c4005-8ac4-45fd-928e-f80d63204f03 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:44.007066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c4005-8ac4-45fd-928e-f80d63204f03 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:44.007990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c4005-8ac4-45fd-928e-f80d63204f03 None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:44.007990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c4005-8ac4-45fd-928e-f80d63204f03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:44.009250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c4005-8ac4-45fd-928e-f80d63204f03 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:44.021169 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 226/443] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:03:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:44.023968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c4005-8ac4-45fd-928e-f80d63204f03 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:44.038243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d40bb3-9cdc-4633-abb1-47b7e11a36d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:44.039169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d40bb3-9cdc-4633-abb1-47b7e11a36d0 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:44.039565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d40bb3-9cdc-4633-abb1-47b7e11a36d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:44.039912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d40bb3-9cdc-4633-abb1-47b7e11a36d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:44.110160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:44.154192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d40bb3-9cdc-4633-abb1-47b7e11a36d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:44.155732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d40bb3-9cdc-4633-abb1-47b7e11a36d0 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:44.162740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c4005-8ac4-45fd-928e-f80d63204f03 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:44.208565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0952ee-fe7e-4852-a248-24a33f0a0ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:44.209360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0952ee-fe7e-4852-a248-24a33f0a0ac2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:44.209765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0952ee-fe7e-4852-a248-24a33f0a0ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:44.210119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0952ee-fe7e-4852-a248-24a33f0a0ac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:44.221962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:44.292536 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 218/444] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:44.292536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d40bb3-9cdc-4633-abb1-47b7e11a36d0 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:44.327978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0952ee-fe7e-4852-a248-24a33f0a0ac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:44.330158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0952ee-fe7e-4852-a248-24a33f0a0ac2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:44.393599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:44.433541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d40bb3-9cdc-4633-abb1-47b7e11a36d0 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:44.463208 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 227/445] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:44.464859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0952ee-fe7e-4852-a248-24a33f0a0ac2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:44.475636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f38eb-f763-40ad-ae2e-10c748b15aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:44.476261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f38eb-f763-40ad-ae2e-10c748b15aa1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:44.476575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f38eb-f763-40ad-ae2e-10c748b15aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:44.476852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f38eb-f763-40ad-ae2e-10c748b15aa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:44.515467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:44.563070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f38eb-f763-40ad-ae2e-10c748b15aa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:44.564982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f38eb-f763-40ad-ae2e-10c748b15aa1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:44.605045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0952ee-fe7e-4852-a248-24a33f0a0ac2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:44.666248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9113e-dc12-48e0-a608-8f8199c2506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:44.669850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9113e-dc12-48e0-a608-8f8199c2506b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:44.670736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9113e-dc12-48e0-a608-8f8199c2506b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:44.670736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9113e-dc12-48e0-a608-8f8199c2506b None admin] PATH_INFO: `/v3/projects/2e232b8348b844fbb8b30d77b02f1872` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:44.674021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9113e-dc12-48e0-a608-8f8199c2506b None admin] RBAC: Authorizing `identity:get_project(project_id=2e232b8348b844fbb8b30d77b02f1872)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:44.675616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9113e-dc12-48e0-a608-8f8199c2506b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:44.676535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:44.678382 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 228/446] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:44 2022] GET /identity/v3/projects/2e232b8348b844fbb8b30d77b02f1872 => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:44.679527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9113e-dc12-48e0-a608-8f8199c2506b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:44.725266 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 219/447] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:44.726135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f38eb-f763-40ad-ae2e-10c748b15aa1 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:44.813625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9113e-dc12-48e0-a608-8f8199c2506b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:44.822953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:44.847167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f38eb-f763-40ad-ae2e-10c748b15aa1 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:44.855763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87bd97-55cf-4218-b0ae-15225b804096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:44.856900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87bd97-55cf-4218-b0ae-15225b804096 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:44.857343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87bd97-55cf-4218-b0ae-15225b804096 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:44.857782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87bd97-55cf-4218-b0ae-15225b804096 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:44.859655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87bd97-55cf-4218-b0ae-15225b804096 None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:44.861819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87bd97-55cf-4218-b0ae-15225b804096 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:44.864748 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 229/448] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:44 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:44.865899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87bd97-55cf-4218-b0ae-15225b804096 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:44.901626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fdd55-6d32-49e3-8652-d9936d323ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:44.902481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fdd55-6d32-49e3-8652-d9936d323ebc None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:44.902792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fdd55-6d32-49e3-8652-d9936d323ebc None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:44.903097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fdd55-6d32-49e3-8652-d9936d323ebc None admin] PATH_INFO: `/v3/groups/8f34c89248894775ae0b02e1404dd83c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:44.904547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fdd55-6d32-49e3-8652-d9936d323ebc None admin] RBAC: Authorizing `identity:get_group(group_id=8f34c89248894775ae0b02e1404dd83c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:44.906566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fdd55-6d32-49e3-8652-d9936d323ebc None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:44.909201 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 220/449] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 18:03:44 2022] GET /identity/v3/groups/8f34c89248894775ae0b02e1404dd83c => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:44.912448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fdd55-6d32-49e3-8652-d9936d323ebc None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:44.968717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:44.999241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87bd97-55cf-4218-b0ae-15225b804096 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:45.039276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308f92c-f926-470f-84a2-8f91924b03c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:45.039959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308f92c-f926-470f-84a2-8f91924b03c8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:45.040243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308f92c-f926-470f-84a2-8f91924b03c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:45.040522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308f92c-f926-470f-84a2-8f91924b03c8 None admin] PATH_INFO: `/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:45.041715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308f92c-f926-470f-84a2-8f91924b03c8 None admin] RBAC: Authorizing `identity:get_project(project_id=0a529bd5dd924e93a8b2eb90a47878d8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:45.043194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308f92c-f926-470f-84a2-8f91924b03c8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:45.044917 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 230/450] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:03:44 2022] GET /identity/v3/projects/0a529bd5dd924e93a8b2eb90a47878d8 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:45.045816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308f92c-f926-470f-84a2-8f91924b03c8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:45.061700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fdd55-6d32-49e3-8652-d9936d323ebc None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:45.098092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:45.106683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea6fe0-379f-4ec8-b9f0-c830ca3fc425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:45.107741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea6fe0-379f-4ec8-b9f0-c830ca3fc425 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:45.108251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea6fe0-379f-4ec8-b9f0-c830ca3fc425 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:45.108686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea6fe0-379f-4ec8-b9f0-c830ca3fc425 None admin] PATH_INFO: `/v3/groups/10fca9e8d32541f7831341e321e111be` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:45.110578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea6fe0-379f-4ec8-b9f0-c830ca3fc425 None admin] RBAC: Authorizing `identity:get_group(group_id=10fca9e8d32541f7831341e321e111be)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:45.113072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea6fe0-379f-4ec8-b9f0-c830ca3fc425 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:45.115983 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 221/451] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 18:03:44 2022] GET /identity/v3/groups/10fca9e8d32541f7831341e321e111be => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:45.118611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea6fe0-379f-4ec8-b9f0-c830ca3fc425 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:45.192001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308f92c-f926-470f-84a2-8f91924b03c8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:45.243835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad228ecd-8c55-42c6-83d1-a9584abaa443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:45.244712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad228ecd-8c55-42c6-83d1-a9584abaa443 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:45.245137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad228ecd-8c55-42c6-83d1-a9584abaa443 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:45.245504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad228ecd-8c55-42c6-83d1-a9584abaa443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:45.246741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad228ecd-8c55-42c6-83d1-a9584abaa443 None admin] RBAC: Adding query filter params (group.id=8f34c89248894775ae0b02e1404dd83c, role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=2e232b8348b844fbb8b30d77b02f1872) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:45.247181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad228ecd-8c55-42c6-83d1-a9584abaa443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:45.249151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad228ecd-8c55-42c6-83d1-a9584abaa443 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:45.249882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea6fe0-379f-4ec8-b9f0-c830ca3fc425 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:45.258703 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 231/452] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 18:03:45 2022] GET /identity/v3/role_assignments?group.id=8f34c89248894775ae0b02e1404dd83c&scope.project.id=2e232b8348b844fbb8b30d77b02f1872&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:45.260421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad228ecd-8c55-42c6-83d1-a9584abaa443 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:45.263301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:45.305990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eaa123-1b51-4748-b1d4-916514ed8924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:45.306996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaa123-1b51-4748-b1d4-916514ed8924 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:45.307487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaa123-1b51-4748-b1d4-916514ed8924 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:45.307916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaa123-1b51-4748-b1d4-916514ed8924 None admin] PATH_INFO: `/v3/groups/10fca9e8d32541f7831341e321e111be` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:45.310067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eaa123-1b51-4748-b1d4-916514ed8924 None admin] RBAC: Authorizing `identity:get_group(group_id=10fca9e8d32541f7831341e321e111be)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:45.312445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eaa123-1b51-4748-b1d4-916514ed8924 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:45.315079 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 222/453] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 18:03:45 2022] GET /identity/v3/groups/10fca9e8d32541f7831341e321e111be => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:45.323680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eaa123-1b51-4748-b1d4-916514ed8924 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:45.462737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad228ecd-8c55-42c6-83d1-a9584abaa443 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:45.474015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:45.488102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eaa123-1b51-4748-b1d4-916514ed8924 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:45.510832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3d5e9-3c1e-426d-9d04-5bca2cc6a1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:45.512118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3d5e9-3c1e-426d-9d04-5bca2cc6a1e7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:45.512782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3d5e9-3c1e-426d-9d04-5bca2cc6a1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:45.513571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3d5e9-3c1e-426d-9d04-5bca2cc6a1e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:45.517001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3d5e9-3c1e-426d-9d04-5bca2cc6a1e7 None admin] RBAC: Adding query filter params (group.id=10fca9e8d32541f7831341e321e111be, role.id=81040db4535e417891c10dd996b1eac5, scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:45.518070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3d5e9-3c1e-426d-9d04-5bca2cc6a1e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:45.520507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3d5e9-3c1e-426d-9d04-5bca2cc6a1e7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:45.528170 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 232/454] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 18:03:45 2022] GET /identity/v3/role_assignments?group.id=10fca9e8d32541f7831341e321e111be&scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8&role.id=81040db4535e417891c10dd996b1eac5 => generated 611 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:45.538024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120f164-adf5-4bc4-95d5-415dc9d6ca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:45.538696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120f164-adf5-4bc4-95d5-415dc9d6ca0d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:45.539202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120f164-adf5-4bc4-95d5-415dc9d6ca0d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:45.539658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120f164-adf5-4bc4-95d5-415dc9d6ca0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:45.541052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120f164-adf5-4bc4-95d5-415dc9d6ca0d None admin] RBAC: Adding query filter params (group.id=10fca9e8d32541f7831341e321e111be, role.id=dcabcc9bd3bf42149eed3abc0d4799c8, scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:45.541438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120f164-adf5-4bc4-95d5-415dc9d6ca0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:45.544054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120f164-adf5-4bc4-95d5-415dc9d6ca0d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:45.563382 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 223/455] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 18:03:45 2022] GET /identity/v3/role_assignments?group.id=10fca9e8d32541f7831341e321e111be&scope.project.id=0a529bd5dd924e93a8b2eb90a47878d8&role.id=dcabcc9bd3bf42149eed3abc0d4799c8 => generated 611 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:48.888993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0e2b8-ae56-4376-aca5-920df551e773 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:48.889596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0e2b8-ae56-4376-aca5-920df551e773 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:48.889596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0e2b8-ae56-4376-aca5-920df551e773 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:48.891387 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 233/456] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:48.897358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf357e4-7404-4a1b-b217-f397c322c472 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:48.898440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf357e4-7404-4a1b-b217-f397c322c472 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:48.899011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf357e4-7404-4a1b-b217-f397c322c472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:48.924741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8cf357e4-7404-4a1b-b217-f397c322c472 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:48.926264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8cf357e4-7404-4a1b-b217-f397c322c472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:48.983891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d062e69-3384-4ec6-b1f8-4da51181aac2 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:48.984203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d062e69-3384-4ec6-b1f8-4da51181aac2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:48.984439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d062e69-3384-4ec6-b1f8-4da51181aac2 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:48.985255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:48.988962 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 234/457] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:03:48.994050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430bd5a-2214-40b0-a186-61d6c65677e2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:48.994350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430bd5a-2214-40b0-a186-61d6c65677e2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:48.994594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430bd5a-2214-40b0-a186-61d6c65677e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:49.015046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b430bd5a-2214-40b0-a186-61d6c65677e2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:49.016535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b430bd5a-2214-40b0-a186-61d6c65677e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:49.052192 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 224/458] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:49.054362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62c476-0c35-4b76-bf9f-df695ace6bd4 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:49.054951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62c476-0c35-4b76-bf9f-df695ace6bd4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:49.056294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62c476-0c35-4b76-bf9f-df695ace6bd4 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:49.058992 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 225/459] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:49.066718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e8313-3135-4da5-865d-743154c263ac None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:49.067461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e8313-3135-4da5-865d-743154c263ac None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:49.068142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e8313-3135-4da5-865d-743154c263ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:49.104326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-db9e8313-3135-4da5-865d-743154c263ac None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:49.105525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db9e8313-3135-4da5-865d-743154c263ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:49.137938 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 235/460] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:49.140176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c510-2f9e-4099-98d8-77d3db83e8af None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:49.140844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c510-2f9e-4099-98d8-77d3db83e8af None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:49.141354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c510-2f9e-4099-98d8-77d3db83e8af None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:49.143399 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 236/461] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:49.148612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba94cd6-bf9f-4ac1-9aff-42ac205a3f99 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:49.149189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba94cd6-bf9f-4ac1-9aff-42ac205a3f99 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:49.149778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba94cd6-bf9f-4ac1-9aff-42ac205a3f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:49.175523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-eba94cd6-bf9f-4ac1-9aff-42ac205a3f99 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:49.177946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eba94cd6-bf9f-4ac1-9aff-42ac205a3f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:49.228961 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 226/462] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:03:49.272633 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 237/463] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:03:49.423491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e8313-3135-4da5-865d-743154c263ac None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:49.436499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba94cd6-bf9f-4ac1-9aff-42ac205a3f99 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:49.510464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:49.625756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:49.631589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e8313-3135-4da5-865d-743154c263ac None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:49.647399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba94cd6-bf9f-4ac1-9aff-42ac205a3f99 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:49.675879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e96d49-80b9-4837-ba8f-7c008ff7f0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:49.676707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e96d49-80b9-4837-ba8f-7c008ff7f0fe None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:49.677112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e96d49-80b9-4837-ba8f-7c008ff7f0fe None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:49.677506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e96d49-80b9-4837-ba8f-7c008ff7f0fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:49.692763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e96d49-80b9-4837-ba8f-7c008ff7f0fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:49.694240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e96d49-80b9-4837-ba8f-7c008ff7f0fe None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:49.699594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a4bba-7fcd-41b6-9923-3076d265e1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:49.700471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a4bba-7fcd-41b6-9923-3076d265e1b3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:49.700930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a4bba-7fcd-41b6-9923-3076d265e1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:49.701229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a4bba-7fcd-41b6-9923-3076d265e1b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:49.712378 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-20e96d49-80b9-4837-ba8f-7c008ff7f0fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:49.712378 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:49.712378 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:49.712378 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:49.712378 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:49.712378 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:49.712378 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:49.712378 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:49.712378 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:49.712378 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:49.712378 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:49.712378 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:49.712378 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:03:49.712378 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:03:49.712378 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:03:49.712378 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:03:49.713506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:49.713506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:49.713506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:49.713506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:49.713506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:49.713506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:49.713506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:49.713506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:49.713506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:49.713506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:49.713506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:49.713506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:49.713506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:49.713506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:49.713506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:49.713506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:49.713506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:03:49.714477 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:03:49.714477 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:49.714477 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:49.714670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a4bba-7fcd-41b6-9923-3076d265e1b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:49.715735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a4bba-7fcd-41b6-9923-3076d265e1b3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:49.716021 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 227/464] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:49.720097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e96d49-80b9-4837-ba8f-7c008ff7f0fe None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:49.737448 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-5b9a4bba-7fcd-41b6-9923-3076d265e1b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:49.737448 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:49.737448 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:49.737448 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:49.737448 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:49.737448 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:49.737448 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:49.737448 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:49.737448 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:49.737448 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:49.737448 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:49.737448 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:49.737448 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:03:49.737448 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:03:49.737448 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:03:49.737448 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:03:49.738410 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:49.738410 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:49.738410 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:49.738410 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:49.738410 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:49.738410 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:49.738410 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:49.738410 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:49.738410 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:49.738410 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:49.738410 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:49.738410 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:49.738410 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:49.738410 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:49.738410 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:49.738410 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:49.738410 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:03:49.739248 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:03:49.739248 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:49.739248 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:49.739248 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 238/465] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:03:49.739796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a4bba-7fcd-41b6-9923-3076d265e1b3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:49.836351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e96d49-80b9-4837-ba8f-7c008ff7f0fe None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:49.845205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:49.865495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a4bba-7fcd-41b6-9923-3076d265e1b3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:49.876762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbc3d3-5059-42b4-8ae8-3e01d15aa19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:49.877557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbc3d3-5059-42b4-8ae8-3e01d15aa19d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:49.877838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbc3d3-5059-42b4-8ae8-3e01d15aa19d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:49.878111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbc3d3-5059-42b4-8ae8-3e01d15aa19d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:49.891704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbc3d3-5059-42b4-8ae8-3e01d15aa19d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:49.893067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbc3d3-5059-42b4-8ae8-3e01d15aa19d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:49.907562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0f677-1b21-47c1-9735-a0f3a63f7163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:49.908251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0f677-1b21-47c1-9735-a0f3a63f7163 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:49.908475 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-97fbc3d3-5059-42b4-8ae8-3e01d15aa19d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:49.908475 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:49.908475 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:49.908475 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:49.908475 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:49.908475 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:49.908475 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:49.908475 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:49.908475 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:49.908475 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:49.908475 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:49.908475 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:49.908475 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:03:49.908475 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:03:49.908475 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:03:49.908475 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:03:49.909661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:49.909661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:49.909661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:49.909661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:49.909661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:49.909661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:49.909661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:49.909661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:49.909661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:49.909661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:49.909661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:49.909661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:49.909661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:49.909661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:49.909661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:49.909661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:49.909661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:03:49.910534 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:03:49.910534 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:49.910534 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:49.911353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0f677-1b21-47c1-9735-a0f3a63f7163 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:49.911353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0f677-1b21-47c1-9735-a0f3a63f7163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:49.911501 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 228/466] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:49.911501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbc3d3-5059-42b4-8ae8-3e01d15aa19d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:49.915942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:49.926416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0f677-1b21-47c1-9735-a0f3a63f7163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:49.927874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0f677-1b21-47c1-9735-a0f3a63f7163 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:49.943024 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-d8d0f677-1b21-47c1-9735-a0f3a63f7163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:49.943024 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:49.943024 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:49.943024 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:49.943024 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:49.943024 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:49.943024 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:49.943024 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:49.943024 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:49.943024 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:49.943024 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:49.943024 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:49.943024 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:03:49.943024 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:03:49.943024 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:03:49.943024 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:03:49.944042 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:49.944042 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:49.944042 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:49.944042 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:49.944042 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:49.944042 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:49.944042 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:49.944042 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:49.944042 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:49.944042 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:49.944042 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:49.944042 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:49.944042 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:49.944042 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:49.944042 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:49.944042 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:49.944042 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:03:49.944923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:03:49.944923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:49.944923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:49.944923 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 239/467] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:49.945186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0f677-1b21-47c1-9735-a0f3a63f7163 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:50.034769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbc3d3-5059-42b4-8ae8-3e01d15aa19d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:50.050319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0f677-1b21-47c1-9735-a0f3a63f7163 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:50.078318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa5398-e8e5-4341-9be4-22f65673977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:50.079123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa5398-e8e5-4341-9be4-22f65673977b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:50.079608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa5398-e8e5-4341-9be4-22f65673977b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:50.079940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa5398-e8e5-4341-9be4-22f65673977b None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:50.080882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa5398-e8e5-4341-9be4-22f65673977b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:50.081280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa5398-e8e5-4341-9be4-22f65673977b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:50.083409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa5398-e8e5-4341-9be4-22f65673977b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:50.086081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcfbb7-f670-417c-9693-f37caf062077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:50.086686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcfbb7-f670-417c-9693-f37caf062077 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:50.087358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcfbb7-f670-417c-9693-f37caf062077 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:50.087358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcfbb7-f670-417c-9693-f37caf062077 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:50.087882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcfbb7-f670-417c-9693-f37caf062077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:50.088190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcfbb7-f670-417c-9693-f37caf062077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:50.089550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcfbb7-f670-417c-9693-f37caf062077 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:50.091218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:50.099326 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 229/468] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:50.104652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa5398-e8e5-4341-9be4-22f65673977b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:50.106570 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 240/469] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:50.111246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcfbb7-f670-417c-9693-f37caf062077 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:50.174591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:50.216524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa5398-e8e5-4341-9be4-22f65673977b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:50.232860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcfbb7-f670-417c-9693-f37caf062077 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:50.260390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476e294-fed5-4db4-803a-973dd4d51daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:50.261002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476e294-fed5-4db4-803a-973dd4d51daf None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:50.261279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476e294-fed5-4db4-803a-973dd4d51daf None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:50.261552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476e294-fed5-4db4-803a-973dd4d51daf None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:50.262285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476e294-fed5-4db4-803a-973dd4d51daf None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:50.262584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476e294-fed5-4db4-803a-973dd4d51daf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:50.263983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476e294-fed5-4db4-803a-973dd4d51daf None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:50.276578 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 230/470] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:50.277329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476e294-fed5-4db4-803a-973dd4d51daf None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:50.279546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd85b1-f086-4c9d-9ff0-7c2d681cd8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:50.281892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd85b1-f086-4c9d-9ff0-7c2d681cd8ff None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:50.282179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd85b1-f086-4c9d-9ff0-7c2d681cd8ff None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:50.282460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd85b1-f086-4c9d-9ff0-7c2d681cd8ff None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:50.283119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd85b1-f086-4c9d-9ff0-7c2d681cd8ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:50.283451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd85b1-f086-4c9d-9ff0-7c2d681cd8ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:50.284856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd85b1-f086-4c9d-9ff0-7c2d681cd8ff None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:50.297707 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 241/471] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:50.298494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd85b1-f086-4c9d-9ff0-7c2d681cd8ff None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:50.359639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:50.387606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476e294-fed5-4db4-803a-973dd4d51daf None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:50.411126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:50.413031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd85b1-f086-4c9d-9ff0-7c2d681cd8ff None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:50.428076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b55cc-a462-4e91-86fc-435f9bf8e99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:50.428676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b55cc-a462-4e91-86fc-435f9bf8e99b None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:50.428898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b55cc-a462-4e91-86fc-435f9bf8e99b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:50.429173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b55cc-a462-4e91-86fc-435f9bf8e99b None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:50.429880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b55cc-a462-4e91-86fc-435f9bf8e99b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:50.431512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b55cc-a462-4e91-86fc-435f9bf8e99b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:50.450099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c383b2-06bc-435c-81a3-c40eb625fcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:50.450713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c383b2-06bc-435c-81a3-c40eb625fcfa None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:50.450989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c383b2-06bc-435c-81a3-c40eb625fcfa None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:50.451278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c383b2-06bc-435c-81a3-c40eb625fcfa None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:50.451932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c383b2-06bc-435c-81a3-c40eb625fcfa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:50.467572 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 231/472] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:03:50 2022] POST /identity/v3/users => generated 248 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:03:50.467923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c383b2-06bc-435c-81a3-c40eb625fcfa None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:50.468109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b5f14-9253-4935-a373-46ede9565d3e None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:50.468109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b5f14-9253-4935-a373-46ede9565d3e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:50.468109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b5f14-9253-4935-a373-46ede9565d3e None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:50.468109 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 232/473] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:50.468109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b5f14-9253-4935-a373-46ede9565d3e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:50.478058 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 242/474] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:03:50 2022] POST /identity/v3/users => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:03:50.478908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c383b2-06bc-435c-81a3-c40eb625fcfa None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:50.615877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c383b2-06bc-435c-81a3-c40eb625fcfa None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:50.629205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:50.662622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f8a0a-34cf-4438-83c9-1c7d2591c067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:50.663970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f8a0a-34cf-4438-83c9-1c7d2591c067 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:50.663970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f8a0a-34cf-4438-83c9-1c7d2591c067 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:50.663970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f8a0a-34cf-4438-83c9-1c7d2591c067 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:50.664529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f8a0a-34cf-4438-83c9-1c7d2591c067 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:50.666649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f8a0a-34cf-4438-83c9-1c7d2591c067 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:50.668181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b5f14-9253-4935-a373-46ede9565d3e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:50.696031 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 243/475] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:03:50 2022] POST /identity/v3/users => generated 249 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:03:50.697303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740b1f8-3e47-4959-88f5-c138203218d8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:50.697590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740b1f8-3e47-4959-88f5-c138203218d8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:50.697866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740b1f8-3e47-4959-88f5-c138203218d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:50.729797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2740b1f8-3e47-4959-88f5-c138203218d8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:50.731906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2740b1f8-3e47-4959-88f5-c138203218d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:50.733338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f16935-63b2-4e16-afbd-855a6baaf39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:50.734093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f16935-63b2-4e16-afbd-855a6baaf39f None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:50.734487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f16935-63b2-4e16-afbd-855a6baaf39f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:50.734701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f16935-63b2-4e16-afbd-855a6baaf39f None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:50.735366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f16935-63b2-4e16-afbd-855a6baaf39f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:50.736883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f16935-63b2-4e16-afbd-855a6baaf39f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:50.768999 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 233/476] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:03:50 2022] POST /identity/v3/users => generated 248 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:03:50.823343 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 244/477] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:51.135711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f16935-63b2-4e16-afbd-855a6baaf39f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:51.181765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:51.252519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f16935-63b2-4e16-afbd-855a6baaf39f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:51.315005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42b646-044a-4f5d-8359-9e385d22767e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:51.315649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42b646-044a-4f5d-8359-9e385d22767e None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:51.315923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42b646-044a-4f5d-8359-9e385d22767e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:51.316194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42b646-044a-4f5d-8359-9e385d22767e None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:51.316875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42b646-044a-4f5d-8359-9e385d22767e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:51.318243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42b646-044a-4f5d-8359-9e385d22767e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:51.330590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.sql.core [None req-6d42b646-044a-4f5d-8359-9e385d22767e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 18:03:51.330590 n-d-850468-20 devstack@keystone.service[82160]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 28 18:03:51.330590 n-d-850468-20 devstack@keystone.service[82160]: [parameters: {'id': 'ca01a7f0cfad4586910b221afe1a8c9b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 28 18:03:51.330590 n-d-850468-20 devstack@keystone.service[82160]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82160) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 18:03:51.347334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-6d42b646-044a-4f5d-8359-9e385d22767e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 28 18:03:51.347334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:51.347334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 18:03:51.347334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 18:03:51.347334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 18:03:51.347334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 18:03:51.347334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 18:03:51.347334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 18:03:51.347334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 18:03:51.347334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application conn.query(q) Aug 28 18:03:51.347334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 18:03:51.347334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 18:03:51.347334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 18:03:51.347334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result.read() Aug 28 18:03:51.347334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return ref.to_dict() Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:03:51.348220 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:03:51.349130 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 18:03:51.349130 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application yield resource Aug 28 18:03:51.349130 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:03:51.349130 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:03:51.349130 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 18:03:51.349130 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 18:03:51.349130 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 18:03:51.349130 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 18:03:51.349130 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 18:03:51.349130 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise self.value Aug 28 18:03:51.349130 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 18:03:51.349130 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 18:03:51.349130 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 18:03:51.349130 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application session.commit() Aug 28 18:03:51.349130 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 18:03:51.349130 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 18:03:51.349130 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 18:03:51.349986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 18:03:51.349986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 18:03:51.349986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.session.flush() Aug 28 18:03:51.349986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 18:03:51.349986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 18:03:51.349986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 18:03:51.349986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 18:03:51.349986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 18:03:51.349986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application compat.raise_( Aug 28 18:03:51.349986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 18:03:51.349986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception Aug 28 18:03:51.349986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 18:03:51.349986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 18:03:51.349986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 18:03:51.349986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 18:03:51.349986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 18:03:51.349986 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 18:03:51.350902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 18:03:51.350902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 18:03:51.350902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 18:03:51.350902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 18:03:51.350902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 18:03:51.350902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 18:03:51.350902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 18:03:51.350902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 18:03:51.350902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 18:03:51.350902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 18:03:51.350902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 18:03:51.350902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 18:03:51.350902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 18:03:51.350902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 18:03:51.350902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 18:03:51.350902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception Aug 28 18:03:51.353239 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 18:03:51.353239 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 18:03:51.353239 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 18:03:51.353239 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 18:03:51.353239 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 18:03:51.353239 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 18:03:51.353239 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 18:03:51.353239 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application conn.query(q) Aug 28 18:03:51.353239 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 18:03:51.353239 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 18:03:51.353239 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 18:03:51.353239 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result.read() Aug 28 18:03:51.353239 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 18:03:51.353239 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 18:03:51.353239 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 18:03:51.353239 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 18:03:51.355189 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 18:03:51.355189 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 18:03:51.355189 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 18:03:51.355189 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 18:03:51.355189 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 18:03:51.355189 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 28 18:03:51.355189 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [parameters: {'id': 'ca01a7f0cfad4586910b221afe1a8c9b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 28 18:03:51.355189 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 18:03:51.355189 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:51.355189 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:03:51.355189 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:51.355189 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:51.355189 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:51.355189 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:51.355189 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:51.355189 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:51.357356 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:51.357356 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:51.357356 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:51.357356 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:51.357356 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:51.357356 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:51.357356 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 28 18:03:51.357356 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 28 18:03:51.357356 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:51.357356 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:51.357356 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 28 18:03:51.357356 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 28 18:03:51.357356 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 18:03:51.357356 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 18:03:51.357356 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 28 18:03:51.357356 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:51.364408 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 234/478] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Aug 28 18:03:51 2022] POST /identity/v3/roles => generated 144 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:51.364577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740b1f8-3e47-4959-88f5-c138203218d8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:51.486016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:51.492724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740b1f8-3e47-4959-88f5-c138203218d8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:51.538905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff3909-ae32-40e3-a9ae-928a50eb8607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:51.539977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff3909-ae32-40e3-a9ae-928a50eb8607 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:51.540475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff3909-ae32-40e3-a9ae-928a50eb8607 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:51.540967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff3909-ae32-40e3-a9ae-928a50eb8607 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:51.564015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff3909-ae32-40e3-a9ae-928a50eb8607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:51.569160 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-88ff3909-ae32-40e3-a9ae-928a50eb8607 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:51.569160 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:51.569160 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:51.569160 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:51.569160 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:51.569160 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:51.569160 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:51.569160 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:51.569160 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:51.569160 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:51.569160 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:51.569160 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:51.569160 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:51.569160 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:51.569160 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:51.569160 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:51.570041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:51.570041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:51.570041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:51.570041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:51.570041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:51.570041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:51.570041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:51.570041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:51.570041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:51.570041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:51.570041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:51.570041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:51.570041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:51.570041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:51.570041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:51.570041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:51.570844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:51.570844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:51.570844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:51.570844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:51.570844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:51.570844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:51.570844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:51.570844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:51.570844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:51.570844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:51.570844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:03:51.570844 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:51.573159 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 245/479] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:03:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:51.579284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42b646-044a-4f5d-8359-9e385d22767e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:51.725667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:51.728946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42b646-044a-4f5d-8359-9e385d22767e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:51.776994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd979f7d-b6b9-4a83-a42f-a91e9c2b78c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:51.777547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd979f7d-b6b9-4a83-a42f-a91e9c2b78c1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:51.777822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd979f7d-b6b9-4a83-a42f-a91e9c2b78c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:51.778091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd979f7d-b6b9-4a83-a42f-a91e9c2b78c1 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:51.778761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd979f7d-b6b9-4a83-a42f-a91e9c2b78c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:51.779063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd979f7d-b6b9-4a83-a42f-a91e9c2b78c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:51.780515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd979f7d-b6b9-4a83-a42f-a91e9c2b78c1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:51.794961 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 235/480] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:03:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:52.848734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d27b55-0479-4705-8f71-dbc6995979c4 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:52.849250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d27b55-0479-4705-8f71-dbc6995979c4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:52.849355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d27b55-0479-4705-8f71-dbc6995979c4 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:52.850676 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 246/481] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:52.856051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a3d56-b6e6-48d7-a9b8-57a48575c819 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:52.856471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a3d56-b6e6-48d7-a9b8-57a48575c819 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:52.856641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a3d56-b6e6-48d7-a9b8-57a48575c819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:52.875214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d19a3d56-b6e6-48d7-a9b8-57a48575c819 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:52.876422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d19a3d56-b6e6-48d7-a9b8-57a48575c819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:52.906843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340e76b-fc0b-401c-b799-268f88c26936 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:52.907149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340e76b-fc0b-401c-b799-268f88c26936 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:52.907442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340e76b-fc0b-401c-b799-268f88c26936 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:52.909374 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 247/482] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:52.922543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fc32e-42e5-48ff-94ad-7c3f07f2423d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:52.922844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fc32e-42e5-48ff-94ad-7c3f07f2423d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:52.923099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fc32e-42e5-48ff-94ad-7c3f07f2423d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:52.951609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1c5fc32e-42e5-48ff-94ad-7c3f07f2423d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:52.952828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c5fc32e-42e5-48ff-94ad-7c3f07f2423d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:52.982013 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 236/483] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:53.067775 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 248/484] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:03:53.224140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240cb45-e114-40de-bd90-73d47665de22 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:53.224437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240cb45-e114-40de-bd90-73d47665de22 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:53.224600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240cb45-e114-40de-bd90-73d47665de22 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:53.226277 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 237/485] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:53.233907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1c593-0f02-44dc-9e96-4a85788556f7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:53.234196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1c593-0f02-44dc-9e96-4a85788556f7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:53.234475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1c593-0f02-44dc-9e96-4a85788556f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:53.260891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-18b1c593-0f02-44dc-9e96-4a85788556f7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:53.262216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-18b1c593-0f02-44dc-9e96-4a85788556f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:53.336487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240cb45-e114-40de-bd90-73d47665de22 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:53.363533 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 249/486] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:53.440151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1c593-0f02-44dc-9e96-4a85788556f7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:53.466792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:53.473161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:53.486519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240cb45-e114-40de-bd90-73d47665de22 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:53.530416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47be17-de33-4a2c-af8c-9a7ca560caa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:53.531374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47be17-de33-4a2c-af8c-9a7ca560caa1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:53.531802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47be17-de33-4a2c-af8c-9a7ca560caa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:53.532178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47be17-de33-4a2c-af8c-9a7ca560caa1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:53.545184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47be17-de33-4a2c-af8c-9a7ca560caa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:53.550716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-5f47be17-de33-4a2c-af8c-9a7ca560caa1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:03:53.550716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:53.550716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:53.550716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:53.550716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:53.550716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:53.550716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:53.550716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:53.550716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:53.550716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:53.550716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:53.550716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:53.550716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:53.550716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:53.550716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:53.550716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:53.551978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:53.551978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:53.551978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:53.551978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:53.551978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:53.551978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:53.551978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:53.551978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:53.551978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:53.551978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:53.551978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:53.551978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:53.551978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:53.551978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:53.551978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:53.551978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:53.552895 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:53.552895 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:53.552895 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:53.552895 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:53.552895 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:53.552895 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:53.552895 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:53.552895 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:53.552895 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:53.552895 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:53.552895 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:03:53.552895 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:53.552895 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 238/487] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:03:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:53.559144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b33055-e4a8-4865-8ec1-78cc0c97aac8 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:53.559144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b33055-e4a8-4865-8ec1-78cc0c97aac8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:53.559332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b33055-e4a8-4865-8ec1-78cc0c97aac8 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:53.564701 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 239/488] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:53.564701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b33055-e4a8-4865-8ec1-78cc0c97aac8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:53.585269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1c593-0f02-44dc-9e96-4a85788556f7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:53.620439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42bca6-d90c-43e8-af8f-33ed5deba4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:53.621600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42bca6-d90c-43e8-af8f-33ed5deba4bd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:53.622064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42bca6-d90c-43e8-af8f-33ed5deba4bd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:53.622515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42bca6-d90c-43e8-af8f-33ed5deba4bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:53.634253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42bca6-d90c-43e8-af8f-33ed5deba4bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:53.639950 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-8d42bca6-d90c-43e8-af8f-33ed5deba4bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:03:53.639950 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:53.639950 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:53.639950 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:53.639950 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:53.639950 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:53.639950 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:53.639950 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:53.639950 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:53.639950 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:53.639950 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:53.639950 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:53.639950 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:53.639950 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:53.639950 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:53.639950 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:53.640948 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:53.640948 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:53.640948 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:53.640948 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:53.640948 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:53.640948 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:53.640948 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:53.640948 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:53.640948 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:53.640948 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:53.640948 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:53.640948 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:53.640948 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:53.640948 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:53.640948 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:53.640948 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:53.641737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:53.641737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:53.641737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:53.641737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:53.641737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:53.641737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:53.641737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:53.641737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:53.641737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:53.641737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:53.641737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:03:53.641737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:53.644356 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 250/489] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:03:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:53.645753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198b01c-62f8-464d-809b-594b6958d61d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:53.646195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198b01c-62f8-464d-809b-594b6958d61d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:53.646470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198b01c-62f8-464d-809b-594b6958d61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:53.664462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f198b01c-62f8-464d-809b-594b6958d61d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:53.665634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f198b01c-62f8-464d-809b-594b6958d61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:53.673968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b33055-e4a8-4865-8ec1-78cc0c97aac8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:53.716268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0dcb1-7265-4e60-b44a-fd114741da98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:53.717129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0dcb1-7265-4e60-b44a-fd114741da98 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:53.717515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0dcb1-7265-4e60-b44a-fd114741da98 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:53.717922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0dcb1-7265-4e60-b44a-fd114741da98 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:53.718683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0dcb1-7265-4e60-b44a-fd114741da98 None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:53.719043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0dcb1-7265-4e60-b44a-fd114741da98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:53.720462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0dcb1-7265-4e60-b44a-fd114741da98 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:53.729564 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 240/490] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:03:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:53.734083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0dcb1-7265-4e60-b44a-fd114741da98 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:53.744894 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 251/491] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:53.745492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198b01c-62f8-464d-809b-594b6958d61d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:53.754619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:53.760667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:53.851067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198b01c-62f8-464d-809b-594b6958d61d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:53.871988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0dcb1-7265-4e60-b44a-fd114741da98 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:53.897930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b453c-282e-47e6-814f-2682d5f9cea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:53.899037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b453c-282e-47e6-814f-2682d5f9cea6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:53.899559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b453c-282e-47e6-814f-2682d5f9cea6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:53.900231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b453c-282e-47e6-814f-2682d5f9cea6 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:53.901478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b453c-282e-47e6-814f-2682d5f9cea6 None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:53.902148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b453c-282e-47e6-814f-2682d5f9cea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:53.904027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b453c-282e-47e6-814f-2682d5f9cea6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:53.909165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6193bd-6fd5-4416-8e83-396068636239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:53.909912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6193bd-6fd5-4416-8e83-396068636239 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:53.910307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6193bd-6fd5-4416-8e83-396068636239 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:53.910714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6193bd-6fd5-4416-8e83-396068636239 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:53.915203 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 252/492] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:03:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:53.916170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b453c-282e-47e6-814f-2682d5f9cea6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:53.927708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6193bd-6fd5-4416-8e83-396068636239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:53.933702 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-ae6193bd-6fd5-4416-8e83-396068636239 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:03:53.933702 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:53.933702 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:53.933702 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:53.933702 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:53.933702 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:53.933702 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:53.933702 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:53.933702 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:53.933702 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:53.933702 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:53.933702 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:53.933702 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:53.933702 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:53.933702 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:53.933702 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:53.934700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:53.934700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:53.934700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:53.934700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:53.934700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:53.934700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:53.934700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:53.934700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:53.934700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:53.934700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:53.934700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:53.934700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:53.934700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:53.934700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:53.934700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:53.934700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:53.935530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:53.935530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:53.935530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:53.935530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:53.935530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:53.935530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:53.935530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:53.935530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:53.935530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:53.935530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:53.935530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:03:53.935530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:53.939735 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 241/493] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:03:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:53.940758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6193bd-6fd5-4416-8e83-396068636239 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:53.995178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:54.025796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:54.033434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b453c-282e-47e6-814f-2682d5f9cea6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:54.053203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6193bd-6fd5-4416-8e83-396068636239 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:54.069367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb465a8-af5a-49e4-9995-ddd5c232b084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:54.070003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb465a8-af5a-49e4-9995-ddd5c232b084 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:54.070284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb465a8-af5a-49e4-9995-ddd5c232b084 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:54.070543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb465a8-af5a-49e4-9995-ddd5c232b084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:54.081937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb465a8-af5a-49e4-9995-ddd5c232b084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:54.083430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb465a8-af5a-49e4-9995-ddd5c232b084 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:54.088271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917c65f-c22a-41a4-863b-fd314c6956b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:54.088906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917c65f-c22a-41a4-863b-fd314c6956b4 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:54.089189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917c65f-c22a-41a4-863b-fd314c6956b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:54.089465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917c65f-c22a-41a4-863b-fd314c6956b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:54.098666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-1fb465a8-af5a-49e4-9995-ddd5c232b084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:54.098666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:54.098666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:54.098666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:54.098666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:54.098666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:54.098666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:54.098666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:54.098666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:54.098666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:54.098666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:54.098666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:54.098666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:03:54.098666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:03:54.098666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:03:54.098666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:03:54.099643 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:54.099643 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:54.099643 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:54.099643 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:54.099643 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:54.099643 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:54.099643 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:54.099643 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:54.099643 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:54.099643 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:54.099643 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:54.099643 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:54.099643 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:54.099643 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:54.099643 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:54.099643 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:54.099643 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:03:54.100520 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:03:54.100520 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:54.100520 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:54.100520 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 253/494] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:54.101017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb465a8-af5a-49e4-9995-ddd5c232b084 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:54.106049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917c65f-c22a-41a4-863b-fd314c6956b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:54.107540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917c65f-c22a-41a4-863b-fd314c6956b4 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:54.123161 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-b917c65f-c22a-41a4-863b-fd314c6956b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:54.123161 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:54.123161 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:54.123161 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:54.123161 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:54.123161 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:54.123161 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:54.123161 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:54.123161 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:54.123161 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:54.123161 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:54.123161 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:54.123161 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:03:54.123161 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:03:54.123161 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:03:54.123161 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:03:54.124135 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:54.124135 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:54.124135 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:54.124135 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:54.124135 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:54.124135 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:54.124135 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:54.124135 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:54.124135 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:54.124135 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:54.124135 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:54.124135 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:54.124135 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:54.124135 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:54.124135 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:54.124135 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:54.124135 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:03:54.124966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:03:54.124966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:54.124966 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:54.124966 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 242/495] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:54.125172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917c65f-c22a-41a4-863b-fd314c6956b4 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:54.214665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb465a8-af5a-49e4-9995-ddd5c232b084 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:54.235022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:54.241811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917c65f-c22a-41a4-863b-fd314c6956b4 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:54.249025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e2e36-4248-4dea-88af-c9f5f7507e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:54.249579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e2e36-4248-4dea-88af-c9f5f7507e50 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:54.249860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e2e36-4248-4dea-88af-c9f5f7507e50 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:54.250134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e2e36-4248-4dea-88af-c9f5f7507e50 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:54.250803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e2e36-4248-4dea-88af-c9f5f7507e50 None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:54.251106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e2e36-4248-4dea-88af-c9f5f7507e50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:54.252530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e2e36-4248-4dea-88af-c9f5f7507e50 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:54.261115 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 254/496] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:03:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:54.261810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e2e36-4248-4dea-88af-c9f5f7507e50 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:54.268269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:54.277660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc08b78-4360-4b2a-889f-9f424a5d1a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:54.278302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc08b78-4360-4b2a-889f-9f424a5d1a16 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:54.278579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc08b78-4360-4b2a-889f-9f424a5d1a16 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:54.278849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc08b78-4360-4b2a-889f-9f424a5d1a16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:54.290517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc08b78-4360-4b2a-889f-9f424a5d1a16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:54.295813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-cdc08b78-4360-4b2a-889f-9f424a5d1a16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:03:54.295813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:54.295813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:54.295813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:54.295813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:54.295813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:54.295813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:54.295813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:54.295813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:54.295813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:54.295813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:54.295813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:54.295813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:54.295813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:54.295813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:54.295813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:54.296947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:54.296947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:54.296947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:54.296947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:54.296947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:54.296947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:54.296947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:54.296947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:54.296947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:54.296947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:54.296947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:54.296947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:54.296947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:54.296947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:54.296947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:54.296947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:54.297735 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:54.297735 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:54.297735 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:54.297735 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:54.297735 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:54.297735 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:54.297735 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:54.297735 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:54.297735 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:54.297735 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:54.297735 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:03:54.297735 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:54.297735 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 243/497] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:03:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:54.297735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc08b78-4360-4b2a-889f-9f424a5d1a16 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:54.361282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e2e36-4248-4dea-88af-c9f5f7507e50 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:54.395889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2247e-651d-4a65-8170-5f72622c89ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:54.396500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2247e-651d-4a65-8170-5f72622c89ee None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:54.396774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2247e-651d-4a65-8170-5f72622c89ee None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:54.397053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2247e-651d-4a65-8170-5f72622c89ee None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:54.397703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2247e-651d-4a65-8170-5f72622c89ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:54.398036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2247e-651d-4a65-8170-5f72622c89ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:54.399460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2247e-651d-4a65-8170-5f72622c89ee None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:54.399582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc08b78-4360-4b2a-889f-9f424a5d1a16 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:54.411138 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 255/498] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:54.412386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac062f-4928-45a9-a500-cc77a5259892 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:54.412668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac062f-4928-45a9-a500-cc77a5259892 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:54.412943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac062f-4928-45a9-a500-cc77a5259892 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:54.414137 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 256/499] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:03:54.414854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac062f-4928-45a9-a500-cc77a5259892 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:54.438082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0a8f1-9c33-4a87-86a4-ac9ac9bc5871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:54.438687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0a8f1-9c33-4a87-86a4-ac9ac9bc5871 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:54.438964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0a8f1-9c33-4a87-86a4-ac9ac9bc5871 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:54.439239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0a8f1-9c33-4a87-86a4-ac9ac9bc5871 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:54.439919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0a8f1-9c33-4a87-86a4-ac9ac9bc5871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:54.440217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0a8f1-9c33-4a87-86a4-ac9ac9bc5871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:54.441613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0a8f1-9c33-4a87-86a4-ac9ac9bc5871 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:54.453310 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 244/500] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:54.454110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0a8f1-9c33-4a87-86a4-ac9ac9bc5871 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:54.462141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:54.499813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:54.522742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac062f-4928-45a9-a500-cc77a5259892 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:54.554096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0a8f1-9c33-4a87-86a4-ac9ac9bc5871 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:54.560779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f79303-e322-42f5-b09d-50561339481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:54.561426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79303-e322-42f5-b09d-50561339481b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:54.561701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79303-e322-42f5-b09d-50561339481b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:54.561966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79303-e322-42f5-b09d-50561339481b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:54.573502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f79303-e322-42f5-b09d-50561339481b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:54.575015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f79303-e322-42f5-b09d-50561339481b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:54.589405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167dd08-c241-4f95-8f43-acbe727c34df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:54.590125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167dd08-c241-4f95-8f43-acbe727c34df None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:54.590229 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-63f79303-e322-42f5-b09d-50561339481b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:54.590229 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:54.590229 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:54.590229 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:54.590229 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:54.590229 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:54.590229 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:54.590229 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:54.590229 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:54.590229 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:54.590229 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:54.590229 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:54.590229 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:03:54.590229 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:03:54.590229 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:03:54.590229 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:03:54.591271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:54.591271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:54.591271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:54.591271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:54.591271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:54.591271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:54.591271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:54.591271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:54.591271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:54.591271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:54.591271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:54.591271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:54.591271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:54.591271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:54.591271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:54.591271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:54.591271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:03:54.592132 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:03:54.592132 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:54.592132 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:54.592310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167dd08-c241-4f95-8f43-acbe727c34df None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:54.592310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167dd08-c241-4f95-8f43-acbe727c34df None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:54.592310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167dd08-c241-4f95-8f43-acbe727c34df None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:54.592480 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 257/501] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:54.592543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167dd08-c241-4f95-8f43-acbe727c34df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:54.592615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f79303-e322-42f5-b09d-50561339481b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:54.592967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167dd08-c241-4f95-8f43-acbe727c34df None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:54.601330 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 245/502] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:03:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:54.602521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fae7a-8343-44cc-9e72-4335e32ec140 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:54.602821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fae7a-8343-44cc-9e72-4335e32ec140 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:54.603086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fae7a-8343-44cc-9e72-4335e32ec140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:54.620897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ab0fae7a-8343-44cc-9e72-4335e32ec140 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:54.622232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ab0fae7a-8343-44cc-9e72-4335e32ec140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:54.689178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:54.689947 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 246/503] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:54.690886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fae7a-8343-44cc-9e72-4335e32ec140 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:54.709857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f79303-e322-42f5-b09d-50561339481b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:54.731388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:54.751225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adb259-d9d4-4d1f-a4b2-8842f4a4d598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:54.751914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adb259-d9d4-4d1f-a4b2-8842f4a4d598 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:54.752248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adb259-d9d4-4d1f-a4b2-8842f4a4d598 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:54.752578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adb259-d9d4-4d1f-a4b2-8842f4a4d598 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:54.761637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56adb259-d9d4-4d1f-a4b2-8842f4a4d598 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:54.763198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56adb259-d9d4-4d1f-a4b2-8842f4a4d598 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:54.775559 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-56adb259-d9d4-4d1f-a4b2-8842f4a4d598 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 18:03:54.775559 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:54.775559 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:54.775559 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:54.775559 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:54.775559 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:54.775559 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:54.775559 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:54.775559 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:54.775559 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:54.775559 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:54.775559 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:54.775559 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:03:54.775559 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:03:54.775559 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:03:54.775559 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:54.776641 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:54.782746 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:54.782746 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:54.782746 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:03:54.782746 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:03:54.782746 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:03:54.782746 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:03:54.782746 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:03:54.782746 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:03:54.782746 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 18:03:54.782746 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:54.782746 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 258/504] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:54.782746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adb259-d9d4-4d1f-a4b2-8842f4a4d598 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:54.816826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fae7a-8343-44cc-9e72-4335e32ec140 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:54.859111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28841c03-3708-484a-9c7d-59b3db1a2cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:54.860691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28841c03-3708-484a-9c7d-59b3db1a2cb0 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:54.860691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28841c03-3708-484a-9c7d-59b3db1a2cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:54.860863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28841c03-3708-484a-9c7d-59b3db1a2cb0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:54.870865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28841c03-3708-484a-9c7d-59b3db1a2cb0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:54.872479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28841c03-3708-484a-9c7d-59b3db1a2cb0 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:54.891752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adb259-d9d4-4d1f-a4b2-8842f4a4d598 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:54.892861 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-28841c03-3708-484a-9c7d-59b3db1a2cb0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:03:54.892861 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:54.892861 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:54.892861 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:54.892861 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:54.892861 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:54.892861 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:54.892861 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:54.892861 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:54.892861 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:54.892861 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:54.892861 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:54.892861 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:03:54.892861 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:03:54.892861 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:03:54.892861 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:54.893909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:54.895011 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:54.895011 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:54.895011 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:03:54.895011 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:03:54.895011 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:03:54.895011 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:03:54.895011 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:03:54.895011 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:03:54.895011 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:03:54.895011 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:54.898897 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 247/505] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 18:03:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:54.899794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28841c03-3708-484a-9c7d-59b3db1a2cb0 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:54.936172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e3d39-7308-42bf-8942-a7416ebbc118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:54.936783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e3d39-7308-42bf-8942-a7416ebbc118 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:54.937066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e3d39-7308-42bf-8942-a7416ebbc118 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:54.937340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e3d39-7308-42bf-8942-a7416ebbc118 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:54.937991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e3d39-7308-42bf-8942-a7416ebbc118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:54.938298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e3d39-7308-42bf-8942-a7416ebbc118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:54.939733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e3d39-7308-42bf-8942-a7416ebbc118 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:54.956513 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 259/506] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:54.956513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e3d39-7308-42bf-8942-a7416ebbc118 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:54.972401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:55.007510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:55.012212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28841c03-3708-484a-9c7d-59b3db1a2cb0 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:55.048444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918d33c-e59c-4d52-ad2d-79ab4457d4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:55.049067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918d33c-e59c-4d52-ad2d-79ab4457d4f2 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:55.049347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918d33c-e59c-4d52-ad2d-79ab4457d4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:55.049620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918d33c-e59c-4d52-ad2d-79ab4457d4f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:55.059123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e3d39-7308-42bf-8942-a7416ebbc118 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:55.061618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918d33c-e59c-4d52-ad2d-79ab4457d4f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:55.063139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918d33c-e59c-4d52-ad2d-79ab4457d4f2 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:55.077265 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-6918d33c-e59c-4d52-ad2d-79ab4457d4f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:55.077265 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:55.077265 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:55.077265 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:55.077265 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:55.077265 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:55.077265 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:55.077265 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:55.077265 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:55.077265 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:55.077265 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:55.077265 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:55.077265 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:03:55.077265 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:03:55.077265 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:03:55.077265 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:03:55.078610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:55.078610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:55.078610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:55.078610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:55.078610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:55.078610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:55.078610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:55.078610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:55.078610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:55.078610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:55.078610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:55.078610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:55.078610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:55.078610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:55.078610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:55.078610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:55.078610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:03:55.079480 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:03:55.079480 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:55.079480 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:55.079480 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 248/507] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:55.079822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918d33c-e59c-4d52-ad2d-79ab4457d4f2 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:55.097648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413018b-6f08-4a03-867e-6f881f72fa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:55.098257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413018b-6f08-4a03-867e-6f881f72fa4b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:55.098532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413018b-6f08-4a03-867e-6f881f72fa4b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:55.098802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413018b-6f08-4a03-867e-6f881f72fa4b None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:55.099561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413018b-6f08-4a03-867e-6f881f72fa4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:55.099864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413018b-6f08-4a03-867e-6f881f72fa4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:55.101291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413018b-6f08-4a03-867e-6f881f72fa4b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:55.137075 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 260/508] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 28 18:03:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:55.137905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413018b-6f08-4a03-867e-6f881f72fa4b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:55.185110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918d33c-e59c-4d52-ad2d-79ab4457d4f2 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:55.209570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:55.221691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657b87c-75c7-4985-b758-0e6f11edc080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:55.222306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657b87c-75c7-4985-b758-0e6f11edc080 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:55.222585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657b87c-75c7-4985-b758-0e6f11edc080 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:55.222857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657b87c-75c7-4985-b758-0e6f11edc080 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:55.223631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657b87c-75c7-4985-b758-0e6f11edc080 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:55.223940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657b87c-75c7-4985-b758-0e6f11edc080 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:55.225378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657b87c-75c7-4985-b758-0e6f11edc080 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:55.242000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413018b-6f08-4a03-867e-6f881f72fa4b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:55.262918 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 249/509] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 18:03:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:55.263714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657b87c-75c7-4985-b758-0e6f11edc080 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:55.274311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:55.281309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620d541-fe64-426f-8f59-c0e86870947c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:55.281948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d541-fe64-426f-8f59-c0e86870947c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:55.282223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d541-fe64-426f-8f59-c0e86870947c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:55.282491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d541-fe64-426f-8f59-c0e86870947c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:55.290392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620d541-fe64-426f-8f59-c0e86870947c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:55.291925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620d541-fe64-426f-8f59-c0e86870947c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:55.302940 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-4620d541-fe64-426f-8f59-c0e86870947c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 18:03:55.302940 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:55.302940 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:55.302940 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:55.302940 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:55.302940 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:55.302940 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:55.302940 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:55.302940 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:55.302940 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:55.302940 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:55.302940 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:55.302940 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:03:55.302940 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:03:55.302940 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:03:55.302940 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:55.304035 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:55.304915 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:55.304915 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:55.304915 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:03:55.304915 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:03:55.304915 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:03:55.304915 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:03:55.304915 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:03:55.304915 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:03:55.304915 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 18:03:55.304915 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:55.304915 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 261/510] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:03:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:55.305447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620d541-fe64-426f-8f59-c0e86870947c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:55.367248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657b87c-75c7-4985-b758-0e6f11edc080 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:55.402327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09935e40-c079-46df-8f98-18615e920283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:55.403009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09935e40-c079-46df-8f98-18615e920283 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:55.404612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09935e40-c079-46df-8f98-18615e920283 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:55.404612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09935e40-c079-46df-8f98-18615e920283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:55.406981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620d541-fe64-426f-8f59-c0e86870947c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:55.414669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09935e40-c079-46df-8f98-18615e920283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:55.416171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09935e40-c079-46df-8f98-18615e920283 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:55.431039 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-09935e40-c079-46df-8f98-18615e920283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:55.431039 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:55.431039 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:55.431039 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:55.431039 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:55.431039 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:55.431039 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:55.431039 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:55.431039 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:55.431039 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:55.431039 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:55.431039 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:55.431039 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:03:55.431039 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:03:55.431039 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:03:55.431039 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:03:55.432164 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:55.432164 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:55.432164 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:55.432164 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:55.432164 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:55.432164 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:55.432164 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:55.432164 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:55.432164 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:55.432164 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:55.432164 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:55.432164 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:55.432164 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:55.432164 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:55.432164 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:55.432164 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:55.432164 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:03:55.433204 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:03:55.433204 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:55.433204 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:55.433204 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 250/511] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:55.433437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09935e40-c079-46df-8f98-18615e920283 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:55.438457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:55.444508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e8002-944b-437a-af73-c61a5a6f3df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:55.445089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e8002-944b-437a-af73-c61a5a6f3df5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:55.445366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e8002-944b-437a-af73-c61a5a6f3df5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:55.445639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e8002-944b-437a-af73-c61a5a6f3df5 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:55.446288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e8002-944b-437a-af73-c61a5a6f3df5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:55.446586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e8002-944b-437a-af73-c61a5a6f3df5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:55.448003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e8002-944b-437a-af73-c61a5a6f3df5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:55.460090 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 262/512] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:55.461059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e8002-944b-437a-af73-c61a5a6f3df5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:55.492427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:55.534945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09935e40-c079-46df-8f98-18615e920283 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:55.564007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e8002-944b-437a-af73-c61a5a6f3df5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:55.570924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c7025-30d7-49da-94ea-ed6646978d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:55.571581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c7025-30d7-49da-94ea-ed6646978d03 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:55.571862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c7025-30d7-49da-94ea-ed6646978d03 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:55.572155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c7025-30d7-49da-94ea-ed6646978d03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:55.598971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a895753-abfc-486b-a38b-bdeb40cacd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:55.599620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895753-abfc-486b-a38b-bdeb40cacd94 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:55.599898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895753-abfc-486b-a38b-bdeb40cacd94 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:55.600166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895753-abfc-486b-a38b-bdeb40cacd94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:55.640084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c7025-30d7-49da-94ea-ed6646978d03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:55.641591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c7025-30d7-49da-94ea-ed6646978d03 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:55.658400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:55.668989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a895753-abfc-486b-a38b-bdeb40cacd94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:55.670465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a895753-abfc-486b-a38b-bdeb40cacd94 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:55.697896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:55.741447 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 251/513] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:55.742447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c7025-30d7-49da-94ea-ed6646978d03 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:55.772833 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 263/514] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:55.773713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a895753-abfc-486b-a38b-bdeb40cacd94 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:55.840555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c7025-30d7-49da-94ea-ed6646978d03 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:55.866413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:55.875374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb828ae4-143e-48f5-826a-5ea7ac469f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:55.876007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb828ae4-143e-48f5-826a-5ea7ac469f7f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:55.876285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb828ae4-143e-48f5-826a-5ea7ac469f7f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:55.876557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb828ae4-143e-48f5-826a-5ea7ac469f7f None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:55.877295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb828ae4-143e-48f5-826a-5ea7ac469f7f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:55.877602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb828ae4-143e-48f5-826a-5ea7ac469f7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:55.877872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a895753-abfc-486b-a38b-bdeb40cacd94 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:55.879045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb828ae4-143e-48f5-826a-5ea7ac469f7f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:55.902254 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 252/515] 10.222.0.27 () {56 vars in 1139 bytes} [Sun Aug 28 18:03:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:55.903406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb828ae4-143e-48f5-826a-5ea7ac469f7f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:55.931661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:55.932004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e068595-40ca-4b54-89dc-207c96f1755f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:55.932647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e068595-40ca-4b54-89dc-207c96f1755f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:55.932907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e068595-40ca-4b54-89dc-207c96f1755f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:55.933180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e068595-40ca-4b54-89dc-207c96f1755f None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:55.933838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e068595-40ca-4b54-89dc-207c96f1755f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:55.934141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e068595-40ca-4b54-89dc-207c96f1755f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:55.935627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e068595-40ca-4b54-89dc-207c96f1755f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:55.948328 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 264/516] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:55.949168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e068595-40ca-4b54-89dc-207c96f1755f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:56.028265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb828ae4-143e-48f5-826a-5ea7ac469f7f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:56.059678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e068595-40ca-4b54-89dc-207c96f1755f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:56.061928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722d442-f337-403f-8168-c0e118155df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:56.062580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722d442-f337-403f-8168-c0e118155df8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:56.062861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722d442-f337-403f-8168-c0e118155df8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:56.063131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722d442-f337-403f-8168-c0e118155df8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:56.070330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722d442-f337-403f-8168-c0e118155df8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:56.071829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722d442-f337-403f-8168-c0e118155df8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:56.083314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-8722d442-f337-403f-8168-c0e118155df8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 18:03:56.083314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:56.083314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:56.083314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:56.083314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:56.083314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:56.083314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:56.083314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:56.083314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:56.083314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:56.083314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:56.083314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:56.083314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:03:56.083314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:03:56.083314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:03:56.083314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:56.084259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:56.085151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:56.085151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:56.085151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:03:56.085151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:03:56.085151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:03:56.085151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:03:56.085151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:03:56.085151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:03:56.085151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 18:03:56.085151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:56.085151 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 253/517] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:03:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:56.085151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722d442-f337-403f-8168-c0e118155df8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:56.098973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f20ebd-3da2-48c5-9dd9-0002e73143a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:56.099568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f20ebd-3da2-48c5-9dd9-0002e73143a6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:56.099834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f20ebd-3da2-48c5-9dd9-0002e73143a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:56.100126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f20ebd-3da2-48c5-9dd9-0002e73143a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:56.110850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f20ebd-3da2-48c5-9dd9-0002e73143a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:56.112407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f20ebd-3da2-48c5-9dd9-0002e73143a6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:56.126634 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-d0f20ebd-3da2-48c5-9dd9-0002e73143a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:56.126634 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:56.126634 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:56.126634 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:56.126634 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:56.126634 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:56.126634 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:56.126634 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:56.126634 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:56.126634 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:56.126634 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:56.126634 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:56.126634 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:03:56.126634 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:03:56.126634 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:03:56.126634 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:03:56.127568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:56.127568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:56.127568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:56.127568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:56.127568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:56.127568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:56.127568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:56.127568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:56.127568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:56.127568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:56.127568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:56.127568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:56.127568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:56.127568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:56.127568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:56.127568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:56.127568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:03:56.129120 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:03:56.129120 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:56.129120 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:56.129120 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 265/518] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:56.129120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f20ebd-3da2-48c5-9dd9-0002e73143a6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:56.133501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:56.166639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:56.189693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722d442-f337-403f-8168-c0e118155df8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:56.224222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cf0dc-0b7f-4cf8-8c50-aff901a34391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:56.224885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cf0dc-0b7f-4cf8-8c50-aff901a34391 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:56.225165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cf0dc-0b7f-4cf8-8c50-aff901a34391 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:56.225436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cf0dc-0b7f-4cf8-8c50-aff901a34391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:56.232859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f20ebd-3da2-48c5-9dd9-0002e73143a6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:56.236412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cf0dc-0b7f-4cf8-8c50-aff901a34391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:56.237893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cf0dc-0b7f-4cf8-8c50-aff901a34391 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:56.252636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-894cf0dc-0b7f-4cf8-8c50-aff901a34391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:56.252636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:56.252636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:56.252636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:56.252636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:56.252636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:56.252636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:56.252636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:56.252636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:56.252636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:56.252636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:56.252636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:56.252636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:03:56.252636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:03:56.252636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:03:56.252636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:03:56.253712 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:56.253712 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:56.253712 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:56.253712 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:56.253712 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:56.253712 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:56.253712 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:56.253712 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:56.253712 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:56.253712 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:56.253712 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:56.253712 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:56.253712 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:56.253712 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:56.253712 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:56.253712 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:56.253712 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:03:56.254746 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:03:56.254746 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:56.254746 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:56.258282 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 254/519] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:56.259105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cf0dc-0b7f-4cf8-8c50-aff901a34391 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:56.269391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac519c5e-fff7-4937-9540-03470294fda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:56.270003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac519c5e-fff7-4937-9540-03470294fda6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:56.270282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac519c5e-fff7-4937-9540-03470294fda6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:56.270550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac519c5e-fff7-4937-9540-03470294fda6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:56.336856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac519c5e-fff7-4937-9540-03470294fda6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:56.338425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac519c5e-fff7-4937-9540-03470294fda6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:56.341155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:56.362386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cf0dc-0b7f-4cf8-8c50-aff901a34391 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:56.391502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:56.398400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbf8d2-6827-47ef-809f-8c78517f5276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:56.399018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbf8d2-6827-47ef-809f-8c78517f5276 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:56.399338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbf8d2-6827-47ef-809f-8c78517f5276 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:56.399632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbf8d2-6827-47ef-809f-8c78517f5276 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:56.400272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbf8d2-6827-47ef-809f-8c78517f5276 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:56.401731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbf8d2-6827-47ef-809f-8c78517f5276 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:56.427290 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 255/520] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:03:56 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:03:56.427290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbf8d2-6827-47ef-809f-8c78517f5276 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:56.455693 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 266/521] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:56.456970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac519c5e-fff7-4937-9540-03470294fda6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:56.549962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbf8d2-6827-47ef-809f-8c78517f5276 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:56.584353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac519c5e-fff7-4937-9540-03470294fda6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:56.586483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:56.597358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc033d-c90f-4578-a84e-dd3a62e2fde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:56.598120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc033d-c90f-4578-a84e-dd3a62e2fde4 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:56.598499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc033d-c90f-4578-a84e-dd3a62e2fde4 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:56.598868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc033d-c90f-4578-a84e-dd3a62e2fde4 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:56.599787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc033d-c90f-4578-a84e-dd3a62e2fde4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:56.600233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc033d-c90f-4578-a84e-dd3a62e2fde4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:56.601752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc033d-c90f-4578-a84e-dd3a62e2fde4 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:56.621993 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 256/522] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 28 18:03:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:56.622715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc033d-c90f-4578-a84e-dd3a62e2fde4 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:56.626956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642db1f-a491-4764-ac1c-115db1dd8268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:56.628032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642db1f-a491-4764-ac1c-115db1dd8268 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:56.628316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642db1f-a491-4764-ac1c-115db1dd8268 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:56.628590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642db1f-a491-4764-ac1c-115db1dd8268 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:56.629359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642db1f-a491-4764-ac1c-115db1dd8268 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:56.629666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642db1f-a491-4764-ac1c-115db1dd8268 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:56.631049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642db1f-a491-4764-ac1c-115db1dd8268 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:56.651455 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 267/523] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:56.652439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642db1f-a491-4764-ac1c-115db1dd8268 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:56.683820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:56.745919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc033d-c90f-4578-a84e-dd3a62e2fde4 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:56.762514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642db1f-a491-4764-ac1c-115db1dd8268 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:56.793130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd2dd5-c69f-40a6-be00-f7a801448835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:56.793776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd2dd5-c69f-40a6-be00-f7a801448835 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:56.794017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd2dd5-c69f-40a6-be00-f7a801448835 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:56.794287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd2dd5-c69f-40a6-be00-f7a801448835 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:56.794933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd2dd5-c69f-40a6-be00-f7a801448835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:56.795233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd2dd5-c69f-40a6-be00-f7a801448835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:56.796684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd2dd5-c69f-40a6-be00-f7a801448835 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:56.801019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3894a94-4788-4fbd-b666-33b2ddd55fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:56.801669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3894a94-4788-4fbd-b666-33b2ddd55fba None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:56.801946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3894a94-4788-4fbd-b666-33b2ddd55fba None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:56.802224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3894a94-4788-4fbd-b666-33b2ddd55fba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:56.814388 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 257/524] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:56.814388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd2dd5-c69f-40a6-be00-f7a801448835 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:56.818978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3894a94-4788-4fbd-b666-33b2ddd55fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:56.820554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3894a94-4788-4fbd-b666-33b2ddd55fba None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:56.837876 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e3894a94-4788-4fbd-b666-33b2ddd55fba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:56.837876 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:56.837876 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:56.837876 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:56.837876 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:56.837876 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:56.837876 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:56.837876 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:56.837876 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:56.837876 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:56.837876 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:56.837876 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:56.837876 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:03:56.837876 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:03:56.837876 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:03:56.837876 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:03:56.839022 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:56.839022 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:56.839022 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:56.839022 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:56.839022 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:56.839022 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:56.839022 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:56.839022 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:56.839022 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:56.839022 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:56.839022 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:56.839022 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:56.839022 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:56.839022 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:56.839022 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:56.839022 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:56.839022 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:03:56.840376 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:03:56.840376 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:56.840376 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:56.843781 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 268/525] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:56.844673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3894a94-4788-4fbd-b666-33b2ddd55fba None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:56.868133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:56.921124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd2dd5-c69f-40a6-be00-f7a801448835 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:56.923582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:56.959191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88dfe7-cdf5-45f7-810f-def402e1fb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:56.960430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88dfe7-cdf5-45f7-810f-def402e1fb59 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:56.960853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88dfe7-cdf5-45f7-810f-def402e1fb59 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:56.961288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88dfe7-cdf5-45f7-810f-def402e1fb59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:56.969241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3894a94-4788-4fbd-b666-33b2ddd55fba None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:57.004932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516346cf-1f36-448c-b001-0b4f542c7f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:57.005566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516346cf-1f36-448c-b001-0b4f542c7f32 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:57.005847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516346cf-1f36-448c-b001-0b4f542c7f32 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:57.006120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516346cf-1f36-448c-b001-0b4f542c7f32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:57.015103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516346cf-1f36-448c-b001-0b4f542c7f32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:57.016622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516346cf-1f36-448c-b001-0b4f542c7f32 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:57.029617 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-516346cf-1f36-448c-b001-0b4f542c7f32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:03:57.029617 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:57.029617 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:57.029617 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:57.029617 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:57.029617 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:57.029617 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:57.029617 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:57.029617 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:57.029617 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:57.029617 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:57.029617 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:57.029617 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:03:57.029617 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:03:57.029617 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:03:57.030642 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:03:57.030642 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:57.030642 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:57.030642 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:57.030642 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:57.030642 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:57.030642 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:57.030642 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:57.030642 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:57.030642 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:57.030642 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:57.030642 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:57.030642 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:57.030642 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:57.030642 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:57.030642 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:57.030642 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:57.031528 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:03:57.031528 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:03:57.031528 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:03:57.031528 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:03:57.031528 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:03:57.031528 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:03:57.031528 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:03:57.031528 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:57.031528 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 269/526] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:03:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:57.031528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516346cf-1f36-448c-b001-0b4f542c7f32 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:57.042053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88dfe7-cdf5-45f7-810f-def402e1fb59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:57.044219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88dfe7-cdf5-45f7-810f-def402e1fb59 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:57.124865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:57.155598 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 258/527] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:03:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:03:57.155799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516346cf-1f36-448c-b001-0b4f542c7f32 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:57.156792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88dfe7-cdf5-45f7-810f-def402e1fb59 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:57.162462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:57.199713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8599c6e-1671-40e5-9052-725198a43090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:57.200255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8599c6e-1671-40e5-9052-725198a43090 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:57.200533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8599c6e-1671-40e5-9052-725198a43090 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:57.200780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8599c6e-1671-40e5-9052-725198a43090 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:57.208144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8599c6e-1671-40e5-9052-725198a43090 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:57.211296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8599c6e-1671-40e5-9052-725198a43090 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:57.223117 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e8599c6e-1671-40e5-9052-725198a43090 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:03:57.223117 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:57.223117 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:57.223117 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:57.223117 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:57.223117 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:57.223117 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:57.223117 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:57.223117 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:57.223117 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:57.223117 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:57.223117 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:57.223117 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:03:57.223117 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:03:57.223117 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:03:57.224218 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:03:57.224218 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:57.224218 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:57.224218 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:57.224218 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:57.224218 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:57.224218 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:57.224218 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:57.224218 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:57.224218 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:57.224218 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:57.224218 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:57.224218 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:57.224218 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:57.224218 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:57.224218 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:57.224218 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:57.225074 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:03:57.225074 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:03:57.225074 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:03:57.225074 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:03:57.225074 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:03:57.225074 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:03:57.225074 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:03:57.225074 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:57.225074 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 270/528] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:03:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:57.225074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8599c6e-1671-40e5-9052-725198a43090 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:57.274381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88dfe7-cdf5-45f7-810f-def402e1fb59 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:57.311885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33770f74-fe0d-42c6-b231-d6ecd1f6da1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:57.312758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33770f74-fe0d-42c6-b231-d6ecd1f6da1f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:57.313040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33770f74-fe0d-42c6-b231-d6ecd1f6da1f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:57.313313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33770f74-fe0d-42c6-b231-d6ecd1f6da1f None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:57.313967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33770f74-fe0d-42c6-b231-d6ecd1f6da1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:57.314268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33770f74-fe0d-42c6-b231-d6ecd1f6da1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:57.315681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33770f74-fe0d-42c6-b231-d6ecd1f6da1f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:57.333072 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 259/529] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:57.333072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33770f74-fe0d-42c6-b231-d6ecd1f6da1f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:57.348697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8599c6e-1671-40e5-9052-725198a43090 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:57.386999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdb1fc-4bf4-4c0e-983a-fd1e29bda9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:57.386999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdb1fc-4bf4-4c0e-983a-fd1e29bda9bd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:57.387643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdb1fc-4bf4-4c0e-983a-fd1e29bda9bd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:57.387856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdb1fc-4bf4-4c0e-983a-fd1e29bda9bd None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:57.388485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdb1fc-4bf4-4c0e-983a-fd1e29bda9bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:57.388788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdb1fc-4bf4-4c0e-983a-fd1e29bda9bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:57.390236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdb1fc-4bf4-4c0e-983a-fd1e29bda9bd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:57.397655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:57.406873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:57.418147 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 271/530] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:03:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:57.418956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdb1fc-4bf4-4c0e-983a-fd1e29bda9bd None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:57.453845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33770f74-fe0d-42c6-b231-d6ecd1f6da1f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:57.495818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4608dd-94bf-4bb9-9bd8-fa725d6abe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:57.496510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4608dd-94bf-4bb9-9bd8-fa725d6abe8b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:57.496802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4608dd-94bf-4bb9-9bd8-fa725d6abe8b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:57.497079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4608dd-94bf-4bb9-9bd8-fa725d6abe8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:57.508592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4608dd-94bf-4bb9-9bd8-fa725d6abe8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:57.510419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4608dd-94bf-4bb9-9bd8-fa725d6abe8b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:57.525286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-4d4608dd-94bf-4bb9-9bd8-fa725d6abe8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:57.525286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:57.525286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:57.525286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:57.525286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:57.525286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:57.525286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:57.525286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:57.525286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:57.525286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:57.525286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:57.525286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:57.525286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:03:57.525286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:03:57.525286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:03:57.525286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:03:57.526194 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:57.526194 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:57.526194 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:57.526194 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:57.526194 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:57.526194 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:57.526194 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:57.526194 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:57.526194 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:57.526194 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:57.526194 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:57.526194 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:57.526194 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:57.526194 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:57.526194 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:57.526194 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:57.526194 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:03:57.527041 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:03:57.527041 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:57.527041 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:57.527041 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 260/531] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:57.527300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4608dd-94bf-4bb9-9bd8-fa725d6abe8b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:57.548529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdb1fc-4bf4-4c0e-983a-fd1e29bda9bd None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:57.587982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e78896-6fb3-44b5-b3f4-7aa981c8f8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:57.588590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e78896-6fb3-44b5-b3f4-7aa981c8f8f3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:57.588869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e78896-6fb3-44b5-b3f4-7aa981c8f8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:57.589142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e78896-6fb3-44b5-b3f4-7aa981c8f8f3 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:57.589895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e78896-6fb3-44b5-b3f4-7aa981c8f8f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:57.590201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e78896-6fb3-44b5-b3f4-7aa981c8f8f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:57.591677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e78896-6fb3-44b5-b3f4-7aa981c8f8f3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:57.608556 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 272/532] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:03:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:57.608556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e78896-6fb3-44b5-b3f4-7aa981c8f8f3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:57.658511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4608dd-94bf-4bb9-9bd8-fa725d6abe8b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:57.667159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:57.679104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:57.699135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75e7c2-d568-4d68-b6a7-a9a2185ccc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:57.699845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75e7c2-d568-4d68-b6a7-a9a2185ccc48 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:57.700128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75e7c2-d568-4d68-b6a7-a9a2185ccc48 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:57.700714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75e7c2-d568-4d68-b6a7-a9a2185ccc48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:57.707646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75e7c2-d568-4d68-b6a7-a9a2185ccc48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:57.709035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75e7c2-d568-4d68-b6a7-a9a2185ccc48 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:57.713472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e78896-6fb3-44b5-b3f4-7aa981c8f8f3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:57.721798 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-0e75e7c2-d568-4d68-b6a7-a9a2185ccc48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:03:57.721798 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:57.721798 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:57.721798 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:57.721798 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:57.721798 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:57.721798 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:57.721798 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:57.721798 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:57.721798 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:57.721798 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:57.721798 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:57.721798 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:03:57.721798 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:03:57.721798 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:03:57.722661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:03:57.722661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:57.722661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:57.722661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:57.722661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:57.722661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:57.722661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:57.722661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:57.722661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:57.722661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:57.722661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:57.722661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:57.722661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:57.722661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:57.722661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:57.722661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:57.722661 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:57.723913 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:03:57.723913 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:03:57.723913 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:03:57.723913 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:03:57.723913 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:03:57.723913 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:03:57.723913 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:03:57.723913 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:03:57.723913 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 261/533] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:03:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:57.724392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75e7c2-d568-4d68-b6a7-a9a2185ccc48 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:57.758205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25effd4e-5262-42ed-b98d-c5f1662792c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:57.758801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25effd4e-5262-42ed-b98d-c5f1662792c4 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:57.759075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25effd4e-5262-42ed-b98d-c5f1662792c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:57.759683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25effd4e-5262-42ed-b98d-c5f1662792c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:57.760414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25effd4e-5262-42ed-b98d-c5f1662792c4 None admin] RBAC: Adding query filter params (role.id=1e0740decc23460f8c3d0f7007f2d97f, scope.project.id=651b8653291a414fba3805312708ce48, user.id=cfed720323bd42329feb7574963f744a) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:57.760722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25effd4e-5262-42ed-b98d-c5f1662792c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:57.762490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25effd4e-5262-42ed-b98d-c5f1662792c4 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:57.768162 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 273/534] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:03:57 2022] GET /identity/v3/role_assignments?user.id=cfed720323bd42329feb7574963f744a&scope.project.id=651b8653291a414fba3805312708ce48&role.id=1e0740decc23460f8c3d0f7007f2d97f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:57.780337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25effd4e-5262-42ed-b98d-c5f1662792c4 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:57.849001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75e7c2-d568-4d68-b6a7-a9a2185ccc48 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:57.888751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408b09d-a38b-49d8-89a4-f3b3be428bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:57.889324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408b09d-a38b-49d8-89a4-f3b3be428bcf None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:57.889672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408b09d-a38b-49d8-89a4-f3b3be428bcf None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:57.890016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408b09d-a38b-49d8-89a4-f3b3be428bcf None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:57.890753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408b09d-a38b-49d8-89a4-f3b3be428bcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:57.891128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408b09d-a38b-49d8-89a4-f3b3be428bcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:57.892785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408b09d-a38b-49d8-89a4-f3b3be428bcf None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:57.911352 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 262/535] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:57.911352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408b09d-a38b-49d8-89a4-f3b3be428bcf None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:57.929446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25effd4e-5262-42ed-b98d-c5f1662792c4 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:57.951186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:57.959701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:57.974874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823b751-e500-45a5-bf97-ddfb9bdbedd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:57.976251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823b751-e500-45a5-bf97-ddfb9bdbedd5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:57.976781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823b751-e500-45a5-bf97-ddfb9bdbedd5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:57.978215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823b751-e500-45a5-bf97-ddfb9bdbedd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:57.979195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823b751-e500-45a5-bf97-ddfb9bdbedd5 None admin] RBAC: Adding query filter params (role.id=1e0740decc23460f8c3d0f7007f2d97f, scope.project.id=651b8653291a414fba3805312708ce48, user.id=faef473a2ab84661b09f3ba3dd977058) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:57.979694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823b751-e500-45a5-bf97-ddfb9bdbedd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:57.981686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823b751-e500-45a5-bf97-ddfb9bdbedd5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:57.988581 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 274/536] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:03:57 2022] GET /identity/v3/role_assignments?user.id=faef473a2ab84661b09f3ba3dd977058&scope.project.id=651b8653291a414fba3805312708ce48&role.id=1e0740decc23460f8c3d0f7007f2d97f => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:57.989688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823b751-e500-45a5-bf97-ddfb9bdbedd5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:58.025356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408b09d-a38b-49d8-89a4-f3b3be428bcf None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:58.062290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6a200-083b-4432-9762-1d4a278fefb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:58.062940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6a200-083b-4432-9762-1d4a278fefb8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:58.063284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6a200-083b-4432-9762-1d4a278fefb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:58.063651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6a200-083b-4432-9762-1d4a278fefb8 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:58.064492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6a200-083b-4432-9762-1d4a278fefb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:58.064858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6a200-083b-4432-9762-1d4a278fefb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:58.066425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6a200-083b-4432-9762-1d4a278fefb8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:58.086446 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 263/537] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:03:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:58.096490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6a200-083b-4432-9762-1d4a278fefb8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:58.110623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823b751-e500-45a5-bf97-ddfb9bdbedd5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:58.158698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c976945-6490-4fe3-842f-6579ae6a1cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:58.159749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c976945-6490-4fe3-842f-6579ae6a1cae None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:58.160033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c976945-6490-4fe3-842f-6579ae6a1cae None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:58.160308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c976945-6490-4fe3-842f-6579ae6a1cae None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:58.175174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c976945-6490-4fe3-842f-6579ae6a1cae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:58.176856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c976945-6490-4fe3-842f-6579ae6a1cae None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:58.196739 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-0c976945-6490-4fe3-842f-6579ae6a1cae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:03:58.196739 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:58.196739 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:58.196739 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:58.196739 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:58.196739 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:58.196739 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:58.196739 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:58.196739 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:58.196739 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:58.196739 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:58.196739 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:58.196739 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:03:58.196739 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:03:58.196739 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:03:58.197622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:03:58.197622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:58.197622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:58.197622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:58.197622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:58.197622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:58.197622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:58.197622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:58.197622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:58.197622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:58.197622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:58.197622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:58.197622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:58.197622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:58.197622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:58.197622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:58.197622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:58.198465 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:03:58.198465 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:03:58.198465 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:03:58.198465 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:03:58.198465 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:03:58.198465 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:03:58.198465 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:03:58.198465 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:58.204328 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 275/538] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:03:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:58.209636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c976945-6490-4fe3-842f-6579ae6a1cae None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:58.254029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:58.260661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6a200-083b-4432-9762-1d4a278fefb8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:58.296535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce986483-cecf-4e0c-a24d-3275df564069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:58.297381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce986483-cecf-4e0c-a24d-3275df564069 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:58.297897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce986483-cecf-4e0c-a24d-3275df564069 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:58.298307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce986483-cecf-4e0c-a24d-3275df564069 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:58.299175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce986483-cecf-4e0c-a24d-3275df564069 None admin] RBAC: Adding query filter params (role.id=1e0740decc23460f8c3d0f7007f2d97f, scope.project.id=651b8653291a414fba3805312708ce48, user.id=0b58ca64493247c188c4c77ad75e426a) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:58.299635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce986483-cecf-4e0c-a24d-3275df564069 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:58.301241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce986483-cecf-4e0c-a24d-3275df564069 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:58.303748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:58.312224 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 264/539] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:03:58 2022] GET /identity/v3/role_assignments?user.id=0b58ca64493247c188c4c77ad75e426a&scope.project.id=651b8653291a414fba3805312708ce48&role.id=1e0740decc23460f8c3d0f7007f2d97f => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:58.347548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c976945-6490-4fe3-842f-6579ae6a1cae None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:58.395019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976b679-be21-423b-9efd-38b565feadbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:58.395824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976b679-be21-423b-9efd-38b565feadbe None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:58.396202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976b679-be21-423b-9efd-38b565feadbe None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:58.396587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976b679-be21-423b-9efd-38b565feadbe None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:58.397396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976b679-be21-423b-9efd-38b565feadbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:58.397799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976b679-be21-423b-9efd-38b565feadbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:58.399425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976b679-be21-423b-9efd-38b565feadbe None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:58.420386 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 276/540] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:03:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:03:58.423870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce986483-cecf-4e0c-a24d-3275df564069 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:58.465095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a1a61-a9cb-4186-b158-2974f82b210a None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:58.465381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a1a61-a9cb-4186-b158-2974f82b210a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:58.465744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a1a61-a9cb-4186-b158-2974f82b210a None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:58.468847 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 277/541] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:03:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:03:58.473858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cf02c-a2e9-4517-b1af-af146858c100 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:58.474140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cf02c-a2e9-4517-b1af-af146858c100 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:58.474419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cf02c-a2e9-4517-b1af-af146858c100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:58.497080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d34cf02c-a2e9-4517-b1af-af146858c100 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:03:58.498355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d34cf02c-a2e9-4517-b1af-af146858c100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:03:58.592217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce986483-cecf-4e0c-a24d-3275df564069 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:58.637301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e052a-a3d1-4f18-baea-f5b73ea5e3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:58.637924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e052a-a3d1-4f18-baea-f5b73ea5e3f9 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:58.638204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e052a-a3d1-4f18-baea-f5b73ea5e3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:58.640026 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 278/542] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:03:58.640134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e052a-a3d1-4f18-baea-f5b73ea5e3f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:58.640581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e052a-a3d1-4f18-baea-f5b73ea5e3f9 None admin] RBAC: Adding query filter params (role.id=1e0740decc23460f8c3d0f7007f2d97f, scope.project.id=651b8653291a414fba3805312708ce48, user.id=6b06f9395d5841b9aa28227d532964eb) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:58.640895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e052a-a3d1-4f18-baea-f5b73ea5e3f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:58.642393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e052a-a3d1-4f18-baea-f5b73ea5e3f9 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:58.648816 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 265/543] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:03:58 2022] GET /identity/v3/role_assignments?user.id=6b06f9395d5841b9aa28227d532964eb&scope.project.id=651b8653291a414fba3805312708ce48&role.id=1e0740decc23460f8c3d0f7007f2d97f => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:59.077066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cf02c-a2e9-4517-b1af-af146858c100 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:59.121773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:59.193145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cf02c-a2e9-4517-b1af-af146858c100 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:59.227455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ac400-8b41-4aad-b60d-3cd2a7e5287a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:59.228543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ac400-8b41-4aad-b60d-3cd2a7e5287a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:59.229008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ac400-8b41-4aad-b60d-3cd2a7e5287a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:59.229466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ac400-8b41-4aad-b60d-3cd2a7e5287a None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:59.240289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ac400-8b41-4aad-b60d-3cd2a7e5287a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:03:59.245360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-7a8ac400-8b41-4aad-b60d-3cd2a7e5287a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:03:59.245360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:59.245360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:59.245360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:59.245360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:59.245360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:59.245360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:59.245360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:59.245360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:59.245360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:59.245360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:59.245360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:59.245360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:03:59.245360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:03:59.245360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:03:59.245360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:03:59.246247 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:03:59.246247 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:03:59.246247 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:03:59.246247 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:03:59.246247 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:59.246247 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:59.246247 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:59.246247 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:59.246247 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:59.246247 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:59.246247 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:59.246247 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:59.246247 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:59.246247 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:59.246247 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:59.246247 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:59.247016 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:59.247016 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:59.247016 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:59.247016 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:59.247016 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:03:59.247016 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:03:59.247016 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:03:59.247016 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:03:59.247016 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:03:59.247016 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:03:59.247016 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:03:59.247016 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:59.250354 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 279/544] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:03:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:59.255461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e052a-a3d1-4f18-baea-f5b73ea5e3f9 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:59.305923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:59.412017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e052a-a3d1-4f18-baea-f5b73ea5e3f9 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:59.455609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c20d64-3e48-4ba2-af9c-907b931539af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:59.456224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c20d64-3e48-4ba2-af9c-907b931539af None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:59.456502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c20d64-3e48-4ba2-af9c-907b931539af None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:59.456775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c20d64-3e48-4ba2-af9c-907b931539af None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:59.457453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c20d64-3e48-4ba2-af9c-907b931539af None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:59.457757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c20d64-3e48-4ba2-af9c-907b931539af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:59.459134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c20d64-3e48-4ba2-af9c-907b931539af None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:59.470926 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 266/545] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:03:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:59.476186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ac400-8b41-4aad-b60d-3cd2a7e5287a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:59.631571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:59.639936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ac400-8b41-4aad-b60d-3cd2a7e5287a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:59.700701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d47f0-24b5-45b6-8ae0-d7db69439187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:59.701266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d47f0-24b5-45b6-8ae0-d7db69439187 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:59.701545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d47f0-24b5-45b6-8ae0-d7db69439187 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:59.701861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d47f0-24b5-45b6-8ae0-d7db69439187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:59.714947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d47f0-24b5-45b6-8ae0-d7db69439187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:59.716451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d47f0-24b5-45b6-8ae0-d7db69439187 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:59.735020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-7d0d47f0-24b5-45b6-8ae0-d7db69439187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:59.735020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:03:59.735020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:03:59.735020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:03:59.735020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:03:59.735020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:03:59.735020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:03:59.735020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:03:59.735020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:03:59.735020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:03:59.735020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:03:59.735020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:03:59.735020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:03:59.735020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:03:59.735020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:03:59.735020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:03:59.736186 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:03:59.736186 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:03:59.736186 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:03:59.736186 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:03:59.736186 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:03:59.736186 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:03:59.736186 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:03:59.736186 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:03:59.736186 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:03:59.736186 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:03:59.736186 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:03:59.736186 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:03:59.736186 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:03:59.736186 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:03:59.736186 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:03:59.736186 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:03:59.736186 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:03:59.737228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:03:59.737228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:03:59.737228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:03:59.737228 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 280/546] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:03:59.743294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c20d64-3e48-4ba2-af9c-907b931539af None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:03:59.853570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:03:59.871593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c20d64-3e48-4ba2-af9c-907b931539af None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:03:59.906279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ed109-e8d7-46ee-b4b3-cb734d913cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:03:59.906901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ed109-e8d7-46ee-b4b3-cb734d913cac None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:03:59.907234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ed109-e8d7-46ee-b4b3-cb734d913cac None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:03:59.907537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ed109-e8d7-46ee-b4b3-cb734d913cac None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:03:59.908199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ed109-e8d7-46ee-b4b3-cb734d913cac None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:03:59.908499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ed109-e8d7-46ee-b4b3-cb734d913cac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:03:59.909995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ed109-e8d7-46ee-b4b3-cb734d913cac None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:03:59.925796 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 267/547] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:03:59.931430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d47f0-24b5-45b6-8ae0-d7db69439187 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:00.060712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d47f0-24b5-45b6-8ae0-d7db69439187 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:00.108579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f32bc8-a35a-4732-9d14-d360afb90fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:00.109281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f32bc8-a35a-4732-9d14-d360afb90fab None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:00.109570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f32bc8-a35a-4732-9d14-d360afb90fab None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:00.109850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f32bc8-a35a-4732-9d14-d360afb90fab None admin] PATH_INFO: `/v3/users/swift` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:00.122719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f32bc8-a35a-4732-9d14-d360afb90fab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:00.124225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f32bc8-a35a-4732-9d14-d360afb90fab None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:00.137449 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-84f32bc8-a35a-4732-9d14-d360afb90fab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:04:00.137449 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:00.137449 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:00.137449 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:00.137449 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:00.137449 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:00.137449 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:00.137449 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:00.137449 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:00.137449 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:00.137449 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:00.137449 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:00.137449 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:00.137449 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:00.137449 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:00.137449 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:00.139064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:00.140401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:00.140401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:00.140401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:00.140401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:00.140401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:00.140401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:00.140401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:00.140401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:00.140401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:04:00.140401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:00.140401 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 281/548] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:03:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:00.144865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ed109-e8d7-46ee-b4b3-cb734d913cac None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:00.222207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03ad54-2213-44a6-be6b-384e85b07374 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:00.222552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03ad54-2213-44a6-be6b-384e85b07374 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:00.222840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03ad54-2213-44a6-be6b-384e85b07374 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:00.224579 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 282/549] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:00.237460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ebf7e-2443-4341-acf9-f49c24762e8a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:00.237786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ebf7e-2443-4341-acf9-f49c24762e8a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:00.238118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ebf7e-2443-4341-acf9-f49c24762e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:00.258865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:00.272267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1b0ebf7e-2443-4341-acf9-f49c24762e8a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:00.273538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b0ebf7e-2443-4341-acf9-f49c24762e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:00.289323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ed109-e8d7-46ee-b4b3-cb734d913cac None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:00.338705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac7c3-454d-4b14-b8c4-d3b7e664b996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:00.339362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac7c3-454d-4b14-b8c4-d3b7e664b996 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:00.339647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac7c3-454d-4b14-b8c4-d3b7e664b996 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:00.339977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac7c3-454d-4b14-b8c4-d3b7e664b996 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:00.340719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ac7c3-454d-4b14-b8c4-d3b7e664b996 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:00.341026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ac7c3-454d-4b14-b8c4-d3b7e664b996 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:00.342470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ac7c3-454d-4b14-b8c4-d3b7e664b996 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:00.377069 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 268/550] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 28 18:04:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:00.383029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac7c3-454d-4b14-b8c4-d3b7e664b996 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:00.389372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:00.410957 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 283/551] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:04:00.486674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e583f-40e6-4ee9-a33f-66f72d96c7b3 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:00.487000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e583f-40e6-4ee9-a33f-66f72d96c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:00.487241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e583f-40e6-4ee9-a33f-66f72d96c7b3 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:00.488873 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 284/552] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:04:00.496424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3d495-b3a8-4fe7-b6d0-f2e504203314 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:00.496687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3d495-b3a8-4fe7-b6d0-f2e504203314 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:00.496969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3d495-b3a8-4fe7-b6d0-f2e504203314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:00.528235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-47d3d495-b3a8-4fe7-b6d0-f2e504203314 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:00.530916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-47d3d495-b3a8-4fe7-b6d0-f2e504203314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:00.549651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac7c3-454d-4b14-b8c4-d3b7e664b996 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:00.616724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44586c8a-8d3f-4509-bf96-bba0ede50b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:00.617257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44586c8a-8d3f-4509-bf96-bba0ede50b7b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:00.617530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44586c8a-8d3f-4509-bf96-bba0ede50b7b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:00.617796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44586c8a-8d3f-4509-bf96-bba0ede50b7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:00.666536 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 285/553] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:04:00.711925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44586c8a-8d3f-4509-bf96-bba0ede50b7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:00.713389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44586c8a-8d3f-4509-bf96-bba0ede50b7b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:00.716221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:00.739574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3d495-b3a8-4fe7-b6d0-f2e504203314 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:00.869715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:00.903459 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 269/554] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:04:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:04:00.905290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188bcfb-374e-4548-a5c0-bacb35aa6efd None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:00.905640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188bcfb-374e-4548-a5c0-bacb35aa6efd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:00.905986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188bcfb-374e-4548-a5c0-bacb35aa6efd None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:00.908973 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 270/555] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:00.910777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188bcfb-374e-4548-a5c0-bacb35aa6efd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:00.934140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3d495-b3a8-4fe7-b6d0-f2e504203314 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:00.984316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5583cb-73a2-4ae7-9366-7c860bbddd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:00.985273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5583cb-73a2-4ae7-9366-7c860bbddd6f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:00.985558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5583cb-73a2-4ae7-9366-7c860bbddd6f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:00.985834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5583cb-73a2-4ae7-9366-7c860bbddd6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:01.003514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5583cb-73a2-4ae7-9366-7c860bbddd6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:01.010374 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-fc5583cb-73a2-4ae7-9366-7c860bbddd6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:01.010374 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:01.010374 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:01.010374 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:01.010374 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:01.010374 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:01.010374 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:01.010374 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:01.010374 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:01.010374 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:01.010374 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:01.010374 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:01.010374 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:01.010374 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:01.010374 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:01.010374 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:01.011419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:01.011419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:01.011419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:01.011419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:01.011419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:01.011419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:01.011419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:01.011419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:01.011419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:01.011419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:01.011419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:01.011419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:01.011419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:01.011419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:01.011419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:01.011419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:01.012452 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:01.012452 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:01.012452 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:01.012452 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:01.012452 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:01.012452 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:01.012452 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:01.012452 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:01.012452 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:01.012452 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:01.012452 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:01.012452 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:01.012452 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 286/556] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:04:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:01.017982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77027dac-2d3d-452a-af39-000f6042e24c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:01.017982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77027dac-2d3d-452a-af39-000f6042e24c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:01.017982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77027dac-2d3d-452a-af39-000f6042e24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:01.034960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-77027dac-2d3d-452a-af39-000f6042e24c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:01.036195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77027dac-2d3d-452a-af39-000f6042e24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:01.038405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188bcfb-374e-4548-a5c0-bacb35aa6efd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:01.041916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:01.082225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3f3e0-ad60-46da-9343-5b4c1bd63364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:01.083104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3f3e0-ad60-46da-9343-5b4c1bd63364 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:01.083661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3f3e0-ad60-46da-9343-5b4c1bd63364 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:01.083944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3f3e0-ad60-46da-9343-5b4c1bd63364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:01.095295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3f3e0-ad60-46da-9343-5b4c1bd63364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:01.096767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3f3e0-ad60-46da-9343-5b4c1bd63364 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:01.112489 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-39b3f3e0-ad60-46da-9343-5b4c1bd63364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:01.112489 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:01.112489 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:01.112489 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:01.112489 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:01.112489 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:01.112489 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:01.112489 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:01.112489 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:01.112489 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:01.112489 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:01.112489 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:01.112489 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:01.112489 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:01.112489 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:01.112489 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:01.113555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:01.113555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:01.113555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:01.113555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:01.113555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:01.113555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:01.113555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:01.113555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:01.113555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:01.113555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:01.113555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:01.113555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:01.113555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:01.113555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:01.113555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:01.113555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:01.113555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:01.114425 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:01.114425 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:01.114425 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:01.114425 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 271/557] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:01.114425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3f3e0-ad60-46da-9343-5b4c1bd63364 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:01.133556 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 287/558] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:04:01.133556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77027dac-2d3d-452a-af39-000f6042e24c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:01.190763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:01.238503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3f3e0-ad60-46da-9343-5b4c1bd63364 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:01.241959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77027dac-2d3d-452a-af39-000f6042e24c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:01.273289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82351a7d-dc01-4aa2-bb2c-a0a4db4119b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:01.273899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82351a7d-dc01-4aa2-bb2c-a0a4db4119b7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:01.274178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82351a7d-dc01-4aa2-bb2c-a0a4db4119b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:01.274467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82351a7d-dc01-4aa2-bb2c-a0a4db4119b7 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:01.275190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82351a7d-dc01-4aa2-bb2c-a0a4db4119b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:01.275522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82351a7d-dc01-4aa2-bb2c-a0a4db4119b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:01.277081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82351a7d-dc01-4aa2-bb2c-a0a4db4119b7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:01.285587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b001cc8-1189-40cd-a96e-bc2b15c2d0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:01.286464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b001cc8-1189-40cd-a96e-bc2b15c2d0c7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:01.286956 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 272/559] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:04:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:01.287484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b001cc8-1189-40cd-a96e-bc2b15c2d0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:01.287635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82351a7d-dc01-4aa2-bb2c-a0a4db4119b7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:01.288082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b001cc8-1189-40cd-a96e-bc2b15c2d0c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:01.301334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b001cc8-1189-40cd-a96e-bc2b15c2d0c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:01.306378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-6b001cc8-1189-40cd-a96e-bc2b15c2d0c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:01.306378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:01.306378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:01.306378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:01.306378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:01.306378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:01.306378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:01.306378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:01.306378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:01.306378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:01.306378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:01.306378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:01.306378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:01.306378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:01.306378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:01.306378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:01.307297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:01.307297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:01.307297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:01.307297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:01.307297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:01.307297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:01.307297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:01.307297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:01.307297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:01.307297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:01.307297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:01.307297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:01.307297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:01.307297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:01.307297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:01.307297 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:01.308224 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:01.308224 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:01.308224 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:01.308224 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:01.308224 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:01.308224 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:01.308224 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:01.308224 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:01.308224 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:01.308224 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:01.308224 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:01.308224 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:01.312659 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 288/560] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:04:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:01.312971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:01.313845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31e5cb-b30e-433f-ae92-81854713b145 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:01.314128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31e5cb-b30e-433f-ae92-81854713b145 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:01.314406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31e5cb-b30e-433f-ae92-81854713b145 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:01.315733 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 289/561] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:01.316425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31e5cb-b30e-433f-ae92-81854713b145 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:01.405820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82351a7d-dc01-4aa2-bb2c-a0a4db4119b7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:01.424679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31e5cb-b30e-433f-ae92-81854713b145 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:01.438920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bada9-9587-47d7-9d18-3d825dfc285d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:01.439555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bada9-9587-47d7-9d18-3d825dfc285d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:01.439827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bada9-9587-47d7-9d18-3d825dfc285d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:01.440095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bada9-9587-47d7-9d18-3d825dfc285d None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:01.440734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bada9-9587-47d7-9d18-3d825dfc285d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:01.441035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bada9-9587-47d7-9d18-3d825dfc285d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:01.441153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:01.442586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bada9-9587-47d7-9d18-3d825dfc285d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:01.456118 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 273/562] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:01.456946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bada9-9587-47d7-9d18-3d825dfc285d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:01.459813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb089e-0501-499a-96b2-d0466ce64efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:01.460452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb089e-0501-499a-96b2-d0466ce64efb None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:01.460789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb089e-0501-499a-96b2-d0466ce64efb None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:01.461063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb089e-0501-499a-96b2-d0466ce64efb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:01.471620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb089e-0501-499a-96b2-d0466ce64efb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:01.473083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb089e-0501-499a-96b2-d0466ce64efb None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:01.487903 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-92fb089e-0501-499a-96b2-d0466ce64efb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:01.487903 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:01.487903 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:01.487903 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:01.487903 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:01.487903 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:01.487903 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:01.487903 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:01.487903 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:01.487903 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:01.487903 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:01.487903 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:01.487903 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:01.487903 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:01.487903 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:01.487903 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:01.488998 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:01.488998 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:01.488998 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:01.488998 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:01.488998 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:01.488998 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:01.488998 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:01.488998 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:01.488998 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:01.488998 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:01.488998 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:01.488998 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:01.488998 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:01.488998 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:01.488998 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:01.488998 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:01.488998 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:01.489880 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:01.489880 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:01.489880 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:01.489880 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 290/563] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:01.490141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c5df-27d0-4512-8267-4e1787477c23 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:01.490419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c5df-27d0-4512-8267-4e1787477c23 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:01.490698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c5df-27d0-4512-8267-4e1787477c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:01.508131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-80f9c5df-27d0-4512-8267-4e1787477c23 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:01.509626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80f9c5df-27d0-4512-8267-4e1787477c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:01.540659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:01.568314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bada9-9587-47d7-9d18-3d825dfc285d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:01.578376 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 291/564] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:04:01.579238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9c5df-27d0-4512-8267-4e1787477c23 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:01.605849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4aac9-fc90-483d-b9c8-f765c9128a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:01.606470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4aac9-fc90-483d-b9c8-f765c9128a52 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:01.606758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4aac9-fc90-483d-b9c8-f765c9128a52 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:01.607020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4aac9-fc90-483d-b9c8-f765c9128a52 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:01.607761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4aac9-fc90-483d-b9c8-f765c9128a52 None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:01.608065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4aac9-fc90-483d-b9c8-f765c9128a52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:01.609641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4aac9-fc90-483d-b9c8-f765c9128a52 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:01.618555 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 274/565] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:04:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:01.619415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4aac9-fc90-483d-b9c8-f765c9128a52 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:01.708204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:01.712700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9c5df-27d0-4512-8267-4e1787477c23 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:01.727043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4aac9-fc90-483d-b9c8-f765c9128a52 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:01.750194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97f6eb-7087-476c-a001-3456f944a2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:01.751508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97f6eb-7087-476c-a001-3456f944a2de None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:01.752134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97f6eb-7087-476c-a001-3456f944a2de None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:01.752438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97f6eb-7087-476c-a001-3456f944a2de None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:01.764333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802bde0-315a-4e37-bb55-03f93aaee32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:01.764970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802bde0-315a-4e37-bb55-03f93aaee32e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:01.765251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802bde0-315a-4e37-bb55-03f93aaee32e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:01.765545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802bde0-315a-4e37-bb55-03f93aaee32e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:01.766615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97f6eb-7087-476c-a001-3456f944a2de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:01.772413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802bde0-315a-4e37-bb55-03f93aaee32e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:01.772797 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-ff97f6eb-7087-476c-a001-3456f944a2de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:01.772797 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:01.772797 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:01.772797 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:01.772797 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:01.772797 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:01.772797 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:01.772797 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:01.772797 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:01.772797 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:01.772797 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:01.772797 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:01.772797 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:01.772797 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:01.772797 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:01.772797 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:01.773852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:01.773852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:01.773852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:01.773852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:01.773852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:01.773852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:01.773852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:01.773852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:01.773852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:01.773852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:01.773852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:01.773852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:01.773852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:01.773852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:01.773852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:01.773852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:01.774840 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:01.774840 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:01.774840 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:01.774840 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:01.774840 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:01.774840 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:01.774840 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:01.774840 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:01.774840 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:01.774840 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:01.774840 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:01.774840 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:01.775642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802bde0-315a-4e37-bb55-03f93aaee32e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:01.782594 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 292/566] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:04:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:01.782594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97f6eb-7087-476c-a001-3456f944a2de None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:01.782840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:01.790490 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-f802bde0-315a-4e37-bb55-03f93aaee32e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:01.790490 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:01.790490 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:01.790490 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:01.790490 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:01.790490 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:01.790490 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:01.790490 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:01.790490 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:01.790490 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:01.790490 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:01.790490 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:01.790490 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:01.790490 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:01.790490 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:01.791700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:01.791700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:01.791700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:01.791700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:01.791700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:01.791700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:01.791700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:01.791700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:01.791700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:01.791700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:01.791700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:01.791700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:01.791700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:01.791700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:01.791700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:01.791700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:01.791700 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:01.792820 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:01.792820 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:01.792820 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:01.792820 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:01.792820 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:01.792820 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:01.792820 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:01.792820 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:01.799051 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 275/567] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:01.799051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802bde0-315a-4e37-bb55-03f93aaee32e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:01.892957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97f6eb-7087-476c-a001-3456f944a2de None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:01.907828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802bde0-315a-4e37-bb55-03f93aaee32e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:01.929824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8b598-fab5-4e79-802c-747e9e737444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:01.930557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8b598-fab5-4e79-802c-747e9e737444 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:01.930841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8b598-fab5-4e79-802c-747e9e737444 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:01.931119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8b598-fab5-4e79-802c-747e9e737444 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:01.931797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8b598-fab5-4e79-802c-747e9e737444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:01.932096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8b598-fab5-4e79-802c-747e9e737444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:01.933567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8b598-fab5-4e79-802c-747e9e737444 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:01.945102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67c5f9-b273-4992-8a0d-32a3138a198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:01.945736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67c5f9-b273-4992-8a0d-32a3138a198d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:01.946014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67c5f9-b273-4992-8a0d-32a3138a198d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:01.946285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67c5f9-b273-4992-8a0d-32a3138a198d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:01.946512 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 293/568] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:01.947455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8b598-fab5-4e79-802c-747e9e737444 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:01.957640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67c5f9-b273-4992-8a0d-32a3138a198d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:01.959148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67c5f9-b273-4992-8a0d-32a3138a198d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:01.970070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:01.973779 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-bf67c5f9-b273-4992-8a0d-32a3138a198d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:01.973779 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:01.973779 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:01.973779 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:01.973779 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:01.973779 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:01.973779 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:01.973779 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:01.973779 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:01.973779 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:01.973779 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:01.973779 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:01.973779 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:01.973779 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:01.973779 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:01.973779 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:01.974935 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:01.974935 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:01.974935 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:01.974935 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:01.974935 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:01.974935 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:01.974935 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:01.974935 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:01.974935 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:01.974935 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:01.974935 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:01.974935 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:01.974935 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:01.974935 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:01.974935 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:01.974935 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:01.974935 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:01.976046 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:01.976046 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:01.976046 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:01.976046 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 276/569] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:01.976046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67c5f9-b273-4992-8a0d-32a3138a198d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:02.030975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:02.062167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8b598-fab5-4e79-802c-747e9e737444 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:02.082410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67c5f9-b273-4992-8a0d-32a3138a198d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:02.098182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009fedf-113d-4575-aa07-d9effec851a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:02.098796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009fedf-113d-4575-aa07-d9effec851a0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:02.099070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009fedf-113d-4575-aa07-d9effec851a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:02.099376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009fedf-113d-4575-aa07-d9effec851a0 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:02.100120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009fedf-113d-4575-aa07-d9effec851a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:02.100418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009fedf-113d-4575-aa07-d9effec851a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:02.101852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009fedf-113d-4575-aa07-d9effec851a0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:02.110193 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 294/570] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:04:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:02.111078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009fedf-113d-4575-aa07-d9effec851a0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:02.119209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787bc90-fde2-4f09-a88f-c09f84d2ae4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:02.119856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787bc90-fde2-4f09-a88f-c09f84d2ae4f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:02.120153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787bc90-fde2-4f09-a88f-c09f84d2ae4f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:02.120428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787bc90-fde2-4f09-a88f-c09f84d2ae4f None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:02.121203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787bc90-fde2-4f09-a88f-c09f84d2ae4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:02.121506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787bc90-fde2-4f09-a88f-c09f84d2ae4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:02.122937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787bc90-fde2-4f09-a88f-c09f84d2ae4f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:02.136381 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 277/571] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:02.137464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787bc90-fde2-4f09-a88f-c09f84d2ae4f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:02.206866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:02.223957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009fedf-113d-4575-aa07-d9effec851a0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:02.248495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787bc90-fde2-4f09-a88f-c09f84d2ae4f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:02.261757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc6b69-8a56-43d2-a34c-0cac2b793f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:02.262392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc6b69-8a56-43d2-a34c-0cac2b793f30 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:02.262665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc6b69-8a56-43d2-a34c-0cac2b793f30 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:02.262932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc6b69-8a56-43d2-a34c-0cac2b793f30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:02.263244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:02.278380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc6b69-8a56-43d2-a34c-0cac2b793f30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:02.283316 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-03fc6b69-8a56-43d2-a34c-0cac2b793f30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:02.283316 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:02.283316 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:02.283316 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:02.283316 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:02.283316 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:02.283316 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:02.283316 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:02.283316 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:02.283316 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:02.283316 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:02.283316 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:02.283316 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:02.283316 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:02.283316 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:02.283316 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:02.284263 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:02.284263 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:02.284263 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:02.284263 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:02.284263 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:02.284263 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:02.284263 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:02.284263 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:02.284263 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:02.284263 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:02.284263 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:02.284263 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:02.284263 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:02.284263 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:02.284263 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:02.284263 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:02.285082 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:02.285082 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:02.285082 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:02.285082 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:02.285082 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:02.285082 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:02.285082 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:02.285082 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:02.285082 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:02.285082 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:02.285082 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:02.285082 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:02.285082 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 295/572] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:04:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:02.285851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc6b69-8a56-43d2-a34c-0cac2b793f30 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:02.287572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca665719-2ebe-4de6-ab5d-bc4fbb7f7d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:02.288415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665719-2ebe-4de6-ab5d-bc4fbb7f7d5a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:02.288729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665719-2ebe-4de6-ab5d-bc4fbb7f7d5a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:02.289119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665719-2ebe-4de6-ab5d-bc4fbb7f7d5a None admin] PATH_INFO: `/v3/users/glance` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:02.298421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca665719-2ebe-4de6-ab5d-bc4fbb7f7d5a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:02.299947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca665719-2ebe-4de6-ab5d-bc4fbb7f7d5a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:02.313255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-ca665719-2ebe-4de6-ab5d-bc4fbb7f7d5a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 18:04:02.313255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:02.313255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:02.313255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:02.313255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:02.313255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:02.313255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:02.313255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:02.313255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:02.313255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:02.313255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:02.313255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:02.313255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:02.313255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:02.313255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:02.313255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:02.314710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:02.315824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:02.315824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:02.315824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:02.315824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:02.315824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:02.315824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:02.315824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:02.315824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:02.315824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 18:04:02.315824 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:02.315824 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 278/573] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:04:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:02.315824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca665719-2ebe-4de6-ab5d-bc4fbb7f7d5a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:02.416260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc6b69-8a56-43d2-a34c-0cac2b793f30 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:02.426328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca665719-2ebe-4de6-ab5d-bc4fbb7f7d5a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:02.451541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8984c3-00b0-4cd0-b090-285092796960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:02.452171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8984c3-00b0-4cd0-b090-285092796960 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:02.452447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8984c3-00b0-4cd0-b090-285092796960 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:02.452706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8984c3-00b0-4cd0-b090-285092796960 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:02.453346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8984c3-00b0-4cd0-b090-285092796960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:02.453654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8984c3-00b0-4cd0-b090-285092796960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:02.455018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8984c3-00b0-4cd0-b090-285092796960 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:02.460686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dd080-ef31-416a-a0a1-f1ce8f3c49f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:02.461327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dd080-ef31-416a-a0a1-f1ce8f3c49f3 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:02.461611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dd080-ef31-416a-a0a1-f1ce8f3c49f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:02.461890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dd080-ef31-416a-a0a1-f1ce8f3c49f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:02.464127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:02.468427 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 296/574] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:02.469240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8984c3-00b0-4cd0-b090-285092796960 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:02.474407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7dd080-ef31-416a-a0a1-f1ce8f3c49f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:02.475078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7dd080-ef31-416a-a0a1-f1ce8f3c49f3 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:02.491140 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-2d7dd080-ef31-416a-a0a1-f1ce8f3c49f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:02.491140 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:02.491140 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:02.491140 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:02.491140 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:02.491140 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:02.491140 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:02.491140 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:02.491140 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:02.491140 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:02.491140 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:02.491140 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:02.491140 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:02.491140 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:02.491140 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:02.491140 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:02.493032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:02.493032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:02.493032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:02.493032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:02.493032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:02.493032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:02.493032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:02.493032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:02.493032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:02.493032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:02.493032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:02.493032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:02.493032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:02.493032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:02.493032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:02.493032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:02.493032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:02.495063 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:02.495063 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:02.495063 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:02.497197 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 279/575] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:02.497854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dd080-ef31-416a-a0a1-f1ce8f3c49f3 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:02.524881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:02.596693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8984c3-00b0-4cd0-b090-285092796960 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:02.607649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dd080-ef31-416a-a0a1-f1ce8f3c49f3 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:02.633282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f01d0-ac9b-4586-b1ce-c2f1625a6465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:02.633975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f01d0-ac9b-4586-b1ce-c2f1625a6465 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:02.634634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f01d0-ac9b-4586-b1ce-c2f1625a6465 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:02.634976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f01d0-ac9b-4586-b1ce-c2f1625a6465 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:02.635806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f01d0-ac9b-4586-b1ce-c2f1625a6465 None admin] RBAC: Adding query filter params (role.id=1e0740decc23460f8c3d0f7007f2d97f, scope.project.id=651b8653291a414fba3805312708ce48, user.id=d55caefe410444509a1eee4262b76c80) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:02.636112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f01d0-ac9b-4586-b1ce-c2f1625a6465 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:02.637635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f01d0-ac9b-4586-b1ce-c2f1625a6465 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:02.642994 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 297/576] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:04:02 2022] GET /identity/v3/role_assignments?user.id=d55caefe410444509a1eee4262b76c80&scope.project.id=651b8653291a414fba3805312708ce48&role.id=1e0740decc23460f8c3d0f7007f2d97f => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:02.643913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f01d0-ac9b-4586-b1ce-c2f1625a6465 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:02.658271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39a644-e011-4670-934e-948d0ca32463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:02.660244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39a644-e011-4670-934e-948d0ca32463 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:02.660244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39a644-e011-4670-934e-948d0ca32463 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:02.660513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39a644-e011-4670-934e-948d0ca32463 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:02.661117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39a644-e011-4670-934e-948d0ca32463 None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:02.661418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39a644-e011-4670-934e-948d0ca32463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:02.662871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39a644-e011-4670-934e-948d0ca32463 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:02.676972 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 280/577] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:04:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:02.676972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39a644-e011-4670-934e-948d0ca32463 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:02.732590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:02.781331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f01d0-ac9b-4586-b1ce-c2f1625a6465 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:02.787457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:02.806708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39a644-e011-4670-934e-948d0ca32463 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:02.823630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6660455-b2d9-4d82-94b9-5336df329658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:02.824251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6660455-b2d9-4d82-94b9-5336df329658 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:02.824531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6660455-b2d9-4d82-94b9-5336df329658 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:02.824802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6660455-b2d9-4d82-94b9-5336df329658 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:02.825535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6660455-b2d9-4d82-94b9-5336df329658 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:02.825834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6660455-b2d9-4d82-94b9-5336df329658 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:02.827294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6660455-b2d9-4d82-94b9-5336df329658 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:02.846858 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 298/578] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 28 18:04:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:02.847760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6660455-b2d9-4d82-94b9-5336df329658 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:02.860021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b379c8-5c3c-49e1-a243-183d64343e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:02.860737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b379c8-5c3c-49e1-a243-183d64343e40 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:02.861066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b379c8-5c3c-49e1-a243-183d64343e40 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:02.861341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b379c8-5c3c-49e1-a243-183d64343e40 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:02.870201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b379c8-5c3c-49e1-a243-183d64343e40 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:02.871777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b379c8-5c3c-49e1-a243-183d64343e40 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:02.883290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-c2b379c8-5c3c-49e1-a243-183d64343e40 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:04:02.883290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:02.883290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:02.883290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:02.883290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:02.883290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:02.883290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:02.883290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:02.883290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:02.883290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:02.883290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:02.883290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:02.883290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:02.883290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:02.883290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:02.883290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:02.884787 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:02.885723 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:02.885723 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:02.885723 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:02.885723 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:02.885723 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:02.885723 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:02.885723 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:02.885723 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:02.885723 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:04:02.885723 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:02.885723 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 281/579] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 18:04:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:02.885723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b379c8-5c3c-49e1-a243-183d64343e40 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:02.965412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6660455-b2d9-4d82-94b9-5336df329658 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:02.991321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:03.001816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b379c8-5c3c-49e1-a243-183d64343e40 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:03.005761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02e939-13ac-46f2-9f35-2c4a1c7343e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:03.006464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02e939-13ac-46f2-9f35-2c4a1c7343e9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:03.006800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02e939-13ac-46f2-9f35-2c4a1c7343e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:03.007137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02e939-13ac-46f2-9f35-2c4a1c7343e9 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:03.007879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02e939-13ac-46f2-9f35-2c4a1c7343e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:03.008260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02e939-13ac-46f2-9f35-2c4a1c7343e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:03.010024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02e939-13ac-46f2-9f35-2c4a1c7343e9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:03.022473 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 299/580] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:03.023140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02e939-13ac-46f2-9f35-2c4a1c7343e9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:03.044416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17642f1-9450-4b4c-9c07-8d97d23849f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:03.045053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17642f1-9450-4b4c-9c07-8d97d23849f6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:03.045333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17642f1-9450-4b4c-9c07-8d97d23849f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:03.045608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17642f1-9450-4b4c-9c07-8d97d23849f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:03.056716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17642f1-9450-4b4c-9c07-8d97d23849f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:03.058178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17642f1-9450-4b4c-9c07-8d97d23849f6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:03.066187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:03.076814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-d17642f1-9450-4b4c-9c07-8d97d23849f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:03.076814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:03.076814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:03.076814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:03.076814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:03.076814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:03.076814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:03.076814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:03.076814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:03.076814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:03.076814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:03.076814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:03.076814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:03.076814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:03.076814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:03.076814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:03.078101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:03.078101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:03.078101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:03.078101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:03.078101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:03.078101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:03.078101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:03.078101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:03.078101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:03.078101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:03.078101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:03.078101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:03.078101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:03.078101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:03.078101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:03.078101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:03.078101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:03.079186 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:03.079186 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:03.079186 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:03.085908 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 282/581] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:03.088479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17642f1-9450-4b4c-9c07-8d97d23849f6 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:03.138857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02e939-13ac-46f2-9f35-2c4a1c7343e9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:03.178054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d598d9-5268-463b-9d19-582aa805cae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:03.178700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d598d9-5268-463b-9d19-582aa805cae5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:03.178974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d598d9-5268-463b-9d19-582aa805cae5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:03.179243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d598d9-5268-463b-9d19-582aa805cae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:03.190917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d598d9-5268-463b-9d19-582aa805cae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:03.192424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d598d9-5268-463b-9d19-582aa805cae5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:03.198833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17642f1-9450-4b4c-9c07-8d97d23849f6 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:03.207157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-40d598d9-5268-463b-9d19-582aa805cae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:03.207157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:03.207157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:03.207157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:03.207157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:03.207157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:03.207157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:03.207157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:03.207157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:03.207157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:03.207157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:03.207157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:03.207157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:03.207157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:03.207157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:03.207157 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:03.208705 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:03.208705 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:03.208705 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:03.208705 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:03.208705 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:03.208705 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:03.208705 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:03.208705 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:03.208705 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:03.208705 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:03.208705 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:03.208705 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:03.208705 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:03.208705 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:03.208705 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:03.208705 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:03.208705 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:03.210041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:03.210041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:03.210041 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:03.210041 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 300/582] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:03.210041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d598d9-5268-463b-9d19-582aa805cae5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:03.239235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea3bb2-ac41-425a-98b0-e3afef78c32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:03.239879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea3bb2-ac41-425a-98b0-e3afef78c32c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:03.240163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea3bb2-ac41-425a-98b0-e3afef78c32c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:03.240468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea3bb2-ac41-425a-98b0-e3afef78c32c None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:03.241216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea3bb2-ac41-425a-98b0-e3afef78c32c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:03.241578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea3bb2-ac41-425a-98b0-e3afef78c32c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:03.242969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea3bb2-ac41-425a-98b0-e3afef78c32c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:03.246872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:03.267345 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 283/583] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 18:04:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:03.267345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea3bb2-ac41-425a-98b0-e3afef78c32c None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:03.331707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:03.333548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d598d9-5268-463b-9d19-582aa805cae5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:03.371927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8091e-5c5b-43f7-94d6-4635a8b4bee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:03.372575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8091e-5c5b-43f7-94d6-4635a8b4bee0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:03.372894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8091e-5c5b-43f7-94d6-4635a8b4bee0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:03.373287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8091e-5c5b-43f7-94d6-4635a8b4bee0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:03.381461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8091e-5c5b-43f7-94d6-4635a8b4bee0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:03.382930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8091e-5c5b-43f7-94d6-4635a8b4bee0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:03.383922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea3bb2-ac41-425a-98b0-e3afef78c32c None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:03.396895 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f6e8091e-5c5b-43f7-94d6-4635a8b4bee0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 18:04:03.396895 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:03.396895 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:03.396895 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:03.396895 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:03.396895 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:03.396895 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:03.396895 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:03.396895 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:03.396895 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:03.396895 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:03.396895 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:03.396895 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:03.396895 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:03.396895 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:03.396895 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:03.397959 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:03.398901 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:03.398901 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:03.398901 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:03.398901 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:03.398901 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:03.398901 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:03.398901 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:03.398901 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:03.398901 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 18:04:03.398901 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:03.398901 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 301/584] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:04:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:03.398901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8091e-5c5b-43f7-94d6-4635a8b4bee0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:03.428827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75700583-d8b0-4b10-8483-a705d55f1fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:03.429447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75700583-d8b0-4b10-8483-a705d55f1fb2 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:03.429780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75700583-d8b0-4b10-8483-a705d55f1fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:03.430025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75700583-d8b0-4b10-8483-a705d55f1fb2 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:03.430673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75700583-d8b0-4b10-8483-a705d55f1fb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:03.430975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75700583-d8b0-4b10-8483-a705d55f1fb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:03.432496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75700583-d8b0-4b10-8483-a705d55f1fb2 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:03.453713 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 284/585] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:03.455516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75700583-d8b0-4b10-8483-a705d55f1fb2 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:03.522704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:03.532039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8091e-5c5b-43f7-94d6-4635a8b4bee0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:03.575906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954bced-bec7-4235-b5e8-7b1bf6495e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:03.576711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954bced-bec7-4235-b5e8-7b1bf6495e5f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:03.576891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954bced-bec7-4235-b5e8-7b1bf6495e5f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:03.577163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954bced-bec7-4235-b5e8-7b1bf6495e5f None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:03.577811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954bced-bec7-4235-b5e8-7b1bf6495e5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:03.578106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954bced-bec7-4235-b5e8-7b1bf6495e5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:03.579494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954bced-bec7-4235-b5e8-7b1bf6495e5f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:03.597090 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 302/586] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:03.597090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954bced-bec7-4235-b5e8-7b1bf6495e5f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:03.597352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75700583-d8b0-4b10-8483-a705d55f1fb2 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:03.614432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:03.636208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc079602-6212-4de3-87bd-be5dc0d45725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:03.636208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc079602-6212-4de3-87bd-be5dc0d45725 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:03.636208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc079602-6212-4de3-87bd-be5dc0d45725 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:03.636631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc079602-6212-4de3-87bd-be5dc0d45725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:03.648181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc079602-6212-4de3-87bd-be5dc0d45725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:03.649624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc079602-6212-4de3-87bd-be5dc0d45725 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:03.665259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-bc079602-6212-4de3-87bd-be5dc0d45725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:03.665259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:03.665259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:03.665259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:03.665259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:03.665259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:03.665259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:03.665259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:03.665259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:03.665259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:03.665259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:03.665259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:03.665259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:03.665259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:03.665259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:03.665259 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:03.666474 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:03.666474 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:03.666474 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:03.666474 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:03.666474 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:03.666474 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:03.666474 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:03.666474 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:03.666474 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:03.666474 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:03.666474 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:03.666474 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:03.666474 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:03.666474 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:03.666474 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:03.666474 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:03.666474 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:03.667762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:03.667762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:03.667762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:03.667762 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 285/587] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:03.667762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc079602-6212-4de3-87bd-be5dc0d45725 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:03.714902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954bced-bec7-4235-b5e8-7b1bf6495e5f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:03.763128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c214f70-56ad-4d5b-8e45-102e57987cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:03.764020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214f70-56ad-4d5b-8e45-102e57987cec None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:03.764462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214f70-56ad-4d5b-8e45-102e57987cec None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:03.765331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214f70-56ad-4d5b-8e45-102e57987cec None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:03.766225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c214f70-56ad-4d5b-8e45-102e57987cec None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:03.766668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c214f70-56ad-4d5b-8e45-102e57987cec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:03.768924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c214f70-56ad-4d5b-8e45-102e57987cec None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:03.791148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc079602-6212-4de3-87bd-be5dc0d45725 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:03.795149 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 303/588] 10.222.0.27 () {56 vars in 1139 bytes} [Sun Aug 28 18:04:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:03.796057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c214f70-56ad-4d5b-8e45-102e57987cec None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:03.811801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:03.842210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dce464-3113-40ad-ae0f-45313a5d364c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:03.842853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dce464-3113-40ad-ae0f-45313a5d364c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:03.843130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dce464-3113-40ad-ae0f-45313a5d364c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:03.843432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dce464-3113-40ad-ae0f-45313a5d364c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:03.852712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dce464-3113-40ad-ae0f-45313a5d364c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:03.854229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dce464-3113-40ad-ae0f-45313a5d364c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:03.865814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-34dce464-3113-40ad-ae0f-45313a5d364c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 18:04:03.865814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:03.865814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:03.865814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:03.865814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:03.865814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:03.865814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:03.865814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:03.865814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:03.865814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:03.865814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:03.865814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:03.865814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:03.865814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:03.865814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:03.865814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:03.866883 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:03.867923 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:03.867923 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:03.867923 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:03.867923 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:03.867923 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:03.867923 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:03.867923 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:03.867923 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:03.867923 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 18:04:03.867923 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:03.867923 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 286/589] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:04:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:03.867923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dce464-3113-40ad-ae0f-45313a5d364c None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:03.898827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:03.917562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c214f70-56ad-4d5b-8e45-102e57987cec None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:03.955498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a5306-1cbc-4f4c-8c91-fcf8849cdf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:03.956478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a5306-1cbc-4f4c-8c91-fcf8849cdf2b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:03.956996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a5306-1cbc-4f4c-8c91-fcf8849cdf2b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:03.957337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a5306-1cbc-4f4c-8c91-fcf8849cdf2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:03.964333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a5306-1cbc-4f4c-8c91-fcf8849cdf2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:03.965875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a5306-1cbc-4f4c-8c91-fcf8849cdf2b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:03.977314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-c17a5306-1cbc-4f4c-8c91-fcf8849cdf2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:03.977314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:03.977314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:03.977314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:03.977314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:03.977314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:03.977314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:03.977314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:03.977314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:03.977314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:03.977314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:03.977314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:03.977314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:03.977314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:03.977314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:03.978209 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:03.978209 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:03.978209 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:03.978209 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:03.978209 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:03.978209 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:03.978209 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:03.978209 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:03.978209 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:03.978209 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:03.978209 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:03.978209 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:03.978209 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:03.978209 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:03.978209 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:03.978209 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:03.978209 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:03.979098 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:03.979098 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:03.979098 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:03.979098 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:03.979098 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:03.979098 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:03.979098 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:03.979098 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:03.979571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dce464-3113-40ad-ae0f-45313a5d364c None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:03.979647 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 304/590] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:03.979647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a5306-1cbc-4f4c-8c91-fcf8849cdf2b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:04.017164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88694497-91fe-4b08-9be4-6ccab791bf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:04.017767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88694497-91fe-4b08-9be4-6ccab791bf39 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:04.018042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88694497-91fe-4b08-9be4-6ccab791bf39 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:04.018309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88694497-91fe-4b08-9be4-6ccab791bf39 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:04.018955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88694497-91fe-4b08-9be4-6ccab791bf39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:04.019283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88694497-91fe-4b08-9be4-6ccab791bf39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:04.020668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88694497-91fe-4b08-9be4-6ccab791bf39 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:04.034020 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 287/591] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:04.039005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88694497-91fe-4b08-9be4-6ccab791bf39 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:04.055347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:04.094022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a5306-1cbc-4f4c-8c91-fcf8849cdf2b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:04.132117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93081f5e-9fac-4e4a-83ca-18baf1833f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:04.133123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93081f5e-9fac-4e4a-83ca-18baf1833f36 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:04.133703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93081f5e-9fac-4e4a-83ca-18baf1833f36 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:04.134146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93081f5e-9fac-4e4a-83ca-18baf1833f36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:04.139906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:04.150275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93081f5e-9fac-4e4a-83ca-18baf1833f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:04.151822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93081f5e-9fac-4e4a-83ca-18baf1833f36 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:04.156293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88694497-91fe-4b08-9be4-6ccab791bf39 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:04.166021 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-93081f5e-9fac-4e4a-83ca-18baf1833f36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:04.166021 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:04.166021 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:04.166021 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:04.166021 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:04.166021 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:04.166021 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:04.166021 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:04.166021 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:04.166021 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:04.166021 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:04.166021 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:04.166021 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:04.166021 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:04.166021 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:04.166021 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:04.167163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:04.167163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:04.167163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:04.167163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:04.167163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:04.167163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:04.167163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:04.167163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:04.167163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:04.167163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:04.167163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:04.167163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:04.167163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:04.167163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:04.167163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:04.167163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:04.167163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:04.168653 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:04.168653 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:04.168653 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:04.171979 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 305/592] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:04.173412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93081f5e-9fac-4e4a-83ca-18baf1833f36 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:04.198324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a64227-5274-4a39-9701-6ef32969c9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:04.198599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a64227-5274-4a39-9701-6ef32969c9a6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:04.198851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a64227-5274-4a39-9701-6ef32969c9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:04.199716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a64227-5274-4a39-9701-6ef32969c9a6 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:04.199997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a64227-5274-4a39-9701-6ef32969c9a6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:04.200301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a64227-5274-4a39-9701-6ef32969c9a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:04.201729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a64227-5274-4a39-9701-6ef32969c9a6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:04.221596 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 288/593] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 28 18:04:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:04.222253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a64227-5274-4a39-9701-6ef32969c9a6 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:04.294645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93081f5e-9fac-4e4a-83ca-18baf1833f36 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:04.321894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:04.333064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e9d73-0165-45b9-b1ad-25d54f411811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:04.333674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e9d73-0165-45b9-b1ad-25d54f411811 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:04.333948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e9d73-0165-45b9-b1ad-25d54f411811 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:04.334216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e9d73-0165-45b9-b1ad-25d54f411811 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:04.334904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e9d73-0165-45b9-b1ad-25d54f411811 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:04.335204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e9d73-0165-45b9-b1ad-25d54f411811 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:04.336656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e9d73-0165-45b9-b1ad-25d54f411811 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:04.341838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a64227-5274-4a39-9701-6ef32969c9a6 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:04.353202 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 306/594] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:04.353202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e9d73-0165-45b9-b1ad-25d54f411811 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:04.386459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410b5f9-27aa-4edc-9e12-e61092577974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:04.387195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b5f9-27aa-4edc-9e12-e61092577974 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:04.387565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b5f9-27aa-4edc-9e12-e61092577974 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:04.387903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b5f9-27aa-4edc-9e12-e61092577974 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:04.395028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410b5f9-27aa-4edc-9e12-e61092577974 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:04.396598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410b5f9-27aa-4edc-9e12-e61092577974 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:04.408215 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-8410b5f9-27aa-4edc-9e12-e61092577974 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:04.408215 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:04.408215 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:04.408215 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:04.408215 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:04.408215 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:04.408215 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:04.408215 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:04.408215 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:04.408215 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:04.408215 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:04.408215 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:04.408215 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:04.408215 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:04.408215 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:04.409330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:04.409330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:04.409330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:04.409330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:04.409330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:04.409330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:04.409330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:04.409330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:04.409330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:04.409330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:04.409330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:04.409330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:04.409330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:04.409330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:04.409330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:04.409330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:04.409330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:04.410476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:04.410476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:04.410476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:04.410476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:04.410476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:04.410476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:04.410476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:04.410476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:04.411136 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 289/595] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:04.411923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410b5f9-27aa-4edc-9e12-e61092577974 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:04.420891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:04.465820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e9d73-0165-45b9-b1ad-25d54f411811 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:04.504603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd5638-5678-478c-9dda-56c7a0255f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:04.505231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd5638-5678-478c-9dda-56c7a0255f3e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:04.505504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd5638-5678-478c-9dda-56c7a0255f3e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:04.505773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd5638-5678-478c-9dda-56c7a0255f3e None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:04.506432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd5638-5678-478c-9dda-56c7a0255f3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:04.506727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd5638-5678-478c-9dda-56c7a0255f3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:04.508186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd5638-5678-478c-9dda-56c7a0255f3e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:04.520967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410b5f9-27aa-4edc-9e12-e61092577974 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:04.526704 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 307/596] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:04.526704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd5638-5678-478c-9dda-56c7a0255f3e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:04.560272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d6a9e-59fc-43bf-a9c7-5182f74f4d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:04.560920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d6a9e-59fc-43bf-a9c7-5182f74f4d9c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:04.561343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d6a9e-59fc-43bf-a9c7-5182f74f4d9c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:04.561558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d6a9e-59fc-43bf-a9c7-5182f74f4d9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:04.574530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d6a9e-59fc-43bf-a9c7-5182f74f4d9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:04.575978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d6a9e-59fc-43bf-a9c7-5182f74f4d9c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:04.576125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:04.591089 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-529d6a9e-59fc-43bf-a9c7-5182f74f4d9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:04.591089 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:04.591089 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:04.591089 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:04.591089 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:04.591089 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:04.591089 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:04.591089 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:04.591089 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:04.591089 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:04.591089 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:04.591089 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:04.591089 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:04.591089 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:04.591089 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:04.591089 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:04.592324 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:04.592324 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:04.592324 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:04.592324 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:04.592324 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:04.592324 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:04.592324 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:04.592324 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:04.592324 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:04.592324 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:04.592324 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:04.592324 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:04.592324 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:04.592324 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:04.592324 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:04.592324 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:04.592324 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:04.593302 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:04.593302 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:04.593302 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:04.593302 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 290/597] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:04.593529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d6a9e-59fc-43bf-a9c7-5182f74f4d9c None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:04.638669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd5638-5678-478c-9dda-56c7a0255f3e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:04.655590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:04.672761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109bee3-0aff-45f4-84f2-a293ae85307d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:04.673442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109bee3-0aff-45f4-84f2-a293ae85307d None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:04.673724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109bee3-0aff-45f4-84f2-a293ae85307d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:04.674008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109bee3-0aff-45f4-84f2-a293ae85307d None admin] PATH_INFO: `/v3/projects/651b8653291a414fba3805312708ce48/users/cfed720323bd42329feb7574963f744a/roles/1e0740decc23460f8c3d0f7007f2d97f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:04.691296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109bee3-0aff-45f4-84f2-a293ae85307d None admin] RBAC: Authorizing `identity:create_grant(project_id=651b8653291a414fba3805312708ce48, user_id=cfed720323bd42329feb7574963f744a, role_id=1e0740decc23460f8c3d0f7007f2d97f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:04.692783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109bee3-0aff-45f4-84f2-a293ae85307d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:04.697460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d6a9e-59fc-43bf-a9c7-5182f74f4d9c None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:04.707360 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 308/598] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:04:04 2022] PUT /identity/v3/projects/651b8653291a414fba3805312708ce48/users/cfed720323bd42329feb7574963f744a/roles/1e0740decc23460f8c3d0f7007f2d97f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:04:04.708105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109bee3-0aff-45f4-84f2-a293ae85307d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:04.744761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309715e6-6ae1-42a0-9d57-991e82b75748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:04.745391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309715e6-6ae1-42a0-9d57-991e82b75748 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:04.745722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309715e6-6ae1-42a0-9d57-991e82b75748 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:04.746082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309715e6-6ae1-42a0-9d57-991e82b75748 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:04.746791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309715e6-6ae1-42a0-9d57-991e82b75748 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:04.747101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309715e6-6ae1-42a0-9d57-991e82b75748 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:04.748704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309715e6-6ae1-42a0-9d57-991e82b75748 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:04.762404 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 291/599] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:04.768091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309715e6-6ae1-42a0-9d57-991e82b75748 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:04.839010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:04.848217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109bee3-0aff-45f4-84f2-a293ae85307d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:04.888555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e84c19-dc0d-4975-a22b-f0f60c673431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:04.889222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e84c19-dc0d-4975-a22b-f0f60c673431 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:04.889503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e84c19-dc0d-4975-a22b-f0f60c673431 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:04.889777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e84c19-dc0d-4975-a22b-f0f60c673431 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:04.897188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e84c19-dc0d-4975-a22b-f0f60c673431 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:04.898776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e84c19-dc0d-4975-a22b-f0f60c673431 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:04.901217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309715e6-6ae1-42a0-9d57-991e82b75748 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:04.910795 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a7e84c19-dc0d-4975-a22b-f0f60c673431 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:04.910795 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:04.910795 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:04.910795 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:04.910795 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:04.910795 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:04.910795 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:04.910795 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:04.910795 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:04.910795 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:04.910795 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:04.910795 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:04.910795 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:04.910795 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:04.910795 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:04.911953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:04.911953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:04.911953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:04.911953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:04.911953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:04.911953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:04.911953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:04.911953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:04.911953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:04.911953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:04.911953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:04.911953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:04.911953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:04.911953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:04.911953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:04.911953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:04.911953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:04.913028 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:04.913028 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:04.913028 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:04.913028 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:04.913028 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:04.913028 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:04.913028 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:04.913028 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:04.913710 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 309/600] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:04.915597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93368e-ce77-4ab0-a30b-e2ff1ca35706 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:04.915597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93368e-ce77-4ab0-a30b-e2ff1ca35706 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:04.915597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93368e-ce77-4ab0-a30b-e2ff1ca35706 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:04.916991 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 310/601] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:04.917704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93368e-ce77-4ab0-a30b-e2ff1ca35706 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:04.924637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:04.944057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15022859-148b-44f7-a216-be9845236c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:04.944687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15022859-148b-44f7-a216-be9845236c97 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:04.944944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15022859-148b-44f7-a216-be9845236c97 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:04.945220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15022859-148b-44f7-a216-be9845236c97 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:04.945871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15022859-148b-44f7-a216-be9845236c97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:04.946172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15022859-148b-44f7-a216-be9845236c97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:04.947989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15022859-148b-44f7-a216-be9845236c97 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:04.960057 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 292/602] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:04.960757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15022859-148b-44f7-a216-be9845236c97 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:05.038349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93368e-ce77-4ab0-a30b-e2ff1ca35706 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:05.068949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15022859-148b-44f7-a216-be9845236c97 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:05.080321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9825db3-fa67-405e-b4f7-1bcefa136dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:05.081199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9825db3-fa67-405e-b4f7-1bcefa136dda None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:05.081725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9825db3-fa67-405e-b4f7-1bcefa136dda None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:05.082040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9825db3-fa67-405e-b4f7-1bcefa136dda None admin] PATH_INFO: `/v3/projects/651b8653291a414fba3805312708ce48/users/faef473a2ab84661b09f3ba3dd977058/roles/1e0740decc23460f8c3d0f7007f2d97f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:05.098472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9825db3-fa67-405e-b4f7-1bcefa136dda None admin] RBAC: Authorizing `identity:create_grant(project_id=651b8653291a414fba3805312708ce48, user_id=faef473a2ab84661b09f3ba3dd977058, role_id=1e0740decc23460f8c3d0f7007f2d97f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:05.100018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9825db3-fa67-405e-b4f7-1bcefa136dda None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:05.104445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205b50e-772c-4c07-9dce-225d38d119d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:05.105178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205b50e-772c-4c07-9dce-225d38d119d2 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:05.105503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205b50e-772c-4c07-9dce-225d38d119d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:05.105891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205b50e-772c-4c07-9dce-225d38d119d2 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:05.106659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205b50e-772c-4c07-9dce-225d38d119d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:05.107010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205b50e-772c-4c07-9dce-225d38d119d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:05.108531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205b50e-772c-4c07-9dce-225d38d119d2 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:05.123346 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 311/603] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:04:04 2022] PUT /identity/v3/projects/651b8653291a414fba3805312708ce48/users/faef473a2ab84661b09f3ba3dd977058/roles/1e0740decc23460f8c3d0f7007f2d97f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:04:05.123346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7231d64-8db2-47ee-a91c-9e4ea95dd97e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:05.123346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7231d64-8db2-47ee-a91c-9e4ea95dd97e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:05.123346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7231d64-8db2-47ee-a91c-9e4ea95dd97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:05.129341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:05.137193 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 293/604] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:05.138706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205b50e-772c-4c07-9dce-225d38d119d2 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:05.144224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c7231d64-8db2-47ee-a91c-9e4ea95dd97e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:05.145599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c7231d64-8db2-47ee-a91c-9e4ea95dd97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:05.187948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:05.239002 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 312/605] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:04:05.240179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7231d64-8db2-47ee-a91c-9e4ea95dd97e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:05.272393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205b50e-772c-4c07-9dce-225d38d119d2 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:05.315325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dfed8-c2fa-40e7-a31f-48abc76742d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:05.315980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dfed8-c2fa-40e7-a31f-48abc76742d1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:05.316259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dfed8-c2fa-40e7-a31f-48abc76742d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:05.316531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dfed8-c2fa-40e7-a31f-48abc76742d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:05.325388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8dfed8-c2fa-40e7-a31f-48abc76742d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:05.327422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8dfed8-c2fa-40e7-a31f-48abc76742d1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:05.342710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-3f8dfed8-c2fa-40e7-a31f-48abc76742d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:05.342710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:05.342710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:05.342710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:05.342710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:05.342710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:05.342710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:05.342710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:05.342710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:05.342710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:05.342710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:05.342710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:05.342710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:05.342710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:05.342710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:05.344449 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:05.344449 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:05.344449 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:05.344449 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:05.344449 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:05.344449 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:05.344449 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:05.344449 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:05.344449 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:05.344449 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:05.344449 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:05.344449 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:05.344449 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:05.344449 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:05.344449 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:05.344449 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:05.344449 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:05.345555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:05.345555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:05.345555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:05.345555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:05.345555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:05.345555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:05.345555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:05.345555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:05.345555 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 294/606] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:05.353279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dfed8-c2fa-40e7-a31f-48abc76742d1 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:05.407171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7231d64-8db2-47ee-a91c-9e4ea95dd97e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:05.444133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2d52b-71c8-4928-8e1b-4fda3794871d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:05.445188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2d52b-71c8-4928-8e1b-4fda3794871d None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:05.445637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2d52b-71c8-4928-8e1b-4fda3794871d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:05.446129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2d52b-71c8-4928-8e1b-4fda3794871d None admin] PATH_INFO: `/v3/projects/651b8653291a414fba3805312708ce48/users/0b58ca64493247c188c4c77ad75e426a/roles/1e0740decc23460f8c3d0f7007f2d97f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:05.448868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:05.462539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2d52b-71c8-4928-8e1b-4fda3794871d None admin] RBAC: Authorizing `identity:create_grant(project_id=651b8653291a414fba3805312708ce48, user_id=0b58ca64493247c188c4c77ad75e426a, role_id=1e0740decc23460f8c3d0f7007f2d97f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:05.464507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2d52b-71c8-4928-8e1b-4fda3794871d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:05.465642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:05.470304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dfed8-c2fa-40e7-a31f-48abc76742d1 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:05.489635 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 313/607] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:04:05 2022] PUT /identity/v3/projects/651b8653291a414fba3805312708ce48/users/0b58ca64493247c188c4c77ad75e426a/roles/1e0740decc23460f8c3d0f7007f2d97f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:04:05.515093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98b0d6-819d-4c6f-abd4-c32e7ad03c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:05.515762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98b0d6-819d-4c6f-abd4-c32e7ad03c3a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:05.516041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98b0d6-819d-4c6f-abd4-c32e7ad03c3a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:05.516310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98b0d6-819d-4c6f-abd4-c32e7ad03c3a None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:05.517044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98b0d6-819d-4c6f-abd4-c32e7ad03c3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:05.517347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98b0d6-819d-4c6f-abd4-c32e7ad03c3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:05.518945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98b0d6-819d-4c6f-abd4-c32e7ad03c3a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:05.542353 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 295/608] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:05.548855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2d52b-71c8-4928-8e1b-4fda3794871d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:05.583055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98b0d6-819d-4c6f-abd4-c32e7ad03c3a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:05.727876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98b0d6-819d-4c6f-abd4-c32e7ad03c3a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:05.736044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2d52b-71c8-4928-8e1b-4fda3794871d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:05.764841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1df550-a2d0-499f-8028-f3f36d87e865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:05.765489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1df550-a2d0-499f-8028-f3f36d87e865 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:05.765763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1df550-a2d0-499f-8028-f3f36d87e865 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:05.766105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1df550-a2d0-499f-8028-f3f36d87e865 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:05.775220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbe57e-a7db-4b32-a31f-5074e27f8472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:05.776200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbe57e-a7db-4b32-a31f-5074e27f8472 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:05.776687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbe57e-a7db-4b32-a31f-5074e27f8472 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:05.777318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbe57e-a7db-4b32-a31f-5074e27f8472 None admin] PATH_INFO: `/v3/projects/651b8653291a414fba3805312708ce48/users/6b06f9395d5841b9aa28227d532964eb/roles/1e0740decc23460f8c3d0f7007f2d97f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:05.777431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1df550-a2d0-499f-8028-f3f36d87e865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:05.782118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-8a1df550-a2d0-499f-8028-f3f36d87e865 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:05.782118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:05.782118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:05.782118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:05.782118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:05.782118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:05.782118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:05.782118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:05.782118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:05.782118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:05.782118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:05.782118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:05.782118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:05.782118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:05.782118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:05.782118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:05.783082 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:05.783082 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:05.783082 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:05.783082 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:05.783082 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:05.783082 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:05.783082 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:05.783082 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:05.783082 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:05.783082 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:05.783082 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:05.783082 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:05.783082 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:05.783082 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:05.783082 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:05.783082 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:05.783940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:05.783940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:05.783940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:05.783940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:05.783940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:05.783940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:05.783940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:05.783940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:05.783940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:05.783940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:05.783940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:05.783940 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:05.787372 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 296/609] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:04:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:05.789461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1df550-a2d0-499f-8028-f3f36d87e865 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:05.798024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbe57e-a7db-4b32-a31f-5074e27f8472 None admin] RBAC: Authorizing `identity:create_grant(project_id=651b8653291a414fba3805312708ce48, user_id=6b06f9395d5841b9aa28227d532964eb, role_id=1e0740decc23460f8c3d0f7007f2d97f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:05.799959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbe57e-a7db-4b32-a31f-5074e27f8472 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:05.813168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:05.816242 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 314/610] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:04:05 2022] PUT /identity/v3/projects/651b8653291a414fba3805312708ce48/users/6b06f9395d5841b9aa28227d532964eb/roles/1e0740decc23460f8c3d0f7007f2d97f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:04:05.911348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1df550-a2d0-499f-8028-f3f36d87e865 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:05.963106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbc8bb-f1da-4b98-90ed-ec8de9852fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:05.963770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbc8bb-f1da-4b98-90ed-ec8de9852fb7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:05.964053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbc8bb-f1da-4b98-90ed-ec8de9852fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:05.964330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbc8bb-f1da-4b98-90ed-ec8de9852fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:05.965082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbc8bb-f1da-4b98-90ed-ec8de9852fb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:05.965386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbc8bb-f1da-4b98-90ed-ec8de9852fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:05.966752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbc8bb-f1da-4b98-90ed-ec8de9852fb7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:05.977733 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 297/611] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:04:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:05.983997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbe57e-a7db-4b32-a31f-5074e27f8472 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:06.021424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:06.095879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbe57e-a7db-4b32-a31f-5074e27f8472 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:06.135321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22ce1e-a12b-426f-8e07-713df3aca7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:06.136428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22ce1e-a12b-426f-8e07-713df3aca7de None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:06.136914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22ce1e-a12b-426f-8e07-713df3aca7de None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:06.137402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22ce1e-a12b-426f-8e07-713df3aca7de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:06.153459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c22ce1e-a12b-426f-8e07-713df3aca7de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:06.155679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c22ce1e-a12b-426f-8e07-713df3aca7de None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:06.173548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3c22ce1e-a12b-426f-8e07-713df3aca7de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:06.173548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:06.173548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:06.173548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:06.173548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:06.173548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:06.173548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:06.173548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:06.173548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:06.173548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:06.173548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:06.173548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:06.173548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:06.173548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:06.173548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:06.173548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:06.174523 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:06.174523 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:06.174523 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:06.174523 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:06.174523 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:06.174523 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:06.174523 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:06.174523 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:06.174523 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:06.174523 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:06.174523 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:06.174523 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:06.174523 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:06.174523 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:06.174523 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:06.174523 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:06.174523 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:06.175443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:06.175443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:06.175443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:06.177538 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 315/612] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:06.182908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbc8bb-f1da-4b98-90ed-ec8de9852fb7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:06.281817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:06.305873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbc8bb-f1da-4b98-90ed-ec8de9852fb7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:06.351182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff26a9-c1ff-4063-8358-e478093f4c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:06.352627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff26a9-c1ff-4063-8358-e478093f4c3e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:06.353145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff26a9-c1ff-4063-8358-e478093f4c3e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:06.353623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff26a9-c1ff-4063-8358-e478093f4c3e None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:06.354527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff26a9-c1ff-4063-8358-e478093f4c3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:06.355024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff26a9-c1ff-4063-8358-e478093f4c3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:06.356656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff26a9-c1ff-4063-8358-e478093f4c3e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:06.374824 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 298/613] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:06.380549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22ce1e-a12b-426f-8e07-713df3aca7de None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:06.504035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:06.529432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22ce1e-a12b-426f-8e07-713df3aca7de None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:06.594759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a146bc0-e7c1-4d10-a97f-3b225b92874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:06.595681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a146bc0-e7c1-4d10-a97f-3b225b92874f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:06.596100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a146bc0-e7c1-4d10-a97f-3b225b92874f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:06.596511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a146bc0-e7c1-4d10-a97f-3b225b92874f None admin] PATH_INFO: `/v3/users/swift` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:06.613483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a146bc0-e7c1-4d10-a97f-3b225b92874f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:06.615565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a146bc0-e7c1-4d10-a97f-3b225b92874f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:06.633990 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-1a146bc0-e7c1-4d10-a97f-3b225b92874f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:04:06.633990 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:06.633990 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:06.633990 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:06.633990 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:06.633990 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:06.633990 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:06.633990 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:06.633990 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:06.633990 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:06.633990 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:06.633990 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:06.633990 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:06.633990 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:06.633990 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:06.633990 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:06.635355 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:06.636271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:06.636271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:06.636271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:06.636271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:06.636271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:06.636271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:06.636271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:06.636271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:06.636271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:04:06.636271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:06.642092 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 316/614] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:04:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:06.643976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff26a9-c1ff-4063-8358-e478093f4c3e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:06.790804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff26a9-c1ff-4063-8358-e478093f4c3e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:06.834157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc0de9-8e9f-4bce-a232-06416176eed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:06.834773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc0de9-8e9f-4bce-a232-06416176eed2 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:06.835054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc0de9-8e9f-4bce-a232-06416176eed2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:06.835361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc0de9-8e9f-4bce-a232-06416176eed2 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:06.836144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc0de9-8e9f-4bce-a232-06416176eed2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:06.836453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc0de9-8e9f-4bce-a232-06416176eed2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:06.837901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc0de9-8e9f-4bce-a232-06416176eed2 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:06.849874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:06.862558 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 299/615] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 28 18:04:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:06.868163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a146bc0-e7c1-4d10-a97f-3b225b92874f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:07.000496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a146bc0-e7c1-4d10-a97f-3b225b92874f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:07.042801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9d282-d945-4eac-9301-eb9f0002b710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:07.043473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9d282-d945-4eac-9301-eb9f0002b710 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:07.043755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9d282-d945-4eac-9301-eb9f0002b710 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:07.044028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9d282-d945-4eac-9301-eb9f0002b710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:07.055501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9d282-d945-4eac-9301-eb9f0002b710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:07.056959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9d282-d945-4eac-9301-eb9f0002b710 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:07.076244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786f623-fc54-4b4f-a07c-4e6a941d4a30 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:07.076559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786f623-fc54-4b4f-a07c-4e6a941d4a30 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:07.076797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786f623-fc54-4b4f-a07c-4e6a941d4a30 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:07.078461 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 300/616] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:07.078811 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3cf9d282-d945-4eac-9301-eb9f0002b710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:07.078811 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:07.078811 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:07.078811 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:07.078811 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:07.078811 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:07.078811 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:07.078811 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:07.078811 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:07.078811 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:07.078811 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:07.078811 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:07.078811 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:07.078811 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:07.078811 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:07.078811 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:07.079716 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:07.079716 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:07.079716 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:07.079716 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:07.079716 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:07.079716 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:07.079716 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:07.079716 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:07.079716 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:07.079716 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:07.079716 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:07.079716 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:07.079716 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:07.079716 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:07.079716 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:07.079716 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:07.079716 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:07.080596 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:07.080596 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:07.080596 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:07.080596 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 317/617] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:07.080836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:07.088441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786f623-fc54-4b4f-a07c-4e6a941d4a30 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:07.091287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf68882-9cd0-4a60-bf61-77bed2da076e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:07.091577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf68882-9cd0-4a60-bf61-77bed2da076e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:07.091858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf68882-9cd0-4a60-bf61-77bed2da076e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:07.111874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fdf68882-9cd0-4a60-bf61-77bed2da076e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:07.113677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fdf68882-9cd0-4a60-bf61-77bed2da076e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:07.227136 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 318/618] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:04:07.262558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786f623-fc54-4b4f-a07c-4e6a941d4a30 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:07.304718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bb4ba-5807-4267-9ec5-f69026673660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:07.305384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bb4ba-5807-4267-9ec5-f69026673660 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:07.305726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bb4ba-5807-4267-9ec5-f69026673660 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:07.306055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bb4ba-5807-4267-9ec5-f69026673660 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:07.306714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bb4ba-5807-4267-9ec5-f69026673660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:07.307016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bb4ba-5807-4267-9ec5-f69026673660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:07.308617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bb4ba-5807-4267-9ec5-f69026673660 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:07.325059 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 301/619] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:07.331859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf68882-9cd0-4a60-bf61-77bed2da076e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:07.437699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf68882-9cd0-4a60-bf61-77bed2da076e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:07.465738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:07.473994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03800d9-a6f1-4a9f-a9e4-8f8cd7e40fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:07.475217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03800d9-a6f1-4a9f-a9e4-8f8cd7e40fee None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:07.475770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03800d9-a6f1-4a9f-a9e4-8f8cd7e40fee None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:07.476350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03800d9-a6f1-4a9f-a9e4-8f8cd7e40fee None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:07.484192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03800d9-a6f1-4a9f-a9e4-8f8cd7e40fee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:07.485774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03800d9-a6f1-4a9f-a9e4-8f8cd7e40fee None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:07.497301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-d03800d9-a6f1-4a9f-a9e4-8f8cd7e40fee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:07.497301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:07.497301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:07.497301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:07.497301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:07.497301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:07.497301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:07.497301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:07.497301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:07.497301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:07.497301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:07.497301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:07.497301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:07.497301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:07.497301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:07.498174 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:07.498174 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:07.498174 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:07.498174 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:07.498174 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:07.498174 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:07.498174 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:07.498174 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:07.498174 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:07.498174 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:07.498174 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:07.498174 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:07.498174 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:07.498174 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:07.498174 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:07.498174 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:07.498174 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:07.499291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:07.499291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:07.499291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:07.499291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:07.499291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:07.499291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:07.499291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:07.499291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:07.499291 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 319/620] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:07.506461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bb4ba-5807-4267-9ec5-f69026673660 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:07.563696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03800d9-a6f1-4a9f-a9e4-8f8cd7e40fee None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:07.607042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:07.695291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bb4ba-5807-4267-9ec5-f69026673660 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:07.715308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03800d9-a6f1-4a9f-a9e4-8f8cd7e40fee None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:07.749120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa277e0b-c083-4b1e-92ef-03f220a707db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:07.749920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa277e0b-c083-4b1e-92ef-03f220a707db None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:07.750533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa277e0b-c083-4b1e-92ef-03f220a707db None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:07.750817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa277e0b-c083-4b1e-92ef-03f220a707db None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:07.755173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256bd8e-f2e7-4d69-8d98-3ac383ead1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:07.755961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256bd8e-f2e7-4d69-8d98-3ac383ead1d0 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:07.756340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256bd8e-f2e7-4d69-8d98-3ac383ead1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:07.756709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256bd8e-f2e7-4d69-8d98-3ac383ead1d0 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:07.757514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256bd8e-f2e7-4d69-8d98-3ac383ead1d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:07.757920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256bd8e-f2e7-4d69-8d98-3ac383ead1d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:07.759806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256bd8e-f2e7-4d69-8d98-3ac383ead1d0 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:07.763678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa277e0b-c083-4b1e-92ef-03f220a707db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:07.770271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-aa277e0b-c083-4b1e-92ef-03f220a707db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:07.770271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:07.770271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:07.770271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:07.770271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:07.770271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:07.770271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:07.770271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:07.770271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:07.770271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:07.770271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:07.770271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:07.770271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:07.770271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:07.770271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:07.770271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:07.771331 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:07.771331 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:07.771331 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:07.771331 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:07.771331 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:07.771331 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:07.771331 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:07.771331 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:07.771331 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:07.771331 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:07.771331 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:07.771331 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:07.771331 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:07.771331 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:07.771331 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:07.771331 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:07.772323 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:07.772323 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:07.772323 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:07.772323 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:07.772323 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:07.772323 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:07.772323 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:07.772323 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:07.772323 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:07.772323 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:07.772323 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:07.772323 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:07.772323 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 320/621] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:04:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:07.773806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb4a31-c4b6-4278-8c6a-317b5557d3e0 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:07.773806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb4a31-c4b6-4278-8c6a-317b5557d3e0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:07.774055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb4a31-c4b6-4278-8c6a-317b5557d3e0 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:07.775317 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 302/622] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:07.775510 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 321/623] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:07.780265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256bd8e-f2e7-4d69-8d98-3ac383ead1d0 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:07.782101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64346dfc-119d-4de8-a8ea-322cc4ee1897 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:07.782600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64346dfc-119d-4de8-a8ea-322cc4ee1897 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:07.783099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64346dfc-119d-4de8-a8ea-322cc4ee1897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:07.803220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-64346dfc-119d-4de8-a8ea-322cc4ee1897 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:07.804810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-64346dfc-119d-4de8-a8ea-322cc4ee1897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:07.856878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:07.892675 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 322/624] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:04:07.894591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64346dfc-119d-4de8-a8ea-322cc4ee1897 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:07.923145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256bd8e-f2e7-4d69-8d98-3ac383ead1d0 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:07.960608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:08.001441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08048167-af72-402a-98df-3141f8216d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:08.002074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08048167-af72-402a-98df-3141f8216d4e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:08.002351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08048167-af72-402a-98df-3141f8216d4e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:08.002626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08048167-af72-402a-98df-3141f8216d4e None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:08.003336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08048167-af72-402a-98df-3141f8216d4e None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:08.003642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08048167-af72-402a-98df-3141f8216d4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:08.005053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08048167-af72-402a-98df-3141f8216d4e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:08.024359 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 303/625] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:04:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:08.028244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08048167-af72-402a-98df-3141f8216d4e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:08.102241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64346dfc-119d-4de8-a8ea-322cc4ee1897 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:08.167345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd082af9-b92f-44a6-8446-06962a4a581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:08.167644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd082af9-b92f-44a6-8446-06962a4a581a None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:08.167896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd082af9-b92f-44a6-8446-06962a4a581a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:08.168170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd082af9-b92f-44a6-8446-06962a4a581a None admin] PATH_INFO: `/v3/projects/651b8653291a414fba3805312708ce48/users/d55caefe410444509a1eee4262b76c80/roles/1e0740decc23460f8c3d0f7007f2d97f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:08.188639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd082af9-b92f-44a6-8446-06962a4a581a None admin] RBAC: Authorizing `identity:create_grant(project_id=651b8653291a414fba3805312708ce48, user_id=d55caefe410444509a1eee4262b76c80, role_id=1e0740decc23460f8c3d0f7007f2d97f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:08.190115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd082af9-b92f-44a6-8446-06962a4a581a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:08.209046 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 323/626] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:04:07 2022] PUT /identity/v3/projects/651b8653291a414fba3805312708ce48/users/d55caefe410444509a1eee4262b76c80/roles/1e0740decc23460f8c3d0f7007f2d97f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:04:08.210992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fda46e-ef04-4339-8945-830dfdee72f8 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:08.211406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fda46e-ef04-4339-8945-830dfdee72f8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:08.211744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fda46e-ef04-4339-8945-830dfdee72f8 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:08.213429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08048167-af72-402a-98df-3141f8216d4e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:08.217916 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 324/627] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:08.220367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f514b-c948-41f7-ac0b-552558c6a102 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:08.220703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f514b-c948-41f7-ac0b-552558c6a102 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:08.220918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f514b-c948-41f7-ac0b-552558c6a102 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:08.222543 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 325/628] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:08.224153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f3558-6eb7-483d-bc9a-123c78e07ba6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:08.224153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f3558-6eb7-483d-bc9a-123c78e07ba6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:08.224153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f3558-6eb7-483d-bc9a-123c78e07ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:08.246695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e87f3558-6eb7-483d-bc9a-123c78e07ba6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:08.248326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e87f3558-6eb7-483d-bc9a-123c78e07ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:08.270194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7db31d-85cf-4b09-a3f3-860a69155158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:08.270912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7db31d-85cf-4b09-a3f3-860a69155158 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:08.271127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7db31d-85cf-4b09-a3f3-860a69155158 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:08.271422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7db31d-85cf-4b09-a3f3-860a69155158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:08.282542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:08.287083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7db31d-85cf-4b09-a3f3-860a69155158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:08.288708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7db31d-85cf-4b09-a3f3-860a69155158 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:08.305768 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-ec7db31d-85cf-4b09-a3f3-860a69155158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:08.305768 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:08.305768 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:08.305768 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:08.305768 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:08.305768 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:08.305768 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:08.305768 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:08.305768 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:08.305768 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:08.305768 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:08.305768 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:08.305768 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:08.305768 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:08.305768 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:08.305768 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:08.306801 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:08.306801 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:08.306801 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:08.306801 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:08.306801 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:08.306801 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:08.306801 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:08.306801 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:08.306801 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:08.306801 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:08.306801 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:08.306801 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:08.306801 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:08.306801 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:08.306801 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:08.306801 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:08.306801 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:08.308147 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:08.308147 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:08.308147 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:08.311633 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 304/629] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:08.313958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f80d81-efba-4b7d-b979-3c551d831f27 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:08.314822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f80d81-efba-4b7d-b979-3c551d831f27 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:08.315287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f80d81-efba-4b7d-b979-3c551d831f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:08.336480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d7f80d81-efba-4b7d-b979-3c551d831f27 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:08.337744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d7f80d81-efba-4b7d-b979-3c551d831f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:08.342151 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 326/630] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:04:08.343390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f3558-6eb7-483d-bc9a-123c78e07ba6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:08.376366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:08.449800 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 305/631] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:04:08.450862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f80d81-efba-4b7d-b979-3c551d831f27 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:08.502200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f3558-6eb7-483d-bc9a-123c78e07ba6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:08.549292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226ae2-dd01-4441-bbd3-cd72dfe5eb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:08.549951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226ae2-dd01-4441-bbd3-cd72dfe5eb98 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:08.550227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226ae2-dd01-4441-bbd3-cd72dfe5eb98 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:08.550652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226ae2-dd01-4441-bbd3-cd72dfe5eb98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:08.569191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b226ae2-dd01-4441-bbd3-cd72dfe5eb98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:08.575886 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-9b226ae2-dd01-4441-bbd3-cd72dfe5eb98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:08.575886 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:08.575886 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:08.575886 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:08.575886 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:08.575886 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:08.575886 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:08.575886 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:08.575886 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:08.575886 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:08.575886 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:08.575886 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:08.575886 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:08.575886 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:08.575886 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:08.575886 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:08.576881 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:08.576881 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:08.576881 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:08.576881 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:08.576881 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:08.576881 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:08.576881 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:08.576881 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:08.576881 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:08.576881 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:08.576881 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:08.576881 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:08.576881 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:08.576881 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:08.576881 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:08.576881 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:08.577733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:08.577733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:08.577733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:08.577733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:08.577733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:08.577733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:08.577733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:08.577733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:08.577733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:08.577733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:08.577733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:08.577733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:08.577733 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 327/632] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:04:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:08.583131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226ae2-dd01-4441-bbd3-cd72dfe5eb98 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:08.613469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f80d81-efba-4b7d-b979-3c551d831f27 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:08.639003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:08.687311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f50319-6c14-4fda-a6d5-895c87525a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:08.688306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f50319-6c14-4fda-a6d5-895c87525a39 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:08.688775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f50319-6c14-4fda-a6d5-895c87525a39 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:08.689235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f50319-6c14-4fda-a6d5-895c87525a39 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:08.690365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f50319-6c14-4fda-a6d5-895c87525a39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:08.690893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f50319-6c14-4fda-a6d5-895c87525a39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:08.692609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f50319-6c14-4fda-a6d5-895c87525a39 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:08.711584 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 306/633] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:08.712911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f50319-6c14-4fda-a6d5-895c87525a39 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:08.715243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226ae2-dd01-4441-bbd3-cd72dfe5eb98 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:08.745128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:08.768444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6918437-c6ca-41c4-8e42-273f60c48c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:08.769004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6918437-c6ca-41c4-8e42-273f60c48c2f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:08.769282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6918437-c6ca-41c4-8e42-273f60c48c2f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:08.769558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6918437-c6ca-41c4-8e42-273f60c48c2f None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:08.770255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6918437-c6ca-41c4-8e42-273f60c48c2f None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:08.770558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6918437-c6ca-41c4-8e42-273f60c48c2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:08.772855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6918437-c6ca-41c4-8e42-273f60c48c2f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:08.787135 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 328/634] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:04:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:08.789628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6918437-c6ca-41c4-8e42-273f60c48c2f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:08.843554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f50319-6c14-4fda-a6d5-895c87525a39 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:08.891225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29b662-63fc-4b27-b651-f4ca408c2e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:08.892079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29b662-63fc-4b27-b651-f4ca408c2e9d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:08.892420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29b662-63fc-4b27-b651-f4ca408c2e9d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:08.892749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29b662-63fc-4b27-b651-f4ca408c2e9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:08.896673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:08.906518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29b662-63fc-4b27-b651-f4ca408c2e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:08.911985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-fe29b662-63fc-4b27-b651-f4ca408c2e9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:08.911985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:08.911985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:08.911985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:08.911985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:08.911985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:08.911985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:08.911985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:08.911985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:08.911985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:08.911985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:08.911985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:08.911985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:08.911985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:08.911985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:08.911985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:08.913440 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:08.913440 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:08.913440 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:08.913440 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:08.913440 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:08.913440 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:08.913440 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:08.913440 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:08.913440 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:08.913440 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:08.913440 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:08.913440 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:08.913440 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:08.913440 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:08.913440 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:08.913440 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:08.914678 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:08.914678 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:08.914678 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:08.914678 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:08.914678 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:08.914678 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:08.914678 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:08.914678 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:08.914678 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:08.914678 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:08.914678 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:08.914678 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:08.914678 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 307/635] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:04:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:08.914678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29b662-63fc-4b27-b651-f4ca408c2e9d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:08.937730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6918437-c6ca-41c4-8e42-273f60c48c2f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:08.975597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00def8-b1c1-4a20-b129-5ae13bbc2303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:08.976247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00def8-b1c1-4a20-b129-5ae13bbc2303 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:08.976529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00def8-b1c1-4a20-b129-5ae13bbc2303 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:08.976834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00def8-b1c1-4a20-b129-5ae13bbc2303 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:08.986058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00def8-b1c1-4a20-b129-5ae13bbc2303 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:08.987610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00def8-b1c1-4a20-b129-5ae13bbc2303 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:09.000503 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3f00def8-b1c1-4a20-b129-5ae13bbc2303 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 18:04:09.000503 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:09.000503 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:09.000503 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:09.000503 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:09.000503 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:09.000503 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:09.000503 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:09.000503 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:09.000503 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:09.000503 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:09.000503 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:09.000503 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:09.000503 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:09.000503 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:09.000503 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:09.001547 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:09.002475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:09.002475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:09.002475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:09.002475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:09.002475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:09.002475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:09.002475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:09.002475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:09.002475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 18:04:09.002475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:09.002475 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 329/636] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:04:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:09.002475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00def8-b1c1-4a20-b129-5ae13bbc2303 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:09.028467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:09.050147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29b662-63fc-4b27-b651-f4ca408c2e9d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:09.088741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984967c-576a-4651-86b7-048d09387901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:09.089542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984967c-576a-4651-86b7-048d09387901 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:09.089948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984967c-576a-4651-86b7-048d09387901 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:09.090221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984967c-576a-4651-86b7-048d09387901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:09.102969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984967c-576a-4651-86b7-048d09387901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:09.104752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984967c-576a-4651-86b7-048d09387901 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:09.113458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00def8-b1c1-4a20-b129-5ae13bbc2303 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:09.121226 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-c984967c-576a-4651-86b7-048d09387901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:09.121226 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:09.121226 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:09.121226 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:09.121226 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:09.121226 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:09.121226 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:09.121226 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:09.121226 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:09.121226 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:09.121226 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:09.121226 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:09.121226 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:09.121226 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:09.121226 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:09.121226 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:09.122429 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:09.122429 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:09.122429 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:09.122429 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:09.122429 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:09.122429 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:09.122429 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:09.122429 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:09.122429 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:09.122429 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:09.122429 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:09.122429 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:09.122429 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:09.122429 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:09.122429 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:09.122429 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:09.122429 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:09.123345 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:09.123345 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:09.123345 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:09.123345 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 308/637] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:09.123345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984967c-576a-4651-86b7-048d09387901 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:09.158328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b824e-d060-4fd8-b7da-8dcef6386935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:09.158976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b824e-d060-4fd8-b7da-8dcef6386935 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:09.159273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b824e-d060-4fd8-b7da-8dcef6386935 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:09.159560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b824e-d060-4fd8-b7da-8dcef6386935 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:09.171759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:09.176453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b824e-d060-4fd8-b7da-8dcef6386935 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:09.181564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-bc2b824e-d060-4fd8-b7da-8dcef6386935 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:09.181564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:09.181564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:09.181564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:09.181564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:09.181564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:09.181564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:09.181564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:09.181564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:09.181564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:09.181564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:09.181564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:09.181564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:09.181564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:09.181564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:09.181564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:09.182543 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:09.182543 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:09.182543 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:09.182543 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:09.182543 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:09.182543 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:09.182543 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:09.182543 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:09.182543 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:09.182543 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:09.182543 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:09.182543 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:09.182543 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:09.182543 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:09.182543 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:09.182543 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:09.188305 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:09.188305 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:09.188305 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:09.188305 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:09.188305 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:09.188305 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:09.188305 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:09.188305 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:09.188305 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:09.188305 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:09.188305 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:09.188305 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:09.188305 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 330/638] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:04:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:09.188305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b824e-d060-4fd8-b7da-8dcef6386935 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:09.250090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984967c-576a-4651-86b7-048d09387901 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:09.288819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6bf85-9872-4bd5-a8ef-f293b90051d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:09.289351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6bf85-9872-4bd5-a8ef-f293b90051d8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:09.289630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6bf85-9872-4bd5-a8ef-f293b90051d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:09.289902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6bf85-9872-4bd5-a8ef-f293b90051d8 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:09.290581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6bf85-9872-4bd5-a8ef-f293b90051d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:09.290994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6bf85-9872-4bd5-a8ef-f293b90051d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:09.292438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6bf85-9872-4bd5-a8ef-f293b90051d8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:09.294092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:09.310576 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 309/639] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:04:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:09.311849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6bf85-9872-4bd5-a8ef-f293b90051d8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:09.329966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b824e-d060-4fd8-b7da-8dcef6386935 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:09.374650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c367d2-a9f7-4303-9c4a-3e41180218ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:09.375055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c367d2-a9f7-4303-9c4a-3e41180218ea None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:09.375244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c367d2-a9f7-4303-9c4a-3e41180218ea None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:09.375851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c367d2-a9f7-4303-9c4a-3e41180218ea None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:09.376708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c367d2-a9f7-4303-9c4a-3e41180218ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:09.377199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c367d2-a9f7-4303-9c4a-3e41180218ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:09.379467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c367d2-a9f7-4303-9c4a-3e41180218ea None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:09.409662 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 331/640] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 28 18:04:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:09.409662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c367d2-a9f7-4303-9c4a-3e41180218ea None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:09.426078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6bf85-9872-4bd5-a8ef-f293b90051d8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:09.463768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb408f-231e-4246-b337-71bcf887fcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:09.464574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb408f-231e-4246-b337-71bcf887fcbb None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:09.464866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb408f-231e-4246-b337-71bcf887fcbb None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:09.465179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb408f-231e-4246-b337-71bcf887fcbb None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:09.465860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb408f-231e-4246-b337-71bcf887fcbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:09.466164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb408f-231e-4246-b337-71bcf887fcbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:09.467590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb408f-231e-4246-b337-71bcf887fcbb None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:09.480127 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 310/641] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:09.480941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb408f-231e-4246-b337-71bcf887fcbb None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:09.491214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:09.542038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:09.548705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c367d2-a9f7-4303-9c4a-3e41180218ea None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:09.591161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb408f-231e-4246-b337-71bcf887fcbb None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:09.596328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b58643-dd7e-441b-bfce-476a59b62cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:09.596947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b58643-dd7e-441b-bfce-476a59b62cc5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:09.597222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b58643-dd7e-441b-bfce-476a59b62cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:09.597494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b58643-dd7e-441b-bfce-476a59b62cc5 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:09.598155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b58643-dd7e-441b-bfce-476a59b62cc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:09.598455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b58643-dd7e-441b-bfce-476a59b62cc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:09.599857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b58643-dd7e-441b-bfce-476a59b62cc5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:09.608179 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 332/642] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:04:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:09.608976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b58643-dd7e-441b-bfce-476a59b62cc5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:09.635396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33d871-2b2a-4006-b66c-16aa0900da97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:09.636046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33d871-2b2a-4006-b66c-16aa0900da97 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:09.636382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33d871-2b2a-4006-b66c-16aa0900da97 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:09.636653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33d871-2b2a-4006-b66c-16aa0900da97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:09.648337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33d871-2b2a-4006-b66c-16aa0900da97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:09.649800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33d871-2b2a-4006-b66c-16aa0900da97 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:09.668338 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-ae33d871-2b2a-4006-b66c-16aa0900da97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:09.668338 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:09.668338 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:09.668338 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:09.668338 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:09.668338 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:09.668338 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:09.668338 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:09.668338 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:09.668338 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:09.668338 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:09.668338 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:09.668338 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:09.668338 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:09.668338 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:09.668338 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:09.669443 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:09.669443 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:09.669443 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:09.669443 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:09.669443 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:09.669443 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:09.669443 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:09.669443 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:09.669443 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:09.669443 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:09.669443 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:09.669443 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:09.669443 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:09.669443 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:09.669443 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:09.669443 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:09.669443 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:09.670330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:09.670330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:09.670330 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:09.670330 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 311/643] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:09.670330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33d871-2b2a-4006-b66c-16aa0900da97 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:09.732939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b58643-dd7e-441b-bfce-476a59b62cc5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:09.766132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:09.784801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae6180-08dd-4409-8cd0-6ff41246081e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:09.785398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae6180-08dd-4409-8cd0-6ff41246081e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:09.785685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae6180-08dd-4409-8cd0-6ff41246081e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:09.785961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae6180-08dd-4409-8cd0-6ff41246081e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:09.811425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33d871-2b2a-4006-b66c-16aa0900da97 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:09.823911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:09.857222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ccb6f-9e6d-4c26-8771-27baebc6a9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:09.858086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ccb6f-9e6d-4c26-8771-27baebc6a9c4 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:09.858358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ccb6f-9e6d-4c26-8771-27baebc6a9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:09.858632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ccb6f-9e6d-4c26-8771-27baebc6a9c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:09.867763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ccb6f-9e6d-4c26-8771-27baebc6a9c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:09.867952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae6180-08dd-4409-8cd0-6ff41246081e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:09.869300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ccb6f-9e6d-4c26-8771-27baebc6a9c4 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:09.872710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae6180-08dd-4409-8cd0-6ff41246081e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:09.888044 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-287ccb6f-9e6d-4c26-8771-27baebc6a9c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:04:09.888044 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:09.888044 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:09.888044 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:09.888044 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:09.888044 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:09.888044 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:09.888044 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:09.888044 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:09.888044 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:09.888044 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:09.888044 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:09.888044 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:09.888044 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:09.888044 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:09.888044 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:09.889287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:09.890358 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:09.890358 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:09.890358 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:09.890358 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:09.890358 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:09.890358 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:09.890358 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:09.890358 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:09.890358 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:04:09.890358 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:09.890358 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 312/644] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 18:04:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:09.890358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ccb6f-9e6d-4c26-8771-27baebc6a9c4 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:09.997692 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 333/645] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:04:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:04:09.998671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae6180-08dd-4409-8cd0-6ff41246081e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:10.010406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ccb6f-9e6d-4c26-8771-27baebc6a9c4 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:10.030713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:10.051359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7baca6-6d00-406a-8d8b-ccae8ac30770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:10.051359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7baca6-6d00-406a-8d8b-ccae8ac30770 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:10.052171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7baca6-6d00-406a-8d8b-ccae8ac30770 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:10.052171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7baca6-6d00-406a-8d8b-ccae8ac30770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:10.067080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7baca6-6d00-406a-8d8b-ccae8ac30770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:10.069786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7baca6-6d00-406a-8d8b-ccae8ac30770 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:10.087572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-cc7baca6-6d00-406a-8d8b-ccae8ac30770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:10.087572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:10.087572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:10.087572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:10.087572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:10.087572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:10.087572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:10.087572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:10.087572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:10.087572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:10.087572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:10.087572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:10.087572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:10.087572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:10.087572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:10.087572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:10.089470 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:10.089470 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:10.089470 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:10.089470 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:10.089470 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:10.089470 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:10.089470 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:10.089470 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:10.089470 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:10.089470 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:10.089470 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:10.089470 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:10.089470 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:10.089470 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:10.089470 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:10.089470 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:10.089470 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:10.090740 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:10.090740 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:10.090740 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:10.091929 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 313/646] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:10.093095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7baca6-6d00-406a-8d8b-ccae8ac30770 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:10.123131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:10.163765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae6180-08dd-4409-8cd0-6ff41246081e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:10.219090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc32638-6e5c-427a-9632-82cdf1ec5285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:10.219787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc32638-6e5c-427a-9632-82cdf1ec5285 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:10.220080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc32638-6e5c-427a-9632-82cdf1ec5285 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:10.220358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc32638-6e5c-427a-9632-82cdf1ec5285 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:10.221045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc32638-6e5c-427a-9632-82cdf1ec5285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:10.221325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc32638-6e5c-427a-9632-82cdf1ec5285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:10.222760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc32638-6e5c-427a-9632-82cdf1ec5285 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:10.238828 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 334/647] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:10.239808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc32638-6e5c-427a-9632-82cdf1ec5285 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:10.249692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7baca6-6d00-406a-8d8b-ccae8ac30770 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:10.296576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f07292-320e-4687-8dee-89ae677f6ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:10.297258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f07292-320e-4687-8dee-89ae677f6ae2 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:10.297567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f07292-320e-4687-8dee-89ae677f6ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:10.297874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f07292-320e-4687-8dee-89ae677f6ae2 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:10.298613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f07292-320e-4687-8dee-89ae677f6ae2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:10.299024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f07292-320e-4687-8dee-89ae677f6ae2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:10.300713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f07292-320e-4687-8dee-89ae677f6ae2 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:10.319786 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 314/648] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 18:04:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:10.320576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f07292-320e-4687-8dee-89ae677f6ae2 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:10.346185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:10.368417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc32638-6e5c-427a-9632-82cdf1ec5285 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:10.403522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa34ecc-43d2-48ea-892d-97087a9dd2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:10.404153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa34ecc-43d2-48ea-892d-97087a9dd2a2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:10.404427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa34ecc-43d2-48ea-892d-97087a9dd2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:10.404785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa34ecc-43d2-48ea-892d-97087a9dd2a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:10.406739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:10.416219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa34ecc-43d2-48ea-892d-97087a9dd2a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:10.417735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa34ecc-43d2-48ea-892d-97087a9dd2a2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:10.428817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f07292-320e-4687-8dee-89ae677f6ae2 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:10.432166 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-8fa34ecc-43d2-48ea-892d-97087a9dd2a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:10.432166 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:10.432166 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:10.432166 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:10.432166 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:10.432166 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:10.432166 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:10.432166 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:10.432166 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:10.432166 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:10.432166 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:10.432166 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:10.432166 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:10.432166 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:10.432166 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:10.432166 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:10.433291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:10.433291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:10.433291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:10.433291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:10.433291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:10.433291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:10.433291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:10.433291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:10.433291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:10.433291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:10.433291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:10.433291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:10.433291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:10.433291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:10.433291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:10.433291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:10.433291 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:10.434176 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:10.434176 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:10.434176 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:10.434176 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 335/649] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:10.434176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa34ecc-43d2-48ea-892d-97087a9dd2a2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:10.464076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0a948-a271-4dba-bb92-6d76fad0c09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:10.464720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0a948-a271-4dba-bb92-6d76fad0c09b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:10.465015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0a948-a271-4dba-bb92-6d76fad0c09b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:10.465285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0a948-a271-4dba-bb92-6d76fad0c09b None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:10.465936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0a948-a271-4dba-bb92-6d76fad0c09b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:10.466225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0a948-a271-4dba-bb92-6d76fad0c09b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:10.467641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0a948-a271-4dba-bb92-6d76fad0c09b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:10.478880 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 315/650] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:10.479971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92659c03-e2da-442b-a6dc-ad6872013758 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:10.480259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92659c03-e2da-442b-a6dc-ad6872013758 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:10.480533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92659c03-e2da-442b-a6dc-ad6872013758 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:10.481843 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 316/651] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:10.482427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92659c03-e2da-442b-a6dc-ad6872013758 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:10.537911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa34ecc-43d2-48ea-892d-97087a9dd2a2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:10.567195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:10.573075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891bbd1-5bd2-40c8-934f-642c895387c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:10.573759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891bbd1-5bd2-40c8-934f-642c895387c2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:10.574038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891bbd1-5bd2-40c8-934f-642c895387c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:10.574311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891bbd1-5bd2-40c8-934f-642c895387c2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:10.582182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891bbd1-5bd2-40c8-934f-642c895387c2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:10.583774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891bbd1-5bd2-40c8-934f-642c895387c2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:10.588924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92659c03-e2da-442b-a6dc-ad6872013758 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:10.595508 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a891bbd1-5bd2-40c8-934f-642c895387c2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 18:04:10.595508 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:10.595508 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:10.595508 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:10.595508 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:10.595508 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:10.595508 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:10.595508 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:10.595508 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:10.595508 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:10.595508 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:10.595508 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:10.595508 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:10.595508 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:10.595508 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:10.595508 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:10.596995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:10.597913 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:10.597913 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:10.597913 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:10.597913 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:10.597913 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:10.597913 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:10.597913 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:10.597913 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:10.597913 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 18:04:10.597913 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:10.597913 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 336/652] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:04:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:10.597913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891bbd1-5bd2-40c8-934f-642c895387c2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:10.627432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490df07-7283-4c58-b0a4-b13646fdbd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:10.628044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490df07-7283-4c58-b0a4-b13646fdbd89 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:10.628324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490df07-7283-4c58-b0a4-b13646fdbd89 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:10.628595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490df07-7283-4c58-b0a4-b13646fdbd89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:10.638206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:10.696877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891bbd1-5bd2-40c8-934f-642c895387c2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:10.697954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490df07-7283-4c58-b0a4-b13646fdbd89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:10.699513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490df07-7283-4c58-b0a4-b13646fdbd89 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:10.731304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37ce9d-265a-4e52-bd72-0a3dac5f3134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:10.731928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37ce9d-265a-4e52-bd72-0a3dac5f3134 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:10.732201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37ce9d-265a-4e52-bd72-0a3dac5f3134 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:10.732472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37ce9d-265a-4e52-bd72-0a3dac5f3134 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:10.733135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37ce9d-265a-4e52-bd72-0a3dac5f3134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:10.733439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37ce9d-265a-4e52-bd72-0a3dac5f3134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:10.734798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37ce9d-265a-4e52-bd72-0a3dac5f3134 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:10.746583 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 337/653] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:10.747505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37ce9d-265a-4e52-bd72-0a3dac5f3134 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:10.799363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:10.804159 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 317/654] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:04:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:04:10.805490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571cab8-96eb-4c20-8cdb-b03e7c7aa304 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:10.805781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571cab8-96eb-4c20-8cdb-b03e7c7aa304 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:10.806054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571cab8-96eb-4c20-8cdb-b03e7c7aa304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:10.823392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6571cab8-96eb-4c20-8cdb-b03e7c7aa304 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:10.824602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6571cab8-96eb-4c20-8cdb-b03e7c7aa304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:10.848406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37ce9d-265a-4e52-bd72-0a3dac5f3134 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:10.854436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:10.888523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919e822-921b-4bd9-ba76-f2f546ffd8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:10.889159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919e822-921b-4bd9-ba76-f2f546ffd8e4 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:10.889435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919e822-921b-4bd9-ba76-f2f546ffd8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:10.889706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919e822-921b-4bd9-ba76-f2f546ffd8e4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:10.896991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919e822-921b-4bd9-ba76-f2f546ffd8e4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:10.897792 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 318/655] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:04:10.898413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919e822-921b-4bd9-ba76-f2f546ffd8e4 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:10.898631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571cab8-96eb-4c20-8cdb-b03e7c7aa304 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:10.920047 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-1919e822-921b-4bd9-ba76-f2f546ffd8e4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 18:04:10.920047 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:10.920047 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:10.920047 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:10.920047 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:10.920047 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:10.920047 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:10.920047 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:10.920047 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:10.920047 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:10.920047 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:10.920047 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:10.920047 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:10.920047 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:10.920047 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:10.920047 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:10.921175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:10.922257 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:10.922257 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:10.922257 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:10.922257 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:10.922257 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:10.922257 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:10.922257 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:10.922257 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:10.922257 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 18:04:10.922257 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:10.924089 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 338/656] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:04:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:10.925089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919e822-921b-4bd9-ba76-f2f546ffd8e4 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:11.014700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571cab8-96eb-4c20-8cdb-b03e7c7aa304 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:11.031226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919e822-921b-4bd9-ba76-f2f546ffd8e4 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:11.045160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:11.055237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517259c0-0ae8-4fcc-a53e-c33e34dabbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:11.056070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517259c0-0ae8-4fcc-a53e-c33e34dabbd7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:11.056489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517259c0-0ae8-4fcc-a53e-c33e34dabbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:11.056893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517259c0-0ae8-4fcc-a53e-c33e34dabbd7 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:11.057777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517259c0-0ae8-4fcc-a53e-c33e34dabbd7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:11.058366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517259c0-0ae8-4fcc-a53e-c33e34dabbd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:11.059842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517259c0-0ae8-4fcc-a53e-c33e34dabbd7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:11.066420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcfdb5-e7ac-4ac4-a6f0-66dc105f3de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:11.067056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcfdb5-e7ac-4ac4-a6f0-66dc105f3de7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:11.067363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcfdb5-e7ac-4ac4-a6f0-66dc105f3de7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:11.067640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcfdb5-e7ac-4ac4-a6f0-66dc105f3de7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:11.074693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcfdb5-e7ac-4ac4-a6f0-66dc105f3de7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:11.076109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcfdb5-e7ac-4ac4-a6f0-66dc105f3de7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:11.077693 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 319/657] 10.222.0.27 () {56 vars in 1139 bytes} [Sun Aug 28 18:04:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:11.078507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517259c0-0ae8-4fcc-a53e-c33e34dabbd7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:11.092401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-21dcfdb5-e7ac-4ac4-a6f0-66dc105f3de7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:11.092401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:11.092401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:11.092401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:11.092401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:11.092401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:11.092401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:11.092401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:11.092401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:11.092401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:11.092401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:11.092401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:11.092401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:11.092401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:11.092401 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:11.093328 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:11.093328 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:11.093328 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:11.093328 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:11.093328 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:11.093328 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:11.093328 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:11.093328 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:11.093328 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:11.093328 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:11.093328 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:11.093328 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:11.093328 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:11.093328 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:11.093328 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:11.093328 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:11.093328 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:11.094233 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:11.094233 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:11.094233 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:11.094233 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:11.094233 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:11.094233 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:11.094233 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:11.094233 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:11.094233 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 339/658] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:11.094710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcfdb5-e7ac-4ac4-a6f0-66dc105f3de7 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:11.114926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:11.190299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517259c0-0ae8-4fcc-a53e-c33e34dabbd7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:11.201437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcfdb5-e7ac-4ac4-a6f0-66dc105f3de7 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:11.223140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166bfd0-6010-4b4b-b89a-7cc5894a4d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:11.223804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166bfd0-6010-4b4b-b89a-7cc5894a4d49 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:11.224077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166bfd0-6010-4b4b-b89a-7cc5894a4d49 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:11.224355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166bfd0-6010-4b4b-b89a-7cc5894a4d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:11.234483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166bfd0-6010-4b4b-b89a-7cc5894a4d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:11.235426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ba6a2-3ea4-43bf-a1b0-d1055db58c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:11.235960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166bfd0-6010-4b4b-b89a-7cc5894a4d49 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:11.236057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ba6a2-3ea4-43bf-a1b0-d1055db58c57 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:11.236318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ba6a2-3ea4-43bf-a1b0-d1055db58c57 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:11.236584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ba6a2-3ea4-43bf-a1b0-d1055db58c57 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:11.237304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ba6a2-3ea4-43bf-a1b0-d1055db58c57 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:11.237604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ba6a2-3ea4-43bf-a1b0-d1055db58c57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:11.239100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ba6a2-3ea4-43bf-a1b0-d1055db58c57 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:11.250267 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-0166bfd0-6010-4b4b-b89a-7cc5894a4d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:11.250267 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:11.250267 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:11.250267 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:11.250267 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:11.250267 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:11.250267 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:11.250267 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:11.250267 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:11.250267 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:11.250267 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:11.250267 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:11.250267 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:11.250267 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:11.250267 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:11.250267 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:11.251279 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:11.251279 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:11.251279 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:11.251279 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:11.251279 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:11.251279 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:11.251279 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:11.251279 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:11.251279 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:11.251279 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:11.251279 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:11.251279 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:11.251279 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:11.251279 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:11.251279 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:11.251279 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:11.251279 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:11.252179 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:11.252179 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:11.252179 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:11.252179 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 320/659] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:11.252179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166bfd0-6010-4b4b-b89a-7cc5894a4d49 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:11.260640 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 340/660] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 28 18:04:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:11.260640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ba6a2-3ea4-43bf-a1b0-d1055db58c57 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:11.288585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:11.336727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:11.358913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166bfd0-6010-4b4b-b89a-7cc5894a4d49 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:11.361246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ba6a2-3ea4-43bf-a1b0-d1055db58c57 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:11.394328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46da780-aeea-4c85-8bfe-072e36e719c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:11.394937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46da780-aeea-4c85-8bfe-072e36e719c6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:11.395220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46da780-aeea-4c85-8bfe-072e36e719c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:11.395524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46da780-aeea-4c85-8bfe-072e36e719c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:11.396242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de935c3f-dbdb-4e8b-876a-1e774e7ea577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:11.396849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de935c3f-dbdb-4e8b-876a-1e774e7ea577 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:11.397123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de935c3f-dbdb-4e8b-876a-1e774e7ea577 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:11.397390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de935c3f-dbdb-4e8b-876a-1e774e7ea577 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:11.398079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de935c3f-dbdb-4e8b-876a-1e774e7ea577 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:11.398380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de935c3f-dbdb-4e8b-876a-1e774e7ea577 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:11.399848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de935c3f-dbdb-4e8b-876a-1e774e7ea577 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:11.411204 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 341/661] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:11.412034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de935c3f-dbdb-4e8b-876a-1e774e7ea577 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:11.462107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46da780-aeea-4c85-8bfe-072e36e719c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:11.463583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46da780-aeea-4c85-8bfe-072e36e719c6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:11.507891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:11.518360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de935c3f-dbdb-4e8b-876a-1e774e7ea577 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:11.546061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:11.557801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8058e61-1961-4c6f-a906-ff467b8f54db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:11.558564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8058e61-1961-4c6f-a906-ff467b8f54db None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:11.559190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8058e61-1961-4c6f-a906-ff467b8f54db None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:11.559190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8058e61-1961-4c6f-a906-ff467b8f54db None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:11.573979 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 321/662] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:04:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:04:11.573979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46da780-aeea-4c85-8bfe-072e36e719c6 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:11.574225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8058e61-1961-4c6f-a906-ff467b8f54db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:11.577667 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a8058e61-1961-4c6f-a906-ff467b8f54db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:11.577667 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:11.577667 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:11.577667 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:11.577667 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:11.577667 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:11.577667 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:11.577667 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:11.577667 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:11.577667 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:11.577667 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:11.577667 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:11.577667 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:11.577667 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:11.577667 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:11.577667 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:11.578837 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:11.578837 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:11.578837 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:11.578837 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:11.578837 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:11.578837 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:11.578837 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:11.578837 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:11.578837 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:11.578837 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:11.578837 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:11.578837 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:11.578837 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:11.578837 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:11.578837 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:11.578837 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:11.579783 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:11.579783 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:11.579783 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:11.579783 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:11.579783 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:11.579783 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:11.579783 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:11.579783 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:11.579783 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:11.579783 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:11.579783 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:11.579783 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:11.583598 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 342/663] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:04:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:11.584361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8058e61-1961-4c6f-a906-ff467b8f54db None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:11.673276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46da780-aeea-4c85-8bfe-072e36e719c6 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:11.686789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8058e61-1961-4c6f-a906-ff467b8f54db None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:11.708201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d80f4c-d16f-4999-a7b8-74b3b5a0c7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:11.708809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d80f4c-d16f-4999-a7b8-74b3b5a0c7fa None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:11.709081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d80f4c-d16f-4999-a7b8-74b3b5a0c7fa None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:11.709369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d80f4c-d16f-4999-a7b8-74b3b5a0c7fa None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:11.710018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d80f4c-d16f-4999-a7b8-74b3b5a0c7fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:11.710316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d80f4c-d16f-4999-a7b8-74b3b5a0c7fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:11.711741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d80f4c-d16f-4999-a7b8-74b3b5a0c7fa None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:11.720589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aef9b7-5736-46a4-b579-fce301289fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:11.721196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aef9b7-5736-46a4-b579-fce301289fb8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:11.721478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aef9b7-5736-46a4-b579-fce301289fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:11.721779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aef9b7-5736-46a4-b579-fce301289fb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:11.723312 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 322/664] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:11.724129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d80f4c-d16f-4999-a7b8-74b3b5a0c7fa None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:11.745237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:11.763767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:11.794913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aef9b7-5736-46a4-b579-fce301289fb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:11.796412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aef9b7-5736-46a4-b579-fce301289fb8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:11.827581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d80f4c-d16f-4999-a7b8-74b3b5a0c7fa None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:11.861553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76156219-59d1-4104-8cf7-0524016e3a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:11.862149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76156219-59d1-4104-8cf7-0524016e3a84 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:11.862427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76156219-59d1-4104-8cf7-0524016e3a84 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:11.862698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76156219-59d1-4104-8cf7-0524016e3a84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:11.863448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76156219-59d1-4104-8cf7-0524016e3a84 None admin] RBAC: Adding query filter params (role.id=1e0740decc23460f8c3d0f7007f2d97f, scope.project.id=651b8653291a414fba3805312708ce48, user.id=cfed720323bd42329feb7574963f744a) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:11.863763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76156219-59d1-4104-8cf7-0524016e3a84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:11.865181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76156219-59d1-4104-8cf7-0524016e3a84 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:11.871018 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 323/665] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:04:11 2022] GET /identity/v3/role_assignments?user.id=cfed720323bd42329feb7574963f744a&scope.project.id=651b8653291a414fba3805312708ce48&role.id=1e0740decc23460f8c3d0f7007f2d97f => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:11.871815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76156219-59d1-4104-8cf7-0524016e3a84 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:11.899074 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 343/666] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:04:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:04:11.900411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aef9b7-5736-46a4-b579-fce301289fb8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:11.956877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:12.001070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76156219-59d1-4104-8cf7-0524016e3a84 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:12.005041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:12.013059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aef9b7-5736-46a4-b579-fce301289fb8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:12.043681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98d039-db5f-44ed-bc92-04d05f53d246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:12.044693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98d039-db5f-44ed-bc92-04d05f53d246 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:12.044977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98d039-db5f-44ed-bc92-04d05f53d246 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:12.045255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98d039-db5f-44ed-bc92-04d05f53d246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:12.052735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abf9ff-fcca-491b-bc8f-1d26f8c4041b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:12.053347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abf9ff-fcca-491b-bc8f-1d26f8c4041b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:12.053625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abf9ff-fcca-491b-bc8f-1d26f8c4041b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:12.053894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abf9ff-fcca-491b-bc8f-1d26f8c4041b None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:12.054552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abf9ff-fcca-491b-bc8f-1d26f8c4041b None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:12.054861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abf9ff-fcca-491b-bc8f-1d26f8c4041b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:12.056275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abf9ff-fcca-491b-bc8f-1d26f8c4041b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:12.056381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98d039-db5f-44ed-bc92-04d05f53d246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:12.057735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98d039-db5f-44ed-bc92-04d05f53d246 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:12.064813 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 344/667] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:04:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:12.065631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abf9ff-fcca-491b-bc8f-1d26f8c4041b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:12.076921 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-8b98d039-db5f-44ed-bc92-04d05f53d246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:12.076921 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:12.076921 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:12.076921 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:12.076921 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:12.076921 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:12.076921 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:12.076921 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:12.076921 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:12.076921 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:12.076921 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:12.076921 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:12.076921 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:12.076921 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:12.076921 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:12.076921 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:12.078023 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:12.078023 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:12.078023 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:12.078023 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:12.078023 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:12.078023 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:12.078023 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:12.078023 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:12.078023 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:12.078023 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:12.078023 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:12.078023 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:12.078023 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:12.078023 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:12.078023 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:12.078023 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:12.078023 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:12.078893 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:12.078893 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:12.078893 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:12.078893 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 324/668] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:12.079150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98d039-db5f-44ed-bc92-04d05f53d246 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:12.173707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abf9ff-fcca-491b-bc8f-1d26f8c4041b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:12.186819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:12.191663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98d039-db5f-44ed-bc92-04d05f53d246 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:12.209285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40131cb2-18bd-4dd3-9b52-31201edaa135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:12.209758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40131cb2-18bd-4dd3-9b52-31201edaa135 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:12.210036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40131cb2-18bd-4dd3-9b52-31201edaa135 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:12.210306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40131cb2-18bd-4dd3-9b52-31201edaa135 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:12.217142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40131cb2-18bd-4dd3-9b52-31201edaa135 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:12.218656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40131cb2-18bd-4dd3-9b52-31201edaa135 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:12.226328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12682f34-0e79-4684-b01e-8bf4c7fccdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:12.226962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12682f34-0e79-4684-b01e-8bf4c7fccdcf None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:12.227242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12682f34-0e79-4684-b01e-8bf4c7fccdcf None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:12.227541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12682f34-0e79-4684-b01e-8bf4c7fccdcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:12.230052 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-40131cb2-18bd-4dd3-9b52-31201edaa135 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:12.230052 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:12.230052 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:12.230052 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:12.230052 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:12.230052 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:12.230052 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:12.230052 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:12.230052 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:12.230052 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:12.230052 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:12.230052 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:12.230052 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:12.230052 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:12.230052 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:12.230902 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:12.230902 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:12.230902 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:12.230902 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:12.230902 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:12.230902 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:12.230902 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:12.230902 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:12.230902 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:12.230902 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:12.230902 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:12.230902 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:12.230902 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:12.230902 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:12.230902 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:12.230902 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:12.230902 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:12.232813 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:12.232813 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:12.232813 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:12.232813 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:12.232813 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:12.232813 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:12.232813 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:12.232813 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:12.232813 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 345/669] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:12.232813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40131cb2-18bd-4dd3-9b52-31201edaa135 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:12.244529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12682f34-0e79-4684-b01e-8bf4c7fccdcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:12.246035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12682f34-0e79-4684-b01e-8bf4c7fccdcf None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:12.260818 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-12682f34-0e79-4684-b01e-8bf4c7fccdcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:12.260818 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:12.260818 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:12.260818 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:12.260818 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:12.260818 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:12.260818 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:12.260818 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:12.260818 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:12.260818 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:12.260818 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:12.260818 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:12.260818 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:12.260818 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:12.260818 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:12.260818 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:12.261909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:12.261909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:12.261909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:12.261909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:12.261909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:12.261909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:12.261909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:12.261909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:12.261909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:12.261909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:12.261909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:12.261909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:12.261909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:12.261909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:12.261909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:12.261909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:12.261909 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:12.262804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:12.262804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:12.262804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:12.266635 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 325/670] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:12.267504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12682f34-0e79-4684-b01e-8bf4c7fccdcf None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:12.277168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:12.340847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40131cb2-18bd-4dd3-9b52-31201edaa135 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:12.379524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96184edb-1f24-400e-83e2-ddeb842b5f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:12.379893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12682f34-0e79-4684-b01e-8bf4c7fccdcf None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:12.380167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96184edb-1f24-400e-83e2-ddeb842b5f4c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:12.380502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96184edb-1f24-400e-83e2-ddeb842b5f4c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:12.380775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96184edb-1f24-400e-83e2-ddeb842b5f4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:12.393000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96184edb-1f24-400e-83e2-ddeb842b5f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:12.394477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96184edb-1f24-400e-83e2-ddeb842b5f4c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:12.409534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-96184edb-1f24-400e-83e2-ddeb842b5f4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:12.409534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:12.409534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:12.409534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:12.409534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:12.409534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:12.409534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:12.409534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:12.409534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:12.409534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:12.409534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:12.409534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:12.409534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:12.409534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:12.409534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:12.409534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:12.410593 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:12.410593 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:12.410593 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:12.410593 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:12.410593 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:12.410593 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:12.410593 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:12.410593 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:12.410593 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:12.410593 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:12.410593 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:12.410593 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:12.410593 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:12.410593 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:12.410593 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:12.410593 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:12.410593 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:12.411964 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:12.411964 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:12.411964 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:12.411964 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 346/671] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:12.411964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96184edb-1f24-400e-83e2-ddeb842b5f4c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:12.421054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f4845-973a-452f-b0eb-50ace5690a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:12.421708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f4845-973a-452f-b0eb-50ace5690a8a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:12.421964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f4845-973a-452f-b0eb-50ace5690a8a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:12.422238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f4845-973a-452f-b0eb-50ace5690a8a None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:12.422966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f4845-973a-452f-b0eb-50ace5690a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:12.423327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f4845-973a-452f-b0eb-50ace5690a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:12.424611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f4845-973a-452f-b0eb-50ace5690a8a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:12.442011 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 326/672] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:12.442011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f4845-973a-452f-b0eb-50ace5690a8a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:12.443977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:12.504624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:12.529577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96184edb-1f24-400e-83e2-ddeb842b5f4c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:12.546480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f4845-973a-452f-b0eb-50ace5690a8a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:12.573239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e1ee9-5c65-444b-89be-66dff63bbaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:12.574193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e1ee9-5c65-444b-89be-66dff63bbaf5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:12.574193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e1ee9-5c65-444b-89be-66dff63bbaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:12.574444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e1ee9-5c65-444b-89be-66dff63bbaf5 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:12.575147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e1ee9-5c65-444b-89be-66dff63bbaf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:12.575460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e1ee9-5c65-444b-89be-66dff63bbaf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:12.576948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e1ee9-5c65-444b-89be-66dff63bbaf5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:12.585413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa3b86-cc16-4386-acc5-fafb5272b4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:12.586029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3b86-cc16-4386-acc5-fafb5272b4f7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:12.586300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3b86-cc16-4386-acc5-fafb5272b4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:12.586567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3b86-cc16-4386-acc5-fafb5272b4f7 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:12.587230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa3b86-cc16-4386-acc5-fafb5272b4f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:12.587564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa3b86-cc16-4386-acc5-fafb5272b4f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:12.589115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa3b86-cc16-4386-acc5-fafb5272b4f7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:12.590061 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 347/673] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:12.590616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e1ee9-5c65-444b-89be-66dff63bbaf5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:12.610549 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 327/674] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:12.611469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa3b86-cc16-4386-acc5-fafb5272b4f7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:12.684460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:12.703369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e1ee9-5c65-444b-89be-66dff63bbaf5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:12.713885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa3b86-cc16-4386-acc5-fafb5272b4f7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:12.738488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:12.741848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382fd38-ac5d-4ee8-88e4-e4593cf53ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:12.742504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382fd38-ac5d-4ee8-88e4-e4593cf53ec9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:12.742778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382fd38-ac5d-4ee8-88e4-e4593cf53ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:12.743140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382fd38-ac5d-4ee8-88e4-e4593cf53ec9 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:12.743810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382fd38-ac5d-4ee8-88e4-e4593cf53ec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:12.744113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382fd38-ac5d-4ee8-88e4-e4593cf53ec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:12.745530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382fd38-ac5d-4ee8-88e4-e4593cf53ec9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:12.748594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9c373-7a87-49af-81cc-ffe60ed418c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:12.749413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9c373-7a87-49af-81cc-ffe60ed418c6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:12.749885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9c373-7a87-49af-81cc-ffe60ed418c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:12.750333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9c373-7a87-49af-81cc-ffe60ed418c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:12.757214 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 348/675] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:12.757891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9c373-7a87-49af-81cc-ffe60ed418c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:12.757997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382fd38-ac5d-4ee8-88e4-e4593cf53ec9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:12.760138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9c373-7a87-49af-81cc-ffe60ed418c6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:12.773673 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-79b9c373-7a87-49af-81cc-ffe60ed418c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:12.773673 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:12.773673 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:12.773673 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:12.773673 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:12.773673 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:12.773673 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:12.773673 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:12.773673 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:12.773673 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:12.773673 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:12.773673 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:12.773673 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:12.773673 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:12.773673 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:12.774605 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:12.774605 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:12.774605 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:12.774605 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:12.774605 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:12.774605 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:12.774605 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:12.774605 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:12.774605 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:12.774605 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:12.774605 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:12.774605 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:12.774605 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:12.774605 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:12.774605 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:12.774605 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:12.774605 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:12.775539 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:12.775539 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:12.775539 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:12.775539 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:12.775539 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:12.775539 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:12.775539 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:12.775539 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:12.775539 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 328/676] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:12.775539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9c373-7a87-49af-81cc-ffe60ed418c6 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:12.871104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382fd38-ac5d-4ee8-88e4-e4593cf53ec9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:12.880964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9c373-7a87-49af-81cc-ffe60ed418c6 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:12.910543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c5e3f-c840-4bb5-b9f1-cc2f5c03b7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:12.911164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c5e3f-c840-4bb5-b9f1-cc2f5c03b7ad None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:12.911471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c5e3f-c840-4bb5-b9f1-cc2f5c03b7ad None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:12.911911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c5e3f-c840-4bb5-b9f1-cc2f5c03b7ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:12.912547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c5e3f-c840-4bb5-b9f1-cc2f5c03b7ad None admin] RBAC: Adding query filter params (role.id=1e0740decc23460f8c3d0f7007f2d97f, scope.project.id=651b8653291a414fba3805312708ce48, user.id=faef473a2ab84661b09f3ba3dd977058) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:12.912849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c5e3f-c840-4bb5-b9f1-cc2f5c03b7ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:12.914394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c5e3f-c840-4bb5-b9f1-cc2f5c03b7ad None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:12.919244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbbf73-6e13-4ded-9eae-3de5a4046bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:12.919930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbbf73-6e13-4ded-9eae-3de5a4046bf8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:12.920207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbbf73-6e13-4ded-9eae-3de5a4046bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:12.920477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbbf73-6e13-4ded-9eae-3de5a4046bf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:12.927731 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 349/677] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:04:12 2022] GET /identity/v3/role_assignments?user.id=faef473a2ab84661b09f3ba3dd977058&scope.project.id=651b8653291a414fba3805312708ce48&role.id=1e0740decc23460f8c3d0f7007f2d97f => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:12.928716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c5e3f-c840-4bb5-b9f1-cc2f5c03b7ad None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:12.931176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbbf73-6e13-4ded-9eae-3de5a4046bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:12.934729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbbf73-6e13-4ded-9eae-3de5a4046bf8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:12.943018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:12.960810 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-94bbbf73-6e13-4ded-9eae-3de5a4046bf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:12.960810 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:12.960810 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:12.960810 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:12.960810 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:12.960810 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:12.960810 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:12.960810 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:12.960810 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:12.960810 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:12.960810 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:12.960810 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:12.960810 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:12.960810 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:12.960810 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:12.961809 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:12.961809 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:12.961809 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:12.961809 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:12.961809 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:12.961809 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:12.961809 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:12.961809 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:12.961809 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:12.961809 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:12.961809 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:12.961809 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:12.961809 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:12.961809 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:12.961809 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:12.961809 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:12.961809 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:12.962705 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:12.962705 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:12.962705 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:12.962705 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:12.962705 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:12.962705 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:12.962705 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:12.962705 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:12.963795 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 329/678] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:12.964466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbbf73-6e13-4ded-9eae-3de5a4046bf8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:13.033257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:13.062823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c5e3f-c840-4bb5-b9f1-cc2f5c03b7ad None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:13.101701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbbf73-6e13-4ded-9eae-3de5a4046bf8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:13.105600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f59bef-14be-4694-8957-697f09e3c156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:13.106243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f59bef-14be-4694-8957-697f09e3c156 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:13.106517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f59bef-14be-4694-8957-697f09e3c156 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:13.106782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f59bef-14be-4694-8957-697f09e3c156 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:13.116956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f59bef-14be-4694-8957-697f09e3c156 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:13.118403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f59bef-14be-4694-8957-697f09e3c156 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:13.136492 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-48f59bef-14be-4694-8957-697f09e3c156 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:04:13.136492 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:13.136492 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:13.136492 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:13.136492 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:13.136492 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:13.136492 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:13.136492 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:13.136492 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:13.136492 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:13.136492 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:13.136492 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:13.136492 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:13.136492 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:13.136492 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:13.136492 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:13.137513 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:13.138440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:13.138440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:13.138440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:13.138440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:13.138440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:13.138440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:13.138440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:13.138440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:13.138440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:04:13.138440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:13.138440 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 350/679] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:04:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:13.139060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f59bef-14be-4694-8957-697f09e3c156 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:13.147862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc34aba-57b3-470c-b720-c79930720913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:13.149017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc34aba-57b3-470c-b720-c79930720913 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:13.149017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc34aba-57b3-470c-b720-c79930720913 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:13.149017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc34aba-57b3-470c-b720-c79930720913 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:13.149703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc34aba-57b3-470c-b720-c79930720913 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:13.150003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc34aba-57b3-470c-b720-c79930720913 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:13.151474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc34aba-57b3-470c-b720-c79930720913 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:13.171457 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 330/680] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:13.172482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc34aba-57b3-470c-b720-c79930720913 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:13.229808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:13.269978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f59bef-14be-4694-8957-697f09e3c156 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:13.310798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa31d2d-8db1-4300-98cf-1cee1db857e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:13.311365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa31d2d-8db1-4300-98cf-1cee1db857e2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:13.311690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa31d2d-8db1-4300-98cf-1cee1db857e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:13.311962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa31d2d-8db1-4300-98cf-1cee1db857e2 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:13.312660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa31d2d-8db1-4300-98cf-1cee1db857e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:13.312959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa31d2d-8db1-4300-98cf-1cee1db857e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:13.314413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa31d2d-8db1-4300-98cf-1cee1db857e2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:13.314956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc34aba-57b3-470c-b720-c79930720913 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:13.326277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:13.327820 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 351/681] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:13.328726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa31d2d-8db1-4300-98cf-1cee1db857e2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:13.367519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f18ab-ed4b-4862-80e6-176c67bbd2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:13.368803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f18ab-ed4b-4862-80e6-176c67bbd2e2 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:13.370227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f18ab-ed4b-4862-80e6-176c67bbd2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:13.370800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f18ab-ed4b-4862-80e6-176c67bbd2e2 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:13.371784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f18ab-ed4b-4862-80e6-176c67bbd2e2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:13.372304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f18ab-ed4b-4862-80e6-176c67bbd2e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:13.373977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f18ab-ed4b-4862-80e6-176c67bbd2e2 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:13.399035 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 331/682] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 28 18:04:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:13.400846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f18ab-ed4b-4862-80e6-176c67bbd2e2 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:13.461621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa31d2d-8db1-4300-98cf-1cee1db857e2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:13.490700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:13.501662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37205a-5a10-475b-9f0a-159c78db0ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:13.502275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37205a-5a10-475b-9f0a-159c78db0ee1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:13.502551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37205a-5a10-475b-9f0a-159c78db0ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:13.502816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37205a-5a10-475b-9f0a-159c78db0ee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:13.503581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37205a-5a10-475b-9f0a-159c78db0ee1 None admin] RBAC: Adding query filter params (role.id=1e0740decc23460f8c3d0f7007f2d97f, scope.project.id=651b8653291a414fba3805312708ce48, user.id=0b58ca64493247c188c4c77ad75e426a) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:13.503884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37205a-5a10-475b-9f0a-159c78db0ee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:13.505322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37205a-5a10-475b-9f0a-159c78db0ee1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:13.512528 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 352/683] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:04:13 2022] GET /identity/v3/role_assignments?user.id=0b58ca64493247c188c4c77ad75e426a&scope.project.id=651b8653291a414fba3805312708ce48&role.id=1e0740decc23460f8c3d0f7007f2d97f => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:13.513666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37205a-5a10-475b-9f0a-159c78db0ee1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:13.561771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f18ab-ed4b-4862-80e6-176c67bbd2e2 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:13.629189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1760302-e63b-4e62-88ef-c6e5c255b1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:13.629832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760302-e63b-4e62-88ef-c6e5c255b1ee None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:13.630106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760302-e63b-4e62-88ef-c6e5c255b1ee None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:13.630374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760302-e63b-4e62-88ef-c6e5c255b1ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:13.631115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1760302-e63b-4e62-88ef-c6e5c255b1ee None admin] RBAC: Adding query filter params (role.id=1e0740decc23460f8c3d0f7007f2d97f, scope.project.id=651b8653291a414fba3805312708ce48, user.id=6b06f9395d5841b9aa28227d532964eb) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:13.631446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1760302-e63b-4e62-88ef-c6e5c255b1ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:13.633045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1760302-e63b-4e62-88ef-c6e5c255b1ee None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:13.646718 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 332/684] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:04:13 2022] GET /identity/v3/role_assignments?user.id=6b06f9395d5841b9aa28227d532964eb&scope.project.id=651b8653291a414fba3805312708ce48&role.id=1e0740decc23460f8c3d0f7007f2d97f => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:13.701668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37205a-5a10-475b-9f0a-159c78db0ee1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:13.737982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe892d-5327-4211-a7c0-a9451fcddf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:13.738667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe892d-5327-4211-a7c0-a9451fcddf75 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:13.739008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe892d-5327-4211-a7c0-a9451fcddf75 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:13.739150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe892d-5327-4211-a7c0-a9451fcddf75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:13.805551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:13.815503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe892d-5327-4211-a7c0-a9451fcddf75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:13.817481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe892d-5327-4211-a7c0-a9451fcddf75 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:13.898929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad65bb-dde7-45c1-b85a-91fff254b44b None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:13.899521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad65bb-dde7-45c1-b85a-91fff254b44b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:13.899598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad65bb-dde7-45c1-b85a-91fff254b44b None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:13.901099 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 333/685] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:04:13.906684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2084d-458a-4f82-8f87-ea45750f4080 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:13.906971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2084d-458a-4f82-8f87-ea45750f4080 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:13.907247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2084d-458a-4f82-8f87-ea45750f4080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:13.930193 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 353/686] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:04:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:04:13.930410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d3f2084d-458a-4f82-8f87-ea45750f4080 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:13.931991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d3f2084d-458a-4f82-8f87-ea45750f4080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:13.937098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe892d-5327-4211-a7c0-a9451fcddf75 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:13.963194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:14.023102 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 334/687] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:04:14.056736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:14.066085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe892d-5327-4211-a7c0-a9451fcddf75 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:14.101627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e13d42-e3ff-4077-bf73-377ae2b83f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:14.102264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e13d42-e3ff-4077-bf73-377ae2b83f12 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:14.102543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e13d42-e3ff-4077-bf73-377ae2b83f12 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:14.102878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e13d42-e3ff-4077-bf73-377ae2b83f12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:14.113465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e13d42-e3ff-4077-bf73-377ae2b83f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:14.114931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e13d42-e3ff-4077-bf73-377ae2b83f12 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:14.130019 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-45e13d42-e3ff-4077-bf73-377ae2b83f12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:14.130019 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:14.130019 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:14.130019 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:14.130019 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:14.130019 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:14.130019 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:14.130019 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:14.130019 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:14.130019 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:14.130019 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:14.130019 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:14.130019 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:14.130019 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:14.130019 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:14.130019 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:14.131040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:14.131040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:14.131040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:14.131040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:14.131040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:14.131040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:14.131040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:14.131040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:14.131040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:14.131040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:14.131040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:14.131040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:14.131040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:14.131040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:14.131040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:14.131040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:14.131040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:14.131967 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:14.131967 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:14.131967 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:14.131967 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 354/688] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:14.137132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2084d-458a-4f82-8f87-ea45750f4080 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:14.271753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2084d-458a-4f82-8f87-ea45750f4080 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:14.333301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005caf7-4bfa-4e94-9758-c6222177524f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:14.333916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005caf7-4bfa-4e94-9758-c6222177524f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:14.334189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005caf7-4bfa-4e94-9758-c6222177524f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:14.334458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005caf7-4bfa-4e94-9758-c6222177524f None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:14.335110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005caf7-4bfa-4e94-9758-c6222177524f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:14.335435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005caf7-4bfa-4e94-9758-c6222177524f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:14.336799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005caf7-4bfa-4e94-9758-c6222177524f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:14.351070 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 335/689] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:14.356670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e13d42-e3ff-4077-bf73-377ae2b83f12 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:14.397823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005caf7-4bfa-4e94-9758-c6222177524f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:14.421003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:14.524093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e13d42-e3ff-4077-bf73-377ae2b83f12 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:14.556570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005caf7-4bfa-4e94-9758-c6222177524f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:14.564291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f4d5c-7db1-4151-bb82-4b4b61cfceea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:14.564947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f4d5c-7db1-4151-bb82-4b4b61cfceea None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:14.565223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f4d5c-7db1-4151-bb82-4b4b61cfceea None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:14.565495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f4d5c-7db1-4151-bb82-4b4b61cfceea None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:14.579358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f4d5c-7db1-4151-bb82-4b4b61cfceea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:14.580851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f4d5c-7db1-4151-bb82-4b4b61cfceea None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:14.600075 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-bb0f4d5c-7db1-4151-bb82-4b4b61cfceea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:14.600075 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:14.600075 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:14.600075 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:14.600075 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:14.600075 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:14.600075 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:14.600075 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:14.600075 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:14.600075 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:14.600075 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:14.600075 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:14.600075 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:14.600075 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:14.600075 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:14.600999 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:14.600999 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:14.600999 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:14.600999 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:14.600999 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:14.600999 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:14.600999 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:14.600999 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:14.600999 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:14.600999 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:14.600999 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:14.600999 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:14.600999 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:14.600999 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:14.600999 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:14.600999 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:14.600999 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:14.601871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:14.601871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:14.601871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:14.601871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:14.601871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:14.601871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:14.601871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:14.601871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:14.601871 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 355/690] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:14.606655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f4d5c-7db1-4151-bb82-4b4b61cfceea None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:14.614620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:14.647970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec0cde-fa62-499c-bda2-f3c99d1f7b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:14.648618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec0cde-fa62-499c-bda2-f3c99d1f7b41 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:14.648895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec0cde-fa62-499c-bda2-f3c99d1f7b41 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:14.649168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec0cde-fa62-499c-bda2-f3c99d1f7b41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:14.680097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec0cde-fa62-499c-bda2-f3c99d1f7b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:14.681565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec0cde-fa62-499c-bda2-f3c99d1f7b41 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:14.722156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f4d5c-7db1-4151-bb82-4b4b61cfceea None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:14.724683 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-bdec0cde-fa62-499c-bda2-f3c99d1f7b41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:14.724683 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:14.724683 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:14.724683 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:14.724683 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:14.724683 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:14.724683 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:14.724683 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:14.724683 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:14.724683 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:14.724683 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:14.724683 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:14.724683 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:14.724683 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:14.724683 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:14.724683 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:14.725610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:14.725610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:14.725610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:14.725610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:14.725610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:14.725610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:14.725610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:14.725610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:14.725610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:14.725610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:14.725610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:14.725610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:14.725610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:14.725610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:14.725610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:14.725610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:14.725610 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:14.726567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:14.726567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:14.726567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:14.726567 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 336/691] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:14.736453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec0cde-fa62-499c-bda2-f3c99d1f7b41 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:14.765402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0626f-355c-4f93-aab1-5480ea23d056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:14.766483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0626f-355c-4f93-aab1-5480ea23d056 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:14.766815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0626f-355c-4f93-aab1-5480ea23d056 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:14.767097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0626f-355c-4f93-aab1-5480ea23d056 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:14.767911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0626f-355c-4f93-aab1-5480ea23d056 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:14.768218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0626f-355c-4f93-aab1-5480ea23d056 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:14.769847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0626f-355c-4f93-aab1-5480ea23d056 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:14.783479 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 356/692] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:14.792359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0626f-355c-4f93-aab1-5480ea23d056 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:14.896546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:14.922201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:14.961487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec0cde-fa62-499c-bda2-f3c99d1f7b41 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:14.988054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0626f-355c-4f93-aab1-5480ea23d056 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:15.026757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8740c8-d2a4-483a-b7e7-aedf3092a333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:15.027391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8740c8-d2a4-483a-b7e7-aedf3092a333 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:15.027713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8740c8-d2a4-483a-b7e7-aedf3092a333 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:15.027932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8740c8-d2a4-483a-b7e7-aedf3092a333 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:15.028716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8740c8-d2a4-483a-b7e7-aedf3092a333 None admin] RBAC: Adding query filter params (role.id=1e0740decc23460f8c3d0f7007f2d97f, scope.project.id=651b8653291a414fba3805312708ce48, user.id=d55caefe410444509a1eee4262b76c80) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:15.028953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8740c8-d2a4-483a-b7e7-aedf3092a333 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:15.030596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8740c8-d2a4-483a-b7e7-aedf3092a333 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:15.034343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c60be0-35a8-4c9d-8509-37e88e5e36c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:15.034977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c60be0-35a8-4c9d-8509-37e88e5e36c1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:15.035273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c60be0-35a8-4c9d-8509-37e88e5e36c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:15.035544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c60be0-35a8-4c9d-8509-37e88e5e36c1 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:15.036201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c60be0-35a8-4c9d-8509-37e88e5e36c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:15.036502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c60be0-35a8-4c9d-8509-37e88e5e36c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:15.037307 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 357/693] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:04:14 2022] GET /identity/v3/role_assignments?user.id=d55caefe410444509a1eee4262b76c80&scope.project.id=651b8653291a414fba3805312708ce48&role.id=1e0740decc23460f8c3d0f7007f2d97f => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:15.037961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c60be0-35a8-4c9d-8509-37e88e5e36c1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:15.061403 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 337/694] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:15.066906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8740c8-d2a4-483a-b7e7-aedf3092a333 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:15.215396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8740c8-d2a4-483a-b7e7-aedf3092a333 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:15.257271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:15.267830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f49b10-fd2a-45d0-af20-dff194fc8a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:15.268655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f49b10-fd2a-45d0-af20-dff194fc8a9c None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:15.268933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f49b10-fd2a-45d0-af20-dff194fc8a9c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:15.269272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f49b10-fd2a-45d0-af20-dff194fc8a9c None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:15.270053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f49b10-fd2a-45d0-af20-dff194fc8a9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:15.271589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f49b10-fd2a-45d0-af20-dff194fc8a9c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:15.283123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280de6c-dcdf-440e-87b5-024b95a118d9 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:15.283488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280de6c-dcdf-440e-87b5-024b95a118d9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:15.283708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280de6c-dcdf-440e-87b5-024b95a118d9 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:15.285110 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 338/695] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:04:15.291053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcd497-4128-4df9-917c-fe8cf6d93f1e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:15.291439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcd497-4128-4df9-917c-fe8cf6d93f1e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:15.291717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcd497-4128-4df9-917c-fe8cf6d93f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:15.304836 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 358/696] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:04:15 2022] POST /identity/v3/users => generated 254 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:04:15.316861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-17bcd497-4128-4df9-917c-fe8cf6d93f1e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:15.318179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-17bcd497-4128-4df9-917c-fe8cf6d93f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:15.403347 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 339/697] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:04:15.680376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f49b10-fd2a-45d0-af20-dff194fc8a9c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:15.823158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f49b10-fd2a-45d0-af20-dff194fc8a9c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:15.868886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14679183-e232-493e-bef5-d82bf701e129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:15.869536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14679183-e232-493e-bef5-d82bf701e129 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:15.869810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14679183-e232-493e-bef5-d82bf701e129 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:15.870077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14679183-e232-493e-bef5-d82bf701e129 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:15.880751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14679183-e232-493e-bef5-d82bf701e129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:15.886409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-14679183-e232-493e-bef5-d82bf701e129 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:04:15.886409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:15.886409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:15.886409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:15.886409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:15.886409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:15.886409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:15.886409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:15.886409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:15.886409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:15.886409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:15.886409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:15.886409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:15.886409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:15.886409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:15.886409 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:15.887364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:15.887364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:15.887364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:15.887364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:15.887364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:15.887364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:15.887364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:15.887364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:15.887364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:15.887364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:15.887364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:15.887364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:15.887364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:15.887364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:15.887364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:15.887364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:15.888383 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:15.888383 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:15.888383 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:15.888383 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:15.888383 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:15.888383 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:15.888383 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:15.888383 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:15.888383 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:15.888383 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:15.888383 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:04:15.888383 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:15.888383 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 359/698] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:04:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:15.896382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcd497-4128-4df9-917c-fe8cf6d93f1e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:15.919430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a2f7c-cc01-4d79-895a-cd8d9d5824dc None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:15.919747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a2f7c-cc01-4d79-895a-cd8d9d5824dc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:15.919983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a2f7c-cc01-4d79-895a-cd8d9d5824dc None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:15.921579 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 360/699] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:04:15.927144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8d62d-539e-423d-b15c-fd1e5929a28c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:15.927478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8d62d-539e-423d-b15c-fd1e5929a28c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:15.927834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8d62d-539e-423d-b15c-fd1e5929a28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:15.947053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-84b8d62d-539e-423d-b15c-fd1e5929a28c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:15.948261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-84b8d62d-539e-423d-b15c-fd1e5929a28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:16.005287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:16.027743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:16.057660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcd497-4128-4df9-917c-fe8cf6d93f1e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:16.099847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce629f8f-d06d-4491-b25a-e98141a43e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:16.100819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce629f8f-d06d-4491-b25a-e98141a43e19 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:16.101317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce629f8f-d06d-4491-b25a-e98141a43e19 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:16.101787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce629f8f-d06d-4491-b25a-e98141a43e19 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:16.102654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce629f8f-d06d-4491-b25a-e98141a43e19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:16.103159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce629f8f-d06d-4491-b25a-e98141a43e19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:16.104920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce629f8f-d06d-4491-b25a-e98141a43e19 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:16.109955 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 361/700] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:04:16.121515 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 340/701] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:04:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:16.126583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8d62d-539e-423d-b15c-fd1e5929a28c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:16.266451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8d62d-539e-423d-b15c-fd1e5929a28c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:16.306692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd8739-ac0a-4d1b-9aee-ecbf64c9f233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:16.307371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd8739-ac0a-4d1b-9aee-ecbf64c9f233 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:16.307650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd8739-ac0a-4d1b-9aee-ecbf64c9f233 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:16.307974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd8739-ac0a-4d1b-9aee-ecbf64c9f233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:16.319196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd8739-ac0a-4d1b-9aee-ecbf64c9f233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:16.320700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd8739-ac0a-4d1b-9aee-ecbf64c9f233 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:16.341085 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-dbbd8739-ac0a-4d1b-9aee-ecbf64c9f233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:16.341085 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:16.341085 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:16.341085 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:16.341085 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:16.341085 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:16.341085 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:16.341085 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:16.341085 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:16.341085 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:16.341085 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:16.341085 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:16.341085 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:16.341085 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:16.341085 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:16.341085 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:16.342088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:16.342088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:16.342088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:16.342088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:16.342088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:16.342088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:16.342088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:16.342088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:16.342088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:16.342088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:16.342088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:16.342088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:16.342088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:16.342088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:16.342088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:16.342088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:16.342088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:16.343683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:16.343683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:16.343683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:16.343683 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 362/702] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:16.348223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce629f8f-d06d-4491-b25a-e98141a43e19 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:16.444717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd8739-ac0a-4d1b-9aee-ecbf64c9f233 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:16.488531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce629f8f-d06d-4491-b25a-e98141a43e19 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:16.502435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:16.527449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:16.544276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776b104-63b3-4c55-b05b-df85bacbfe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:16.545054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776b104-63b3-4c55-b05b-df85bacbfe9b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:16.545433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776b104-63b3-4c55-b05b-df85bacbfe9b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:16.545812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776b104-63b3-4c55-b05b-df85bacbfe9b None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:16.546595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776b104-63b3-4c55-b05b-df85bacbfe9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:16.547244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776b104-63b3-4c55-b05b-df85bacbfe9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:16.549328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776b104-63b3-4c55-b05b-df85bacbfe9b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:16.574412 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 341/703] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:16.576702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132427b-12fe-49ca-a93f-9c97a004e5e5 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:16.577052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132427b-12fe-49ca-a93f-9c97a004e5e5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:16.577416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132427b-12fe-49ca-a93f-9c97a004e5e5 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:16.578792 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 342/704] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:16.580110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132427b-12fe-49ca-a93f-9c97a004e5e5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:16.666396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd8739-ac0a-4d1b-9aee-ecbf64c9f233 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:16.705713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ca5b6-43b5-4ab8-9ca9-551acc20f1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:16.706317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ca5b6-43b5-4ab8-9ca9-551acc20f1e4 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:16.706597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ca5b6-43b5-4ab8-9ca9-551acc20f1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:16.706865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ca5b6-43b5-4ab8-9ca9-551acc20f1e4 None admin] PATH_INFO: `/v3/services/network` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:16.707560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ca5b6-43b5-4ab8-9ca9-551acc20f1e4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:16.708950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ca5b6-43b5-4ab8-9ca9-551acc20f1e4 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:16.722688 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-5d1ca5b6-43b5-4ab8-9ca9-551acc20f1e4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:04:16.722688 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:16.722688 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:16.722688 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:16.722688 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:16.722688 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:16.722688 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:16.722688 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:16.722688 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:04:16.722688 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:16.722688 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:16.722688 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:16.722688 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:16.722688 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:16.722688 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:16.722688 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:16.722688 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:16.723984 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:16.723984 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:16.723984 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:16.723984 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:16.723984 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:16.723984 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:16.723984 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:16.723984 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:16.723984 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:16.723984 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:16.723984 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:16.723984 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:16.723984 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:16.723984 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:16.723984 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:16.723984 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:16.724819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:16.724819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:16.724819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:16.724819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:16.724819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:16.724819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:16.724819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:16.724819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:16.724819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:16.724819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:16.724819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:16.724819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:16.724819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:04:16.724819 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:16.728914 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 363/705] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:16 2022] GET /identity/v3/services/network => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:16.730441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d52cf-9da4-4611-87e3-9c9dbd768ef2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:16.730706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d52cf-9da4-4611-87e3-9c9dbd768ef2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:16.730978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d52cf-9da4-4611-87e3-9c9dbd768ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:16.742376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132427b-12fe-49ca-a93f-9c97a004e5e5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:16.750213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-486d52cf-9da4-4611-87e3-9c9dbd768ef2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:16.751437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-486d52cf-9da4-4611-87e3-9c9dbd768ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:16.790127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a4c6b-9e20-427f-a3c2-7ac04a9f0a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:16.790890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a4c6b-9e20-427f-a3c2-7ac04a9f0a09 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:16.791216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a4c6b-9e20-427f-a3c2-7ac04a9f0a09 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:16.791517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a4c6b-9e20-427f-a3c2-7ac04a9f0a09 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:16.800607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a4c6b-9e20-427f-a3c2-7ac04a9f0a09 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:16.802268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a4c6b-9e20-427f-a3c2-7ac04a9f0a09 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:16.815692 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-414a4c6b-9e20-427f-a3c2-7ac04a9f0a09 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:04:16.815692 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:16.815692 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:16.815692 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:16.815692 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:16.815692 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:16.815692 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:16.815692 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:16.815692 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:16.815692 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:16.815692 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:16.815692 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:16.815692 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:16.815692 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:16.815692 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:16.815692 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:16.817954 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:16.820200 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:16.820200 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:16.820200 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:16.820200 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:16.820200 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:16.820200 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:16.820200 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:16.820200 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:16.820200 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:04:16.820200 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:16.820200 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 343/706] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 18:04:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:16.820200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a4c6b-9e20-427f-a3c2-7ac04a9f0a09 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:16.831485 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 364/707] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:04:16.832574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d52cf-9da4-4611-87e3-9c9dbd768ef2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:16.867593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:16.873420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:16.947743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a4c6b-9e20-427f-a3c2-7ac04a9f0a09 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:16.977566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d52cf-9da4-4611-87e3-9c9dbd768ef2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:17.017952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a372bf-207b-4c7e-bdc6-a38fd126cc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:17.018559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a372bf-207b-4c7e-bdc6-a38fd126cc9a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:17.018835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a372bf-207b-4c7e-bdc6-a38fd126cc9a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:17.019107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a372bf-207b-4c7e-bdc6-a38fd126cc9a None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:17.019952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a372bf-207b-4c7e-bdc6-a38fd126cc9a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:17.020257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a372bf-207b-4c7e-bdc6-a38fd126cc9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:17.021697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a372bf-207b-4c7e-bdc6-a38fd126cc9a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:17.045611 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 365/708] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 18:04:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:17.046946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd0a12-664d-45c6-8636-62fe196f1495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:17.047608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd0a12-664d-45c6-8636-62fe196f1495 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:17.047891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd0a12-664d-45c6-8636-62fe196f1495 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:17.048164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd0a12-664d-45c6-8636-62fe196f1495 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:17.048810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd0a12-664d-45c6-8636-62fe196f1495 None admin] RBAC: Adding query filter params (name=network) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:17.049110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd0a12-664d-45c6-8636-62fe196f1495 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:17.050582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd0a12-664d-45c6-8636-62fe196f1495 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:17.050991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a372bf-207b-4c7e-bdc6-a38fd126cc9a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:17.057036 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 344/709] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 18:04:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:17.065317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd0a12-664d-45c6-8636-62fe196f1495 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:17.155359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:17.191162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a372bf-207b-4c7e-bdc6-a38fd126cc9a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:17.239363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3385de7-72b4-4904-922f-19353ab70dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:17.239363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3385de7-72b4-4904-922f-19353ab70dbd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:17.239363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3385de7-72b4-4904-922f-19353ab70dbd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:17.239363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3385de7-72b4-4904-922f-19353ab70dbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:17.285373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd0a12-664d-45c6-8636-62fe196f1495 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:17.293459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:17.317846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3385de7-72b4-4904-922f-19353ab70dbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:17.319753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3385de7-72b4-4904-922f-19353ab70dbd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:17.322566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ee8c2-db90-47bf-8214-a31880da354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:17.323347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ee8c2-db90-47bf-8214-a31880da354d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:17.324228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ee8c2-db90-47bf-8214-a31880da354d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:17.324228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ee8c2-db90-47bf-8214-a31880da354d None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:17.324491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ee8c2-db90-47bf-8214-a31880da354d None admin] RBAC: Adding query filter params (type=network) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:17.324789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ee8c2-db90-47bf-8214-a31880da354d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:17.326174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ee8c2-db90-47bf-8214-a31880da354d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:17.339707 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 345/710] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 18:04:17 2022] GET /identity/v3/services?type=network => generated 124 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:17.340985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ee8c2-db90-47bf-8214-a31880da354d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:17.423860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:17.456586 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 366/711] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:04:17.462846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3385de7-72b4-4904-922f-19353ab70dbd None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:17.586491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ee8c2-db90-47bf-8214-a31880da354d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:17.607104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3385de7-72b4-4904-922f-19353ab70dbd None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:17.632856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199efb3-813a-40cc-be94-756fb9785075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:17.633504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199efb3-813a-40cc-be94-756fb9785075 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:17.633788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199efb3-813a-40cc-be94-756fb9785075 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:17.634057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199efb3-813a-40cc-be94-756fb9785075 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:17.634962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199efb3-813a-40cc-be94-756fb9785075 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:17.636530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199efb3-813a-40cc-be94-756fb9785075 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:17.650555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-4199efb3-813a-40cc-be94-756fb9785075 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:04:17.650555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:17.650555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:17.650555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:17.650555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:17.650555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:17.650555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:17.650555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:17.650555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:04:17.650555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:17.650555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:17.650555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:17.650555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:17.650555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:17.650555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:17.650555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:17.650555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:17.651996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:17.651996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:17.651996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:17.651996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:17.651996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:17.651996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:17.651996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:17.651996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:17.651996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:17.651996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:17.651996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:17.651996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:17.651996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:17.651996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:17.651996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:17.651996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:17.652829 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:17.652829 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:17.652829 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:17.652829 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:17.652829 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:17.652829 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:17.652829 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:17.652829 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:17.652829 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:17.652829 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:17.652829 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:17.652829 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:17.652829 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:04:17.652829 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:17.656156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efd9ec-a687-43f0-873d-bcbea9ba8ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:17.656622 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 346/712] 10.222.0.27 () {56 vars in 1129 bytes} [Sun Aug 28 18:04:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:17.657745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efd9ec-a687-43f0-873d-bcbea9ba8ba5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:17.658010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9115b-99c0-4a3d-a2fd-dff74352e261 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:17.658256 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9115b-99c0-4a3d-a2fd-dff74352e261 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:17.658537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9115b-99c0-4a3d-a2fd-dff74352e261 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:17.659141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efd9ec-a687-43f0-873d-bcbea9ba8ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:17.659695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efd9ec-a687-43f0-873d-bcbea9ba8ba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:17.660137 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 347/713] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:17.660846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9115b-99c0-4a3d-a2fd-dff74352e261 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:17.675934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efd9ec-a687-43f0-873d-bcbea9ba8ba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:17.677406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efd9ec-a687-43f0-873d-bcbea9ba8ba5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:17.694742 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e1efd9ec-a687-43f0-873d-bcbea9ba8ba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:17.694742 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:17.694742 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:17.694742 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:17.694742 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:17.694742 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:17.694742 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:17.694742 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:17.694742 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:17.694742 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:17.694742 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:17.694742 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:17.694742 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:17.694742 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:17.694742 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:17.694742 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:17.695878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:17.695878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:17.695878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:17.695878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:17.695878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:17.695878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:17.695878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:17.695878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:17.695878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:17.695878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:17.695878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:17.695878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:17.695878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:17.695878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:17.695878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:17.695878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:17.695878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:17.696748 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:17.696748 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:17.696748 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:17.700688 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 367/714] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:17.702220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0115e9c-cd8c-46ac-9003-6120691fa791 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:17.702512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0115e9c-cd8c-46ac-9003-6120691fa791 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:17.702789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0115e9c-cd8c-46ac-9003-6120691fa791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:17.711985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:17.724448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b0115e9c-cd8c-46ac-9003-6120691fa791 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:17.725533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0115e9c-cd8c-46ac-9003-6120691fa791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:17.753710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:17.790113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9115b-99c0-4a3d-a2fd-dff74352e261 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:17.804972 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 368/715] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:04:17.805850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0115e9c-cd8c-46ac-9003-6120691fa791 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:17.836866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f0bcc-5bdd-4c21-a7d0-0ca42500b467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:17.837710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f0bcc-5bdd-4c21-a7d0-0ca42500b467 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:17.838164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f0bcc-5bdd-4c21-a7d0-0ca42500b467 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:17.838515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f0bcc-5bdd-4c21-a7d0-0ca42500b467 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:17.839466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f0bcc-5bdd-4c21-a7d0-0ca42500b467 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:17.839977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f0bcc-5bdd-4c21-a7d0-0ca42500b467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:17.841455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f0bcc-5bdd-4c21-a7d0-0ca42500b467 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:17.851097 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 348/716] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 28 18:04:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:17.851097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1594a-e8cc-457f-ae2e-752f28b056ba None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:17.851097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1594a-e8cc-457f-ae2e-752f28b056ba None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:17.851097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1594a-e8cc-457f-ae2e-752f28b056ba None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:17.851097 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 349/717] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:17.852226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1594a-e8cc-457f-ae2e-752f28b056ba None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:17.948238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0115e9c-cd8c-46ac-9003-6120691fa791 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:17.972371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:17.980237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1594a-e8cc-457f-ae2e-752f28b056ba None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:18.002918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c95b9e-d89d-4635-8214-4540ab66fa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:18.004196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c95b9e-d89d-4635-8214-4540ab66fa8a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:18.004683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c95b9e-d89d-4635-8214-4540ab66fa8a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:18.005098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c95b9e-d89d-4635-8214-4540ab66fa8a None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:18.006609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c95b9e-d89d-4635-8214-4540ab66fa8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:18.007087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c95b9e-d89d-4635-8214-4540ab66fa8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:18.008779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c95b9e-d89d-4635-8214-4540ab66fa8a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:18.031574 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 369/718] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:18.031574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5fb89-69f0-4bdb-a203-2c7dbc35228b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:18.031574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5fb89-69f0-4bdb-a203-2c7dbc35228b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:18.031574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5fb89-69f0-4bdb-a203-2c7dbc35228b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:18.032625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151feeab-d924-4940-a5e4-ef3750aab412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:18.033676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151feeab-d924-4940-a5e4-ef3750aab412 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:18.034154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151feeab-d924-4940-a5e4-ef3750aab412 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:18.034616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151feeab-d924-4940-a5e4-ef3750aab412 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:18.035612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151feeab-d924-4940-a5e4-ef3750aab412 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:18.036130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151feeab-d924-4940-a5e4-ef3750aab412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:18.038921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151feeab-d924-4940-a5e4-ef3750aab412 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:18.051926 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 350/719] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 28 18:04:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:18.051926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151feeab-d924-4940-a5e4-ef3750aab412 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:18.061730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d3d5fb89-69f0-4bdb-a203-2c7dbc35228b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:18.065667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3d5fb89-69f0-4bdb-a203-2c7dbc35228b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:18.112806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:18.181660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151feeab-d924-4940-a5e4-ef3750aab412 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:18.193694 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 370/720] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:04:18.195057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5fb89-69f0-4bdb-a203-2c7dbc35228b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:18.239867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d816a-a902-45af-9b7f-0edeff843b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:18.240506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d816a-a902-45af-9b7f-0edeff843b6d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:18.240778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d816a-a902-45af-9b7f-0edeff843b6d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:18.241048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d816a-a902-45af-9b7f-0edeff843b6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:18.248320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d816a-a902-45af-9b7f-0edeff843b6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:18.250279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d816a-a902-45af-9b7f-0edeff843b6d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:18.262286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-a12d816a-a902-45af-9b7f-0edeff843b6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:18.262286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:18.262286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:18.262286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:18.262286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:18.262286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:18.262286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:18.262286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:18.262286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:18.262286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:18.262286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:18.262286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:18.262286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:18.262286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:18.262286 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:18.263366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:18.263366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:18.263366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:18.263366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:18.263366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:18.263366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:18.263366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:18.263366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:18.263366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:18.263366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:18.263366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:18.263366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:18.263366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:18.263366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:18.263366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:18.263366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:18.263366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:18.264312 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:18.264312 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:18.264312 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:18.264312 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:18.264312 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:18.264312 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:18.264312 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:18.264312 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:18.264312 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 351/721] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:18.269437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d816a-a902-45af-9b7f-0edeff843b6d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:18.297947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:18.314965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5fb89-69f0-4bdb-a203-2c7dbc35228b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:18.353498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c4e36-a23d-4577-8e69-607d4997a3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:18.354570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c4e36-a23d-4577-8e69-607d4997a3ce None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:18.355073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c4e36-a23d-4577-8e69-607d4997a3ce None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:18.355566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c4e36-a23d-4577-8e69-607d4997a3ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:18.367304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c4e36-a23d-4577-8e69-607d4997a3ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:18.372599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-911c4e36-a23d-4577-8e69-607d4997a3ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:04:18.372599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:18.372599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:18.372599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:18.372599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:18.372599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:18.372599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:18.372599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:18.372599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:18.372599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:18.372599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:18.372599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:18.372599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:18.372599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:18.372599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:18.372599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:18.373572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:18.373572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:18.373572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:18.373572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:18.373572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:18.373572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:18.373572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:18.373572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:18.373572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:18.373572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:18.373572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:18.373572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:18.373572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:18.373572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:18.373572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:18.373572 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:18.374408 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:18.374408 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:18.374408 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:18.374408 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:18.374408 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:18.374408 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:18.374408 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:18.374408 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:18.374408 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:18.374408 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:18.374408 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:04:18.374408 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:18.377145 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 371/722] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:04:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:18.384786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c4e36-a23d-4577-8e69-607d4997a3ce None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:18.413324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:18.501344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d816a-a902-45af-9b7f-0edeff843b6d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:18.585332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a426c75-f03e-4399-9d44-4c5d4c2a4b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:18.586341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426c75-f03e-4399-9d44-4c5d4c2a4b0f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:18.586810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426c75-f03e-4399-9d44-4c5d4c2a4b0f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:18.587299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426c75-f03e-4399-9d44-4c5d4c2a4b0f None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:18.588220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a426c75-f03e-4399-9d44-4c5d4c2a4b0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:18.588714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a426c75-f03e-4399-9d44-4c5d4c2a4b0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:18.590442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a426c75-f03e-4399-9d44-4c5d4c2a4b0f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:18.596240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c4e36-a23d-4577-8e69-607d4997a3ce None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:18.619609 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 352/723] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:18.624927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a426c75-f03e-4399-9d44-4c5d4c2a4b0f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:18.667443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b54e0f-aaba-4f69-a098-aabf03996f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:18.668457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b54e0f-aaba-4f69-a098-aabf03996f82 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:18.669579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b54e0f-aaba-4f69-a098-aabf03996f82 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:18.670040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b54e0f-aaba-4f69-a098-aabf03996f82 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:18.671134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b54e0f-aaba-4f69-a098-aabf03996f82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:18.671915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b54e0f-aaba-4f69-a098-aabf03996f82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:18.674628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b54e0f-aaba-4f69-a098-aabf03996f82 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:18.691617 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 372/724] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:04:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:18.696045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b54e0f-aaba-4f69-a098-aabf03996f82 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:18.770123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:18.792438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a426c75-f03e-4399-9d44-4c5d4c2a4b0f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:18.800050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:18.835056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269c13a-e05b-4d5f-988d-9fb6e7e5ee65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:18.836164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269c13a-e05b-4d5f-988d-9fb6e7e5ee65 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:18.836636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269c13a-e05b-4d5f-988d-9fb6e7e5ee65 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:18.837169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269c13a-e05b-4d5f-988d-9fb6e7e5ee65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:18.838155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269c13a-e05b-4d5f-988d-9fb6e7e5ee65 None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=651b8653291a414fba3805312708ce48, user.id=faef473a2ab84661b09f3ba3dd977058) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:18.838702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269c13a-e05b-4d5f-988d-9fb6e7e5ee65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:18.839836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b54e0f-aaba-4f69-a098-aabf03996f82 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:18.840699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269c13a-e05b-4d5f-988d-9fb6e7e5ee65 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:18.848779 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 353/725] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:04:18 2022] GET /identity/v3/role_assignments?user.id=faef473a2ab84661b09f3ba3dd977058&scope.project.id=651b8653291a414fba3805312708ce48&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:18.850322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269c13a-e05b-4d5f-988d-9fb6e7e5ee65 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:18.883093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfb60a-f66b-40a8-95a4-43948f407b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:18.883695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfb60a-f66b-40a8-95a4-43948f407b7f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:18.883970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfb60a-f66b-40a8-95a4-43948f407b7f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:18.884562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfb60a-f66b-40a8-95a4-43948f407b7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:18.900394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfb60a-f66b-40a8-95a4-43948f407b7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:18.903788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfb60a-f66b-40a8-95a4-43948f407b7f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:18.935972 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a8dfb60a-f66b-40a8-95a4-43948f407b7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:18.935972 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:18.935972 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:18.935972 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:18.935972 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:18.935972 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:18.935972 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:18.935972 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:18.935972 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:18.935972 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:18.935972 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:18.935972 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:18.935972 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:18.935972 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:18.935972 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:18.935972 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:18.937938 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:18.937938 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:18.937938 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:18.937938 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:18.937938 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:18.937938 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:18.937938 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:18.937938 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:18.937938 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:18.937938 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:18.937938 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:18.937938 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:18.937938 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:18.937938 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:18.937938 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:18.937938 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:18.937938 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:18.939233 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:18.939233 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:18.939233 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:18.939233 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 373/726] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:18.948280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfb60a-f66b-40a8-95a4-43948f407b7f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:19.065860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269c13a-e05b-4d5f-988d-9fb6e7e5ee65 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:19.102803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfb60a-f66b-40a8-95a4-43948f407b7f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:19.105398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac518e-ede2-461e-a7f7-e0604f458ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:19.106283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac518e-ede2-461e-a7f7-e0604f458ac8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:19.106765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac518e-ede2-461e-a7f7-e0604f458ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:19.107232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac518e-ede2-461e-a7f7-e0604f458ac8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:19.119520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac518e-ede2-461e-a7f7-e0604f458ac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:19.126139 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-0fac518e-ede2-461e-a7f7-e0604f458ac8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:19.126139 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:19.126139 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:19.126139 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:19.126139 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:19.126139 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:19.126139 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:19.126139 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:19.126139 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:19.126139 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:19.126139 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:19.126139 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:19.126139 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:19.126139 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:19.126139 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:19.126139 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:19.127102 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:19.127102 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:19.127102 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:19.127102 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:19.127102 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:19.127102 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:19.127102 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:19.127102 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:19.127102 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:19.127102 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:19.127102 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:19.127102 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:19.127102 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:19.127102 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:19.127102 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:19.127102 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:19.128074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:19.128074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:19.128074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:19.128074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:19.128074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:19.128074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:19.128074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:19.128074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:19.128074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:19.128074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:19.128074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:19.128074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:19.128878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:19.135173 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 354/727] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:04:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:19.137746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac518e-ede2-461e-a7f7-e0604f458ac8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:19.141196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b10b7-3dc3-4c9e-89c1-49d254bd9985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:19.142013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b10b7-3dc3-4c9e-89c1-49d254bd9985 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:19.142432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b10b7-3dc3-4c9e-89c1-49d254bd9985 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:19.143649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b10b7-3dc3-4c9e-89c1-49d254bd9985 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:19.143773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b10b7-3dc3-4c9e-89c1-49d254bd9985 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:19.144162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b10b7-3dc3-4c9e-89c1-49d254bd9985 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:19.145630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b10b7-3dc3-4c9e-89c1-49d254bd9985 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:19.155317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:19.162649 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 374/728] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:19.167788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b10b7-3dc3-4c9e-89c1-49d254bd9985 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:19.278254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b10b7-3dc3-4c9e-89c1-49d254bd9985 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:19.314862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb992f-d50c-4442-bf40-3729ae0fc7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:19.316820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb992f-d50c-4442-bf40-3729ae0fc7b7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:19.317296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb992f-d50c-4442-bf40-3729ae0fc7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:19.322336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb992f-d50c-4442-bf40-3729ae0fc7b7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:19.335288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb992f-d50c-4442-bf40-3729ae0fc7b7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:19.338658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb992f-d50c-4442-bf40-3729ae0fc7b7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:19.364430 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-72cb992f-d50c-4442-bf40-3729ae0fc7b7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:04:19.364430 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:19.364430 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:19.364430 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:19.364430 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:19.364430 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:19.364430 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:19.364430 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:19.364430 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:19.364430 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:19.364430 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:19.364430 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:19.364430 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:19.364430 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:19.364430 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:19.364430 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:19.365640 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:19.366548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:19.366548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:19.366548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:19.366548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:19.366548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:19.366548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:19.366548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:19.366548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:19.366548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:04:19.366548 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:19.372298 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 375/729] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:04:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:19.376449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac518e-ede2-461e-a7f7-e0604f458ac8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:19.377575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb992f-d50c-4442-bf40-3729ae0fc7b7 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:19.437007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:19.480046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1fe34-6525-4563-9ba3-c39e27451b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:19.480680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1fe34-6525-4563-9ba3-c39e27451b37 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:19.481018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1fe34-6525-4563-9ba3-c39e27451b37 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:19.481232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1fe34-6525-4563-9ba3-c39e27451b37 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:19.481918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1fe34-6525-4563-9ba3-c39e27451b37 None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:19.482222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1fe34-6525-4563-9ba3-c39e27451b37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:19.483651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1fe34-6525-4563-9ba3-c39e27451b37 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:19.490461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb992f-d50c-4442-bf40-3729ae0fc7b7 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:19.499114 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 355/730] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:04:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:19.504599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1fe34-6525-4563-9ba3-c39e27451b37 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:19.529666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7baad02-1bc6-463e-bbe9-590c2f33b976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:19.530679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baad02-1bc6-463e-bbe9-590c2f33b976 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:19.531432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baad02-1bc6-463e-bbe9-590c2f33b976 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:19.532029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baad02-1bc6-463e-bbe9-590c2f33b976 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:19.532967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7baad02-1bc6-463e-bbe9-590c2f33b976 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:19.533407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7baad02-1bc6-463e-bbe9-590c2f33b976 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:19.535281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7baad02-1bc6-463e-bbe9-590c2f33b976 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:19.558570 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 376/731] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 28 18:04:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:19.563438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c744-8150-45b0-a57e-c023972631eb None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:19.563438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c744-8150-45b0-a57e-c023972631eb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:19.563438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c744-8150-45b0-a57e-c023972631eb None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:19.563438 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 377/732] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:19.564639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968c744-8150-45b0-a57e-c023972631eb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:19.597705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:19.651811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1fe34-6525-4563-9ba3-c39e27451b37 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:19.692367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968c744-8150-45b0-a57e-c023972631eb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:19.694595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:19.698454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a195bbb-4b71-4f2b-929c-f1a276c58bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:19.699518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a195bbb-4b71-4f2b-929c-f1a276c58bae None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:19.699940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a195bbb-4b71-4f2b-929c-f1a276c58bae None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:19.700368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a195bbb-4b71-4f2b-929c-f1a276c58bae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:19.713301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a195bbb-4b71-4f2b-929c-f1a276c58bae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:19.715294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a195bbb-4b71-4f2b-929c-f1a276c58bae None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:19.732831 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-5a195bbb-4b71-4f2b-929c-f1a276c58bae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:19.732831 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:19.732831 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:19.732831 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:19.732831 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:19.732831 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:19.732831 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:19.732831 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:19.732831 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:19.732831 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:19.732831 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:19.732831 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:19.732831 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:19.732831 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:19.732831 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:19.732831 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:19.733876 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:19.733876 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:19.733876 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:19.733876 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:19.733876 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:19.733876 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:19.733876 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:19.733876 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:19.733876 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:19.733876 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:19.733876 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:19.733876 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:19.733876 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:19.733876 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:19.733876 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:19.733876 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:19.733876 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:19.734754 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:19.734754 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:19.734754 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:19.735530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582fb10-a2de-45b0-b933-85bb3da450ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:19.736159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582fb10-a2de-45b0-b933-85bb3da450ef None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:19.736444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582fb10-a2de-45b0-b933-85bb3da450ef None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:19.736721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582fb10-a2de-45b0-b933-85bb3da450ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:19.737876 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 356/733] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:19.739565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdd60c-d2e3-4d5a-9e04-d5ba5dbeec40 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:19.740090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdd60c-d2e3-4d5a-9e04-d5ba5dbeec40 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:19.740564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdd60c-d2e3-4d5a-9e04-d5ba5dbeec40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:19.760372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c3fdd60c-d2e3-4d5a-9e04-d5ba5dbeec40 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:19.762116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c3fdd60c-d2e3-4d5a-9e04-d5ba5dbeec40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:19.831333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582fb10-a2de-45b0-b933-85bb3da450ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:19.833464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582fb10-a2de-45b0-b933-85bb3da450ef None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:19.837541 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 357/734] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:04:19.838757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdd60c-d2e3-4d5a-9e04-d5ba5dbeec40 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:19.918217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:19.972535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdd60c-d2e3-4d5a-9e04-d5ba5dbeec40 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:20.011472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b0d9b-ec62-4c14-89aa-69bb9b23d2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:20.012095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b0d9b-ec62-4c14-89aa-69bb9b23d2cd None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:20.012375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b0d9b-ec62-4c14-89aa-69bb9b23d2cd None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:20.012646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b0d9b-ec62-4c14-89aa-69bb9b23d2cd None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:20.013308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b0d9b-ec62-4c14-89aa-69bb9b23d2cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:20.013669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b0d9b-ec62-4c14-89aa-69bb9b23d2cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:20.015106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b0d9b-ec62-4c14-89aa-69bb9b23d2cd None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:20.028156 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 358/735] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:20.033603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b0d9b-ec62-4c14-89aa-69bb9b23d2cd None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:20.143806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b0d9b-ec62-4c14-89aa-69bb9b23d2cd None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:20.151194 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 378/736] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:04:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:04:20.152881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582fb10-a2de-45b0-b933-85bb3da450ef None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:20.155902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:20.162630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:20.194191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa40ebb-9c11-4356-a634-7f3045226aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:20.194879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa40ebb-9c11-4356-a634-7f3045226aee None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:20.195161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa40ebb-9c11-4356-a634-7f3045226aee None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:20.195461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa40ebb-9c11-4356-a634-7f3045226aee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:20.209062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa40ebb-9c11-4356-a634-7f3045226aee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:20.211049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa40ebb-9c11-4356-a634-7f3045226aee None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:20.227880 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-3aa40ebb-9c11-4356-a634-7f3045226aee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:04:20.227880 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:20.227880 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:20.227880 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:20.227880 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:20.227880 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:20.227880 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:20.227880 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:20.227880 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:20.227880 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:20.227880 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:20.227880 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:20.227880 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:20.227880 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:20.227880 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:20.227880 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:20.228851 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:20.230233 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:20.230233 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:20.230233 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:20.230233 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:20.230233 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:20.230233 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:20.230233 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:20.230233 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:20.230233 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:04:20.230233 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:20.230233 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 359/737] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 18:04:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:20.230233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa40ebb-9c11-4356-a634-7f3045226aee None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:20.282416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582fb10-a2de-45b0-b933-85bb3da450ef None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:20.335892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcbf97-10a9-4b88-abfc-0ffa90c39c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:20.336528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcbf97-10a9-4b88-abfc-0ffa90c39c23 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:20.336926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcbf97-10a9-4b88-abfc-0ffa90c39c23 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:20.337075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcbf97-10a9-4b88-abfc-0ffa90c39c23 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:20.337744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bcbf97-10a9-4b88-abfc-0ffa90c39c23 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:20.339150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bcbf97-10a9-4b88-abfc-0ffa90c39c23 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:20.367293 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 379/738] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 18:04:20 2022] POST /identity/v3/services => generated 240 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:04:20.367293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcbf97-10a9-4b88-abfc-0ffa90c39c23 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:20.444626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa40ebb-9c11-4356-a634-7f3045226aee None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:20.505212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:20.538311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364dc2d-100d-43a0-9127-96554acfa484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:20.539469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364dc2d-100d-43a0-9127-96554acfa484 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:20.539994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364dc2d-100d-43a0-9127-96554acfa484 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:20.540427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364dc2d-100d-43a0-9127-96554acfa484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:20.561939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcbf97-10a9-4b88-abfc-0ffa90c39c23 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:20.564669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364dc2d-100d-43a0-9127-96554acfa484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:20.567657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364dc2d-100d-43a0-9127-96554acfa484 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:20.596353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-e364dc2d-100d-43a0-9127-96554acfa484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:20.596353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:20.596353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:20.596353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:20.596353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:20.596353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:20.596353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:20.596353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:20.596353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:20.596353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:20.596353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:20.596353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:20.596353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:20.596353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:20.596353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:20.596353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:20.597965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:20.597965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:20.597965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:20.597965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:20.597965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:20.597965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:20.597965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:20.597965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:20.597965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:20.597965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:20.597965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:20.597965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:20.597965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:20.597965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:20.597965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:20.597965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:20.597965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:20.600126 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:20.600126 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:20.600126 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:20.601534 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 360/739] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:20.605776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6afbb3-2432-4e5d-bd1d-b674e8e503b0 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:20.605776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6afbb3-2432-4e5d-bd1d-b674e8e503b0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:20.605776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6afbb3-2432-4e5d-bd1d-b674e8e503b0 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:20.605776 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 361/740] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:20.606282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5edef0-7dfe-4600-b929-cd0abb2e3776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:20.606649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5edef0-7dfe-4600-b929-cd0abb2e3776 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:20.606875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5edef0-7dfe-4600-b929-cd0abb2e3776 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:20.607076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5edef0-7dfe-4600-b929-cd0abb2e3776 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:20.607974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5edef0-7dfe-4600-b929-cd0abb2e3776 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:20.608246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5edef0-7dfe-4600-b929-cd0abb2e3776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:20.609875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5edef0-7dfe-4600-b929-cd0abb2e3776 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:20.611224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4b90c-e85b-4b17-8df6-8c7dd5a8992d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:20.611537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4b90c-e85b-4b17-8df6-8c7dd5a8992d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:20.611812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4b90c-e85b-4b17-8df6-8c7dd5a8992d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:20.630242 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 380/741] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 28 18:04:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:20.631181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5edef0-7dfe-4600-b929-cd0abb2e3776 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:20.638479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-41d4b90c-e85b-4b17-8df6-8c7dd5a8992d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:20.639760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-41d4b90c-e85b-4b17-8df6-8c7dd5a8992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:20.654601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:20.742265 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 362/742] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:20 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:04:20.742265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4b90c-e85b-4b17-8df6-8c7dd5a8992d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:20.769806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5edef0-7dfe-4600-b929-cd0abb2e3776 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:20.803660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:20.836638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ba47d-487a-4a2d-b4d6-b55410dfbb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:20.837252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ba47d-487a-4a2d-b4d6-b55410dfbb10 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:20.837534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ba47d-487a-4a2d-b4d6-b55410dfbb10 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:20.837808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ba47d-487a-4a2d-b4d6-b55410dfbb10 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:20.838467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ba47d-487a-4a2d-b4d6-b55410dfbb10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:20.838772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ba47d-487a-4a2d-b4d6-b55410dfbb10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:20.840379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ba47d-487a-4a2d-b4d6-b55410dfbb10 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:20.869640 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 381/743] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:20.875885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ba47d-487a-4a2d-b4d6-b55410dfbb10 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:20.914494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4b90c-e85b-4b17-8df6-8c7dd5a8992d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:20.980282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7e3e6-211b-411e-9650-cd92774e5e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:20.981759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7e3e6-211b-411e-9650-cd92774e5e7b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:20.983173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7e3e6-211b-411e-9650-cd92774e5e7b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:20.983723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7e3e6-211b-411e-9650-cd92774e5e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:21.025304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:21.105930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7e3e6-211b-411e-9650-cd92774e5e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:21.107861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7e3e6-211b-411e-9650-cd92774e5e7b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:21.115653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ba47d-487a-4a2d-b4d6-b55410dfbb10 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:21.152550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54959fe-261e-40be-a803-2acd0397b31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:21.153223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54959fe-261e-40be-a803-2acd0397b31d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:21.153449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54959fe-261e-40be-a803-2acd0397b31d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:21.153676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54959fe-261e-40be-a803-2acd0397b31d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:21.161455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54959fe-261e-40be-a803-2acd0397b31d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:21.162990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54959fe-261e-40be-a803-2acd0397b31d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:21.178327 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-c54959fe-261e-40be-a803-2acd0397b31d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:21.178327 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:21.178327 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:21.178327 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:21.178327 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:21.178327 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:21.178327 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:21.178327 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:21.178327 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:21.178327 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:21.178327 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:21.178327 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:21.178327 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:21.178327 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:21.178327 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:21.179309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:21.179309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:21.179309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:21.179309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:21.179309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:21.179309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:21.179309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:21.179309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:21.179309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:21.179309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:21.179309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:21.179309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:21.179309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:21.179309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:21.179309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:21.179309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:21.179309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:21.180211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:21.180211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:21.180211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:21.180211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:21.180211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:21.180211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:21.180211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:21.180211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:21.180211 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 382/744] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:21.181206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54959fe-261e-40be-a803-2acd0397b31d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:21.223839 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 363/745] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:04:20 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:04:21.223839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7e3e6-211b-411e-9650-cd92774e5e7b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:21.243962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:21.279291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:21.310863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54959fe-261e-40be-a803-2acd0397b31d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:21.339878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7e3e6-211b-411e-9650-cd92774e5e7b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:21.358666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5fbf2-f17e-40ad-9521-96e5f7c41713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:21.359821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5fbf2-f17e-40ad-9521-96e5f7c41713 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:21.360286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5fbf2-f17e-40ad-9521-96e5f7c41713 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:21.361009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5fbf2-f17e-40ad-9521-96e5f7c41713 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:21.362294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5fbf2-f17e-40ad-9521-96e5f7c41713 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:21.364050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5fbf2-f17e-40ad-9521-96e5f7c41713 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:21.381661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb91e0-5c53-4197-9cb2-fe4dad12bcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:21.382550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb91e0-5c53-4197-9cb2-fe4dad12bcf7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:21.382957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb91e0-5c53-4197-9cb2-fe4dad12bcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:21.383419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb91e0-5c53-4197-9cb2-fe4dad12bcf7 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:21.384593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb91e0-5c53-4197-9cb2-fe4dad12bcf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:21.385029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb91e0-5c53-4197-9cb2-fe4dad12bcf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:21.385919 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 383/746] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 18:04:21 2022] POST /identity/v3/services => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:04:21.386923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5fbf2-f17e-40ad-9521-96e5f7c41713 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:21.387190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb91e0-5c53-4197-9cb2-fe4dad12bcf7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:21.402900 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 364/747] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:21.411769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb91e0-5c53-4197-9cb2-fe4dad12bcf7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:21.516554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:21.527293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb91e0-5c53-4197-9cb2-fe4dad12bcf7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:21.530926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5fbf2-f17e-40ad-9521-96e5f7c41713 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:21.538132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:21.566725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec14a5-1ebf-474b-86c3-fa7ad8a2e11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:21.567637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec14a5-1ebf-474b-86c3-fa7ad8a2e11a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:21.568135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec14a5-1ebf-474b-86c3-fa7ad8a2e11a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:21.568584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec14a5-1ebf-474b-86c3-fa7ad8a2e11a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:21.569516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec14a5-1ebf-474b-86c3-fa7ad8a2e11a None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=651b8653291a414fba3805312708ce48, user.id=d55caefe410444509a1eee4262b76c80) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:21.570007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec14a5-1ebf-474b-86c3-fa7ad8a2e11a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:21.571736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec14a5-1ebf-474b-86c3-fa7ad8a2e11a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:21.578022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db758c4-b33d-4f92-8f8c-0e624c1659bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:21.578789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db758c4-b33d-4f92-8f8c-0e624c1659bb None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:21.579138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db758c4-b33d-4f92-8f8c-0e624c1659bb None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:21.579499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db758c4-b33d-4f92-8f8c-0e624c1659bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:21.580106 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 365/748] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:04:21 2022] GET /identity/v3/role_assignments?user.id=d55caefe410444509a1eee4262b76c80&scope.project.id=651b8653291a414fba3805312708ce48&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:21.592682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db758c4-b33d-4f92-8f8c-0e624c1659bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:21.594538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db758c4-b33d-4f92-8f8c-0e624c1659bb None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:21.614168 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3db758c4-b33d-4f92-8f8c-0e624c1659bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:21.614168 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:21.614168 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:21.614168 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:21.614168 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:21.614168 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:21.614168 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:21.614168 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:21.614168 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:21.614168 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:21.614168 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:21.614168 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:21.614168 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:21.614168 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:21.614168 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:21.614168 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:21.615181 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:21.615181 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:21.615181 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:21.615181 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:21.615181 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:21.615181 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:21.615181 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:21.615181 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:21.615181 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:21.615181 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:21.615181 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:21.615181 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:21.615181 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:21.615181 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:21.615181 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:21.615181 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:21.615181 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:21.616087 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:21.616087 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:21.616087 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:21.616087 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 384/749] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:21.624076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec14a5-1ebf-474b-86c3-fa7ad8a2e11a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:21.671643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadae1b-551e-4aa5-9228-c5e12015bb60 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:21.671918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadae1b-551e-4aa5-9228-c5e12015bb60 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:21.672442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadae1b-551e-4aa5-9228-c5e12015bb60 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:21.676806 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 385/750] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:21.684190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae40367-854c-4eab-94d4-a153ec01a0c6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:21.684461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae40367-854c-4eab-94d4-a153ec01a0c6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:21.684899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae40367-854c-4eab-94d4-a153ec01a0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:21.720364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6ae40367-854c-4eab-94d4-a153ec01a0c6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:21.721418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6ae40367-854c-4eab-94d4-a153ec01a0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:21.775480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec14a5-1ebf-474b-86c3-fa7ad8a2e11a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:21.817801 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 386/751] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:04:21.832898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8035db-f2bf-48f8-87ff-c4eec5ed8f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:21.833536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8035db-f2bf-48f8-87ff-c4eec5ed8f5d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:21.833816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8035db-f2bf-48f8-87ff-c4eec5ed8f5d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:21.834088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8035db-f2bf-48f8-87ff-c4eec5ed8f5d None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:21.834757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8035db-f2bf-48f8-87ff-c4eec5ed8f5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:21.835061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8035db-f2bf-48f8-87ff-c4eec5ed8f5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:21.836511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8035db-f2bf-48f8-87ff-c4eec5ed8f5d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:21.854197 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 366/752] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:21.859846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae40367-854c-4eab-94d4-a153ec01a0c6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:21.977102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:22.007380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae40367-854c-4eab-94d4-a153ec01a0c6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:22.056476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b04eb-0745-4f68-a951-5fefe0cda50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:22.057123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b04eb-0745-4f68-a951-5fefe0cda50d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:22.057398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b04eb-0745-4f68-a951-5fefe0cda50d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:22.057725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b04eb-0745-4f68-a951-5fefe0cda50d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:22.070551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b04eb-0745-4f68-a951-5fefe0cda50d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:22.071966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b04eb-0745-4f68-a951-5fefe0cda50d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:22.087326 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-195b04eb-0745-4f68-a951-5fefe0cda50d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:22.087326 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:22.087326 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:22.087326 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:22.087326 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:22.087326 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:22.087326 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:22.087326 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:22.087326 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:22.087326 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:22.087326 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:22.087326 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:22.087326 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:22.087326 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:22.087326 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:22.088276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:22.088276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:22.088276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:22.088276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:22.088276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:22.088276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:22.088276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:22.088276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:22.088276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:22.088276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:22.088276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:22.088276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:22.088276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:22.088276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:22.088276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:22.088276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:22.088276 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:22.089637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:22.089637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:22.089637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:22.089637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:22.089637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:22.089637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:22.089637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:22.089637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:22.089637 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 387/753] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:22.094850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8035db-f2bf-48f8-87ff-c4eec5ed8f5d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:22.129251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:22.169000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b04eb-0745-4f68-a951-5fefe0cda50d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:22.257082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8035db-f2bf-48f8-87ff-c4eec5ed8f5d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:22.309345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca487deb-f772-4024-910b-e80a6d2e5709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:22.310880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca487deb-f772-4024-910b-e80a6d2e5709 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:22.311593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca487deb-f772-4024-910b-e80a6d2e5709 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:22.312088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca487deb-f772-4024-910b-e80a6d2e5709 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:22.314098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca487deb-f772-4024-910b-e80a6d2e5709 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:22.314630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca487deb-f772-4024-910b-e80a6d2e5709 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:22.316361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca487deb-f772-4024-910b-e80a6d2e5709 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:22.351719 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 367/754] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:22.358255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca487deb-f772-4024-910b-e80a6d2e5709 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:22.395366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b04eb-0745-4f68-a951-5fefe0cda50d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:22.451940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbc28e-6d72-4de7-b9e5-fd23911034a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:22.452968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbc28e-6d72-4de7-b9e5-fd23911034a9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:22.453498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbc28e-6d72-4de7-b9e5-fd23911034a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:22.453946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbc28e-6d72-4de7-b9e5-fd23911034a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:22.462589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:22.469774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbc28e-6d72-4de7-b9e5-fd23911034a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:22.475766 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-43dbc28e-6d72-4de7-b9e5-fd23911034a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:04:22.475766 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:22.475766 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:22.475766 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:22.475766 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:22.475766 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:22.475766 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:22.475766 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:22.475766 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:22.475766 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:22.475766 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:22.475766 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:22.475766 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:22.475766 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:22.475766 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:22.475766 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:22.476684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:22.476684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:22.476684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:22.476684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:22.476684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:22.476684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:22.476684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:22.476684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:22.476684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:22.476684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:22.476684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:22.476684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:22.476684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:22.476684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:22.476684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:22.476684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:22.477514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:22.477514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:22.477514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:22.477514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:22.477514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:22.477514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:22.477514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:22.477514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:22.477514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:22.477514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:22.477514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:04:22.477514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:22.478137 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 388/755] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:04:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:22.486701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbc28e-6d72-4de7-b9e5-fd23911034a9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:22.559696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:22.577756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca487deb-f772-4024-910b-e80a6d2e5709 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:22.617491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbc28e-6d72-4de7-b9e5-fd23911034a9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:22.656031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188f11b-9f8f-4c75-9531-6b6035de5557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:22.656674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188f11b-9f8f-4c75-9531-6b6035de5557 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:22.656958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188f11b-9f8f-4c75-9531-6b6035de5557 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:22.657233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188f11b-9f8f-4c75-9531-6b6035de5557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:22.657981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188f11b-9f8f-4c75-9531-6b6035de5557 None admin] RBAC: Adding query filter params (role.id=1e0740decc23460f8c3d0f7007f2d97f, scope.project.id=651b8653291a414fba3805312708ce48, user.id=e63fa755c46b4a2b9e32e720f9fb8413) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:22.658291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188f11b-9f8f-4c75-9531-6b6035de5557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:22.659329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85724620-2816-4401-8e18-93eeabdc44b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:22.659777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188f11b-9f8f-4c75-9531-6b6035de5557 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:22.660398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85724620-2816-4401-8e18-93eeabdc44b3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:22.660869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85724620-2816-4401-8e18-93eeabdc44b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:22.661335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85724620-2816-4401-8e18-93eeabdc44b3 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:22.662198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85724620-2816-4401-8e18-93eeabdc44b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:22.662696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85724620-2816-4401-8e18-93eeabdc44b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:22.664478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85724620-2816-4401-8e18-93eeabdc44b3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:22.674362 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 389/756] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:04:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:22.679153 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 368/757] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:04:22 2022] GET /identity/v3/role_assignments?user.id=e63fa755c46b4a2b9e32e720f9fb8413&scope.project.id=651b8653291a414fba3805312708ce48&role.id=1e0740decc23460f8c3d0f7007f2d97f => generated 259 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:22.680612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85724620-2816-4401-8e18-93eeabdc44b3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:22.687360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7a5e1-5fb0-4e4b-b010-5788b8206716 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:22.687709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7a5e1-5fb0-4e4b-b010-5788b8206716 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:22.687957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7a5e1-5fb0-4e4b-b010-5788b8206716 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:22.690596 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 369/758] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:04:22.695088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16119fc3-25ce-45a9-83fe-a02c1e8cc8b1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:22.695433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16119fc3-25ce-45a9-83fe-a02c1e8cc8b1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:22.695706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16119fc3-25ce-45a9-83fe-a02c1e8cc8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:22.736686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-16119fc3-25ce-45a9-83fe-a02c1e8cc8b1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:22.738005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-16119fc3-25ce-45a9-83fe-a02c1e8cc8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:22.760033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:22.812986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85724620-2816-4401-8e18-93eeabdc44b3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:22.856646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355e1f3-7a88-4dec-bfef-7dd4d3d54ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:22.857711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355e1f3-7a88-4dec-bfef-7dd4d3d54ec9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:22.858972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355e1f3-7a88-4dec-bfef-7dd4d3d54ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:22.859503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355e1f3-7a88-4dec-bfef-7dd4d3d54ec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:22.861126 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 370/759] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:04:22.871761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355e1f3-7a88-4dec-bfef-7dd4d3d54ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:22.873460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355e1f3-7a88-4dec-bfef-7dd4d3d54ec9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:22.889531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-7355e1f3-7a88-4dec-bfef-7dd4d3d54ec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:22.889531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:22.889531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:22.889531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:22.889531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:22.889531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:22.889531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:22.889531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:22.889531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:22.889531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:22.889531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:22.889531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:22.889531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:22.889531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:22.889531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:22.889531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:22.890723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:22.890723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:22.890723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:22.890723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:22.890723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:22.890723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:22.890723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:22.890723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:22.890723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:22.890723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:22.890723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:22.890723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:22.890723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:22.890723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:22.890723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:22.890723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:22.890723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:22.891866 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:22.891866 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:22.891866 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:22.893620 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 390/760] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:22.899664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16119fc3-25ce-45a9-83fe-a02c1e8cc8b1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:23.007244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:23.025446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16119fc3-25ce-45a9-83fe-a02c1e8cc8b1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:23.079975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a5a12-b2c0-4e01-8d24-e3fd653d507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:23.080852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a5a12-b2c0-4e01-8d24-e3fd653d507d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:23.081300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a5a12-b2c0-4e01-8d24-e3fd653d507d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:23.081708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a5a12-b2c0-4e01-8d24-e3fd653d507d None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:23.082503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a5a12-b2c0-4e01-8d24-e3fd653d507d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:23.082942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a5a12-b2c0-4e01-8d24-e3fd653d507d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:23.084491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a5a12-b2c0-4e01-8d24-e3fd653d507d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:23.097344 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 371/761] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:23.102882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355e1f3-7a88-4dec-bfef-7dd4d3d54ec9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:23.192014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a5a12-b2c0-4e01-8d24-e3fd653d507d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:23.263562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355e1f3-7a88-4dec-bfef-7dd4d3d54ec9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:23.278277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:23.312778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e685e23-14ba-4c4c-b8f1-670282aeef5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:23.313489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e685e23-14ba-4c4c-b8f1-670282aeef5b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:23.313772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e685e23-14ba-4c4c-b8f1-670282aeef5b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:23.314046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e685e23-14ba-4c4c-b8f1-670282aeef5b None admin] PATH_INFO: `/v3/users/nova` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:23.327680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e685e23-14ba-4c4c-b8f1-670282aeef5b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:23.329182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e685e23-14ba-4c4c-b8f1-670282aeef5b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:23.366066 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3e685e23-14ba-4c4c-b8f1-670282aeef5b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:04:23.366066 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:23.366066 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:23.366066 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:23.366066 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:23.366066 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:23.366066 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:23.366066 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:23.366066 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:23.366066 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:23.366066 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:23.366066 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:23.366066 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:23.366066 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:23.366066 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:23.366066 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:23.367046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:23.368001 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:23.368001 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:23.368001 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:23.368001 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:23.368001 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:23.368001 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:23.368001 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:23.368001 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:23.368001 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:04:23.368001 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:23.368535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a5a12-b2c0-4e01-8d24-e3fd653d507d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:23.368933 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 391/762] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 18:04:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:23.378529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e685e23-14ba-4c4c-b8f1-670282aeef5b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:23.468488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3a58e-c1ff-4e5c-a83e-0a308b1a7920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:23.469716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3a58e-c1ff-4e5c-a83e-0a308b1a7920 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:23.470219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3a58e-c1ff-4e5c-a83e-0a308b1a7920 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:23.470713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3a58e-c1ff-4e5c-a83e-0a308b1a7920 None admin] PATH_INFO: `/v3/services/network` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:23.471776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3a58e-c1ff-4e5c-a83e-0a308b1a7920 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:23.474363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3a58e-c1ff-4e5c-a83e-0a308b1a7920 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:23.492773 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-7da3a58e-c1ff-4e5c-a83e-0a308b1a7920 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:04:23.492773 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:23.492773 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:23.492773 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:23.492773 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:23.492773 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:23.492773 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:23.492773 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:23.492773 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:04:23.492773 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:23.492773 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:23.492773 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:23.492773 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:23.492773 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:23.492773 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:23.492773 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:23.492773 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:23.493794 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:23.493794 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:23.493794 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:23.493794 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:23.493794 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:23.493794 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:23.493794 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:23.493794 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:23.493794 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:23.493794 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:23.493794 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:23.493794 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:23.493794 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:23.493794 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:23.493794 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:23.493794 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:23.494629 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:23.494629 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:23.494629 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:23.494629 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:23.494629 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:23.494629 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:23.494629 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:23.494629 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:23.494629 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:23.494629 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:23.494629 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:23.494629 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:23.494629 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:04:23.494629 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:23.495500 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 372/763] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:23 2022] GET /identity/v3/services/network => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:23.502335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3a58e-c1ff-4e5c-a83e-0a308b1a7920 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:23.538649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:23.628056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e685e23-14ba-4c4c-b8f1-670282aeef5b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:23.699966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2b39d-13aa-400e-a639-127fd397e9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:23.700636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2b39d-13aa-400e-a639-127fd397e9cd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:23.700963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2b39d-13aa-400e-a639-127fd397e9cd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:23.701286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2b39d-13aa-400e-a639-127fd397e9cd None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:23.702364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2b39d-13aa-400e-a639-127fd397e9cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:23.702744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2b39d-13aa-400e-a639-127fd397e9cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:23.704236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2b39d-13aa-400e-a639-127fd397e9cd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:23.725733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3a58e-c1ff-4e5c-a83e-0a308b1a7920 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:23.741578 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 392/764] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 18:04:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:23.747303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2b39d-13aa-400e-a639-127fd397e9cd None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:23.780686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e90bd-032d-476b-b370-488b21260de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:23.781321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e90bd-032d-476b-b370-488b21260de6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:23.781624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e90bd-032d-476b-b370-488b21260de6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:23.781863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e90bd-032d-476b-b370-488b21260de6 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:23.782508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e90bd-032d-476b-b370-488b21260de6 None admin] RBAC: Adding query filter params (name=network) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:23.782809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e90bd-032d-476b-b370-488b21260de6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:23.783029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:23.784211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e90bd-032d-476b-b370-488b21260de6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:23.795817 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 373/765] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 18:04:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:23.800689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e90bd-032d-476b-b370-488b21260de6 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:23.864338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2b39d-13aa-400e-a639-127fd397e9cd None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:23.899726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:23.904792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce876c5-74e5-4a55-a74a-b571c534a391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:23.905787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce876c5-74e5-4a55-a74a-b571c534a391 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:23.906068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce876c5-74e5-4a55-a74a-b571c534a391 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:23.906337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce876c5-74e5-4a55-a74a-b571c534a391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:23.918079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce876c5-74e5-4a55-a74a-b571c534a391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:23.919599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce876c5-74e5-4a55-a74a-b571c534a391 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:23.927753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e90bd-032d-476b-b370-488b21260de6 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:23.937598 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3ce876c5-74e5-4a55-a74a-b571c534a391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:23.937598 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:23.937598 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:23.937598 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:23.937598 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:23.937598 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:23.937598 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:23.937598 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:23.937598 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:23.937598 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:23.937598 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:23.937598 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:23.937598 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:23.937598 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:23.937598 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:23.937598 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:23.938637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:23.938637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:23.938637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:23.938637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:23.938637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:23.938637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:23.938637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:23.938637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:23.938637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:23.938637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:23.938637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:23.938637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:23.938637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:23.938637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:23.938637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:23.938637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:23.938637 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:23.939618 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:23.939618 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:23.939618 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:23.943602 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 393/766] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:23.945954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d106a28-23d9-40ac-b129-3d1b85f23128 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:23.946425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d106a28-23d9-40ac-b129-3d1b85f23128 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:23.946425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d106a28-23d9-40ac-b129-3d1b85f23128 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:23.949438 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 394/767] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:23.959302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d106a28-23d9-40ac-b129-3d1b85f23128 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:23.971022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c7de3-5586-4b3c-acbd-54dd57531d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:23.971701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c7de3-5586-4b3c-acbd-54dd57531d01 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:23.975282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c7de3-5586-4b3c-acbd-54dd57531d01 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:23.975282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c7de3-5586-4b3c-acbd-54dd57531d01 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:23.975282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c7de3-5586-4b3c-acbd-54dd57531d01 None admin] RBAC: Adding query filter params (type=network) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:23.975282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c7de3-5586-4b3c-acbd-54dd57531d01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:23.975282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c7de3-5586-4b3c-acbd-54dd57531d01 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:23.981370 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 374/768] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 18:04:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:23.982679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bcf32-fbe8-4ecf-9372-c47c1d5fd71d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:23.982970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bcf32-fbe8-4ecf-9372-c47c1d5fd71d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:23.983247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bcf32-fbe8-4ecf-9372-c47c1d5fd71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:24.002195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-db1bcf32-fbe8-4ecf-9372-c47c1d5fd71d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:24.003426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db1bcf32-fbe8-4ecf-9372-c47c1d5fd71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:24.094695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:24.106119 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 375/769] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:24.107002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bcf32-fbe8-4ecf-9372-c47c1d5fd71d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:24.117950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d106a28-23d9-40ac-b129-3d1b85f23128 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:24.175456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7852c31-6ac2-434d-a803-a9043d4115e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:24.177428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7852c31-6ac2-434d-a803-a9043d4115e0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:24.177708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7852c31-6ac2-434d-a803-a9043d4115e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:24.182792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7852c31-6ac2-434d-a803-a9043d4115e0 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:24.183730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7852c31-6ac2-434d-a803-a9043d4115e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:24.184046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7852c31-6ac2-434d-a803-a9043d4115e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:24.186813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7852c31-6ac2-434d-a803-a9043d4115e0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:24.215397 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 395/770] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:24.222800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c2677-e848-46df-bd48-28758963052c None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:24.224910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c2677-e848-46df-bd48-28758963052c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:24.224910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c2677-e848-46df-bd48-28758963052c None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:24.231224 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 396/771] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:24 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:24.231224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c2677-e848-46df-bd48-28758963052c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:24.252735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:24.305197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bcf32-fbe8-4ecf-9372-c47c1d5fd71d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:24.387738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c2677-e848-46df-bd48-28758963052c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:24.389051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a059a7-f678-4268-bcb5-b6ba6b762744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:24.390337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a059a7-f678-4268-bcb5-b6ba6b762744 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:24.390900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a059a7-f678-4268-bcb5-b6ba6b762744 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:24.391471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a059a7-f678-4268-bcb5-b6ba6b762744 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:24.392383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a059a7-f678-4268-bcb5-b6ba6b762744 None admin] RBAC: Adding query filter params (interface=public, service_id=ca323965f9c4429bade6a9098e4c2599, region_id=RegionOne) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:24.392884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a059a7-f678-4268-bcb5-b6ba6b762744 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:24.394473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a059a7-f678-4268-bcb5-b6ba6b762744 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:24.403490 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 376/772] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 28 18:04:24 2022] GET /identity/v3/endpoints?service_id=ca323965f9c4429bade6a9098e4c2599&interface=public®ion_id=RegionOne => generated 194 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:24.405075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5bea2-e17e-4d98-918c-91c0a35d1675 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:24.405550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5bea2-e17e-4d98-918c-91c0a35d1675 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:24.406024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5bea2-e17e-4d98-918c-91c0a35d1675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:24.428399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4ab5bea2-e17e-4d98-918c-91c0a35d1675 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:24.429585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4ab5bea2-e17e-4d98-918c-91c0a35d1675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:24.437701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211b123-46f2-4f84-9ede-21b13a1d50cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:24.439798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211b123-46f2-4f84-9ede-21b13a1d50cc None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:24.441320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211b123-46f2-4f84-9ede-21b13a1d50cc None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:24.442368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211b123-46f2-4f84-9ede-21b13a1d50cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:24.459918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211b123-46f2-4f84-9ede-21b13a1d50cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:24.463560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211b123-46f2-4f84-9ede-21b13a1d50cc None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:24.478719 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-1211b123-46f2-4f84-9ede-21b13a1d50cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:24.478719 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:24.478719 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:24.478719 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:24.478719 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:24.478719 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:24.478719 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:24.478719 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:24.478719 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:24.478719 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:24.478719 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:24.478719 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:24.478719 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:24.478719 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:24.478719 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:24.480180 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:24.480180 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:24.480180 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:24.480180 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:24.480180 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:24.480180 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:24.480180 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:24.480180 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:24.480180 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:24.480180 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:24.480180 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:24.480180 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:24.480180 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:24.480180 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:24.480180 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:24.480180 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:24.480180 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:24.481302 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:24.481302 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:24.481302 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:24.481302 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:24.481302 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:24.481302 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:24.481302 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:24.481302 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:24.488013 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 397/773] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:24.488890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211b123-46f2-4f84-9ede-21b13a1d50cc None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:24.492147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:24.519827 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 377/774] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:24.521037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5bea2-e17e-4d98-918c-91c0a35d1675 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:24.628496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:24.634790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211b123-46f2-4f84-9ede-21b13a1d50cc None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:24.670608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5bea2-e17e-4d98-918c-91c0a35d1675 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:24.672965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314aa6d-e23e-4a33-ac51-a4a3a2487b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:24.673662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314aa6d-e23e-4a33-ac51-a4a3a2487b79 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:24.674648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314aa6d-e23e-4a33-ac51-a4a3a2487b79 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:24.674648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314aa6d-e23e-4a33-ac51-a4a3a2487b79 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:24.674821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314aa6d-e23e-4a33-ac51-a4a3a2487b79 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:24.676284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314aa6d-e23e-4a33-ac51-a4a3a2487b79 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:24.686193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-2314aa6d-e23e-4a33-ac51-a4a3a2487b79 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:04:24.686193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:24.686193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:24.686193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:24.686193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:24.686193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:24.686193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:24.686193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:24.686193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:04:24.686193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:24.686193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:24.686193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:24.686193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:24.686193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:24.686193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:24.686193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:24.686193 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:24.687234 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:24.687234 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:24.687234 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:24.687234 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:24.687234 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:24.687234 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:24.687234 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:24.687234 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:24.687234 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:24.687234 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:24.687234 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:24.687234 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:24.687234 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:24.687234 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:24.687234 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:24.687234 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:24.688103 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:24.688103 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:24.688103 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:24.688103 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:24.688103 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:24.688103 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:24.688103 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:24.688103 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:24.688103 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:24.688103 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:24.688103 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:24.688103 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:24.688103 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:04:24.688103 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:24.688103 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 398/775] 10.222.0.27 () {56 vars in 1129 bytes} [Sun Aug 28 18:04:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:24.688894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314aa6d-e23e-4a33-ac51-a4a3a2487b79 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:24.712967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745f4fc-7ba6-4c12-8536-efced81dfde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:24.714046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745f4fc-7ba6-4c12-8536-efced81dfde8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:24.714569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745f4fc-7ba6-4c12-8536-efced81dfde8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:24.715100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745f4fc-7ba6-4c12-8536-efced81dfde8 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:24.715964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745f4fc-7ba6-4c12-8536-efced81dfde8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:24.717520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745f4fc-7ba6-4c12-8536-efced81dfde8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:24.723732 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 378/776] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 18:04:24 2022] GET /identity/v3/services => generated 772 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:24.725057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745f4fc-7ba6-4c12-8536-efced81dfde8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:24.768342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:24.809565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314aa6d-e23e-4a33-ac51-a4a3a2487b79 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:24.851293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745f4fc-7ba6-4c12-8536-efced81dfde8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:24.911104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:24.915915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a325200-2036-4fe3-aa2e-0dbab708ef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:24.916558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a325200-2036-4fe3-aa2e-0dbab708ef3a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:24.916839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a325200-2036-4fe3-aa2e-0dbab708ef3a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:24.917144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a325200-2036-4fe3-aa2e-0dbab708ef3a None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:24.917823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a325200-2036-4fe3-aa2e-0dbab708ef3a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:24.918134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a325200-2036-4fe3-aa2e-0dbab708ef3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:24.919659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a325200-2036-4fe3-aa2e-0dbab708ef3a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:24.930036 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 379/777] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 28 18:04:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:24.931147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a325200-2036-4fe3-aa2e-0dbab708ef3a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:24.976377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b55983-6f14-4879-99d7-f8a5333c28ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:24.977002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55983-6f14-4879-99d7-f8a5333c28ef None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:24.977275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55983-6f14-4879-99d7-f8a5333c28ef None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:24.977545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55983-6f14-4879-99d7-f8a5333c28ef None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:24.978254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b55983-6f14-4879-99d7-f8a5333c28ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:24.978553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b55983-6f14-4879-99d7-f8a5333c28ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:24.980971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b55983-6f14-4879-99d7-f8a5333c28ef None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:25.000011 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 399/778] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:25.000887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b55983-6f14-4879-99d7-f8a5333c28ef None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:25.053917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a325200-2036-4fe3-aa2e-0dbab708ef3a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:25.101041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadd875-0935-40d0-a8a5-f7ba35b89273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:25.101682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadd875-0935-40d0-a8a5-f7ba35b89273 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:25.102103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadd875-0935-40d0-a8a5-f7ba35b89273 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:25.102383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadd875-0935-40d0-a8a5-f7ba35b89273 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:25.111702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b55983-6f14-4879-99d7-f8a5333c28ef None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:25.114624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadd875-0935-40d0-a8a5-f7ba35b89273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:25.119501 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-9eadd875-0935-40d0-a8a5-f7ba35b89273 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:04:25.119501 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:25.119501 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:25.119501 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:25.119501 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:25.119501 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:25.119501 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:25.119501 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:25.119501 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:25.119501 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:25.119501 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:25.119501 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:25.119501 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:25.119501 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:25.119501 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:25.119501 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:25.121083 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:25.121083 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:25.121083 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:25.121083 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:25.121083 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:25.121083 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:25.121083 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:25.121083 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:25.121083 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:25.121083 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:25.121083 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:25.121083 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:25.121083 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:25.121083 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:25.121083 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:25.121083 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:25.122180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:25.122180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:25.122180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:25.122180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:25.122180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:25.122180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:25.122180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:25.122180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:25.122180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:25.122180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:25.122180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:04:25.122180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:25.122180 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 380/779] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:04:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:25.122180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c711d-2856-416b-85b5-73709a4ddf0a None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:25.123100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c711d-2856-416b-85b5-73709a4ddf0a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:25.123100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c711d-2856-416b-85b5-73709a4ddf0a None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:25.129733 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 381/780] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:25.129733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c711d-2856-416b-85b5-73709a4ddf0a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:25.156412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:25.166359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758137f-5109-4f0b-b03c-901c34f1595f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:25.167056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758137f-5109-4f0b-b03c-901c34f1595f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:25.167365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758137f-5109-4f0b-b03c-901c34f1595f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:25.167643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758137f-5109-4f0b-b03c-901c34f1595f None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:25.168279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758137f-5109-4f0b-b03c-901c34f1595f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:25.168578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758137f-5109-4f0b-b03c-901c34f1595f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:25.169966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758137f-5109-4f0b-b03c-901c34f1595f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:25.176513 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 400/781] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 28 18:04:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:25.177337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758137f-5109-4f0b-b03c-901c34f1595f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:25.192241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:25.246133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c711d-2856-416b-85b5-73709a4ddf0a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:25.281729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad0b3f-a6ec-4eb8-a484-3707614e9e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:25.282411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad0b3f-a6ec-4eb8-a484-3707614e9e55 None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:25.282692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad0b3f-a6ec-4eb8-a484-3707614e9e55 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:25.282974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad0b3f-a6ec-4eb8-a484-3707614e9e55 None admin] PATH_INFO: `/v3/projects/651b8653291a414fba3805312708ce48/users/faef473a2ab84661b09f3ba3dd977058/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:25.284995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad0b3f-a6ec-4eb8-a484-3707614e9e55 None admin] RBAC: Authorizing `identity:create_grant(project_id=651b8653291a414fba3805312708ce48, user_id=faef473a2ab84661b09f3ba3dd977058, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:25.286432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad0b3f-a6ec-4eb8-a484-3707614e9e55 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:25.293147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758137f-5109-4f0b-b03c-901c34f1595f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:25.304867 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 382/782] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:04:25 2022] PUT /identity/v3/projects/651b8653291a414fba3805312708ce48/users/faef473a2ab84661b09f3ba3dd977058/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:04:25.307055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6efb97-edda-4cd1-9739-8a83983b9d82 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:25.307542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6efb97-edda-4cd1-9739-8a83983b9d82 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:25.308099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6efb97-edda-4cd1-9739-8a83983b9d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:25.332612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ef6efb97-edda-4cd1-9739-8a83983b9d82 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:25.333225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24469dec-4ced-47f3-b17c-9af30df2fbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:25.333950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24469dec-4ced-47f3-b17c-9af30df2fbde None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:25.334292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24469dec-4ced-47f3-b17c-9af30df2fbde None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:25.334631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24469dec-4ced-47f3-b17c-9af30df2fbde None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:25.334944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ef6efb97-edda-4cd1-9739-8a83983b9d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:25.335495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24469dec-4ced-47f3-b17c-9af30df2fbde None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:25.335868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24469dec-4ced-47f3-b17c-9af30df2fbde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:25.337508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24469dec-4ced-47f3-b17c-9af30df2fbde None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:25.348948 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 401/783] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:04:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:25.349730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24469dec-4ced-47f3-b17c-9af30df2fbde None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:25.416757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:25.441388 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 383/784] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:25.442993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6efb97-edda-4cd1-9739-8a83983b9d82 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:25.499315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24469dec-4ced-47f3-b17c-9af30df2fbde None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:25.499698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:25.537106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70191b8c-db0f-46a0-855f-43059f4b40c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:25.537726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70191b8c-db0f-46a0-855f-43059f4b40c2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:25.538005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70191b8c-db0f-46a0-855f-43059f4b40c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:25.538285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70191b8c-db0f-46a0-855f-43059f4b40c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:25.539010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70191b8c-db0f-46a0-855f-43059f4b40c2 None admin] RBAC: Adding query filter params (interface=public, service_id=2ca449358a61474c8ded1c86faaf0d60, region_id=RegionOne) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:25.539392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70191b8c-db0f-46a0-855f-43059f4b40c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:25.540786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70191b8c-db0f-46a0-855f-43059f4b40c2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:25.550789 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 402/785] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 28 18:04:25 2022] GET /identity/v3/endpoints?service_id=2ca449358a61474c8ded1c86faaf0d60&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:25.556099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70191b8c-db0f-46a0-855f-43059f4b40c2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:25.568035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6efb97-edda-4cd1-9739-8a83983b9d82 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:25.608313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b47fc5-e817-4e05-ad72-c19b8a9c6e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:25.609064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b47fc5-e817-4e05-ad72-c19b8a9c6e58 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:25.609348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b47fc5-e817-4e05-ad72-c19b8a9c6e58 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:25.609675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b47fc5-e817-4e05-ad72-c19b8a9c6e58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:25.620292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b47fc5-e817-4e05-ad72-c19b8a9c6e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:25.621765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b47fc5-e817-4e05-ad72-c19b8a9c6e58 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:25.638444 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-c3b47fc5-e817-4e05-ad72-c19b8a9c6e58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:25.638444 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:25.638444 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:25.638444 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:25.638444 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:25.638444 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:25.638444 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:25.638444 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:25.638444 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:25.638444 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:25.638444 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:25.638444 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:25.638444 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:25.638444 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:25.638444 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:25.638444 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:25.639533 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:25.639533 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:25.639533 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:25.639533 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:25.639533 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:25.639533 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:25.639533 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:25.639533 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:25.639533 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:25.639533 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:25.639533 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:25.639533 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:25.639533 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:25.639533 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:25.639533 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:25.639533 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:25.639533 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:25.640427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:25.640427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:25.640427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:25.640427 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 384/786] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:25.647301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b47fc5-e817-4e05-ad72-c19b8a9c6e58 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:25.680364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70191b8c-db0f-46a0-855f-43059f4b40c2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:25.721380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:25.760164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778e4b6-2617-45e0-9f32-0e41b429045f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:25.760821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778e4b6-2617-45e0-9f32-0e41b429045f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:25.761095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778e4b6-2617-45e0-9f32-0e41b429045f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:25.761366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778e4b6-2617-45e0-9f32-0e41b429045f None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:25.761979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778e4b6-2617-45e0-9f32-0e41b429045f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:25.763383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778e4b6-2617-45e0-9f32-0e41b429045f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:25.778873 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 403/787] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 18:04:25 2022] GET /identity/v3/services => generated 772 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:25.805965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778e4b6-2617-45e0-9f32-0e41b429045f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:25.811429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:25.822262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b47fc5-e817-4e05-ad72-c19b8a9c6e58 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:25.860786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85406e-7186-40e4-8585-b955f990a408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:25.861785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85406e-7186-40e4-8585-b955f990a408 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:25.862264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85406e-7186-40e4-8585-b955f990a408 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:25.862759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85406e-7186-40e4-8585-b955f990a408 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:25.863639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85406e-7186-40e4-8585-b955f990a408 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:25.864144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85406e-7186-40e4-8585-b955f990a408 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:25.865790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85406e-7186-40e4-8585-b955f990a408 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:25.880321 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 385/788] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:25.892402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85406e-7186-40e4-8585-b955f990a408 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:25.931991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778e4b6-2617-45e0-9f32-0e41b429045f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:25.985913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460ea85-43a2-426f-a2a2-e494e9bcb3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:25.986574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460ea85-43a2-426f-a2a2-e494e9bcb3da None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:25.986852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460ea85-43a2-426f-a2a2-e494e9bcb3da None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:25.987124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460ea85-43a2-426f-a2a2-e494e9bcb3da None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:26.013139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460ea85-43a2-426f-a2a2-e494e9bcb3da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:26.019525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-7460ea85-43a2-426f-a2a2-e494e9bcb3da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:26.019525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:26.019525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:26.019525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:26.019525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:26.019525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:26.019525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:26.019525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:26.019525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:26.019525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:26.019525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:26.019525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:26.019525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:26.019525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:26.019525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:26.019525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:26.020472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:26.020472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:26.020472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:26.020472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:26.020472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:26.020472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:26.020472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:26.020472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:26.020472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:26.020472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:26.020472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:26.020472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:26.020472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:26.020472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:26.020472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:26.020472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:26.021314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:26.021314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:26.021314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:26.021314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:26.021314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:26.021314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:26.021314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:26.021314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:26.021314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:26.021314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:26.021314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:26.021314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:26.029612 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 404/789] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:04:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:26.035938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460ea85-43a2-426f-a2a2-e494e9bcb3da None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:26.062390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85406e-7186-40e4-8585-b955f990a408 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:26.101738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:26.116659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c1cb5-3045-4832-b3c8-7f4d171db8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:26.117210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c1cb5-3045-4832-b3c8-7f4d171db8c2 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:26.117601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c1cb5-3045-4832-b3c8-7f4d171db8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:26.117972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c1cb5-3045-4832-b3c8-7f4d171db8c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:26.126023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c1cb5-3045-4832-b3c8-7f4d171db8c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:26.127656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c1cb5-3045-4832-b3c8-7f4d171db8c2 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:26.141504 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-b51c1cb5-3045-4832-b3c8-7f4d171db8c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:04:26.141504 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:26.141504 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:26.141504 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:26.141504 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:26.141504 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:26.141504 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:26.141504 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:26.141504 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:26.141504 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:26.141504 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:26.141504 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:26.141504 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:26.141504 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:26.141504 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:26.141504 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:26.142775 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:26.143888 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:26.143888 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:26.143888 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:26.143888 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:26.143888 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:26.143888 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:26.143888 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:26.143888 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:26.143888 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:04:26.143888 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:26.145620 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 386/790] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:04:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:26.156669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c1cb5-3045-4832-b3c8-7f4d171db8c2 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:26.176670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460ea85-43a2-426f-a2a2-e494e9bcb3da None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:26.179643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:26.276249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c1cb5-3045-4832-b3c8-7f4d171db8c2 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:26.284033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44818546-33c1-4371-868d-e395479a550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:26.284879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44818546-33c1-4371-868d-e395479a550f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:26.285304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44818546-33c1-4371-868d-e395479a550f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:26.285737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44818546-33c1-4371-868d-e395479a550f None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:26.286611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44818546-33c1-4371-868d-e395479a550f None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:26.287065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44818546-33c1-4371-868d-e395479a550f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:26.288632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44818546-33c1-4371-868d-e395479a550f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:26.305621 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 405/791] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:04:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:26.311806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44818546-33c1-4371-868d-e395479a550f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:26.312859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41b60b-2b46-41a0-a434-10b3ed12224d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:26.313477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41b60b-2b46-41a0-a434-10b3ed12224d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:26.313752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41b60b-2b46-41a0-a434-10b3ed12224d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:26.314024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41b60b-2b46-41a0-a434-10b3ed12224d None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:26.314764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41b60b-2b46-41a0-a434-10b3ed12224d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:26.315067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41b60b-2b46-41a0-a434-10b3ed12224d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:26.319303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41b60b-2b46-41a0-a434-10b3ed12224d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:26.338757 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 387/792] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 28 18:04:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:26.344223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41b60b-2b46-41a0-a434-10b3ed12224d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:26.427714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:26.457585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41b60b-2b46-41a0-a434-10b3ed12224d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:26.506341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785e686-c1c9-4151-9e2a-4909707be451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:26.507243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785e686-c1c9-4151-9e2a-4909707be451 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:26.509450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785e686-c1c9-4151-9e2a-4909707be451 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:26.509885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785e686-c1c9-4151-9e2a-4909707be451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:26.525383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44818546-33c1-4371-868d-e395479a550f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:26.528146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:26.537925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785e686-c1c9-4151-9e2a-4909707be451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:26.539658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785e686-c1c9-4151-9e2a-4909707be451 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:26.567557 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-f785e686-c1c9-4151-9e2a-4909707be451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:26.567557 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:26.567557 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:26.567557 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:26.567557 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:26.567557 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:26.567557 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:26.567557 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:26.567557 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:26.567557 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:26.567557 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:26.567557 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:26.567557 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:26.567557 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:26.567557 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:26.567557 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:26.568764 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:26.568764 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:26.568764 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:26.568764 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:26.568764 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:26.568764 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:26.568764 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:26.568764 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:26.568764 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:26.568764 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:26.568764 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:26.568764 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:26.568764 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:26.568764 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:26.568764 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:26.568764 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:26.568764 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:26.569855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:26.569855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:26.569855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:26.576014 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 388/793] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:26.583322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785e686-c1c9-4151-9e2a-4909707be451 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:26.644121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8ab46-676a-42cb-a4b9-5d94bc5bc7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:26.645089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8ab46-676a-42cb-a4b9-5d94bc5bc7cc None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:26.645545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8ab46-676a-42cb-a4b9-5d94bc5bc7cc None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:26.646022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8ab46-676a-42cb-a4b9-5d94bc5bc7cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:26.675102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8ab46-676a-42cb-a4b9-5d94bc5bc7cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:26.676936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8ab46-676a-42cb-a4b9-5d94bc5bc7cc None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:26.690817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785e686-c1c9-4151-9e2a-4909707be451 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:26.716317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-16c8ab46-676a-42cb-a4b9-5d94bc5bc7cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:26.716317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:26.716317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:26.716317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:26.716317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:26.716317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:26.716317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:26.716317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:26.716317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:26.716317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:26.716317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:26.716317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:26.716317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:26.716317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:26.716317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:26.716317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:26.717502 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:26.717502 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:26.717502 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:26.717502 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:26.717502 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:26.717502 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:26.717502 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:26.717502 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:26.717502 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:26.717502 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:26.717502 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:26.717502 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:26.717502 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:26.717502 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:26.717502 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:26.717502 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:26.717502 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:26.718594 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:26.718594 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:26.718594 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:26.718806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:26.724748 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 406/794] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:26.725843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8ab46-676a-42cb-a4b9-5d94bc5bc7cc None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:26.737180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568a237-a540-40f3-88ba-735e267e9438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:26.737799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568a237-a540-40f3-88ba-735e267e9438 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:26.738073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568a237-a540-40f3-88ba-735e267e9438 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:26.738341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568a237-a540-40f3-88ba-735e267e9438 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:26.738995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568a237-a540-40f3-88ba-735e267e9438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:26.739311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568a237-a540-40f3-88ba-735e267e9438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:26.740689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568a237-a540-40f3-88ba-735e267e9438 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:26.774914 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 389/795] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:26.781209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568a237-a540-40f3-88ba-735e267e9438 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:26.893218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568a237-a540-40f3-88ba-735e267e9438 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:26.932759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfb277-f193-4d98-aaea-f32f67bdf7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:26.933441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8ab46-676a-42cb-a4b9-5d94bc5bc7cc None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:26.933805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfb277-f193-4d98-aaea-f32f67bdf7db None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:26.934256 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfb277-f193-4d98-aaea-f32f67bdf7db None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:26.934698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfb277-f193-4d98-aaea-f32f67bdf7db None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:26.947218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfb277-f193-4d98-aaea-f32f67bdf7db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:26.948864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfb277-f193-4d98-aaea-f32f67bdf7db None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:26.961546 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-15bfb277-f193-4d98-aaea-f32f67bdf7db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:26.961546 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:26.961546 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:26.961546 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:26.961546 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:26.961546 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:26.961546 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:26.961546 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:26.961546 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:26.961546 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:26.961546 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:26.961546 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:26.961546 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:26.961546 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:26.961546 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:26.962481 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:26.962481 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:26.962481 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:26.962481 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:26.962481 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:26.962481 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:26.962481 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:26.962481 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:26.962481 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:26.962481 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:26.962481 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:26.962481 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:26.962481 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:26.962481 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:26.962481 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:26.962481 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:26.962481 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:26.963847 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:26.963847 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:26.963847 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:26.963847 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:26.963847 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:26.963847 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:26.963847 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:26.963847 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:26.963847 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 390/796] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:26.964552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5988d55-75dc-45f4-a914-a7e797191c4f None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:26.964846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5988d55-75dc-45f4-a914-a7e797191c4f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:26.964995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5988d55-75dc-45f4-a914-a7e797191c4f None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:26.970505 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 391/797] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:26.971496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5988d55-75dc-45f4-a914-a7e797191c4f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:26.981166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320ccee-b1f7-409e-96eb-03c877445dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:26.981791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320ccee-b1f7-409e-96eb-03c877445dee None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:26.982067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320ccee-b1f7-409e-96eb-03c877445dee None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:26.982337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320ccee-b1f7-409e-96eb-03c877445dee None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:26.983471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320ccee-b1f7-409e-96eb-03c877445dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:26.983772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320ccee-b1f7-409e-96eb-03c877445dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:26.985752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320ccee-b1f7-409e-96eb-03c877445dee None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:27.001428 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 407/798] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:27.003161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c188b82-4e64-419c-ae05-98e42e8fb2a4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:27.003464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c188b82-4e64-419c-ae05-98e42e8fb2a4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:27.004030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c188b82-4e64-419c-ae05-98e42e8fb2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:27.019683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:27.029575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0c188b82-4e64-419c-ae05-98e42e8fb2a4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:27.030782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0c188b82-4e64-419c-ae05-98e42e8fb2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:27.042280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:27.085414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5988d55-75dc-45f4-a914-a7e797191c4f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:27.108300 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 408/799] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:27.109533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c188b82-4e64-419c-ae05-98e42e8fb2a4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:27.146237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b4aec-8687-4c3a-af9c-02911b366276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:27.147114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b4aec-8687-4c3a-af9c-02911b366276 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:27.147551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b4aec-8687-4c3a-af9c-02911b366276 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:27.147958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b4aec-8687-4c3a-af9c-02911b366276 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:27.148834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b4aec-8687-4c3a-af9c-02911b366276 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:27.149276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b4aec-8687-4c3a-af9c-02911b366276 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:27.150844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b4aec-8687-4c3a-af9c-02911b366276 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:27.178476 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 392/800] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:27.197379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b4aec-8687-4c3a-af9c-02911b366276 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:27.256403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c188b82-4e64-419c-ae05-98e42e8fb2a4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:27.300615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf8ab5-ce7b-4686-afc2-be41aa811600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:27.301489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf8ab5-ce7b-4686-afc2-be41aa811600 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:27.301903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf8ab5-ce7b-4686-afc2-be41aa811600 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:27.302310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf8ab5-ce7b-4686-afc2-be41aa811600 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:27.314557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf8ab5-ce7b-4686-afc2-be41aa811600 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:27.318883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf8ab5-ce7b-4686-afc2-be41aa811600 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:27.338443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3fdf8ab5-ce7b-4686-afc2-be41aa811600 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:04:27.338443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:27.338443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:27.338443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:27.338443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:27.338443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:27.338443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:27.338443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:27.338443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:27.338443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:27.338443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:27.338443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:27.338443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:27.338443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:27.338443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:27.338443 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:27.339784 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:27.340906 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:27.340906 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:27.340906 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:27.340906 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:27.340906 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:27.340906 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:27.340906 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:27.340906 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:27.340906 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:04:27.340906 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:27.352270 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 409/801] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 18:04:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:27.357571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf8ab5-ce7b-4686-afc2-be41aa811600 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:27.367132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:27.400968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b4aec-8687-4c3a-af9c-02911b366276 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:27.403741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:27.446557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8b0a2-92c9-4ab9-ac22-3aa72eb7ca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:27.447231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8b0a2-92c9-4ab9-ac22-3aa72eb7ca3d None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:27.447535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8b0a2-92c9-4ab9-ac22-3aa72eb7ca3d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:27.447803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8b0a2-92c9-4ab9-ac22-3aa72eb7ca3d None admin] PATH_INFO: `/v3/projects/651b8653291a414fba3805312708ce48/users/d55caefe410444509a1eee4262b76c80/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:27.449752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8b0a2-92c9-4ab9-ac22-3aa72eb7ca3d None admin] RBAC: Authorizing `identity:create_grant(project_id=651b8653291a414fba3805312708ce48, user_id=d55caefe410444509a1eee4262b76c80, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:27.451445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8b0a2-92c9-4ab9-ac22-3aa72eb7ca3d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:27.469681 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 393/802] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:04:27 2022] PUT /identity/v3/projects/651b8653291a414fba3805312708ce48/users/d55caefe410444509a1eee4262b76c80/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:04:27.471287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8b0a2-92c9-4ab9-ac22-3aa72eb7ca3d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:27.521344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf8ab5-ce7b-4686-afc2-be41aa811600 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:27.609760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8b0a2-92c9-4ab9-ac22-3aa72eb7ca3d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:27.629291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f4ed7-d68a-420d-aa72-4c1b6247462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:27.629998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f4ed7-d68a-420d-aa72-4c1b6247462a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:27.630202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f4ed7-d68a-420d-aa72-4c1b6247462a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:27.630474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f4ed7-d68a-420d-aa72-4c1b6247462a None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:27.631230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f4ed7-d68a-420d-aa72-4c1b6247462a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:27.631547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f4ed7-d68a-420d-aa72-4c1b6247462a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:27.633410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f4ed7-d68a-420d-aa72-4c1b6247462a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:27.655436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902b60a-c6a4-4c24-963b-f936586bc873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:27.655799 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 410/803] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 28 18:04:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:27.656645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902b60a-c6a4-4c24-963b-f936586bc873 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:27.656927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902b60a-c6a4-4c24-963b-f936586bc873 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:27.657199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902b60a-c6a4-4c24-963b-f936586bc873 None admin] PATH_INFO: `/v3/services/network` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:27.657921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902b60a-c6a4-4c24-963b-f936586bc873 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:27.660153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902b60a-c6a4-4c24-963b-f936586bc873 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:27.661473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f4ed7-d68a-420d-aa72-4c1b6247462a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:27.671182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-1902b60a-c6a4-4c24-963b-f936586bc873 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:04:27.671182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:27.671182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:27.671182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:27.671182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:27.671182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:27.671182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:27.671182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:27.671182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:04:27.671182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:27.671182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:27.671182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:27.671182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:27.671182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:27.671182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:27.671182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:27.671182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:27.672237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:27.672237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:27.672237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:27.672237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:27.672237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:27.672237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:27.672237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:27.672237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:27.672237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:27.672237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:27.672237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:27.672237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:27.672237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:27.672237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:27.672237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:27.672237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:27.673088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:27.673088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:27.673088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:27.673088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:27.673088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:27.673088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:27.673088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:27.673088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:27.673088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:27.673088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:27.673088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:27.673088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:27.673088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:04:27.673088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:27.677798 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 394/804] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:27 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:27.678482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902b60a-c6a4-4c24-963b-f936586bc873 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:27.711688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:27.751893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:27.793468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902b60a-c6a4-4c24-963b-f936586bc873 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:27.805800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f4ed7-d68a-420d-aa72-4c1b6247462a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:27.832513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dd883-6a4a-4b36-864a-40d681350851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:27.833128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd883-6a4a-4b36-864a-40d681350851 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:27.833406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd883-6a4a-4b36-864a-40d681350851 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:27.833677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd883-6a4a-4b36-864a-40d681350851 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:27.834314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8dd883-6a4a-4b36-864a-40d681350851 None admin] RBAC: Adding query filter params (name=network) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:27.834615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8dd883-6a4a-4b36-864a-40d681350851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:27.836054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8dd883-6a4a-4b36-864a-40d681350851 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:27.841377 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 395/805] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 18:04:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:27.842828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d087d2-fd3a-4087-9791-e682f2e93523 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:27.843107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d087d2-fd3a-4087-9791-e682f2e93523 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:27.843422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d087d2-fd3a-4087-9791-e682f2e93523 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:27.844908 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 396/806] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:27.847098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d087d2-fd3a-4087-9791-e682f2e93523 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:27.850987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014233d-b4d0-4ed7-a23a-de8d53613ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:27.851700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014233d-b4d0-4ed7-a23a-de8d53613ca0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:27.851973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014233d-b4d0-4ed7-a23a-de8d53613ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:27.852242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014233d-b4d0-4ed7-a23a-de8d53613ca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:27.863208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014233d-b4d0-4ed7-a23a-de8d53613ca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:27.864855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014233d-b4d0-4ed7-a23a-de8d53613ca0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:27.884221 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-1014233d-b4d0-4ed7-a23a-de8d53613ca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:27.884221 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:27.884221 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:27.884221 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:27.884221 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:27.884221 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:27.884221 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:27.884221 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:27.884221 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:27.884221 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:27.884221 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:27.884221 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:27.884221 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:27.884221 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:27.884221 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:27.884221 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:27.885261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:27.885261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:27.885261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:27.885261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:27.885261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:27.885261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:27.885261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:27.885261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:27.885261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:27.885261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:27.885261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:27.885261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:27.885261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:27.885261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:27.885261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:27.885261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:27.885261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:27.886212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:27.886212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:27.886212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:27.886212 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 411/807] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:27.890898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae6cc8-b37e-4f03-8cdf-379fe52f965e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:27.890898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae6cc8-b37e-4f03-8cdf-379fe52f965e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:27.890898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae6cc8-b37e-4f03-8cdf-379fe52f965e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:27.910040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-44ae6cc8-b37e-4f03-8cdf-379fe52f965e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:27.911235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-44ae6cc8-b37e-4f03-8cdf-379fe52f965e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:27.962628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:27.976062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d087d2-fd3a-4087-9791-e682f2e93523 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:27.986765 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 412/808] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:27.988252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae6cc8-b37e-4f03-8cdf-379fe52f965e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:28.020198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d51d06-c17e-46fe-920e-59ff6b03ba5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:28.021207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d51d06-c17e-46fe-920e-59ff6b03ba5c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:28.021490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d51d06-c17e-46fe-920e-59ff6b03ba5c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:28.021762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d51d06-c17e-46fe-920e-59ff6b03ba5c None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:28.022668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d51d06-c17e-46fe-920e-59ff6b03ba5c None admin] RBAC: Adding query filter params (type=network) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:28.022974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d51d06-c17e-46fe-920e-59ff6b03ba5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:28.024620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d51d06-c17e-46fe-920e-59ff6b03ba5c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:28.032168 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 397/809] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 18:04:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:28.037895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d51d06-c17e-46fe-920e-59ff6b03ba5c None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:28.044766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:28.109091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae6cc8-b37e-4f03-8cdf-379fe52f965e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:28.150856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dcb3f-66c1-459c-8dcb-014a2c3d1200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:28.151696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dcb3f-66c1-459c-8dcb-014a2c3d1200 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:28.152063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dcb3f-66c1-459c-8dcb-014a2c3d1200 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:28.152430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dcb3f-66c1-459c-8dcb-014a2c3d1200 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:28.153230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dcb3f-66c1-459c-8dcb-014a2c3d1200 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:28.153622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dcb3f-66c1-459c-8dcb-014a2c3d1200 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:28.155934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dcb3f-66c1-459c-8dcb-014a2c3d1200 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:28.170486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d51d06-c17e-46fe-920e-59ff6b03ba5c None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:28.175288 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 413/810] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:28.179392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dcb3f-66c1-459c-8dcb-014a2c3d1200 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:28.245113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2f180-e816-4180-9f9e-06307445f4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:28.246441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2f180-e816-4180-9f9e-06307445f4c3 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:28.247220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2f180-e816-4180-9f9e-06307445f4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:28.249987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2f180-e816-4180-9f9e-06307445f4c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:28.250848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2f180-e816-4180-9f9e-06307445f4c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:28.253234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2f180-e816-4180-9f9e-06307445f4c3 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:28.280704 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 398/811] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:04:28 2022] POST /identity/v3/endpoints => generated 337 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:04:28.282791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99659a2d-c03c-4869-ad49-1531f2a711c9 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:28.283772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99659a2d-c03c-4869-ad49-1531f2a711c9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:28.284330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99659a2d-c03c-4869-ad49-1531f2a711c9 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:28.286663 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 399/812] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:28.293048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67280d2c-c1d3-43e5-92db-f7b7f3e8074d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:28.293678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67280d2c-c1d3-43e5-92db-f7b7f3e8074d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:28.294155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67280d2c-c1d3-43e5-92db-f7b7f3e8074d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:28.320280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-67280d2c-c1d3-43e5-92db-f7b7f3e8074d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:28.322594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-67280d2c-c1d3-43e5-92db-f7b7f3e8074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:28.327847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:28.336331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dcb3f-66c1-459c-8dcb-014a2c3d1200 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:28.341172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:28.400912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23515280-fb62-4d9a-8dfc-a8071888b873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:28.401916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23515280-fb62-4d9a-8dfc-a8071888b873 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:28.402555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23515280-fb62-4d9a-8dfc-a8071888b873 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:28.403047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23515280-fb62-4d9a-8dfc-a8071888b873 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:28.413843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23515280-fb62-4d9a-8dfc-a8071888b873 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:28.415609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23515280-fb62-4d9a-8dfc-a8071888b873 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:28.419426 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 400/813] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:28.420865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67280d2c-c1d3-43e5-92db-f7b7f3e8074d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:28.439187 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-23515280-fb62-4d9a-8dfc-a8071888b873 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:28.439187 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:28.439187 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:28.439187 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:28.439187 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:28.439187 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:28.439187 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:28.439187 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:28.439187 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:28.439187 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:28.439187 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:28.439187 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:28.439187 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:28.439187 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:28.439187 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:28.440384 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:28.440384 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:28.440384 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:28.440384 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:28.440384 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:28.440384 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:28.440384 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:28.440384 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:28.440384 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:28.440384 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:28.440384 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:28.440384 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:28.440384 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:28.440384 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:28.440384 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:28.440384 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:28.440384 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:28.441507 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:28.441507 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:28.441507 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:28.441507 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:28.441507 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:28.441507 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:28.441507 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:28.441507 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:28.448213 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 414/814] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:28.450610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23515280-fb62-4d9a-8dfc-a8071888b873 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:28.593068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23515280-fb62-4d9a-8dfc-a8071888b873 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:28.600749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67280d2c-c1d3-43e5-92db-f7b7f3e8074d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:28.641634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e090a0-d75f-4ad6-8bc0-6bc8589394ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:28.642261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e090a0-d75f-4ad6-8bc0-6bc8589394ae None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:28.642537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e090a0-d75f-4ad6-8bc0-6bc8589394ae None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:28.642806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e090a0-d75f-4ad6-8bc0-6bc8589394ae None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:28.643547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e090a0-d75f-4ad6-8bc0-6bc8589394ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:28.643865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e090a0-d75f-4ad6-8bc0-6bc8589394ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:28.645288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e090a0-d75f-4ad6-8bc0-6bc8589394ae None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:28.647157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274c422-f580-4cb1-addc-5c64282e23a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:28.649255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274c422-f580-4cb1-addc-5c64282e23a7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:28.649763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274c422-f580-4cb1-addc-5c64282e23a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:28.650204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274c422-f580-4cb1-addc-5c64282e23a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:28.659234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:28.663390 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 415/815] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:28.663773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274c422-f580-4cb1-addc-5c64282e23a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:28.665011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e090a0-d75f-4ad6-8bc0-6bc8589394ae None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:28.669827 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-a274c422-f580-4cb1-addc-5c64282e23a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:04:28.669827 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:28.669827 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:28.669827 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:28.669827 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:28.669827 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:28.669827 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:28.669827 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:28.669827 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:28.669827 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:28.669827 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:28.669827 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:28.669827 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:28.669827 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:28.669827 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:28.669827 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:28.670786 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:28.670786 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:28.670786 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:28.670786 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:28.670786 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:28.670786 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:28.670786 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:28.670786 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:28.670786 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:28.670786 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:28.670786 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:28.670786 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:28.670786 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:28.670786 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:28.670786 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:28.670786 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:28.671653 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:28.671653 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:28.671653 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:28.671653 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:28.671653 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:28.671653 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:28.671653 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:28.671653 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:28.671653 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:28.671653 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:28.671653 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:04:28.671653 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:28.674026 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 401/816] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:04:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:28.679882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274c422-f580-4cb1-addc-5c64282e23a7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:28.690894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:28.780328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e090a0-d75f-4ad6-8bc0-6bc8589394ae None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:28.796503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274c422-f580-4cb1-addc-5c64282e23a7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:28.816472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65512213-996c-4cee-9de9-49decac173b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:28.817139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65512213-996c-4cee-9de9-49decac173b1 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:28.817414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65512213-996c-4cee-9de9-49decac173b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:28.817694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65512213-996c-4cee-9de9-49decac173b1 None admin] PATH_INFO: `/v3/projects/651b8653291a414fba3805312708ce48/users/e63fa755c46b4a2b9e32e720f9fb8413/roles/1e0740decc23460f8c3d0f7007f2d97f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:28.833107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65512213-996c-4cee-9de9-49decac173b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=651b8653291a414fba3805312708ce48, user_id=e63fa755c46b4a2b9e32e720f9fb8413, role_id=1e0740decc23460f8c3d0f7007f2d97f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:28.833283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2b8d8-b9d8-4cc2-87b1-1fcb1c51c47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:28.833752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2b8d8-b9d8-4cc2-87b1-1fcb1c51c47b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:28.834090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2b8d8-b9d8-4cc2-87b1-1fcb1c51c47b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:28.834362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2b8d8-b9d8-4cc2-87b1-1fcb1c51c47b None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:28.834560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65512213-996c-4cee-9de9-49decac173b1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:28.835025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2b8d8-b9d8-4cc2-87b1-1fcb1c51c47b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:28.835349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2b8d8-b9d8-4cc2-87b1-1fcb1c51c47b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:28.836693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2b8d8-b9d8-4cc2-87b1-1fcb1c51c47b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:28.850369 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 402/817] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:04:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:28.850369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2b8d8-b9d8-4cc2-87b1-1fcb1c51c47b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:28.854025 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 416/818] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:04:28 2022] PUT /identity/v3/projects/651b8653291a414fba3805312708ce48/users/e63fa755c46b4a2b9e32e720f9fb8413/roles/1e0740decc23460f8c3d0f7007f2d97f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:04:28.855007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65512213-996c-4cee-9de9-49decac173b1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:28.945390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:28.960968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:28.996655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65512213-996c-4cee-9de9-49decac173b1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:29.008204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2b8d8-b9d8-4cc2-87b1-1fcb1c51c47b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:29.042577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6249e-6fce-4993-853b-bd61b586e282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:29.043230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6249e-6fce-4993-853b-bd61b586e282 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:29.043536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6249e-6fce-4993-853b-bd61b586e282 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:29.043815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6249e-6fce-4993-853b-bd61b586e282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:29.050589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d5ba3-ecb9-43bf-b420-7968560e07ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:29.051294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d5ba3-ecb9-43bf-b420-7968560e07ee None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:29.051549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d5ba3-ecb9-43bf-b420-7968560e07ee None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:29.051826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d5ba3-ecb9-43bf-b420-7968560e07ee None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:29.052423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d5ba3-ecb9-43bf-b420-7968560e07ee None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:29.053798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d5ba3-ecb9-43bf-b420-7968560e07ee None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:29.055043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6249e-6fce-4993-853b-bd61b586e282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:29.056541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6249e-6fce-4993-853b-bd61b586e282 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:29.064341 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-483d5ba3-ecb9-43bf-b420-7968560e07ee None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:04:29.064341 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:29.064341 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:29.064341 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:29.064341 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:29.064341 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:29.064341 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:29.064341 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:29.064341 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:04:29.064341 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:29.064341 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:29.064341 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:29.064341 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:29.064341 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:29.064341 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:29.064341 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:29.064341 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:29.065375 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:29.065375 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:29.065375 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:29.065375 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:29.065375 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:29.065375 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:29.065375 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:29.065375 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:29.065375 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:29.065375 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:29.065375 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:29.065375 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:29.065375 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:29.065375 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:29.065375 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:29.065375 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:29.066529 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:29.066529 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:29.066529 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:29.066529 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:29.066529 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:29.066529 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:29.066529 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:29.066529 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:29.066529 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:29.066529 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:29.066529 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:29.066529 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:29.066529 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:04:29.066529 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:29.066529 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 403/819] 10.222.0.27 () {56 vars in 1129 bytes} [Sun Aug 28 18:04:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:29.072128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d5ba3-ecb9-43bf-b420-7968560e07ee None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:29.078368 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f0f6249e-6fce-4993-853b-bd61b586e282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:29.078368 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:29.078368 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:29.078368 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:29.078368 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:29.078368 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:29.078368 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:29.078368 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:29.078368 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:29.078368 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:29.078368 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:29.078368 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:29.078368 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:29.078368 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:29.078368 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:29.078368 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:29.079429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:29.079429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:29.079429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:29.079429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:29.079429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:29.079429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:29.079429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:29.079429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:29.079429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:29.079429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:29.079429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:29.079429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:29.079429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:29.079429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:29.079429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:29.079429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:29.079429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:29.084286 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:29.084286 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:29.084286 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:29.084286 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 417/820] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:29.087387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6249e-6fce-4993-853b-bd61b586e282 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:29.186847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d5ba3-ecb9-43bf-b420-7968560e07ee None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:29.213848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:29.223054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6249e-6fce-4993-853b-bd61b586e282 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:29.224226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ffa93-34bb-49cc-bf63-5af35864da6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:29.224912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ffa93-34bb-49cc-bf63-5af35864da6b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:29.225253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ffa93-34bb-49cc-bf63-5af35864da6b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:29.225584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ffa93-34bb-49cc-bf63-5af35864da6b None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:29.226234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ffa93-34bb-49cc-bf63-5af35864da6b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:29.226531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ffa93-34bb-49cc-bf63-5af35864da6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:29.227985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ffa93-34bb-49cc-bf63-5af35864da6b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:29.233442 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 404/821] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 28 18:04:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:29.239639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ffa93-34bb-49cc-bf63-5af35864da6b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:29.258798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:29.270622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16e5d5-68f3-46d8-a5ba-9bc917eeaa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:29.271326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16e5d5-68f3-46d8-a5ba-9bc917eeaa01 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:29.271654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16e5d5-68f3-46d8-a5ba-9bc917eeaa01 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:29.271926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16e5d5-68f3-46d8-a5ba-9bc917eeaa01 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:29.272559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16e5d5-68f3-46d8-a5ba-9bc917eeaa01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:29.272862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16e5d5-68f3-46d8-a5ba-9bc917eeaa01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:29.274360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16e5d5-68f3-46d8-a5ba-9bc917eeaa01 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:29.288153 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 418/822] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:29.293366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16e5d5-68f3-46d8-a5ba-9bc917eeaa01 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:29.352165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ffa93-34bb-49cc-bf63-5af35864da6b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:29.388803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd33dad-c43a-49aa-9bde-bf0ac9e0cb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:29.389834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd33dad-c43a-49aa-9bde-bf0ac9e0cb10 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:29.390314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd33dad-c43a-49aa-9bde-bf0ac9e0cb10 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:29.390787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd33dad-c43a-49aa-9bde-bf0ac9e0cb10 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:29.391682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd33dad-c43a-49aa-9bde-bf0ac9e0cb10 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:29.392188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd33dad-c43a-49aa-9bde-bf0ac9e0cb10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:29.393765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd33dad-c43a-49aa-9bde-bf0ac9e0cb10 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:29.404251 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 405/823] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 28 18:04:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:29.405511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16e5d5-68f3-46d8-a5ba-9bc917eeaa01 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:29.405798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd33dad-c43a-49aa-9bde-bf0ac9e0cb10 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:29.443788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb45d29-39d7-4a0d-9700-5417c9b6c9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:29.444430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb45d29-39d7-4a0d-9700-5417c9b6c9ed None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:29.444703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb45d29-39d7-4a0d-9700-5417c9b6c9ed None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:29.445024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb45d29-39d7-4a0d-9700-5417c9b6c9ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:29.453813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb45d29-39d7-4a0d-9700-5417c9b6c9ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:29.455563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb45d29-39d7-4a0d-9700-5417c9b6c9ed None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:29.466118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:29.469281 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-1eb45d29-39d7-4a0d-9700-5417c9b6c9ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:04:29.469281 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:29.469281 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:29.469281 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:29.469281 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:29.469281 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:29.469281 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:29.469281 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:29.469281 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:29.469281 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:29.469281 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:29.469281 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:29.469281 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:29.469281 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:29.469281 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:29.469281 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:29.470217 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:29.471848 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:29.471848 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:29.471848 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:29.471848 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:29.471848 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:29.471848 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:29.471848 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:29.471848 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:29.471848 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:04:29.471848 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:29.471848 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 419/824] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 18:04:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:29.476900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb45d29-39d7-4a0d-9700-5417c9b6c9ed None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:29.525869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd33dad-c43a-49aa-9bde-bf0ac9e0cb10 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:29.535872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:29.575496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89c848-5d4a-4eca-a326-7e0bf7a7401c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:29.576114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89c848-5d4a-4eca-a326-7e0bf7a7401c None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:29.576480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89c848-5d4a-4eca-a326-7e0bf7a7401c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:29.576934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89c848-5d4a-4eca-a326-7e0bf7a7401c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:29.577796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89c848-5d4a-4eca-a326-7e0bf7a7401c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:29.579408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89c848-5d4a-4eca-a326-7e0bf7a7401c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:29.611303 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 406/825] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:04:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:04:29.611303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c6ff7-d394-4e26-9cca-80c0ad5ae55b None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:29.611303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c6ff7-d394-4e26-9cca-80c0ad5ae55b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:29.611303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c6ff7-d394-4e26-9cca-80c0ad5ae55b None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:29.611303 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 407/826] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:29.615758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb45d29-39d7-4a0d-9700-5417c9b6c9ed None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:29.616829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd8f2f-bce2-4689-81b5-5a322e162e65 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:29.617122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd8f2f-bce2-4689-81b5-5a322e162e65 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:29.617394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd8f2f-bce2-4689-81b5-5a322e162e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:29.637409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-41bd8f2f-bce2-4689-81b5-5a322e162e65 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:29.638713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-41bd8f2f-bce2-4689-81b5-5a322e162e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:29.665075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37cde1-adac-4412-b1c6-3f91373a5407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:29.665803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37cde1-adac-4412-b1c6-3f91373a5407 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:29.666075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37cde1-adac-4412-b1c6-3f91373a5407 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:29.666343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37cde1-adac-4412-b1c6-3f91373a5407 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:29.667134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37cde1-adac-4412-b1c6-3f91373a5407 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:29.667540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37cde1-adac-4412-b1c6-3f91373a5407 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:29.669177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37cde1-adac-4412-b1c6-3f91373a5407 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:29.693313 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 420/827] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 18:04:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:29.699030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37cde1-adac-4412-b1c6-3f91373a5407 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:29.744414 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 408/828] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:29.819264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:29.826633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37cde1-adac-4412-b1c6-3f91373a5407 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:29.872107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e033108-189e-4e2e-9804-bb8a07e66345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:29.872919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e033108-189e-4e2e-9804-bb8a07e66345 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:29.873083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e033108-189e-4e2e-9804-bb8a07e66345 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:29.873351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e033108-189e-4e2e-9804-bb8a07e66345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:29.954335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e033108-189e-4e2e-9804-bb8a07e66345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:29.956180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e033108-189e-4e2e-9804-bb8a07e66345 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:30.014774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd8f2f-bce2-4689-81b5-5a322e162e65 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:30.065979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:30.075863 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 421/829] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:04:29 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:04:30.084494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e033108-189e-4e2e-9804-bb8a07e66345 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:30.190421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:30.210866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e033108-189e-4e2e-9804-bb8a07e66345 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:30.255626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa8b35-6d48-4396-95df-1aceb5fb34d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:30.256893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8b35-6d48-4396-95df-1aceb5fb34d2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:30.257530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8b35-6d48-4396-95df-1aceb5fb34d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:30.257907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8b35-6d48-4396-95df-1aceb5fb34d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:30.263520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd8f2f-bce2-4689-81b5-5a322e162e65 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:30.272587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa8b35-6d48-4396-95df-1aceb5fb34d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:30.274602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa8b35-6d48-4396-95df-1aceb5fb34d2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:30.293565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-80aa8b35-6d48-4396-95df-1aceb5fb34d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:30.293565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:30.293565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:30.293565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:30.293565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:30.293565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:30.293565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:30.293565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:30.293565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:30.293565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:30.293565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:30.293565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:30.293565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:30.293565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:30.293565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:30.293565 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:30.294995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:30.294995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:30.294995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:30.294995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:30.294995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:30.294995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:30.294995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:30.294995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:30.294995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:30.294995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:30.294995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:30.294995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:30.294995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:30.294995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:30.294995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:30.294995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:30.294995 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:30.295961 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:30.295961 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:30.295961 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:30.297993 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 422/830] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:30.304655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa8b35-6d48-4396-95df-1aceb5fb34d2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:30.312971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da70ac1-9a92-4d3a-91f9-9a7800a26bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:30.313930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da70ac1-9a92-4d3a-91f9-9a7800a26bd3 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:30.314403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da70ac1-9a92-4d3a-91f9-9a7800a26bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:30.314842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da70ac1-9a92-4d3a-91f9-9a7800a26bd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:30.330272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da70ac1-9a92-4d3a-91f9-9a7800a26bd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:30.337097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-5da70ac1-9a92-4d3a-91f9-9a7800a26bd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:04:30.337097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:30.337097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:30.337097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:30.337097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:30.337097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:30.337097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:30.337097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:30.337097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:30.337097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:30.337097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:30.337097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:30.337097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:30.337097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:30.337097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:30.337097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:30.338145 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:30.338145 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:30.338145 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:30.338145 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:30.338145 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:30.338145 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:30.338145 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:30.338145 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:30.338145 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:30.338145 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:30.338145 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:30.338145 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:30.338145 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:30.338145 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:30.338145 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:30.338145 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:30.339032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:30.339032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:30.339032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:30.339032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:30.339032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:30.339032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:30.339032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:30.339032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:30.339032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:30.339032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:30.339032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:04:30.339032 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:30.340797 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 409/831] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:04:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:30.347207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da70ac1-9a92-4d3a-91f9-9a7800a26bd3 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:30.375472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:30.439771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa8b35-6d48-4396-95df-1aceb5fb34d2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:30.459501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:30.462573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da70ac1-9a92-4d3a-91f9-9a7800a26bd3 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:30.482143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa15e6-b5dc-4576-86ff-005102f4ad0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:30.483593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa15e6-b5dc-4576-86ff-005102f4ad0c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:30.484020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa15e6-b5dc-4576-86ff-005102f4ad0c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:30.484432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa15e6-b5dc-4576-86ff-005102f4ad0c None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:30.485219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa15e6-b5dc-4576-86ff-005102f4ad0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:30.485719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa15e6-b5dc-4576-86ff-005102f4ad0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:30.487334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa15e6-b5dc-4576-86ff-005102f4ad0c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:30.500496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46426132-fdf1-48db-855a-c89a479fcd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:30.501276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46426132-fdf1-48db-855a-c89a479fcd51 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:30.501645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46426132-fdf1-48db-855a-c89a479fcd51 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:30.502057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46426132-fdf1-48db-855a-c89a479fcd51 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:30.502450 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 423/832] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:30.502894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46426132-fdf1-48db-855a-c89a479fcd51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:30.510559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46426132-fdf1-48db-855a-c89a479fcd51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:30.510559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46426132-fdf1-48db-855a-c89a479fcd51 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:30.510813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa15e6-b5dc-4576-86ff-005102f4ad0c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:30.514632 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 410/833] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:04:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:30.525182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46426132-fdf1-48db-855a-c89a479fcd51 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:30.628438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa15e6-b5dc-4576-86ff-005102f4ad0c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:30.645147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:30.663172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46426132-fdf1-48db-855a-c89a479fcd51 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:30.682330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9caec6-dcde-463c-8d8e-e2cfcb5591dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:30.683728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9caec6-dcde-463c-8d8e-e2cfcb5591dd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:30.684203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9caec6-dcde-463c-8d8e-e2cfcb5591dd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:30.684668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9caec6-dcde-463c-8d8e-e2cfcb5591dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:30.695855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9caec6-dcde-463c-8d8e-e2cfcb5591dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:30.698057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9caec6-dcde-463c-8d8e-e2cfcb5591dd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:30.701444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ef927-ff12-412e-9833-3dbe8595ba20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:30.702421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ef927-ff12-412e-9833-3dbe8595ba20 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:30.702700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ef927-ff12-412e-9833-3dbe8595ba20 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:30.702974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ef927-ff12-412e-9833-3dbe8595ba20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:30.711774 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-be9caec6-dcde-463c-8d8e-e2cfcb5591dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:30.711774 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:30.711774 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:30.711774 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:30.711774 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:30.711774 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:30.711774 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:30.711774 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:30.711774 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:30.711774 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:30.711774 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:30.711774 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:30.711774 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:30.711774 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:30.711774 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:30.712676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:30.712676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:30.712676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:30.712676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:30.712676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:30.712676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:30.712676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:30.712676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:30.712676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:30.712676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:30.712676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:30.712676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:30.712676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:30.712676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:30.712676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:30.712676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:30.712676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:30.713655 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:30.713655 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:30.713655 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:30.713655 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:30.713655 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:30.713655 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:30.713655 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:30.713655 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:30.714095 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 424/834] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:30.719862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ef927-ff12-412e-9833-3dbe8595ba20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:30.720271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9caec6-dcde-463c-8d8e-e2cfcb5591dd None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:30.721419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ef927-ff12-412e-9833-3dbe8595ba20 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:30.738156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-d87ef927-ff12-412e-9833-3dbe8595ba20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:30.738156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:30.738156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:30.738156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:30.738156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:30.738156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:30.738156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:30.738156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:30.738156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:30.738156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:30.738156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:30.738156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:30.738156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:30.738156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:30.738156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:30.738156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:30.739185 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:30.739185 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:30.739185 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:30.739185 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:30.739185 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:30.739185 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:30.739185 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:30.739185 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:30.739185 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:30.739185 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:30.739185 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:30.739185 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:30.739185 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:30.739185 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:30.739185 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:30.739185 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:30.739185 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:30.740132 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:30.740132 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:30.740132 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:30.740132 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 411/835] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:30.745152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ef927-ff12-412e-9833-3dbe8595ba20 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:30.763637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:30.844120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9caec6-dcde-463c-8d8e-e2cfcb5591dd None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:30.863516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ef927-ff12-412e-9833-3dbe8595ba20 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:30.895469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8dc64-3c5b-4bf1-9fae-cc2de1116acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:30.896408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8dc64-3c5b-4bf1-9fae-cc2de1116acc None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:30.896696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8dc64-3c5b-4bf1-9fae-cc2de1116acc None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:30.896973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8dc64-3c5b-4bf1-9fae-cc2de1116acc None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:30.897693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8dc64-3c5b-4bf1-9fae-cc2de1116acc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:30.898004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8dc64-3c5b-4bf1-9fae-cc2de1116acc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:30.899517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8dc64-3c5b-4bf1-9fae-cc2de1116acc None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:30.910620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db40465-4aba-4af8-9a4c-5c04190af715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:30.912002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db40465-4aba-4af8-9a4c-5c04190af715 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:30.912284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db40465-4aba-4af8-9a4c-5c04190af715 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:30.912559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db40465-4aba-4af8-9a4c-5c04190af715 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:30.913236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db40465-4aba-4af8-9a4c-5c04190af715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:30.913544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db40465-4aba-4af8-9a4c-5c04190af715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:30.914947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db40465-4aba-4af8-9a4c-5c04190af715 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:30.920105 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 425/836] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:30.926296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1091915-1c23-41bc-a0c7-45d107381f13 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:30.926633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1091915-1c23-41bc-a0c7-45d107381f13 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:30.926821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1091915-1c23-41bc-a0c7-45d107381f13 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:30.929191 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 412/837] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:30.930251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db40465-4aba-4af8-9a4c-5c04190af715 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:30.931387 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 426/838] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:04:30.934002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811d8ad-0925-41c6-8687-a6b91a22fe2e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:30.934927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811d8ad-0925-41c6-8687-a6b91a22fe2e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:30.935205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811d8ad-0925-41c6-8687-a6b91a22fe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:30.954133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9811d8ad-0925-41c6-8687-a6b91a22fe2e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:30.955398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9811d8ad-0925-41c6-8687-a6b91a22fe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:30.981998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:31.018128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:31.039395 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 427/839] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:04:31.039395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811d8ad-0925-41c6-8687-a6b91a22fe2e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:31.055374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db40465-4aba-4af8-9a4c-5c04190af715 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:31.093173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc955d-9eb5-47c3-b85c-56b45ccb1103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:31.093798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc955d-9eb5-47c3-b85c-56b45ccb1103 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:31.094084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc955d-9eb5-47c3-b85c-56b45ccb1103 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:31.094412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc955d-9eb5-47c3-b85c-56b45ccb1103 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:31.095167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc955d-9eb5-47c3-b85c-56b45ccb1103 None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=651b8653291a414fba3805312708ce48, user.id=faef473a2ab84661b09f3ba3dd977058) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:31.095560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc955d-9eb5-47c3-b85c-56b45ccb1103 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:31.097047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc955d-9eb5-47c3-b85c-56b45ccb1103 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:31.104020 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 413/840] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:04:30 2022] GET /identity/v3/role_assignments?user.id=faef473a2ab84661b09f3ba3dd977058&scope.project.id=651b8653291a414fba3805312708ce48&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:31.164278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811d8ad-0925-41c6-8687-a6b91a22fe2e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:31.205030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071ad52-bc34-4a51-b124-4ca6bd58c746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:31.205743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071ad52-bc34-4a51-b124-4ca6bd58c746 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:31.206023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071ad52-bc34-4a51-b124-4ca6bd58c746 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:31.206403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071ad52-bc34-4a51-b124-4ca6bd58c746 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:31.214983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071ad52-bc34-4a51-b124-4ca6bd58c746 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:31.216636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071ad52-bc34-4a51-b124-4ca6bd58c746 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:31.230306 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-1071ad52-bc34-4a51-b124-4ca6bd58c746 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:04:31.230306 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:31.230306 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:31.230306 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:31.230306 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:31.230306 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:31.230306 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:31.230306 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:31.230306 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:31.230306 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:31.230306 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:31.230306 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:31.230306 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:31.230306 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:31.230306 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:31.230306 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:31.231440 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:31.232464 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:31.232464 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:31.232464 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:31.232464 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:31.232464 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:31.232464 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:31.232464 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:31.232464 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:31.232464 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:04:31.232464 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:31.232464 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 428/841] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:04:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:31.239670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc955d-9eb5-47c3-b85c-56b45ccb1103 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:31.309307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071ad52-bc34-4a51-b124-4ca6bd58c746 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:31.338864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:31.377118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc955d-9eb5-47c3-b85c-56b45ccb1103 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:31.425597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3712a-9944-4ba4-98b1-34bda44bfd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:31.426473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3712a-9944-4ba4-98b1-34bda44bfd59 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:31.426752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3712a-9944-4ba4-98b1-34bda44bfd59 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:31.427025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3712a-9944-4ba4-98b1-34bda44bfd59 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:31.428046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3712a-9944-4ba4-98b1-34bda44bfd59 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:31.428350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3712a-9944-4ba4-98b1-34bda44bfd59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:31.430432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3712a-9944-4ba4-98b1-34bda44bfd59 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:31.431801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071ad52-bc34-4a51-b124-4ca6bd58c746 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:31.440623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:31.459115 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 414/842] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 28 18:04:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:31.461210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3712a-9944-4ba4-98b1-34bda44bfd59 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:31.476567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd523a33-644a-420b-9583-61834a8be063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:31.477234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd523a33-644a-420b-9583-61834a8be063 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:31.477507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd523a33-644a-420b-9583-61834a8be063 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:31.477775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd523a33-644a-420b-9583-61834a8be063 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:31.489195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd523a33-644a-420b-9583-61834a8be063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:31.494461 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-bd523a33-644a-420b-9583-61834a8be063 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:31.494461 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:31.494461 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:31.494461 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:31.494461 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:31.494461 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:31.494461 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:31.494461 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:31.494461 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:31.494461 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:31.494461 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:31.494461 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:31.494461 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:31.494461 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:31.494461 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:31.494461 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:31.495493 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:31.495493 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:31.495493 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:31.495493 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:31.495493 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:31.495493 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:31.495493 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:31.495493 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:31.495493 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:31.495493 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:31.495493 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:31.495493 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:31.495493 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:31.495493 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:31.495493 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:31.495493 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:31.496340 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:31.496340 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:31.496340 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:31.496340 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:31.496340 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:31.496340 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:31.496340 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:31.496340 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:31.496340 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:31.496340 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:31.496340 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:04:31.496340 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:31.496340 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 429/843] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:04:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:31.502579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd523a33-644a-420b-9583-61834a8be063 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:31.596019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:31.598870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3712a-9944-4ba4-98b1-34bda44bfd59 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:31.621865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd523a33-644a-420b-9583-61834a8be063 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:31.653398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610d9f3-4bb5-45a5-bc5f-feac521458c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:31.654474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610d9f3-4bb5-45a5-bc5f-feac521458c7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:31.654845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610d9f3-4bb5-45a5-bc5f-feac521458c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:31.655437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610d9f3-4bb5-45a5-bc5f-feac521458c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:31.662764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8a3ed-84bc-4bad-a503-b65ffd1437a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:31.663678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a3ed-84bc-4bad-a503-b65ffd1437a8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:31.664183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a3ed-84bc-4bad-a503-b65ffd1437a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:31.664646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a3ed-84bc-4bad-a503-b65ffd1437a8 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:31.665485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8a3ed-84bc-4bad-a503-b65ffd1437a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:31.665981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8a3ed-84bc-4bad-a503-b65ffd1437a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:31.667845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8a3ed-84bc-4bad-a503-b65ffd1437a8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:31.682001 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 430/844] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:04:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:31.683360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8a3ed-84bc-4bad-a503-b65ffd1437a8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:31.730179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:31.738662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610d9f3-4bb5-45a5-bc5f-feac521458c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:31.740002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610d9f3-4bb5-45a5-bc5f-feac521458c7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:31.802865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8a3ed-84bc-4bad-a503-b65ffd1437a8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:31.841168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce994462-ca5f-427a-addf-b2ff96c97fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:31.842103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce994462-ca5f-427a-addf-b2ff96c97fb1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:31.842525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce994462-ca5f-427a-addf-b2ff96c97fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:31.842937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce994462-ca5f-427a-addf-b2ff96c97fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:31.847482 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 415/845] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:04:31 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:04:31.848776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd188d64-8b8b-4ae8-b870-ef1dc49c86b8 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:31.849063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd188d64-8b8b-4ae8-b870-ef1dc49c86b8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:31.849341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd188d64-8b8b-4ae8-b870-ef1dc49c86b8 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:31.851290 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 416/846] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:31.852586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd188d64-8b8b-4ae8-b870-ef1dc49c86b8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:31.858503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:31.860941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce994462-ca5f-427a-addf-b2ff96c97fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:31.863020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce994462-ca5f-427a-addf-b2ff96c97fb1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:31.878542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-ce994462-ca5f-427a-addf-b2ff96c97fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:31.878542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:31.878542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:31.878542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:31.878542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:31.878542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:31.878542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:31.878542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:31.878542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:31.878542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:31.878542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:31.878542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:31.878542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:31.878542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:31.878542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:31.878542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:31.879601 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:31.879601 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:31.879601 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:31.879601 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:31.879601 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:31.879601 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:31.879601 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:31.879601 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:31.879601 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:31.879601 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:31.879601 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:31.879601 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:31.879601 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:31.879601 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:31.879601 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:31.879601 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:31.879601 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:31.880480 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:31.880480 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:31.880480 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:31.880480 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 431/847] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:31.881279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf1eef-335d-49f4-9b98-8685eac6b6a8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:31.881279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf1eef-335d-49f4-9b98-8685eac6b6a8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:31.881451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf1eef-335d-49f4-9b98-8685eac6b6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:31.899962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-90bf1eef-335d-49f4-9b98-8685eac6b6a8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:31.901196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-90bf1eef-335d-49f4-9b98-8685eac6b6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:31.962702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:31.971886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd188d64-8b8b-4ae8-b870-ef1dc49c86b8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:31.978302 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 432/848] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:31.979218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf1eef-335d-49f4-9b98-8685eac6b6a8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:32.032330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf08d7-d8a6-4fa7-9385-6c173d15b666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:32.033633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf08d7-d8a6-4fa7-9385-6c173d15b666 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:32.034127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf08d7-d8a6-4fa7-9385-6c173d15b666 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:32.034821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf08d7-d8a6-4fa7-9385-6c173d15b666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:32.050669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf08d7-d8a6-4fa7-9385-6c173d15b666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:32.053288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf08d7-d8a6-4fa7-9385-6c173d15b666 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:32.074981 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-ddaf08d7-d8a6-4fa7-9385-6c173d15b666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:32.074981 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:32.074981 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:32.074981 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:32.074981 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:32.074981 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:32.074981 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:32.074981 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:32.074981 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:32.074981 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:32.074981 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:32.074981 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:32.074981 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:32.074981 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:32.074981 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:32.074981 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:32.075985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:32.075985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:32.075985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:32.075985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:32.075985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:32.075985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:32.075985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:32.075985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:32.075985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:32.075985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:32.075985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:32.075985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:32.075985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:32.075985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:32.075985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:32.075985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:32.075985 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:32.077416 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:32.077416 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:32.077416 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:32.079764 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 417/849] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:32.084916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf08d7-d8a6-4fa7-9385-6c173d15b666 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:32.099923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf1eef-335d-49f4-9b98-8685eac6b6a8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:32.124735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:32.138399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700f547-31b0-402b-88eb-8e4ee6a5f7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:32.139272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700f547-31b0-402b-88eb-8e4ee6a5f7d0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:32.139629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700f547-31b0-402b-88eb-8e4ee6a5f7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:32.139963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700f547-31b0-402b-88eb-8e4ee6a5f7d0 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:32.140681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700f547-31b0-402b-88eb-8e4ee6a5f7d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:32.141044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700f547-31b0-402b-88eb-8e4ee6a5f7d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:32.142484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700f547-31b0-402b-88eb-8e4ee6a5f7d0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:32.161759 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 433/850] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:32.162859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700f547-31b0-402b-88eb-8e4ee6a5f7d0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:32.218509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf08d7-d8a6-4fa7-9385-6c173d15b666 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:32.254403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072402e6-ae6c-43e4-9a5d-74888835b08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:32.255090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072402e6-ae6c-43e4-9a5d-74888835b08b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:32.255404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072402e6-ae6c-43e4-9a5d-74888835b08b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:32.255682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072402e6-ae6c-43e4-9a5d-74888835b08b None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:32.256392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072402e6-ae6c-43e4-9a5d-74888835b08b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:32.256696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072402e6-ae6c-43e4-9a5d-74888835b08b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:32.258104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072402e6-ae6c-43e4-9a5d-74888835b08b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:32.273419 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 418/851] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:32.274168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072402e6-ae6c-43e4-9a5d-74888835b08b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:32.292039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:32.307107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700f547-31b0-402b-88eb-8e4ee6a5f7d0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:32.347881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10e4ff-ead0-47cf-9757-58e8182f2913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:32.348825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10e4ff-ead0-47cf-9757-58e8182f2913 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:32.349300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10e4ff-ead0-47cf-9757-58e8182f2913 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:32.349838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10e4ff-ead0-47cf-9757-58e8182f2913 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:32.359385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10e4ff-ead0-47cf-9757-58e8182f2913 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:32.361457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10e4ff-ead0-47cf-9757-58e8182f2913 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:32.376770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-8a10e4ff-ead0-47cf-9757-58e8182f2913 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:04:32.376770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:32.376770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:32.376770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:32.376770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:32.376770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:32.376770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:32.376770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:32.376770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:32.376770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:32.376770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:32.376770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:32.376770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:32.376770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:32.376770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:32.376770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:32.377753 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:32.378692 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:32.378692 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:32.378692 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:32.378692 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:32.378692 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:32.378692 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:32.378692 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:32.378692 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:32.378692 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:04:32.378692 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:32.385668 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 434/852] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 18:04:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:32.385668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10e4ff-ead0-47cf-9757-58e8182f2913 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:32.392919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072402e6-ae6c-43e4-9a5d-74888835b08b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:32.429905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:32.433024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8af32-1026-4053-820f-9cf10ba9b4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:32.433486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8af32-1026-4053-820f-9cf10ba9b4b8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:32.433766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8af32-1026-4053-820f-9cf10ba9b4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:32.434033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8af32-1026-4053-820f-9cf10ba9b4b8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:32.434626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8af32-1026-4053-820f-9cf10ba9b4b8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:32.436194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8af32-1026-4053-820f-9cf10ba9b4b8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:32.445097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-50b8af32-1026-4053-820f-9cf10ba9b4b8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:04:32.445097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:32.445097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:32.445097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:32.445097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:32.445097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:32.445097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:32.445097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:32.445097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:04:32.445097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:32.445097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:32.445097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:32.445097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:32.445097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:32.445097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:32.445097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:32.445097 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:32.446134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:32.446134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:32.446134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:32.446134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:32.446134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:32.446134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:32.446134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:32.446134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:32.446134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:32.446134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:32.446134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:32.446134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:32.446134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:32.446134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:32.446134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:32.446134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:32.446964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:32.446964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:32.446964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:32.446964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:32.446964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:32.446964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:32.446964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:32.446964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:32.446964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:32.446964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:32.446964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:32.446964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:32.446964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:04:32.446964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:32.446964 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 419/853] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:04:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:32.447826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8af32-1026-4053-820f-9cf10ba9b4b8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:32.500948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10e4ff-ead0-47cf-9757-58e8182f2913 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:32.523401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:32.537928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedaab2-7b5e-407b-ad2c-c1fdb930896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:32.538571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedaab2-7b5e-407b-ad2c-c1fdb930896a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:32.538857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedaab2-7b5e-407b-ad2c-c1fdb930896a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:32.539130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedaab2-7b5e-407b-ad2c-c1fdb930896a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:32.546294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedaab2-7b5e-407b-ad2c-c1fdb930896a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:32.547819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedaab2-7b5e-407b-ad2c-c1fdb930896a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:32.559473 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3aedaab2-7b5e-407b-ad2c-c1fdb930896a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:32.559473 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:32.559473 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:32.559473 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:32.559473 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:32.559473 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:32.559473 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:32.559473 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:32.559473 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:32.559473 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:32.559473 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:32.559473 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:32.559473 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:32.559473 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:32.559473 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:32.560499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:32.560499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:32.560499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:32.560499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:32.560499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:32.560499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:32.560499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:32.560499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:32.560499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:32.560499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:32.560499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:32.560499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:32.560499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:32.560499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:32.560499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:32.560499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:32.560499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:32.561823 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:32.561823 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:32.561823 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:32.561823 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:32.561823 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:32.561823 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:32.561823 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:32.561823 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:32.561823 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 435/854] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:32.561823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedaab2-7b5e-407b-ad2c-c1fdb930896a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:32.562582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8af32-1026-4053-820f-9cf10ba9b4b8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:32.603198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eaef69-5093-4a4a-809c-58ec489ad50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:32.603838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaef69-5093-4a4a-809c-58ec489ad50e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:32.604171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaef69-5093-4a4a-809c-58ec489ad50e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:32.604450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaef69-5093-4a4a-809c-58ec489ad50e None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:32.605650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaef69-5093-4a4a-809c-58ec489ad50e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:32.605650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaef69-5093-4a4a-809c-58ec489ad50e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:32.606920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaef69-5093-4a4a-809c-58ec489ad50e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:32.631353 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 420/855] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 28 18:04:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:32.631353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eaef69-5093-4a4a-809c-58ec489ad50e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:32.677456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedaab2-7b5e-407b-ad2c-c1fdb930896a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:32.679478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:32.713734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed28a9-56be-4682-be3f-63ee64df18ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:32.714383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed28a9-56be-4682-be3f-63ee64df18ad None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:32.714622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed28a9-56be-4682-be3f-63ee64df18ad None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:32.714895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed28a9-56be-4682-be3f-63ee64df18ad None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:32.715571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed28a9-56be-4682-be3f-63ee64df18ad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:32.715877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed28a9-56be-4682-be3f-63ee64df18ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:32.717499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed28a9-56be-4682-be3f-63ee64df18ad None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:32.723885 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 436/856] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:04:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:32.724712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed28a9-56be-4682-be3f-63ee64df18ad None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:32.745575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eaef69-5093-4a4a-809c-58ec489ad50e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:32.778022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:32.785403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c17cab-abb0-42da-a21b-8e6579435e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:32.786185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c17cab-abb0-42da-a21b-8e6579435e73 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:32.786768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c17cab-abb0-42da-a21b-8e6579435e73 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:32.786768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c17cab-abb0-42da-a21b-8e6579435e73 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:32.787502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c17cab-abb0-42da-a21b-8e6579435e73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:32.787870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c17cab-abb0-42da-a21b-8e6579435e73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:32.789304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c17cab-abb0-42da-a21b-8e6579435e73 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:32.802289 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 421/857] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:32.803143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c17cab-abb0-42da-a21b-8e6579435e73 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:32.837857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed28a9-56be-4682-be3f-63ee64df18ad None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:32.877685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e720b89-3f75-42c6-aacc-bc709cde7d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:32.878443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e720b89-3f75-42c6-aacc-bc709cde7d69 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:32.878784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e720b89-3f75-42c6-aacc-bc709cde7d69 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:32.879061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e720b89-3f75-42c6-aacc-bc709cde7d69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:32.913646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c17cab-abb0-42da-a21b-8e6579435e73 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:32.918039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:32.952640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b8dc6-526a-451f-a867-7c62168d3a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:32.953547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b8dc6-526a-451f-a867-7c62168d3a97 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:32.953825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b8dc6-526a-451f-a867-7c62168d3a97 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:32.954087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b8dc6-526a-451f-a867-7c62168d3a97 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:32.954720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b8dc6-526a-451f-a867-7c62168d3a97 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:32.955019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b8dc6-526a-451f-a867-7c62168d3a97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:32.956430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b8dc6-526a-451f-a867-7c62168d3a97 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:32.960278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e720b89-3f75-42c6-aacc-bc709cde7d69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:32.971640 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 422/858] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:04:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:32.971853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e720b89-3f75-42c6-aacc-bc709cde7d69 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:32.971950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b8dc6-526a-451f-a867-7c62168d3a97 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:33.045574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:33.100834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b8dc6-526a-451f-a867-7c62168d3a97 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:33.101436 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 437/859] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:04:32 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:04:33.102969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a259554-da93-4854-b1b6-720bb75b21ba None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:33.104243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a259554-da93-4854-b1b6-720bb75b21ba None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:33.104540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a259554-da93-4854-b1b6-720bb75b21ba None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:33.106224 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 438/860] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:33.108834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a259554-da93-4854-b1b6-720bb75b21ba None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:33.147682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886179ff-46ea-487d-b5ac-f5ae63faaad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:33.148308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886179ff-46ea-487d-b5ac-f5ae63faaad5 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:33.148588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886179ff-46ea-487d-b5ac-f5ae63faaad5 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:33.148860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886179ff-46ea-487d-b5ac-f5ae63faaad5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:33.149598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886179ff-46ea-487d-b5ac-f5ae63faaad5 None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=651b8653291a414fba3805312708ce48, user.id=d55caefe410444509a1eee4262b76c80) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:33.150084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886179ff-46ea-487d-b5ac-f5ae63faaad5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:33.152444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886179ff-46ea-487d-b5ac-f5ae63faaad5 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:33.163409 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 423/861] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:04:32 2022] GET /identity/v3/role_assignments?user.id=d55caefe410444509a1eee4262b76c80&scope.project.id=651b8653291a414fba3805312708ce48&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:33.163409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0624e73-4c6d-4465-9fdb-dc7e026b1dbc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:33.163409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0624e73-4c6d-4465-9fdb-dc7e026b1dbc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:33.163409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0624e73-4c6d-4465-9fdb-dc7e026b1dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:33.197919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:33.200063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b0624e73-4c6d-4465-9fdb-dc7e026b1dbc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:33.202401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b0624e73-4c6d-4465-9fdb-dc7e026b1dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:33.241959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a259554-da93-4854-b1b6-720bb75b21ba None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:33.282611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80217819-da83-40b6-83e4-e61c37745864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:33.283384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80217819-da83-40b6-83e4-e61c37745864 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:33.283664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80217819-da83-40b6-83e4-e61c37745864 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:33.283945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80217819-da83-40b6-83e4-e61c37745864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:33.296169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80217819-da83-40b6-83e4-e61c37745864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:33.297591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80217819-da83-40b6-83e4-e61c37745864 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:33.308713 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 424/862] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:33.322164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-80217819-da83-40b6-83e4-e61c37745864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:33.322164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:33.322164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:33.322164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:33.322164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:33.322164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:33.322164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:33.322164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:33.322164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:33.322164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:33.322164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:33.322164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:33.322164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:33.322164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:33.322164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:33.322164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:33.323213 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:33.323213 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:33.323213 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:33.323213 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:33.323213 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:33.323213 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:33.323213 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:33.323213 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:33.323213 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:33.323213 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:33.323213 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:33.323213 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:33.323213 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:33.323213 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:33.323213 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:33.323213 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:33.323213 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:33.324140 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:33.324140 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:33.324140 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:33.324140 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 439/863] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:33.330648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0624e73-4c6d-4465-9fdb-dc7e026b1dbc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:33.388037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:33.439459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0624e73-4c6d-4465-9fdb-dc7e026b1dbc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:33.477679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3677fd-67f0-4812-bbfa-e29ebe7596f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:33.478661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3677fd-67f0-4812-bbfa-e29ebe7596f8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:33.479191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3677fd-67f0-4812-bbfa-e29ebe7596f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:33.479685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3677fd-67f0-4812-bbfa-e29ebe7596f8 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:33.480560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3677fd-67f0-4812-bbfa-e29ebe7596f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:33.481052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3677fd-67f0-4812-bbfa-e29ebe7596f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:33.482685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3677fd-67f0-4812-bbfa-e29ebe7596f8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:33.496291 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 425/864] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:33.502163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80217819-da83-40b6-83e4-e61c37745864 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:33.577325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3677fd-67f0-4812-bbfa-e29ebe7596f8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:33.655842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80217819-da83-40b6-83e4-e61c37745864 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:33.677256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:33.699066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac6007-e232-4a46-a015-68eefd2d40bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:33.699744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac6007-e232-4a46-a015-68eefd2d40bd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:33.700020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac6007-e232-4a46-a015-68eefd2d40bd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:33.700287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac6007-e232-4a46-a015-68eefd2d40bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:33.709839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac6007-e232-4a46-a015-68eefd2d40bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:33.711634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac6007-e232-4a46-a015-68eefd2d40bd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:33.717883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3677fd-67f0-4812-bbfa-e29ebe7596f8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:33.726280 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a3ac6007-e232-4a46-a015-68eefd2d40bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:33.726280 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:33.726280 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:33.726280 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:33.726280 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:33.726280 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:33.726280 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:33.726280 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:33.726280 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:33.726280 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:33.726280 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:33.726280 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:33.726280 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:33.726280 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:33.726280 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:33.728200 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:33.728200 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:33.728200 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:33.728200 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:33.728200 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:33.728200 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:33.728200 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:33.728200 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:33.728200 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:33.728200 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:33.728200 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:33.728200 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:33.728200 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:33.728200 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:33.728200 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:33.728200 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:33.728200 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:33.729696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:33.729696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:33.729696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:33.729696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:33.729696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:33.729696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:33.729696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:33.729696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:33.733211 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 440/865] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:33.734798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac6007-e232-4a46-a015-68eefd2d40bd None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:33.736202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:33.765242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6d5bf-6808-4e0e-806f-01fb9f1aba43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:33.766683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6d5bf-6808-4e0e-806f-01fb9f1aba43 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:33.767275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6d5bf-6808-4e0e-806f-01fb9f1aba43 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:33.767903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6d5bf-6808-4e0e-806f-01fb9f1aba43 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:33.768741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6d5bf-6808-4e0e-806f-01fb9f1aba43 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:33.770445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6d5bf-6808-4e0e-806f-01fb9f1aba43 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:33.782804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-acc6d5bf-6808-4e0e-806f-01fb9f1aba43 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:04:33.782804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:33.782804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:33.782804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:33.782804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:33.782804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:33.782804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:33.782804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:33.782804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:04:33.782804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:33.782804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:33.782804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:33.782804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:33.782804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:33.782804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:33.782804 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:33.783868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:33.783868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:33.783868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:33.783868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:33.783868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:33.783868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:33.783868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:33.783868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:33.783868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:33.783868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:33.783868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:33.783868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:33.783868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:33.783868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:33.783868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:33.783868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:33.783868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:33.784754 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:33.784754 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:33.784754 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:33.784754 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:33.784754 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:33.784754 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:33.784754 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:33.784754 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:33.784754 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:33.784754 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:33.784754 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:33.784754 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:33.784754 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:04:33.784754 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:33.793134 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 426/866] 10.222.0.27 () {56 vars in 1132 bytes} [Sun Aug 28 18:04:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:33.793715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6d5bf-6808-4e0e-806f-01fb9f1aba43 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:33.868167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac6007-e232-4a46-a015-68eefd2d40bd None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:33.908536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68df97-d28d-4fdb-97aa-c71c2b47529f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:33.909676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68df97-d28d-4fdb-97aa-c71c2b47529f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:33.910220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68df97-d28d-4fdb-97aa-c71c2b47529f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:33.910686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68df97-d28d-4fdb-97aa-c71c2b47529f None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:33.911609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6d5bf-6808-4e0e-806f-01fb9f1aba43 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:33.911912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68df97-d28d-4fdb-97aa-c71c2b47529f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:33.912405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68df97-d28d-4fdb-97aa-c71c2b47529f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:33.914268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68df97-d28d-4fdb-97aa-c71c2b47529f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:33.930918 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 441/867] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:33.937793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68df97-d28d-4fdb-97aa-c71c2b47529f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:33.954245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f25318-f076-4903-954a-eed53c957e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:33.954859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f25318-f076-4903-954a-eed53c957e0f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:33.955132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f25318-f076-4903-954a-eed53c957e0f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:33.955443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f25318-f076-4903-954a-eed53c957e0f None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:33.956227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f25318-f076-4903-954a-eed53c957e0f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:33.956903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f25318-f076-4903-954a-eed53c957e0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:33.958538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f25318-f076-4903-954a-eed53c957e0f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:33.964946 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 427/868] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 18:04:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:33.970557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f25318-f076-4903-954a-eed53c957e0f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:33.990361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:34.019328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:34.082031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68df97-d28d-4fdb-97aa-c71c2b47529f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:34.105397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f25318-f076-4903-954a-eed53c957e0f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:34.123019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0626b68-f1f0-41cd-be82-7d70fcf61aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:34.124041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0626b68-f1f0-41cd-be82-7d70fcf61aa6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:34.124538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0626b68-f1f0-41cd-be82-7d70fcf61aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:34.125001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0626b68-f1f0-41cd-be82-7d70fcf61aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:34.126080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0626b68-f1f0-41cd-be82-7d70fcf61aa6 None admin] RBAC: Adding query filter params (role.id=1e0740decc23460f8c3d0f7007f2d97f, scope.project.id=651b8653291a414fba3805312708ce48, user.id=e63fa755c46b4a2b9e32e720f9fb8413) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:34.126678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0626b68-f1f0-41cd-be82-7d70fcf61aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:34.128425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0626b68-f1f0-41cd-be82-7d70fcf61aa6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:34.137342 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 442/869] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:04:33 2022] GET /identity/v3/role_assignments?user.id=e63fa755c46b4a2b9e32e720f9fb8413&scope.project.id=651b8653291a414fba3805312708ce48&role.id=1e0740decc23460f8c3d0f7007f2d97f => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:34.152698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000ddf7-59e9-4ef9-8a54-9b27bf3c87cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:34.153732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000ddf7-59e9-4ef9-8a54-9b27bf3c87cc None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:34.154211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000ddf7-59e9-4ef9-8a54-9b27bf3c87cc None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:34.154678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000ddf7-59e9-4ef9-8a54-9b27bf3c87cc None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:34.155610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000ddf7-59e9-4ef9-8a54-9b27bf3c87cc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:34.156120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000ddf7-59e9-4ef9-8a54-9b27bf3c87cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:34.157847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000ddf7-59e9-4ef9-8a54-9b27bf3c87cc None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:34.164120 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 428/870] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 18:04:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:34.907689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fd395-bfdc-44c2-8a6c-fc87f5865eb8 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:34.908218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fd395-bfdc-44c2-8a6c-fc87f5865eb8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:34.908218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fd395-bfdc-44c2-8a6c-fc87f5865eb8 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:34.909807 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 443/871] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:34.915284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbe0be-1c12-4cee-9156-65e10337a6a2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:34.915689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbe0be-1c12-4cee-9156-65e10337a6a2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:34.915878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbe0be-1c12-4cee-9156-65e10337a6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:34.934304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-02bbe0be-1c12-4cee-9156-65e10337a6a2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:34.935556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-02bbe0be-1c12-4cee-9156-65e10337a6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:35.009060 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 429/872] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:35.171623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769ea03-1970-42cb-8446-8d8c07ab2a4f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:35.171832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769ea03-1970-42cb-8446-8d8c07ab2a4f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:35.172094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769ea03-1970-42cb-8446-8d8c07ab2a4f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:35.173838 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 444/873] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:35.179243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c911c39-86bb-4bea-993c-a38693b2e695 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:35.179556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c911c39-86bb-4bea-993c-a38693b2e695 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:35.179833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c911c39-86bb-4bea-993c-a38693b2e695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:35.201862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2c911c39-86bb-4bea-993c-a38693b2e695 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:35.203370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2c911c39-86bb-4bea-993c-a38693b2e695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:35.231646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:35.280152 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 430/874] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:35.281738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769ea03-1970-42cb-8446-8d8c07ab2a4f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:35.396059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769ea03-1970-42cb-8446-8d8c07ab2a4f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:35.397695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:35.434412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccd3ae-246a-4010-a866-c2128611b5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:35.434940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccd3ae-246a-4010-a866-c2128611b5b8 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:35.435218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccd3ae-246a-4010-a866-c2128611b5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:35.435626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccd3ae-246a-4010-a866-c2128611b5b8 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:35.436377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ccd3ae-246a-4010-a866-c2128611b5b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:35.437870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ccd3ae-246a-4010-a866-c2128611b5b8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:35.455522 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 445/875] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 18:04:35 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:04:35.543550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c911c39-86bb-4bea-993c-a38693b2e695 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:35.649473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c911c39-86bb-4bea-993c-a38693b2e695 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:35.692303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4ae4f-5894-4782-a7eb-ff7b64263733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:35.692861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ae4f-5894-4782-a7eb-ff7b64263733 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:35.693139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ae4f-5894-4782-a7eb-ff7b64263733 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:35.693409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ae4f-5894-4782-a7eb-ff7b64263733 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:35.693999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4ae4f-5894-4782-a7eb-ff7b64263733 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:35.695432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4ae4f-5894-4782-a7eb-ff7b64263733 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:35.707072 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-bba4ae4f-5894-4782-a7eb-ff7b64263733 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:04:35.707072 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:35.707072 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:35.707072 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:35.707072 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:35.707072 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:35.707072 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:35.707072 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:35.707072 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:04:35.707072 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:35.707072 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:35.707072 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:35.707072 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:35.707072 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:35.707072 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:35.707072 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:35.707072 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:35.708202 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:35.708202 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:35.708202 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:35.708202 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:35.708202 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:35.708202 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:35.708202 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:35.708202 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:35.708202 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:35.708202 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:35.708202 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:35.708202 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:35.708202 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:35.708202 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:35.708202 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:35.708202 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:35.709088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:35.709088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:35.709088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:35.709088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:35.709088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:35.709088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:35.709088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:35.709088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:35.709088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:35.709088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:35.709088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:35.709088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:35.709088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:04:35.709088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:35.713208 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 431/876] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 18:04:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:35.715146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccd3ae-246a-4010-a866-c2128611b5b8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:35.827116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccd3ae-246a-4010-a866-c2128611b5b8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:35.862727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d107536-dfc7-4b19-8ad8-dea06e055031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:35.863397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d107536-dfc7-4b19-8ad8-dea06e055031 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:35.863679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d107536-dfc7-4b19-8ad8-dea06e055031 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:35.863955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d107536-dfc7-4b19-8ad8-dea06e055031 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:35.864603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d107536-dfc7-4b19-8ad8-dea06e055031 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:35.864909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d107536-dfc7-4b19-8ad8-dea06e055031 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:35.866295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d107536-dfc7-4b19-8ad8-dea06e055031 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:35.871566 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 446/877] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 18:04:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:35.877264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4ae4f-5894-4782-a7eb-ff7b64263733 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:35.903051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:36.002233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4ae4f-5894-4782-a7eb-ff7b64263733 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:36.044393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac787b-bf40-46b8-b1b2-bee2b6f40534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:36.045413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac787b-bf40-46b8-b1b2-bee2b6f40534 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:36.045901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac787b-bf40-46b8-b1b2-bee2b6f40534 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:36.046434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac787b-bf40-46b8-b1b2-bee2b6f40534 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:36.047325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac787b-bf40-46b8-b1b2-bee2b6f40534 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:36.047857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac787b-bf40-46b8-b1b2-bee2b6f40534 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:36.049468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac787b-bf40-46b8-b1b2-bee2b6f40534 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:36.059452 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 432/878] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 18:04:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:36.124352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8062736-68a0-4a3e-84cb-1c9fbcd06337 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:36.125442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8062736-68a0-4a3e-84cb-1c9fbcd06337 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:36.125957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8062736-68a0-4a3e-84cb-1c9fbcd06337 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:36.128077 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 447/879] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:36.134580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac27ac-a4ce-4024-ad14-76f7e84f25f4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:36.134900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac27ac-a4ce-4024-ad14-76f7e84f25f4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:36.135156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac27ac-a4ce-4024-ad14-76f7e84f25f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:36.155241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-15ac27ac-a4ce-4024-ad14-76f7e84f25f4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:36.156488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-15ac27ac-a4ce-4024-ad14-76f7e84f25f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:36.233636 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 433/880] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:04:36.451844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7facbf-49d4-40cf-a090-d81c69d92206 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:36.452233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7facbf-49d4-40cf-a090-d81c69d92206 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:36.452352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7facbf-49d4-40cf-a090-d81c69d92206 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:36.454009 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 448/881] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:36.460063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac658b9c-d842-4291-b01b-cc706da77fdc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:36.460692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac658b9c-d842-4291-b01b-cc706da77fdc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:36.461155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac658b9c-d842-4291-b01b-cc706da77fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:36.484427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ac658b9c-d842-4291-b01b-cc706da77fdc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:36.485982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ac658b9c-d842-4291-b01b-cc706da77fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:36.497656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:36.509398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7facbf-49d4-40cf-a090-d81c69d92206 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:36.543609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:36.578201 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 434/882] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:04:36.640411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7facbf-49d4-40cf-a090-d81c69d92206 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:36.675807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5b58e-88a6-487b-bc1a-bb98b3f09657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:36.676421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5b58e-88a6-487b-bc1a-bb98b3f09657 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:36.676700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5b58e-88a6-487b-bc1a-bb98b3f09657 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:36.676970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5b58e-88a6-487b-bc1a-bb98b3f09657 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:36.677624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5b58e-88a6-487b-bc1a-bb98b3f09657 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:36.679001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5b58e-88a6-487b-bc1a-bb98b3f09657 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:36.697061 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 449/883] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 18:04:36 2022] POST /identity/v3/services => generated 269 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:04:36.868304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac658b9c-d842-4291-b01b-cc706da77fdc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:36.973965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac658b9c-d842-4291-b01b-cc706da77fdc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:37.015266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258eb1a-e9ec-4efb-a7b3-d11e3ede76e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:37.015922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258eb1a-e9ec-4efb-a7b3-d11e3ede76e9 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:37.016191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258eb1a-e9ec-4efb-a7b3-d11e3ede76e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:37.016464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258eb1a-e9ec-4efb-a7b3-d11e3ede76e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:37.024234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:37.028822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258eb1a-e9ec-4efb-a7b3-d11e3ede76e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:37.033623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-1258eb1a-e9ec-4efb-a7b3-d11e3ede76e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:04:37.033623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:37.033623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:37.033623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:37.033623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:37.033623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:37.033623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:37.033623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:37.033623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:37.033623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:37.033623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:37.033623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:37.033623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:37.033623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:37.033623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:37.033623 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:37.035689 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:37.035689 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:37.035689 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:37.035689 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:37.035689 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:37.035689 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:37.035689 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:37.035689 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:37.035689 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:37.035689 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:37.035689 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:37.035689 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:37.035689 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:37.035689 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:37.035689 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:37.035689 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:37.037644 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:37.037644 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:37.037644 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:37.037644 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:37.037644 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:37.037644 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:37.037644 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:37.037644 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:37.037644 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:37.037644 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:37.037644 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:04:37.037644 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:37.037644 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 435/884] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 28 18:04:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:37.044703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5b58e-88a6-487b-bc1a-bb98b3f09657 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:37.143900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:37.160214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5b58e-88a6-487b-bc1a-bb98b3f09657 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:37.198365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c257d82-a11a-456b-9e6a-4cf191ad942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:37.199097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c257d82-a11a-456b-9e6a-4cf191ad942b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:37.199415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c257d82-a11a-456b-9e6a-4cf191ad942b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:37.199690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c257d82-a11a-456b-9e6a-4cf191ad942b None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:37.200399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c257d82-a11a-456b-9e6a-4cf191ad942b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:37.200705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c257d82-a11a-456b-9e6a-4cf191ad942b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:37.202140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c257d82-a11a-456b-9e6a-4cf191ad942b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:37.222895 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 450/885] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 28 18:04:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:37.224348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258eb1a-e9ec-4efb-a7b3-d11e3ede76e9 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:37.331554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258eb1a-e9ec-4efb-a7b3-d11e3ede76e9 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:37.367422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12397fc8-09d4-4bf6-a962-32a5eca8b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:37.368421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12397fc8-09d4-4bf6-a962-32a5eca8b910 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:37.368875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12397fc8-09d4-4bf6-a962-32a5eca8b910 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:37.369387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12397fc8-09d4-4bf6-a962-32a5eca8b910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:37.380221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12397fc8-09d4-4bf6-a962-32a5eca8b910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:37.381956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12397fc8-09d4-4bf6-a962-32a5eca8b910 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:37.398007 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-12397fc8-09d4-4bf6-a962-32a5eca8b910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:37.398007 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:37.398007 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:37.398007 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:37.398007 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:37.398007 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:37.398007 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:37.398007 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:37.398007 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:37.398007 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:37.398007 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:37.398007 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:37.398007 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:37.398007 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:37.398007 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:37.398007 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:37.399018 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:37.399018 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:37.399018 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:37.399018 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:37.399018 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:37.399018 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:37.399018 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:37.399018 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:37.399018 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:37.399018 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:37.399018 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:37.399018 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:37.399018 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:37.399018 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:37.399018 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:37.399018 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:37.399018 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:37.400042 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:37.400042 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:37.400042 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:37.405728 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 436/886] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:37.408213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c257d82-a11a-456b-9e6a-4cf191ad942b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:37.461783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a1208-aefb-46ce-b5fa-c307f7ac6884 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:37.462061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a1208-aefb-46ce-b5fa-c307f7ac6884 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:37.462339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a1208-aefb-46ce-b5fa-c307f7ac6884 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:37.464061 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 437/887] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:04:37.469393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb369a71-a444-4d15-8ded-7818b76dd8f3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:37.469680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb369a71-a444-4d15-8ded-7818b76dd8f3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:37.469959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb369a71-a444-4d15-8ded-7818b76dd8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:37.490877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-eb369a71-a444-4d15-8ded-7818b76dd8f3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:37.492766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eb369a71-a444-4d15-8ded-7818b76dd8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:37.521541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c257d82-a11a-456b-9e6a-4cf191ad942b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:37.551571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:37.573269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c103096-6348-4db9-b9ff-f3fdc906116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:37.574113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c103096-6348-4db9-b9ff-f3fdc906116d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:37.574395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c103096-6348-4db9-b9ff-f3fdc906116d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:37.574670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c103096-6348-4db9-b9ff-f3fdc906116d None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:37.575373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c103096-6348-4db9-b9ff-f3fdc906116d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:37.575682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c103096-6348-4db9-b9ff-f3fdc906116d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:37.577108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c103096-6348-4db9-b9ff-f3fdc906116d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:37.587629 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 438/888] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:04:37.598805 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 451/889] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:37.600420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb369a71-a444-4d15-8ded-7818b76dd8f3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:37.704738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb369a71-a444-4d15-8ded-7818b76dd8f3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:37.743705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826487c2-4336-48c4-ac04-63f5baffe140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:37.744775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826487c2-4336-48c4-ac04-63f5baffe140 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:37.745261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826487c2-4336-48c4-ac04-63f5baffe140 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:37.745735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826487c2-4336-48c4-ac04-63f5baffe140 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:37.754008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826487c2-4336-48c4-ac04-63f5baffe140 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:37.755794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826487c2-4336-48c4-ac04-63f5baffe140 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:37.768566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-826487c2-4336-48c4-ac04-63f5baffe140 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:04:37.768566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:37.768566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:37.768566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:37.768566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:37.768566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:37.768566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:37.768566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:37.768566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:37.768566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:37.768566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:37.768566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:37.768566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:37.768566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:37.768566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:37.768566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:37.769578 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:37.770568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:37.770568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:37.770568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:37.770568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:37.770568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:37.770568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:37.770568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:37.770568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:37.770568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:04:37.770568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:37.777616 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 439/890] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 18:04:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:37.779227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c103096-6348-4db9-b9ff-f3fdc906116d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:37.791066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:37.865932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826487c2-4336-48c4-ac04-63f5baffe140 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:37.891164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c103096-6348-4db9-b9ff-f3fdc906116d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:37.918112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:37.938268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9fd9a-e941-4eec-b793-7c6ea03a627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:37.938886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9fd9a-e941-4eec-b793-7c6ea03a627f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:37.939168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9fd9a-e941-4eec-b793-7c6ea03a627f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:37.939640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9fd9a-e941-4eec-b793-7c6ea03a627f None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:37.940477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9fd9a-e941-4eec-b793-7c6ea03a627f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:37.940785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9fd9a-e941-4eec-b793-7c6ea03a627f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:37.942900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9fd9a-e941-4eec-b793-7c6ea03a627f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:37.970403 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 452/891] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 28 18:04:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:37.971980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9fd9a-e941-4eec-b793-7c6ea03a627f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:37.991730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826487c2-4336-48c4-ac04-63f5baffe140 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:38.031066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034be79-5468-4bfb-9070-1b92c80ee952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:38.032620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034be79-5468-4bfb-9070-1b92c80ee952 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:38.033073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034be79-5468-4bfb-9070-1b92c80ee952 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:38.033525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034be79-5468-4bfb-9070-1b92c80ee952 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:38.034343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034be79-5468-4bfb-9070-1b92c80ee952 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:38.036014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034be79-5468-4bfb-9070-1b92c80ee952 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:38.046563 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-7034be79-5468-4bfb-9070-1b92c80ee952 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:04:38.046563 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:38.046563 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:38.046563 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:38.046563 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:38.046563 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:38.046563 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:38.046563 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:38.046563 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:04:38.046563 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:38.046563 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:38.046563 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:38.046563 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:38.046563 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:38.046563 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:38.046563 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:38.046563 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:38.047666 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:38.047666 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:38.047666 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:38.047666 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:38.047666 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:38.047666 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:38.047666 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:38.047666 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:38.047666 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:38.047666 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:38.047666 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:38.047666 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:38.047666 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:38.047666 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:38.047666 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:38.047666 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:38.048498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:38.048498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:38.048498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:38.048498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:38.048498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:38.048498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:38.048498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:38.048498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:38.048498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:38.048498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:38.048498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:38.048498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:38.048498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:04:38.048498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:38.050593 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 440/892] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:04:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:38.052016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5da5a-cf77-43ff-8a2f-d0fb8aae00f2 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:38.052494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5da5a-cf77-43ff-8a2f-d0fb8aae00f2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:38.052958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5da5a-cf77-43ff-8a2f-d0fb8aae00f2 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:38.054641 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 441/893] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:38.058193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:38.060338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5da5a-cf77-43ff-8a2f-d0fb8aae00f2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:38.097673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9fd9a-e941-4eec-b793-7c6ea03a627f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:38.134735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680a2ff-be58-4207-be1f-56ae857c2fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:38.135511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680a2ff-be58-4207-be1f-56ae857c2fc2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:38.136326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680a2ff-be58-4207-be1f-56ae857c2fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:38.136326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680a2ff-be58-4207-be1f-56ae857c2fc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:38.177238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5da5a-cf77-43ff-8a2f-d0fb8aae00f2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:38.184995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:38.207647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680a2ff-be58-4207-be1f-56ae857c2fc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:38.209131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680a2ff-be58-4207-be1f-56ae857c2fc2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:38.216444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a9ed3-d4b4-451b-a70f-45763c8fc370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:38.217060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a9ed3-d4b4-451b-a70f-45763c8fc370 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:38.217783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a9ed3-d4b4-451b-a70f-45763c8fc370 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:38.218062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a9ed3-d4b4-451b-a70f-45763c8fc370 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:38.218849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a9ed3-d4b4-451b-a70f-45763c8fc370 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:38.219504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a9ed3-d4b4-451b-a70f-45763c8fc370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:38.221275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a9ed3-d4b4-451b-a70f-45763c8fc370 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:38.230953 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 442/894] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:04:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:38.230953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d5dde-2f99-4bbc-8bc3-20a7d6040792 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:38.230953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d5dde-2f99-4bbc-8bc3-20a7d6040792 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:38.230953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d5dde-2f99-4bbc-8bc3-20a7d6040792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:38.247164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2b0d5dde-2f99-4bbc-8bc3-20a7d6040792 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:38.248451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2b0d5dde-2f99-4bbc-8bc3-20a7d6040792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:38.282640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:38.321551 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 453/895] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:04:37 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 18:04:38.322410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680a2ff-be58-4207-be1f-56ae857c2fc2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:38.323457 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 443/896] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:38.327190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d5dde-2f99-4bbc-8bc3-20a7d6040792 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:38.432510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:38.436168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d5dde-2f99-4bbc-8bc3-20a7d6040792 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:38.449684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680a2ff-be58-4207-be1f-56ae857c2fc2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:38.474299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5831179-017d-4421-90fa-eabf24003316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:38.475006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831179-017d-4421-90fa-eabf24003316 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:38.475424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831179-017d-4421-90fa-eabf24003316 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:38.475789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831179-017d-4421-90fa-eabf24003316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:38.487485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5831179-017d-4421-90fa-eabf24003316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:38.488922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875f693-ce3b-4589-97b0-6f72ca4573d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:38.489262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5831179-017d-4421-90fa-eabf24003316 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:38.490059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875f693-ce3b-4589-97b0-6f72ca4573d9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:38.490494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875f693-ce3b-4589-97b0-6f72ca4573d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:38.490966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875f693-ce3b-4589-97b0-6f72ca4573d9 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:38.491885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875f693-ce3b-4589-97b0-6f72ca4573d9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:38.492427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875f693-ce3b-4589-97b0-6f72ca4573d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:38.494026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875f693-ce3b-4589-97b0-6f72ca4573d9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:38.505039 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 454/897] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:04:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:38.505478 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-b5831179-017d-4421-90fa-eabf24003316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:38.505478 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:38.505478 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:38.505478 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:38.505478 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:38.505478 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:38.505478 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:38.505478 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:38.505478 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:38.505478 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:38.505478 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:38.505478 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:38.505478 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:38.505478 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:38.505478 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:38.505478 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:38.506506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:38.506506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:38.506506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:38.506506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:38.506506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:38.506506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:38.506506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:38.506506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:38.506506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:38.506506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:38.506506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:38.506506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:38.506506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:38.506506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:38.506506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:38.506506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:38.506506 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:38.507431 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:38.507431 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:38.507431 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:38.509163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875f693-ce3b-4589-97b0-6f72ca4573d9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:38.511418 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 444/898] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:38.512750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5831179-017d-4421-90fa-eabf24003316 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:38.542704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:38.622098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875f693-ce3b-4589-97b0-6f72ca4573d9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:38.628734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5831179-017d-4421-90fa-eabf24003316 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:38.658832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c85bf-7980-4179-94ec-38f0e9dadd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:38.659471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c85bf-7980-4179-94ec-38f0e9dadd87 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:38.659748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c85bf-7980-4179-94ec-38f0e9dadd87 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:38.660020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c85bf-7980-4179-94ec-38f0e9dadd87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:38.660725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c85bf-7980-4179-94ec-38f0e9dadd87 None admin] RBAC: Adding query filter params (interface=public, service_id=fd18a59b01654828be0fcfea08bd9633, region_id=RegionOne) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:38.661031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c85bf-7980-4179-94ec-38f0e9dadd87 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:38.662399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c85bf-7980-4179-94ec-38f0e9dadd87 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:38.667832 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 455/899] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 28 18:04:38 2022] GET /identity/v3/endpoints?service_id=fd18a59b01654828be0fcfea08bd9633&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:38.668617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c85bf-7980-4179-94ec-38f0e9dadd87 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:38.674381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a55fc8-b667-4dc4-b641-e422a243113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:38.675112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55fc8-b667-4dc4-b641-e422a243113a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:38.675396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55fc8-b667-4dc4-b641-e422a243113a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:38.675695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55fc8-b667-4dc4-b641-e422a243113a None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:38.676374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a55fc8-b667-4dc4-b641-e422a243113a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:38.676681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a55fc8-b667-4dc4-b641-e422a243113a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:38.678049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a55fc8-b667-4dc4-b641-e422a243113a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:38.694338 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 445/900] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:38.695190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a55fc8-b667-4dc4-b641-e422a243113a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:38.712661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:38.770394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:38.778484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c85bf-7980-4179-94ec-38f0e9dadd87 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:38.801642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a55fc8-b667-4dc4-b641-e422a243113a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:38.812328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbebe4-b178-42d6-a15f-313bea1510c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:38.812946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbebe4-b178-42d6-a15f-313bea1510c0 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:38.813226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbebe4-b178-42d6-a15f-313bea1510c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:38.813498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbebe4-b178-42d6-a15f-313bea1510c0 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:38.814150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbebe4-b178-42d6-a15f-313bea1510c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:38.815567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbebe4-b178-42d6-a15f-313bea1510c0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:38.831162 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 456/901] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 18:04:38 2022] POST /identity/v3/services => generated 241 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:04:38.832023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbebe4-b178-42d6-a15f-313bea1510c0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:38.846867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c372a4-225f-4a18-9e0d-1874acdf48e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:38.847523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c372a4-225f-4a18-9e0d-1874acdf48e0 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:38.847800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c372a4-225f-4a18-9e0d-1874acdf48e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:38.848068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c372a4-225f-4a18-9e0d-1874acdf48e0 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:38.848698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c372a4-225f-4a18-9e0d-1874acdf48e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:38.850113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c372a4-225f-4a18-9e0d-1874acdf48e0 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:38.857065 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 446/902] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 18:04:38 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:04:38.873006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d28f4-02dc-4250-8bfe-baa9e083dcc5 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:38.873383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d28f4-02dc-4250-8bfe-baa9e083dcc5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:38.873568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d28f4-02dc-4250-8bfe-baa9e083dcc5 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:38.879626 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 447/903] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:38.884932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53f2b6-7b5e-447b-aabf-14bf904654c4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:38.885403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53f2b6-7b5e-447b-aabf-14bf904654c4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:38.885831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53f2b6-7b5e-447b-aabf-14bf904654c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:38.908385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7c53f2b6-7b5e-447b-aabf-14bf904654c4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:38.910153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7c53f2b6-7b5e-447b-aabf-14bf904654c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:38.983010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbebe4-b178-42d6-a15f-313bea1510c0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:39.002988 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 448/904] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:39.024729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce560c4-f26f-40a3-b62b-a2d09fedf3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:39.025313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce560c4-f26f-40a3-b62b-a2d09fedf3bb None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:39.025620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce560c4-f26f-40a3-b62b-a2d09fedf3bb None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:39.025920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce560c4-f26f-40a3-b62b-a2d09fedf3bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:39.033537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce560c4-f26f-40a3-b62b-a2d09fedf3bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:39.035007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce560c4-f26f-40a3-b62b-a2d09fedf3bb None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:39.046883 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-0ce560c4-f26f-40a3-b62b-a2d09fedf3bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:39.046883 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:39.046883 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:39.046883 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:39.046883 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:39.046883 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:39.046883 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:39.046883 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:39.046883 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:39.046883 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:39.046883 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:39.046883 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:39.046883 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:39.046883 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:39.046883 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:39.048043 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:39.048043 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:39.048043 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:39.048043 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:39.048043 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:39.048043 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:39.048043 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:39.048043 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:39.048043 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:39.048043 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:39.048043 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:39.048043 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:39.048043 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:39.048043 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:39.048043 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:39.048043 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:39.048043 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:39.049132 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:39.049132 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:39.049132 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:39.049132 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:39.049132 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:39.049132 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:39.049132 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:39.049132 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:39.049667 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 457/905] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:39.056305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53f2b6-7b5e-447b-aabf-14bf904654c4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:39.059363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:39.162545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53f2b6-7b5e-447b-aabf-14bf904654c4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:39.197562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23618e08-a879-447f-8c09-5bb7ad945907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:39.198594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618e08-a879-447f-8c09-5bb7ad945907 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:39.199094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618e08-a879-447f-8c09-5bb7ad945907 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:39.199581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618e08-a879-447f-8c09-5bb7ad945907 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:39.200478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23618e08-a879-447f-8c09-5bb7ad945907 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:39.201118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23618e08-a879-447f-8c09-5bb7ad945907 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:39.202773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23618e08-a879-447f-8c09-5bb7ad945907 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:39.215921 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 449/906] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:39.221733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce560c4-f26f-40a3-b62b-a2d09fedf3bb None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:39.240687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:39.310133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23618e08-a879-447f-8c09-5bb7ad945907 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:39.342443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce560c4-f26f-40a3-b62b-a2d09fedf3bb None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:39.387745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77afcc7-eca2-45b4-81c7-1c352285a291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:39.388515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:39.388623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77afcc7-eca2-45b4-81c7-1c352285a291 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:39.388802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77afcc7-eca2-45b4-81c7-1c352285a291 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:39.389079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77afcc7-eca2-45b4-81c7-1c352285a291 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:39.390369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77afcc7-eca2-45b4-81c7-1c352285a291 None admin] RBAC: Adding query filter params (role.id=64676cb561754d11874d385e16ffa09b, scope.project.id=651b8653291a414fba3805312708ce48, user.id=e63fa755c46b4a2b9e32e720f9fb8413) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:39.390685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77afcc7-eca2-45b4-81c7-1c352285a291 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:39.392668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77afcc7-eca2-45b4-81c7-1c352285a291 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:39.400747 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 458/907] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:04:39 2022] GET /identity/v3/role_assignments?user.id=e63fa755c46b4a2b9e32e720f9fb8413&scope.project.id=651b8653291a414fba3805312708ce48&role.id=64676cb561754d11874d385e16ffa09b => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:39.447028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23618e08-a879-447f-8c09-5bb7ad945907 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:39.489471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040dad7-6ee6-44b8-afd2-5152c3a157de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:39.490136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040dad7-6ee6-44b8-afd2-5152c3a157de None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:39.490417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040dad7-6ee6-44b8-afd2-5152c3a157de None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:39.490691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040dad7-6ee6-44b8-afd2-5152c3a157de None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:39.491334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040dad7-6ee6-44b8-afd2-5152c3a157de None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:39.492742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040dad7-6ee6-44b8-afd2-5152c3a157de None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:39.502674 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-a040dad7-6ee6-44b8-afd2-5152c3a157de None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:04:39.502674 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:39.502674 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:39.502674 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:39.502674 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:39.502674 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:39.502674 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:39.502674 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:39.502674 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:04:39.502674 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:39.502674 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:39.502674 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:39.502674 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:39.502674 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:39.502674 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:39.502674 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:39.503688 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:39.503688 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:39.503688 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:39.503688 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:39.503688 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:39.503688 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:39.503688 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:39.503688 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:39.503688 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:39.503688 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:39.503688 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:39.503688 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:39.503688 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:39.503688 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:39.503688 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:39.503688 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:39.503688 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:39.504568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:39.504568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:39.504568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:39.504568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:39.504568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:39.504568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:39.504568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:39.504568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:39.504568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:39.504568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:39.504568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:39.504568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:39.504568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:04:39.504568 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:39.504568 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 450/908] 10.222.0.27 () {56 vars in 1132 bytes} [Sun Aug 28 18:04:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:39.510451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77afcc7-eca2-45b4-81c7-1c352285a291 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:39.607731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:39.631708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77afcc7-eca2-45b4-81c7-1c352285a291 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:39.682957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07b60d-4ba1-4332-96f3-65ea4d6fdf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:39.683992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07b60d-4ba1-4332-96f3-65ea4d6fdf5f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:39.684488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07b60d-4ba1-4332-96f3-65ea4d6fdf5f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:39.684952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07b60d-4ba1-4332-96f3-65ea4d6fdf5f None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:39.686040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07b60d-4ba1-4332-96f3-65ea4d6fdf5f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:39.686532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07b60d-4ba1-4332-96f3-65ea4d6fdf5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:39.689019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07b60d-4ba1-4332-96f3-65ea4d6fdf5f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:39.697805 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 459/909] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 18:04:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:39.703288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040dad7-6ee6-44b8-afd2-5152c3a157de None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:39.848711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040dad7-6ee6-44b8-afd2-5152c3a157de None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:39.893813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:39.908846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324b014-9003-444c-b161-06c67543031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:39.909852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324b014-9003-444c-b161-06c67543031f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:39.910338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324b014-9003-444c-b161-06c67543031f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:39.910775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324b014-9003-444c-b161-06c67543031f None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:39.911884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324b014-9003-444c-b161-06c67543031f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:39.912428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324b014-9003-444c-b161-06c67543031f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:39.914731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324b014-9003-444c-b161-06c67543031f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:39.924508 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 451/910] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 18:04:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:39.930027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07b60d-4ba1-4332-96f3-65ea4d6fdf5f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:40.043727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07b60d-4ba1-4332-96f3-65ea4d6fdf5f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:40.078922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9eee3a-e8c1-4912-8a0f-645ad76fafa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:40.079577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eee3a-e8c1-4912-8a0f-645ad76fafa3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:40.079987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eee3a-e8c1-4912-8a0f-645ad76fafa3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:40.080257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eee3a-e8c1-4912-8a0f-645ad76fafa3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:40.080974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9eee3a-e8c1-4912-8a0f-645ad76fafa3 None admin] RBAC: Adding query filter params (interface=public, service_id=41e0abdebb7940d4a5898e33560e8657, region_id=RegionOne) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:40.081280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9eee3a-e8c1-4912-8a0f-645ad76fafa3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:40.082655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9eee3a-e8c1-4912-8a0f-645ad76fafa3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:40.088632 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 460/911] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 28 18:04:39 2022] GET /identity/v3/endpoints?service_id=41e0abdebb7940d4a5898e33560e8657&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:40.094072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324b014-9003-444c-b161-06c67543031f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:40.204959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324b014-9003-444c-b161-06c67543031f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:40.240824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fdda6-1ed1-49d2-945a-730d6d8615f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:40.241440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fdda6-1ed1-49d2-945a-730d6d8615f5 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:40.241721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fdda6-1ed1-49d2-945a-730d6d8615f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:40.241994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fdda6-1ed1-49d2-945a-730d6d8615f5 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:40.242666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fdda6-1ed1-49d2-945a-730d6d8615f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:40.244081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fdda6-1ed1-49d2-945a-730d6d8615f5 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:40.250864 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 452/912] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 18:04:40 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:04:40.866190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57772b-8422-47a3-87b7-df017eec34fa None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:40.866873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57772b-8422-47a3-87b7-df017eec34fa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:40.866873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57772b-8422-47a3-87b7-df017eec34fa None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:40.868480 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 461/913] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:40.874392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd41ae-19a0-424f-9df9-76be503e7840 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:40.874663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd41ae-19a0-424f-9df9-76be503e7840 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:40.874932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd41ae-19a0-424f-9df9-76be503e7840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:40.894457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5cfd41ae-19a0-424f-9df9-76be503e7840 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:40.895751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5cfd41ae-19a0-424f-9df9-76be503e7840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:40.948362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:40.971453 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 453/914] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:40.974784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc27a-8698-4957-aba9-d09a276180d2 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:40.975108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc27a-8698-4957-aba9-d09a276180d2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:40.975372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc27a-8698-4957-aba9-d09a276180d2 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:40.976962 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 462/915] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:40.982247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e68a-41ef-49bc-977c-07408e2bdada None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:40.982523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e68a-41ef-49bc-977c-07408e2bdada None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:40.982791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e68a-41ef-49bc-977c-07408e2bdada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:41.000928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dd95e68a-41ef-49bc-977c-07408e2bdada None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:41.002076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dd95e68a-41ef-49bc-977c-07408e2bdada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:41.069083 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 454/916] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:04:41.241220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dc27a-8698-4957-aba9-d09a276180d2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:41.251053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:41.342914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95e68a-41ef-49bc-977c-07408e2bdada None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:41.358104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dc27a-8698-4957-aba9-d09a276180d2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:41.397211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c424c2-615b-4184-83a9-f3893eeb25e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:41.398287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c424c2-615b-4184-83a9-f3893eeb25e2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:41.398781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c424c2-615b-4184-83a9-f3893eeb25e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:41.399246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c424c2-615b-4184-83a9-f3893eeb25e2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:41.400005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c424c2-615b-4184-83a9-f3893eeb25e2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:41.401704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c424c2-615b-4184-83a9-f3893eeb25e2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:41.411058 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-41c424c2-615b-4184-83a9-f3893eeb25e2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:04:41.411058 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:41.411058 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:41.411058 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:41.411058 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:41.411058 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:41.411058 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:41.411058 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:41.411058 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:04:41.411058 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:41.411058 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:41.411058 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:41.411058 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:41.411058 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:41.411058 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:41.411058 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:41.411058 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:41.412301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:41.412301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:41.412301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:41.412301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:41.412301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:41.412301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:41.412301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:41.412301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:41.412301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:41.412301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:41.412301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:41.412301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:41.412301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:41.412301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:41.412301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:41.412301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:41.413262 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:41.413262 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:41.413262 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:41.413262 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:41.413262 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:41.413262 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:41.413262 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:41.413262 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:41.413262 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:41.413262 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:41.413262 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:41.413262 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:41.413262 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:04:41.413262 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:41.415611 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 463/917] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 18:04:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:41.417033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92a954-e330-43ec-bdbb-ffbb613e8503 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:41.417314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92a954-e330-43ec-bdbb-ffbb613e8503 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:41.417590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92a954-e330-43ec-bdbb-ffbb613e8503 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:41.418970 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 464/918] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:41.423735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92a954-e330-43ec-bdbb-ffbb613e8503 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:41.456212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95e68a-41ef-49bc-977c-07408e2bdada None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:41.470829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:41.492043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc171e1a-8631-4abd-8a46-5cddb9de4c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:41.492572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc171e1a-8631-4abd-8a46-5cddb9de4c80 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:41.492866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc171e1a-8631-4abd-8a46-5cddb9de4c80 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:41.493141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc171e1a-8631-4abd-8a46-5cddb9de4c80 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:41.493724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc171e1a-8631-4abd-8a46-5cddb9de4c80 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:41.495148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc171e1a-8631-4abd-8a46-5cddb9de4c80 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:41.503824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:41.506104 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-bc171e1a-8631-4abd-8a46-5cddb9de4c80 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:04:41.506104 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:41.506104 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:41.506104 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:41.506104 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:41.506104 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:41.506104 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:41.506104 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:41.506104 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:04:41.506104 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:41.506104 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:41.506104 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:41.506104 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:41.506104 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:41.506104 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:41.506104 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:41.506104 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:41.507078 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:41.507078 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:41.507078 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:41.507078 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:41.507078 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:41.507078 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:41.507078 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:41.507078 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:41.507078 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:41.507078 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:41.507078 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:41.507078 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:41.507078 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:41.507078 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:41.507078 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:41.507078 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:41.508088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:41.508088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:41.508088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:41.508088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:41.508088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:41.508088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:41.508088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:41.508088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:41.508088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:41.508088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:41.508088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:41.508088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:41.508088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:04:41.508088 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:41.508088 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 455/919] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:04:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:41.509203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eb240-07b6-4b2d-99d1-c67bddb224de None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:41.509921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eb240-07b6-4b2d-99d1-c67bddb224de None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:41.509921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eb240-07b6-4b2d-99d1-c67bddb224de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:41.528528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8d4eb240-07b6-4b2d-99d1-c67bddb224de None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:41.529769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8d4eb240-07b6-4b2d-99d1-c67bddb224de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:41.539300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92a954-e330-43ec-bdbb-ffbb613e8503 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:41.583225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58207f16-4108-413a-bee5-2a0461ad6a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:41.583870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58207f16-4108-413a-bee5-2a0461ad6a13 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:41.584146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58207f16-4108-413a-bee5-2a0461ad6a13 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:41.584414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58207f16-4108-413a-bee5-2a0461ad6a13 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:41.585057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58207f16-4108-413a-bee5-2a0461ad6a13 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:41.585324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58207f16-4108-413a-bee5-2a0461ad6a13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:41.586690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58207f16-4108-413a-bee5-2a0461ad6a13 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:41.595306 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 465/920] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 18:04:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:41.595306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58207f16-4108-413a-bee5-2a0461ad6a13 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:41.607837 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 456/921] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:41.608712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4eb240-07b6-4b2d-99d1-c67bddb224de None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:41.708065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58207f16-4108-413a-bee5-2a0461ad6a13 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:41.742402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4eb240-07b6-4b2d-99d1-c67bddb224de None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:41.749811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c29ca-0607-4929-b2aa-e2d230cbda19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:41.750427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c29ca-0607-4929-b2aa-e2d230cbda19 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:41.750702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c29ca-0607-4929-b2aa-e2d230cbda19 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:41.750973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c29ca-0607-4929-b2aa-e2d230cbda19 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:41.751995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c29ca-0607-4929-b2aa-e2d230cbda19 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:41.752300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c29ca-0607-4929-b2aa-e2d230cbda19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:41.753732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c29ca-0607-4929-b2aa-e2d230cbda19 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:41.754338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:41.755901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:41.767573 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 466/922] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:04:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:41.768561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c29ca-0607-4929-b2aa-e2d230cbda19 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:41.789660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33580d4d-007b-4577-9f3c-5fb16a172fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:41.790582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33580d4d-007b-4577-9f3c-5fb16a172fef None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:41.790869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33580d4d-007b-4577-9f3c-5fb16a172fef None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:41.791194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33580d4d-007b-4577-9f3c-5fb16a172fef None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:41.792261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33580d4d-007b-4577-9f3c-5fb16a172fef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:41.792568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33580d4d-007b-4577-9f3c-5fb16a172fef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:41.794067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33580d4d-007b-4577-9f3c-5fb16a172fef None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:41.801945 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 457/923] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 18:04:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:41.816713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33580d4d-007b-4577-9f3c-5fb16a172fef None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:41.884187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c29ca-0607-4929-b2aa-e2d230cbda19 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:41.919488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33580d4d-007b-4577-9f3c-5fb16a172fef None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:41.926922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9170387-152b-4451-bc7a-069e222c1fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:41.927903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9170387-152b-4451-bc7a-069e222c1fdc None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:41.928191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9170387-152b-4451-bc7a-069e222c1fdc None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:41.928470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9170387-152b-4451-bc7a-069e222c1fdc None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:41.929111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9170387-152b-4451-bc7a-069e222c1fdc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:41.929647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9170387-152b-4451-bc7a-069e222c1fdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:41.930799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9170387-152b-4451-bc7a-069e222c1fdc None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:41.936157 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 467/924] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 18:04:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:41.936772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9170387-152b-4451-bc7a-069e222c1fdc None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:41.963747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d76841-b1d8-4d87-b3df-5d0be326227d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:41.964366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d76841-b1d8-4d87-b3df-5d0be326227d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:41.964647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d76841-b1d8-4d87-b3df-5d0be326227d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:41.964910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d76841-b1d8-4d87-b3df-5d0be326227d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:41.965623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d76841-b1d8-4d87-b3df-5d0be326227d None admin] RBAC: Adding query filter params (interface=public, service_id=0289b3666a984d0eb231a0fcdac43858, region_id=RegionOne) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:41.965928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d76841-b1d8-4d87-b3df-5d0be326227d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:41.967442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d76841-b1d8-4d87-b3df-5d0be326227d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:41.976877 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 458/925] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 28 18:04:41 2022] GET /identity/v3/endpoints?service_id=0289b3666a984d0eb231a0fcdac43858&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:41.976877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d76841-b1d8-4d87-b3df-5d0be326227d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:42.012218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:42.013828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:42.056279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9170387-152b-4451-bc7a-069e222c1fdc None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:42.084092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d76841-b1d8-4d87-b3df-5d0be326227d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:42.092134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadaa38-2c1c-41a6-875f-ee098e426975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:42.092776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadaa38-2c1c-41a6-875f-ee098e426975 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:42.093058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadaa38-2c1c-41a6-875f-ee098e426975 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:42.093333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadaa38-2c1c-41a6-875f-ee098e426975 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:42.104255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadaa38-2c1c-41a6-875f-ee098e426975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:42.109619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-dfadaa38-2c1c-41a6-875f-ee098e426975 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:04:42.109619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:42.109619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:42.109619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:42.109619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:42.109619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:42.109619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:42.109619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:42.109619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:42.109619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:42.109619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:42.109619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:42.109619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:42.109619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:42.109619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:42.109619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:42.110534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:42.110534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:42.110534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:42.110534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:42.110534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:42.110534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:42.110534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:42.110534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:42.110534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:42.110534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:42.110534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:42.110534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:42.110534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:42.110534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:42.110534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:42.110534 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:42.111391 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:42.111391 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:42.111391 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:42.111391 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:42.111391 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:42.111391 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:42.111391 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:42.111391 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:42.111391 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:42.111391 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:42.111391 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:04:42.111391 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:42.111391 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 468/926] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 28 18:04:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:42.112069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadaa38-2c1c-41a6-875f-ee098e426975 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:42.126355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0789d2d-e4f8-4932-8f65-6ac45aa44838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:42.126971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0789d2d-e4f8-4932-8f65-6ac45aa44838 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:42.127294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0789d2d-e4f8-4932-8f65-6ac45aa44838 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:42.127547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0789d2d-e4f8-4932-8f65-6ac45aa44838 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:42.128220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0789d2d-e4f8-4932-8f65-6ac45aa44838 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:42.129589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0789d2d-e4f8-4932-8f65-6ac45aa44838 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:42.151827 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 459/927] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:04:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:04:42.152990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0789d2d-e4f8-4932-8f65-6ac45aa44838 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:42.230952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadaa38-2c1c-41a6-875f-ee098e426975 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:42.259343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:42.282956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc54192-c5aa-4eaf-985a-974a123edc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:42.283532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc54192-c5aa-4eaf-985a-974a123edc9e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:42.283816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc54192-c5aa-4eaf-985a-974a123edc9e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:42.284086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc54192-c5aa-4eaf-985a-974a123edc9e None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:42.284706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc54192-c5aa-4eaf-985a-974a123edc9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:42.286143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc54192-c5aa-4eaf-985a-974a123edc9e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:42.289515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:42.295313 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 469/928] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 18:04:42 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:04:42.295313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19172bc0-6624-4d73-9e22-2b76c0f19c56 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:42.295313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19172bc0-6624-4d73-9e22-2b76c0f19c56 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:42.295313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19172bc0-6624-4d73-9e22-2b76c0f19c56 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:42.296961 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 470/929] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:42.305726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973ee6-c3bb-4443-ac85-83d222c05cce None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:42.306125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973ee6-c3bb-4443-ac85-83d222c05cce None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:42.306282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973ee6-c3bb-4443-ac85-83d222c05cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:42.312250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0789d2d-e4f8-4932-8f65-6ac45aa44838 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:42.327661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-56973ee6-c3bb-4443-ac85-83d222c05cce None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:42.328529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56973ee6-c3bb-4443-ac85-83d222c05cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:42.366805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e6aeb-eef8-462b-99e3-682b0f477b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:42.367378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e6aeb-eef8-462b-99e3-682b0f477b87 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:42.367378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e6aeb-eef8-462b-99e3-682b0f477b87 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:42.367546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e6aeb-eef8-462b-99e3-682b0f477b87 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:42.368588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e6aeb-eef8-462b-99e3-682b0f477b87 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:42.368933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e6aeb-eef8-462b-99e3-682b0f477b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:42.371059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e6aeb-eef8-462b-99e3-682b0f477b87 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:42.383459 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 460/930] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 28 18:04:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:42.387540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e6aeb-eef8-462b-99e3-682b0f477b87 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:42.422475 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 471/931] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:42.511393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e6aeb-eef8-462b-99e3-682b0f477b87 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:42.551632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c8bdc-07be-401b-8ba6-ed2949cd5d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:42.552206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c8bdc-07be-401b-8ba6-ed2949cd5d35 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:42.552487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c8bdc-07be-401b-8ba6-ed2949cd5d35 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:42.552761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c8bdc-07be-401b-8ba6-ed2949cd5d35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:42.565530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c8bdc-07be-401b-8ba6-ed2949cd5d35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:42.567016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c8bdc-07be-401b-8ba6-ed2949cd5d35 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:42.586246 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-1b8c8bdc-07be-401b-8ba6-ed2949cd5d35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:42.586246 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:42.586246 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:42.586246 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:42.586246 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:42.586246 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:42.586246 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:42.586246 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:42.586246 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:42.586246 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:42.586246 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:42.586246 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:42.586246 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:42.586246 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:42.586246 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:42.586246 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:42.587293 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:42.587293 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:42.587293 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:42.587293 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:42.587293 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:42.587293 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:42.587293 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:42.587293 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:42.587293 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:42.587293 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:42.587293 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:42.587293 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:42.587293 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:42.587293 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:42.587293 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:42.587293 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:42.587293 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:42.588232 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:42.588232 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:42.588232 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:42.588232 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 461/932] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:42.594164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56973ee6-c3bb-4443-ac85-83d222c05cce None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:42.703839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56973ee6-c3bb-4443-ac85-83d222c05cce None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:42.715461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c8bdc-07be-401b-8ba6-ed2949cd5d35 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:42.719993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:42.726456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:42.742168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665951f5-9c4f-4de1-a0d4-383bacd297e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:42.742810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665951f5-9c4f-4de1-a0d4-383bacd297e6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:42.743076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665951f5-9c4f-4de1-a0d4-383bacd297e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:42.743376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665951f5-9c4f-4de1-a0d4-383bacd297e6 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:42.744031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665951f5-9c4f-4de1-a0d4-383bacd297e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:42.744442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665951f5-9c4f-4de1-a0d4-383bacd297e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:42.745826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665951f5-9c4f-4de1-a0d4-383bacd297e6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:42.763024 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 472/933] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:42.768990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665951f5-9c4f-4de1-a0d4-383bacd297e6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:42.855026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c8bdc-07be-401b-8ba6-ed2949cd5d35 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:42.888639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665951f5-9c4f-4de1-a0d4-383bacd297e6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:42.898635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e815f-e241-4050-94a4-ccea41a8d17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:42.899350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e815f-e241-4050-94a4-ccea41a8d17a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:42.899630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e815f-e241-4050-94a4-ccea41a8d17a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:42.899900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e815f-e241-4050-94a4-ccea41a8d17a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:42.900925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e815f-e241-4050-94a4-ccea41a8d17a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:42.902623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e815f-e241-4050-94a4-ccea41a8d17a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:42.914094 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-028e815f-e241-4050-94a4-ccea41a8d17a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:04:42.914094 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:42.914094 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:42.914094 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:42.914094 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:42.914094 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:42.914094 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:42.914094 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:42.914094 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:04:42.914094 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:42.914094 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:42.914094 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:42.914094 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:42.914094 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:42.914094 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:42.914094 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:42.915091 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:42.915091 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:42.915091 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:42.915091 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:42.915091 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:42.915091 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:42.915091 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:42.915091 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:42.915091 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:42.915091 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:42.915091 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:42.915091 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:42.915091 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:42.915091 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:42.915091 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:42.915091 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:42.915091 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:42.920670 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:42.920670 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:42.920670 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:42.920670 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:42.920670 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:42.920670 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:42.920670 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:42.920670 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:42.920670 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:42.920670 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:42.920670 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:42.920670 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:42.920670 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:04:42.920670 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:42.920670 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 462/934] 10.222.0.27 () {56 vars in 1132 bytes} [Sun Aug 28 18:04:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:42.924352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e815f-e241-4050-94a4-ccea41a8d17a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:42.930639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b80dd8-5780-49e9-828b-598896874ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:42.931297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b80dd8-5780-49e9-828b-598896874ced None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:42.931706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b80dd8-5780-49e9-828b-598896874ced None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:42.932008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b80dd8-5780-49e9-828b-598896874ced None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:42.941943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b80dd8-5780-49e9-828b-598896874ced None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:42.943588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b80dd8-5780-49e9-828b-598896874ced None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:42.958701 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-19b80dd8-5780-49e9-828b-598896874ced None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:04:42.958701 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:42.958701 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:42.958701 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:42.958701 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:42.958701 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:42.958701 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:42.958701 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:42.958701 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:42.958701 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:42.958701 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:42.958701 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:42.958701 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:42.958701 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:42.958701 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:42.958701 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:42.960012 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:42.961366 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:42.961366 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:42.961366 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:42.961366 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:42.961366 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:42.961366 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:42.961366 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:42.961366 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:42.961366 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:04:42.961366 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:42.963335 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 473/935] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 18:04:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:42.965900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b80dd8-5780-49e9-828b-598896874ced None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:43.006159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:43.014564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:43.051759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e815f-e241-4050-94a4-ccea41a8d17a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:43.089781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b80dd8-5780-49e9-828b-598896874ced None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:43.094745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31388c23-3095-423c-af43-00cac8900b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:43.095666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31388c23-3095-423c-af43-00cac8900b95 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:43.096149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31388c23-3095-423c-af43-00cac8900b95 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:43.096618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31388c23-3095-423c-af43-00cac8900b95 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:43.097639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31388c23-3095-423c-af43-00cac8900b95 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:43.098144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31388c23-3095-423c-af43-00cac8900b95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:43.099883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31388c23-3095-423c-af43-00cac8900b95 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:43.111011 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 463/936] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 18:04:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:43.112665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31388c23-3095-423c-af43-00cac8900b95 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:43.133122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a9412-de80-4baa-86e2-d864c2300a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:43.134045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a9412-de80-4baa-86e2-d864c2300a00 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:43.134322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a9412-de80-4baa-86e2-d864c2300a00 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:43.134630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a9412-de80-4baa-86e2-d864c2300a00 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:43.135695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a9412-de80-4baa-86e2-d864c2300a00 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:43.135975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a9412-de80-4baa-86e2-d864c2300a00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:43.137433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a9412-de80-4baa-86e2-d864c2300a00 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:43.160816 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 474/937] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 28 18:04:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:43.161968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a9412-de80-4baa-86e2-d864c2300a00 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:43.238982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31388c23-3095-423c-af43-00cac8900b95 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:43.261901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:43.278453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a9412-de80-4baa-86e2-d864c2300a00 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:43.291228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852abed8-ac44-4b3d-a940-c04a4306f138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:43.292473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852abed8-ac44-4b3d-a940-c04a4306f138 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:43.292755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852abed8-ac44-4b3d-a940-c04a4306f138 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:43.293027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852abed8-ac44-4b3d-a940-c04a4306f138 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:43.293683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852abed8-ac44-4b3d-a940-c04a4306f138 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:43.294329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852abed8-ac44-4b3d-a940-c04a4306f138 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:43.295637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852abed8-ac44-4b3d-a940-c04a4306f138 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:43.297117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:43.307390 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 464/938] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 18:04:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:43.309790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852abed8-ac44-4b3d-a940-c04a4306f138 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:43.323303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007975a-d3dc-490b-9197-9d40efbc9bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:43.324129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007975a-d3dc-490b-9197-9d40efbc9bca None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:43.324487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007975a-d3dc-490b-9197-9d40efbc9bca None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:43.324870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007975a-d3dc-490b-9197-9d40efbc9bca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:43.338097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007975a-d3dc-490b-9197-9d40efbc9bca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:43.340200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007975a-d3dc-490b-9197-9d40efbc9bca None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:43.361301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-6007975a-d3dc-490b-9197-9d40efbc9bca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:43.361301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:43.361301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:43.361301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:43.361301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:43.361301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:43.361301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:43.361301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:43.361301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:43.361301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:43.361301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:43.361301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:43.361301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:43.361301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:43.361301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:43.361301 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:43.362696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:43.362696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:43.362696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:43.362696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:43.362696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:43.362696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:43.362696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:43.362696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:43.362696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:43.362696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:43.362696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:43.362696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:43.362696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:43.362696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:43.362696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:43.362696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:43.362696 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:43.363673 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:43.363673 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:43.363673 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:43.363673 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 475/939] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:43.367128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007975a-d3dc-490b-9197-9d40efbc9bca None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:43.441762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852abed8-ac44-4b3d-a940-c04a4306f138 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:43.485361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba1b17-08d7-4b90-af43-57aa60e27035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:43.486226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba1b17-08d7-4b90-af43-57aa60e27035 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:43.486579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba1b17-08d7-4b90-af43-57aa60e27035 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:43.487041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba1b17-08d7-4b90-af43-57aa60e27035 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:43.487913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba1b17-08d7-4b90-af43-57aa60e27035 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:43.489393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba1b17-08d7-4b90-af43-57aa60e27035 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:43.509817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007975a-d3dc-490b-9197-9d40efbc9bca None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:43.517625 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 465/940] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:04:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:04:43.561998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52536c7-7c32-4ed5-b0b1-c143f705d69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:43.562988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52536c7-7c32-4ed5-b0b1-c143f705d69f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:43.563494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52536c7-7c32-4ed5-b0b1-c143f705d69f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:43.563936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52536c7-7c32-4ed5-b0b1-c143f705d69f None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:43.564762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52536c7-7c32-4ed5-b0b1-c143f705d69f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:43.565220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52536c7-7c32-4ed5-b0b1-c143f705d69f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:43.567036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52536c7-7c32-4ed5-b0b1-c143f705d69f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:43.576183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:43.585585 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 476/941] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:43.591849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba1b17-08d7-4b90-af43-57aa60e27035 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:43.661111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:43.713313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba1b17-08d7-4b90-af43-57aa60e27035 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:43.751890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878843d-0ffc-402e-bed7-964d12736620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:43.753250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878843d-0ffc-402e-bed7-964d12736620 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:43.753948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878843d-0ffc-402e-bed7-964d12736620 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:43.754581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878843d-0ffc-402e-bed7-964d12736620 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:43.766469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878843d-0ffc-402e-bed7-964d12736620 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:43.768225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878843d-0ffc-402e-bed7-964d12736620 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:43.781627 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-a878843d-0ffc-402e-bed7-964d12736620 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:43.781627 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:43.781627 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:43.781627 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:43.781627 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:43.781627 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:43.781627 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:43.781627 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:43.781627 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:43.781627 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:43.781627 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:43.781627 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:43.781627 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:43.781627 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:43.781627 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:43.783110 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:43.783110 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:43.783110 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:43.783110 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:43.783110 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:43.783110 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:43.783110 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:43.783110 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:43.783110 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:43.783110 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:43.783110 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:43.783110 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:43.783110 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:43.783110 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:43.783110 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:43.783110 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:43.783110 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:43.784353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:43.784353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:43.784353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:43.784353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:43.784353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:43.784353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:43.784353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:43.784353 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:43.786640 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 466/942] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:43.794104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52536c7-7c32-4ed5-b0b1-c143f705d69f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:43.914730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52536c7-7c32-4ed5-b0b1-c143f705d69f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:43.953534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d5845-833d-4ef4-ad65-a27576308119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:43.954433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d5845-833d-4ef4-ad65-a27576308119 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:43.954879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d5845-833d-4ef4-ad65-a27576308119 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:43.955350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d5845-833d-4ef4-ad65-a27576308119 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:43.956224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d5845-833d-4ef4-ad65-a27576308119 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:43.956760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d5845-833d-4ef4-ad65-a27576308119 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:43.958737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d5845-833d-4ef4-ad65-a27576308119 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:43.973037 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 477/943] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:43.982042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878843d-0ffc-402e-bed7-964d12736620 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:44.103233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878843d-0ffc-402e-bed7-964d12736620 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:44.118339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:44.141779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19506e1-8442-4349-811a-9133823009b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:44.142467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19506e1-8442-4349-811a-9133823009b8 None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:44.142750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19506e1-8442-4349-811a-9133823009b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:44.143026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19506e1-8442-4349-811a-9133823009b8 None admin] PATH_INFO: `/v3/projects/651b8653291a414fba3805312708ce48/users/e63fa755c46b4a2b9e32e720f9fb8413/roles/64676cb561754d11874d385e16ffa09b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:44.145628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19506e1-8442-4349-811a-9133823009b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=651b8653291a414fba3805312708ce48, user_id=e63fa755c46b4a2b9e32e720f9fb8413, role_id=64676cb561754d11874d385e16ffa09b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:44.147141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19506e1-8442-4349-811a-9133823009b8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:44.163863 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 467/944] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:04:43 2022] PUT /identity/v3/projects/651b8653291a414fba3805312708ce48/users/e63fa755c46b4a2b9e32e720f9fb8413/roles/64676cb561754d11874d385e16ffa09b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:04:44.282004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf700ee1-5ab1-47b8-969d-bf7604909e65 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:44.282184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf700ee1-5ab1-47b8-969d-bf7604909e65 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:44.282465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf700ee1-5ab1-47b8-969d-bf7604909e65 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:44.284350 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 478/945] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:44.290262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e618c73-169b-4ea3-a60b-9decb7ba2570 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:44.290572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e618c73-169b-4ea3-a60b-9decb7ba2570 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:44.290926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e618c73-169b-4ea3-a60b-9decb7ba2570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:44.313716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0e618c73-169b-4ea3-a60b-9decb7ba2570 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:44.314916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0e618c73-169b-4ea3-a60b-9decb7ba2570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:44.367220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f25d6-25f3-450d-80fb-bcf634b27e6b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:44.367567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f25d6-25f3-450d-80fb-bcf634b27e6b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:44.367807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f25d6-25f3-450d-80fb-bcf634b27e6b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:44.369407 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 479/946] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:04:44.374775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e52ee5-3208-41f5-be40-2d4aef26d34c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:44.375047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e52ee5-3208-41f5-be40-2d4aef26d34c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:44.375368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e52ee5-3208-41f5-be40-2d4aef26d34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:44.404967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d0e52ee5-3208-41f5-be40-2d4aef26d34c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:44.407162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d0e52ee5-3208-41f5-be40-2d4aef26d34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:44.408241 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 468/947] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:44.503583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:44.530765 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 480/948] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:04:44.705142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e618c73-169b-4ea3-a60b-9decb7ba2570 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:44.820003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e618c73-169b-4ea3-a60b-9decb7ba2570 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:44.822476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:44.860147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdbd7d-87c3-420f-b80f-caa2e471fb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:44.861991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdbd7d-87c3-420f-b80f-caa2e471fb73 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:44.862795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdbd7d-87c3-420f-b80f-caa2e471fb73 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:44.863850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdbd7d-87c3-420f-b80f-caa2e471fb73 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:44.865278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdbd7d-87c3-420f-b80f-caa2e471fb73 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:44.868476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdbd7d-87c3-420f-b80f-caa2e471fb73 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:44.872600 n-d-850468-20 devstack@keystone.service[82160]: WARNING keystone.server.flask.common [None req-b0fdbd7d-87c3-420f-b80f-caa2e471fb73 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 28 18:04:44.892932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.sql.core [None req-b0fdbd7d-87c3-420f-b80f-caa2e471fb73 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 18:04:44.892932 n-d-850468-20 devstack@keystone.service[82160]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 18:04:44.892932 n-d-850468-20 devstack@keystone.service[82160]: [parameters: {'id': 'f45a1c0123794a35b71cc794f1ac954d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 18:04:44.892932 n-d-850468-20 devstack@keystone.service[82160]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82160) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 18:04:44.901598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-b0fdbd7d-87c3-420f-b80f-caa2e471fb73 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f45a1c0123794a35b71cc794f1ac954d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f45a1c0123794a35b71cc794f1ac954d. Aug 28 18:04:44.901598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:44.901598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 18:04:44.901598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 18:04:44.901598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 18:04:44.901598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 18:04:44.901598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 18:04:44.901598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 18:04:44.901598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 18:04:44.901598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application conn.query(q) Aug 28 18:04:44.901598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 18:04:44.901598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 18:04:44.901598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result.read() Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 28 18:04:44.902414 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 28 18:04:44.903805 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:04:44.903805 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:04:44.903805 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 18:04:44.903805 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application yield resource Aug 28 18:04:44.903805 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:04:44.903805 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:04:44.903805 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 18:04:44.903805 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 18:04:44.903805 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 18:04:44.903805 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 18:04:44.903805 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 18:04:44.903805 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise self.value Aug 28 18:04:44.903805 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 18:04:44.903805 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 18:04:44.903805 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 18:04:44.903805 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application session.commit() Aug 28 18:04:44.903805 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 18:04:44.905606 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 18:04:44.905606 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 18:04:44.905606 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 18:04:44.905606 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 18:04:44.905606 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.session.flush() Aug 28 18:04:44.905606 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 18:04:44.905606 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 18:04:44.905606 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 18:04:44.905606 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 18:04:44.905606 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 18:04:44.905606 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application compat.raise_( Aug 28 18:04:44.905606 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 18:04:44.905606 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception Aug 28 18:04:44.905606 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 18:04:44.905606 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 18:04:44.905606 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 18:04:44.905606 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 18:04:44.907013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 18:04:44.907013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 18:04:44.907013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 18:04:44.907013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 18:04:44.907013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 18:04:44.907013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 18:04:44.907013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 18:04:44.907013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 18:04:44.907013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 18:04:44.907013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 18:04:44.907013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 18:04:44.907013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 18:04:44.907013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 18:04:44.907013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 18:04:44.907013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 18:04:44.908978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 18:04:44.908978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 18:04:44.908978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception Aug 28 18:04:44.908978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 18:04:44.908978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 18:04:44.908978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 18:04:44.908978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 18:04:44.908978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 18:04:44.908978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 18:04:44.908978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 18:04:44.908978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application conn.query(q) Aug 28 18:04:44.908978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 18:04:44.908978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 18:04:44.908978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 18:04:44.908978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result.read() Aug 28 18:04:44.908978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 18:04:44.908978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 18:04:44.912714 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 18:04:44.912714 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 18:04:44.912714 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 18:04:44.912714 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 18:04:44.912714 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 18:04:44.912714 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 18:04:44.912714 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 18:04:44.912714 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 18:04:44.912714 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [parameters: {'id': 'f45a1c0123794a35b71cc794f1ac954d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 18:04:44.912714 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 18:04:44.912714 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:44.912714 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:44.912714 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:44.912714 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:44.912714 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 28 18:04:44.914213 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 28 18:04:44.914213 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 18:04:44.914213 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 18:04:44.914213 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 28 18:04:44.914213 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:44.914213 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:44.914213 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:44.914213 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:44.914213 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:44.914213 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:44.914213 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:44.914213 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:44.914213 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:44.914213 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:44.914213 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:44.914213 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:44.914213 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:44.915970 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:44.915970 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 28 18:04:44.915970 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 28 18:04:44.915970 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:44.915970 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:44.915970 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 28 18:04:44.915970 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 28 18:04:44.915970 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f45a1c0123794a35b71cc794f1ac954d. Aug 28 18:04:44.915970 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:44.915970 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 469/949] 10.222.0.27 () {60 vars in 1140 bytes} [Sun Aug 28 18:04:44 2022] POST /identity/v3/projects => generated 262 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:44.917650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e52ee5-3208-41f5-be40-2d4aef26d34c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:45.022813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdbd7d-87c3-420f-b80f-caa2e471fb73 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:45.078702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e52ee5-3208-41f5-be40-2d4aef26d34c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:45.133883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c36cf-6bd1-4a74-adca-5681756411a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:45.134532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c36cf-6bd1-4a74-adca-5681756411a4 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:45.134814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c36cf-6bd1-4a74-adca-5681756411a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:45.135089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c36cf-6bd1-4a74-adca-5681756411a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:45.147015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c36cf-6bd1-4a74-adca-5681756411a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:45.149729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c36cf-6bd1-4a74-adca-5681756411a4 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:45.164996 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-071c36cf-6bd1-4a74-adca-5681756411a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:45.164996 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:45.164996 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:45.164996 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:45.164996 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:45.164996 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:45.164996 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:45.164996 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:45.164996 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:45.164996 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:45.164996 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:45.164996 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:45.164996 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:45.164996 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:45.164996 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:45.165898 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:45.165898 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:45.165898 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:45.165898 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:45.165898 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:45.165898 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:45.165898 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:45.165898 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:45.165898 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:45.165898 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:45.165898 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:45.165898 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:45.165898 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:45.165898 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:45.165898 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:45.165898 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:45.165898 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:45.166810 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:45.166810 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:45.166810 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:45.166810 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:45.166810 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:45.166810 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:45.166810 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:45.166810 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:45.166810 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 481/950] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:45.169270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdbd7d-87c3-420f-b80f-caa2e471fb73 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:45.174490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c36cf-6bd1-4a74-adca-5681756411a4 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:45.223616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa109b-5651-4b8c-a38d-0e9c0b9fc34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:45.224278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa109b-5651-4b8c-a38d-0e9c0b9fc34f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:45.224558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa109b-5651-4b8c-a38d-0e9c0b9fc34f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:45.224827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa109b-5651-4b8c-a38d-0e9c0b9fc34f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:45.225478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa109b-5651-4b8c-a38d-0e9c0b9fc34f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:45.227121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa109b-5651-4b8c-a38d-0e9c0b9fc34f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:45.238517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:45.241432 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-89aa109b-5651-4b8c-a38d-0e9c0b9fc34f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:04:45.241432 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:45.241432 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:45.241432 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:45.241432 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:45.241432 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:45.241432 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:45.241432 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:45.241432 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:04:45.241432 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:45.241432 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:45.241432 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:45.241432 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:45.241432 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:45.241432 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:45.241432 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:45.241432 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:45.242564 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:45.242564 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:45.242564 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:45.242564 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:45.242564 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:45.242564 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:45.242564 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:45.242564 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:45.242564 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:45.242564 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:45.242564 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:45.242564 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:45.242564 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:45.242564 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:45.242564 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:45.242564 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:45.243447 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:45.243447 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:45.243447 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:45.243447 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:45.243447 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:45.243447 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:45.243447 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:45.243447 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:45.243447 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:45.243447 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:45.243447 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:45.243447 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:45.243447 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:04:45.243447 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:45.243447 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 470/951] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 18:04:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:45.251174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa109b-5651-4b8c-a38d-0e9c0b9fc34f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:45.290801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:45.310768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c36cf-6bd1-4a74-adca-5681756411a4 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:45.365502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6979f36-e50c-411c-b213-cceceee1e5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:45.366499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979f36-e50c-411c-b213-cceceee1e5db None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:45.366949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979f36-e50c-411c-b213-cceceee1e5db None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:45.367365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979f36-e50c-411c-b213-cceceee1e5db None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:45.368151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6979f36-e50c-411c-b213-cceceee1e5db None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:45.368553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6979f36-e50c-411c-b213-cceceee1e5db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:45.370149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6979f36-e50c-411c-b213-cceceee1e5db None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:45.399707 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 482/952] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 18:04:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:45.417697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa109b-5651-4b8c-a38d-0e9c0b9fc34f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:45.464216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c2355-05dc-4b61-a8b9-8ae2e127d43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:45.465121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c2355-05dc-4b61-a8b9-8ae2e127d43e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:45.465688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c2355-05dc-4b61-a8b9-8ae2e127d43e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:45.465983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c2355-05dc-4b61-a8b9-8ae2e127d43e None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:45.467086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c2355-05dc-4b61-a8b9-8ae2e127d43e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:45.467603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c2355-05dc-4b61-a8b9-8ae2e127d43e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:45.469598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c2355-05dc-4b61-a8b9-8ae2e127d43e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:45.479980 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 471/953] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 18:04:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:45.487698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6979f36-e50c-411c-b213-cceceee1e5db None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:45.620922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6979f36-e50c-411c-b213-cceceee1e5db None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:45.635550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:45.673178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e90b81-57f9-4d22-8605-2812fa7ae39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:45.673864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e90b81-57f9-4d22-8605-2812fa7ae39e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:45.674105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e90b81-57f9-4d22-8605-2812fa7ae39e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:45.674380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e90b81-57f9-4d22-8605-2812fa7ae39e None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:45.675003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e90b81-57f9-4d22-8605-2812fa7ae39e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:45.675832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e90b81-57f9-4d22-8605-2812fa7ae39e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:45.676718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e90b81-57f9-4d22-8605-2812fa7ae39e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:45.684711 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 483/954] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 18:04:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:45.690496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c2355-05dc-4b61-a8b9-8ae2e127d43e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:45.798842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:45.814110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c2355-05dc-4b61-a8b9-8ae2e127d43e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:45.853414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74cf1d-e498-45dc-bdfe-80f3aa3ae1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:45.854044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74cf1d-e498-45dc-bdfe-80f3aa3ae1e9 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:45.854328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74cf1d-e498-45dc-bdfe-80f3aa3ae1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:45.854647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74cf1d-e498-45dc-bdfe-80f3aa3ae1e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:45.855310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74cf1d-e498-45dc-bdfe-80f3aa3ae1e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:45.856699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74cf1d-e498-45dc-bdfe-80f3aa3ae1e9 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:45.882415 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 472/955] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:04:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:04:45.915047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d2213-1f75-4b21-90d2-22c9291d61a4 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:45.915483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d2213-1f75-4b21-90d2-22c9291d61a4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:45.915846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d2213-1f75-4b21-90d2-22c9291d61a4 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:45.917730 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 484/956] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:45.926154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09e8e6-0e90-4a89-8937-396b2599741b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:45.926801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09e8e6-0e90-4a89-8937-396b2599741b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:45.927317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09e8e6-0e90-4a89-8937-396b2599741b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:45.948029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ad09e8e6-0e90-4a89-8937-396b2599741b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:45.949986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ad09e8e6-0e90-4a89-8937-396b2599741b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:46.038573 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 473/957] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:46.228646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a96a96-2a85-48e1-acd8-1d8aa27f460e None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:46.228893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a96a96-2a85-48e1-acd8-1d8aa27f460e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:46.229158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a96a96-2a85-48e1-acd8-1d8aa27f460e None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:46.231325 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 485/958] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:46.237083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0b3f6-17d3-462c-a368-6d165a45f49d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:46.237367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0b3f6-17d3-462c-a368-6d165a45f49d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:46.237638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0b3f6-17d3-462c-a368-6d165a45f49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:46.255519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-aaf0b3f6-17d3-462c-a368-6d165a45f49d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:46.256695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aaf0b3f6-17d3-462c-a368-6d165a45f49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:46.329301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:46.333753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a96a96-2a85-48e1-acd8-1d8aa27f460e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:46.339567 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 474/959] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:46.467584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a96a96-2a85-48e1-acd8-1d8aa27f460e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:46.508017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6821b-27ed-4fae-86b8-95607fe27f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:46.509037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6821b-27ed-4fae-86b8-95607fe27f4f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:46.509359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6821b-27ed-4fae-86b8-95607fe27f4f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:46.509653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6821b-27ed-4fae-86b8-95607fe27f4f None admin] PATH_INFO: `/v3/services/compute` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:46.510235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6821b-27ed-4fae-86b8-95607fe27f4f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:46.511636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6821b-27ed-4fae-86b8-95607fe27f4f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:46.521953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3df6821b-27ed-4fae-86b8-95607fe27f4f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:04:46.521953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:46.521953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:46.521953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:46.521953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:46.521953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:46.521953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:46.521953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:46.521953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:04:46.521953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:46.521953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:46.521953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:46.521953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:46.521953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:46.521953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:46.521953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:46.521953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:46.523310 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:46.523310 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:46.523310 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:46.523310 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:46.523310 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:46.523310 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:46.523310 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:46.523310 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:46.523310 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:46.523310 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:46.523310 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:46.523310 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:46.523310 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:46.523310 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:46.523310 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:46.523310 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:46.524900 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:46.524900 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:46.524900 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:46.524900 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:46.524900 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:46.524900 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:46.524900 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:46.524900 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:46.524900 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:46.524900 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:46.524900 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:46.524900 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:46.524900 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:04:46.524900 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:46.524900 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 486/960] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:46.529926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0b3f6-17d3-462c-a368-6d165a45f49d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:46.652442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6821b-27ed-4fae-86b8-95607fe27f4f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:46.654871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0b3f6-17d3-462c-a368-6d165a45f49d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:46.700274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:46.702468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e93fe0-3416-456b-a148-f7e317e67ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:46.703343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e93fe0-3416-456b-a148-f7e317e67ea4 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:46.703725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e93fe0-3416-456b-a148-f7e317e67ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:46.704162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e93fe0-3416-456b-a148-f7e317e67ea4 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:46.704893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e93fe0-3416-456b-a148-f7e317e67ea4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:46.705347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e93fe0-3416-456b-a148-f7e317e67ea4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:46.706898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e93fe0-3416-456b-a148-f7e317e67ea4 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:46.712765 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 475/961] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 18:04:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:46.721601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e93fe0-3416-456b-a148-f7e317e67ea4 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:46.794451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6821b-27ed-4fae-86b8-95607fe27f4f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:46.821763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:46.845007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e5a19-489c-4b33-8895-4e8cee25769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:46.845671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e5a19-489c-4b33-8895-4e8cee25769a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:46.845956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e5a19-489c-4b33-8895-4e8cee25769a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:46.846557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e5a19-489c-4b33-8895-4e8cee25769a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:46.864697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e5a19-489c-4b33-8895-4e8cee25769a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:46.870612 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-877e5a19-489c-4b33-8895-4e8cee25769a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:04:46.870612 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:46.870612 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:46.870612 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:46.870612 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:46.870612 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:46.870612 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:46.870612 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:46.870612 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:46.870612 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:46.870612 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:46.870612 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:46.870612 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:46.870612 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:46.870612 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:46.870612 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:46.871583 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:46.871583 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:46.871583 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:46.871583 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:46.871583 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:46.871583 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:46.871583 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:46.871583 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:46.871583 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:46.871583 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:46.871583 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:46.871583 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:46.871583 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:46.871583 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:46.871583 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:46.871583 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:46.872622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:46.872622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:46.872622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:46.872622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:46.872622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:46.872622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:46.872622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:46.872622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:46.872622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:46.872622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:46.872622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:04:46.872622 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:46.872622 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 487/962] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 28 18:04:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:04:46.877655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e5a19-489c-4b33-8895-4e8cee25769a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:46.878908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e93fe0-3416-456b-a148-f7e317e67ea4 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:46.927579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34e814-4b35-44f2-abc0-da21eade4419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:46.928876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e814-4b35-44f2-abc0-da21eade4419 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:46.929228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e814-4b35-44f2-abc0-da21eade4419 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:46.929510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e814-4b35-44f2-abc0-da21eade4419 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:46.930566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34e814-4b35-44f2-abc0-da21eade4419 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:46.930881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34e814-4b35-44f2-abc0-da21eade4419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:46.932599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34e814-4b35-44f2-abc0-da21eade4419 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:46.939447 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 476/963] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 18:04:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:47.016301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e5a19-489c-4b33-8895-4e8cee25769a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:47.019741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:47.073228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0160bea-28ca-4aa0-b76e-67186f176d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:47.073868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0160bea-28ca-4aa0-b76e-67186f176d13 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:47.074148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0160bea-28ca-4aa0-b76e-67186f176d13 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:47.074463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0160bea-28ca-4aa0-b76e-67186f176d13 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:47.075309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0160bea-28ca-4aa0-b76e-67186f176d13 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:47.075621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0160bea-28ca-4aa0-b76e-67186f176d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:47.077826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0160bea-28ca-4aa0-b76e-67186f176d13 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:47.089205 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 488/964] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 28 18:04:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:47.094682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34e814-4b35-44f2-abc0-da21eade4419 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:47.230844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34e814-4b35-44f2-abc0-da21eade4419 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:47.265328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:47.273968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0907add-3063-4849-8e05-b4c6f7eae707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:47.274601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0907add-3063-4849-8e05-b4c6f7eae707 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:47.274881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0907add-3063-4849-8e05-b4c6f7eae707 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:47.275156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0907add-3063-4849-8e05-b4c6f7eae707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:47.294403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0907add-3063-4849-8e05-b4c6f7eae707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:47.294403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0907add-3063-4849-8e05-b4c6f7eae707 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:47.312560 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-e0907add-3063-4849-8e05-b4c6f7eae707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:47.312560 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:47.312560 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:47.312560 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:47.312560 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:47.312560 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:47.312560 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:47.312560 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:47.312560 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:47.312560 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:47.312560 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:47.312560 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:47.312560 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:47.312560 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:47.312560 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:47.312560 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:47.313585 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:47.313585 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:47.313585 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:47.313585 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:47.313585 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:47.313585 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:47.313585 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:47.313585 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:47.313585 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:47.313585 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:47.313585 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:47.313585 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:47.313585 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:47.313585 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:47.313585 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:47.313585 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:47.313585 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:47.314473 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:47.314473 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:47.314473 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:47.316732 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 477/965] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:47.323026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0160bea-28ca-4aa0-b76e-67186f176d13 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:47.446843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0160bea-28ca-4aa0-b76e-67186f176d13 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:47.486763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc966d-a44d-4693-8152-4d4b15ab3738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:47.487512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc966d-a44d-4693-8152-4d4b15ab3738 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:47.487799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc966d-a44d-4693-8152-4d4b15ab3738 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:47.488102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc966d-a44d-4693-8152-4d4b15ab3738 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:47.488887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc966d-a44d-4693-8152-4d4b15ab3738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:47.489210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc966d-a44d-4693-8152-4d4b15ab3738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:47.490727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc966d-a44d-4693-8152-4d4b15ab3738 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:47.505641 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 489/966] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:47.516408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0907add-3063-4849-8e05-b4c6f7eae707 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:47.683902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0907add-3063-4849-8e05-b4c6f7eae707 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:47.701604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5085fa6-af9b-47c0-a104-b471dfefd55a None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:47.702241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5085fa6-af9b-47c0-a104-b471dfefd55a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:47.702659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5085fa6-af9b-47c0-a104-b471dfefd55a None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:47.704897 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 490/967] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:04:47.715722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec8af2-68e6-4b26-9c20-72e775efa04c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:47.716258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec8af2-68e6-4b26-9c20-72e775efa04c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:47.716744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec8af2-68e6-4b26-9c20-72e775efa04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:47.725825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4c086-b937-46e9-8a92-cd0bab8458c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:47.726923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4c086-b937-46e9-8a92-cd0bab8458c1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:47.727481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4c086-b937-46e9-8a92-cd0bab8458c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:47.728101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4c086-b937-46e9-8a92-cd0bab8458c1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:47.738090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4c086-b937-46e9-8a92-cd0bab8458c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:47.739807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4c086-b937-46e9-8a92-cd0bab8458c1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:47.741472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6aec8af2-68e6-4b26-9c20-72e775efa04c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:47.742996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6aec8af2-68e6-4b26-9c20-72e775efa04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:47.754584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-92d4c086-b937-46e9-8a92-cd0bab8458c1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:04:47.754584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:47.754584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:47.754584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:47.754584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:47.754584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:47.754584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:47.754584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:47.754584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:47.754584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:47.754584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:47.754584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:47.754584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:47.754584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:47.754584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:47.754584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:47.755631 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:47.756607 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:47.756607 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:47.756607 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:47.756607 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:47.756607 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:47.756607 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:47.756607 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:47.756607 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:47.756607 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:04:47.756607 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:47.759427 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 478/968] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 18:04:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:47.764342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:47.766679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4c086-b937-46e9-8a92-cd0bab8458c1 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:47.831766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:47.852749 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 491/969] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:04:47.907519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4c086-b937-46e9-8a92-cd0bab8458c1 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:47.947954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccaaef-d11e-416e-9731-6a7475456df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:47.949115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccaaef-d11e-416e-9731-6a7475456df9 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:47.949648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccaaef-d11e-416e-9731-6a7475456df9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:47.950162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccaaef-d11e-416e-9731-6a7475456df9 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:47.951122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccaaef-d11e-416e-9731-6a7475456df9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:47.951717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccaaef-d11e-416e-9731-6a7475456df9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:47.953510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccaaef-d11e-416e-9731-6a7475456df9 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:47.974907 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 479/970] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 28 18:04:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:47.987326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec8af2-68e6-4b26-9c20-72e775efa04c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:48.097084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec8af2-68e6-4b26-9c20-72e775efa04c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:48.116795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a5fa4-23da-41b1-8135-aa82e7c6a0d9 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:48.117100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a5fa4-23da-41b1-8135-aa82e7c6a0d9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:48.117351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a5fa4-23da-41b1-8135-aa82e7c6a0d9 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:48.120206 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 480/971] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:48.124626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161a61a-e863-49e2-8c2c-1093372f8a5c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:48.124922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161a61a-e863-49e2-8c2c-1093372f8a5c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:48.125185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161a61a-e863-49e2-8c2c-1093372f8a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:48.137888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada700b4-ca2e-46b9-8276-cf1901a6a08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:48.139004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada700b4-ca2e-46b9-8276-cf1901a6a08f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:48.139408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada700b4-ca2e-46b9-8276-cf1901a6a08f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:48.139682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada700b4-ca2e-46b9-8276-cf1901a6a08f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:48.148325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b161a61a-e863-49e2-8c2c-1093372f8a5c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:48.149512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b161a61a-e863-49e2-8c2c-1093372f8a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:48.160431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:48.230529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada700b4-ca2e-46b9-8276-cf1901a6a08f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:48.232007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada700b4-ca2e-46b9-8276-cf1901a6a08f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:48.243315 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 481/972] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:04:48.243315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161a61a-e863-49e2-8c2c-1093372f8a5c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:48.278790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:48.374185 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 492/973] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:04:47 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 18:04:48.375160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada700b4-ca2e-46b9-8276-cf1901a6a08f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:48.386639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161a61a-e863-49e2-8c2c-1093372f8a5c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:48.423894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53884892-050a-4567-8a93-529bc27aa446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:48.424682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53884892-050a-4567-8a93-529bc27aa446 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:48.425032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53884892-050a-4567-8a93-529bc27aa446 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:48.425400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53884892-050a-4567-8a93-529bc27aa446 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:48.426127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53884892-050a-4567-8a93-529bc27aa446 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:48.427740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53884892-050a-4567-8a93-529bc27aa446 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:48.432348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:48.447243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.sql.core [None req-53884892-050a-4567-8a93-529bc27aa446 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 18:04:48.447243 n-d-850468-20 devstack@keystone.service[82160]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 28 18:04:48.447243 n-d-850468-20 devstack@keystone.service[82160]: [parameters: {'user_id': 'ac68f098f75a43daabf227c0c133dfce', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 28 18:04:48.447243 n-d-850468-20 devstack@keystone.service[82160]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82160) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 18:04:48.458251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-53884892-050a-4567-8a93-529bc27aa446 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 28 18:04:48.458251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:48.458251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 18:04:48.458251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 18:04:48.458251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 18:04:48.458251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 18:04:48.458251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 18:04:48.458251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 18:04:48.458251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 18:04:48.458251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application conn.query(q) Aug 28 18:04:48.458251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 18:04:48.458251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 18:04:48.458251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 18:04:48.458251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result.read() Aug 28 18:04:48.458251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:04:48.459157 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:04:48.460262 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 18:04:48.460262 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application yield resource Aug 28 18:04:48.460262 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:04:48.460262 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:04:48.460262 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 18:04:48.460262 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 18:04:48.460262 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 18:04:48.460262 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 18:04:48.460262 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 18:04:48.460262 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise self.value Aug 28 18:04:48.460262 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 18:04:48.460262 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 18:04:48.460262 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 18:04:48.460262 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application session.commit() Aug 28 18:04:48.460262 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 18:04:48.460262 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 18:04:48.460262 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 18:04:48.461394 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 18:04:48.461394 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 18:04:48.461394 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.session.flush() Aug 28 18:04:48.461394 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 18:04:48.461394 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 18:04:48.461394 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 18:04:48.461394 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 18:04:48.461394 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 18:04:48.461394 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application compat.raise_( Aug 28 18:04:48.461394 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 18:04:48.461394 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception Aug 28 18:04:48.461394 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 18:04:48.461394 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 18:04:48.461394 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 18:04:48.461394 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 18:04:48.461394 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 18:04:48.461394 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 18:04:48.462409 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 18:04:48.462409 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 18:04:48.462409 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 28 18:04:48.462409 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 28 18:04:48.462409 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 18:04:48.462409 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 18:04:48.462409 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 18:04:48.462409 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 18:04:48.462409 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 18:04:48.462409 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 18:04:48.462409 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 18:04:48.462409 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 18:04:48.462409 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 18:04:48.462409 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 18:04:48.462409 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 18:04:48.462409 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception Aug 28 18:04:48.464498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 18:04:48.464498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 18:04:48.464498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 18:04:48.464498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 18:04:48.464498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 18:04:48.464498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 18:04:48.464498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 18:04:48.464498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application conn.query(q) Aug 28 18:04:48.464498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 18:04:48.464498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 18:04:48.464498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 18:04:48.464498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result.read() Aug 28 18:04:48.464498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 18:04:48.464498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 18:04:48.464498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 18:04:48.464498 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 18:04:48.466584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 18:04:48.466584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 18:04:48.466584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 18:04:48.466584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 18:04:48.466584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 18:04:48.466584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 28 18:04:48.466584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ac68f098f75a43daabf227c0c133dfce', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 28 18:04:48.466584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 18:04:48.466584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:48.466584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:48.466584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:48.466584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:48.466584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:48.466584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:48.466584 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:48.477887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:48.477887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:48.477887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:48.477887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:48.477887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:48.477887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:48.477887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:48.477887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 28 18:04:48.477887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 28 18:04:48.477887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:48.477887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:48.477887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:48.477887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:48.477887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:48.477887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:48.477887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 28 18:04:48.477887 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 28 18:04:48.480152 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 28 18:04:48.480152 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 28 18:04:48.480152 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 18:04:48.480152 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 18:04:48.480152 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 28 18:04:48.480152 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:48.480152 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 482/974] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Aug 28 18:04:48 2022] POST /identity/v3/users => generated 160 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:48.480152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53884892-050a-4567-8a93-529bc27aa446 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:48.519455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada700b4-ca2e-46b9-8276-cf1901a6a08f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:48.563450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce75ea-1244-47c7-ad76-99fd15abdbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:48.566370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce75ea-1244-47c7-ad76-99fd15abdbb0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:48.566790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce75ea-1244-47c7-ad76-99fd15abdbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:48.570039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce75ea-1244-47c7-ad76-99fd15abdbb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:48.582391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce75ea-1244-47c7-ad76-99fd15abdbb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:48.584579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce75ea-1244-47c7-ad76-99fd15abdbb0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:48.601858 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-19ce75ea-1244-47c7-ad76-99fd15abdbb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:48.601858 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:48.601858 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:48.601858 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:48.601858 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:48.601858 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:48.601858 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:48.601858 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:48.601858 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:48.601858 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:48.601858 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:48.601858 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:48.601858 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:04:48.601858 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:04:48.601858 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:04:48.601858 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:04:48.603226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:48.603226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:48.603226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:48.603226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:48.603226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:48.603226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:48.603226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:48.603226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:48.603226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:48.603226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:48.603226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:48.603226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:48.603226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:48.603226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:48.603226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:48.603226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:48.603226 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:04:48.604499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:04:48.604499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:04:48.604499 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:48.608359 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 493/975] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:48.609972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce75ea-1244-47c7-ad76-99fd15abdbb0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:48.620569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:48.632420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53884892-050a-4567-8a93-529bc27aa446 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:48.692409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6353f51-a12d-4196-970c-2411c6c6d5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:48.693578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6353f51-a12d-4196-970c-2411c6c6d5f0 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:48.694102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6353f51-a12d-4196-970c-2411c6c6d5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:48.694639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6353f51-a12d-4196-970c-2411c6c6d5f0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:48.712298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6353f51-a12d-4196-970c-2411c6c6d5f0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:48.716537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6353f51-a12d-4196-970c-2411c6c6d5f0 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:48.734081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-b6353f51-a12d-4196-970c-2411c6c6d5f0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 18:04:48.734081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:48.734081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:48.734081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:48.734081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:48.734081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:48.734081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:48.734081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:48.734081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:48.734081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:48.734081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:48.734081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:48.734081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:04:48.734081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:04:48.734081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:04:48.734081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:48.735718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:48.736659 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:48.736659 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:48.736659 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:04:48.736659 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:04:48.736659 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:04:48.736659 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:04:48.736659 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:04:48.736659 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:04:48.736659 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 18:04:48.736659 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:48.736659 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 483/976] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:04:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:48.736659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6353f51-a12d-4196-970c-2411c6c6d5f0 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:48.764763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:48.769424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce75ea-1244-47c7-ad76-99fd15abdbb0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:48.825113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282a6f6-299b-428c-a5bb-fc0178f7234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:48.825927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282a6f6-299b-428c-a5bb-fc0178f7234c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:48.826274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282a6f6-299b-428c-a5bb-fc0178f7234c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:48.826612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282a6f6-299b-428c-a5bb-fc0178f7234c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:48.827293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282a6f6-299b-428c-a5bb-fc0178f7234c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:48.828881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282a6f6-299b-428c-a5bb-fc0178f7234c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:48.838616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-6282a6f6-299b-428c-a5bb-fc0178f7234c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:04:48.838616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:48.838616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:48.838616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:48.838616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:48.838616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:48.838616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:48.838616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:48.838616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:04:48.838616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:48.838616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:48.838616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:48.838616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:48.838616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:48.838616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:48.838616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:48.838616 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:48.840564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:48.840564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:48.840564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:48.840564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:48.840564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:48.840564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:48.840564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:48.840564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:48.840564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:48.840564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:48.840564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:48.840564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:48.840564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:48.840564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:48.840564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:48.840564 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:48.841864 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:48.841864 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:48.841864 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:48.841864 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:48.841864 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:48.841864 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:48.841864 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:48.841864 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:48.841864 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:48.841864 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:48.841864 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:48.841864 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:48.841864 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:04:48.841864 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:48.842661 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 494/977] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 18:04:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:48.843983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282a6f6-299b-428c-a5bb-fc0178f7234c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:48.868216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6353f51-a12d-4196-970c-2411c6c6d5f0 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:48.919976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fc423-0900-4571-b705-b4c7688f0ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:48.920913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fc423-0900-4571-b705-b4c7688f0ecc None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:48.921344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fc423-0900-4571-b705-b4c7688f0ecc None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:48.921792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fc423-0900-4571-b705-b4c7688f0ecc None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:48.922836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fc423-0900-4571-b705-b4c7688f0ecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:48.923355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fc423-0900-4571-b705-b4c7688f0ecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:48.925665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fc423-0900-4571-b705-b4c7688f0ecc None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:48.944697 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 484/978] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:48.945625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fc423-0900-4571-b705-b4c7688f0ecc None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:48.959811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:48.972562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282a6f6-299b-428c-a5bb-fc0178f7234c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:49.013373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286eb0e-87b0-4c95-a91d-720fdd5b0a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:49.014360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286eb0e-87b0-4c95-a91d-720fdd5b0a4f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:49.014913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286eb0e-87b0-4c95-a91d-720fdd5b0a4f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:49.015566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286eb0e-87b0-4c95-a91d-720fdd5b0a4f None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:49.016621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286eb0e-87b0-4c95-a91d-720fdd5b0a4f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:49.017159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286eb0e-87b0-4c95-a91d-720fdd5b0a4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:49.019797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286eb0e-87b0-4c95-a91d-720fdd5b0a4f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:49.055567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fc423-0900-4571-b705-b4c7688f0ecc None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:49.058426 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 495/979] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 18:04:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:49.059308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286eb0e-87b0-4c95-a91d-720fdd5b0a4f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:49.100769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:49.107392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9474e-580d-4d2f-ac93-80bd787434b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:49.108035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9474e-580d-4d2f-ac93-80bd787434b0 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:49.108311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9474e-580d-4d2f-ac93-80bd787434b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:49.108579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9474e-580d-4d2f-ac93-80bd787434b0 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:49.109238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9474e-580d-4d2f-ac93-80bd787434b0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:49.109543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9474e-580d-4d2f-ac93-80bd787434b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:49.111240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9474e-580d-4d2f-ac93-80bd787434b0 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:49.124523 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 485/980] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 18:04:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:49.124523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0769ff3-60c0-449f-b910-38ea4b2fdda6 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:49.124523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0769ff3-60c0-449f-b910-38ea4b2fdda6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:49.124523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0769ff3-60c0-449f-b910-38ea4b2fdda6 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:49.124523 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 486/981] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:49.126784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0769ff3-60c0-449f-b910-38ea4b2fdda6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:49.196481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286eb0e-87b0-4c95-a91d-720fdd5b0a4f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:49.227500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:49.243604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147bd24-02d5-414c-8610-54194b2a20cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:49.244505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147bd24-02d5-414c-8610-54194b2a20cd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:49.244832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147bd24-02d5-414c-8610-54194b2a20cd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:49.245165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147bd24-02d5-414c-8610-54194b2a20cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:49.253043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147bd24-02d5-414c-8610-54194b2a20cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:49.254767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147bd24-02d5-414c-8610-54194b2a20cd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:49.265874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0769ff3-60c0-449f-b910-38ea4b2fdda6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:49.272013 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3147bd24-02d5-414c-8610-54194b2a20cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:49.272013 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:49.272013 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:49.272013 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:49.272013 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:49.272013 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:49.272013 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:49.272013 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:49.272013 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:49.272013 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:49.272013 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:49.272013 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:49.272013 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:04:49.272013 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:04:49.272013 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:04:49.273038 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:04:49.273038 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:49.273038 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:49.273038 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:49.273038 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:49.273038 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:49.273038 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:49.273038 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:49.273038 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:49.273038 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:49.273038 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:49.273038 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:49.273038 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:49.273038 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:49.273038 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:49.273038 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:49.273038 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:49.274048 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:04:49.274048 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:04:49.274048 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:04:49.274048 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:04:49.274048 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:04:49.274048 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:04:49.274048 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:04:49.274048 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:49.274488 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 496/982] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:49.279355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19db18f-1c5b-4129-884d-e978209491f7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:49.279355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19db18f-1c5b-4129-884d-e978209491f7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:49.279355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19db18f-1c5b-4129-884d-e978209491f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:49.300549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c19db18f-1c5b-4129-884d-e978209491f7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:49.301883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c19db18f-1c5b-4129-884d-e978209491f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:49.314747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014e969-ad84-4d22-aa33-07a8677316f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:49.315509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014e969-ad84-4d22-aa33-07a8677316f1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:49.315849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014e969-ad84-4d22-aa33-07a8677316f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:49.316184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014e969-ad84-4d22-aa33-07a8677316f1 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:49.316888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014e969-ad84-4d22-aa33-07a8677316f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:49.317192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014e969-ad84-4d22-aa33-07a8677316f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:49.318589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014e969-ad84-4d22-aa33-07a8677316f1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:49.324590 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 487/983] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 18:04:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:49.325549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014e969-ad84-4d22-aa33-07a8677316f1 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:49.412540 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 497/984] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:49.413426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19db18f-1c5b-4129-884d-e978209491f7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:49.438887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:49.456112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014e969-ad84-4d22-aa33-07a8677316f1 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:49.497553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbc7a8-97c4-479b-9606-55b33ad59974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:49.498363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbc7a8-97c4-479b-9606-55b33ad59974 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:49.498663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbc7a8-97c4-479b-9606-55b33ad59974 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:49.498980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbc7a8-97c4-479b-9606-55b33ad59974 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:49.499860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbc7a8-97c4-479b-9606-55b33ad59974 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:49.500301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbc7a8-97c4-479b-9606-55b33ad59974 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:49.501948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbc7a8-97c4-479b-9606-55b33ad59974 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:49.511732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:49.519479 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 488/985] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:04:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:49.525272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbc7a8-97c4-479b-9606-55b33ad59974 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:49.555980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19db18f-1c5b-4129-884d-e978209491f7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:49.603570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe08ab-c845-47e5-9afa-5e16fb33f6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:49.604200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe08ab-c845-47e5-9afa-5e16fb33f6a5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:49.604480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe08ab-c845-47e5-9afa-5e16fb33f6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:49.604756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe08ab-c845-47e5-9afa-5e16fb33f6a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:49.605482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe08ab-c845-47e5-9afa-5e16fb33f6a5 None admin] RBAC: Adding query filter params (interface=admin, service_id=0289b3666a984d0eb231a0fcdac43858, region_id=RegionOne) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:49.605790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe08ab-c845-47e5-9afa-5e16fb33f6a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:49.607617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe08ab-c845-47e5-9afa-5e16fb33f6a5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:49.615375 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 498/986] 10.222.0.27 () {56 vars in 1249 bytes} [Sun Aug 28 18:04:49 2022] GET /identity/v3/endpoints?service_id=0289b3666a984d0eb231a0fcdac43858&interface=admin®ion_id=RegionOne => generated 193 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:49.621012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe08ab-c845-47e5-9afa-5e16fb33f6a5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:49.667862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbc7a8-97c4-479b-9606-55b33ad59974 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:49.708606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ca5ff-3218-4bdf-bfc6-4a60fb8bcc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:49.709569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ca5ff-3218-4bdf-bfc6-4a60fb8bcc87 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:49.709896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ca5ff-3218-4bdf-bfc6-4a60fb8bcc87 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:49.710190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ca5ff-3218-4bdf-bfc6-4a60fb8bcc87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:49.710997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ca5ff-3218-4bdf-bfc6-4a60fb8bcc87 None admin] RBAC: Adding query filter params (role.id=64676cb561754d11874d385e16ffa09b, scope.project.id=651b8653291a414fba3805312708ce48, user.id=e63fa755c46b4a2b9e32e720f9fb8413) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:49.711344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ca5ff-3218-4bdf-bfc6-4a60fb8bcc87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:49.712857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ca5ff-3218-4bdf-bfc6-4a60fb8bcc87 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:49.719502 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 489/987] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:04:49 2022] GET /identity/v3/role_assignments?user.id=e63fa755c46b4a2b9e32e720f9fb8413&scope.project.id=651b8653291a414fba3805312708ce48&role.id=64676cb561754d11874d385e16ffa09b => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:49.720353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ca5ff-3218-4bdf-bfc6-4a60fb8bcc87 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:49.731862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:49.758857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe08ab-c845-47e5-9afa-5e16fb33f6a5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:49.812407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b633ae-0658-462e-a8a2-0f0f28f33e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:49.813301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b633ae-0658-462e-a8a2-0f0f28f33e25 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:49.813711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b633ae-0658-462e-a8a2-0f0f28f33e25 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:49.814364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b633ae-0658-462e-a8a2-0f0f28f33e25 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:49.815184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b633ae-0658-462e-a8a2-0f0f28f33e25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:49.817124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b633ae-0658-462e-a8a2-0f0f28f33e25 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:49.818896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:49.835295 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 499/988] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 18:04:49 2022] GET /identity/v3/services => generated 1497 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:04:49.885764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ca5ff-3218-4bdf-bfc6-4a60fb8bcc87 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:49.929403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a010e7-07e6-4e13-a47a-e9a5409909f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:49.929948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a010e7-07e6-4e13-a47a-e9a5409909f0 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:49.930259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a010e7-07e6-4e13-a47a-e9a5409909f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:49.930496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a010e7-07e6-4e13-a47a-e9a5409909f0 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:49.931160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a010e7-07e6-4e13-a47a-e9a5409909f0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:49.932647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a010e7-07e6-4e13-a47a-e9a5409909f0 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:49.952163 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 490/989] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 18:04:49 2022] POST /identity/v3/services => generated 242 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:04:51.766905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96cf57-8d6d-4226-9d2d-99220f3fef45 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:51.767502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96cf57-8d6d-4226-9d2d-99220f3fef45 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:51.767502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96cf57-8d6d-4226-9d2d-99220f3fef45 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:51.769120 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 500/990] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:51.776028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574340a-32c6-4c7d-a2dd-b14edf6edfaa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:51.776539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574340a-32c6-4c7d-a2dd-b14edf6edfaa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:51.776757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574340a-32c6-4c7d-a2dd-b14edf6edfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:51.803228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2574340a-32c6-4c7d-a2dd-b14edf6edfaa None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:51.805536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2574340a-32c6-4c7d-a2dd-b14edf6edfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:51.903859 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 491/991] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:52.002176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5a97c-4f8e-4186-9354-15aae9dfe845 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:52.002523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5a97c-4f8e-4186-9354-15aae9dfe845 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:52.002720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5a97c-4f8e-4186-9354-15aae9dfe845 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:52.004406 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 501/992] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:52.010436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341faa94-f150-40c3-b1c1-529f7ae66e3f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:52.010753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341faa94-f150-40c3-b1c1-529f7ae66e3f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:52.011062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341faa94-f150-40c3-b1c1-529f7ae66e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:52.018037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd39281-0427-4bdb-8059-901fa884c507 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:52.018340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd39281-0427-4bdb-8059-901fa884c507 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:52.018605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd39281-0427-4bdb-8059-901fa884c507 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:52.020125 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 502/993] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:52.025496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da650c1b-9b9e-4407-8222-b8a8660c4cae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:52.025777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da650c1b-9b9e-4407-8222-b8a8660c4cae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:52.026052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da650c1b-9b9e-4407-8222-b8a8660c4cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:52.034553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-341faa94-f150-40c3-b1c1-529f7ae66e3f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:52.036044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-341faa94-f150-40c3-b1c1-529f7ae66e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:52.046659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-da650c1b-9b9e-4407-8222-b8a8660c4cae None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:52.047875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-da650c1b-9b9e-4407-8222-b8a8660c4cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:52.105224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:52.139185 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 503/994] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:04:52.151318 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 492/995] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:52.207974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da650c1b-9b9e-4407-8222-b8a8660c4cae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:52.293266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:52.337261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da650c1b-9b9e-4407-8222-b8a8660c4cae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:52.382994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ebfe4-09e4-450b-a601-1b227081ed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:52.384079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ebfe4-09e4-450b-a601-1b227081ed7c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:52.384415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ebfe4-09e4-450b-a601-1b227081ed7c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:52.384729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ebfe4-09e4-450b-a601-1b227081ed7c None admin] PATH_INFO: `/v3/services/image` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:52.385313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ebfe4-09e4-450b-a601-1b227081ed7c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:52.386688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ebfe4-09e4-450b-a601-1b227081ed7c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:52.397354 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-553ebfe4-09e4-450b-a601-1b227081ed7c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:04:52.397354 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:52.397354 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:52.397354 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:52.397354 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:52.397354 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:52.397354 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:52.397354 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:52.397354 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:04:52.397354 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:52.397354 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:52.397354 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:52.397354 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:52.397354 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:52.397354 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:52.397354 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:52.397354 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:52.398393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:52.398393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:52.398393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:52.398393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:52.398393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:52.398393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:52.398393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:52.398393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:52.398393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:52.398393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:52.398393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:52.398393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:52.398393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:52.398393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:52.398393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:52.398393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:52.399854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:52.399854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:52.399854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:52.399854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:52.399854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:52.399854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:52.399854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:52.399854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:52.399854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:52.399854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:52.399854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:52.399854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:52.399854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:04:52.399854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:52.400730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341faa94-f150-40c3-b1c1-529f7ae66e3f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:52.400808 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 504/996] 10.222.0.27 () {56 vars in 1105 bytes} [Sun Aug 28 18:04:52 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:52.406185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ebfe4-09e4-450b-a601-1b227081ed7c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:52.528214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341faa94-f150-40c3-b1c1-529f7ae66e3f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:52.530471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ebfe4-09e4-450b-a601-1b227081ed7c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:52.574982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1a6c2-8bbe-4f0f-b6c1-39488a090e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:52.575826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1a6c2-8bbe-4f0f-b6c1-39488a090e60 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:52.575989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1a6c2-8bbe-4f0f-b6c1-39488a090e60 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:52.576122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1a6c2-8bbe-4f0f-b6c1-39488a090e60 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:52.576760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1a6c2-8bbe-4f0f-b6c1-39488a090e60 None admin] RBAC: Adding query filter params (name=image) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:52.577072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1a6c2-8bbe-4f0f-b6c1-39488a090e60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:52.578442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1a6c2-8bbe-4f0f-b6c1-39488a090e60 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:52.579756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:52.584369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472a183-0ccc-4b94-9f80-829b504fdcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:52.590076 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 505/997] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:52.590292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472a183-0ccc-4b94-9f80-829b504fdcff None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:52.590292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472a183-0ccc-4b94-9f80-829b504fdcff None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:52.590292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472a183-0ccc-4b94-9f80-829b504fdcff None admin] PATH_INFO: `/v3/services/compute` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:52.590651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1a6c2-8bbe-4f0f-b6c1-39488a090e60 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:52.590777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472a183-0ccc-4b94-9f80-829b504fdcff None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:52.590777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472a183-0ccc-4b94-9f80-829b504fdcff None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:52.597625 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-1472a183-0ccc-4b94-9f80-829b504fdcff None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:04:52.597625 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:52.597625 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:52.597625 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:52.597625 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:52.597625 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:52.597625 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:52.597625 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:52.597625 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:04:52.597625 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:52.597625 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:52.597625 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:52.597625 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:52.597625 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:52.597625 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:52.597625 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:52.597625 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:52.598964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:52.598964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:52.598964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:52.598964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:52.598964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:52.598964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:52.598964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:52.598964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:52.598964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:52.598964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:52.598964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:52.598964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:52.598964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:52.598964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:52.598964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:52.598964 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:52.599978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:52.599978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:52.599978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:52.599978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:52.599978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:52.599978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:52.599978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:52.599978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:52.599978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:52.599978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:52.599978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:52.599978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:52.599978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:04:52.599978 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:52.599978 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 493/998] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:52.601156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472a183-0ccc-4b94-9f80-829b504fdcff None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:52.653364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:52.740718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472a183-0ccc-4b94-9f80-829b504fdcff None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:52.741473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1a6c2-8bbe-4f0f-b6c1-39488a090e60 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:52.783233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b8323-eeff-471c-8d09-c9b1c378a980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:52.784422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523824d-ba8c-4248-90bd-29482060c272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:52.785172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b8323-eeff-471c-8d09-c9b1c378a980 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:52.785325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523824d-ba8c-4248-90bd-29482060c272 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:52.785325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523824d-ba8c-4248-90bd-29482060c272 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:52.785609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b8323-eeff-471c-8d09-c9b1c378a980 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:52.785758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523824d-ba8c-4248-90bd-29482060c272 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:52.785947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b8323-eeff-471c-8d09-c9b1c378a980 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:52.786100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523824d-ba8c-4248-90bd-29482060c272 None admin] RBAC: Adding query filter params (type=image) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:52.786100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523824d-ba8c-4248-90bd-29482060c272 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:52.786410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b8323-eeff-471c-8d09-c9b1c378a980 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:52.787424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523824d-ba8c-4248-90bd-29482060c272 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:52.787926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b8323-eeff-471c-8d09-c9b1c378a980 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:52.793571 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 494/999] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:52.794137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523824d-ba8c-4248-90bd-29482060c272 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:52.799070 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-822b8323-eeff-471c-8d09-c9b1c378a980 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:04:52.799070 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:52.799070 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:52.799070 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:52.799070 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:52.799070 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:52.799070 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:52.799070 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:52.799070 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:04:52.799070 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:52.799070 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:52.799070 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:52.799070 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:52.799070 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:52.799070 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:52.799070 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:52.799070 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:52.800852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:52.800852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:52.800852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:52.800852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:52.800852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:52.800852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:52.800852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:52.800852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:52.800852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:52.800852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:52.800852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:52.800852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:52.800852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:52.800852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:52.800852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:52.800852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:52.801735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:52.801735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:52.801735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:52.801735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:52.801735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:52.801735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:52.801735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:52.801735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:52.801735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:52.801735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:52.801735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:52.801735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:52.801735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:04:52.801735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:52.801735 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 506/1000] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 18:04:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:52.809238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b8323-eeff-471c-8d09-c9b1c378a980 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:52.888569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:52.948998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523824d-ba8c-4248-90bd-29482060c272 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:52.951209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b8323-eeff-471c-8d09-c9b1c378a980 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:52.962644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:52.998132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f4c2-d3b5-453a-b630-145e56c2ac7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:52.998947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f4c2-d3b5-453a-b630-145e56c2ac7f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:52.999629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f4c2-d3b5-453a-b630-145e56c2ac7f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:52.999959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f4c2-d3b5-453a-b630-145e56c2ac7f None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:53.000629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901f4c2-d3b5-453a-b630-145e56c2ac7f None admin] RBAC: Adding query filter params (name=compute) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:53.000966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901f4c2-d3b5-453a-b630-145e56c2ac7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:53.002611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901f4c2-d3b5-453a-b630-145e56c2ac7f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:53.004544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ae758-5a5f-421f-988f-fa92149b8c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:53.005626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ae758-5a5f-421f-988f-fa92149b8c50 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:53.006031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ae758-5a5f-421f-988f-fa92149b8c50 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:53.006581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ae758-5a5f-421f-988f-fa92149b8c50 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:53.007511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ae758-5a5f-421f-988f-fa92149b8c50 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:53.007987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ae758-5a5f-421f-988f-fa92149b8c50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:53.014932 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 495/1001] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 18:04:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:53.015093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ae758-5a5f-421f-988f-fa92149b8c50 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:53.016564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f4c2-d3b5-453a-b630-145e56c2ac7f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:53.020155 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 507/1002] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 18:04:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:53.025862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ae758-5a5f-421f-988f-fa92149b8c50 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:53.155948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f4c2-d3b5-453a-b630-145e56c2ac7f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:53.157501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ae758-5a5f-421f-988f-fa92149b8c50 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:53.187351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:53.194489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b4c00-6e70-4625-9d45-480de6350104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:53.195103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4c00-6e70-4625-9d45-480de6350104 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:53.195406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4c00-6e70-4625-9d45-480de6350104 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:53.195685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4c00-6e70-4625-9d45-480de6350104 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:53.196326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b4c00-6e70-4625-9d45-480de6350104 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:53.196676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b4c00-6e70-4625-9d45-480de6350104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:53.197984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba361a-1d83-4036-be1a-8a94cc6ead5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:53.198117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b4c00-6e70-4625-9d45-480de6350104 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:53.198953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba361a-1d83-4036-be1a-8a94cc6ead5a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:53.199356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba361a-1d83-4036-be1a-8a94cc6ead5a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:53.199641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba361a-1d83-4036-be1a-8a94cc6ead5a None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:53.200565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba361a-1d83-4036-be1a-8a94cc6ead5a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:53.200968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba361a-1d83-4036-be1a-8a94cc6ead5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:53.202496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba361a-1d83-4036-be1a-8a94cc6ead5a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:53.206455 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 496/1003] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 18:04:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:53.210668 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 508/1004] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 18:04:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:53.212656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b4c00-6e70-4625-9d45-480de6350104 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:53.219381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba361a-1d83-4036-be1a-8a94cc6ead5a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:53.255821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:53.345049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b4c00-6e70-4625-9d45-480de6350104 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:53.357346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba361a-1d83-4036-be1a-8a94cc6ead5a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:53.392025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f74f28-5fbe-493a-b7f4-06b24a209418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:53.393148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f74f28-5fbe-493a-b7f4-06b24a209418 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:53.393616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f74f28-5fbe-493a-b7f4-06b24a209418 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:53.394064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f74f28-5fbe-493a-b7f4-06b24a209418 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:53.395226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f74f28-5fbe-493a-b7f4-06b24a209418 None admin] RBAC: Adding query filter params (interface=public, service_id=6fa8b2ac6fc2446e8cec362dd89bb84b, region_id=RegionOne) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:53.395724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f74f28-5fbe-493a-b7f4-06b24a209418 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:53.397434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f74f28-5fbe-493a-b7f4-06b24a209418 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:53.398081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c93d0e-e98d-43c6-983d-88c4f3c83817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:53.398693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c93d0e-e98d-43c6-983d-88c4f3c83817 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:53.398967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c93d0e-e98d-43c6-983d-88c4f3c83817 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:53.399240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c93d0e-e98d-43c6-983d-88c4f3c83817 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:53.399963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c93d0e-e98d-43c6-983d-88c4f3c83817 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:53.401599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c93d0e-e98d-43c6-983d-88c4f3c83817 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:53.404486 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 497/1005] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 28 18:04:53 2022] GET /identity/v3/endpoints?service_id=6fa8b2ac6fc2446e8cec362dd89bb84b&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:53.412454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f74f28-5fbe-493a-b7f4-06b24a209418 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:53.428626 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 509/1006] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:04:53 2022] POST /identity/v3/endpoints => generated 325 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:04:53.565807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:53.575608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f74f28-5fbe-493a-b7f4-06b24a209418 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:53.639581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001b58c-2c43-405b-967e-bb3f906aa589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:53.640208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001b58c-2c43-405b-967e-bb3f906aa589 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:53.640548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001b58c-2c43-405b-967e-bb3f906aa589 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:53.640912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001b58c-2c43-405b-967e-bb3f906aa589 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:53.641573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001b58c-2c43-405b-967e-bb3f906aa589 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:53.643129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001b58c-2c43-405b-967e-bb3f906aa589 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:53.652762 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 498/1007] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 18:04:53 2022] GET /identity/v3/services => generated 1727 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:04:54.778610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd2934-cf34-4e30-9507-de2776569913 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:54.779141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd2934-cf34-4e30-9507-de2776569913 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:54.779543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd2934-cf34-4e30-9507-de2776569913 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:54.781848 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 510/1008] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:54.787469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e928e8c-924a-4543-a0c3-15b7828e5335 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:54.788016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e928e8c-924a-4543-a0c3-15b7828e5335 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:54.788016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e928e8c-924a-4543-a0c3-15b7828e5335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:54.809628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5e928e8c-924a-4543-a0c3-15b7828e5335 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:54.810488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5e928e8c-924a-4543-a0c3-15b7828e5335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:54.909747 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 499/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:55.180016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd2934-cf34-4e30-9507-de2776569913 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:55.243784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:55.317800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd2934-cf34-4e30-9507-de2776569913 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:55.359151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7ce13-5d30-4319-943b-4f3fe0cf41e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:55.359841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ce13-5d30-4319-943b-4f3fe0cf41e8 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:55.360179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ce13-5d30-4319-943b-4f3fe0cf41e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:55.360451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ce13-5d30-4319-943b-4f3fe0cf41e8 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:55.361402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7ce13-5d30-4319-943b-4f3fe0cf41e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:55.362791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7ce13-5d30-4319-943b-4f3fe0cf41e8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:55.385723 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 511/1010] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 18:04:55 2022] POST /identity/v3/services => generated 242 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:04:55.546756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb6a14-73a6-4593-9bfc-88a61d75b53c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:55.546937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb6a14-73a6-4593-9bfc-88a61d75b53c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:55.547229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb6a14-73a6-4593-9bfc-88a61d75b53c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:55.548691 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 500/1011] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:55.554479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3c646-9dac-4e8a-9ee4-59131ac5317a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:55.554772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3c646-9dac-4e8a-9ee4-59131ac5317a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:55.555053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3c646-9dac-4e8a-9ee4-59131ac5317a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:55.581190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2eb3c646-9dac-4e8a-9ee4-59131ac5317a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:55.582414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2eb3c646-9dac-4e8a-9ee4-59131ac5317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:55.687298 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 512/1012] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:55 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:55.749280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce660581-84f0-4afb-8110-950e2182ff5d None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:55.749541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce660581-84f0-4afb-8110-950e2182ff5d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:55.749823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce660581-84f0-4afb-8110-950e2182ff5d None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:55.751442 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 501/1013] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:55.757090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5221d-1b3a-410a-af82-d8dfa9b44f82 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:55.757414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5221d-1b3a-410a-af82-d8dfa9b44f82 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:55.757653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5221d-1b3a-410a-af82-d8dfa9b44f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:55.780920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d8e5221d-1b3a-410a-af82-d8dfa9b44f82 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:55.782158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d8e5221d-1b3a-410a-af82-d8dfa9b44f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:55.822190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:55.891218 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 513/1014] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:55 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:55.974364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce660581-84f0-4afb-8110-950e2182ff5d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:56.099354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:56.115673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce660581-84f0-4afb-8110-950e2182ff5d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:56.163099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a4d90-44fc-4ef2-a7d2-dd5459bd4a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:56.164091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a4d90-44fc-4ef2-a7d2-dd5459bd4a87 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:56.164587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a4d90-44fc-4ef2-a7d2-dd5459bd4a87 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:56.165008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a4d90-44fc-4ef2-a7d2-dd5459bd4a87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:56.166878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a4d90-44fc-4ef2-a7d2-dd5459bd4a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:56.169347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a4d90-44fc-4ef2-a7d2-dd5459bd4a87 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:56.171239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5221d-1b3a-410a-af82-d8dfa9b44f82 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:56.172007 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 502/1015] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:56.177790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a4d90-44fc-4ef2-a7d2-dd5459bd4a87 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:56.301522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5221d-1b3a-410a-af82-d8dfa9b44f82 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:56.312901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a4d90-44fc-4ef2-a7d2-dd5459bd4a87 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:56.349298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc710e-b20c-497d-8684-b674963479e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:56.350291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc710e-b20c-497d-8684-b674963479e2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:56.350643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc710e-b20c-497d-8684-b674963479e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:56.351041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc710e-b20c-497d-8684-b674963479e2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:56.351972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc710e-b20c-497d-8684-b674963479e2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:56.354135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc710e-b20c-497d-8684-b674963479e2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:56.355766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef4a05-66cc-4a28-8849-c29771d952e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:56.356389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef4a05-66cc-4a28-8849-c29771d952e8 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:56.357416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef4a05-66cc-4a28-8849-c29771d952e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:56.357416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef4a05-66cc-4a28-8849-c29771d952e8 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:56.357812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef4a05-66cc-4a28-8849-c29771d952e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:56.359062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef4a05-66cc-4a28-8849-c29771d952e8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:56.370261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b2bc710e-b20c-497d-8684-b674963479e2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:04:56.370261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:56.370261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:56.370261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:56.370261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:56.370261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:56.370261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:56.370261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:56.370261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:04:56.370261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:56.370261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:56.370261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:56.370261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:56.370261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:56.370261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:56.370261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:56.370261 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:56.371718 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:56.371718 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:56.371718 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:56.371718 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:56.371718 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:56.371718 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:56.371718 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:56.371718 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:56.371718 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:56.371718 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:56.371718 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:56.371718 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:56.371718 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:56.371718 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:56.371718 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:56.371718 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:56.372619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:56.372619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:56.372619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:56.372619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:56.372619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:56.372619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:56.372619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:56.372619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:56.372619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:56.372619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:56.372619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:56.372619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:56.372619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:04:56.372619 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:04:56.372619 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 514/1016] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:04:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:56.379149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc710e-b20c-497d-8684-b674963479e2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:56.396664 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 503/1017] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 18:04:56 2022] POST /identity/v3/projects => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:04:56.422492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:56.549032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc710e-b20c-497d-8684-b674963479e2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:56.611405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec58d7-a657-4c8d-9c30-586a8f8ebb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:56.612460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec58d7-a657-4c8d-9c30-586a8f8ebb72 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:56.612950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec58d7-a657-4c8d-9c30-586a8f8ebb72 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:56.613437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec58d7-a657-4c8d-9c30-586a8f8ebb72 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:56.614597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec58d7-a657-4c8d-9c30-586a8f8ebb72 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:56.615135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec58d7-a657-4c8d-9c30-586a8f8ebb72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:56.617760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec58d7-a657-4c8d-9c30-586a8f8ebb72 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:56.627750 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 515/1018] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 18:04:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:56.633774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef4a05-66cc-4a28-8849-c29771d952e8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:56.647861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:56.771351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef4a05-66cc-4a28-8849-c29771d952e8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:56.818149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e65c8-7ec4-4387-9cbd-d3e7473479d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:56.818763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e65c8-7ec4-4387-9cbd-d3e7473479d8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:56.819058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e65c8-7ec4-4387-9cbd-d3e7473479d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:56.819360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e65c8-7ec4-4387-9cbd-d3e7473479d8 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:56.820010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e65c8-7ec4-4387-9cbd-d3e7473479d8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:56.820300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e65c8-7ec4-4387-9cbd-d3e7473479d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:56.821751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e65c8-7ec4-4387-9cbd-d3e7473479d8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:56.831707 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 504/1019] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 18:04:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:56.833667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec58d7-a657-4c8d-9c30-586a8f8ebb72 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:56.963156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:56.973414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec58d7-a657-4c8d-9c30-586a8f8ebb72 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:57.025043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc79c38-5308-4d37-86e3-6e66855a5d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:57.025782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc79c38-5308-4d37-86e3-6e66855a5d43 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:57.026204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc79c38-5308-4d37-86e3-6e66855a5d43 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:57.026480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc79c38-5308-4d37-86e3-6e66855a5d43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:57.027326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc79c38-5308-4d37-86e3-6e66855a5d43 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:57.028995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc79c38-5308-4d37-86e3-6e66855a5d43 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:57.054596 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 516/1020] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:04:56 2022] POST /identity/v3/endpoints => generated 334 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:04:57.441816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4721d67-d569-413a-b2f9-d11cdc1c191e None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:57.442388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4721d67-d569-413a-b2f9-d11cdc1c191e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:57.442388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4721d67-d569-413a-b2f9-d11cdc1c191e None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:57.443891 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 505/1021] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:57.449438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4992070-3dc7-447a-a944-609ec72f1243 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:57.451887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4992070-3dc7-447a-a944-609ec72f1243 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:57.451887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4992070-3dc7-447a-a944-609ec72f1243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:57.480275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a4992070-3dc7-447a-a944-609ec72f1243 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:57.481364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a4992070-3dc7-447a-a944-609ec72f1243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:57.590143 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 517/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:04:57.885822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4721d67-d569-413a-b2f9-d11cdc1c191e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:58.020130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:58.080105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4721d67-d569-413a-b2f9-d11cdc1c191e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:58.141735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124392c-1dab-4a8c-9304-1b3a21d8cbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:58.142720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124392c-1dab-4a8c-9304-1b3a21d8cbc7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:58.143200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124392c-1dab-4a8c-9304-1b3a21d8cbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:58.143709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124392c-1dab-4a8c-9304-1b3a21d8cbc7 None admin] PATH_INFO: `/v3/services/image` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:58.144740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124392c-1dab-4a8c-9304-1b3a21d8cbc7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:58.147169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124392c-1dab-4a8c-9304-1b3a21d8cbc7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:58.165825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-2124392c-1dab-4a8c-9304-1b3a21d8cbc7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:04:58.165825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:58.165825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:04:58.165825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:04:58.165825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:04:58.165825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:04:58.165825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:04:58.165825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:58.165825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:04:58.165825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:58.165825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:04:58.165825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:58.165825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:58.165825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:58.165825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:58.165825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:58.165825 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:58.167014 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:58.167014 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:58.167014 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:58.167014 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:58.167014 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:58.167014 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:58.167014 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:04:58.167014 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:04:58.167014 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:04:58.167014 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:04:58.167014 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:58.167014 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:58.167014 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:58.167014 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:58.167014 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:58.167014 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:58.167957 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:58.167957 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:58.167957 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:58.167957 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:58.167957 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:58.167957 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:58.167957 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:58.167957 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:58.167957 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:58.167957 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:58.167957 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:04:58.167957 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:04:58.167957 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:04:58.167957 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:58.169529 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 506/1023] 10.222.0.27 () {56 vars in 1105 bytes} [Sun Aug 28 18:04:57 2022] GET /identity/v3/services/image => generated 86 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:58.178528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4992070-3dc7-447a-a944-609ec72f1243 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:58.290544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:58.318682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4992070-3dc7-447a-a944-609ec72f1243 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:58.371083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374f374-9675-4975-b403-e735cdb55c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:58.372125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374f374-9675-4975-b403-e735cdb55c89 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:58.372580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374f374-9675-4975-b403-e735cdb55c89 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:58.373033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374f374-9675-4975-b403-e735cdb55c89 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:58.374287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374f374-9675-4975-b403-e735cdb55c89 None admin] RBAC: Adding query filter params (name=image) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:58.374788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374f374-9675-4975-b403-e735cdb55c89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:58.377212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374f374-9675-4975-b403-e735cdb55c89 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:58.394091 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 518/1024] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:58.404203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124392c-1dab-4a8c-9304-1b3a21d8cbc7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:58.598592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124392c-1dab-4a8c-9304-1b3a21d8cbc7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:58.611104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594dd55-f988-49a3-87bd-59fe703d0917 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:58.611466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594dd55-f988-49a3-87bd-59fe703d0917 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:58.611698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594dd55-f988-49a3-87bd-59fe703d0917 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:58.613263 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 519/1025] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:04:58.618915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edaa74-5d5f-4f93-b553-ce6bcd215f53 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:58.619198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edaa74-5d5f-4f93-b553-ce6bcd215f53 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:58.619498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edaa74-5d5f-4f93-b553-ce6bcd215f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:58.641314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-52edaa74-5d5f-4f93-b553-ce6bcd215f53 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:58.643129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52edaa74-5d5f-4f93-b553-ce6bcd215f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:58.655312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5a4a0-ff7a-4c11-8e83-701906f27732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:58.656649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5a4a0-ff7a-4c11-8e83-701906f27732 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:58.657308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5a4a0-ff7a-4c11-8e83-701906f27732 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:58.657754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5a4a0-ff7a-4c11-8e83-701906f27732 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:58.658834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5a4a0-ff7a-4c11-8e83-701906f27732 None admin] RBAC: Adding query filter params (type=image) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:58.659370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5a4a0-ff7a-4c11-8e83-701906f27732 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:58.661753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5a4a0-ff7a-4c11-8e83-701906f27732 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:58.665936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:58.677224 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 507/1026] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:58.678779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5a4a0-ff7a-4c11-8e83-701906f27732 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:58.733173 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 520/1027] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:04:58.817527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5a4a0-ff7a-4c11-8e83-701906f27732 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:58.856633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df612cb6-47f1-4c54-9059-dd61cc702d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:58.857375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df612cb6-47f1-4c54-9059-dd61cc702d1d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:58.857654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df612cb6-47f1-4c54-9059-dd61cc702d1d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:58.857926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df612cb6-47f1-4c54-9059-dd61cc702d1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:58.858654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df612cb6-47f1-4c54-9059-dd61cc702d1d None admin] RBAC: Adding query filter params (interface=public, service_id=ef81ee8791434aa38812bba595c413b6, region_id=RegionOne) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:58.858961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df612cb6-47f1-4c54-9059-dd61cc702d1d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:58.860397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df612cb6-47f1-4c54-9059-dd61cc702d1d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:58.870787 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 508/1028] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 28 18:04:58 2022] GET /identity/v3/endpoints?service_id=ef81ee8791434aa38812bba595c413b6&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:58.872649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edaa74-5d5f-4f93-b553-ce6bcd215f53 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:58.954867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:58.990754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edaa74-5d5f-4f93-b553-ce6bcd215f53 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:59.005206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df612cb6-47f1-4c54-9059-dd61cc702d1d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:59.035561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a83791-074a-4a61-864c-18860e238024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:59.036177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a83791-074a-4a61-864c-18860e238024 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:59.036451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a83791-074a-4a61-864c-18860e238024 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:59.036721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a83791-074a-4a61-864c-18860e238024 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:59.037441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a83791-074a-4a61-864c-18860e238024 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:59.038914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a83791-074a-4a61-864c-18860e238024 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:59.055333 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 521/1029] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 18:04:58 2022] GET /identity/v3/services => generated 1957 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:04:59.085095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:59.131461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df612cb6-47f1-4c54-9059-dd61cc702d1d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:59.172847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22842355-e926-4384-bb77-e1a6d86247ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:59.173497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22842355-e926-4384-bb77-e1a6d86247ff None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:59.173769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22842355-e926-4384-bb77-e1a6d86247ff None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:59.174054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22842355-e926-4384-bb77-e1a6d86247ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:59.175293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22842355-e926-4384-bb77-e1a6d86247ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:59.176858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22842355-e926-4384-bb77-e1a6d86247ff None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:59.178761 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 509/1030] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:04:59.185055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a83791-074a-4a61-864c-18860e238024 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:59.260874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4f6dd-30cc-4130-8408-062ef77ec46d None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:59.261177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4f6dd-30cc-4130-8408-062ef77ec46d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:59.261443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4f6dd-30cc-4130-8408-062ef77ec46d None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:59.262861 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 510/1031] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:04:59.267685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d59ef-255a-452d-a1fb-e906fda4b945 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:59.268003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d59ef-255a-452d-a1fb-e906fda4b945 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:59.268255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d59ef-255a-452d-a1fb-e906fda4b945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:59.286679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-529d59ef-255a-452d-a1fb-e906fda4b945 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:04:59.287897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-529d59ef-255a-452d-a1fb-e906fda4b945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:04:59.301679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a83791-074a-4a61-864c-18860e238024 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:59.346317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efa772-2375-4aca-9e19-1c61d019fdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:59.346941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efa772-2375-4aca-9e19-1c61d019fdb8 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:59.347212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efa772-2375-4aca-9e19-1c61d019fdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:59.347548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efa772-2375-4aca-9e19-1c61d019fdb8 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:59.348227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efa772-2375-4aca-9e19-1c61d019fdb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:59.349699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efa772-2375-4aca-9e19-1c61d019fdb8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:59.357976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:59.362317 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 511/1032] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:04:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:04:59.378977 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 522/1033] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:04:59 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:04:59.630102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d59ef-255a-452d-a1fb-e906fda4b945 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:59.712441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:04:59.760349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d59ef-255a-452d-a1fb-e906fda4b945 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:59.796023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c07ab7-7ccd-419e-9701-72c14f10f2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:59.796690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c07ab7-7ccd-419e-9701-72c14f10f2b1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:59.796935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c07ab7-7ccd-419e-9701-72c14f10f2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:59.797203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c07ab7-7ccd-419e-9701-72c14f10f2b1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:59.807811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c07ab7-7ccd-419e-9701-72c14f10f2b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:04:59.812716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-86c07ab7-7ccd-419e-9701-72c14f10f2b1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:04:59.812716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:04:59.812716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:04:59.812716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:04:59.812716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:04:59.812716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:04:59.812716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:04:59.812716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:04:59.812716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:04:59.812716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:04:59.812716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:04:59.812716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:04:59.812716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:04:59.812716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:04:59.812716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:04:59.812716 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:04:59.813636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:04:59.813636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:04:59.813636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:04:59.813636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:04:59.813636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:04:59.813636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:04:59.813636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:04:59.813636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:04:59.813636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:04:59.813636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:04:59.813636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:04:59.813636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:04:59.813636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:04:59.813636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:04:59.813636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:04:59.813636 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:04:59.814473 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:04:59.814473 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:04:59.814473 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:04:59.814473 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:04:59.814473 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:04:59.814473 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:04:59.814473 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:04:59.814473 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:04:59.814473 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:04:59.814473 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:04:59.814473 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:04:59.814473 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:04:59.818746 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 512/1034] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 28 18:04:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:04:59.820175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efa772-2375-4aca-9e19-1c61d019fdb8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:04:59.936057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efa772-2375-4aca-9e19-1c61d019fdb8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:04:59.980128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a2540-5bbf-4996-bf61-8debcd581b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:04:59.980747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a2540-5bbf-4996-bf61-8debcd581b4d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:04:59.981022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a2540-5bbf-4996-bf61-8debcd581b4d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:04:59.981293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a2540-5bbf-4996-bf61-8debcd581b4d None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:04:59.981959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a2540-5bbf-4996-bf61-8debcd581b4d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:04:59.982254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a2540-5bbf-4996-bf61-8debcd581b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:04:59.983654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a2540-5bbf-4996-bf61-8debcd581b4d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:04:59.992881 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 523/1035] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 28 18:04:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:04:59.998709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c07ab7-7ccd-419e-9701-72c14f10f2b1 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:00.117811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c07ab7-7ccd-419e-9701-72c14f10f2b1 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:00.145023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:00.158291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0fc52-630a-4dfd-90ec-0a6439cb757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:00.158928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0fc52-630a-4dfd-90ec-0a6439cb757c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:00.159209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0fc52-630a-4dfd-90ec-0a6439cb757c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:00.159517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0fc52-630a-4dfd-90ec-0a6439cb757c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:00.170478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0fc52-630a-4dfd-90ec-0a6439cb757c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:00.171968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0fc52-630a-4dfd-90ec-0a6439cb757c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:00.187427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-cbc0fc52-630a-4dfd-90ec-0a6439cb757c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:05:00.187427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:00.187427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:00.187427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:00.187427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:00.187427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:00.187427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:00.187427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:00.187427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:00.187427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:00.187427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:00.187427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:00.187427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:05:00.187427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:05:00.187427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:05:00.187427 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:05:00.193774 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:00.193774 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:00.193774 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:00.193774 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:00.193774 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:00.193774 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:00.193774 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:00.193774 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:00.193774 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:00.193774 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:00.193774 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:00.193774 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:00.193774 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:00.193774 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:00.193774 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:00.193774 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:00.193774 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:05:00.194648 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:05:00.194648 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:05:00.194648 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:05:00.194648 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 513/1036] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:05:00.196473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a2540-5bbf-4996-bf61-8debcd581b4d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:00.254300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:00.306708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a2540-5bbf-4996-bf61-8debcd581b4d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:00.342818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72158d-a5a5-48c7-9327-9bd137c923a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:00.343466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72158d-a5a5-48c7-9327-9bd137c923a4 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:00.343741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72158d-a5a5-48c7-9327-9bd137c923a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:00.344009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72158d-a5a5-48c7-9327-9bd137c923a4 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:00.344709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72158d-a5a5-48c7-9327-9bd137c923a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:00.345007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72158d-a5a5-48c7-9327-9bd137c923a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:00.346381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72158d-a5a5-48c7-9327-9bd137c923a4 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:00.359128 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 524/1037] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:00.364555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0fc52-630a-4dfd-90ec-0a6439cb757c None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:00.485243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0fc52-630a-4dfd-90ec-0a6439cb757c None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:00.523128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861ab07-c358-495d-ae0d-46d807fa3729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:00.523803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861ab07-c358-495d-ae0d-46d807fa3729 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:00.524079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861ab07-c358-495d-ae0d-46d807fa3729 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:00.524350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861ab07-c358-495d-ae0d-46d807fa3729 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:00.533380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861ab07-c358-495d-ae0d-46d807fa3729 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:00.534843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861ab07-c358-495d-ae0d-46d807fa3729 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:00.547868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-d861ab07-c358-495d-ae0d-46d807fa3729 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:05:00.547868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:00.547868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:00.547868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:00.547868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:00.547868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:00.547868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:00.547868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:00.547868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:00.547868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:00.547868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:00.547868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:00.547868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:05:00.547868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:05:00.547868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:05:00.547868 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:00.548882 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:00.557598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:00.557598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:00.557598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:05:00.557598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:05:00.557598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:05:00.557598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:05:00.557598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:05:00.557598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:05:00.557598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:05:00.557598 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:05:00.557598 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 514/1038] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 18:05:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:05:00.560351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72158d-a5a5-48c7-9327-9bd137c923a4 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:00.685534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72158d-a5a5-48c7-9327-9bd137c923a4 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:00.700624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:00.722918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dc8d5-ccf9-4f9d-a182-5f3616f9f0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:00.723588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dc8d5-ccf9-4f9d-a182-5f3616f9f0b5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:00.724017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dc8d5-ccf9-4f9d-a182-5f3616f9f0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:00.724258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dc8d5-ccf9-4f9d-a182-5f3616f9f0b5 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:00.724980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dc8d5-ccf9-4f9d-a182-5f3616f9f0b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:00.725291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dc8d5-ccf9-4f9d-a182-5f3616f9f0b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:00.726745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dc8d5-ccf9-4f9d-a182-5f3616f9f0b5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:00.745562 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 525/1039] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 18:05:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:00.751365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861ab07-c358-495d-ae0d-46d807fa3729 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:00.789240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:00.862721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861ab07-c358-495d-ae0d-46d807fa3729 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:00.897269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cb1c4-bd07-4482-ad82-6726f57c2994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:00.897871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cb1c4-bd07-4482-ad82-6726f57c2994 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:00.898144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cb1c4-bd07-4482-ad82-6726f57c2994 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:00.898410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cb1c4-bd07-4482-ad82-6726f57c2994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:00.970710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cb1c4-bd07-4482-ad82-6726f57c2994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:00.972262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cb1c4-bd07-4482-ad82-6726f57c2994 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:00.979406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325320-b5a6-4d05-a766-1a4f39807e0d None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:00.979711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325320-b5a6-4d05-a766-1a4f39807e0d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:00.979967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325320-b5a6-4d05-a766-1a4f39807e0d None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:00.981497 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 526/1040] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:00.986921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070fd05-3cbf-4623-928e-1a95649ccf74 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:00.987175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070fd05-3cbf-4623-928e-1a95649ccf74 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:00.987640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070fd05-3cbf-4623-928e-1a95649ccf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:01.007358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8070fd05-3cbf-4623-928e-1a95649ccf74 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:01.008916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8070fd05-3cbf-4623-928e-1a95649ccf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:01.009241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:01.087350 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 527/1041] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:01.088011 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 515/1042] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:05:00 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:05:01.093786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070fd05-3cbf-4623-928e-1a95649ccf74 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:01.196224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:01.199563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070fd05-3cbf-4623-928e-1a95649ccf74 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:01.237065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee297f6-4550-4d0e-bee8-60944fdfa3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:01.237705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee297f6-4550-4d0e-bee8-60944fdfa3d2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:01.237977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee297f6-4550-4d0e-bee8-60944fdfa3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:01.238247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee297f6-4550-4d0e-bee8-60944fdfa3d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:01.248970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee297f6-4550-4d0e-bee8-60944fdfa3d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:01.250559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee297f6-4550-4d0e-bee8-60944fdfa3d2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:01.266786 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-1ee297f6-4550-4d0e-bee8-60944fdfa3d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:05:01.266786 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:01.266786 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:01.266786 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:01.266786 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:01.266786 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:01.266786 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:01.266786 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:01.266786 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:01.266786 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:01.266786 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:01.266786 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:01.266786 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:05:01.266786 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:05:01.266786 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:05:01.266786 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:05:01.268014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:01.268014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:01.268014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:01.268014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:01.268014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:01.268014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:01.268014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:01.268014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:01.268014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:01.268014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:01.268014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:01.268014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:01.268014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:01.268014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:01.268014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:01.268014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:01.268014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:05:01.268911 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:05:01.268911 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:05:01.268911 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:05:01.271670 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 528/1043] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:05:01.273815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cb1c4-bd07-4482-ad82-6726f57c2994 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:01.355796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee297f6-4550-4d0e-bee8-60944fdfa3d2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:01.381614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cb1c4-bd07-4482-ad82-6726f57c2994 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:01.416832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39bf68-557d-4b3a-b629-52d1ee0e8fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:01.417444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39bf68-557d-4b3a-b629-52d1ee0e8fdc None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:01.417730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39bf68-557d-4b3a-b629-52d1ee0e8fdc None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:01.418004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39bf68-557d-4b3a-b629-52d1ee0e8fdc None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:01.418653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39bf68-557d-4b3a-b629-52d1ee0e8fdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:01.418959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39bf68-557d-4b3a-b629-52d1ee0e8fdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:01.420444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39bf68-557d-4b3a-b629-52d1ee0e8fdc None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:01.422051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:01.433518 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 516/1044] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:01.434754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb291ba7-e7c0-4c98-ae87-e955eb8b0967 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:01.435040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb291ba7-e7c0-4c98-ae87-e955eb8b0967 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:01.435381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb291ba7-e7c0-4c98-ae87-e955eb8b0967 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:01.436532 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 517/1045] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:01.439149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb291ba7-e7c0-4c98-ae87-e955eb8b0967 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:01.461670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee297f6-4550-4d0e-bee8-60944fdfa3d2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:01.496276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f7d91-c314-47ef-94d4-85c3d7bc95c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:01.496909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f7d91-c314-47ef-94d4-85c3d7bc95c9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:01.497177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f7d91-c314-47ef-94d4-85c3d7bc95c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:01.497439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f7d91-c314-47ef-94d4-85c3d7bc95c9 None admin] PATH_INFO: `/v3/services/image` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:01.498017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f7d91-c314-47ef-94d4-85c3d7bc95c9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:01.499498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f7d91-c314-47ef-94d4-85c3d7bc95c9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:01.508579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-673f7d91-c314-47ef-94d4-85c3d7bc95c9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:05:01.508579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:01.508579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:05:01.508579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:05:01.508579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:05:01.508579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:05:01.508579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:05:01.508579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:05:01.508579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:05:01.508579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:05:01.508579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:05:01.508579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:05:01.508579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:01.508579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:01.508579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:01.508579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:01.508579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:01.509607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:01.509607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:01.509607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:01.509607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:01.509607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:01.509607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:01.509607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:05:01.509607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:05:01.509607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:05:01.509607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:05:01.509607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:01.509607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:01.509607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:01.509607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:01.509607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:01.509607 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:01.510458 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:01.510458 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:01.510458 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:01.510458 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:01.510458 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:01.510458 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:01.510458 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:01.510458 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:01.510458 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:01.510458 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:01.510458 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:05:01.510458 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:05:01.510458 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:05:01.510458 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:05:01.510458 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 529/1046] 10.222.0.27 () {56 vars in 1105 bytes} [Sun Aug 28 18:05:01 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:05:01.511293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08874f9b-4471-4eee-9e73-815f76db38fe None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:01.511293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08874f9b-4471-4eee-9e73-815f76db38fe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:01.511716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08874f9b-4471-4eee-9e73-815f76db38fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:01.533311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-08874f9b-4471-4eee-9e73-815f76db38fe None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:01.534433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08874f9b-4471-4eee-9e73-815f76db38fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:01.546246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:01.549844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb291ba7-e7c0-4c98-ae87-e955eb8b0967 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:01.585862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb8f99-70ef-438b-94c7-5f126352eec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:01.586511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb8f99-70ef-438b-94c7-5f126352eec0 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:01.586785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb8f99-70ef-438b-94c7-5f126352eec0 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:01.587052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb8f99-70ef-438b-94c7-5f126352eec0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:01.594024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb8f99-70ef-438b-94c7-5f126352eec0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:01.595563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb8f99-70ef-438b-94c7-5f126352eec0 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:01.607487 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-b2fb8f99-70ef-438b-94c7-5f126352eec0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:05:01.607487 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:01.607487 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:01.607487 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:01.607487 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:01.607487 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:01.607487 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:01.607487 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:01.607487 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:01.607487 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:01.607487 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:01.607487 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:01.607487 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:05:01.607487 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:05:01.607487 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:05:01.608437 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:05:01.608437 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:01.608437 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:01.608437 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:01.608437 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:01.608437 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:01.608437 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:01.608437 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:01.608437 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:01.608437 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:01.608437 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:01.608437 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:01.608437 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:01.608437 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:01.608437 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:01.608437 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:01.608437 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:01.609544 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:05:01.609544 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:05:01.609544 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:05:01.609544 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:05:01.609544 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:05:01.609544 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:05:01.609544 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:05:01.609544 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:05:01.609544 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 518/1047] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:05:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:05:01.610616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb8f99-70ef-438b-94c7-5f126352eec0 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:01.611603 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 530/1048] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:01.614546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08874f9b-4471-4eee-9e73-815f76db38fe None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:01.670662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:01.722877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb8f99-70ef-438b-94c7-5f126352eec0 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:01.726706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08874f9b-4471-4eee-9e73-815f76db38fe None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:01.759616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e84730-b615-474a-9c06-db6ac4dbe0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:01.760211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e84730-b615-474a-9c06-db6ac4dbe0b3 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:01.760527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e84730-b615-474a-9c06-db6ac4dbe0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:01.760806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e84730-b615-474a-9c06-db6ac4dbe0b3 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:01.761472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e84730-b615-474a-9c06-db6ac4dbe0b3 None admin] RBAC: Adding query filter params (name=image) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:01.761790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e84730-b615-474a-9c06-db6ac4dbe0b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:01.763226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf48852-c5a1-4018-8d5f-3521d8d10468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:01.763399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e84730-b615-474a-9c06-db6ac4dbe0b3 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:01.763624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf48852-c5a1-4018-8d5f-3521d8d10468 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:01.763901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf48852-c5a1-4018-8d5f-3521d8d10468 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:01.764179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf48852-c5a1-4018-8d5f-3521d8d10468 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:01.764871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf48852-c5a1-4018-8d5f-3521d8d10468 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:01.765178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf48852-c5a1-4018-8d5f-3521d8d10468 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:01.766616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf48852-c5a1-4018-8d5f-3521d8d10468 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:01.768619 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 519/1049] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:05:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:01.774153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e84730-b615-474a-9c06-db6ac4dbe0b3 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:01.781082 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 531/1050] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:05:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:01.786841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf48852-c5a1-4018-8d5f-3521d8d10468 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:01.799901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:01.880495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e84730-b615-474a-9c06-db6ac4dbe0b3 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:01.892496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf48852-c5a1-4018-8d5f-3521d8d10468 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:01.897787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:01.915721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32e0ee-1c4c-41f5-bfd3-bdadef1da53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:01.916331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32e0ee-1c4c-41f5-bfd3-bdadef1da53c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:01.916641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32e0ee-1c4c-41f5-bfd3-bdadef1da53c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:01.916905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32e0ee-1c4c-41f5-bfd3-bdadef1da53c None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:01.917536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32e0ee-1c4c-41f5-bfd3-bdadef1da53c None admin] RBAC: Adding query filter params (type=image) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:01.917833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32e0ee-1c4c-41f5-bfd3-bdadef1da53c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:01.919242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32e0ee-1c4c-41f5-bfd3-bdadef1da53c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:01.924349 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 520/1051] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:05:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:05:01.925226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32e0ee-1c4c-41f5-bfd3-bdadef1da53c None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:01.930496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611f6be-94af-4ddf-9dde-9bf36e9d7354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:01.931165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611f6be-94af-4ddf-9dde-9bf36e9d7354 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:01.931468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611f6be-94af-4ddf-9dde-9bf36e9d7354 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:01.931742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611f6be-94af-4ddf-9dde-9bf36e9d7354 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:01.932477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611f6be-94af-4ddf-9dde-9bf36e9d7354 None admin] RBAC: Adding query filter params (role.id=64676cb561754d11874d385e16ffa09b, scope.project.id=651b8653291a414fba3805312708ce48, user.id=faef473a2ab84661b09f3ba3dd977058) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:01.932778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611f6be-94af-4ddf-9dde-9bf36e9d7354 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:01.934217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611f6be-94af-4ddf-9dde-9bf36e9d7354 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:01.949219 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 532/1052] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:05:01 2022] GET /identity/v3/role_assignments?user.id=faef473a2ab84661b09f3ba3dd977058&scope.project.id=651b8653291a414fba3805312708ce48&role.id=64676cb561754d11874d385e16ffa09b => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:05:01.949219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611f6be-94af-4ddf-9dde-9bf36e9d7354 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:02.028359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:02.052087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32e0ee-1c4c-41f5-bfd3-bdadef1da53c None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:02.069177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611f6be-94af-4ddf-9dde-9bf36e9d7354 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:02.117393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed94b9-c606-4d97-9a46-ae5342c23b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:02.118609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed94b9-c606-4d97-9a46-ae5342c23b80 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:02.119035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed94b9-c606-4d97-9a46-ae5342c23b80 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:02.119296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed94b9-c606-4d97-9a46-ae5342c23b80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:02.122240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083c956-364b-40fb-a498-b8096bda0734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:02.122868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083c956-364b-40fb-a498-b8096bda0734 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:02.123168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083c956-364b-40fb-a498-b8096bda0734 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:02.123458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083c956-364b-40fb-a498-b8096bda0734 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:02.124140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083c956-364b-40fb-a498-b8096bda0734 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:02.125530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083c956-364b-40fb-a498-b8096bda0734 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:02.135741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed94b9-c606-4d97-9a46-ae5342c23b80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:05:02.142961 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-c6ed94b9-c606-4d97-9a46-ae5342c23b80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:02.142961 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:02.142961 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:02.142961 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:02.142961 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:02.142961 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:02.142961 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:02.142961 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:02.142961 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:02.142961 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:02.142961 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:02.142961 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:02.142961 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:05:02.142961 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:05:02.142961 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:05:02.142961 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:05:02.144304 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:05:02.144304 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:05:02.144304 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:05:02.144304 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:05:02.144304 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:02.144304 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:02.144304 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:02.144304 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:02.144304 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:02.144304 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:02.144304 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:02.144304 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:02.144304 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:02.144304 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:02.144304 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:02.144304 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:02.145251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:02.145251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:02.145251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:02.145251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:02.145251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:05:02.145251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:05:02.145251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:05:02.145251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:05:02.145251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:05:02.145251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:05:02.145251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:02.145251 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:05:02.145251 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 521/1053] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:05:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:05:02.150542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed94b9-c606-4d97-9a46-ae5342c23b80 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:02.155637 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 533/1054] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:05:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:05:02.210705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:02.297094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed94b9-c606-4d97-9a46-ae5342c23b80 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:02.350478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a5e12-0134-4e9d-b35b-3811ba2c0fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:02.351099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a5e12-0134-4e9d-b35b-3811ba2c0fbb None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:02.351412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a5e12-0134-4e9d-b35b-3811ba2c0fbb None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:02.351728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a5e12-0134-4e9d-b35b-3811ba2c0fbb None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:02.352353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a5e12-0134-4e9d-b35b-3811ba2c0fbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:02.352650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a5e12-0134-4e9d-b35b-3811ba2c0fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:02.354015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a5e12-0134-4e9d-b35b-3811ba2c0fbb None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:02.365386 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 522/1055] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:05:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:05:02.371283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083c956-364b-40fb-a498-b8096bda0734 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:02.479540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083c956-364b-40fb-a498-b8096bda0734 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:02.510462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:02.520018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae168cdb-27fd-4349-ac7c-d8399646fc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:02.520670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae168cdb-27fd-4349-ac7c-d8399646fc5e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:02.520948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae168cdb-27fd-4349-ac7c-d8399646fc5e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:02.521221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae168cdb-27fd-4349-ac7c-d8399646fc5e None admin] PATH_INFO: `/v3/users/c4f55c2a013d4d08841ff6e9fb2bfd17` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:02.537602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae168cdb-27fd-4349-ac7c-d8399646fc5e None admin] RBAC: Authorizing `identity:get_user(user_id=c4f55c2a013d4d08841ff6e9fb2bfd17)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:02.539079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae168cdb-27fd-4349-ac7c-d8399646fc5e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:02.541027 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 534/1056] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:05:02 2022] GET /identity/v3/users/c4f55c2a013d4d08841ff6e9fb2bfd17 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:02.546925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a5e12-0134-4e9d-b35b-3811ba2c0fbb None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:02.654371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:02.657314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a5e12-0134-4e9d-b35b-3811ba2c0fbb None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:02.694097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4ea05-365d-4bec-834c-ca7c024c6f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:02.694720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4ea05-365d-4bec-834c-ca7c024c6f94 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:02.695000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4ea05-365d-4bec-834c-ca7c024c6f94 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:02.695307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4ea05-365d-4bec-834c-ca7c024c6f94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:02.767508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4ea05-365d-4bec-834c-ca7c024c6f94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:02.768994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4ea05-365d-4bec-834c-ca7c024c6f94 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:02.866587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:02.871364 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 523/1057] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:05:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:05:02.876850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae168cdb-27fd-4349-ac7c-d8399646fc5e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:02.992666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae168cdb-27fd-4349-ac7c-d8399646fc5e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:03.032048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd97b93-4691-4966-a127-e970f7d0f214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:03.032473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd97b93-4691-4966-a127-e970f7d0f214 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:03.032776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd97b93-4691-4966-a127-e970f7d0f214 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:03.033074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd97b93-4691-4966-a127-e970f7d0f214 None admin] PATH_INFO: `/v3/projects/4181ba3f88e74d5cb4d3d23e43879b3f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:03.034947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd97b93-4691-4966-a127-e970f7d0f214 None admin] RBAC: Authorizing `identity:get_project(project_id=4181ba3f88e74d5cb4d3d23e43879b3f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:03.036085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd97b93-4691-4966-a127-e970f7d0f214 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:03.043569 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 535/1058] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:05:02 2022] GET /identity/v3/projects/4181ba3f88e74d5cb4d3d23e43879b3f => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:03.046532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4ea05-365d-4bec-834c-ca7c024c6f94 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:03.158854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4ea05-365d-4bec-834c-ca7c024c6f94 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:03.194596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088a74f-b850-41a7-9c73-d97805b82e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:03.195204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088a74f-b850-41a7-9c73-d97805b82e26 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:03.195503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088a74f-b850-41a7-9c73-d97805b82e26 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:03.195780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088a74f-b850-41a7-9c73-d97805b82e26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:03.196568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088a74f-b850-41a7-9c73-d97805b82e26 None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=4181ba3f88e74d5cb4d3d23e43879b3f, user.id=c4f55c2a013d4d08841ff6e9fb2bfd17) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:03.196869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088a74f-b850-41a7-9c73-d97805b82e26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:03.198302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088a74f-b850-41a7-9c73-d97805b82e26 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:03.204384 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 524/1059] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:05:03 2022] GET /identity/v3/role_assignments?user.id=c4f55c2a013d4d08841ff6e9fb2bfd17&scope.project.id=4181ba3f88e74d5cb4d3d23e43879b3f&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:03.874692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc681f73-7fcc-4f1c-b0c7-e5238aa54fce None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:03.875237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc681f73-7fcc-4f1c-b0c7-e5238aa54fce None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:03.875237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc681f73-7fcc-4f1c-b0c7-e5238aa54fce None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:03.876764 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 536/1060] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:03.881780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4498f-1d94-4901-bb55-3a2e78cce14c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:03.882185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4498f-1d94-4901-bb55-3a2e78cce14c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:03.882261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4498f-1d94-4901-bb55-3a2e78cce14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:03.901754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a4c4498f-1d94-4901-bb55-3a2e78cce14c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:03.903034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a4c4498f-1d94-4901-bb55-3a2e78cce14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:03.965890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:03.976091 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 525/1061] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:04.119991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e409c95-18a3-41ba-a43f-9a5c68731350 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:04.120338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e409c95-18a3-41ba-a43f-9a5c68731350 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:04.120528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e409c95-18a3-41ba-a43f-9a5c68731350 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:04.122036 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 537/1062] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:05:04.127347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e6b53-76dc-4726-99e7-64032dc3e12c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:04.127572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e6b53-76dc-4726-99e7-64032dc3e12c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:04.127925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e6b53-76dc-4726-99e7-64032dc3e12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:04.147923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b78e6b53-76dc-4726-99e7-64032dc3e12c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:04.149102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b78e6b53-76dc-4726-99e7-64032dc3e12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:04.223606 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 526/1063] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:04.245390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e409c95-18a3-41ba-a43f-9a5c68731350 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:04.309626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:04.364203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e409c95-18a3-41ba-a43f-9a5c68731350 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:04.399001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11245f7e-36a8-4054-b0cc-60512c70a74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:04.399599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11245f7e-36a8-4054-b0cc-60512c70a74d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:04.399872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11245f7e-36a8-4054-b0cc-60512c70a74d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:04.400143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11245f7e-36a8-4054-b0cc-60512c70a74d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:04.411738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11245f7e-36a8-4054-b0cc-60512c70a74d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:05:04.416525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-11245f7e-36a8-4054-b0cc-60512c70a74d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:05:04.416525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:04.416525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:04.416525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:04.416525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:04.416525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:04.416525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:04.416525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:04.416525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:04.416525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:04.416525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:04.416525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:04.416525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:05:04.416525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:05:04.416525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:05:04.416525 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:05:04.417457 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:05:04.417457 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:05:04.417457 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:05:04.417457 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:05:04.417457 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:04.417457 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:04.417457 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:04.417457 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:04.417457 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:04.417457 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:04.417457 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:04.417457 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:04.417457 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:04.417457 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:04.417457 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:04.417457 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:04.418341 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:04.418341 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:04.418341 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:04.418341 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:04.418341 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:05:04.418341 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:05:04.418341 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:05:04.418341 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:05:04.418341 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:05:04.418341 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:05:04.418341 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:05:04.418341 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:05:04.422991 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 538/1064] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 28 18:05:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:05:04.424356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e6b53-76dc-4726-99e7-64032dc3e12c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:04.485080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11245f7e-36a8-4054-b0cc-60512c70a74d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:04.531759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e6b53-76dc-4726-99e7-64032dc3e12c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:04.557652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:04.576460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46b501-e886-4575-9a29-d6a4451fc7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:04.577090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46b501-e886-4575-9a29-d6a4451fc7e9 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:04.577695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46b501-e886-4575-9a29-d6a4451fc7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:04.577968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46b501-e886-4575-9a29-d6a4451fc7e9 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:04.578922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46b501-e886-4575-9a29-d6a4451fc7e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:04.579224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46b501-e886-4575-9a29-d6a4451fc7e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:04.581166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46b501-e886-4575-9a29-d6a4451fc7e9 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:04.591643 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 527/1065] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 28 18:05:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:04.597416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46b501-e886-4575-9a29-d6a4451fc7e9 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:04.597886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11245f7e-36a8-4054-b0cc-60512c70a74d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:04.612400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:04.637009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49281641-1d1d-4873-84b2-af465e9d3294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:04.637886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49281641-1d1d-4873-84b2-af465e9d3294 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:04.638302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49281641-1d1d-4873-84b2-af465e9d3294 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:04.638579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49281641-1d1d-4873-84b2-af465e9d3294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:04.708582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46b501-e886-4575-9a29-d6a4451fc7e9 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:04.714903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49281641-1d1d-4873-84b2-af465e9d3294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:04.717207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49281641-1d1d-4873-84b2-af465e9d3294 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:04.746943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737756f4-f13c-498c-8252-e7b22dd606dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:04.747609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737756f4-f13c-498c-8252-e7b22dd606dd None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:04.748005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737756f4-f13c-498c-8252-e7b22dd606dd None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:04.748275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737756f4-f13c-498c-8252-e7b22dd606dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:04.761017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737756f4-f13c-498c-8252-e7b22dd606dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:04.762455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737756f4-f13c-498c-8252-e7b22dd606dd None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:04.778594 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-737756f4-f13c-498c-8252-e7b22dd606dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:05:04.778594 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:04.778594 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:04.778594 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:04.778594 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:04.778594 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:04.778594 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:04.778594 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:04.778594 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:04.778594 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:04.778594 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:04.778594 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:04.778594 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:05:04.778594 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:05:04.778594 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:05:04.778594 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:05:04.779634 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:04.779634 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:04.779634 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:04.779634 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:04.779634 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:04.779634 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:04.779634 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:04.779634 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:04.779634 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:04.779634 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:04.779634 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:04.779634 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:04.779634 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:04.779634 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:04.779634 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:04.779634 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:04.779634 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:05:04.780658 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:05:04.780658 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:05:04.780658 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:05:04.780658 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 528/1066] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:05:04.785825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737756f4-f13c-498c-8252-e7b22dd606dd None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:04.830214 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 539/1067] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:05:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:05:04.830761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:04.836301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49281641-1d1d-4873-84b2-af465e9d3294 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:04.851794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:04.899030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737756f4-f13c-498c-8252-e7b22dd606dd None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:04.936030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50e6cd-1091-4f72-8ef4-c1de625eb6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:04.936648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50e6cd-1091-4f72-8ef4-c1de625eb6b0 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:04.936931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50e6cd-1091-4f72-8ef4-c1de625eb6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:04.937210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50e6cd-1091-4f72-8ef4-c1de625eb6b0 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:04.937862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50e6cd-1091-4f72-8ef4-c1de625eb6b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:04.938167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50e6cd-1091-4f72-8ef4-c1de625eb6b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:04.939586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50e6cd-1091-4f72-8ef4-c1de625eb6b0 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:04.947462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49281641-1d1d-4873-84b2-af465e9d3294 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:04.957504 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 529/1068] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:05:04.958580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50e6cd-1091-4f72-8ef4-c1de625eb6b0 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:04.988868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488a3bc-bb7c-47a6-a70a-2226fe640189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:04.989446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488a3bc-bb7c-47a6-a70a-2226fe640189 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:04.989731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488a3bc-bb7c-47a6-a70a-2226fe640189 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:04.990008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488a3bc-bb7c-47a6-a70a-2226fe640189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:05.000944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488a3bc-bb7c-47a6-a70a-2226fe640189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:05.002422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488a3bc-bb7c-47a6-a70a-2226fe640189 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:05.020488 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b488a3bc-bb7c-47a6-a70a-2226fe640189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:05:05.020488 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:05.020488 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:05.020488 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:05.020488 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:05.020488 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:05.020488 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:05.020488 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:05.020488 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:05.020488 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:05.020488 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:05.020488 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:05.020488 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:05:05.020488 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:05:05.020488 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:05:05.020488 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:05:05.021666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:05.021666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:05.021666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:05.021666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:05.021666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:05.021666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:05.021666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:05.021666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:05.021666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:05.021666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:05.021666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:05.021666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:05.021666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:05.021666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:05.021666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:05.021666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:05.021666 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:05:05.023233 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:05:05.023233 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:05:05.023233 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:05:05.023233 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 540/1069] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:05:05.027640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488a3bc-bb7c-47a6-a70a-2226fe640189 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:05.063458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:05.067424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50e6cd-1091-4f72-8ef4-c1de625eb6b0 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:05.101497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:05.104853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1785b-07ab-49e5-94fa-edbb01df41d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:05.105520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1785b-07ab-49e5-94fa-edbb01df41d1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:05.105786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1785b-07ab-49e5-94fa-edbb01df41d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:05.106023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1785b-07ab-49e5-94fa-edbb01df41d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:05.113599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1785b-07ab-49e5-94fa-edbb01df41d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:05.115044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1785b-07ab-49e5-94fa-edbb01df41d1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:05.127013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-4da1785b-07ab-49e5-94fa-edbb01df41d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:05:05.127013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:05.127013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:05.127013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:05.127013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:05.127013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:05.127013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:05.127013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:05.127013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:05.127013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:05.127013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:05.127013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:05.127013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:05:05.127013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:05:05.127013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:05:05.127013 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:05.128028 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:05.128996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:05.128996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:05.128996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:05:05.128996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:05:05.128996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:05:05.128996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:05:05.128996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:05:05.128996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:05:05.128996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:05:05.128996 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:05:05.128996 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 530/1070] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 18:05:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:05:05.134540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1785b-07ab-49e5-94fa-edbb01df41d1 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:05.147870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488a3bc-bb7c-47a6-a70a-2226fe640189 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:05.181834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec82a06-7390-4487-a3a3-c0fc258ddde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:05.182447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec82a06-7390-4487-a3a3-c0fc258ddde6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:05.182750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec82a06-7390-4487-a3a3-c0fc258ddde6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:05.183017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec82a06-7390-4487-a3a3-c0fc258ddde6 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:05.183721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec82a06-7390-4487-a3a3-c0fc258ddde6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:05.184267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec82a06-7390-4487-a3a3-c0fc258ddde6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:05.185470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec82a06-7390-4487-a3a3-c0fc258ddde6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:05.213939 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 541/1071] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:05:05.213939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b3e99-b124-47a2-8e66-9cc359dfbe32 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:05.213939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b3e99-b124-47a2-8e66-9cc359dfbe32 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:05.213939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b3e99-b124-47a2-8e66-9cc359dfbe32 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:05.213939 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 542/1072] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:05.213939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b109d0-e5a7-4a37-b600-10e8ebb712d3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:05.213939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b109d0-e5a7-4a37-b600-10e8ebb712d3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:05.214641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b109d0-e5a7-4a37-b600-10e8ebb712d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:05.227365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-25b109d0-e5a7-4a37-b600-10e8ebb712d3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:05.228652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-25b109d0-e5a7-4a37-b600-10e8ebb712d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:05.256788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1785b-07ab-49e5-94fa-edbb01df41d1 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:05.299552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e5f89-69fe-4ce8-b9df-0687cd0e8fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:05.300208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e5f89-69fe-4ce8-b9df-0687cd0e8fb6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:05.300487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e5f89-69fe-4ce8-b9df-0687cd0e8fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:05.300759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e5f89-69fe-4ce8-b9df-0687cd0e8fb6 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:05.301517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e5f89-69fe-4ce8-b9df-0687cd0e8fb6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:05.301819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e5f89-69fe-4ce8-b9df-0687cd0e8fb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:05.303366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e5f89-69fe-4ce8-b9df-0687cd0e8fb6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:05.307096 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 543/1073] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:05.328907 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 531/1074] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 18:05:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:05:05.330198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b109d0-e5a7-4a37-b600-10e8ebb712d3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:05.389986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:05.438971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b109d0-e5a7-4a37-b600-10e8ebb712d3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:05.476504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09da003-b474-4496-b4be-69f5d93186b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:05.477145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09da003-b474-4496-b4be-69f5d93186b1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:05.477422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09da003-b474-4496-b4be-69f5d93186b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:05.477745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09da003-b474-4496-b4be-69f5d93186b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:05.488585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09da003-b474-4496-b4be-69f5d93186b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:05.490060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09da003-b474-4496-b4be-69f5d93186b1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:05.505847 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-d09da003-b474-4496-b4be-69f5d93186b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:05:05.505847 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:05.505847 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:05.505847 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:05.505847 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:05.505847 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:05.505847 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:05.505847 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:05.505847 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:05.505847 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:05.505847 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:05.505847 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:05.505847 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:05:05.505847 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:05:05.505847 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:05:05.505847 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:05:05.506887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:05.506887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:05.506887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:05.506887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:05.506887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:05.506887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:05.506887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:05.506887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:05.506887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:05.506887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:05.506887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:05.506887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:05.506887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:05.506887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:05.506887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:05.506887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:05.506887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:05:05.507835 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:05:05.507835 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:05:05.507835 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:05:05.507835 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 544/1075] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:05:05.513581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e5f89-69fe-4ce8-b9df-0687cd0e8fb6 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:05.533459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:05.582889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09da003-b474-4496-b4be-69f5d93186b1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:05.627693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e5f89-69fe-4ce8-b9df-0687cd0e8fb6 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:05.661971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347025e5-a7c1-4df6-9d74-c0c6892c4c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:05.662585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347025e5-a7c1-4df6-9d74-c0c6892c4c77 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:05.662863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347025e5-a7c1-4df6-9d74-c0c6892c4c77 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:05.663134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347025e5-a7c1-4df6-9d74-c0c6892c4c77 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:05.663822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347025e5-a7c1-4df6-9d74-c0c6892c4c77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:05.664123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347025e5-a7c1-4df6-9d74-c0c6892c4c77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:05.665619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347025e5-a7c1-4df6-9d74-c0c6892c4c77 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:05.677915 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 532/1076] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:05.683669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347025e5-a7c1-4df6-9d74-c0c6892c4c77 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:05.687079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09da003-b474-4496-b4be-69f5d93186b1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:05.694305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:05.727388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b045b38-8cf3-450b-b338-986d7d67392e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:05.728081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b045b38-8cf3-450b-b338-986d7d67392e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:05.728378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b045b38-8cf3-450b-b338-986d7d67392e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:05.728726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b045b38-8cf3-450b-b338-986d7d67392e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:05.740918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b045b38-8cf3-450b-b338-986d7d67392e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:05:05.745770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-2b045b38-8cf3-450b-b338-986d7d67392e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:05.745770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:05.745770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:05.745770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:05.745770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:05.745770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:05.745770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:05.745770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:05.745770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:05.745770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:05.745770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:05.745770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:05.745770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:05:05.745770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:05:05.745770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:05:05.745770 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:05:05.747034 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:05:05.747034 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:05:05.747034 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:05:05.747034 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:05:05.747034 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:05.747034 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:05.747034 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:05.747034 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:05.747034 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:05.747034 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:05.747034 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:05.747034 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:05.747034 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:05.747034 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:05.747034 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:05.747034 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:05.748163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:05.748163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:05.748163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:05.748163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:05.748163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:05:05.748163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:05:05.748163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:05:05.748163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:05:05.748163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:05:05.748163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:05:05.748163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:05.748163 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:05:05.748163 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 545/1077] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:05:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:05:05.752968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b045b38-8cf3-450b-b338-986d7d67392e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:05.770507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:05.794474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347025e5-a7c1-4df6-9d74-c0c6892c4c77 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:05.829478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3ecd3-9480-4547-ad71-686a47fd54a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:05.830109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3ecd3-9480-4547-ad71-686a47fd54a9 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:05.830392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3ecd3-9480-4547-ad71-686a47fd54a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:05.830664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3ecd3-9480-4547-ad71-686a47fd54a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:05.837545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3ecd3-9480-4547-ad71-686a47fd54a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:05.838988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3ecd3-9480-4547-ad71-686a47fd54a9 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:05.850485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-dab3ecd3-9480-4547-ad71-686a47fd54a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:05:05.850485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:05.850485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:05.850485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:05.850485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:05.850485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:05.850485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:05.850485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:05.850485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:05.850485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:05.850485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:05.850485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:05.850485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:05:05.850485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:05:05.850485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:05:05.851591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:05:05.851591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:05.851591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:05.851591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:05.851591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:05.851591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:05.851591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:05.851591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:05.851591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:05.851591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:05.851591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:05.851591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:05.851591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:05.851591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:05.851591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:05.851591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:05.851591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:05.853076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:05:05.853076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:05:05.853076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:05:05.853076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:05:05.853076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:05:05.853076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:05:05.853076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:05:05.853076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:05:05.853076 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 533/1078] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:05:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:05:05.857793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3ecd3-9480-4547-ad71-686a47fd54a9 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:05.860687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b045b38-8cf3-450b-b338-986d7d67392e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:05.896100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac6eef-2488-4d2f-9a8b-5e3f3c546297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:05.896824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac6eef-2488-4d2f-9a8b-5e3f3c546297 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:05.897102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac6eef-2488-4d2f-9a8b-5e3f3c546297 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:05.897368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac6eef-2488-4d2f-9a8b-5e3f3c546297 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:05.898024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac6eef-2488-4d2f-9a8b-5e3f3c546297 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:05.898399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac6eef-2488-4d2f-9a8b-5e3f3c546297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:05.899885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac6eef-2488-4d2f-9a8b-5e3f3c546297 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:05.908291 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 546/1079] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:05:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:05:05.914037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac6eef-2488-4d2f-9a8b-5e3f3c546297 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:05.943831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:05.958767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3ecd3-9480-4547-ad71-686a47fd54a9 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:05.996984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0d278-95f0-40e4-9c14-ccec3314ee79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:05.997601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0d278-95f0-40e4-9c14-ccec3314ee79 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:05.997895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0d278-95f0-40e4-9c14-ccec3314ee79 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:05.998164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0d278-95f0-40e4-9c14-ccec3314ee79 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:05.998874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0d278-95f0-40e4-9c14-ccec3314ee79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:05.999176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0d278-95f0-40e4-9c14-ccec3314ee79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:06.000691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0d278-95f0-40e4-9c14-ccec3314ee79 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:06.003428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:06.014310 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 534/1080] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:05:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:05:06.020359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0d278-95f0-40e4-9c14-ccec3314ee79 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:06.024327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac6eef-2488-4d2f-9a8b-5e3f3c546297 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:06.060132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43571cca-4943-4b36-87db-c5f1f0ecd160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:06.060769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43571cca-4943-4b36-87db-c5f1f0ecd160 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:06.061046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43571cca-4943-4b36-87db-c5f1f0ecd160 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:06.061314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43571cca-4943-4b36-87db-c5f1f0ecd160 None admin] PATH_INFO: `/v3/users/c4f55c2a013d4d08841ff6e9fb2bfd17` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:06.062579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43571cca-4943-4b36-87db-c5f1f0ecd160 None admin] RBAC: Authorizing `identity:get_user(user_id=c4f55c2a013d4d08841ff6e9fb2bfd17)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:06.064045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43571cca-4943-4b36-87db-c5f1f0ecd160 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:06.065948 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 547/1081] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:05:05 2022] GET /identity/v3/users/c4f55c2a013d4d08841ff6e9fb2bfd17 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:05:06.071349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43571cca-4943-4b36-87db-c5f1f0ecd160 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:06.126229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0d278-95f0-40e4-9c14-ccec3314ee79 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:06.161850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac5196-f548-4b17-a006-b230d70ec65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:06.162539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac5196-f548-4b17-a006-b230d70ec65e None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:06.162817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac5196-f548-4b17-a006-b230d70ec65e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:06.163090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac5196-f548-4b17-a006-b230d70ec65e None admin] PATH_INFO: `/v3/projects/651b8653291a414fba3805312708ce48/users/faef473a2ab84661b09f3ba3dd977058/roles/64676cb561754d11874d385e16ffa09b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:06.165449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac5196-f548-4b17-a006-b230d70ec65e None admin] RBAC: Authorizing `identity:create_grant(project_id=651b8653291a414fba3805312708ce48, user_id=faef473a2ab84661b09f3ba3dd977058, role_id=64676cb561754d11874d385e16ffa09b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:06.166885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac5196-f548-4b17-a006-b230d70ec65e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:06.170635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:06.177339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43571cca-4943-4b36-87db-c5f1f0ecd160 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:06.182892 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 535/1082] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:05:06 2022] PUT /identity/v3/projects/651b8653291a414fba3805312708ce48/users/faef473a2ab84661b09f3ba3dd977058/roles/64676cb561754d11874d385e16ffa09b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:05:06.217279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ae477-85b3-436e-bf1d-d07ec1b559d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:06.217946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ae477-85b3-436e-bf1d-d07ec1b559d6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:06.218221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ae477-85b3-436e-bf1d-d07ec1b559d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:06.218489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ae477-85b3-436e-bf1d-d07ec1b559d6 None admin] PATH_INFO: `/v3/projects/4181ba3f88e74d5cb4d3d23e43879b3f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:06.219703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ae477-85b3-436e-bf1d-d07ec1b559d6 None admin] RBAC: Authorizing `identity:get_project(project_id=4181ba3f88e74d5cb4d3d23e43879b3f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:06.221176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ae477-85b3-436e-bf1d-d07ec1b559d6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:06.222884 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 548/1083] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:05:06 2022] GET /identity/v3/projects/4181ba3f88e74d5cb4d3d23e43879b3f => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:05:06.229470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac5196-f548-4b17-a006-b230d70ec65e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:06.306063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:06.357984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac5196-f548-4b17-a006-b230d70ec65e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:06.394660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f259a-f81e-4295-b9f2-3c127134c21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:06.395376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f259a-f81e-4295-b9f2-3c127134c21c None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:06.395648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f259a-f81e-4295-b9f2-3c127134c21c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:06.395901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f259a-f81e-4295-b9f2-3c127134c21c None admin] PATH_INFO: `/v3/projects/4181ba3f88e74d5cb4d3d23e43879b3f/users/c4f55c2a013d4d08841ff6e9fb2bfd17/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:06.397855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f259a-f81e-4295-b9f2-3c127134c21c None admin] RBAC: Authorizing `identity:create_grant(project_id=4181ba3f88e74d5cb4d3d23e43879b3f, user_id=c4f55c2a013d4d08841ff6e9fb2bfd17, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:06.399395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f259a-f81e-4295-b9f2-3c127134c21c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:06.413467 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 536/1084] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:05:06 2022] PUT /identity/v3/projects/4181ba3f88e74d5cb4d3d23e43879b3f/users/c4f55c2a013d4d08841ff6e9fb2bfd17/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:05:08.079633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e668ba-cf6e-4051-9f5f-e818571ece59 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:08.080223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e668ba-cf6e-4051-9f5f-e818571ece59 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:08.080223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e668ba-cf6e-4051-9f5f-e818571ece59 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:08.081508 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 549/1085] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:08.087329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79207-7e2e-40cf-a1a5-600000395acb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:08.087775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79207-7e2e-40cf-a1a5-600000395acb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:08.087875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79207-7e2e-40cf-a1a5-600000395acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:08.108354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-00f79207-7e2e-40cf-a1a5-600000395acb None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:08.109536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00f79207-7e2e-40cf-a1a5-600000395acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:08.180002 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 537/1086] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:08.314373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117eb2f-5db5-458c-acd5-73ca444cd5db None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:08.314653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117eb2f-5db5-458c-acd5-73ca444cd5db None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:08.314924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117eb2f-5db5-458c-acd5-73ca444cd5db None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:08.316315 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 550/1087] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:08.321769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615d08d-3cfa-40c7-8795-743638fb3425 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:08.322020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615d08d-3cfa-40c7-8795-743638fb3425 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:08.322324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615d08d-3cfa-40c7-8795-743638fb3425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:08.340795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2615d08d-3cfa-40c7-8795-743638fb3425 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:08.341876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2615d08d-3cfa-40c7-8795-743638fb3425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:08.385121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:08.410918 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 538/1088] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:08.442472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117eb2f-5db5-458c-acd5-73ca444cd5db None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:08.548214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117eb2f-5db5-458c-acd5-73ca444cd5db None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:08.585733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bbd06-e54b-4415-90a0-824e9ba3a488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:08.586366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bbd06-e54b-4415-90a0-824e9ba3a488 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:08.586641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bbd06-e54b-4415-90a0-824e9ba3a488 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:08.586951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bbd06-e54b-4415-90a0-824e9ba3a488 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:08.597691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bbd06-e54b-4415-90a0-824e9ba3a488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:05:08.602386 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-834bbd06-e54b-4415-90a0-824e9ba3a488 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:05:08.602386 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:08.602386 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:08.602386 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:08.602386 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:08.602386 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:08.602386 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:08.602386 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:08.602386 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:08.602386 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:08.602386 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:08.602386 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:08.602386 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:05:08.602386 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:05:08.602386 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:05:08.602386 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:05:08.603373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:05:08.603373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:05:08.603373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:05:08.603373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:05:08.603373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:08.603373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:08.603373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:08.603373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:08.603373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:08.603373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:08.603373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:08.603373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:08.603373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:08.603373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:08.603373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:08.603373 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:08.604317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:08.604317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:08.604317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:08.604317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:08.604317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:05:08.604317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:05:08.604317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:05:08.604317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:05:08.604317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:05:08.604317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:05:08.604317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:05:08.604317 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:05:08.604317 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 551/1089] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 28 18:05:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:05:08.609833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615d08d-3cfa-40c7-8795-743638fb3425 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:08.676245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bbd06-e54b-4415-90a0-824e9ba3a488 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:08.703585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:08.711315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615d08d-3cfa-40c7-8795-743638fb3425 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:08.748436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc712aff-65cf-4ee7-adf3-9f1cb10dee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:08.749185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc712aff-65cf-4ee7-adf3-9f1cb10dee6a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:08.749459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc712aff-65cf-4ee7-adf3-9f1cb10dee6a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:08.749727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc712aff-65cf-4ee7-adf3-9f1cb10dee6a None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:08.750390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc712aff-65cf-4ee7-adf3-9f1cb10dee6a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:08.750684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc712aff-65cf-4ee7-adf3-9f1cb10dee6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:08.752093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc712aff-65cf-4ee7-adf3-9f1cb10dee6a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:08.760235 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 539/1090] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 28 18:05:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:08.766067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc712aff-65cf-4ee7-adf3-9f1cb10dee6a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:08.782760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bbd06-e54b-4415-90a0-824e9ba3a488 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:08.808596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:08.819126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5126e-de4a-4c16-88c0-4f3d749181e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:08.819797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5126e-de4a-4c16-88c0-4f3d749181e5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:08.820069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5126e-de4a-4c16-88c0-4f3d749181e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:08.820335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5126e-de4a-4c16-88c0-4f3d749181e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:08.830512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5126e-de4a-4c16-88c0-4f3d749181e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:05:08.835325 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-0cb5126e-de4a-4c16-88c0-4f3d749181e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:08.835325 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:08.835325 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:08.835325 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:08.835325 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:08.835325 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:08.835325 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:08.835325 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:08.835325 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:08.835325 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:08.835325 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:08.835325 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:08.835325 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:05:08.835325 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:05:08.835325 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:05:08.835325 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:05:08.836322 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:05:08.836322 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:05:08.836322 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:05:08.836322 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:05:08.836322 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:08.836322 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:08.836322 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:08.836322 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:08.836322 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:08.836322 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:08.836322 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:08.836322 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:08.836322 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:08.836322 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:08.836322 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:08.836322 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:08.837204 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:08.837204 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:08.837204 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:08.837204 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:08.837204 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:05:08.837204 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:05:08.837204 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:05:08.837204 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:05:08.837204 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:05:08.837204 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:05:08.837204 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:08.837204 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:05:08.837204 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 552/1091] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:05:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:05:08.842610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5126e-de4a-4c16-88c0-4f3d749181e5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:08.869281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc712aff-65cf-4ee7-adf3-9f1cb10dee6a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:08.905906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fccf08-60ec-4cb1-99da-2f21597aa847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:08.906550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fccf08-60ec-4cb1-99da-2f21597aa847 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:08.906845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fccf08-60ec-4cb1-99da-2f21597aa847 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:08.907114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fccf08-60ec-4cb1-99da-2f21597aa847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:08.917802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fccf08-60ec-4cb1-99da-2f21597aa847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:08.919242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fccf08-60ec-4cb1-99da-2f21597aa847 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:08.924566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:08.933694 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-57fccf08-60ec-4cb1-99da-2f21597aa847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:05:08.933694 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:08.933694 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:08.933694 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:08.933694 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:08.933694 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:08.933694 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:08.933694 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:08.933694 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:08.933694 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:08.933694 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:08.933694 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:08.933694 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:05:08.933694 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:05:08.933694 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:05:08.933694 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:05:08.934848 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:08.934848 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:08.934848 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:08.934848 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:08.934848 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:08.934848 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:08.934848 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:08.934848 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:08.934848 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:08.934848 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:08.934848 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:08.934848 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:08.934848 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:08.934848 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:08.934848 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:08.934848 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:08.934848 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:05:08.935965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:05:08.935965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:05:08.935965 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:05:08.935965 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 540/1092] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:05:08.940793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fccf08-60ec-4cb1-99da-2f21597aa847 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:08.943131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5126e-de4a-4c16-88c0-4f3d749181e5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:08.978600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2f917-7f8b-4b23-882c-ae6c7d493f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:08.979274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2f917-7f8b-4b23-882c-ae6c7d493f52 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:08.979562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2f917-7f8b-4b23-882c-ae6c7d493f52 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:08.979834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2f917-7f8b-4b23-882c-ae6c7d493f52 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:08.980503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2f917-7f8b-4b23-882c-ae6c7d493f52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:08.980803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2f917-7f8b-4b23-882c-ae6c7d493f52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:08.982176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2f917-7f8b-4b23-882c-ae6c7d493f52 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:08.990570 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 553/1093] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:05:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:05:08.996538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2f917-7f8b-4b23-882c-ae6c7d493f52 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:09.035171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:09.044802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fccf08-60ec-4cb1-99da-2f21597aa847 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:09.079412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ed40e-871c-4ad0-be1d-c65b96edc682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:09.080027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed40e-871c-4ad0-be1d-c65b96edc682 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:09.080309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed40e-871c-4ad0-be1d-c65b96edc682 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:09.080588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed40e-871c-4ad0-be1d-c65b96edc682 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:09.081233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ed40e-871c-4ad0-be1d-c65b96edc682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:09.081543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ed40e-871c-4ad0-be1d-c65b96edc682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:09.082918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ed40e-871c-4ad0-be1d-c65b96edc682 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:09.094959 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 541/1094] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:09.100644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ed40e-871c-4ad0-be1d-c65b96edc682 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:09.100994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2f917-7f8b-4b23-882c-ae6c7d493f52 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:09.136488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca6945-e0e9-4c35-b8fd-27241d97f1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:09.137054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca6945-e0e9-4c35-b8fd-27241d97f1f5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:09.137326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca6945-e0e9-4c35-b8fd-27241d97f1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:09.137600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca6945-e0e9-4c35-b8fd-27241d97f1f5 None admin] PATH_INFO: `/v3/users/c4f55c2a013d4d08841ff6e9fb2bfd17` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:09.138969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca6945-e0e9-4c35-b8fd-27241d97f1f5 None admin] RBAC: Authorizing `identity:get_user(user_id=c4f55c2a013d4d08841ff6e9fb2bfd17)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:09.140437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca6945-e0e9-4c35-b8fd-27241d97f1f5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:09.142022 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 554/1095] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:05:08 2022] GET /identity/v3/users/c4f55c2a013d4d08841ff6e9fb2bfd17 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:05:09.148224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca6945-e0e9-4c35-b8fd-27241d97f1f5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:09.165161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:09.203744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ed40e-871c-4ad0-be1d-c65b96edc682 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:09.237983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0fbdb-48dc-4277-9d62-14c73d35b668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:09.238623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0fbdb-48dc-4277-9d62-14c73d35b668 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:09.238905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0fbdb-48dc-4277-9d62-14c73d35b668 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:09.239169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0fbdb-48dc-4277-9d62-14c73d35b668 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:09.247166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0fbdb-48dc-4277-9d62-14c73d35b668 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:09.248649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0fbdb-48dc-4277-9d62-14c73d35b668 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:09.261250 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-18d0fbdb-48dc-4277-9d62-14c73d35b668 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:05:09.261250 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:09.261250 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:09.261250 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:09.261250 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:09.261250 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:09.261250 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:09.261250 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:09.261250 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:09.261250 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:09.261250 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:09.261250 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:09.261250 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:05:09.261250 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:05:09.261250 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:05:09.261250 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:09.262400 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:09.269383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:09.269383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:09.269383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:05:09.269383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:05:09.269383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:05:09.269383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:05:09.269383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:05:09.269383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:05:09.269383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:05:09.269383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:05:09.269383 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 542/1096] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 18:05:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:05:09.270007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0fbdb-48dc-4277-9d62-14c73d35b668 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:09.272805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca6945-e0e9-4c35-b8fd-27241d97f1f5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:09.283692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:09.312404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8b9e-063e-4871-b2fa-898a5b2d83d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:09.313020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8b9e-063e-4871-b2fa-898a5b2d83d3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:09.313293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8b9e-063e-4871-b2fa-898a5b2d83d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:09.313560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8b9e-063e-4871-b2fa-898a5b2d83d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:09.385433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0fbdb-48dc-4277-9d62-14c73d35b668 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:09.388884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b8b9e-063e-4871-b2fa-898a5b2d83d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:09.389756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b8b9e-063e-4871-b2fa-898a5b2d83d3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:09.404808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:09.422552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cfa85-867a-4594-b9a5-1c2a46f5c742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:09.423175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cfa85-867a-4594-b9a5-1c2a46f5c742 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:09.423481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cfa85-867a-4594-b9a5-1c2a46f5c742 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:09.423755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cfa85-867a-4594-b9a5-1c2a46f5c742 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:09.424503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cfa85-867a-4594-b9a5-1c2a46f5c742 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:09.424806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cfa85-867a-4594-b9a5-1c2a46f5c742 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:09.426616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cfa85-867a-4594-b9a5-1c2a46f5c742 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:09.457643 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 543/1097] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 18:05:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:09.463720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cfa85-867a-4594-b9a5-1c2a46f5c742 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:09.504607 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 555/1098] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:05:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:05:09.511474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8b9e-063e-4871-b2fa-898a5b2d83d3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:09.535834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:09.570732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cfa85-867a-4594-b9a5-1c2a46f5c742 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:09.606766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9294b-5c48-4b19-bdbe-c8b8b30bea26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:09.607442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9294b-5c48-4b19-bdbe-c8b8b30bea26 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:09.607726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9294b-5c48-4b19-bdbe-c8b8b30bea26 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:09.608012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9294b-5c48-4b19-bdbe-c8b8b30bea26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:09.627874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8b9e-063e-4871-b2fa-898a5b2d83d3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:09.648802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:09.671095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3a3a7-e61b-464b-bd0f-958d346f5c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:09.671838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a3a7-e61b-464b-bd0f-958d346f5c60 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:09.672066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a3a7-e61b-464b-bd0f-958d346f5c60 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:09.672340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a3a7-e61b-464b-bd0f-958d346f5c60 None admin] PATH_INFO: `/v3/projects/4181ba3f88e74d5cb4d3d23e43879b3f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:09.673527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3a3a7-e61b-464b-bd0f-958d346f5c60 None admin] RBAC: Authorizing `identity:get_project(project_id=4181ba3f88e74d5cb4d3d23e43879b3f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:09.674985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3a3a7-e61b-464b-bd0f-958d346f5c60 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:09.678008 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 556/1099] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:05:09 2022] GET /identity/v3/projects/4181ba3f88e74d5cb4d3d23e43879b3f => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:09.683091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3a3a7-e61b-464b-bd0f-958d346f5c60 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:09.690839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9294b-5c48-4b19-bdbe-c8b8b30bea26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:09.692340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9294b-5c48-4b19-bdbe-c8b8b30bea26 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:09.759472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:09.789277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3a3a7-e61b-464b-bd0f-958d346f5c60 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:09.796139 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 544/1100] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:05:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 18:05:09.802283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9294b-5c48-4b19-bdbe-c8b8b30bea26 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:09.825075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778295be-52a9-4bc6-8751-5f10f8717301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:09.825690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778295be-52a9-4bc6-8751-5f10f8717301 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:09.825968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778295be-52a9-4bc6-8751-5f10f8717301 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:09.826240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778295be-52a9-4bc6-8751-5f10f8717301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:09.826956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778295be-52a9-4bc6-8751-5f10f8717301 None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=4181ba3f88e74d5cb4d3d23e43879b3f, user.id=c4f55c2a013d4d08841ff6e9fb2bfd17) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:09.827285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778295be-52a9-4bc6-8751-5f10f8717301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:09.828712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778295be-52a9-4bc6-8751-5f10f8717301 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:09.834712 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 557/1101] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:05:09 2022] GET /identity/v3/role_assignments?user.id=c4f55c2a013d4d08841ff6e9fb2bfd17&scope.project.id=4181ba3f88e74d5cb4d3d23e43879b3f&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:09.917419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9294b-5c48-4b19-bdbe-c8b8b30bea26 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:09.955611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483c65f-7a49-4e23-8b08-14ffeb1a4d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:09.956261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483c65f-7a49-4e23-8b08-14ffeb1a4d4f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:09.956536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483c65f-7a49-4e23-8b08-14ffeb1a4d4f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:09.956805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483c65f-7a49-4e23-8b08-14ffeb1a4d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:09.968682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483c65f-7a49-4e23-8b08-14ffeb1a4d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:09.970153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483c65f-7a49-4e23-8b08-14ffeb1a4d4f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:09.986298 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-c483c65f-7a49-4e23-8b08-14ffeb1a4d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:05:09.986298 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:09.986298 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:09.986298 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:09.986298 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:09.986298 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:09.986298 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:09.986298 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:09.986298 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:09.986298 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:09.986298 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:09.986298 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:09.986298 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:05:09.986298 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:05:09.986298 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:05:09.986298 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:05:09.987464 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:09.987464 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:09.987464 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:09.987464 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:09.987464 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:09.987464 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:09.987464 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:09.987464 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:09.987464 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:09.987464 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:09.987464 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:09.987464 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:09.987464 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:09.987464 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:09.987464 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:09.987464 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:09.987464 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:05:09.988507 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:05:09.988507 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:05:09.988507 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:05:09.988507 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 545/1102] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:05:09.993823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778295be-52a9-4bc6-8751-5f10f8717301 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:10.048936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:10.105334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778295be-52a9-4bc6-8751-5f10f8717301 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:10.143618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec393e13-0c64-4826-9559-6bc03d3bcfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:10.144233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec393e13-0c64-4826-9559-6bc03d3bcfa3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:10.144506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec393e13-0c64-4826-9559-6bc03d3bcfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:10.144774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec393e13-0c64-4826-9559-6bc03d3bcfa3 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:10.145432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec393e13-0c64-4826-9559-6bc03d3bcfa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:10.145752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec393e13-0c64-4826-9559-6bc03d3bcfa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:10.147115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec393e13-0c64-4826-9559-6bc03d3bcfa3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:10.160908 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 558/1103] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:10.167051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483c65f-7a49-4e23-8b08-14ffeb1a4d4f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:10.190975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:10.275736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483c65f-7a49-4e23-8b08-14ffeb1a4d4f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:10.314174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ae4a0-fce7-4418-9468-fa30d242ca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:10.314798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ae4a0-fce7-4418-9468-fa30d242ca6e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:10.315077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ae4a0-fce7-4418-9468-fa30d242ca6e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:10.315414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ae4a0-fce7-4418-9468-fa30d242ca6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:10.322994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ae4a0-fce7-4418-9468-fa30d242ca6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:10.324454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ae4a0-fce7-4418-9468-fa30d242ca6e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:10.336182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-380ae4a0-fce7-4418-9468-fa30d242ca6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:05:10.336182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:10.336182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:10.336182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:10.336182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:10.336182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:10.336182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:10.336182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:10.336182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:10.336182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:10.336182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:10.336182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:10.336182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:05:10.336182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:05:10.336182 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:05:10.337118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:05:10.337118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:10.337118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:10.337118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:10.337118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:10.337118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:10.337118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:10.337118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:10.337118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:10.337118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:10.337118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:10.337118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:10.337118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:10.337118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:10.337118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:10.337118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:10.337118 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:10.338485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:05:10.338485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:05:10.338485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:05:10.338485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:05:10.338485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:05:10.338485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:05:10.338485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:05:10.338485 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:05:10.338485 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 546/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:05:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:05:10.343465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec393e13-0c64-4826-9559-6bc03d3bcfa3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:10.447052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec393e13-0c64-4826-9559-6bc03d3bcfa3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:10.454798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:10.483765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc00b2-831d-4632-8cb5-9c76d894a9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:10.484380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc00b2-831d-4632-8cb5-9c76d894a9db None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:10.484669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc00b2-831d-4632-8cb5-9c76d894a9db None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:10.484937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc00b2-831d-4632-8cb5-9c76d894a9db None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:10.485658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc00b2-831d-4632-8cb5-9c76d894a9db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:10.485980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc00b2-831d-4632-8cb5-9c76d894a9db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:10.487914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc00b2-831d-4632-8cb5-9c76d894a9db None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:10.511738 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 559/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:05:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:10.518067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ae4a0-fce7-4418-9468-fa30d242ca6e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:10.608722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:10.629124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ae4a0-fce7-4418-9468-fa30d242ca6e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:10.664516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239bd15-4517-4413-a2c7-67920d5b1f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:10.665141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239bd15-4517-4413-a2c7-67920d5b1f81 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:10.665422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239bd15-4517-4413-a2c7-67920d5b1f81 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:10.665697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239bd15-4517-4413-a2c7-67920d5b1f81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:10.666430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239bd15-4517-4413-a2c7-67920d5b1f81 None admin] RBAC: Adding query filter params (role.id=64676cb561754d11874d385e16ffa09b, scope.project.id=651b8653291a414fba3805312708ce48, user.id=faef473a2ab84661b09f3ba3dd977058) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:10.666739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239bd15-4517-4413-a2c7-67920d5b1f81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:10.668478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239bd15-4517-4413-a2c7-67920d5b1f81 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:10.674343 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 547/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:05:10 2022] GET /identity/v3/role_assignments?user.id=faef473a2ab84661b09f3ba3dd977058&scope.project.id=651b8653291a414fba3805312708ce48&role.id=64676cb561754d11874d385e16ffa09b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:11.780897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7ed3f-026a-44c8-870e-9cfce8125d99 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:11.781489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7ed3f-026a-44c8-870e-9cfce8125d99 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:11.781489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7ed3f-026a-44c8-870e-9cfce8125d99 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:11.783472 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 560/1107] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:11.789831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a34ea-9da5-40c9-88e8-f5a083fbc732 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:11.790283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a34ea-9da5-40c9-88e8-f5a083fbc732 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:11.790465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a34ea-9da5-40c9-88e8-f5a083fbc732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:11.811018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-af7a34ea-9da5-40c9-88e8-f5a083fbc732 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:11.812163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-af7a34ea-9da5-40c9-88e8-f5a083fbc732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:11.889528 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 548/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:12.165430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7ed3f-026a-44c8-870e-9cfce8125d99 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:12.298233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7ed3f-026a-44c8-870e-9cfce8125d99 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:12.335858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79347790-b6f6-4b40-8741-b1a8485e23de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:12.336492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79347790-b6f6-4b40-8741-b1a8485e23de None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:12.336845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79347790-b6f6-4b40-8741-b1a8485e23de None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:12.337113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79347790-b6f6-4b40-8741-b1a8485e23de None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:12.338227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79347790-b6f6-4b40-8741-b1a8485e23de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:12.339728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79347790-b6f6-4b40-8741-b1a8485e23de None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:12.341282 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 561/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:05:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:12.347333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a34ea-9da5-40c9-88e8-f5a083fbc732 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:12.428825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:12.457233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a34ea-9da5-40c9-88e8-f5a083fbc732 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:12.496776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1248ce9-6bc8-4f6d-9282-8330e2941d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:12.497409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1248ce9-6bc8-4f6d-9282-8330e2941d9f None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:12.497684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1248ce9-6bc8-4f6d-9282-8330e2941d9f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:12.497955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1248ce9-6bc8-4f6d-9282-8330e2941d9f None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:12.498615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1248ce9-6bc8-4f6d-9282-8330e2941d9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:12.500083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1248ce9-6bc8-4f6d-9282-8330e2941d9f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:12.527988 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 549/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:05:12 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:05:14.452239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9d5ce-623e-4079-8563-89f5f5ace51e None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:14.452824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9d5ce-623e-4079-8563-89f5f5ace51e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:14.452824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9d5ce-623e-4079-8563-89f5f5ace51e None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:14.454826 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 562/1111] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:14.462008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95ed3d-1436-4b18-9aac-601a9f90b89f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:14.462525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95ed3d-1436-4b18-9aac-601a9f90b89f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:14.462525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95ed3d-1436-4b18-9aac-601a9f90b89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:14.493190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dd95ed3d-1436-4b18-9aac-601a9f90b89f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:14.494372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dd95ed3d-1436-4b18-9aac-601a9f90b89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:14.571697 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 550/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:14.838066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9d5ce-623e-4079-8563-89f5f5ace51e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:14.876166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:14.950920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9d5ce-623e-4079-8563-89f5f5ace51e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:14.989405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b4e6c-9a1d-4aa8-ba55-2c311e9de998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:14.990289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b4e6c-9a1d-4aa8-ba55-2c311e9de998 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:14.990589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b4e6c-9a1d-4aa8-ba55-2c311e9de998 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:14.990945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b4e6c-9a1d-4aa8-ba55-2c311e9de998 None admin] PATH_INFO: `/v3/roles/81040db4535e417891c10dd996b1eac5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:14.993224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b4e6c-9a1d-4aa8-ba55-2c311e9de998 None admin] RBAC: Authorizing `identity:get_role(role_id=81040db4535e417891c10dd996b1eac5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:14.994630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b4e6c-9a1d-4aa8-ba55-2c311e9de998 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:14.996021 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 563/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:05:14 2022] GET /identity/v3/roles/81040db4535e417891c10dd996b1eac5 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:15.002129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95ed3d-1436-4b18-9aac-601a9f90b89f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:15.067364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:15.124158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95ed3d-1436-4b18-9aac-601a9f90b89f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:15.160373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36c090-3d88-4dfa-82d1-05d308107697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:15.160999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36c090-3d88-4dfa-82d1-05d308107697 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:15.161278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36c090-3d88-4dfa-82d1-05d308107697 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:15.161554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36c090-3d88-4dfa-82d1-05d308107697 None admin] PATH_INFO: `/v3/users/9c5264783d874f2daff8f5d2850a145f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:15.180727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36c090-3d88-4dfa-82d1-05d308107697 None admin] RBAC: Authorizing `identity:get_user(user_id=9c5264783d874f2daff8f5d2850a145f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:15.182345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36c090-3d88-4dfa-82d1-05d308107697 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:15.184863 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 551/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:05:15 2022] GET /identity/v3/users/9c5264783d874f2daff8f5d2850a145f => generated 286 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:15.191071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b4e6c-9a1d-4aa8-ba55-2c311e9de998 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:15.301296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b4e6c-9a1d-4aa8-ba55-2c311e9de998 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:15.302908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:15.340368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc79eb-ee51-4c7d-9826-9b3a706d9633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:15.340808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc79eb-ee51-4c7d-9826-9b3a706d9633 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:15.341086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc79eb-ee51-4c7d-9826-9b3a706d9633 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:15.341366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc79eb-ee51-4c7d-9826-9b3a706d9633 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:15.419741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc79eb-ee51-4c7d-9826-9b3a706d9633 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:15.421152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc79eb-ee51-4c7d-9826-9b3a706d9633 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:15.528837 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 564/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:05:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:05:15.535123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36c090-3d88-4dfa-82d1-05d308107697 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:15.651557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36c090-3d88-4dfa-82d1-05d308107697 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:15.670625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:15.688901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414af90a-d92e-46a3-9b29-421bf9d679c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:15.689527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414af90a-d92e-46a3-9b29-421bf9d679c7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:15.689807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414af90a-d92e-46a3-9b29-421bf9d679c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:15.690082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414af90a-d92e-46a3-9b29-421bf9d679c7 None admin] PATH_INFO: `/v3/projects/4181ba3f88e74d5cb4d3d23e43879b3f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:15.691274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414af90a-d92e-46a3-9b29-421bf9d679c7 None admin] RBAC: Authorizing `identity:get_project(project_id=4181ba3f88e74d5cb4d3d23e43879b3f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:15.692710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414af90a-d92e-46a3-9b29-421bf9d679c7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:15.694354 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 552/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:05:15 2022] GET /identity/v3/projects/4181ba3f88e74d5cb4d3d23e43879b3f => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:15.701203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc79eb-ee51-4c7d-9826-9b3a706d9633 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:15.703469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:15.820951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc79eb-ee51-4c7d-9826-9b3a706d9633 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:15.855368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56480b36-7267-4999-8742-3d1a28b6d1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:15.855963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56480b36-7267-4999-8742-3d1a28b6d1ca None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:15.856239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56480b36-7267-4999-8742-3d1a28b6d1ca None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:15.856502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56480b36-7267-4999-8742-3d1a28b6d1ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:15.857216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56480b36-7267-4999-8742-3d1a28b6d1ca None admin] RBAC: Adding query filter params (role.id=81040db4535e417891c10dd996b1eac5, scope.project.id=4181ba3f88e74d5cb4d3d23e43879b3f, user.id=9c5264783d874f2daff8f5d2850a145f) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:15.857518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56480b36-7267-4999-8742-3d1a28b6d1ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:15.858951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56480b36-7267-4999-8742-3d1a28b6d1ca None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:15.864245 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 565/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:05:15 2022] GET /identity/v3/role_assignments?user.id=9c5264783d874f2daff8f5d2850a145f&scope.project.id=4181ba3f88e74d5cb4d3d23e43879b3f&role.id=81040db4535e417891c10dd996b1eac5 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:17.756304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7c124-f85f-49a3-899d-3774e9043e5e None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:17.756846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7c124-f85f-49a3-899d-3774e9043e5e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:17.756846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7c124-f85f-49a3-899d-3774e9043e5e None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:17.758575 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 553/1118] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:17.764161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff83caa-e075-4372-afbd-066ffba4e2d7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:17.764589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff83caa-e075-4372-afbd-066ffba4e2d7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:17.764711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff83caa-e075-4372-afbd-066ffba4e2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:17.784174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3ff83caa-e075-4372-afbd-066ffba4e2d7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:17.785390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3ff83caa-e075-4372-afbd-066ffba4e2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:17.863471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:17.876552 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 566/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:18.144154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7c124-f85f-49a3-899d-3774e9043e5e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:18.254761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7c124-f85f-49a3-899d-3774e9043e5e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:18.291337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5a76-4de8-48b1-976e-d48cce0cb8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:18.291964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5a76-4de8-48b1-976e-d48cce0cb8b5 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:18.292236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5a76-4de8-48b1-976e-d48cce0cb8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:18.292501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5a76-4de8-48b1-976e-d48cce0cb8b5 None admin] PATH_INFO: `/v3/roles/81040db4535e417891c10dd996b1eac5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:18.293907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac5a76-4de8-48b1-976e-d48cce0cb8b5 None admin] RBAC: Authorizing `identity:get_role(role_id=81040db4535e417891c10dd996b1eac5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:18.295509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac5a76-4de8-48b1-976e-d48cce0cb8b5 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:18.296663 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 554/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:05:18 2022] GET /identity/v3/roles/81040db4535e417891c10dd996b1eac5 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:18.302851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff83caa-e075-4372-afbd-066ffba4e2d7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:18.408043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff83caa-e075-4372-afbd-066ffba4e2d7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:18.442332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9e48f-0988-4671-ba08-9049978bf9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:18.442962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9e48f-0988-4671-ba08-9049978bf9ae None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:18.443242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9e48f-0988-4671-ba08-9049978bf9ae None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:18.443536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9e48f-0988-4671-ba08-9049978bf9ae None admin] PATH_INFO: `/v3/users/9c5264783d874f2daff8f5d2850a145f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:18.444651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9e48f-0988-4671-ba08-9049978bf9ae None admin] RBAC: Authorizing `identity:get_user(user_id=9c5264783d874f2daff8f5d2850a145f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:18.446145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9e48f-0988-4671-ba08-9049978bf9ae None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:18.447773 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 567/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:05:18 2022] GET /identity/v3/users/9c5264783d874f2daff8f5d2850a145f => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:18.453779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5a76-4de8-48b1-976e-d48cce0cb8b5 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:18.512152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:18.566105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5a76-4de8-48b1-976e-d48cce0cb8b5 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:18.609990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ab76e-9c60-4185-89a2-6c65cf01c804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:18.610637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ab76e-9c60-4185-89a2-6c65cf01c804 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:18.610914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ab76e-9c60-4185-89a2-6c65cf01c804 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:18.611185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ab76e-9c60-4185-89a2-6c65cf01c804 None admin] PATH_INFO: `/v3/projects/4181ba3f88e74d5cb4d3d23e43879b3f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:18.612360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ab76e-9c60-4185-89a2-6c65cf01c804 None admin] RBAC: Authorizing `identity:get_project(project_id=4181ba3f88e74d5cb4d3d23e43879b3f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:18.613801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ab76e-9c60-4185-89a2-6c65cf01c804 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:18.615502 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 555/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:05:18 2022] GET /identity/v3/projects/4181ba3f88e74d5cb4d3d23e43879b3f => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:18.622694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9e48f-0988-4671-ba08-9049978bf9ae None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:18.697857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:18.743793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9e48f-0988-4671-ba08-9049978bf9ae None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:18.779722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d7f86-2dc7-4cde-bd25-e616a8a56a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:18.780384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d7f86-2dc7-4cde-bd25-e616a8a56a9e None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:18.780662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d7f86-2dc7-4cde-bd25-e616a8a56a9e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:18.780953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d7f86-2dc7-4cde-bd25-e616a8a56a9e None admin] PATH_INFO: `/v3/projects/4181ba3f88e74d5cb4d3d23e43879b3f/users/9c5264783d874f2daff8f5d2850a145f/roles/81040db4535e417891c10dd996b1eac5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:18.784558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d7f86-2dc7-4cde-bd25-e616a8a56a9e None admin] RBAC: Authorizing `identity:create_grant(project_id=4181ba3f88e74d5cb4d3d23e43879b3f, user_id=9c5264783d874f2daff8f5d2850a145f, role_id=81040db4535e417891c10dd996b1eac5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:18.786746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d7f86-2dc7-4cde-bd25-e616a8a56a9e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:18.808157 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 568/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:05:18 2022] PUT /identity/v3/projects/4181ba3f88e74d5cb4d3d23e43879b3f/users/9c5264783d874f2daff8f5d2850a145f/roles/81040db4535e417891c10dd996b1eac5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:05:20.709432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceff5f3-848d-46a0-8e91-ac61de273e76 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:20.709979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceff5f3-848d-46a0-8e91-ac61de273e76 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:20.709979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceff5f3-848d-46a0-8e91-ac61de273e76 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:20.711369 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 556/1124] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:20.716679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f218d-01ac-40d3-8bf0-446939ab3fbf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:20.717268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f218d-01ac-40d3-8bf0-446939ab3fbf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:20.717268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f218d-01ac-40d3-8bf0-446939ab3fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:20.735768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-092f218d-01ac-40d3-8bf0-446939ab3fbf None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:20.736951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-092f218d-01ac-40d3-8bf0-446939ab3fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:20.810670 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 569/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:21.081044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceff5f3-848d-46a0-8e91-ac61de273e76 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:21.205478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceff5f3-848d-46a0-8e91-ac61de273e76 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:21.228878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:21.245935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b42e0-64dc-4196-8efb-22ea4b5a02c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:21.246572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b42e0-64dc-4196-8efb-22ea4b5a02c5 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:21.246847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b42e0-64dc-4196-8efb-22ea4b5a02c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:21.247120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b42e0-64dc-4196-8efb-22ea4b5a02c5 None admin] PATH_INFO: `/v3/roles/81040db4535e417891c10dd996b1eac5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:21.249197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b42e0-64dc-4196-8efb-22ea4b5a02c5 None admin] RBAC: Authorizing `identity:get_role(role_id=81040db4535e417891c10dd996b1eac5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:21.250658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b42e0-64dc-4196-8efb-22ea4b5a02c5 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:21.252083 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 557/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:05:21 2022] GET /identity/v3/roles/81040db4535e417891c10dd996b1eac5 => generated 223 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:21.259023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f218d-01ac-40d3-8bf0-446939ab3fbf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:21.322946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:21.370526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f218d-01ac-40d3-8bf0-446939ab3fbf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:21.421943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26975c9c-7235-4950-9205-25038ad2025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:21.422662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26975c9c-7235-4950-9205-25038ad2025e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:21.423045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26975c9c-7235-4950-9205-25038ad2025e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:21.423361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26975c9c-7235-4950-9205-25038ad2025e None admin] PATH_INFO: `/v3/users/9c5264783d874f2daff8f5d2850a145f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:21.424643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26975c9c-7235-4950-9205-25038ad2025e None admin] RBAC: Authorizing `identity:get_user(user_id=9c5264783d874f2daff8f5d2850a145f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:21.426125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26975c9c-7235-4950-9205-25038ad2025e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:21.427759 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 570/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:05:21 2022] GET /identity/v3/users/9c5264783d874f2daff8f5d2850a145f => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:05:21.436900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b42e0-64dc-4196-8efb-22ea4b5a02c5 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:21.563280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b42e0-64dc-4196-8efb-22ea4b5a02c5 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:21.619416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25230070-83c3-42d7-ae1b-0b5ae305efb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:21.620418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25230070-83c3-42d7-ae1b-0b5ae305efb6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:21.620964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25230070-83c3-42d7-ae1b-0b5ae305efb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:21.621350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25230070-83c3-42d7-ae1b-0b5ae305efb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:21.692484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:21.706669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25230070-83c3-42d7-ae1b-0b5ae305efb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:21.709007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25230070-83c3-42d7-ae1b-0b5ae305efb6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:21.830550 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 558/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:05:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:05:21.836864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26975c9c-7235-4950-9205-25038ad2025e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:21.942673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26975c9c-7235-4950-9205-25038ad2025e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:21.974843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:21.988152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe037558-0931-47b7-89f3-3b3e2df8bb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:21.988803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe037558-0931-47b7-89f3-3b3e2df8bb74 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:21.989081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe037558-0931-47b7-89f3-3b3e2df8bb74 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:21.989356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe037558-0931-47b7-89f3-3b3e2df8bb74 None admin] PATH_INFO: `/v3/projects/4181ba3f88e74d5cb4d3d23e43879b3f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:21.990520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe037558-0931-47b7-89f3-3b3e2df8bb74 None admin] RBAC: Authorizing `identity:get_project(project_id=4181ba3f88e74d5cb4d3d23e43879b3f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:21.992003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe037558-0931-47b7-89f3-3b3e2df8bb74 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:21.993700 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 571/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:05:21 2022] GET /identity/v3/projects/4181ba3f88e74d5cb4d3d23e43879b3f => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:22.000166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25230070-83c3-42d7-ae1b-0b5ae305efb6 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:22.112465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:22.124536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25230070-83c3-42d7-ae1b-0b5ae305efb6 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:22.160771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05458b29-a152-4f49-94f8-2155cb61f116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:22.161372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05458b29-a152-4f49-94f8-2155cb61f116 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:22.161676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05458b29-a152-4f49-94f8-2155cb61f116 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:22.161947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05458b29-a152-4f49-94f8-2155cb61f116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:22.162678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05458b29-a152-4f49-94f8-2155cb61f116 None admin] RBAC: Adding query filter params (role.id=81040db4535e417891c10dd996b1eac5, scope.project.id=4181ba3f88e74d5cb4d3d23e43879b3f, user.id=9c5264783d874f2daff8f5d2850a145f) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:22.162986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05458b29-a152-4f49-94f8-2155cb61f116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:22.164565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05458b29-a152-4f49-94f8-2155cb61f116 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:22.171514 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 559/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:05:21 2022] GET /identity/v3/role_assignments?user.id=9c5264783d874f2daff8f5d2850a145f&scope.project.id=4181ba3f88e74d5cb4d3d23e43879b3f&role.id=81040db4535e417891c10dd996b1eac5 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:24.111089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b78a2c-1a18-40fa-aed4-1c08eca3beec None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:24.111712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b78a2c-1a18-40fa-aed4-1c08eca3beec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:24.111712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b78a2c-1a18-40fa-aed4-1c08eca3beec None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:24.112991 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 572/1131] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:24.118406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a56d5-9d4f-4cf0-9b66-858caac395c5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:24.118832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a56d5-9d4f-4cf0-9b66-858caac395c5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:24.118921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a56d5-9d4f-4cf0-9b66-858caac395c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:24.138126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cf7a56d5-9d4f-4cf0-9b66-858caac395c5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:24.139358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cf7a56d5-9d4f-4cf0-9b66-858caac395c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:24.212979 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 560/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:24.473418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b78a2c-1a18-40fa-aed4-1c08eca3beec None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:24.579143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b78a2c-1a18-40fa-aed4-1c08eca3beec None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:24.615900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb432d1-d84f-4155-b73b-cf1d223770d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:24.616537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb432d1-d84f-4155-b73b-cf1d223770d9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:24.616813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb432d1-d84f-4155-b73b-cf1d223770d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:24.617083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb432d1-d84f-4155-b73b-cf1d223770d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:24.618217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb432d1-d84f-4155-b73b-cf1d223770d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:24.619674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb432d1-d84f-4155-b73b-cf1d223770d9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:24.621240 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 573/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:05:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:24.627368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a56d5-9d4f-4cf0-9b66-858caac395c5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:24.726471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:24.743208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a56d5-9d4f-4cf0-9b66-858caac395c5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:24.784054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e55e59-50b0-4e77-b0ea-c56f3e14bd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:24.784662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e55e59-50b0-4e77-b0ea-c56f3e14bd3f None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:24.784935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e55e59-50b0-4e77-b0ea-c56f3e14bd3f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:24.785205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e55e59-50b0-4e77-b0ea-c56f3e14bd3f None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:24.785875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e55e59-50b0-4e77-b0ea-c56f3e14bd3f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:24.787327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e55e59-50b0-4e77-b0ea-c56f3e14bd3f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:24.824226 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 561/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 18:05:24 2022] POST /identity/v3/projects => generated 311 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:05:26.760138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84000033-8dac-4c5e-9e58-75a1e85ae561 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:26.760706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84000033-8dac-4c5e-9e58-75a1e85ae561 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:26.760706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84000033-8dac-4c5e-9e58-75a1e85ae561 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:26.762035 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 574/1135] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:26.767990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ff3ca-6c55-47fc-834b-271e88304b78 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:26.768455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ff3ca-6c55-47fc-834b-271e88304b78 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:26.768596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ff3ca-6c55-47fc-834b-271e88304b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:26.787534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e18ff3ca-6c55-47fc-834b-271e88304b78 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:26.788726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e18ff3ca-6c55-47fc-834b-271e88304b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:26.863932 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 562/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:27.127764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84000033-8dac-4c5e-9e58-75a1e85ae561 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:27.189096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:27.232712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84000033-8dac-4c5e-9e58-75a1e85ae561 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:27.267991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d864da0-5133-47ff-b6a0-ba4c571b6d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:27.268618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d864da0-5133-47ff-b6a0-ba4c571b6d09 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:27.268890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d864da0-5133-47ff-b6a0-ba4c571b6d09 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:27.269157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d864da0-5133-47ff-b6a0-ba4c571b6d09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:27.270260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d864da0-5133-47ff-b6a0-ba4c571b6d09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:27.271721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d864da0-5133-47ff-b6a0-ba4c571b6d09 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:27.273323 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 575/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:05:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:27.279765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ff3ca-6c55-47fc-834b-271e88304b78 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:27.349821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:27.388861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ff3ca-6c55-47fc-834b-271e88304b78 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:27.426270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b5941-9a92-4ab9-b86c-3434507f2aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:27.426942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5941-9a92-4ab9-b86c-3434507f2aab None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:27.427300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5941-9a92-4ab9-b86c-3434507f2aab None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:27.427640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5941-9a92-4ab9-b86c-3434507f2aab None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:27.428343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b5941-9a92-4ab9-b86c-3434507f2aab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:27.429885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b5941-9a92-4ab9-b86c-3434507f2aab None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:27.452434 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 563/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:05:27 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:05:29.443773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae440c00-2b0f-4ec8-87bf-9b4a0edb1f3d None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:29.444391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae440c00-2b0f-4ec8-87bf-9b4a0edb1f3d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:29.444391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae440c00-2b0f-4ec8-87bf-9b4a0edb1f3d None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:29.445713 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 576/1139] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:29.451996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d7dfa-af94-4f60-916f-56a29b4b3af3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:29.454832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d7dfa-af94-4f60-916f-56a29b4b3af3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:29.454832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d7dfa-af94-4f60-916f-56a29b4b3af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:29.472908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-954d7dfa-af94-4f60-916f-56a29b4b3af3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:29.474143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-954d7dfa-af94-4f60-916f-56a29b4b3af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:29.559070 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 564/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:29.827144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae440c00-2b0f-4ec8-87bf-9b4a0edb1f3d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:29.944733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae440c00-2b0f-4ec8-87bf-9b4a0edb1f3d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:29.973069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:29.988325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd16de9-44a7-4ade-b66f-4cbb218a5c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:29.989363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd16de9-44a7-4ade-b66f-4cbb218a5c91 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:29.989837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd16de9-44a7-4ade-b66f-4cbb218a5c91 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:29.990324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd16de9-44a7-4ade-b66f-4cbb218a5c91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:30.009746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd16de9-44a7-4ade-b66f-4cbb218a5c91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:05:30.019175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-9dd16de9-44a7-4ade-b66f-4cbb218a5c91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:30.019175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:30.019175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:30.019175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:30.019175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:30.019175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:30.019175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:30.019175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:30.019175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:30.019175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:30.019175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:30.019175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:30.019175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:05:30.019175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:05:30.019175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:05:30.019175 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:05:30.020439 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:05:30.020439 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:05:30.020439 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:05:30.020439 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:05:30.020439 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:30.020439 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:30.020439 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:30.020439 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:30.020439 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:30.020439 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:30.020439 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:30.020439 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:30.020439 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:30.020439 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:30.020439 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:30.020439 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:30.021398 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:30.021398 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:30.021398 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:30.021398 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:30.021398 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:05:30.021398 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:05:30.021398 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:05:30.021398 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:05:30.021398 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:05:30.021398 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:05:30.021398 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:30.021398 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:05:30.021398 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 577/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:05:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:05:30.028443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d7dfa-af94-4f60-916f-56a29b4b3af3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:30.089863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:30.140311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d7dfa-af94-4f60-916f-56a29b4b3af3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:30.180550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafc4ab-4ed4-4296-8da5-5fb16fded64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:30.181170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc4ab-4ed4-4296-8da5-5fb16fded64c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:30.181447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc4ab-4ed4-4296-8da5-5fb16fded64c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:30.181716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc4ab-4ed4-4296-8da5-5fb16fded64c None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:30.182397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafc4ab-4ed4-4296-8da5-5fb16fded64c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:30.182698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafc4ab-4ed4-4296-8da5-5fb16fded64c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:30.184135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafc4ab-4ed4-4296-8da5-5fb16fded64c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:30.194274 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 565/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:05:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:30.200757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd16de9-44a7-4ade-b66f-4cbb218a5c91 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:30.317301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd16de9-44a7-4ade-b66f-4cbb218a5c91 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:30.357015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e30498-1ed9-4d44-8d6b-e99d7b1a8779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:30.357576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e30498-1ed9-4d44-8d6b-e99d7b1a8779 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:30.357829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e30498-1ed9-4d44-8d6b-e99d7b1a8779 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:30.358105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e30498-1ed9-4d44-8d6b-e99d7b1a8779 None admin] PATH_INFO: `/v3/users/c8dc3927bc0b4a77bf3a78d5f185c0d2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:30.374398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e30498-1ed9-4d44-8d6b-e99d7b1a8779 None admin] RBAC: Authorizing `identity:get_user(user_id=c8dc3927bc0b4a77bf3a78d5f185c0d2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:30.375947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e30498-1ed9-4d44-8d6b-e99d7b1a8779 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:30.377718 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 578/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:05:30 2022] GET /identity/v3/users/c8dc3927bc0b4a77bf3a78d5f185c0d2 => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:30.384758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafc4ab-4ed4-4296-8da5-5fb16fded64c None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:30.490935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafc4ab-4ed4-4296-8da5-5fb16fded64c None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:30.505042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:30.528590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ccb69-7c39-4fd0-882b-cc8183b30f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:30.529207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ccb69-7c39-4fd0-882b-cc8183b30f1f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:30.529484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ccb69-7c39-4fd0-882b-cc8183b30f1f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:30.529756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ccb69-7c39-4fd0-882b-cc8183b30f1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:30.612549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ccb69-7c39-4fd0-882b-cc8183b30f1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:30.613918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ccb69-7c39-4fd0-882b-cc8183b30f1f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:30.725067 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 566/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:05:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:05:30.731231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e30498-1ed9-4d44-8d6b-e99d7b1a8779 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:30.780285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:30.840178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e30498-1ed9-4d44-8d6b-e99d7b1a8779 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:30.875823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda4e90-1f2f-4964-b512-48509ee22b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:30.876307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4e90-1f2f-4964-b512-48509ee22b45 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:30.876580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4e90-1f2f-4964-b512-48509ee22b45 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:30.876848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4e90-1f2f-4964-b512-48509ee22b45 None admin] PATH_INFO: `/v3/projects/f3899b971bc74d028bf499b5c0914c80` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:30.877986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda4e90-1f2f-4964-b512-48509ee22b45 None admin] RBAC: Authorizing `identity:get_project(project_id=f3899b971bc74d028bf499b5c0914c80)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:30.879449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda4e90-1f2f-4964-b512-48509ee22b45 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:30.881121 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 579/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:05:30 2022] GET /identity/v3/projects/f3899b971bc74d028bf499b5c0914c80 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:30.887987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ccb69-7c39-4fd0-882b-cc8183b30f1f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:30.905237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:30.991442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ccb69-7c39-4fd0-882b-cc8183b30f1f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:31.027476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a700561-0ece-4555-9882-c7228fe6d875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:31.028078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a700561-0ece-4555-9882-c7228fe6d875 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:31.028353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a700561-0ece-4555-9882-c7228fe6d875 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:31.028622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a700561-0ece-4555-9882-c7228fe6d875 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:31.029357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a700561-0ece-4555-9882-c7228fe6d875 None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=f3899b971bc74d028bf499b5c0914c80, user.id=c8dc3927bc0b4a77bf3a78d5f185c0d2) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:31.029661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a700561-0ece-4555-9882-c7228fe6d875 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:31.031085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a700561-0ece-4555-9882-c7228fe6d875 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:31.036796 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 567/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:05:30 2022] GET /identity/v3/role_assignments?user.id=c8dc3927bc0b4a77bf3a78d5f185c0d2&scope.project.id=f3899b971bc74d028bf499b5c0914c80&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:32.914936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bccc2-ac63-48d1-8513-127e717879bd None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:32.915743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bccc2-ac63-48d1-8513-127e717879bd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:32.915743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bccc2-ac63-48d1-8513-127e717879bd None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:32.917252 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 580/1147] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:32.922864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e91bb8-626e-491a-a7b7-f2bba9d44811 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:32.926392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e91bb8-626e-491a-a7b7-f2bba9d44811 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:32.926392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e91bb8-626e-491a-a7b7-f2bba9d44811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:32.942063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-48e91bb8-626e-491a-a7b7-f2bba9d44811 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:32.943234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-48e91bb8-626e-491a-a7b7-f2bba9d44811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:33.021302 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 568/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:33.295084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bccc2-ac63-48d1-8513-127e717879bd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:33.400697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bccc2-ac63-48d1-8513-127e717879bd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:33.414541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:33.448348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f83284-8d58-4f36-b74a-f2f787fdadc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:33.449375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f83284-8d58-4f36-b74a-f2f787fdadc1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:33.449852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f83284-8d58-4f36-b74a-f2f787fdadc1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:33.450327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f83284-8d58-4f36-b74a-f2f787fdadc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:33.467341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f83284-8d58-4f36-b74a-f2f787fdadc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:05:33.476687 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-92f83284-8d58-4f36-b74a-f2f787fdadc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:33.476687 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:33.476687 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:33.476687 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:33.476687 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:33.476687 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:33.476687 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:33.476687 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:33.476687 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:33.476687 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:33.476687 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:33.476687 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:33.476687 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:05:33.476687 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:05:33.476687 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:05:33.476687 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:05:33.477799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:05:33.477799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:05:33.477799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:05:33.477799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:05:33.477799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:33.477799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:33.477799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:33.477799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:33.477799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:33.477799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:33.477799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:33.477799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:33.477799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:33.477799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:33.477799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:33.477799 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:33.479778 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:33.479778 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:33.479778 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:33.479778 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:33.479778 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:05:33.479778 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:05:33.479778 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:05:33.479778 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:05:33.479778 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:05:33.479778 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:05:33.479778 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:33.479778 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:05:33.479778 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 581/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:05:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:05:33.484935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e91bb8-626e-491a-a7b7-f2bba9d44811 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:33.495848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:33.590629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e91bb8-626e-491a-a7b7-f2bba9d44811 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:33.625111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c8050-6217-407b-ab6f-31bf1aff787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:33.625714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c8050-6217-407b-ab6f-31bf1aff787d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:33.625989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c8050-6217-407b-ab6f-31bf1aff787d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:33.626260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c8050-6217-407b-ab6f-31bf1aff787d None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:33.626928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c8050-6217-407b-ab6f-31bf1aff787d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:33.627226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c8050-6217-407b-ab6f-31bf1aff787d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:33.628625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c8050-6217-407b-ab6f-31bf1aff787d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:33.636964 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 569/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:05:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:33.643116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f83284-8d58-4f36-b74a-f2f787fdadc1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:33.747372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f83284-8d58-4f36-b74a-f2f787fdadc1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:33.783413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db37271-41ce-446c-a338-e124064726d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:33.784079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db37271-41ce-446c-a338-e124064726d2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:33.784360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db37271-41ce-446c-a338-e124064726d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:33.784634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db37271-41ce-446c-a338-e124064726d2 None admin] PATH_INFO: `/v3/users/c8dc3927bc0b4a77bf3a78d5f185c0d2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:33.785817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db37271-41ce-446c-a338-e124064726d2 None admin] RBAC: Authorizing `identity:get_user(user_id=c8dc3927bc0b4a77bf3a78d5f185c0d2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:33.787291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db37271-41ce-446c-a338-e124064726d2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:33.788914 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 582/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:05:33 2022] GET /identity/v3/users/c8dc3927bc0b4a77bf3a78d5f185c0d2 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:33.795057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c8050-6217-407b-ab6f-31bf1aff787d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:33.872089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:33.905026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c8050-6217-407b-ab6f-31bf1aff787d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:33.939446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbda1c-da7e-497c-80a4-6616cf41f8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:33.940104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbda1c-da7e-497c-80a4-6616cf41f8dc None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:33.940324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbda1c-da7e-497c-80a4-6616cf41f8dc None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:33.940595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbda1c-da7e-497c-80a4-6616cf41f8dc None admin] PATH_INFO: `/v3/projects/f3899b971bc74d028bf499b5c0914c80` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:33.941708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbda1c-da7e-497c-80a4-6616cf41f8dc None admin] RBAC: Authorizing `identity:get_project(project_id=f3899b971bc74d028bf499b5c0914c80)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:33.943132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbda1c-da7e-497c-80a4-6616cf41f8dc None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:33.944800 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 570/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:05:33 2022] GET /identity/v3/projects/f3899b971bc74d028bf499b5c0914c80 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:33.951276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db37271-41ce-446c-a338-e124064726d2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:33.995968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:34.057131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db37271-41ce-446c-a338-e124064726d2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:34.092287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba7365-5856-40e6-b046-36614f239ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:34.092949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7365-5856-40e6-b046-36614f239ff8 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:34.093225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7365-5856-40e6-b046-36614f239ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:34.093499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7365-5856-40e6-b046-36614f239ff8 None admin] PATH_INFO: `/v3/projects/f3899b971bc74d028bf499b5c0914c80/users/c8dc3927bc0b4a77bf3a78d5f185c0d2/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:34.095709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba7365-5856-40e6-b046-36614f239ff8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3899b971bc74d028bf499b5c0914c80, user_id=c8dc3927bc0b4a77bf3a78d5f185c0d2, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:34.097159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba7365-5856-40e6-b046-36614f239ff8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:34.112261 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 583/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:05:33 2022] PUT /identity/v3/projects/f3899b971bc74d028bf499b5c0914c80/users/c8dc3927bc0b4a77bf3a78d5f185c0d2/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:05:36.026631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd90e49-c669-4c01-a9cb-bd7a60c0d3c5 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:36.027193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd90e49-c669-4c01-a9cb-bd7a60c0d3c5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:36.027193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd90e49-c669-4c01-a9cb-bd7a60c0d3c5 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:36.028729 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 571/1154] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:36.035208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf3fd6-4496-4335-9035-42e9bc0a85a7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:36.035732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf3fd6-4496-4335-9035-42e9bc0a85a7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:36.036156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf3fd6-4496-4335-9035-42e9bc0a85a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:36.061697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4edf3fd6-4496-4335-9035-42e9bc0a85a7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:36.062897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4edf3fd6-4496-4335-9035-42e9bc0a85a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:36.137158 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 584/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:36.404538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd90e49-c669-4c01-a9cb-bd7a60c0d3c5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:36.516171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd90e49-c669-4c01-a9cb-bd7a60c0d3c5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:36.549241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4706bf-c86f-43fd-9b57-0671d921ca7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:36.549864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4706bf-c86f-43fd-9b57-0671d921ca7d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:36.550145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4706bf-c86f-43fd-9b57-0671d921ca7d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:36.550420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4706bf-c86f-43fd-9b57-0671d921ca7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:36.557522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:36.563461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4706bf-c86f-43fd-9b57-0671d921ca7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:05:36.568618 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-0a4706bf-c86f-43fd-9b57-0671d921ca7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:36.568618 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:36.568618 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:36.568618 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:36.568618 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:36.568618 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:36.568618 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:36.568618 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:36.568618 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:36.568618 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:36.568618 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:36.568618 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:36.568618 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:05:36.568618 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:05:36.568618 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:05:36.568618 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:05:36.569696 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:05:36.569696 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:05:36.569696 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:05:36.569696 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:05:36.569696 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:36.569696 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:36.569696 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:36.569696 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:36.569696 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:36.569696 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:36.569696 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:36.569696 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:36.569696 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:36.569696 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:36.569696 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:36.569696 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:36.570855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:36.570855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:36.570855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:36.570855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:36.570855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:05:36.570855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:05:36.570855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:05:36.570855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:05:36.570855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:05:36.570855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:05:36.570855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:36.570855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:05:36.570855 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 572/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:05:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:05:36.576207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf3fd6-4496-4335-9035-42e9bc0a85a7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:36.607452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:36.681543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf3fd6-4496-4335-9035-42e9bc0a85a7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:36.717658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27497c-b7e6-41c4-bd16-65d6e95c7042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:36.718265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27497c-b7e6-41c4-bd16-65d6e95c7042 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:36.718543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27497c-b7e6-41c4-bd16-65d6e95c7042 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:36.718813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27497c-b7e6-41c4-bd16-65d6e95c7042 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:36.719512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27497c-b7e6-41c4-bd16-65d6e95c7042 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:36.719816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27497c-b7e6-41c4-bd16-65d6e95c7042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:36.721186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27497c-b7e6-41c4-bd16-65d6e95c7042 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:36.730806 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 585/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:05:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:05:36.737087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4706bf-c86f-43fd-9b57-0671d921ca7d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:36.840902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4706bf-c86f-43fd-9b57-0671d921ca7d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:36.878801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f5bac-0098-460e-b67d-69ceeeb194a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:36.879531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f5bac-0098-460e-b67d-69ceeeb194a3 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:36.879809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f5bac-0098-460e-b67d-69ceeeb194a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:36.880079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f5bac-0098-460e-b67d-69ceeeb194a3 None admin] PATH_INFO: `/v3/users/c8dc3927bc0b4a77bf3a78d5f185c0d2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:36.881236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f5bac-0098-460e-b67d-69ceeeb194a3 None admin] RBAC: Authorizing `identity:get_user(user_id=c8dc3927bc0b4a77bf3a78d5f185c0d2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:36.883071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f5bac-0098-460e-b67d-69ceeeb194a3 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:36.884683 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 573/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:05:36 2022] GET /identity/v3/users/c8dc3927bc0b4a77bf3a78d5f185c0d2 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:36.890908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27497c-b7e6-41c4-bd16-65d6e95c7042 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:36.984359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:36.994919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27497c-b7e6-41c4-bd16-65d6e95c7042 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:37.033519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b97ce-554d-4e19-9acf-308d1c646cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:37.034148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b97ce-554d-4e19-9acf-308d1c646cfb None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:37.034428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b97ce-554d-4e19-9acf-308d1c646cfb None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:37.034704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b97ce-554d-4e19-9acf-308d1c646cfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:37.108150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b97ce-554d-4e19-9acf-308d1c646cfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:37.109613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b97ce-554d-4e19-9acf-308d1c646cfb None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:37.202329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:37.212692 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 586/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:05:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:05:37.218844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f5bac-0098-460e-b67d-69ceeeb194a3 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:37.285889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:37.328386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f5bac-0098-460e-b67d-69ceeeb194a3 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:37.363693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85639664-40e5-4d56-a8c2-206cfbd970e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:37.364300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85639664-40e5-4d56-a8c2-206cfbd970e2 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:37.364575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85639664-40e5-4d56-a8c2-206cfbd970e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:37.364855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85639664-40e5-4d56-a8c2-206cfbd970e2 None admin] PATH_INFO: `/v3/projects/f3899b971bc74d028bf499b5c0914c80` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:37.366038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85639664-40e5-4d56-a8c2-206cfbd970e2 None admin] RBAC: Authorizing `identity:get_project(project_id=f3899b971bc74d028bf499b5c0914c80)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:37.367534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85639664-40e5-4d56-a8c2-206cfbd970e2 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:37.369205 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 574/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:05:37 2022] GET /identity/v3/projects/f3899b971bc74d028bf499b5c0914c80 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:37.375649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b97ce-554d-4e19-9acf-308d1c646cfb None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:37.479746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b97ce-554d-4e19-9acf-308d1c646cfb None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:37.516770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60132b4-039b-4692-9712-1a6790398a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:37.517506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60132b4-039b-4692-9712-1a6790398a3c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:37.517883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60132b4-039b-4692-9712-1a6790398a3c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:37.518142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60132b4-039b-4692-9712-1a6790398a3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:37.520052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60132b4-039b-4692-9712-1a6790398a3c None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=f3899b971bc74d028bf499b5c0914c80, user.id=c8dc3927bc0b4a77bf3a78d5f185c0d2) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:37.520052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60132b4-039b-4692-9712-1a6790398a3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:37.522717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60132b4-039b-4692-9712-1a6790398a3c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:37.527391 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 587/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:05:37 2022] GET /identity/v3/role_assignments?user.id=c8dc3927bc0b4a77bf3a78d5f185c0d2&scope.project.id=f3899b971bc74d028bf499b5c0914c80&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:39.449492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919f68e-a880-4957-a78e-3d41261229c9 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:39.450084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919f68e-a880-4957-a78e-3d41261229c9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:39.450084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919f68e-a880-4957-a78e-3d41261229c9 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:39.451360 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 575/1162] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:39.456989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0877c-7ae7-4b2e-a8c6-97364aa5e617 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:39.457489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0877c-7ae7-4b2e-a8c6-97364aa5e617 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:39.457588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0877c-7ae7-4b2e-a8c6-97364aa5e617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:39.476610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-00d0877c-7ae7-4b2e-a8c6-97364aa5e617 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:39.477821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00d0877c-7ae7-4b2e-a8c6-97364aa5e617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:39.530303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:39.548837 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 588/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:39.814603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919f68e-a880-4957-a78e-3d41261229c9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:39.927546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919f68e-a880-4957-a78e-3d41261229c9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:39.963213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dac71-31a2-47ad-8609-4b8e759200cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:39.963857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dac71-31a2-47ad-8609-4b8e759200cb None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:39.964136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dac71-31a2-47ad-8609-4b8e759200cb None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:39.964407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dac71-31a2-47ad-8609-4b8e759200cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:39.967101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:40.042128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603dac71-31a2-47ad-8609-4b8e759200cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:40.043649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603dac71-31a2-47ad-8609-4b8e759200cb None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:40.146970 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 576/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:05:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:05:40.155366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0877c-7ae7-4b2e-a8c6-97364aa5e617 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:40.266068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0877c-7ae7-4b2e-a8c6-97364aa5e617 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:40.302054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdb97b-0cd0-432d-841c-8313931c79b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:40.302686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb97b-0cd0-432d-841c-8313931c79b0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:40.302963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb97b-0cd0-432d-841c-8313931c79b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:40.303235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb97b-0cd0-432d-841c-8313931c79b0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:40.310265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdb97b-0cd0-432d-841c-8313931c79b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:40.311755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdb97b-0cd0-432d-841c-8313931c79b0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:40.327246 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-26cdb97b-0cd0-432d-841c-8313931c79b0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 28 18:05:40.327246 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:40.327246 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:05:40.327246 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:05:40.327246 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:05:40.327246 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:05:40.327246 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:05:40.327246 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:05:40.327246 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 28 18:05:40.327246 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:05:40.327246 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:05:40.327246 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:05:40.327246 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:40.327246 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:40.327246 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:40.327246 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:40.327246 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:40.328394 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:40.328394 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:40.328394 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:40.328394 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:40.328394 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:40.328394 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:40.328394 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:05:40.328394 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:05:40.328394 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:05:40.328394 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:05:40.328394 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:40.328394 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:40.328394 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:40.328394 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:40.328394 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:40.328394 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:40.329303 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:40.329303 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:40.329303 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:40.329303 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:40.329303 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:40.329303 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:40.329303 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:40.329303 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:40.329303 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:40.329303 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:40.329303 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:05:40.329303 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:05:40.329303 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 28 18:05:40.329303 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:05:40.329303 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 589/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 18:05:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:05:40.336924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dac71-31a2-47ad-8609-4b8e759200cb None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:40.378911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:40.448544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dac71-31a2-47ad-8609-4b8e759200cb None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:40.484526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58012a59-98b3-4cba-9a6d-a1346fc21421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:40.485217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58012a59-98b3-4cba-9a6d-a1346fc21421 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:40.485363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58012a59-98b3-4cba-9a6d-a1346fc21421 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:40.485665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58012a59-98b3-4cba-9a6d-a1346fc21421 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:40.486312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58012a59-98b3-4cba-9a6d-a1346fc21421 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:40.486615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58012a59-98b3-4cba-9a6d-a1346fc21421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:40.488010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58012a59-98b3-4cba-9a6d-a1346fc21421 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:40.495420 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 577/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 28 18:05:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:05:42.369281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85aff9-c9e7-4f9f-ba6e-739c0c6b85e9 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:42.369939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85aff9-c9e7-4f9f-ba6e-739c0c6b85e9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:42.369939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85aff9-c9e7-4f9f-ba6e-739c0c6b85e9 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:42.371319 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 590/1167] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:42.377195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2195d-cd01-4f4a-81be-f6039ad98e21 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:42.377640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2195d-cd01-4f4a-81be-f6039ad98e21 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:42.377745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2195d-cd01-4f4a-81be-f6039ad98e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:42.404971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-10b2195d-cd01-4f4a-81be-f6039ad98e21 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:42.406383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-10b2195d-cd01-4f4a-81be-f6039ad98e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:42.475277 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 578/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:42.743574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85aff9-c9e7-4f9f-ba6e-739c0c6b85e9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:42.793097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:42.850970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85aff9-c9e7-4f9f-ba6e-739c0c6b85e9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:42.886249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27503ce1-ea20-4f1c-b955-d667feaee025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:42.886851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27503ce1-ea20-4f1c-b955-d667feaee025 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:42.887124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27503ce1-ea20-4f1c-b955-d667feaee025 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:42.887427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27503ce1-ea20-4f1c-b955-d667feaee025 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:42.888089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27503ce1-ea20-4f1c-b955-d667feaee025 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:42.889453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27503ce1-ea20-4f1c-b955-d667feaee025 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:42.906580 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 591/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Sun Aug 28 18:05:42 2022] POST /identity/v3/domains => generated 267 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:05:44.853961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fd313-6665-451d-a70b-3d684d287b7d None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:44.854533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fd313-6665-451d-a70b-3d684d287b7d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:44.854533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fd313-6665-451d-a70b-3d684d287b7d None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:44.856000 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 579/1170] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:44.861981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad981b23-f9f9-4ae1-a1fd-9b81e4784077 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:44.862437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad981b23-f9f9-4ae1-a1fd-9b81e4784077 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:44.862538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad981b23-f9f9-4ae1-a1fd-9b81e4784077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:44.881697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ad981b23-f9f9-4ae1-a1fd-9b81e4784077 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:44.883314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad981b23-f9f9-4ae1-a1fd-9b81e4784077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:44.953012 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 592/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:45.216779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fd313-6665-451d-a70b-3d684d287b7d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:45.246764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:45.324998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fd313-6665-451d-a70b-3d684d287b7d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:45.359613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35642b3-0bb6-473e-ae9b-332501b352b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:45.360224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35642b3-0bb6-473e-ae9b-332501b352b6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:45.360497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35642b3-0bb6-473e-ae9b-332501b352b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:45.360765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35642b3-0bb6-473e-ae9b-332501b352b6 None admin] PATH_INFO: `/v3/domains/8e74e55f7d84454bb13cf0adcbaede45` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:45.371399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35642b3-0bb6-473e-ae9b-332501b352b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8e74e55f7d84454bb13cf0adcbaede45)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:45.372844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35642b3-0bb6-473e-ae9b-332501b352b6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:45.374430 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 580/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Sun Aug 28 18:05:45 2022] GET /identity/v3/domains/8e74e55f7d84454bb13cf0adcbaede45 => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:45.380565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad981b23-f9f9-4ae1-a1fd-9b81e4784077 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:45.416233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:45.484724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad981b23-f9f9-4ae1-a1fd-9b81e4784077 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:45.525057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687722d-035d-4713-8e90-1f98e5527864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:45.525678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687722d-035d-4713-8e90-1f98e5527864 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:45.525957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687722d-035d-4713-8e90-1f98e5527864 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:45.526224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687722d-035d-4713-8e90-1f98e5527864 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:45.526873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687722d-035d-4713-8e90-1f98e5527864 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:45.528364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687722d-035d-4713-8e90-1f98e5527864 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:45.564855 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 593/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 18:05:45 2022] POST /identity/v3/projects => generated 361 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:05:47.523568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32745aea-f483-446b-9f44-a45c4ff570c0 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:47.524126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32745aea-f483-446b-9f44-a45c4ff570c0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:47.524126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32745aea-f483-446b-9f44-a45c4ff570c0 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:47.525435 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 581/1174] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:47.531024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a307d-09e2-46ae-a765-d19d87980c2f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:47.531493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a307d-09e2-46ae-a765-d19d87980c2f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:47.531613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a307d-09e2-46ae-a765-d19d87980c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:47.550431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3e6a307d-09e2-46ae-a765-d19d87980c2f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:47.551659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e6a307d-09e2-46ae-a765-d19d87980c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:47.624356 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 594/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:47.887835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32745aea-f483-446b-9f44-a45c4ff570c0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:47.982196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:47.996971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32745aea-f483-446b-9f44-a45c4ff570c0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:48.031458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f452efa-cb88-492b-91aa-d17322a958d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:48.032091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f452efa-cb88-492b-91aa-d17322a958d1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:48.032376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f452efa-cb88-492b-91aa-d17322a958d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:48.032653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f452efa-cb88-492b-91aa-d17322a958d1 None admin] PATH_INFO: `/v3/domains/8e74e55f7d84454bb13cf0adcbaede45` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:48.033810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f452efa-cb88-492b-91aa-d17322a958d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8e74e55f7d84454bb13cf0adcbaede45)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:48.035271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f452efa-cb88-492b-91aa-d17322a958d1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:48.036878 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 582/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Sun Aug 28 18:05:47 2022] GET /identity/v3/domains/8e74e55f7d84454bb13cf0adcbaede45 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:48.044163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a307d-09e2-46ae-a765-d19d87980c2f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:48.063737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:48.156523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a307d-09e2-46ae-a765-d19d87980c2f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:48.193694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842636e-68da-4cce-9ac6-684d3a82d5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:48.194325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842636e-68da-4cce-9ac6-684d3a82d5f7 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:48.194600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842636e-68da-4cce-9ac6-684d3a82d5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:48.194870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842636e-68da-4cce-9ac6-684d3a82d5f7 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:48.195549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842636e-68da-4cce-9ac6-684d3a82d5f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:48.196982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842636e-68da-4cce-9ac6-684d3a82d5f7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:48.219934 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 595/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:05:48 2022] POST /identity/v3/users => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:05:50.162400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd824d5f-fb96-4112-9296-9bcfaf8ff97b None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:50.163076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd824d5f-fb96-4112-9296-9bcfaf8ff97b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:50.163076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd824d5f-fb96-4112-9296-9bcfaf8ff97b None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:50.164348 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 583/1178] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:50.169962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dbc39-1424-4329-8584-ed16df08ffed None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:50.170393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dbc39-1424-4329-8584-ed16df08ffed None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:50.170646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dbc39-1424-4329-8584-ed16df08ffed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:50.190031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c33dbc39-1424-4329-8584-ed16df08ffed None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:50.191220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c33dbc39-1424-4329-8584-ed16df08ffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:50.267878 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 596/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:50.531380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd824d5f-fb96-4112-9296-9bcfaf8ff97b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:50.641377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd824d5f-fb96-4112-9296-9bcfaf8ff97b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:50.678929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75615ee7-cf29-43b6-86e0-04adb0315dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:50.679579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75615ee7-cf29-43b6-86e0-04adb0315dac None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:50.679855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75615ee7-cf29-43b6-86e0-04adb0315dac None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:50.680129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75615ee7-cf29-43b6-86e0-04adb0315dac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:50.691030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75615ee7-cf29-43b6-86e0-04adb0315dac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:05:50.695889 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-75615ee7-cf29-43b6-86e0-04adb0315dac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:50.695889 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:50.695889 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:50.695889 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:50.695889 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:50.695889 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:50.695889 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:50.695889 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:50.695889 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:50.695889 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:50.695889 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:50.695889 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:50.695889 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:05:50.695889 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:05:50.695889 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:05:50.695889 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:05:50.697029 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:05:50.697029 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:05:50.697029 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:05:50.697029 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:05:50.697029 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:50.697029 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:50.697029 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:50.697029 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:50.697029 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:50.697029 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:50.697029 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:50.697029 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:50.697029 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:50.697029 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:50.697029 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:50.697029 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:50.698242 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:50.698242 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:50.698242 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:50.698242 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:50.698242 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:05:50.698242 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:05:50.698242 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:05:50.698242 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:05:50.698242 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:05:50.698242 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:05:50.698242 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:50.698242 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:05:50.698242 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 584/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:05:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:05:50.703239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dbc39-1424-4329-8584-ed16df08ffed None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:50.706498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:50.816704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dbc39-1424-4329-8584-ed16df08ffed None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:50.851820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da1f26-e305-4906-85c3-c97f5b96b257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:50.852436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da1f26-e305-4906-85c3-c97f5b96b257 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:50.852718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da1f26-e305-4906-85c3-c97f5b96b257 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:50.852992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da1f26-e305-4906-85c3-c97f5b96b257 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:50.853663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da1f26-e305-4906-85c3-c97f5b96b257 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:50.853968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da1f26-e305-4906-85c3-c97f5b96b257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:50.855384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da1f26-e305-4906-85c3-c97f5b96b257 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:50.863985 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 597/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:05:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:50.870362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75615ee7-cf29-43b6-86e0-04adb0315dac None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:50.889955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:50.971384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75615ee7-cf29-43b6-86e0-04adb0315dac None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:51.006157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27744de8-fc72-4f10-a6ff-d3e85dd9136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:51.007170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27744de8-fc72-4f10-a6ff-d3e85dd9136d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:51.007484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27744de8-fc72-4f10-a6ff-d3e85dd9136d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:51.007763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27744de8-fc72-4f10-a6ff-d3e85dd9136d None admin] PATH_INFO: `/v3/users/ce56363e57bd452bb8589d6ba38db293` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:51.021522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27744de8-fc72-4f10-a6ff-d3e85dd9136d None admin] RBAC: Authorizing `identity:get_user(user_id=ce56363e57bd452bb8589d6ba38db293)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:51.023029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27744de8-fc72-4f10-a6ff-d3e85dd9136d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:51.024697 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 585/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:05:50 2022] GET /identity/v3/users/ce56363e57bd452bb8589d6ba38db293 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:51.030908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da1f26-e305-4906-85c3-c97f5b96b257 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:51.095188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:51.130794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da1f26-e305-4906-85c3-c97f5b96b257 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:51.165961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb7698-b244-4d4b-86bb-f7b39c065b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:51.166568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb7698-b244-4d4b-86bb-f7b39c065b31 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:51.166847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb7698-b244-4d4b-86bb-f7b39c065b31 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:51.167119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb7698-b244-4d4b-86bb-f7b39c065b31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:51.250730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb7698-b244-4d4b-86bb-f7b39c065b31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:51.252216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb7698-b244-4d4b-86bb-f7b39c065b31 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:51.321029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:51.360165 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 598/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:05:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:05:51.366390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27744de8-fc72-4f10-a6ff-d3e85dd9136d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:51.448979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:51.475151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27744de8-fc72-4f10-a6ff-d3e85dd9136d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:51.509534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87809856-fc16-46e5-b8bc-c85c2fe7ffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:51.510161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809856-fc16-46e5-b8bc-c85c2fe7ffe4 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:51.510438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809856-fc16-46e5-b8bc-c85c2fe7ffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:51.510711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809856-fc16-46e5-b8bc-c85c2fe7ffe4 None admin] PATH_INFO: `/v3/projects/d90e16d0b19e4544a63c48ce0293e32a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:51.511939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87809856-fc16-46e5-b8bc-c85c2fe7ffe4 None admin] RBAC: Authorizing `identity:get_project(project_id=d90e16d0b19e4544a63c48ce0293e32a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:51.513343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87809856-fc16-46e5-b8bc-c85c2fe7ffe4 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:51.515032 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 586/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:05:51 2022] GET /identity/v3/projects/d90e16d0b19e4544a63c48ce0293e32a => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:51.521765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb7698-b244-4d4b-86bb-f7b39c065b31 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:51.645874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb7698-b244-4d4b-86bb-f7b39c065b31 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:51.682096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448881ab-df1f-4e61-a102-52a972a02211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:51.682697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448881ab-df1f-4e61-a102-52a972a02211 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:51.682967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448881ab-df1f-4e61-a102-52a972a02211 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:51.683231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448881ab-df1f-4e61-a102-52a972a02211 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:51.683981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448881ab-df1f-4e61-a102-52a972a02211 None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=d90e16d0b19e4544a63c48ce0293e32a, user.id=ce56363e57bd452bb8589d6ba38db293) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:51.684281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448881ab-df1f-4e61-a102-52a972a02211 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:51.685733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448881ab-df1f-4e61-a102-52a972a02211 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:51.691273 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 599/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:05:51 2022] GET /identity/v3/role_assignments?user.id=ce56363e57bd452bb8589d6ba38db293&scope.project.id=d90e16d0b19e4544a63c48ce0293e32a&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:53.592506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc046c-12dd-4c84-bf8e-2d4d7ae74c5f None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:53.593148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc046c-12dd-4c84-bf8e-2d4d7ae74c5f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:53.593148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc046c-12dd-4c84-bf8e-2d4d7ae74c5f None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:53.594372 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 587/1186] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:53.599622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea09f-ce79-499c-abcc-11639db74f5f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:53.600134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea09f-ce79-499c-abcc-11639db74f5f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:53.600260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea09f-ce79-499c-abcc-11639db74f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:53.622329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-30eea09f-ce79-499c-abcc-11639db74f5f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:53.623634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-30eea09f-ce79-499c-abcc-11639db74f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:53.649346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:53.700596 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 600/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:53.968725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc046c-12dd-4c84-bf8e-2d4d7ae74c5f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:54.078712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc046c-12dd-4c84-bf8e-2d4d7ae74c5f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:54.113363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4904c74-d4b2-4f1b-86a6-7559e3edea3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:54.113981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4904c74-d4b2-4f1b-86a6-7559e3edea3c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:54.114259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4904c74-d4b2-4f1b-86a6-7559e3edea3c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:54.114526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4904c74-d4b2-4f1b-86a6-7559e3edea3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:54.125186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4904c74-d4b2-4f1b-86a6-7559e3edea3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:05:54.129958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-d4904c74-d4b2-4f1b-86a6-7559e3edea3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:54.129958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:54.129958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:54.129958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:54.129958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:54.129958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:54.129958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:54.129958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:54.129958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:54.129958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:54.129958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:54.129958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:54.129958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:05:54.129958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:05:54.129958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:05:54.129958 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:05:54.131105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:05:54.131105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:05:54.131105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:05:54.131105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:05:54.131105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:54.131105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:54.131105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:54.131105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:54.131105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:54.131105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:54.131105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:54.131105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:54.131105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:54.131105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:54.131105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:54.131105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:54.132446 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:54.132446 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:54.132446 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:54.132446 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:54.132446 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:05:54.132446 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:05:54.132446 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:05:54.132446 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:05:54.132446 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:05:54.132446 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:05:54.132446 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:54.132446 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:05:54.132446 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 588/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:05:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:05:54.137890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea09f-ce79-499c-abcc-11639db74f5f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:54.243955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea09f-ce79-499c-abcc-11639db74f5f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:54.278453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ed372-8554-4432-a928-2abadb4f5bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:54.279052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ed372-8554-4432-a928-2abadb4f5bcb None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:54.279352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ed372-8554-4432-a928-2abadb4f5bcb None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:54.279623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ed372-8554-4432-a928-2abadb4f5bcb None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:54.280274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ed372-8554-4432-a928-2abadb4f5bcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:54.280570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ed372-8554-4432-a928-2abadb4f5bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:54.281940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ed372-8554-4432-a928-2abadb4f5bcb None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:54.290034 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 601/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:05:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:54.296175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4904c74-d4b2-4f1b-86a6-7559e3edea3c None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:54.299790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:54.406976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4904c74-d4b2-4f1b-86a6-7559e3edea3c None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:54.442325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de0185-0f05-4a43-9d18-1d08b4e86055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:54.442940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de0185-0f05-4a43-9d18-1d08b4e86055 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:54.443216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de0185-0f05-4a43-9d18-1d08b4e86055 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:54.443518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de0185-0f05-4a43-9d18-1d08b4e86055 None admin] PATH_INFO: `/v3/users/ce56363e57bd452bb8589d6ba38db293` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:54.444772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de0185-0f05-4a43-9d18-1d08b4e86055 None admin] RBAC: Authorizing `identity:get_user(user_id=ce56363e57bd452bb8589d6ba38db293)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:54.446201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de0185-0f05-4a43-9d18-1d08b4e86055 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:54.447820 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 589/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:05:54 2022] GET /identity/v3/users/ce56363e57bd452bb8589d6ba38db293 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:54.453849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ed372-8554-4432-a928-2abadb4f5bcb None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:54.479732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:54.557364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ed372-8554-4432-a928-2abadb4f5bcb None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:54.594032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42152d-e2bc-4fde-bf14-79e3807cfe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:54.594658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42152d-e2bc-4fde-bf14-79e3807cfe67 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:54.594938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42152d-e2bc-4fde-bf14-79e3807cfe67 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:54.595216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42152d-e2bc-4fde-bf14-79e3807cfe67 None admin] PATH_INFO: `/v3/projects/d90e16d0b19e4544a63c48ce0293e32a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:54.596446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42152d-e2bc-4fde-bf14-79e3807cfe67 None admin] RBAC: Authorizing `identity:get_project(project_id=d90e16d0b19e4544a63c48ce0293e32a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:54.597893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42152d-e2bc-4fde-bf14-79e3807cfe67 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:54.599537 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 602/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:05:54 2022] GET /identity/v3/projects/d90e16d0b19e4544a63c48ce0293e32a => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:54.606033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de0185-0f05-4a43-9d18-1d08b4e86055 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:54.676609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:54.709426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de0185-0f05-4a43-9d18-1d08b4e86055 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:54.746138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac9954-44db-4d32-8f03-cc6219402359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:54.746794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac9954-44db-4d32-8f03-cc6219402359 None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:54.747072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac9954-44db-4d32-8f03-cc6219402359 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:54.747378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac9954-44db-4d32-8f03-cc6219402359 None admin] PATH_INFO: `/v3/projects/d90e16d0b19e4544a63c48ce0293e32a/users/ce56363e57bd452bb8589d6ba38db293/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:54.749311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac9954-44db-4d32-8f03-cc6219402359 None admin] RBAC: Authorizing `identity:create_grant(project_id=d90e16d0b19e4544a63c48ce0293e32a, user_id=ce56363e57bd452bb8589d6ba38db293, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:54.750753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac9954-44db-4d32-8f03-cc6219402359 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:54.765221 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 590/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:05:54 2022] PUT /identity/v3/projects/d90e16d0b19e4544a63c48ce0293e32a/users/ce56363e57bd452bb8589d6ba38db293/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:05:56.632080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72858087-e4b1-4cd4-8d2b-be520dc72916 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:56.632624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72858087-e4b1-4cd4-8d2b-be520dc72916 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:56.632624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72858087-e4b1-4cd4-8d2b-be520dc72916 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:56.633967 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 603/1193] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:05:56.639340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57667b-5d48-4213-833b-df7a4c69e88d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:56.639812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57667b-5d48-4213-833b-df7a4c69e88d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:56.639910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57667b-5d48-4213-833b-df7a4c69e88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:56.658071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1b57667b-5d48-4213-833b-df7a4c69e88d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:05:56.659282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1b57667b-5d48-4213-833b-df7a4c69e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:05:56.728247 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 591/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:05:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:05:56.996362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72858087-e4b1-4cd4-8d2b-be520dc72916 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:57.095454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:57.107097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72858087-e4b1-4cd4-8d2b-be520dc72916 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:57.143113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec147daa-76f6-4c56-a73c-f18b8c214fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:57.143779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec147daa-76f6-4c56-a73c-f18b8c214fa3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:57.144052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec147daa-76f6-4c56-a73c-f18b8c214fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:57.144328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec147daa-76f6-4c56-a73c-f18b8c214fa3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:57.155505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec147daa-76f6-4c56-a73c-f18b8c214fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:05:57.160364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-ec147daa-76f6-4c56-a73c-f18b8c214fa3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:57.160364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:05:57.160364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:05:57.160364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:05:57.160364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:05:57.160364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:05:57.160364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:05:57.160364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:05:57.160364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:05:57.160364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:05:57.160364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:05:57.160364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:05:57.160364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:05:57.160364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:05:57.160364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:05:57.160364 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:05:57.161475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:05:57.161475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:05:57.161475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:05:57.161475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:05:57.161475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:05:57.161475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:05:57.161475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:05:57.161475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:05:57.161475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:05:57.161475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:05:57.161475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:05:57.161475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:05:57.161475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:05:57.161475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:05:57.161475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:05:57.161475 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:05:57.162791 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:05:57.162791 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:05:57.162791 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:05:57.162791 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:05:57.162791 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:05:57.162791 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:05:57.162791 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:05:57.162791 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:05:57.162791 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:05:57.162791 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:05:57.162791 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:05:57.162791 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:05:57.162791 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 604/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:05:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:05:57.167763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57667b-5d48-4213-833b-df7a4c69e88d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:57.229077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:57.272625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57667b-5d48-4213-833b-df7a4c69e88d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:57.306638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e7aea-7bad-4348-9905-178384df1c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:57.307283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e7aea-7bad-4348-9905-178384df1c61 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:57.307536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e7aea-7bad-4348-9905-178384df1c61 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:57.307836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e7aea-7bad-4348-9905-178384df1c61 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:57.308504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e7aea-7bad-4348-9905-178384df1c61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:57.308803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e7aea-7bad-4348-9905-178384df1c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:57.310175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e7aea-7bad-4348-9905-178384df1c61 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:57.318556 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 592/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:05:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:57.324660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec147daa-76f6-4c56-a73c-f18b8c214fa3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:57.428691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec147daa-76f6-4c56-a73c-f18b8c214fa3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:57.466475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b90f4-93b9-483b-91d8-cc8af0f5b448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:57.467300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b90f4-93b9-483b-91d8-cc8af0f5b448 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:57.467610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b90f4-93b9-483b-91d8-cc8af0f5b448 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:57.467915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b90f4-93b9-483b-91d8-cc8af0f5b448 None admin] PATH_INFO: `/v3/users/ce56363e57bd452bb8589d6ba38db293` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:57.469515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b90f4-93b9-483b-91d8-cc8af0f5b448 None admin] RBAC: Authorizing `identity:get_user(user_id=ce56363e57bd452bb8589d6ba38db293)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:57.470966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b90f4-93b9-483b-91d8-cc8af0f5b448 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:57.472595 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 605/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 18:05:57 2022] GET /identity/v3/users/ce56363e57bd452bb8589d6ba38db293 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:57.478762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e7aea-7bad-4348-9905-178384df1c61 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:57.581212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e7aea-7bad-4348-9905-178384df1c61 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:57.606198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:57.618911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90cea7-862a-4fe8-a0f3-55f84ffb2fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:57.619566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90cea7-862a-4fe8-a0f3-55f84ffb2fbb None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:57.619844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90cea7-862a-4fe8-a0f3-55f84ffb2fbb None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:57.620117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90cea7-862a-4fe8-a0f3-55f84ffb2fbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:57.702651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90cea7-862a-4fe8-a0f3-55f84ffb2fbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:57.704142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90cea7-862a-4fe8-a0f3-55f84ffb2fbb None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:57.812751 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 593/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:05:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:05:57.819236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b90f4-93b9-483b-91d8-cc8af0f5b448 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:57.841803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:57.934279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b90f4-93b9-483b-91d8-cc8af0f5b448 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:57.972754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b3128-5dbf-4808-ae11-0be6e2d70cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:57.973402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b3128-5dbf-4808-ae11-0be6e2d70cc5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:57.973680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b3128-5dbf-4808-ae11-0be6e2d70cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:57.973949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b3128-5dbf-4808-ae11-0be6e2d70cc5 None admin] PATH_INFO: `/v3/projects/d90e16d0b19e4544a63c48ce0293e32a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:57.975138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b3128-5dbf-4808-ae11-0be6e2d70cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=d90e16d0b19e4544a63c48ce0293e32a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:57.976613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b3128-5dbf-4808-ae11-0be6e2d70cc5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:57.978265 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 606/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 18:05:57 2022] GET /identity/v3/projects/d90e16d0b19e4544a63c48ce0293e32a => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:05:57.984883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90cea7-862a-4fe8-a0f3-55f84ffb2fbb None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:05:58.014897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:05:58.098688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90cea7-862a-4fe8-a0f3-55f84ffb2fbb None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:05:58.145117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c02fbe-5d5b-46c0-b269-ad1d3047cc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:05:58.145728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c02fbe-5d5b-46c0-b269-ad1d3047cc8f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:05:58.146003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c02fbe-5d5b-46c0-b269-ad1d3047cc8f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:05:58.146270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c02fbe-5d5b-46c0-b269-ad1d3047cc8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:05:58.147016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c02fbe-5d5b-46c0-b269-ad1d3047cc8f None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=d90e16d0b19e4544a63c48ce0293e32a, user.id=ce56363e57bd452bb8589d6ba38db293) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:05:58.147346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c02fbe-5d5b-46c0-b269-ad1d3047cc8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:05:58.148782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c02fbe-5d5b-46c0-b269-ad1d3047cc8f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:05:58.155785 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 594/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:05:57 2022] GET /identity/v3/role_assignments?user.id=ce56363e57bd452bb8589d6ba38db293&scope.project.id=d90e16d0b19e4544a63c48ce0293e32a&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:06:07.968155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=57 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:06:08.152554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=57 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:06:55.027872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4553fe-0234-4af4-bbc8-395a48369405 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:06:55.028559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4553fe-0234-4af4-bbc8-395a48369405 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:06:55.028559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4553fe-0234-4af4-bbc8-395a48369405 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:06:55.030055 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 607/1201] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:06:55.036832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebc11f-d58e-4b32-afb5-22e6ffcb9857 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:06:55.037387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebc11f-d58e-4b32-afb5-22e6ffcb9857 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:06:55.037525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebc11f-d58e-4b32-afb5-22e6ffcb9857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:06:55.065700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-51ebc11f-d58e-4b32-afb5-22e6ffcb9857 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:06:55.067049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-51ebc11f-d58e-4b32-afb5-22e6ffcb9857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:06:55.180132 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 595/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:06:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:06:55.446840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4553fe-0234-4af4-bbc8-395a48369405 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:06:55.594283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4553fe-0234-4af4-bbc8-395a48369405 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:06:55.650212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da536d-52c8-4c43-8045-db15f0ddcba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:06:55.650940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da536d-52c8-4c43-8045-db15f0ddcba9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:06:55.651220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da536d-52c8-4c43-8045-db15f0ddcba9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:06:55.651549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da536d-52c8-4c43-8045-db15f0ddcba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:06:55.665811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da536d-52c8-4c43-8045-db15f0ddcba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:06:55.667339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da536d-52c8-4c43-8045-db15f0ddcba9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:06:55.687599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b9da536d-52c8-4c43-8045-db15f0ddcba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:06:55.687599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:06:55.687599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:06:55.687599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:06:55.687599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:06:55.687599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:06:55.687599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:06:55.687599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:06:55.687599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:06:55.687599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:06:55.687599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:06:55.687599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:06:55.687599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:06:55.687599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:06:55.687599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:06:55.687599 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:06:55.689032 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:06:55.689032 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:06:55.689032 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:06:55.689032 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:06:55.689032 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:06:55.689032 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:06:55.689032 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:06:55.689032 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:06:55.689032 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:06:55.689032 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:06:55.689032 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:06:55.689032 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:06:55.689032 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:06:55.689032 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:06:55.689032 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:06:55.689032 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:06:55.689032 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:06:55.690832 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:06:55.690832 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:06:55.690832 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:06:55.690832 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 608/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:06:55.698461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebc11f-d58e-4b32-afb5-22e6ffcb9857 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:06:55.856225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebc11f-d58e-4b32-afb5-22e6ffcb9857 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:06:55.897971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:06:55.904657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491327c5-b1a8-4318-a0fd-95f08a5bd906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:06:55.905389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491327c5-b1a8-4318-a0fd-95f08a5bd906 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:06:55.906116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491327c5-b1a8-4318-a0fd-95f08a5bd906 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:06:55.906486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491327c5-b1a8-4318-a0fd-95f08a5bd906 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:06:55.907344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491327c5-b1a8-4318-a0fd-95f08a5bd906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:06:55.907860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491327c5-b1a8-4318-a0fd-95f08a5bd906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:06:55.909707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491327c5-b1a8-4318-a0fd-95f08a5bd906 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:06:55.926072 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 596/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:06:55.932189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da536d-52c8-4c43-8045-db15f0ddcba9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:06:56.003712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:06:56.073452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da536d-52c8-4c43-8045-db15f0ddcba9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:06:56.114412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd34878-0d22-42ef-a0de-5d744bf13f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:06:56.115095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd34878-0d22-42ef-a0de-5d744bf13f72 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:06:56.115388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd34878-0d22-42ef-a0de-5d744bf13f72 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:06:56.115642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd34878-0d22-42ef-a0de-5d744bf13f72 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:06:56.116392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd34878-0d22-42ef-a0de-5d744bf13f72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:06:56.118085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd34878-0d22-42ef-a0de-5d744bf13f72 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:06:56.145063 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 609/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 18:06:55 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:06:58.352109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c0814-3e96-4beb-83b1-e922fa14bedd None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:06:58.352975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c0814-3e96-4beb-83b1-e922fa14bedd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:06:58.353439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c0814-3e96-4beb-83b1-e922fa14bedd None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:06:58.355340 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 597/1206] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:06:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:06:58.362079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddf48a-39dc-4e0a-adb0-f4073c82e1e6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:06:58.363059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddf48a-39dc-4e0a-adb0-f4073c82e1e6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:06:58.363727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddf48a-39dc-4e0a-adb0-f4073c82e1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:06:58.385539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-27ddf48a-39dc-4e0a-adb0-f4073c82e1e6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:06:58.387342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27ddf48a-39dc-4e0a-adb0-f4073c82e1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:06:58.467973 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 610/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:06:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:06:58.800865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c0814-3e96-4beb-83b1-e922fa14bedd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:06:58.983214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c0814-3e96-4beb-83b1-e922fa14bedd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:06:59.053906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba52ad-2644-4356-af07-75d48cb7402e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:06:59.054654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba52ad-2644-4356-af07-75d48cb7402e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:06:59.054934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba52ad-2644-4356-af07-75d48cb7402e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:06:59.055204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba52ad-2644-4356-af07-75d48cb7402e None admin] PATH_INFO: `/v3/roles/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:06:59.084235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba52ad-2644-4356-af07-75d48cb7402e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:06:59.095334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-45ba52ad-2644-4356-af07-75d48cb7402e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:06:59.095334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:06:59.095334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:06:59.095334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:06:59.095334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:06:59.095334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:06:59.095334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:06:59.095334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:06:59.095334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:06:59.095334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:06:59.095334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:06:59.095334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:06:59.095334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:06:59.095334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:06:59.095334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:06:59.095334 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:06:59.096401 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:06:59.096401 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:06:59.096401 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:06:59.096401 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:06:59.096401 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:06:59.096401 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:06:59.096401 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:06:59.096401 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:06:59.096401 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:06:59.096401 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:06:59.096401 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:06:59.096401 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:06:59.096401 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:06:59.096401 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:06:59.096401 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:06:59.096401 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:06:59.098877 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:06:59.098877 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:06:59.098877 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:06:59.098877 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:06:59.098877 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:06:59.098877 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:06:59.098877 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:06:59.098877 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:06:59.098877 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:06:59.098877 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:06:59.098877 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:06:59.098877 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:06:59.098877 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 598/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:06:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:06:59.102334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddf48a-39dc-4e0a-adb0-f4073c82e1e6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:06:59.171390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:06:59.281605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddf48a-39dc-4e0a-adb0-f4073c82e1e6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:06:59.328592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318760e-5d05-432d-81f9-c96c1801a804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:06:59.329251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318760e-5d05-432d-81f9-c96c1801a804 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:06:59.329525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318760e-5d05-432d-81f9-c96c1801a804 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:06:59.329793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318760e-5d05-432d-81f9-c96c1801a804 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:06:59.330490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318760e-5d05-432d-81f9-c96c1801a804 None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:06:59.330974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318760e-5d05-432d-81f9-c96c1801a804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:06:59.333574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318760e-5d05-432d-81f9-c96c1801a804 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:06:59.344646 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 611/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:06:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:06:59.351446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba52ad-2644-4356-af07-75d48cb7402e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:06:59.417717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:06:59.483921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba52ad-2644-4356-af07-75d48cb7402e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:06:59.552866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292a97c-082c-48ca-8f2e-7bb368ec20ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:06:59.553738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292a97c-082c-48ca-8f2e-7bb368ec20ed None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:06:59.554127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292a97c-082c-48ca-8f2e-7bb368ec20ed None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:06:59.554541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292a97c-082c-48ca-8f2e-7bb368ec20ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:06:59.577491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292a97c-082c-48ca-8f2e-7bb368ec20ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:06:59.579213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292a97c-082c-48ca-8f2e-7bb368ec20ed None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:06:59.604813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-f292a97c-082c-48ca-8f2e-7bb368ec20ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:06:59.604813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:06:59.604813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:06:59.604813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:06:59.604813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:06:59.604813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:06:59.604813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:06:59.604813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:06:59.604813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:06:59.604813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:06:59.604813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:06:59.604813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:06:59.604813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:06:59.604813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:06:59.604813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:06:59.604813 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:06:59.605928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:06:59.605928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:06:59.605928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:06:59.605928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:06:59.605928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:06:59.605928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:06:59.605928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:06:59.605928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:06:59.605928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:06:59.605928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:06:59.605928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:06:59.605928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:06:59.605928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:06:59.605928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:06:59.605928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:06:59.605928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:06:59.605928 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:06:59.606988 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:06:59.606988 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:06:59.606988 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:06:59.608994 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 599/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:06:59.616150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318760e-5d05-432d-81f9-c96c1801a804 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:06:59.751968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:06:59.760975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318760e-5d05-432d-81f9-c96c1801a804 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:06:59.812994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494798b-42b6-4f08-804e-d90eec2ae47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:06:59.813252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494798b-42b6-4f08-804e-d90eec2ae47e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:06:59.813621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494798b-42b6-4f08-804e-d90eec2ae47e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:06:59.813997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494798b-42b6-4f08-804e-d90eec2ae47e None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:06:59.814811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494798b-42b6-4f08-804e-d90eec2ae47e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:06:59.816078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494798b-42b6-4f08-804e-d90eec2ae47e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:06:59.816765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494798b-42b6-4f08-804e-d90eec2ae47e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:06:59.835364 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 612/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:06:59.838884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292a97c-082c-48ca-8f2e-7bb368ec20ed None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:06:59.972699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292a97c-082c-48ca-8f2e-7bb368ec20ed None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:06:59.974778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:00.031096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040282e5-a924-47ec-ab53-a1d1ec5fc1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:00.032033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040282e5-a924-47ec-ab53-a1d1ec5fc1b4 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:00.032393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040282e5-a924-47ec-ab53-a1d1ec5fc1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:00.032738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040282e5-a924-47ec-ab53-a1d1ec5fc1b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:00.043789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040282e5-a924-47ec-ab53-a1d1ec5fc1b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:00.045318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040282e5-a924-47ec-ab53-a1d1ec5fc1b4 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:00.059932 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-040282e5-a924-47ec-ab53-a1d1ec5fc1b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:07:00.059932 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:00.059932 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:00.059932 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:00.059932 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:00.059932 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:00.059932 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:00.059932 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:00.059932 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:00.059932 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:00.059932 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:00.059932 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:00.059932 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:07:00.059932 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:07:00.059932 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:07:00.059932 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:00.061292 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:00.062511 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:00.062511 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:00.062511 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:07:00.062511 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:07:00.062511 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:07:00.062511 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:07:00.062511 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:07:00.062511 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:07:00.062511 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:07:00.062511 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:00.062511 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 600/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:06:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:00.069094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494798b-42b6-4f08-804e-d90eec2ae47e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:00.234957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494798b-42b6-4f08-804e-d90eec2ae47e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:00.284039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22f1c4-bb1b-4c2c-a4ca-33a0224ddaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:00.284653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22f1c4-bb1b-4c2c-a4ca-33a0224ddaf9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:00.284936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22f1c4-bb1b-4c2c-a4ca-33a0224ddaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:00.285209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22f1c4-bb1b-4c2c-a4ca-33a0224ddaf9 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:00.285960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22f1c4-bb1b-4c2c-a4ca-33a0224ddaf9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:00.286254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22f1c4-bb1b-4c2c-a4ca-33a0224ddaf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:00.289222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22f1c4-bb1b-4c2c-a4ca-33a0224ddaf9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:00.319890 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 613/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 28 18:07:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:00.327815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040282e5-a924-47ec-ab53-a1d1ec5fc1b4 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:00.470212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040282e5-a924-47ec-ab53-a1d1ec5fc1b4 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:00.513795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2b90a-d6ba-4dca-ac80-7160252fd284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:00.514318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2b90a-d6ba-4dca-ac80-7160252fd284 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:00.514593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2b90a-d6ba-4dca-ac80-7160252fd284 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:00.514898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2b90a-d6ba-4dca-ac80-7160252fd284 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:00.559388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:00.605287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2b90a-d6ba-4dca-ac80-7160252fd284 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:00.607590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2b90a-d6ba-4dca-ac80-7160252fd284 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:00.732322 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 601/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:07:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:07:00.738997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22f1c4-bb1b-4c2c-a4ca-33a0224ddaf9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:00.765473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:00.875888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22f1c4-bb1b-4c2c-a4ca-33a0224ddaf9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:00.915222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac0d97-0192-4580-92d6-2aa32bc316d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:00.915899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac0d97-0192-4580-92d6-2aa32bc316d1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:00.916242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac0d97-0192-4580-92d6-2aa32bc316d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:00.916516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac0d97-0192-4580-92d6-2aa32bc316d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:00.927954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac0d97-0192-4580-92d6-2aa32bc316d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:00.929029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac0d97-0192-4580-92d6-2aa32bc316d1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:00.944818 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-75ac0d97-0192-4580-92d6-2aa32bc316d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:00.944818 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:00.944818 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:00.944818 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:00.944818 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:00.944818 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:00.944818 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:00.944818 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:00.944818 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:00.944818 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:00.944818 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:00.944818 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:00.944818 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:07:00.944818 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:07:00.944818 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:07:00.944818 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:07:00.946044 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:00.946044 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:00.946044 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:00.946044 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:00.946044 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:00.946044 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:00.946044 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:00.946044 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:00.946044 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:00.946044 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:00.946044 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:00.946044 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:00.946044 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:00.946044 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:00.946044 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:00.946044 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:00.946044 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:07:00.946951 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:07:00.946951 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:00.946951 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:07:00.946951 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 614/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:00.952007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2b90a-d6ba-4dca-ac80-7160252fd284 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:01.034486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:01.087762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2b90a-d6ba-4dca-ac80-7160252fd284 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:01.131827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880311a-bb20-48b1-98e1-63e0fb101ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:01.132441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880311a-bb20-48b1-98e1-63e0fb101ee8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:01.132712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880311a-bb20-48b1-98e1-63e0fb101ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:01.132978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880311a-bb20-48b1-98e1-63e0fb101ee8 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:01.133630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880311a-bb20-48b1-98e1-63e0fb101ee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:01.133933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880311a-bb20-48b1-98e1-63e0fb101ee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:01.135349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880311a-bb20-48b1-98e1-63e0fb101ee8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:01.148136 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 602/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:01.154663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac0d97-0192-4580-92d6-2aa32bc316d1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:01.261009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:01.300946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac0d97-0192-4580-92d6-2aa32bc316d1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:01.342358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b68011-6f83-4855-b10d-98fec62e813e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:01.343278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b68011-6f83-4855-b10d-98fec62e813e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:01.343578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b68011-6f83-4855-b10d-98fec62e813e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:01.343844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b68011-6f83-4855-b10d-98fec62e813e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:01.351458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b68011-6f83-4855-b10d-98fec62e813e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:01.352956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b68011-6f83-4855-b10d-98fec62e813e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:01.365134 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-35b68011-6f83-4855-b10d-98fec62e813e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:07:01.365134 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:01.365134 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:01.365134 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:01.365134 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:01.365134 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:01.365134 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:01.365134 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:01.365134 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:01.365134 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:01.365134 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:01.365134 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:01.365134 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:07:01.365134 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:07:01.365134 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:07:01.371762 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:07:01.371762 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:01.371762 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:01.371762 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:01.371762 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:01.371762 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:01.371762 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:01.371762 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:01.371762 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:01.371762 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:01.371762 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:01.371762 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:01.371762 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:01.371762 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:01.371762 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:01.371762 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:01.371762 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:01.372813 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:07:01.372813 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:07:01.372813 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:07:01.372813 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:07:01.372813 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:07:01.372813 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:07:01.372813 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:07:01.372813 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:07:01.372813 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 615/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:07:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:07:01.375644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880311a-bb20-48b1-98e1-63e0fb101ee8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:01.499630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880311a-bb20-48b1-98e1-63e0fb101ee8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:01.530176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:01.549622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9908a23-9ce7-44cc-8060-d2f9231fe55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:01.550265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9908a23-9ce7-44cc-8060-d2f9231fe55a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:01.550543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9908a23-9ce7-44cc-8060-d2f9231fe55a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:01.550816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9908a23-9ce7-44cc-8060-d2f9231fe55a None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:01.551734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9908a23-9ce7-44cc-8060-d2f9231fe55a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:01.551990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9908a23-9ce7-44cc-8060-d2f9231fe55a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:01.555983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9908a23-9ce7-44cc-8060-d2f9231fe55a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:01.573577 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 603/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:07:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:01.581517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b68011-6f83-4855-b10d-98fec62e813e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:01.697978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b68011-6f83-4855-b10d-98fec62e813e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:01.731094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:01.738569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be4fc0-d16b-4fec-805c-bab986813680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:01.739186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be4fc0-d16b-4fec-805c-bab986813680 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:01.739870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be4fc0-d16b-4fec-805c-bab986813680 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:01.739870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be4fc0-d16b-4fec-805c-bab986813680 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:01.740704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be4fc0-d16b-4fec-805c-bab986813680 None admin] RBAC: Adding query filter params (role.id=1e0740decc23460f8c3d0f7007f2d97f, scope.project.id=651b8653291a414fba3805312708ce48, user.id=a124350e5c384907b9d80fbe05d07d7e) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:01.740874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be4fc0-d16b-4fec-805c-bab986813680 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:01.742288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be4fc0-d16b-4fec-805c-bab986813680 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:01.749622 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 616/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:07:01 2022] GET /identity/v3/role_assignments?user.id=a124350e5c384907b9d80fbe05d07d7e&scope.project.id=651b8653291a414fba3805312708ce48&role.id=1e0740decc23460f8c3d0f7007f2d97f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:03.770301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d614efd-19f3-4f3c-a3e1-2c2792cf134f None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:03.770923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d614efd-19f3-4f3c-a3e1-2c2792cf134f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:03.770923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d614efd-19f3-4f3c-a3e1-2c2792cf134f None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:03.772693 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 604/1220] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:07:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:07:03.778752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c10f8a-6a09-47d9-80d5-b5384ff43cb5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:03.779307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c10f8a-6a09-47d9-80d5-b5384ff43cb5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:03.779396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c10f8a-6a09-47d9-80d5-b5384ff43cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:03.799926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e9c10f8a-6a09-47d9-80d5-b5384ff43cb5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:07:03.801313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e9c10f8a-6a09-47d9-80d5-b5384ff43cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:07:03.876567 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 617/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:07:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:07:04.139889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d614efd-19f3-4f3c-a3e1-2c2792cf134f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:04.261542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d614efd-19f3-4f3c-a3e1-2c2792cf134f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:04.305277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff79c5-e8f8-48d6-b88d-c2cb965afec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:04.306054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff79c5-e8f8-48d6-b88d-c2cb965afec4 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:04.306361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff79c5-e8f8-48d6-b88d-c2cb965afec4 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:04.306764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff79c5-e8f8-48d6-b88d-c2cb965afec4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:04.319457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff79c5-e8f8-48d6-b88d-c2cb965afec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:07:04.324967 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-cdff79c5-e8f8-48d6-b88d-c2cb965afec4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:07:04.324967 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:04.324967 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:04.324967 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:04.324967 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:04.324967 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:04.324967 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:04.324967 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:04.324967 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:04.324967 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:04.324967 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:04.324967 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:04.324967 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:07:04.324967 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:07:04.324967 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:07:04.324967 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:07:04.326112 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:07:04.326112 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:07:04.326112 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:07:04.326112 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:07:04.326112 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:04.326112 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:04.326112 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:04.326112 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:04.326112 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:04.326112 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:04.326112 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:04.326112 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:04.326112 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:04.326112 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:04.326112 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:04.326112 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:04.327229 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:04.327229 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:04.327229 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:04.327229 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:04.327229 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:07:04.327229 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:07:04.327229 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:07:04.327229 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:07:04.327229 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:07:04.327229 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:07:04.327229 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:07:04.327229 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:04.327229 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 605/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:07:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:04.334473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c10f8a-6a09-47d9-80d5-b5384ff43cb5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:04.442151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c10f8a-6a09-47d9-80d5-b5384ff43cb5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:04.466625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:04.478109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fe086-2b33-433f-8e5d-8220e916b741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:04.478725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fe086-2b33-433f-8e5d-8220e916b741 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:04.479009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fe086-2b33-433f-8e5d-8220e916b741 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:04.479348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fe086-2b33-433f-8e5d-8220e916b741 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:04.480005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fe086-2b33-433f-8e5d-8220e916b741 None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:04.480307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fe086-2b33-433f-8e5d-8220e916b741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:04.481692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fe086-2b33-433f-8e5d-8220e916b741 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:04.490419 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 618/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:07:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:07:04.496672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff79c5-e8f8-48d6-b88d-c2cb965afec4 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:04.546623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:04.624774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff79c5-e8f8-48d6-b88d-c2cb965afec4 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:04.664136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364befd7-b8d8-4b00-8721-a1bc07d28576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:04.664798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364befd7-b8d8-4b00-8721-a1bc07d28576 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:04.665067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364befd7-b8d8-4b00-8721-a1bc07d28576 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:04.665388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364befd7-b8d8-4b00-8721-a1bc07d28576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:04.678060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364befd7-b8d8-4b00-8721-a1bc07d28576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:04.680138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364befd7-b8d8-4b00-8721-a1bc07d28576 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:04.697168 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-364befd7-b8d8-4b00-8721-a1bc07d28576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:04.697168 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:04.697168 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:04.697168 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:04.697168 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:04.697168 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:04.697168 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:04.697168 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:04.697168 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:04.697168 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:04.697168 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:04.697168 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:04.697168 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:07:04.697168 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:07:04.697168 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:07:04.697168 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:07:04.698360 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:04.698360 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:04.698360 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:04.698360 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:04.698360 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:04.698360 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:04.698360 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:04.698360 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:04.698360 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:04.698360 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:04.698360 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:04.698360 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:04.698360 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:04.698360 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:04.698360 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:04.698360 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:04.698360 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:07:04.699385 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:07:04.699385 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:04.699385 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:04.699385 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 606/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:04.705931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fe086-2b33-433f-8e5d-8220e916b741 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:04.829123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fe086-2b33-433f-8e5d-8220e916b741 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:04.866054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e6123-c63f-4908-a781-76b790ce8888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:04.866677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e6123-c63f-4908-a781-76b790ce8888 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:04.867008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e6123-c63f-4908-a781-76b790ce8888 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:04.867241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e6123-c63f-4908-a781-76b790ce8888 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:04.867917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e6123-c63f-4908-a781-76b790ce8888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:04.868241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e6123-c63f-4908-a781-76b790ce8888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:04.869620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e6123-c63f-4908-a781-76b790ce8888 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:04.882770 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 619/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:07:04.890337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364befd7-b8d8-4b00-8721-a1bc07d28576 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:04.999577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:05.007807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364befd7-b8d8-4b00-8721-a1bc07d28576 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:05.047635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747000b-9543-4c76-b073-61db4cccb492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:05.048292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747000b-9543-4c76-b073-61db4cccb492 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:05.048574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747000b-9543-4c76-b073-61db4cccb492 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:05.048852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747000b-9543-4c76-b073-61db4cccb492 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:05.058267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747000b-9543-4c76-b073-61db4cccb492 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:05.059911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747000b-9543-4c76-b073-61db4cccb492 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:05.072783 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-6747000b-9543-4c76-b073-61db4cccb492 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:07:05.072783 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:05.072783 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:05.072783 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:05.072783 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:05.072783 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:05.072783 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:05.072783 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:05.072783 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:05.072783 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:05.072783 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:05.072783 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:05.072783 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:07:05.072783 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:07:05.072783 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:07:05.072783 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:05.074002 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:05.075128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:05.075128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:05.075128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:07:05.075128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:07:05.075128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:07:05.075128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:07:05.075128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:07:05.075128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:07:05.075128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:07:05.075128 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:05.075128 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 607/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:07:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:05.079901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e6123-c63f-4908-a781-76b790ce8888 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:05.131714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:05.195113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e6123-c63f-4908-a781-76b790ce8888 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:05.234438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc95080-e5cc-46d8-8367-eeb86accd1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:05.235062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc95080-e5cc-46d8-8367-eeb86accd1df None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:05.235372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc95080-e5cc-46d8-8367-eeb86accd1df None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:05.235796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc95080-e5cc-46d8-8367-eeb86accd1df None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:05.236815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc95080-e5cc-46d8-8367-eeb86accd1df None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:05.237123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc95080-e5cc-46d8-8367-eeb86accd1df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:05.238731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc95080-e5cc-46d8-8367-eeb86accd1df None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:05.259085 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 620/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 28 18:07:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:05.264930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747000b-9543-4c76-b073-61db4cccb492 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:05.382155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747000b-9543-4c76-b073-61db4cccb492 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:05.420640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de85ef-18d6-4735-86ca-1a8b7348e3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:05.421348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de85ef-18d6-4735-86ca-1a8b7348e3e0 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:05.421692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de85ef-18d6-4735-86ca-1a8b7348e3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:05.421966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de85ef-18d6-4735-86ca-1a8b7348e3e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:05.436595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de85ef-18d6-4735-86ca-1a8b7348e3e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:05.438321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de85ef-18d6-4735-86ca-1a8b7348e3e0 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:05.455807 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-e8de85ef-18d6-4735-86ca-1a8b7348e3e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:05.455807 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:05.455807 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:05.455807 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:05.455807 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:05.455807 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:05.455807 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:05.455807 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:05.455807 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:05.455807 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:05.455807 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:05.455807 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:05.455807 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:07:05.455807 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:07:05.455807 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:07:05.455807 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:07:05.456902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:05.456902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:05.456902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:05.456902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:05.456902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:05.456902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:05.456902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:05.456902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:05.456902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:05.456902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:05.456902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:05.456902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:05.456902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:05.456902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:05.456902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:05.456902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:05.456902 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:07:05.457878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:07:05.457878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:05.457878 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:05.457878 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 608/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:07:05.463507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc95080-e5cc-46d8-8367-eeb86accd1df None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:05.582189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc95080-e5cc-46d8-8367-eeb86accd1df None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:05.584874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:05.621539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f498d33-891a-4343-b3f5-2199e030014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:05.622159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f498d33-891a-4343-b3f5-2199e030014c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:05.622445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f498d33-891a-4343-b3f5-2199e030014c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:05.622730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f498d33-891a-4343-b3f5-2199e030014c None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:05.623423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f498d33-891a-4343-b3f5-2199e030014c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:05.623724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f498d33-891a-4343-b3f5-2199e030014c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:05.625101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f498d33-891a-4343-b3f5-2199e030014c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:05.637931 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 621/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:05.645046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de85ef-18d6-4735-86ca-1a8b7348e3e0 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:05.654937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:05.762637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de85ef-18d6-4735-86ca-1a8b7348e3e0 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:05.808569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd3577-7f4a-4b86-afaa-46731318a947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:05.809489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd3577-7f4a-4b86-afaa-46731318a947 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:05.809927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd3577-7f4a-4b86-afaa-46731318a947 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:05.810411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd3577-7f4a-4b86-afaa-46731318a947 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:05.819620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd3577-7f4a-4b86-afaa-46731318a947 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:05.821076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd3577-7f4a-4b86-afaa-46731318a947 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:05.836224 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-83fd3577-7f4a-4b86-afaa-46731318a947 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:07:05.836224 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:05.836224 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:05.836224 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:05.836224 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:05.836224 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:05.836224 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:05.836224 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:05.836224 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:05.836224 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:05.836224 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:05.836224 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:05.836224 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:07:05.836224 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:07:05.836224 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:07:05.837314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:07:05.837314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:05.837314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:05.837314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:05.837314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:05.837314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:05.837314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:05.837314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:05.837314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:05.837314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:05.837314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:05.837314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:05.837314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:05.837314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:05.837314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:05.837314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:05.837314 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:05.838366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:07:05.838366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:07:05.838366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:07:05.838366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:07:05.838366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:07:05.838366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:07:05.838366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:07:05.838366 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:05.838366 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 609/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:07:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:07:05.845404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f498d33-891a-4343-b3f5-2199e030014c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:05.968320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f498d33-891a-4343-b3f5-2199e030014c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:06.012191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b77c8-8594-46f7-b4ae-a2b094562bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:06.012912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b77c8-8594-46f7-b4ae-a2b094562bc8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:06.013230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b77c8-8594-46f7-b4ae-a2b094562bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:06.013536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b77c8-8594-46f7-b4ae-a2b094562bc8 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:06.014243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b77c8-8594-46f7-b4ae-a2b094562bc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:06.014548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b77c8-8594-46f7-b4ae-a2b094562bc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:06.016276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b77c8-8594-46f7-b4ae-a2b094562bc8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:06.030170 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 622/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:07:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:06.037152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd3577-7f4a-4b86-afaa-46731318a947 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:06.116384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:06.159289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd3577-7f4a-4b86-afaa-46731318a947 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:06.203396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685487fe-8849-48ac-8562-9be0efae9d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:06.204137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685487fe-8849-48ac-8562-9be0efae9d69 None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:06.204400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685487fe-8849-48ac-8562-9be0efae9d69 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:06.204668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685487fe-8849-48ac-8562-9be0efae9d69 None admin] PATH_INFO: `/v3/projects/651b8653291a414fba3805312708ce48/users/a124350e5c384907b9d80fbe05d07d7e/roles/1e0740decc23460f8c3d0f7007f2d97f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:06.223752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685487fe-8849-48ac-8562-9be0efae9d69 None admin] RBAC: Authorizing `identity:create_grant(project_id=651b8653291a414fba3805312708ce48, user_id=a124350e5c384907b9d80fbe05d07d7e, role_id=1e0740decc23460f8c3d0f7007f2d97f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:06.225441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685487fe-8849-48ac-8562-9be0efae9d69 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:06.239971 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 610/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:07:06 2022] PUT /identity/v3/projects/651b8653291a414fba3805312708ce48/users/a124350e5c384907b9d80fbe05d07d7e/roles/1e0740decc23460f8c3d0f7007f2d97f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:07:08.248095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86398372-db32-4f02-a6fd-e0143136fc03 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:08.248730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86398372-db32-4f02-a6fd-e0143136fc03 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:08.248730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86398372-db32-4f02-a6fd-e0143136fc03 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:08.250172 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 623/1233] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:07:08.256397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddefcb-2299-456f-bbb2-a4258832315a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:08.256928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddefcb-2299-456f-bbb2-a4258832315a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:08.257037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddefcb-2299-456f-bbb2-a4258832315a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:08.276717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-24ddefcb-2299-456f-bbb2-a4258832315a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:07:08.277905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-24ddefcb-2299-456f-bbb2-a4258832315a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:07:08.362898 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 611/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:07:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:07:08.641498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86398372-db32-4f02-a6fd-e0143136fc03 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:08.668395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:08.759875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86398372-db32-4f02-a6fd-e0143136fc03 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:08.799021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd2ef-fd61-4ffd-b428-ecf5a278b96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:08.799926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd2ef-fd61-4ffd-b428-ecf5a278b96b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:08.800203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd2ef-fd61-4ffd-b428-ecf5a278b96b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:08.800470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd2ef-fd61-4ffd-b428-ecf5a278b96b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:08.812709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fd2ef-fd61-4ffd-b428-ecf5a278b96b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:07:08.817557 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-c95fd2ef-fd61-4ffd-b428-ecf5a278b96b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:07:08.817557 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:08.817557 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:08.817557 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:08.817557 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:08.817557 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:08.817557 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:08.817557 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:08.817557 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:08.817557 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:08.817557 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:08.817557 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:08.817557 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:07:08.817557 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:07:08.817557 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:07:08.817557 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:07:08.818720 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:07:08.818720 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:07:08.818720 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:07:08.818720 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:07:08.818720 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:08.818720 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:08.818720 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:08.818720 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:08.818720 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:08.818720 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:08.818720 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:08.818720 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:08.818720 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:08.818720 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:08.818720 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:08.818720 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:08.819853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:08.819853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:08.819853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:08.819853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:08.819853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:07:08.819853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:07:08.819853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:07:08.819853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:07:08.819853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:07:08.819853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:07:08.819853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:07:08.819853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:07:08.824142 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 624/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 18:07:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:08.825106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddefcb-2299-456f-bbb2-a4258832315a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:08.880341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:08.939464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddefcb-2299-456f-bbb2-a4258832315a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:08.981230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1a225-f64c-47e8-8501-af6695bf6e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:08.981846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1a225-f64c-47e8-8501-af6695bf6e3d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:08.982104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1a225-f64c-47e8-8501-af6695bf6e3d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:08.982371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1a225-f64c-47e8-8501-af6695bf6e3d None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:08.983065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1a225-f64c-47e8-8501-af6695bf6e3d None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:08.983370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1a225-f64c-47e8-8501-af6695bf6e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:08.984758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1a225-f64c-47e8-8501-af6695bf6e3d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:08.994398 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 612/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 18:07:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:09.000601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd2ef-fd61-4ffd-b428-ecf5a278b96b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:09.098479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:09.118838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd2ef-fd61-4ffd-b428-ecf5a278b96b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:09.158748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917daff-decf-4cb0-9c60-c86e7e0e4ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:09.159443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917daff-decf-4cb0-9c60-c86e7e0e4ef1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:09.159719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917daff-decf-4cb0-9c60-c86e7e0e4ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:09.159980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917daff-decf-4cb0-9c60-c86e7e0e4ef1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:09.171089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917daff-decf-4cb0-9c60-c86e7e0e4ef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:09.172640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917daff-decf-4cb0-9c60-c86e7e0e4ef1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:09.188220 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f917daff-decf-4cb0-9c60-c86e7e0e4ef1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:09.188220 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:09.188220 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:09.188220 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:09.188220 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:09.188220 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:09.188220 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:09.188220 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:09.188220 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:09.188220 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:09.188220 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:09.188220 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:09.188220 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:07:09.188220 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:07:09.188220 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:07:09.188220 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:07:09.189579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:09.189579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:09.189579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:09.189579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:09.189579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:09.189579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:09.189579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:09.189579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:09.189579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:09.189579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:09.189579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:09.189579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:09.189579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:09.189579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:09.189579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:09.189579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:09.189579 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:07:09.190756 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:07:09.190756 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:09.190756 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:07:09.190756 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 625/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:09.195703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1a225-f64c-47e8-8501-af6695bf6e3d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:09.319591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1a225-f64c-47e8-8501-af6695bf6e3d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:09.330686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:09.363139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789144f3-13b5-493c-b3a6-c797c117e484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:09.364081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789144f3-13b5-493c-b3a6-c797c117e484 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:09.364525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789144f3-13b5-493c-b3a6-c797c117e484 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:09.364973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789144f3-13b5-493c-b3a6-c797c117e484 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:09.366054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789144f3-13b5-493c-b3a6-c797c117e484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:09.366543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789144f3-13b5-493c-b3a6-c797c117e484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:09.367987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789144f3-13b5-493c-b3a6-c797c117e484 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:09.384098 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 613/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:09.390110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917daff-decf-4cb0-9c60-c86e7e0e4ef1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:09.506695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917daff-decf-4cb0-9c60-c86e7e0e4ef1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:09.551841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149b263-bf53-4676-9d84-7ad222ef5e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:09.552490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149b263-bf53-4676-9d84-7ad222ef5e10 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:09.552769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149b263-bf53-4676-9d84-7ad222ef5e10 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:09.553046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149b263-bf53-4676-9d84-7ad222ef5e10 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:09.556545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:09.562878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149b263-bf53-4676-9d84-7ad222ef5e10 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:09.564707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149b263-bf53-4676-9d84-7ad222ef5e10 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:09.580569 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-6149b263-bf53-4676-9d84-7ad222ef5e10 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:07:09.580569 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:09.580569 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:09.580569 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:09.580569 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:09.580569 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:09.580569 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:09.580569 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:09.580569 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:09.580569 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:09.580569 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:09.580569 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:09.580569 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:07:09.580569 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:07:09.580569 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:07:09.580569 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:09.582289 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:09.583333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:09.583333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:09.583333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:07:09.583333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:07:09.583333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:07:09.583333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:07:09.583333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:07:09.583333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:07:09.583333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:07:09.583333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:07:09.583333 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 626/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:07:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:07:09.588096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789144f3-13b5-493c-b3a6-c797c117e484 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:09.706723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789144f3-13b5-493c-b3a6-c797c117e484 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:09.747321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c1ce2-baf3-4ea3-95b6-8e6ad01601dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:09.748270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c1ce2-baf3-4ea3-95b6-8e6ad01601dc None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:09.748530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c1ce2-baf3-4ea3-95b6-8e6ad01601dc None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:09.748852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c1ce2-baf3-4ea3-95b6-8e6ad01601dc None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:09.749918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c1ce2-baf3-4ea3-95b6-8e6ad01601dc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:09.750247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c1ce2-baf3-4ea3-95b6-8e6ad01601dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:09.751943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c1ce2-baf3-4ea3-95b6-8e6ad01601dc None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:09.779189 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 614/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 28 18:07:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:09.785796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149b263-bf53-4676-9d84-7ad222ef5e10 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:09.912989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149b263-bf53-4676-9d84-7ad222ef5e10 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:09.960411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d6202-015b-4810-821a-fd43219c0488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:09.960962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d6202-015b-4810-821a-fd43219c0488 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:09.961259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d6202-015b-4810-821a-fd43219c0488 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:09.961535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d6202-015b-4810-821a-fd43219c0488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:10.027302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:10.034698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d6202-015b-4810-821a-fd43219c0488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:10.036213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d6202-015b-4810-821a-fd43219c0488 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:10.159498 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 627/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:07:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 18:07:10.166998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c1ce2-baf3-4ea3-95b6-8e6ad01601dc None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:10.198123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:10.290337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c1ce2-baf3-4ea3-95b6-8e6ad01601dc None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:10.340536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c4eeb-bcb7-45f3-adae-1cfb5e2ceda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:10.341240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c4eeb-bcb7-45f3-adae-1cfb5e2ceda9 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:10.341433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c4eeb-bcb7-45f3-adae-1cfb5e2ceda9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:10.341702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c4eeb-bcb7-45f3-adae-1cfb5e2ceda9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:10.355393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c4eeb-bcb7-45f3-adae-1cfb5e2ceda9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:10.357420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c4eeb-bcb7-45f3-adae-1cfb5e2ceda9 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:10.375856 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-560c4eeb-bcb7-45f3-adae-1cfb5e2ceda9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:10.375856 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:10.375856 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:10.375856 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:10.375856 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:10.375856 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:10.375856 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:10.375856 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:10.375856 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:10.375856 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:10.375856 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:10.375856 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:10.375856 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:07:10.375856 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:07:10.375856 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:07:10.375856 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:07:10.377129 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:10.377129 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:10.377129 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:10.377129 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:10.377129 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:10.377129 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:10.377129 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:10.377129 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:10.377129 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:10.377129 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:10.377129 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:10.377129 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:10.377129 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:10.377129 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:10.377129 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:10.377129 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:10.377129 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:07:10.378037 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:07:10.378037 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:10.378037 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:10.378037 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 615/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:10.385308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d6202-015b-4810-821a-fd43219c0488 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:10.502788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:10.509898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d6202-015b-4810-821a-fd43219c0488 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:10.556099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b040d6-3e8a-4470-b819-a30339b2459d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:10.556997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b040d6-3e8a-4470-b819-a30339b2459d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:10.557294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b040d6-3e8a-4470-b819-a30339b2459d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:10.557558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b040d6-3e8a-4470-b819-a30339b2459d None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:10.558266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b040d6-3e8a-4470-b819-a30339b2459d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:10.558487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b040d6-3e8a-4470-b819-a30339b2459d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:10.559897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b040d6-3e8a-4470-b819-a30339b2459d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:10.573803 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 628/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:10.579279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c4eeb-bcb7-45f3-adae-1cfb5e2ceda9 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:10.668843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:10.699946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c4eeb-bcb7-45f3-adae-1cfb5e2ceda9 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:10.738467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5748a-893f-4828-965c-e4b456ca45a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:10.739112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5748a-893f-4828-965c-e4b456ca45a4 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:10.739390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5748a-893f-4828-965c-e4b456ca45a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:10.739669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5748a-893f-4828-965c-e4b456ca45a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:10.749861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5748a-893f-4828-965c-e4b456ca45a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:10.751544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5748a-893f-4828-965c-e4b456ca45a4 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:10.770134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-d7b5748a-893f-4828-965c-e4b456ca45a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:07:10.770134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:10.770134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:10.770134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:10.770134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:10.770134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:10.770134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:10.770134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:10.770134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:10.770134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:10.770134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:10.770134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:10.770134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:07:10.770134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:07:10.770134 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:07:10.771530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:07:10.771530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:10.771530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:10.771530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:10.771530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:10.771530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:10.771530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:10.771530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:10.771530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:10.771530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:10.771530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:10.771530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:10.771530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:10.771530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:10.771530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:10.771530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:10.771530 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:10.777744 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:07:10.777744 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:07:10.777744 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:07:10.777744 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:07:10.777744 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:07:10.777744 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:07:10.777744 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:07:10.777744 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:10.777744 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 616/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:07:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:10.778395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b040d6-3e8a-4470-b819-a30339b2459d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:10.902047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b040d6-3e8a-4470-b819-a30339b2459d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:10.941705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f12d4-7298-4d99-b999-5212fd0eab89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:10.942341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f12d4-7298-4d99-b999-5212fd0eab89 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:10.942621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f12d4-7298-4d99-b999-5212fd0eab89 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:10.942922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f12d4-7298-4d99-b999-5212fd0eab89 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:10.943675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f12d4-7298-4d99-b999-5212fd0eab89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:10.943976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f12d4-7298-4d99-b999-5212fd0eab89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:10.945726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f12d4-7298-4d99-b999-5212fd0eab89 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:10.961219 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 629/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:07:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:10.971828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5748a-893f-4828-965c-e4b456ca45a4 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:11.098584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5748a-893f-4828-965c-e4b456ca45a4 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:11.137543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374c51e-738b-4b9c-9696-722ae84de671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:11.138346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374c51e-738b-4b9c-9696-722ae84de671 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:11.138631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374c51e-738b-4b9c-9696-722ae84de671 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:11.138913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374c51e-738b-4b9c-9696-722ae84de671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:11.139687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374c51e-738b-4b9c-9696-722ae84de671 None admin] RBAC: Adding query filter params (role.id=1e0740decc23460f8c3d0f7007f2d97f, scope.project.id=651b8653291a414fba3805312708ce48, user.id=a124350e5c384907b9d80fbe05d07d7e) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:11.139998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374c51e-738b-4b9c-9696-722ae84de671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:11.141447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374c51e-738b-4b9c-9696-722ae84de671 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:11.163372 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 617/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:07:10 2022] GET /identity/v3/role_assignments?user.id=a124350e5c384907b9d80fbe05d07d7e&scope.project.id=651b8653291a414fba3805312708ce48&role.id=1e0740decc23460f8c3d0f7007f2d97f => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:13.216129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2371682-1b7b-4a82-8e4e-0ffecb95f3db None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:13.216691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2371682-1b7b-4a82-8e4e-0ffecb95f3db None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:13.216691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2371682-1b7b-4a82-8e4e-0ffecb95f3db None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:13.217998 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 630/1247] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:07:13.224069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45210f7-47fe-43e6-baca-43552c9cf002 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:13.224561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45210f7-47fe-43e6-baca-43552c9cf002 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:13.224670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45210f7-47fe-43e6-baca-43552c9cf002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:13.231832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:13.247680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a45210f7-47fe-43e6-baca-43552c9cf002 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:07:13.248907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a45210f7-47fe-43e6-baca-43552c9cf002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:07:13.330122 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 618/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:07:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:07:13.655727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2371682-1b7b-4a82-8e4e-0ffecb95f3db None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:13.678181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:13.786610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2371682-1b7b-4a82-8e4e-0ffecb95f3db None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:13.833811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16c2f0-3e51-49da-9b11-9ca0083e4836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:13.834944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16c2f0-3e51-49da-9b11-9ca0083e4836 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:13.835212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16c2f0-3e51-49da-9b11-9ca0083e4836 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:13.835646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16c2f0-3e51-49da-9b11-9ca0083e4836 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:13.849778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16c2f0-3e51-49da-9b11-9ca0083e4836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:07:13.855360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-df16c2f0-3e51-49da-9b11-9ca0083e4836 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:07:13.855360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:13.855360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:13.855360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:13.855360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:13.855360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:13.855360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:13.855360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:13.855360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:13.855360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:13.855360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:13.855360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:13.855360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:07:13.855360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:07:13.855360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:07:13.855360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:07:13.856424 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:07:13.856424 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:07:13.856424 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:07:13.856424 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:07:13.856424 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:13.856424 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:13.856424 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:13.856424 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:13.856424 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:13.856424 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:13.856424 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:13.856424 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:13.856424 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:13.856424 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:13.856424 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:13.856424 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:13.860378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:13.860378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:13.860378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:13.860378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:13.860378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:07:13.860378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:07:13.860378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:07:13.860378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:07:13.860378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:07:13.860378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:07:13.860378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:07:13.860378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:07:13.860378 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 631/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:07:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:13.863214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45210f7-47fe-43e6-baca-43552c9cf002 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:13.977261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45210f7-47fe-43e6-baca-43552c9cf002 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:14.012299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:14.019529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c73b80-fe6e-4f4c-a6a5-82cdbdb3b080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:14.020227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c73b80-fe6e-4f4c-a6a5-82cdbdb3b080 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:14.020525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c73b80-fe6e-4f4c-a6a5-82cdbdb3b080 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:14.020943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c73b80-fe6e-4f4c-a6a5-82cdbdb3b080 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:14.021688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c73b80-fe6e-4f4c-a6a5-82cdbdb3b080 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:14.022004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c73b80-fe6e-4f4c-a6a5-82cdbdb3b080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:14.023726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c73b80-fe6e-4f4c-a6a5-82cdbdb3b080 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:14.037696 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 619/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:07:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:14.044303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16c2f0-3e51-49da-9b11-9ca0083e4836 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:14.137473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:14.168581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16c2f0-3e51-49da-9b11-9ca0083e4836 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:14.210761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da4ef4-6cb1-4cd3-964f-7665d0db63c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:14.211477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da4ef4-6cb1-4cd3-964f-7665d0db63c9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:14.211751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da4ef4-6cb1-4cd3-964f-7665d0db63c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:14.212022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da4ef4-6cb1-4cd3-964f-7665d0db63c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:14.224515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da4ef4-6cb1-4cd3-964f-7665d0db63c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:14.226218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da4ef4-6cb1-4cd3-964f-7665d0db63c9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:14.246203 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-69da4ef4-6cb1-4cd3-964f-7665d0db63c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:14.246203 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:14.246203 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:14.246203 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:14.246203 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:14.246203 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:14.246203 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:14.246203 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:14.246203 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:14.246203 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:14.246203 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:14.246203 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:14.246203 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:07:14.246203 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:07:14.246203 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:07:14.246203 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:07:14.247519 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:14.247519 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:14.247519 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:14.247519 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:14.247519 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:14.247519 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:14.247519 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:14.247519 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:14.247519 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:14.247519 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:14.247519 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:14.247519 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:14.247519 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:14.247519 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:14.247519 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:14.247519 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:14.247519 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:07:14.248427 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:07:14.248427 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:14.248427 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:07:14.248427 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 632/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:07:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:14.252803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c73b80-fe6e-4f4c-a6a5-82cdbdb3b080 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:14.373586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c73b80-fe6e-4f4c-a6a5-82cdbdb3b080 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:14.412524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b738a5-0d9d-41e2-8e58-298b846f9aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:14.413115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b738a5-0d9d-41e2-8e58-298b846f9aa9 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:14.413449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b738a5-0d9d-41e2-8e58-298b846f9aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:14.413763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b738a5-0d9d-41e2-8e58-298b846f9aa9 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:14.414575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b738a5-0d9d-41e2-8e58-298b846f9aa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:14.414951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b738a5-0d9d-41e2-8e58-298b846f9aa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:14.416421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b738a5-0d9d-41e2-8e58-298b846f9aa9 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:14.431154 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 620/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:14.437110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da4ef4-6cb1-4cd3-964f-7665d0db63c9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:14.551604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da4ef4-6cb1-4cd3-964f-7665d0db63c9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:14.587270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:14.598273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace033c-7f73-4376-89d3-752069a16513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:14.598927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace033c-7f73-4376-89d3-752069a16513 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:14.599202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace033c-7f73-4376-89d3-752069a16513 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:14.599500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace033c-7f73-4376-89d3-752069a16513 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:14.608170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace033c-7f73-4376-89d3-752069a16513 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:14.609649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace033c-7f73-4376-89d3-752069a16513 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:14.621629 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-4ace033c-7f73-4376-89d3-752069a16513 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:07:14.621629 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:14.621629 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:14.621629 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:14.621629 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:14.621629 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:14.621629 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:14.621629 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:14.621629 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:14.621629 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:14.621629 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:14.621629 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:14.621629 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:07:14.621629 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:07:14.621629 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:07:14.621629 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:14.622623 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:14.623628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:14.623628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:14.623628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:07:14.623628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:07:14.623628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:07:14.623628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:07:14.623628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:07:14.623628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:07:14.623628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:07:14.623628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:07:14.623628 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 633/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:07:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:07:14.629469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b738a5-0d9d-41e2-8e58-298b846f9aa9 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:14.699956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:14.753611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b738a5-0d9d-41e2-8e58-298b846f9aa9 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:14.813828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d6c65-8ab5-4c48-91ee-ee6967c97cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:14.814565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d6c65-8ab5-4c48-91ee-ee6967c97cc3 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:14.814841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d6c65-8ab5-4c48-91ee-ee6967c97cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:14.815289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d6c65-8ab5-4c48-91ee-ee6967c97cc3 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:14.816059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d6c65-8ab5-4c48-91ee-ee6967c97cc3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:14.816513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d6c65-8ab5-4c48-91ee-ee6967c97cc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:14.818280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d6c65-8ab5-4c48-91ee-ee6967c97cc3 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:14.842319 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 621/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 28 18:07:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:14.848463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace033c-7f73-4376-89d3-752069a16513 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:14.981120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace033c-7f73-4376-89d3-752069a16513 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:15.030342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30fbd7-82ec-446e-a75a-4a89771a9ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:15.031030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30fbd7-82ec-446e-a75a-4a89771a9ff6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:15.031351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30fbd7-82ec-446e-a75a-4a89771a9ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:15.032117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30fbd7-82ec-446e-a75a-4a89771a9ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:15.105223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:15.121593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30fbd7-82ec-446e-a75a-4a89771a9ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:15.123314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30fbd7-82ec-446e-a75a-4a89771a9ff6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:15.248448 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 634/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:07:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:07:15.257198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d6c65-8ab5-4c48-91ee-ee6967c97cc3 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:15.386132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d6c65-8ab5-4c48-91ee-ee6967c97cc3 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:15.404414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:15.434683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41725ddc-bcc4-494c-9834-a8f4c8447e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:15.435390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41725ddc-bcc4-494c-9834-a8f4c8447e7f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:15.438205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41725ddc-bcc4-494c-9834-a8f4c8447e7f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:15.438205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41725ddc-bcc4-494c-9834-a8f4c8447e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:15.449122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41725ddc-bcc4-494c-9834-a8f4c8447e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:15.450681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41725ddc-bcc4-494c-9834-a8f4c8447e7f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:15.468299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-41725ddc-bcc4-494c-9834-a8f4c8447e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:15.468299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:15.468299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:15.468299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:15.468299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:15.468299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:15.468299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:15.468299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:15.468299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:15.468299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:15.468299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:15.468299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:15.468299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:07:15.468299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:07:15.468299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:07:15.468299 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:07:15.470095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:15.470095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:15.470095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:15.470095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:15.470095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:15.470095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:15.470095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:15.470095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:15.470095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:15.470095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:15.470095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:15.470095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:15.470095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:15.470095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:15.470095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:15.470095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:15.470095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:07:15.471566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:07:15.471566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:15.471566 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:15.474479 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 622/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:07:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:15.477068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30fbd7-82ec-446e-a75a-4a89771a9ff6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:15.581259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:15.595284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30fbd7-82ec-446e-a75a-4a89771a9ff6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:15.642652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32990f30-a1c8-4ca2-9b96-038d08b7801b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:15.643324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990f30-a1c8-4ca2-9b96-038d08b7801b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:15.643603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990f30-a1c8-4ca2-9b96-038d08b7801b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:15.643878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990f30-a1c8-4ca2-9b96-038d08b7801b None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:15.644526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32990f30-a1c8-4ca2-9b96-038d08b7801b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:15.644828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32990f30-a1c8-4ca2-9b96-038d08b7801b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:15.646210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32990f30-a1c8-4ca2-9b96-038d08b7801b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:15.660407 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 635/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:15.666600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41725ddc-bcc4-494c-9834-a8f4c8447e7f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:15.798387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41725ddc-bcc4-494c-9834-a8f4c8447e7f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:15.847061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32824037-5ac4-46b0-bf1c-33e139cde0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:15.847747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32824037-5ac4-46b0-bf1c-33e139cde0d8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:15.848022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32824037-5ac4-46b0-bf1c-33e139cde0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:15.848291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32824037-5ac4-46b0-bf1c-33e139cde0d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:15.856594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32824037-5ac4-46b0-bf1c-33e139cde0d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:15.858060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32824037-5ac4-46b0-bf1c-33e139cde0d8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:15.871780 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-32824037-5ac4-46b0-bf1c-33e139cde0d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:07:15.871780 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:15.871780 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:15.871780 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:15.871780 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:15.871780 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:15.871780 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:15.871780 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:15.871780 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:15.871780 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:15.871780 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:15.871780 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:15.871780 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:07:15.871780 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:07:15.871780 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:07:15.872947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:07:15.872947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:15.872947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:15.872947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:15.872947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:15.872947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:15.872947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:15.872947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:15.872947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:15.872947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:15.872947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:15.872947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:15.872947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:15.872947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:15.872947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:15.872947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:15.872947 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:15.873863 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:07:15.873863 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:07:15.873863 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:07:15.873863 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:07:15.873863 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:07:15.873863 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:07:15.873863 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:07:15.873863 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:15.873863 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 623/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:07:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:15.879532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32990f30-a1c8-4ca2-9b96-038d08b7801b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:16.002039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32990f30-a1c8-4ca2-9b96-038d08b7801b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:16.039292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714cc6d-c734-478f-af5e-97b8f7e46005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:16.039970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714cc6d-c734-478f-af5e-97b8f7e46005 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:16.040271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714cc6d-c734-478f-af5e-97b8f7e46005 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:16.040547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714cc6d-c734-478f-af5e-97b8f7e46005 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:16.041246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714cc6d-c734-478f-af5e-97b8f7e46005 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:16.041552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714cc6d-c734-478f-af5e-97b8f7e46005 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:16.043127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714cc6d-c734-478f-af5e-97b8f7e46005 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:16.056893 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 636/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:07:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:07:16.063903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32824037-5ac4-46b0-bf1c-33e139cde0d8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:16.099099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:16.200656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32824037-5ac4-46b0-bf1c-33e139cde0d8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:16.247556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9624640-2f7d-4709-99fc-ebd5458c3cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:16.248574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9624640-2f7d-4709-99fc-ebd5458c3cab None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:16.249057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9624640-2f7d-4709-99fc-ebd5458c3cab None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:16.249502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9624640-2f7d-4709-99fc-ebd5458c3cab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:16.250819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9624640-2f7d-4709-99fc-ebd5458c3cab None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=651b8653291a414fba3805312708ce48, user.id=a124350e5c384907b9d80fbe05d07d7e) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:16.251187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9624640-2f7d-4709-99fc-ebd5458c3cab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:16.253532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9624640-2f7d-4709-99fc-ebd5458c3cab None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:16.262075 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 624/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:07:16 2022] GET /identity/v3/role_assignments?user.id=a124350e5c384907b9d80fbe05d07d7e&scope.project.id=651b8653291a414fba3805312708ce48&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:18.191066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4c139-d408-4c02-b201-b784cc4975a6 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:18.191723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4c139-d408-4c02-b201-b784cc4975a6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:18.191723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4c139-d408-4c02-b201-b784cc4975a6 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:18.192996 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 637/1261] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:07:18.198889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d217f1a-9efe-4a39-989a-54df96bde64e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:18.199455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d217f1a-9efe-4a39-989a-54df96bde64e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:18.199455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d217f1a-9efe-4a39-989a-54df96bde64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:18.219314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3d217f1a-9efe-4a39-989a-54df96bde64e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:07:18.220568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3d217f1a-9efe-4a39-989a-54df96bde64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:07:18.300245 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 625/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:07:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:07:18.564685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4c139-d408-4c02-b201-b784cc4975a6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:18.576561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:18.678675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4c139-d408-4c02-b201-b784cc4975a6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:18.717016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef477ed-7b9e-47dc-84d4-4a15b0029234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:18.717016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef477ed-7b9e-47dc-84d4-4a15b0029234 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:18.717016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef477ed-7b9e-47dc-84d4-4a15b0029234 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:18.717016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef477ed-7b9e-47dc-84d4-4a15b0029234 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:18.727585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef477ed-7b9e-47dc-84d4-4a15b0029234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:07:18.732367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-8ef477ed-7b9e-47dc-84d4-4a15b0029234 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:07:18.732367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:18.732367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:18.732367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:18.732367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:18.732367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:18.732367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:18.732367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:18.732367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:18.732367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:18.732367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:18.732367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:18.732367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:07:18.732367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:07:18.732367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:07:18.732367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:07:18.733453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:07:18.733453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:07:18.733453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:07:18.733453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:07:18.733453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:18.733453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:18.733453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:18.733453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:18.733453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:18.733453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:18.733453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:18.733453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:18.733453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:18.733453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:18.733453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:18.733453 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:18.734432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:18.734432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:18.734432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:18.734432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:18.734432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:07:18.734432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:07:18.734432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:07:18.734432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:07:18.734432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:07:18.734432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:07:18.734432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:07:18.734432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:07:18.734432 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 638/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:07:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:18.739766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d217f1a-9efe-4a39-989a-54df96bde64e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:18.762178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:18.865630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d217f1a-9efe-4a39-989a-54df96bde64e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:18.908140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0885f7-8b9b-4224-9c0a-5f362c3ac252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:18.908997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0885f7-8b9b-4224-9c0a-5f362c3ac252 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:18.909398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0885f7-8b9b-4224-9c0a-5f362c3ac252 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:18.909808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0885f7-8b9b-4224-9c0a-5f362c3ac252 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:18.910858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0885f7-8b9b-4224-9c0a-5f362c3ac252 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:18.911343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0885f7-8b9b-4224-9c0a-5f362c3ac252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:18.913176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0885f7-8b9b-4224-9c0a-5f362c3ac252 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:18.924896 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 626/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:07:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:18.931198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef477ed-7b9e-47dc-84d4-4a15b0029234 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:19.015556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:19.053564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef477ed-7b9e-47dc-84d4-4a15b0029234 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:19.090654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3527360-7fa2-4fa7-a3e4-b9db9dfb25f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:19.091311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3527360-7fa2-4fa7-a3e4-b9db9dfb25f7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:19.091582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3527360-7fa2-4fa7-a3e4-b9db9dfb25f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:19.091869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3527360-7fa2-4fa7-a3e4-b9db9dfb25f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:19.106416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3527360-7fa2-4fa7-a3e4-b9db9dfb25f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:19.109037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3527360-7fa2-4fa7-a3e4-b9db9dfb25f7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:19.127278 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-c3527360-7fa2-4fa7-a3e4-b9db9dfb25f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:19.127278 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:19.127278 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:19.127278 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:19.127278 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:19.127278 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:19.127278 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:19.127278 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:19.127278 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:19.127278 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:19.127278 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:19.127278 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:19.127278 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:07:19.127278 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:07:19.127278 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:07:19.127278 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:07:19.128378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:19.128378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:19.128378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:19.128378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:19.128378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:19.128378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:19.128378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:19.128378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:19.128378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:19.128378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:19.128378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:19.128378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:19.128378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:19.128378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:19.128378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:19.128378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:19.128378 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:07:19.129717 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:07:19.129717 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:19.129717 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:07:19.129717 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 639/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:19.134771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0885f7-8b9b-4224-9c0a-5f362c3ac252 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:19.226049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:19.253508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0885f7-8b9b-4224-9c0a-5f362c3ac252 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:19.291483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d78f2-b8a9-414a-85ab-a7a15e5bce2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:19.292089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d78f2-b8a9-414a-85ab-a7a15e5bce2f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:19.292363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d78f2-b8a9-414a-85ab-a7a15e5bce2f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:19.292631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d78f2-b8a9-414a-85ab-a7a15e5bce2f None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:19.293276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d78f2-b8a9-414a-85ab-a7a15e5bce2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:19.293572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d78f2-b8a9-414a-85ab-a7a15e5bce2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:19.294924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d78f2-b8a9-414a-85ab-a7a15e5bce2f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:19.308082 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 627/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:19.314272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3527360-7fa2-4fa7-a3e4-b9db9dfb25f7 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:19.426704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3527360-7fa2-4fa7-a3e4-b9db9dfb25f7 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:19.449095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:19.468395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35749c-a8fa-48e2-afb5-d1e5185634ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:19.469035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35749c-a8fa-48e2-afb5-d1e5185634ab None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:19.469314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35749c-a8fa-48e2-afb5-d1e5185634ab None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:19.469587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35749c-a8fa-48e2-afb5-d1e5185634ab None admin] PATH_INFO: `/v3/users/placement` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:19.479543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35749c-a8fa-48e2-afb5-d1e5185634ab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:19.481001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35749c-a8fa-48e2-afb5-d1e5185634ab None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:19.494676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-de35749c-a8fa-48e2-afb5-d1e5185634ab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:07:19.494676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:19.494676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:19.494676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:19.494676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:19.494676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:19.494676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:19.494676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:19.494676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:19.494676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:19.494676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:19.494676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:19.494676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:07:19.494676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:07:19.494676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:07:19.494676 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:19.495869 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:19.496949 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:19.496949 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:19.496949 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:07:19.496949 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:07:19.496949 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:07:19.496949 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:07:19.496949 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:07:19.496949 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:07:19.496949 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:07:19.496949 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:07:19.499434 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 640/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:07:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:19.501806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d78f2-b8a9-414a-85ab-a7a15e5bce2f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:19.618941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d78f2-b8a9-414a-85ab-a7a15e5bce2f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:19.655941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b60ce4-c201-4fdd-b423-3c4433e7a45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:19.656549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b60ce4-c201-4fdd-b423-3c4433e7a45f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:19.656819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b60ce4-c201-4fdd-b423-3c4433e7a45f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:19.657091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b60ce4-c201-4fdd-b423-3c4433e7a45f None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:19.657862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b60ce4-c201-4fdd-b423-3c4433e7a45f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:19.658165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b60ce4-c201-4fdd-b423-3c4433e7a45f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:19.659629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b60ce4-c201-4fdd-b423-3c4433e7a45f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:19.669056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:19.678504 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 628/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 28 18:07:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:19.684388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35749c-a8fa-48e2-afb5-d1e5185634ab None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:19.814528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35749c-a8fa-48e2-afb5-d1e5185634ab None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:19.850381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6b61a-51df-4ce4-a1fb-5083e04173f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:19.851018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6b61a-51df-4ce4-a1fb-5083e04173f1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:19.851293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6b61a-51df-4ce4-a1fb-5083e04173f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:19.851595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6b61a-51df-4ce4-a1fb-5083e04173f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:19.863107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6b61a-51df-4ce4-a1fb-5083e04173f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:19.864588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6b61a-51df-4ce4-a1fb-5083e04173f1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:19.879737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e7a6b61a-51df-4ce4-a1fb-5083e04173f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:19.879737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:19.879737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:19.879737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:19.879737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:19.879737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:19.879737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:19.879737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:19.879737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:19.879737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:19.879737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:19.879737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:19.879737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:07:19.879737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:07:19.879737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:07:19.879737 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:07:19.880854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:19.880854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:19.880854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:19.880854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:19.880854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:19.880854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:19.880854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:19.880854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:19.880854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:19.880854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:19.880854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:19.880854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:19.880854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:19.880854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:19.880854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:19.880854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:19.880854 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:07:19.881805 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:07:19.881805 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:19.881805 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:07:19.881805 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 641/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:07:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:19.887100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b60ce4-c201-4fdd-b423-3c4433e7a45f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:20.002468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b60ce4-c201-4fdd-b423-3c4433e7a45f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:20.040580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b86569-69f8-4004-af02-efda385f6f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:20.041185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b86569-69f8-4004-af02-efda385f6f1f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:20.041463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b86569-69f8-4004-af02-efda385f6f1f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:20.041735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b86569-69f8-4004-af02-efda385f6f1f None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:20.042457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b86569-69f8-4004-af02-efda385f6f1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:20.042683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b86569-69f8-4004-af02-efda385f6f1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:20.044094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b86569-69f8-4004-af02-efda385f6f1f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:20.056161 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 629/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:20.064973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6b61a-51df-4ce4-a1fb-5083e04173f1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:20.098111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:20.174895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6b61a-51df-4ce4-a1fb-5083e04173f1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:20.210908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198d367-a8c5-4ce1-adf9-8bcdb92f6070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:20.211571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198d367-a8c5-4ce1-adf9-8bcdb92f6070 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:20.211843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198d367-a8c5-4ce1-adf9-8bcdb92f6070 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:20.212107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198d367-a8c5-4ce1-adf9-8bcdb92f6070 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:20.219238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198d367-a8c5-4ce1-adf9-8bcdb92f6070 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:20.220752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198d367-a8c5-4ce1-adf9-8bcdb92f6070 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:20.232969 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b198d367-a8c5-4ce1-adf9-8bcdb92f6070 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:07:20.232969 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:20.232969 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:20.232969 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:20.232969 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:20.232969 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:20.232969 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:20.232969 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:20.232969 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:20.232969 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:20.232969 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:20.232969 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:20.232969 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:07:20.232969 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:07:20.232969 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:07:20.234031 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:07:20.234031 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:20.234031 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:20.234031 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:20.234031 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:20.234031 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:20.234031 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:20.234031 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:20.234031 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:20.234031 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:20.234031 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:20.234031 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:20.234031 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:20.234031 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:20.234031 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:20.234031 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:20.234031 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:20.234919 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:07:20.234919 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:07:20.234919 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:07:20.234919 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:07:20.234919 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:07:20.234919 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:07:20.234919 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:07:20.234919 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:07:20.234919 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 642/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:07:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:20.240499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b86569-69f8-4004-af02-efda385f6f1f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:20.307060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:20.358443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b86569-69f8-4004-af02-efda385f6f1f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:20.396505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ec80b-1095-4e2d-a014-23d73d747f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:20.397124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ec80b-1095-4e2d-a014-23d73d747f9c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:20.397401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ec80b-1095-4e2d-a014-23d73d747f9c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:20.397667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ec80b-1095-4e2d-a014-23d73d747f9c None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:20.398369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ec80b-1095-4e2d-a014-23d73d747f9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:20.398671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ec80b-1095-4e2d-a014-23d73d747f9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:20.400923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ec80b-1095-4e2d-a014-23d73d747f9c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:20.414516 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 630/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:07:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:20.420986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198d367-a8c5-4ce1-adf9-8bcdb92f6070 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:20.519817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:20.530823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198d367-a8c5-4ce1-adf9-8bcdb92f6070 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:20.572529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd64836-fc60-48fb-8cdd-6316510db661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:20.573379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd64836-fc60-48fb-8cdd-6316510db661 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:20.573654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd64836-fc60-48fb-8cdd-6316510db661 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:20.573935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd64836-fc60-48fb-8cdd-6316510db661 None admin] PATH_INFO: `/v3/projects/651b8653291a414fba3805312708ce48/users/a124350e5c384907b9d80fbe05d07d7e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:20.577263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd64836-fc60-48fb-8cdd-6316510db661 None admin] RBAC: Authorizing `identity:create_grant(project_id=651b8653291a414fba3805312708ce48, user_id=a124350e5c384907b9d80fbe05d07d7e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:20.579713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd64836-fc60-48fb-8cdd-6316510db661 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:20.601204 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 643/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 18:07:20 2022] PUT /identity/v3/projects/651b8653291a414fba3805312708ce48/users/a124350e5c384907b9d80fbe05d07d7e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:07:22.471672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33475f3e-3122-438d-ab66-9064c2519ca6 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:22.472230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33475f3e-3122-438d-ab66-9064c2519ca6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:22.472230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33475f3e-3122-438d-ab66-9064c2519ca6 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:22.473542 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 631/1274] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:07:22.478941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc804989-46bc-49b4-b121-1a18da13ca5c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:22.479407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc804989-46bc-49b4-b121-1a18da13ca5c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:22.479499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc804989-46bc-49b4-b121-1a18da13ca5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:22.498383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fc804989-46bc-49b4-b121-1a18da13ca5c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:07:22.499636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc804989-46bc-49b4-b121-1a18da13ca5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:07:22.574515 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 644/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:07:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:07:22.863441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33475f3e-3122-438d-ab66-9064c2519ca6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:22.981588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33475f3e-3122-438d-ab66-9064c2519ca6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:23.004077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:23.022889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41c4fe-f61f-4adc-8fca-d0a24fa1dcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:23.023712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41c4fe-f61f-4adc-8fca-d0a24fa1dcb2 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:23.024125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41c4fe-f61f-4adc-8fca-d0a24fa1dcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:23.024560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41c4fe-f61f-4adc-8fca-d0a24fa1dcb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:23.039095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41c4fe-f61f-4adc-8fca-d0a24fa1dcb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:07:23.046160 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-de41c4fe-f61f-4adc-8fca-d0a24fa1dcb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:07:23.046160 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:23.046160 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:23.046160 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:23.046160 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:23.046160 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:23.046160 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:23.046160 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:23.046160 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:23.046160 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:23.046160 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:23.046160 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:23.046160 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:07:23.046160 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:07:23.046160 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:07:23.046160 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:07:23.047287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:07:23.047287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:07:23.047287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:07:23.047287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:07:23.047287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:23.047287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:23.047287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:23.047287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:23.047287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:23.047287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:23.047287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:23.047287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:23.047287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:23.047287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:23.047287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:23.047287 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:23.048553 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:23.048553 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:23.048553 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:23.048553 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:23.048553 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:07:23.048553 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:07:23.048553 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:07:23.048553 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:07:23.048553 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:07:23.048553 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:07:23.048553 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:07:23.048553 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:23.048553 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 632/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 18:07:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:23.053940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc804989-46bc-49b4-b121-1a18da13ca5c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:23.140912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:23.162455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc804989-46bc-49b4-b121-1a18da13ca5c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:23.200673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4dfbe-5c4b-4b60-86be-e5d6bf25dcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:23.201310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4dfbe-5c4b-4b60-86be-e5d6bf25dcd0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:23.201586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4dfbe-5c4b-4b60-86be-e5d6bf25dcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:23.201857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4dfbe-5c4b-4b60-86be-e5d6bf25dcd0 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:23.202527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4dfbe-5c4b-4b60-86be-e5d6bf25dcd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:23.202828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4dfbe-5c4b-4b60-86be-e5d6bf25dcd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:23.204214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4dfbe-5c4b-4b60-86be-e5d6bf25dcd0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:23.212946 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 645/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 18:07:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:23.218965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41c4fe-f61f-4adc-8fca-d0a24fa1dcb2 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:23.335728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41c4fe-f61f-4adc-8fca-d0a24fa1dcb2 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:23.384775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f3fb6-860a-4f4c-9d6c-ad107bea1713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:23.385402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3fb6-860a-4f4c-9d6c-ad107bea1713 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:23.385682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3fb6-860a-4f4c-9d6c-ad107bea1713 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:23.385959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3fb6-860a-4f4c-9d6c-ad107bea1713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:23.396892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f3fb6-860a-4f4c-9d6c-ad107bea1713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:23.398275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f3fb6-860a-4f4c-9d6c-ad107bea1713 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:23.416641 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-6a3f3fb6-860a-4f4c-9d6c-ad107bea1713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:23.416641 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:23.416641 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:23.416641 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:23.416641 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:23.416641 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:23.416641 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:23.416641 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:23.416641 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:23.416641 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:23.416641 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:23.416641 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:23.416641 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:07:23.416641 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:07:23.416641 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:07:23.416641 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:07:23.417835 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:23.417835 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:23.417835 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:23.417835 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:23.417835 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:23.417835 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:23.417835 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:23.417835 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:23.417835 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:23.417835 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:23.417835 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:23.417835 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:23.417835 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:23.417835 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:23.417835 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:23.417835 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:23.417835 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:07:23.418971 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:07:23.418971 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:23.418971 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:23.418971 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 633/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:23.424227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4dfbe-5c4b-4b60-86be-e5d6bf25dcd0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:23.530416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4dfbe-5c4b-4b60-86be-e5d6bf25dcd0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:23.566995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d82103-c525-4f0b-adc5-0d7b1546618d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:23.567641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d82103-c525-4f0b-adc5-0d7b1546618d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:23.567918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d82103-c525-4f0b-adc5-0d7b1546618d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:23.568191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d82103-c525-4f0b-adc5-0d7b1546618d None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:23.568838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d82103-c525-4f0b-adc5-0d7b1546618d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:23.569140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d82103-c525-4f0b-adc5-0d7b1546618d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:23.570535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d82103-c525-4f0b-adc5-0d7b1546618d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:23.584284 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 646/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:23.590792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f3fb6-860a-4f4c-9d6c-ad107bea1713 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:23.625209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:23.714364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f3fb6-860a-4f4c-9d6c-ad107bea1713 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:23.752530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643a096-ca52-467d-a333-c1e72845c9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:23.753231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643a096-ca52-467d-a333-c1e72845c9f1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:23.753510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643a096-ca52-467d-a333-c1e72845c9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:23.754120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643a096-ca52-467d-a333-c1e72845c9f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:23.765025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643a096-ca52-467d-a333-c1e72845c9f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:23.767111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643a096-ca52-467d-a333-c1e72845c9f1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:23.781120 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-0643a096-ca52-467d-a333-c1e72845c9f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:07:23.781120 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:23.781120 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:23.781120 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:23.781120 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:23.781120 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:23.781120 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:23.781120 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:23.781120 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:23.781120 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:23.781120 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:23.781120 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:23.781120 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:07:23.781120 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:07:23.781120 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:07:23.781120 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:23.782685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:23.783853 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:23.783853 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:23.783853 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:07:23.783853 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:07:23.783853 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:07:23.783853 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:07:23.783853 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:07:23.783853 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:07:23.783853 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:07:23.783853 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:23.783853 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 634/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:07:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:23.789130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d82103-c525-4f0b-adc5-0d7b1546618d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:23.793717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:23.897881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d82103-c525-4f0b-adc5-0d7b1546618d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:23.942008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14770e69-2771-4295-bca3-390de6226d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:23.942639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14770e69-2771-4295-bca3-390de6226d78 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:23.942923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14770e69-2771-4295-bca3-390de6226d78 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:23.943200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14770e69-2771-4295-bca3-390de6226d78 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:23.943981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14770e69-2771-4295-bca3-390de6226d78 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:23.944289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14770e69-2771-4295-bca3-390de6226d78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:23.945750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14770e69-2771-4295-bca3-390de6226d78 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:23.966749 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 647/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 28 18:07:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:23.973326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643a096-ca52-467d-a333-c1e72845c9f1 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:24.079688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:24.090869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643a096-ca52-467d-a333-c1e72845c9f1 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:24.132417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac82dc-329f-401c-ba9f-8a26b91b3028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:24.133026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac82dc-329f-401c-ba9f-8a26b91b3028 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:24.133299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac82dc-329f-401c-ba9f-8a26b91b3028 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:24.133569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac82dc-329f-401c-ba9f-8a26b91b3028 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:24.206121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac82dc-329f-401c-ba9f-8a26b91b3028 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:24.207611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac82dc-329f-401c-ba9f-8a26b91b3028 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:24.298449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:24.310387 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 635/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 18:07:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:07:24.316639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14770e69-2771-4295-bca3-390de6226d78 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:24.388684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:24.430048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14770e69-2771-4295-bca3-390de6226d78 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:24.468561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85273d1d-1b90-4d1f-ace5-a6ddd52e3417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:24.469194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85273d1d-1b90-4d1f-ace5-a6ddd52e3417 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:24.469451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85273d1d-1b90-4d1f-ace5-a6ddd52e3417 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:24.469710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85273d1d-1b90-4d1f-ace5-a6ddd52e3417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:24.480496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85273d1d-1b90-4d1f-ace5-a6ddd52e3417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:24.481954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85273d1d-1b90-4d1f-ace5-a6ddd52e3417 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:24.500563 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-85273d1d-1b90-4d1f-ace5-a6ddd52e3417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:24.500563 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:24.500563 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:24.500563 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:24.500563 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:24.500563 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:24.500563 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:24.500563 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:24.500563 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:24.500563 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:24.500563 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:24.500563 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:24.500563 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:07:24.500563 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:07:24.500563 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:07:24.500563 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:07:24.501993 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:24.501993 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:24.501993 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:24.501993 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:24.501993 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:24.501993 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:24.501993 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:24.501993 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:24.501993 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:24.501993 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:24.501993 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:24.501993 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:24.501993 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:24.501993 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:24.501993 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:24.501993 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:24.501993 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:07:24.503088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:07:24.503088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:07:24.503088 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:07:24.503088 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 648/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:07:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:24.508258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac82dc-329f-401c-ba9f-8a26b91b3028 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:24.621479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac82dc-329f-401c-ba9f-8a26b91b3028 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:24.661515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ddeb2-bfd1-4020-a8e2-1805ad294a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:24.662098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ddeb2-bfd1-4020-a8e2-1805ad294a44 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:24.662370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ddeb2-bfd1-4020-a8e2-1805ad294a44 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:24.662667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ddeb2-bfd1-4020-a8e2-1805ad294a44 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:24.663309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ddeb2-bfd1-4020-a8e2-1805ad294a44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:24.663638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ddeb2-bfd1-4020-a8e2-1805ad294a44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:24.664996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ddeb2-bfd1-4020-a8e2-1805ad294a44 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:24.677345 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 636/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 18:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:24.683534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85273d1d-1b90-4d1f-ace5-a6ddd52e3417 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:24.805510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85273d1d-1b90-4d1f-ace5-a6ddd52e3417 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:24.819613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:24.842992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7f8b8-ed38-4d45-8f53-c7390b3e0220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:24.843665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7f8b8-ed38-4d45-8f53-c7390b3e0220 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:24.843946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7f8b8-ed38-4d45-8f53-c7390b3e0220 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:24.844222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7f8b8-ed38-4d45-8f53-c7390b3e0220 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:24.851177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7f8b8-ed38-4d45-8f53-c7390b3e0220 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:24.852653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7f8b8-ed38-4d45-8f53-c7390b3e0220 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:24.864026 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-0fa7f8b8-ed38-4d45-8f53-c7390b3e0220 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:07:24.864026 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:24.864026 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:24.864026 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:24.864026 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:24.864026 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:24.864026 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:24.864026 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:24.864026 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:24.864026 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:24.864026 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:24.864026 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:24.864026 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:07:24.864026 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:07:24.864026 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:07:24.865077 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:07:24.865077 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:24.865077 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:24.865077 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:24.865077 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:24.865077 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:24.865077 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:24.865077 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:24.865077 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:24.865077 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:24.865077 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:24.865077 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:24.865077 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:24.865077 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:24.865077 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:24.865077 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:24.865077 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:24.866145 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:07:24.866145 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:07:24.866145 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:07:24.866145 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:07:24.866145 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:07:24.866145 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:07:24.866145 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:07:24.866145 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:07:24.866145 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 649/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 18:07:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:24.871310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ddeb2-bfd1-4020-a8e2-1805ad294a44 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:24.929204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:24.991629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ddeb2-bfd1-4020-a8e2-1805ad294a44 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:25.034267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52748142-f104-454a-9b4e-5346e6586267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:25.034877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52748142-f104-454a-9b4e-5346e6586267 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:25.035151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52748142-f104-454a-9b4e-5346e6586267 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:25.035451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52748142-f104-454a-9b4e-5346e6586267 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:25.036152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52748142-f104-454a-9b4e-5346e6586267 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:25.036455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52748142-f104-454a-9b4e-5346e6586267 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:25.037879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52748142-f104-454a-9b4e-5346e6586267 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:25.052803 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 637/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 18:07:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:25.059491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7f8b8-ed38-4d45-8f53-c7390b3e0220 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:25.173608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7f8b8-ed38-4d45-8f53-c7390b3e0220 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:25.211814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01aee8-e674-4209-9559-1f6ea0cdd694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:25.212431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01aee8-e674-4209-9559-1f6ea0cdd694 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:25.212707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01aee8-e674-4209-9559-1f6ea0cdd694 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:25.212977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01aee8-e674-4209-9559-1f6ea0cdd694 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:25.213709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01aee8-e674-4209-9559-1f6ea0cdd694 None admin] RBAC: Adding query filter params (role.id=57de4e6fb8c54c94bbcb10d57ae795e1, scope.project.id=651b8653291a414fba3805312708ce48, user.id=a124350e5c384907b9d80fbe05d07d7e) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:25.214022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01aee8-e674-4209-9559-1f6ea0cdd694 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:25.215513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01aee8-e674-4209-9559-1f6ea0cdd694 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:25.221724 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 650/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 18:07:25 2022] GET /identity/v3/role_assignments?user.id=a124350e5c384907b9d80fbe05d07d7e&scope.project.id=651b8653291a414fba3805312708ce48&role.id=57de4e6fb8c54c94bbcb10d57ae795e1 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:27.159582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa81715-1084-47ba-965c-cd3daa482404 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:27.160141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa81715-1084-47ba-965c-cd3daa482404 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:27.160141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa81715-1084-47ba-965c-cd3daa482404 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:27.161453 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 638/1288] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:07:27.166993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2ddc4-44db-410a-8a43-98c6f0d229b1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:27.167464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2ddc4-44db-410a-8a43-98c6f0d229b1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:27.167554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2ddc4-44db-410a-8a43-98c6f0d229b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:27.186788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-10b2ddc4-44db-410a-8a43-98c6f0d229b1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:07:27.188024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-10b2ddc4-44db-410a-8a43-98c6f0d229b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:07:27.218517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:27.258659 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 651/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:07:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:07:27.523986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa81715-1084-47ba-965c-cd3daa482404 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:27.637028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa81715-1084-47ba-965c-cd3daa482404 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:27.649751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:27.677967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ff0b5-9c3c-4459-a23a-3384e33421a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:27.678597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ff0b5-9c3c-4459-a23a-3384e33421a8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:27.678877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ff0b5-9c3c-4459-a23a-3384e33421a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:27.679152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ff0b5-9c3c-4459-a23a-3384e33421a8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:27.679773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ff0b5-9c3c-4459-a23a-3384e33421a8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:27.681157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ff0b5-9c3c-4459-a23a-3384e33421a8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:27.690402 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-c19ff0b5-9c3c-4459-a23a-3384e33421a8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:07:27.690402 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:27.690402 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:07:27.690402 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:07:27.690402 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:07:27.690402 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:07:27.690402 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:07:27.690402 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:07:27.690402 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:07:27.690402 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:27.690402 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:07:27.690402 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:27.690402 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:27.690402 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:27.690402 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:27.690402 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:27.690402 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:27.691671 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:27.691671 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:27.691671 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:27.691671 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:27.691671 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:27.691671 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:27.691671 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:07:27.691671 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:07:27.691671 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:07:27.691671 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:07:27.691671 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:27.691671 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:27.691671 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:27.691671 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:27.691671 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:27.691671 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:27.692572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:27.692572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:27.692572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:27.692572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:27.692572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:27.692572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:27.692572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:27.692572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:27.692572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:27.692572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:27.692572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:07:27.692572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:07:27.692572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:07:27.692572 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:27.692572 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 639/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 18:07:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:27.698103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2ddc4-44db-410a-8a43-98c6f0d229b1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:27.812653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2ddc4-44db-410a-8a43-98c6f0d229b1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:27.854939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eeac24-8adf-4ebe-99fe-e08b49b29485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:27.855592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeac24-8adf-4ebe-99fe-e08b49b29485 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:27.855866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeac24-8adf-4ebe-99fe-e08b49b29485 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:27.856132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeac24-8adf-4ebe-99fe-e08b49b29485 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:27.856768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eeac24-8adf-4ebe-99fe-e08b49b29485 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:27.857064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eeac24-8adf-4ebe-99fe-e08b49b29485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:27.858444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eeac24-8adf-4ebe-99fe-e08b49b29485 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:27.863725 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 652/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Aug 28 18:07:27 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:27.870270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ff0b5-9c3c-4459-a23a-3384e33421a8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:27.980222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ff0b5-9c3c-4459-a23a-3384e33421a8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:28.015972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ba1d1-ab8e-47e8-b4c7-cefd6f87f9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:28.016615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ba1d1-ab8e-47e8-b4c7-cefd6f87f9b6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:28.016890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ba1d1-ab8e-47e8-b4c7-cefd6f87f9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:28.017156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ba1d1-ab8e-47e8-b4c7-cefd6f87f9b6 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:28.017788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ba1d1-ab8e-47e8-b4c7-cefd6f87f9b6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:28.018082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ba1d1-ab8e-47e8-b4c7-cefd6f87f9b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:28.019469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ba1d1-ab8e-47e8-b4c7-cefd6f87f9b6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:28.024335 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 640/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Aug 28 18:07:27 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:29.907967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bf922-1814-4c4d-9062-22c53cce43d1 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:29.908541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bf922-1814-4c4d-9062-22c53cce43d1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:29.908541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bf922-1814-4c4d-9062-22c53cce43d1 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:29.909836 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 653/1293] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:07:29.915723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcb160-32f3-41eb-8fba-cccb2b359e2c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:29.916422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcb160-32f3-41eb-8fba-cccb2b359e2c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:29.916422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcb160-32f3-41eb-8fba-cccb2b359e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:29.936103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-60dcb160-32f3-41eb-8fba-cccb2b359e2c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:07:29.937329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-60dcb160-32f3-41eb-8fba-cccb2b359e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:07:29.971867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:30.013302 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 641/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:07:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:07:30.275220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bf922-1814-4c4d-9062-22c53cce43d1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:30.308698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:30.388030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bf922-1814-4c4d-9062-22c53cce43d1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:30.425198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d320990-402e-48bf-b616-632a04dfb589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:30.425805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d320990-402e-48bf-b616-632a04dfb589 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:30.426079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d320990-402e-48bf-b616-632a04dfb589 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:30.426348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d320990-402e-48bf-b616-632a04dfb589 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:30.426982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d320990-402e-48bf-b616-632a04dfb589 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:30.428401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d320990-402e-48bf-b616-632a04dfb589 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:30.445034 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 654/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 18:07:30 2022] POST /identity/v3/services => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:07:32.359298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85d1e9-46f7-4b4e-ae68-e3638ca80c2c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:32.359853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85d1e9-46f7-4b4e-ae68-e3638ca80c2c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:32.359853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85d1e9-46f7-4b4e-ae68-e3638ca80c2c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:32.361275 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 642/1296] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:07:32.367629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34a26-579c-45d8-aa4a-ca1b68cd23ec None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:32.368080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34a26-579c-45d8-aa4a-ca1b68cd23ec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:32.368204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34a26-579c-45d8-aa4a-ca1b68cd23ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:32.396062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b4e34a26-579c-45d8-aa4a-ca1b68cd23ec None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:07:32.397272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b4e34a26-579c-45d8-aa4a-ca1b68cd23ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:07:32.483307 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 655/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:07:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:07:32.748554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85d1e9-46f7-4b4e-ae68-e3638ca80c2c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:32.865272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85d1e9-46f7-4b4e-ae68-e3638ca80c2c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:32.904639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87093a90-157b-469b-99dd-7a57e3457023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:32.905272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87093a90-157b-469b-99dd-7a57e3457023 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:32.905550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87093a90-157b-469b-99dd-7a57e3457023 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:32.905821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87093a90-157b-469b-99dd-7a57e3457023 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:32.906409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87093a90-157b-469b-99dd-7a57e3457023 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:32.907917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87093a90-157b-469b-99dd-7a57e3457023 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:32.917076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-87093a90-157b-469b-99dd-7a57e3457023 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:07:32.917076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:32.917076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:07:32.917076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:07:32.917076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:07:32.917076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:07:32.917076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:07:32.917076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:07:32.917076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:07:32.917076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:32.917076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:07:32.917076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:32.917076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:32.917076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:32.917076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:32.917076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:32.917076 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:32.918208 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:32.918208 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:32.918208 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:32.918208 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:32.918208 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:32.918208 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:32.918208 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:07:32.918208 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:07:32.918208 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:07:32.918208 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:07:32.918208 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:32.918208 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:32.918208 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:32.918208 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:32.918208 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:32.918208 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:32.919069 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:32.919069 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:32.919069 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:32.919069 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:32.919069 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:32.919069 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:32.919069 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:32.919069 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:32.919069 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:32.919069 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:32.919069 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:07:32.919069 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:07:32.919069 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:07:32.919069 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:32.919069 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 643/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 18:07:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:07:32.924662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e34a26-579c-45d8-aa4a-ca1b68cd23ec None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:32.944139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:33.037451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e34a26-579c-45d8-aa4a-ca1b68cd23ec None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:33.086597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d8ba6-6bc1-4e02-a52a-6034a0975543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:33.087216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d8ba6-6bc1-4e02-a52a-6034a0975543 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:33.087531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d8ba6-6bc1-4e02-a52a-6034a0975543 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:33.087803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d8ba6-6bc1-4e02-a52a-6034a0975543 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:33.088442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d8ba6-6bc1-4e02-a52a-6034a0975543 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:33.088744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d8ba6-6bc1-4e02-a52a-6034a0975543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:33.090129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d8ba6-6bc1-4e02-a52a-6034a0975543 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:33.095820 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 656/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Aug 28 18:07:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:33.102111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87093a90-157b-469b-99dd-7a57e3457023 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:33.137085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:33.211722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87093a90-157b-469b-99dd-7a57e3457023 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:33.247688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ae588-a929-49e5-931f-f548f051d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:33.248307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ae588-a929-49e5-931f-f548f051d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:33.248555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ae588-a929-49e5-931f-f548f051d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:33.248852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ae588-a929-49e5-931f-f548f051d2d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:33.249573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ae588-a929-49e5-931f-f548f051d2d1 None admin] RBAC: Adding query filter params (interface=public, service_id=f0ac74317ad74203b31623a1cdd78a52, region_id=RegionOne) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:33.249879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ae588-a929-49e5-931f-f548f051d2d1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:33.251299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ae588-a929-49e5-931f-f548f051d2d1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:33.257255 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 644/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 28 18:07:33 2022] GET /identity/v3/endpoints?service_id=f0ac74317ad74203b31623a1cdd78a52&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:33.263289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d8ba6-6bc1-4e02-a52a-6034a0975543 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:33.349100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:33.367568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d8ba6-6bc1-4e02-a52a-6034a0975543 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:33.402146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65621865-0fdd-424c-8227-b9022d848637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:33.402778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65621865-0fdd-424c-8227-b9022d848637 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:33.403017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65621865-0fdd-424c-8227-b9022d848637 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:33.403302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65621865-0fdd-424c-8227-b9022d848637 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:33.403938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65621865-0fdd-424c-8227-b9022d848637 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:33.405316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65621865-0fdd-424c-8227-b9022d848637 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:33.412480 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 657/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 18:07:33 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:07:35.289584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5781b7-6945-447b-bcf9-138c841c107b None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:35.290378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5781b7-6945-447b-bcf9-138c841c107b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:35.290378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5781b7-6945-447b-bcf9-138c841c107b None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:35.291477 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 645/1302] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:07:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:07:35.298731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33e874-842e-4ca6-a839-131df001fe6f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:35.299250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33e874-842e-4ca6-a839-131df001fe6f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:35.299250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33e874-842e-4ca6-a839-131df001fe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:35.319540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7d33e874-842e-4ca6-a839-131df001fe6f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:07:35.320816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7d33e874-842e-4ca6-a839-131df001fe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:07:35.391544 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 658/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:07:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:07:35.661713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5781b7-6945-447b-bcf9-138c841c107b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:35.761986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:35.769762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5781b7-6945-447b-bcf9-138c841c107b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:35.804272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988997f0-e036-49b9-a366-c80957f01cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:35.804903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988997f0-e036-49b9-a366-c80957f01cdc None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:35.805184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988997f0-e036-49b9-a366-c80957f01cdc None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:35.805458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988997f0-e036-49b9-a366-c80957f01cdc None admin] PATH_INFO: `/v3/services/placement` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:35.806044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988997f0-e036-49b9-a366-c80957f01cdc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:35.807494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988997f0-e036-49b9-a366-c80957f01cdc None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:35.816604 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-988997f0-e036-49b9-a366-c80957f01cdc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:07:35.816604 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:35.816604 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:07:35.816604 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:07:35.816604 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:07:35.816604 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:07:35.816604 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:07:35.816604 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:07:35.816604 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:07:35.816604 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:35.816604 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:07:35.816604 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:35.816604 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:07:35.816604 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:07:35.816604 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:07:35.816604 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:07:35.816604 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:07:35.817708 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:07:35.817708 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:07:35.817708 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:07:35.817708 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:07:35.817708 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:07:35.817708 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:07:35.817708 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:07:35.817708 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:07:35.817708 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:07:35.817708 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:07:35.817708 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:07:35.817708 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:07:35.817708 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:07:35.817708 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:07:35.817708 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:07:35.817708 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:07:35.818554 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:07:35.818554 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:07:35.818554 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:07:35.818554 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:07:35.818554 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:07:35.818554 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:07:35.818554 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:07:35.818554 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:07:35.818554 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:07:35.818554 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:07:35.818554 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:07:35.818554 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:07:35.818554 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:07:35.818554 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:07:35.818554 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 646/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 18:07:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:07:35.823943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33e874-842e-4ca6-a839-131df001fe6f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:35.902816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:35.926812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33e874-842e-4ca6-a839-131df001fe6f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:35.962680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f10e48-7674-449a-84cb-d8ea6108d065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:35.963287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f10e48-7674-449a-84cb-d8ea6108d065 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:35.963584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f10e48-7674-449a-84cb-d8ea6108d065 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:35.963851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f10e48-7674-449a-84cb-d8ea6108d065 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:35.964486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f10e48-7674-449a-84cb-d8ea6108d065 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:07:35.964782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f10e48-7674-449a-84cb-d8ea6108d065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:35.966161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f10e48-7674-449a-84cb-d8ea6108d065 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:35.971923 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 659/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Aug 28 18:07:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:07:35.978328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988997f0-e036-49b9-a366-c80957f01cdc None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:07:36.081848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988997f0-e036-49b9-a366-c80957f01cdc None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:07:36.117972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94746e8-19c2-429d-8062-b8f450ab19ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:07:36.118684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94746e8-19c2-429d-8062-b8f450ab19ba None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:07:36.118959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94746e8-19c2-429d-8062-b8f450ab19ba None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:07:36.119229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94746e8-19c2-429d-8062-b8f450ab19ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:07:36.119924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94746e8-19c2-429d-8062-b8f450ab19ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:07:36.121281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94746e8-19c2-429d-8062-b8f450ab19ba None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:07:36.142760 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 647/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:07:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:07:45.968708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=30 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:07:46.138760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:08:42.014544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae361413-f5a5-4691-85c3-e2f1d7a1ddea None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:42.015090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae361413-f5a5-4691-85c3-e2f1d7a1ddea None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:42.015090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae361413-f5a5-4691-85c3-e2f1d7a1ddea None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:42.021865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15649c9-0a93-43a1-9858-9428bc57d21c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:42.022322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15649c9-0a93-43a1-9858-9428bc57d21c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:42.022415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15649c9-0a93-43a1-9858-9428bc57d21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:42.027032 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 660/1307] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:08:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:08:42.160517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b15649c9-0a93-43a1-9858-9428bc57d21c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:08:42.161763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b15649c9-0a93-43a1-9858-9428bc57d21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:42.318747 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 648/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:08:42.608838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2a3a4-5125-4a72-83f9-fd40a20a223f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:42.609537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2a3a4-5125-4a72-83f9-fd40a20a223f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:42.610046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2a3a4-5125-4a72-83f9-fd40a20a223f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:42.612056 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 661/1309] 10.222.0.27 () {54 vars in 965 bytes} [Sun Aug 28 18:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:08:42.618840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff3003-056e-4b18-8ee2-a7d81cc406bd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:42.619152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff3003-056e-4b18-8ee2-a7d81cc406bd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:42.619513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff3003-056e-4b18-8ee2-a7d81cc406bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:42.705934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-66ff3003-056e-4b18-8ee2-a7d81cc406bd None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:08:42.707167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-66ff3003-056e-4b18-8ee2-a7d81cc406bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:42.731775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:08:42.825024 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 649/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Sun Aug 28 18:08:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:08:42.835497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2a3a4-5125-4a72-83f9-fd40a20a223f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:08:42.838060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ebe2a3a4-5125-4a72-83f9-fd40a20a223f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:42.978990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2a3a4-5125-4a72-83f9-fd40a20a223f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:08:43.070175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fce87-7d5e-4a6c-84a1-cf1d9b511f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:08:43.070886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fce87-7d5e-4a6c-84a1-cf1d9b511f75 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:43.071158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fce87-7d5e-4a6c-84a1-cf1d9b511f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:43.071387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fce87-7d5e-4a6c-84a1-cf1d9b511f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:43.072961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-247fce87-7d5e-4a6c-84a1-cf1d9b511f75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:43.132802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:08:43.194743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fce87-7d5e-4a6c-84a1-cf1d9b511f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:08:43.196226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fce87-7d5e-4a6c-84a1-cf1d9b511f75 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:08:43.216229 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 662/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:08:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:08:45.561420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24a95a-3249-402e-84de-6e8335c64865 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:45.561936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24a95a-3249-402e-84de-6e8335c64865 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:45.562051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24a95a-3249-402e-84de-6e8335c64865 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:45.563547 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 650/1312] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:08:45.571018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbb379-0dda-4824-b1d3-ad80db9d44e9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:45.571590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbb379-0dda-4824-b1d3-ad80db9d44e9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:45.571590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbb379-0dda-4824-b1d3-ad80db9d44e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:45.656420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-16fbb379-0dda-4824-b1d3-ad80db9d44e9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:08:45.657558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-16fbb379-0dda-4824-b1d3-ad80db9d44e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:45.767965 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 663/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:08:46.046936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24a95a-3249-402e-84de-6e8335c64865 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:08:46.048630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5d24a95a-3249-402e-84de-6e8335c64865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:46.167736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24a95a-3249-402e-84de-6e8335c64865 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:08:46.260511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:08:46.263370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44882bac-6980-4fdf-b33b-a629c487498e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:08:46.264161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44882bac-6980-4fdf-b33b-a629c487498e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:46.264839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44882bac-6980-4fdf-b33b-a629c487498e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:46.265315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44882bac-6980-4fdf-b33b-a629c487498e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:46.267409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-44882bac-6980-4fdf-b33b-a629c487498e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:46.398298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44882bac-6980-4fdf-b33b-a629c487498e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:08:46.399791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44882bac-6980-4fdf-b33b-a629c487498e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:08:46.420898 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 651/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:08:48.655769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133637b1-ab1d-4aa1-9251-729dc09946f3 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:48.656580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133637b1-ab1d-4aa1-9251-729dc09946f3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:48.656739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133637b1-ab1d-4aa1-9251-729dc09946f3 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:48.658182 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 664/1315] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:08:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:08:48.664102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76646fb-bcd3-4368-9b4f-5afc58beed8e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:48.664545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76646fb-bcd3-4368-9b4f-5afc58beed8e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:48.664637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76646fb-bcd3-4368-9b4f-5afc58beed8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:48.738405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e76646fb-bcd3-4368-9b4f-5afc58beed8e None None] MFA Rules not processed for user `4190655e461b49b0932d472dd67ff9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:08:48.739689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e76646fb-bcd3-4368-9b4f-5afc58beed8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:48.794086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:08:48.844232 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 652/1316] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:08:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:08:49.130425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133637b1-ab1d-4aa1-9251-729dc09946f3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:08:49.132010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-133637b1-ab1d-4aa1-9251-729dc09946f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:49.142010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:08:49.237300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133637b1-ab1d-4aa1-9251-729dc09946f3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:08:49.313257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c46f84-4a59-447a-8f50-f28091dea775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:08:49.313865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c46f84-4a59-447a-8f50-f28091dea775 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:49.314223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c46f84-4a59-447a-8f50-f28091dea775 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:49.314402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c46f84-4a59-447a-8f50-f28091dea775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:49.316037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-21c46f84-4a59-447a-8f50-f28091dea775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:49.384014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:08:49.433995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c46f84-4a59-447a-8f50-f28091dea775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:08:49.435466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c46f84-4a59-447a-8f50-f28091dea775 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:08:49.461059 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 665/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:08:49 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:08:51.949762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64a182-6de7-47bf-807f-7537eba37710 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:51.950360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64a182-6de7-47bf-807f-7537eba37710 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:51.950360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64a182-6de7-47bf-807f-7537eba37710 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:51.951666 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 653/1318] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:08:51.957084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9037c-b0d5-4b28-b9fe-fde4948aee5f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:51.957511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9037c-b0d5-4b28-b9fe-fde4948aee5f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:51.957697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9037c-b0d5-4b28-b9fe-fde4948aee5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:52.027096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f5f9037c-b0d5-4b28-b9fe-fde4948aee5f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:08:52.028344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5f9037c-b0d5-4b28-b9fe-fde4948aee5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:52.133353 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 666/1319] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:08:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:08:52.409866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64a182-6de7-47bf-807f-7537eba37710 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:08:52.414658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5e64a182-6de7-47bf-807f-7537eba37710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:52.535760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64a182-6de7-47bf-807f-7537eba37710 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:08:52.626385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11bf61-03e6-42ed-94d3-f328b5fe7fd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:08:52.627173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11bf61-03e6-42ed-94d3-f328b5fe7fd8 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:52.627572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11bf61-03e6-42ed-94d3-f328b5fe7fd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:52.627861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11bf61-03e6-42ed-94d3-f328b5fe7fd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:52.630710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7e11bf61-03e6-42ed-94d3-f328b5fe7fd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:52.642222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:08:52.783413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11bf61-03e6-42ed-94d3-f328b5fe7fd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:08:52.784790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11bf61-03e6-42ed-94d3-f328b5fe7fd8 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:08:52.807242 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 654/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:08:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:08:55.432595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164d0ae-6716-41e8-8a9a-fa01297480cb None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:55.433110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164d0ae-6716-41e8-8a9a-fa01297480cb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:55.433324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164d0ae-6716-41e8-8a9a-fa01297480cb None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:55.434727 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 667/1321] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:08:55.440315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aaac5-da1f-437f-ad5f-204be437eb16 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:55.440718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aaac5-da1f-437f-ad5f-204be437eb16 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:55.440901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aaac5-da1f-437f-ad5f-204be437eb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:55.511873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a00aaac5-da1f-437f-ad5f-204be437eb16 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:08:55.513082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a00aaac5-da1f-437f-ad5f-204be437eb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:55.572842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:08:55.613651 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 655/1322] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:08:55.904700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f252896-d6e3-4324-aa44-6439f6dc295e None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:55.905152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f252896-d6e3-4324-aa44-6439f6dc295e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:55.905497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f252896-d6e3-4324-aa44-6439f6dc295e None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:55.906921 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 668/1323] 10.222.0.27 () {54 vars in 965 bytes} [Sun Aug 28 18:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:08:55.913333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7d215-3f89-475a-a9ef-7ca8864a03c1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:55.913614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7d215-3f89-475a-a9ef-7ca8864a03c1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:55.913887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7d215-3f89-475a-a9ef-7ca8864a03c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:55.992053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8ae7d215-3f89-475a-a9ef-7ca8864a03c1 None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:08:55.993261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8ae7d215-3f89-475a-a9ef-7ca8864a03c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:56.068423 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 656/1324] 10.222.0.27 () {58 vars in 1062 bytes} [Sun Aug 28 18:08:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:08:56.077750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f252896-d6e3-4324-aa44-6439f6dc295e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:08:56.079303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2f252896-d6e3-4324-aa44-6439f6dc295e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:56.101015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:08:56.190338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f252896-d6e3-4324-aa44-6439f6dc295e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:08:56.265072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f05bff-36d4-4289-a966-a208d6cbdea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:08:56.265675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f05bff-36d4-4289-a966-a208d6cbdea1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:56.265944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f05bff-36d4-4289-a966-a208d6cbdea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:56.266358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f05bff-36d4-4289-a966-a208d6cbdea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:56.268205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-71f05bff-36d4-4289-a966-a208d6cbdea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:56.341043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:08:56.379285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f05bff-36d4-4289-a966-a208d6cbdea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:08:56.380650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f05bff-36d4-4289-a966-a208d6cbdea1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:08:56.399395 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 669/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:08:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:08:58.547077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b776b57-98f6-44b2-9954-c9bfdcc7eb71 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:58.547694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b776b57-98f6-44b2-9954-c9bfdcc7eb71 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:58.547694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b776b57-98f6-44b2-9954-c9bfdcc7eb71 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:58.548998 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 657/1326] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:08:58.554800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06f55f-7449-446c-adfd-138f2b3da5b5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:58.555296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06f55f-7449-446c-adfd-138f2b3da5b5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:58.555381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06f55f-7449-446c-adfd-138f2b3da5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:58.622460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2d06f55f-7449-446c-adfd-138f2b3da5b5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:08:58.623727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d06f55f-7449-446c-adfd-138f2b3da5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:58.729223 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 670/1327] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:08:59.004106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b776b57-98f6-44b2-9954-c9bfdcc7eb71 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:08:59.005792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0b776b57-98f6-44b2-9954-c9bfdcc7eb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:59.072563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:08:59.116093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b776b57-98f6-44b2-9954-c9bfdcc7eb71 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:08:59.190284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7a37a-f64f-4f2c-ac48-69881f634acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:08:59.190895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7a37a-f64f-4f2c-ac48-69881f634acd service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:08:59.191181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7a37a-f64f-4f2c-ac48-69881f634acd service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:08:59.191485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7a37a-f64f-4f2c-ac48-69881f634acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:08:59.193137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3fc7a37a-f64f-4f2c-ac48-69881f634acd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:08:59.301474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:08:59.304131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7a37a-f64f-4f2c-ac48-69881f634acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:08:59.306101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7a37a-f64f-4f2c-ac48-69881f634acd service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:08:59.324603 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 658/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:09:01.270265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02407f78-3f72-4d82-827d-23820f9edc58 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:01.270265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02407f78-3f72-4d82-827d-23820f9edc58 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:01.270265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02407f78-3f72-4d82-827d-23820f9edc58 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:01.273402 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 671/1329] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:09:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:01.275013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfd62c-e6f6-4ac6-8114-b9d69c63e4da None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:01.275494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfd62c-e6f6-4ac6-8114-b9d69c63e4da None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:01.275589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfd62c-e6f6-4ac6-8114-b9d69c63e4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:01.349962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2fbfd62c-e6f6-4ac6-8114-b9d69c63e4da None None] MFA Rules not processed for user `4190655e461b49b0932d472dd67ff9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:01.351208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2fbfd62c-e6f6-4ac6-8114-b9d69c63e4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:01.454385 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 659/1330] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:09:01 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:01.733136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02407f78-3f72-4d82-827d-23820f9edc58 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:09:01.734756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-02407f78-3f72-4d82-827d-23820f9edc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:01.773639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:01.858602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02407f78-3f72-4d82-827d-23820f9edc58 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:09:01.959437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020b454-1944-4d5e-85f1-2a1b49cfed67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:09:01.961184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020b454-1944-4d5e-85f1-2a1b49cfed67 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:01.962499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020b454-1944-4d5e-85f1-2a1b49cfed67 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:01.963409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020b454-1944-4d5e-85f1-2a1b49cfed67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:01.965179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c020b454-1944-4d5e-85f1-2a1b49cfed67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:02.068450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:02.109654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020b454-1944-4d5e-85f1-2a1b49cfed67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:09:02.111203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020b454-1944-4d5e-85f1-2a1b49cfed67 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:09:02.140431 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 672/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:09:01 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:09:04.472641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef6e3e-a587-4055-9d07-cb999c6d38c4 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:04.473240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef6e3e-a587-4055-9d07-cb999c6d38c4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:04.473240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef6e3e-a587-4055-9d07-cb999c6d38c4 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:04.474510 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 660/1332] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:04.480208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bde402-5d46-49a5-aec3-9887dda3e335 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:04.480683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bde402-5d46-49a5-aec3-9887dda3e335 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:04.480779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bde402-5d46-49a5-aec3-9887dda3e335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:04.555219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-69bde402-5d46-49a5-aec3-9887dda3e335 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:04.556476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-69bde402-5d46-49a5-aec3-9887dda3e335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:04.656585 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 673/1333] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:09:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:04.934931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef6e3e-a587-4055-9d07-cb999c6d38c4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:09:04.936677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f5ef6e3e-a587-4055-9d07-cb999c6d38c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:05.013923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:05.049676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef6e3e-a587-4055-9d07-cb999c6d38c4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:09:05.129106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a402a2b-a662-40ee-89bb-a5760a6cf9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:09:05.129716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a402a2b-a662-40ee-89bb-a5760a6cf9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:05.129987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a402a2b-a662-40ee-89bb-a5760a6cf9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:05.130250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a402a2b-a662-40ee-89bb-a5760a6cf9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:05.131878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2a402a2b-a662-40ee-89bb-a5760a6cf9e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:05.250507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a402a2b-a662-40ee-89bb-a5760a6cf9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:09:05.252566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a402a2b-a662-40ee-89bb-a5760a6cf9e7 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:09:05.268439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:05.277799 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 661/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:09:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:09:07.238733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083bb5-f0f0-41e8-a6b6-6fc180186337 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:07.239358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083bb5-f0f0-41e8-a6b6-6fc180186337 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:07.239358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083bb5-f0f0-41e8-a6b6-6fc180186337 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:07.240688 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 674/1335] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:07.248002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993d477-1a6a-4e2f-bcbe-44eac28242ce None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:07.248912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993d477-1a6a-4e2f-bcbe-44eac28242ce None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:07.248912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993d477-1a6a-4e2f-bcbe-44eac28242ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:07.323032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f993d477-1a6a-4e2f-bcbe-44eac28242ce None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:07.324311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f993d477-1a6a-4e2f-bcbe-44eac28242ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:07.432885 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 662/1336] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:07.719662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd083bb5-f0f0-41e8-a6b6-6fc180186337 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:09:07.721248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cd083bb5-f0f0-41e8-a6b6-6fc180186337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:07.779708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:07.853961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd083bb5-f0f0-41e8-a6b6-6fc180186337 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:09:07.933038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c2ae0-113f-4729-91d2-0b918af55a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:09:07.933655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c2ae0-113f-4729-91d2-0b918af55a3b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:07.933934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c2ae0-113f-4729-91d2-0b918af55a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:07.934205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c2ae0-113f-4729-91d2-0b918af55a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:07.935858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d8c2ae0-113f-4729-91d2-0b918af55a3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:08.050990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:08.079586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c2ae0-113f-4729-91d2-0b918af55a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:09:08.081047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c2ae0-113f-4729-91d2-0b918af55a3b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:09:08.100423 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 675/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:09:10.471713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633c993-cdcb-4df0-8d52-9934179c6fba None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:10.472281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633c993-cdcb-4df0-8d52-9934179c6fba None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:10.472281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633c993-cdcb-4df0-8d52-9934179c6fba None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:10.473626 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 663/1338] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:10.479140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff883d-bab6-4f6a-afd3-a52fe3f278de None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:10.479583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff883d-bab6-4f6a-afd3-a52fe3f278de None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:10.479713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff883d-bab6-4f6a-afd3-a52fe3f278de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:10.572798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-09ff883d-bab6-4f6a-afd3-a52fe3f278de None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:10.574029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09ff883d-bab6-4f6a-afd3-a52fe3f278de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:10.679981 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 676/1339] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:09:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:10.987001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633c993-cdcb-4df0-8d52-9934179c6fba None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:09:10.988664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1633c993-cdcb-4df0-8d52-9934179c6fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:11.080293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:11.109571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633c993-cdcb-4df0-8d52-9934179c6fba None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:09:11.192986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f856690-43d7-48e6-b8aa-a853d61cf422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:09:11.193630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f856690-43d7-48e6-b8aa-a853d61cf422 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:11.193902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f856690-43d7-48e6-b8aa-a853d61cf422 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:11.194168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f856690-43d7-48e6-b8aa-a853d61cf422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:11.195821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8f856690-43d7-48e6-b8aa-a853d61cf422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:11.312044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f856690-43d7-48e6-b8aa-a853d61cf422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:09:11.313399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f856690-43d7-48e6-b8aa-a853d61cf422 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:09:11.331432 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 664/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:09:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:09:15.282003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1cf5d-b5ac-4cc6-b4e0-81821c681f7f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:15.282641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1cf5d-b5ac-4cc6-b4e0-81821c681f7f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:15.282641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1cf5d-b5ac-4cc6-b4e0-81821c681f7f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:15.284105 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 677/1341] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:15.289530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75df3b1-261c-488d-89bb-05db116ff003 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:15.289986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75df3b1-261c-488d-89bb-05db116ff003 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:15.290072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75df3b1-261c-488d-89bb-05db116ff003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:15.296752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:15.369109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f75df3b1-261c-488d-89bb-05db116ff003 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:15.370457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f75df3b1-261c-488d-89bb-05db116ff003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:15.473573 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 665/1342] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:15.756297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1cf5d-b5ac-4cc6-b4e0-81821c681f7f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:09:15.758215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8bd1cf5d-b5ac-4cc6-b4e0-81821c681f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:15.811176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:15.874442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1cf5d-b5ac-4cc6-b4e0-81821c681f7f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:09:15.956100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89da4bc-0a41-48a7-868c-2d35d8a5ded4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:09:15.956722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89da4bc-0a41-48a7-868c-2d35d8a5ded4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:15.956998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89da4bc-0a41-48a7-868c-2d35d8a5ded4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:15.957270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89da4bc-0a41-48a7-868c-2d35d8a5ded4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:15.958878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c89da4bc-0a41-48a7-868c-2d35d8a5ded4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:16.057141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:16.075033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89da4bc-0a41-48a7-868c-2d35d8a5ded4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:09:16.076552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89da4bc-0a41-48a7-868c-2d35d8a5ded4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:09:16.095874 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 678/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:09:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:09:18.601653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33692322-5215-4937-9b29-dfcd0b46e842 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:18.602196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33692322-5215-4937-9b29-dfcd0b46e842 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:18.602196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33692322-5215-4937-9b29-dfcd0b46e842 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:18.604079 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 666/1344] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:09:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:18.609781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54fcea-68d0-4c51-a4f5-022f8b9ec2be None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:18.610352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54fcea-68d0-4c51-a4f5-022f8b9ec2be None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:18.610352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54fcea-68d0-4c51-a4f5-022f8b9ec2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:18.686545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ac54fcea-68d0-4c51-a4f5-022f8b9ec2be None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:18.687811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac54fcea-68d0-4c51-a4f5-022f8b9ec2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:18.802116 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 679/1345] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:09:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:09:19.080084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33692322-5215-4937-9b29-dfcd0b46e842 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:09:19.081635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-33692322-5215-4937-9b29-dfcd0b46e842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:19.178959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:19.198371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33692322-5215-4937-9b29-dfcd0b46e842 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:09:19.275861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90497b6b-0148-44aa-9c7e-10ccb934b059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:09:19.276485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90497b6b-0148-44aa-9c7e-10ccb934b059 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:19.276765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90497b6b-0148-44aa-9c7e-10ccb934b059 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:19.277091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90497b6b-0148-44aa-9c7e-10ccb934b059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:19.278802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-90497b6b-0148-44aa-9c7e-10ccb934b059 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:19.397624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90497b6b-0148-44aa-9c7e-10ccb934b059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:09:19.398999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90497b6b-0148-44aa-9c7e-10ccb934b059 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:09:19.419214 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 667/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:09:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:09:23.843799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6bd2-717c-4ef5-aa37-846bc04e8315 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:23.844373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6bd2-717c-4ef5-aa37-846bc04e8315 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:23.844373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6bd2-717c-4ef5-aa37-846bc04e8315 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:23.845708 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 680/1347] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:23.851717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200ad89-ace9-4d5c-8cb3-0fdcce5c76e3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:23.852252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200ad89-ace9-4d5c-8cb3-0fdcce5c76e3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:23.852252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200ad89-ace9-4d5c-8cb3-0fdcce5c76e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:23.868847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:23.929309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4200ad89-ace9-4d5c-8cb3-0fdcce5c76e3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:23.930708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4200ad89-ace9-4d5c-8cb3-0fdcce5c76e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:24.037966 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 668/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:24.319439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e6bd2-717c-4ef5-aa37-846bc04e8315 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:09:24.321018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab8e6bd2-717c-4ef5-aa37-846bc04e8315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:24.385128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:24.441513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e6bd2-717c-4ef5-aa37-846bc04e8315 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:09:24.520262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d7fe4-ccc8-412c-bb99-b7e0fcedcad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:09:24.520778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d7fe4-ccc8-412c-bb99-b7e0fcedcad1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:24.521053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d7fe4-ccc8-412c-bb99-b7e0fcedcad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:24.521321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d7fe4-ccc8-412c-bb99-b7e0fcedcad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:24.522915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c49d7fe4-ccc8-412c-bb99-b7e0fcedcad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:24.646765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:24.650851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d7fe4-ccc8-412c-bb99-b7e0fcedcad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:09:24.652533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d7fe4-ccc8-412c-bb99-b7e0fcedcad1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:09:24.672745 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 681/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:09:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:09:29.714079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697d6f-c3f0-4517-a544-a2d077d556e1 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:29.714079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697d6f-c3f0-4517-a544-a2d077d556e1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:29.714079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697d6f-c3f0-4517-a544-a2d077d556e1 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:29.723278 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 669/1350] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 18:09:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:29.723959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d8897-b536-49bb-8769-0152f22d1aec None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:29.723959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d8897-b536-49bb-8769-0152f22d1aec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:29.723959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d8897-b536-49bb-8769-0152f22d1aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:29.845034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e78d8897-b536-49bb-8769-0152f22d1aec None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:29.846322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e78d8897-b536-49bb-8769-0152f22d1aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:30.007798 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 682/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 18:09:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:34.036145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=59 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:34.569022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9c5b7-4806-4bfe-a300-615274860bb1 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:34.569297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9c5b7-4806-4bfe-a300-615274860bb1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:34.569767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9c5b7-4806-4bfe-a300-615274860bb1 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:34.571731 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 670/1352] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 18:09:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:34.577474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d444f-cb83-4819-b6f1-d8ae78f9ef35 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:34.578036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d444f-cb83-4819-b6f1-d8ae78f9ef35 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:34.578036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d444f-cb83-4819-b6f1-d8ae78f9ef35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:34.642769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:34.675238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-223d444f-cb83-4819-b6f1-d8ae78f9ef35 None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:34.676476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-223d444f-cb83-4819-b6f1-d8ae78f9ef35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:34.813125 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 683/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 18:09:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:35.777908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc269f-cbcb-41c0-a2fc-40483c9a15a1 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:35.778478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc269f-cbcb-41c0-a2fc-40483c9a15a1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:35.778478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc269f-cbcb-41c0-a2fc-40483c9a15a1 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:35.780057 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 671/1354] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 18:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:35.785403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db548e-e995-41af-aff9-fe0a03282fca None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:35.785878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db548e-e995-41af-aff9-fe0a03282fca None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:35.786100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db548e-e995-41af-aff9-fe0a03282fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:35.880350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f1db548e-e995-41af-aff9-fe0a03282fca None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:35.881849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1db548e-e995-41af-aff9-fe0a03282fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:35.929306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:36.002993 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 684/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 18:09:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:39.595490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9c97d-926c-4998-b132-fecd32ccc900 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:39.596447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9c97d-926c-4998-b132-fecd32ccc900 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:39.596748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9c97d-926c-4998-b132-fecd32ccc900 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:39.598276 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 672/1356] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:09:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:39.604133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3485e6-87a7-4a5c-be7b-d7c2623d1961 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:39.604594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3485e6-87a7-4a5c-be7b-d7c2623d1961 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:39.604708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3485e6-87a7-4a5c-be7b-d7c2623d1961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:39.676360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aa3485e6-87a7-4a5c-be7b-d7c2623d1961 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:39.679041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa3485e6-87a7-4a5c-be7b-d7c2623d1961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:39.839649 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 685/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:40.145938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e5415-1f59-4978-84cb-2ed11b11344f None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:40.146602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e5415-1f59-4978-84cb-2ed11b11344f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:40.147272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e5415-1f59-4978-84cb-2ed11b11344f None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:40.151147 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 673/1358] 10.222.0.27 () {54 vars in 962 bytes} [Sun Aug 28 18:09:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:09:40.160458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781a5aa-7e29-441e-b791-5077bb91b7db None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:40.161092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781a5aa-7e29-441e-b791-5077bb91b7db None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:40.161566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781a5aa-7e29-441e-b791-5077bb91b7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:40.181841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:40.246460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9781a5aa-7e29-441e-b791-5077bb91b7db None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:40.247994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9781a5aa-7e29-441e-b791-5077bb91b7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:40.399905 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 686/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Aug 28 18:09:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:40.408624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e5415-1f59-4978-84cb-2ed11b11344f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:09:40.410194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fa8e5415-1f59-4978-84cb-2ed11b11344f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:40.585156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e5415-1f59-4978-84cb-2ed11b11344f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:09:40.668276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:40.718634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ad45d-53db-4f67-bae1-215482d1125a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:09:40.719271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ad45d-53db-4f67-bae1-215482d1125a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:40.719561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ad45d-53db-4f67-bae1-215482d1125a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:40.719839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ad45d-53db-4f67-bae1-215482d1125a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:40.723688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-516ad45d-53db-4f67-bae1-215482d1125a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:40.834893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ad45d-53db-4f67-bae1-215482d1125a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:09:40.836756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ad45d-53db-4f67-bae1-215482d1125a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:09:40.856554 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 674/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:09:42.977072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b3782-5d80-43e1-99f6-c3b2e5a6d515 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:42.977777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b3782-5d80-43e1-99f6-c3b2e5a6d515 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:42.977777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b3782-5d80-43e1-99f6-c3b2e5a6d515 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:42.979127 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 687/1361] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:42.984743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400bec6-aaca-48b8-a6e9-ce19caa5d7f4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:42.985409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400bec6-aaca-48b8-a6e9-ce19caa5d7f4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:42.985409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400bec6-aaca-48b8-a6e9-ce19caa5d7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:43.056576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1400bec6-aaca-48b8-a6e9-ce19caa5d7f4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:43.057770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1400bec6-aaca-48b8-a6e9-ce19caa5d7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:43.101447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:43.170197 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 675/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:43.473090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b3782-5d80-43e1-99f6-c3b2e5a6d515 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:09:43.474653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-776b3782-5d80-43e1-99f6-c3b2e5a6d515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:43.551750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:43.662695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b3782-5d80-43e1-99f6-c3b2e5a6d515 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:09:43.804125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7afa28-5a6e-48d9-b97d-9ec3ad2c8890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:09:43.804952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7afa28-5a6e-48d9-b97d-9ec3ad2c8890 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:43.805371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7afa28-5a6e-48d9-b97d-9ec3ad2c8890 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:43.805704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7afa28-5a6e-48d9-b97d-9ec3ad2c8890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:43.807585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4b7afa28-5a6e-48d9-b97d-9ec3ad2c8890 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:43.836226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:43.930215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7afa28-5a6e-48d9-b97d-9ec3ad2c8890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:09:43.931999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7afa28-5a6e-48d9-b97d-9ec3ad2c8890 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:09:43.952688 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 688/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:09:46.290285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d87958-6159-4921-8b6b-900433c72f75 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:46.290857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d87958-6159-4921-8b6b-900433c72f75 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:46.290857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d87958-6159-4921-8b6b-900433c72f75 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:46.292224 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 676/1364] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:46.298574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c45058-ddb7-4825-bacd-faa7f219855c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:46.299117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c45058-ddb7-4825-bacd-faa7f219855c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:46.299117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c45058-ddb7-4825-bacd-faa7f219855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:46.391576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-06c45058-ddb7-4825-bacd-faa7f219855c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:46.393289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-06c45058-ddb7-4825-bacd-faa7f219855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:46.519923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:46.527282 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 689/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:46.850888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55d552-e17f-4bea-bf6e-038e7cfeb459 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:46.851151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55d552-e17f-4bea-bf6e-038e7cfeb459 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:46.855517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55d552-e17f-4bea-bf6e-038e7cfeb459 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:46.857370 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 677/1366] 10.222.0.27 () {54 vars in 962 bytes} [Sun Aug 28 18:09:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:46.866037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf48f63-b067-4a04-afbc-f887edd093ab None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:46.866497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf48f63-b067-4a04-afbc-f887edd093ab None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:46.866963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf48f63-b067-4a04-afbc-f887edd093ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:46.977784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3bf48f63-b067-4a04-afbc-f887edd093ab None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:46.978929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3bf48f63-b067-4a04-afbc-f887edd093ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:47.150067 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 690/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Aug 28 18:09:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:47.162347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55d552-e17f-4bea-bf6e-038e7cfeb459 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:09:47.162347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6e55d552-e17f-4bea-bf6e-038e7cfeb459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:47.381207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55d552-e17f-4bea-bf6e-038e7cfeb459 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:09:47.402534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:47.518417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a33713-54cb-43e6-ac22-14ddbb071b78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:09:47.519006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a33713-54cb-43e6-ac22-14ddbb071b78 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:47.519320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a33713-54cb-43e6-ac22-14ddbb071b78 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:47.519602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a33713-54cb-43e6-ac22-14ddbb071b78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:47.521298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-50a33713-54cb-43e6-ac22-14ddbb071b78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:47.653771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a33713-54cb-43e6-ac22-14ddbb071b78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:09:47.658354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a33713-54cb-43e6-ac22-14ddbb071b78 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:09:47.690530 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 678/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:09:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:09:49.920903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67983ea9-2e69-4b74-baf8-3df87b392847 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:49.921482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67983ea9-2e69-4b74-baf8-3df87b392847 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:49.921582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67983ea9-2e69-4b74-baf8-3df87b392847 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:49.924249 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 691/1369] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:09:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:49.931046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc589e1c-d7c7-4a6c-b500-4ea86a58a287 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:49.932247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc589e1c-d7c7-4a6c-b500-4ea86a58a287 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:49.932800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc589e1c-d7c7-4a6c-b500-4ea86a58a287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:50.012035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:50.097296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dc589e1c-d7c7-4a6c-b500-4ea86a58a287 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:50.099074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dc589e1c-d7c7-4a6c-b500-4ea86a58a287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:50.226857 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 679/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:50.521241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67983ea9-2e69-4b74-baf8-3df87b392847 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:09:50.523123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-67983ea9-2e69-4b74-baf8-3df87b392847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:50.581311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:50.690580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67983ea9-2e69-4b74-baf8-3df87b392847 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:09:50.864149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bd814-e8e1-4681-8585-3f35d4dbcfe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:09:50.864782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bd814-e8e1-4681-8585-3f35d4dbcfe3 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:50.865229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bd814-e8e1-4681-8585-3f35d4dbcfe3 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:50.865676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bd814-e8e1-4681-8585-3f35d4dbcfe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:50.867425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b69bd814-e8e1-4681-8585-3f35d4dbcfe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:50.881923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:50.991072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bd814-e8e1-4681-8585-3f35d4dbcfe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:09:50.993771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bd814-e8e1-4681-8585-3f35d4dbcfe3 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:09:51.015163 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 692/1371] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:09:51.827435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760aa85-e6f7-4476-bb21-b59f414d7755 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:51.827918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760aa85-e6f7-4476-bb21-b59f414d7755 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:51.828061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760aa85-e6f7-4476-bb21-b59f414d7755 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:51.832058 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 680/1372] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:09:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:51.837997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faddfc-2d7b-40bb-9cca-f32182cc6f42 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:51.837997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faddfc-2d7b-40bb-9cca-f32182cc6f42 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:51.838356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faddfc-2d7b-40bb-9cca-f32182cc6f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:51.927955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a5faddfc-2d7b-40bb-9cca-f32182cc6f42 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:51.929743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a5faddfc-2d7b-40bb-9cca-f32182cc6f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:52.032458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:52.063767 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 693/1373] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:52.604382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119096b1-67b3-495e-b34b-dc8dc6e80a3f None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:52.604661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119096b1-67b3-495e-b34b-dc8dc6e80a3f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:52.605124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119096b1-67b3-495e-b34b-dc8dc6e80a3f None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:52.606487 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 681/1374] 10.222.0.27 () {54 vars in 964 bytes} [Sun Aug 28 18:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:52.612016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f386060-b446-42c2-988d-14f3f3134989 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:52.612579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f386060-b446-42c2-988d-14f3f3134989 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:52.613061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f386060-b446-42c2-988d-14f3f3134989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:52.700471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0f386060-b446-42c2-988d-14f3f3134989 None None] MFA Rules not processed for user `6b06f9395d5841b9aa28227d532964eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:52.701800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f386060-b446-42c2-988d-14f3f3134989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:52.808679 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 694/1375] 10.222.0.27 () {58 vars in 1061 bytes} [Sun Aug 28 18:09:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:52.817807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119096b1-67b3-495e-b34b-dc8dc6e80a3f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:09:52.820246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-119096b1-67b3-495e-b34b-dc8dc6e80a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:52.959757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119096b1-67b3-495e-b34b-dc8dc6e80a3f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:09:52.964493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:53.050563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e2380-e614-4fe5-8dfe-9b3088955d0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:09:53.051188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e2380-e614-4fe5-8dfe-9b3088955d0d service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:53.051543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e2380-e614-4fe5-8dfe-9b3088955d0d service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:53.051773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e2380-e614-4fe5-8dfe-9b3088955d0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:53.053465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c59e2380-e614-4fe5-8dfe-9b3088955d0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:53.125861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58d7d4-b132-45ba-a1b0-28a05efc58c5 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:53.126412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58d7d4-b132-45ba-a1b0-28a05efc58c5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:53.126412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58d7d4-b132-45ba-a1b0-28a05efc58c5 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:53.128040 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 695/1376] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:09:53.138251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbce4f-ec57-46f8-907b-9453e4bdd0af None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:53.138548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbce4f-ec57-46f8-907b-9453e4bdd0af None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:53.138939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbce4f-ec57-46f8-907b-9453e4bdd0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:53.185526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e2380-e614-4fe5-8dfe-9b3088955d0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:09:53.187043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e2380-e614-4fe5-8dfe-9b3088955d0d service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:09:53.208422 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 682/1377] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:09:53.215946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7dbbce4f-ec57-46f8-907b-9453e4bdd0af None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:53.217298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7dbbce4f-ec57-46f8-907b-9453e4bdd0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:53.256020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:53.340357 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 696/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:53.631671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e2380-e614-4fe5-8dfe-9b3088955d0d service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:09:53.632851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c59e2380-e614-4fe5-8dfe-9b3088955d0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:53.683320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:53.768107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e2380-e614-4fe5-8dfe-9b3088955d0d service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:09:53.934138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decf593-b28b-4a6d-bda2-a1f09dcc0a43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:09:53.935063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decf593-b28b-4a6d-bda2-a1f09dcc0a43 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:53.935595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decf593-b28b-4a6d-bda2-a1f09dcc0a43 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:53.936360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decf593-b28b-4a6d-bda2-a1f09dcc0a43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:53.939875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4decf593-b28b-4a6d-bda2-a1f09dcc0a43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:54.001703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:54.055815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decf593-b28b-4a6d-bda2-a1f09dcc0a43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:09:54.057712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decf593-b28b-4a6d-bda2-a1f09dcc0a43 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:09:54.082424 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 683/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:09:56.077019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3898a-2144-4d01-8bb0-85fba0ebb294 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:56.077678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3898a-2144-4d01-8bb0-85fba0ebb294 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:56.077678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3898a-2144-4d01-8bb0-85fba0ebb294 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:56.085952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab185fb-72be-4d1e-9ad4-39acbe197388 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:56.086509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab185fb-72be-4d1e-9ad4-39acbe197388 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:56.086770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab185fb-72be-4d1e-9ad4-39acbe197388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:56.087668 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 697/1380] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:09:56 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:56.196621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3ab185fb-72be-4d1e-9ad4-39acbe197388 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:56.197850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3ab185fb-72be-4d1e-9ad4-39acbe197388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:56.318870 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 684/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:56.646559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3898a-2144-4d01-8bb0-85fba0ebb294 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:09:56.648150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4db3898a-2144-4d01-8bb0-85fba0ebb294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:56.832730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3898a-2144-4d01-8bb0-85fba0ebb294 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:09:56.866731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:57.030053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd6111-4724-4923-91cc-3429268f6a6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:09:57.030765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd6111-4724-4923-91cc-3429268f6a6b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:57.034585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd6111-4724-4923-91cc-3429268f6a6b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:57.034585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd6111-4724-4923-91cc-3429268f6a6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:57.037759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0dbd6111-4724-4923-91cc-3429268f6a6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:57.187001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd6111-4724-4923-91cc-3429268f6a6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:09:57.189809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd6111-4724-4923-91cc-3429268f6a6b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:09:57.216845 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 698/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:09:59.243172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87649e-e3c9-4fd4-b2c2-669a2ef121c4 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:59.243785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87649e-e3c9-4fd4-b2c2-669a2ef121c4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:59.243785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87649e-e3c9-4fd4-b2c2-669a2ef121c4 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:59.249694 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 685/1383] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:09:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:09:59.251105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720b448-265a-4d69-af25-0f39ebe8ca7c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:09:59.251679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720b448-265a-4d69-af25-0f39ebe8ca7c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:09:59.251679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720b448-265a-4d69-af25-0f39ebe8ca7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:09:59.281297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:59.341972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3720b448-265a-4d69-af25-0f39ebe8ca7c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:09:59.343590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3720b448-265a-4d69-af25-0f39ebe8ca7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:59.476581 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 699/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:09:59.762219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87649e-e3c9-4fd4-b2c2-669a2ef121c4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:09:59.763820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fd87649e-e3c9-4fd4-b2c2-669a2ef121c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:09:59.795438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:09:59.944346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87649e-e3c9-4fd4-b2c2-669a2ef121c4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:00.060520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:00.084248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ad831-5869-4adf-bbf4-271c5f38987d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:00.085051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ad831-5869-4adf-bbf4-271c5f38987d service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:00.085422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ad831-5869-4adf-bbf4-271c5f38987d service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:00.085786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ad831-5869-4adf-bbf4-271c5f38987d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:00.087936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7f1ad831-5869-4adf-bbf4-271c5f38987d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:00.204085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ad831-5869-4adf-bbf4-271c5f38987d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:00.206471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ad831-5869-4adf-bbf4-271c5f38987d service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:00.230942 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 686/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:09:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:10:02.186534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27271c09-f153-45c4-8151-2132af92633c None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:02.187137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27271c09-f153-45c4-8151-2132af92633c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:02.187267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27271c09-f153-45c4-8151-2132af92633c None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:02.189156 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 700/1386] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:10:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:10:02.195196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7102c1-a634-4a11-a3b9-880959030044 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:02.195793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7102c1-a634-4a11-a3b9-880959030044 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:02.195793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7102c1-a634-4a11-a3b9-880959030044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:02.270476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8f7102c1-a634-4a11-a3b9-880959030044 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:02.271768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8f7102c1-a634-4a11-a3b9-880959030044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:02.341502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:02.393422 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 687/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:10:02.681347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27271c09-f153-45c4-8151-2132af92633c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:02.684432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27271c09-f153-45c4-8151-2132af92633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:02.813021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:02.876352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27271c09-f153-45c4-8151-2132af92633c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:03.021307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ae842-1bd5-4d1c-9b7b-6c5b82c5f282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:03.022134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ae842-1bd5-4d1c-9b7b-6c5b82c5f282 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:03.022461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ae842-1bd5-4d1c-9b7b-6c5b82c5f282 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:03.022680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ae842-1bd5-4d1c-9b7b-6c5b82c5f282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:03.024597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-634ae842-1bd5-4d1c-9b7b-6c5b82c5f282 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:03.099708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:03.131813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ae842-1bd5-4d1c-9b7b-6c5b82c5f282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:03.133459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ae842-1bd5-4d1c-9b7b-6c5b82c5f282 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:03.154972 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 701/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:10:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:10:05.408536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3b81d-c6b1-44de-b7c5-36f2f7b1f0b2 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:05.409213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3b81d-c6b1-44de-b7c5-36f2f7b1f0b2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:05.409213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3b81d-c6b1-44de-b7c5-36f2f7b1f0b2 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:05.410319 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 688/1389] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:10:05.416179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744374de-fd43-4b73-866c-550bbc43164f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:05.416811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744374de-fd43-4b73-866c-550bbc43164f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:05.416811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744374de-fd43-4b73-866c-550bbc43164f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:05.496605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-744374de-fd43-4b73-866c-550bbc43164f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:05.498119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-744374de-fd43-4b73-866c-550bbc43164f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:05.606961 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 702/1390] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:05.901681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3b81d-c6b1-44de-b7c5-36f2f7b1f0b2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:05.903235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dee3b81d-c6b1-44de-b7c5-36f2f7b1f0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:06.076105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3b81d-c6b1-44de-b7c5-36f2f7b1f0b2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:06.121660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:06.207793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2b351-28b5-44b6-b87f-d4ca4d105500 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:06.208313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2b351-28b5-44b6-b87f-d4ca4d105500 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:06.208626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2b351-28b5-44b6-b87f-d4ca4d105500 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:06.208998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2b351-28b5-44b6-b87f-d4ca4d105500 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:06.210516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-24f2b351-28b5-44b6-b87f-d4ca4d105500 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:06.312040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2b351-28b5-44b6-b87f-d4ca4d105500 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:06.313683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2b351-28b5-44b6-b87f-d4ca4d105500 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:06.334971 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 689/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:10:08.461886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896fab4-9bc6-4a89-bf41-fd266b9c0cbd None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:08.462502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896fab4-9bc6-4a89-bf41-fd266b9c0cbd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:08.462502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896fab4-9bc6-4a89-bf41-fd266b9c0cbd None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:08.463801 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 703/1392] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:10:08.469704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e48450-5751-4f5c-8d17-7ad6b854ba19 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:08.470235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e48450-5751-4f5c-8d17-7ad6b854ba19 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:08.470235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e48450-5751-4f5c-8d17-7ad6b854ba19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:08.536462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:08.545466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b3e48450-5751-4f5c-8d17-7ad6b854ba19 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:08.546757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b3e48450-5751-4f5c-8d17-7ad6b854ba19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:08.651099 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 690/1393] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:08.938480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896fab4-9bc6-4a89-bf41-fd266b9c0cbd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:08.940269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0896fab4-9bc6-4a89-bf41-fd266b9c0cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:08.986464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:09.161865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896fab4-9bc6-4a89-bf41-fd266b9c0cbd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:09.242847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba174-3b48-47d9-a12f-a60b89a93e57 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:09.243058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba174-3b48-47d9-a12f-a60b89a93e57 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:09.243365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba174-3b48-47d9-a12f-a60b89a93e57 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:09.244897 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 691/1394] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:10:09.250792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4016b8-f1f5-4c82-bf13-c002b4810e8f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:09.251240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4016b8-f1f5-4c82-bf13-c002b4810e8f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:09.251565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4016b8-f1f5-4c82-bf13-c002b4810e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:09.295706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:09.298688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c7c0f-380e-4a02-9286-bf5c4877475c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:09.299575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c7c0f-380e-4a02-9286-bf5c4877475c service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:09.300065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c7c0f-380e-4a02-9286-bf5c4877475c service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:09.301205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c7c0f-380e-4a02-9286-bf5c4877475c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:09.302289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a0c7c0f-380e-4a02-9286-bf5c4877475c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:09.335601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8b4016b8-f1f5-4c82-bf13-c002b4810e8f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:09.337070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8b4016b8-f1f5-4c82-bf13-c002b4810e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:09.409595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c7c0f-380e-4a02-9286-bf5c4877475c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:09.411317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c7c0f-380e-4a02-9286-bf5c4877475c service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:09.422420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:09.432408 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 704/1395] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:10:09.457848 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 692/1396] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:09.759833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a588a-265f-427c-9467-9fa6e8543282 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:09.760364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a588a-265f-427c-9467-9fa6e8543282 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:09.760364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a588a-265f-427c-9467-9fa6e8543282 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:09.761637 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 705/1397] 10.222.0.27 () {54 vars in 967 bytes} [Sun Aug 28 18:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:10:09.767119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50082b69-6c9d-4bf0-8e28-58cf4c908291 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:09.767689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50082b69-6c9d-4bf0-8e28-58cf4c908291 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:09.767689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50082b69-6c9d-4bf0-8e28-58cf4c908291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:09.855265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-50082b69-6c9d-4bf0-8e28-58cf4c908291 None None] MFA Rules not processed for user `cfed720323bd42329feb7574963f744a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:09.856543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-50082b69-6c9d-4bf0-8e28-58cf4c908291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:09.943121 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 693/1398] 10.222.0.27 () {58 vars in 1064 bytes} [Sun Aug 28 18:10:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:09.952056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a588a-265f-427c-9467-9fa6e8543282 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:09.953687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c8a588a-265f-427c-9467-9fa6e8543282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:10.090758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a588a-265f-427c-9467-9fa6e8543282 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:10.116594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:10.188465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c748e-6f1a-46fe-9dd5-46f86b0b4006 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:10.189085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c748e-6f1a-46fe-9dd5-46f86b0b4006 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:10.189401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c748e-6f1a-46fe-9dd5-46f86b0b4006 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:10.189695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c748e-6f1a-46fe-9dd5-46f86b0b4006 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:10.191347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-039c748e-6f1a-46fe-9dd5-46f86b0b4006 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:10.319104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c748e-6f1a-46fe-9dd5-46f86b0b4006 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:10.320603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c748e-6f1a-46fe-9dd5-46f86b0b4006 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:10.342274 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 706/1399] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:10:11.097156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9b602-157f-4cc6-847f-e3fe55dcd86e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:11.097707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9b602-157f-4cc6-847f-e3fe55dcd86e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:11.097707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9b602-157f-4cc6-847f-e3fe55dcd86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:11.172888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b0e9b602-157f-4cc6-847f-e3fe55dcd86e None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:11.174110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b0e9b602-157f-4cc6-847f-e3fe55dcd86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:11.198174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:11.274956 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 694/1400] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:10:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:11.320997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20288ab7-de14-42ea-b8a4-3059877073be None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:11.321552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20288ab7-de14-42ea-b8a4-3059877073be None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:11.321552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20288ab7-de14-42ea-b8a4-3059877073be None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:11.322905 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 707/1401] 10.222.0.27 () {54 vars in 943 bytes} [Sun Aug 28 18:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:10:11.329610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f913d-9844-4ee9-8702-96149942bca9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:11.330097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f913d-9844-4ee9-8702-96149942bca9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:11.330451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f913d-9844-4ee9-8702-96149942bca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:11.438295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2f8f913d-9844-4ee9-8702-96149942bca9 None None] MFA Rules not processed for user `d55caefe410444509a1eee4262b76c80`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:11.439782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2f8f913d-9844-4ee9-8702-96149942bca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:11.443819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3422e9-5599-4cad-985a-4762ce34b720 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:11.444157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3422e9-5599-4cad-985a-4762ce34b720 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:11.444435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3422e9-5599-4cad-985a-4762ce34b720 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:11.445779 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 708/1402] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:10:11.451321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a937fe-45af-40d3-b645-8a115d7e2745 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:11.451697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a937fe-45af-40d3-b645-8a115d7e2745 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:11.452057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a937fe-45af-40d3-b645-8a115d7e2745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:11.523737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f7a937fe-45af-40d3-b645-8a115d7e2745 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:11.525048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f7a937fe-45af-40d3-b645-8a115d7e2745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:11.527200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:11.552605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:11.561333 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 695/1403] 10.222.0.27 () {58 vars in 1040 bytes} [Sun Aug 28 18:10:11 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:11.572504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f913d-9844-4ee9-8702-96149942bca9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:11.586153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f913d-9844-4ee9-8702-96149942bca9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:11.637675 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 709/1404] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:10:11.713042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c84c9e-64b5-4e1f-ba81-bd0683cf11bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:11.713655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c84c9e-64b5-4e1f-ba81-bd0683cf11bd service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:11.713935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c84c9e-64b5-4e1f-ba81-bd0683cf11bd service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:11.714206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c84c9e-64b5-4e1f-ba81-bd0683cf11bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:11.715900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d7c84c9e-64b5-4e1f-ba81-bd0683cf11bd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:11.805963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c84c9e-64b5-4e1f-ba81-bd0683cf11bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:11.807520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c84c9e-64b5-4e1f-ba81-bd0683cf11bd service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:11.816614 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 696/1405] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:10:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:10:11.928376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a937fe-45af-40d3-b645-8a115d7e2745 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:11.929597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f7a937fe-45af-40d3-b645-8a115d7e2745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:12.071042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a937fe-45af-40d3-b645-8a115d7e2745 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:12.098346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:12.206804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d4db0-3729-488e-ac64-abda715e097f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:12.207461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d4db0-3729-488e-ac64-abda715e097f service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:12.207740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d4db0-3729-488e-ac64-abda715e097f service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:12.208017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d4db0-3729-488e-ac64-abda715e097f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:12.209649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f63d4db0-3729-488e-ac64-abda715e097f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:12.317070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d4db0-3729-488e-ac64-abda715e097f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:12.318717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d4db0-3729-488e-ac64-abda715e097f service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:12.339410 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 710/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:10:14.375884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b4aa6-2af9-4902-87a4-b4e2b0b6fa5f None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:14.376460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b4aa6-2af9-4902-87a4-b4e2b0b6fa5f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:14.376460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b4aa6-2af9-4902-87a4-b4e2b0b6fa5f None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:14.377794 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 697/1407] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:10:14.383783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea006d8-2cfb-45ed-adb1-5adc85bafff9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:14.384296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea006d8-2cfb-45ed-adb1-5adc85bafff9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:14.384296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea006d8-2cfb-45ed-adb1-5adc85bafff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:14.420686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:14.459558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aea006d8-2cfb-45ed-adb1-5adc85bafff9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:14.460787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aea006d8-2cfb-45ed-adb1-5adc85bafff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:14.582620 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 711/1408] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:14.868377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b4aa6-2af9-4902-87a4-b4e2b0b6fa5f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:14.870249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2b9b4aa6-2af9-4902-87a4-b4e2b0b6fa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:14.900446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:15.057032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b4aa6-2af9-4902-87a4-b4e2b0b6fa5f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:15.167493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:15.188502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1b3f6-fc7a-4ed5-a4ef-97be8534b0ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:15.189156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1b3f6-fc7a-4ed5-a4ef-97be8534b0ec service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:15.189439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1b3f6-fc7a-4ed5-a4ef-97be8534b0ec service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:15.189715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1b3f6-fc7a-4ed5-a4ef-97be8534b0ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:15.191484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-03e1b3f6-fc7a-4ed5-a4ef-97be8534b0ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:15.305540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1b3f6-fc7a-4ed5-a4ef-97be8534b0ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:15.307197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1b3f6-fc7a-4ed5-a4ef-97be8534b0ec service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:15.328320 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 698/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:10:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:10:24.580265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=54 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:25.325380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=52 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:34.800248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a376b8-9965-4324-98eb-0b1efe3af36d None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:34.800831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a376b8-9965-4324-98eb-0b1efe3af36d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:34.800831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a376b8-9965-4324-98eb-0b1efe3af36d None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:34.802152 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 712/1410] 10.222.0.27 () {54 vars in 918 bytes} [Sun Aug 28 18:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:10:34.807703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe1a46-a8d4-4c76-837b-08fc7da7af7b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:34.808177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe1a46-a8d4-4c76-837b-08fc7da7af7b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:34.808296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe1a46-a8d4-4c76-837b-08fc7da7af7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:34.900232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5afe1a46-a8d4-4c76-837b-08fc7da7af7b None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:34.901484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5afe1a46-a8d4-4c76-837b-08fc7da7af7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:35.020330 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 699/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Sun Aug 28 18:10:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:35.035215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229828e9-eadc-4b60-ad25-e69eb5195e73 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:35.035518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229828e9-eadc-4b60-ad25-e69eb5195e73 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:35.035927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229828e9-eadc-4b60-ad25-e69eb5195e73 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:35.037930 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 713/1412] 10.222.0.27 () {54 vars in 918 bytes} [Sun Aug 28 18:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:10:35.044895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67c601-6aaa-486c-8236-167bb92dd22a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:35.045209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67c601-6aaa-486c-8236-167bb92dd22a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:35.045586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67c601-6aaa-486c-8236-167bb92dd22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:35.127863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:35.131029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bd67c601-6aaa-486c-8236-167bb92dd22a None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:35.133182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bd67c601-6aaa-486c-8236-167bb92dd22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:35.271798 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 700/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Sun Aug 28 18:10:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:37.665243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78aa26b-a38c-4161-b8fc-d90979d6ccb3 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:37.665932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78aa26b-a38c-4161-b8fc-d90979d6ccb3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:37.665932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78aa26b-a38c-4161-b8fc-d90979d6ccb3 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:37.667393 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:10:37.676868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8ad99-8f5e-4c77-991b-f23f86371d7a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:37.677713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8ad99-8f5e-4c77-991b-f23f86371d7a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:37.677713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8ad99-8f5e-4c77-991b-f23f86371d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:37.758403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9ca8ad99-8f5e-4c77-991b-f23f86371d7a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:37.759570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9ca8ad99-8f5e-4c77-991b-f23f86371d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:37.822695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:37.871070 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:38.154707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78aa26b-a38c-4161-b8fc-d90979d6ccb3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:38.156392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b78aa26b-a38c-4161-b8fc-d90979d6ccb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:38.311690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78aa26b-a38c-4161-b8fc-d90979d6ccb3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:38.396056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:38.440669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd14ce6-eece-4c7c-9485-350447838d7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:38.441278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd14ce6-eece-4c7c-9485-350447838d7f service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:38.441551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd14ce6-eece-4c7c-9485-350447838d7f service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:38.441817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd14ce6-eece-4c7c-9485-350447838d7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:38.443477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fbd14ce6-eece-4c7c-9485-350447838d7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:38.560258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd14ce6-eece-4c7c-9485-350447838d7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:38.561950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd14ce6-eece-4c7c-9485-350447838d7f service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:38.582413 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 715/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:10:39.518871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bd2c1-2517-49fe-8b59-693f502260bf None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:39.519528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bd2c1-2517-49fe-8b59-693f502260bf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:39.519528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bd2c1-2517-49fe-8b59-693f502260bf None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:39.520958 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:10:39.526196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546f066-b7c6-4c31-9b05-14aab6f9066d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:39.526705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546f066-b7c6-4c31-9b05-14aab6f9066d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:39.526705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546f066-b7c6-4c31-9b05-14aab6f9066d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:39.613866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d546f066-b7c6-4c31-9b05-14aab6f9066d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:39.615120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d546f066-b7c6-4c31-9b05-14aab6f9066d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:39.647469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:39.723174 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:39.888528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bd2c1-2517-49fe-8b59-693f502260bf None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:39.890104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6e0bd2c1-2517-49fe-8b59-693f502260bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:40.048227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bd2c1-2517-49fe-8b59-693f502260bf None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:40.092563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:40.175390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c4b13-d171-466f-97e7-d7cafb618f2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:40.176016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c4b13-d171-466f-97e7-d7cafb618f2d service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:40.176281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c4b13-d171-466f-97e7-d7cafb618f2d service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:40.176545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c4b13-d171-466f-97e7-d7cafb618f2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:40.178192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-464c4b13-d171-466f-97e7-d7cafb618f2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:40.272372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c4b13-d171-466f-97e7-d7cafb618f2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:40.273975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c4b13-d171-466f-97e7-d7cafb618f2d service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:40.292921 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 703/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:10:41.184803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a142c70-c20b-406d-a2b0-d6e15d3bf17f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:41.185407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a142c70-c20b-406d-a2b0-d6e15d3bf17f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:41.185407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a142c70-c20b-406d-a2b0-d6e15d3bf17f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:41.186671 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:10:41.192244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af101fe4-c52e-46e4-bf04-54b4a761781b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:41.192769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af101fe4-c52e-46e4-bf04-54b4a761781b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:41.192769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af101fe4-c52e-46e4-bf04-54b4a761781b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:41.258034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:41.281552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-af101fe4-c52e-46e4-bf04-54b4a761781b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:41.282786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-af101fe4-c52e-46e4-bf04-54b4a761781b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:41.397514 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:41.559142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a142c70-c20b-406d-a2b0-d6e15d3bf17f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:41.560600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a142c70-c20b-406d-a2b0-d6e15d3bf17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:41.739876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a142c70-c20b-406d-a2b0-d6e15d3bf17f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:41.754138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:41.878212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099a025-2709-4aca-8e84-a9e6166dc836 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:41.878985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099a025-2709-4aca-8e84-a9e6166dc836 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:41.879282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099a025-2709-4aca-8e84-a9e6166dc836 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:41.879572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099a025-2709-4aca-8e84-a9e6166dc836 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:41.881184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6099a025-2709-4aca-8e84-a9e6166dc836 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:41.975755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099a025-2709-4aca-8e84-a9e6166dc836 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:41.977425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099a025-2709-4aca-8e84-a9e6166dc836 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:41.997212 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 718/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:10:42.866036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aa9e8-6539-46d5-9960-b427618392c4 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:42.866613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aa9e8-6539-46d5-9960-b427618392c4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:42.866613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aa9e8-6539-46d5-9960-b427618392c4 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:42.868099 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:10:42.873185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a6932-27e7-4ea3-97fb-f7bcffe50fe4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:42.873621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a6932-27e7-4ea3-97fb-f7bcffe50fe4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:42.873738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a6932-27e7-4ea3-97fb-f7bcffe50fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:42.896025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:42.961123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-668a6932-27e7-4ea3-97fb-f7bcffe50fe4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:42.962349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-668a6932-27e7-4ea3-97fb-f7bcffe50fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:43.073990 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:43.223430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aa9e8-6539-46d5-9960-b427618392c4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:43.225661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-be8aa9e8-6539-46d5-9960-b427618392c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:43.348480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:43.391393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aa9e8-6539-46d5-9960-b427618392c4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:43.516017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16746db-0d7c-4705-873b-5beb8fd4db12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:43.517004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16746db-0d7c-4705-873b-5beb8fd4db12 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:43.517475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16746db-0d7c-4705-873b-5beb8fd4db12 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:43.518000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16746db-0d7c-4705-873b-5beb8fd4db12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:43.520753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d16746db-0d7c-4705-873b-5beb8fd4db12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:43.607994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:43.622312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16746db-0d7c-4705-873b-5beb8fd4db12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:43.623992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16746db-0d7c-4705-873b-5beb8fd4db12 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:43.644621 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 706/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:10:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:10:44.515801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67eacc-2cf0-4493-a46c-1073506d35db None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:44.516376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67eacc-2cf0-4493-a46c-1073506d35db None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:44.516376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67eacc-2cf0-4493-a46c-1073506d35db None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:44.517729 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:10:44.523068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b547b-161a-4b7d-961f-ec40bb005069 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:44.523662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b547b-161a-4b7d-961f-ec40bb005069 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:44.523662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b547b-161a-4b7d-961f-ec40bb005069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:44.612984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c03b547b-161a-4b7d-961f-ec40bb005069 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:44.614258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c03b547b-161a-4b7d-961f-ec40bb005069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:44.725284 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:44.877470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67eacc-2cf0-4493-a46c-1073506d35db None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:44.879040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c67eacc-2cf0-4493-a46c-1073506d35db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:44.977167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:45.045824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67eacc-2cf0-4493-a46c-1073506d35db None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:45.169035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8399ee-3e9c-40c5-8d55-2fd6e79fa591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:45.169595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8399ee-3e9c-40c5-8d55-2fd6e79fa591 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:45.169839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8399ee-3e9c-40c5-8d55-2fd6e79fa591 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:45.170133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8399ee-3e9c-40c5-8d55-2fd6e79fa591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:45.171872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf8399ee-3e9c-40c5-8d55-2fd6e79fa591 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:45.224740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:45.269893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8399ee-3e9c-40c5-8d55-2fd6e79fa591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:45.271863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8399ee-3e9c-40c5-8d55-2fd6e79fa591 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:45.291692 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 721/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:10:46.118104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dbde9-35fb-4751-ae19-f81b68546cc6 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:46.118711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dbde9-35fb-4751-ae19-f81b68546cc6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:46.118711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dbde9-35fb-4751-ae19-f81b68546cc6 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:46.120127 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:10:46.125639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc338c4-5523-4adb-8b9e-77311936daaa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:46.126148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc338c4-5523-4adb-8b9e-77311936daaa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:46.126148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc338c4-5523-4adb-8b9e-77311936daaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:46.211959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cfc338c4-5523-4adb-8b9e-77311936daaa None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:46.213206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cfc338c4-5523-4adb-8b9e-77311936daaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:46.320370 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:46.473120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dbde9-35fb-4751-ae19-f81b68546cc6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:46.474645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b86dbde9-35fb-4751-ae19-f81b68546cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:46.532073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:46.637119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dbde9-35fb-4751-ae19-f81b68546cc6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:46.761849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b072f-a938-4281-b11d-5dd471d4bebc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:46.762374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b072f-a938-4281-b11d-5dd471d4bebc service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:46.762654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b072f-a938-4281-b11d-5dd471d4bebc service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:46.762925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b072f-a938-4281-b11d-5dd471d4bebc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:46.764620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-572b072f-a938-4281-b11d-5dd471d4bebc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:46.772638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:46.871062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b072f-a938-4281-b11d-5dd471d4bebc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:46.872665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b072f-a938-4281-b11d-5dd471d4bebc service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:46.893966 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 709/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:10:47.707072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaae7bf-3cab-4076-b137-089645173660 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:47.707661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaae7bf-3cab-4076-b137-089645173660 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:47.707661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaae7bf-3cab-4076-b137-089645173660 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:47.708986 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:10:47.714790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd7d23-49f0-43db-b9df-3495863bfb5f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:47.715345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd7d23-49f0-43db-b9df-3495863bfb5f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:47.715345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd7d23-49f0-43db-b9df-3495863bfb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:47.807366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ccfd7d23-49f0-43db-b9df-3495863bfb5f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:47.808547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ccfd7d23-49f0-43db-b9df-3495863bfb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:47.885604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:47.918823 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:48.070205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaae7bf-3cab-4076-b137-089645173660 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:48.071811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eeaae7bf-3cab-4076-b137-089645173660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:48.093641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:48.239577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaae7bf-3cab-4076-b137-089645173660 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:48.333084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:48.362044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980497f6-af7d-478b-9390-f9875265e295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:48.362669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980497f6-af7d-478b-9390-f9875265e295 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:48.362947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980497f6-af7d-478b-9390-f9875265e295 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:48.363218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980497f6-af7d-478b-9390-f9875265e295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:48.364881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-980497f6-af7d-478b-9390-f9875265e295 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:48.466796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980497f6-af7d-478b-9390-f9875265e295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:48.468572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980497f6-af7d-478b-9390-f9875265e295 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:48.487080 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 724/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:10:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:10:49.306765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f8390-010b-49fd-8ad3-55682e002638 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:49.307426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f8390-010b-49fd-8ad3-55682e002638 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:49.307426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f8390-010b-49fd-8ad3-55682e002638 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:49.308692 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:10:49.314150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbfc20-ee0b-44b6-a23f-343717de605f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:49.314635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbfc20-ee0b-44b6-a23f-343717de605f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:49.314731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbfc20-ee0b-44b6-a23f-343717de605f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:49.525454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-84bbfc20-ee0b-44b6-a23f-343717de605f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:49.526692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-84bbfc20-ee0b-44b6-a23f-343717de605f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:49.571463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:49.634692 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:49.786048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f8390-010b-49fd-8ad3-55682e002638 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:49.787629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7d2f8390-010b-49fd-8ad3-55682e002638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:49.966737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f8390-010b-49fd-8ad3-55682e002638 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:50.039608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:50.105932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9baff7-2b80-411c-a4c4-ec20a969203b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:50.106568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9baff7-2b80-411c-a4c4-ec20a969203b service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:50.106843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9baff7-2b80-411c-a4c4-ec20a969203b service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:50.107113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9baff7-2b80-411c-a4c4-ec20a969203b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:50.108762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7e9baff7-2b80-411c-a4c4-ec20a969203b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:50.214929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9baff7-2b80-411c-a4c4-ec20a969203b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:50.216592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9baff7-2b80-411c-a4c4-ec20a969203b service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:50.236730 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 712/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:10:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:10:51.055861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c33082-647c-400f-9a2e-5b57540a2204 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:51.055861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c33082-647c-400f-9a2e-5b57540a2204 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:51.055861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c33082-647c-400f-9a2e-5b57540a2204 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:51.055861 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:10:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:10:51.062008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c2e18-5864-4636-91f1-ea145ccae3d0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:51.062492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c2e18-5864-4636-91f1-ea145ccae3d0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:51.063005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c2e18-5864-4636-91f1-ea145ccae3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:51.158349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c26c2e18-5864-4636-91f1-ea145ccae3d0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:51.159613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c26c2e18-5864-4636-91f1-ea145ccae3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:51.161807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:51.268216 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:51.419803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c33082-647c-400f-9a2e-5b57540a2204 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:51.421338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-12c33082-647c-400f-9a2e-5b57540a2204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:51.584089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c33082-647c-400f-9a2e-5b57540a2204 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:51.614245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:51.716889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285e618-dcf7-4698-a16b-c256743d9749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:51.717645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285e618-dcf7-4698-a16b-c256743d9749 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:51.718079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285e618-dcf7-4698-a16b-c256743d9749 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:51.718521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285e618-dcf7-4698-a16b-c256743d9749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:51.720302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4285e618-dcf7-4698-a16b-c256743d9749 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:51.824697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285e618-dcf7-4698-a16b-c256743d9749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:51.826319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285e618-dcf7-4698-a16b-c256743d9749 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:51.845387 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 727/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:10:53.672185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9de530-e6a1-488e-90d5-c639ba765ba7 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:53.672865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9de530-e6a1-488e-90d5-c639ba765ba7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:53.672865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9de530-e6a1-488e-90d5-c639ba765ba7 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:53.674079 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:10:53.680628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf6f1c-3e27-4a92-b929-ff4f5c88fdca None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:53.681130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf6f1c-3e27-4a92-b929-ff4f5c88fdca None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:53.681130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf6f1c-3e27-4a92-b929-ff4f5c88fdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:53.737476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:53.767163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2cdf6f1c-3e27-4a92-b929-ff4f5c88fdca None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:53.768411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2cdf6f1c-3e27-4a92-b929-ff4f5c88fdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:53.878211 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:54.156227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9de530-e6a1-488e-90d5-c639ba765ba7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:54.157812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3c9de530-e6a1-488e-90d5-c639ba765ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:54.274676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9de530-e6a1-488e-90d5-c639ba765ba7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:54.309120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:54.355652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd092323-9bb3-43ce-888e-0ce241368918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:54.356281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd092323-9bb3-43ce-888e-0ce241368918 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:54.356554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd092323-9bb3-43ce-888e-0ce241368918 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:54.356822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd092323-9bb3-43ce-888e-0ce241368918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:54.358459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dd092323-9bb3-43ce-888e-0ce241368918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:54.478382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd092323-9bb3-43ce-888e-0ce241368918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:54.479824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd092323-9bb3-43ce-888e-0ce241368918 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:54.498795 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 715/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:10:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:10:56.560654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28119df4-7303-40d0-a7fd-5efef0a98b74 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:56.561036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28119df4-7303-40d0-a7fd-5efef0a98b74 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:56.561230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28119df4-7303-40d0-a7fd-5efef0a98b74 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:56.562639 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:10:56.570369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8e729-e3d7-4bbb-89a8-0afdd16fe884 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:56.570900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8e729-e3d7-4bbb-89a8-0afdd16fe884 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:56.570900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8e729-e3d7-4bbb-89a8-0afdd16fe884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:56.642111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-aed8e729-e3d7-4bbb-89a8-0afdd16fe884 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:56.643395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aed8e729-e3d7-4bbb-89a8-0afdd16fe884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:56.657661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:56.756430 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:10:57.042343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28119df4-7303-40d0-a7fd-5efef0a98b74 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:10:57.043925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-28119df4-7303-40d0-a7fd-5efef0a98b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:57.155319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28119df4-7303-40d0-a7fd-5efef0a98b74 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:10:57.168798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:57.242354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be0e5e-1b67-43d1-9b1a-1ea202c833f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:10:57.242964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be0e5e-1b67-43d1-9b1a-1ea202c833f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:57.243241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be0e5e-1b67-43d1-9b1a-1ea202c833f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:57.243538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be0e5e-1b67-43d1-9b1a-1ea202c833f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:57.245152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-25be0e5e-1b67-43d1-9b1a-1ea202c833f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:57.371073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be0e5e-1b67-43d1-9b1a-1ea202c833f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:10:57.372592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be0e5e-1b67-43d1-9b1a-1ea202c833f4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:10:57.395198 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 730/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:10:59.660546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe26388-e290-406d-95b5-951761f5a3a9 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:59.661135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe26388-e290-406d-95b5-951761f5a3a9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:59.661135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe26388-e290-406d-95b5-951761f5a3a9 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:59.662469 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:10:59.669281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bebf36-d986-44f6-9dea-9816e81d4cf1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:10:59.670058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bebf36-d986-44f6-9dea-9816e81d4cf1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:10:59.670058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bebf36-d986-44f6-9dea-9816e81d4cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:10:59.726393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:10:59.747245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-80bebf36-d986-44f6-9dea-9816e81d4cf1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:10:59.748432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80bebf36-d986-44f6-9dea-9816e81d4cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:10:59.867343 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:11:00.145156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe26388-e290-406d-95b5-951761f5a3a9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:11:00.146710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bbe26388-e290-406d-95b5-951761f5a3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:00.262464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe26388-e290-406d-95b5-951761f5a3a9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:11:00.305034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:00.343505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc03a56-745f-4e18-b751-437770291b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:11:00.344127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc03a56-745f-4e18-b751-437770291b35 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:00.344406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc03a56-745f-4e18-b751-437770291b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:00.344819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc03a56-745f-4e18-b751-437770291b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:00.346491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6fc03a56-745f-4e18-b751-437770291b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:00.470936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc03a56-745f-4e18-b751-437770291b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:11:00.472386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc03a56-745f-4e18-b751-437770291b35 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:11:00.493241 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 718/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:11:02.614189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1c521-8dfe-477c-b951-ab27870ed8c6 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:02.614816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1c521-8dfe-477c-b951-ab27870ed8c6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:02.614816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1c521-8dfe-477c-b951-ab27870ed8c6 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:02.616125 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:11:02.621788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff0d9f-0b18-4dd2-af7b-e76e1e2324b0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:02.622266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff0d9f-0b18-4dd2-af7b-e76e1e2324b0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:02.622381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff0d9f-0b18-4dd2-af7b-e76e1e2324b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:02.702074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-58ff0d9f-0b18-4dd2-af7b-e76e1e2324b0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:11:02.703435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-58ff0d9f-0b18-4dd2-af7b-e76e1e2324b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:02.729006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:02.815354 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:11:03.096469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1c521-8dfe-477c-b951-ab27870ed8c6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:11:03.098025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-22f1c521-8dfe-477c-b951-ab27870ed8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:03.214644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1c521-8dfe-477c-b951-ab27870ed8c6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:11:03.235606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:03.297796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6e1a2-2ee3-4975-b9b4-e0217fa77c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:11:03.298410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6e1a2-2ee3-4975-b9b4-e0217fa77c67 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:03.298684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6e1a2-2ee3-4975-b9b4-e0217fa77c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:03.298951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6e1a2-2ee3-4975-b9b4-e0217fa77c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:03.300642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-41b6e1a2-2ee3-4975-b9b4-e0217fa77c67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:03.421048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6e1a2-2ee3-4975-b9b4-e0217fa77c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:11:03.422460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6e1a2-2ee3-4975-b9b4-e0217fa77c67 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:11:03.442502 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 733/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:11:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:11:05.452490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9abf4-9b9c-4fc7-9d68-1a21ae8f7f5f None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:05.453071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9abf4-9b9c-4fc7-9d68-1a21ae8f7f5f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:05.453071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9abf4-9b9c-4fc7-9d68-1a21ae8f7f5f None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:05.454461 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:11:05.462825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bb425-f17f-4c2b-b795-7d0061aad304 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:05.463373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bb425-f17f-4c2b-b795-7d0061aad304 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:05.463501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bb425-f17f-4c2b-b795-7d0061aad304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:05.539127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:05.542779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f07bb425-f17f-4c2b-b795-7d0061aad304 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:11:05.549985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f07bb425-f17f-4c2b-b795-7d0061aad304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:05.665194 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:11:05.947581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9abf4-9b9c-4fc7-9d68-1a21ae8f7f5f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:11:05.949145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-abb9abf4-9b9c-4fc7-9d68-1a21ae8f7f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:06.074266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9abf4-9b9c-4fc7-9d68-1a21ae8f7f5f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:11:06.126535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:06.152021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4daf8e-d6af-4df0-b6fc-59371fa5483c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:11:06.152612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4daf8e-d6af-4df0-b6fc-59371fa5483c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:06.152889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4daf8e-d6af-4df0-b6fc-59371fa5483c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:06.153161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4daf8e-d6af-4df0-b6fc-59371fa5483c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:06.154739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3f4daf8e-d6af-4df0-b6fc-59371fa5483c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:06.274742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4daf8e-d6af-4df0-b6fc-59371fa5483c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:11:06.276149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4daf8e-d6af-4df0-b6fc-59371fa5483c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:11:06.294900 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 721/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:11:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:11:08.273950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02046312-8a3f-49c0-b599-a13cf6063c9d None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:08.274519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02046312-8a3f-49c0-b599-a13cf6063c9d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:08.274519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02046312-8a3f-49c0-b599-a13cf6063c9d None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:08.275813 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:11:08.282282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82876739-84a5-40b1-90b2-e3701ff96f9d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:08.282787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82876739-84a5-40b1-90b2-e3701ff96f9d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:08.282879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82876739-84a5-40b1-90b2-e3701ff96f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:08.356002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-82876739-84a5-40b1-90b2-e3701ff96f9d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:11:08.357235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-82876739-84a5-40b1-90b2-e3701ff96f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:08.391772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:08.465832 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:11:08.749565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02046312-8a3f-49c0-b599-a13cf6063c9d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:11:08.751124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-02046312-8a3f-49c0-b599-a13cf6063c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:08.862373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02046312-8a3f-49c0-b599-a13cf6063c9d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:11:08.892514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:08.944306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a8bfa-fa8f-4087-be53-f37cc52e020b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:11:08.944919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a8bfa-fa8f-4087-be53-f37cc52e020b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:08.945203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a8bfa-fa8f-4087-be53-f37cc52e020b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:08.945479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a8bfa-fa8f-4087-be53-f37cc52e020b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:08.947154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c30a8bfa-fa8f-4087-be53-f37cc52e020b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:09.071207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a8bfa-fa8f-4087-be53-f37cc52e020b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:11:09.072763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a8bfa-fa8f-4087-be53-f37cc52e020b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:11:09.092153 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 736/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:11:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:11:11.036961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b56955-58e8-4cba-a55a-f698cc414ecd None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:11.037558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b56955-58e8-4cba-a55a-f698cc414ecd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:11.037670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b56955-58e8-4cba-a55a-f698cc414ecd None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:11.039165 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:11:11.045040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fff123-4aec-40af-9843-4aca8fcdb259 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:11.045585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fff123-4aec-40af-9843-4aca8fcdb259 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:11.045585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fff123-4aec-40af-9843-4aca8fcdb259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:11.115396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a2fff123-4aec-40af-9843-4aca8fcdb259 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:11:11.116903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a2fff123-4aec-40af-9843-4aca8fcdb259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:11.125923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:11.223977 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:11:11.519965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b56955-58e8-4cba-a55a-f698cc414ecd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:11:11.521508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a7b56955-58e8-4cba-a55a-f698cc414ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:11.644608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b56955-58e8-4cba-a55a-f698cc414ecd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:11:11.705845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:11.726835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4a3d7-787f-4118-b60a-67420694f243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:11:11.727474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4a3d7-787f-4118-b60a-67420694f243 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:11.727756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4a3d7-787f-4118-b60a-67420694f243 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:11.728028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4a3d7-787f-4118-b60a-67420694f243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:11.729673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aed4a3d7-787f-4118-b60a-67420694f243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:11.849429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4a3d7-787f-4118-b60a-67420694f243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:11:11.850881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4a3d7-787f-4118-b60a-67420694f243 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:11:11.870350 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 724/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:11:13.912061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aefe2-bf49-4c1f-9385-d03909853b60 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:13.912604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aefe2-bf49-4c1f-9385-d03909853b60 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:13.912604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aefe2-bf49-4c1f-9385-d03909853b60 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:13.913968 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:11:13.921614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0f03d-c416-4f5f-bf08-be315405eebf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:13.922191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0f03d-c416-4f5f-bf08-be315405eebf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:13.922191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0f03d-c416-4f5f-bf08-be315405eebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:13.994985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-aeb0f03d-c416-4f5f-bf08-be315405eebf None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:11:13.996248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aeb0f03d-c416-4f5f-bf08-be315405eebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:14.038011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:14.099703 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:11:14.382583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8aefe2-bf49-4c1f-9385-d03909853b60 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:11:14.384740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1a8aefe2-bf49-4c1f-9385-d03909853b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:14.502250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8aefe2-bf49-4c1f-9385-d03909853b60 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:11:14.550422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:14.590661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa25ff4-9ec7-4c31-800a-88ead45914de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:11:14.591309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa25ff4-9ec7-4c31-800a-88ead45914de service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:14.591600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa25ff4-9ec7-4c31-800a-88ead45914de service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:14.591870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa25ff4-9ec7-4c31-800a-88ead45914de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:14.593569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-efa25ff4-9ec7-4c31-800a-88ead45914de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:14.709450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa25ff4-9ec7-4c31-800a-88ead45914de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:11:14.710813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa25ff4-9ec7-4c31-800a-88ead45914de service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:11:14.731010 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 739/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:11:16.699828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8ee7e-c64e-4a77-9d2c-20fc4e89148d None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:16.700391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8ee7e-c64e-4a77-9d2c-20fc4e89148d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:16.700391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8ee7e-c64e-4a77-9d2c-20fc4e89148d None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:16.701729 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:11:16.707563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd710d-b7ba-45d0-bc41-bfba1928a34f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:16.708068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd710d-b7ba-45d0-bc41-bfba1928a34f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:16.708165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd710d-b7ba-45d0-bc41-bfba1928a34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:16.782386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-99cd710d-b7ba-45d0-bc41-bfba1928a34f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:11:16.783781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-99cd710d-b7ba-45d0-bc41-bfba1928a34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:16.810703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:16.896985 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:11:17.179729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8ee7e-c64e-4a77-9d2c-20fc4e89148d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:11:17.181888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2fc8ee7e-c64e-4a77-9d2c-20fc4e89148d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:17.298395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8ee7e-c64e-4a77-9d2c-20fc4e89148d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:11:17.372707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:17.380413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b60f9-ecdb-4fe2-a07c-6752a90465f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:11:17.381025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b60f9-ecdb-4fe2-a07c-6752a90465f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:17.381301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b60f9-ecdb-4fe2-a07c-6752a90465f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:17.381564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b60f9-ecdb-4fe2-a07c-6752a90465f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:17.383515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ca4b60f9-ecdb-4fe2-a07c-6752a90465f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:17.508437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b60f9-ecdb-4fe2-a07c-6752a90465f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:11:17.509919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b60f9-ecdb-4fe2-a07c-6752a90465f6 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:11:17.529605 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 727/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:11:19.467455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3122-98c2-42c3-9d29-a8b67282b749 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:19.468316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3122-98c2-42c3-9d29-a8b67282b749 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:19.468316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3122-98c2-42c3-9d29-a8b67282b749 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:19.469529 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:11:19.475632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8187-cefe-4230-b0d8-2cd0ea2e62c5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:19.476113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8187-cefe-4230-b0d8-2cd0ea2e62c5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:19.476235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8187-cefe-4230-b0d8-2cd0ea2e62c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:19.553201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cb7b8187-cefe-4230-b0d8-2cd0ea2e62c5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:11:19.554465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cb7b8187-cefe-4230-b0d8-2cd0ea2e62c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:19.606554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:19.657674 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:11:19.944803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f3122-98c2-42c3-9d29-a8b67282b749 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:11:19.946349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-617f3122-98c2-42c3-9d29-a8b67282b749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:20.056717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f3122-98c2-42c3-9d29-a8b67282b749 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:11:20.110437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:20.139392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7a33f-b16e-4649-b9b6-e6e355bb4513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:11:20.140047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7a33f-b16e-4649-b9b6-e6e355bb4513 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:20.140325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7a33f-b16e-4649-b9b6-e6e355bb4513 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:20.140618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7a33f-b16e-4649-b9b6-e6e355bb4513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:20.142262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2cb7a33f-b16e-4649-b9b6-e6e355bb4513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:20.259636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7a33f-b16e-4649-b9b6-e6e355bb4513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:11:20.261008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7a33f-b16e-4649-b9b6-e6e355bb4513 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:11:20.282306 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 742/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:11:29.655879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=22 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:30.279498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=66 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:39.881388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f6a62-dccd-4f67-bbe3-3ba981e6d858 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:39.882367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f6a62-dccd-4f67-bbe3-3ba981e6d858 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:39.882367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f6a62-dccd-4f67-bbe3-3ba981e6d858 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:39.883638 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 729/1471] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:11:39.889288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886ea97-ff2a-4c64-bd66-06602c8d7207 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:39.889786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886ea97-ff2a-4c64-bd66-06602c8d7207 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:39.889786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886ea97-ff2a-4c64-bd66-06602c8d7207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:39.962955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d886ea97-ff2a-4c64-bd66-06602c8d7207 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:11:39.964219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d886ea97-ff2a-4c64-bd66-06602c8d7207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:40.080342 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 743/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:11:40.376533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d41f8-9138-4c02-a0f3-8264ba90006e None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:40.376838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d41f8-9138-4c02-a0f3-8264ba90006e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:40.377195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d41f8-9138-4c02-a0f3-8264ba90006e None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:40.378583 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 730/1473] 10.222.0.27 () {54 vars in 967 bytes} [Sun Aug 28 18:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:11:40.384344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d24e75-3e73-4ac6-bcf9-aeb98aaa2884 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:40.384708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d24e75-3e73-4ac6-bcf9-aeb98aaa2884 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:40.385053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d24e75-3e73-4ac6-bcf9-aeb98aaa2884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:40.470747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-18d24e75-3e73-4ac6-bcf9-aeb98aaa2884 None None] MFA Rules not processed for user `cfed720323bd42329feb7574963f744a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:11:40.472021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-18d24e75-3e73-4ac6-bcf9-aeb98aaa2884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:40.494847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:40.558262 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 744/1474] 10.222.0.27 () {58 vars in 1064 bytes} [Sun Aug 28 18:11:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:11:40.568473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d41f8-9138-4c02-a0f3-8264ba90006e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:11:40.570005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d43d41f8-9138-4c02-a0f3-8264ba90006e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:40.677386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d41f8-9138-4c02-a0f3-8264ba90006e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:11:40.757800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5c9df-bc89-4c46-acc7-6ce51cfc5ece service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:11:40.758410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5c9df-bc89-4c46-acc7-6ce51cfc5ece service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:40.758687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5c9df-bc89-4c46-acc7-6ce51cfc5ece service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:40.758956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5c9df-bc89-4c46-acc7-6ce51cfc5ece service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:40.760620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-65b5c9df-bc89-4c46-acc7-6ce51cfc5ece service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:40.824470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:40.895247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5c9df-bc89-4c46-acc7-6ce51cfc5ece service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:11:40.896669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5c9df-bc89-4c46-acc7-6ce51cfc5ece service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:11:40.917770 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 731/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:11:42.908837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969d537-a2f7-4153-8de0-28fdf46136c6 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:42.909443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969d537-a2f7-4153-8de0-28fdf46136c6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:42.909443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969d537-a2f7-4153-8de0-28fdf46136c6 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:42.910713 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 745/1476] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:11:42.917051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ddd35-cf09-40c9-a7ee-6ef10756fe11 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:42.917833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ddd35-cf09-40c9-a7ee-6ef10756fe11 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:42.917833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ddd35-cf09-40c9-a7ee-6ef10756fe11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:42.993897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a99ddd35-cf09-40c9-a7ee-6ef10756fe11 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:11:42.995107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a99ddd35-cf09-40c9-a7ee-6ef10756fe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:43.114030 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 732/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:11:43.392908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969d537-a2f7-4153-8de0-28fdf46136c6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:11:43.394473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b969d537-a2f7-4153-8de0-28fdf46136c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:43.538981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969d537-a2f7-4153-8de0-28fdf46136c6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:11:43.596367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:43.648600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c2438-85e6-4a6a-9021-cdbc23af7b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:11:43.649481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c2438-85e6-4a6a-9021-cdbc23af7b26 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:43.649905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c2438-85e6-4a6a-9021-cdbc23af7b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:43.650355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c2438-85e6-4a6a-9021-cdbc23af7b26 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:43.651492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c2438-85e6-4a6a-9021-cdbc23af7b26 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:11:43.654579 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-b77c2438-85e6-4a6a-9021-cdbc23af7b26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:11:43.654579 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:11:43.654579 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:11:43.656758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c2438-85e6-4a6a-9021-cdbc23af7b26 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:11:43.679313 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 746/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 18:11:43 2022] GET /identity/v3/projects => generated 2553 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:11:45.621802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e5f20-7ffb-4b99-baa3-ddb71710f4a3 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:45.622606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e5f20-7ffb-4b99-baa3-ddb71710f4a3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:45.622606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e5f20-7ffb-4b99-baa3-ddb71710f4a3 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:45.623867 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 733/1479] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:11:45.629414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaf2a0-d3ea-4a9b-8bc9-94f807e8afb7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:45.629900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaf2a0-d3ea-4a9b-8bc9-94f807e8afb7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:45.630024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaf2a0-d3ea-4a9b-8bc9-94f807e8afb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:45.708159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e5eaf2a0-d3ea-4a9b-8bc9-94f807e8afb7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:11:45.709406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e5eaf2a0-d3ea-4a9b-8bc9-94f807e8afb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:45.816456 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 747/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:11:46.110996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e5f20-7ffb-4b99-baa3-ddb71710f4a3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:11:46.112630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3d2e5f20-7ffb-4b99-baa3-ddb71710f4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:46.122969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:46.274240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e5f20-7ffb-4b99-baa3-ddb71710f4a3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:11:46.369018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:46.406702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecd9a9-1e9f-40de-8c96-b01ade117454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:11:46.407300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecd9a9-1e9f-40de-8c96-b01ade117454 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:46.407609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecd9a9-1e9f-40de-8c96-b01ade117454 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:46.407884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecd9a9-1e9f-40de-8c96-b01ade117454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:46.409487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f9ecd9a9-1e9f-40de-8c96-b01ade117454 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:46.509398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecd9a9-1e9f-40de-8c96-b01ade117454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:11:46.511016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecd9a9-1e9f-40de-8c96-b01ade117454 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:11:46.532912 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 734/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:11:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:11:48.651845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd5361-e808-4048-ad83-bc94a11ab13d None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:48.652672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd5361-e808-4048-ad83-bc94a11ab13d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:48.652672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd5361-e808-4048-ad83-bc94a11ab13d None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:48.653770 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 748/1482] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:11:48.659881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279f7b2-341f-461d-b3a8-4257a6443669 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:48.660420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279f7b2-341f-461d-b3a8-4257a6443669 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:48.660536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279f7b2-341f-461d-b3a8-4257a6443669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:48.732670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7279f7b2-341f-461d-b3a8-4257a6443669 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:11:48.733914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7279f7b2-341f-461d-b3a8-4257a6443669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:48.785487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:48.844663 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 735/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:11:49.137009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd5361-e808-4048-ad83-bc94a11ab13d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:11:49.138542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58dd5361-e808-4048-ad83-bc94a11ab13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:49.165945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:49.262277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd5361-e808-4048-ad83-bc94a11ab13d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:11:49.355949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d33458-307c-4ce1-b40d-9a95b3608e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:11:49.356470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d33458-307c-4ce1-b40d-9a95b3608e1a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:49.356749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d33458-307c-4ce1-b40d-9a95b3608e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:49.357020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d33458-307c-4ce1-b40d-9a95b3608e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:49.358628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-05d33458-307c-4ce1-b40d-9a95b3608e1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:49.440786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:49.481207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d33458-307c-4ce1-b40d-9a95b3608e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:11:49.482804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d33458-307c-4ce1-b40d-9a95b3608e1a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:11:49.503858 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 749/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:11:51.457940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b46cf-f386-4276-97ff-9b69b5140c48 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:51.458540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b46cf-f386-4276-97ff-9b69b5140c48 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:51.458540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b46cf-f386-4276-97ff-9b69b5140c48 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:51.460299 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 736/1485] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:11:51.465755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa798bc-cba6-4f6d-a1e7-31ab88c5786e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:51.466246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa798bc-cba6-4f6d-a1e7-31ab88c5786e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:51.466440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa798bc-cba6-4f6d-a1e7-31ab88c5786e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:51.534899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6aa798bc-cba6-4f6d-a1e7-31ab88c5786e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:11:51.536163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6aa798bc-cba6-4f6d-a1e7-31ab88c5786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:51.637542 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 750/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:11:51.923370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b46cf-f386-4276-97ff-9b69b5140c48 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:11:51.924940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-256b46cf-f386-4276-97ff-9b69b5140c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:52.056407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b46cf-f386-4276-97ff-9b69b5140c48 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:11:52.155348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:52.157550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc0db0-71f0-41e5-91e1-6040e0dd4d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:11:52.158319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc0db0-71f0-41e5-91e1-6040e0dd4d6c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:52.158610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc0db0-71f0-41e5-91e1-6040e0dd4d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:52.158906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc0db0-71f0-41e5-91e1-6040e0dd4d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:52.161829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-77bc0db0-71f0-41e5-91e1-6040e0dd4d6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:52.296969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc0db0-71f0-41e5-91e1-6040e0dd4d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:11:52.298485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc0db0-71f0-41e5-91e1-6040e0dd4d6c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:11:52.318956 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 737/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:11:54.324917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5c2ec-0617-4952-80eb-2304246d7f56 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:54.325504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5c2ec-0617-4952-80eb-2304246d7f56 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:54.325504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5c2ec-0617-4952-80eb-2304246d7f56 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:54.326851 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 751/1488] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:11:54.332981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6403cd6-dd74-4243-988b-0cc35f5e3bcb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:54.333494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6403cd6-dd74-4243-988b-0cc35f5e3bcb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:54.333494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6403cd6-dd74-4243-988b-0cc35f5e3bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:54.403901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e6403cd6-dd74-4243-988b-0cc35f5e3bcb None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:11:54.405143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e6403cd6-dd74-4243-988b-0cc35f5e3bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:54.459080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:54.505279 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 738/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:11:54.794581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5c2ec-0617-4952-80eb-2304246d7f56 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:11:54.796203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1fa5c2ec-0617-4952-80eb-2304246d7f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:54.835735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:54.912989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5c2ec-0617-4952-80eb-2304246d7f56 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:11:54.993186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72eee0-ffd4-4195-bca6-0e20b5dd2800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:11:54.993800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72eee0-ffd4-4195-bca6-0e20b5dd2800 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:54.994076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72eee0-ffd4-4195-bca6-0e20b5dd2800 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:54.994344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72eee0-ffd4-4195-bca6-0e20b5dd2800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:54.995984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ae72eee0-ffd4-4195-bca6-0e20b5dd2800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:55.088458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:55.120203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72eee0-ffd4-4195-bca6-0e20b5dd2800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:11:55.121729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72eee0-ffd4-4195-bca6-0e20b5dd2800 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:11:55.142877 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 752/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:11:57.239642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e1146-4ab3-4cda-bb53-22733a0b5fc7 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:57.240327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e1146-4ab3-4cda-bb53-22733a0b5fc7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:57.240327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e1146-4ab3-4cda-bb53-22733a0b5fc7 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:57.241597 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 739/1491] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 18:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:11:57.247451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b3506-06f6-4e3c-8a48-b90aaf38aa9b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:57.247905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b3506-06f6-4e3c-8a48-b90aaf38aa9b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:57.248011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b3506-06f6-4e3c-8a48-b90aaf38aa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:57.320555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-618b3506-06f6-4e3c-8a48-b90aaf38aa9b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:11:57.321781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-618b3506-06f6-4e3c-8a48-b90aaf38aa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:57.424348 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 753/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 18:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:11:57.707398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e1146-4ab3-4cda-bb53-22733a0b5fc7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:11:57.708965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e97e1146-4ab3-4cda-bb53-22733a0b5fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:57.950292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e1146-4ab3-4cda-bb53-22733a0b5fc7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:11:58.040457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b92d51-540e-4234-8124-05fd6567bb6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:11:58.041219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b92d51-540e-4234-8124-05fd6567bb6b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:11:58.041510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b92d51-540e-4234-8124-05fd6567bb6b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:11:58.041780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b92d51-540e-4234-8124-05fd6567bb6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:11:58.043483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-07b92d51-540e-4234-8124-05fd6567bb6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:11:58.052769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:11:58.175342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b92d51-540e-4234-8124-05fd6567bb6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:11:58.177356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b92d51-540e-4234-8124-05fd6567bb6b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:11:58.207128 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 740/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:12:07.422239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:12:08.204345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=50 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:13:18.160335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda607d-b0d7-40b4-86fa-40904420e787 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:13:18.160962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda607d-b0d7-40b4-86fa-40904420e787 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:13:18.160962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda607d-b0d7-40b4-86fa-40904420e787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:13:18.238362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0fda607d-b0d7-40b4-86fa-40904420e787 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:13:18.239624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0fda607d-b0d7-40b4-86fa-40904420e787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:13:18.340495 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 754/1494] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:13:18.348857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6170b6-1b65-4111-9e1c-ae68ea08a726 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:13:18.349391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6170b6-1b65-4111-9e1c-ae68ea08a726 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:13:18.349391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6170b6-1b65-4111-9e1c-ae68ea08a726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:13:18.429103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6e6170b6-1b65-4111-9e1c-ae68ea08a726 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:13:18.430231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6e6170b6-1b65-4111-9e1c-ae68ea08a726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:13:18.531894 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 741/1495] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:13:18.536809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda607d-b0d7-40b4-86fa-40904420e787 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:13:18.538034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0fda607d-b0d7-40b4-86fa-40904420e787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:13:18.550274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda607d-b0d7-40b4-86fa-40904420e787 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:13:18.617709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:13:18.654742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978f56b-ca6d-4ebe-8e34-8925866e0047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:13:18.655388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978f56b-ca6d-4ebe-8e34-8925866e0047 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:13:18.655671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978f56b-ca6d-4ebe-8e34-8925866e0047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:13:18.655939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978f56b-ca6d-4ebe-8e34-8925866e0047 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:13:18.656591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978f56b-ca6d-4ebe-8e34-8925866e0047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:13:18.656891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978f56b-ca6d-4ebe-8e34-8925866e0047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:13:18.657926 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-f978f56b-ca6d-4ebe-8e34-8925866e0047 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:13:18.657926 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:13:18.657926 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:13:18.658822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978f56b-ca6d-4ebe-8e34-8925866e0047 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:13:18.670583 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 755/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:13:18.678989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6170b6-1b65-4111-9e1c-ae68ea08a726 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:13:18.688456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6170b6-1b65-4111-9e1c-ae68ea08a726 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:13:18.752488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:13:18.788433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c6af7-6b36-4439-8615-355bbd6cf47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:13:18.789044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c6af7-6b36-4439-8615-355bbd6cf47f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:13:18.789325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c6af7-6b36-4439-8615-355bbd6cf47f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:13:18.789599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c6af7-6b36-4439-8615-355bbd6cf47f admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:13:18.790242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c6af7-6b36-4439-8615-355bbd6cf47f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:13:18.792049 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-443c6af7-6b36-4439-8615-355bbd6cf47f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:13:18.792049 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:13:18.792049 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:13:18.793268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c6af7-6b36-4439-8615-355bbd6cf47f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:13:18.852182 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 742/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:13:18 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:13:18.856151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978f56b-ca6d-4ebe-8e34-8925866e0047 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:13:18.857774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f978f56b-ca6d-4ebe-8e34-8925866e0047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:13:18.893659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978f56b-ca6d-4ebe-8e34-8925866e0047 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:13:18.993067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fa84-b7fe-481e-b605-be014aaf0d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:13:18.993555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fa84-b7fe-481e-b605-be014aaf0d7d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:13:18.993826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fa84-b7fe-481e-b605-be014aaf0d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:13:18.994102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fa84-b7fe-481e-b605-be014aaf0d7d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:13:18.994745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710fa84-b7fe-481e-b605-be014aaf0d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:13:18.995788 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-b710fa84-b7fe-481e-b605-be014aaf0d7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:13:18.995788 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:13:18.995788 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:13:18.997015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710fa84-b7fe-481e-b605-be014aaf0d7d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:13:19.042581 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 756/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:13:18 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:13:19.046963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c6af7-6b36-4439-8615-355bbd6cf47f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:13:19.048570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-443c6af7-6b36-4439-8615-355bbd6cf47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:13:19.124195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c6af7-6b36-4439-8615-355bbd6cf47f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:13:19.210548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:13:19.222813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c418d-73d6-4f88-8365-70a6f3dddec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:13:19.223468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c418d-73d6-4f88-8365-70a6f3dddec8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:13:19.223738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c418d-73d6-4f88-8365-70a6f3dddec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:13:19.224012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c418d-73d6-4f88-8365-70a6f3dddec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:13:19.224672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c418d-73d6-4f88-8365-70a6f3dddec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:13:19.225764 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-b23c418d-73d6-4f88-8365-70a6f3dddec8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:13:19.225764 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:13:19.225764 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:13:19.227199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c418d-73d6-4f88-8365-70a6f3dddec8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:13:19.240998 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 743/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:13:19.245641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fa84-b7fe-481e-b605-be014aaf0d7d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:13:19.247201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b710fa84-b7fe-481e-b605-be014aaf0d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:13:19.259639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fa84-b7fe-481e-b605-be014aaf0d7d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:13:19.286272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:13:19.360342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c90d05-3a4f-4812-bea0-20217665d86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:13:19.360986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c90d05-3a4f-4812-bea0-20217665d86e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:13:19.361263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c90d05-3a4f-4812-bea0-20217665d86e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:13:19.361536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c90d05-3a4f-4812-bea0-20217665d86e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:13:19.362189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c90d05-3a4f-4812-bea0-20217665d86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:13:19.363220 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-c4c90d05-3a4f-4812-bea0-20217665d86e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:13:19.363220 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:13:19.363220 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:13:19.364146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c90d05-3a4f-4812-bea0-20217665d86e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:13:19.377274 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 757/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:13:19.381524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c418d-73d6-4f88-8365-70a6f3dddec8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:13:19.383416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b23c418d-73d6-4f88-8365-70a6f3dddec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:13:19.418203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c418d-73d6-4f88-8365-70a6f3dddec8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:13:19.521538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da4b7c-3bf6-4321-a0ba-8d1970505f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:13:19.522139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da4b7c-3bf6-4321-a0ba-8d1970505f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:13:19.522416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da4b7c-3bf6-4321-a0ba-8d1970505f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:13:19.522708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da4b7c-3bf6-4321-a0ba-8d1970505f8a admin admin] PATH_INFO: `/v3/projects/87b07f97914449b0ae1d10ad6aab58e2/users/691166ba24034f518a31347b01fe4e28/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:13:19.546479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da4b7c-3bf6-4321-a0ba-8d1970505f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b07f97914449b0ae1d10ad6aab58e2, user_id=691166ba24034f518a31347b01fe4e28, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:13:19.547663 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-27da4b7c-3bf6-4321-a0ba-8d1970505f8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:13:19.547663 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:13:19.547663 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:13:19.549609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da4b7c-3bf6-4321-a0ba-8d1970505f8a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:13:19.577869 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 744/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:13:19 2022] PUT /identity/v3/projects/87b07f97914449b0ae1d10ad6aab58e2/users/691166ba24034f518a31347b01fe4e28/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:13:19.590059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc13c2-ad5e-4483-9cef-b728903901a6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:13:19.590381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc13c2-ad5e-4483-9cef-b728903901a6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:13:19.590649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc13c2-ad5e-4483-9cef-b728903901a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:13:19.648703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-54dc13c2-ad5e-4483-9cef-b728903901a6 None None] MFA Rules not processed for user `691166ba24034f518a31347b01fe4e28`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:13:19.649907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54dc13c2-ad5e-4483-9cef-b728903901a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:13:19.732815 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 758/1502] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:13:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:13:19.746172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07d463-b30b-4d94-a581-6aba4d85a207 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:13:19.746456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07d463-b30b-4d94-a581-6aba4d85a207 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:13:19.746734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07d463-b30b-4d94-a581-6aba4d85a207 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:13:19.748140 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 745/1503] 10.222.0.27 () {54 vars in 964 bytes} [Sun Aug 28 18:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:13:19.753219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e4bd4-a5b6-407c-99ff-52de785130ea None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:13:19.753497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e4bd4-a5b6-407c-99ff-52de785130ea None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:13:19.753767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e4bd4-a5b6-407c-99ff-52de785130ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:13:19.787676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:13:19.839113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-094e4bd4-a5b6-407c-99ff-52de785130ea None None] MFA Rules not processed for user `6b06f9395d5841b9aa28227d532964eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:13:19.840376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-094e4bd4-a5b6-407c-99ff-52de785130ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:13:19.917328 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 759/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Sun Aug 28 18:13:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:13:19.925072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07d463-b30b-4d94-a581-6aba4d85a207 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:13:19.926645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9a07d463-b30b-4d94-a581-6aba4d85a207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:13:19.981055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:13:20.038337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07d463-b30b-4d94-a581-6aba4d85a207 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:13:20.113992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbdbf4-2a21-4d26-9e59-9f53610452de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:13:20.114603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbdbf4-2a21-4d26-9e59-9f53610452de service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:13:20.114883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbdbf4-2a21-4d26-9e59-9f53610452de service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:13:20.115156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbdbf4-2a21-4d26-9e59-9f53610452de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:13:20.116822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-66cbdbf4-2a21-4d26-9e59-9f53610452de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:13:20.218110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbdbf4-2a21-4d26-9e59-9f53610452de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:13:20.219592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbdbf4-2a21-4d26-9e59-9f53610452de service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:13:20.223153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:13:20.237737 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 746/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:13:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:13:20.283738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067be8d-f72f-4bf9-8c6e-0bdfea51c72c None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:13:20.284228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067be8d-f72f-4bf9-8c6e-0bdfea51c72c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:13:20.284228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067be8d-f72f-4bf9-8c6e-0bdfea51c72c None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:13:20.285552 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 760/1506] 10.222.0.27 () {52 vars in 830 bytes} [Sun Aug 28 18:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:13:20.289417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbdbf4-2a21-4d26-9e59-9f53610452de service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:13:20.290595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-66cbdbf4-2a21-4d26-9e59-9f53610452de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:13:20.395670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbdbf4-2a21-4d26-9e59-9f53610452de service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:13:20.497226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa51447-51e1-414d-8c71-7c60d7532883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:13:20.497848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa51447-51e1-414d-8c71-7c60d7532883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:13:20.498116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa51447-51e1-414d-8c71-7c60d7532883 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:13:20.498356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa51447-51e1-414d-8c71-7c60d7532883 admin admin] PATH_INFO: `/v3/users/691166ba24034f518a31347b01fe4e28` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:13:20.512390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa51447-51e1-414d-8c71-7c60d7532883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=691166ba24034f518a31347b01fe4e28)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:13:20.513504 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-bfa51447-51e1-414d-8c71-7c60d7532883 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:13:20.513504 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:13:20.513504 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:13:20.514944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa51447-51e1-414d-8c71-7c60d7532883 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:13:20.525543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:13:20.595705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bfa51447-51e1-414d-8c71-7c60d7532883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '691166ba24034f518a31347b01fe4e28'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:13:20.622109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bfa51447-51e1-414d-8c71-7c60d7532883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '691166ba24034f518a31347b01fe4e28'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:13:20.622580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bfa51447-51e1-414d-8c71-7c60d7532883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '691166ba24034f518a31347b01fe4e28'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:13:20.623106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bfa51447-51e1-414d-8c71-7c60d7532883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '691166ba24034f518a31347b01fe4e28'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:13:20.641100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bfa51447-51e1-414d-8c71-7c60d7532883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '691166ba24034f518a31347b01fe4e28'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:13:20.661038 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 747/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:13:20 2022] DELETE /identity/v3/users/691166ba24034f518a31347b01fe4e28 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:13:20.665855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4e5d8-9a5e-4bda-a71f-6563b4231bdc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:13:20.666200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4e5d8-9a5e-4bda-a71f-6563b4231bdc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:13:20.666518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4e5d8-9a5e-4bda-a71f-6563b4231bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:13:20.729230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3ec4e5d8-9a5e-4bda-a71f-6563b4231bdc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:13:20.730433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3ec4e5d8-9a5e-4bda-a71f-6563b4231bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:13:20.806658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:13:20.819526 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 761/1508] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:13:20.829657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa51447-51e1-414d-8c71-7c60d7532883 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:13:20.830925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bfa51447-51e1-414d-8c71-7c60d7532883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:13:20.934370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa51447-51e1-414d-8c71-7c60d7532883 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:13:20.990170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:13:21.012894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176454e6-f459-48ff-a5bd-347c7ab95d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:13:21.013510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176454e6-f459-48ff-a5bd-347c7ab95d60 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:13:21.013791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176454e6-f459-48ff-a5bd-347c7ab95d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:13:21.014066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176454e6-f459-48ff-a5bd-347c7ab95d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:13:21.015736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-176454e6-f459-48ff-a5bd-347c7ab95d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:13:21.134055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176454e6-f459-48ff-a5bd-347c7ab95d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:13:21.135529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176454e6-f459-48ff-a5bd-347c7ab95d60 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:13:21.154365 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 748/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:13:21.501817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4e5d8-9a5e-4bda-a71f-6563b4231bdc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:13:21.503215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3ec4e5d8-9a5e-4bda-a71f-6563b4231bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:13:21.515848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4e5d8-9a5e-4bda-a71f-6563b4231bdc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:13:21.628425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b48a0-a2ef-4cb4-bda5-f8c4ab337149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:13:21.629068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b48a0-a2ef-4cb4-bda5-f8c4ab337149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:13:21.629350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b48a0-a2ef-4cb4-bda5-f8c4ab337149 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:13:21.629623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b48a0-a2ef-4cb4-bda5-f8c4ab337149 admin admin] PATH_INFO: `/v3/projects/87b07f97914449b0ae1d10ad6aab58e2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:13:21.640952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b48a0-a2ef-4cb4-bda5-f8c4ab337149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b07f97914449b0ae1d10ad6aab58e2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:13:21.641921 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-393b48a0-a2ef-4cb4-bda5-f8c4ab337149 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:13:21.641921 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:13:21.641921 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:13:21.643164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b48a0-a2ef-4cb4-bda5-f8c4ab337149 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:13:21.702390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-393b48a0-a2ef-4cb4-bda5-f8c4ab337149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b07f97914449b0ae1d10ad6aab58e2', 'request_id': 'req-393b48a0-a2ef-4cb4-bda5-f8c4ab337149'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:13:21.713315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-393b48a0-a2ef-4cb4-bda5-f8c4ab337149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b07f97914449b0ae1d10ad6aab58e2', 'request_id': 'req-393b48a0-a2ef-4cb4-bda5-f8c4ab337149'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:13:21.719839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-393b48a0-a2ef-4cb4-bda5-f8c4ab337149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b07f97914449b0ae1d10ad6aab58e2', 'request_id': 'req-393b48a0-a2ef-4cb4-bda5-f8c4ab337149'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:13:21.750430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-393b48a0-a2ef-4cb4-bda5-f8c4ab337149 admin admin] The token cache is being invalidate because project 87b07f97914449b0ae1d10ad6aab58e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:13:21.750700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-393b48a0-a2ef-4cb4-bda5-f8c4ab337149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:13:21.751145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-393b48a0-a2ef-4cb4-bda5-f8c4ab337149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:13:21.752591 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 762/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:13:21 2022] DELETE /identity/v3/projects/87b07f97914449b0ae1d10ad6aab58e2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:13:31.151866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=62 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:13:31.748383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:16:52.199150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc813906-1b9c-4f7c-a37b-640a2517444d None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:16:52.199872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc813906-1b9c-4f7c-a37b-640a2517444d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:16:52.199872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc813906-1b9c-4f7c-a37b-640a2517444d None None] PATH_INFO: `/v3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:16:52.201044 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 749/1511] 10.222.0.42 () {54 vars in 925 bytes} [Sun Aug 28 18:16:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:16:52.208211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d803cc-f894-4df4-a9be-ad69962f1b09 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:16:52.208775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d803cc-f894-4df4-a9be-ad69962f1b09 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:16:52.208881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d803cc-f894-4df4-a9be-ad69962f1b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:16:52.300812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-00d803cc-f894-4df4-a9be-ad69962f1b09 None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:16:52.302033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00d803cc-f894-4df4-a9be-ad69962f1b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:16:52.451311 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 763/1512] 10.222.0.42 () {58 vars in 1015 bytes} [Sun Aug 28 18:16:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:16:52.588051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13daa7-d475-431e-af15-347f07529355 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:16:52.588328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13daa7-d475-431e-af15-347f07529355 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:16:52.588620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13daa7-d475-431e-af15-347f07529355 None None] PATH_INFO: `/v3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:16:52.589988 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 750/1513] 10.222.0.45 () {54 vars in 925 bytes} [Sun Aug 28 18:16:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:16:52.596362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fb2e7-3bd6-4b6a-a7a4-b098fbdbeb08 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:16:52.596625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fb2e7-3bd6-4b6a-a7a4-b098fbdbeb08 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:16:52.596908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fb2e7-3bd6-4b6a-a7a4-b098fbdbeb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:16:52.618846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5d9fb2e7-3bd6-4b6a-a7a4-b098fbdbeb08 None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:16:52.620183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d9fb2e7-3bd6-4b6a-a7a4-b098fbdbeb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:16:52.631092 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 764/1514] 10.222.0.45 () {58 vars in 1015 bytes} [Sun Aug 28 18:16:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:17:01.306012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f24133-d417-4d7b-abe2-bec31fc9193c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:01.306692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f24133-d417-4d7b-abe2-bec31fc9193c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:01.306692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f24133-d417-4d7b-abe2-bec31fc9193c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:01.307839 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 751/1515] 10.222.0.27 () {54 vars in 961 bytes} [Sun Aug 28 18:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:17:01.313291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728056c6-8893-41ea-ba8b-4d6c00929211 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:01.313768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728056c6-8893-41ea-ba8b-4d6c00929211 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:01.313890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728056c6-8893-41ea-ba8b-4d6c00929211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:01.334638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-728056c6-8893-41ea-ba8b-4d6c00929211 None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:17:01.336041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-728056c6-8893-41ea-ba8b-4d6c00929211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:17:01.350838 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 765/1516] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Aug 28 18:17:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:17:01.360651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f24133-d417-4d7b-abe2-bec31fc9193c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:17:01.376265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f24133-d417-4d7b-abe2-bec31fc9193c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:17:01.381882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bd1fb-cb2b-4d00-8f6a-cffecad479fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:17:01.382540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bd1fb-cb2b-4d00-8f6a-cffecad479fc service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:01.382823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bd1fb-cb2b-4d00-8f6a-cffecad479fc service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:01.383095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bd1fb-cb2b-4d00-8f6a-cffecad479fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:01.392894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bd1fb-cb2b-4d00-8f6a-cffecad479fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:17:01.394786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bd1fb-cb2b-4d00-8f6a-cffecad479fc service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:17:01.405973 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 752/1517] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:17:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:17:01.583520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e748c8f-6152-4ccc-a3ac-f78d11f7111f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:01.583798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e748c8f-6152-4ccc-a3ac-f78d11f7111f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:01.584068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e748c8f-6152-4ccc-a3ac-f78d11f7111f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:01.585419 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 766/1518] 10.222.0.27 () {54 vars in 961 bytes} [Sun Aug 28 18:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:17:01.591114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36435cc-61f8-4dc2-ac08-161baa2da439 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:01.591550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36435cc-61f8-4dc2-ac08-161baa2da439 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:01.591831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36435cc-61f8-4dc2-ac08-161baa2da439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:01.613272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a36435cc-61f8-4dc2-ac08-161baa2da439 None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:17:01.614528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a36435cc-61f8-4dc2-ac08-161baa2da439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:17:01.630139 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 753/1519] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Aug 28 18:17:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:17:01.641303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e748c8f-6152-4ccc-a3ac-f78d11f7111f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:17:01.656661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e748c8f-6152-4ccc-a3ac-f78d11f7111f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:17:01.662279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fece7-83cc-43bc-87f9-be912afc3938 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:17:01.662893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fece7-83cc-43bc-87f9-be912afc3938 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:01.663169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fece7-83cc-43bc-87f9-be912afc3938 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:01.663550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fece7-83cc-43bc-87f9-be912afc3938 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:01.673090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fece7-83cc-43bc-87f9-be912afc3938 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:17:01.674700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fece7-83cc-43bc-87f9-be912afc3938 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:17:01.685357 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 767/1520] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:17:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:17:11.607905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=9 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:17:11.680744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:17:18.629558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc65293-cdbd-4dd1-a2ed-9461c051583d None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:18.630156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc65293-cdbd-4dd1-a2ed-9461c051583d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:18.630156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc65293-cdbd-4dd1-a2ed-9461c051583d None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:18.631516 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 754/1521] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:17:18.637517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb3db3-4586-427b-813e-be3ba3a336e5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:18.638068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb3db3-4586-427b-813e-be3ba3a336e5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:18.638068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb3db3-4586-427b-813e-be3ba3a336e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:18.709721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-46fb3db3-4586-427b-813e-be3ba3a336e5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:17:18.710934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-46fb3db3-4586-427b-813e-be3ba3a336e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:17:18.819214 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 768/1522] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:17:18.975710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc65293-cdbd-4dd1-a2ed-9461c051583d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:17:18.977627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4cc65293-cdbd-4dd1-a2ed-9461c051583d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:17:19.105034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc65293-cdbd-4dd1-a2ed-9461c051583d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:17:19.115712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54605b-403a-4ecc-984f-9a59b313d4ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:17:19.116701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54605b-403a-4ecc-984f-9a59b313d4ff service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:19.117090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54605b-403a-4ecc-984f-9a59b313d4ff service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:19.117417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54605b-403a-4ecc-984f-9a59b313d4ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:19.126613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54605b-403a-4ecc-984f-9a59b313d4ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:17:19.128260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54605b-403a-4ecc-984f-9a59b313d4ff service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:17:19.144862 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 755/1523] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:17:19.998193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8c0b2-034e-4de3-acfb-b71d5f05b030 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:19.998808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8c0b2-034e-4de3-acfb-b71d5f05b030 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:19.998808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8c0b2-034e-4de3-acfb-b71d5f05b030 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:20.000107 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 769/1524] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:17:20.005866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdce61-b6c8-4859-852a-923e486cba6f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:20.006402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdce61-b6c8-4859-852a-923e486cba6f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:20.006402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdce61-b6c8-4859-852a-923e486cba6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:20.028739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-adbdce61-b6c8-4859-852a-923e486cba6f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:17:20.029961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-adbdce61-b6c8-4859-852a-923e486cba6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:17:20.039572 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 756/1525] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:17:20.195406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8c0b2-034e-4de3-acfb-b71d5f05b030 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:17:20.211278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8c0b2-034e-4de3-acfb-b71d5f05b030 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:17:20.217971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c4dea-50d1-4146-8952-f11a0f173ad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:17:20.218588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c4dea-50d1-4146-8952-f11a0f173ad9 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:20.218867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c4dea-50d1-4146-8952-f11a0f173ad9 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:20.219136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c4dea-50d1-4146-8952-f11a0f173ad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:20.228284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c4dea-50d1-4146-8952-f11a0f173ad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:17:20.229978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c4dea-50d1-4146-8952-f11a0f173ad9 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:17:20.240534 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 770/1526] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:17:23.900672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a902b-f199-40ea-956f-af068e90431d None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:23.901273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a902b-f199-40ea-956f-af068e90431d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:23.901273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a902b-f199-40ea-956f-af068e90431d None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:23.902635 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 757/1527] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:17:23.908754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e47c-6f04-4834-8c1b-655306fee16e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:23.909343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e47c-6f04-4834-8c1b-655306fee16e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:23.909343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e47c-6f04-4834-8c1b-655306fee16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:23.931721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bbb6e47c-6f04-4834-8c1b-655306fee16e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:17:23.932958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bbb6e47c-6f04-4834-8c1b-655306fee16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:17:23.942395 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 771/1528] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:17:24.233212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a902b-f199-40ea-956f-af068e90431d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:17:24.235168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9f9a902b-f199-40ea-956f-af068e90431d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:17:24.330154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a902b-f199-40ea-956f-af068e90431d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:17:24.334638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c6936-66bc-4e74-95bb-4f198cee909d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:17:24.335276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c6936-66bc-4e74-95bb-4f198cee909d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:24.335559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c6936-66bc-4e74-95bb-4f198cee909d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:24.335823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c6936-66bc-4e74-95bb-4f198cee909d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:24.346697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c6936-66bc-4e74-95bb-4f198cee909d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:17:24.348174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c6936-66bc-4e74-95bb-4f198cee909d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:17:24.357955 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 758/1529] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:17:26.258831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e040415-e84a-46ad-ae31-43f16ad0fe86 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:26.259476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e040415-e84a-46ad-ae31-43f16ad0fe86 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:26.259476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e040415-e84a-46ad-ae31-43f16ad0fe86 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:26.260835 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 772/1530] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:17:26.267899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeab65-0385-4332-82c4-51bf67659e23 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:26.268606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeab65-0385-4332-82c4-51bf67659e23 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:26.268708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeab65-0385-4332-82c4-51bf67659e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:26.297849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7ffeab65-0385-4332-82c4-51bf67659e23 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:17:26.299067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7ffeab65-0385-4332-82c4-51bf67659e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:17:26.308641 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 759/1531] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:17:26.589582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e040415-e84a-46ad-ae31-43f16ad0fe86 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:17:26.602161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e040415-e84a-46ad-ae31-43f16ad0fe86 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:17:26.606322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf2b1c-dff5-454b-9cf6-5be29d9fc968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:17:26.606921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf2b1c-dff5-454b-9cf6-5be29d9fc968 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:17:26.607196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf2b1c-dff5-454b-9cf6-5be29d9fc968 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:17:26.607497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf2b1c-dff5-454b-9cf6-5be29d9fc968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:17:26.617196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf2b1c-dff5-454b-9cf6-5be29d9fc968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:17:26.618628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf2b1c-dff5-454b-9cf6-5be29d9fc968 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:17:26.628607 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 773/1532] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:17:36.292031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:17:36.623914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=65 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:16.256013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b353e1f-34b6-4f9c-ba7b-5463dcf58bba None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:16.256525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b353e1f-34b6-4f9c-ba7b-5463dcf58bba None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:16.256525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b353e1f-34b6-4f9c-ba7b-5463dcf58bba None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:16.258111 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 760/1533] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 18:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:18:16.263231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a567b-f16b-4f72-8033-5380b6582a09 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:16.263693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a567b-f16b-4f72-8033-5380b6582a09 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:16.264092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a567b-f16b-4f72-8033-5380b6582a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:16.284864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-417a567b-f16b-4f72-8033-5380b6582a09 None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:16.286292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-417a567b-f16b-4f72-8033-5380b6582a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:16.295747 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 774/1534] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 18:18:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:26.279732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:47.853514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9a4b8-d7d8-4fa7-94d1-10c1677040d3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:47.854102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9a4b8-d7d8-4fa7-94d1-10c1677040d3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:47.854102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9a4b8-d7d8-4fa7-94d1-10c1677040d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:47.888500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5df9a4b8-d7d8-4fa7-94d1-10c1677040d3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:47.889931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5df9a4b8-d7d8-4fa7-94d1-10c1677040d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:47.899680 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 761/1535] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:47.909264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fedf8-d511-45d8-b296-597d44da284d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:47.909837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fedf8-d511-45d8-b296-597d44da284d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:47.909837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fedf8-d511-45d8-b296-597d44da284d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:47.965114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c53fedf8-d511-45d8-b296-597d44da284d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:47.967219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c53fedf8-d511-45d8-b296-597d44da284d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:47.992885 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 775/1536] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:47.998674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9a4b8-d7d8-4fa7-94d1-10c1677040d3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:48.013840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9a4b8-d7d8-4fa7-94d1-10c1677040d3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:48.019434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57604746-4553-4fa7-b55e-7d2facec15ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:48.020059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57604746-4553-4fa7-b55e-7d2facec15ea admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.020340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57604746-4553-4fa7-b55e-7d2facec15ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.020615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57604746-4553-4fa7-b55e-7d2facec15ea admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.021278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57604746-4553-4fa7-b55e-7d2facec15ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:18:48.021579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57604746-4553-4fa7-b55e-7d2facec15ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:48.022603 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-57604746-4553-4fa7-b55e-7d2facec15ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:18:48.022603 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:18:48.022603 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:18:48.023540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57604746-4553-4fa7-b55e-7d2facec15ea admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:48.036715 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 762/1537] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:18:48.045779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fedf8-d511-45d8-b296-597d44da284d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:48.067764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fedf8-d511-45d8-b296-597d44da284d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:48.081655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb175e1b-ca07-4dd1-9792-e2042db4d045 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.081970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb175e1b-ca07-4dd1-9792-e2042db4d045 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.082207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb175e1b-ca07-4dd1-9792-e2042db4d045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.088918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef819d-c82c-46fd-a53d-fbbfbab27e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:48.090052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef819d-c82c-46fd-a53d-fbbfbab27e41 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.090668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef819d-c82c-46fd-a53d-fbbfbab27e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.091161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef819d-c82c-46fd-a53d-fbbfbab27e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.092553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef819d-c82c-46fd-a53d-fbbfbab27e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:48.094488 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-4eef819d-c82c-46fd-a53d-fbbfbab27e41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:18:48.094488 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:18:48.094488 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:18:48.105339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef819d-c82c-46fd-a53d-fbbfbab27e41 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:48.110105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fb175e1b-ca07-4dd1-9792-e2042db4d045 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:48.111353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fb175e1b-ca07-4dd1-9792-e2042db4d045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:48.141255 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 763/1538] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:48.151459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795423-2748-4d5c-b961-40d2ce6b400c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.151787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795423-2748-4d5c-b961-40d2ce6b400c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.152002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795423-2748-4d5c-b961-40d2ce6b400c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.194673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-89795423-2748-4d5c-b961-40d2ce6b400c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:48.195996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-89795423-2748-4d5c-b961-40d2ce6b400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:48.207862 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 764/1539] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:48.209274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3251bb-dbc7-4455-8f17-b1afbb67156b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.209557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3251bb-dbc7-4455-8f17-b1afbb67156b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.209832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3251bb-dbc7-4455-8f17-b1afbb67156b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.218022 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 776/1540] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:48.220520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343b5d-70dc-45e2-83b8-59924388a74a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.221031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343b5d-70dc-45e2-83b8-59924388a74a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.221526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343b5d-70dc-45e2-83b8-59924388a74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.244388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0c3251bb-dbc7-4455-8f17-b1afbb67156b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:48.245727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0c3251bb-dbc7-4455-8f17-b1afbb67156b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:48.257746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-86343b5d-70dc-45e2-83b8-59924388a74a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:48.260199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-86343b5d-70dc-45e2-83b8-59924388a74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:48.354901 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 765/1541] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:48.356419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3251bb-dbc7-4455-8f17-b1afbb67156b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:48.376074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3251bb-dbc7-4455-8f17-b1afbb67156b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:48.384502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71243d2-55cb-4905-930c-9e7a87336093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:48.386040 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 777/1542] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:48.386329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71243d2-55cb-4905-930c-9e7a87336093 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.386890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71243d2-55cb-4905-930c-9e7a87336093 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.387390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71243d2-55cb-4905-930c-9e7a87336093 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.388275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71243d2-55cb-4905-930c-9e7a87336093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:18:48.388516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d864b34-84c9-403c-b475-62da79fd0f4e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.389016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d864b34-84c9-403c-b475-62da79fd0f4e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.389121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71243d2-55cb-4905-930c-9e7a87336093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:48.389500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d864b34-84c9-403c-b475-62da79fd0f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.391175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71243d2-55cb-4905-930c-9e7a87336093 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:48.409446 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 766/1543] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:18:48.410642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71243d2-55cb-4905-930c-9e7a87336093 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:48.422995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71243d2-55cb-4905-930c-9e7a87336093 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:48.425044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7d864b34-84c9-403c-b475-62da79fd0f4e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:48.427480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7d864b34-84c9-403c-b475-62da79fd0f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:48.430172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b40fc-d85c-41fb-9de4-d93c6f4178b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:48.431069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b40fc-d85c-41fb-9de4-d93c6f4178b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.431575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b40fc-d85c-41fb-9de4-d93c6f4178b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.432072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b40fc-d85c-41fb-9de4-d93c6f4178b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.433090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b40fc-d85c-41fb-9de4-d93c6f4178b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:48.434390 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-d94b40fc-d85c-41fb-9de4-d93c6f4178b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:18:48.434390 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:18:48.434390 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:18:48.436672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b40fc-d85c-41fb-9de4-d93c6f4178b8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:48.442664 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 778/1544] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:48.444933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c342-0279-4036-801a-9515b3190aeb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.445431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c342-0279-4036-801a-9515b3190aeb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.445920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c342-0279-4036-801a-9515b3190aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.468577 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 767/1545] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/users => generated 292 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:48.470283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd46f4-9ebe-42c7-a95f-ce684c8cffb8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.470807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd46f4-9ebe-42c7-a95f-ce684c8cffb8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.471369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd46f4-9ebe-42c7-a95f-ce684c8cffb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.483531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d698c342-0279-4036-801a-9515b3190aeb None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:48.485651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d698c342-0279-4036-801a-9515b3190aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:48.495940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3efd46f4-9ebe-42c7-a95f-ce684c8cffb8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:48.498342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3efd46f4-9ebe-42c7-a95f-ce684c8cffb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:48.505116 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 779/1546] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:48.507193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930431e8-5d4b-45a5-977e-010213cbbe08 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.511117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930431e8-5d4b-45a5-977e-010213cbbe08 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.512937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930431e8-5d4b-45a5-977e-010213cbbe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.515687 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 768/1547] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:48.516773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd46f4-9ebe-42c7-a95f-ce684c8cffb8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:48.528437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd46f4-9ebe-42c7-a95f-ce684c8cffb8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:48.534717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856876a8-4f8e-4830-827b-8b9be48d013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:48.535679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856876a8-4f8e-4830-827b-8b9be48d013d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.536188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856876a8-4f8e-4830-827b-8b9be48d013d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.536660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856876a8-4f8e-4830-827b-8b9be48d013d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.537506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856876a8-4f8e-4830-827b-8b9be48d013d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:48.539751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856876a8-4f8e-4830-827b-8b9be48d013d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:48.540181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-930431e8-5d4b-45a5-977e-010213cbbe08 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:48.541567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-930431e8-5d4b-45a5-977e-010213cbbe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:48.553332 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 780/1548] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:48.554685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab910-10da-4a8a-8f15-e5cc835d32de None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.555288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab910-10da-4a8a-8f15-e5cc835d32de None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.555552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab910-10da-4a8a-8f15-e5cc835d32de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.583005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3deab910-10da-4a8a-8f15-e5cc835d32de None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:48.584636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3deab910-10da-4a8a-8f15-e5cc835d32de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:48.594320 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 769/1549] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:48.595342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856876a8-4f8e-4830-827b-8b9be48d013d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:48.600123 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 781/1550] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:48.601620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ed029-52c9-4306-abf5-d8e3e3792b4a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.601912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ed029-52c9-4306-abf5-d8e3e3792b4a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.602179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ed029-52c9-4306-abf5-d8e3e3792b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.624240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ea0ed029-52c9-4306-abf5-d8e3e3792b4a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:48.625352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea0ed029-52c9-4306-abf5-d8e3e3792b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:48.674645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856876a8-4f8e-4830-827b-8b9be48d013d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:48.679811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467f530-30e8-400d-bc67-d7bfa57c2b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:48.680803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467f530-30e8-400d-bc67-d7bfa57c2b10 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.681078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467f530-30e8-400d-bc67-d7bfa57c2b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.681350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467f530-30e8-400d-bc67-d7bfa57c2b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.681999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467f530-30e8-400d-bc67-d7bfa57c2b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:48.683782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467f530-30e8-400d-bc67-d7bfa57c2b10 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:48.692387 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 782/1551] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:48.698357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a4625-bd64-40e2-aaee-cb437df42671 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.698357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a4625-bd64-40e2-aaee-cb437df42671 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.698505 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 770/1552] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:48.698601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a4625-bd64-40e2-aaee-cb437df42671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.698679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467f530-30e8-400d-bc67-d7bfa57c2b10 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:48.705301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:48.709136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467f530-30e8-400d-bc67-d7bfa57c2b10 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:48.715434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66794372-31d4-45c0-b4f1-ff6c0a289c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:48.716049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66794372-31d4-45c0-b4f1-ff6c0a289c96 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.716323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66794372-31d4-45c0-b4f1-ff6c0a289c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.716593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66794372-31d4-45c0-b4f1-ff6c0a289c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.717246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66794372-31d4-45c0-b4f1-ff6c0a289c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:18:48.717548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66794372-31d4-45c0-b4f1-ff6c0a289c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:48.718275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2b2a4625-bd64-40e2-aaee-cb437df42671 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:48.719137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66794372-31d4-45c0-b4f1-ff6c0a289c96 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:48.719558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b2a4625-bd64-40e2-aaee-cb437df42671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:48.727659 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 783/1553] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:48.728463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a4625-bd64-40e2-aaee-cb437df42671 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:48.738682 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 771/1554] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:18:48.738682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66794372-31d4-45c0-b4f1-ff6c0a289c96 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:48.742540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66794372-31d4-45c0-b4f1-ff6c0a289c96 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:48.744381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a4625-bd64-40e2-aaee-cb437df42671 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:48.747458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce273049-ef14-4a72-a307-9c822de5aaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:48.748079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce273049-ef14-4a72-a307-9c822de5aaa4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.748357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce273049-ef14-4a72-a307-9c822de5aaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.748629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce273049-ef14-4a72-a307-9c822de5aaa4 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.749098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac402ad4-9c52-489d-b7a2-96f82d896996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:48.749272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce273049-ef14-4a72-a307-9c822de5aaa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:48.749700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac402ad4-9c52-489d-b7a2-96f82d896996 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.749974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac402ad4-9c52-489d-b7a2-96f82d896996 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.750321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac402ad4-9c52-489d-b7a2-96f82d896996 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.750975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac402ad4-9c52-489d-b7a2-96f82d896996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:18:48.751201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce273049-ef14-4a72-a307-9c822de5aaa4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:48.751322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac402ad4-9c52-489d-b7a2-96f82d896996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:48.753367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac402ad4-9c52-489d-b7a2-96f82d896996 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:48.766537 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 784/1555] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:18:48.768060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a2ea1-8f84-4989-8c37-19b531b4de82 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.768349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a2ea1-8f84-4989-8c37-19b531b4de82 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.768618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a2ea1-8f84-4989-8c37-19b531b4de82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.775972 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 772/1556] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:48.776934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce273049-ef14-4a72-a307-9c822de5aaa4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:48.789180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce273049-ef14-4a72-a307-9c822de5aaa4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:48.790230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c66a2ea1-8f84-4989-8c37-19b531b4de82 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:48.791586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c66a2ea1-8f84-4989-8c37-19b531b4de82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:48.797236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fe948-dfe9-4069-870a-bc3f8e92c359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:48.798017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fe948-dfe9-4069-870a-bc3f8e92c359 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.798515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fe948-dfe9-4069-870a-bc3f8e92c359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.798812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fe948-dfe9-4069-870a-bc3f8e92c359 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.799504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fe948-dfe9-4069-870a-bc3f8e92c359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:18:48.799815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fe948-dfe9-4069-870a-bc3f8e92c359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:48.801210 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 785/1557] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:48.801455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fe948-dfe9-4069-870a-bc3f8e92c359 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:48.802039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a2ea1-8f84-4989-8c37-19b531b4de82 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:48.813072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a2ea1-8f84-4989-8c37-19b531b4de82 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:48.818295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172ec2b-9735-4096-b547-3e784a623fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:48.818955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172ec2b-9735-4096-b547-3e784a623fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.819235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172ec2b-9735-4096-b547-3e784a623fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.819496 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 773/1558] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:18:48.819594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172ec2b-9735-4096-b547-3e784a623fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.820260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172ec2b-9735-4096-b547-3e784a623fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:48.821220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0823bf-9919-44a0-8c60-3de2b9c9daa3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.821586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0823bf-9919-44a0-8c60-3de2b9c9daa3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.821810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172ec2b-9735-4096-b547-3e784a623fc4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:48.822308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0823bf-9919-44a0-8c60-3de2b9c9daa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.828894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:48.841390 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 786/1559] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:48.842417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172ec2b-9735-4096-b547-3e784a623fc4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:48.846608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-da0823bf-9919-44a0-8c60-3de2b9c9daa3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:48.847925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-da0823bf-9919-44a0-8c60-3de2b9c9daa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:48.853704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172ec2b-9735-4096-b547-3e784a623fc4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:48.857004 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 774/1560] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:48.857721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0823bf-9919-44a0-8c60-3de2b9c9daa3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:48.859192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c636594-f082-4ff6-bf20-b9dbfbd7057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:48.859934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c636594-f082-4ff6-bf20-b9dbfbd7057b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.860275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c636594-f082-4ff6-bf20-b9dbfbd7057b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.860835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c636594-f082-4ff6-bf20-b9dbfbd7057b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.861695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c636594-f082-4ff6-bf20-b9dbfbd7057b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:18:48.862069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c636594-f082-4ff6-bf20-b9dbfbd7057b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:48.864575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c636594-f082-4ff6-bf20-b9dbfbd7057b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:48.867147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0823bf-9919-44a0-8c60-3de2b9c9daa3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:48.872334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e3fe8-208a-48fa-a993-d9b9e88c656b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:48.872938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e3fe8-208a-48fa-a993-d9b9e88c656b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.873217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e3fe8-208a-48fa-a993-d9b9e88c656b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.873490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e3fe8-208a-48fa-a993-d9b9e88c656b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.874128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e3fe8-208a-48fa-a993-d9b9e88c656b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:48.876183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e3fe8-208a-48fa-a993-d9b9e88c656b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:48.885137 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 787/1561] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:18:48.885137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c636594-f082-4ff6-bf20-b9dbfbd7057b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:48.888338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c636594-f082-4ff6-bf20-b9dbfbd7057b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:48.893491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e0a0e-9fa8-4b0e-a9d8-62a8eb6d4e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:48.893991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e0a0e-9fa8-4b0e-a9d8-62a8eb6d4e4d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.894310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e0a0e-9fa8-4b0e-a9d8-62a8eb6d4e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.894602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e0a0e-9fa8-4b0e-a9d8-62a8eb6d4e4d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.895390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e0a0e-9fa8-4b0e-a9d8-62a8eb6d4e4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:48.897512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e0a0e-9fa8-4b0e-a9d8-62a8eb6d4e4d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:48.905788 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 775/1562] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:48.906649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e3fe8-208a-48fa-a993-d9b9e88c656b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:48.933524 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 788/1563] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:48.933524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028407df-91f6-4b9c-8e25-6a3c5cacae93 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:48.933524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028407df-91f6-4b9c-8e25-6a3c5cacae93 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:48.933524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028407df-91f6-4b9c-8e25-6a3c5cacae93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:48.953434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-028407df-91f6-4b9c-8e25-6a3c5cacae93 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:48.954640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-028407df-91f6-4b9c-8e25-6a3c5cacae93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:48.981651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e3fe8-208a-48fa-a993-d9b9e88c656b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.019003 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 789/1564] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:49.019976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028407df-91f6-4b9c-8e25-6a3c5cacae93 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.031992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028407df-91f6-4b9c-8e25-6a3c5cacae93 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.037153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b32e16-87f4-4a9a-8c8d-6bb6b0ab87d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.037793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b32e16-87f4-4a9a-8c8d-6bb6b0ab87d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.038108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b32e16-87f4-4a9a-8c8d-6bb6b0ab87d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.038397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b32e16-87f4-4a9a-8c8d-6bb6b0ab87d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.039045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b32e16-87f4-4a9a-8c8d-6bb6b0ab87d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.041076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b32e16-87f4-4a9a-8c8d-6bb6b0ab87d8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.042113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b38923-b134-4b7f-a0df-283d3f4cab9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.042782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38923-b134-4b7f-a0df-283d3f4cab9e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.043064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38923-b134-4b7f-a0df-283d3f4cab9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.043388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38923-b134-4b7f-a0df-283d3f4cab9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.044044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b38923-b134-4b7f-a0df-283d3f4cab9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.045650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b38923-b134-4b7f-a0df-283d3f4cab9e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.055908 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 776/1565] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:49.056854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b38923-b134-4b7f-a0df-283d3f4cab9e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.067886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b38923-b134-4b7f-a0df-283d3f4cab9e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.073401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf56545-6c83-4b41-baea-e779df66ac44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.073923 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 790/1566] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:49 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:49.074945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b32e16-87f4-4a9a-8c8d-6bb6b0ab87d8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.075847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf56545-6c83-4b41-baea-e779df66ac44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.076130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf56545-6c83-4b41-baea-e779df66ac44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.076407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf56545-6c83-4b41-baea-e779df66ac44 admin admin] PATH_INFO: `/v3/projects/7e37f0d2bd3b4faa875f4ae86be21975/users/a570bd844f7f4344a7ed64840d410992/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.092117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf56545-6c83-4b41-baea-e779df66ac44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e37f0d2bd3b4faa875f4ae86be21975, user_id=a570bd844f7f4344a7ed64840d410992, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.094817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf56545-6c83-4b41-baea-e779df66ac44 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.108726 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 777/1567] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:49 2022] PUT /identity/v3/projects/7e37f0d2bd3b4faa875f4ae86be21975/users/a570bd844f7f4344a7ed64840d410992/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:49.109610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf56545-6c83-4b41-baea-e779df66ac44 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.121923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:49.150094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b32e16-87f4-4a9a-8c8d-6bb6b0ab87d8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.177266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf56545-6c83-4b41-baea-e779df66ac44 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.182331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5378a2-6c89-4986-83f4-3cec1ea833c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.182990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5378a2-6c89-4986-83f4-3cec1ea833c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.183312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5378a2-6c89-4986-83f4-3cec1ea833c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.183625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5378a2-6c89-4986-83f4-3cec1ea833c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.184291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5378a2-6c89-4986-83f4-3cec1ea833c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.186233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5378a2-6c89-4986-83f4-3cec1ea833c7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.201188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:49.213571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353eaad8-258d-4958-8b3d-679c022dd178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.214187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353eaad8-258d-4958-8b3d-679c022dd178 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.214483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353eaad8-258d-4958-8b3d-679c022dd178 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.214753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353eaad8-258d-4958-8b3d-679c022dd178 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.215053 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 778/1568] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:49 2022] POST /identity/v3/projects => generated 407 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:49.215435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353eaad8-258d-4958-8b3d-679c022dd178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:18:49.215735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353eaad8-258d-4958-8b3d-679c022dd178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.215906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5378a2-6c89-4986-83f4-3cec1ea833c7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.217411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353eaad8-258d-4958-8b3d-679c022dd178 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.229711 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 791/1569] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:18:49.237724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353eaad8-258d-4958-8b3d-679c022dd178 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.248690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353eaad8-258d-4958-8b3d-679c022dd178 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.284467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5378a2-6c89-4986-83f4-3cec1ea833c7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.289506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82682dbf-442b-4331-bf29-c3fb934629d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.290138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82682dbf-442b-4331-bf29-c3fb934629d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.290413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82682dbf-442b-4331-bf29-c3fb934629d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.290804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82682dbf-442b-4331-bf29-c3fb934629d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.291606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82682dbf-442b-4331-bf29-c3fb934629d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.293913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82682dbf-442b-4331-bf29-c3fb934629d2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.313431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e28223-e6f2-445e-acbb-e207e0c1be10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.314052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e28223-e6f2-445e-acbb-e207e0c1be10 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.314325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e28223-e6f2-445e-acbb-e207e0c1be10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.314587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e28223-e6f2-445e-acbb-e207e0c1be10 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.315200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e28223-e6f2-445e-acbb-e207e0c1be10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.315666 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 779/1570] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:49 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:49.316594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82682dbf-442b-4331-bf29-c3fb934629d2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.320553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e28223-e6f2-445e-acbb-e207e0c1be10 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.326795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82682dbf-442b-4331-bf29-c3fb934629d2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.333516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3faffa-2fc1-4b30-ad67-757f0e09f662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.334271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3faffa-2fc1-4b30-ad67-757f0e09f662 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.334617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3faffa-2fc1-4b30-ad67-757f0e09f662 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.334932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3faffa-2fc1-4b30-ad67-757f0e09f662 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.336004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3faffa-2fc1-4b30-ad67-757f0e09f662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:18:49.336359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3faffa-2fc1-4b30-ad67-757f0e09f662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.338288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3faffa-2fc1-4b30-ad67-757f0e09f662 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.343765 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 792/1571] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:49 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:49.344622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e28223-e6f2-445e-acbb-e207e0c1be10 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.354235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e28223-e6f2-445e-acbb-e207e0c1be10 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.360434 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 780/1572] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:18:49.360434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3faffa-2fc1-4b30-ad67-757f0e09f662 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.364280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1d7bc-daa6-4eab-8eb2-48e092eb7265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.364931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1d7bc-daa6-4eab-8eb2-48e092eb7265 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.365215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1d7bc-daa6-4eab-8eb2-48e092eb7265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.365524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1d7bc-daa6-4eab-8eb2-48e092eb7265 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.366144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1d7bc-daa6-4eab-8eb2-48e092eb7265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.366957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3faffa-2fc1-4b30-ad67-757f0e09f662 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.367857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1d7bc-daa6-4eab-8eb2-48e092eb7265 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.372284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba048068-1a6f-4639-9aeb-2bc992f5126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.372892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048068-1a6f-4639-9aeb-2bc992f5126d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.373173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048068-1a6f-4639-9aeb-2bc992f5126d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.373581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048068-1a6f-4639-9aeb-2bc992f5126d admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.374225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba048068-1a6f-4639-9aeb-2bc992f5126d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.376203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba048068-1a6f-4639-9aeb-2bc992f5126d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.380154 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 793/1573] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:49.381197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12751669-cc25-4102-bd1f-6a2cc9570a42 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.381480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12751669-cc25-4102-bd1f-6a2cc9570a42 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.381749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12751669-cc25-4102-bd1f-6a2cc9570a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.403548 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 781/1574] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:49 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:49.403548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba048068-1a6f-4639-9aeb-2bc992f5126d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.410133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-12751669-cc25-4102-bd1f-6a2cc9570a42 None None] MFA Rules not processed for user `a570bd844f7f4344a7ed64840d410992`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:49.411406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-12751669-cc25-4102-bd1f-6a2cc9570a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:49.413327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba048068-1a6f-4639-9aeb-2bc992f5126d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.418017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a10c72-e1ba-40df-885d-1ae8e1557e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.418619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a10c72-e1ba-40df-885d-1ae8e1557e7b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.418900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a10c72-e1ba-40df-885d-1ae8e1557e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.419174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a10c72-e1ba-40df-885d-1ae8e1557e7b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.419842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a10c72-e1ba-40df-885d-1ae8e1557e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.421768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a10c72-e1ba-40df-885d-1ae8e1557e7b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.446298 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 782/1575] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:49 2022] POST /identity/v3/users => generated 304 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:49.447318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a10c72-e1ba-40df-885d-1ae8e1557e7b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.457502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a10c72-e1ba-40df-885d-1ae8e1557e7b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.463152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cafc84-4833-4bb8-9465-7775891f60cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.463796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cafc84-4833-4bb8-9465-7775891f60cb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.464114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cafc84-4833-4bb8-9465-7775891f60cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.464363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cafc84-4833-4bb8-9465-7775891f60cb admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.465000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cafc84-4833-4bb8-9465-7775891f60cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.466943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cafc84-4833-4bb8-9465-7775891f60cb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.478302 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 794/1576] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:49.479328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12751669-cc25-4102-bd1f-6a2cc9570a42 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.491266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12751669-cc25-4102-bd1f-6a2cc9570a42 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.496607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24303e6b-68bd-469d-90c9-5a6492627153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.497311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24303e6b-68bd-469d-90c9-5a6492627153 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.497654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24303e6b-68bd-469d-90c9-5a6492627153 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.498166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24303e6b-68bd-469d-90c9-5a6492627153 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.498260 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 783/1577] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:49 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:49.498651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24303e6b-68bd-469d-90c9-5a6492627153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.498873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cafc84-4833-4bb8-9465-7775891f60cb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.500334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24303e6b-68bd-469d-90c9-5a6492627153 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.515131 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 795/1578] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:49.515131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24303e6b-68bd-469d-90c9-5a6492627153 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.523969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24303e6b-68bd-469d-90c9-5a6492627153 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.524199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:49.575658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:49.584341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cafc84-4833-4bb8-9465-7775891f60cb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.589343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198dd68-69cd-4ec2-aded-3c465fbbfdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.590086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198dd68-69cd-4ec2-aded-3c465fbbfdc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.590366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198dd68-69cd-4ec2-aded-3c465fbbfdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.590631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198dd68-69cd-4ec2-aded-3c465fbbfdc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.591316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198dd68-69cd-4ec2-aded-3c465fbbfdc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.592981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198dd68-69cd-4ec2-aded-3c465fbbfdc0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.595392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d2cd5-8199-4bf2-8a67-e5f05ecaee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.596200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d2cd5-8199-4bf2-8a67-e5f05ecaee12 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.596478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d2cd5-8199-4bf2-8a67-e5f05ecaee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.596778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d2cd5-8199-4bf2-8a67-e5f05ecaee12 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.597434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d2cd5-8199-4bf2-8a67-e5f05ecaee12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.599432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d2cd5-8199-4bf2-8a67-e5f05ecaee12 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.604424 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 784/1579] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:49.605590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198dd68-69cd-4ec2-aded-3c465fbbfdc0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.616597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198dd68-69cd-4ec2-aded-3c465fbbfdc0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.621812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b22b3-b185-471c-9c57-1cfcbf0dc647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.622507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b22b3-b185-471c-9c57-1cfcbf0dc647 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.622782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b22b3-b185-471c-9c57-1cfcbf0dc647 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.623052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b22b3-b185-471c-9c57-1cfcbf0dc647 admin admin] PATH_INFO: `/v3/projects/1a93c104d0964b35ba609299da32fbc5/users/6c65df553af04997898c1ee72f3dc40b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.631206 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 796/1580] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:49 2022] POST /identity/v3/projects => generated 399 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:49.632080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d2cd5-8199-4bf2-8a67-e5f05ecaee12 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.641722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b22b3-b185-471c-9c57-1cfcbf0dc647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a93c104d0964b35ba609299da32fbc5, user_id=6c65df553af04997898c1ee72f3dc40b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.644471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b22b3-b185-471c-9c57-1cfcbf0dc647 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.671398 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 785/1581] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:49 2022] PUT /identity/v3/projects/1a93c104d0964b35ba609299da32fbc5/users/6c65df553af04997898c1ee72f3dc40b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:49.671398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b22b3-b185-471c-9c57-1cfcbf0dc647 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.699597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d2cd5-8199-4bf2-8a67-e5f05ecaee12 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.735448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b22b3-b185-471c-9c57-1cfcbf0dc647 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.740363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f48ee6-3aac-4747-87c8-ce3dc03f448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.740971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f48ee6-3aac-4747-87c8-ce3dc03f448b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.741244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f48ee6-3aac-4747-87c8-ce3dc03f448b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.741507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f48ee6-3aac-4747-87c8-ce3dc03f448b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.742151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f48ee6-3aac-4747-87c8-ce3dc03f448b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.743795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f48ee6-3aac-4747-87c8-ce3dc03f448b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.754381 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 786/1582] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:49.755167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f48ee6-3aac-4747-87c8-ce3dc03f448b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.762837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ef9d3-371c-45c7-bd3d-9bb4cff0106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.763492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ef9d3-371c-45c7-bd3d-9bb4cff0106a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.763771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ef9d3-371c-45c7-bd3d-9bb4cff0106a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.764045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ef9d3-371c-45c7-bd3d-9bb4cff0106a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.764700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ef9d3-371c-45c7-bd3d-9bb4cff0106a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.764824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f48ee6-3aac-4747-87c8-ce3dc03f448b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.766321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ef9d3-371c-45c7-bd3d-9bb4cff0106a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.769600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a64f9e-55cc-4f92-97b4-432fba4d0b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.770192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a64f9e-55cc-4f92-97b4-432fba4d0b2e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.770469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a64f9e-55cc-4f92-97b4-432fba4d0b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.771288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a64f9e-55cc-4f92-97b4-432fba4d0b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.771384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a64f9e-55cc-4f92-97b4-432fba4d0b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.773230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a64f9e-55cc-4f92-97b4-432fba4d0b2e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.776766 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 797/1583] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:49.777647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ef9d3-371c-45c7-bd3d-9bb4cff0106a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.789861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ef9d3-371c-45c7-bd3d-9bb4cff0106a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.794524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cf7f0-0f26-475c-b400-eb65093802f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.795133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cf7f0-0f26-475c-b400-eb65093802f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.795439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cf7f0-0f26-475c-b400-eb65093802f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.795737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cf7f0-0f26-475c-b400-eb65093802f4 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.796476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cf7f0-0f26-475c-b400-eb65093802f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.798469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cf7f0-0f26-475c-b400-eb65093802f4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.805336 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 787/1584] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:49 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:49.809621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a64f9e-55cc-4f92-97b4-432fba4d0b2e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.823005 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 798/1585] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:49 2022] POST /identity/v3/users => generated 291 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:49.823005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cf7f0-0f26-475c-b400-eb65093802f4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.830216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cf7f0-0f26-475c-b400-eb65093802f4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.874200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a64f9e-55cc-4f92-97b4-432fba4d0b2e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.879431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf371e7c-6b8c-4cc3-b530-043a95144458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.880045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf371e7c-6b8c-4cc3-b530-043a95144458 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.880322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf371e7c-6b8c-4cc3-b530-043a95144458 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.880611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf371e7c-6b8c-4cc3-b530-043a95144458 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.880802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:49.881255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf371e7c-6b8c-4cc3-b530-043a95144458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.882912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf371e7c-6b8c-4cc3-b530-043a95144458 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.885405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:49.892229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f0a0a-b717-4d90-841e-64f198b7f636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.892840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f0a0a-b717-4d90-841e-64f198b7f636 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.893123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f0a0a-b717-4d90-841e-64f198b7f636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.893394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f0a0a-b717-4d90-841e-64f198b7f636 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.894038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f0a0a-b717-4d90-841e-64f198b7f636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.898405 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 788/1586] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:49.898544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f0a0a-b717-4d90-841e-64f198b7f636 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.898619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf371e7c-6b8c-4cc3-b530-043a95144458 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.907473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf371e7c-6b8c-4cc3-b530-043a95144458 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.910928 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 799/1587] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:49.910928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81e73e-934a-41bd-bf37-db5186b74d6b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.910928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81e73e-934a-41bd-bf37-db5186b74d6b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.910928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81e73e-934a-41bd-bf37-db5186b74d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.914268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459769d8-0b35-4f65-a928-f7f32f4385b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.914880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459769d8-0b35-4f65-a928-f7f32f4385b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.915154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459769d8-0b35-4f65-a928-f7f32f4385b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.915485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459769d8-0b35-4f65-a928-f7f32f4385b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.916133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459769d8-0b35-4f65-a928-f7f32f4385b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.918206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459769d8-0b35-4f65-a928-f7f32f4385b3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.938008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1e81e73e-934a-41bd-bf37-db5186b74d6b None None] MFA Rules not processed for user `6c65df553af04997898c1ee72f3dc40b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:49.939143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e81e73e-934a-41bd-bf37-db5186b74d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:49.945268 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 789/1588] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:49 2022] POST /identity/v3/users => generated 300 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:49.945268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459769d8-0b35-4f65-a928-f7f32f4385b3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.952880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459769d8-0b35-4f65-a928-f7f32f4385b3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.957460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bf298-aa17-4c09-bb58-73a104125b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.958092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf298-aa17-4c09-bb58-73a104125b47 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.958376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf298-aa17-4c09-bb58-73a104125b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.958651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf298-aa17-4c09-bb58-73a104125b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.959322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bf298-aa17-4c09-bb58-73a104125b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.960916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bf298-aa17-4c09-bb58-73a104125b47 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:49.972910 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 790/1589] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:49.974101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bf298-aa17-4c09-bb58-73a104125b47 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:49.985937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bf298-aa17-4c09-bb58-73a104125b47 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:49.990625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2e17d-0bd3-4d91-8910-6ec8f6a4abb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:49.991231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2e17d-0bd3-4d91-8910-6ec8f6a4abb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:49.991536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2e17d-0bd3-4d91-8910-6ec8f6a4abb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:49.991808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2e17d-0bd3-4d91-8910-6ec8f6a4abb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:49.992474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2e17d-0bd3-4d91-8910-6ec8f6a4abb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:49.994160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2e17d-0bd3-4d91-8910-6ec8f6a4abb7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:50.005267 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 791/1590] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:50.007894 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 800/1591] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:50.008441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2e17d-0bd3-4d91-8910-6ec8f6a4abb7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.008957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81e73e-934a-41bd-bf37-db5186b74d6b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.018925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2e17d-0bd3-4d91-8910-6ec8f6a4abb7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:50.019355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81e73e-934a-41bd-bf37-db5186b74d6b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:50.023696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff4d90-e5ed-43ee-b66c-48a11a5a4e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:50.023854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11fdc0-6896-4ceb-9b5d-e0f25c83a317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:50.024448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4d90-e5ed-43ee-b66c-48a11a5a4e4c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.024550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11fdc0-6896-4ceb-9b5d-e0f25c83a317 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.024726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4d90-e5ed-43ee-b66c-48a11a5a4e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.024822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11fdc0-6896-4ceb-9b5d-e0f25c83a317 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.025000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4d90-e5ed-43ee-b66c-48a11a5a4e4c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.025097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11fdc0-6896-4ceb-9b5d-e0f25c83a317 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.025635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff4d90-e5ed-43ee-b66c-48a11a5a4e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:50.025742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11fdc0-6896-4ceb-9b5d-e0f25c83a317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:50.027345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11fdc0-6896-4ceb-9b5d-e0f25c83a317 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:50.027634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff4d90-e5ed-43ee-b66c-48a11a5a4e4c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:50.037490 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 801/1592] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:50.038277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11fdc0-6896-4ceb-9b5d-e0f25c83a317 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.049043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11fdc0-6896-4ceb-9b5d-e0f25c83a317 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:50.051908 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 792/1593] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:50 2022] POST /identity/v3/users => generated 299 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:50.053743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498120b-7e09-4561-834a-b36f74a139af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:50.054439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498120b-7e09-4561-834a-b36f74a139af admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.054853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498120b-7e09-4561-834a-b36f74a139af admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.055140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498120b-7e09-4561-834a-b36f74a139af admin admin] PATH_INFO: `/v3/projects/1cd14f4e60304dbfa32d188385d80cf4/users/466ca25704e44b68b9e7eaa24d1bcf68/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.055740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff4d90-e5ed-43ee-b66c-48a11a5a4e4c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.065860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff4d90-e5ed-43ee-b66c-48a11a5a4e4c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:50.070619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9ff0b-5248-4190-b140-7dbfeff07ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:50.070755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498120b-7e09-4561-834a-b36f74a139af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd14f4e60304dbfa32d188385d80cf4, user_id=466ca25704e44b68b9e7eaa24d1bcf68, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:50.071352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9ff0b-5248-4190-b140-7dbfeff07ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.071634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9ff0b-5248-4190-b140-7dbfeff07ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.071742 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-4498120b-7e09-4561-834a-b36f74a139af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:18:50.071742 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:18:50.071742 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:18:50.071929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9ff0b-5248-4190-b140-7dbfeff07ae9 admin admin] PATH_INFO: `/v3/projects/6028abc53fae43efad53c36731f53e2a/users/b246523e6be5484aa37660723e8ee527/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.073666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498120b-7e09-4561-834a-b36f74a139af admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:50.087428 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 802/1594] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:50 2022] PUT /identity/v3/projects/1cd14f4e60304dbfa32d188385d80cf4/users/466ca25704e44b68b9e7eaa24d1bcf68/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:50.087826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9ff0b-5248-4190-b140-7dbfeff07ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6028abc53fae43efad53c36731f53e2a, user_id=b246523e6be5484aa37660723e8ee527, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:50.088565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498120b-7e09-4561-834a-b36f74a139af admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.090555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9ff0b-5248-4190-b140-7dbfeff07ae9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:50.111790 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 793/1595] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:50 2022] PUT /identity/v3/projects/6028abc53fae43efad53c36731f53e2a/users/b246523e6be5484aa37660723e8ee527/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:50.112599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9ff0b-5248-4190-b140-7dbfeff07ae9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.160175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498120b-7e09-4561-834a-b36f74a139af admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:50.173843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9ff0b-5248-4190-b140-7dbfeff07ae9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:50.178504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289097c4-f5f8-451d-8919-0d5286461a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:50.179169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289097c4-f5f8-451d-8919-0d5286461a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.179480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289097c4-f5f8-451d-8919-0d5286461a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.179752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289097c4-f5f8-451d-8919-0d5286461a9a admin admin] PATH_INFO: `/v3/projects/8cadcc3435e140a28de0ae62594c2bea/users/5eb7dcf195db4f3982e8a10599bdd674/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.195407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289097c4-f5f8-451d-8919-0d5286461a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cadcc3435e140a28de0ae62594c2bea, user_id=5eb7dcf195db4f3982e8a10599bdd674, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:50.198046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289097c4-f5f8-451d-8919-0d5286461a9a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:50.208851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:50.213902 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 794/1596] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:50 2022] PUT /identity/v3/projects/8cadcc3435e140a28de0ae62594c2bea/users/5eb7dcf195db4f3982e8a10599bdd674/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:50.215393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289097c4-f5f8-451d-8919-0d5286461a9a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.231453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb8433-e587-4465-8262-ad5384fdba78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:50.232511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb8433-e587-4465-8262-ad5384fdba78 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.233006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb8433-e587-4465-8262-ad5384fdba78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.233471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb8433-e587-4465-8262-ad5384fdba78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.234687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb8433-e587-4465-8262-ad5384fdba78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:50.238016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb8433-e587-4465-8262-ad5384fdba78 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:50.251704 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 803/1597] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:50.252897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb8433-e587-4465-8262-ad5384fdba78 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.263102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb8433-e587-4465-8262-ad5384fdba78 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:50.286344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289097c4-f5f8-451d-8919-0d5286461a9a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:50.291550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf97997-84e2-4079-85da-0d21f0632130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:50.292220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf97997-84e2-4079-85da-0d21f0632130 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.292512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf97997-84e2-4079-85da-0d21f0632130 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.292817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf97997-84e2-4079-85da-0d21f0632130 admin admin] PATH_INFO: `/v3/projects/6296cd575f9b4128b52434a018771716/users/c19128b867234c8d9050fd0f9f982d6d/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.295077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:50.312016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf97997-84e2-4079-85da-0d21f0632130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6296cd575f9b4128b52434a018771716, user_id=c19128b867234c8d9050fd0f9f982d6d, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:50.315593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf97997-84e2-4079-85da-0d21f0632130 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:50.323897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad508781-f4bf-4f06-b0ea-b722714a5e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:50.324564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad508781-f4bf-4f06-b0ea-b722714a5e60 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.324987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad508781-f4bf-4f06-b0ea-b722714a5e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.325263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad508781-f4bf-4f06-b0ea-b722714a5e60 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.325964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad508781-f4bf-4f06-b0ea-b722714a5e60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:50.328046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad508781-f4bf-4f06-b0ea-b722714a5e60 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:50.331946 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 795/1598] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:50 2022] PUT /identity/v3/projects/6296cd575f9b4128b52434a018771716/users/c19128b867234c8d9050fd0f9f982d6d/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:50.340297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf97997-84e2-4079-85da-0d21f0632130 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.362809 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 804/1599] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:50 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:50.362809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad508781-f4bf-4f06-b0ea-b722714a5e60 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.408780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf97997-84e2-4079-85da-0d21f0632130 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:50.425996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad508781-f4bf-4f06-b0ea-b722714a5e60 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:50.430576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b2d2a-1517-4c35-a2a1-b62c7d6cb8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:50.431200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b2d2a-1517-4c35-a2a1-b62c7d6cb8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.431535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b2d2a-1517-4c35-a2a1-b62c7d6cb8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.431808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b2d2a-1517-4c35-a2a1-b62c7d6cb8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.432459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b2d2a-1517-4c35-a2a1-b62c7d6cb8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:50.434183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b2d2a-1517-4c35-a2a1-b62c7d6cb8d7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:50.451659 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 805/1600] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:50.451659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad5a1f-f1bb-4b63-940d-a688f8a48ce9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.451659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad5a1f-f1bb-4b63-940d-a688f8a48ce9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.451659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad5a1f-f1bb-4b63-940d-a688f8a48ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.473072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c09485-f10f-47e9-8ed4-7d1c57b98645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:50.473689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c09485-f10f-47e9-8ed4-7d1c57b98645 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.473964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c09485-f10f-47e9-8ed4-7d1c57b98645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.474255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c09485-f10f-47e9-8ed4-7d1c57b98645 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.474880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c09485-f10f-47e9-8ed4-7d1c57b98645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:50.476533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c09485-f10f-47e9-8ed4-7d1c57b98645 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:50.481000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d1ad5a1f-f1bb-4b63-940d-a688f8a48ce9 None None] MFA Rules not processed for user `466ca25704e44b68b9e7eaa24d1bcf68`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:50.482253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d1ad5a1f-f1bb-4b63-940d-a688f8a48ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:50.486918 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 796/1601] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:50.488382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2251f6b-bddc-46c3-a707-1d4eaff41366 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.488698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2251f6b-bddc-46c3-a707-1d4eaff41366 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.488944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2251f6b-bddc-46c3-a707-1d4eaff41366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.516399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b2251f6b-bddc-46c3-a707-1d4eaff41366 None None] MFA Rules not processed for user `b246523e6be5484aa37660723e8ee527`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:50.517805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b2251f6b-bddc-46c3-a707-1d4eaff41366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:50.544222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:50.550561 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 806/1602] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:50.552052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ac003-1e17-465a-b220-ab1700b1e7a1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.552336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ac003-1e17-465a-b220-ab1700b1e7a1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.552680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ac003-1e17-465a-b220-ab1700b1e7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.586204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-919ac003-1e17-465a-b220-ab1700b1e7a1 None None] MFA Rules not processed for user `5eb7dcf195db4f3982e8a10599bdd674`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:50.586548 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 797/1603] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:50.587449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-919ac003-1e17-465a-b220-ab1700b1e7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:50.588240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2251f6b-bddc-46c3-a707-1d4eaff41366 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.599314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2251f6b-bddc-46c3-a707-1d4eaff41366 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:50.604006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5e61e-59e8-46f3-b66b-bc4aba5c1b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:50.604631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5e61e-59e8-46f3-b66b-bc4aba5c1b2a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.604906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5e61e-59e8-46f3-b66b-bc4aba5c1b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.605210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5e61e-59e8-46f3-b66b-bc4aba5c1b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.605853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5e61e-59e8-46f3-b66b-bc4aba5c1b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:50.607650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5e61e-59e8-46f3-b66b-bc4aba5c1b2a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:50.618472 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 798/1604] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:50.620351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ffd2-9439-40a8-b70e-1cbb9d69fe32 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.620351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ffd2-9439-40a8-b70e-1cbb9d69fe32 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.620351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ffd2-9439-40a8-b70e-1cbb9d69fe32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.628818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:50.650668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6747ffd2-9439-40a8-b70e-1cbb9d69fe32 None None] MFA Rules not processed for user `c19128b867234c8d9050fd0f9f982d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:50.651907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6747ffd2-9439-40a8-b70e-1cbb9d69fe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:50.657626 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 807/1605] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:50 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:50.658858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ac003-1e17-465a-b220-ab1700b1e7a1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.670840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ac003-1e17-465a-b220-ab1700b1e7a1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:50.675618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c5201-f1e9-421b-af8e-052a3153f62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:50.676234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c5201-f1e9-421b-af8e-052a3153f62f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.676513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c5201-f1e9-421b-af8e-052a3153f62f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.676807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c5201-f1e9-421b-af8e-052a3153f62f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.677497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c5201-f1e9-421b-af8e-052a3153f62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:50.679651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c5201-f1e9-421b-af8e-052a3153f62f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:50.702727 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 808/1606] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:50 2022] POST /identity/v3/users => generated 298 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:50.703513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c5201-f1e9-421b-af8e-052a3153f62f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.713310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c5201-f1e9-421b-af8e-052a3153f62f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:50.718084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a8f64-87fa-42d4-a035-b4ab4bd7e373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:50.718783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a8f64-87fa-42d4-a035-b4ab4bd7e373 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.719032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a8f64-87fa-42d4-a035-b4ab4bd7e373 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.719470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a8f64-87fa-42d4-a035-b4ab4bd7e373 admin admin] PATH_INFO: `/v3/projects/659ccde015ae427fa9532b9155f01d04/users/3ba6ffb5d0fc441d854b9dc43a66ddf9/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.722647 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 799/1607] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:50.723785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747ffd2-9439-40a8-b70e-1cbb9d69fe32 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.738257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747ffd2-9439-40a8-b70e-1cbb9d69fe32 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:50.738453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a8f64-87fa-42d4-a035-b4ab4bd7e373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=659ccde015ae427fa9532b9155f01d04, user_id=3ba6ffb5d0fc441d854b9dc43a66ddf9, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:50.741306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a8f64-87fa-42d4-a035-b4ab4bd7e373 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:50.743574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44896f-897f-4028-a2d1-c64c9474353a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:50.744279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44896f-897f-4028-a2d1-c64c9474353a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.744431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44896f-897f-4028-a2d1-c64c9474353a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.744915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44896f-897f-4028-a2d1-c64c9474353a admin admin] PATH_INFO: `/v3/projects/3cf08cb9f9ea4fb590e6837f807fa8b3/users/f151e9d5d8514c91ad29e086d41cd6c0/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.758292 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 809/1608] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:50 2022] PUT /identity/v3/projects/659ccde015ae427fa9532b9155f01d04/users/3ba6ffb5d0fc441d854b9dc43a66ddf9/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:50.758938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a8f64-87fa-42d4-a035-b4ab4bd7e373 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.764356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44896f-897f-4028-a2d1-c64c9474353a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf08cb9f9ea4fb590e6837f807fa8b3, user_id=f151e9d5d8514c91ad29e086d41cd6c0, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:50.767064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44896f-897f-4028-a2d1-c64c9474353a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:50.782256 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 800/1609] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:50 2022] PUT /identity/v3/projects/3cf08cb9f9ea4fb590e6837f807fa8b3/users/f151e9d5d8514c91ad29e086d41cd6c0/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:50.783010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44896f-897f-4028-a2d1-c64c9474353a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.832700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a8f64-87fa-42d4-a035-b4ab4bd7e373 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:50.846778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44896f-897f-4028-a2d1-c64c9474353a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:50.851683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145be04a-6d64-484d-ad0e-702a8e713400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:50.852328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145be04a-6d64-484d-ad0e-702a8e713400 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.852629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145be04a-6d64-484d-ad0e-702a8e713400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.852901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145be04a-6d64-484d-ad0e-702a8e713400 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.853544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145be04a-6d64-484d-ad0e-702a8e713400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:50.855564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145be04a-6d64-484d-ad0e-702a8e713400 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:50.884722 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 801/1610] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:50 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:50.886287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145be04a-6d64-484d-ad0e-702a8e713400 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.889386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:50.900216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf0c1a-e4f0-4001-85ea-a61f109faec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:50.900867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf0c1a-e4f0-4001-85ea-a61f109faec7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:50.901142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf0c1a-e4f0-4001-85ea-a61f109faec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:50.901399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf0c1a-e4f0-4001-85ea-a61f109faec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:50.902085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf0c1a-e4f0-4001-85ea-a61f109faec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:50.904074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf0c1a-e4f0-4001-85ea-a61f109faec7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:50.934397 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 810/1611] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:50 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:50.935278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf0c1a-e4f0-4001-85ea-a61f109faec7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:50.952248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:50.958620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145be04a-6d64-484d-ad0e-702a8e713400 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:50.999434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf0c1a-e4f0-4001-85ea-a61f109faec7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:51.004655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7a7b7-100e-4604-9d40-52549a461c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.005272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7a7b7-100e-4604-9d40-52549a461c1f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.005546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7a7b7-100e-4604-9d40-52549a461c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.005811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7a7b7-100e-4604-9d40-52549a461c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.006447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7a7b7-100e-4604-9d40-52549a461c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.008407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7a7b7-100e-4604-9d40-52549a461c1f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.017378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91de0a-ea55-47d4-bc4a-cf65f5d13b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.018054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91de0a-ea55-47d4-bc4a-cf65f5d13b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.018332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91de0a-ea55-47d4-bc4a-cf65f5d13b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.018604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91de0a-ea55-47d4-bc4a-cf65f5d13b00 admin admin] PATH_INFO: `/v3/projects/caa93463800e456d806414540abd8d39/users/a91caff6a7dc4f9fad3f15d7ade19a76/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.036151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91de0a-ea55-47d4-bc4a-cf65f5d13b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa93463800e456d806414540abd8d39, user_id=a91caff6a7dc4f9fad3f15d7ade19a76, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.038076 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 811/1612] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:50 2022] POST /identity/v3/projects => generated 407 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:51.039038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91de0a-ea55-47d4-bc4a-cf65f5d13b00 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.039143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7a7b7-100e-4604-9d40-52549a461c1f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.055042 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 802/1613] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:50 2022] PUT /identity/v3/projects/caa93463800e456d806414540abd8d39/users/a91caff6a7dc4f9fad3f15d7ade19a76/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:51.055920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91de0a-ea55-47d4-bc4a-cf65f5d13b00 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.109894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7a7b7-100e-4604-9d40-52549a461c1f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:51.112455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91de0a-ea55-47d4-bc4a-cf65f5d13b00 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:51.116352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0266a6-598c-4529-bd01-744fbbb4742b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.117025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0266a6-598c-4529-bd01-744fbbb4742b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.117369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0266a6-598c-4529-bd01-744fbbb4742b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.117739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0266a6-598c-4529-bd01-744fbbb4742b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.169881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f4367-61ac-4458-83d9-9f8c923a6468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.170510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f4367-61ac-4458-83d9-9f8c923a6468 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.170785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f4367-61ac-4458-83d9-9f8c923a6468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.171106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f4367-61ac-4458-83d9-9f8c923a6468 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.171799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f4367-61ac-4458-83d9-9f8c923a6468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.173428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f4367-61ac-4458-83d9-9f8c923a6468 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.175477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0266a6-598c-4529-bd01-744fbbb4742b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.176953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0266a6-598c-4529-bd01-744fbbb4742b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.183658 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 812/1614] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:51.184807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f4367-61ac-4458-83d9-9f8c923a6468 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.186420 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 803/1615] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:51.188094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929403e9-6e65-4285-afca-d2bf6fb34c10 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.188228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929403e9-6e65-4285-afca-d2bf6fb34c10 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.188504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929403e9-6e65-4285-afca-d2bf6fb34c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.195586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f4367-61ac-4458-83d9-9f8c923a6468 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:51.200394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbff19b-c492-4b29-aea7-51abe7f49c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.201038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbff19b-c492-4b29-aea7-51abe7f49c93 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.201319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbff19b-c492-4b29-aea7-51abe7f49c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.201599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbff19b-c492-4b29-aea7-51abe7f49c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.202281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbff19b-c492-4b29-aea7-51abe7f49c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.204015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbff19b-c492-4b29-aea7-51abe7f49c93 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.205683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:51.221431 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 813/1616] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:51.222601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbff19b-c492-4b29-aea7-51abe7f49c93 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.224375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-929403e9-6e65-4285-afca-d2bf6fb34c10 None None] MFA Rules not processed for user `f151e9d5d8514c91ad29e086d41cd6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:51.226018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-929403e9-6e65-4285-afca-d2bf6fb34c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:51.235582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbff19b-c492-4b29-aea7-51abe7f49c93 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:51.240727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a517ca-c262-448c-b0e5-8cb09457f0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.241366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a517ca-c262-448c-b0e5-8cb09457f0fb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.241646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a517ca-c262-448c-b0e5-8cb09457f0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.242045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a517ca-c262-448c-b0e5-8cb09457f0fb admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.242831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a517ca-c262-448c-b0e5-8cb09457f0fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.245009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a517ca-c262-448c-b0e5-8cb09457f0fb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.259117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:51.275818 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 814/1617] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:51 2022] POST /identity/v3/users => generated 301 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:51.278253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a517ca-c262-448c-b0e5-8cb09457f0fb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.291647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a517ca-c262-448c-b0e5-8cb09457f0fb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:51.297798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffa305-551c-4ce9-8726-a643fa41551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.299004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffa305-551c-4ce9-8726-a643fa41551e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.299570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffa305-551c-4ce9-8726-a643fa41551e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.300138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffa305-551c-4ce9-8726-a643fa41551e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.300915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffa305-551c-4ce9-8726-a643fa41551e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.303018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffa305-551c-4ce9-8726-a643fa41551e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.303411 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 804/1618] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:51.305237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929403e9-6e65-4285-afca-d2bf6fb34c10 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.321815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929403e9-6e65-4285-afca-d2bf6fb34c10 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:51.329409 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 815/1619] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:51 2022] POST /identity/v3/users => generated 298 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:51.329579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116c32a-7564-4c65-87f8-8f0b7f95ec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.330783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116c32a-7564-4c65-87f8-8f0b7f95ec85 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.330907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d2011-e3d8-477e-b96d-a73186caf496 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.331089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d2011-e3d8-477e-b96d-a73186caf496 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.331417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d2011-e3d8-477e-b96d-a73186caf496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.331574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116c32a-7564-4c65-87f8-8f0b7f95ec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.332123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116c32a-7564-4c65-87f8-8f0b7f95ec85 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.333653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116c32a-7564-4c65-87f8-8f0b7f95ec85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.338349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116c32a-7564-4c65-87f8-8f0b7f95ec85 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.363649 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 805/1620] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:51 2022] POST /identity/v3/users => generated 310 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:51.364719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116c32a-7564-4c65-87f8-8f0b7f95ec85 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.367373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-657d2011-e3d8-477e-b96d-a73186caf496 None None] MFA Rules not processed for user `a91caff6a7dc4f9fad3f15d7ade19a76`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:51.368701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-657d2011-e3d8-477e-b96d-a73186caf496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:51.375371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116c32a-7564-4c65-87f8-8f0b7f95ec85 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:51.382194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1a459-3bd1-4380-adf1-64888868681d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.382870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1a459-3bd1-4380-adf1-64888868681d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.383201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1a459-3bd1-4380-adf1-64888868681d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.383509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1a459-3bd1-4380-adf1-64888868681d admin admin] PATH_INFO: `/v3/projects/0fc6ab80953b41bc9d99d882162f2276/users/d4747972868d406a90c6b958ffdad894/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.399992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1a459-3bd1-4380-adf1-64888868681d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc6ab80953b41bc9d99d882162f2276, user_id=d4747972868d406a90c6b958ffdad894, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.403091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1a459-3bd1-4380-adf1-64888868681d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.418872 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 806/1621] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:51 2022] PUT /identity/v3/projects/0fc6ab80953b41bc9d99d882162f2276/users/d4747972868d406a90c6b958ffdad894/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:51.419718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1a459-3bd1-4380-adf1-64888868681d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.448078 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 816/1622] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:51.449040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d2011-e3d8-477e-b96d-a73186caf496 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.459848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d2011-e3d8-477e-b96d-a73186caf496 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:51.488781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1a459-3bd1-4380-adf1-64888868681d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:51.494241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee95a5-3bb9-44ae-86c5-fb4067629b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.494982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee95a5-3bb9-44ae-86c5-fb4067629b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.495442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee95a5-3bb9-44ae-86c5-fb4067629b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.495771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee95a5-3bb9-44ae-86c5-fb4067629b86 admin admin] PATH_INFO: `/v3/projects/659ccde015ae427fa9532b9155f01d04/users/3ba6ffb5d0fc441d854b9dc43a66ddf9/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.500540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee95a5-3bb9-44ae-86c5-fb4067629b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=659ccde015ae427fa9532b9155f01d04, user_id=3ba6ffb5d0fc441d854b9dc43a66ddf9, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.504487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee95a5-3bb9-44ae-86c5-fb4067629b86 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.516420 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 807/1623] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:51 2022] PUT /identity/v3/projects/659ccde015ae427fa9532b9155f01d04/users/3ba6ffb5d0fc441d854b9dc43a66ddf9/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:51.518227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee95a5-3bb9-44ae-86c5-fb4067629b86 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.541447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37446c2f-2a08-4827-9c53-b1b09b76c315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.542377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37446c2f-2a08-4827-9c53-b1b09b76c315 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.542692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37446c2f-2a08-4827-9c53-b1b09b76c315 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.542998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37446c2f-2a08-4827-9c53-b1b09b76c315 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.543734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37446c2f-2a08-4827-9c53-b1b09b76c315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.545370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37446c2f-2a08-4827-9c53-b1b09b76c315 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.556579 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 817/1624] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:51.557703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37446c2f-2a08-4827-9c53-b1b09b76c315 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.568086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37446c2f-2a08-4827-9c53-b1b09b76c315 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:51.588479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee95a5-3bb9-44ae-86c5-fb4067629b86 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:51.593080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df8e02-5055-4c81-b5c0-e73a52fe009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.593689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df8e02-5055-4c81-b5c0-e73a52fe009f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.593961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df8e02-5055-4c81-b5c0-e73a52fe009f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.594227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df8e02-5055-4c81-b5c0-e73a52fe009f admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.594855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df8e02-5055-4c81-b5c0-e73a52fe009f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.596788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df8e02-5055-4c81-b5c0-e73a52fe009f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.612523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:51.626731 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 808/1625] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:51 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:51.627879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df8e02-5055-4c81-b5c0-e73a52fe009f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.630480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb79fca-c654-4023-9973-524f2771275d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.631142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb79fca-c654-4023-9973-524f2771275d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.631469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb79fca-c654-4023-9973-524f2771275d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.631746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb79fca-c654-4023-9973-524f2771275d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.632428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb79fca-c654-4023-9973-524f2771275d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.634401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb79fca-c654-4023-9973-524f2771275d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.638083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:51.648555 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 818/1626] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:51.649449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb79fca-c654-4023-9973-524f2771275d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.659833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb79fca-c654-4023-9973-524f2771275d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:51.697806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df8e02-5055-4c81-b5c0-e73a52fe009f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:51.703187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838148d-535b-4d85-b1f9-37d06270f43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.703939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838148d-535b-4d85-b1f9-37d06270f43b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.704280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838148d-535b-4d85-b1f9-37d06270f43b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.704621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838148d-535b-4d85-b1f9-37d06270f43b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.705515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838148d-535b-4d85-b1f9-37d06270f43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.707170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838148d-535b-4d85-b1f9-37d06270f43b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.717585 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 809/1627] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:51.718429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838148d-535b-4d85-b1f9-37d06270f43b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.718709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b17f2-b15a-4af9-86f5-74e975157007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.719366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b17f2-b15a-4af9-86f5-74e975157007 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.719649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b17f2-b15a-4af9-86f5-74e975157007 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.719921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b17f2-b15a-4af9-86f5-74e975157007 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.720583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b17f2-b15a-4af9-86f5-74e975157007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.722213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b17f2-b15a-4af9-86f5-74e975157007 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.729044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838148d-535b-4d85-b1f9-37d06270f43b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:51.736758 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 819/1628] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:51.736934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2123704-3bde-4db2-beea-0797b05a4486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.736934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2123704-3bde-4db2-beea-0797b05a4486 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.737079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a3743-8a0b-4c70-b77a-15f81c6ed688 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.737150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2123704-3bde-4db2-beea-0797b05a4486 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.737225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a3743-8a0b-4c70-b77a-15f81c6ed688 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.737291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2123704-3bde-4db2-beea-0797b05a4486 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.737359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a3743-8a0b-4c70-b77a-15f81c6ed688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.737422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2123704-3bde-4db2-beea-0797b05a4486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.738141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2123704-3bde-4db2-beea-0797b05a4486 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.765099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8d4a3743-8a0b-4c70-b77a-15f81c6ed688 None None] MFA Rules not processed for user `3ba6ffb5d0fc441d854b9dc43a66ddf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:51.766240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d4a3743-8a0b-4c70-b77a-15f81c6ed688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:51.770928 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 810/1629] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:51 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:51.771762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2123704-3bde-4db2-beea-0797b05a4486 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.837528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2123704-3bde-4db2-beea-0797b05a4486 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:51.842336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104a05b-0119-457c-b042-68403c10a2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.842971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104a05b-0119-457c-b042-68403c10a2a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.843248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104a05b-0119-457c-b042-68403c10a2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.843546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104a05b-0119-457c-b042-68403c10a2a1 admin admin] PATH_INFO: `/v3/users/c19128b867234c8d9050fd0f9f982d6d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.844694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104a05b-0119-457c-b042-68403c10a2a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c19128b867234c8d9050fd0f9f982d6d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.845147 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 820/1630] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:51.846009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a3743-8a0b-4c70-b77a-15f81c6ed688 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.846625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104a05b-0119-457c-b042-68403c10a2a1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.857062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a3743-8a0b-4c70-b77a-15f81c6ed688 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:51.866108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195a42b-7a76-4094-a7c0-2c12492bfa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:51.866814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195a42b-7a76-4094-a7c0-2c12492bfa8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:51.867099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195a42b-7a76-4094-a7c0-2c12492bfa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:51.867418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195a42b-7a76-4094-a7c0-2c12492bfa8c admin admin] PATH_INFO: `/v3/projects/1b335352a355419db88c8be4d4191c79/users/9c60fff9171a47e6b3d31bbc67baa6e2/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:51.889815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195a42b-7a76-4094-a7c0-2c12492bfa8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b335352a355419db88c8be4d4191c79, user_id=9c60fff9171a47e6b3d31bbc67baa6e2, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:51.893230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195a42b-7a76-4094-a7c0-2c12492bfa8c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:51.907094 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 821/1631] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:51 2022] PUT /identity/v3/projects/1b335352a355419db88c8be4d4191c79/users/9c60fff9171a47e6b3d31bbc67baa6e2/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:51.909218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f104a05b-0119-457c-b042-68403c10a2a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c19128b867234c8d9050fd0f9f982d6d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:51.910943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195a42b-7a76-4094-a7c0-2c12492bfa8c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.921530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f104a05b-0119-457c-b042-68403c10a2a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c19128b867234c8d9050fd0f9f982d6d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:51.922216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f104a05b-0119-457c-b042-68403c10a2a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c19128b867234c8d9050fd0f9f982d6d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:51.922834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f104a05b-0119-457c-b042-68403c10a2a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c19128b867234c8d9050fd0f9f982d6d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:51.931770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f104a05b-0119-457c-b042-68403c10a2a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c19128b867234c8d9050fd0f9f982d6d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:51.941316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:51.946717 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 811/1632] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:18:51 2022] DELETE /identity/v3/users/c19128b867234c8d9050fd0f9f982d6d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:51.947939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104a05b-0119-457c-b042-68403c10a2a1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:51.951427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f104a05b-0119-457c-b042-68403c10a2a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:51.955739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:51.976307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195a42b-7a76-4094-a7c0-2c12492bfa8c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:52.022245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104a05b-0119-457c-b042-68403c10a2a1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:52.027364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855150e-85ae-4167-8934-62a31e847a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:52.028058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855150e-85ae-4167-8934-62a31e847a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.028361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855150e-85ae-4167-8934-62a31e847a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.028633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855150e-85ae-4167-8934-62a31e847a6a admin admin] PATH_INFO: `/v3/projects/7d7ea433a00346caade6bbb2df0143b7/users/c83d61bcaa2e4df6b8af5804a3eea488/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.032595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdbe3a-12ba-43ca-a0fb-3ade1e358687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:52.033213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdbe3a-12ba-43ca-a0fb-3ade1e358687 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.033490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdbe3a-12ba-43ca-a0fb-3ade1e358687 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.033760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdbe3a-12ba-43ca-a0fb-3ade1e358687 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.034399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdbe3a-12ba-43ca-a0fb-3ade1e358687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:52.036381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdbe3a-12ba-43ca-a0fb-3ade1e358687 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:52.044023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855150e-85ae-4167-8934-62a31e847a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7ea433a00346caade6bbb2df0143b7, user_id=c83d61bcaa2e4df6b8af5804a3eea488, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:52.046679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855150e-85ae-4167-8934-62a31e847a6a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:52.059814 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 812/1633] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:51 2022] PUT /identity/v3/projects/7d7ea433a00346caade6bbb2df0143b7/users/c83d61bcaa2e4df6b8af5804a3eea488/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:52.060246 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 822/1634] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:51 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:52.060956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdbe3a-12ba-43ca-a0fb-3ade1e358687 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:52.062624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b4fdbe3a-12ba-43ca-a0fb-3ade1e358687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:52.063494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855150e-85ae-4167-8934-62a31e847a6a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:52.065332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f855150e-85ae-4167-8934-62a31e847a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:52.075804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdbe3a-12ba-43ca-a0fb-3ade1e358687 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:52.132608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855150e-85ae-4167-8934-62a31e847a6a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:52.136420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b2fd5-fbaa-4214-8616-d549a0b7427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:52.137150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b2fd5-fbaa-4214-8616-d549a0b7427c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.137430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b2fd5-fbaa-4214-8616-d549a0b7427c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.137859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b2fd5-fbaa-4214-8616-d549a0b7427c admin admin] PATH_INFO: `/v3/projects/0fc6ab80953b41bc9d99d882162f2276/users/d4747972868d406a90c6b958ffdad894/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.138143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47e1a2-bad7-4318-852b-1f344f3d5e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:52.138881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47e1a2-bad7-4318-852b-1f344f3d5e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.139165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47e1a2-bad7-4318-852b-1f344f3d5e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.139471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47e1a2-bad7-4318-852b-1f344f3d5e51 admin admin] PATH_INFO: `/v3/projects/58e32a18622146c598ac7c5732a5626f/users/d4998edbaa434d2fb637373597ed10cd/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.140616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b2fd5-fbaa-4214-8616-d549a0b7427c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc6ab80953b41bc9d99d882162f2276, user_id=d4747972868d406a90c6b958ffdad894, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:52.143586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b2fd5-fbaa-4214-8616-d549a0b7427c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:52.154963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47e1a2-bad7-4318-852b-1f344f3d5e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e32a18622146c598ac7c5732a5626f, user_id=d4998edbaa434d2fb637373597ed10cd, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:52.155134 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 823/1635] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:52 2022] PUT /identity/v3/projects/0fc6ab80953b41bc9d99d882162f2276/users/d4747972868d406a90c6b958ffdad894/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:52.155891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b2fd5-fbaa-4214-8616-d549a0b7427c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:52.157695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-646b2fd5-fbaa-4214-8616-d549a0b7427c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:52.157862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47e1a2-bad7-4318-852b-1f344f3d5e51 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:52.173820 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 813/1636] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:52 2022] PUT /identity/v3/projects/58e32a18622146c598ac7c5732a5626f/users/d4998edbaa434d2fb637373597ed10cd/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:52.174943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca4009-fc60-4a6c-ad37-a0e85e6bb51b None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.175333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca4009-fc60-4a6c-ad37-a0e85e6bb51b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.175674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca4009-fc60-4a6c-ad37-a0e85e6bb51b None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.176978 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 814/1637] 10.222.0.27 () {54 vars in 962 bytes} [Sun Aug 28 18:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:18:52.177741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca4009-fc60-4a6c-ad37-a0e85e6bb51b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:52.179790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-72ca4009-fc60-4a6c-ad37-a0e85e6bb51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:52.226490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b2fd5-fbaa-4214-8616-d549a0b7427c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:52.240270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:52.252093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca4009-fc60-4a6c-ad37-a0e85e6bb51b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:52.259286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3eeeb-2f5c-46e7-be75-6db3675d225c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:52.260249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3eeeb-2f5c-46e7-be75-6db3675d225c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.260703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3eeeb-2f5c-46e7-be75-6db3675d225c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.261142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3eeeb-2f5c-46e7-be75-6db3675d225c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.262315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3eeeb-2f5c-46e7-be75-6db3675d225c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:52.265061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3eeeb-2f5c-46e7-be75-6db3675d225c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:52.277301 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 815/1638] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:52.280870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb4f1d-b54b-4e02-a9fa-27b8805dd9ad None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.281160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb4f1d-b54b-4e02-a9fa-27b8805dd9ad None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.281430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb4f1d-b54b-4e02-a9fa-27b8805dd9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.289490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:52.304682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-15bb4f1d-b54b-4e02-a9fa-27b8805dd9ad None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:52.304883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d230ac-0518-4cbf-9071-9ea105c8d34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:52.305798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d230ac-0518-4cbf-9071-9ea105c8d34a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.305906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-15bb4f1d-b54b-4e02-a9fa-27b8805dd9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:52.306267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d230ac-0518-4cbf-9071-9ea105c8d34a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.306885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d230ac-0518-4cbf-9071-9ea105c8d34a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.308014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d230ac-0518-4cbf-9071-9ea105c8d34a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:52.311742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d230ac-0518-4cbf-9071-9ea105c8d34a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:52.316921 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 816/1639] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:52.316921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb4f1d-b54b-4e02-a9fa-27b8805dd9ad None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:52.316921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-15bb4f1d-b54b-4e02-a9fa-27b8805dd9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:52.328777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb4f1d-b54b-4e02-a9fa-27b8805dd9ad None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:52.334071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9899d-805e-4b63-bcca-a69d476bdc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:52.334685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9899d-805e-4b63-bcca-a69d476bdc8b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.334957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9899d-805e-4b63-bcca-a69d476bdc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.335225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9899d-805e-4b63-bcca-a69d476bdc8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.336179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9899d-805e-4b63-bcca-a69d476bdc8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:52.337884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9899d-805e-4b63-bcca-a69d476bdc8b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:52.349142 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 824/1640] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:52 2022] POST /identity/v3/users => generated 306 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:52.349142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d230ac-0518-4cbf-9071-9ea105c8d34a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:52.349410 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 817/1641] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:52.349493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f4c1a-7edb-4399-ad1d-4d8542ebb003 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.349736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f4c1a-7edb-4399-ad1d-4d8542ebb003 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.350009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f4c1a-7edb-4399-ad1d-4d8542ebb003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.361598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d230ac-0518-4cbf-9071-9ea105c8d34a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:52.367601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab04fa3-409c-4ea2-9ab1-2e0c42ee9f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:52.368221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab04fa3-409c-4ea2-9ab1-2e0c42ee9f22 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.368473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab04fa3-409c-4ea2-9ab1-2e0c42ee9f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.368747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab04fa3-409c-4ea2-9ab1-2e0c42ee9f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.369390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab04fa3-409c-4ea2-9ab1-2e0c42ee9f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:52.371010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab04fa3-409c-4ea2-9ab1-2e0c42ee9f22 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:52.380670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6c9f4c1a-7edb-4399-ad1d-4d8542ebb003 None None] MFA Rules not processed for user `d4747972868d406a90c6b958ffdad894`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:52.382482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c9f4c1a-7edb-4399-ad1d-4d8542ebb003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:52.383917 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 825/1642] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:52.388884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab04fa3-409c-4ea2-9ab1-2e0c42ee9f22 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:52.396296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab04fa3-409c-4ea2-9ab1-2e0c42ee9f22 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:52.401013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676aea9-1d41-4d10-b175-70ac0e9fdbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:52.401689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676aea9-1d41-4d10-b175-70ac0e9fdbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.401946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676aea9-1d41-4d10-b175-70ac0e9fdbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.402228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676aea9-1d41-4d10-b175-70ac0e9fdbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.402867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676aea9-1d41-4d10-b175-70ac0e9fdbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:52.404542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676aea9-1d41-4d10-b175-70ac0e9fdbf3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:52.416471 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 826/1643] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:52.417767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434d49-ebcc-4119-bb28-8f2a1db80b82 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.418044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434d49-ebcc-4119-bb28-8f2a1db80b82 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.418314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434d49-ebcc-4119-bb28-8f2a1db80b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.458846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-27434d49-ebcc-4119-bb28-8f2a1db80b82 None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:52.460416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27434d49-ebcc-4119-bb28-8f2a1db80b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:52.478551 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 818/1644] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:52.480033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f4c1a-7edb-4399-ad1d-4d8542ebb003 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:52.492474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f4c1a-7edb-4399-ad1d-4d8542ebb003 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:52.499313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12f7f5-254f-4b7b-bb78-e98df1e4b8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:52.500106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12f7f5-254f-4b7b-bb78-e98df1e4b8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.500222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12f7f5-254f-4b7b-bb78-e98df1e4b8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.500631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12f7f5-254f-4b7b-bb78-e98df1e4b8ec admin admin] PATH_INFO: `/v3/projects/1b335352a355419db88c8be4d4191c79/users/9c60fff9171a47e6b3d31bbc67baa6e2/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.503696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12f7f5-254f-4b7b-bb78-e98df1e4b8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b335352a355419db88c8be4d4191c79, user_id=9c60fff9171a47e6b3d31bbc67baa6e2, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:52.507551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12f7f5-254f-4b7b-bb78-e98df1e4b8ec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:52.522845 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 819/1645] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:52 2022] PUT /identity/v3/projects/1b335352a355419db88c8be4d4191c79/users/9c60fff9171a47e6b3d31bbc67baa6e2/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:52.528434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12f7f5-254f-4b7b-bb78-e98df1e4b8ec admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:52.531039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5f12f7f5-254f-4b7b-bb78-e98df1e4b8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:52.532999 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 827/1646] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Aug 28 18:18:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:52.533853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27434d49-ebcc-4119-bb28-8f2a1db80b82 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:52.545353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27434d49-ebcc-4119-bb28-8f2a1db80b82 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:52.599379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12f7f5-254f-4b7b-bb78-e98df1e4b8ec admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:52.603435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f246548-e7b9-4b89-9883-9e2ba27a4b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:52.604062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f246548-e7b9-4b89-9883-9e2ba27a4b02 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.604320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f246548-e7b9-4b89-9883-9e2ba27a4b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.604592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f246548-e7b9-4b89-9883-9e2ba27a4b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.606392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebdb9b5-ca77-4730-8b5f-5992d48b1766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:52.607065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdb9b5-ca77-4730-8b5f-5992d48b1766 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.607380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdb9b5-ca77-4730-8b5f-5992d48b1766 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.607660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdb9b5-ca77-4730-8b5f-5992d48b1766 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.608302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebdb9b5-ca77-4730-8b5f-5992d48b1766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:52.609912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebdb9b5-ca77-4730-8b5f-5992d48b1766 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:52.615143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f246548-e7b9-4b89-9883-9e2ba27a4b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:52.616355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:52.617187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f246548-e7b9-4b89-9883-9e2ba27a4b02 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:52.621512 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 828/1647] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:52.622422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebdb9b5-ca77-4730-8b5f-5992d48b1766 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:52.629351 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 820/1648] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:52.630613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f246548-e7b9-4b89-9883-9e2ba27a4b02 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:52.634574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebdb9b5-ca77-4730-8b5f-5992d48b1766 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:52.640603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f246548-e7b9-4b89-9883-9e2ba27a4b02 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:52.641192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6109bf-86ed-4146-9c9e-bb65872a7062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:52.641947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6109bf-86ed-4146-9c9e-bb65872a7062 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.642293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6109bf-86ed-4146-9c9e-bb65872a7062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.642633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6109bf-86ed-4146-9c9e-bb65872a7062 admin admin] PATH_INFO: `/v3/projects/61b75fb3cad24d5a89efe12942fbb36f/users/dad9dc2539a0413db4c0957dc13d156e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.645483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9221ae-6358-44be-bddc-88cf9792c71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:52.646347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9221ae-6358-44be-bddc-88cf9792c71b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.646631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9221ae-6358-44be-bddc-88cf9792c71b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.646908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9221ae-6358-44be-bddc-88cf9792c71b admin admin] PATH_INFO: `/v3/projects/7d7ea433a00346caade6bbb2df0143b7/users/c83d61bcaa2e4df6b8af5804a3eea488/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.648899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9221ae-6358-44be-bddc-88cf9792c71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7ea433a00346caade6bbb2df0143b7, user_id=c83d61bcaa2e4df6b8af5804a3eea488, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:52.651607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9221ae-6358-44be-bddc-88cf9792c71b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:52.661960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6109bf-86ed-4146-9c9e-bb65872a7062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b75fb3cad24d5a89efe12942fbb36f, user_id=dad9dc2539a0413db4c0957dc13d156e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:52.664297 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 821/1649] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:52 2022] PUT /identity/v3/projects/7d7ea433a00346caade6bbb2df0143b7/users/c83d61bcaa2e4df6b8af5804a3eea488/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:52.664940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9221ae-6358-44be-bddc-88cf9792c71b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:52.674947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6109bf-86ed-4146-9c9e-bb65872a7062 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:52.693250 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 829/1650] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:52 2022] PUT /identity/v3/projects/61b75fb3cad24d5a89efe12942fbb36f/users/dad9dc2539a0413db4c0957dc13d156e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:52.694992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb5763-c039-4e6a-a4a4-7747410554b9 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.695387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb5763-c039-4e6a-a4a4-7747410554b9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.695580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb5763-c039-4e6a-a4a4-7747410554b9 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.697412 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 830/1651] 10.222.0.27 () {54 vars in 962 bytes} [Sun Aug 28 18:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:18:52.703580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e43b1-f8a9-4eaf-8182-baf33a17ffef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.703871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e43b1-f8a9-4eaf-8182-baf33a17ffef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.704148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e43b1-f8a9-4eaf-8182-baf33a17ffef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.736006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a19e43b1-f8a9-4eaf-8182-baf33a17ffef None None] MFA Rules not processed for user `9c60fff9171a47e6b3d31bbc67baa6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:52.737769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a19e43b1-f8a9-4eaf-8182-baf33a17ffef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:52.740673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:52.759696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9221ae-6358-44be-bddc-88cf9792c71b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:52.835296 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 831/1652] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:52 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:52.836096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e43b1-f8a9-4eaf-8182-baf33a17ffef None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:52.859201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a275d-13be-49c6-9267-8f3495957507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:52.860179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a275d-13be-49c6-9267-8f3495957507 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.860668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a275d-13be-49c6-9267-8f3495957507 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.861012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a275d-13be-49c6-9267-8f3495957507 admin admin] PATH_INFO: `/v3/projects/58e32a18622146c598ac7c5732a5626f/users/d4998edbaa434d2fb637373597ed10cd/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.863657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a275d-13be-49c6-9267-8f3495957507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e32a18622146c598ac7c5732a5626f, user_id=d4998edbaa434d2fb637373597ed10cd, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:52.866983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a275d-13be-49c6-9267-8f3495957507 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:52.880483 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 822/1653] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:52 2022] PUT /identity/v3/projects/58e32a18622146c598ac7c5732a5626f/users/d4998edbaa434d2fb637373597ed10cd/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:52.881293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a275d-13be-49c6-9267-8f3495957507 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:52.938049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e43b1-f8a9-4eaf-8182-baf33a17ffef None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:52.951057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a275d-13be-49c6-9267-8f3495957507 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:52.957526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47249ae-efb8-43d3-88a9-25c87f8e4ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:52.958457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47249ae-efb8-43d3-88a9-25c87f8e4ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:52.958830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47249ae-efb8-43d3-88a9-25c87f8e4ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:52.959171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47249ae-efb8-43d3-88a9-25c87f8e4ad3 admin admin] PATH_INFO: `/v3/projects/8e6522c1365e420b9a22221976aacb6f/users/ef7f8210d3ef4141b3e043a782c692dd/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:52.980567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47249ae-efb8-43d3-88a9-25c87f8e4ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6522c1365e420b9a22221976aacb6f, user_id=ef7f8210d3ef4141b3e043a782c692dd, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:52.983847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47249ae-efb8-43d3-88a9-25c87f8e4ad3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:53.000218 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 823/1654] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:52 2022] PUT /identity/v3/projects/8e6522c1365e420b9a22221976aacb6f/users/ef7f8210d3ef4141b3e043a782c692dd/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:53.002116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70126-217c-4526-af71-2166de40e35c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:53.002402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70126-217c-4526-af71-2166de40e35c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:53.002828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70126-217c-4526-af71-2166de40e35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:53.004564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:53.021679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bb05d-4d59-4b24-b320-84a0802138b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:53.022347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bb05d-4d59-4b24-b320-84a0802138b6 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:53.023096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bb05d-4d59-4b24-b320-84a0802138b6 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:53.023503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bb05d-4d59-4b24-b320-84a0802138b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:53.025498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-100bb05d-4d59-4b24-b320-84a0802138b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:53.043636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-eee70126-217c-4526-af71-2166de40e35c None None] MFA Rules not processed for user `c83d61bcaa2e4df6b8af5804a3eea488`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:53.044843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eee70126-217c-4526-af71-2166de40e35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:53.096743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bb05d-4d59-4b24-b320-84a0802138b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:53.098799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bb05d-4d59-4b24-b320-84a0802138b6 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:53.109725 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 832/1655] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:53.110573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bb05d-4d59-4b24-b320-84a0802138b6 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:53.111927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:53.123281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bb05d-4d59-4b24-b320-84a0802138b6 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:53.124028 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 824/1656] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:53.131190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9658a-da65-4a57-b105-83ed2e641899 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:53.131807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9658a-da65-4a57-b105-83ed2e641899 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:53.132238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9658a-da65-4a57-b105-83ed2e641899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:53.152629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f4c9658a-da65-4a57-b105-83ed2e641899 None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:53.153932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f4c9658a-da65-4a57-b105-83ed2e641899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:53.190174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0b40a-ff63-4661-b362-43be1977f215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:53.190797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0b40a-ff63-4661-b362-43be1977f215 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:53.191070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0b40a-ff63-4661-b362-43be1977f215 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:53.191393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0b40a-ff63-4661-b362-43be1977f215 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:53.192037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0b40a-ff63-4661-b362-43be1977f215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:53.194155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0b40a-ff63-4661-b362-43be1977f215 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:53.209990 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 833/1657] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:53.209990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d822cc-ff5a-4f73-8905-3b50e2f39104 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:53.209990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d822cc-ff5a-4f73-8905-3b50e2f39104 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:53.209990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d822cc-ff5a-4f73-8905-3b50e2f39104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:53.246853 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 825/1658] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Aug 28 18:18:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:53.248528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9658a-da65-4a57-b105-83ed2e641899 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:53.250403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f4c9658a-da65-4a57-b105-83ed2e641899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:53.253556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e0d822cc-ff5a-4f73-8905-3b50e2f39104 None None] MFA Rules not processed for user `d4998edbaa434d2fb637373597ed10cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:53.255305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e0d822cc-ff5a-4f73-8905-3b50e2f39104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:53.271959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9658a-da65-4a57-b105-83ed2e641899 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:53.279138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e79d6d-aba2-493e-b626-b90cc65ea6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:53.279829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79d6d-aba2-493e-b626-b90cc65ea6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:53.280110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79d6d-aba2-493e-b626-b90cc65ea6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:53.280384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79d6d-aba2-493e-b626-b90cc65ea6a0 admin admin] PATH_INFO: `/v3/projects/6296cd575f9b4128b52434a018771716` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:53.281538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e79d6d-aba2-493e-b626-b90cc65ea6a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6296cd575f9b4128b52434a018771716)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:53.282607 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-47e79d6d-aba2-493e-b626-b90cc65ea6a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:18:53.282607 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:18:53.282607 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:18:53.283850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e79d6d-aba2-493e-b626-b90cc65ea6a0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:53.351475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-47e79d6d-aba2-493e-b626-b90cc65ea6a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6296cd575f9b4128b52434a018771716', 'request_id': 'req-47e79d6d-aba2-493e-b626-b90cc65ea6a0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:53.369405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-47e79d6d-aba2-493e-b626-b90cc65ea6a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6296cd575f9b4128b52434a018771716', 'request_id': 'req-47e79d6d-aba2-493e-b626-b90cc65ea6a0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:53.370722 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 834/1659] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:53 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:53.372034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d822cc-ff5a-4f73-8905-3b50e2f39104 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:53.378965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-47e79d6d-aba2-493e-b626-b90cc65ea6a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6296cd575f9b4128b52434a018771716', 'request_id': 'req-47e79d6d-aba2-493e-b626-b90cc65ea6a0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:53.403563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d822cc-ff5a-4f73-8905-3b50e2f39104 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:53.410269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-47e79d6d-aba2-493e-b626-b90cc65ea6a0 admin admin] The token cache is being invalidate because project 6296cd575f9b4128b52434a018771716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:18:53.410575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-47e79d6d-aba2-493e-b626-b90cc65ea6a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:53.411662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-47e79d6d-aba2-493e-b626-b90cc65ea6a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:53.414119 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 826/1660] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:18:53 2022] DELETE /identity/v3/projects/6296cd575f9b4128b52434a018771716 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:53.419783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e79d6d-aba2-493e-b626-b90cc65ea6a0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:53.419783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-47e79d6d-aba2-493e-b626-b90cc65ea6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:53.422398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:53.496556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9d5ee-5f12-41b3-b2dc-109973bf126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:53.497214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9d5ee-5f12-41b3-b2dc-109973bf126a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:53.497651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9d5ee-5f12-41b3-b2dc-109973bf126a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:53.497936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9d5ee-5f12-41b3-b2dc-109973bf126a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:53.498660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9d5ee-5f12-41b3-b2dc-109973bf126a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:53.500342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9d5ee-5f12-41b3-b2dc-109973bf126a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:53.514568 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 835/1661] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:53.516373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9d5ee-5f12-41b3-b2dc-109973bf126a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:53.520005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f8d9d5ee-5f12-41b3-b2dc-109973bf126a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:53.522518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e79d6d-aba2-493e-b626-b90cc65ea6a0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:53.539272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5f02f-7812-458d-9b0e-f5f38700eb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:53.540142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5f02f-7812-458d-9b0e-f5f38700eb45 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:53.540467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5f02f-7812-458d-9b0e-f5f38700eb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:53.540794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5f02f-7812-458d-9b0e-f5f38700eb45 admin admin] PATH_INFO: `/v3/projects/61b75fb3cad24d5a89efe12942fbb36f/users/dad9dc2539a0413db4c0957dc13d156e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:53.543435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5f02f-7812-458d-9b0e-f5f38700eb45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b75fb3cad24d5a89efe12942fbb36f, user_id=dad9dc2539a0413db4c0957dc13d156e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:53.547161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5f02f-7812-458d-9b0e-f5f38700eb45 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:53.577087 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 827/1662] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:53 2022] PUT /identity/v3/projects/61b75fb3cad24d5a89efe12942fbb36f/users/dad9dc2539a0413db4c0957dc13d156e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:53.586016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5f02f-7812-458d-9b0e-f5f38700eb45 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:53.586016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e0a5f02f-7812-458d-9b0e-f5f38700eb45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:53.588424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:53.619185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9d5ee-5f12-41b3-b2dc-109973bf126a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:53.672649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5f02f-7812-458d-9b0e-f5f38700eb45 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:53.678624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4506d83-dcfb-4f67-8e1b-e0f5c491364a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:53.679283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4506d83-dcfb-4f67-8e1b-e0f5c491364a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:53.679557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4506d83-dcfb-4f67-8e1b-e0f5c491364a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:53.679829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4506d83-dcfb-4f67-8e1b-e0f5c491364a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:53.681633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a4506d83-dcfb-4f67-8e1b-e0f5c491364a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:53.699149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102bdc8-e7ee-4491-bbe1-bd60cd6d88da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:53.699806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102bdc8-e7ee-4491-bbe1-bd60cd6d88da service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:53.700087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102bdc8-e7ee-4491-bbe1-bd60cd6d88da service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:53.700364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102bdc8-e7ee-4491-bbe1-bd60cd6d88da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:53.702318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f102bdc8-e7ee-4491-bbe1-bd60cd6d88da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:53.750077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4506d83-dcfb-4f67-8e1b-e0f5c491364a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:53.752107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4506d83-dcfb-4f67-8e1b-e0f5c491364a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:53.758169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:53.765518 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 828/1663] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:53 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:53.767006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd54545-152d-4c7f-a38f-1777f8b1e7ad None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:53.767231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd54545-152d-4c7f-a38f-1777f8b1e7ad None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:53.767444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd54545-152d-4c7f-a38f-1777f8b1e7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:53.792960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102bdc8-e7ee-4491-bbe1-bd60cd6d88da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:53.797775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102bdc8-e7ee-4491-bbe1-bd60cd6d88da service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:53.798119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7cd54545-152d-4c7f-a38f-1777f8b1e7ad None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:53.799883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7cd54545-152d-4c7f-a38f-1777f8b1e7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:53.816407 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 836/1664] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:53.817887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102bdc8-e7ee-4491-bbe1-bd60cd6d88da service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:53.820399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f102bdc8-e7ee-4491-bbe1-bd60cd6d88da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:53.917424 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 829/1665] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:53.919030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2861d3-648c-4f2a-a64b-01f158ef927b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:53.919609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2861d3-648c-4f2a-a64b-01f158ef927b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:53.920037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2861d3-648c-4f2a-a64b-01f158ef927b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:53.930834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102bdc8-e7ee-4491-bbe1-bd60cd6d88da service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:53.938086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8146a9-14f3-4631-8b57-6e316d7c0c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:53.939006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8146a9-14f3-4631-8b57-6e316d7c0c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:53.939648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8146a9-14f3-4631-8b57-6e316d7c0c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:53.940313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8146a9-14f3-4631-8b57-6e316d7c0c67 admin admin] PATH_INFO: `/v3/projects/8e6522c1365e420b9a22221976aacb6f/users/ef7f8210d3ef4141b3e043a782c692dd/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:53.943280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8146a9-14f3-4631-8b57-6e316d7c0c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6522c1365e420b9a22221976aacb6f, user_id=ef7f8210d3ef4141b3e043a782c692dd, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:53.948357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8146a9-14f3-4631-8b57-6e316d7c0c67 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:53.956043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9f2861d3-648c-4f2a-a64b-01f158ef927b None None] MFA Rules not processed for user `dad9dc2539a0413db4c0957dc13d156e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:53.957531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9f2861d3-648c-4f2a-a64b-01f158ef927b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:53.966319 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 837/1666] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:53 2022] PUT /identity/v3/projects/8e6522c1365e420b9a22221976aacb6f/users/ef7f8210d3ef4141b3e043a782c692dd/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:53.967771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8146a9-14f3-4631-8b57-6e316d7c0c67 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:54.007516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:54.052187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8146a9-14f3-4631-8b57-6e316d7c0c67 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:54.063981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac918bc0-3fbb-4c91-8216-b0db287c3685 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:54.064889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918bc0-3fbb-4c91-8216-b0db287c3685 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:54.065523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918bc0-3fbb-4c91-8216-b0db287c3685 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:54.065801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918bc0-3fbb-4c91-8216-b0db287c3685 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:54.067479 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 830/1667] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:54.070835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd973cc-072f-4a68-8f3c-60294db106ea None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:54.072090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd973cc-072f-4a68-8f3c-60294db106ea None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:54.072525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd973cc-072f-4a68-8f3c-60294db106ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:54.076190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac918bc0-3fbb-4c91-8216-b0db287c3685 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:54.108980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9dd973cc-072f-4a68-8f3c-60294db106ea None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:54.110156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9dd973cc-072f-4a68-8f3c-60294db106ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:54.155956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac918bc0-3fbb-4c91-8216-b0db287c3685 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:54.157585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac918bc0-3fbb-4c91-8216-b0db287c3685 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:54.170359 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 838/1668] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:54.171505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a830f29-68f6-4159-9599-33a73d8c06a9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:54.171795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a830f29-68f6-4159-9599-33a73d8c06a9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:54.172073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a830f29-68f6-4159-9599-33a73d8c06a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:54.189467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:54.196397 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 831/1669] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:54.197849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd973cc-072f-4a68-8f3c-60294db106ea None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:54.208681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd973cc-072f-4a68-8f3c-60294db106ea None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:54.213729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1a830f29-68f6-4159-9599-33a73d8c06a9 None None] MFA Rules not processed for user `ef7f8210d3ef4141b3e043a782c692dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:54.214932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1a830f29-68f6-4159-9599-33a73d8c06a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:54.215216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cf511-ef01-40eb-aae3-a30690edc917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:54.216043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cf511-ef01-40eb-aae3-a30690edc917 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:54.216362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cf511-ef01-40eb-aae3-a30690edc917 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:54.216647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cf511-ef01-40eb-aae3-a30690edc917 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:54.217457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cf511-ef01-40eb-aae3-a30690edc917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:18:54.217622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cf511-ef01-40eb-aae3-a30690edc917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:54.219283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cf511-ef01-40eb-aae3-a30690edc917 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:54.232123 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 832/1670] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:18:54.232984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cf511-ef01-40eb-aae3-a30690edc917 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:54.246324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cf511-ef01-40eb-aae3-a30690edc917 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:54.252904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f75f8f-5196-4487-8cd2-d60b03f619a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:54.253675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75f8f-5196-4487-8cd2-d60b03f619a1 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:54.254055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75f8f-5196-4487-8cd2-d60b03f619a1 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:54.254456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75f8f-5196-4487-8cd2-d60b03f619a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:54.256422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c4f75f8f-5196-4487-8cd2-d60b03f619a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:54.293429 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 839/1671] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:54 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:54.294635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a830f29-68f6-4159-9599-33a73d8c06a9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:54.306473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a830f29-68f6-4159-9599-33a73d8c06a9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:54.311465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3226ed7-98da-46f9-a2b0-7ca8a16e7ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:54.312220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3226ed7-98da-46f9-a2b0-7ca8a16e7ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:54.312608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3226ed7-98da-46f9-a2b0-7ca8a16e7ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:54.312984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3226ed7-98da-46f9-a2b0-7ca8a16e7ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:54.313728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3226ed7-98da-46f9-a2b0-7ca8a16e7ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:54.315808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3226ed7-98da-46f9-a2b0-7ca8a16e7ce1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:54.330608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f75f8f-5196-4487-8cd2-d60b03f619a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:54.333145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f75f8f-5196-4487-8cd2-d60b03f619a1 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:54.344718 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 833/1672] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:54 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:54.350397 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 840/1673] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:54 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:54.354516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f75f8f-5196-4487-8cd2-d60b03f619a1 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:54.367279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f75f8f-5196-4487-8cd2-d60b03f619a1 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:54.424122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:54.445575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbba6c-30c4-4c33-8ecf-609394f3c805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:54.446328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbba6c-30c4-4c33-8ecf-609394f3c805 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:54.446729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbba6c-30c4-4c33-8ecf-609394f3c805 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:54.447073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbba6c-30c4-4c33-8ecf-609394f3c805 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:54.447963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbba6c-30c4-4c33-8ecf-609394f3c805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:54.450339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbba6c-30c4-4c33-8ecf-609394f3c805 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:54.480931 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 834/1674] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:54 2022] POST /identity/v3/users => generated 285 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:54.484116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3226ed7-98da-46f9-a2b0-7ca8a16e7ce1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:54.485263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbba6c-30c4-4c33-8ecf-609394f3c805 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:54.497405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbba6c-30c4-4c33-8ecf-609394f3c805 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:54.503284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab98e10-04c3-40cc-b12a-80664418f7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:54.503933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab98e10-04c3-40cc-b12a-80664418f7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:54.504273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab98e10-04c3-40cc-b12a-80664418f7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:54.504556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab98e10-04c3-40cc-b12a-80664418f7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:54.505296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab98e10-04c3-40cc-b12a-80664418f7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:54.507013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab98e10-04c3-40cc-b12a-80664418f7d1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:54.519638 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 835/1675] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:18:54.523355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab98e10-04c3-40cc-b12a-80664418f7d1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:54.534316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab98e10-04c3-40cc-b12a-80664418f7d1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:54.539628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a0382-c610-4d7b-9f84-d33964fba991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:54.540516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a0382-c610-4d7b-9f84-d33964fba991 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:54.540849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a0382-c610-4d7b-9f84-d33964fba991 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:54.541160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a0382-c610-4d7b-9f84-d33964fba991 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:54.541862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a0382-c610-4d7b-9f84-d33964fba991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:54.543778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a0382-c610-4d7b-9f84-d33964fba991 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:54.557692 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 836/1676] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:18:54.563445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a0382-c610-4d7b-9f84-d33964fba991 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:54.576297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a0382-c610-4d7b-9f84-d33964fba991 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:54.580990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e4e66-d5bd-487c-92f1-ef30df2c9f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:54.581681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e4e66-d5bd-487c-92f1-ef30df2c9f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:54.581962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e4e66-d5bd-487c-92f1-ef30df2c9f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:54.582240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e4e66-d5bd-487c-92f1-ef30df2c9f59 admin admin] PATH_INFO: `/v3/projects/395385689ded402896bf6008989b68cb/users/c1266e2606ec4c8f86c6a7462c714d30/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:54.598158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e4e66-d5bd-487c-92f1-ef30df2c9f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395385689ded402896bf6008989b68cb, user_id=c1266e2606ec4c8f86c6a7462c714d30, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:54.600922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e4e66-d5bd-487c-92f1-ef30df2c9f59 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:54.612975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3226ed7-98da-46f9-a2b0-7ca8a16e7ce1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:54.616412 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 837/1677] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:54 2022] PUT /identity/v3/projects/395385689ded402896bf6008989b68cb/users/c1266e2606ec4c8f86c6a7462c714d30/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:54.630003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98501e0c-d39d-42f5-b0a0-13f9380d74f2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:54.630625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98501e0c-d39d-42f5-b0a0-13f9380d74f2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:54.632022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98501e0c-d39d-42f5-b0a0-13f9380d74f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:54.674209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-98501e0c-d39d-42f5-b0a0-13f9380d74f2 None None] MFA Rules not processed for user `c1266e2606ec4c8f86c6a7462c714d30`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:54.675499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-98501e0c-d39d-42f5-b0a0-13f9380d74f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:54.700708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0e0be-fa2e-402f-a249-0adaa0b33610 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:54.701336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0e0be-fa2e-402f-a249-0adaa0b33610 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:54.701619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0e0be-fa2e-402f-a249-0adaa0b33610 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:54.701903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0e0be-fa2e-402f-a249-0adaa0b33610 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:54.703760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e2b0e0be-fa2e-402f-a249-0adaa0b33610 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:54.709123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:54.748913 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 838/1678] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:54.748913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98501e0c-d39d-42f5-b0a0-13f9380d74f2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:54.759079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98501e0c-d39d-42f5-b0a0-13f9380d74f2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:54.764884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb6a6a-6e31-4fb7-95a9-54bd33e78d82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:54.765506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb6a6a-6e31-4fb7-95a9-54bd33e78d82 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:54.765782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb6a6a-6e31-4fb7-95a9-54bd33e78d82 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:54.766057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb6a6a-6e31-4fb7-95a9-54bd33e78d82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:54.769789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0e0be-fa2e-402f-a249-0adaa0b33610 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:54.771472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0e0be-fa2e-402f-a249-0adaa0b33610 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:54.783029 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 841/1679] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:54.783029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0e0be-fa2e-402f-a249-0adaa0b33610 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:54.857755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0e0be-fa2e-402f-a249-0adaa0b33610 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:54.857928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb6a6a-6e31-4fb7-95a9-54bd33e78d82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:54.859471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb6a6a-6e31-4fb7-95a9-54bd33e78d82 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:54.862909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78fbd8-53af-408e-aaf0-19a458202953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:54.863586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78fbd8-53af-408e-aaf0-19a458202953 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:54.863872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78fbd8-53af-408e-aaf0-19a458202953 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:54.864145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78fbd8-53af-408e-aaf0-19a458202953 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:54.864793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78fbd8-53af-408e-aaf0-19a458202953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:54.866734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78fbd8-53af-408e-aaf0-19a458202953 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:54.870638 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 839/1680] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:54.871688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb6a6a-6e31-4fb7-95a9-54bd33e78d82 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:54.889466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb6a6a-6e31-4fb7-95a9-54bd33e78d82 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:54.899419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d555b-d04e-4e21-86b2-eeb196fd1231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:54.900343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d555b-d04e-4e21-86b2-eeb196fd1231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:54.900905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d555b-d04e-4e21-86b2-eeb196fd1231 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:54.901985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d555b-d04e-4e21-86b2-eeb196fd1231 admin admin] PATH_INFO: `/v3/users/f151e9d5d8514c91ad29e086d41cd6c0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:54.903578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d555b-d04e-4e21-86b2-eeb196fd1231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f151e9d5d8514c91ad29e086d41cd6c0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:54.905652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d555b-d04e-4e21-86b2-eeb196fd1231 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:54.910599 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 842/1681] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:54 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:54.910599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78fbd8-53af-408e-aaf0-19a458202953 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:54.912575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:54.974381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e17d555b-d04e-4e21-86b2-eeb196fd1231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f151e9d5d8514c91ad29e086d41cd6c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:54.997484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e17d555b-d04e-4e21-86b2-eeb196fd1231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f151e9d5d8514c91ad29e086d41cd6c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:54.998927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e17d555b-d04e-4e21-86b2-eeb196fd1231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f151e9d5d8514c91ad29e086d41cd6c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:54.999974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e17d555b-d04e-4e21-86b2-eeb196fd1231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f151e9d5d8514c91ad29e086d41cd6c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:55.010233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e17d555b-d04e-4e21-86b2-eeb196fd1231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f151e9d5d8514c91ad29e086d41cd6c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:55.025609 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 840/1682] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:18:54 2022] DELETE /identity/v3/users/f151e9d5d8514c91ad29e086d41cd6c0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:55.026860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d555b-d04e-4e21-86b2-eeb196fd1231 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:55.028481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e17d555b-d04e-4e21-86b2-eeb196fd1231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.028655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78fbd8-53af-408e-aaf0-19a458202953 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:55.072557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:55.108577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d555b-d04e-4e21-86b2-eeb196fd1231 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:55.116193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3316d7-132b-46e3-ac28-2382a04b11a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:55.117191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3316d7-132b-46e3-ac28-2382a04b11a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.117471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3316d7-132b-46e3-ac28-2382a04b11a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.117747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3316d7-132b-46e3-ac28-2382a04b11a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:55.118407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3316d7-132b-46e3-ac28-2382a04b11a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:55.120382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3316d7-132b-46e3-ac28-2382a04b11a1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:55.134325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739fcb9-78c5-4891-bfa0-cca618cea17c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:55.135129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739fcb9-78c5-4891-bfa0-cca618cea17c service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.135757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739fcb9-78c5-4891-bfa0-cca618cea17c service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.136555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739fcb9-78c5-4891-bfa0-cca618cea17c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:55.139140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0739fcb9-78c5-4891-bfa0-cca618cea17c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.157566 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 841/1683] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:55 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:55.159361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb56797-99fa-44f9-a2f6-7af8a228c5f1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.160177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb56797-99fa-44f9-a2f6-7af8a228c5f1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.160646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb56797-99fa-44f9-a2f6-7af8a228c5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:55.185067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0cb56797-99fa-44f9-a2f6-7af8a228c5f1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:55.186571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0cb56797-99fa-44f9-a2f6-7af8a228c5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.196340 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 842/1684] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:55.197455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb56797-99fa-44f9-a2f6-7af8a228c5f1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:55.198988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0cb56797-99fa-44f9-a2f6-7af8a228c5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.215162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb56797-99fa-44f9-a2f6-7af8a228c5f1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:55.219969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dc48d-b28b-47a5-acc4-32bc3f62f503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:55.220701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dc48d-b28b-47a5-acc4-32bc3f62f503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.221077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dc48d-b28b-47a5-acc4-32bc3f62f503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.221358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dc48d-b28b-47a5-acc4-32bc3f62f503 admin admin] PATH_INFO: `/v3/users/b246523e6be5484aa37660723e8ee527` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:55.222532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101dc48d-b28b-47a5-acc4-32bc3f62f503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b246523e6be5484aa37660723e8ee527)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:55.224527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101dc48d-b28b-47a5-acc4-32bc3f62f503 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:55.233426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739fcb9-78c5-4891-bfa0-cca618cea17c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:55.235093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739fcb9-78c5-4891-bfa0-cca618cea17c service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:55.244662 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 843/1685] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:54 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:55.245559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739fcb9-78c5-4891-bfa0-cca618cea17c service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:55.246856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0739fcb9-78c5-4891-bfa0-cca618cea17c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.263330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739fcb9-78c5-4891-bfa0-cca618cea17c service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:55.269573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaad51-748f-4374-902a-396a5e7a50ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:55.270278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaad51-748f-4374-902a-396a5e7a50ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.270589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaad51-748f-4374-902a-396a5e7a50ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.270941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaad51-748f-4374-902a-396a5e7a50ed admin admin] PATH_INFO: `/v3/users/a570bd844f7f4344a7ed64840d410992` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:55.272259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaad51-748f-4374-902a-396a5e7a50ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a570bd844f7f4344a7ed64840d410992)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:55.273284 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-bcfaad51-748f-4374-902a-396a5e7a50ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:18:55.273284 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:18:55.273284 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:18:55.274532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaad51-748f-4374-902a-396a5e7a50ed admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:55.289321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-101dc48d-b28b-47a5-acc4-32bc3f62f503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b246523e6be5484aa37660723e8ee527'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:55.317274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=78,keystone:DELETE=18,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:55.321635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-101dc48d-b28b-47a5-acc4-32bc3f62f503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b246523e6be5484aa37660723e8ee527'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:55.322524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-101dc48d-b28b-47a5-acc4-32bc3f62f503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b246523e6be5484aa37660723e8ee527'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:55.323638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-101dc48d-b28b-47a5-acc4-32bc3f62f503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b246523e6be5484aa37660723e8ee527'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:55.341874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-101dc48d-b28b-47a5-acc4-32bc3f62f503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b246523e6be5484aa37660723e8ee527'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:55.358794 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 843/1686] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:18:55 2022] DELETE /identity/v3/users/b246523e6be5484aa37660723e8ee527 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:55.359471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dc48d-b28b-47a5-acc4-32bc3f62f503 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:55.361072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-101dc48d-b28b-47a5-acc4-32bc3f62f503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.373983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bcfaad51-748f-4374-902a-396a5e7a50ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a570bd844f7f4344a7ed64840d410992'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:55.375009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bcfaad51-748f-4374-902a-396a5e7a50ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a570bd844f7f4344a7ed64840d410992'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:55.388104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bcfaad51-748f-4374-902a-396a5e7a50ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a570bd844f7f4344a7ed64840d410992'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:55.401132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bcfaad51-748f-4374-902a-396a5e7a50ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a570bd844f7f4344a7ed64840d410992'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:55.424450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bcfaad51-748f-4374-902a-396a5e7a50ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a570bd844f7f4344a7ed64840d410992'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:55.439806 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 844/1687] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:18:55 2022] DELETE /identity/v3/users/a570bd844f7f4344a7ed64840d410992 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:55.441296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaad51-748f-4374-902a-396a5e7a50ed admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:55.443204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bcfaad51-748f-4374-902a-396a5e7a50ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.446487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dc48d-b28b-47a5-acc4-32bc3f62f503 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:55.496926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:55.511378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba4728-15f2-4dc1-87ab-a2136cc34f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:55.512027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba4728-15f2-4dc1-87ab-a2136cc34f96 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.512325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba4728-15f2-4dc1-87ab-a2136cc34f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.512632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba4728-15f2-4dc1-87ab-a2136cc34f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:55.513328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba4728-15f2-4dc1-87ab-a2136cc34f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:55.515215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba4728-15f2-4dc1-87ab-a2136cc34f96 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:55.517647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaad51-748f-4374-902a-396a5e7a50ed admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:55.521478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92050c70-4147-4980-a959-3c2a9af1bc44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:55.522120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92050c70-4147-4980-a959-3c2a9af1bc44 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.522396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92050c70-4147-4980-a959-3c2a9af1bc44 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.522665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92050c70-4147-4980-a959-3c2a9af1bc44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:55.524636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-92050c70-4147-4980-a959-3c2a9af1bc44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.529338 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 844/1688] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:55.529338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94140a28-9b63-4148-b643-33aec5451c1f None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.529338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94140a28-9b63-4148-b643-33aec5451c1f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.529338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94140a28-9b63-4148-b643-33aec5451c1f None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:55.529338 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 845/1689] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:18:55.530405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5596b4-83be-4d47-bf5c-7eb28857231f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.530687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5596b4-83be-4d47-bf5c-7eb28857231f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.530956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5596b4-83be-4d47-bf5c-7eb28857231f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:55.548664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92050c70-4147-4980-a959-3c2a9af1bc44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:55.550203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92050c70-4147-4980-a959-3c2a9af1bc44 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:55.551584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0b5596b4-83be-4d47-bf5c-7eb28857231f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:55.552825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0b5596b4-83be-4d47-bf5c-7eb28857231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.561701 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 845/1690] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:55.562560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92050c70-4147-4980-a959-3c2a9af1bc44 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:55.566292 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 846/1691] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:55.566292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30af9cf-22c1-4066-836b-6668068dfefc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.566292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30af9cf-22c1-4066-836b-6668068dfefc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.566292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30af9cf-22c1-4066-836b-6668068dfefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:55.574721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-92050c70-4147-4980-a959-3c2a9af1bc44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.588306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92050c70-4147-4980-a959-3c2a9af1bc44 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:55.594195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc8997-c9c7-453c-82e3-6b98d99b0d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:55.594848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc8997-c9c7-453c-82e3-6b98d99b0d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.595124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc8997-c9c7-453c-82e3-6b98d99b0d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.595428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc8997-c9c7-453c-82e3-6b98d99b0d2f admin admin] PATH_INFO: `/v3/users/5eb7dcf195db4f3982e8a10599bdd674` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:55.596815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc8997-c9c7-453c-82e3-6b98d99b0d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb7dcf195db4f3982e8a10599bdd674)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:55.598232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b30af9cf-22c1-4066-836b-6668068dfefc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:55.606440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc8997-c9c7-453c-82e3-6b98d99b0d2f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:55.606669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b30af9cf-22c1-4066-836b-6668068dfefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.615696 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 847/1692] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:55.616447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30af9cf-22c1-4066-836b-6668068dfefc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:55.618032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b30af9cf-22c1-4066-836b-6668068dfefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.632872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30af9cf-22c1-4066-836b-6668068dfefc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:55.639360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dfa19-77bb-4cf0-a381-70785e28f057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:55.640081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dfa19-77bb-4cf0-a381-70785e28f057 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.640401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dfa19-77bb-4cf0-a381-70785e28f057 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.640727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dfa19-77bb-4cf0-a381-70785e28f057 admin admin] PATH_INFO: `/v3/projects/432af217ac3a45ac823f24dcb843c8b5/users/1e5d68994fc9416ba945704fbf8f8e9b/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:55.663842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7dfa19-77bb-4cf0-a381-70785e28f057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=432af217ac3a45ac823f24dcb843c8b5, user_id=1e5d68994fc9416ba945704fbf8f8e9b, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:55.667066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7dfa19-77bb-4cf0-a381-70785e28f057 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:55.676457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abc8997-c9c7-453c-82e3-6b98d99b0d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb7dcf195db4f3982e8a10599bdd674'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:55.677759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abc8997-c9c7-453c-82e3-6b98d99b0d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb7dcf195db4f3982e8a10599bdd674'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:55.687031 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 848/1693] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:55 2022] PUT /identity/v3/projects/432af217ac3a45ac823f24dcb843c8b5/users/1e5d68994fc9416ba945704fbf8f8e9b/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:55.688606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abc8997-c9c7-453c-82e3-6b98d99b0d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb7dcf195db4f3982e8a10599bdd674'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:55.693412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755a7a-8cfd-4828-bdac-45f0f5c4d483 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.693660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755a7a-8cfd-4828-bdac-45f0f5c4d483 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.694002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755a7a-8cfd-4828-bdac-45f0f5c4d483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:55.706124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abc8997-c9c7-453c-82e3-6b98d99b0d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb7dcf195db4f3982e8a10599bdd674'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:55.716199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ab755a7a-8cfd-4828-bdac-45f0f5c4d483 None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:55.717540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ab755a7a-8cfd-4828-bdac-45f0f5c4d483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.722966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abc8997-c9c7-453c-82e3-6b98d99b0d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb7dcf195db4f3982e8a10599bdd674'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:55.730167 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 846/1694] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:18:55 2022] DELETE /identity/v3/users/5eb7dcf195db4f3982e8a10599bdd674 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:55.730810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc8997-c9c7-453c-82e3-6b98d99b0d2f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:55.734356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9abc8997-c9c7-453c-82e3-6b98d99b0d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.780175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:55.813886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc8997-c9c7-453c-82e3-6b98d99b0d2f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:55.817917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b740e1-14d0-4b8b-a5ea-78f06bc1a982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:55.818643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b740e1-14d0-4b8b-a5ea-78f06bc1a982 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.818988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b740e1-14d0-4b8b-a5ea-78f06bc1a982 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.819458 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 849/1695] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:18:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:55.819561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b740e1-14d0-4b8b-a5ea-78f06bc1a982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:55.826068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab755a7a-8cfd-4828-bdac-45f0f5c4d483 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:55.826929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6b740e1-14d0-4b8b-a5ea-78f06bc1a982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.898018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab755a7a-8cfd-4828-bdac-45f0f5c4d483 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:55.903103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6d330-9c94-49c2-afd3-83d7bc61d11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:55.903891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6d330-9c94-49c2-afd3-83d7bc61d11e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.904238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6d330-9c94-49c2-afd3-83d7bc61d11e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.904576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6d330-9c94-49c2-afd3-83d7bc61d11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:55.906715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c4f6d330-9c94-49c2-afd3-83d7bc61d11e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.919617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6d330-9c94-49c2-afd3-83d7bc61d11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:55.921479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6d330-9c94-49c2-afd3-83d7bc61d11e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:55.921613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b740e1-14d0-4b8b-a5ea-78f06bc1a982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:55.923016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b740e1-14d0-4b8b-a5ea-78f06bc1a982 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:55.934183 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 850/1696] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:55.934477 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 847/1697] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:55.935665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6d330-9c94-49c2-afd3-83d7bc61d11e service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:55.935911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60970b-8405-4ce9-9d0f-6927992a6657 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.936198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60970b-8405-4ce9-9d0f-6927992a6657 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.936562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60970b-8405-4ce9-9d0f-6927992a6657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:55.938251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c4f6d330-9c94-49c2-afd3-83d7bc61d11e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.943994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:55.951114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6d330-9c94-49c2-afd3-83d7bc61d11e service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:55.957798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de55508-04c4-48e6-8fe3-82a63d06c944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:55.958350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de55508-04c4-48e6-8fe3-82a63d06c944 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.958614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ac60970b-8405-4ce9-9d0f-6927992a6657 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:55.958775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de55508-04c4-48e6-8fe3-82a63d06c944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.958998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de55508-04c4-48e6-8fe3-82a63d06c944 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:55.959809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de55508-04c4-48e6-8fe3-82a63d06c944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:55.959916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac60970b-8405-4ce9-9d0f-6927992a6657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.961514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de55508-04c4-48e6-8fe3-82a63d06c944 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:55.969612 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 848/1698] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:55.973523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60970b-8405-4ce9-9d0f-6927992a6657 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:55.975001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac60970b-8405-4ce9-9d0f-6927992a6657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.977154 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 851/1699] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:55.978112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de55508-04c4-48e6-8fe3-82a63d06c944 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:55.979909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9de55508-04c4-48e6-8fe3-82a63d06c944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:55.993330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de55508-04c4-48e6-8fe3-82a63d06c944 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:55.998335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbdcfb-1785-4e2e-b053-44f326d41673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:55.999010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbdcfb-1785-4e2e-b053-44f326d41673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:55.999315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbdcfb-1785-4e2e-b053-44f326d41673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:55.999756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbdcfb-1785-4e2e-b053-44f326d41673 admin admin] PATH_INFO: `/v3/projects/3cf08cb9f9ea4fb590e6837f807fa8b3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:56.000755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbdcfb-1785-4e2e-b053-44f326d41673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf08cb9f9ea4fb590e6837f807fa8b3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:56.003190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbdcfb-1785-4e2e-b053-44f326d41673 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:56.059598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60970b-8405-4ce9-9d0f-6927992a6657 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:56.066950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71bbdcfb-1785-4e2e-b053-44f326d41673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf08cb9f9ea4fb590e6837f807fa8b3', 'request_id': 'req-71bbdcfb-1785-4e2e-b053-44f326d41673'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:56.077242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71bbdcfb-1785-4e2e-b053-44f326d41673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf08cb9f9ea4fb590e6837f807fa8b3', 'request_id': 'req-71bbdcfb-1785-4e2e-b053-44f326d41673'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:56.088722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71bbdcfb-1785-4e2e-b053-44f326d41673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf08cb9f9ea4fb590e6837f807fa8b3', 'request_id': 'req-71bbdcfb-1785-4e2e-b053-44f326d41673'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:56.111124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71bbdcfb-1785-4e2e-b053-44f326d41673 admin admin] The token cache is being invalidate because project 3cf08cb9f9ea4fb590e6837f807fa8b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:18:56.111626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71bbdcfb-1785-4e2e-b053-44f326d41673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:56.112622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71bbdcfb-1785-4e2e-b053-44f326d41673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:56.115226 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 852/1700] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:18:55 2022] DELETE /identity/v3/projects/3cf08cb9f9ea4fb590e6837f807fa8b3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:56.115906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbdcfb-1785-4e2e-b053-44f326d41673 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:56.118063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-71bbdcfb-1785-4e2e-b053-44f326d41673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:56.142737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c1bcf-eba6-4998-a9a4-9e6bc0c9311e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:56.147134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c1bcf-eba6-4998-a9a4-9e6bc0c9311e service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:56.147134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c1bcf-eba6-4998-a9a4-9e6bc0c9311e service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:56.147134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c1bcf-eba6-4998-a9a4-9e6bc0c9311e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:56.150337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c70c1bcf-eba6-4998-a9a4-9e6bc0c9311e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:56.165319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c1bcf-eba6-4998-a9a4-9e6bc0c9311e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:56.167000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c1bcf-eba6-4998-a9a4-9e6bc0c9311e service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:56.181595 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 849/1701] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:56.182451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c1bcf-eba6-4998-a9a4-9e6bc0c9311e service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:56.184295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c70c1bcf-eba6-4998-a9a4-9e6bc0c9311e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:56.204633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:56.216617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbdcfb-1785-4e2e-b053-44f326d41673 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:56.241429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b915958-9b6e-423f-9e19-9850850d5404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:56.242673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b915958-9b6e-423f-9e19-9850850d5404 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:56.243208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b915958-9b6e-423f-9e19-9850850d5404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:56.243732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b915958-9b6e-423f-9e19-9850850d5404 admin admin] PATH_INFO: `/v3/projects/432af217ac3a45ac823f24dcb843c8b5/users/1e5d68994fc9416ba945704fbf8f8e9b/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:56.246456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b915958-9b6e-423f-9e19-9850850d5404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=432af217ac3a45ac823f24dcb843c8b5, user_id=1e5d68994fc9416ba945704fbf8f8e9b, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:56.250806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b915958-9b6e-423f-9e19-9850850d5404 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:56.285236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c1bcf-eba6-4998-a9a4-9e6bc0c9311e service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:56.316158 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 853/1702] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:18:56 2022] PUT /identity/v3/projects/432af217ac3a45ac823f24dcb843c8b5/users/1e5d68994fc9416ba945704fbf8f8e9b/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:56.317115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b915958-9b6e-423f-9e19-9850850d5404 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:56.324200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7b915958-9b6e-423f-9e19-9850850d5404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:56.367419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:56.392706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0eea7b-f509-4483-9137-ef2087dcdb75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:56.394161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0eea7b-f509-4483-9137-ef2087dcdb75 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:56.396018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0eea7b-f509-4483-9137-ef2087dcdb75 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:56.396458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0eea7b-f509-4483-9137-ef2087dcdb75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:56.398735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f0eea7b-f509-4483-9137-ef2087dcdb75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:56.460552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b915958-9b6e-423f-9e19-9850850d5404 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:56.466111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc97b40-9d39-4e60-b85f-aa4a53d702e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:56.466798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc97b40-9d39-4e60-b85f-aa4a53d702e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:56.467081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc97b40-9d39-4e60-b85f-aa4a53d702e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:56.467392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc97b40-9d39-4e60-b85f-aa4a53d702e0 admin admin] PATH_INFO: `/v3/users/dad9dc2539a0413db4c0957dc13d156e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:56.468562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc97b40-9d39-4e60-b85f-aa4a53d702e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad9dc2539a0413db4c0957dc13d156e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:56.470610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc97b40-9d39-4e60-b85f-aa4a53d702e0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:56.521743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0eea7b-f509-4483-9137-ef2087dcdb75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:56.523294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0eea7b-f509-4483-9137-ef2087dcdb75 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:56.543878 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 850/1703] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:56.547167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515769b3-de4e-48bb-9707-e32e2886911a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:56.547670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515769b3-de4e-48bb-9707-e32e2886911a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:56.548136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515769b3-de4e-48bb-9707-e32e2886911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:56.563222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2fc97b40-9d39-4e60-b85f-aa4a53d702e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad9dc2539a0413db4c0957dc13d156e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:56.586189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2fc97b40-9d39-4e60-b85f-aa4a53d702e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad9dc2539a0413db4c0957dc13d156e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:56.589079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2fc97b40-9d39-4e60-b85f-aa4a53d702e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad9dc2539a0413db4c0957dc13d156e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:56.590642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2fc97b40-9d39-4e60-b85f-aa4a53d702e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad9dc2539a0413db4c0957dc13d156e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:56.602661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-515769b3-de4e-48bb-9707-e32e2886911a None None] MFA Rules not processed for user `6c65df553af04997898c1ee72f3dc40b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:56.604287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-515769b3-de4e-48bb-9707-e32e2886911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:56.609476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2fc97b40-9d39-4e60-b85f-aa4a53d702e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad9dc2539a0413db4c0957dc13d156e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:56.627370 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 854/1704] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:18:56 2022] DELETE /identity/v3/users/dad9dc2539a0413db4c0957dc13d156e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:56.629041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34d136-86c8-4a11-9733-b9c4d2aab943 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:56.629432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34d136-86c8-4a11-9733-b9c4d2aab943 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:56.629767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34d136-86c8-4a11-9733-b9c4d2aab943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:56.665590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ef34d136-86c8-4a11-9733-b9c4d2aab943 None None] MFA Rules not processed for user `1e5d68994fc9416ba945704fbf8f8e9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:56.667611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ef34d136-86c8-4a11-9733-b9c4d2aab943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:56.694524 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 851/1705] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:56.694524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515769b3-de4e-48bb-9707-e32e2886911a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:56.694524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-515769b3-de4e-48bb-9707-e32e2886911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:56.719055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515769b3-de4e-48bb-9707-e32e2886911a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:56.775759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:56.805569 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 855/1706] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:56.807947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34d136-86c8-4a11-9733-b9c4d2aab943 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:56.811968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ef34d136-86c8-4a11-9733-b9c4d2aab943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:56.842208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c5697-9381-406d-8d4a-9a4dec6f4684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:56.843290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c5697-9381-406d-8d4a-9a4dec6f4684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:56.843789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c5697-9381-406d-8d4a-9a4dec6f4684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:56.844846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c5697-9381-406d-8d4a-9a4dec6f4684 admin admin] PATH_INFO: `/v3/projects/7e37f0d2bd3b4faa875f4ae86be21975` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:56.846945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c5697-9381-406d-8d4a-9a4dec6f4684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e37f0d2bd3b4faa875f4ae86be21975)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:56.869959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c5697-9381-406d-8d4a-9a4dec6f4684 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:56.949457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34d136-86c8-4a11-9733-b9c4d2aab943 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:56.956698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:56.980808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e2c5697-9381-406d-8d4a-9a4dec6f4684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e37f0d2bd3b4faa875f4ae86be21975', 'request_id': 'req-3e2c5697-9381-406d-8d4a-9a4dec6f4684'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:56.997461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e2c5697-9381-406d-8d4a-9a4dec6f4684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e37f0d2bd3b4faa875f4ae86be21975', 'request_id': 'req-3e2c5697-9381-406d-8d4a-9a4dec6f4684'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.005389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e2c5697-9381-406d-8d4a-9a4dec6f4684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e37f0d2bd3b4faa875f4ae86be21975', 'request_id': 'req-3e2c5697-9381-406d-8d4a-9a4dec6f4684'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.022293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e2c5697-9381-406d-8d4a-9a4dec6f4684 admin admin] The token cache is being invalidate because project 7e37f0d2bd3b4faa875f4ae86be21975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:18:57.023205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e2c5697-9381-406d-8d4a-9a4dec6f4684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.024716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e2c5697-9381-406d-8d4a-9a4dec6f4684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.027234 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 852/1707] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:18:56 2022] DELETE /identity/v3/projects/7e37f0d2bd3b4faa875f4ae86be21975 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:57.028517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c5697-9381-406d-8d4a-9a4dec6f4684 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:57.030762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e2c5697-9381-406d-8d4a-9a4dec6f4684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:57.053304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df1640-5416-4eb9-a822-ea13490ea8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:57.054236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df1640-5416-4eb9-a822-ea13490ea8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:57.054236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df1640-5416-4eb9-a822-ea13490ea8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:57.054491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df1640-5416-4eb9-a822-ea13490ea8e5 admin admin] PATH_INFO: `/v3/projects/6028abc53fae43efad53c36731f53e2a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:57.055908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df1640-5416-4eb9-a822-ea13490ea8e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6028abc53fae43efad53c36731f53e2a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:57.058406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df1640-5416-4eb9-a822-ea13490ea8e5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:57.132746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-40df1640-5416-4eb9-a822-ea13490ea8e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6028abc53fae43efad53c36731f53e2a', 'request_id': 'req-40df1640-5416-4eb9-a822-ea13490ea8e5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.139744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-40df1640-5416-4eb9-a822-ea13490ea8e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6028abc53fae43efad53c36731f53e2a', 'request_id': 'req-40df1640-5416-4eb9-a822-ea13490ea8e5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.143602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c5697-9381-406d-8d4a-9a4dec6f4684 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:57.146783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-40df1640-5416-4eb9-a822-ea13490ea8e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6028abc53fae43efad53c36731f53e2a', 'request_id': 'req-40df1640-5416-4eb9-a822-ea13490ea8e5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.162491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-40df1640-5416-4eb9-a822-ea13490ea8e5 admin admin] The token cache is being invalidate because project 6028abc53fae43efad53c36731f53e2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:18:57.162876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-40df1640-5416-4eb9-a822-ea13490ea8e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.163590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-40df1640-5416-4eb9-a822-ea13490ea8e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.167313 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 856/1708] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:18:56 2022] DELETE /identity/v3/projects/6028abc53fae43efad53c36731f53e2a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:57.167313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df1640-5416-4eb9-a822-ea13490ea8e5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:57.167313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-40df1640-5416-4eb9-a822-ea13490ea8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:57.205571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:57.226988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d471355-b439-496c-89fe-6f54e72ddba5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:57.227670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d471355-b439-496c-89fe-6f54e72ddba5 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:57.227955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d471355-b439-496c-89fe-6f54e72ddba5 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:57.228231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d471355-b439-496c-89fe-6f54e72ddba5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:57.230185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d471355-b439-496c-89fe-6f54e72ddba5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:57.256826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df1640-5416-4eb9-a822-ea13490ea8e5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:57.262825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff74b99-b470-41e5-88d5-11924cbb02fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:57.263368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff74b99-b470-41e5-88d5-11924cbb02fe service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:57.263659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff74b99-b470-41e5-88d5-11924cbb02fe service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:57.263929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff74b99-b470-41e5-88d5-11924cbb02fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:57.265726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dff74b99-b470-41e5-88d5-11924cbb02fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:57.297318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d471355-b439-496c-89fe-6f54e72ddba5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:57.300083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d471355-b439-496c-89fe-6f54e72ddba5 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:57.315504 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 853/1709] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:57.317030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d471355-b439-496c-89fe-6f54e72ddba5 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:57.318991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d471355-b439-496c-89fe-6f54e72ddba5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:57.325436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:57.347472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff74b99-b470-41e5-88d5-11924cbb02fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:57.349872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff74b99-b470-41e5-88d5-11924cbb02fe service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:57.362753 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 857/1710] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:57.365152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff74b99-b470-41e5-88d5-11924cbb02fe service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:57.365776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dff74b99-b470-41e5-88d5-11924cbb02fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:57.417249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d471355-b439-496c-89fe-6f54e72ddba5 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:57.425550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:57.426215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:57.433486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:57.433486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a admin admin] PATH_INFO: `/v3/projects/8cadcc3435e140a28de0ae62594c2bea` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:57.434652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cadcc3435e140a28de0ae62594c2bea)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:57.436968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:57.467824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff74b99-b470-41e5-88d5-11924cbb02fe service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:57.476397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596d4d2-9f2b-428e-9ee0-88286d6a3f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:57.477239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596d4d2-9f2b-428e-9ee0-88286d6a3f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:57.477591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596d4d2-9f2b-428e-9ee0-88286d6a3f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:57.478002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596d4d2-9f2b-428e-9ee0-88286d6a3f9d admin admin] PATH_INFO: `/v3/users/3ba6ffb5d0fc441d854b9dc43a66ddf9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:57.479894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596d4d2-9f2b-428e-9ee0-88286d6a3f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba6ffb5d0fc441d854b9dc43a66ddf9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:57.482257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596d4d2-9f2b-428e-9ee0-88286d6a3f9d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:57.501053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cadcc3435e140a28de0ae62594c2bea', 'request_id': 'req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.512069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cadcc3435e140a28de0ae62594c2bea', 'request_id': 'req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.520266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cadcc3435e140a28de0ae62594c2bea', 'request_id': 'req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.533397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a admin admin] The token cache is being invalidate because project 8cadcc3435e140a28de0ae62594c2bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:18:57.533697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.534392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.536164 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 854/1711] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:18:57 2022] DELETE /identity/v3/projects/8cadcc3435e140a28de0ae62594c2bea => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:57.537104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:57.538490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:57.541485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6596d4d2-9f2b-428e-9ee0-88286d6a3f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba6ffb5d0fc441d854b9dc43a66ddf9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.561007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6596d4d2-9f2b-428e-9ee0-88286d6a3f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba6ffb5d0fc441d854b9dc43a66ddf9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.561794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6596d4d2-9f2b-428e-9ee0-88286d6a3f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba6ffb5d0fc441d854b9dc43a66ddf9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.562424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6596d4d2-9f2b-428e-9ee0-88286d6a3f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba6ffb5d0fc441d854b9dc43a66ddf9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.564945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:57.577219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6596d4d2-9f2b-428e-9ee0-88286d6a3f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba6ffb5d0fc441d854b9dc43a66ddf9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.594540 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 858/1712] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:18:57 2022] DELETE /identity/v3/users/3ba6ffb5d0fc441d854b9dc43a66ddf9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:57.595435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596d4d2-9f2b-428e-9ee0-88286d6a3f9d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:57.596838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6596d4d2-9f2b-428e-9ee0-88286d6a3f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:57.618605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca9fdc-d7ea-45a5-bc58-076d22ad7f8a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:57.674991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:57.689647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596d4d2-9f2b-428e-9ee0-88286d6a3f9d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:57.697115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55c708-9cd0-4875-97ac-2b29d35c156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:57.697370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55c708-9cd0-4875-97ac-2b29d35c156a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:57.697519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55c708-9cd0-4875-97ac-2b29d35c156a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:57.697707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55c708-9cd0-4875-97ac-2b29d35c156a admin admin] PATH_INFO: `/v3/users/9c60fff9171a47e6b3d31bbc67baa6e2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:57.698959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55c708-9cd0-4875-97ac-2b29d35c156a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c60fff9171a47e6b3d31bbc67baa6e2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:57.701168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55c708-9cd0-4875-97ac-2b29d35c156a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:57.702562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07f038-d913-4115-91f5-f2724828d7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:57.703281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07f038-d913-4115-91f5-f2724828d7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:57.703560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07f038-d913-4115-91f5-f2724828d7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:57.704093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07f038-d913-4115-91f5-f2724828d7a2 admin admin] PATH_INFO: `/v3/projects/61b75fb3cad24d5a89efe12942fbb36f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:57.705705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07f038-d913-4115-91f5-f2724828d7a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b75fb3cad24d5a89efe12942fbb36f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:57.708165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07f038-d913-4115-91f5-f2724828d7a2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:57.758017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7e55c708-9cd0-4875-97ac-2b29d35c156a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c60fff9171a47e6b3d31bbc67baa6e2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.778206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7e55c708-9cd0-4875-97ac-2b29d35c156a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c60fff9171a47e6b3d31bbc67baa6e2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.779675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7e55c708-9cd0-4875-97ac-2b29d35c156a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c60fff9171a47e6b3d31bbc67baa6e2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.780488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed07f038-d913-4115-91f5-f2724828d7a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b75fb3cad24d5a89efe12942fbb36f', 'request_id': 'req-ed07f038-d913-4115-91f5-f2724828d7a2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.780981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7e55c708-9cd0-4875-97ac-2b29d35c156a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c60fff9171a47e6b3d31bbc67baa6e2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.792568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7e55c708-9cd0-4875-97ac-2b29d35c156a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c60fff9171a47e6b3d31bbc67baa6e2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.800113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed07f038-d913-4115-91f5-f2724828d7a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b75fb3cad24d5a89efe12942fbb36f', 'request_id': 'req-ed07f038-d913-4115-91f5-f2724828d7a2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.808266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed07f038-d913-4115-91f5-f2724828d7a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b75fb3cad24d5a89efe12942fbb36f', 'request_id': 'req-ed07f038-d913-4115-91f5-f2724828d7a2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.810907 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 859/1713] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:18:57 2022] DELETE /identity/v3/users/9c60fff9171a47e6b3d31bbc67baa6e2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:57.814904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee98426-341a-417b-a800-f5a56a268881 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:57.815182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee98426-341a-417b-a800-f5a56a268881 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:57.815495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee98426-341a-417b-a800-f5a56a268881 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:57.817162 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 860/1714] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:18:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:18:57.824129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee98426-341a-417b-a800-f5a56a268881 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:57.827148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2ee98426-341a-417b-a800-f5a56a268881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:57.833676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed07f038-d913-4115-91f5-f2724828d7a2 admin admin] The token cache is being invalidate because project 61b75fb3cad24d5a89efe12942fbb36f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:18:57.834234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed07f038-d913-4115-91f5-f2724828d7a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.835106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed07f038-d913-4115-91f5-f2724828d7a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:57.837423 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 855/1715] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:18:57 2022] DELETE /identity/v3/projects/61b75fb3cad24d5a89efe12942fbb36f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:57.838631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07f038-d913-4115-91f5-f2724828d7a2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:57.842356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ed07f038-d913-4115-91f5-f2724828d7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:57.945956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07f038-d913-4115-91f5-f2724828d7a2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:57.951502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee98426-341a-417b-a800-f5a56a268881 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:57.957239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ebbe7-5ea6-4fd5-9767-4055764588dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:57.957914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ebbe7-5ea6-4fd5-9767-4055764588dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:57.958195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ebbe7-5ea6-4fd5-9767-4055764588dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:57.958471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ebbe7-5ea6-4fd5-9767-4055764588dd admin admin] PATH_INFO: `/v3/users/d4998edbaa434d2fb637373597ed10cd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:57.959822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ebbe7-5ea6-4fd5-9767-4055764588dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4998edbaa434d2fb637373597ed10cd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:57.961304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca6967-bc48-45c0-9d65-deee5d6e9436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:57.961954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca6967-bc48-45c0-9d65-deee5d6e9436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:57.962165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ebbe7-5ea6-4fd5-9767-4055764588dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:57.962259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca6967-bc48-45c0-9d65-deee5d6e9436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:57.962490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca6967-bc48-45c0-9d65-deee5d6e9436 admin admin] PATH_INFO: `/v3/users/c1266e2606ec4c8f86c6a7462c714d30` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:57.963838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca6967-bc48-45c0-9d65-deee5d6e9436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1266e2606ec4c8f86c6a7462c714d30)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:57.965914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca6967-bc48-45c0-9d65-deee5d6e9436 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:57.968846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:58.026026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca5ebbe7-5ea6-4fd5-9767-4055764588dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4998edbaa434d2fb637373597ed10cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.026903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca5ebbe7-5ea6-4fd5-9767-4055764588dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4998edbaa434d2fb637373597ed10cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.035046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bdca6967-bc48-45c0-9d65-deee5d6e9436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1266e2606ec4c8f86c6a7462c714d30'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.043831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca5ebbe7-5ea6-4fd5-9767-4055764588dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4998edbaa434d2fb637373597ed10cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.052580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bdca6967-bc48-45c0-9d65-deee5d6e9436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1266e2606ec4c8f86c6a7462c714d30'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.053420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bdca6967-bc48-45c0-9d65-deee5d6e9436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1266e2606ec4c8f86c6a7462c714d30'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.054049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bdca6967-bc48-45c0-9d65-deee5d6e9436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1266e2606ec4c8f86c6a7462c714d30'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.056105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca5ebbe7-5ea6-4fd5-9767-4055764588dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4998edbaa434d2fb637373597ed10cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.069819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bdca6967-bc48-45c0-9d65-deee5d6e9436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1266e2606ec4c8f86c6a7462c714d30'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.073231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:58.081648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca5ebbe7-5ea6-4fd5-9767-4055764588dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4998edbaa434d2fb637373597ed10cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.089619 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 861/1716] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:18:57 2022] DELETE /identity/v3/users/c1266e2606ec4c8f86c6a7462c714d30 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:58.089619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bbebf-43b0-4306-8199-4275cfe15a3e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:58.089619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bbebf-43b0-4306-8199-4275cfe15a3e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:58.089619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bbebf-43b0-4306-8199-4275cfe15a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:58.095365 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 856/1717] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:18:57 2022] DELETE /identity/v3/users/d4998edbaa434d2fb637373597ed10cd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:58.095365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e44e42-03d2-40b8-abfd-2d6ac52c2458 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:58.095365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e44e42-03d2-40b8-abfd-2d6ac52c2458 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:58.095365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e44e42-03d2-40b8-abfd-2d6ac52c2458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:58.115835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-13e44e42-03d2-40b8-abfd-2d6ac52c2458 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:58.117125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13e44e42-03d2-40b8-abfd-2d6ac52c2458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:58.127673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-042bbebf-43b0-4306-8199-4275cfe15a3e None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:58.129981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-042bbebf-43b0-4306-8199-4275cfe15a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:58.204484 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 857/1718] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:58.204484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e44e42-03d2-40b8-abfd-2d6ac52c2458 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:58.204484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13e44e42-03d2-40b8-abfd-2d6ac52c2458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:58.215534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e44e42-03d2-40b8-abfd-2d6ac52c2458 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:58.226849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:58.227783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:58.228168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:58.228570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b admin admin] PATH_INFO: `/v3/projects/659ccde015ae427fa9532b9155f01d04` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:58.230276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b admin admin] RBAC: Authorizing `identity:delete_project(project_id=659ccde015ae427fa9532b9155f01d04)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:58.234457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:58.256143 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 862/1719] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:18:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:58.257455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846d585-3de3-480c-b2de-c1c8c81791d2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:58.259458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846d585-3de3-480c-b2de-c1c8c81791d2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:58.259765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846d585-3de3-480c-b2de-c1c8c81791d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:58.286876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1846d585-3de3-480c-b2de-c1c8c81791d2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:58.288542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1846d585-3de3-480c-b2de-c1c8c81791d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:58.297567 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 863/1720] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:58.298899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d1c08-a2a4-458b-88ef-6c62c91d2315 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:58.300011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d1c08-a2a4-458b-88ef-6c62c91d2315 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:58.300011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d1c08-a2a4-458b-88ef-6c62c91d2315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:58.324151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '659ccde015ae427fa9532b9155f01d04', 'request_id': 'req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.328544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f96d1c08-a2a4-458b-88ef-6c62c91d2315 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:58.330684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f96d1c08-a2a4-458b-88ef-6c62c91d2315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:58.336712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '659ccde015ae427fa9532b9155f01d04', 'request_id': 'req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.345823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '659ccde015ae427fa9532b9155f01d04', 'request_id': 'req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.361774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b admin admin] The token cache is being invalidate because project 659ccde015ae427fa9532b9155f01d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:18:58.362504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.362962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.365862 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 858/1721] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:18:58 2022] DELETE /identity/v3/projects/659ccde015ae427fa9532b9155f01d04 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:58.366724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:58.370009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:58.422035 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 864/1722] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:58.422905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d1c08-a2a4-458b-88ef-6c62c91d2315 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:58.424250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f96d1c08-a2a4-458b-88ef-6c62c91d2315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:58.435893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:58.459062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb6e52-c7ea-423b-8ecb-9c3c7ce4c13b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:58.465316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512a597-e394-4692-800c-dc9aadc6464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:58.466419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512a597-e394-4692-800c-dc9aadc6464a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:58.466419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512a597-e394-4692-800c-dc9aadc6464a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:58.466768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512a597-e394-4692-800c-dc9aadc6464a admin admin] PATH_INFO: `/v3/projects/1b335352a355419db88c8be4d4191c79` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:58.467941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512a597-e394-4692-800c-dc9aadc6464a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b335352a355419db88c8be4d4191c79)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:58.470366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512a597-e394-4692-800c-dc9aadc6464a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:58.494681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:58.547325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d1c08-a2a4-458b-88ef-6c62c91d2315 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:58.548193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1512a597-e394-4692-800c-dc9aadc6464a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b335352a355419db88c8be4d4191c79', 'request_id': 'req-1512a597-e394-4692-800c-dc9aadc6464a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.559442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1512a597-e394-4692-800c-dc9aadc6464a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b335352a355419db88c8be4d4191c79', 'request_id': 'req-1512a597-e394-4692-800c-dc9aadc6464a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.566000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1512a597-e394-4692-800c-dc9aadc6464a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b335352a355419db88c8be4d4191c79', 'request_id': 'req-1512a597-e394-4692-800c-dc9aadc6464a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.579214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1512a597-e394-4692-800c-dc9aadc6464a admin admin] The token cache is being invalidate because project 1b335352a355419db88c8be4d4191c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:18:58.579675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1512a597-e394-4692-800c-dc9aadc6464a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.580436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1512a597-e394-4692-800c-dc9aadc6464a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.582071 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 859/1723] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:18:58 2022] DELETE /identity/v3/projects/1b335352a355419db88c8be4d4191c79 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:58.582828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512a597-e394-4692-800c-dc9aadc6464a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:58.584224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1512a597-e394-4692-800c-dc9aadc6464a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:58.617304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f519782-30d0-4c90-948c-8e847f4640c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:58.617923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519782-30d0-4c90-948c-8e847f4640c3 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:58.618197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519782-30d0-4c90-948c-8e847f4640c3 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:58.618480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519782-30d0-4c90-948c-8e847f4640c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:58.620916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8f519782-30d0-4c90-948c-8e847f4640c3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:58.647504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512a597-e394-4692-800c-dc9aadc6464a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:58.651307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403af35-4227-4b98-a6d3-189d52e856f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:58.652067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403af35-4227-4b98-a6d3-189d52e856f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:58.652339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403af35-4227-4b98-a6d3-189d52e856f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:58.652607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403af35-4227-4b98-a6d3-189d52e856f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:58.654424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d403af35-4227-4b98-a6d3-189d52e856f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:58.717800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f519782-30d0-4c90-948c-8e847f4640c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:58.720686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f519782-30d0-4c90-948c-8e847f4640c3 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:58.722078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403af35-4227-4b98-a6d3-189d52e856f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:58.723631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403af35-4227-4b98-a6d3-189d52e856f7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:58.733973 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 865/1724] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:58.734651 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 860/1725] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:58.735385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0feba-0877-44fa-ae86-bad57b1f0084 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:58.735493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403af35-4227-4b98-a6d3-189d52e856f7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:58.735675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0feba-0877-44fa-ae86-bad57b1f0084 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:58.735956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0feba-0877-44fa-ae86-bad57b1f0084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:58.736794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d403af35-4227-4b98-a6d3-189d52e856f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:58.755635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403af35-4227-4b98-a6d3-189d52e856f7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:58.757962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ddf0feba-0877-44fa-ae86-bad57b1f0084 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:58.759215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ddf0feba-0877-44fa-ae86-bad57b1f0084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:58.760995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1139d3-9ff0-4fab-a4fd-38d6d5d68328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:58.761849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1139d3-9ff0-4fab-a4fd-38d6d5d68328 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:58.762144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1139d3-9ff0-4fab-a4fd-38d6d5d68328 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:58.762425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1139d3-9ff0-4fab-a4fd-38d6d5d68328 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:58.763628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1139d3-9ff0-4fab-a4fd-38d6d5d68328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:18:58.764017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1139d3-9ff0-4fab-a4fd-38d6d5d68328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:58.766860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1139d3-9ff0-4fab-a4fd-38d6d5d68328 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:58.769523 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 866/1726] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:58.770675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0feba-0877-44fa-ae86-bad57b1f0084 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:58.772245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ddf0feba-0877-44fa-ae86-bad57b1f0084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:58.786359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0feba-0877-44fa-ae86-bad57b1f0084 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:58.793584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:58.794990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:58.795292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:58.795582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6 admin admin] PATH_INFO: `/v3/projects/58e32a18622146c598ac7c5732a5626f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:58.796775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e32a18622146c598ac7c5732a5626f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:58.798986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:58.801047 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 861/1727] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:18:58.802608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9940a-f5c6-4b7a-be70-b82ccdb13ccc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:58.802894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9940a-f5c6-4b7a-be70-b82ccdb13ccc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:58.803171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9940a-f5c6-4b7a-be70-b82ccdb13ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:58.834773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-25e9940a-f5c6-4b7a-be70-b82ccdb13ccc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:58.836355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-25e9940a-f5c6-4b7a-be70-b82ccdb13ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:58.848116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:58.855704 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 862/1728] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:58.861434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d4135-56e1-4f8d-bdc3-b44fc306d82d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:58.861744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d4135-56e1-4f8d-bdc3-b44fc306d82d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:58.863576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d4135-56e1-4f8d-bdc3-b44fc306d82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:58.876445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e32a18622146c598ac7c5732a5626f', 'request_id': 'req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.888288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e32a18622146c598ac7c5732a5626f', 'request_id': 'req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.892175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-831d4135-56e1-4f8d-bdc3-b44fc306d82d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:58.894064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-831d4135-56e1-4f8d-bdc3-b44fc306d82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:58.895986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e32a18622146c598ac7c5732a5626f', 'request_id': 'req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.921542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6 admin admin] The token cache is being invalidate because project 58e32a18622146c598ac7c5732a5626f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:18:58.921825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.922551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:58.924511 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 867/1729] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:18:58 2022] DELETE /identity/v3/projects/58e32a18622146c598ac7c5732a5626f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:58.925916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:58.928439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:58.949284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:58.989201 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 863/1730] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:58.995203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14609341-028b-4927-b046-73207f3a4ca3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:58.995674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14609341-028b-4927-b046-73207f3a4ca3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:58.995964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14609341-028b-4927-b046-73207f3a4ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.015622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720bcae-2bc7-4917-9c1e-6f98a283d8d6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:59.021010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-14609341-028b-4927-b046-73207f3a4ca3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:59.023014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276fc88-2948-4fc8-8ab9-22783423db89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:59.023203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-14609341-028b-4927-b046-73207f3a4ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:59.024202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276fc88-2948-4fc8-8ab9-22783423db89 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.024689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276fc88-2948-4fc8-8ab9-22783423db89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.025402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276fc88-2948-4fc8-8ab9-22783423db89 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.026496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276fc88-2948-4fc8-8ab9-22783423db89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:59.030263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276fc88-2948-4fc8-8ab9-22783423db89 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:59.031562 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 864/1731] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:59.033651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f4cd5-9c0d-4927-9732-b89670716b73 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.033936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f4cd5-9c0d-4927-9732-b89670716b73 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.034390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f4cd5-9c0d-4927-9732-b89670716b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.055186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-307f4cd5-9c0d-4927-9732-b89670716b73 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:59.056341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-307f4cd5-9c0d-4927-9732-b89670716b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:59.073181 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 865/1732] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:59.073181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f4cd5-9c0d-4927-9732-b89670716b73 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:59.079683 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 868/1733] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:58 2022] POST /identity/v3/projects => generated 393 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:59.079683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276fc88-2948-4fc8-8ab9-22783423db89 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:59.080249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f4cd5-9c0d-4927-9732-b89670716b73 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:59.167546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276fc88-2948-4fc8-8ab9-22783423db89 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:59.174352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3516be-505d-430a-a587-d97cc682124b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:59.174561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbff85-7cce-4144-a164-edb8d7520211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:59.175078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3516be-505d-430a-a587-d97cc682124b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.175554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3516be-505d-430a-a587-d97cc682124b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.176293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3516be-505d-430a-a587-d97cc682124b admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.177145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3516be-505d-430a-a587-d97cc682124b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:18:59.177407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbff85-7cce-4144-a164-edb8d7520211 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.177510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3516be-505d-430a-a587-d97cc682124b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:59.177778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbff85-7cce-4144-a164-edb8d7520211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.178066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbff85-7cce-4144-a164-edb8d7520211 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.179021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbff85-7cce-4144-a164-edb8d7520211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:18:59.179654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbff85-7cce-4144-a164-edb8d7520211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:59.180141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3516be-505d-430a-a587-d97cc682124b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:59.183822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbff85-7cce-4144-a164-edb8d7520211 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:59.202249 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 869/1734] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:18:59.203809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff657a1a-c042-483e-9430-ac20ff1fed89 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.204280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff657a1a-c042-483e-9430-ac20ff1fed89 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.204426 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 866/1735] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:18:59.205441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbff85-7cce-4144-a164-edb8d7520211 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:59.208819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff657a1a-c042-483e-9430-ac20ff1fed89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.227002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbff85-7cce-4144-a164-edb8d7520211 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:59.234404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ff657a1a-c042-483e-9430-ac20ff1fed89 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:59.236007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ff657a1a-c042-483e-9430-ac20ff1fed89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:59.238460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f66e0-f425-4865-bb6e-c48c61a0ff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:59.239890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f66e0-f425-4865-bb6e-c48c61a0ff39 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.240621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f66e0-f425-4865-bb6e-c48c61a0ff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.241804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f66e0-f425-4865-bb6e-c48c61a0ff39 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.243324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f66e0-f425-4865-bb6e-c48c61a0ff39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:59.247154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f66e0-f425-4865-bb6e-c48c61a0ff39 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:59.249307 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 870/1736] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:18:59.254685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff657a1a-c042-483e-9430-ac20ff1fed89 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:59.267979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff657a1a-c042-483e-9430-ac20ff1fed89 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:59.274504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476582b2-68df-4a89-a070-f874ce8128e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:59.275686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476582b2-68df-4a89-a070-f874ce8128e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.276274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476582b2-68df-4a89-a070-f874ce8128e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.276601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476582b2-68df-4a89-a070-f874ce8128e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.277688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476582b2-68df-4a89-a070-f874ce8128e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:59.280265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476582b2-68df-4a89-a070-f874ce8128e7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:59.294671 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 867/1737] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:59 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:59.295646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f66e0-f425-4865-bb6e-c48c61a0ff39 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:59.311571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f66e0-f425-4865-bb6e-c48c61a0ff39 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:59.321138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014353b-6342-4078-bb07-083c8ae1bab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:59.321810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014353b-6342-4078-bb07-083c8ae1bab7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.322092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014353b-6342-4078-bb07-083c8ae1bab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.322472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014353b-6342-4078-bb07-083c8ae1bab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.323033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014353b-6342-4078-bb07-083c8ae1bab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:59.325696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014353b-6342-4078-bb07-083c8ae1bab7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:59.332450 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 871/1738] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:59 2022] POST /identity/v3/projects => generated 403 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:59.337593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476582b2-68df-4a89-a070-f874ce8128e7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:59.337593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-476582b2-68df-4a89-a070-f874ce8128e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:59.366035 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 868/1739] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:59 2022] POST /identity/v3/projects => generated 393 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:59.367361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014353b-6342-4078-bb07-083c8ae1bab7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:59.374053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:59.468290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476582b2-68df-4a89-a070-f874ce8128e7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:59.474740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014353b-6342-4078-bb07-083c8ae1bab7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:59.475185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:59.476169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.476823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.477077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af admin admin] PATH_INFO: `/v3/projects/395385689ded402896bf6008989b68cb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.478736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af admin admin] RBAC: Authorizing `identity:delete_project(project_id=395385689ded402896bf6008989b68cb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:59.481532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:59.490665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbcc18-f6ac-4dd1-b117-4a366d350b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:59.490665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbcc18-f6ac-4dd1-b117-4a366d350b87 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.490665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbcc18-f6ac-4dd1-b117-4a366d350b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.490665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbcc18-f6ac-4dd1-b117-4a366d350b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.491098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbcc18-f6ac-4dd1-b117-4a366d350b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:18:59.491098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbcc18-f6ac-4dd1-b117-4a366d350b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:59.491098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbcc18-f6ac-4dd1-b117-4a366d350b87 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:59.504464 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 869/1740] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:18:59.505363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbcc18-f6ac-4dd1-b117-4a366d350b87 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:59.515918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbcc18-f6ac-4dd1-b117-4a366d350b87 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:59.521762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510ad13-69a4-4065-a1f9-829e16dc8cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:59.522551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510ad13-69a4-4065-a1f9-829e16dc8cfe admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.522891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510ad13-69a4-4065-a1f9-829e16dc8cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.523235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510ad13-69a4-4065-a1f9-829e16dc8cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.524037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510ad13-69a4-4065-a1f9-829e16dc8cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:59.525629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510ad13-69a4-4065-a1f9-829e16dc8cfe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:59.533299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:59.540511 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 870/1741] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:59.541866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510ad13-69a4-4065-a1f9-829e16dc8cfe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:59.546348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395385689ded402896bf6008989b68cb', 'request_id': 'req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:59.554030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395385689ded402896bf6008989b68cb', 'request_id': 'req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:59.554203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510ad13-69a4-4065-a1f9-829e16dc8cfe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:59.561488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395385689ded402896bf6008989b68cb', 'request_id': 'req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:59.579016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af admin admin] The token cache is being invalidate because project 395385689ded402896bf6008989b68cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:18:59.579346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:59.580136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:59.581843 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 872/1742] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:18:59 2022] DELETE /identity/v3/projects/395385689ded402896bf6008989b68cb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:18:59.583093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:59.585167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:59.619610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9d89a-13ef-4a70-a256-a7642e42162d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:59.620314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9d89a-13ef-4a70-a256-a7642e42162d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.620605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9d89a-13ef-4a70-a256-a7642e42162d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.620880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9d89a-13ef-4a70-a256-a7642e42162d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.621550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9d89a-13ef-4a70-a256-a7642e42162d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:59.623556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9d89a-13ef-4a70-a256-a7642e42162d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:59.648460 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 871/1743] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:59 2022] POST /identity/v3/users => generated 302 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:59.649983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6c5e4-17eb-4756-9b8b-2a54f5c51d04 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.651043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6c5e4-17eb-4756-9b8b-2a54f5c51d04 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.651043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6c5e4-17eb-4756-9b8b-2a54f5c51d04 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.652357 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 872/1744] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:18:59.653143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6c5e4-17eb-4756-9b8b-2a54f5c51d04 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:59.654708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee9374-b6eb-4fc6-bc2c-d487db64d7af admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:59.654914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a0c6c5e4-17eb-4756-9b8b-2a54f5c51d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:59.659373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192bf62-fbbe-47d8-88be-d8109a80f737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:59.660002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192bf62-fbbe-47d8-88be-d8109a80f737 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.660277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192bf62-fbbe-47d8-88be-d8109a80f737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.660550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192bf62-fbbe-47d8-88be-d8109a80f737 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.661221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192bf62-fbbe-47d8-88be-d8109a80f737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:59.663165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192bf62-fbbe-47d8-88be-d8109a80f737 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:59.696504 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 873/1745] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:18:59 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:59.696504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192bf62-fbbe-47d8-88be-d8109a80f737 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:59.696504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c192bf62-fbbe-47d8-88be-d8109a80f737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:59.708212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192bf62-fbbe-47d8-88be-d8109a80f737 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:59.713321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db84ca-2923-44dc-a6e8-63c16262e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:59.713938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db84ca-2923-44dc-a6e8-63c16262e118 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.714240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db84ca-2923-44dc-a6e8-63c16262e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.714491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db84ca-2923-44dc-a6e8-63c16262e118 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.715130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db84ca-2923-44dc-a6e8-63c16262e118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:59.717241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db84ca-2923-44dc-a6e8-63c16262e118 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:59.746462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6c5e4-17eb-4756-9b8b-2a54f5c51d04 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:59.749175 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 874/1746] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:18:59 2022] POST /identity/v3/projects => generated 359 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:18:59.750018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db84ca-2923-44dc-a6e8-63c16262e118 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:59.752052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e7db84ca-2923-44dc-a6e8-63c16262e118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:59.755873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059aaae1-7a59-456e-af21-6ce1c7830be1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:59.756518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aaae1-7a59-456e-af21-6ce1c7830be1 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.756800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aaae1-7a59-456e-af21-6ce1c7830be1 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.757077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aaae1-7a59-456e-af21-6ce1c7830be1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.759135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-059aaae1-7a59-456e-af21-6ce1c7830be1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:59.763050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:59.772189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aaae1-7a59-456e-af21-6ce1c7830be1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:59.773988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aaae1-7a59-456e-af21-6ce1c7830be1 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:59.784548 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 873/1747] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:18:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:18:59.785494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059aaae1-7a59-456e-af21-6ce1c7830be1 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:59.786956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-059aaae1-7a59-456e-af21-6ce1c7830be1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:59.801025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059aaae1-7a59-456e-af21-6ce1c7830be1 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:59.834615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db84ca-2923-44dc-a6e8-63c16262e118 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:59.840285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedfe22-5707-486a-ac80-3d2ec75cd45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:59.841033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedfe22-5707-486a-ac80-3d2ec75cd45a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.841383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedfe22-5707-486a-ac80-3d2ec75cd45a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.841684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedfe22-5707-486a-ac80-3d2ec75cd45a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.842348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedfe22-5707-486a-ac80-3d2ec75cd45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:59.843993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedfe22-5707-486a-ac80-3d2ec75cd45a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:59.864125 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 875/1748] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:59.864125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedfe22-5707-486a-ac80-3d2ec75cd45a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:18:59.864460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cfedfe22-5707-486a-ac80-3d2ec75cd45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:59.878907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fe239-62ac-47f2-a75a-1f4b98fdd746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:59.879378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedfe22-5707-486a-ac80-3d2ec75cd45a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:18:59.879897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fe239-62ac-47f2-a75a-1f4b98fdd746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.880182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fe239-62ac-47f2-a75a-1f4b98fdd746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.880518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fe239-62ac-47f2-a75a-1f4b98fdd746 admin admin] PATH_INFO: `/v3/users/1e5d68994fc9416ba945704fbf8f8e9b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.881622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fe239-62ac-47f2-a75a-1f4b98fdd746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e5d68994fc9416ba945704fbf8f8e9b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:59.883924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fe239-62ac-47f2-a75a-1f4b98fdd746 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:59.884805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225834c5-6ec6-4958-b0d6-ae6990fdbc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:18:59.885247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225834c5-6ec6-4958-b0d6-ae6990fdbc0a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.885533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225834c5-6ec6-4958-b0d6-ae6990fdbc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.885810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225834c5-6ec6-4958-b0d6-ae6990fdbc0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.886632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225834c5-6ec6-4958-b0d6-ae6990fdbc0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:18:59.888300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225834c5-6ec6-4958-b0d6-ae6990fdbc0a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:18:59.906414 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 876/1749] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:18:59.906414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e09fca-ec86-4791-9fd2-2661ce686538 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:18:59.906414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e09fca-ec86-4791-9fd2-2661ce686538 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:18:59.906414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e09fca-ec86-4791-9fd2-2661ce686538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:18:59.915969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:18:59.925454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-06e09fca-ec86-4791-9fd2-2661ce686538 None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:18:59.926699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-06e09fca-ec86-4791-9fd2-2661ce686538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:18:59.957072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f49fe239-62ac-47f2-a75a-1f4b98fdd746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e5d68994fc9416ba945704fbf8f8e9b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:59.957850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f49fe239-62ac-47f2-a75a-1f4b98fdd746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e5d68994fc9416ba945704fbf8f8e9b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:59.965987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f49fe239-62ac-47f2-a75a-1f4b98fdd746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e5d68994fc9416ba945704fbf8f8e9b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:59.976687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f49fe239-62ac-47f2-a75a-1f4b98fdd746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e5d68994fc9416ba945704fbf8f8e9b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:18:59.996378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f49fe239-62ac-47f2-a75a-1f4b98fdd746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e5d68994fc9416ba945704fbf8f8e9b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:00.005023 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 874/1750] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:18:59 2022] DELETE /identity/v3/users/1e5d68994fc9416ba945704fbf8f8e9b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:00.006120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fe239-62ac-47f2-a75a-1f4b98fdd746 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:00.009603 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 877/1751] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:18:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:00.011536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e09fca-ec86-4791-9fd2-2661ce686538 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:00.013189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-06e09fca-ec86-4791-9fd2-2661ce686538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:00.013424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f49fe239-62ac-47f2-a75a-1f4b98fdd746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:00.035609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e09fca-ec86-4791-9fd2-2661ce686538 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:00.114335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fe239-62ac-47f2-a75a-1f4b98fdd746 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:00.116147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcb5ab-2fb8-48ad-90ed-9864aa397c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:00.116889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb5ab-2fb8-48ad-90ed-9864aa397c19 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:00.117693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb5ab-2fb8-48ad-90ed-9864aa397c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:00.117996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb5ab-2fb8-48ad-90ed-9864aa397c19 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:00.118995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcb5ab-2fb8-48ad-90ed-9864aa397c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:00.120729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efff0bb-c695-47b8-a0a1-4218587edee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:00.121209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcb5ab-2fb8-48ad-90ed-9864aa397c19 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:00.121336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efff0bb-c695-47b8-a0a1-4218587edee1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:00.121632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efff0bb-c695-47b8-a0a1-4218587edee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:00.121890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efff0bb-c695-47b8-a0a1-4218587edee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:00.122546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efff0bb-c695-47b8-a0a1-4218587edee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:00.124380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efff0bb-c695-47b8-a0a1-4218587edee1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:00.139605 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 875/1752] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:00.141445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efff0bb-c695-47b8-a0a1-4218587edee1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:00.145752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9efff0bb-c695-47b8-a0a1-4218587edee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:00.155516 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 878/1753] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:00 2022] POST /identity/v3/users => generated 280 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:00.156928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcb5ab-2fb8-48ad-90ed-9864aa397c19 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:00.159576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-15fcb5ab-2fb8-48ad-90ed-9864aa397c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:00.164593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efff0bb-c695-47b8-a0a1-4218587edee1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:00.169746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dca98-594b-4371-8781-a7de6aae6d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:00.170598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dca98-594b-4371-8781-a7de6aae6d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:00.171224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dca98-594b-4371-8781-a7de6aae6d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:00.171355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dca98-594b-4371-8781-a7de6aae6d18 admin admin] PATH_INFO: `/v3/projects/93898211fcfe463eabea994e6b14efd4/users/10daf35a911041458fbf4c281a9ebc56/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:00.180554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcb5ab-2fb8-48ad-90ed-9864aa397c19 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:00.188716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0cd57-224d-4403-b51f-c3c363bdcf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:00.189382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0cd57-224d-4403-b51f-c3c363bdcf3e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:00.189691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0cd57-224d-4403-b51f-c3c363bdcf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:00.189995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0cd57-224d-4403-b51f-c3c363bdcf3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:00.190827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0cd57-224d-4403-b51f-c3c363bdcf3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:00.193046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0cd57-224d-4403-b51f-c3c363bdcf3e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:00.195950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dca98-594b-4371-8781-a7de6aae6d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93898211fcfe463eabea994e6b14efd4, user_id=10daf35a911041458fbf4c281a9ebc56, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:00.201597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dca98-594b-4371-8781-a7de6aae6d18 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:00.209078 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 879/1754] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:00.209078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0cd57-224d-4403-b51f-c3c363bdcf3e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:00.209078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b8c0cd57-224d-4403-b51f-c3c363bdcf3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:00.217486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:00.239735 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 876/1755] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:00 2022] PUT /identity/v3/projects/93898211fcfe463eabea994e6b14efd4/users/10daf35a911041458fbf4c281a9ebc56/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:00.240618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dca98-594b-4371-8781-a7de6aae6d18 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:00.320993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0cd57-224d-4403-b51f-c3c363bdcf3e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:00.367472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dca98-594b-4371-8781-a7de6aae6d18 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:00.379578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb12db0-4dcf-4aea-9261-5dbef5340fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:00.380747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb12db0-4dcf-4aea-9261-5dbef5340fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:00.381253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb12db0-4dcf-4aea-9261-5dbef5340fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:00.385183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb12db0-4dcf-4aea-9261-5dbef5340fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:00.386266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb12db0-4dcf-4aea-9261-5dbef5340fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:00.395675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb12db0-4dcf-4aea-9261-5dbef5340fd6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:00.399549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b123b-0859-4403-90ea-7555a714c851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:00.400183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b123b-0859-4403-90ea-7555a714c851 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:00.400520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b123b-0859-4403-90ea-7555a714c851 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:00.400825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b123b-0859-4403-90ea-7555a714c851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:00.413835 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 877/1756] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:00.424036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb12db0-4dcf-4aea-9261-5dbef5340fd6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:00.435588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb12db0-4dcf-4aea-9261-5dbef5340fd6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:00.440592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf227d74-ea3b-4bab-8af7-6fa6d5ebb3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:00.441331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf227d74-ea3b-4bab-8af7-6fa6d5ebb3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:00.441685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf227d74-ea3b-4bab-8af7-6fa6d5ebb3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:00.442029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf227d74-ea3b-4bab-8af7-6fa6d5ebb3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:00.442770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf227d74-ea3b-4bab-8af7-6fa6d5ebb3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:00.444444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf227d74-ea3b-4bab-8af7-6fa6d5ebb3c9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:00.446050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:00.464071 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 878/1757] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:00.464071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf227d74-ea3b-4bab-8af7-6fa6d5ebb3c9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:00.477605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf227d74-ea3b-4bab-8af7-6fa6d5ebb3c9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:00.485755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1810f73-e2a1-4fb3-9251-27d376b53b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:00.487384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1810f73-e2a1-4fb3-9251-27d376b53b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:00.488269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1810f73-e2a1-4fb3-9251-27d376b53b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:00.489738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1810f73-e2a1-4fb3-9251-27d376b53b5e admin admin] PATH_INFO: `/v3/projects/085bbfe6c3574cd29ef4542fe4033b94/users/dcb628c8f43d423e80393eaa3ca709a7/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:00.511690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1810f73-e2a1-4fb3-9251-27d376b53b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=085bbfe6c3574cd29ef4542fe4033b94, user_id=dcb628c8f43d423e80393eaa3ca709a7, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:00.514435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1810f73-e2a1-4fb3-9251-27d376b53b5e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:00.525424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b123b-0859-4403-90ea-7555a714c851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:00.527922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b123b-0859-4403-90ea-7555a714c851 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:00.536437 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 879/1758] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:00 2022] PUT /identity/v3/projects/085bbfe6c3574cd29ef4542fe4033b94/users/dcb628c8f43d423e80393eaa3ca709a7/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:00.538555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33887892-22c0-49fc-ac0f-0281c8c5b1f7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:00.539058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33887892-22c0-49fc-ac0f-0281c8c5b1f7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:00.539537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33887892-22c0-49fc-ac0f-0281c8c5b1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:00.550063 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 880/1759] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:00.553904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b123b-0859-4403-90ea-7555a714c851 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:00.557452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5b7b123b-0859-4403-90ea-7555a714c851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:00.583408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-33887892-22c0-49fc-ac0f-0281c8c5b1f7 None None] MFA Rules not processed for user `10daf35a911041458fbf4c281a9ebc56`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:00.584771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-33887892-22c0-49fc-ac0f-0281c8c5b1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:00.588655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b123b-0859-4403-90ea-7555a714c851 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:00.665075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4139b45-1005-4638-9ad9-af25deb1ec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:00.665754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139b45-1005-4638-9ad9-af25deb1ec72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:00.666028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139b45-1005-4638-9ad9-af25deb1ec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:00.666304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139b45-1005-4638-9ad9-af25deb1ec72 admin admin] PATH_INFO: `/v3/projects/432af217ac3a45ac823f24dcb843c8b5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:00.667582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4139b45-1005-4638-9ad9-af25deb1ec72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=432af217ac3a45ac823f24dcb843c8b5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:00.669589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4139b45-1005-4638-9ad9-af25deb1ec72 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:00.673617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:00.689944 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 880/1760] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:00.690790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33887892-22c0-49fc-ac0f-0281c8c5b1f7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:00.711273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33887892-22c0-49fc-ac0f-0281c8c5b1f7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:00.720027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec853c9b-ee0c-4316-9d5e-e01ee67ddd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:00.720839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec853c9b-ee0c-4316-9d5e-e01ee67ddd3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:00.721114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec853c9b-ee0c-4316-9d5e-e01ee67ddd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:00.721427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec853c9b-ee0c-4316-9d5e-e01ee67ddd3f admin admin] PATH_INFO: `/v3/projects/d51f0bfa0be24385bec3ad605cbdabfa/users/b48191da03874439900da27f001e0980/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:00.740824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec853c9b-ee0c-4316-9d5e-e01ee67ddd3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51f0bfa0be24385bec3ad605cbdabfa, user_id=b48191da03874439900da27f001e0980, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:00.741156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f4139b45-1005-4638-9ad9-af25deb1ec72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432af217ac3a45ac823f24dcb843c8b5', 'request_id': 'req-f4139b45-1005-4638-9ad9-af25deb1ec72'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:00.743969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec853c9b-ee0c-4316-9d5e-e01ee67ddd3f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:00.749019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f4139b45-1005-4638-9ad9-af25deb1ec72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432af217ac3a45ac823f24dcb843c8b5', 'request_id': 'req-f4139b45-1005-4638-9ad9-af25deb1ec72'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:00.757292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f4139b45-1005-4638-9ad9-af25deb1ec72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432af217ac3a45ac823f24dcb843c8b5', 'request_id': 'req-f4139b45-1005-4638-9ad9-af25deb1ec72'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:00.759906 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 881/1761] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:00 2022] PUT /identity/v3/projects/d51f0bfa0be24385bec3ad605cbdabfa/users/b48191da03874439900da27f001e0980/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:00.760795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec853c9b-ee0c-4316-9d5e-e01ee67ddd3f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:00.780946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f4139b45-1005-4638-9ad9-af25deb1ec72 admin admin] The token cache is being invalidate because project 432af217ac3a45ac823f24dcb843c8b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:00.781251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f4139b45-1005-4638-9ad9-af25deb1ec72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:00.782036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f4139b45-1005-4638-9ad9-af25deb1ec72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:00.787378 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 881/1762] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:00 2022] DELETE /identity/v3/projects/432af217ac3a45ac823f24dcb843c8b5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:00.789840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a3e23-8a71-43c3-8feb-160c5573609b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:00.790094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a3e23-8a71-43c3-8feb-160c5573609b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:00.790462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a3e23-8a71-43c3-8feb-160c5573609b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:00.813114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e94a3e23-8a71-43c3-8feb-160c5573609b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:00.814453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e94a3e23-8a71-43c3-8feb-160c5573609b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:00.842925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec853c9b-ee0c-4316-9d5e-e01ee67ddd3f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:00.850197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0250e7-d608-4bbb-aaa2-bd541f319faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:00.850989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0250e7-d608-4bbb-aaa2-bd541f319faa admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:00.851299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0250e7-d608-4bbb-aaa2-bd541f319faa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:00.851579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0250e7-d608-4bbb-aaa2-bd541f319faa admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:00.852253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0250e7-d608-4bbb-aaa2-bd541f319faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:00.853907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0250e7-d608-4bbb-aaa2-bd541f319faa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:00.865573 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 882/1763] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:00.866396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0250e7-d608-4bbb-aaa2-bd541f319faa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:00.868130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-da0250e7-d608-4bbb-aaa2-bd541f319faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:00.881605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0250e7-d608-4bbb-aaa2-bd541f319faa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:00.886791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62abcb-0fd2-4e12-bb21-f477772c9c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:00.887465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62abcb-0fd2-4e12-bb21-f477772c9c40 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:00.887764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62abcb-0fd2-4e12-bb21-f477772c9c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:00.888181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62abcb-0fd2-4e12-bb21-f477772c9c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:00.889231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62abcb-0fd2-4e12-bb21-f477772c9c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:00.891191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62abcb-0fd2-4e12-bb21-f477772c9c40 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:00.895168 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 882/1764] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:00.896677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e330e65-de77-4fe1-8069-99fd2ac7044a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:00.897129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e330e65-de77-4fe1-8069-99fd2ac7044a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:00.897529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e330e65-de77-4fe1-8069-99fd2ac7044a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:00.930081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1e330e65-de77-4fe1-8069-99fd2ac7044a None None] MFA Rules not processed for user `b48191da03874439900da27f001e0980`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:00.934914 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 883/1765] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:00 2022] POST /identity/v3/projects => generated 395 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:00.935122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1e330e65-de77-4fe1-8069-99fd2ac7044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:00.935217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae6ea6-81b3-4e75-8fda-504d1423c355 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:00.935217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae6ea6-81b3-4e75-8fda-504d1423c355 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:00.935217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae6ea6-81b3-4e75-8fda-504d1423c355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:00.958911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-41ae6ea6-81b3-4e75-8fda-504d1423c355 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:00.960586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-41ae6ea6-81b3-4e75-8fda-504d1423c355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:00.970861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:01.022441 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 883/1766] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:01.027815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e330e65-de77-4fe1-8069-99fd2ac7044a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:01.029525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1e330e65-de77-4fe1-8069-99fd2ac7044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:01.039118 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 884/1767] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:01.040071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae6ea6-81b3-4e75-8fda-504d1423c355 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:01.041440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-41ae6ea6-81b3-4e75-8fda-504d1423c355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:01.061389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:01.105061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae6ea6-81b3-4e75-8fda-504d1423c355 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:01.109812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dba8b2-f712-4f75-ba11-d866123c6138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:01.110464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dba8b2-f712-4f75-ba11-d866123c6138 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:01.110742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dba8b2-f712-4f75-ba11-d866123c6138 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:01.112370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dba8b2-f712-4f75-ba11-d866123c6138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:01.112669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e330e65-de77-4fe1-8069-99fd2ac7044a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:01.118394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58312e-d9c6-45f2-8ccb-9149d4101dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:01.119312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58312e-d9c6-45f2-8ccb-9149d4101dae admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:01.119312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58312e-d9c6-45f2-8ccb-9149d4101dae admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:01.119720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58312e-d9c6-45f2-8ccb-9149d4101dae admin admin] PATH_INFO: `/v3/projects/294616b4d0114a558978bcfb264c917c/users/a77f303235ce46cfaf59c49a88cc6312/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:01.123945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dba8b2-f712-4f75-ba11-d866123c6138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:01.125642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dba8b2-f712-4f75-ba11-d866123c6138 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:01.136928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58312e-d9c6-45f2-8ccb-9149d4101dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=294616b4d0114a558978bcfb264c917c, user_id=a77f303235ce46cfaf59c49a88cc6312, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:01.137773 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 885/1768] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:01.139788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dba8b2-f712-4f75-ba11-d866123c6138 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:01.149772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58312e-d9c6-45f2-8ccb-9149d4101dae admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:01.153809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dba8b2-f712-4f75-ba11-d866123c6138 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:01.159906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d8bce-bb82-4928-a7fd-9565f40e713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:01.160127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d8bce-bb82-4928-a7fd-9565f40e713e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:01.160327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d8bce-bb82-4928-a7fd-9565f40e713e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:01.160588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d8bce-bb82-4928-a7fd-9565f40e713e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:01.161320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d8bce-bb82-4928-a7fd-9565f40e713e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:01.163763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d8bce-bb82-4928-a7fd-9565f40e713e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:01.171987 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 884/1769] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:01 2022] PUT /identity/v3/projects/294616b4d0114a558978bcfb264c917c/users/a77f303235ce46cfaf59c49a88cc6312/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:01.173003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58312e-d9c6-45f2-8ccb-9149d4101dae admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:01.182819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5f58312e-d9c6-45f2-8ccb-9149d4101dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:01.205079 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 886/1770] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:01 2022] POST /identity/v3/users => generated 304 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:01.207669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66ec4d-70b4-4147-98ee-6f0044269299 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:01.208444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66ec4d-70b4-4147-98ee-6f0044269299 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:01.209194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66ec4d-70b4-4147-98ee-6f0044269299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:01.246918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9f66ec4d-70b4-4147-98ee-6f0044269299 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:01.248457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f66ec4d-70b4-4147-98ee-6f0044269299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:01.306338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58312e-d9c6-45f2-8ccb-9149d4101dae admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:01.312336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2153a-3fac-493e-863b-0f03ef6815b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:01.316107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2153a-3fac-493e-863b-0f03ef6815b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:01.317357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2153a-3fac-493e-863b-0f03ef6815b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:01.317995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2153a-3fac-493e-863b-0f03ef6815b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:01.319100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2153a-3fac-493e-863b-0f03ef6815b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:01.321482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2153a-3fac-493e-863b-0f03ef6815b9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:01.357911 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 887/1771] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:01.359613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4f39f-79fd-42e8-8fb9-88a213a477f2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:01.359885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4f39f-79fd-42e8-8fb9-88a213a477f2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:01.360157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4f39f-79fd-42e8-8fb9-88a213a477f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:01.382562 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 885/1772] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:01 2022] POST /identity/v3/projects => generated 391 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:01.384052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2153a-3fac-493e-863b-0f03ef6815b9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:01.395548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5fa4f39f-79fd-42e8-8fb9-88a213a477f2 None None] MFA Rules not processed for user `a77f303235ce46cfaf59c49a88cc6312`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:01.397120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5fa4f39f-79fd-42e8-8fb9-88a213a477f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:01.434222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:01.472206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2153a-3fac-493e-863b-0f03ef6815b9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:01.477327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278d221-8a6c-45a3-b2f4-a0abd151ee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:01.478140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278d221-8a6c-45a3-b2f4-a0abd151ee2c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:01.478424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278d221-8a6c-45a3-b2f4-a0abd151ee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:01.478698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278d221-8a6c-45a3-b2f4-a0abd151ee2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:01.479913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278d221-8a6c-45a3-b2f4-a0abd151ee2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:01.481252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278d221-8a6c-45a3-b2f4-a0abd151ee2c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:01.489141 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 888/1773] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:01.490385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4f39f-79fd-42e8-8fb9-88a213a477f2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:01.493720 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 886/1774] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:01.497837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278d221-8a6c-45a3-b2f4-a0abd151ee2c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:01.510653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4f39f-79fd-42e8-8fb9-88a213a477f2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:01.513378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278d221-8a6c-45a3-b2f4-a0abd151ee2c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:01.517450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb7668-4bd0-41ba-9c64-7bd212ef6e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:01.518854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb7668-4bd0-41ba-9c64-7bd212ef6e41 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:01.519215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb7668-4bd0-41ba-9c64-7bd212ef6e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:01.519592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb7668-4bd0-41ba-9c64-7bd212ef6e41 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:01.521509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb7668-4bd0-41ba-9c64-7bd212ef6e41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:01.521902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb7668-4bd0-41ba-9c64-7bd212ef6e41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:01.523678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb7668-4bd0-41ba-9c64-7bd212ef6e41 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:01.529705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bb986-61b4-4245-ba9a-0112665d73ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:01.530386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bb986-61b4-4245-ba9a-0112665d73ff admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:01.530648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bb986-61b4-4245-ba9a-0112665d73ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:01.531061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bb986-61b4-4245-ba9a-0112665d73ff admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:01.531816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bb986-61b4-4245-ba9a-0112665d73ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:01.534567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bb986-61b4-4245-ba9a-0112665d73ff admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:01.548272 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 889/1775] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:01.549864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb7668-4bd0-41ba-9c64-7bd212ef6e41 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:01.575605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb7668-4bd0-41ba-9c64-7bd212ef6e41 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:01.577377 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 887/1776] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:01 2022] POST /identity/v3/users => generated 302 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:01.578643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bb986-61b4-4245-ba9a-0112665d73ff admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:01.580775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0b294-8722-4a13-a18c-73cc1e95d592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:01.581493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0b294-8722-4a13-a18c-73cc1e95d592 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:01.581774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0b294-8722-4a13-a18c-73cc1e95d592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:01.582048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0b294-8722-4a13-a18c-73cc1e95d592 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:01.582695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0b294-8722-4a13-a18c-73cc1e95d592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:01.584712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0b294-8722-4a13-a18c-73cc1e95d592 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:01.595528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bb986-61b4-4245-ba9a-0112665d73ff admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:01.601681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20404bc-c790-4f45-923c-eca2dc451aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:01.602660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20404bc-c790-4f45-923c-eca2dc451aa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:01.603116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20404bc-c790-4f45-923c-eca2dc451aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:01.603888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20404bc-c790-4f45-923c-eca2dc451aa9 admin admin] PATH_INFO: `/v3/projects/a79a4315a95c46b291e9aa2249b48249/users/b10dc0ae957e47379c27ad3d9fffeb85/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:01.609478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:01.627030 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 890/1777] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:01 2022] POST /identity/v3/projects => generated 359 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:01.628274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0b294-8722-4a13-a18c-73cc1e95d592 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:01.654732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20404bc-c790-4f45-923c-eca2dc451aa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79a4315a95c46b291e9aa2249b48249, user_id=b10dc0ae957e47379c27ad3d9fffeb85, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:01.658833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20404bc-c790-4f45-923c-eca2dc451aa9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:01.691398 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 888/1778] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:01 2022] PUT /identity/v3/projects/a79a4315a95c46b291e9aa2249b48249/users/b10dc0ae957e47379c27ad3d9fffeb85/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:01.693362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20404bc-c790-4f45-923c-eca2dc451aa9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:01.757145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0b294-8722-4a13-a18c-73cc1e95d592 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:01.844477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20404bc-c790-4f45-923c-eca2dc451aa9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:01.850778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66636c8e-cfd9-4e21-bc8b-6c65d98286c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:01.851429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66636c8e-cfd9-4e21-bc8b-6c65d98286c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:01.851705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66636c8e-cfd9-4e21-bc8b-6c65d98286c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:01.852276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66636c8e-cfd9-4e21-bc8b-6c65d98286c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:01.852949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66636c8e-cfd9-4e21-bc8b-6c65d98286c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:01.855026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66636c8e-cfd9-4e21-bc8b-6c65d98286c3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:01.874676 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 889/1779] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:01.876364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66636c8e-cfd9-4e21-bc8b-6c65d98286c3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:01.889233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4a0fe-fafd-48c1-8bd1-3f045371be3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:01.889757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66636c8e-cfd9-4e21-bc8b-6c65d98286c3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:01.889899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4a0fe-fafd-48c1-8bd1-3f045371be3e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:01.890363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4a0fe-fafd-48c1-8bd1-3f045371be3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:01.890644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4a0fe-fafd-48c1-8bd1-3f045371be3e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:01.891333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4a0fe-fafd-48c1-8bd1-3f045371be3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:01.893942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4a0fe-fafd-48c1-8bd1-3f045371be3e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:01.901993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eca1ae-1f8d-4b8c-9790-3cefa4a45190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:01.902885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eca1ae-1f8d-4b8c-9790-3cefa4a45190 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:01.903417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eca1ae-1f8d-4b8c-9790-3cefa4a45190 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:01.903825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eca1ae-1f8d-4b8c-9790-3cefa4a45190 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:01.904661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eca1ae-1f8d-4b8c-9790-3cefa4a45190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:01.906847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eca1ae-1f8d-4b8c-9790-3cefa4a45190 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:01.957225 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 890/1780] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:01 2022] POST /identity/v3/users => generated 286 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:01.960371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eca1ae-1f8d-4b8c-9790-3cefa4a45190 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:01.977019 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 891/1781] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:01 2022] POST /identity/v3/projects => generated 389 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:01.977019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4a0fe-fafd-48c1-8bd1-3f045371be3e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:01.983796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eca1ae-1f8d-4b8c-9790-3cefa4a45190 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:02.021333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:02.056677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af20fe-a55a-4064-85da-886aff32bf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:02.057470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af20fe-a55a-4064-85da-886aff32bf53 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:02.057947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af20fe-a55a-4064-85da-886aff32bf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:02.058312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af20fe-a55a-4064-85da-886aff32bf53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:02.059064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af20fe-a55a-4064-85da-886aff32bf53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:02.064720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af20fe-a55a-4064-85da-886aff32bf53 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:02.070293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4a0fe-fafd-48c1-8bd1-3f045371be3e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:02.080344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dfb14-460c-4899-b9ef-caa00a46e6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:02.081464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dfb14-460c-4899-b9ef-caa00a46e6bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:02.089115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dfb14-460c-4899-b9ef-caa00a46e6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:02.089606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dfb14-460c-4899-b9ef-caa00a46e6bd admin admin] PATH_INFO: `/v3/projects/d8cf2ba6dfd54626ba0bc85d842ed3f0/users/acf9af344d5546ee9bd6787a5bbd460f/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:02.101812 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 891/1782] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:02.103506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af20fe-a55a-4064-85da-886aff32bf53 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:02.119879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3dfb14-460c-4899-b9ef-caa00a46e6bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8cf2ba6dfd54626ba0bc85d842ed3f0, user_id=acf9af344d5546ee9bd6787a5bbd460f, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:02.123395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3dfb14-460c-4899-b9ef-caa00a46e6bd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:02.123808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af20fe-a55a-4064-85da-886aff32bf53 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:02.131401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67e432-ebba-4132-b445-f546c538aa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:02.132585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67e432-ebba-4132-b445-f546c538aa92 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:02.133067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67e432-ebba-4132-b445-f546c538aa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:02.133596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67e432-ebba-4132-b445-f546c538aa92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:02.134593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67e432-ebba-4132-b445-f546c538aa92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:02.137495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67e432-ebba-4132-b445-f546c538aa92 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:02.146188 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 892/1783] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:01 2022] PUT /identity/v3/projects/d8cf2ba6dfd54626ba0bc85d842ed3f0/users/acf9af344d5546ee9bd6787a5bbd460f/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:02.146188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dfb14-460c-4899-b9ef-caa00a46e6bd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:02.155246 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 892/1784] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:02.160421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67e432-ebba-4132-b445-f546c538aa92 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:02.171770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67e432-ebba-4132-b445-f546c538aa92 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:02.225712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dfb14-460c-4899-b9ef-caa00a46e6bd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:02.228015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:02.236764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc6758-33f3-4933-8201-5e9d766e6471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:02.237790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc6758-33f3-4933-8201-5e9d766e6471 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:02.238081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc6758-33f3-4933-8201-5e9d766e6471 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:02.238367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc6758-33f3-4933-8201-5e9d766e6471 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:02.239016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc6758-33f3-4933-8201-5e9d766e6471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:02.241546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc6758-33f3-4933-8201-5e9d766e6471 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:02.278174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b698b53-e974-4940-baae-63872d445755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:02.278879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b698b53-e974-4940-baae-63872d445755 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:02.279158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b698b53-e974-4940-baae-63872d445755 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:02.281095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b698b53-e974-4940-baae-63872d445755 admin admin] PATH_INFO: `/v3/projects/a79a4315a95c46b291e9aa2249b48249/users/b10dc0ae957e47379c27ad3d9fffeb85/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:02.286368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b698b53-e974-4940-baae-63872d445755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79a4315a95c46b291e9aa2249b48249, user_id=b10dc0ae957e47379c27ad3d9fffeb85, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:02.291215 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 893/1785] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:02 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:02.291215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc6758-33f3-4933-8201-5e9d766e6471 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:02.292909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b698b53-e974-4940-baae-63872d445755 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:02.311535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc6758-33f3-4933-8201-5e9d766e6471 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:02.318518 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 893/1786] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:02 2022] PUT /identity/v3/projects/a79a4315a95c46b291e9aa2249b48249/users/b10dc0ae957e47379c27ad3d9fffeb85/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:02.319693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b698b53-e974-4940-baae-63872d445755 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:02.388590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1e5c8-36c4-4f02-a9ee-2d12e76827d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:02.389903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1e5c8-36c4-4f02-a9ee-2d12e76827d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:02.390183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1e5c8-36c4-4f02-a9ee-2d12e76827d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:02.390737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1e5c8-36c4-4f02-a9ee-2d12e76827d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:02.391318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1e5c8-36c4-4f02-a9ee-2d12e76827d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:02.393410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1e5c8-36c4-4f02-a9ee-2d12e76827d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:02.408519 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 894/1787] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:02.408519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1e5c8-36c4-4f02-a9ee-2d12e76827d1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:02.413692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b698b53-e974-4940-baae-63872d445755 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:02.426205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b063cd-505e-4918-9421-1034d0895024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:02.427021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b063cd-505e-4918-9421-1034d0895024 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:02.427336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b063cd-505e-4918-9421-1034d0895024 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:02.427616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b063cd-505e-4918-9421-1034d0895024 admin admin] PATH_INFO: `/v3/projects/f8ee0ee3bfc54a49a9f5320f76faf168/users/0aa0358cfba34de6ac95604595ce876d/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:02.428562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1e5c8-36c4-4f02-a9ee-2d12e76827d1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:02.434262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c34a39-6f9f-441b-ae57-16a98b7a163a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:02.436626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c34a39-6f9f-441b-ae57-16a98b7a163a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:02.438084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c34a39-6f9f-441b-ae57-16a98b7a163a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:02.438084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c34a39-6f9f-441b-ae57-16a98b7a163a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:02.438808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c34a39-6f9f-441b-ae57-16a98b7a163a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:02.441653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c34a39-6f9f-441b-ae57-16a98b7a163a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:02.457003 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 895/1788] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:02.458662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88449b35-1f9c-4f1d-b1fb-086b7df67db6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:02.459105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88449b35-1f9c-4f1d-b1fb-086b7df67db6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:02.459550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88449b35-1f9c-4f1d-b1fb-086b7df67db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:02.462886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b063cd-505e-4918-9421-1034d0895024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ee0ee3bfc54a49a9f5320f76faf168, user_id=0aa0358cfba34de6ac95604595ce876d, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:02.467904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b063cd-505e-4918-9421-1034d0895024 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:02.496861 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 894/1789] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:02 2022] PUT /identity/v3/projects/f8ee0ee3bfc54a49a9f5320f76faf168/users/0aa0358cfba34de6ac95604595ce876d/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:02.498608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aff60c-01f4-449b-b48e-05682535c7ff None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:02.499221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aff60c-01f4-449b-b48e-05682535c7ff None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:02.499659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aff60c-01f4-449b-b48e-05682535c7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:02.531945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:02.539696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-00aff60c-01f4-449b-b48e-05682535c7ff None None] MFA Rules not processed for user `b10dc0ae957e47379c27ad3d9fffeb85`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:02.541362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00aff60c-01f4-449b-b48e-05682535c7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:02.582773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-88449b35-1f9c-4f1d-b1fb-086b7df67db6 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:02.584069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-88449b35-1f9c-4f1d-b1fb-086b7df67db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:02.677241 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 896/1790] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:19:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:02.678108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88449b35-1f9c-4f1d-b1fb-086b7df67db6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:02.757075 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 895/1791] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:02 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:02.758956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aff60c-01f4-449b-b48e-05682535c7ff None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:02.767199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88449b35-1f9c-4f1d-b1fb-086b7df67db6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:02.773431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011eda8b-b467-4a8f-9f6d-5a2f6f303e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:02.774172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aff60c-01f4-449b-b48e-05682535c7ff None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:02.774328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011eda8b-b467-4a8f-9f6d-5a2f6f303e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:02.774646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011eda8b-b467-4a8f-9f6d-5a2f6f303e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:02.775159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011eda8b-b467-4a8f-9f6d-5a2f6f303e04 admin admin] PATH_INFO: `/v3/projects/d8cf2ba6dfd54626ba0bc85d842ed3f0/users/acf9af344d5546ee9bd6787a5bbd460f/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:02.778258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011eda8b-b467-4a8f-9f6d-5a2f6f303e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8cf2ba6dfd54626ba0bc85d842ed3f0, user_id=acf9af344d5546ee9bd6787a5bbd460f, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:02.781440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011eda8b-b467-4a8f-9f6d-5a2f6f303e04 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:02.785284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6820b37-5bec-452f-9e3c-4bf3b94875e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:02.786311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6820b37-5bec-452f-9e3c-4bf3b94875e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:02.786828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6820b37-5bec-452f-9e3c-4bf3b94875e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:02.787301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6820b37-5bec-452f-9e3c-4bf3b94875e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:02.789003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6820b37-5bec-452f-9e3c-4bf3b94875e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:02.792578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6820b37-5bec-452f-9e3c-4bf3b94875e1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:02.803383 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 897/1792] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:02 2022] PUT /identity/v3/projects/d8cf2ba6dfd54626ba0bc85d842ed3f0/users/acf9af344d5546ee9bd6787a5bbd460f/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:02.809944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011eda8b-b467-4a8f-9f6d-5a2f6f303e04 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:02.818658 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 896/1793] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:02.820909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6820b37-5bec-452f-9e3c-4bf3b94875e1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:02.841526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6820b37-5bec-452f-9e3c-4bf3b94875e1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:02.909099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:02.954622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa6f4f-8e70-44d7-a515-de0927e83f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:02.955341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa6f4f-8e70-44d7-a515-de0927e83f95 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:02.955341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa6f4f-8e70-44d7-a515-de0927e83f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:02.955696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa6f4f-8e70-44d7-a515-de0927e83f95 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:02.957271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa6f4f-8e70-44d7-a515-de0927e83f95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:02.958855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa6f4f-8e70-44d7-a515-de0927e83f95 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:02.985022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011eda8b-b467-4a8f-9f6d-5a2f6f303e04 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:03.000740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b213660-6010-4f46-b96c-e712d1fabca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:03.004100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213660-6010-4f46-b96c-e712d1fabca1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:03.005960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213660-6010-4f46-b96c-e712d1fabca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:03.006151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213660-6010-4f46-b96c-e712d1fabca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:03.006920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b213660-6010-4f46-b96c-e712d1fabca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:03.008739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b213660-6010-4f46-b96c-e712d1fabca1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:03.029142 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 897/1794] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:02 2022] POST /identity/v3/projects => generated 395 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:03.030372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2a02-2b3f-48da-a458-096f037f1f7e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:03.031348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2a02-2b3f-48da-a458-096f037f1f7e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:03.031348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2a02-2b3f-48da-a458-096f037f1f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:03.051782 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 898/1795] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:03.052837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b213660-6010-4f46-b96c-e712d1fabca1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:03.091500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b213660-6010-4f46-b96c-e712d1fabca1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:03.148575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-79ae2a02-2b3f-48da-a458-096f037f1f7e None None] MFA Rules not processed for user `acf9af344d5546ee9bd6787a5bbd460f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:03.150466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-79ae2a02-2b3f-48da-a458-096f037f1f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:03.179219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:03.242015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ba211-b787-478e-8de3-1d2e8bfcb871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:03.255934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ba211-b787-478e-8de3-1d2e8bfcb871 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:03.256347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ba211-b787-478e-8de3-1d2e8bfcb871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:03.256656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ba211-b787-478e-8de3-1d2e8bfcb871 admin admin] PATH_INFO: `/v3/projects/285065cde91d4adb80d52f0dbda6ad11/users/c2187dbb36d84ea7be564d69b10e6302/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:03.314417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ba211-b787-478e-8de3-1d2e8bfcb871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=285065cde91d4adb80d52f0dbda6ad11, user_id=c2187dbb36d84ea7be564d69b10e6302, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:03.320612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ba211-b787-478e-8de3-1d2e8bfcb871 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:03.330603 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 898/1796] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:03 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:03.331708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae2a02-2b3f-48da-a458-096f037f1f7e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:03.336479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-79ae2a02-2b3f-48da-a458-096f037f1f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:03.366965 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 899/1797] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:03 2022] PUT /identity/v3/projects/285065cde91d4adb80d52f0dbda6ad11/users/c2187dbb36d84ea7be564d69b10e6302/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:03.366965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ba211-b787-478e-8de3-1d2e8bfcb871 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:03.474076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ba211-b787-478e-8de3-1d2e8bfcb871 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:03.486156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a4668-7160-49ac-afea-4362b5e8b13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:03.486798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a4668-7160-49ac-afea-4362b5e8b13a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:03.487116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a4668-7160-49ac-afea-4362b5e8b13a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:03.487456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a4668-7160-49ac-afea-4362b5e8b13a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:03.488165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a4668-7160-49ac-afea-4362b5e8b13a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:03.490340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a4668-7160-49ac-afea-4362b5e8b13a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:03.532537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae2a02-2b3f-48da-a458-096f037f1f7e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:03.536761 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 900/1798] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:03 2022] POST /identity/v3/users => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:03.537929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a4668-7160-49ac-afea-4362b5e8b13a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:03.550076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a4668-7160-49ac-afea-4362b5e8b13a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:03.561773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c8966-dbb3-4d3c-863c-972b88a51b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:03.563055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8966-dbb3-4d3c-863c-972b88a51b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:03.563714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8966-dbb3-4d3c-863c-972b88a51b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:03.564556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8966-dbb3-4d3c-863c-972b88a51b43 admin admin] PATH_INFO: `/v3/projects/f8ee0ee3bfc54a49a9f5320f76faf168/users/0aa0358cfba34de6ac95604595ce876d/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:03.569197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c8966-dbb3-4d3c-863c-972b88a51b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ee0ee3bfc54a49a9f5320f76faf168, user_id=0aa0358cfba34de6ac95604595ce876d, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:03.575376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c8966-dbb3-4d3c-863c-972b88a51b43 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:03.599074 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 901/1799] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:03 2022] PUT /identity/v3/projects/f8ee0ee3bfc54a49a9f5320f76faf168/users/0aa0358cfba34de6ac95604595ce876d/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:03.600173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c8966-dbb3-4d3c-863c-972b88a51b43 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:03.609737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-573c8966-dbb3-4d3c-863c-972b88a51b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:03.622171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:03.709081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc312d3-0b81-4263-87ec-dba7dc08ab97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:03.710357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc312d3-0b81-4263-87ec-dba7dc08ab97 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:03.710850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc312d3-0b81-4263-87ec-dba7dc08ab97 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:03.711431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc312d3-0b81-4263-87ec-dba7dc08ab97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:03.810528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c8966-dbb3-4d3c-863c-972b88a51b43 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:03.826484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eead62-0ce7-4058-94ad-4065ba16a59d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:03.827161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eead62-0ce7-4058-94ad-4065ba16a59d service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:03.827509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eead62-0ce7-4058-94ad-4065ba16a59d service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:03.827811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eead62-0ce7-4058-94ad-4065ba16a59d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:03.854496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc312d3-0b81-4263-87ec-dba7dc08ab97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:03.858653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc312d3-0b81-4263-87ec-dba7dc08ab97 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:03.871189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:03.880950 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 899/1800] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:19:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:19:03.897852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d09ad6-bfa4-4937-b1b9-d269cc03a233 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:03.899194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d09ad6-bfa4-4937-b1b9-d269cc03a233 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:03.899706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d09ad6-bfa4-4937-b1b9-d269cc03a233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:03.980552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-36d09ad6-bfa4-4937-b1b9-d269cc03a233 None None] MFA Rules not processed for user `c2187dbb36d84ea7be564d69b10e6302`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:03.982149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-36d09ad6-bfa4-4937-b1b9-d269cc03a233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:03.992003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eead62-0ce7-4058-94ad-4065ba16a59d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:03.997074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eead62-0ce7-4058-94ad-4065ba16a59d service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:04.043087 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 902/1801] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:03 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:04.047321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eead62-0ce7-4058-94ad-4065ba16a59d service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:04.197546 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 900/1802] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:04.199913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b4705-ded9-41fe-b378-be89ad087d44 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:04.201527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b4705-ded9-41fe-b378-be89ad087d44 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:04.202005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b4705-ded9-41fe-b378-be89ad087d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:04.259226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f29b4705-ded9-41fe-b378-be89ad087d44 None None] MFA Rules not processed for user `0aa0358cfba34de6ac95604595ce876d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:04.262164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f29b4705-ded9-41fe-b378-be89ad087d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:04.342428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eead62-0ce7-4058-94ad-4065ba16a59d service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:04.368452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5dcd08-dee1-44ba-9366-c6b37d1ad54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:04.370564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dcd08-dee1-44ba-9366-c6b37d1ad54f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:04.370564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dcd08-dee1-44ba-9366-c6b37d1ad54f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:04.370783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dcd08-dee1-44ba-9366-c6b37d1ad54f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:04.371877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5dcd08-dee1-44ba-9366-c6b37d1ad54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:04.384834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5dcd08-dee1-44ba-9366-c6b37d1ad54f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:04.444136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:04.460321 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 903/1803] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:04.465373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5dcd08-dee1-44ba-9366-c6b37d1ad54f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:04.524185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5dcd08-dee1-44ba-9366-c6b37d1ad54f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:04.552797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf02268-7792-4557-9116-9335585e2683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:04.554160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf02268-7792-4557-9116-9335585e2683 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:04.555990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf02268-7792-4557-9116-9335585e2683 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:04.556751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf02268-7792-4557-9116-9335585e2683 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:04.560392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf02268-7792-4557-9116-9335585e2683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:04.561233 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 901/1804] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:04 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:04.564098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b4705-ded9-41fe-b378-be89ad087d44 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:04.570490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf02268-7792-4557-9116-9335585e2683 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:04.608599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b4705-ded9-41fe-b378-be89ad087d44 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:04.637342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b76e0-660e-47fc-a0e8-c1223215e937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:04.638484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b76e0-660e-47fc-a0e8-c1223215e937 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:04.638887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b76e0-660e-47fc-a0e8-c1223215e937 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:04.639968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b76e0-660e-47fc-a0e8-c1223215e937 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:04.641813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b76e0-660e-47fc-a0e8-c1223215e937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:04.648127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b76e0-660e-47fc-a0e8-c1223215e937 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:04.697910 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 902/1805] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:04.705118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b76e0-660e-47fc-a0e8-c1223215e937 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:04.765383 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 904/1806] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:04 2022] POST /identity/v3/projects => generated 389 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:04.770216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df600bc6-7dbc-4e63-9fdc-8f1845663130 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:04.785135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df600bc6-7dbc-4e63-9fdc-8f1845663130 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:04.786022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df600bc6-7dbc-4e63-9fdc-8f1845663130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:04.798417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b76e0-660e-47fc-a0e8-c1223215e937 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:04.949791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-df600bc6-7dbc-4e63-9fdc-8f1845663130 None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:04.953136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-df600bc6-7dbc-4e63-9fdc-8f1845663130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:05.103772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e002a-96bc-4f39-9cdd-46be6c730d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:05.104547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e002a-96bc-4f39-9cdd-46be6c730d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:05.104939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e002a-96bc-4f39-9cdd-46be6c730d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:05.105099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e002a-96bc-4f39-9cdd-46be6c730d90 admin admin] PATH_INFO: `/v3/projects/7fbdbd4329bb440e8f4e06fcbcc0e785/users/0c7a62a530404485b07b3a9f889ded62/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:05.120894 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 905/1807] 10.222.0.42 () {58 vars in 1015 bytes} [Sun Aug 28 18:19:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:05.123674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df600bc6-7dbc-4e63-9fdc-8f1845663130 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:05.169323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df600bc6-7dbc-4e63-9fdc-8f1845663130 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:05.177577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e002a-96bc-4f39-9cdd-46be6c730d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fbdbd4329bb440e8f4e06fcbcc0e785, user_id=0c7a62a530404485b07b3a9f889ded62, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:05.188045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e002a-96bc-4f39-9cdd-46be6c730d90 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:05.193069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26050dce-ef7c-493f-97be-9d186b2045f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:05.196776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26050dce-ef7c-493f-97be-9d186b2045f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:05.197025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26050dce-ef7c-493f-97be-9d186b2045f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:05.207350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26050dce-ef7c-493f-97be-9d186b2045f0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:05.208102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26050dce-ef7c-493f-97be-9d186b2045f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:05.210221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26050dce-ef7c-493f-97be-9d186b2045f0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:05.242837 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 903/1808] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:04 2022] PUT /identity/v3/projects/7fbdbd4329bb440e8f4e06fcbcc0e785/users/0c7a62a530404485b07b3a9f889ded62/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:05.251330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e002a-96bc-4f39-9cdd-46be6c730d90 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:05.254076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-992e002a-96bc-4f39-9cdd-46be6c730d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:05.267653 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 906/1809] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:05 2022] POST /identity/v3/users => generated 301 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:05.267653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26050dce-ef7c-493f-97be-9d186b2045f0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:05.291765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26050dce-ef7c-493f-97be-9d186b2045f0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:05.303903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:05.426658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e002a-96bc-4f39-9cdd-46be6c730d90 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:05.434926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2f968-a4e6-40e6-9c72-19aaa54a6309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:05.436089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2f968-a4e6-40e6-9c72-19aaa54a6309 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:05.436373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38199635-8ed5-4272-8c32-eeb001f41d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:05.436513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2f968-a4e6-40e6-9c72-19aaa54a6309 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:05.436788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2f968-a4e6-40e6-9c72-19aaa54a6309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:05.437676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38199635-8ed5-4272-8c32-eeb001f41d3c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:05.438273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38199635-8ed5-4272-8c32-eeb001f41d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:05.438786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38199635-8ed5-4272-8c32-eeb001f41d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:05.464216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38199635-8ed5-4272-8c32-eeb001f41d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:05.466230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38199635-8ed5-4272-8c32-eeb001f41d3c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:05.478676 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 907/1810] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:05.482163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38199635-8ed5-4272-8c32-eeb001f41d3c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:05.622337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:05.636519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2f968-a4e6-40e6-9c72-19aaa54a6309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:05.642872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2f968-a4e6-40e6-9c72-19aaa54a6309 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:05.662482 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 904/1811] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:05.665239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991790d0-77c3-42cb-b923-2893c3d99ca8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:05.665723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991790d0-77c3-42cb-b923-2893c3d99ca8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:05.666176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991790d0-77c3-42cb-b923-2893c3d99ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:05.703604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38199635-8ed5-4272-8c32-eeb001f41d3c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:05.717419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3650f5-d1eb-4e96-a3f8-224e06c79cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:05.720442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-991790d0-77c3-42cb-b923-2893c3d99ca8 None None] MFA Rules not processed for user `0c7a62a530404485b07b3a9f889ded62`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:05.721786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-991790d0-77c3-42cb-b923-2893c3d99ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:05.723446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3650f5-d1eb-4e96-a3f8-224e06c79cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:05.725148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3650f5-d1eb-4e96-a3f8-224e06c79cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:05.725626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3650f5-d1eb-4e96-a3f8-224e06c79cfc admin admin] PATH_INFO: `/v3/users/b48191da03874439900da27f001e0980` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:05.730516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3650f5-d1eb-4e96-a3f8-224e06c79cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48191da03874439900da27f001e0980)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:05.737084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3650f5-d1eb-4e96-a3f8-224e06c79cfc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:05.927874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2a3650f5-d1eb-4e96-a3f8-224e06c79cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48191da03874439900da27f001e0980'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:05.928731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2a3650f5-d1eb-4e96-a3f8-224e06c79cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48191da03874439900da27f001e0980'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:05.930155 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 905/1812] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:05 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:05.932132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991790d0-77c3-42cb-b923-2893c3d99ca8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:05.947046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2a3650f5-d1eb-4e96-a3f8-224e06c79cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48191da03874439900da27f001e0980'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:05.975809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2a3650f5-d1eb-4e96-a3f8-224e06c79cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48191da03874439900da27f001e0980'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:05.981837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991790d0-77c3-42cb-b923-2893c3d99ca8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:05.989448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a3172-455b-4cce-aa8c-bb77698c4ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:05.990115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a3172-455b-4cce-aa8c-bb77698c4ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:05.990409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a3172-455b-4cce-aa8c-bb77698c4ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:05.990685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a3172-455b-4cce-aa8c-bb77698c4ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:05.991488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a3172-455b-4cce-aa8c-bb77698c4ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:05.994018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a3172-455b-4cce-aa8c-bb77698c4ae3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:06.032649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2a3650f5-d1eb-4e96-a3f8-224e06c79cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48191da03874439900da27f001e0980'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:06.038634 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 906/1813] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:06.040156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a3172-455b-4cce-aa8c-bb77698c4ae3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:06.042416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-572a3172-455b-4cce-aa8c-bb77698c4ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:06.066241 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 908/1814] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:05 2022] DELETE /identity/v3/users/b48191da03874439900da27f001e0980 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:06.066241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3650f5-d1eb-4e96-a3f8-224e06c79cfc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:06.068106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2a3650f5-d1eb-4e96-a3f8-224e06c79cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:06.076923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a3172-455b-4cce-aa8c-bb77698c4ae3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:06.166375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:06.246805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3650f5-d1eb-4e96-a3f8-224e06c79cfc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:06.254180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b1ab6-82cd-4d83-9ab2-87d4bc2239fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:06.255169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b1ab6-82cd-4d83-9ab2-87d4bc2239fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:06.255643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b1ab6-82cd-4d83-9ab2-87d4bc2239fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:06.255985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b1ab6-82cd-4d83-9ab2-87d4bc2239fd admin admin] PATH_INFO: `/v3/projects/9c99d9920f7443e3ba5e1cf0ae4a3b11/users/d7e1941f3d244902b183b416fb44d5d0/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:06.278045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b1ab6-82cd-4d83-9ab2-87d4bc2239fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c99d9920f7443e3ba5e1cf0ae4a3b11, user_id=d7e1941f3d244902b183b416fb44d5d0, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:06.281631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b1ab6-82cd-4d83-9ab2-87d4bc2239fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:06.314745 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 909/1815] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:06 2022] PUT /identity/v3/projects/9c99d9920f7443e3ba5e1cf0ae4a3b11/users/d7e1941f3d244902b183b416fb44d5d0/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:06.318306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0d8b1-6237-4d61-a4cb-a5fbeeb11430 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:06.318306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0d8b1-6237-4d61-a4cb-a5fbeeb11430 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:06.318306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0d8b1-6237-4d61-a4cb-a5fbeeb11430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:06.319754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb3207-59b7-4fa6-a43a-f57dfa51edb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:06.320642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb3207-59b7-4fa6-a43a-f57dfa51edb8 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:06.321032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb3207-59b7-4fa6-a43a-f57dfa51edb8 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:06.321434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb3207-59b7-4fa6-a43a-f57dfa51edb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:06.324665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eaeb3207-59b7-4fa6-a43a-f57dfa51edb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:06.367871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6ad0d8b1-6237-4d61-a4cb-a5fbeeb11430 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:06.371522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6ad0d8b1-6237-4d61-a4cb-a5fbeeb11430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:06.533802 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 910/1816] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:06.533802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0d8b1-6237-4d61-a4cb-a5fbeeb11430 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:06.559893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0d8b1-6237-4d61-a4cb-a5fbeeb11430 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:06.572426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5768cf4-14c0-4796-9d7a-15f1461939b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:06.573207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5768cf4-14c0-4796-9d7a-15f1461939b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:06.573973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5768cf4-14c0-4796-9d7a-15f1461939b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:06.573973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5768cf4-14c0-4796-9d7a-15f1461939b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:06.574623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5768cf4-14c0-4796-9d7a-15f1461939b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:06.576788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5768cf4-14c0-4796-9d7a-15f1461939b8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:06.579235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb3207-59b7-4fa6-a43a-f57dfa51edb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:06.582535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb3207-59b7-4fa6-a43a-f57dfa51edb8 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:06.606077 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 911/1817] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:06.606077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5768cf4-14c0-4796-9d7a-15f1461939b8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:06.609905 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 907/1818] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:06 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:06.611521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e5768cf4-14c0-4796-9d7a-15f1461939b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:06.612497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb3207-59b7-4fa6-a43a-f57dfa51edb8 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:06.625298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:06.633004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb3207-59b7-4fa6-a43a-f57dfa51edb8 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:06.641642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9110f25-5914-4a66-b6a9-2630c519731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:06.643676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110f25-5914-4a66-b6a9-2630c519731b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:06.643676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110f25-5914-4a66-b6a9-2630c519731b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:06.644103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110f25-5914-4a66-b6a9-2630c519731b admin admin] PATH_INFO: `/v3/projects/9c99d9920f7443e3ba5e1cf0ae4a3b11/users/d7e1941f3d244902b183b416fb44d5d0/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:06.654597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9110f25-5914-4a66-b6a9-2630c519731b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c99d9920f7443e3ba5e1cf0ae4a3b11, user_id=d7e1941f3d244902b183b416fb44d5d0, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:06.659704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9110f25-5914-4a66-b6a9-2630c519731b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:06.709255 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 908/1819] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:06 2022] PUT /identity/v3/projects/9c99d9920f7443e3ba5e1cf0ae4a3b11/users/d7e1941f3d244902b183b416fb44d5d0/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:06.724794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd88a9-1e7c-4787-93a3-a81cd67e33c9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:06.725105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd88a9-1e7c-4787-93a3-a81cd67e33c9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:06.725482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd88a9-1e7c-4787-93a3-a81cd67e33c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:06.795004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-09dd88a9-1e7c-4787-93a3-a81cd67e33c9 None None] MFA Rules not processed for user `d7e1941f3d244902b183b416fb44d5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:06.796517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-09dd88a9-1e7c-4787-93a3-a81cd67e33c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:06.802335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5768cf4-14c0-4796-9d7a-15f1461939b8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:06.929562 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 909/1820] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:06 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:19:06.943765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0593c80-6ba8-40d6-bc7b-f91ccf6c88aa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:06.947480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0593c80-6ba8-40d6-bc7b-f91ccf6c88aa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:06.948226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0593c80-6ba8-40d6-bc7b-f91ccf6c88aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:06.971646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa47180-c2b2-4ebf-bceb-e38e8488da6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:06.972503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa47180-c2b2-4ebf-bceb-e38e8488da6f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:06.974830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa47180-c2b2-4ebf-bceb-e38e8488da6f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:06.975291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa47180-c2b2-4ebf-bceb-e38e8488da6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:07.008225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:07.014491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e0593c80-6ba8-40d6-bc7b-f91ccf6c88aa None None] MFA Rules not processed for user `c2187dbb36d84ea7be564d69b10e6302`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:07.015765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e0593c80-6ba8-40d6-bc7b-f91ccf6c88aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:07.157965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa47180-c2b2-4ebf-bceb-e38e8488da6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:07.161318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa47180-c2b2-4ebf-bceb-e38e8488da6f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:07.185655 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 910/1821] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:19:07.192491 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 912/1822] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:07.220650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083594-cbc8-49b4-bd08-d84360598b62 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:07.221195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083594-cbc8-49b4-bd08-d84360598b62 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:07.221839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083594-cbc8-49b4-bd08-d84360598b62 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:07.224937 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 911/1823] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:19:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:19:07.244516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa47180-c2b2-4ebf-bceb-e38e8488da6f service neutron] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:19:07.246778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ffa47180-c2b2-4ebf-bceb-e38e8488da6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:07.358433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df083594-cbc8-49b4-bd08-d84360598b62 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:07.519274 n-d-850468-20 devstack@keystone.service[82161]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-ffa47180-c2b2-4ebf-bceb-e38e8488da6f service neutron] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 28 18:19:07.520749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa47180-c2b2-4ebf-bceb-e38e8488da6f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:07.614389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df083594-cbc8-49b4-bd08-d84360598b62 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:07.653203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892212b-ac0f-4aa9-aad0-e793da859a04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:07.654146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892212b-ac0f-4aa9-aad0-e793da859a04 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:07.654561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892212b-ac0f-4aa9-aad0-e793da859a04 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:07.654986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892212b-ac0f-4aa9-aad0-e793da859a04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:07.658634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6892212b-ac0f-4aa9-aad0-e793da859a04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:07.690264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa47180-c2b2-4ebf-bceb-e38e8488da6f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:07.690535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892212b-ac0f-4aa9-aad0-e793da859a04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:07.692269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892212b-ac0f-4aa9-aad0-e793da859a04 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:07.699430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd974394-f087-43b0-b97c-5279f10acd8c tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10dc0ae957e47379c27ad3d9fffeb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a79a4315a95c46b291e9aa2249b48249', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:07.701042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd974394-f087-43b0-b97c-5279f10acd8c tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:07.701682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd974394-f087-43b0-b97c-5279f10acd8c tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:07.702386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd974394-f087-43b0-b97c-5279f10acd8c tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] PATH_INFO: `/v3/projects/93898211fcfe463eabea994e6b14efd4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:07.707986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd974394-f087-43b0-b97c-5279f10acd8c tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: Authorizing `identity:get_project(project_id=93898211fcfe463eabea994e6b14efd4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:07.714634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd974394-f087-43b0-b97c-5279f10acd8c tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:07.729733 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 912/1824] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:19:07.731714 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 913/1825] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:19:07 2022] GET /identity/v3/projects/93898211fcfe463eabea994e6b14efd4 => generated 393 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:08.320351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892212b-ac0f-4aa9-aad0-e793da859a04 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:08.322013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6892212b-ac0f-4aa9-aad0-e793da859a04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:08.350868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892212b-ac0f-4aa9-aad0-e793da859a04 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:08.361997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306b569-2783-43b3-ba32-41df38561508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:08.362704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306b569-2783-43b3-ba32-41df38561508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:08.362923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306b569-2783-43b3-ba32-41df38561508 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:08.363365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306b569-2783-43b3-ba32-41df38561508 admin admin] PATH_INFO: `/v3/users/a77f303235ce46cfaf59c49a88cc6312` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:08.366947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306b569-2783-43b3-ba32-41df38561508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a77f303235ce46cfaf59c49a88cc6312)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:08.369434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd86269-a9f6-4d02-b85e-2871167238f6 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:08.370006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306b569-2783-43b3-ba32-41df38561508 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:08.370630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd86269-a9f6-4d02-b85e-2871167238f6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:08.371287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd86269-a9f6-4d02-b85e-2871167238f6 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:08.374999 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 914/1826] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:19:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:19:08.376191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:08.381848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd86269-a9f6-4d02-b85e-2871167238f6 None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:19:08.481514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd86269-a9f6-4d02-b85e-2871167238f6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:08.502576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a306b569-2783-43b3-ba32-41df38561508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a77f303235ce46cfaf59c49a88cc6312'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:08.546318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a306b569-2783-43b3-ba32-41df38561508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a77f303235ce46cfaf59c49a88cc6312'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:08.549322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a306b569-2783-43b3-ba32-41df38561508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a77f303235ce46cfaf59c49a88cc6312'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:08.550883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a306b569-2783-43b3-ba32-41df38561508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a77f303235ce46cfaf59c49a88cc6312'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:08.557525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd86269-a9f6-4d02-b85e-2871167238f6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:08.578723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a306b569-2783-43b3-ba32-41df38561508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a77f303235ce46cfaf59c49a88cc6312'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:08.581507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2098927-6600-45f4-ba83-8153d76ef1f1 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10dc0ae957e47379c27ad3d9fffeb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a79a4315a95c46b291e9aa2249b48249', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:08.584565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2098927-6600-45f4-ba83-8153d76ef1f1 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:08.585180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2098927-6600-45f4-ba83-8153d76ef1f1 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:08.585626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2098927-6600-45f4-ba83-8153d76ef1f1 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] PATH_INFO: `/v3/projects/93898211fcfe463eabea994e6b14efd4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:08.595383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2098927-6600-45f4-ba83-8153d76ef1f1 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: Authorizing `identity:get_project(project_id=93898211fcfe463eabea994e6b14efd4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:08.620643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2098927-6600-45f4-ba83-8153d76ef1f1 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:08.625010 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 913/1827] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:08 2022] DELETE /identity/v3/users/a77f303235ce46cfaf59c49a88cc6312 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:08.627204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673b8ab-75aa-4b7a-beef-65b419321c39 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:08.627517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673b8ab-75aa-4b7a-beef-65b419321c39 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:08.627954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673b8ab-75aa-4b7a-beef-65b419321c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:08.649478 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 915/1828] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:19:08 2022] GET /identity/v3/projects/93898211fcfe463eabea994e6b14efd4 => generated 393 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:19:08.680803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d673b8ab-75aa-4b7a-beef-65b419321c39 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:08.682151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d673b8ab-75aa-4b7a-beef-65b419321c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:08.851341 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 914/1829] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:08.929392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b9526-cd41-4a9e-8261-07f38b43752e None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:08.929677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b9526-cd41-4a9e-8261-07f38b43752e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:08.929961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b9526-cd41-4a9e-8261-07f38b43752e None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:08.931973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673b8ab-75aa-4b7a-beef-65b419321c39 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:08.932205 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 916/1830] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 18:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:19:08.934236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d673b8ab-75aa-4b7a-beef-65b419321c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:08.964160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a442806-b637-4d08-97f8-6a1f0acf426a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:08.964550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a442806-b637-4d08-97f8-6a1f0acf426a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:08.965140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a442806-b637-4d08-97f8-6a1f0acf426a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:09.039374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7a442806-b637-4d08-97f8-6a1f0acf426a None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:09.041350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a442806-b637-4d08-97f8-6a1f0acf426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:09.120069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673b8ab-75aa-4b7a-beef-65b419321c39 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:09.148924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f76be-2c41-4f2a-a4b1-5b9261369e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:09.149808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f76be-2c41-4f2a-a4b1-5b9261369e1b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:09.150278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f76be-2c41-4f2a-a4b1-5b9261369e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:09.150679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f76be-2c41-4f2a-a4b1-5b9261369e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:09.182404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f76be-2c41-4f2a-a4b1-5b9261369e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:09.187072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f76be-2c41-4f2a-a4b1-5b9261369e1b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:09.204053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:09.216274 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 915/1831] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:09.218259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30939d63-89d7-48ac-8527-2d9817211100 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:09.218765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30939d63-89d7-48ac-8527-2d9817211100 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:09.219217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30939d63-89d7-48ac-8527-2d9817211100 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:09.236818 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 916/1832] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:19:09 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:19:09.238201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30939d63-89d7-48ac-8527-2d9817211100 None None] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:19:09.252946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-30939d63-89d7-48ac-8527-2d9817211100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:09.287854 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 917/1833] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 18:19:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:09.335944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:09.365578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a442806-b637-4d08-97f8-6a1f0acf426a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:09.370131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a442806-b637-4d08-97f8-6a1f0acf426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:09.420814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a442806-b637-4d08-97f8-6a1f0acf426a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:09.443151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66137f04-3635-4fff-9da9-79da4f6a78f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:09.446568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66137f04-3635-4fff-9da9-79da4f6a78f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:09.448771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66137f04-3635-4fff-9da9-79da4f6a78f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:09.449897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66137f04-3635-4fff-9da9-79da4f6a78f1 admin admin] PATH_INFO: `/v3/projects/d51f0bfa0be24385bec3ad605cbdabfa` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:09.455923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66137f04-3635-4fff-9da9-79da4f6a78f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51f0bfa0be24385bec3ad605cbdabfa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:09.460026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66137f04-3635-4fff-9da9-79da4f6a78f1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:09.563074 n-d-850468-20 devstack@keystone.service[82160]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-30939d63-89d7-48ac-8527-2d9817211100 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 28 18:19:09.563541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30939d63-89d7-48ac-8527-2d9817211100 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:09.564743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-30939d63-89d7-48ac-8527-2d9817211100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:09.659103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66137f04-3635-4fff-9da9-79da4f6a78f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51f0bfa0be24385bec3ad605cbdabfa', 'request_id': 'req-66137f04-3635-4fff-9da9-79da4f6a78f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:09.678535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66137f04-3635-4fff-9da9-79da4f6a78f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51f0bfa0be24385bec3ad605cbdabfa', 'request_id': 'req-66137f04-3635-4fff-9da9-79da4f6a78f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:09.703702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66137f04-3635-4fff-9da9-79da4f6a78f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51f0bfa0be24385bec3ad605cbdabfa', 'request_id': 'req-66137f04-3635-4fff-9da9-79da4f6a78f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:09.737098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30939d63-89d7-48ac-8527-2d9817211100 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:09.743774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66137f04-3635-4fff-9da9-79da4f6a78f1 admin admin] The token cache is being invalidate because project d51f0bfa0be24385bec3ad605cbdabfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:09.744268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66137f04-3635-4fff-9da9-79da4f6a78f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:09.750278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66137f04-3635-4fff-9da9-79da4f6a78f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:09.769153 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 918/1834] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:09 2022] DELETE /identity/v3/projects/d51f0bfa0be24385bec3ad605cbdabfa => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:09.774529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66137f04-3635-4fff-9da9-79da4f6a78f1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:09.779101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-66137f04-3635-4fff-9da9-79da4f6a78f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:09.932457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46c4e6-bef5-475c-9a10-24716583415e tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10dc0ae957e47379c27ad3d9fffeb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a79a4315a95c46b291e9aa2249b48249', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:09.939100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46c4e6-bef5-475c-9a10-24716583415e tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:09.939626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46c4e6-bef5-475c-9a10-24716583415e tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:09.940104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46c4e6-bef5-475c-9a10-24716583415e tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] PATH_INFO: `/v3/projects/93898211fcfe463eabea994e6b14efd4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:09.942499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46c4e6-bef5-475c-9a10-24716583415e tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: Authorizing `identity:get_project(project_id=93898211fcfe463eabea994e6b14efd4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:09.947998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46c4e6-bef5-475c-9a10-24716583415e tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:09.953590 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 917/1835] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:19:09 2022] GET /identity/v3/projects/93898211fcfe463eabea994e6b14efd4 => generated 393 bytes in 716 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:09.989171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66137f04-3635-4fff-9da9-79da4f6a78f1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:10.010399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdf188-f124-433a-829e-f09c94aa5f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:10.013563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdf188-f124-433a-829e-f09c94aa5f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:10.016972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdf188-f124-433a-829e-f09c94aa5f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:10.018699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdf188-f124-433a-829e-f09c94aa5f79 admin admin] PATH_INFO: `/v3/users/acf9af344d5546ee9bd6787a5bbd460f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:10.020773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efdf188-f124-433a-829e-f09c94aa5f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf9af344d5546ee9bd6787a5bbd460f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:10.025688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efdf188-f124-433a-829e-f09c94aa5f79 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:10.029621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46c4e6-bef5-475c-9a10-24716583415e tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:10.031749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ba46c4e6-bef5-475c-9a10-24716583415e tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:10.257868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6efdf188-f124-433a-829e-f09c94aa5f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf9af344d5546ee9bd6787a5bbd460f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:10.260532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6efdf188-f124-433a-829e-f09c94aa5f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf9af344d5546ee9bd6787a5bbd460f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:10.315896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:10.318947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6efdf188-f124-433a-829e-f09c94aa5f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf9af344d5546ee9bd6787a5bbd460f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:10.335181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:10.353935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46c4e6-bef5-475c-9a10-24716583415e tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:10.369243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6efdf188-f124-433a-829e-f09c94aa5f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf9af344d5546ee9bd6787a5bbd460f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:10.374901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfe30a-7092-42c0-9893-23b66d195f0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:10.377142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfe30a-7092-42c0-9893-23b66d195f0a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:10.377551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfe30a-7092-42c0-9893-23b66d195f0a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:10.377946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfe30a-7092-42c0-9893-23b66d195f0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:10.383938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-28cfe30a-7092-42c0-9893-23b66d195f0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:10.407656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6efdf188-f124-433a-829e-f09c94aa5f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf9af344d5546ee9bd6787a5bbd460f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:10.425162 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 919/1836] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:09 2022] DELETE /identity/v3/users/acf9af344d5546ee9bd6787a5bbd460f => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:10.444284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfe30a-7092-42c0-9893-23b66d195f0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:10.448215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfe30a-7092-42c0-9893-23b66d195f0a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:10.519883 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 918/1837] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:10.588066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdf188-f124-433a-829e-f09c94aa5f79 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:10.609204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6efdf188-f124-433a-829e-f09c94aa5f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:10.912595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdf188-f124-433a-829e-f09c94aa5f79 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:10.924527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700851a8-7aaa-493a-96b4-38d3bdc04e52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:10.925526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700851a8-7aaa-493a-96b4-38d3bdc04e52 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:10.925950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700851a8-7aaa-493a-96b4-38d3bdc04e52 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:10.926330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700851a8-7aaa-493a-96b4-38d3bdc04e52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:10.928759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-700851a8-7aaa-493a-96b4-38d3bdc04e52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:11.111326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700851a8-7aaa-493a-96b4-38d3bdc04e52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:11.112991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700851a8-7aaa-493a-96b4-38d3bdc04e52 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:11.157016 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 920/1838] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:10 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:11.393321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51a407-67ff-4bcf-b25a-6fb48d9dd9d6 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:11.394278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51a407-67ff-4bcf-b25a-6fb48d9dd9d6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:11.394721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51a407-67ff-4bcf-b25a-6fb48d9dd9d6 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:11.396743 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 919/1839] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:19:11.404031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700851a8-7aaa-493a-96b4-38d3bdc04e52 service nova] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:19:11.418639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700851a8-7aaa-493a-96b4-38d3bdc04e52 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:11.422034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-700851a8-7aaa-493a-96b4-38d3bdc04e52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:11.530711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700851a8-7aaa-493a-96b4-38d3bdc04e52 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:11.554402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04175b50-e2a5-44a7-8581-0834fca8a601 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10dc0ae957e47379c27ad3d9fffeb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a79a4315a95c46b291e9aa2249b48249', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:11.555845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04175b50-e2a5-44a7-8581-0834fca8a601 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:11.555845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04175b50-e2a5-44a7-8581-0834fca8a601 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:11.556477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04175b50-e2a5-44a7-8581-0834fca8a601 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] PATH_INFO: `/v3/projects/93898211fcfe463eabea994e6b14efd4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:11.558154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04175b50-e2a5-44a7-8581-0834fca8a601 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: Authorizing `identity:get_project(project_id=93898211fcfe463eabea994e6b14efd4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:11.561252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04175b50-e2a5-44a7-8581-0834fca8a601 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:11.569228 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 921/1840] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:19:11 2022] GET /identity/v3/projects/93898211fcfe463eabea994e6b14efd4 => generated 393 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:19:11.678442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443a1e5-a48a-44b9-bb22-3697dafc3b17 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:11.679400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443a1e5-a48a-44b9-bb22-3697dafc3b17 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:11.680098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443a1e5-a48a-44b9-bb22-3697dafc3b17 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:11.682884 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 920/1841] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:19:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:19:11.689161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04175b50-e2a5-44a7-8581-0834fca8a601 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:19:11.715727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04175b50-e2a5-44a7-8581-0834fca8a601 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:11.721398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:11.730018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04175b50-e2a5-44a7-8581-0834fca8a601 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:11.752795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2898e51-bf9c-419b-a57e-083b558aa0b4 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10dc0ae957e47379c27ad3d9fffeb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a79a4315a95c46b291e9aa2249b48249', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:11.753757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2898e51-bf9c-419b-a57e-083b558aa0b4 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:11.754159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2898e51-bf9c-419b-a57e-083b558aa0b4 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:11.754645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2898e51-bf9c-419b-a57e-083b558aa0b4 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] PATH_INFO: `/v3/projects/93898211fcfe463eabea994e6b14efd4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:11.756635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2898e51-bf9c-419b-a57e-083b558aa0b4 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: Authorizing `identity:get_project(project_id=93898211fcfe463eabea994e6b14efd4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:11.761148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2898e51-bf9c-419b-a57e-083b558aa0b4 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:11.763402 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 922/1842] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:19:11 2022] GET /identity/v3/projects/93898211fcfe463eabea994e6b14efd4 => generated 393 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:11.903385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443a1e5-a48a-44b9-bb22-3697dafc3b17 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:11.906484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f443a1e5-a48a-44b9-bb22-3697dafc3b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:12.126719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443a1e5-a48a-44b9-bb22-3697dafc3b17 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:12.137764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af363-ffff-4c1a-8d95-f6c2d6a24237 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:12.137764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af363-ffff-4c1a-8d95-f6c2d6a24237 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:12.138163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af363-ffff-4c1a-8d95-f6c2d6a24237 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:12.141810 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 923/1843] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:19:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:19:12.147557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee8612-5ade-48a5-8d81-17734294042e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:12.148250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee8612-5ade-48a5-8d81-17734294042e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:12.148531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee8612-5ade-48a5-8d81-17734294042e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:12.148810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee8612-5ade-48a5-8d81-17734294042e admin admin] PATH_INFO: `/v3/projects/294616b4d0114a558978bcfb264c917c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:12.154057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee8612-5ade-48a5-8d81-17734294042e admin admin] RBAC: Authorizing `identity:delete_project(project_id=294616b4d0114a558978bcfb264c917c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:12.155280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926af363-ffff-4c1a-8d95-f6c2d6a24237 None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:19:12.173386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee8612-5ade-48a5-8d81-17734294042e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:12.186171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926af363-ffff-4c1a-8d95-f6c2d6a24237 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:12.233280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926af363-ffff-4c1a-8d95-f6c2d6a24237 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:12.267805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463407d6-278c-4a60-87b8-f414e4d79433 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b10dc0ae957e47379c27ad3d9fffeb85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a79a4315a95c46b291e9aa2249b48249', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:12.268491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463407d6-278c-4a60-87b8-f414e4d79433 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:12.268777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463407d6-278c-4a60-87b8-f414e4d79433 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:12.269060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463407d6-278c-4a60-87b8-f414e4d79433 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] PATH_INFO: `/v3/projects/7fbdbd4329bb440e8f4e06fcbcc0e785` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:12.277997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463407d6-278c-4a60-87b8-f414e4d79433 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: Authorizing `identity:get_project(project_id=7fbdbd4329bb440e8f4e06fcbcc0e785)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:12.280428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463407d6-278c-4a60-87b8-f414e4d79433 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:12.282311 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 924/1844] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:19:12 2022] GET /identity/v3/projects/7fbdbd4329bb440e8f4e06fcbcc0e785 => generated 395 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:12.425234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-65ee8612-5ade-48a5-8d81-17734294042e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294616b4d0114a558978bcfb264c917c', 'request_id': 'req-65ee8612-5ade-48a5-8d81-17734294042e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:12.452188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-65ee8612-5ade-48a5-8d81-17734294042e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294616b4d0114a558978bcfb264c917c', 'request_id': 'req-65ee8612-5ade-48a5-8d81-17734294042e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:12.478509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-65ee8612-5ade-48a5-8d81-17734294042e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294616b4d0114a558978bcfb264c917c', 'request_id': 'req-65ee8612-5ade-48a5-8d81-17734294042e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:12.534187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-65ee8612-5ade-48a5-8d81-17734294042e admin admin] The token cache is being invalidate because project 294616b4d0114a558978bcfb264c917c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:12.534655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-65ee8612-5ade-48a5-8d81-17734294042e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:12.535668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-65ee8612-5ade-48a5-8d81-17734294042e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:12.547541 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 921/1845] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:11 2022] DELETE /identity/v3/projects/294616b4d0114a558978bcfb264c917c => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:12.549370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463407d6-278c-4a60-87b8-f414e4d79433 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:12.552816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-463407d6-278c-4a60-87b8-f414e4d79433 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:12.612386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463407d6-278c-4a60-87b8-f414e4d79433 tempest-FlavorsAccessNegativeTestJSON-2060015804 tempest-FlavorsAccessNegativeTestJSON-2060015804-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:12.723711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee8612-5ade-48a5-8d81-17734294042e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:12.725481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-65ee8612-5ade-48a5-8d81-17734294042e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:12.877644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff45bf-90e9-4b68-9a82-031f2660b8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:12.878830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff45bf-90e9-4b68-9a82-031f2660b8f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:12.879339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff45bf-90e9-4b68-9a82-031f2660b8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:12.880039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff45bf-90e9-4b68-9a82-031f2660b8f8 admin admin] PATH_INFO: `/v3/users/0aa0358cfba34de6ac95604595ce876d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:12.882062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff45bf-90e9-4b68-9a82-031f2660b8f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa0358cfba34de6ac95604595ce876d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:12.885667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff45bf-90e9-4b68-9a82-031f2660b8f8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:12.967029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee8612-5ade-48a5-8d81-17734294042e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:12.982537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fff45bf-90e9-4b68-9a82-031f2660b8f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa0358cfba34de6ac95604595ce876d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:12.984297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fff45bf-90e9-4b68-9a82-031f2660b8f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa0358cfba34de6ac95604595ce876d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:12.988704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba645fa1-960c-4ee6-93e0-1ba96def41b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:12.989532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645fa1-960c-4ee6-93e0-1ba96def41b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:12.989684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645fa1-960c-4ee6-93e0-1ba96def41b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:12.989950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645fa1-960c-4ee6-93e0-1ba96def41b4 admin admin] PATH_INFO: `/v3/users/10daf35a911041458fbf4c281a9ebc56` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:12.997844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba645fa1-960c-4ee6-93e0-1ba96def41b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10daf35a911041458fbf4c281a9ebc56)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:13.000439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba645fa1-960c-4ee6-93e0-1ba96def41b4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:13.068196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fff45bf-90e9-4b68-9a82-031f2660b8f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa0358cfba34de6ac95604595ce876d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:13.090665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:13.098234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fff45bf-90e9-4b68-9a82-031f2660b8f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa0358cfba34de6ac95604595ce876d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:13.127617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fff45bf-90e9-4b68-9a82-031f2660b8f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa0358cfba34de6ac95604595ce876d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:13.145473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ba645fa1-960c-4ee6-93e0-1ba96def41b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10daf35a911041458fbf4c281a9ebc56'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:13.163373 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 925/1846] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:12 2022] DELETE /identity/v3/users/0aa0358cfba34de6ac95604595ce876d => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:13.169773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ba645fa1-960c-4ee6-93e0-1ba96def41b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10daf35a911041458fbf4c281a9ebc56'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:13.170696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ba645fa1-960c-4ee6-93e0-1ba96def41b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10daf35a911041458fbf4c281a9ebc56'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:13.172131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff45bf-90e9-4b68-9a82-031f2660b8f8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:13.172299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ba645fa1-960c-4ee6-93e0-1ba96def41b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10daf35a911041458fbf4c281a9ebc56'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:13.174414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6fff45bf-90e9-4b68-9a82-031f2660b8f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:13.193148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ba645fa1-960c-4ee6-93e0-1ba96def41b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10daf35a911041458fbf4c281a9ebc56'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:13.228044 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 922/1847] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:12 2022] DELETE /identity/v3/users/10daf35a911041458fbf4c281a9ebc56 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:19:13.230010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a033cf-4611-4693-8e94-ca264017dc27 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:13.231850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a033cf-4611-4693-8e94-ca264017dc27 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:13.232149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a033cf-4611-4693-8e94-ca264017dc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:13.278491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d6a033cf-4611-4693-8e94-ca264017dc27 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:13.279865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d6a033cf-4611-4693-8e94-ca264017dc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:13.387407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff45bf-90e9-4b68-9a82-031f2660b8f8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:13.418065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:13.500598 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 923/1848] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:19:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:13.504162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c411925-24a1-4b95-9b7f-9be1bf0d9607 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:13.504591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c411925-24a1-4b95-9b7f-9be1bf0d9607 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:13.504965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c411925-24a1-4b95-9b7f-9be1bf0d9607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:13.592757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6c411925-24a1-4b95-9b7f-9be1bf0d9607 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:13.595976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f71e3-d124-4f8b-8087-35e23855749c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:13.596912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c411925-24a1-4b95-9b7f-9be1bf0d9607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:13.597038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f71e3-d124-4f8b-8087-35e23855749c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:13.597403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f71e3-d124-4f8b-8087-35e23855749c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:13.597512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f71e3-d124-4f8b-8087-35e23855749c admin admin] PATH_INFO: `/v3/projects/d8cf2ba6dfd54626ba0bc85d842ed3f0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:13.604599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f71e3-d124-4f8b-8087-35e23855749c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8cf2ba6dfd54626ba0bc85d842ed3f0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:13.606872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f71e3-d124-4f8b-8087-35e23855749c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:13.623113 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 924/1849] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:13.635104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c411925-24a1-4b95-9b7f-9be1bf0d9607 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:13.642299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c411925-24a1-4b95-9b7f-9be1bf0d9607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:13.802694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c6f71e3-d124-4f8b-8087-35e23855749c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8cf2ba6dfd54626ba0bc85d842ed3f0', 'request_id': 'req-2c6f71e3-d124-4f8b-8087-35e23855749c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:13.831925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c6f71e3-d124-4f8b-8087-35e23855749c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8cf2ba6dfd54626ba0bc85d842ed3f0', 'request_id': 'req-2c6f71e3-d124-4f8b-8087-35e23855749c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:13.849800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c6f71e3-d124-4f8b-8087-35e23855749c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8cf2ba6dfd54626ba0bc85d842ed3f0', 'request_id': 'req-2c6f71e3-d124-4f8b-8087-35e23855749c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:13.889328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c6f71e3-d124-4f8b-8087-35e23855749c admin admin] The token cache is being invalidate because project d8cf2ba6dfd54626ba0bc85d842ed3f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:13.889767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c6f71e3-d124-4f8b-8087-35e23855749c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:13.891884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c411925-24a1-4b95-9b7f-9be1bf0d9607 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:13.900293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c6f71e3-d124-4f8b-8087-35e23855749c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:13.909198 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 926/1850] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:13 2022] DELETE /identity/v3/projects/d8cf2ba6dfd54626ba0bc85d842ed3f0 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:13.921374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f71e3-d124-4f8b-8087-35e23855749c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:13.931519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2c6f71e3-d124-4f8b-8087-35e23855749c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:13.993608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:14.039844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a8b84-eb88-4931-b531-dd80be43fc5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:14.040794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a8b84-eb88-4931-b531-dd80be43fc5e service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:14.041252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a8b84-eb88-4931-b531-dd80be43fc5e service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:14.041766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a8b84-eb88-4931-b531-dd80be43fc5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:14.045280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-017a8b84-eb88-4931-b531-dd80be43fc5e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:14.142441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a8b84-eb88-4931-b531-dd80be43fc5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:14.144555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a8b84-eb88-4931-b531-dd80be43fc5e service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:14.159014 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 925/1851] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:19:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:19:14.161532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c3cef-b5a6-466b-a4ed-5d528e41f424 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:14.163410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c3cef-b5a6-466b-a4ed-5d528e41f424 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:14.164022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c3cef-b5a6-466b-a4ed-5d528e41f424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:14.192035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f71e3-d124-4f8b-8087-35e23855749c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:14.200925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-166c3cef-b5a6-466b-a4ed-5d528e41f424 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:14.204699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-166c3cef-b5a6-466b-a4ed-5d528e41f424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:14.209234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2206780-dc4d-4637-ac19-36126f6d7e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:14.214178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2206780-dc4d-4637-ac19-36126f6d7e57 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:14.214484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2206780-dc4d-4637-ac19-36126f6d7e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:14.214765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2206780-dc4d-4637-ac19-36126f6d7e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:14.220529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f2206780-dc4d-4637-ac19-36126f6d7e57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:14.454303 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 926/1852] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:14.454303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c3cef-b5a6-466b-a4ed-5d528e41f424 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:14.456091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-166c3cef-b5a6-466b-a4ed-5d528e41f424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:14.461433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:14.465914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2206780-dc4d-4637-ac19-36126f6d7e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:14.467971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2206780-dc4d-4637-ac19-36126f6d7e57 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:14.507084 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 927/1853] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:14.508855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c078d-2725-4df8-92e6-7373c103c33e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:14.509173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c078d-2725-4df8-92e6-7373c103c33e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:14.509503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c078d-2725-4df8-92e6-7373c103c33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:14.526354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c3cef-b5a6-466b-a4ed-5d528e41f424 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:14.546469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b59008-2af2-475d-9511-e632605c5f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:14.547636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b59008-2af2-475d-9511-e632605c5f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:14.548173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b59008-2af2-475d-9511-e632605c5f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:14.548587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b59008-2af2-475d-9511-e632605c5f60 admin admin] PATH_INFO: `/v3/projects/f8ee0ee3bfc54a49a9f5320f76faf168` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:14.559874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-596c078d-2725-4df8-92e6-7373c103c33e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:14.561387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-596c078d-2725-4df8-92e6-7373c103c33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:14.566593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b59008-2af2-475d-9511-e632605c5f60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ee0ee3bfc54a49a9f5320f76faf168)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:14.586125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b59008-2af2-475d-9511-e632605c5f60 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:14.589336 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 928/1854] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:14.590482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c078d-2725-4df8-92e6-7373c103c33e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:14.611991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c078d-2725-4df8-92e6-7373c103c33e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:14.623766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23282705-94ab-4b5e-8eaf-504874daae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:14.624483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23282705-94ab-4b5e-8eaf-504874daae25 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:14.624769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23282705-94ab-4b5e-8eaf-504874daae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:14.625090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23282705-94ab-4b5e-8eaf-504874daae25 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:14.626820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23282705-94ab-4b5e-8eaf-504874daae25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:14.627439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23282705-94ab-4b5e-8eaf-504874daae25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:14.629412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23282705-94ab-4b5e-8eaf-504874daae25 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:14.648527 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 929/1855] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:14.649605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23282705-94ab-4b5e-8eaf-504874daae25 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:14.662513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23282705-94ab-4b5e-8eaf-504874daae25 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:14.668707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a985c-cd77-479b-a839-55c5fb17d878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:14.669630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a985c-cd77-479b-a839-55c5fb17d878 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:14.669920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a985c-cd77-479b-a839-55c5fb17d878 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:14.670218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a985c-cd77-479b-a839-55c5fb17d878 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:14.671333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a985c-cd77-479b-a839-55c5fb17d878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:14.673954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a985c-cd77-479b-a839-55c5fb17d878 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:14.722564 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 930/1856] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:14 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:14.730362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a985c-cd77-479b-a839-55c5fb17d878 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:14.769737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6b59008-2af2-475d-9511-e632605c5f60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ee0ee3bfc54a49a9f5320f76faf168', 'request_id': 'req-f6b59008-2af2-475d-9511-e632605c5f60'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:14.788431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6b59008-2af2-475d-9511-e632605c5f60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ee0ee3bfc54a49a9f5320f76faf168', 'request_id': 'req-f6b59008-2af2-475d-9511-e632605c5f60'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:14.795847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6b59008-2af2-475d-9511-e632605c5f60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ee0ee3bfc54a49a9f5320f76faf168', 'request_id': 'req-f6b59008-2af2-475d-9511-e632605c5f60'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:14.823772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6b59008-2af2-475d-9511-e632605c5f60 admin admin] The token cache is being invalidate because project f8ee0ee3bfc54a49a9f5320f76faf168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:14.824058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6b59008-2af2-475d-9511-e632605c5f60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:14.824376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a985c-cd77-479b-a839-55c5fb17d878 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:14.831817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6b59008-2af2-475d-9511-e632605c5f60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:14.837465 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 927/1857] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:14 2022] DELETE /identity/v3/projects/f8ee0ee3bfc54a49a9f5320f76faf168 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:14.839346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f3c16-5d91-4d46-b969-21f07d766e0e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:14.839697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f3c16-5d91-4d46-b969-21f07d766e0e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:14.839959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f3c16-5d91-4d46-b969-21f07d766e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:14.866457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:14.880970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b70f3c16-5d91-4d46-b969-21f07d766e0e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:14.882225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b70f3c16-5d91-4d46-b969-21f07d766e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:14.942170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5441fc-d314-4fee-9118-8e1c850bf712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:14.942893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5441fc-d314-4fee-9118-8e1c850bf712 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:14.943174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5441fc-d314-4fee-9118-8e1c850bf712 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:14.943475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5441fc-d314-4fee-9118-8e1c850bf712 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:14.944343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5441fc-d314-4fee-9118-8e1c850bf712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:14.946652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5441fc-d314-4fee-9118-8e1c850bf712 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:14.997781 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 931/1858] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:14 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:14.999679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5441fc-d314-4fee-9118-8e1c850bf712 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:15.004230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc5441fc-d314-4fee-9118-8e1c850bf712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:15.033657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5441fc-d314-4fee-9118-8e1c850bf712 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:15.051039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcad46f-bc81-45d8-b39f-50fac5ec11d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:15.052391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcad46f-bc81-45d8-b39f-50fac5ec11d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:15.052829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcad46f-bc81-45d8-b39f-50fac5ec11d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:15.053201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcad46f-bc81-45d8-b39f-50fac5ec11d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:15.057215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcad46f-bc81-45d8-b39f-50fac5ec11d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:15.059791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcad46f-bc81-45d8-b39f-50fac5ec11d9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:15.061275 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 928/1859] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:19:15.074314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bae1f3-053c-4b72-ae15-700700f9d031 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:15.075291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bae1f3-053c-4b72-ae15-700700f9d031 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:15.076171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bae1f3-053c-4b72-ae15-700700f9d031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:15.085796 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 932/1860] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:15.087821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcad46f-bc81-45d8-b39f-50fac5ec11d9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:15.105732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcad46f-bc81-45d8-b39f-50fac5ec11d9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:15.112948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f4bae1f3-053c-4b72-ae15-700700f9d031 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:15.114683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a279ee8-dfa3-4635-b40f-c83695c19e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:15.115115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f4bae1f3-053c-4b72-ae15-700700f9d031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:15.115616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a279ee8-dfa3-4635-b40f-c83695c19e6d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:15.116052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a279ee8-dfa3-4635-b40f-c83695c19e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:15.116437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a279ee8-dfa3-4635-b40f-c83695c19e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:15.117375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a279ee8-dfa3-4635-b40f-c83695c19e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:15.119365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a279ee8-dfa3-4635-b40f-c83695c19e6d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:15.129506 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 929/1861] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:15.133827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bae1f3-053c-4b72-ae15-700700f9d031 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:15.155895 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 933/1862] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:15.157042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a279ee8-dfa3-4635-b40f-c83695c19e6d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:15.187088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bae1f3-053c-4b72-ae15-700700f9d031 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:15.191736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a279ee8-dfa3-4635-b40f-c83695c19e6d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:15.194857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c01ae2-6e6f-424c-b715-4831c0019b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:15.196435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c01ae2-6e6f-424c-b715-4831c0019b25 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:15.196861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c01ae2-6e6f-424c-b715-4831c0019b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:15.197246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c01ae2-6e6f-424c-b715-4831c0019b25 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:15.198287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c01ae2-6e6f-424c-b715-4831c0019b25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:15.198754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c01ae2-6e6f-424c-b715-4831c0019b25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:15.200830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c01ae2-6e6f-424c-b715-4831c0019b25 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:15.206968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81919bfb-bb55-4e6a-bc66-4d8318e09931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:15.208801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81919bfb-bb55-4e6a-bc66-4d8318e09931 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:15.209694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81919bfb-bb55-4e6a-bc66-4d8318e09931 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:15.212003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81919bfb-bb55-4e6a-bc66-4d8318e09931 admin admin] PATH_INFO: `/v3/projects/f47bc0cfe90c4f9a8653971f892eecc1/users/8f9d4a3a7e064e809db32cd26cf9050a/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:15.226559 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 930/1863] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:15.227775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c01ae2-6e6f-424c-b715-4831c0019b25 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:15.249956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81919bfb-bb55-4e6a-bc66-4d8318e09931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47bc0cfe90c4f9a8653971f892eecc1, user_id=8f9d4a3a7e064e809db32cd26cf9050a, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:15.253693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c01ae2-6e6f-424c-b715-4831c0019b25 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:15.257006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81919bfb-bb55-4e6a-bc66-4d8318e09931 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:15.266962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b246b7-980c-4fcb-9c17-0697e55a619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:15.267763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b246b7-980c-4fcb-9c17-0697e55a619f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:15.268299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b246b7-980c-4fcb-9c17-0697e55a619f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:15.268623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b246b7-980c-4fcb-9c17-0697e55a619f admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:15.269570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b246b7-980c-4fcb-9c17-0697e55a619f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:15.272141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b246b7-980c-4fcb-9c17-0697e55a619f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:15.299341 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 934/1864] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:15 2022] PUT /identity/v3/projects/f47bc0cfe90c4f9a8653971f892eecc1/users/8f9d4a3a7e064e809db32cd26cf9050a/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:15.306330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c278f-7dcf-4364-b6c1-74b6be5b1ef7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:15.306885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c278f-7dcf-4364-b6c1-74b6be5b1ef7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:15.307442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c278f-7dcf-4364-b6c1-74b6be5b1ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:15.324572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:15.369598 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 931/1865] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:15 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:15.375128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b246b7-980c-4fcb-9c17-0697e55a619f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:15.383970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c24c278f-7dcf-4364-b6c1-74b6be5b1ef7 None None] MFA Rules not processed for user `8f9d4a3a7e064e809db32cd26cf9050a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:15.385210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c24c278f-7dcf-4364-b6c1-74b6be5b1ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:15.566841 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 935/1866] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:19:15.584451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c278f-7dcf-4364-b6c1-74b6be5b1ef7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:15.621348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b246b7-980c-4fcb-9c17-0697e55a619f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:15.631181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c278f-7dcf-4364-b6c1-74b6be5b1ef7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:15.634826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145dc70-583e-4066-8609-9878ba7434f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:15.635953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145dc70-583e-4066-8609-9878ba7434f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:15.639277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145dc70-583e-4066-8609-9878ba7434f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:15.639922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145dc70-583e-4066-8609-9878ba7434f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:15.641568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145dc70-583e-4066-8609-9878ba7434f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:15.644934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145dc70-583e-4066-8609-9878ba7434f6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:15.656818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c84530-8489-4e95-9195-01cfd45cf7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:15.657996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c84530-8489-4e95-9195-01cfd45cf7bd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:15.658576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c84530-8489-4e95-9195-01cfd45cf7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:15.659079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c84530-8489-4e95-9195-01cfd45cf7bd admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:15.660091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c84530-8489-4e95-9195-01cfd45cf7bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:15.666263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c84530-8489-4e95-9195-01cfd45cf7bd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:15.735519 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 936/1867] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:15 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:15.750483 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 932/1868] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:15 2022] POST /identity/v3/users => generated 287 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:15.756143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c84530-8489-4e95-9195-01cfd45cf7bd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:15.756373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145dc70-583e-4066-8609-9878ba7434f6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:15.794450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145dc70-583e-4066-8609-9878ba7434f6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:15.895064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:15.903585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c867f-0b29-4c52-913f-5351de4b73e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:15.904658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c867f-0b29-4c52-913f-5351de4b73e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:15.915467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c867f-0b29-4c52-913f-5351de4b73e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:15.916128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c867f-0b29-4c52-913f-5351de4b73e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:15.916941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c867f-0b29-4c52-913f-5351de4b73e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:15.918712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c867f-0b29-4c52-913f-5351de4b73e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:15.948879 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 933/1869] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:15.950573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c867f-0b29-4c52-913f-5351de4b73e2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:15.955028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c84530-8489-4e95-9195-01cfd45cf7bd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:15.968916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7487a5-fcfd-428f-9734-08a046ddfee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:15.969840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7487a5-fcfd-428f-9734-08a046ddfee9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:15.970226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7487a5-fcfd-428f-9734-08a046ddfee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:15.970614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7487a5-fcfd-428f-9734-08a046ddfee9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:15.971485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7487a5-fcfd-428f-9734-08a046ddfee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:15.973633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7487a5-fcfd-428f-9734-08a046ddfee9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:15.988018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c867f-0b29-4c52-913f-5351de4b73e2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:16.001276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5968b56-9362-4bf4-9522-2945443f0180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:16.003206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5968b56-9362-4bf4-9522-2945443f0180 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:16.003951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5968b56-9362-4bf4-9522-2945443f0180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:16.004866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5968b56-9362-4bf4-9522-2945443f0180 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:16.008724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5968b56-9362-4bf4-9522-2945443f0180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:16.013895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5968b56-9362-4bf4-9522-2945443f0180 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:16.028130 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 937/1870] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:15 2022] POST /identity/v3/users => generated 298 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:16.029055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7487a5-fcfd-428f-9734-08a046ddfee9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:16.058973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7487a5-fcfd-428f-9734-08a046ddfee9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:16.061127 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 934/1871] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:16.068608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5968b56-9362-4bf4-9522-2945443f0180 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:16.076071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26565c74-b302-4479-bda7-bbab1995a51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:16.076713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26565c74-b302-4479-bda7-bbab1995a51a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:16.076989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26565c74-b302-4479-bda7-bbab1995a51a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:16.077259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26565c74-b302-4479-bda7-bbab1995a51a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:16.077963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26565c74-b302-4479-bda7-bbab1995a51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:16.081655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26565c74-b302-4479-bda7-bbab1995a51a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:16.093303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5968b56-9362-4bf4-9522-2945443f0180 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:16.111455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10a232-0de7-4038-a6f3-cb6aa8928776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:16.112676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10a232-0de7-4038-a6f3-cb6aa8928776 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:16.113577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10a232-0de7-4038-a6f3-cb6aa8928776 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:16.114081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10a232-0de7-4038-a6f3-cb6aa8928776 admin admin] PATH_INFO: `/v3/projects/a412320a2f8c4a61a464515096f9a319/users/cbce2cccc2c646bd94d3405957c1b212/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:16.140873 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 938/1872] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:16.147512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26565c74-b302-4479-bda7-bbab1995a51a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:16.174303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10a232-0de7-4038-a6f3-cb6aa8928776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a412320a2f8c4a61a464515096f9a319, user_id=cbce2cccc2c646bd94d3405957c1b212, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:16.177876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10a232-0de7-4038-a6f3-cb6aa8928776 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:16.195037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26565c74-b302-4479-bda7-bbab1995a51a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:16.220130 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 935/1873] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:16 2022] PUT /identity/v3/projects/a412320a2f8c4a61a464515096f9a319/users/cbce2cccc2c646bd94d3405957c1b212/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:16.222902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602b6b2-1ec5-4cb7-9b46-a52a3f850215 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:16.223406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2dca7-2674-4d50-9a60-eab6ae233225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:16.223537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602b6b2-1ec5-4cb7-9b46-a52a3f850215 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:16.223963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602b6b2-1ec5-4cb7-9b46-a52a3f850215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:16.224146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2dca7-2674-4d50-9a60-eab6ae233225 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:16.224433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2dca7-2674-4d50-9a60-eab6ae233225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:16.229711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2dca7-2674-4d50-9a60-eab6ae233225 admin admin] PATH_INFO: `/v3/projects/b2bc7da4e3c84cd4873ebd46f590026c/users/b3255c0dc2114f2291a3df856a297c3b/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:16.291694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2dca7-2674-4d50-9a60-eab6ae233225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2bc7da4e3c84cd4873ebd46f590026c, user_id=b3255c0dc2114f2291a3df856a297c3b, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:16.294906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2dca7-2674-4d50-9a60-eab6ae233225 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:16.333140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f602b6b2-1ec5-4cb7-9b46-a52a3f850215 None None] MFA Rules not processed for user `cbce2cccc2c646bd94d3405957c1b212`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:16.341245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f602b6b2-1ec5-4cb7-9b46-a52a3f850215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:16.359594 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 939/1874] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:16 2022] PUT /identity/v3/projects/b2bc7da4e3c84cd4873ebd46f590026c/users/b3255c0dc2114f2291a3df856a297c3b/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:19:16.360867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2dca7-2674-4d50-9a60-eab6ae233225 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:16.473592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:16.501138 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 936/1875] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:16.502944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602b6b2-1ec5-4cb7-9b46-a52a3f850215 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:16.562640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2dca7-2674-4d50-9a60-eab6ae233225 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:16.581488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9dd5df-aa65-46b6-8f5b-0f91fc8e1f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:16.582871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dd5df-aa65-46b6-8f5b-0f91fc8e1f20 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:16.584459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dd5df-aa65-46b6-8f5b-0f91fc8e1f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:16.585216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dd5df-aa65-46b6-8f5b-0f91fc8e1f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:16.586616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9dd5df-aa65-46b6-8f5b-0f91fc8e1f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:16.590813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9dd5df-aa65-46b6-8f5b-0f91fc8e1f20 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:16.607901 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 940/1876] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:16.614484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9dd5df-aa65-46b6-8f5b-0f91fc8e1f20 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:16.634408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9dd5df-aa65-46b6-8f5b-0f91fc8e1f20 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:16.641526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6668cb0-1f35-45c0-a4cb-1040f0778ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:16.643002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6668cb0-1f35-45c0-a4cb-1040f0778ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:16.643535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6668cb0-1f35-45c0-a4cb-1040f0778ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:16.644425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6668cb0-1f35-45c0-a4cb-1040f0778ea9 admin admin] PATH_INFO: `/v3/projects/b2bc7da4e3c84cd4873ebd46f590026c/users/b3255c0dc2114f2291a3df856a297c3b/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:16.651217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6668cb0-1f35-45c0-a4cb-1040f0778ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2bc7da4e3c84cd4873ebd46f590026c, user_id=b3255c0dc2114f2291a3df856a297c3b, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:16.680646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6668cb0-1f35-45c0-a4cb-1040f0778ea9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:16.699844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602b6b2-1ec5-4cb7-9b46-a52a3f850215 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:16.711078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb2625-6994-4f57-944b-00c9930d5771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:16.713228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2625-6994-4f57-944b-00c9930d5771 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:16.714399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2625-6994-4f57-944b-00c9930d5771 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:16.714963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2625-6994-4f57-944b-00c9930d5771 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:16.716125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb2625-6994-4f57-944b-00c9930d5771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:16.722028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb2625-6994-4f57-944b-00c9930d5771 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:16.744170 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 941/1877] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:16 2022] PUT /identity/v3/projects/b2bc7da4e3c84cd4873ebd46f590026c/users/b3255c0dc2114f2291a3df856a297c3b/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:16.753098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a135ba8-3765-4b13-8b38-8b8662e8394c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:16.753385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a135ba8-3765-4b13-8b38-8b8662e8394c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:16.753660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a135ba8-3765-4b13-8b38-8b8662e8394c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:16.822054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6a135ba8-3765-4b13-8b38-8b8662e8394c None None] MFA Rules not processed for user `b3255c0dc2114f2291a3df856a297c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:16.827052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a135ba8-3765-4b13-8b38-8b8662e8394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:16.887553 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 937/1878] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:16 2022] POST /identity/v3/projects => generated 373 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:16.889028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb2625-6994-4f57-944b-00c9930d5771 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:17.088043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:17.176395 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 942/1879] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:19:17.194851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a135ba8-3765-4b13-8b38-8b8662e8394c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:17.196457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a135ba8-3765-4b13-8b38-8b8662e8394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:17.218396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb2625-6994-4f57-944b-00c9930d5771 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:17.242970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca78859-e053-4036-a798-496a0ac1b2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:17.245587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca78859-e053-4036-a798-496a0ac1b2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:17.245937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca78859-e053-4036-a798-496a0ac1b2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:17.248563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca78859-e053-4036-a798-496a0ac1b2d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:17.250961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca78859-e053-4036-a798-496a0ac1b2d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:17.257388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca78859-e053-4036-a798-496a0ac1b2d6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:17.353594 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 938/1880] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:16 2022] POST /identity/v3/users => generated 293 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:17.357918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca78859-e053-4036-a798-496a0ac1b2d6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:17.366428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0ca78859-e053-4036-a798-496a0ac1b2d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:17.418437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca78859-e053-4036-a798-496a0ac1b2d6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:17.422971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a135ba8-3765-4b13-8b38-8b8662e8394c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:17.443702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2f5cf-a887-47f9-bc6e-f0c7e8d91a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:17.452379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2f5cf-a887-47f9-bc6e-f0c7e8d91a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:17.454481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2f5cf-a887-47f9-bc6e-f0c7e8d91a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:17.456086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2f5cf-a887-47f9-bc6e-f0c7e8d91a87 admin admin] PATH_INFO: `/v3/projects/93898211fcfe463eabea994e6b14efd4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:17.465177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2f5cf-a887-47f9-bc6e-f0c7e8d91a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93898211fcfe463eabea994e6b14efd4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:17.470495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2f5cf-a887-47f9-bc6e-f0c7e8d91a87 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:17.499479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:17.575706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a19e7f-0dd1-4143-b36f-1f740c501879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:17.577686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a19e7f-0dd1-4143-b36f-1f740c501879 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:17.577976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a19e7f-0dd1-4143-b36f-1f740c501879 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:17.578303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a19e7f-0dd1-4143-b36f-1f740c501879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:17.681453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecc2f5cf-a887-47f9-bc6e-f0c7e8d91a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93898211fcfe463eabea994e6b14efd4', 'request_id': 'req-ecc2f5cf-a887-47f9-bc6e-f0c7e8d91a87'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:17.748783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecc2f5cf-a887-47f9-bc6e-f0c7e8d91a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93898211fcfe463eabea994e6b14efd4', 'request_id': 'req-ecc2f5cf-a887-47f9-bc6e-f0c7e8d91a87'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:17.777085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a19e7f-0dd1-4143-b36f-1f740c501879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:17.779073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a19e7f-0dd1-4143-b36f-1f740c501879 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:17.796388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecc2f5cf-a887-47f9-bc6e-f0c7e8d91a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93898211fcfe463eabea994e6b14efd4', 'request_id': 'req-ecc2f5cf-a887-47f9-bc6e-f0c7e8d91a87'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:17.812737 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 943/1881] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:17.813860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a19e7f-0dd1-4143-b36f-1f740c501879 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:17.831557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecc2f5cf-a887-47f9-bc6e-f0c7e8d91a87 admin admin] The token cache is being invalidate because project 93898211fcfe463eabea994e6b14efd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:17.832042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecc2f5cf-a887-47f9-bc6e-f0c7e8d91a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:17.832888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecc2f5cf-a887-47f9-bc6e-f0c7e8d91a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:17.837394 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 939/1882] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:17 2022] DELETE /identity/v3/projects/93898211fcfe463eabea994e6b14efd4 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:17.844818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f41cbd-04f2-4261-8bb8-8b0522165ec2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:17.845245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f41cbd-04f2-4261-8bb8-8b0522165ec2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:17.845530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f41cbd-04f2-4261-8bb8-8b0522165ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:17.858668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a19e7f-0dd1-4143-b36f-1f740c501879 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:17.926101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b5f41cbd-04f2-4261-8bb8-8b0522165ec2 None None] MFA Rules not processed for user `dcb628c8f43d423e80393eaa3ca709a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:17.927761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b5f41cbd-04f2-4261-8bb8-8b0522165ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:18.111701 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 940/1883] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:17 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:18.124554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f41cbd-04f2-4261-8bb8-8b0522165ec2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:18.129174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b5f41cbd-04f2-4261-8bb8-8b0522165ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:18.133520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27746dc-ece2-4b48-8040-fc7d1cfc9f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:18.134183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27746dc-ece2-4b48-8040-fc7d1cfc9f1f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:18.134467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27746dc-ece2-4b48-8040-fc7d1cfc9f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:18.134758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27746dc-ece2-4b48-8040-fc7d1cfc9f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:18.135569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27746dc-ece2-4b48-8040-fc7d1cfc9f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:18.137494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27746dc-ece2-4b48-8040-fc7d1cfc9f1f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:18.169219 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 944/1884] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:18.170892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f41cbd-04f2-4261-8bb8-8b0522165ec2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:18.173485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa5d15-279b-48e7-8142-572c9bf0217a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:18.173850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa5d15-279b-48e7-8142-572c9bf0217a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:18.175395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa5d15-279b-48e7-8142-572c9bf0217a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:18.187178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094954db-e007-41a0-b63d-61fdd7f0af96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:18.191087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094954db-e007-41a0-b63d-61fdd7f0af96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:18.191394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094954db-e007-41a0-b63d-61fdd7f0af96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:18.191674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094954db-e007-41a0-b63d-61fdd7f0af96 admin admin] PATH_INFO: `/v3/users/b10dc0ae957e47379c27ad3d9fffeb85` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:18.196719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094954db-e007-41a0-b63d-61fdd7f0af96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b10dc0ae957e47379c27ad3d9fffeb85)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:18.198998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094954db-e007-41a0-b63d-61fdd7f0af96 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:18.241094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5afa5d15-279b-48e7-8142-572c9bf0217a None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:18.243854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5afa5d15-279b-48e7-8142-572c9bf0217a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:18.297626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:18.372484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-094954db-e007-41a0-b63d-61fdd7f0af96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b10dc0ae957e47379c27ad3d9fffeb85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:18.453905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-094954db-e007-41a0-b63d-61fdd7f0af96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b10dc0ae957e47379c27ad3d9fffeb85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:18.455519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-094954db-e007-41a0-b63d-61fdd7f0af96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b10dc0ae957e47379c27ad3d9fffeb85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:18.457542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-094954db-e007-41a0-b63d-61fdd7f0af96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b10dc0ae957e47379c27ad3d9fffeb85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:18.511321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-094954db-e007-41a0-b63d-61fdd7f0af96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b10dc0ae957e47379c27ad3d9fffeb85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:18.516378 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 945/1885] 10.222.0.45 () {58 vars in 1015 bytes} [Sun Aug 28 18:19:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:18.520545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa5d15-279b-48e7-8142-572c9bf0217a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:18.527740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5afa5d15-279b-48e7-8142-572c9bf0217a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:18.586329 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 941/1886] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:18 2022] DELETE /identity/v3/users/b10dc0ae957e47379c27ad3d9fffeb85 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:18.587661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094954db-e007-41a0-b63d-61fdd7f0af96 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:18.588448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa5d15-279b-48e7-8142-572c9bf0217a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:18.590626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-094954db-e007-41a0-b63d-61fdd7f0af96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:18.598134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:18.731919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7079c9d-d1af-4957-bd22-36b4aafdaeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:18.732835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7079c9d-d1af-4957-bd22-36b4aafdaeb4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:18.733372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7079c9d-d1af-4957-bd22-36b4aafdaeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:18.733827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7079c9d-d1af-4957-bd22-36b4aafdaeb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:18.734669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7079c9d-d1af-4957-bd22-36b4aafdaeb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:18.744207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7079c9d-d1af-4957-bd22-36b4aafdaeb4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:18.787709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094954db-e007-41a0-b63d-61fdd7f0af96 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:18.818728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b290c-f2c4-43a9-9c3d-a5deb7ee9134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:18.820015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b290c-f2c4-43a9-9c3d-a5deb7ee9134 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:18.821215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b290c-f2c4-43a9-9c3d-a5deb7ee9134 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:18.828980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b290c-f2c4-43a9-9c3d-a5deb7ee9134 admin admin] PATH_INFO: `/v3/projects/a1d463c5f4e1438ba47948cd79d2c228/users/173f8828fb6247da89b2bc5a79f8c087/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:18.842679 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 946/1887] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:18 2022] POST /identity/v3/projects => generated 403 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:18.846606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7079c9d-d1af-4957-bd22-36b4aafdaeb4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:18.858721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e7079c9d-d1af-4957-bd22-36b4aafdaeb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:18.891779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b290c-f2c4-43a9-9c3d-a5deb7ee9134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d463c5f4e1438ba47948cd79d2c228, user_id=173f8828fb6247da89b2bc5a79f8c087, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:18.907356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b290c-f2c4-43a9-9c3d-a5deb7ee9134 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:18.950236 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 942/1888] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:18 2022] PUT /identity/v3/projects/a1d463c5f4e1438ba47948cd79d2c228/users/173f8828fb6247da89b2bc5a79f8c087/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:18.951835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b290c-f2c4-43a9-9c3d-a5deb7ee9134 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:19.062490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7079c9d-d1af-4957-bd22-36b4aafdaeb4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:19.203041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b290c-f2c4-43a9-9c3d-a5deb7ee9134 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:19.213419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727077b9-53dc-43f4-a872-ed89260847c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:19.216499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727077b9-53dc-43f4-a872-ed89260847c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:19.218889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727077b9-53dc-43f4-a872-ed89260847c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:19.219556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727077b9-53dc-43f4-a872-ed89260847c1 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:19.220572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727077b9-53dc-43f4-a872-ed89260847c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:19.227668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727077b9-53dc-43f4-a872-ed89260847c1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:19.293191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a05430-abf8-42b0-9b61-629e17b4a0ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:19.297337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a05430-abf8-42b0-9b61-629e17b4a0ba service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:19.297878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a05430-abf8-42b0-9b61-629e17b4a0ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:19.298454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a05430-abf8-42b0-9b61-629e17b4a0ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:19.318626 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 943/1889] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:18 2022] POST /identity/v3/users => generated 308 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:19.321693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727077b9-53dc-43f4-a872-ed89260847c1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:19.352042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a05430-abf8-42b0-9b61-629e17b4a0ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:19.358832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a05430-abf8-42b0-9b61-629e17b4a0ba service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:19.375242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727077b9-53dc-43f4-a872-ed89260847c1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:19.400404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ae56c-21b7-4a6e-b937-2620444ae8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:19.409442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ae56c-21b7-4a6e-b937-2620444ae8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:19.409742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ae56c-21b7-4a6e-b937-2620444ae8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:19.410021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ae56c-21b7-4a6e-b937-2620444ae8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:19.410770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ae56c-21b7-4a6e-b937-2620444ae8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:19.412837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ae56c-21b7-4a6e-b937-2620444ae8f2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:19.426455 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 947/1890] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:19.429935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a05430-abf8-42b0-9b61-629e17b4a0ba service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:19.437494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-90a05430-abf8-42b0-9b61-629e17b4a0ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:19.505595 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 944/1891] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:19.512310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ae56c-21b7-4a6e-b937-2620444ae8f2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:19.534204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a05430-abf8-42b0-9b61-629e17b4a0ba service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:19.591611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975ed1f-aeb1-4537-af1f-181639f450b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:19.593042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975ed1f-aeb1-4537-af1f-181639f450b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:19.593804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975ed1f-aeb1-4537-af1f-181639f450b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:19.594558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975ed1f-aeb1-4537-af1f-181639f450b5 admin admin] PATH_INFO: `/v3/users/8f9d4a3a7e064e809db32cd26cf9050a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:19.598090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ae56c-21b7-4a6e-b937-2620444ae8f2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:19.598414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975ed1f-aeb1-4537-af1f-181639f450b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9d4a3a7e064e809db32cd26cf9050a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:19.601725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975ed1f-aeb1-4537-af1f-181639f450b5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:19.632574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d512adc-8e39-43af-bc98-cd2c1f617d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:19.633212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d512adc-8e39-43af-bc98-cd2c1f617d50 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:19.633413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d512adc-8e39-43af-bc98-cd2c1f617d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:19.633667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d512adc-8e39-43af-bc98-cd2c1f617d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:19.634670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d512adc-8e39-43af-bc98-cd2c1f617d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:19.636645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d512adc-8e39-43af-bc98-cd2c1f617d50 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:19.642151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:19.681560 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 945/1892] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:19.691545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d512adc-8e39-43af-bc98-cd2c1f617d50 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:19.704313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d512adc-8e39-43af-bc98-cd2c1f617d50 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:19.719706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f61e3-867a-4043-99bb-d4d6a44102d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:19.720768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f61e3-867a-4043-99bb-d4d6a44102d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:19.721212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f61e3-867a-4043-99bb-d4d6a44102d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:19.721785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f61e3-867a-4043-99bb-d4d6a44102d1 admin admin] PATH_INFO: `/v3/projects/a1d463c5f4e1438ba47948cd79d2c228/users/173f8828fb6247da89b2bc5a79f8c087/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:19.726590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f61e3-867a-4043-99bb-d4d6a44102d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d463c5f4e1438ba47948cd79d2c228, user_id=173f8828fb6247da89b2bc5a79f8c087, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:19.734580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f61e3-867a-4043-99bb-d4d6a44102d1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:19.758142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3975ed1f-aeb1-4537-af1f-181639f450b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9d4a3a7e064e809db32cd26cf9050a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:19.759595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3975ed1f-aeb1-4537-af1f-181639f450b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9d4a3a7e064e809db32cd26cf9050a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:19.764916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:19.768579 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 946/1893] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:19 2022] PUT /identity/v3/projects/a1d463c5f4e1438ba47948cd79d2c228/users/173f8828fb6247da89b2bc5a79f8c087/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:19.771889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f61e3-867a-4043-99bb-d4d6a44102d1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:19.781783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-457f61e3-867a-4043-99bb-d4d6a44102d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:19.782784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3975ed1f-aeb1-4537-af1f-181639f450b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9d4a3a7e064e809db32cd26cf9050a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:19.822544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3975ed1f-aeb1-4537-af1f-181639f450b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9d4a3a7e064e809db32cd26cf9050a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:19.867393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3975ed1f-aeb1-4537-af1f-181639f450b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9d4a3a7e064e809db32cd26cf9050a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:19.895892 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 948/1894] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:19 2022] DELETE /identity/v3/users/8f9d4a3a7e064e809db32cd26cf9050a => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:19.900310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398606e-4048-4bc2-a14f-84bb63f07300 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:19.901800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398606e-4048-4bc2-a14f-84bb63f07300 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:19.902962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398606e-4048-4bc2-a14f-84bb63f07300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:20.009162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9398606e-4048-4bc2-a14f-84bb63f07300 None None] MFA Rules not processed for user `173f8828fb6247da89b2bc5a79f8c087`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:20.015696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9398606e-4048-4bc2-a14f-84bb63f07300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:20.016141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f61e3-867a-4043-99bb-d4d6a44102d1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:20.153248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba29de-c584-4878-9b2c-fbff1c6a053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:20.153973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba29de-c584-4878-9b2c-fbff1c6a053b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:20.155419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba29de-c584-4878-9b2c-fbff1c6a053b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:20.155747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba29de-c584-4878-9b2c-fbff1c6a053b admin admin] PATH_INFO: `/v3/projects/1dea63374bbe44abb9b793f325ef6ae3/users/79fd6a956dcd46628dd085a626731217/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:20.179212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba29de-c584-4878-9b2c-fbff1c6a053b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dea63374bbe44abb9b793f325ef6ae3, user_id=79fd6a956dcd46628dd085a626731217, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:20.181992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba29de-c584-4878-9b2c-fbff1c6a053b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:20.214204 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 947/1895] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:19 2022] PUT /identity/v3/projects/1dea63374bbe44abb9b793f325ef6ae3/users/79fd6a956dcd46628dd085a626731217/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:20.219648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b672b-612e-4799-b7b5-beaf2958af7c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:20.220014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b672b-612e-4799-b7b5-beaf2958af7c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:20.220338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b672b-612e-4799-b7b5-beaf2958af7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:20.262097 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 949/1896] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:20.263024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398606e-4048-4bc2-a14f-84bb63f07300 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:20.273466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4f5b672b-612e-4799-b7b5-beaf2958af7c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:20.274763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4f5b672b-612e-4799-b7b5-beaf2958af7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:20.303023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398606e-4048-4bc2-a14f-84bb63f07300 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:20.409288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59beb676-5d97-4216-ae6b-231504cc54bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:20.410390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beb676-5d97-4216-ae6b-231504cc54bb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:20.410770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beb676-5d97-4216-ae6b-231504cc54bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:20.413693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beb676-5d97-4216-ae6b-231504cc54bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:20.415658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59beb676-5d97-4216-ae6b-231504cc54bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:20.420623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59beb676-5d97-4216-ae6b-231504cc54bb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:20.462629 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 950/1897] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:20.465029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59beb676-5d97-4216-ae6b-231504cc54bb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:20.486041 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 948/1898] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:20.488924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b672b-612e-4799-b7b5-beaf2958af7c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:20.494258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4f5b672b-612e-4799-b7b5-beaf2958af7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:20.543941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b672b-612e-4799-b7b5-beaf2958af7c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:20.563933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6c118-9253-4b0e-a408-930cd4e0943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:20.564616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6c118-9253-4b0e-a408-930cd4e0943e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:20.564898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6c118-9253-4b0e-a408-930cd4e0943e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:20.569173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6c118-9253-4b0e-a408-930cd4e0943e admin admin] PATH_INFO: `/v3/projects/a79a4315a95c46b291e9aa2249b48249` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:20.580669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6c118-9253-4b0e-a408-930cd4e0943e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a79a4315a95c46b291e9aa2249b48249)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:20.586142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6c118-9253-4b0e-a408-930cd4e0943e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:20.596181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:20.614952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:20.636616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59beb676-5d97-4216-ae6b-231504cc54bb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:20.661842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f102d8-3037-4606-8259-490eefbda68c tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173f8828fb6247da89b2bc5a79f8c087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1d463c5f4e1438ba47948cd79d2c228', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:20.662399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f102d8-3037-4606-8259-490eefbda68c tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:20.662683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f102d8-3037-4606-8259-490eefbda68c tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:20.662967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f102d8-3037-4606-8259-490eefbda68c tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:20.664276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f102d8-3037-4606-8259-490eefbda68c tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:20.664276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f102d8-3037-4606-8259-490eefbda68c tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:20.668015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f102d8-3037-4606-8259-490eefbda68c tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:20.695830 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 951/1899] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:20.697960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f102d8-3037-4606-8259-490eefbda68c tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:20.714958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f102d8-3037-4606-8259-490eefbda68c tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:20.724738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57c6c118-9253-4b0e-a408-930cd4e0943e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a79a4315a95c46b291e9aa2249b48249', 'request_id': 'req-57c6c118-9253-4b0e-a408-930cd4e0943e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:20.738366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57c6c118-9253-4b0e-a408-930cd4e0943e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a79a4315a95c46b291e9aa2249b48249', 'request_id': 'req-57c6c118-9253-4b0e-a408-930cd4e0943e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:20.755466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57c6c118-9253-4b0e-a408-930cd4e0943e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a79a4315a95c46b291e9aa2249b48249', 'request_id': 'req-57c6c118-9253-4b0e-a408-930cd4e0943e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:20.781802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57c6c118-9253-4b0e-a408-930cd4e0943e admin admin] The token cache is being invalidate because project a79a4315a95c46b291e9aa2249b48249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:20.784413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57c6c118-9253-4b0e-a408-930cd4e0943e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:20.788665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57c6c118-9253-4b0e-a408-930cd4e0943e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:20.793455 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 949/1900] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:20 2022] DELETE /identity/v3/projects/a79a4315a95c46b291e9aa2249b48249 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:20.794664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6c118-9253-4b0e-a408-930cd4e0943e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:20.799444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-57c6c118-9253-4b0e-a408-930cd4e0943e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:20.882224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d505328-d537-4db7-94b9-8d9c699a6ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:20.883018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d505328-d537-4db7-94b9-8d9c699a6ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:20.883372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d505328-d537-4db7-94b9-8d9c699a6ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:20.883655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d505328-d537-4db7-94b9-8d9c699a6ea3 admin admin] PATH_INFO: `/v3/projects/1dea63374bbe44abb9b793f325ef6ae3/users/79fd6a956dcd46628dd085a626731217/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:20.886069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d505328-d537-4db7-94b9-8d9c699a6ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dea63374bbe44abb9b793f325ef6ae3, user_id=79fd6a956dcd46628dd085a626731217, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:20.889951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d505328-d537-4db7-94b9-8d9c699a6ea3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:20.934773 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 952/1901] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:20 2022] PUT /identity/v3/projects/1dea63374bbe44abb9b793f325ef6ae3/users/79fd6a956dcd46628dd085a626731217/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:20.937706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d505328-d537-4db7-94b9-8d9c699a6ea3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:20.949225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6d505328-d537-4db7-94b9-8d9c699a6ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:21.011990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6c118-9253-4b0e-a408-930cd4e0943e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:21.139478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047beddb-aee4-435a-9921-87556b29ee8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:21.141092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047beddb-aee4-435a-9921-87556b29ee8b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:21.141549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047beddb-aee4-435a-9921-87556b29ee8b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:21.144462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047beddb-aee4-435a-9921-87556b29ee8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:21.153769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-047beddb-aee4-435a-9921-87556b29ee8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:21.168575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d505328-d537-4db7-94b9-8d9c699a6ea3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:21.183211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d2993-e7ad-4213-88e1-1b3cbb5b4d94 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173f8828fb6247da89b2bc5a79f8c087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1d463c5f4e1438ba47948cd79d2c228', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:21.185276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d2993-e7ad-4213-88e1-1b3cbb5b4d94 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:21.185680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d2993-e7ad-4213-88e1-1b3cbb5b4d94 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:21.185783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d2993-e7ad-4213-88e1-1b3cbb5b4d94 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:21.191859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d2993-e7ad-4213-88e1-1b3cbb5b4d94 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:21.196820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d2993-e7ad-4213-88e1-1b3cbb5b4d94 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:21.295300 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 953/1902] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:20 2022] POST /identity/v3/projects => generated 369 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:21.297260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d2993-e7ad-4213-88e1-1b3cbb5b4d94 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:21.301803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d49d2993-e7ad-4213-88e1-1b3cbb5b4d94 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:21.360801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047beddb-aee4-435a-9921-87556b29ee8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:21.362857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047beddb-aee4-435a-9921-87556b29ee8b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:21.391934 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 950/1903] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:21.395296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047beddb-aee4-435a-9921-87556b29ee8b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:21.410734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:21.431036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047beddb-aee4-435a-9921-87556b29ee8b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:21.495406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d2993-e7ad-4213-88e1-1b3cbb5b4d94 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:21.509504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea50a3a-7d05-47e3-99a8-ad66f09f2665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:21.512369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea50a3a-7d05-47e3-99a8-ad66f09f2665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:21.513383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea50a3a-7d05-47e3-99a8-ad66f09f2665 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:21.513747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea50a3a-7d05-47e3-99a8-ad66f09f2665 admin admin] PATH_INFO: `/v3/users/0c7a62a530404485b07b3a9f889ded62` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:21.517461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea50a3a-7d05-47e3-99a8-ad66f09f2665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c7a62a530404485b07b3a9f889ded62)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:21.523928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea50a3a-7d05-47e3-99a8-ad66f09f2665 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:21.534108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:21.568439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a32e80-7032-4d32-95d6-6c14790c7b33 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173f8828fb6247da89b2bc5a79f8c087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1d463c5f4e1438ba47948cd79d2c228', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:21.570412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a32e80-7032-4d32-95d6-6c14790c7b33 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:21.570927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a32e80-7032-4d32-95d6-6c14790c7b33 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:21.572265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a32e80-7032-4d32-95d6-6c14790c7b33 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:21.574381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a32e80-7032-4d32-95d6-6c14790c7b33 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:21.575050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a32e80-7032-4d32-95d6-6c14790c7b33 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:21.577076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a32e80-7032-4d32-95d6-6c14790c7b33 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:21.599981 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 951/1904] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:21.645918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a32e80-7032-4d32-95d6-6c14790c7b33 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:21.653254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-48a32e80-7032-4d32-95d6-6c14790c7b33 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:21.664211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ea50a3a-7d05-47e3-99a8-ad66f09f2665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c7a62a530404485b07b3a9f889ded62'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:21.667613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ea50a3a-7d05-47e3-99a8-ad66f09f2665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c7a62a530404485b07b3a9f889ded62'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:21.689048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ea50a3a-7d05-47e3-99a8-ad66f09f2665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c7a62a530404485b07b3a9f889ded62'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:21.708124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ea50a3a-7d05-47e3-99a8-ad66f09f2665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c7a62a530404485b07b3a9f889ded62'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:21.745895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ea50a3a-7d05-47e3-99a8-ad66f09f2665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c7a62a530404485b07b3a9f889ded62'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:21.771965 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 954/1905] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:21 2022] DELETE /identity/v3/users/0c7a62a530404485b07b3a9f889ded62 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:21.821174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a32e80-7032-4d32-95d6-6c14790c7b33 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:21.923368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e406555-14de-4351-9ba2-bea34ad125ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:21.924430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e406555-14de-4351-9ba2-bea34ad125ad service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:21.924917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e406555-14de-4351-9ba2-bea34ad125ad service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:21.925433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e406555-14de-4351-9ba2-bea34ad125ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:21.928548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7e406555-14de-4351-9ba2-bea34ad125ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:22.006721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:22.149144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e406555-14de-4351-9ba2-bea34ad125ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:22.153196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e406555-14de-4351-9ba2-bea34ad125ad service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:22.178689 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 952/1906] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:22.197600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269f3b6-1d0b-4c50-9d0e-8b70e8905822 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:22.198174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269f3b6-1d0b-4c50-9d0e-8b70e8905822 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:22.198322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269f3b6-1d0b-4c50-9d0e-8b70e8905822 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:22.199963 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 955/1907] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:19:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:19:22.223828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e406555-14de-4351-9ba2-bea34ad125ad service nova] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:19:22.226986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7e406555-14de-4351-9ba2-bea34ad125ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:22.312818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e406555-14de-4351-9ba2-bea34ad125ad service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:22.366490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e406555-14de-4351-9ba2-bea34ad125ad service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:22.384281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd662c39-812a-4f3e-a0ad-ae8b8deaab49 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173f8828fb6247da89b2bc5a79f8c087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1d463c5f4e1438ba47948cd79d2c228', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:22.387503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd662c39-812a-4f3e-a0ad-ae8b8deaab49 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:22.387831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd662c39-812a-4f3e-a0ad-ae8b8deaab49 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:22.388117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd662c39-812a-4f3e-a0ad-ae8b8deaab49 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] PATH_INFO: `/v3/projects/6d14472cfa31483498a0a037fb6c6cf3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:22.389909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd662c39-812a-4f3e-a0ad-ae8b8deaab49 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorizing `identity:get_project(project_id=6d14472cfa31483498a0a037fb6c6cf3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:22.396117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd662c39-812a-4f3e-a0ad-ae8b8deaab49 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:22.407735 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 953/1908] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:19:22 2022] GET /identity/v3/projects/6d14472cfa31483498a0a037fb6c6cf3 => generated 369 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:22.764538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b4280-4b4f-4df0-893d-3ab2e98bdef2 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:22.765051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b4280-4b4f-4df0-893d-3ab2e98bdef2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:22.765499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b4280-4b4f-4df0-893d-3ab2e98bdef2 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:22.767231 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 956/1909] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:19:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:19:22.775578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd662c39-812a-4f3e-a0ad-ae8b8deaab49 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:19:22.795321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd662c39-812a-4f3e-a0ad-ae8b8deaab49 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:22.812041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd662c39-812a-4f3e-a0ad-ae8b8deaab49 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:22.817806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d26248-61ca-4905-828c-4cd209f59c5b tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173f8828fb6247da89b2bc5a79f8c087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1d463c5f4e1438ba47948cd79d2c228', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:22.818482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d26248-61ca-4905-828c-4cd209f59c5b tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:22.819581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d26248-61ca-4905-828c-4cd209f59c5b tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:22.820462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d26248-61ca-4905-828c-4cd209f59c5b tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] PATH_INFO: `/v3/projects/6d14472cfa31483498a0a037fb6c6cf3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:22.822242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d26248-61ca-4905-828c-4cd209f59c5b tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorizing `identity:get_project(project_id=6d14472cfa31483498a0a037fb6c6cf3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:22.825500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d26248-61ca-4905-828c-4cd209f59c5b tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:22.831652 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 954/1910] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:19:22 2022] GET /identity/v3/projects/6d14472cfa31483498a0a037fb6c6cf3 => generated 369 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:22.899704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b4280-4b4f-4df0-893d-3ab2e98bdef2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:22.941321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b4280-4b4f-4df0-893d-3ab2e98bdef2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:22.958382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71cc6b-8a54-4fc9-93de-ded8161f74e8 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173f8828fb6247da89b2bc5a79f8c087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1d463c5f4e1438ba47948cd79d2c228', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:22.959860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71cc6b-8a54-4fc9-93de-ded8161f74e8 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:22.960380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71cc6b-8a54-4fc9-93de-ded8161f74e8 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:22.960846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71cc6b-8a54-4fc9-93de-ded8161f74e8 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:22.962243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71cc6b-8a54-4fc9-93de-ded8161f74e8 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:22.962754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71cc6b-8a54-4fc9-93de-ded8161f74e8 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:22.966077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71cc6b-8a54-4fc9-93de-ded8161f74e8 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:22.974666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d26248-61ca-4905-828c-4cd209f59c5b tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:22.976653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-61d26248-61ca-4905-828c-4cd209f59c5b tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:22.988507 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 957/1911] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:22.989670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71cc6b-8a54-4fc9-93de-ded8161f74e8 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:23.002324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71cc6b-8a54-4fc9-93de-ded8161f74e8 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:23.007482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e4d0e-7a57-4801-b169-9298b6f7e107 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173f8828fb6247da89b2bc5a79f8c087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1d463c5f4e1438ba47948cd79d2c228', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:23.008137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e4d0e-7a57-4801-b169-9298b6f7e107 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:23.008864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e4d0e-7a57-4801-b169-9298b6f7e107 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:23.009169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e4d0e-7a57-4801-b169-9298b6f7e107 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:23.010174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e4d0e-7a57-4801-b169-9298b6f7e107 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:23.012652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e4d0e-7a57-4801-b169-9298b6f7e107 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:23.052984 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 958/1912] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:22 2022] POST /identity/v3/users => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:23.057715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e4d0e-7a57-4801-b169-9298b6f7e107 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:23.083044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e4d0e-7a57-4801-b169-9298b6f7e107 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:23.089252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf518da-8fc1-44b1-8f3c-4adff7a317fd tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173f8828fb6247da89b2bc5a79f8c087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1d463c5f4e1438ba47948cd79d2c228', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:23.099856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf518da-8fc1-44b1-8f3c-4adff7a317fd tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:23.100457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf518da-8fc1-44b1-8f3c-4adff7a317fd tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:23.100626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf518da-8fc1-44b1-8f3c-4adff7a317fd tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:23.101320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf518da-8fc1-44b1-8f3c-4adff7a317fd tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:23.101631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf518da-8fc1-44b1-8f3c-4adff7a317fd tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:23.103506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf518da-8fc1-44b1-8f3c-4adff7a317fd tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:23.141403 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 959/1913] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:19:23.163904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdb19a-f1ed-43cd-9d7e-b696f522616f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:23.164220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdb19a-f1ed-43cd-9d7e-b696f522616f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:23.164479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdb19a-f1ed-43cd-9d7e-b696f522616f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:23.165921 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 960/1914] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:19:23.172669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdb19a-f1ed-43cd-9d7e-b696f522616f None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:19:23.227929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d26248-61ca-4905-828c-4cd209f59c5b tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:23.233590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdb19a-f1ed-43cd-9d7e-b696f522616f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:23.246417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdb19a-f1ed-43cd-9d7e-b696f522616f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:23.249732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6be104-6fd6-4b3c-96ae-3276cede6a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:23.253466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6be104-6fd6-4b3c-96ae-3276cede6a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:23.254249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6be104-6fd6-4b3c-96ae-3276cede6a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:23.254659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa9257-2c58-4a95-a22e-285547c35fe3 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173f8828fb6247da89b2bc5a79f8c087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1d463c5f4e1438ba47948cd79d2c228', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:23.255145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6be104-6fd6-4b3c-96ae-3276cede6a86 admin admin] PATH_INFO: `/v3/projects/7fbdbd4329bb440e8f4e06fcbcc0e785` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:23.255408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa9257-2c58-4a95-a22e-285547c35fe3 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:23.255693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa9257-2c58-4a95-a22e-285547c35fe3 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:23.255961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa9257-2c58-4a95-a22e-285547c35fe3 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] PATH_INFO: `/v3/projects/6d14472cfa31483498a0a037fb6c6cf3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:23.257798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa9257-2c58-4a95-a22e-285547c35fe3 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorizing `identity:get_project(project_id=6d14472cfa31483498a0a037fb6c6cf3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:23.257977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6be104-6fd6-4b3c-96ae-3276cede6a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fbdbd4329bb440e8f4e06fcbcc0e785)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:23.260332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa9257-2c58-4a95-a22e-285547c35fe3 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:23.261197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6be104-6fd6-4b3c-96ae-3276cede6a86 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:23.288612 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 961/1915] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:19:23 2022] GET /identity/v3/projects/6d14472cfa31483498a0a037fb6c6cf3 => generated 369 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:23.343610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1f6be104-6fd6-4b3c-96ae-3276cede6a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fbdbd4329bb440e8f4e06fcbcc0e785', 'request_id': 'req-1f6be104-6fd6-4b3c-96ae-3276cede6a86'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:23.362522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1f6be104-6fd6-4b3c-96ae-3276cede6a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fbdbd4329bb440e8f4e06fcbcc0e785', 'request_id': 'req-1f6be104-6fd6-4b3c-96ae-3276cede6a86'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:23.373664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1f6be104-6fd6-4b3c-96ae-3276cede6a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fbdbd4329bb440e8f4e06fcbcc0e785', 'request_id': 'req-1f6be104-6fd6-4b3c-96ae-3276cede6a86'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:23.436589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1f6be104-6fd6-4b3c-96ae-3276cede6a86 admin admin] The token cache is being invalidate because project 7fbdbd4329bb440e8f4e06fcbcc0e785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:23.437803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1f6be104-6fd6-4b3c-96ae-3276cede6a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:23.444572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1f6be104-6fd6-4b3c-96ae-3276cede6a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:23.470183 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 955/1916] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:22 2022] DELETE /identity/v3/projects/7fbdbd4329bb440e8f4e06fcbcc0e785 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:23.476423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1363-ba8b-41e8-9da4-580255d63542 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:23.477134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1363-ba8b-41e8-9da4-580255d63542 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:23.477624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1363-ba8b-41e8-9da4-580255d63542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:23.561597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f5ee1363-ba8b-41e8-9da4-580255d63542 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:23.563327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5ee1363-ba8b-41e8-9da4-580255d63542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:23.596294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934bf85-9e15-4e47-9e33-9f9ed58147a3 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:23.596948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934bf85-9e15-4e47-9e33-9f9ed58147a3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:23.597425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934bf85-9e15-4e47-9e33-9f9ed58147a3 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:23.599136 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 956/1917] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:19:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:19:23.621307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934bf85-9e15-4e47-9e33-9f9ed58147a3 None None] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:19:23.623823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6934bf85-9e15-4e47-9e33-9f9ed58147a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:23.783289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:23.784947 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 962/1918] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:23.798139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea529a-15ed-4804-92bd-4ab6f85dbbc9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:23.799127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea529a-15ed-4804-92bd-4ab6f85dbbc9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:23.800203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea529a-15ed-4804-92bd-4ab6f85dbbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:23.864169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934bf85-9e15-4e47-9e33-9f9ed58147a3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:23.866844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6934bf85-9e15-4e47-9e33-9f9ed58147a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:23.897513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-25ea529a-15ed-4804-92bd-4ab6f85dbbc9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:23.900501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-25ea529a-15ed-4804-92bd-4ab6f85dbbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:23.920954 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 963/1919] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:23.926375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea529a-15ed-4804-92bd-4ab6f85dbbc9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:23.939293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea529a-15ed-4804-92bd-4ab6f85dbbc9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:23.945841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dd2ef-8c4c-4ebb-916c-882049822e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:23.946875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dd2ef-8c4c-4ebb-916c-882049822e35 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:23.947561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dd2ef-8c4c-4ebb-916c-882049822e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:23.948477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dd2ef-8c4c-4ebb-916c-882049822e35 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:23.949451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dd2ef-8c4c-4ebb-916c-882049822e35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:23.949989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dd2ef-8c4c-4ebb-916c-882049822e35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:23.953300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dd2ef-8c4c-4ebb-916c-882049822e35 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:23.989394 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 964/1920] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:19:23.990655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dd2ef-8c4c-4ebb-916c-882049822e35 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:24.015333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dd2ef-8c4c-4ebb-916c-882049822e35 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:24.028669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ba1ef-4f54-4743-adeb-0628aad931dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:24.029289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934bf85-9e15-4e47-9e33-9f9ed58147a3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:24.030906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ba1ef-4f54-4743-adeb-0628aad931dd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:24.032439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ba1ef-4f54-4743-adeb-0628aad931dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:24.034085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ba1ef-4f54-4743-adeb-0628aad931dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:24.035510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ba1ef-4f54-4743-adeb-0628aad931dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:24.038552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd9cad-101d-499f-b4ef-5e2580a3a54e tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173f8828fb6247da89b2bc5a79f8c087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1d463c5f4e1438ba47948cd79d2c228', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:24.039385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd9cad-101d-499f-b4ef-5e2580a3a54e tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:24.039769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd9cad-101d-499f-b4ef-5e2580a3a54e tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:24.039974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd9cad-101d-499f-b4ef-5e2580a3a54e tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] PATH_INFO: `/v3/projects/6d14472cfa31483498a0a037fb6c6cf3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:24.046755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd9cad-101d-499f-b4ef-5e2580a3a54e tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorizing `identity:get_project(project_id=6d14472cfa31483498a0a037fb6c6cf3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:24.048667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ba1ef-4f54-4743-adeb-0628aad931dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:24.049430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd9cad-101d-499f-b4ef-5e2580a3a54e tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:24.051610 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 957/1921] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:19:23 2022] GET /identity/v3/projects/6d14472cfa31483498a0a037fb6c6cf3 => generated 369 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:24.093730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:24.141654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd9cad-101d-499f-b4ef-5e2580a3a54e tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:24.156421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd9cad-101d-499f-b4ef-5e2580a3a54e tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:24.168440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02829712-633e-427b-8b1c-55e4c77e3d5a tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173f8828fb6247da89b2bc5a79f8c087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1d463c5f4e1438ba47948cd79d2c228', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:24.169787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02829712-633e-427b-8b1c-55e4c77e3d5a tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:24.170361 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 965/1922] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:23 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:24.171199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02829712-633e-427b-8b1c-55e4c77e3d5a tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:24.172560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02829712-633e-427b-8b1c-55e4c77e3d5a tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] PATH_INFO: `/v3/users/eb424984c2a64dca9fbcb69337862a54` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:24.174248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ba1ef-4f54-4743-adeb-0628aad931dd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:24.211621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02829712-633e-427b-8b1c-55e4c77e3d5a tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorizing `identity:delete_user(user_id=eb424984c2a64dca9fbcb69337862a54)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:24.214053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02829712-633e-427b-8b1c-55e4c77e3d5a tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:24.366392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ba1ef-4f54-4743-adeb-0628aad931dd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:24.386655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ddd5e-acce-40d4-a672-1252dee3ea59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:24.387863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ddd5e-acce-40d4-a672-1252dee3ea59 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:24.388349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ddd5e-acce-40d4-a672-1252dee3ea59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:24.388846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ddd5e-acce-40d4-a672-1252dee3ea59 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:24.390140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ddd5e-acce-40d4-a672-1252dee3ea59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:24.392890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ddd5e-acce-40d4-a672-1252dee3ea59 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:24.403755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-02829712-633e-427b-8b1c-55e4c77e3d5a tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb424984c2a64dca9fbcb69337862a54'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:24.441504 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 966/1923] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:24 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:24.443737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ddd5e-acce-40d4-a672-1252dee3ea59 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:24.451750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-479ddd5e-acce-40d4-a672-1252dee3ea59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:24.460101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-02829712-633e-427b-8b1c-55e4c77e3d5a tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb424984c2a64dca9fbcb69337862a54'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:24.463124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-02829712-633e-427b-8b1c-55e4c77e3d5a tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb424984c2a64dca9fbcb69337862a54'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:24.464584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-02829712-633e-427b-8b1c-55e4c77e3d5a tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb424984c2a64dca9fbcb69337862a54'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:24.481157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-02829712-633e-427b-8b1c-55e4c77e3d5a tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb424984c2a64dca9fbcb69337862a54'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:24.487828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ddd5e-acce-40d4-a672-1252dee3ea59 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:24.498041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac99517-8d52-4900-9cb1-4715bd5144ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:24.500116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac99517-8d52-4900-9cb1-4715bd5144ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:24.501024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac99517-8d52-4900-9cb1-4715bd5144ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:24.501544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac99517-8d52-4900-9cb1-4715bd5144ae admin admin] PATH_INFO: `/v3/projects/f47bc0cfe90c4f9a8653971f892eecc1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:24.504072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac99517-8d52-4900-9cb1-4715bd5144ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=f47bc0cfe90c4f9a8653971f892eecc1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:24.506573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac99517-8d52-4900-9cb1-4715bd5144ae admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:24.510235 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 958/1924] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:24 2022] DELETE /identity/v3/users/eb424984c2a64dca9fbcb69337862a54 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:19:24.511246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02829712-633e-427b-8b1c-55e4c77e3d5a tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:24.513795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-02829712-633e-427b-8b1c-55e4c77e3d5a tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:24.630183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:24.671859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ac99517-8d52-4900-9cb1-4715bd5144ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f47bc0cfe90c4f9a8653971f892eecc1', 'request_id': 'req-9ac99517-8d52-4900-9cb1-4715bd5144ae'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:24.692284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ac99517-8d52-4900-9cb1-4715bd5144ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f47bc0cfe90c4f9a8653971f892eecc1', 'request_id': 'req-9ac99517-8d52-4900-9cb1-4715bd5144ae'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:24.707374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02829712-633e-427b-8b1c-55e4c77e3d5a tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:24.713481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ac99517-8d52-4900-9cb1-4715bd5144ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f47bc0cfe90c4f9a8653971f892eecc1', 'request_id': 'req-9ac99517-8d52-4900-9cb1-4715bd5144ae'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:24.759475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ac99517-8d52-4900-9cb1-4715bd5144ae admin admin] The token cache is being invalidate because project f47bc0cfe90c4f9a8653971f892eecc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:24.763985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ac99517-8d52-4900-9cb1-4715bd5144ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:24.765893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ac99517-8d52-4900-9cb1-4715bd5144ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:24.774237 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 967/1925] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:24 2022] DELETE /identity/v3/projects/f47bc0cfe90c4f9a8653971f892eecc1 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:24.775400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac99517-8d52-4900-9cb1-4715bd5144ae admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:24.777109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9ac99517-8d52-4900-9cb1-4715bd5144ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:24.887754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdac7d-5de3-4701-9c88-f325d8d6d8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:24.888528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdac7d-5de3-4701-9c88-f325d8d6d8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:24.889767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdac7d-5de3-4701-9c88-f325d8d6d8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:24.889767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdac7d-5de3-4701-9c88-f325d8d6d8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:24.890015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdac7d-5de3-4701-9c88-f325d8d6d8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:24.891648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdac7d-5de3-4701-9c88-f325d8d6d8d2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:24.919515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac99517-8d52-4900-9cb1-4715bd5144ae admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:24.920113 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 959/1926] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:24.921791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdac7d-5de3-4701-9c88-f325d8d6d8d2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:24.924643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-27cdac7d-5de3-4701-9c88-f325d8d6d8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:24.935008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c99f2-ea8f-407a-a692-cd010991c668 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173f8828fb6247da89b2bc5a79f8c087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1d463c5f4e1438ba47948cd79d2c228', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:24.936155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c99f2-ea8f-407a-a692-cd010991c668 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:24.939718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c99f2-ea8f-407a-a692-cd010991c668 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:24.940177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c99f2-ea8f-407a-a692-cd010991c668 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] PATH_INFO: `/v3/projects/6d14472cfa31483498a0a037fb6c6cf3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:24.944473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c99f2-ea8f-407a-a692-cd010991c668 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d14472cfa31483498a0a037fb6c6cf3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:24.951309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdac7d-5de3-4701-9c88-f325d8d6d8d2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:24.951771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c99f2-ea8f-407a-a692-cd010991c668 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:24.955091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:24.959032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab564a-f133-458a-b54b-dfae6692bdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:24.960356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab564a-f133-458a-b54b-dfae6692bdff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:24.960747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab564a-f133-458a-b54b-dfae6692bdff admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:24.961434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab564a-f133-458a-b54b-dfae6692bdff admin admin] PATH_INFO: `/v3/users/b3255c0dc2114f2291a3df856a297c3b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:24.963720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab564a-f133-458a-b54b-dfae6692bdff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3255c0dc2114f2291a3df856a297c3b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:24.970407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab564a-f133-458a-b54b-dfae6692bdff admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:25.072857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d33c99f2-ea8f-407a-a692-cd010991c668 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d14472cfa31483498a0a037fb6c6cf3', 'request_id': 'req-d33c99f2-ea8f-407a-a692-cd010991c668'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:25.088012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d33c99f2-ea8f-407a-a692-cd010991c668 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d14472cfa31483498a0a037fb6c6cf3', 'request_id': 'req-d33c99f2-ea8f-407a-a692-cd010991c668'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:25.104160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d33c99f2-ea8f-407a-a692-cd010991c668 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d14472cfa31483498a0a037fb6c6cf3', 'request_id': 'req-d33c99f2-ea8f-407a-a692-cd010991c668'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:25.105066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66ab564a-f133-458a-b54b-dfae6692bdff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3255c0dc2114f2291a3df856a297c3b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:25.128078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d33c99f2-ea8f-407a-a692-cd010991c668 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] The token cache is being invalidate because project 6d14472cfa31483498a0a037fb6c6cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:25.128307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d33c99f2-ea8f-407a-a692-cd010991c668 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:25.131812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d33c99f2-ea8f-407a-a692-cd010991c668 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:25.134485 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 968/1927] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:24 2022] DELETE /identity/v3/projects/6d14472cfa31483498a0a037fb6c6cf3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:25.135600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c99f2-ea8f-407a-a692-cd010991c668 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:25.138601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d33c99f2-ea8f-407a-a692-cd010991c668 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:25.141261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66ab564a-f133-458a-b54b-dfae6692bdff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3255c0dc2114f2291a3df856a297c3b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:25.143743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66ab564a-f133-458a-b54b-dfae6692bdff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3255c0dc2114f2291a3df856a297c3b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:25.147765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66ab564a-f133-458a-b54b-dfae6692bdff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3255c0dc2114f2291a3df856a297c3b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:25.165201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66ab564a-f133-458a-b54b-dfae6692bdff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3255c0dc2114f2291a3df856a297c3b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:25.203850 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 960/1928] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:24 2022] DELETE /identity/v3/users/b3255c0dc2114f2291a3df856a297c3b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:25.206042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab564a-f133-458a-b54b-dfae6692bdff admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:25.212244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-66ab564a-f133-458a-b54b-dfae6692bdff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:25.338325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c99f2-ea8f-407a-a692-cd010991c668 tempest-QuotasAdminTestV236-716144208 tempest-QuotasAdminTestV236-716144208-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:25.392532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:25.416223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab564a-f133-458a-b54b-dfae6692bdff admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:25.430474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd63fd5-ae9a-4f4c-8203-a430e8e2d52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:25.431441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd63fd5-ae9a-4f4c-8203-a430e8e2d52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:25.431812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd63fd5-ae9a-4f4c-8203-a430e8e2d52f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:25.432279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd63fd5-ae9a-4f4c-8203-a430e8e2d52f admin admin] PATH_INFO: `/v3/users/cbce2cccc2c646bd94d3405957c1b212` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:25.435114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd63fd5-ae9a-4f4c-8203-a430e8e2d52f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbce2cccc2c646bd94d3405957c1b212)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:25.440695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd63fd5-ae9a-4f4c-8203-a430e8e2d52f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:25.523573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d784ed0-20a8-46cc-804d-35e8cc2a5157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:25.532848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d784ed0-20a8-46cc-804d-35e8cc2a5157 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:25.533222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d784ed0-20a8-46cc-804d-35e8cc2a5157 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:25.536394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d784ed0-20a8-46cc-804d-35e8cc2a5157 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:25.538256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d784ed0-20a8-46cc-804d-35e8cc2a5157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:25.547088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d784ed0-20a8-46cc-804d-35e8cc2a5157 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:25.593807 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 969/1929] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:25.598775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d784ed0-20a8-46cc-804d-35e8cc2a5157 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:25.607153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3cd63fd5-ae9a-4f4c-8203-a430e8e2d52f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbce2cccc2c646bd94d3405957c1b212'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:25.608372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d784ed0-20a8-46cc-804d-35e8cc2a5157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:25.643630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3cd63fd5-ae9a-4f4c-8203-a430e8e2d52f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbce2cccc2c646bd94d3405957c1b212'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:25.645293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3cd63fd5-ae9a-4f4c-8203-a430e8e2d52f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbce2cccc2c646bd94d3405957c1b212'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:25.646371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3cd63fd5-ae9a-4f4c-8203-a430e8e2d52f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbce2cccc2c646bd94d3405957c1b212'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:25.648850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d784ed0-20a8-46cc-804d-35e8cc2a5157 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:25.666159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920c318-c940-4cb8-980e-36e92def844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:25.667911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920c318-c940-4cb8-980e-36e92def844c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:25.668429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920c318-c940-4cb8-980e-36e92def844c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:25.668902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920c318-c940-4cb8-980e-36e92def844c admin admin] PATH_INFO: `/v3/projects/049146327a654bb5975dda4755d56507/users/65fabea7e46f422c8e9ed95f863e97da/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:25.672914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3cd63fd5-ae9a-4f4c-8203-a430e8e2d52f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbce2cccc2c646bd94d3405957c1b212'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:25.705971 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 961/1930] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:25 2022] DELETE /identity/v3/users/cbce2cccc2c646bd94d3405957c1b212 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:25.712411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685f5a9-a133-4639-a416-601ea2a6de50 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:25.712992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685f5a9-a133-4639-a416-601ea2a6de50 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:25.713437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685f5a9-a133-4639-a416-601ea2a6de50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:25.741311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920c318-c940-4cb8-980e-36e92def844c admin admin] RBAC: Authorizing `identity:create_grant(project_id=049146327a654bb5975dda4755d56507, user_id=65fabea7e46f422c8e9ed95f863e97da, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:25.751349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920c318-c940-4cb8-980e-36e92def844c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:25.784847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7685f5a9-a133-4639-a416-601ea2a6de50 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:25.787407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7685f5a9-a133-4639-a416-601ea2a6de50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:25.812155 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 970/1931] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:25 2022] PUT /identity/v3/projects/049146327a654bb5975dda4755d56507/users/65fabea7e46f422c8e9ed95f863e97da/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:19:25.816423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e166c4d-fb97-4b98-a2b4-6bdd52671cf5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:25.817021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e166c4d-fb97-4b98-a2b4-6bdd52671cf5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:25.817595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e166c4d-fb97-4b98-a2b4-6bdd52671cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:25.856237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:25.878537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7e166c4d-fb97-4b98-a2b4-6bdd52671cf5 None None] MFA Rules not processed for user `65fabea7e46f422c8e9ed95f863e97da`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:25.881917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7e166c4d-fb97-4b98-a2b4-6bdd52671cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:25.946319 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 962/1932] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:26.044423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685f5a9-a133-4639-a416-601ea2a6de50 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:26.059971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7685f5a9-a133-4639-a416-601ea2a6de50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:26.124272 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 971/1933] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:26.125328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e166c4d-fb97-4b98-a2b4-6bdd52671cf5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:26.127285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7e166c4d-fb97-4b98-a2b4-6bdd52671cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:26.176597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e166c4d-fb97-4b98-a2b4-6bdd52671cf5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:26.200424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02e363-4717-4db6-b475-c901c28da1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:26.201502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02e363-4717-4db6-b475-c901c28da1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:26.201959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02e363-4717-4db6-b475-c901c28da1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:26.211594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02e363-4717-4db6-b475-c901c28da1a4 admin admin] PATH_INFO: `/v3/projects/b2bc7da4e3c84cd4873ebd46f590026c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:26.217910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02e363-4717-4db6-b475-c901c28da1a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2bc7da4e3c84cd4873ebd46f590026c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:26.227279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02e363-4717-4db6-b475-c901c28da1a4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:26.236460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685f5a9-a133-4639-a416-601ea2a6de50 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:26.241400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c9372-e2c0-4545-91f6-d98f2e68a7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:26.242623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c9372-e2c0-4545-91f6-d98f2e68a7fa service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:26.243124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c9372-e2c0-4545-91f6-d98f2e68a7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:26.243639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c9372-e2c0-4545-91f6-d98f2e68a7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:26.266461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c9372-e2c0-4545-91f6-d98f2e68a7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:26.271306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c9372-e2c0-4545-91f6-d98f2e68a7fa service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:26.296777 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 963/1934] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:19:26.302391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c9372-e2c0-4545-91f6-d98f2e68a7fa service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:26.306779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8d1c9372-e2c0-4545-91f6-d98f2e68a7fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:26.346888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c9372-e2c0-4545-91f6-d98f2e68a7fa service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:26.369370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43043c27-a640-4a21-9d39-5f0067cc237c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:26.371803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43043c27-a640-4a21-9d39-5f0067cc237c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:26.372935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43043c27-a640-4a21-9d39-5f0067cc237c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:26.374121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43043c27-a640-4a21-9d39-5f0067cc237c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:26.375209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43043c27-a640-4a21-9d39-5f0067cc237c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:26.393003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43043c27-a640-4a21-9d39-5f0067cc237c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:26.418857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf02e363-4717-4db6-b475-c901c28da1a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2bc7da4e3c84cd4873ebd46f590026c', 'request_id': 'req-bf02e363-4717-4db6-b475-c901c28da1a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:26.442449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf02e363-4717-4db6-b475-c901c28da1a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2bc7da4e3c84cd4873ebd46f590026c', 'request_id': 'req-bf02e363-4717-4db6-b475-c901c28da1a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:26.450332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf02e363-4717-4db6-b475-c901c28da1a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2bc7da4e3c84cd4873ebd46f590026c', 'request_id': 'req-bf02e363-4717-4db6-b475-c901c28da1a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:26.484825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf02e363-4717-4db6-b475-c901c28da1a4 admin admin] The token cache is being invalidate because project b2bc7da4e3c84cd4873ebd46f590026c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:26.485208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf02e363-4717-4db6-b475-c901c28da1a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:26.489977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf02e363-4717-4db6-b475-c901c28da1a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:26.494353 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 972/1935] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:26 2022] DELETE /identity/v3/projects/b2bc7da4e3c84cd4873ebd46f590026c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:26.495562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34d246-42e1-4cc5-b447-ef220c43b590 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:26.495907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34d246-42e1-4cc5-b447-ef220c43b590 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:26.496250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34d246-42e1-4cc5-b447-ef220c43b590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:26.511896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:26.548592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bc34d246-42e1-4cc5-b447-ef220c43b590 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:26.555589 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 964/1936] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:26 2022] POST /identity/v3/projects => generated 387 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:26.556878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43043c27-a640-4a21-9d39-5f0067cc237c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:26.559604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bc34d246-42e1-4cc5-b447-ef220c43b590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:26.564460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-43043c27-a640-4a21-9d39-5f0067cc237c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:26.679701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43043c27-a640-4a21-9d39-5f0067cc237c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:26.693653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de809c-5e98-426e-9f04-732df863e827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:26.694432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de809c-5e98-426e-9f04-732df863e827 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:26.694748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de809c-5e98-426e-9f04-732df863e827 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:26.695024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de809c-5e98-426e-9f04-732df863e827 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:26.695751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de809c-5e98-426e-9f04-732df863e827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:26.709353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de809c-5e98-426e-9f04-732df863e827 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:26.763500 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 965/1937] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:26 2022] POST /identity/v3/users => generated 300 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:26.767529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de809c-5e98-426e-9f04-732df863e827 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:26.789784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de809c-5e98-426e-9f04-732df863e827 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:26.812587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8d4ee-2525-40f2-b3aa-d4c29b4a45fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:26.813228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8d4ee-2525-40f2-b3aa-d4c29b4a45fb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:26.813721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8d4ee-2525-40f2-b3aa-d4c29b4a45fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:26.813926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8d4ee-2525-40f2-b3aa-d4c29b4a45fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:26.814644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8d4ee-2525-40f2-b3aa-d4c29b4a45fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:26.816814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8d4ee-2525-40f2-b3aa-d4c29b4a45fb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:26.834328 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 966/1938] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:26.835597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8d4ee-2525-40f2-b3aa-d4c29b4a45fb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:26.844513 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 973/1939] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:26.851429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8d4ee-2525-40f2-b3aa-d4c29b4a45fb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:26.856778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ff351-29cc-4a31-8c11-b1b9d553c152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:26.857334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddd756-6d06-4a9a-b602-a7410a5a5afa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:26.857565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ff351-29cc-4a31-8c11-b1b9d553c152 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:26.857845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ff351-29cc-4a31-8c11-b1b9d553c152 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:26.858024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddd756-6d06-4a9a-b602-a7410a5a5afa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:26.858141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ff351-29cc-4a31-8c11-b1b9d553c152 admin admin] PATH_INFO: `/v3/projects/b3ad866fafcf46b58caabb6ee6ece641/users/175db8a1c2204bca89aaa2ca599ca6fd/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:26.858599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddd756-6d06-4a9a-b602-a7410a5a5afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:26.878753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ff351-29cc-4a31-8c11-b1b9d553c152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ad866fafcf46b58caabb6ee6ece641, user_id=175db8a1c2204bca89aaa2ca599ca6fd, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:26.882093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ff351-29cc-4a31-8c11-b1b9d553c152 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:26.898217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-eaddd756-6d06-4a9a-b602-a7410a5a5afa None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:26.899854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eaddd756-6d06-4a9a-b602-a7410a5a5afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:26.927984 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 967/1940] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:26 2022] PUT /identity/v3/projects/b3ad866fafcf46b58caabb6ee6ece641/users/175db8a1c2204bca89aaa2ca599ca6fd/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:26.934054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ff351-29cc-4a31-8c11-b1b9d553c152 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:26.935755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:27.027435 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 974/1941] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:27.029110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddd756-6d06-4a9a-b602-a7410a5a5afa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:27.043440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddd756-6d06-4a9a-b602-a7410a5a5afa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:27.048627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ff351-29cc-4a31-8c11-b1b9d553c152 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:27.054087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb8f48-cb57-45a0-8f3e-37066eb6e7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:27.055572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7927ce8-a79f-43a8-8085-4ca20f8d6df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:27.056140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb8f48-cb57-45a0-8f3e-37066eb6e7da admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:27.056468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7927ce8-a79f-43a8-8085-4ca20f8d6df0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:27.056754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7927ce8-a79f-43a8-8085-4ca20f8d6df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:27.056996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb8f48-cb57-45a0-8f3e-37066eb6e7da admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:27.057121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7927ce8-a79f-43a8-8085-4ca20f8d6df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:27.057574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb8f48-cb57-45a0-8f3e-37066eb6e7da admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:27.057866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7927ce8-a79f-43a8-8085-4ca20f8d6df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:27.058684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb8f48-cb57-45a0-8f3e-37066eb6e7da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:27.059820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb8f48-cb57-45a0-8f3e-37066eb6e7da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:27.059945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7927ce8-a79f-43a8-8085-4ca20f8d6df0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:27.064121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb8f48-cb57-45a0-8f3e-37066eb6e7da admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:27.077365 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 968/1942] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:27.078081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7927ce8-a79f-43a8-8085-4ca20f8d6df0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:27.097659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7927ce8-a79f-43a8-8085-4ca20f8d6df0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:27.104040 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 975/1943] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:27.105867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb8f48-cb57-45a0-8f3e-37066eb6e7da admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:27.131900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e7a72-739b-4ef1-a216-8442f48d124b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:27.133395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e7a72-739b-4ef1-a216-8442f48d124b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:27.135958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e7a72-739b-4ef1-a216-8442f48d124b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:27.136896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e7a72-739b-4ef1-a216-8442f48d124b admin admin] PATH_INFO: `/v3/projects/b3ad866fafcf46b58caabb6ee6ece641/users/175db8a1c2204bca89aaa2ca599ca6fd/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:27.140596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb8f48-cb57-45a0-8f3e-37066eb6e7da admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:27.141930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e7a72-739b-4ef1-a216-8442f48d124b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ad866fafcf46b58caabb6ee6ece641, user_id=175db8a1c2204bca89aaa2ca599ca6fd, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:27.154902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e7a72-739b-4ef1-a216-8442f48d124b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:27.161875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01291d5-b2d1-4f74-a168-8d21c908a87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:27.163268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01291d5-b2d1-4f74-a168-8d21c908a87a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:27.164012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01291d5-b2d1-4f74-a168-8d21c908a87a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:27.169222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01291d5-b2d1-4f74-a168-8d21c908a87a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:27.170493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01291d5-b2d1-4f74-a168-8d21c908a87a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:27.176234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01291d5-b2d1-4f74-a168-8d21c908a87a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:27.196597 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 969/1944] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:27 2022] PUT /identity/v3/projects/b3ad866fafcf46b58caabb6ee6ece641/users/175db8a1c2204bca89aaa2ca599ca6fd/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:27.207673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94214226-04aa-421b-8b1e-9e7ef2a1745d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:27.208505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94214226-04aa-421b-8b1e-9e7ef2a1745d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:27.209141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94214226-04aa-421b-8b1e-9e7ef2a1745d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:27.281080 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 976/1945] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:27 2022] POST /identity/v3/projects => generated 409 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:27.283459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01291d5-b2d1-4f74-a168-8d21c908a87a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:27.392553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-94214226-04aa-421b-8b1e-9e7ef2a1745d None None] MFA Rules not processed for user `175db8a1c2204bca89aaa2ca599ca6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:27.399806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-94214226-04aa-421b-8b1e-9e7ef2a1745d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:27.465708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:27.493015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01291d5-b2d1-4f74-a168-8d21c908a87a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:27.513917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f0fc7-95e0-4585-9247-06c97c86efd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:27.514556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f0fc7-95e0-4585-9247-06c97c86efd2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:27.514829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f0fc7-95e0-4585-9247-06c97c86efd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:27.515095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f0fc7-95e0-4585-9247-06c97c86efd2 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:27.515806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f0fc7-95e0-4585-9247-06c97c86efd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:27.517803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f0fc7-95e0-4585-9247-06c97c86efd2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:27.557535 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 977/1946] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:27 2022] POST /identity/v3/users => generated 305 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:27.561876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f0fc7-95e0-4585-9247-06c97c86efd2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:27.578512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f0fc7-95e0-4585-9247-06c97c86efd2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:27.590335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cba78-f530-4c68-b2f4-2fa0d0312278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:27.590971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cba78-f530-4c68-b2f4-2fa0d0312278 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:27.591275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cba78-f530-4c68-b2f4-2fa0d0312278 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:27.591546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cba78-f530-4c68-b2f4-2fa0d0312278 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:27.593212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cba78-f530-4c68-b2f4-2fa0d0312278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:27.594707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cba78-f530-4c68-b2f4-2fa0d0312278 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:27.612891 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 970/1947] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:27 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:19:27.615128 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 978/1948] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:27.616714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94214226-04aa-421b-8b1e-9e7ef2a1745d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:27.623965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cba78-f530-4c68-b2f4-2fa0d0312278 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:27.628600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc5cba78-f530-4c68-b2f4-2fa0d0312278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:27.630415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94214226-04aa-421b-8b1e-9e7ef2a1745d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:27.638876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd993d5-88e6-451c-8336-f8e4eef152e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:27.639598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd993d5-88e6-451c-8336-f8e4eef152e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:27.640255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd993d5-88e6-451c-8336-f8e4eef152e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:27.641409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd993d5-88e6-451c-8336-f8e4eef152e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:27.647187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd993d5-88e6-451c-8336-f8e4eef152e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:27.647187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd993d5-88e6-451c-8336-f8e4eef152e7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:27.660032 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 971/1949] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:27.664407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd993d5-88e6-451c-8336-f8e4eef152e7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:27.680643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd993d5-88e6-451c-8336-f8e4eef152e7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:27.686996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79717a9b-c879-425e-a81a-24001b448250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:27.688108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79717a9b-c879-425e-a81a-24001b448250 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:27.688531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79717a9b-c879-425e-a81a-24001b448250 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:27.688909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79717a9b-c879-425e-a81a-24001b448250 admin admin] PATH_INFO: `/v3/projects/26663ee761264eccb53bf83ef10ef2c0/users/a7f0dd7f615f422c95b41a49c35cccc3/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:27.724503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79717a9b-c879-425e-a81a-24001b448250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26663ee761264eccb53bf83ef10ef2c0, user_id=a7f0dd7f615f422c95b41a49c35cccc3, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:27.730193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79717a9b-c879-425e-a81a-24001b448250 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:27.759176 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 972/1950] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:27 2022] PUT /identity/v3/projects/26663ee761264eccb53bf83ef10ef2c0/users/a7f0dd7f615f422c95b41a49c35cccc3/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:27.759894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:27.765199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cba78-f530-4c68-b2f4-2fa0d0312278 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:27.772811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79717a9b-c879-425e-a81a-24001b448250 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:27.774243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-79717a9b-c879-425e-a81a-24001b448250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:27.873445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79717a9b-c879-425e-a81a-24001b448250 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:27.893107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ea704-fadb-4004-9c74-8a29fc6d7467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:27.893777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ea704-fadb-4004-9c74-8a29fc6d7467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:27.894064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ea704-fadb-4004-9c74-8a29fc6d7467 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:27.894337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ea704-fadb-4004-9c74-8a29fc6d7467 admin admin] PATH_INFO: `/v3/projects/a412320a2f8c4a61a464515096f9a319` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:27.895594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ea704-fadb-4004-9c74-8a29fc6d7467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a412320a2f8c4a61a464515096f9a319)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:27.897537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ea704-fadb-4004-9c74-8a29fc6d7467 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:27.914417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1c738-c9aa-40dd-ab95-00d083d7291b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:27.915186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1c738-c9aa-40dd-ab95-00d083d7291b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:27.915899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1c738-c9aa-40dd-ab95-00d083d7291b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:27.916298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1c738-c9aa-40dd-ab95-00d083d7291b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:28.005041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-655ea704-fadb-4004-9c74-8a29fc6d7467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a412320a2f8c4a61a464515096f9a319', 'request_id': 'req-655ea704-fadb-4004-9c74-8a29fc6d7467'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:28.020489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1c738-c9aa-40dd-ab95-00d083d7291b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:28.022171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1c738-c9aa-40dd-ab95-00d083d7291b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:28.024937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-655ea704-fadb-4004-9c74-8a29fc6d7467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a412320a2f8c4a61a464515096f9a319', 'request_id': 'req-655ea704-fadb-4004-9c74-8a29fc6d7467'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:28.038984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-655ea704-fadb-4004-9c74-8a29fc6d7467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a412320a2f8c4a61a464515096f9a319', 'request_id': 'req-655ea704-fadb-4004-9c74-8a29fc6d7467'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:28.055145 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 979/1951] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:27 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:19:28.057286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b7f72-dfd7-48ac-afbc-de4b279c7f52 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:28.059942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b7f72-dfd7-48ac-afbc-de4b279c7f52 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:28.060260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b7f72-dfd7-48ac-afbc-de4b279c7f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:28.065314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-655ea704-fadb-4004-9c74-8a29fc6d7467 admin admin] The token cache is being invalidate because project a412320a2f8c4a61a464515096f9a319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:28.065314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-655ea704-fadb-4004-9c74-8a29fc6d7467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:28.066326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-655ea704-fadb-4004-9c74-8a29fc6d7467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:28.069769 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 973/1952] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:27 2022] DELETE /identity/v3/projects/a412320a2f8c4a61a464515096f9a319 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:28.073822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ea704-fadb-4004-9c74-8a29fc6d7467 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:28.076770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-655ea704-fadb-4004-9c74-8a29fc6d7467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:28.100664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:28.124658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-980b7f72-dfd7-48ac-afbc-de4b279c7f52 None None] MFA Rules not processed for user `a7f0dd7f615f422c95b41a49c35cccc3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:28.126892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-980b7f72-dfd7-48ac-afbc-de4b279c7f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:28.204355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ea704-fadb-4004-9c74-8a29fc6d7467 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:28.212789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de63a47-cba5-41a4-bd73-94d02ee552bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:28.213462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de63a47-cba5-41a4-bd73-94d02ee552bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:28.213740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de63a47-cba5-41a4-bd73-94d02ee552bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:28.214015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de63a47-cba5-41a4-bd73-94d02ee552bd admin admin] PATH_INFO: `/v3/users/173f8828fb6247da89b2bc5a79f8c087` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:28.215672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de63a47-cba5-41a4-bd73-94d02ee552bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=173f8828fb6247da89b2bc5a79f8c087)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:28.217643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de63a47-cba5-41a4-bd73-94d02ee552bd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:28.252638 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 980/1953] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:28 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:28.253779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b7f72-dfd7-48ac-afbc-de4b279c7f52 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:28.256056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-980b7f72-dfd7-48ac-afbc-de4b279c7f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:28.308456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:28.332087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7de63a47-cba5-41a4-bd73-94d02ee552bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173f8828fb6247da89b2bc5a79f8c087'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:28.361488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7de63a47-cba5-41a4-bd73-94d02ee552bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173f8828fb6247da89b2bc5a79f8c087'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:28.362396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7de63a47-cba5-41a4-bd73-94d02ee552bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173f8828fb6247da89b2bc5a79f8c087'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:28.363130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7de63a47-cba5-41a4-bd73-94d02ee552bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173f8828fb6247da89b2bc5a79f8c087'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:28.382142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b7f72-dfd7-48ac-afbc-de4b279c7f52 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:28.383893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7de63a47-cba5-41a4-bd73-94d02ee552bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173f8828fb6247da89b2bc5a79f8c087'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:28.394890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4610ce9-0de8-40e1-bfc3-c1304acc96fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:28.395731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4610ce9-0de8-40e1-bfc3-c1304acc96fa service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:28.396012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4610ce9-0de8-40e1-bfc3-c1304acc96fa service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:28.398943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4610ce9-0de8-40e1-bfc3-c1304acc96fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:28.403227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4610ce9-0de8-40e1-bfc3-c1304acc96fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:28.441135 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 974/1954] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:28 2022] DELETE /identity/v3/users/173f8828fb6247da89b2bc5a79f8c087 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:28.448606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de63a47-cba5-41a4-bd73-94d02ee552bd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:28.452719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7de63a47-cba5-41a4-bd73-94d02ee552bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:28.544460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4610ce9-0de8-40e1-bfc3-c1304acc96fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:28.546132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4610ce9-0de8-40e1-bfc3-c1304acc96fa service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:28.577698 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 981/1955] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:28.608539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de63a47-cba5-41a4-bd73-94d02ee552bd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:28.622007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fda81-4db8-4212-9c32-643f9e974f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:28.622699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fda81-4db8-4212-9c32-643f9e974f9d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:28.622903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fda81-4db8-4212-9c32-643f9e974f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:28.623174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fda81-4db8-4212-9c32-643f9e974f9d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:28.624843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fda81-4db8-4212-9c32-643f9e974f9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:28.627637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fda81-4db8-4212-9c32-643f9e974f9d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:28.679750 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 975/1956] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:28 2022] POST /identity/v3/projects => generated 407 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:28.686106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4610ce9-0de8-40e1-bfc3-c1304acc96fa service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:28.702494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4610ce9-0de8-40e1-bfc3-c1304acc96fa service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:28.856701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86c5ec-2837-4cd8-8490-53fb52fc6949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:28.857682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86c5ec-2837-4cd8-8490-53fb52fc6949 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:28.858034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86c5ec-2837-4cd8-8490-53fb52fc6949 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:28.859502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86c5ec-2837-4cd8-8490-53fb52fc6949 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:28.860696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86c5ec-2837-4cd8-8490-53fb52fc6949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:28.863213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86c5ec-2837-4cd8-8490-53fb52fc6949 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:28.915332 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 982/1957] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:28 2022] POST /identity/v3/users => generated 310 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:28.918941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fda81-4db8-4212-9c32-643f9e974f9d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:28.951641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fda81-4db8-4212-9c32-643f9e974f9d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:28.964862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc53d56-f1c3-47c6-84db-2bdec60c6019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:28.965501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc53d56-f1c3-47c6-84db-2bdec60c6019 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:28.967817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc53d56-f1c3-47c6-84db-2bdec60c6019 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:28.968102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc53d56-f1c3-47c6-84db-2bdec60c6019 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:28.968786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc53d56-f1c3-47c6-84db-2bdec60c6019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:28.971456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc53d56-f1c3-47c6-84db-2bdec60c6019 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:29.012391 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 976/1958] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:19:29.016572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86c5ec-2837-4cd8-8490-53fb52fc6949 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:29.046469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86c5ec-2837-4cd8-8490-53fb52fc6949 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:29.058021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70744af6-2142-4535-80d2-40fe1a03d91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:29.058984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70744af6-2142-4535-80d2-40fe1a03d91f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:29.059487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70744af6-2142-4535-80d2-40fe1a03d91f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:29.059999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70744af6-2142-4535-80d2-40fe1a03d91f admin admin] PATH_INFO: `/v3/projects/18b820b6d3664ae1a8f61b6b7559379b/users/b4534750715e48b0b650480ad4f9ef37/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:29.091814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70744af6-2142-4535-80d2-40fe1a03d91f admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b820b6d3664ae1a8f61b6b7559379b, user_id=b4534750715e48b0b650480ad4f9ef37, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:29.099238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70744af6-2142-4535-80d2-40fe1a03d91f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:29.131163 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 983/1959] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:29 2022] PUT /identity/v3/projects/18b820b6d3664ae1a8f61b6b7559379b/users/b4534750715e48b0b650480ad4f9ef37/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:29.132378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc53d56-f1c3-47c6-84db-2bdec60c6019 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:29.139529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:29.165073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc53d56-f1c3-47c6-84db-2bdec60c6019 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:29.280491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70744af6-2142-4535-80d2-40fe1a03d91f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:29.283036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-70744af6-2142-4535-80d2-40fe1a03d91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:29.306294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771d53a-e433-4f35-85ea-5ebf3c94fd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:29.311350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771d53a-e433-4f35-85ea-5ebf3c94fd9d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:29.312396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771d53a-e433-4f35-85ea-5ebf3c94fd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:29.314034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771d53a-e433-4f35-85ea-5ebf3c94fd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:29.314144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771d53a-e433-4f35-85ea-5ebf3c94fd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:29.326506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771d53a-e433-4f35-85ea-5ebf3c94fd9d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:29.373008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:29.375731 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 977/1960] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:29.376540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771d53a-e433-4f35-85ea-5ebf3c94fd9d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:29.382794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b771d53a-e433-4f35-85ea-5ebf3c94fd9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:29.396885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771d53a-e433-4f35-85ea-5ebf3c94fd9d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:29.402468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966440ed-198b-43e3-ac98-21b8999a46a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:29.403110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966440ed-198b-43e3-ac98-21b8999a46a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:29.403425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966440ed-198b-43e3-ac98-21b8999a46a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:29.403701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966440ed-198b-43e3-ac98-21b8999a46a3 admin admin] PATH_INFO: `/v3/users/65fabea7e46f422c8e9ed95f863e97da` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:29.404892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966440ed-198b-43e3-ac98-21b8999a46a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65fabea7e46f422c8e9ed95f863e97da)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:29.407017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966440ed-198b-43e3-ac98-21b8999a46a3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:29.434439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70744af6-2142-4535-80d2-40fe1a03d91f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:29.440278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e9dfd-ecdc-4d59-a4e4-872aa01dc7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:29.440885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e9dfd-ecdc-4d59-a4e4-872aa01dc7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:29.441173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e9dfd-ecdc-4d59-a4e4-872aa01dc7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:29.441451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e9dfd-ecdc-4d59-a4e4-872aa01dc7cb admin admin] PATH_INFO: `/v3/projects/a1d463c5f4e1438ba47948cd79d2c228` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:29.451597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e9dfd-ecdc-4d59-a4e4-872aa01dc7cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d463c5f4e1438ba47948cd79d2c228)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:29.453917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e9dfd-ecdc-4d59-a4e4-872aa01dc7cb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:29.494527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-966440ed-198b-43e3-ac98-21b8999a46a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65fabea7e46f422c8e9ed95f863e97da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:29.517889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-966440ed-198b-43e3-ac98-21b8999a46a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65fabea7e46f422c8e9ed95f863e97da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:29.518718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-966440ed-198b-43e3-ac98-21b8999a46a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65fabea7e46f422c8e9ed95f863e97da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:29.519385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-966440ed-198b-43e3-ac98-21b8999a46a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65fabea7e46f422c8e9ed95f863e97da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:29.530647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-966440ed-198b-43e3-ac98-21b8999a46a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65fabea7e46f422c8e9ed95f863e97da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:29.542065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a3e9dfd-ecdc-4d59-a4e4-872aa01dc7cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d463c5f4e1438ba47948cd79d2c228', 'request_id': 'req-1a3e9dfd-ecdc-4d59-a4e4-872aa01dc7cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:29.558018 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 978/1961] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:29 2022] DELETE /identity/v3/users/65fabea7e46f422c8e9ed95f863e97da => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:29.558018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966440ed-198b-43e3-ac98-21b8999a46a3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:29.558018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-966440ed-198b-43e3-ac98-21b8999a46a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:29.573959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a3e9dfd-ecdc-4d59-a4e4-872aa01dc7cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d463c5f4e1438ba47948cd79d2c228', 'request_id': 'req-1a3e9dfd-ecdc-4d59-a4e4-872aa01dc7cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:29.588332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a3e9dfd-ecdc-4d59-a4e4-872aa01dc7cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d463c5f4e1438ba47948cd79d2c228', 'request_id': 'req-1a3e9dfd-ecdc-4d59-a4e4-872aa01dc7cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:29.613354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a3e9dfd-ecdc-4d59-a4e4-872aa01dc7cb admin admin] The token cache is being invalidate because project a1d463c5f4e1438ba47948cd79d2c228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:29.614067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a3e9dfd-ecdc-4d59-a4e4-872aa01dc7cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:29.615320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a3e9dfd-ecdc-4d59-a4e4-872aa01dc7cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:29.623293 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 984/1962] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:29 2022] DELETE /identity/v3/projects/a1d463c5f4e1438ba47948cd79d2c228 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:29.625676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b10b2-e3b5-4c7b-b064-269cc822eefb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:29.625880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b10b2-e3b5-4c7b-b064-269cc822eefb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:29.626252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b10b2-e3b5-4c7b-b064-269cc822eefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:29.651420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ef1b10b2-e3b5-4c7b-b064-269cc822eefb None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:29.652809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef1b10b2-e3b5-4c7b-b064-269cc822eefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:29.672334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966440ed-198b-43e3-ac98-21b8999a46a3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:29.678630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a48f4-7dec-4aa6-aad8-c8d934f423fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:29.680489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a48f4-7dec-4aa6-aad8-c8d934f423fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:29.680975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a48f4-7dec-4aa6-aad8-c8d934f423fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:29.681666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a48f4-7dec-4aa6-aad8-c8d934f423fd admin admin] PATH_INFO: `/v3/projects/18b820b6d3664ae1a8f61b6b7559379b/users/b4534750715e48b0b650480ad4f9ef37/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:29.684012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a48f4-7dec-4aa6-aad8-c8d934f423fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b820b6d3664ae1a8f61b6b7559379b, user_id=b4534750715e48b0b650480ad4f9ef37, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:29.688047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a48f4-7dec-4aa6-aad8-c8d934f423fd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:29.702573 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 979/1963] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:29 2022] PUT /identity/v3/projects/18b820b6d3664ae1a8f61b6b7559379b/users/b4534750715e48b0b650480ad4f9ef37/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:29.704068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c50d8b-e014-4f8a-b3f0-c350daeda452 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:29.705468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c50d8b-e014-4f8a-b3f0-c350daeda452 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:29.705847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c50d8b-e014-4f8a-b3f0-c350daeda452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:29.724319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:29.736443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b6c50d8b-e014-4f8a-b3f0-c350daeda452 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:29.739239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b6c50d8b-e014-4f8a-b3f0-c350daeda452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:29.786947 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 985/1964] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:29.788647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e44e1-a4a3-4011-94c6-b95876ce088e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:29.789672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e44e1-a4a3-4011-94c6-b95876ce088e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:29.789967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e44e1-a4a3-4011-94c6-b95876ce088e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:29.848273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-db5e44e1-a4a3-4011-94c6-b95876ce088e None None] MFA Rules not processed for user `b4534750715e48b0b650480ad4f9ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:29.852125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db5e44e1-a4a3-4011-94c6-b95876ce088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:29.859024 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 980/1965] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:29.860070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c50d8b-e014-4f8a-b3f0-c350daeda452 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:29.861766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b6c50d8b-e014-4f8a-b3f0-c350daeda452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:29.944770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:29.973252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c50d8b-e014-4f8a-b3f0-c350daeda452 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:29.977770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e864e1b-7d8a-4c36-89d5-a604bb60d4e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:29.978572 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 986/1966] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:29 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:29.983529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958f44d-5c61-4fa2-9f24-313cd1c7ac98 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:29.983813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958f44d-5c61-4fa2-9f24-313cd1c7ac98 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:29.984089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958f44d-5c61-4fa2-9f24-313cd1c7ac98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:29.986085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e864e1b-7d8a-4c36-89d5-a604bb60d4e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:29.986532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e864e1b-7d8a-4c36-89d5-a604bb60d4e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:29.986893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e864e1b-7d8a-4c36-89d5-a604bb60d4e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:30.001296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e864e1b-7d8a-4c36-89d5-a604bb60d4e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:30.003363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e864e1b-7d8a-4c36-89d5-a604bb60d4e8 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:30.006251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b958f44d-5c61-4fa2-9f24-313cd1c7ac98 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:30.007494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b958f44d-5c61-4fa2-9f24-313cd1c7ac98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:30.016342 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 981/1967] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:30.020625 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 987/1968] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:30.021456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e864e1b-7d8a-4c36-89d5-a604bb60d4e8 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:30.025062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958f44d-5c61-4fa2-9f24-313cd1c7ac98 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:30.025387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2e864e1b-7d8a-4c36-89d5-a604bb60d4e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:30.055800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958f44d-5c61-4fa2-9f24-313cd1c7ac98 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:30.057492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e864e1b-7d8a-4c36-89d5-a604bb60d4e8 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:30.061312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcb77a-ff67-4069-980f-cd0630ce4856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:30.062297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcb77a-ff67-4069-980f-cd0630ce4856 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:30.062557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcb77a-ff67-4069-980f-cd0630ce4856 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:30.063498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcb77a-ff67-4069-980f-cd0630ce4856 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:30.064250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcb77a-ff67-4069-980f-cd0630ce4856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:30.069611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea4be8-3f2c-4ce7-acf9-48ee8ecafc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:30.069974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcb77a-ff67-4069-980f-cd0630ce4856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:30.071020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4be8-3f2c-4ce7-acf9-48ee8ecafc08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:30.073365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4be8-3f2c-4ce7-acf9-48ee8ecafc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:30.073365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4be8-3f2c-4ce7-acf9-48ee8ecafc08 admin admin] PATH_INFO: `/v3/users/a7f0dd7f615f422c95b41a49c35cccc3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:30.073604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcb77a-ff67-4069-980f-cd0630ce4856 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:30.074957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea4be8-3f2c-4ce7-acf9-48ee8ecafc08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7f0dd7f615f422c95b41a49c35cccc3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:30.080755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea4be8-3f2c-4ce7-acf9-48ee8ecafc08 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:30.110189 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 988/1969] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:30.111493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcb77a-ff67-4069-980f-cd0630ce4856 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:30.126955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcb77a-ff67-4069-980f-cd0630ce4856 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:30.138632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca247a-816f-4921-abd2-e5bd95f16aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:30.140406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca247a-816f-4921-abd2-e5bd95f16aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:30.142245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca247a-816f-4921-abd2-e5bd95f16aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:30.142668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca247a-816f-4921-abd2-e5bd95f16aa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:30.143756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca247a-816f-4921-abd2-e5bd95f16aa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:30.150619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca247a-816f-4921-abd2-e5bd95f16aa7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:30.183192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3aea4be8-3f2c-4ce7-acf9-48ee8ecafc08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7f0dd7f615f422c95b41a49c35cccc3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:30.219948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3aea4be8-3f2c-4ce7-acf9-48ee8ecafc08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7f0dd7f615f422c95b41a49c35cccc3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:30.224668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3aea4be8-3f2c-4ce7-acf9-48ee8ecafc08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7f0dd7f615f422c95b41a49c35cccc3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:30.228299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3aea4be8-3f2c-4ce7-acf9-48ee8ecafc08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7f0dd7f615f422c95b41a49c35cccc3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:30.230968 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 989/1970] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:30 2022] POST /identity/v3/projects => generated 391 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:30.237316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca247a-816f-4921-abd2-e5bd95f16aa7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:30.240224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-04ca247a-816f-4921-abd2-e5bd95f16aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:30.254168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3aea4be8-3f2c-4ce7-acf9-48ee8ecafc08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7f0dd7f615f422c95b41a49c35cccc3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:30.280103 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 982/1971] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:30 2022] DELETE /identity/v3/users/a7f0dd7f615f422c95b41a49c35cccc3 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:30.281840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26c3d7-731c-4d74-bfad-fc47738f91f8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:30.282127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26c3d7-731c-4d74-bfad-fc47738f91f8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:30.289122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26c3d7-731c-4d74-bfad-fc47738f91f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:30.337825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6c26c3d7-731c-4d74-bfad-fc47738f91f8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:30.340651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c26c3d7-731c-4d74-bfad-fc47738f91f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:30.372391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca247a-816f-4921-abd2-e5bd95f16aa7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:30.393917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:30.496489 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 983/1972] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:30.534883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26c3d7-731c-4d74-bfad-fc47738f91f8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:30.536734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c26c3d7-731c-4d74-bfad-fc47738f91f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:30.566365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731947b1-e23b-4855-8c0b-9f5b3aa22eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:30.574665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731947b1-e23b-4855-8c0b-9f5b3aa22eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:30.574665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731947b1-e23b-4855-8c0b-9f5b3aa22eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:30.574859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731947b1-e23b-4855-8c0b-9f5b3aa22eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:30.575544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731947b1-e23b-4855-8c0b-9f5b3aa22eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:30.581177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731947b1-e23b-4855-8c0b-9f5b3aa22eb6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:30.649340 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 990/1973] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:30 2022] POST /identity/v3/users => generated 296 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:19:30.652890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731947b1-e23b-4855-8c0b-9f5b3aa22eb6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:30.655327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-731947b1-e23b-4855-8c0b-9f5b3aa22eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:30.657507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26c3d7-731c-4d74-bfad-fc47738f91f8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:30.662490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52ae02-f14f-4084-bf95-589bc5b2444b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:30.663572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52ae02-f14f-4084-bf95-589bc5b2444b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:30.664089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52ae02-f14f-4084-bf95-589bc5b2444b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:30.664887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52ae02-f14f-4084-bf95-589bc5b2444b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:30.680210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52ae02-f14f-4084-bf95-589bc5b2444b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:30.683732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52ae02-f14f-4084-bf95-589bc5b2444b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:30.684078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731947b1-e23b-4855-8c0b-9f5b3aa22eb6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:30.699885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe10ff-768a-4afc-bd74-16730c5b7826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:30.700443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe10ff-768a-4afc-bd74-16730c5b7826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:30.700780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe10ff-768a-4afc-bd74-16730c5b7826 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:30.701109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe10ff-768a-4afc-bd74-16730c5b7826 admin admin] PATH_INFO: `/v3/projects/049146327a654bb5975dda4755d56507` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:30.702460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe10ff-768a-4afc-bd74-16730c5b7826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=049146327a654bb5975dda4755d56507)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:30.704937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe10ff-768a-4afc-bd74-16730c5b7826 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:30.708479 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 984/1974] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:19:30.709859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52ae02-f14f-4084-bf95-589bc5b2444b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:30.726086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52ae02-f14f-4084-bf95-589bc5b2444b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:30.733841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3a6cf-fa25-4d72-8672-751183116125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:30.735729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3a6cf-fa25-4d72-8672-751183116125 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:30.735729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3a6cf-fa25-4d72-8672-751183116125 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:30.735729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3a6cf-fa25-4d72-8672-751183116125 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:30.736215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3a6cf-fa25-4d72-8672-751183116125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:30.740009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3a6cf-fa25-4d72-8672-751183116125 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:30.777208 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 985/1975] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:30.779794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f50494-32c2-4aa6-9cb6-b20cf7bfbf9e None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:30.780365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f50494-32c2-4aa6-9cb6-b20cf7bfbf9e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:30.780867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f50494-32c2-4aa6-9cb6-b20cf7bfbf9e None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:30.782506 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 986/1976] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 18:19:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:19:30.785502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f50494-32c2-4aa6-9cb6-b20cf7bfbf9e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:30.789526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:30.812874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4efe10ff-768a-4afc-bd74-16730c5b7826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '049146327a654bb5975dda4755d56507', 'request_id': 'req-4efe10ff-768a-4afc-bd74-16730c5b7826'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:30.826476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4efe10ff-768a-4afc-bd74-16730c5b7826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '049146327a654bb5975dda4755d56507', 'request_id': 'req-4efe10ff-768a-4afc-bd74-16730c5b7826'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:30.843299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4efe10ff-768a-4afc-bd74-16730c5b7826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '049146327a654bb5975dda4755d56507', 'request_id': 'req-4efe10ff-768a-4afc-bd74-16730c5b7826'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:30.864809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4efe10ff-768a-4afc-bd74-16730c5b7826 admin admin] The token cache is being invalidate because project 049146327a654bb5975dda4755d56507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:30.865228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4efe10ff-768a-4afc-bd74-16730c5b7826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:30.867468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4efe10ff-768a-4afc-bd74-16730c5b7826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:30.870138 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 991/1977] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:30 2022] DELETE /identity/v3/projects/049146327a654bb5975dda4755d56507 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:30.871937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a94cd-fe34-4b24-9eec-2ce6c53f1506 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:30.872296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a94cd-fe34-4b24-9eec-2ce6c53f1506 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:30.872744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a94cd-fe34-4b24-9eec-2ce6c53f1506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:30.898644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b76a94cd-fe34-4b24-9eec-2ce6c53f1506 None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:30.900448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b76a94cd-fe34-4b24-9eec-2ce6c53f1506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:30.903544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f50494-32c2-4aa6-9cb6-b20cf7bfbf9e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:30.918622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f0f38-7083-46f3-91e5-7375f9d3ced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:30.919435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f0f38-7083-46f3-91e5-7375f9d3ced3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:30.919716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f0f38-7083-46f3-91e5-7375f9d3ced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:30.920174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f0f38-7083-46f3-91e5-7375f9d3ced3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:30.920828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f0f38-7083-46f3-91e5-7375f9d3ced3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:30.928621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f0f38-7083-46f3-91e5-7375f9d3ced3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:30.947417 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 987/1978] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:30.952336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f0f38-7083-46f3-91e5-7375f9d3ced3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:30.955463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f14f0f38-7083-46f3-91e5-7375f9d3ced3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:30.970665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f0f38-7083-46f3-91e5-7375f9d3ced3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:30.980628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26279fa-cb3f-4d83-ac32-10cab3068d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:30.982370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26279fa-cb3f-4d83-ac32-10cab3068d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:30.982828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26279fa-cb3f-4d83-ac32-10cab3068d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:30.983285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26279fa-cb3f-4d83-ac32-10cab3068d97 admin admin] PATH_INFO: `/v3/users/175db8a1c2204bca89aaa2ca599ca6fd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:30.985756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26279fa-cb3f-4d83-ac32-10cab3068d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=175db8a1c2204bca89aaa2ca599ca6fd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:30.987417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26279fa-cb3f-4d83-ac32-10cab3068d97 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:30.992431 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 992/1979] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 18:19:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:30.993436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a94cd-fe34-4b24-9eec-2ce6c53f1506 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:30.995344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b76a94cd-fe34-4b24-9eec-2ce6c53f1506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:31.013138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a94cd-fe34-4b24-9eec-2ce6c53f1506 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:31.021150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f43c15-598c-4a95-9e6c-debcccb4c831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:31.022059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f43c15-598c-4a95-9e6c-debcccb4c831 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:31.022438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f43c15-598c-4a95-9e6c-debcccb4c831 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:31.022839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f43c15-598c-4a95-9e6c-debcccb4c831 admin admin] PATH_INFO: `/v3/projects/dfa4381f12d3438089661344f994f0b2/users/43f5cb387ac64c48a039f0595e92c8ed/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:31.046891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f43c15-598c-4a95-9e6c-debcccb4c831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa4381f12d3438089661344f994f0b2, user_id=43f5cb387ac64c48a039f0595e92c8ed, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:31.050247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f43c15-598c-4a95-9e6c-debcccb4c831 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:31.070823 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 993/1980] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:30 2022] PUT /identity/v3/projects/dfa4381f12d3438089661344f994f0b2/users/43f5cb387ac64c48a039f0595e92c8ed/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:31.072997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f43c15-598c-4a95-9e6c-debcccb4c831 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:31.083302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c5f43c15-598c-4a95-9e6c-debcccb4c831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:31.093757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:31.100478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d26279fa-cb3f-4d83-ac32-10cab3068d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '175db8a1c2204bca89aaa2ca599ca6fd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:31.116235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d26279fa-cb3f-4d83-ac32-10cab3068d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '175db8a1c2204bca89aaa2ca599ca6fd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:31.117267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d26279fa-cb3f-4d83-ac32-10cab3068d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '175db8a1c2204bca89aaa2ca599ca6fd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:31.118001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d26279fa-cb3f-4d83-ac32-10cab3068d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '175db8a1c2204bca89aaa2ca599ca6fd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:31.140719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d26279fa-cb3f-4d83-ac32-10cab3068d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '175db8a1c2204bca89aaa2ca599ca6fd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:31.176291 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 988/1981] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:30 2022] DELETE /identity/v3/users/175db8a1c2204bca89aaa2ca599ca6fd => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:31.178294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaf97d-80a1-4153-b84b-8fdd9955a04f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:31.178685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaf97d-80a1-4153-b84b-8fdd9955a04f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:31.179350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaf97d-80a1-4153-b84b-8fdd9955a04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:31.217855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4fdaf97d-80a1-4153-b84b-8fdd9955a04f None None] MFA Rules not processed for user `43f5cb387ac64c48a039f0595e92c8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:31.220842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4fdaf97d-80a1-4153-b84b-8fdd9955a04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:31.246754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f43c15-598c-4a95-9e6c-debcccb4c831 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:31.282140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:31.342168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350848f-a58a-4a31-8374-718d43f2f8ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:31.343458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350848f-a58a-4a31-8374-718d43f2f8ad service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:31.344640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350848f-a58a-4a31-8374-718d43f2f8ad service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:31.345211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350848f-a58a-4a31-8374-718d43f2f8ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:31.347672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1350848f-a58a-4a31-8374-718d43f2f8ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:31.350937 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 989/1982] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:31.355484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaf97d-80a1-4153-b84b-8fdd9955a04f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:31.357498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4fdaf97d-80a1-4153-b84b-8fdd9955a04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:31.363974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350848f-a58a-4a31-8374-718d43f2f8ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:31.367710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350848f-a58a-4a31-8374-718d43f2f8ad service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:31.387709 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 994/1983] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:31.487881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350848f-a58a-4a31-8374-718d43f2f8ad service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:31.491382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1350848f-a58a-4a31-8374-718d43f2f8ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:31.568115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaf97d-80a1-4153-b84b-8fdd9955a04f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:31.583375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c42d4-02c1-48ea-9a4b-f6a2ac0eb839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:31.585077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c42d4-02c1-48ea-9a4b-f6a2ac0eb839 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:31.594746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c42d4-02c1-48ea-9a4b-f6a2ac0eb839 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:31.595056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c42d4-02c1-48ea-9a4b-f6a2ac0eb839 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:31.595809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c42d4-02c1-48ea-9a4b-f6a2ac0eb839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:31.598232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c42d4-02c1-48ea-9a4b-f6a2ac0eb839 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:31.657630 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 990/1984] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:31 2022] POST /identity/v3/projects => generated 389 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:19:31.661681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c42d4-02c1-48ea-9a4b-f6a2ac0eb839 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:31.718735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350848f-a58a-4a31-8374-718d43f2f8ad service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:31.763298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:31.814171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c42d4-02c1-48ea-9a4b-f6a2ac0eb839 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:31.828934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf48ae-a7e8-4fb8-8bd7-1052e9e09679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:31.832103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf48ae-a7e8-4fb8-8bd7-1052e9e09679 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:31.832861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf48ae-a7e8-4fb8-8bd7-1052e9e09679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:31.834090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf48ae-a7e8-4fb8-8bd7-1052e9e09679 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:31.836459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf48ae-a7e8-4fb8-8bd7-1052e9e09679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:31.842712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf48ae-a7e8-4fb8-8bd7-1052e9e09679 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:31.894597 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 991/1985] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:31 2022] POST /identity/v3/users => generated 301 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:31.901521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d474ba-ba90-4ced-8b49-286b087e9f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:31.902189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d474ba-ba90-4ced-8b49-286b087e9f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:31.902464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d474ba-ba90-4ced-8b49-286b087e9f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:31.902713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf48ae-a7e8-4fb8-8bd7-1052e9e09679 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:31.902838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d474ba-ba90-4ced-8b49-286b087e9f00 admin admin] PATH_INFO: `/v3/projects/26663ee761264eccb53bf83ef10ef2c0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:31.903926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d474ba-ba90-4ced-8b49-286b087e9f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26663ee761264eccb53bf83ef10ef2c0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:31.905903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d474ba-ba90-4ced-8b49-286b087e9f00 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:31.925165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf48ae-a7e8-4fb8-8bd7-1052e9e09679 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:31.949276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e0fb3-7639-442a-a1eb-0f510aed26ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:31.951059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e0fb3-7639-442a-a1eb-0f510aed26ce admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:31.951786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e0fb3-7639-442a-a1eb-0f510aed26ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:31.951786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e0fb3-7639-442a-a1eb-0f510aed26ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:31.955098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e0fb3-7639-442a-a1eb-0f510aed26ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:31.963421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e0fb3-7639-442a-a1eb-0f510aed26ce admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:31.987622 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 992/1986] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:31.988333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e0fb3-7639-442a-a1eb-0f510aed26ce admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:32.034532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3d474ba-ba90-4ced-8b49-286b087e9f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26663ee761264eccb53bf83ef10ef2c0', 'request_id': 'req-a3d474ba-ba90-4ced-8b49-286b087e9f00'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:32.035422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e0fb3-7639-442a-a1eb-0f510aed26ce admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:32.046579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3d474ba-ba90-4ced-8b49-286b087e9f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26663ee761264eccb53bf83ef10ef2c0', 'request_id': 'req-a3d474ba-ba90-4ced-8b49-286b087e9f00'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:32.064865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:32.070843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3d474ba-ba90-4ced-8b49-286b087e9f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26663ee761264eccb53bf83ef10ef2c0', 'request_id': 'req-a3d474ba-ba90-4ced-8b49-286b087e9f00'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:32.115886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3d474ba-ba90-4ced-8b49-286b087e9f00 admin admin] The token cache is being invalidate because project 26663ee761264eccb53bf83ef10ef2c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:32.115886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3d474ba-ba90-4ced-8b49-286b087e9f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:32.117140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3d474ba-ba90-4ced-8b49-286b087e9f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:32.121839 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 995/1987] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:31 2022] DELETE /identity/v3/projects/26663ee761264eccb53bf83ef10ef2c0 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:32.122831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d474ba-ba90-4ced-8b49-286b087e9f00 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:32.126260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a3d474ba-ba90-4ced-8b49-286b087e9f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:32.166025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d35aff-5968-49d6-89c6-2d30f69c8cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:32.166981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d35aff-5968-49d6-89c6-2d30f69c8cfb admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:32.167511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d35aff-5968-49d6-89c6-2d30f69c8cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:32.167927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d35aff-5968-49d6-89c6-2d30f69c8cfb admin admin] PATH_INFO: `/v3/projects/ba68a3d6608f45e19f6daf80179fd393/users/80cc409e9e6b408da7f48c674bd458ca/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:32.202443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d35aff-5968-49d6-89c6-2d30f69c8cfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba68a3d6608f45e19f6daf80179fd393, user_id=80cc409e9e6b408da7f48c674bd458ca, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:32.205730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d35aff-5968-49d6-89c6-2d30f69c8cfb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:32.227459 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 993/1988] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:31 2022] PUT /identity/v3/projects/ba68a3d6608f45e19f6daf80179fd393/users/80cc409e9e6b408da7f48c674bd458ca/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:32.229057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d35aff-5968-49d6-89c6-2d30f69c8cfb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:32.231745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e0d35aff-5968-49d6-89c6-2d30f69c8cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:32.312228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d474ba-ba90-4ced-8b49-286b087e9f00 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:32.330787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d35aff-5968-49d6-89c6-2d30f69c8cfb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:32.340217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be14bd2-8253-448f-b5bf-ed9f1928789d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:32.341405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be14bd2-8253-448f-b5bf-ed9f1928789d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:32.341899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be14bd2-8253-448f-b5bf-ed9f1928789d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:32.342389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be14bd2-8253-448f-b5bf-ed9f1928789d admin admin] PATH_INFO: `/v3/projects/b3ad866fafcf46b58caabb6ee6ece641` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:32.344404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be14bd2-8253-448f-b5bf-ed9f1928789d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ad866fafcf46b58caabb6ee6ece641)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:32.346909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be14bd2-8253-448f-b5bf-ed9f1928789d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:32.394800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1471b4-17ab-43a6-9302-2451a8e6de75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:32.396868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1471b4-17ab-43a6-9302-2451a8e6de75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:32.397324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1471b4-17ab-43a6-9302-2451a8e6de75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:32.397739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1471b4-17ab-43a6-9302-2451a8e6de75 admin admin] PATH_INFO: `/v3/users/b4534750715e48b0b650480ad4f9ef37` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:32.400324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1471b4-17ab-43a6-9302-2451a8e6de75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4534750715e48b0b650480ad4f9ef37)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:32.406370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:32.409452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1471b4-17ab-43a6-9302-2451a8e6de75 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:32.421562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3be14bd2-8253-448f-b5bf-ed9f1928789d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ad866fafcf46b58caabb6ee6ece641', 'request_id': 'req-3be14bd2-8253-448f-b5bf-ed9f1928789d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:32.430920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3be14bd2-8253-448f-b5bf-ed9f1928789d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ad866fafcf46b58caabb6ee6ece641', 'request_id': 'req-3be14bd2-8253-448f-b5bf-ed9f1928789d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:32.444825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3be14bd2-8253-448f-b5bf-ed9f1928789d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ad866fafcf46b58caabb6ee6ece641', 'request_id': 'req-3be14bd2-8253-448f-b5bf-ed9f1928789d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:32.468386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3be14bd2-8253-448f-b5bf-ed9f1928789d admin admin] The token cache is being invalidate because project b3ad866fafcf46b58caabb6ee6ece641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:32.468792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3be14bd2-8253-448f-b5bf-ed9f1928789d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:32.469636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3be14bd2-8253-448f-b5bf-ed9f1928789d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:32.474827 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 994/1989] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:32 2022] DELETE /identity/v3/projects/b3ad866fafcf46b58caabb6ee6ece641 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:32.476038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be14bd2-8253-448f-b5bf-ed9f1928789d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:32.492252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3be14bd2-8253-448f-b5bf-ed9f1928789d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:32.527359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e1471b4-17ab-43a6-9302-2451a8e6de75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4534750715e48b0b650480ad4f9ef37'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:32.528103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e1471b4-17ab-43a6-9302-2451a8e6de75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4534750715e48b0b650480ad4f9ef37'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:32.538076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e1471b4-17ab-43a6-9302-2451a8e6de75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4534750715e48b0b650480ad4f9ef37'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:32.560645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e1471b4-17ab-43a6-9302-2451a8e6de75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4534750715e48b0b650480ad4f9ef37'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:32.590998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e1471b4-17ab-43a6-9302-2451a8e6de75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4534750715e48b0b650480ad4f9ef37'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:32.599224 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 996/1990] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:32 2022] DELETE /identity/v3/users/b4534750715e48b0b650480ad4f9ef37 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:32.601309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad4ced-547b-448b-b7f4-717c81a63f11 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:32.601974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad4ced-547b-448b-b7f4-717c81a63f11 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:32.602381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad4ced-547b-448b-b7f4-717c81a63f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:32.632688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-84ad4ced-547b-448b-b7f4-717c81a63f11 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:32.634668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-84ad4ced-547b-448b-b7f4-717c81a63f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:32.650838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be14bd2-8253-448f-b5bf-ed9f1928789d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:32.661463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:32.766215 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 997/1991] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:32.769813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d514b3b-5fb2-4366-8e08-62f806dd1c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:32.771193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d514b3b-5fb2-4366-8e08-62f806dd1c7b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:32.771630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d514b3b-5fb2-4366-8e08-62f806dd1c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:32.772317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d514b3b-5fb2-4366-8e08-62f806dd1c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:32.772990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d514b3b-5fb2-4366-8e08-62f806dd1c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:32.774619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d514b3b-5fb2-4366-8e08-62f806dd1c7b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:32.778635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8504c-118d-4583-9590-5b886e234b80 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:32.778996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8504c-118d-4583-9590-5b886e234b80 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:32.779367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8504c-118d-4583-9590-5b886e234b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:32.788536 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 995/1992] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:32.793245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d514b3b-5fb2-4366-8e08-62f806dd1c7b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:32.800289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8d514b3b-5fb2-4366-8e08-62f806dd1c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:32.816248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b5a8504c-118d-4583-9590-5b886e234b80 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:32.817518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b5a8504c-118d-4583-9590-5b886e234b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:32.823530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d514b3b-5fb2-4366-8e08-62f806dd1c7b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:32.832880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76a6cc-972a-46b6-828c-ce0e6521355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:32.833481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76a6cc-972a-46b6-828c-ce0e6521355a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:32.833764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76a6cc-972a-46b6-828c-ce0e6521355a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:32.834041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76a6cc-972a-46b6-828c-ce0e6521355a admin admin] PATH_INFO: `/v3/projects/ba68a3d6608f45e19f6daf80179fd393/users/80cc409e9e6b408da7f48c674bd458ca/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:32.837235 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 998/1993] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:32.838583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76a6cc-972a-46b6-828c-ce0e6521355a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba68a3d6608f45e19f6daf80179fd393, user_id=80cc409e9e6b408da7f48c674bd458ca, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:32.841414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8504c-118d-4583-9590-5b886e234b80 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:32.847398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76a6cc-972a-46b6-828c-ce0e6521355a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:32.856033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8504c-118d-4583-9590-5b886e234b80 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:32.869255 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 996/1994] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:32 2022] PUT /identity/v3/projects/ba68a3d6608f45e19f6daf80179fd393/users/80cc409e9e6b408da7f48c674bd458ca/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:19:32.872174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591222b6-6027-4ec2-94da-7c17118cf632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:32.872994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591222b6-6027-4ec2-94da-7c17118cf632 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:32.873224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591222b6-6027-4ec2-94da-7c17118cf632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:32.873509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591222b6-6027-4ec2-94da-7c17118cf632 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:32.874213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591222b6-6027-4ec2-94da-7c17118cf632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:32.874497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591222b6-6027-4ec2-94da-7c17118cf632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:32.878662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591222b6-6027-4ec2-94da-7c17118cf632 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:32.882211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf6019-b182-4dad-ae5f-d83352105162 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:32.882553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf6019-b182-4dad-ae5f-d83352105162 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:32.882762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf6019-b182-4dad-ae5f-d83352105162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:32.900939 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 999/1995] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:32.902580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591222b6-6027-4ec2-94da-7c17118cf632 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:32.933699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591222b6-6027-4ec2-94da-7c17118cf632 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:32.953036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-38bf6019-b182-4dad-ae5f-d83352105162 None None] MFA Rules not processed for user `80cc409e9e6b408da7f48c674bd458ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:32.959584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-38bf6019-b182-4dad-ae5f-d83352105162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:33.052280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:33.087493 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 997/1996] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:32 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:33.095317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf6019-b182-4dad-ae5f-d83352105162 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:33.097693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-38bf6019-b182-4dad-ae5f-d83352105162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:33.138207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae177581-610e-4231-b354-1848fe1342af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:33.138988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae177581-610e-4231-b354-1848fe1342af admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:33.139809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae177581-610e-4231-b354-1848fe1342af admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:33.140101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae177581-610e-4231-b354-1848fe1342af admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:33.140944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae177581-610e-4231-b354-1848fe1342af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:33.143063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae177581-610e-4231-b354-1848fe1342af admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:33.181150 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1000/1997] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:32 2022] POST /identity/v3/projects => generated 387 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:33.185311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae177581-610e-4231-b354-1848fe1342af admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:33.242708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf6019-b182-4dad-ae5f-d83352105162 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:33.279183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae177581-610e-4231-b354-1848fe1342af admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:33.285642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9218ab7-23bb-40fb-af80-bb517e5231cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:33.286277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9218ab7-23bb-40fb-af80-bb517e5231cf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:33.286555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9218ab7-23bb-40fb-af80-bb517e5231cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:33.286828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9218ab7-23bb-40fb-af80-bb517e5231cf admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:33.287509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9218ab7-23bb-40fb-af80-bb517e5231cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:33.289464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9218ab7-23bb-40fb-af80-bb517e5231cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:33.313399 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1001/1998] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:33 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:19:33.314339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9218ab7-23bb-40fb-af80-bb517e5231cf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:33.315931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c9218ab7-23bb-40fb-af80-bb517e5231cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:33.328160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9218ab7-23bb-40fb-af80-bb517e5231cf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:33.334213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de146c7-a2e0-4c92-b761-273863fa5edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:33.334369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e7b77-6d8e-437f-a9e4-410252486310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:33.334703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de146c7-a2e0-4c92-b761-273863fa5edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:33.334839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de146c7-a2e0-4c92-b761-273863fa5edb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:33.334964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e7b77-6d8e-437f-a9e4-410252486310 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:33.335206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de146c7-a2e0-4c92-b761-273863fa5edb admin admin] PATH_INFO: `/v3/projects/18b820b6d3664ae1a8f61b6b7559379b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:33.335369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e7b77-6d8e-437f-a9e4-410252486310 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:33.335585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e7b77-6d8e-437f-a9e4-410252486310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:33.336438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de146c7-a2e0-4c92-b761-273863fa5edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b820b6d3664ae1a8f61b6b7559379b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:33.337404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d00e7b77-6d8e-437f-a9e4-410252486310 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:33.338534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de146c7-a2e0-4c92-b761-273863fa5edb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:33.350921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:33.402385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6de146c7-a2e0-4c92-b761-273863fa5edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b820b6d3664ae1a8f61b6b7559379b', 'request_id': 'req-6de146c7-a2e0-4c92-b761-273863fa5edb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:33.414633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6de146c7-a2e0-4c92-b761-273863fa5edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b820b6d3664ae1a8f61b6b7559379b', 'request_id': 'req-6de146c7-a2e0-4c92-b761-273863fa5edb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:33.415994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e7b77-6d8e-437f-a9e4-410252486310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:33.417958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e7b77-6d8e-437f-a9e4-410252486310 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:33.421167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6de146c7-a2e0-4c92-b761-273863fa5edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b820b6d3664ae1a8f61b6b7559379b', 'request_id': 'req-6de146c7-a2e0-4c92-b761-273863fa5edb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:33.432819 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 998/1999] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:33.434156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a9c8-e845-45ac-8430-26e839fc4b94 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:33.434445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a9c8-e845-45ac-8430-26e839fc4b94 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:33.434711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a9c8-e845-45ac-8430-26e839fc4b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:33.435383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6de146c7-a2e0-4c92-b761-273863fa5edb admin admin] The token cache is being invalidate because project 18b820b6d3664ae1a8f61b6b7559379b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:33.435672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6de146c7-a2e0-4c92-b761-273863fa5edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:33.436362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6de146c7-a2e0-4c92-b761-273863fa5edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:33.438258 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1002/2000] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:33 2022] DELETE /identity/v3/projects/18b820b6d3664ae1a8f61b6b7559379b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:33.439049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de146c7-a2e0-4c92-b761-273863fa5edb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:33.444721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6de146c7-a2e0-4c92-b761-273863fa5edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:33.481492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a110a9c8-e845-45ac-8430-26e839fc4b94 None None] MFA Rules not processed for user `79fd6a956dcd46628dd085a626731217`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:33.483230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a110a9c8-e845-45ac-8430-26e839fc4b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:33.496493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:33.537552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de146c7-a2e0-4c92-b761-273863fa5edb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:33.543790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ea5cd-984d-4416-9e2b-ec3a0325487b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:33.544579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ea5cd-984d-4416-9e2b-ec3a0325487b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:33.544892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ea5cd-984d-4416-9e2b-ec3a0325487b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:33.545375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ea5cd-984d-4416-9e2b-ec3a0325487b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:33.546421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ea5cd-984d-4416-9e2b-ec3a0325487b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:33.548238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ea5cd-984d-4416-9e2b-ec3a0325487b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:33.564720 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1003/2001] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:33.568678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f6d08-017c-4714-9c96-a2143a33363a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:33.569035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f6d08-017c-4714-9c96-a2143a33363a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:33.570772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f6d08-017c-4714-9c96-a2143a33363a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:33.603608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-481f6d08-017c-4714-9c96-a2143a33363a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:33.605170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-481f6d08-017c-4714-9c96-a2143a33363a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:33.611711 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 999/2002] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:33 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:33.612734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110a9c8-e845-45ac-8430-26e839fc4b94 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:33.627022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110a9c8-e845-45ac-8430-26e839fc4b94 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:33.633202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621237a-85e9-4030-a915-fa76ec8ed060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:33.640559 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1004/2003] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:33.640933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621237a-85e9-4030-a915-fa76ec8ed060 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:33.640933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621237a-85e9-4030-a915-fa76ec8ed060 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:33.640933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621237a-85e9-4030-a915-fa76ec8ed060 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:33.640933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621237a-85e9-4030-a915-fa76ec8ed060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:33.640933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621237a-85e9-4030-a915-fa76ec8ed060 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:33.645024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bd514-9417-4880-8294-6977a5698015 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:33.645518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bd514-9417-4880-8294-6977a5698015 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:33.645865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bd514-9417-4880-8294-6977a5698015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:33.648492 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1000/2004] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:33.654149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621237a-85e9-4030-a915-fa76ec8ed060 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:33.667378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621237a-85e9-4030-a915-fa76ec8ed060 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:33.673973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa87f7a-024c-4964-a391-0dd37db272d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:33.674727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa87f7a-024c-4964-a391-0dd37db272d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:33.675557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa87f7a-024c-4964-a391-0dd37db272d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:33.676054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa87f7a-024c-4964-a391-0dd37db272d7 admin admin] PATH_INFO: `/v3/projects/7b000ee588774020888da86dcbf9320a/users/f095925d3fc54784adef258d1f5ef02e/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:33.682819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-090bd514-9417-4880-8294-6977a5698015 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:33.684888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-090bd514-9417-4880-8294-6977a5698015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:33.697188 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1005/2005] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:33.700941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa87f7a-024c-4964-a391-0dd37db272d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b000ee588774020888da86dcbf9320a, user_id=f095925d3fc54784adef258d1f5ef02e, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:33.701845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bd514-9417-4880-8294-6977a5698015 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:33.703983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa87f7a-024c-4964-a391-0dd37db272d7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:33.714676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bd514-9417-4880-8294-6977a5698015 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:33.722087 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1001/2006] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:33 2022] PUT /identity/v3/projects/7b000ee588774020888da86dcbf9320a/users/f095925d3fc54784adef258d1f5ef02e/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:33.738457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87b572-d3f7-4b1b-84d5-ac25db6358a6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:33.739934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87b572-d3f7-4b1b-84d5-ac25db6358a6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:33.740585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87b572-d3f7-4b1b-84d5-ac25db6358a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:33.801503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9e87b572-d3f7-4b1b-84d5-ac25db6358a6 None None] MFA Rules not processed for user `f095925d3fc54784adef258d1f5ef02e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:33.805021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9e87b572-d3f7-4b1b-84d5-ac25db6358a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:33.846418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198a4ae-a4d0-426b-be16-375f6ac2e5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:33.847386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198a4ae-a4d0-426b-be16-375f6ac2e5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:33.847737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198a4ae-a4d0-426b-be16-375f6ac2e5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:33.848983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198a4ae-a4d0-426b-be16-375f6ac2e5d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:33.851470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198a4ae-a4d0-426b-be16-375f6ac2e5d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:33.851941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198a4ae-a4d0-426b-be16-375f6ac2e5d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:33.856509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198a4ae-a4d0-426b-be16-375f6ac2e5d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:33.893881 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1006/2007] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:33.897361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198a4ae-a4d0-426b-be16-375f6ac2e5d1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:33.926099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198a4ae-a4d0-426b-be16-375f6ac2e5d1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:33.931044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412dce5-1cd9-4d4e-8663-61d6687a46df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:33.932009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412dce5-1cd9-4d4e-8663-61d6687a46df admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:33.932291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412dce5-1cd9-4d4e-8663-61d6687a46df admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:33.932561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412dce5-1cd9-4d4e-8663-61d6687a46df admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:33.933219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412dce5-1cd9-4d4e-8663-61d6687a46df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:33.935174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412dce5-1cd9-4d4e-8663-61d6687a46df admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:33.956426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:33.988594 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1007/2008] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:33 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:19:33.992991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412dce5-1cd9-4d4e-8663-61d6687a46df admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:34.009510 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1002/2009] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:34.011034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87b572-d3f7-4b1b-84d5-ac25db6358a6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:34.035613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87b572-d3f7-4b1b-84d5-ac25db6358a6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:34.147292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32fbb7-437c-4806-8fee-f02f4880b66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:34.148185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32fbb7-437c-4806-8fee-f02f4880b66c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:34.148557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32fbb7-437c-4806-8fee-f02f4880b66c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:34.148908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32fbb7-437c-4806-8fee-f02f4880b66c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:34.149948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32fbb7-437c-4806-8fee-f02f4880b66c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:34.151432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412dce5-1cd9-4d4e-8663-61d6687a46df admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:34.152402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32fbb7-437c-4806-8fee-f02f4880b66c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:34.165507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:34.166544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d111-90ea-46bd-826f-a3c436264d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:34.167183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d111-90ea-46bd-826f-a3c436264d3c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:34.167491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d111-90ea-46bd-826f-a3c436264d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:34.167770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d111-90ea-46bd-826f-a3c436264d3c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:34.168496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9d111-90ea-46bd-826f-a3c436264d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:34.175056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9d111-90ea-46bd-826f-a3c436264d3c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:34.214389 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1003/2010] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:34 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:34.215355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32fbb7-437c-4806-8fee-f02f4880b66c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:34.219727 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1008/2011] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:33 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:19:34.221292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d111-90ea-46bd-826f-a3c436264d3c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:34.234352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d111-90ea-46bd-826f-a3c436264d3c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:34.314858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f99b3-79fe-4942-a7c7-d8a273e517b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:34.318019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f99b3-79fe-4942-a7c7-d8a273e517b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:34.318019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f99b3-79fe-4942-a7c7-d8a273e517b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:34.318019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f99b3-79fe-4942-a7c7-d8a273e517b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:34.318694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f99b3-79fe-4942-a7c7-d8a273e517b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:34.320549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f99b3-79fe-4942-a7c7-d8a273e517b6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:34.337282 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1009/2012] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:34.337282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f99b3-79fe-4942-a7c7-d8a273e517b6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:34.337568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f74f99b3-79fe-4942-a7c7-d8a273e517b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:34.376167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32fbb7-437c-4806-8fee-f02f4880b66c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:34.426882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256496a6-1696-4324-b20a-79980318e807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:34.427971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256496a6-1696-4324-b20a-79980318e807 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:34.435481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256496a6-1696-4324-b20a-79980318e807 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:34.436123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256496a6-1696-4324-b20a-79980318e807 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:34.437161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256496a6-1696-4324-b20a-79980318e807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:34.449832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256496a6-1696-4324-b20a-79980318e807 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:34.474825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f99b3-79fe-4942-a7c7-d8a273e517b6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:34.494961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063be44-2764-4d58-9da4-b91599424d84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:34.496971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063be44-2764-4d58-9da4-b91599424d84 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:34.497457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063be44-2764-4d58-9da4-b91599424d84 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:34.497987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063be44-2764-4d58-9da4-b91599424d84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:34.500597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6063be44-2764-4d58-9da4-b91599424d84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:34.506154 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1004/2013] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:34 2022] POST /identity/v3/users => generated 300 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:34.507176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256496a6-1696-4324-b20a-79980318e807 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:34.519754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:34.533715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256496a6-1696-4324-b20a-79980318e807 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:34.600901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f6ce1-581a-4cb1-be85-acf837a821e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:34.610208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f6ce1-581a-4cb1-be85-acf837a821e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:34.610433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f6ce1-581a-4cb1-be85-acf837a821e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:34.610861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f6ce1-581a-4cb1-be85-acf837a821e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:34.612275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f6ce1-581a-4cb1-be85-acf837a821e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:34.616334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f6ce1-581a-4cb1-be85-acf837a821e9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:34.668657 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1005/2014] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:34.668657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f6ce1-581a-4cb1-be85-acf837a821e9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:34.696489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063be44-2764-4d58-9da4-b91599424d84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:34.698318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063be44-2764-4d58-9da4-b91599424d84 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:34.711506 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1010/2015] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:34 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:34.713602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063be44-2764-4d58-9da4-b91599424d84 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:34.716410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f6ce1-581a-4cb1-be85-acf837a821e9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:34.726562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063be44-2764-4d58-9da4-b91599424d84 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:34.733123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea708a9f-5b09-4ea1-8546-437c3318bc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:34.733422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea708a9f-5b09-4ea1-8546-437c3318bc85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:34.733983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea708a9f-5b09-4ea1-8546-437c3318bc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:34.734364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea708a9f-5b09-4ea1-8546-437c3318bc85 admin admin] PATH_INFO: `/v3/projects/db2c5054f72d497ab721ee57e9eddaba/users/062028896c1f4599a1a0fc25d4260c02/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:34.736121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01334e-51c6-4353-9b3a-267e6f1d0577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:34.737094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01334e-51c6-4353-9b3a-267e6f1d0577 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:34.737589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01334e-51c6-4353-9b3a-267e6f1d0577 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:34.738068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01334e-51c6-4353-9b3a-267e6f1d0577 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:34.739328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01334e-51c6-4353-9b3a-267e6f1d0577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:34.742361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01334e-51c6-4353-9b3a-267e6f1d0577 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:34.757513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea708a9f-5b09-4ea1-8546-437c3318bc85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2c5054f72d497ab721ee57e9eddaba, user_id=062028896c1f4599a1a0fc25d4260c02, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:34.760728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea708a9f-5b09-4ea1-8546-437c3318bc85 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:34.791947 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1006/2017] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:34.793124 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1011/2017] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:34 2022] PUT /identity/v3/projects/db2c5054f72d497ab721ee57e9eddaba/users/062028896c1f4599a1a0fc25d4260c02/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:34.793507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01334e-51c6-4353-9b3a-267e6f1d0577 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:34.795636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a34d43-be2c-4b43-9c0b-a774e79d5ab4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:34.796155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a34d43-be2c-4b43-9c0b-a774e79d5ab4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:34.796609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a34d43-be2c-4b43-9c0b-a774e79d5ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:34.825308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01334e-51c6-4353-9b3a-267e6f1d0577 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:34.845112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-45a34d43-be2c-4b43-9c0b-a774e79d5ab4 None None] MFA Rules not processed for user `062028896c1f4599a1a0fc25d4260c02`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:34.848189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-45a34d43-be2c-4b43-9c0b-a774e79d5ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:34.982344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33162bb8-40f4-4c39-8fe1-0b0fbd88c36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:34.983992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33162bb8-40f4-4c39-8fe1-0b0fbd88c36c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:34.984609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33162bb8-40f4-4c39-8fe1-0b0fbd88c36c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:34.985847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33162bb8-40f4-4c39-8fe1-0b0fbd88c36c admin admin] PATH_INFO: `/v3/projects/d9f2db000a55495bb94abdad0dcd0081/users/417a0c949de9422f9876853f1ef839d4/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:35.002308 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1012/2018] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:35.007459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a34d43-be2c-4b43-9c0b-a774e79d5ab4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:35.014706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33162bb8-40f4-4c39-8fe1-0b0fbd88c36c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f2db000a55495bb94abdad0dcd0081, user_id=417a0c949de9422f9876853f1ef839d4, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:35.020056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33162bb8-40f4-4c39-8fe1-0b0fbd88c36c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:35.031292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a34d43-be2c-4b43-9c0b-a774e79d5ab4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:35.043767 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1007/2019] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:34 2022] PUT /identity/v3/projects/d9f2db000a55495bb94abdad0dcd0081/users/417a0c949de9422f9876853f1ef839d4/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:35.049673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33162bb8-40f4-4c39-8fe1-0b0fbd88c36c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:35.140167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:35.184397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33162bb8-40f4-4c39-8fe1-0b0fbd88c36c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:35.187845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7d740-ac19-4d33-a71a-a2f329f55cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:35.188637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d740-ac19-4d33-a71a-a2f329f55cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:35.188991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d740-ac19-4d33-a71a-a2f329f55cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:35.189369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d740-ac19-4d33-a71a-a2f329f55cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:35.190384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7d740-ac19-4d33-a71a-a2f329f55cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:35.190590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abf5e1-cf10-4e19-ac40-3438d7735c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:35.191280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abf5e1-cf10-4e19-ac40-3438d7735c8f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:35.191637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abf5e1-cf10-4e19-ac40-3438d7735c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:35.191912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abf5e1-cf10-4e19-ac40-3438d7735c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:35.192703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abf5e1-cf10-4e19-ac40-3438d7735c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:35.193881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7d740-ac19-4d33-a71a-a2f329f55cc2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:35.194390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abf5e1-cf10-4e19-ac40-3438d7735c8f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:35.208161 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1008/2020] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:35.213200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abf5e1-cf10-4e19-ac40-3438d7735c8f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:35.230073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abf5e1-cf10-4e19-ac40-3438d7735c8f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:35.237948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14161264-1a8d-4c8b-b98e-c8234dbc53bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:35.239059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14161264-1a8d-4c8b-b98e-c8234dbc53bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:35.239763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14161264-1a8d-4c8b-b98e-c8234dbc53bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:35.240053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14161264-1a8d-4c8b-b98e-c8234dbc53bd admin admin] PATH_INFO: `/v3/projects/d9f2db000a55495bb94abdad0dcd0081/users/417a0c949de9422f9876853f1ef839d4/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:35.241137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:35.246532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14161264-1a8d-4c8b-b98e-c8234dbc53bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f2db000a55495bb94abdad0dcd0081, user_id=417a0c949de9422f9876853f1ef839d4, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:35.252670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14161264-1a8d-4c8b-b98e-c8234dbc53bd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:35.255709 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1013/2021] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:35 2022] POST /identity/v3/projects => generated 375 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:35.260046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7d740-ac19-4d33-a71a-a2f329f55cc2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:35.281873 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1009/2022] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:35 2022] PUT /identity/v3/projects/d9f2db000a55495bb94abdad0dcd0081/users/417a0c949de9422f9876853f1ef839d4/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:35.292850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5667973-9868-4459-afa0-56498c890a74 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:35.293132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5667973-9868-4459-afa0-56498c890a74 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:35.293453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5667973-9868-4459-afa0-56498c890a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:35.332393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a5667973-9868-4459-afa0-56498c890a74 None None] MFA Rules not processed for user `417a0c949de9422f9876853f1ef839d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:35.336987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a5667973-9868-4459-afa0-56498c890a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:35.398769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7d740-ac19-4d33-a71a-a2f329f55cc2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:35.504902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f0030-be01-4178-b4ea-e4c4f8509fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:35.505510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f0030-be01-4178-b4ea-e4c4f8509fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:35.505793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f0030-be01-4178-b4ea-e4c4f8509fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:35.506065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f0030-be01-4178-b4ea-e4c4f8509fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:35.506732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f0030-be01-4178-b4ea-e4c4f8509fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:35.508983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f0030-be01-4178-b4ea-e4c4f8509fa5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:35.575574 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1014/2023] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:35 2022] POST /identity/v3/users => generated 294 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:19:35.576816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f0030-be01-4178-b4ea-e4c4f8509fa5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:35.611305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f0030-be01-4178-b4ea-e4c4f8509fa5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:35.615650 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1010/2024] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:35.617573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429e593-5193-4550-b0cc-94fccdb1b3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:35.618953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429e593-5193-4550-b0cc-94fccdb1b3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:35.619710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429e593-5193-4550-b0cc-94fccdb1b3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:35.620423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429e593-5193-4550-b0cc-94fccdb1b3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:35.621758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429e593-5193-4550-b0cc-94fccdb1b3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:35.626134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429e593-5193-4550-b0cc-94fccdb1b3f0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:35.681464 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1015/2025] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:35.686620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5667973-9868-4459-afa0-56498c890a74 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:35.702198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5667973-9868-4459-afa0-56498c890a74 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:35.710674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9d740-7277-4870-bf7d-7abf7b4239f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:35.713260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9d740-7277-4870-bf7d-7abf7b4239f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:35.713833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9d740-7277-4870-bf7d-7abf7b4239f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:35.714380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9d740-7277-4870-bf7d-7abf7b4239f7 admin admin] PATH_INFO: `/v3/projects/173d0f8552c741fcb3ab0559d041d977/users/df66f8811aac4793871fab96f5ceccc7/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:35.742725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9d740-7277-4870-bf7d-7abf7b4239f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=173d0f8552c741fcb3ab0559d041d977, user_id=df66f8811aac4793871fab96f5ceccc7, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:35.748426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9d740-7277-4870-bf7d-7abf7b4239f7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:35.777954 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1011/2026] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:35 2022] PUT /identity/v3/projects/173d0f8552c741fcb3ab0559d041d977/users/df66f8811aac4793871fab96f5ceccc7/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:35.780472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429e593-5193-4550-b0cc-94fccdb1b3f0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:35.797594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429e593-5193-4550-b0cc-94fccdb1b3f0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:35.931028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9d740-7277-4870-bf7d-7abf7b4239f7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:35.969708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a78c5-794d-4753-bfaf-2e68c4b14146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:35.971656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a78c5-794d-4753-bfaf-2e68c4b14146 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:35.972139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a78c5-794d-4753-bfaf-2e68c4b14146 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:35.973033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a78c5-794d-4753-bfaf-2e68c4b14146 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:35.974317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a78c5-794d-4753-bfaf-2e68c4b14146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:35.977250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a78c5-794d-4753-bfaf-2e68c4b14146 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:36.008361 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1016/2027] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:36.009603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a78c5-794d-4753-bfaf-2e68c4b14146 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:36.033226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a78c5-794d-4753-bfaf-2e68c4b14146 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:36.046807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97953fea-41e6-40a2-824e-1debf6c4f1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:36.047543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97953fea-41e6-40a2-824e-1debf6c4f1e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:36.047831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97953fea-41e6-40a2-824e-1debf6c4f1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:36.048109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97953fea-41e6-40a2-824e-1debf6c4f1e2 admin admin] PATH_INFO: `/v3/projects/173d0f8552c741fcb3ab0559d041d977/users/df66f8811aac4793871fab96f5ceccc7/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:36.056543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97953fea-41e6-40a2-824e-1debf6c4f1e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=173d0f8552c741fcb3ab0559d041d977, user_id=df66f8811aac4793871fab96f5ceccc7, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:36.070752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97953fea-41e6-40a2-824e-1debf6c4f1e2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:36.099600 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1017/2028] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:36 2022] PUT /identity/v3/projects/173d0f8552c741fcb3ab0559d041d977/users/df66f8811aac4793871fab96f5ceccc7/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:36.111324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d8f9f-9a50-40e1-b9e4-178119b3675a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:36.111549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d8f9f-9a50-40e1-b9e4-178119b3675a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:36.111899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d8f9f-9a50-40e1-b9e4-178119b3675a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:36.148128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:36.165651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c91d8f9f-9a50-40e1-b9e4-178119b3675a None None] MFA Rules not processed for user `df66f8811aac4793871fab96f5ceccc7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:36.167291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c91d8f9f-9a50-40e1-b9e4-178119b3675a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:36.168190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9d740-7277-4870-bf7d-7abf7b4239f7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:36.196052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:36.333669 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1018/2029] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:19:36.335772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4993d-5e13-4e30-989f-50a86f05ce7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:36.336082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae2e20-f90a-4dc8-8cd9-25455e8f1384 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:36.336532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae2e20-f90a-4dc8-8cd9-25455e8f1384 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:36.336730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4993d-5e13-4e30-989f-50a86f05ce7b service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:36.337039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae2e20-f90a-4dc8-8cd9-25455e8f1384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:36.337162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4993d-5e13-4e30-989f-50a86f05ce7b service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:36.337635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4993d-5e13-4e30-989f-50a86f05ce7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:36.391361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b0ae2e20-f90a-4dc8-8cd9-25455e8f1384 None None] MFA Rules not processed for user `062028896c1f4599a1a0fc25d4260c02`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:36.393507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0ae2e20-f90a-4dc8-8cd9-25455e8f1384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:36.462812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4993d-5e13-4e30-989f-50a86f05ce7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:36.465283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4993d-5e13-4e30-989f-50a86f05ce7b service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:36.481075 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1012/2030] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:36.597715 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1019/2031] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:37.778026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4993d-5e13-4e30-989f-50a86f05ce7b service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:37.800390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4993d-5e13-4e30-989f-50a86f05ce7b service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:37.813835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0d399-b859-44e2-8899-6cb62654af34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:37.814604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0d399-b859-44e2-8899-6cb62654af34 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:37.814734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0d399-b859-44e2-8899-6cb62654af34 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:37.815001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0d399-b859-44e2-8899-6cb62654af34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:37.832569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0d399-b859-44e2-8899-6cb62654af34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:37.834307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0d399-b859-44e2-8899-6cb62654af34 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:37.861966 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1013/2032] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:37.905386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae2e20-f90a-4dc8-8cd9-25455e8f1384 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:37.906914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0ae2e20-f90a-4dc8-8cd9-25455e8f1384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:37.948514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae2e20-f90a-4dc8-8cd9-25455e8f1384 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:37.966909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e08bb-3659-4198-badb-b475ddee5575 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:37.967603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e08bb-3659-4198-badb-b475ddee5575 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:37.967879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e08bb-3659-4198-badb-b475ddee5575 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:37.968151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e08bb-3659-4198-badb-b475ddee5575 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:38.097741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e08bb-3659-4198-badb-b475ddee5575 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:38.101340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e08bb-3659-4198-badb-b475ddee5575 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:38.127218 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1020/2033] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:39.845952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0d399-b859-44e2-8899-6cb62654af34 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:39.924568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580c38f-e2fc-4806-97d4-5234638abbf4 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:39.925636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580c38f-e2fc-4806-97d4-5234638abbf4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:39.926065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580c38f-e2fc-4806-97d4-5234638abbf4 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:39.927631 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1021/2034] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 18:19:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:19:39.935592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1de25-6133-402b-94e3-b6db538d536a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:39.936283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1de25-6133-402b-94e3-b6db538d536a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:39.936570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1de25-6133-402b-94e3-b6db538d536a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:39.959007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0d399-b859-44e2-8899-6cb62654af34 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:39.964745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e0d1de25-6133-402b-94e3-b6db538d536a None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:39.966251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e0d1de25-6133-402b-94e3-b6db538d536a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:39.973176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8085a4-de6e-45f4-b370-40a282192990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:39.976193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8085a4-de6e-45f4-b370-40a282192990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:39.976804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8085a4-de6e-45f4-b370-40a282192990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:39.978525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8085a4-de6e-45f4-b370-40a282192990 admin admin] PATH_INFO: `/v3/users/f095925d3fc54784adef258d1f5ef02e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:39.980421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8085a4-de6e-45f4-b370-40a282192990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f095925d3fc54784adef258d1f5ef02e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:39.996367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8085a4-de6e-45f4-b370-40a282192990 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:40.047705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:40.077154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:40.088918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7b8085a4-de6e-45f4-b370-40a282192990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f095925d3fc54784adef258d1f5ef02e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:40.104611 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1022/2035] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 18:19:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:19:40.107996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7b8085a4-de6e-45f4-b370-40a282192990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f095925d3fc54784adef258d1f5ef02e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:40.108978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7b8085a4-de6e-45f4-b370-40a282192990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f095925d3fc54784adef258d1f5ef02e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:40.109733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7b8085a4-de6e-45f4-b370-40a282192990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f095925d3fc54784adef258d1f5ef02e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:40.115028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1de25-6133-402b-94e3-b6db538d536a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:40.116747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e0d1de25-6133-402b-94e3-b6db538d536a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:40.140590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7b8085a4-de6e-45f4-b370-40a282192990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f095925d3fc54784adef258d1f5ef02e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:40.144649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1de25-6133-402b-94e3-b6db538d536a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:40.152232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baec5a-2f65-475e-a644-2301123f8b7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:40.153064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baec5a-2f65-475e-a644-2301123f8b7f service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:40.153412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baec5a-2f65-475e-a644-2301123f8b7f service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:40.153765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baec5a-2f65-475e-a644-2301123f8b7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:40.156649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94baec5a-2f65-475e-a644-2301123f8b7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:40.167544 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1014/2036] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:39 2022] DELETE /identity/v3/users/f095925d3fc54784adef258d1f5ef02e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:40.172449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe27403-dbe9-478f-9e32-62b2722df5e9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:40.172830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe27403-dbe9-478f-9e32-62b2722df5e9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:40.173389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe27403-dbe9-478f-9e32-62b2722df5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:40.175546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baec5a-2f65-475e-a644-2301123f8b7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:40.177542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baec5a-2f65-475e-a644-2301123f8b7f service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:40.200189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fbe27403-dbe9-478f-9e32-62b2722df5e9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:40.201725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fbe27403-dbe9-478f-9e32-62b2722df5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:40.221425 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1023/2037] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:19:40.310925 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1015/2038] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:40.330432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baec5a-2f65-475e-a644-2301123f8b7f service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:40.332604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94baec5a-2f65-475e-a644-2301123f8b7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:40.483215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baec5a-2f65-475e-a644-2301123f8b7f service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:40.598330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491e00a-49ae-4924-93e1-5d817b4fef4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:40.598983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e00a-49ae-4924-93e1-5d817b4fef4f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:40.599361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e00a-49ae-4924-93e1-5d817b4fef4f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:40.599639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e00a-49ae-4924-93e1-5d817b4fef4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:40.610777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491e00a-49ae-4924-93e1-5d817b4fef4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:40.623288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491e00a-49ae-4924-93e1-5d817b4fef4f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:40.652678 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1024/2039] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:41.427417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe27403-dbe9-478f-9e32-62b2722df5e9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:41.431346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fbe27403-dbe9-478f-9e32-62b2722df5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:41.466315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe27403-dbe9-478f-9e32-62b2722df5e9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:41.477249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657ff38-22bd-4764-be4d-e5902e3a4893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:41.478694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657ff38-22bd-4764-be4d-e5902e3a4893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:41.479123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657ff38-22bd-4764-be4d-e5902e3a4893 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:41.479698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657ff38-22bd-4764-be4d-e5902e3a4893 admin admin] PATH_INFO: `/v3/projects/7b000ee588774020888da86dcbf9320a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:41.481382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657ff38-22bd-4764-be4d-e5902e3a4893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b000ee588774020888da86dcbf9320a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:41.502795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657ff38-22bd-4764-be4d-e5902e3a4893 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:41.596779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6657ff38-22bd-4764-be4d-e5902e3a4893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b000ee588774020888da86dcbf9320a', 'request_id': 'req-6657ff38-22bd-4764-be4d-e5902e3a4893'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:41.606853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6657ff38-22bd-4764-be4d-e5902e3a4893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b000ee588774020888da86dcbf9320a', 'request_id': 'req-6657ff38-22bd-4764-be4d-e5902e3a4893'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:41.613494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6657ff38-22bd-4764-be4d-e5902e3a4893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b000ee588774020888da86dcbf9320a', 'request_id': 'req-6657ff38-22bd-4764-be4d-e5902e3a4893'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:41.640928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6657ff38-22bd-4764-be4d-e5902e3a4893 admin admin] The token cache is being invalidate because project 7b000ee588774020888da86dcbf9320a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:41.641805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6657ff38-22bd-4764-be4d-e5902e3a4893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:41.642721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6657ff38-22bd-4764-be4d-e5902e3a4893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:41.645262 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1016/2040] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:41 2022] DELETE /identity/v3/projects/7b000ee588774020888da86dcbf9320a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:41.649688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491e00a-49ae-4924-93e1-5d817b4fef4f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:41.694839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491e00a-49ae-4924-93e1-5d817b4fef4f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:41.848073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bd39e-4fe6-4637-9c63-907c235ce540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:41.848731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bd39e-4fe6-4637-9c63-907c235ce540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:41.849025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bd39e-4fe6-4637-9c63-907c235ce540 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:41.849278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bd39e-4fe6-4637-9c63-907c235ce540 admin admin] PATH_INFO: `/v3/users/417a0c949de9422f9876853f1ef839d4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:41.851011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391bd39e-4fe6-4637-9c63-907c235ce540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=417a0c949de9422f9876853f1ef839d4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:41.853071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391bd39e-4fe6-4637-9c63-907c235ce540 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:41.886278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:41.930125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-391bd39e-4fe6-4637-9c63-907c235ce540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '417a0c949de9422f9876853f1ef839d4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:41.931942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-391bd39e-4fe6-4637-9c63-907c235ce540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '417a0c949de9422f9876853f1ef839d4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:41.958643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-391bd39e-4fe6-4637-9c63-907c235ce540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '417a0c949de9422f9876853f1ef839d4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:41.972227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-391bd39e-4fe6-4637-9c63-907c235ce540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '417a0c949de9422f9876853f1ef839d4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:42.000524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-391bd39e-4fe6-4637-9c63-907c235ce540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '417a0c949de9422f9876853f1ef839d4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:42.012944 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1025/2041] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:41 2022] DELETE /identity/v3/users/417a0c949de9422f9876853f1ef839d4 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:42.180056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657ff38-22bd-4764-be4d-e5902e3a4893 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:42.184355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6657ff38-22bd-4764-be4d-e5902e3a4893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:42.276534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657ff38-22bd-4764-be4d-e5902e3a4893 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:42.352161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:42.384977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef25cfb-483f-4065-8b73-902230e910c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:42.385986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef25cfb-483f-4065-8b73-902230e910c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:42.386274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef25cfb-483f-4065-8b73-902230e910c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:42.386555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef25cfb-483f-4065-8b73-902230e910c7 admin admin] PATH_INFO: `/v3/users/43f5cb387ac64c48a039f0595e92c8ed` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:42.388023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef25cfb-483f-4065-8b73-902230e910c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f5cb387ac64c48a039f0595e92c8ed)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:42.390097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef25cfb-483f-4065-8b73-902230e910c7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:42.476941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9ef25cfb-483f-4065-8b73-902230e910c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f5cb387ac64c48a039f0595e92c8ed'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:42.512653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9ef25cfb-483f-4065-8b73-902230e910c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f5cb387ac64c48a039f0595e92c8ed'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:42.517851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9ef25cfb-483f-4065-8b73-902230e910c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f5cb387ac64c48a039f0595e92c8ed'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:42.520940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9ef25cfb-483f-4065-8b73-902230e910c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f5cb387ac64c48a039f0595e92c8ed'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:42.538330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9ef25cfb-483f-4065-8b73-902230e910c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f5cb387ac64c48a039f0595e92c8ed'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:42.585337 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1017/2042] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:42 2022] DELETE /identity/v3/users/43f5cb387ac64c48a039f0595e92c8ed => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:42.591568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c815a65-21c2-4e68-8968-273d15c61f42 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:42.592155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c815a65-21c2-4e68-8968-273d15c61f42 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:42.592509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c815a65-21c2-4e68-8968-273d15c61f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:42.618563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2c815a65-21c2-4e68-8968-273d15c61f42 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:42.619439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2c815a65-21c2-4e68-8968-273d15c61f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:42.698561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef25cfb-483f-4065-8b73-902230e910c7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:42.700778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9ef25cfb-483f-4065-8b73-902230e910c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:42.748906 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1026/2043] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:42.816969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c815a65-21c2-4e68-8968-273d15c61f42 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:42.820784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2c815a65-21c2-4e68-8968-273d15c61f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:42.856848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef25cfb-483f-4065-8b73-902230e910c7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:42.877009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44e8a8-cbc0-4a95-b680-0ddc163b1de8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:42.879230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44e8a8-cbc0-4a95-b680-0ddc163b1de8 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:42.879230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44e8a8-cbc0-4a95-b680-0ddc163b1de8 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:42.879547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44e8a8-cbc0-4a95-b680-0ddc163b1de8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:42.883154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6b44e8a8-cbc0-4a95-b680-0ddc163b1de8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:42.969985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c815a65-21c2-4e68-8968-273d15c61f42 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:42.979946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2bd9e-ebf1-4dd5-98ed-7561cdddcb14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:42.980595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2bd9e-ebf1-4dd5-98ed-7561cdddcb14 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:42.980879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2bd9e-ebf1-4dd5-98ed-7561cdddcb14 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:42.981136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2bd9e-ebf1-4dd5-98ed-7561cdddcb14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:43.008530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2bd9e-ebf1-4dd5-98ed-7561cdddcb14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:43.008530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2bd9e-ebf1-4dd5-98ed-7561cdddcb14 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:43.016314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:43.033243 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1027/2044] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:43.034144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44e8a8-cbc0-4a95-b680-0ddc163b1de8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:43.034474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2bd9e-ebf1-4dd5-98ed-7561cdddcb14 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:43.036359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44e8a8-cbc0-4a95-b680-0ddc163b1de8 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:43.037603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-baa2bd9e-ebf1-4dd5-98ed-7561cdddcb14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:43.049829 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1018/2045] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:42 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:43.070485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2bd9e-ebf1-4dd5-98ed-7561cdddcb14 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:43.084095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19c7ba-dd15-480d-b23b-85fded6b7d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:43.085345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19c7ba-dd15-480d-b23b-85fded6b7d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:43.085798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19c7ba-dd15-480d-b23b-85fded6b7d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:43.086240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19c7ba-dd15-480d-b23b-85fded6b7d5e admin admin] PATH_INFO: `/v3/projects/d9f2db000a55495bb94abdad0dcd0081` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:43.088729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19c7ba-dd15-480d-b23b-85fded6b7d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f2db000a55495bb94abdad0dcd0081)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:43.095412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19c7ba-dd15-480d-b23b-85fded6b7d5e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:43.128366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0cb81-fbf9-48cc-90c3-3e32be40abc9 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:43.128822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0cb81-fbf9-48cc-90c3-3e32be40abc9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:43.129409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0cb81-fbf9-48cc-90c3-3e32be40abc9 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:43.132010 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1019/2046] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:19:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:19:43.141713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fcb80-a293-4cf9-8dd6-2d7b715a57f0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:43.142156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fcb80-a293-4cf9-8dd6-2d7b715a57f0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:43.142528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fcb80-a293-4cf9-8dd6-2d7b715a57f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:43.202820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e22fcb80-a293-4cf9-8dd6-2d7b715a57f0 None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:43.206743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e22fcb80-a293-4cf9-8dd6-2d7b715a57f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:43.209407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:43.232226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7c19c7ba-dd15-480d-b23b-85fded6b7d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f2db000a55495bb94abdad0dcd0081', 'request_id': 'req-7c19c7ba-dd15-480d-b23b-85fded6b7d5e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:43.260259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7c19c7ba-dd15-480d-b23b-85fded6b7d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f2db000a55495bb94abdad0dcd0081', 'request_id': 'req-7c19c7ba-dd15-480d-b23b-85fded6b7d5e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:43.289530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7c19c7ba-dd15-480d-b23b-85fded6b7d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f2db000a55495bb94abdad0dcd0081', 'request_id': 'req-7c19c7ba-dd15-480d-b23b-85fded6b7d5e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:43.323889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7c19c7ba-dd15-480d-b23b-85fded6b7d5e admin admin] The token cache is being invalidate because project d9f2db000a55495bb94abdad0dcd0081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:43.323889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7c19c7ba-dd15-480d-b23b-85fded6b7d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:43.325949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7c19c7ba-dd15-480d-b23b-85fded6b7d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:43.331873 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1028/2047] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:43 2022] DELETE /identity/v3/projects/d9f2db000a55495bb94abdad0dcd0081 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:43.340961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76903d-98f0-4f32-b2b3-57d83096e6a8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:43.341359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76903d-98f0-4f32-b2b3-57d83096e6a8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:43.341980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76903d-98f0-4f32-b2b3-57d83096e6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:43.392084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cb76903d-98f0-4f32-b2b3-57d83096e6a8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:43.395040 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1020/2048] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 28 18:19:43.407400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cb76903d-98f0-4f32-b2b3-57d83096e6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:43.443985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fcb80-a293-4cf9-8dd6-2d7b715a57f0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:43.447454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e22fcb80-a293-4cf9-8dd6-2d7b715a57f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:43.500742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fcb80-a293-4cf9-8dd6-2d7b715a57f0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:43.531502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5e2ec-b293-4733-b49f-e2e8d201d452 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:43.533986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e2ec-b293-4733-b49f-e2e8d201d452 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:43.534984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e2ec-b293-4733-b49f-e2e8d201d452 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:43.535315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e2ec-b293-4733-b49f-e2e8d201d452 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:43.573916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5e2ec-b293-4733-b49f-e2e8d201d452 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:43.575820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5e2ec-b293-4733-b49f-e2e8d201d452 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:43.594374 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1021/2049] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:43.608756 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1029/2050] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:43.619132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29879fcb-3d82-44a2-9bfe-8c0fc11dba68 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:43.619516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29879fcb-3d82-44a2-9bfe-8c0fc11dba68 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:43.619890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29879fcb-3d82-44a2-9bfe-8c0fc11dba68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:43.661900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-29879fcb-3d82-44a2-9bfe-8c0fc11dba68 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:43.664400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-29879fcb-3d82-44a2-9bfe-8c0fc11dba68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:43.689113 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1022/2051] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:43.695648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76903d-98f0-4f32-b2b3-57d83096e6a8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:43.711510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76903d-98f0-4f32-b2b3-57d83096e6a8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:43.719167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbcdd9-11e7-414f-8e32-5a39dc3a7f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:43.720590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbcdd9-11e7-414f-8e32-5a39dc3a7f74 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:43.721112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbcdd9-11e7-414f-8e32-5a39dc3a7f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:43.721618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbcdd9-11e7-414f-8e32-5a39dc3a7f74 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:43.722507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbcdd9-11e7-414f-8e32-5a39dc3a7f74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:43.723021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbcdd9-11e7-414f-8e32-5a39dc3a7f74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:43.724989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbcdd9-11e7-414f-8e32-5a39dc3a7f74 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:43.741317 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1030/2052] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:43.745618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29879fcb-3d82-44a2-9bfe-8c0fc11dba68 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:43.768661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29879fcb-3d82-44a2-9bfe-8c0fc11dba68 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:43.775538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670db78-f306-4592-bb33-4a1a3cbd1929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:43.776564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670db78-f306-4592-bb33-4a1a3cbd1929 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:43.777043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670db78-f306-4592-bb33-4a1a3cbd1929 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:43.777562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670db78-f306-4592-bb33-4a1a3cbd1929 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:43.778301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670db78-f306-4592-bb33-4a1a3cbd1929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:43.780863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670db78-f306-4592-bb33-4a1a3cbd1929 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:43.837466 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1023/2053] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:43 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:43.841712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbcdd9-11e7-414f-8e32-5a39dc3a7f74 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:43.857051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbcdd9-11e7-414f-8e32-5a39dc3a7f74 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:43.905470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670db78-f306-4592-bb33-4a1a3cbd1929 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:43.911434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a670db78-f306-4592-bb33-4a1a3cbd1929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:44.112138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ac211-a852-4710-9d90-092294edf62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:44.114787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ac211-a852-4710-9d90-092294edf62e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:44.115232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ac211-a852-4710-9d90-092294edf62e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:44.115546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ac211-a852-4710-9d90-092294edf62e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:44.118286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ac211-a852-4710-9d90-092294edf62e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:44.119784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670db78-f306-4592-bb33-4a1a3cbd1929 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:44.121700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ac211-a852-4710-9d90-092294edf62e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:44.134521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:44.135455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:44.135740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:44.138204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f admin admin] PATH_INFO: `/v3/projects/dfa4381f12d3438089661344f994f0b2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:44.140803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa4381f12d3438089661344f994f0b2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:44.152620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:44.183102 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1031/2054] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:43 2022] POST /identity/v3/users => generated 288 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:44.184435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ac211-a852-4710-9d90-092294edf62e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:44.213849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ac211-a852-4710-9d90-092294edf62e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:44.232374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daca3f7-3dcd-46ce-a132-35304f59726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:44.233123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daca3f7-3dcd-46ce-a132-35304f59726f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:44.233481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daca3f7-3dcd-46ce-a132-35304f59726f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:44.233819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daca3f7-3dcd-46ce-a132-35304f59726f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:44.234702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daca3f7-3dcd-46ce-a132-35304f59726f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:44.236461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daca3f7-3dcd-46ce-a132-35304f59726f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:44.254189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:44.256243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa4381f12d3438089661344f994f0b2', 'request_id': 'req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:44.262868 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1032/2055] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:19:44.266906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daca3f7-3dcd-46ce-a132-35304f59726f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:44.273171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa4381f12d3438089661344f994f0b2', 'request_id': 'req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:44.285457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa4381f12d3438089661344f994f0b2', 'request_id': 'req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:44.292683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daca3f7-3dcd-46ce-a132-35304f59726f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:44.331475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f admin admin] The token cache is being invalidate because project dfa4381f12d3438089661344f994f0b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:44.331954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:44.340426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:44.346346 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1024/2056] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:43 2022] DELETE /identity/v3/projects/dfa4381f12d3438089661344f994f0b2 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:44.348002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:44.350255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:44.383097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:44.428998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b995a8-4da3-47cc-8d97-ec46084a3bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:44.430358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b995a8-4da3-47cc-8d97-ec46084a3bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:44.430841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b995a8-4da3-47cc-8d97-ec46084a3bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:44.431380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b995a8-4da3-47cc-8d97-ec46084a3bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:44.433386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b995a8-4da3-47cc-8d97-ec46084a3bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:44.436066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b995a8-4da3-47cc-8d97-ec46084a3bd0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:44.453041 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1033/2057] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:19:44.457357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b995a8-4da3-47cc-8d97-ec46084a3bd0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:44.464309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-69b995a8-4da3-47cc-8d97-ec46084a3bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:44.480080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b995a8-4da3-47cc-8d97-ec46084a3bd0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:44.486832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6b309-ae24-4398-ad5b-7c2961ca5b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:44.487379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b309-ae24-4398-ad5b-7c2961ca5b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:44.488251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b309-ae24-4398-ad5b-7c2961ca5b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:44.488542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b309-ae24-4398-ad5b-7c2961ca5b72 admin admin] PATH_INFO: `/v3/projects/4d74efe8ace44d66bd7037b90704e600/users/07d15640e89043968af21502b628aa98/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:44.510482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6b309-ae24-4398-ad5b-7c2961ca5b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d74efe8ace44d66bd7037b90704e600, user_id=07d15640e89043968af21502b628aa98, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:44.513390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6b309-ae24-4398-ad5b-7c2961ca5b72 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:44.523363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4cefa-7c17-45f8-8845-62ef2aa26f8f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:44.538668 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1034/2058] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:44 2022] PUT /identity/v3/projects/4d74efe8ace44d66bd7037b90704e600/users/07d15640e89043968af21502b628aa98/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:44.549235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab4287-d3a9-4e8a-b8d2-3f8d57bae3f8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:44.549522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab4287-d3a9-4e8a-b8d2-3f8d57bae3f8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:44.549796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab4287-d3a9-4e8a-b8d2-3f8d57bae3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:44.625428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cdab4287-d3a9-4e8a-b8d2-3f8d57bae3f8 None None] MFA Rules not processed for user `07d15640e89043968af21502b628aa98`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:44.630395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cdab4287-d3a9-4e8a-b8d2-3f8d57bae3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:44.670586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b427d-9bd4-4e48-b0f2-9b62a731c84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:44.671844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b427d-9bd4-4e48-b0f2-9b62a731c84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:44.672431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b427d-9bd4-4e48-b0f2-9b62a731c84f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:44.673021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b427d-9bd4-4e48-b0f2-9b62a731c84f admin admin] PATH_INFO: `/v3/users/80cc409e9e6b408da7f48c674bd458ca` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:44.691560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b427d-9bd4-4e48-b0f2-9b62a731c84f admin admin] RBAC: Authorizing `identity:delete_user(user_id=80cc409e9e6b408da7f48c674bd458ca)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:44.695573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b427d-9bd4-4e48-b0f2-9b62a731c84f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:44.751738 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1035/2059] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:19:44.757962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab4287-d3a9-4e8a-b8d2-3f8d57bae3f8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:44.771388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab4287-d3a9-4e8a-b8d2-3f8d57bae3f8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:44.784394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e01b37-7016-4bcd-895a-6cdfc341e0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:44.785062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e01b37-7016-4bcd-895a-6cdfc341e0da admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:44.785339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e01b37-7016-4bcd-895a-6cdfc341e0da admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:44.785615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e01b37-7016-4bcd-895a-6cdfc341e0da admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:44.785716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-044b427d-9bd4-4e48-b0f2-9b62a731c84f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80cc409e9e6b408da7f48c674bd458ca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:44.786271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e01b37-7016-4bcd-895a-6cdfc341e0da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:44.788376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e01b37-7016-4bcd-895a-6cdfc341e0da admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:44.815753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-044b427d-9bd4-4e48-b0f2-9b62a731c84f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80cc409e9e6b408da7f48c674bd458ca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:44.816732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-044b427d-9bd4-4e48-b0f2-9b62a731c84f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80cc409e9e6b408da7f48c674bd458ca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:44.817378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-044b427d-9bd4-4e48-b0f2-9b62a731c84f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80cc409e9e6b408da7f48c674bd458ca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:44.825298 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1036/2060] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:44 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:44.830312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-044b427d-9bd4-4e48-b0f2-9b62a731c84f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80cc409e9e6b408da7f48c674bd458ca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:44.831385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e01b37-7016-4bcd-895a-6cdfc341e0da admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:44.835100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97e01b37-7016-4bcd-895a-6cdfc341e0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:44.847758 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1025/2061] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:44 2022] DELETE /identity/v3/users/80cc409e9e6b408da7f48c674bd458ca => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:44.930128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b427d-9bd4-4e48-b0f2-9b62a731c84f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:44.931694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-044b427d-9bd4-4e48-b0f2-9b62a731c84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:44.937389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:44.956030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e01b37-7016-4bcd-895a-6cdfc341e0da admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:45.015176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:45.132582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b427d-9bd4-4e48-b0f2-9b62a731c84f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:45.138327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde572f-b1c3-4026-992e-685c612eac39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:45.139109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde572f-b1c3-4026-992e-685c612eac39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:45.139514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde572f-b1c3-4026-992e-685c612eac39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:45.139852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde572f-b1c3-4026-992e-685c612eac39 admin admin] PATH_INFO: `/v3/users/466ca25704e44b68b9e7eaa24d1bcf68` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:45.144322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde572f-b1c3-4026-992e-685c612eac39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=466ca25704e44b68b9e7eaa24d1bcf68)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:45.146616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde572f-b1c3-4026-992e-685c612eac39 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:45.173979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936f135-cb01-4739-9a71-d06d31bf34b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:45.175239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936f135-cb01-4739-9a71-d06d31bf34b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:45.175560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936f135-cb01-4739-9a71-d06d31bf34b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:45.176710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936f135-cb01-4739-9a71-d06d31bf34b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:45.176710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936f135-cb01-4739-9a71-d06d31bf34b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:45.179296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936f135-cb01-4739-9a71-d06d31bf34b5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:45.229517 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1037/2062] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:44 2022] POST /identity/v3/users => generated 295 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:45.230524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936f135-cb01-4739-9a71-d06d31bf34b5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:45.256889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936f135-cb01-4739-9a71-d06d31bf34b5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:45.266835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5fde572f-b1c3-4026-992e-685c612eac39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '466ca25704e44b68b9e7eaa24d1bcf68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:45.270039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305bdd0-5484-41d6-bec1-2605c4354c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:45.270801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305bdd0-5484-41d6-bec1-2605c4354c7e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:45.271086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305bdd0-5484-41d6-bec1-2605c4354c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:45.271391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305bdd0-5484-41d6-bec1-2605c4354c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:45.272061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305bdd0-5484-41d6-bec1-2605c4354c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:45.273716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305bdd0-5484-41d6-bec1-2605c4354c7e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:45.288514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5fde572f-b1c3-4026-992e-685c612eac39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '466ca25704e44b68b9e7eaa24d1bcf68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:45.289861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5fde572f-b1c3-4026-992e-685c612eac39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '466ca25704e44b68b9e7eaa24d1bcf68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:45.292240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5fde572f-b1c3-4026-992e-685c612eac39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '466ca25704e44b68b9e7eaa24d1bcf68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:45.299919 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1038/2063] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:45.301167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305bdd0-5484-41d6-bec1-2605c4354c7e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:45.306305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8305bdd0-5484-41d6-bec1-2605c4354c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:45.306960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5fde572f-b1c3-4026-992e-685c612eac39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '466ca25704e44b68b9e7eaa24d1bcf68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:45.324038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305bdd0-5484-41d6-bec1-2605c4354c7e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:45.330033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22c809-8566-4bae-98e3-5f6e9e7b106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:45.330889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22c809-8566-4bae-98e3-5f6e9e7b106a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:45.331169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22c809-8566-4bae-98e3-5f6e9e7b106a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:45.331482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22c809-8566-4bae-98e3-5f6e9e7b106a admin admin] PATH_INFO: `/v3/projects/37b0885c30fb4606b2c5a11cc4fb4823/users/cb4b9a69c59c4c4badfdf942e7c7320b/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:45.339614 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1026/2064] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:44 2022] DELETE /identity/v3/users/466ca25704e44b68b9e7eaa24d1bcf68 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:19:45.345001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154efad-461c-4978-97e3-fdeb7b941cf1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:45.345363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154efad-461c-4978-97e3-fdeb7b941cf1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:45.345699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154efad-461c-4978-97e3-fdeb7b941cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:45.360294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22c809-8566-4bae-98e3-5f6e9e7b106a admin admin] RBAC: Authorizing `identity:create_grant(project_id=37b0885c30fb4606b2c5a11cc4fb4823, user_id=cb4b9a69c59c4c4badfdf942e7c7320b, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:45.363501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22c809-8566-4bae-98e3-5f6e9e7b106a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:45.378875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5154efad-461c-4978-97e3-fdeb7b941cf1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:45.380801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5154efad-461c-4978-97e3-fdeb7b941cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:45.396411 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1039/2065] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:45 2022] PUT /identity/v3/projects/37b0885c30fb4606b2c5a11cc4fb4823/users/cb4b9a69c59c4c4badfdf942e7c7320b/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:45.397733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22c809-8566-4bae-98e3-5f6e9e7b106a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:45.400040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2e22c809-8566-4bae-98e3-5f6e9e7b106a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:45.506255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22c809-8566-4bae-98e3-5f6e9e7b106a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:45.528140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:45.531113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:45.531842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:45.532180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc admin admin] PATH_INFO: `/v3/projects/ba68a3d6608f45e19f6daf80179fd393` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:45.533604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba68a3d6608f45e19f6daf80179fd393)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:45.536672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:45.590296 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1027/2066] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:45.608604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154efad-461c-4978-97e3-fdeb7b941cf1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:45.640480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154efad-461c-4978-97e3-fdeb7b941cf1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:45.652887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d2c2-67c8-4940-9135-56fb2b12c609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:45.677181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d2c2-67c8-4940-9135-56fb2b12c609 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:45.677780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d2c2-67c8-4940-9135-56fb2b12c609 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:45.678147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d2c2-67c8-4940-9135-56fb2b12c609 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:45.679888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9d2c2-67c8-4940-9135-56fb2b12c609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:45.683677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9d2c2-67c8-4940-9135-56fb2b12c609 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:45.702675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba68a3d6608f45e19f6daf80179fd393', 'request_id': 'req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:45.718057 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1028/2067] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:45.718320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba68a3d6608f45e19f6daf80179fd393', 'request_id': 'req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:45.719694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d2c2-67c8-4940-9135-56fb2b12c609 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:45.727109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-11e9d2c2-67c8-4940-9135-56fb2b12c609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:45.733396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba68a3d6608f45e19f6daf80179fd393', 'request_id': 'req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:45.792092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:45.805004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc admin admin] The token cache is being invalidate because project ba68a3d6608f45e19f6daf80179fd393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:45.805306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:45.806511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:45.814981 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1040/2068] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:45 2022] DELETE /identity/v3/projects/ba68a3d6608f45e19f6daf80179fd393 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:45.814981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:45.814981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:45.820800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:45.993999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d2c2-67c8-4940-9135-56fb2b12c609 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:46.078564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50da6eb-d395-4dfa-9fe1-1e7d95d597dc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:46.092324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39490d3f-392a-40fc-ad8b-97d12c97c9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:46.093035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39490d3f-392a-40fc-ad8b-97d12c97c9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:46.093310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39490d3f-392a-40fc-ad8b-97d12c97c9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:46.093579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39490d3f-392a-40fc-ad8b-97d12c97c9e0 admin admin] PATH_INFO: `/v3/projects/37b0885c30fb4606b2c5a11cc4fb4823/users/cb4b9a69c59c4c4badfdf942e7c7320b/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:46.098205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39490d3f-392a-40fc-ad8b-97d12c97c9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37b0885c30fb4606b2c5a11cc4fb4823, user_id=cb4b9a69c59c4c4badfdf942e7c7320b, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:46.103201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39490d3f-392a-40fc-ad8b-97d12c97c9e0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:46.152766 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1041/2069] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:45 2022] PUT /identity/v3/projects/37b0885c30fb4606b2c5a11cc4fb4823/users/cb4b9a69c59c4c4badfdf942e7c7320b/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:46.154259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83af103-5f2f-4e05-8e6d-81fb406a9c6d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:46.154545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83af103-5f2f-4e05-8e6d-81fb406a9c6d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:46.154821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83af103-5f2f-4e05-8e6d-81fb406a9c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:46.183856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a7a16-e0c9-4a1d-92d8-2e243dfbbdbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:46.184565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a7a16-e0c9-4a1d-92d8-2e243dfbbdbe service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:46.184886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a7a16-e0c9-4a1d-92d8-2e243dfbbdbe service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:46.189323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a7a16-e0c9-4a1d-92d8-2e243dfbbdbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:46.195124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d45a7a16-e0c9-4a1d-92d8-2e243dfbbdbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:46.231043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b83af103-5f2f-4e05-8e6d-81fb406a9c6d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:46.233489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a7a16-e0c9-4a1d-92d8-2e243dfbbdbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:46.236460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b83af103-5f2f-4e05-8e6d-81fb406a9c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:46.243947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a7a16-e0c9-4a1d-92d8-2e243dfbbdbe service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:46.277333 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1029/2070] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:46.280673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ba726-a1aa-4f1d-90b4-526a62249241 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:46.281290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ba726-a1aa-4f1d-90b4-526a62249241 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:46.281666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ba726-a1aa-4f1d-90b4-526a62249241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:46.369320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6d0ba726-a1aa-4f1d-90b4-526a62249241 None None] MFA Rules not processed for user `cb4b9a69c59c4c4badfdf942e7c7320b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:46.371723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6d0ba726-a1aa-4f1d-90b4-526a62249241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:46.408173 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1042/2071] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:46.413670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb371e9-2047-4cc5-b0ab-dc97c2ee54a9 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:46.416219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb371e9-2047-4cc5-b0ab-dc97c2ee54a9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:46.416526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb371e9-2047-4cc5-b0ab-dc97c2ee54a9 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:46.420086 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1043/2072] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 18:19:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:19:46.421103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2131534-0e10-46af-a349-2b0afb4cb476 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:46.421382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2131534-0e10-46af-a349-2b0afb4cb476 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:46.421952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2131534-0e10-46af-a349-2b0afb4cb476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:46.473889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c2131534-0e10-46af-a349-2b0afb4cb476 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:46.475041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c2131534-0e10-46af-a349-2b0afb4cb476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:46.502901 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1044/2073] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:46.505881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a2d1-6c93-4563-9077-6c3999916ed6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:46.506866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a2d1-6c93-4563-9077-6c3999916ed6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:46.508095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a2d1-6c93-4563-9077-6c3999916ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:46.546556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-09e2a2d1-6c93-4563-9077-6c3999916ed6 None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:46.547755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09e2a2d1-6c93-4563-9077-6c3999916ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:46.560967 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1030/2074] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:46.568497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ba726-a1aa-4f1d-90b4-526a62249241 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:46.598158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ba726-a1aa-4f1d-90b4-526a62249241 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:46.609085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4abd5a-83b4-448e-b594-b19a4382dc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:46.609738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4abd5a-83b4-448e-b594-b19a4382dc2a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:46.610021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4abd5a-83b4-448e-b594-b19a4382dc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:46.610318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4abd5a-83b4-448e-b594-b19a4382dc2a admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:46.610969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4abd5a-83b4-448e-b594-b19a4382dc2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:46.611377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4abd5a-83b4-448e-b594-b19a4382dc2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:46.612939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4abd5a-83b4-448e-b594-b19a4382dc2a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:46.645602 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1031/2075] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:46.648995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4abd5a-83b4-448e-b594-b19a4382dc2a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:46.657481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cb4abd5a-83b4-448e-b594-b19a4382dc2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:46.672067 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1045/2076] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 18:19:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:46.674477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2a2d1-6c93-4563-9077-6c3999916ed6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:46.692713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4abd5a-83b4-448e-b594-b19a4382dc2a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:46.699519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106be81-4171-4004-81fe-7377fb30890d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:46.700366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106be81-4171-4004-81fe-7377fb30890d service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:46.700787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106be81-4171-4004-81fe-7377fb30890d service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:46.701238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106be81-4171-4004-81fe-7377fb30890d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:46.713762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106be81-4171-4004-81fe-7377fb30890d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:46.715848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106be81-4171-4004-81fe-7377fb30890d service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:46.729285 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1032/2077] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:46.734176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2a2d1-6c93-4563-9077-6c3999916ed6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:46.747652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508ca42-a3cd-4a2f-bae4-92dd933b45a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:46.748568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508ca42-a3cd-4a2f-bae4-92dd933b45a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:46.748997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508ca42-a3cd-4a2f-bae4-92dd933b45a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:46.749455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508ca42-a3cd-4a2f-bae4-92dd933b45a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:46.750628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508ca42-a3cd-4a2f-bae4-92dd933b45a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:46.753923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508ca42-a3cd-4a2f-bae4-92dd933b45a1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:46.809362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:46.842884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106be81-4171-4004-81fe-7377fb30890d service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:46.843838 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1046/2078] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:46 2022] POST /identity/v3/projects => generated 393 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:46.845107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508ca42-a3cd-4a2f-bae4-92dd933b45a1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:46.856008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106be81-4171-4004-81fe-7377fb30890d service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:46.894804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:46.944062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508ca42-a3cd-4a2f-bae4-92dd933b45a1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:46.950629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb1496-741c-48c9-8dec-eeef5a865457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:46.951721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb1496-741c-48c9-8dec-eeef5a865457 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:46.952228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb1496-741c-48c9-8dec-eeef5a865457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:46.952444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb1496-741c-48c9-8dec-eeef5a865457 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:46.953279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb1496-741c-48c9-8dec-eeef5a865457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:46.956944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb1496-741c-48c9-8dec-eeef5a865457 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:46.960192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff7a6b-2d2f-4887-9f43-302aecd54979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:46.963012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff7a6b-2d2f-4887-9f43-302aecd54979 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:46.966652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff7a6b-2d2f-4887-9f43-302aecd54979 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:46.967034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff7a6b-2d2f-4887-9f43-302aecd54979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:46.988239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff7a6b-2d2f-4887-9f43-302aecd54979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:46.991603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff7a6b-2d2f-4887-9f43-302aecd54979 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:47.012124 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1033/2079] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:47.022543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff7a6b-2d2f-4887-9f43-302aecd54979 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:47.022751 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1047/2080] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:46 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:47.038954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff7a6b-2d2f-4887-9f43-302aecd54979 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:47.047702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199aa53-c370-452c-9f5c-24bb49fd1457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:47.048409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199aa53-c370-452c-9f5c-24bb49fd1457 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:47.049058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199aa53-c370-452c-9f5c-24bb49fd1457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:47.049443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199aa53-c370-452c-9f5c-24bb49fd1457 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:47.050176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199aa53-c370-452c-9f5c-24bb49fd1457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:47.052993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199aa53-c370-452c-9f5c-24bb49fd1457 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:47.082765 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1034/2081] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:47.088993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb1496-741c-48c9-8dec-eeef5a865457 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:47.101493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb1496-741c-48c9-8dec-eeef5a865457 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:47.111776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c4776-c841-45ec-af6c-92d0bce3ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:47.112423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4776-c841-45ec-af6c-92d0bce3ea34 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:47.112702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4776-c841-45ec-af6c-92d0bce3ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:47.112978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4776-c841-45ec-af6c-92d0bce3ea34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:47.113905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c4776-c841-45ec-af6c-92d0bce3ea34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:47.115779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c4776-c841-45ec-af6c-92d0bce3ea34 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:47.150331 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1048/2082] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:47.153901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199aa53-c370-452c-9f5c-24bb49fd1457 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:47.170247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199aa53-c370-452c-9f5c-24bb49fd1457 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:47.175118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30eca40-ec9e-4d06-b454-dac8d699b897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:47.175866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eca40-ec9e-4d06-b454-dac8d699b897 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:47.176154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eca40-ec9e-4d06-b454-dac8d699b897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:47.176461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eca40-ec9e-4d06-b454-dac8d699b897 admin admin] PATH_INFO: `/v3/projects/759b87aad6b345f6bfce02f8415624bb/users/68aba97bb5c94a128fb66ca97e90ad70/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:47.207870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30eca40-ec9e-4d06-b454-dac8d699b897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=759b87aad6b345f6bfce02f8415624bb, user_id=68aba97bb5c94a128fb66ca97e90ad70, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:47.211625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30eca40-ec9e-4d06-b454-dac8d699b897 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:47.247784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9750f-b32b-462f-b653-7aaaf8d9b630 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:47.248104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9750f-b32b-462f-b653-7aaaf8d9b630 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:47.248343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9750f-b32b-462f-b653-7aaaf8d9b630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:47.251864 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1035/2083] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:47 2022] PUT /identity/v3/projects/759b87aad6b345f6bfce02f8415624bb/users/68aba97bb5c94a128fb66ca97e90ad70/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:47.287622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ade9750f-b32b-462f-b653-7aaaf8d9b630 None None] MFA Rules not processed for user `68aba97bb5c94a128fb66ca97e90ad70`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:47.289390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ade9750f-b32b-462f-b653-7aaaf8d9b630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:47.506699 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1049/2084] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:47.511562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30eca40-ec9e-4d06-b454-dac8d699b897 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:47.610539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9750f-b32b-462f-b653-7aaaf8d9b630 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:47.612466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ade9750f-b32b-462f-b653-7aaaf8d9b630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:47.766108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30eca40-ec9e-4d06-b454-dac8d699b897 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:47.777567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372cf5d-64b0-4a08-a400-a34362a26410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:47.778339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372cf5d-64b0-4a08-a400-a34362a26410 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:47.780558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372cf5d-64b0-4a08-a400-a34362a26410 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:47.781579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372cf5d-64b0-4a08-a400-a34362a26410 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:47.782643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372cf5d-64b0-4a08-a400-a34362a26410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:47.792871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372cf5d-64b0-4a08-a400-a34362a26410 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:47.844164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9750f-b32b-462f-b653-7aaaf8d9b630 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:47.850123 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1036/2085] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:47 2022] POST /identity/v3/projects => generated 393 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:47.851332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372cf5d-64b0-4a08-a400-a34362a26410 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:47.865373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90797853-0185-4df4-a52d-b02224aedf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:47.866175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90797853-0185-4df4-a52d-b02224aedf6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:47.866617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90797853-0185-4df4-a52d-b02224aedf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:47.867070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90797853-0185-4df4-a52d-b02224aedf6d admin admin] PATH_INFO: `/v3/projects/1cd14f4e60304dbfa32d188385d80cf4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:47.869607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90797853-0185-4df4-a52d-b02224aedf6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cd14f4e60304dbfa32d188385d80cf4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:47.873639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90797853-0185-4df4-a52d-b02224aedf6d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:47.939232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:48.004899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372cf5d-64b0-4a08-a400-a34362a26410 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:48.017724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-90797853-0185-4df4-a52d-b02224aedf6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cd14f4e60304dbfa32d188385d80cf4', 'request_id': 'req-90797853-0185-4df4-a52d-b02224aedf6d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.023988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:48.037085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-90797853-0185-4df4-a52d-b02224aedf6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cd14f4e60304dbfa32d188385d80cf4', 'request_id': 'req-90797853-0185-4df4-a52d-b02224aedf6d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.048223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-90797853-0185-4df4-a52d-b02224aedf6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cd14f4e60304dbfa32d188385d80cf4', 'request_id': 'req-90797853-0185-4df4-a52d-b02224aedf6d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.083487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-90797853-0185-4df4-a52d-b02224aedf6d admin admin] The token cache is being invalidate because project 1cd14f4e60304dbfa32d188385d80cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:48.084555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-90797853-0185-4df4-a52d-b02224aedf6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.088654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-90797853-0185-4df4-a52d-b02224aedf6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.098836 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1050/2086] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:47 2022] DELETE /identity/v3/projects/1cd14f4e60304dbfa32d188385d80cf4 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:19:48.098836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90797853-0185-4df4-a52d-b02224aedf6d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:48.104619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-90797853-0185-4df4-a52d-b02224aedf6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:48.165282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61b586-a34c-4c55-ab33-ba8187397572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:48.165999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61b586-a34c-4c55-ab33-ba8187397572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:48.167247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61b586-a34c-4c55-ab33-ba8187397572 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:48.167648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61b586-a34c-4c55-ab33-ba8187397572 admin admin] PATH_INFO: `/v3/users/07d15640e89043968af21502b628aa98` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:48.172234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61b586-a34c-4c55-ab33-ba8187397572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d15640e89043968af21502b628aa98)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:48.177297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61b586-a34c-4c55-ab33-ba8187397572 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:48.317237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90797853-0185-4df4-a52d-b02224aedf6d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:48.337433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba4100-a9b8-46b4-bc6c-c6aab655d430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:48.339463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba4100-a9b8-46b4-bc6c-c6aab655d430 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:48.339948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba4100-a9b8-46b4-bc6c-c6aab655d430 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:48.340345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba4100-a9b8-46b4-bc6c-c6aab655d430 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:48.341228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba4100-a9b8-46b4-bc6c-c6aab655d430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:48.343655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba4100-a9b8-46b4-bc6c-c6aab655d430 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:48.381037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ea61b586-a34c-4c55-ab33-ba8187397572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d15640e89043968af21502b628aa98'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.401657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ea61b586-a34c-4c55-ab33-ba8187397572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d15640e89043968af21502b628aa98'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.402847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ea61b586-a34c-4c55-ab33-ba8187397572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d15640e89043968af21502b628aa98'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.415863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ea61b586-a34c-4c55-ab33-ba8187397572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d15640e89043968af21502b628aa98'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.421504 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1051/2087] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:48 2022] POST /identity/v3/users => generated 303 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:48.421504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba4100-a9b8-46b4-bc6c-c6aab655d430 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:48.430564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a5ba4100-a9b8-46b4-bc6c-c6aab655d430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:48.435631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ea61b586-a34c-4c55-ab33-ba8187397572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d15640e89043968af21502b628aa98'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.448502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba4100-a9b8-46b4-bc6c-c6aab655d430 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:48.455789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73303cdb-ff2e-4c1d-be5a-5a30331e58ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:48.456561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73303cdb-ff2e-4c1d-be5a-5a30331e58ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:48.456937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73303cdb-ff2e-4c1d-be5a-5a30331e58ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:48.457203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73303cdb-ff2e-4c1d-be5a-5a30331e58ab admin admin] PATH_INFO: `/v3/users/c83d61bcaa2e4df6b8af5804a3eea488` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:48.458432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73303cdb-ff2e-4c1d-be5a-5a30331e58ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83d61bcaa2e4df6b8af5804a3eea488)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:48.458964 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1037/2088] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:47 2022] DELETE /identity/v3/users/07d15640e89043968af21502b628aa98 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:48.460204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61b586-a34c-4c55-ab33-ba8187397572 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:48.460667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73303cdb-ff2e-4c1d-be5a-5a30331e58ab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:48.463114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ea61b586-a34c-4c55-ab33-ba8187397572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:48.563970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-73303cdb-ff2e-4c1d-be5a-5a30331e58ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83d61bcaa2e4df6b8af5804a3eea488'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.564840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-73303cdb-ff2e-4c1d-be5a-5a30331e58ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83d61bcaa2e4df6b8af5804a3eea488'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.584284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-73303cdb-ff2e-4c1d-be5a-5a30331e58ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83d61bcaa2e4df6b8af5804a3eea488'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.602289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-73303cdb-ff2e-4c1d-be5a-5a30331e58ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83d61bcaa2e4df6b8af5804a3eea488'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.613304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61b586-a34c-4c55-ab33-ba8187397572 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:48.623332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-73303cdb-ff2e-4c1d-be5a-5a30331e58ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83d61bcaa2e4df6b8af5804a3eea488'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.624691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915e317-e4f5-4c02-b6bc-4ccab6bfb62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:48.626212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e317-e4f5-4c02-b6bc-4ccab6bfb62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:48.626685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e317-e4f5-4c02-b6bc-4ccab6bfb62f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:48.627217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e317-e4f5-4c02-b6bc-4ccab6bfb62f admin admin] PATH_INFO: `/v3/users/dcb628c8f43d423e80393eaa3ca709a7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:48.630474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915e317-e4f5-4c02-b6bc-4ccab6bfb62f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb628c8f43d423e80393eaa3ca709a7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:48.635146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=78,keystone:DELETE=17,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:48.636720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915e317-e4f5-4c02-b6bc-4ccab6bfb62f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:48.637924 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1052/2089] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:48 2022] DELETE /identity/v3/users/c83d61bcaa2e4df6b8af5804a3eea488 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:48.640567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe330f-5862-42da-81e2-170b26f9c355 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:48.656167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe330f-5862-42da-81e2-170b26f9c355 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:48.656522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe330f-5862-42da-81e2-170b26f9c355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:48.700748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3afe330f-5862-42da-81e2-170b26f9c355 None None] MFA Rules not processed for user `c2187dbb36d84ea7be564d69b10e6302`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:48.702016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3afe330f-5862-42da-81e2-170b26f9c355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:48.704310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:48.734007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1915e317-e4f5-4c02-b6bc-4ccab6bfb62f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb628c8f43d423e80393eaa3ca709a7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.777692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1915e317-e4f5-4c02-b6bc-4ccab6bfb62f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb628c8f43d423e80393eaa3ca709a7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.778775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1915e317-e4f5-4c02-b6bc-4ccab6bfb62f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb628c8f43d423e80393eaa3ca709a7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.779790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1915e317-e4f5-4c02-b6bc-4ccab6bfb62f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb628c8f43d423e80393eaa3ca709a7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.798011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1915e317-e4f5-4c02-b6bc-4ccab6bfb62f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb628c8f43d423e80393eaa3ca709a7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:48.819862 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1038/2090] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:48 2022] DELETE /identity/v3/users/dcb628c8f43d423e80393eaa3ca709a7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:48.821659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915e317-e4f5-4c02-b6bc-4ccab6bfb62f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:48.824231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1915e317-e4f5-4c02-b6bc-4ccab6bfb62f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:48.831080 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1053/2091] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:48.832831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458273b6-478c-4042-9e7a-1550ef7f5b57 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:48.833263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458273b6-478c-4042-9e7a-1550ef7f5b57 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:48.833824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458273b6-478c-4042-9e7a-1550ef7f5b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:48.872417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-458273b6-478c-4042-9e7a-1550ef7f5b57 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:48.874764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-458273b6-478c-4042-9e7a-1550ef7f5b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:48.971014 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1054/2092] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:48.992069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458273b6-478c-4042-9e7a-1550ef7f5b57 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:48.995192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-458273b6-478c-4042-9e7a-1550ef7f5b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:48.995727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915e317-e4f5-4c02-b6bc-4ccab6bfb62f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:49.005396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0559214-2eab-40a8-8b20-8262ca229aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:49.007167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0559214-2eab-40a8-8b20-8262ca229aef admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:49.007860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0559214-2eab-40a8-8b20-8262ca229aef admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:49.008797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0559214-2eab-40a8-8b20-8262ca229aef admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:49.010002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0559214-2eab-40a8-8b20-8262ca229aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:49.014877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0559214-2eab-40a8-8b20-8262ca229aef admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:49.049904 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1039/2093] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:49.049904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0559214-2eab-40a8-8b20-8262ca229aef admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:49.063973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0559214-2eab-40a8-8b20-8262ca229aef admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:49.070759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bc3b1-217f-461a-82c9-6540e84bddca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:49.071526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bc3b1-217f-461a-82c9-6540e84bddca admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:49.071808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bc3b1-217f-461a-82c9-6540e84bddca admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:49.072084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bc3b1-217f-461a-82c9-6540e84bddca admin admin] PATH_INFO: `/v3/projects/d5bf41103ebe45d38555d04a1befcd47/users/5c10d70451b841da992ddb4cf47229d8/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:49.098329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0bc3b1-217f-461a-82c9-6540e84bddca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5bf41103ebe45d38555d04a1befcd47, user_id=5c10d70451b841da992ddb4cf47229d8, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:49.101002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0bc3b1-217f-461a-82c9-6540e84bddca admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:49.106452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458273b6-478c-4042-9e7a-1550ef7f5b57 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:49.112653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac67d9-31e8-40a0-a7f1-d78c3e5753ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:49.113731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac67d9-31e8-40a0-a7f1-d78c3e5753ab service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:49.114243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac67d9-31e8-40a0-a7f1-d78c3e5753ab service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:49.114666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac67d9-31e8-40a0-a7f1-d78c3e5753ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:49.126018 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1040/2094] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:49 2022] PUT /identity/v3/projects/d5bf41103ebe45d38555d04a1befcd47/users/5c10d70451b841da992ddb4cf47229d8/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:49.127892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bc3b1-217f-461a-82c9-6540e84bddca admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:49.130248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cc0bc3b1-217f-461a-82c9-6540e84bddca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:49.131022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac67d9-31e8-40a0-a7f1-d78c3e5753ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:49.133192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac67d9-31e8-40a0-a7f1-d78c3e5753ab service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:49.165899 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1055/2095] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:19:49.167127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac67d9-31e8-40a0-a7f1-d78c3e5753ab service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:49.185814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac67d9-31e8-40a0-a7f1-d78c3e5753ab service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:49.264463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bc3b1-217f-461a-82c9-6540e84bddca admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:49.272486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030729d-febe-4b63-b397-c4f2f8098f11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:49.273443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030729d-febe-4b63-b397-c4f2f8098f11 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:49.274355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030729d-febe-4b63-b397-c4f2f8098f11 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:49.274642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030729d-febe-4b63-b397-c4f2f8098f11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:49.277401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f030729d-febe-4b63-b397-c4f2f8098f11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:49.279882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:49.298658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c00bd6-55d4-4133-8e74-604d7121ad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:49.299367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c00bd6-55d4-4133-8e74-604d7121ad7a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:49.299638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c00bd6-55d4-4133-8e74-604d7121ad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:49.299910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c00bd6-55d4-4133-8e74-604d7121ad7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:49.300569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c00bd6-55d4-4133-8e74-604d7121ad7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:49.302216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c00bd6-55d4-4133-8e74-604d7121ad7a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:49.302910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:49.317414 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1056/2096] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:49.318975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c00bd6-55d4-4133-8e74-604d7121ad7a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:49.321794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-16c00bd6-55d4-4133-8e74-604d7121ad7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:49.343207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c00bd6-55d4-4133-8e74-604d7121ad7a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:49.351090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4c05a-6171-4f63-9511-d33cab08377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:49.352763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4c05a-6171-4f63-9511-d33cab08377c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:49.353567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4c05a-6171-4f63-9511-d33cab08377c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:49.354054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4c05a-6171-4f63-9511-d33cab08377c admin admin] PATH_INFO: `/v3/projects/7d7ea433a00346caade6bbb2df0143b7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:49.356197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4c05a-6171-4f63-9511-d33cab08377c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d7ea433a00346caade6bbb2df0143b7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:49.359706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4c05a-6171-4f63-9511-d33cab08377c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:49.370445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030729d-febe-4b63-b397-c4f2f8098f11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:49.372687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030729d-febe-4b63-b397-c4f2f8098f11 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:49.387632 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1041/2097] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:49 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:49.388600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030729d-febe-4b63-b397-c4f2f8098f11 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:49.402653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030729d-febe-4b63-b397-c4f2f8098f11 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:49.411542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6bfda-de8e-4640-ba63-88f9c8c12230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:49.412402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6bfda-de8e-4640-ba63-88f9c8c12230 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:49.412885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6bfda-de8e-4640-ba63-88f9c8c12230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:49.413285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6bfda-de8e-4640-ba63-88f9c8c12230 admin admin] PATH_INFO: `/v3/projects/d5bf41103ebe45d38555d04a1befcd47/users/5c10d70451b841da992ddb4cf47229d8/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:49.417457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6bfda-de8e-4640-ba63-88f9c8c12230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5bf41103ebe45d38555d04a1befcd47, user_id=5c10d70451b841da992ddb4cf47229d8, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:49.419463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6bfda-de8e-4640-ba63-88f9c8c12230 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:49.433052 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1042/2098] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:49 2022] PUT /identity/v3/projects/d5bf41103ebe45d38555d04a1befcd47/users/5c10d70451b841da992ddb4cf47229d8/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:49.445942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718c890-1db7-4f7f-a5c2-91b9c8d50be8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:49.446729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718c890-1db7-4f7f-a5c2-91b9c8d50be8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:49.447132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718c890-1db7-4f7f-a5c2-91b9c8d50be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:49.452201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10b4c05a-6171-4f63-9511-d33cab08377c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d7ea433a00346caade6bbb2df0143b7', 'request_id': 'req-10b4c05a-6171-4f63-9511-d33cab08377c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:49.466420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10b4c05a-6171-4f63-9511-d33cab08377c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d7ea433a00346caade6bbb2df0143b7', 'request_id': 'req-10b4c05a-6171-4f63-9511-d33cab08377c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:49.477615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10b4c05a-6171-4f63-9511-d33cab08377c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d7ea433a00346caade6bbb2df0143b7', 'request_id': 'req-10b4c05a-6171-4f63-9511-d33cab08377c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:49.486325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d718c890-1db7-4f7f-a5c2-91b9c8d50be8 None None] MFA Rules not processed for user `5c10d70451b841da992ddb4cf47229d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:49.490803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d718c890-1db7-4f7f-a5c2-91b9c8d50be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:49.497692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10b4c05a-6171-4f63-9511-d33cab08377c admin admin] The token cache is being invalidate because project 7d7ea433a00346caade6bbb2df0143b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:49.498170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10b4c05a-6171-4f63-9511-d33cab08377c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:49.499175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10b4c05a-6171-4f63-9511-d33cab08377c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:49.501899 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1057/2099] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:49 2022] DELETE /identity/v3/projects/7d7ea433a00346caade6bbb2df0143b7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:49.509113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3dcc5-8eb7-4ba1-852b-dc7e8cb36c8e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:49.509525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3dcc5-8eb7-4ba1-852b-dc7e8cb36c8e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:49.510136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3dcc5-8eb7-4ba1-852b-dc7e8cb36c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:49.556809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-41b3dcc5-8eb7-4ba1-852b-dc7e8cb36c8e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:49.559286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-41b3dcc5-8eb7-4ba1-852b-dc7e8cb36c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:49.622418 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1043/2100] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:49.623660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718c890-1db7-4f7f-a5c2-91b9c8d50be8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:49.625887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d718c890-1db7-4f7f-a5c2-91b9c8d50be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:49.691198 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1058/2101] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:49.692828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664950e9-429a-49ce-8cf0-a70ca00da405 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:49.693628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664950e9-429a-49ce-8cf0-a70ca00da405 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:49.693628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664950e9-429a-49ce-8cf0-a70ca00da405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:49.724857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-664950e9-429a-49ce-8cf0-a70ca00da405 None None] MFA Rules not processed for user `68aba97bb5c94a128fb66ca97e90ad70`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:49.727027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-664950e9-429a-49ce-8cf0-a70ca00da405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:49.754547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718c890-1db7-4f7f-a5c2-91b9c8d50be8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:49.762383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:49.763371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:49.763863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:49.764327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f admin admin] PATH_INFO: `/v3/projects/085bbfe6c3574cd29ef4542fe4033b94` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:49.766010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f admin admin] RBAC: Authorizing `identity:delete_project(project_id=085bbfe6c3574cd29ef4542fe4033b94)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:49.768484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:49.848080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:49.872629 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1059/2102] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:49.882531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6fefe-1d45-4392-9dab-df07e216cb2f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:49.883048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6fefe-1d45-4392-9dab-df07e216cb2f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:49.883547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6fefe-1d45-4392-9dab-df07e216cb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:49.889197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085bbfe6c3574cd29ef4542fe4033b94', 'request_id': 'req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:49.917093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085bbfe6c3574cd29ef4542fe4033b94', 'request_id': 'req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:49.917401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0ed6fefe-1d45-4392-9dab-df07e216cb2f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:49.919486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0ed6fefe-1d45-4392-9dab-df07e216cb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:49.926630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085bbfe6c3574cd29ef4542fe4033b94', 'request_id': 'req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:49.955920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f admin admin] The token cache is being invalidate because project 085bbfe6c3574cd29ef4542fe4033b94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:49.956884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:49.958299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:49.962281 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1044/2103] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:49 2022] DELETE /identity/v3/projects/085bbfe6c3574cd29ef4542fe4033b94 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:49.967521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:49.969172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:49.971341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:50.092475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad882a4-9bb2-4191-9a6f-ef9db3f8d33f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:50.102667 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1060/2104] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:50.106398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6fefe-1d45-4392-9dab-df07e216cb2f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:50.106509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d400a16-c1a3-4ee8-9925-4135c87230e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:50.106509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d400a16-c1a3-4ee8-9925-4135c87230e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:50.106509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d400a16-c1a3-4ee8-9925-4135c87230e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:50.106509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d400a16-c1a3-4ee8-9925-4135c87230e2 admin admin] PATH_INFO: `/v3/users/79fd6a956dcd46628dd085a626731217` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:50.106999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d400a16-c1a3-4ee8-9925-4135c87230e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79fd6a956dcd46628dd085a626731217)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:50.107683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0ed6fefe-1d45-4392-9dab-df07e216cb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:50.109624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d400a16-c1a3-4ee8-9925-4135c87230e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:50.125387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6fefe-1d45-4392-9dab-df07e216cb2f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:50.137566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13321072-aafe-4f58-b6a1-8363c56b878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:50.138464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321072-aafe-4f58-b6a1-8363c56b878e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:50.138940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321072-aafe-4f58-b6a1-8363c56b878e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:50.140394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321072-aafe-4f58-b6a1-8363c56b878e admin admin] PATH_INFO: `/v3/projects/4d74efe8ace44d66bd7037b90704e600` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:50.141867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13321072-aafe-4f58-b6a1-8363c56b878e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d74efe8ace44d66bd7037b90704e600)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:50.144008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13321072-aafe-4f58-b6a1-8363c56b878e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:50.197598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d400a16-c1a3-4ee8-9925-4135c87230e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79fd6a956dcd46628dd085a626731217'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:50.227632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d400a16-c1a3-4ee8-9925-4135c87230e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79fd6a956dcd46628dd085a626731217'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:50.228769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d400a16-c1a3-4ee8-9925-4135c87230e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79fd6a956dcd46628dd085a626731217'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:50.229394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d400a16-c1a3-4ee8-9925-4135c87230e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79fd6a956dcd46628dd085a626731217'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:50.239690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13321072-aafe-4f58-b6a1-8363c56b878e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d74efe8ace44d66bd7037b90704e600', 'request_id': 'req-13321072-aafe-4f58-b6a1-8363c56b878e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:50.241572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d400a16-c1a3-4ee8-9925-4135c87230e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79fd6a956dcd46628dd085a626731217'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:50.257838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13321072-aafe-4f58-b6a1-8363c56b878e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d74efe8ace44d66bd7037b90704e600', 'request_id': 'req-13321072-aafe-4f58-b6a1-8363c56b878e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:50.263642 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1045/2105] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:49 2022] DELETE /identity/v3/users/79fd6a956dcd46628dd085a626731217 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:50.264767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d400a16-c1a3-4ee8-9925-4135c87230e2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:50.266216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5d400a16-c1a3-4ee8-9925-4135c87230e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:50.279278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13321072-aafe-4f58-b6a1-8363c56b878e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d74efe8ace44d66bd7037b90704e600', 'request_id': 'req-13321072-aafe-4f58-b6a1-8363c56b878e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:50.314197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13321072-aafe-4f58-b6a1-8363c56b878e admin admin] The token cache is being invalidate because project 4d74efe8ace44d66bd7037b90704e600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:50.315423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13321072-aafe-4f58-b6a1-8363c56b878e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:50.331301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13321072-aafe-4f58-b6a1-8363c56b878e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:50.339216 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1061/2106] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:50 2022] DELETE /identity/v3/projects/4d74efe8ace44d66bd7037b90704e600 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:50.340309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13321072-aafe-4f58-b6a1-8363c56b878e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:50.344833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13321072-aafe-4f58-b6a1-8363c56b878e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:50.354149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:50.416694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d400a16-c1a3-4ee8-9925-4135c87230e2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:50.431170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d5ba5-0ede-45f8-9fe0-77b70eec49c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:50.432041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d5ba5-0ede-45f8-9fe0-77b70eec49c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:50.432330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d5ba5-0ede-45f8-9fe0-77b70eec49c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:50.432590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d5ba5-0ede-45f8-9fe0-77b70eec49c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:50.433275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d5ba5-0ede-45f8-9fe0-77b70eec49c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:50.433578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d5ba5-0ede-45f8-9fe0-77b70eec49c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:50.435213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d5ba5-0ede-45f8-9fe0-77b70eec49c9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:50.465739 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1046/2107] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:50.468119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d5ba5-0ede-45f8-9fe0-77b70eec49c9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:50.471142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cb1d5ba5-0ede-45f8-9fe0-77b70eec49c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:50.483833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13321072-aafe-4f58-b6a1-8363c56b878e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:50.495983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d5ba5-0ede-45f8-9fe0-77b70eec49c9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:50.508203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f27aa-dc79-4941-b161-87749d6734cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:50.508908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f27aa-dc79-4941-b161-87749d6734cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:50.509199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f27aa-dc79-4941-b161-87749d6734cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:50.509725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f27aa-dc79-4941-b161-87749d6734cb admin admin] PATH_INFO: `/v3/users/cb4b9a69c59c4c4badfdf942e7c7320b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:50.511539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f27aa-dc79-4941-b161-87749d6734cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb4b9a69c59c4c4badfdf942e7c7320b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:50.514022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f27aa-dc79-4941-b161-87749d6734cb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:50.588152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-af3f27aa-dc79-4941-b161-87749d6734cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb4b9a69c59c4c4badfdf942e7c7320b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:50.598817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:50.619170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-af3f27aa-dc79-4941-b161-87749d6734cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb4b9a69c59c4c4badfdf942e7c7320b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:50.620061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-af3f27aa-dc79-4941-b161-87749d6734cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb4b9a69c59c4c4badfdf942e7c7320b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:50.622088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-af3f27aa-dc79-4941-b161-87749d6734cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb4b9a69c59c4c4badfdf942e7c7320b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:50.639339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-af3f27aa-dc79-4941-b161-87749d6734cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb4b9a69c59c4c4badfdf942e7c7320b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:50.668456 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1047/2108] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:50 2022] DELETE /identity/v3/users/cb4b9a69c59c4c4badfdf942e7c7320b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:50.673658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f27aa-dc79-4941-b161-87749d6734cb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:50.675285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-af3f27aa-dc79-4941-b161-87749d6734cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:50.699599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5d4a0-7c23-4cf5-a980-9363e1720c1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:50.700246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5d4a0-7c23-4cf5-a980-9363e1720c1a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:50.700537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5d4a0-7c23-4cf5-a980-9363e1720c1a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:50.700814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5d4a0-7c23-4cf5-a980-9363e1720c1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:50.702723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48e5d4a0-7c23-4cf5-a980-9363e1720c1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:50.865536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5d4a0-7c23-4cf5-a980-9363e1720c1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:50.872371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5d4a0-7c23-4cf5-a980-9363e1720c1a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:50.880210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f27aa-dc79-4941-b161-87749d6734cb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:50.891582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7a076-0ac5-4e81-9dbf-5914401e97ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:50.892230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7a076-0ac5-4e81-9dbf-5914401e97ce admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:50.892554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7a076-0ac5-4e81-9dbf-5914401e97ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:50.892838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7a076-0ac5-4e81-9dbf-5914401e97ce admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:50.894038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7a076-0ac5-4e81-9dbf-5914401e97ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:50.896295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7a076-0ac5-4e81-9dbf-5914401e97ce admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:50.928859 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1062/2109] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:50.931057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5d4a0-7c23-4cf5-a980-9363e1720c1a service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:50.934072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48e5d4a0-7c23-4cf5-a980-9363e1720c1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:50.941602 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1048/2110] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:50 2022] POST /identity/v3/projects => generated 381 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:50.946500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7a076-0ac5-4e81-9dbf-5914401e97ce admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:50.985874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5d4a0-7c23-4cf5-a980-9363e1720c1a service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:51.033113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:51.102512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e37f38-606a-4373-a6a9-84a6a386e5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:51.103175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e37f38-606a-4373-a6a9-84a6a386e5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:51.104233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e37f38-606a-4373-a6a9-84a6a386e5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:51.104513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e37f38-606a-4373-a6a9-84a6a386e5b4 admin admin] PATH_INFO: `/v3/projects/1dea63374bbe44abb9b793f325ef6ae3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:51.107773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e37f38-606a-4373-a6a9-84a6a386e5b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dea63374bbe44abb9b793f325ef6ae3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:51.109872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e37f38-606a-4373-a6a9-84a6a386e5b4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:51.123022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7a076-0ac5-4e81-9dbf-5914401e97ce admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:51.155707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd311104-2b9e-4e7c-8170-740402d2b258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:51.158192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd311104-2b9e-4e7c-8170-740402d2b258 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:51.158640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd311104-2b9e-4e7c-8170-740402d2b258 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:51.162746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd311104-2b9e-4e7c-8170-740402d2b258 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:51.165333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd311104-2b9e-4e7c-8170-740402d2b258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:51.173171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd311104-2b9e-4e7c-8170-740402d2b258 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:51.224721 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1049/2111] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:50 2022] POST /identity/v3/users => generated 291 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:19:51.225031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd311104-2b9e-4e7c-8170-740402d2b258 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:51.226798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dd311104-2b9e-4e7c-8170-740402d2b258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:51.238013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4e37f38-606a-4373-a6a9-84a6a386e5b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dea63374bbe44abb9b793f325ef6ae3', 'request_id': 'req-f4e37f38-606a-4373-a6a9-84a6a386e5b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:51.240399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd311104-2b9e-4e7c-8170-740402d2b258 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:51.252586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4e37f38-606a-4373-a6a9-84a6a386e5b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dea63374bbe44abb9b793f325ef6ae3', 'request_id': 'req-f4e37f38-606a-4373-a6a9-84a6a386e5b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:51.267203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4e37f38-606a-4373-a6a9-84a6a386e5b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dea63374bbe44abb9b793f325ef6ae3', 'request_id': 'req-f4e37f38-606a-4373-a6a9-84a6a386e5b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:51.298910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4e37f38-606a-4373-a6a9-84a6a386e5b4 admin admin] The token cache is being invalidate because project 1dea63374bbe44abb9b793f325ef6ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:51.303056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4e37f38-606a-4373-a6a9-84a6a386e5b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:51.306869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4e37f38-606a-4373-a6a9-84a6a386e5b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:51.311852 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1063/2112] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:50 2022] DELETE /identity/v3/projects/1dea63374bbe44abb9b793f325ef6ae3 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:51.313819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e37f38-606a-4373-a6a9-84a6a386e5b4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:51.322880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4e37f38-606a-4373-a6a9-84a6a386e5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:51.337349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:51.399601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe9014-75d6-40d2-aa42-91713d726f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:51.400812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe9014-75d6-40d2-aa42-91713d726f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:51.401093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe9014-75d6-40d2-aa42-91713d726f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:51.401365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe9014-75d6-40d2-aa42-91713d726f25 admin admin] PATH_INFO: `/v3/users/6c65df553af04997898c1ee72f3dc40b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:51.402703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe9014-75d6-40d2-aa42-91713d726f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c65df553af04997898c1ee72f3dc40b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:51.406466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe9014-75d6-40d2-aa42-91713d726f25 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:51.541783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5fe9014-75d6-40d2-aa42-91713d726f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c65df553af04997898c1ee72f3dc40b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:51.560187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e37f38-606a-4373-a6a9-84a6a386e5b4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:51.575855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab05b16-7914-4901-ad24-fa1ba13c9dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:51.576572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab05b16-7914-4901-ad24-fa1ba13c9dcc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:51.576850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab05b16-7914-4901-ad24-fa1ba13c9dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:51.576954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5fe9014-75d6-40d2-aa42-91713d726f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c65df553af04997898c1ee72f3dc40b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:51.577157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab05b16-7914-4901-ad24-fa1ba13c9dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:51.577922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab05b16-7914-4901-ad24-fa1ba13c9dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:51.578223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5fe9014-75d6-40d2-aa42-91713d726f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c65df553af04997898c1ee72f3dc40b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:51.579016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5fe9014-75d6-40d2-aa42-91713d726f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c65df553af04997898c1ee72f3dc40b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:51.579729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab05b16-7914-4901-ad24-fa1ba13c9dcc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:51.596733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5fe9014-75d6-40d2-aa42-91713d726f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c65df553af04997898c1ee72f3dc40b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:51.610949 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1064/2113] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:51.612493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe13941-30eb-4ce0-bef5-73b82f63e9df None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:51.612782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe13941-30eb-4ce0-bef5-73b82f63e9df None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:51.613057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe13941-30eb-4ce0-bef5-73b82f63e9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:51.640234 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1050/2114] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:51 2022] DELETE /identity/v3/users/6c65df553af04997898c1ee72f3dc40b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:51.641413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe9014-75d6-40d2-aa42-91713d726f25 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:51.645094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b5fe9014-75d6-40d2-aa42-91713d726f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:51.660143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1fe13941-30eb-4ce0-bef5-73b82f63e9df None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:51.662728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1fe13941-30eb-4ce0-bef5-73b82f63e9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:51.772601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:51.775561 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1065/2115] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:51.776734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe13941-30eb-4ce0-bef5-73b82f63e9df None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:51.778425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1fe13941-30eb-4ce0-bef5-73b82f63e9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:51.807948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe13941-30eb-4ce0-bef5-73b82f63e9df None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:51.819481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe9014-75d6-40d2-aa42-91713d726f25 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:51.820583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27145c24-d14e-436e-bacc-08bd08d43abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:51.821404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27145c24-d14e-436e-bacc-08bd08d43abe admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:51.821781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27145c24-d14e-436e-bacc-08bd08d43abe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:51.822267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27145c24-d14e-436e-bacc-08bd08d43abe admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:51.823032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27145c24-d14e-436e-bacc-08bd08d43abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:51.825500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27145c24-d14e-436e-bacc-08bd08d43abe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:51.826096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde169f-bf24-4678-a648-673b94c5f0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:51.826771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde169f-bf24-4678-a648-673b94c5f0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:51.827052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde169f-bf24-4678-a648-673b94c5f0da admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:51.827654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde169f-bf24-4678-a648-673b94c5f0da admin admin] PATH_INFO: `/v3/projects/37b0885c30fb4606b2c5a11cc4fb4823` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:51.829481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde169f-bf24-4678-a648-673b94c5f0da admin admin] RBAC: Authorizing `identity:delete_project(project_id=37b0885c30fb4606b2c5a11cc4fb4823)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:51.831487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde169f-bf24-4678-a648-673b94c5f0da admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:51.838440 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1066/2116] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:51.848209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e4bc-5b7e-46fa-bc5e-9c91d1da998a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:51.848704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e4bc-5b7e-46fa-bc5e-9c91d1da998a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:51.853362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e4bc-5b7e-46fa-bc5e-9c91d1da998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:51.902399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-61b3e4bc-5b7e-46fa-bc5e-9c91d1da998a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:51.904093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-61b3e4bc-5b7e-46fa-bc5e-9c91d1da998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:51.940046 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1067/2117] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:51.942048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bf0a1-70f7-411a-9198-a5f14c5eac48 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:51.942452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bf0a1-70f7-411a-9198-a5f14c5eac48 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:51.942852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bf0a1-70f7-411a-9198-a5f14c5eac48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:51.993474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cdde169f-bf24-4678-a648-673b94c5f0da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37b0885c30fb4606b2c5a11cc4fb4823', 'request_id': 'req-cdde169f-bf24-4678-a648-673b94c5f0da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:51.996332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d33bf0a1-70f7-411a-9198-a5f14c5eac48 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:52.001013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d33bf0a1-70f7-411a-9198-a5f14c5eac48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:52.010021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cdde169f-bf24-4678-a648-673b94c5f0da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37b0885c30fb4606b2c5a11cc4fb4823', 'request_id': 'req-cdde169f-bf24-4678-a648-673b94c5f0da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:52.034054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cdde169f-bf24-4678-a648-673b94c5f0da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37b0885c30fb4606b2c5a11cc4fb4823', 'request_id': 'req-cdde169f-bf24-4678-a648-673b94c5f0da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:52.064528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cdde169f-bf24-4678-a648-673b94c5f0da admin admin] The token cache is being invalidate because project 37b0885c30fb4606b2c5a11cc4fb4823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:52.064653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cdde169f-bf24-4678-a648-673b94c5f0da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:52.065954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cdde169f-bf24-4678-a648-673b94c5f0da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:52.072164 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1051/2118] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:51 2022] DELETE /identity/v3/projects/37b0885c30fb4606b2c5a11cc4fb4823 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:52.072679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde169f-bf24-4678-a648-673b94c5f0da admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:52.077957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cdde169f-bf24-4678-a648-673b94c5f0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:52.203147 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1068/2119] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:52.208853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bf0a1-70f7-411a-9198-a5f14c5eac48 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:52.214137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d33bf0a1-70f7-411a-9198-a5f14c5eac48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:52.279287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde169f-bf24-4678-a648-673b94c5f0da admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:52.286287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0484c4-8fbc-4ebc-a6f1-6f0c54e86065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:52.287064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0484c4-8fbc-4ebc-a6f1-6f0c54e86065 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:52.287376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0484c4-8fbc-4ebc-a6f1-6f0c54e86065 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:52.287652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0484c4-8fbc-4ebc-a6f1-6f0c54e86065 admin admin] PATH_INFO: `/v3/projects/ff6523454d43458a9a398bf89a738cb2/users/33148543cf534e0a86258ffca7fb336b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:52.305112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:52.319707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0484c4-8fbc-4ebc-a6f1-6f0c54e86065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6523454d43458a9a398bf89a738cb2, user_id=33148543cf534e0a86258ffca7fb336b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:52.323921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0484c4-8fbc-4ebc-a6f1-6f0c54e86065 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:52.350023 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1052/2120] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:52 2022] PUT /identity/v3/projects/ff6523454d43458a9a398bf89a738cb2/users/33148543cf534e0a86258ffca7fb336b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:52.358288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1998117-7045-4833-9c1b-06946ecbf50a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:52.359215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1998117-7045-4833-9c1b-06946ecbf50a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:52.361659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1998117-7045-4833-9c1b-06946ecbf50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:52.406710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c1998117-7045-4833-9c1b-06946ecbf50a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:52.409229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c1998117-7045-4833-9c1b-06946ecbf50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:52.426939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bf0a1-70f7-411a-9198-a5f14c5eac48 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:52.484451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:52.515436 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1053/2121] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:52.521176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1998117-7045-4833-9c1b-06946ecbf50a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:52.523060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c95ff-8ed1-4f1c-86db-00dcb99c241a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:52.523471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c95ff-8ed1-4f1c-86db-00dcb99c241a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:52.523844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c95ff-8ed1-4f1c-86db-00dcb99c241a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:52.524280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c95ff-8ed1-4f1c-86db-00dcb99c241a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:52.539466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ba4c95ff-8ed1-4f1c-86db-00dcb99c241a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:52.540481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1998117-7045-4833-9c1b-06946ecbf50a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:52.546675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fce331-5213-4452-83c6-322c8573d56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:52.548036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fce331-5213-4452-83c6-322c8573d56f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:52.548441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fce331-5213-4452-83c6-322c8573d56f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:52.548781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fce331-5213-4452-83c6-322c8573d56f admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:52.549524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fce331-5213-4452-83c6-322c8573d56f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:52.549905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fce331-5213-4452-83c6-322c8573d56f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:52.551993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fce331-5213-4452-83c6-322c8573d56f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:52.555523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c95ff-8ed1-4f1c-86db-00dcb99c241a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:52.559574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c95ff-8ed1-4f1c-86db-00dcb99c241a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:52.580469 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1069/2122] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:52.580469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853674b4-c278-455d-89c0-ed60bd46c349 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:52.580766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853674b4-c278-455d-89c0-ed60bd46c349 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:52.580766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853674b4-c278-455d-89c0-ed60bd46c349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:52.609730 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1054/2123] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:52.611438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508a0a5-e5ac-4ae2-b7bd-8af2482b2e90 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:52.611729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508a0a5-e5ac-4ae2-b7bd-8af2482b2e90 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:52.612006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508a0a5-e5ac-4ae2-b7bd-8af2482b2e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:52.642869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-853674b4-c278-455d-89c0-ed60bd46c349 None None] MFA Rules not processed for user `33148543cf534e0a86258ffca7fb336b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:52.644165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-853674b4-c278-455d-89c0-ed60bd46c349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:52.656012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d508a0a5-e5ac-4ae2-b7bd-8af2482b2e90 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:52.657248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d508a0a5-e5ac-4ae2-b7bd-8af2482b2e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:52.714993 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1055/2124] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:52.715594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508a0a5-e5ac-4ae2-b7bd-8af2482b2e90 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:52.745567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508a0a5-e5ac-4ae2-b7bd-8af2482b2e90 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:52.758233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e9844-cfa8-469b-9909-55077a49421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:52.758917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e9844-cfa8-469b-9909-55077a49421b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:52.759196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e9844-cfa8-469b-9909-55077a49421b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:52.759506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e9844-cfa8-469b-9909-55077a49421b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:52.760156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e9844-cfa8-469b-9909-55077a49421b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:52.763763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e9844-cfa8-469b-9909-55077a49421b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:52.848037 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1056/2125] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:52 2022] POST /identity/v3/projects => generated 393 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:52.849331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e9844-cfa8-469b-9909-55077a49421b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:52.871867 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1070/2126] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:52.874325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853674b4-c278-455d-89c0-ed60bd46c349 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:52.924276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853674b4-c278-455d-89c0-ed60bd46c349 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:53.015791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e9844-cfa8-469b-9909-55077a49421b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:53.030587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2902f0-ff4e-46e0-a7fd-0ec68fe936a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:53.031285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2902f0-ff4e-46e0-a7fd-0ec68fe936a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:53.031532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2902f0-ff4e-46e0-a7fd-0ec68fe936a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:53.031807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2902f0-ff4e-46e0-a7fd-0ec68fe936a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:53.032598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2902f0-ff4e-46e0-a7fd-0ec68fe936a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:53.033251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2902f0-ff4e-46e0-a7fd-0ec68fe936a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:53.035810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2902f0-ff4e-46e0-a7fd-0ec68fe936a1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:53.057181 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1057/2127] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:53.063422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2902f0-ff4e-46e0-a7fd-0ec68fe936a1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:53.079375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0caf3be-7874-48d0-849e-d6e1ac9ed74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:53.080994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caf3be-7874-48d0-849e-d6e1ac9ed74d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:53.081613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caf3be-7874-48d0-849e-d6e1ac9ed74d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:53.082285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caf3be-7874-48d0-849e-d6e1ac9ed74d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:53.084208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0caf3be-7874-48d0-849e-d6e1ac9ed74d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:53.090355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0caf3be-7874-48d0-849e-d6e1ac9ed74d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:53.097476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2902f0-ff4e-46e0-a7fd-0ec68fe936a1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:53.131887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c75e9-538e-4b99-b0e5-6f509e371dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:53.131887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c75e9-538e-4b99-b0e5-6f509e371dbc admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:53.131887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c75e9-538e-4b99-b0e5-6f509e371dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:53.131887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c75e9-538e-4b99-b0e5-6f509e371dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:53.132352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c75e9-538e-4b99-b0e5-6f509e371dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:53.132352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c75e9-538e-4b99-b0e5-6f509e371dbc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:53.136020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:53.151672 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1071/2128] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:52 2022] POST /identity/v3/users => generated 297 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:53.152887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0caf3be-7874-48d0-849e-d6e1ac9ed74d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:53.186948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0caf3be-7874-48d0-849e-d6e1ac9ed74d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:53.199132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c329a08-2940-4eb8-8776-f058319a5738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:53.199930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c329a08-2940-4eb8-8776-f058319a5738 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:53.200893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c329a08-2940-4eb8-8776-f058319a5738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:53.200893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c329a08-2940-4eb8-8776-f058319a5738 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:53.201132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c329a08-2940-4eb8-8776-f058319a5738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:53.204058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c329a08-2940-4eb8-8776-f058319a5738 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:53.209922 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1058/2129] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:53 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:53.210986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c75e9-538e-4b99-b0e5-6f509e371dbc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:53.311908 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1072/2130] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:53 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:53.313212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c329a08-2940-4eb8-8776-f058319a5738 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:53.450962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c75e9-538e-4b99-b0e5-6f509e371dbc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:53.458996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c329a08-2940-4eb8-8776-f058319a5738 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:53.474418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3888c7d-c817-42f6-8007-d279c67e9cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:53.477075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09daa84-8d5c-4b34-a9b0-54c72a9392e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:53.477217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3888c7d-c817-42f6-8007-d279c67e9cdf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:53.478432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09daa84-8d5c-4b34-a9b0-54c72a9392e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:53.478548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3888c7d-c817-42f6-8007-d279c67e9cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:53.478846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09daa84-8d5c-4b34-a9b0-54c72a9392e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:53.478964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3888c7d-c817-42f6-8007-d279c67e9cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:53.479288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09daa84-8d5c-4b34-a9b0-54c72a9392e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:53.482661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3888c7d-c817-42f6-8007-d279c67e9cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:53.484910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09daa84-8d5c-4b34-a9b0-54c72a9392e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:53.486054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3888c7d-c817-42f6-8007-d279c67e9cdf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:53.487512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09daa84-8d5c-4b34-a9b0-54c72a9392e2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:53.513296 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1059/2131] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:53.515467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3888c7d-c817-42f6-8007-d279c67e9cdf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:53.524316 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1073/2132] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:53 2022] POST /identity/v3/users => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:53.524316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09daa84-8d5c-4b34-a9b0-54c72a9392e2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:53.524794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e09daa84-8d5c-4b34-a9b0-54c72a9392e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:53.547448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09daa84-8d5c-4b34-a9b0-54c72a9392e2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:53.552582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3888c7d-c817-42f6-8007-d279c67e9cdf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:53.559075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d7e26-91ff-44a0-87af-2ed6ac4736bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:53.560041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d7e26-91ff-44a0-87af-2ed6ac4736bb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:53.560460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d7e26-91ff-44a0-87af-2ed6ac4736bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:53.560873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d7e26-91ff-44a0-87af-2ed6ac4736bb admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:53.561567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7b097-885d-4c79-9c22-178a9227ece2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:53.562065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d7e26-91ff-44a0-87af-2ed6ac4736bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:53.562330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7b097-885d-4c79-9c22-178a9227ece2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:53.562615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7b097-885d-4c79-9c22-178a9227ece2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:53.563072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7b097-885d-4c79-9c22-178a9227ece2 admin admin] PATH_INFO: `/v3/projects/1a93c104d0964b35ba609299da32fbc5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:53.564682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d7e26-91ff-44a0-87af-2ed6ac4736bb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:53.564822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7b097-885d-4c79-9c22-178a9227ece2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a93c104d0964b35ba609299da32fbc5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:53.575951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7b097-885d-4c79-9c22-178a9227ece2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:53.598941 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1060/2133] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:53 2022] POST /identity/v3/users => generated 285 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:53.598941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d7e26-91ff-44a0-87af-2ed6ac4736bb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:53.607884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:53.619599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d7e26-91ff-44a0-87af-2ed6ac4736bb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:53.629129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f87ddd-e20a-48c3-a7cc-789ee86881f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:53.630252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f87ddd-e20a-48c3-a7cc-789ee86881f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:53.630726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f87ddd-e20a-48c3-a7cc-789ee86881f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:53.631191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f87ddd-e20a-48c3-a7cc-789ee86881f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:53.632748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f87ddd-e20a-48c3-a7cc-789ee86881f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:53.637127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f87ddd-e20a-48c3-a7cc-789ee86881f9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:53.657089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2dc7b097-885d-4c79-9c22-178a9227ece2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a93c104d0964b35ba609299da32fbc5', 'request_id': 'req-2dc7b097-885d-4c79-9c22-178a9227ece2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:53.659383 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1061/2134] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:53.661225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f87ddd-e20a-48c3-a7cc-789ee86881f9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:53.669362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2dc7b097-885d-4c79-9c22-178a9227ece2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a93c104d0964b35ba609299da32fbc5', 'request_id': 'req-2dc7b097-885d-4c79-9c22-178a9227ece2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:53.676972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2dc7b097-885d-4c79-9c22-178a9227ece2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a93c104d0964b35ba609299da32fbc5', 'request_id': 'req-2dc7b097-885d-4c79-9c22-178a9227ece2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:53.680315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f87ddd-e20a-48c3-a7cc-789ee86881f9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:53.691376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2dc7b097-885d-4c79-9c22-178a9227ece2 admin admin] The token cache is being invalidate because project 1a93c104d0964b35ba609299da32fbc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:53.691591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2dc7b097-885d-4c79-9c22-178a9227ece2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:53.692334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2dc7b097-885d-4c79-9c22-178a9227ece2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:53.694997 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1074/2135] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:53 2022] DELETE /identity/v3/projects/1a93c104d0964b35ba609299da32fbc5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:53.696028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7b097-885d-4c79-9c22-178a9227ece2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:53.697758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2dc7b097-885d-4c79-9c22-178a9227ece2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:53.756786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f88c03-1d37-4fba-aed1-f8121cb10a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:53.757502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f88c03-1d37-4fba-aed1-f8121cb10a8c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:53.757684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f88c03-1d37-4fba-aed1-f8121cb10a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:53.757992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f88c03-1d37-4fba-aed1-f8121cb10a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:53.758887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f88c03-1d37-4fba-aed1-f8121cb10a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:53.760392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:53.760534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f88c03-1d37-4fba-aed1-f8121cb10a8c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:53.775932 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1062/2136] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:53.775932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f88c03-1d37-4fba-aed1-f8121cb10a8c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:53.777997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-59f88c03-1d37-4fba-aed1-f8121cb10a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:53.792848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7b097-885d-4c79-9c22-178a9227ece2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:53.799180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefee358-36b8-44c1-8974-bb519d3544b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:53.799911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefee358-36b8-44c1-8974-bb519d3544b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:53.800172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefee358-36b8-44c1-8974-bb519d3544b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:53.800637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefee358-36b8-44c1-8974-bb519d3544b6 admin admin] PATH_INFO: `/v3/users/a91caff6a7dc4f9fad3f15d7ade19a76` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:53.802735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefee358-36b8-44c1-8974-bb519d3544b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a91caff6a7dc4f9fad3f15d7ade19a76)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:53.814401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefee358-36b8-44c1-8974-bb519d3544b6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:53.818491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f88c03-1d37-4fba-aed1-f8121cb10a8c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:53.826945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0b164-763e-4a57-9e34-23d2806eb26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:53.828563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b164-763e-4a57-9e34-23d2806eb26f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:53.829253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b164-763e-4a57-9e34-23d2806eb26f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:53.830028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b164-763e-4a57-9e34-23d2806eb26f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:53.831645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0b164-763e-4a57-9e34-23d2806eb26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:53.833197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0b164-763e-4a57-9e34-23d2806eb26f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:53.861751 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1063/2137] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:53.862777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0b164-763e-4a57-9e34-23d2806eb26f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:53.864911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-72e0b164-763e-4a57-9e34-23d2806eb26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:53.912746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0b164-763e-4a57-9e34-23d2806eb26f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:53.920972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbfcf8-b556-46aa-8381-e9deeb09603d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:53.922191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbfcf8-b556-46aa-8381-e9deeb09603d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:53.922683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbfcf8-b556-46aa-8381-e9deeb09603d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:53.923137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbfcf8-b556-46aa-8381-e9deeb09603d admin admin] PATH_INFO: `/v3/projects/fc1abd01f4074cffbe8bb5b383ef8972/users/76a98d75a6aa47f3ae3dff33d42f0f67/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:53.969661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbfcf8-b556-46aa-8381-e9deeb09603d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1abd01f4074cffbe8bb5b383ef8972, user_id=76a98d75a6aa47f3ae3dff33d42f0f67, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:53.971797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fefee358-36b8-44c1-8974-bb519d3544b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a91caff6a7dc4f9fad3f15d7ade19a76'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:53.973955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fefee358-36b8-44c1-8974-bb519d3544b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a91caff6a7dc4f9fad3f15d7ade19a76'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:53.974497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbfcf8-b556-46aa-8381-e9deeb09603d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:53.995760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fefee358-36b8-44c1-8974-bb519d3544b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a91caff6a7dc4f9fad3f15d7ade19a76'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:53.996903 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1064/2138] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:53 2022] PUT /identity/v3/projects/fc1abd01f4074cffbe8bb5b383ef8972/users/76a98d75a6aa47f3ae3dff33d42f0f67/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:53.997710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbfcf8-b556-46aa-8381-e9deeb09603d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:54.000342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b4dbfcf8-b556-46aa-8381-e9deeb09603d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:54.016080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fefee358-36b8-44c1-8974-bb519d3544b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a91caff6a7dc4f9fad3f15d7ade19a76'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:54.050896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fefee358-36b8-44c1-8974-bb519d3544b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a91caff6a7dc4f9fad3f15d7ade19a76'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:54.062184 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1075/2139] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:53 2022] DELETE /identity/v3/users/a91caff6a7dc4f9fad3f15d7ade19a76 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:54.062812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefee358-36b8-44c1-8974-bb519d3544b6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:54.067050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fefee358-36b8-44c1-8974-bb519d3544b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:54.162480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbfcf8-b556-46aa-8381-e9deeb09603d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:54.170804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefee358-36b8-44c1-8974-bb519d3544b6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:54.175704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09980765-6a23-4b27-93b3-eb6324947437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:54.177166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09980765-6a23-4b27-93b3-eb6324947437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:54.177294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5580a17-3dbb-417c-bdc4-a30500682a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:54.177462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09980765-6a23-4b27-93b3-eb6324947437 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:54.177742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09980765-6a23-4b27-93b3-eb6324947437 admin admin] PATH_INFO: `/v3/users/d4747972868d406a90c6b958ffdad894` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:54.178158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5580a17-3dbb-417c-bdc4-a30500682a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:54.178795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5580a17-3dbb-417c-bdc4-a30500682a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:54.179186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5580a17-3dbb-417c-bdc4-a30500682a5a admin admin] PATH_INFO: `/v3/projects/7284221e9dae48e1815e1b9de611d93f/users/9770610df1604bd6b658b3f44c498dbf/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:54.182295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09980765-6a23-4b27-93b3-eb6324947437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4747972868d406a90c6b958ffdad894)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:54.186911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09980765-6a23-4b27-93b3-eb6324947437 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:54.208124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5580a17-3dbb-417c-bdc4-a30500682a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7284221e9dae48e1815e1b9de611d93f, user_id=9770610df1604bd6b658b3f44c498dbf, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:54.211180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5580a17-3dbb-417c-bdc4-a30500682a5a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:54.261073 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1076/2140] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:54 2022] PUT /identity/v3/projects/7284221e9dae48e1815e1b9de611d93f/users/9770610df1604bd6b658b3f44c498dbf/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:54.270223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5580a17-3dbb-417c-bdc4-a30500682a5a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:54.277075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e5580a17-3dbb-417c-bdc4-a30500682a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:54.352598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09980765-6a23-4b27-93b3-eb6324947437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4747972868d406a90c6b958ffdad894'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:54.364631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:54.387004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09980765-6a23-4b27-93b3-eb6324947437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4747972868d406a90c6b958ffdad894'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:54.388016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09980765-6a23-4b27-93b3-eb6324947437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4747972868d406a90c6b958ffdad894'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:54.388496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09980765-6a23-4b27-93b3-eb6324947437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4747972868d406a90c6b958ffdad894'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:54.404514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09980765-6a23-4b27-93b3-eb6324947437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4747972868d406a90c6b958ffdad894'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:54.437926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:54.445453 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1065/2141] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:53 2022] DELETE /identity/v3/users/d4747972868d406a90c6b958ffdad894 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:54.447132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608f6eb-cec5-485f-a5a6-802ea42e642a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:54.447515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608f6eb-cec5-485f-a5a6-802ea42e642a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:54.447778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608f6eb-cec5-485f-a5a6-802ea42e642a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:54.462827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5580a17-3dbb-417c-bdc4-a30500682a5a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:54.490003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3608f6eb-cec5-485f-a5a6-802ea42e642a None None] MFA Rules not processed for user `76a98d75a6aa47f3ae3dff33d42f0f67`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:54.491170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3608f6eb-cec5-485f-a5a6-802ea42e642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:54.572863 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1066/2142] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:54.574196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5a038-cd36-4979-9873-3acac3a57044 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:54.574484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5a038-cd36-4979-9873-3acac3a57044 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:54.574777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5a038-cd36-4979-9873-3acac3a57044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:54.603643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d6e5a038-cd36-4979-9873-3acac3a57044 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:54.603643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d6e5a038-cd36-4979-9873-3acac3a57044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:54.607770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b66625-29e9-4f24-a540-364b25b19f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:54.609569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b66625-29e9-4f24-a540-364b25b19f46 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:54.609856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b66625-29e9-4f24-a540-364b25b19f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:54.610600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b66625-29e9-4f24-a540-364b25b19f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:54.611335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b66625-29e9-4f24-a540-364b25b19f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:54.614294 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1067/2143] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:54.615409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5a038-cd36-4979-9873-3acac3a57044 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:54.618898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d6e5a038-cd36-4979-9873-3acac3a57044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:54.624236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b66625-29e9-4f24-a540-364b25b19f46 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:54.636180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5a038-cd36-4979-9873-3acac3a57044 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:54.641428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe104886-221a-45be-a455-c208be8307f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:54.642166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe104886-221a-45be-a455-c208be8307f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:54.642550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe104886-221a-45be-a455-c208be8307f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:54.642846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe104886-221a-45be-a455-c208be8307f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:54.643568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe104886-221a-45be-a455-c208be8307f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:54.645225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe104886-221a-45be-a455-c208be8307f9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:54.649553 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1077/2144] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:54.655535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b66625-29e9-4f24-a540-364b25b19f46 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:54.658845 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1068/2145] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:54.659934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe104886-221a-45be-a455-c208be8307f9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:54.661661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fe104886-221a-45be-a455-c208be8307f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:54.661880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-47b66625-29e9-4f24-a540-364b25b19f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:54.678755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe104886-221a-45be-a455-c208be8307f9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:54.686219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd86b5-8a13-4723-8246-f371161d7233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:54.687349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd86b5-8a13-4723-8246-f371161d7233 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:54.687349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd86b5-8a13-4723-8246-f371161d7233 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:54.687774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd86b5-8a13-4723-8246-f371161d7233 admin admin] PATH_INFO: `/v3/projects/e07f55af86e848ab9958b33fcddbf77f/users/890a53a49e0d4e4b9ca2920535e4c85c/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:54.702950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b66625-29e9-4f24-a540-364b25b19f46 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:54.712600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd86b5-8a13-4723-8246-f371161d7233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07f55af86e848ab9958b33fcddbf77f, user_id=890a53a49e0d4e4b9ca2920535e4c85c, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:54.712600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd86b5-8a13-4723-8246-f371161d7233 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:54.720748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84812e-0aa3-4d0b-89a0-bc1ac1c4538a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:54.721428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84812e-0aa3-4d0b-89a0-bc1ac1c4538a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:54.722326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84812e-0aa3-4d0b-89a0-bc1ac1c4538a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:54.722326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84812e-0aa3-4d0b-89a0-bc1ac1c4538a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:54.722621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84812e-0aa3-4d0b-89a0-bc1ac1c4538a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:54.724588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84812e-0aa3-4d0b-89a0-bc1ac1c4538a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:54.734152 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1069/2146] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:54 2022] PUT /identity/v3/projects/e07f55af86e848ab9958b33fcddbf77f/users/890a53a49e0d4e4b9ca2920535e4c85c/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:54.735197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd86b5-8a13-4723-8246-f371161d7233 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:54.783954 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1078/2147] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:54 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:54.783954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84812e-0aa3-4d0b-89a0-bc1ac1c4538a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:54.785067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f84812e-0aa3-4d0b-89a0-bc1ac1c4538a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:54.880633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84812e-0aa3-4d0b-89a0-bc1ac1c4538a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:54.886178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd86b5-8a13-4723-8246-f371161d7233 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:54.886444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f7a53-2928-4b62-8f73-72be954fea3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:54.887016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f7a53-2928-4b62-8f73-72be954fea3d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:54.887431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f7a53-2928-4b62-8f73-72be954fea3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:54.887839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f7a53-2928-4b62-8f73-72be954fea3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:54.937623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:54.973008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f7a53-2928-4b62-8f73-72be954fea3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:54.974489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f7a53-2928-4b62-8f73-72be954fea3d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:54.982112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab0674-5b18-479f-aa8c-d759ea905ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:54.983277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab0674-5b18-479f-aa8c-d759ea905ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:54.984247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab0674-5b18-479f-aa8c-d759ea905ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:54.984678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab0674-5b18-479f-aa8c-d759ea905ef2 admin admin] PATH_INFO: `/v3/projects/7284221e9dae48e1815e1b9de611d93f/users/9770610df1604bd6b658b3f44c498dbf/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:54.986194 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1079/2148] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:54.987245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab0674-5b18-479f-aa8c-d759ea905ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7284221e9dae48e1815e1b9de611d93f, user_id=9770610df1604bd6b658b3f44c498dbf, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:54.987800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e7ad0-0150-438b-a74e-811221fe888c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:54.988078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e7ad0-0150-438b-a74e-811221fe888c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:54.988366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e7ad0-0150-438b-a74e-811221fe888c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:54.990584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab0674-5b18-479f-aa8c-d759ea905ef2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:55.006891 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1070/2149] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:54 2022] PUT /identity/v3/projects/7284221e9dae48e1815e1b9de611d93f/users/9770610df1604bd6b658b3f44c498dbf/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:55.008128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab0674-5b18-479f-aa8c-d759ea905ef2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:55.028548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d95e7ad0-0150-438b-a74e-811221fe888c None None] MFA Rules not processed for user `890a53a49e0d4e4b9ca2920535e4c85c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:55.030008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d95e7ad0-0150-438b-a74e-811221fe888c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:55.045427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:55.097198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab0674-5b18-479f-aa8c-d759ea905ef2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:55.108913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e8823-d5da-49dc-ada4-36f0a3d50dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:55.109699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8823-d5da-49dc-ada4-36f0a3d50dbb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:55.109830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8823-d5da-49dc-ada4-36f0a3d50dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:55.110111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8823-d5da-49dc-ada4-36f0a3d50dbb admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:55.110767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e8823-d5da-49dc-ada4-36f0a3d50dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:55.113266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e8823-d5da-49dc-ada4-36f0a3d50dbb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:55.132825 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1080/2150] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:55.134521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6678096-20eb-4188-b5b8-4373b76f03ff None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:55.134793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6678096-20eb-4188-b5b8-4373b76f03ff None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:55.135100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6678096-20eb-4188-b5b8-4373b76f03ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:55.153188 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1071/2151] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:55 2022] POST /identity/v3/users => generated 303 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:55.153188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e8823-d5da-49dc-ada4-36f0a3d50dbb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:55.155176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-712e8823-d5da-49dc-ada4-36f0a3d50dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:55.166822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e6678096-20eb-4188-b5b8-4373b76f03ff None None] MFA Rules not processed for user `9770610df1604bd6b658b3f44c498dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:55.168092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e6678096-20eb-4188-b5b8-4373b76f03ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:55.262584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e8823-d5da-49dc-ada4-36f0a3d50dbb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:55.269911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fd2ff-b55b-4e28-bb32-c84a3f4c841d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:55.270977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fd2ff-b55b-4e28-bb32-c84a3f4c841d service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:55.271502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fd2ff-b55b-4e28-bb32-c84a3f4c841d service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:55.272021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fd2ff-b55b-4e28-bb32-c84a3f4c841d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:55.272683 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1081/2152] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:55.273455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6678096-20eb-4188-b5b8-4373b76f03ff None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:55.297297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fd2ff-b55b-4e28-bb32-c84a3f4c841d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:55.299686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6678096-20eb-4188-b5b8-4373b76f03ff None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:55.301100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fd2ff-b55b-4e28-bb32-c84a3f4c841d service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:55.305033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c4451-ce56-4895-b8a2-6f72fada1667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:55.305775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c4451-ce56-4895-b8a2-6f72fada1667 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:55.306180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c4451-ce56-4895-b8a2-6f72fada1667 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:55.306586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c4451-ce56-4895-b8a2-6f72fada1667 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:55.307357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c4451-ce56-4895-b8a2-6f72fada1667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:55.309325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c4451-ce56-4895-b8a2-6f72fada1667 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:55.322648 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1072/2153] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:55.323583 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1082/2154] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:55.324015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fd2ff-b55b-4e28-bb32-c84a3f4c841d service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:55.325928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d97fd2ff-b55b-4e28-bb32-c84a3f4c841d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:55.329884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c4451-ce56-4895-b8a2-6f72fada1667 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:55.350388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c4451-ce56-4895-b8a2-6f72fada1667 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:55.350644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fd2ff-b55b-4e28-bb32-c84a3f4c841d service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:55.356013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e954174-7a1b-4091-aa8b-d38f7068e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:55.356773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e954174-7a1b-4091-aa8b-d38f7068e28b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:55.357141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e954174-7a1b-4091-aa8b-d38f7068e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:55.357557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e954174-7a1b-4091-aa8b-d38f7068e28b admin admin] PATH_INFO: `/v3/projects/c284426be5f94b219663bd1b1238b081/users/fe5d01ced4d84f4bb1286643b219effc/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:55.358435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ae922-9014-4fc8-9165-654787a08291 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:55.359062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae922-9014-4fc8-9165-654787a08291 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:55.359609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae922-9014-4fc8-9165-654787a08291 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:55.359883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae922-9014-4fc8-9165-654787a08291 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:55.373053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ae922-9014-4fc8-9165-654787a08291 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:55.375035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ae922-9014-4fc8-9165-654787a08291 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:55.384793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e954174-7a1b-4091-aa8b-d38f7068e28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c284426be5f94b219663bd1b1238b081, user_id=fe5d01ced4d84f4bb1286643b219effc, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:55.388199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e954174-7a1b-4091-aa8b-d38f7068e28b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:55.396417 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1073/2155] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:55.397525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ae922-9014-4fc8-9165-654787a08291 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:55.399462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b65ae922-9014-4fc8-9165-654787a08291 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:55.420765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ae922-9014-4fc8-9165-654787a08291 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:55.438924 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1083/2156] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:55 2022] PUT /identity/v3/projects/c284426be5f94b219663bd1b1238b081/users/fe5d01ced4d84f4bb1286643b219effc/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:19:55.444485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e954174-7a1b-4091-aa8b-d38f7068e28b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:55.451627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:55.596845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e954174-7a1b-4091-aa8b-d38f7068e28b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:55.601250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d79a76-4738-4786-a7cc-e1e059041497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:55.603482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d79a76-4738-4786-a7cc-e1e059041497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:55.604284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d79a76-4738-4786-a7cc-e1e059041497 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:55.605040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d79a76-4738-4786-a7cc-e1e059041497 admin admin] PATH_INFO: `/v3/projects/0fc6ab80953b41bc9d99d882162f2276` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:55.606913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d79a76-4738-4786-a7cc-e1e059041497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc6ab80953b41bc9d99d882162f2276)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:55.607074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deab712-f3d2-41e9-8cc1-3a2d62b412c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:55.607661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deab712-f3d2-41e9-8cc1-3a2d62b412c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:55.607946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deab712-f3d2-41e9-8cc1-3a2d62b412c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:55.608224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deab712-f3d2-41e9-8cc1-3a2d62b412c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:55.608904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deab712-f3d2-41e9-8cc1-3a2d62b412c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:55.610879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deab712-f3d2-41e9-8cc1-3a2d62b412c4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:55.618750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d79a76-4738-4786-a7cc-e1e059041497 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:55.619296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:55.641954 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1084/2157] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:55.643533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deab712-f3d2-41e9-8cc1-3a2d62b412c4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:55.672533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deab712-f3d2-41e9-8cc1-3a2d62b412c4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:55.692541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42541c5f-7a9c-46e7-96ee-48333fff9c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:55.693361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42541c5f-7a9c-46e7-96ee-48333fff9c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:55.693881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42541c5f-7a9c-46e7-96ee-48333fff9c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:55.694262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42541c5f-7a9c-46e7-96ee-48333fff9c82 admin admin] PATH_INFO: `/v3/projects/c284426be5f94b219663bd1b1238b081/users/fe5d01ced4d84f4bb1286643b219effc/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:55.700055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42541c5f-7a9c-46e7-96ee-48333fff9c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c284426be5f94b219663bd1b1238b081, user_id=fe5d01ced4d84f4bb1286643b219effc, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:55.709258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42541c5f-7a9c-46e7-96ee-48333fff9c82 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:55.749071 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1085/2158] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:55 2022] PUT /identity/v3/projects/c284426be5f94b219663bd1b1238b081/users/fe5d01ced4d84f4bb1286643b219effc/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:19:55.751295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bba0cd-be4f-4f96-b055-d9eb71d6ed70 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:55.751916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bba0cd-be4f-4f96-b055-d9eb71d6ed70 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:55.752494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bba0cd-be4f-4f96-b055-d9eb71d6ed70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:55.796743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-76d79a76-4738-4786-a7cc-e1e059041497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc6ab80953b41bc9d99d882162f2276', 'request_id': 'req-76d79a76-4738-4786-a7cc-e1e059041497'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:55.797217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-84bba0cd-be4f-4f96-b055-d9eb71d6ed70 None None] MFA Rules not processed for user `fe5d01ced4d84f4bb1286643b219effc`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:55.799378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-84bba0cd-be4f-4f96-b055-d9eb71d6ed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:55.815910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-76d79a76-4738-4786-a7cc-e1e059041497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc6ab80953b41bc9d99d882162f2276', 'request_id': 'req-76d79a76-4738-4786-a7cc-e1e059041497'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:55.853921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-76d79a76-4738-4786-a7cc-e1e059041497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc6ab80953b41bc9d99d882162f2276', 'request_id': 'req-76d79a76-4738-4786-a7cc-e1e059041497'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:55.880575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-76d79a76-4738-4786-a7cc-e1e059041497 admin admin] The token cache is being invalidate because project 0fc6ab80953b41bc9d99d882162f2276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:55.880804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-76d79a76-4738-4786-a7cc-e1e059041497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:55.881433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-76d79a76-4738-4786-a7cc-e1e059041497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:55.886960 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1074/2159] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:55 2022] DELETE /identity/v3/projects/0fc6ab80953b41bc9d99d882162f2276 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:55.889272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda2929-6b03-4a3e-b357-de34f21bfee8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:55.889561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda2929-6b03-4a3e-b357-de34f21bfee8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:55.889836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda2929-6b03-4a3e-b357-de34f21bfee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:55.940744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7cda2929-6b03-4a3e-b357-de34f21bfee8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:55.945110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7cda2929-6b03-4a3e-b357-de34f21bfee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:56.005967 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1086/2160] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:55 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:56.019510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0889-c960-4b5e-961b-cd5fe794a911 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:56.019801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0889-c960-4b5e-961b-cd5fe794a911 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:56.020528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0889-c960-4b5e-961b-cd5fe794a911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:56.062449 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1075/2161] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:56.064386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba76a6-b3cc-4380-bae8-a53c7340e968 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:56.064879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba76a6-b3cc-4380-bae8-a53c7340e968 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:56.065367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba76a6-b3cc-4380-bae8-a53c7340e968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:56.084615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-987f0889-c960-4b5e-961b-cd5fe794a911 None None] MFA Rules not processed for user `76a98d75a6aa47f3ae3dff33d42f0f67`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:56.087024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-987f0889-c960-4b5e-961b-cd5fe794a911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:56.089995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6aba76a6-b3cc-4380-bae8-a53c7340e968 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:56.091701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6aba76a6-b3cc-4380-bae8-a53c7340e968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:56.104271 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1076/2162] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:56.109707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba76a6-b3cc-4380-bae8-a53c7340e968 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:56.123372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba76a6-b3cc-4380-bae8-a53c7340e968 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:56.129546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27423c1-1c03-422f-9d8d-8ee65b7350c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:56.130517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27423c1-1c03-422f-9d8d-8ee65b7350c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:56.130998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27423c1-1c03-422f-9d8d-8ee65b7350c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:56.131544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27423c1-1c03-422f-9d8d-8ee65b7350c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:56.133297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27423c1-1c03-422f-9d8d-8ee65b7350c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:56.133842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27423c1-1c03-422f-9d8d-8ee65b7350c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:56.135798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27423c1-1c03-422f-9d8d-8ee65b7350c6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:56.158371 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1077/2163] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:56.163123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27423c1-1c03-422f-9d8d-8ee65b7350c6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:56.194696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27423c1-1c03-422f-9d8d-8ee65b7350c6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:56.215605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dea439-35db-4473-8d95-8446c9284f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:56.216250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dea439-35db-4473-8d95-8446c9284f52 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:56.216529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dea439-35db-4473-8d95-8446c9284f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:56.216796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dea439-35db-4473-8d95-8446c9284f52 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:56.219970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dea439-35db-4473-8d95-8446c9284f52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:56.222601 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1087/2164] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:56.224346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f0889-c960-4b5e-961b-cd5fe794a911 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:56.224471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dea439-35db-4473-8d95-8446c9284f52 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:56.226105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-987f0889-c960-4b5e-961b-cd5fe794a911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:56.246268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f0889-c960-4b5e-961b-cd5fe794a911 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:56.259646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896c454-1fa5-446b-95c3-d07edad9a7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:56.260682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896c454-1fa5-446b-95c3-d07edad9a7e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:56.263051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896c454-1fa5-446b-95c3-d07edad9a7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:56.263474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896c454-1fa5-446b-95c3-d07edad9a7e6 admin admin] PATH_INFO: `/v3/projects/caa93463800e456d806414540abd8d39` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:56.266075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896c454-1fa5-446b-95c3-d07edad9a7e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caa93463800e456d806414540abd8d39)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:56.271969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896c454-1fa5-446b-95c3-d07edad9a7e6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:56.311278 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1078/2165] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:56 2022] POST /identity/v3/projects => generated 391 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:56.313839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dea439-35db-4473-8d95-8446c9284f52 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:56.352091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:56.375272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5896c454-1fa5-446b-95c3-d07edad9a7e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caa93463800e456d806414540abd8d39', 'request_id': 'req-5896c454-1fa5-446b-95c3-d07edad9a7e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:56.398900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5896c454-1fa5-446b-95c3-d07edad9a7e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caa93463800e456d806414540abd8d39', 'request_id': 'req-5896c454-1fa5-446b-95c3-d07edad9a7e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:56.417325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5896c454-1fa5-446b-95c3-d07edad9a7e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caa93463800e456d806414540abd8d39', 'request_id': 'req-5896c454-1fa5-446b-95c3-d07edad9a7e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:56.437116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:56.444351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5896c454-1fa5-446b-95c3-d07edad9a7e6 admin admin] The token cache is being invalidate because project caa93463800e456d806414540abd8d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:56.445052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5896c454-1fa5-446b-95c3-d07edad9a7e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:56.446198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5896c454-1fa5-446b-95c3-d07edad9a7e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:56.452977 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1088/2166] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:56 2022] DELETE /identity/v3/projects/caa93463800e456d806414540abd8d39 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:56.455096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896c454-1fa5-446b-95c3-d07edad9a7e6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:56.457043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5896c454-1fa5-446b-95c3-d07edad9a7e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:56.476110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dea439-35db-4473-8d95-8446c9284f52 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:56.590361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a2d01-56ca-410a-b26f-8bba79b7c819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:56.591196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a2d01-56ca-410a-b26f-8bba79b7c819 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:56.591515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a2d01-56ca-410a-b26f-8bba79b7c819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:56.591801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a2d01-56ca-410a-b26f-8bba79b7c819 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:56.592638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a2d01-56ca-410a-b26f-8bba79b7c819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:56.594746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a2d01-56ca-410a-b26f-8bba79b7c819 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:56.602849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896c454-1fa5-446b-95c3-d07edad9a7e6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:56.610170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823fc1-59ed-4821-8b3e-ba455336c721 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:56.610944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823fc1-59ed-4821-8b3e-ba455336c721 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:56.611374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823fc1-59ed-4821-8b3e-ba455336c721 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:56.611676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823fc1-59ed-4821-8b3e-ba455336c721 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:56.614851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-85823fc1-59ed-4821-8b3e-ba455336c721 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:56.633934 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1079/2167] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:56 2022] POST /identity/v3/users => generated 296 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:19:56.640152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a2d01-56ca-410a-b26f-8bba79b7c819 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:56.646136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-058a2d01-56ca-410a-b26f-8bba79b7c819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:56.689342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a2d01-56ca-410a-b26f-8bba79b7c819 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:56.695291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85823fc1-59ed-4821-8b3e-ba455336c721 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:56.697009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85823fc1-59ed-4821-8b3e-ba455336c721 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:56.708190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497600c-c95b-4e33-bdf5-faa738faa473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:56.708481 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1089/2168] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:56.709037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497600c-c95b-4e33-bdf5-faa738faa473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:56.709565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497600c-c95b-4e33-bdf5-faa738faa473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:56.710074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497600c-c95b-4e33-bdf5-faa738faa473 admin admin] PATH_INFO: `/v3/users/ef7f8210d3ef4141b3e043a782c692dd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:56.712135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497600c-c95b-4e33-bdf5-faa738faa473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef7f8210d3ef4141b3e043a782c692dd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:56.714213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497600c-c95b-4e33-bdf5-faa738faa473 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:56.723588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823fc1-59ed-4821-8b3e-ba455336c721 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:56.725465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-85823fc1-59ed-4821-8b3e-ba455336c721 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:56.753760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823fc1-59ed-4821-8b3e-ba455336c721 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:56.760370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e130063-eb9d-4d1c-a252-1a851a930f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:56.761016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e130063-eb9d-4d1c-a252-1a851a930f08 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:56.761296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e130063-eb9d-4d1c-a252-1a851a930f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:56.761575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e130063-eb9d-4d1c-a252-1a851a930f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:56.762248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e130063-eb9d-4d1c-a252-1a851a930f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:56.764862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e130063-eb9d-4d1c-a252-1a851a930f08 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:56.781049 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1090/2169] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:56.785100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e130063-eb9d-4d1c-a252-1a851a930f08 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:56.818785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e497600c-c95b-4e33-bdf5-faa738faa473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef7f8210d3ef4141b3e043a782c692dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:56.820204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e130063-eb9d-4d1c-a252-1a851a930f08 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:56.842291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e070f-ec1e-4c19-94e1-4a725a5ae8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:56.843284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e070f-ec1e-4c19-94e1-4a725a5ae8ad admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:56.843581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e070f-ec1e-4c19-94e1-4a725a5ae8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:56.843858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e070f-ec1e-4c19-94e1-4a725a5ae8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:56.844532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e070f-ec1e-4c19-94e1-4a725a5ae8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:56.854838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e070f-ec1e-4c19-94e1-4a725a5ae8ad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:56.867006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e497600c-c95b-4e33-bdf5-faa738faa473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef7f8210d3ef4141b3e043a782c692dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:56.868775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e497600c-c95b-4e33-bdf5-faa738faa473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef7f8210d3ef4141b3e043a782c692dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:56.872187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e497600c-c95b-4e33-bdf5-faa738faa473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef7f8210d3ef4141b3e043a782c692dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:56.887145 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1091/2170] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:56.890273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e497600c-c95b-4e33-bdf5-faa738faa473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef7f8210d3ef4141b3e043a782c692dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:56.892684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e070f-ec1e-4c19-94e1-4a725a5ae8ad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:56.901716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f4e070f-ec1e-4c19-94e1-4a725a5ae8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:56.920913 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1080/2171] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:56 2022] DELETE /identity/v3/users/ef7f8210d3ef4141b3e043a782c692dd => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:56.928101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e070f-ec1e-4c19-94e1-4a725a5ae8ad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:57.023790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb3610-2e07-4986-b151-2e6a0dc3f8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:57.025471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb3610-2e07-4986-b151-2e6a0dc3f8f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:57.025803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb3610-2e07-4986-b151-2e6a0dc3f8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:57.026191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb3610-2e07-4986-b151-2e6a0dc3f8f3 admin admin] PATH_INFO: `/v3/projects/39ee9d3b390640af9456aad61407fe0a/users/3d8e444ed17b483085943d78ceb85acd/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:57.053586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb3610-2e07-4986-b151-2e6a0dc3f8f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ee9d3b390640af9456aad61407fe0a, user_id=3d8e444ed17b483085943d78ceb85acd, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:57.061373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb3610-2e07-4986-b151-2e6a0dc3f8f3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:57.082215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:57.100043 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1092/2172] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:56 2022] PUT /identity/v3/projects/39ee9d3b390640af9456aad61407fe0a/users/3d8e444ed17b483085943d78ceb85acd/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:57.104232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebffc8-8d91-4ded-9b87-b6a823728287 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:57.104592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebffc8-8d91-4ded-9b87-b6a823728287 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:57.104850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebffc8-8d91-4ded-9b87-b6a823728287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:57.153629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb3610-2e07-4986-b151-2e6a0dc3f8f3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:57.155763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2ebb3610-2e07-4986-b151-2e6a0dc3f8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:57.178428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-53ebffc8-8d91-4ded-9b87-b6a823728287 None None] MFA Rules not processed for user `3d8e444ed17b483085943d78ceb85acd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:57.180023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-53ebffc8-8d91-4ded-9b87-b6a823728287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:57.203972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:57.281895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb3610-2e07-4986-b151-2e6a0dc3f8f3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:57.289874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7b9de-2a2f-4f20-a0ef-55f1195c2c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:57.290542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7b9de-2a2f-4f20-a0ef-55f1195c2c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:57.290814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7b9de-2a2f-4f20-a0ef-55f1195c2c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:57.291125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7b9de-2a2f-4f20-a0ef-55f1195c2c4b admin admin] PATH_INFO: `/v3/users/33148543cf534e0a86258ffca7fb336b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:57.292436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7b9de-2a2f-4f20-a0ef-55f1195c2c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=33148543cf534e0a86258ffca7fb336b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:57.294702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7b9de-2a2f-4f20-a0ef-55f1195c2c4b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:57.313480 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1081/2173] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:19:57.315156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebffc8-8d91-4ded-9b87-b6a823728287 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:57.328367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebffc8-8d91-4ded-9b87-b6a823728287 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:57.337629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219f0f2-560d-423b-813d-6d69d551d73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:57.352385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219f0f2-560d-423b-813d-6d69d551d73e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:57.352625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219f0f2-560d-423b-813d-6d69d551d73e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:57.352959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219f0f2-560d-423b-813d-6d69d551d73e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:57.355298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219f0f2-560d-423b-813d-6d69d551d73e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:57.358530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219f0f2-560d-423b-813d-6d69d551d73e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:57.387331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12b7b9de-2a2f-4f20-a0ef-55f1195c2c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33148543cf534e0a86258ffca7fb336b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:57.388572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12b7b9de-2a2f-4f20-a0ef-55f1195c2c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33148543cf534e0a86258ffca7fb336b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:57.403247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12b7b9de-2a2f-4f20-a0ef-55f1195c2c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33148543cf534e0a86258ffca7fb336b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:57.411351 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1082/2174] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:57 2022] POST /identity/v3/projects => generated 393 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:57.413358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219f0f2-560d-423b-813d-6d69d551d73e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:57.415299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12b7b9de-2a2f-4f20-a0ef-55f1195c2c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33148543cf534e0a86258ffca7fb336b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:57.415916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6219f0f2-560d-423b-813d-6d69d551d73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:57.439754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12b7b9de-2a2f-4f20-a0ef-55f1195c2c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33148543cf534e0a86258ffca7fb336b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:57.451625 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1093/2175] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:57 2022] DELETE /identity/v3/users/33148543cf534e0a86258ffca7fb336b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:57.453356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58e997-c9bb-4459-a290-42f5c0b3ad8e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:57.453645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58e997-c9bb-4459-a290-42f5c0b3ad8e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:57.453923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58e997-c9bb-4459-a290-42f5c0b3ad8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:57.482261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fd58e997-c9bb-4459-a290-42f5c0b3ad8e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:57.487138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd58e997-c9bb-4459-a290-42f5c0b3ad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:57.515655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219f0f2-560d-423b-813d-6d69d551d73e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:57.644606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96290e-e694-4874-a489-c86aab0b7bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:57.646012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96290e-e694-4874-a489-c86aab0b7bcf admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:57.646539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96290e-e694-4874-a489-c86aab0b7bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:57.647028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96290e-e694-4874-a489-c86aab0b7bcf admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:57.648212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96290e-e694-4874-a489-c86aab0b7bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:57.652991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96290e-e694-4874-a489-c86aab0b7bcf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:57.656485 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1094/2176] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:57.694575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58e997-c9bb-4459-a290-42f5c0b3ad8e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:57.696708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd58e997-c9bb-4459-a290-42f5c0b3ad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:57.715937 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1083/2177] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:57 2022] POST /identity/v3/users => generated 303 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:57.720045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96290e-e694-4874-a489-c86aab0b7bcf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:57.735217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96290e-e694-4874-a489-c86aab0b7bcf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:57.740766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84a1ec-1c35-4d06-b066-446c2c28c923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:57.741508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a1ec-1c35-4d06-b066-446c2c28c923 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:57.742077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a1ec-1c35-4d06-b066-446c2c28c923 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:57.742471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a1ec-1c35-4d06-b066-446c2c28c923 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:57.743247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84a1ec-1c35-4d06-b066-446c2c28c923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:57.745973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84a1ec-1c35-4d06-b066-446c2c28c923 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:57.748110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:57.771314 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1084/2178] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:57.772702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84a1ec-1c35-4d06-b066-446c2c28c923 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:57.785455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84a1ec-1c35-4d06-b066-446c2c28c923 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:57.800042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7619c-120c-40af-b6c4-b12b5e82513b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:57.802949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7619c-120c-40af-b6c4-b12b5e82513b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:57.804131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7619c-120c-40af-b6c4-b12b5e82513b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:57.804630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7619c-120c-40af-b6c4-b12b5e82513b admin admin] PATH_INFO: `/v3/projects/3df55c1c6e6a4d72b287c309b4c00c0d/users/2831b3ac2eca49d49fac1b102b5bc337/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:57.838357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58e997-c9bb-4459-a290-42f5c0b3ad8e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:57.840050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:57.850050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4961feb-c413-4065-9b47-2f9f33a47455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:57.850555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4961feb-c413-4065-9b47-2f9f33a47455 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:57.850837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4961feb-c413-4065-9b47-2f9f33a47455 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:57.851146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4961feb-c413-4065-9b47-2f9f33a47455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:57.857484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7619c-120c-40af-b6c4-b12b5e82513b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df55c1c6e6a4d72b287c309b4c00c0d, user_id=2831b3ac2eca49d49fac1b102b5bc337, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:57.867829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7619c-120c-40af-b6c4-b12b5e82513b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:57.889760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4961feb-c413-4065-9b47-2f9f33a47455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:57.891591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4961feb-c413-4065-9b47-2f9f33a47455 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:57.903271 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1085/2179] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:57 2022] PUT /identity/v3/projects/3df55c1c6e6a4d72b287c309b4c00c0d/users/2831b3ac2eca49d49fac1b102b5bc337/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:57.908231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7619c-120c-40af-b6c4-b12b5e82513b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:57.917286 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1095/2180] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:57.918763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4961feb-c413-4065-9b47-2f9f33a47455 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:57.920887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e2a7619c-120c-40af-b6c4-b12b5e82513b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:57.939298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4961feb-c413-4065-9b47-2f9f33a47455 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:58.074068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7619c-120c-40af-b6c4-b12b5e82513b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:58.082613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d76907-f319-40be-9f79-6e9cd7366696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:58.083286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d76907-f319-40be-9f79-6e9cd7366696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:58.083768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d76907-f319-40be-9f79-6e9cd7366696 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:58.084278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d76907-f319-40be-9f79-6e9cd7366696 admin admin] PATH_INFO: `/v3/projects/8e6522c1365e420b9a22221976aacb6f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:58.085508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d76907-f319-40be-9f79-6e9cd7366696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6522c1365e420b9a22221976aacb6f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:58.088050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d76907-f319-40be-9f79-6e9cd7366696 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:58.091931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77c26c-5e1f-4415-bc1d-802d342c5d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:58.093479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77c26c-5e1f-4415-bc1d-802d342c5d13 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:58.094021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77c26c-5e1f-4415-bc1d-802d342c5d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:58.094878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77c26c-5e1f-4415-bc1d-802d342c5d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:58.097690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77c26c-5e1f-4415-bc1d-802d342c5d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:58.100628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77c26c-5e1f-4415-bc1d-802d342c5d13 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:58.121386 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1096/2181] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:19:58.128412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77c26c-5e1f-4415-bc1d-802d342c5d13 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:58.162170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77c26c-5e1f-4415-bc1d-802d342c5d13 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:58.168019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea35b2-b05d-4750-a075-1f9ab904d78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:58.168754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea35b2-b05d-4750-a075-1f9ab904d78f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:58.169037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea35b2-b05d-4750-a075-1f9ab904d78f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:58.169325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea35b2-b05d-4750-a075-1f9ab904d78f admin admin] PATH_INFO: `/v3/projects/3df55c1c6e6a4d72b287c309b4c00c0d/users/2831b3ac2eca49d49fac1b102b5bc337/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:58.172045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea35b2-b05d-4750-a075-1f9ab904d78f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df55c1c6e6a4d72b287c309b4c00c0d, user_id=2831b3ac2eca49d49fac1b102b5bc337, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:58.191309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea35b2-b05d-4750-a075-1f9ab904d78f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:58.211537 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1097/2182] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:19:58 2022] PUT /identity/v3/projects/3df55c1c6e6a4d72b287c309b4c00c0d/users/2831b3ac2eca49d49fac1b102b5bc337/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:58.220581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89d76907-f319-40be-9f79-6e9cd7366696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6522c1365e420b9a22221976aacb6f', 'request_id': 'req-89d76907-f319-40be-9f79-6e9cd7366696'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:58.223368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676fd55-3089-43e3-b761-e85a9bad3315 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:58.223700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676fd55-3089-43e3-b761-e85a9bad3315 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:58.224020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676fd55-3089-43e3-b761-e85a9bad3315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:58.244430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89d76907-f319-40be-9f79-6e9cd7366696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6522c1365e420b9a22221976aacb6f', 'request_id': 'req-89d76907-f319-40be-9f79-6e9cd7366696'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:58.256105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89d76907-f319-40be-9f79-6e9cd7366696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6522c1365e420b9a22221976aacb6f', 'request_id': 'req-89d76907-f319-40be-9f79-6e9cd7366696'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:58.276641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89d76907-f319-40be-9f79-6e9cd7366696 admin admin] The token cache is being invalidate because project 8e6522c1365e420b9a22221976aacb6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:58.276938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89d76907-f319-40be-9f79-6e9cd7366696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:58.277626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89d76907-f319-40be-9f79-6e9cd7366696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:58.279537 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1086/2183] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:57 2022] DELETE /identity/v3/projects/8e6522c1365e420b9a22221976aacb6f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:19:58.280486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d76907-f319-40be-9f79-6e9cd7366696 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:58.281842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-89d76907-f319-40be-9f79-6e9cd7366696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:58.292256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a676fd55-3089-43e3-b761-e85a9bad3315 None None] MFA Rules not processed for user `2831b3ac2eca49d49fac1b102b5bc337`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:58.293677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a676fd55-3089-43e3-b761-e85a9bad3315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:58.475063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d76907-f319-40be-9f79-6e9cd7366696 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:58.480215 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1098/2184] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:58.482293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a2825-74d4-488f-a407-2330d640cbfc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:58.482492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a2825-74d4-488f-a407-2330d640cbfc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:58.482783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a2825-74d4-488f-a407-2330d640cbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:58.524463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:58.546116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d01a2825-74d4-488f-a407-2330d640cbfc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:58.559311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d01a2825-74d4-488f-a407-2330d640cbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:58.635732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:58.676530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9203281-d6cf-4cd0-ba92-298b87e729e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:58.677626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9203281-d6cf-4cd0-ba92-298b87e729e6 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:58.678036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9203281-d6cf-4cd0-ba92-298b87e729e6 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:58.678192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9203281-d6cf-4cd0-ba92-298b87e729e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:58.683142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e9203281-d6cf-4cd0-ba92-298b87e729e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:58.707054 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1099/2185] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:58.708731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a2825-74d4-488f-a407-2330d640cbfc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:58.711073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d01a2825-74d4-488f-a407-2330d640cbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:58.733160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a2825-74d4-488f-a407-2330d640cbfc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:58.741191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917115c-ba4d-43fb-ac6b-d656b775ac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:58.742364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917115c-ba4d-43fb-ac6b-d656b775ac9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:58.742950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917115c-ba4d-43fb-ac6b-d656b775ac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:58.743526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917115c-ba4d-43fb-ac6b-d656b775ac9a admin admin] PATH_INFO: `/v3/projects/ff6523454d43458a9a398bf89a738cb2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:58.745474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917115c-ba4d-43fb-ac6b-d656b775ac9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff6523454d43458a9a398bf89a738cb2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:58.749025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917115c-ba4d-43fb-ac6b-d656b775ac9a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:58.811599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9203281-d6cf-4cd0-ba92-298b87e729e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:58.815076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9203281-d6cf-4cd0-ba92-298b87e729e6 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:58.840978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6917115c-ba4d-43fb-ac6b-d656b775ac9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6523454d43458a9a398bf89a738cb2', 'request_id': 'req-6917115c-ba4d-43fb-ac6b-d656b775ac9a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:58.847460 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1087/2186] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:58.849613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9203281-d6cf-4cd0-ba92-298b87e729e6 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:58.852762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e9203281-d6cf-4cd0-ba92-298b87e729e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:58.857102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6917115c-ba4d-43fb-ac6b-d656b775ac9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6523454d43458a9a398bf89a738cb2', 'request_id': 'req-6917115c-ba4d-43fb-ac6b-d656b775ac9a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:58.875774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6917115c-ba4d-43fb-ac6b-d656b775ac9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6523454d43458a9a398bf89a738cb2', 'request_id': 'req-6917115c-ba4d-43fb-ac6b-d656b775ac9a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:58.899922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6917115c-ba4d-43fb-ac6b-d656b775ac9a admin admin] The token cache is being invalidate because project ff6523454d43458a9a398bf89a738cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:19:58.900403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6917115c-ba4d-43fb-ac6b-d656b775ac9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:58.900568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9203281-d6cf-4cd0-ba92-298b87e729e6 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:58.901823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6917115c-ba4d-43fb-ac6b-d656b775ac9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:58.907340 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1100/2187] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:19:58 2022] DELETE /identity/v3/projects/ff6523454d43458a9a398bf89a738cb2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:58.907340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216aaec-2dbd-4516-904d-0d923336c7d3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:58.907340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216aaec-2dbd-4516-904d-0d923336c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:58.907340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216aaec-2dbd-4516-904d-0d923336c7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:58.941771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d216aaec-2dbd-4516-904d-0d923336c7d3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:58.943764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d216aaec-2dbd-4516-904d-0d923336c7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:59.045636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d677085-3ef5-4947-a6ac-3caaa1e55f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:59.046357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d677085-3ef5-4947-a6ac-3caaa1e55f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:59.046641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d677085-3ef5-4947-a6ac-3caaa1e55f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:59.046916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d677085-3ef5-4947-a6ac-3caaa1e55f37 admin admin] PATH_INFO: `/v3/users/3d8e444ed17b483085943d78ceb85acd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:59.047395 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1101/2188] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:59.048414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d677085-3ef5-4947-a6ac-3caaa1e55f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d8e444ed17b483085943d78ceb85acd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:59.048705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216aaec-2dbd-4516-904d-0d923336c7d3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:59.050129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d216aaec-2dbd-4516-904d-0d923336c7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:59.051031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d677085-3ef5-4947-a6ac-3caaa1e55f37 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:59.063608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216aaec-2dbd-4516-904d-0d923336c7d3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:59.068959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57197706-8f95-49a7-be60-a5dd3157a26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:59.069449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57197706-8f95-49a7-be60-a5dd3157a26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:59.069733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57197706-8f95-49a7-be60-a5dd3157a26c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:59.070013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57197706-8f95-49a7-be60-a5dd3157a26c admin admin] PATH_INFO: `/v3/users/890a53a49e0d4e4b9ca2920535e4c85c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:59.073872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57197706-8f95-49a7-be60-a5dd3157a26c admin admin] RBAC: Authorizing `identity:delete_user(user_id=890a53a49e0d4e4b9ca2920535e4c85c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:59.075942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57197706-8f95-49a7-be60-a5dd3157a26c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:59.126220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d677085-3ef5-4947-a6ac-3caaa1e55f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d8e444ed17b483085943d78ceb85acd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:59.133431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:59.144996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d677085-3ef5-4947-a6ac-3caaa1e55f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d8e444ed17b483085943d78ceb85acd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:59.145485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-57197706-8f95-49a7-be60-a5dd3157a26c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890a53a49e0d4e4b9ca2920535e4c85c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:59.145756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d677085-3ef5-4947-a6ac-3caaa1e55f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d8e444ed17b483085943d78ceb85acd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:59.146406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-57197706-8f95-49a7-be60-a5dd3157a26c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890a53a49e0d4e4b9ca2920535e4c85c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:59.146520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d677085-3ef5-4947-a6ac-3caaa1e55f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d8e444ed17b483085943d78ceb85acd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:59.147873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:59.156611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-57197706-8f95-49a7-be60-a5dd3157a26c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890a53a49e0d4e4b9ca2920535e4c85c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:59.167194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d677085-3ef5-4947-a6ac-3caaa1e55f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d8e444ed17b483085943d78ceb85acd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:59.169292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-57197706-8f95-49a7-be60-a5dd3157a26c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890a53a49e0d4e4b9ca2920535e4c85c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:59.187668 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1088/2189] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:58 2022] DELETE /identity/v3/users/3d8e444ed17b483085943d78ceb85acd => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:59.187668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d677085-3ef5-4947-a6ac-3caaa1e55f37 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:59.188002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0d677085-3ef5-4947-a6ac-3caaa1e55f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:59.189585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-57197706-8f95-49a7-be60-a5dd3157a26c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890a53a49e0d4e4b9ca2920535e4c85c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:59.197816 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1102/2190] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:59 2022] DELETE /identity/v3/users/890a53a49e0d4e4b9ca2920535e4c85c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:59.199008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57197706-8f95-49a7-be60-a5dd3157a26c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:59.200835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-57197706-8f95-49a7-be60-a5dd3157a26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:59.314482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d677085-3ef5-4947-a6ac-3caaa1e55f37 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:59.320807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c59ffc-7086-43c9-b97d-924b0802f739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:59.321481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c59ffc-7086-43c9-b97d-924b0802f739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:59.321590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57197706-8f95-49a7-be60-a5dd3157a26c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:59.321787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c59ffc-7086-43c9-b97d-924b0802f739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:59.322040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c59ffc-7086-43c9-b97d-924b0802f739 admin admin] PATH_INFO: `/v3/users/9770610df1604bd6b658b3f44c498dbf` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:59.323495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c59ffc-7086-43c9-b97d-924b0802f739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9770610df1604bd6b658b3f44c498dbf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:59.325641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c59ffc-7086-43c9-b97d-924b0802f739 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:59.340237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4393793-49c8-4f56-b867-efaeb6c5fb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:59.340882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4393793-49c8-4f56-b867-efaeb6c5fb43 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:59.341324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4393793-49c8-4f56-b867-efaeb6c5fb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:59.341614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4393793-49c8-4f56-b867-efaeb6c5fb43 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:59.345508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4393793-49c8-4f56-b867-efaeb6c5fb43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:19:59.345508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4393793-49c8-4f56-b867-efaeb6c5fb43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:59.345508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4393793-49c8-4f56-b867-efaeb6c5fb43 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:59.378511 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1103/2191] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:19:59.378511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50cec1-ebd8-437e-bcc0-7d5c46199240 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:59.378511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50cec1-ebd8-437e-bcc0-7d5c46199240 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:59.378511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50cec1-ebd8-437e-bcc0-7d5c46199240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:59.401026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aa50cec1-ebd8-437e-bcc0-7d5c46199240 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:59.402519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa50cec1-ebd8-437e-bcc0-7d5c46199240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:59.415400 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1104/2192] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:59.418317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53c59ffc-7086-43c9-b97d-924b0802f739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9770610df1604bd6b658b3f44c498dbf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:59.419649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e48ce9-93ad-483e-a850-a7722a229913 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:59.421055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e48ce9-93ad-483e-a850-a7722a229913 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:59.424634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e48ce9-93ad-483e-a850-a7722a229913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:59.437778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53c59ffc-7086-43c9-b97d-924b0802f739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9770610df1604bd6b658b3f44c498dbf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:59.438680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53c59ffc-7086-43c9-b97d-924b0802f739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9770610df1604bd6b658b3f44c498dbf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:59.440322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53c59ffc-7086-43c9-b97d-924b0802f739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9770610df1604bd6b658b3f44c498dbf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:59.449956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e4e48ce9-93ad-483e-a850-a7722a229913 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:19:59.452254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e4e48ce9-93ad-483e-a850-a7722a229913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:59.452693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53c59ffc-7086-43c9-b97d-924b0802f739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9770610df1604bd6b658b3f44c498dbf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:19:59.467403 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1105/2193] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:19:59.469609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e48ce9-93ad-483e-a850-a7722a229913 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:59.473980 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1089/2194] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:19:59 2022] DELETE /identity/v3/users/9770610df1604bd6b658b3f44c498dbf => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:19:59.473980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c59ffc-7086-43c9-b97d-924b0802f739 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:59.474844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-53c59ffc-7086-43c9-b97d-924b0802f739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:59.476016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e4e48ce9-93ad-483e-a850-a7722a229913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:59.496117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e48ce9-93ad-483e-a850-a7722a229913 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:59.602979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:59.611041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c59ffc-7086-43c9-b97d-924b0802f739 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:59.618884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1fb62-6a09-4fe5-8092-d22acc0cd3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:59.619852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf4804-0238-4442-9cbb-eb4fd65ddfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:59.620269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1fb62-6a09-4fe5-8092-d22acc0cd3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:59.620489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf4804-0238-4442-9cbb-eb4fd65ddfff admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:59.620619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1fb62-6a09-4fe5-8092-d22acc0cd3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:59.620985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1fb62-6a09-4fe5-8092-d22acc0cd3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:59.622591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf4804-0238-4442-9cbb-eb4fd65ddfff admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:59.623504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf4804-0238-4442-9cbb-eb4fd65ddfff admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:59.625288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf4804-0238-4442-9cbb-eb4fd65ddfff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:59.625421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2fb1fb62-6a09-4fe5-8092-d22acc0cd3f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:59.628964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf4804-0238-4442-9cbb-eb4fd65ddfff admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:59.650310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1fb62-6a09-4fe5-8092-d22acc0cd3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:59.653473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1fb62-6a09-4fe5-8092-d22acc0cd3f8 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:59.677937 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1090/2195] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:19:59.680140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1fb62-6a09-4fe5-8092-d22acc0cd3f8 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:59.682205 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1106/2196] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:19:59 2022] POST /identity/v3/projects => generated 403 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:59.682726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2fb1fb62-6a09-4fe5-8092-d22acc0cd3f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:19:59.686869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf4804-0238-4442-9cbb-eb4fd65ddfff admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:59.699061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1fb62-6a09-4fe5-8092-d22acc0cd3f8 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:59.791890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:19:59.833884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90c400-126b-431b-91a5-a2f63e084e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:59.834872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90c400-126b-431b-91a5-a2f63e084e14 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:59.835951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90c400-126b-431b-91a5-a2f63e084e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:59.836400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90c400-126b-431b-91a5-a2f63e084e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:59.886274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf4804-0238-4442-9cbb-eb4fd65ddfff admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:59.899995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65d274-5167-4aba-8f44-0bc537b593a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:59.900660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65d274-5167-4aba-8f44-0bc537b593a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:59.900976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65d274-5167-4aba-8f44-0bc537b593a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:59.901318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65d274-5167-4aba-8f44-0bc537b593a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:59.902003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65d274-5167-4aba-8f44-0bc537b593a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:59.903978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65d274-5167-4aba-8f44-0bc537b593a4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:59.936265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90c400-126b-431b-91a5-a2f63e084e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:59.938513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90c400-126b-431b-91a5-a2f63e084e14 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:59.949436 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1107/2197] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:19:59 2022] POST /identity/v3/users => generated 302 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:19:59.951687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65d274-5167-4aba-8f44-0bc537b593a4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:19:59.952149 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1091/2198] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:19:59.970211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65d274-5167-4aba-8f44-0bc537b593a4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:19:59.983860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e15519-d858-4414-b525-1f41e7cef066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:19:59.983860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e15519-d858-4414-b525-1f41e7cef066 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:19:59.983860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e15519-d858-4414-b525-1f41e7cef066 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:19:59.983860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e15519-d858-4414-b525-1f41e7cef066 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:19:59.984322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e15519-d858-4414-b525-1f41e7cef066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:19:59.984322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e15519-d858-4414-b525-1f41e7cef066 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:19:59.998718 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1108/2199] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:00.001332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90c400-126b-431b-91a5-a2f63e084e14 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:00.017067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90c400-126b-431b-91a5-a2f63e084e14 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:00.032139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c73a4-8d7b-4562-a25b-bff63f6c23d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:00.034050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c73a4-8d7b-4562-a25b-bff63f6c23d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:00.034656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c73a4-8d7b-4562-a25b-bff63f6c23d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:00.035286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c73a4-8d7b-4562-a25b-bff63f6c23d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:00.037856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c73a4-8d7b-4562-a25b-bff63f6c23d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:00.039699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c73a4-8d7b-4562-a25b-bff63f6c23d7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:00.058142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e15519-d858-4414-b525-1f41e7cef066 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:00.058907 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1092/2200] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:20:00.069568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e15519-d858-4414-b525-1f41e7cef066 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:00.076085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26cbcb-1443-4edb-8b22-cacff18fcd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:00.076874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26cbcb-1443-4edb-8b22-cacff18fcd7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:00.077258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26cbcb-1443-4edb-8b22-cacff18fcd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:00.077598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26cbcb-1443-4edb-8b22-cacff18fcd7a admin admin] PATH_INFO: `/v3/projects/ff6fafa42b16479bbe5209dd0a953b2c/users/2af1c9ed95b84cff82c1abb4416aff3f/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:00.100295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26cbcb-1443-4edb-8b22-cacff18fcd7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6fafa42b16479bbe5209dd0a953b2c, user_id=2af1c9ed95b84cff82c1abb4416aff3f, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:00.104463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26cbcb-1443-4edb-8b22-cacff18fcd7a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:00.133633 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1109/2201] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:00 2022] PUT /identity/v3/projects/ff6fafa42b16479bbe5209dd0a953b2c/users/2af1c9ed95b84cff82c1abb4416aff3f/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:00.141703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a2ce6-98f0-4154-ba40-4803c720f50d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:00.141909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a2ce6-98f0-4154-ba40-4803c720f50d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:00.142201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a2ce6-98f0-4154-ba40-4803c720f50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:00.167734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-870a2ce6-98f0-4154-ba40-4803c720f50d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:00.168991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-870a2ce6-98f0-4154-ba40-4803c720f50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:00.239927 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1093/2202] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:00.280497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26cbcb-1443-4edb-8b22-cacff18fcd7a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:00.364285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26cbcb-1443-4edb-8b22-cacff18fcd7a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:00.373140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8187415-8ac7-4b0c-9c25-df48b3215bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:00.374311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8187415-8ac7-4b0c-9c25-df48b3215bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:00.374934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8187415-8ac7-4b0c-9c25-df48b3215bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:00.375648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8187415-8ac7-4b0c-9c25-df48b3215bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:00.394684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8187415-8ac7-4b0c-9c25-df48b3215bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:00.397447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8187415-8ac7-4b0c-9c25-df48b3215bc2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:00.422793 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1110/2203] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:00.549702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a2ce6-98f0-4154-ba40-4803c720f50d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:00.551383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-870a2ce6-98f0-4154-ba40-4803c720f50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:00.572332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a2ce6-98f0-4154-ba40-4803c720f50d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:00.579990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8187415-8ac7-4b0c-9c25-df48b3215bc2 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:00.581642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a8187415-8ac7-4b0c-9c25-df48b3215bc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:00.583304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7a1bf-5be4-405c-a031-85d4c5f95323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:00.584291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7a1bf-5be4-405c-a031-85d4c5f95323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:00.584685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7a1bf-5be4-405c-a031-85d4c5f95323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:00.585197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7a1bf-5be4-405c-a031-85d4c5f95323 admin admin] PATH_INFO: `/v3/projects/39ee9d3b390640af9456aad61407fe0a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:00.586821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7a1bf-5be4-405c-a031-85d4c5f95323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ee9d3b390640af9456aad61407fe0a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:00.589204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7a1bf-5be4-405c-a031-85d4c5f95323 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:00.611225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8187415-8ac7-4b0c-9c25-df48b3215bc2 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:00.619954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429d4d8-074a-4539-b173-cb711c8d574f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:00.620944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429d4d8-074a-4539-b173-cb711c8d574f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:00.622090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429d4d8-074a-4539-b173-cb711c8d574f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:00.623440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429d4d8-074a-4539-b173-cb711c8d574f admin admin] PATH_INFO: `/v3/projects/7284221e9dae48e1815e1b9de611d93f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:00.626645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429d4d8-074a-4539-b173-cb711c8d574f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7284221e9dae48e1815e1b9de611d93f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:00.631491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429d4d8-074a-4539-b173-cb711c8d574f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:00.637976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:00.669154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-63c7a1bf-5be4-405c-a031-85d4c5f95323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ee9d3b390640af9456aad61407fe0a', 'request_id': 'req-63c7a1bf-5be4-405c-a031-85d4c5f95323'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:00.679430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-63c7a1bf-5be4-405c-a031-85d4c5f95323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ee9d3b390640af9456aad61407fe0a', 'request_id': 'req-63c7a1bf-5be4-405c-a031-85d4c5f95323'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:00.688764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-63c7a1bf-5be4-405c-a031-85d4c5f95323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ee9d3b390640af9456aad61407fe0a', 'request_id': 'req-63c7a1bf-5be4-405c-a031-85d4c5f95323'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:00.713978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-63c7a1bf-5be4-405c-a031-85d4c5f95323 admin admin] The token cache is being invalidate because project 39ee9d3b390640af9456aad61407fe0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:00.714283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-63c7a1bf-5be4-405c-a031-85d4c5f95323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:00.714960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-63c7a1bf-5be4-405c-a031-85d4c5f95323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:00.717248 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1094/2204] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:00 2022] DELETE /identity/v3/projects/39ee9d3b390640af9456aad61407fe0a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:00.717672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5429d4d8-074a-4539-b173-cb711c8d574f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7284221e9dae48e1815e1b9de611d93f', 'request_id': 'req-5429d4d8-074a-4539-b173-cb711c8d574f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:00.723401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7a1bf-5be4-405c-a031-85d4c5f95323 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:00.725437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-63c7a1bf-5be4-405c-a031-85d4c5f95323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:00.734037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5429d4d8-074a-4539-b173-cb711c8d574f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7284221e9dae48e1815e1b9de611d93f', 'request_id': 'req-5429d4d8-074a-4539-b173-cb711c8d574f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:00.743850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5429d4d8-074a-4539-b173-cb711c8d574f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7284221e9dae48e1815e1b9de611d93f', 'request_id': 'req-5429d4d8-074a-4539-b173-cb711c8d574f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:00.762141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5429d4d8-074a-4539-b173-cb711c8d574f admin admin] The token cache is being invalidate because project 7284221e9dae48e1815e1b9de611d93f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:00.762453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5429d4d8-074a-4539-b173-cb711c8d574f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:00.763136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5429d4d8-074a-4539-b173-cb711c8d574f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:00.765950 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1111/2205] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:00 2022] DELETE /identity/v3/projects/7284221e9dae48e1815e1b9de611d93f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:20:00.773957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568d571-1376-4d35-a8d3-60d5aca2ad27 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:00.774329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568d571-1376-4d35-a8d3-60d5aca2ad27 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:00.774684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568d571-1376-4d35-a8d3-60d5aca2ad27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:00.838024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b568d571-1376-4d35-a8d3-60d5aca2ad27 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:00.841793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b568d571-1376-4d35-a8d3-60d5aca2ad27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:00.850916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:00.859212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7a1bf-5be4-405c-a031-85d4c5f95323 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:00.934206 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1112/2206] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:00.942624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b4d00-5a54-49d5-b792-302810ee7b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:00.943310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b4d00-5a54-49d5-b792-302810ee7b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:00.943597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b4d00-5a54-49d5-b792-302810ee7b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:00.943879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b4d00-5a54-49d5-b792-302810ee7b11 admin admin] PATH_INFO: `/v3/users/2831b3ac2eca49d49fac1b102b5bc337` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:00.944004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05687a21-1834-4b0c-9abc-71488eb37457 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:00.944426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05687a21-1834-4b0c-9abc-71488eb37457 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:00.944712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05687a21-1834-4b0c-9abc-71488eb37457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:00.945215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b4d00-5a54-49d5-b792-302810ee7b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2831b3ac2eca49d49fac1b102b5bc337)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:00.947284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b4d00-5a54-49d5-b792-302810ee7b11 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:00.984164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-05687a21-1834-4b0c-9abc-71488eb37457 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:00.986499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-05687a21-1834-4b0c-9abc-71488eb37457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:00.996793 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1113/2207] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:01.001190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05687a21-1834-4b0c-9abc-71488eb37457 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:01.011852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05687a21-1834-4b0c-9abc-71488eb37457 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:01.017820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f42513-24c2-43c8-8709-300d675400d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:01.018480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f42513-24c2-43c8-8709-300d675400d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:01.018751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f42513-24c2-43c8-8709-300d675400d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:01.019028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f42513-24c2-43c8-8709-300d675400d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:01.019750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f42513-24c2-43c8-8709-300d675400d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:20:01.020063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f42513-24c2-43c8-8709-300d675400d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:01.021715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f42513-24c2-43c8-8709-300d675400d8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:01.036038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-059b4d00-5a54-49d5-b792-302810ee7b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2831b3ac2eca49d49fac1b102b5bc337'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:01.039563 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1114/2208] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:20:01.044067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f42513-24c2-43c8-8709-300d675400d8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:01.052646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:01.055606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-059b4d00-5a54-49d5-b792-302810ee7b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2831b3ac2eca49d49fac1b102b5bc337'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:01.057730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f42513-24c2-43c8-8709-300d675400d8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:01.057935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-059b4d00-5a54-49d5-b792-302810ee7b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2831b3ac2eca49d49fac1b102b5bc337'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:01.058743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-059b4d00-5a54-49d5-b792-302810ee7b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2831b3ac2eca49d49fac1b102b5bc337'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:01.071744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-059b4d00-5a54-49d5-b792-302810ee7b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2831b3ac2eca49d49fac1b102b5bc337'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:01.078916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96646382-f7f7-41c2-ac66-8cbe8c17a671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:01.081293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96646382-f7f7-41c2-ac66-8cbe8c17a671 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:01.082369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96646382-f7f7-41c2-ac66-8cbe8c17a671 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:01.083822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96646382-f7f7-41c2-ac66-8cbe8c17a671 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:01.086149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96646382-f7f7-41c2-ac66-8cbe8c17a671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:01.095797 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1095/2209] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:00 2022] DELETE /identity/v3/users/2831b3ac2eca49d49fac1b102b5bc337 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:01.105080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96646382-f7f7-41c2-ac66-8cbe8c17a671 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:01.172858 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1115/2210] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:01 2022] POST /identity/v3/projects => generated 399 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:20:01.177281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b4d00-5a54-49d5-b792-302810ee7b11 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:01.179945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-059b4d00-5a54-49d5-b792-302810ee7b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:01.308103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b4d00-5a54-49d5-b792-302810ee7b11 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:01.348122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96646382-f7f7-41c2-ac66-8cbe8c17a671 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:01.350222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-96646382-f7f7-41c2-ac66-8cbe8c17a671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:01.406089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111574a3-ce96-4d1a-a191-4e51bcf15d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:01.407535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111574a3-ce96-4d1a-a191-4e51bcf15d31 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:01.407888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111574a3-ce96-4d1a-a191-4e51bcf15d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:01.408693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111574a3-ce96-4d1a-a191-4e51bcf15d31 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:01.410533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111574a3-ce96-4d1a-a191-4e51bcf15d31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:01.415091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111574a3-ce96-4d1a-a191-4e51bcf15d31 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:01.436255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96646382-f7f7-41c2-ac66-8cbe8c17a671 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:01.447211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d668d50-a2b9-43e2-9117-091c2cda9a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:01.448632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d668d50-a2b9-43e2-9117-091c2cda9a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:01.448962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d668d50-a2b9-43e2-9117-091c2cda9a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:01.450081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d668d50-a2b9-43e2-9117-091c2cda9a1b admin admin] PATH_INFO: `/v3/projects/e07f55af86e848ab9958b33fcddbf77f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:01.462791 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1096/2211] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:01 2022] POST /identity/v3/users => generated 300 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:01.462976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d668d50-a2b9-43e2-9117-091c2cda9a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e07f55af86e848ab9958b33fcddbf77f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:01.462976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d668d50-a2b9-43e2-9117-091c2cda9a1b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:01.464967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111574a3-ce96-4d1a-a191-4e51bcf15d31 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:01.480163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111574a3-ce96-4d1a-a191-4e51bcf15d31 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:01.487899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b36ab-17f1-4b68-b582-f9b1457bad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:01.488646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b36ab-17f1-4b68-b582-f9b1457bad02 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:01.489046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b36ab-17f1-4b68-b582-f9b1457bad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:01.489974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b36ab-17f1-4b68-b582-f9b1457bad02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:01.491279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b36ab-17f1-4b68-b582-f9b1457bad02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:01.494012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b36ab-17f1-4b68-b582-f9b1457bad02 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:01.513109 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1097/2212] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:01.514270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b36ab-17f1-4b68-b582-f9b1457bad02 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:01.519678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9a8b36ab-17f1-4b68-b582-f9b1457bad02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:01.549386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d668d50-a2b9-43e2-9117-091c2cda9a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e07f55af86e848ab9958b33fcddbf77f', 'request_id': 'req-5d668d50-a2b9-43e2-9117-091c2cda9a1b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:01.550165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b36ab-17f1-4b68-b582-f9b1457bad02 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:01.568110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d668d50-a2b9-43e2-9117-091c2cda9a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e07f55af86e848ab9958b33fcddbf77f', 'request_id': 'req-5d668d50-a2b9-43e2-9117-091c2cda9a1b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:01.585562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d668d50-a2b9-43e2-9117-091c2cda9a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e07f55af86e848ab9958b33fcddbf77f', 'request_id': 'req-5d668d50-a2b9-43e2-9117-091c2cda9a1b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:01.595980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:01.607841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d668d50-a2b9-43e2-9117-091c2cda9a1b admin admin] The token cache is being invalidate because project e07f55af86e848ab9958b33fcddbf77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:01.610013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d668d50-a2b9-43e2-9117-091c2cda9a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:01.610995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d668d50-a2b9-43e2-9117-091c2cda9a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:01.619670 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1116/2213] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:01 2022] DELETE /identity/v3/projects/e07f55af86e848ab9958b33fcddbf77f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:01.620935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d668d50-a2b9-43e2-9117-091c2cda9a1b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:01.622669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d668d50-a2b9-43e2-9117-091c2cda9a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:01.673523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cab3d6-0ac7-48ea-9af3-cee563d371e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:01.673523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cab3d6-0ac7-48ea-9af3-cee563d371e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:01.674470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cab3d6-0ac7-48ea-9af3-cee563d371e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:01.674785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cab3d6-0ac7-48ea-9af3-cee563d371e3 admin admin] PATH_INFO: `/v3/projects/3df55c1c6e6a4d72b287c309b4c00c0d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:01.677901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cab3d6-0ac7-48ea-9af3-cee563d371e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df55c1c6e6a4d72b287c309b4c00c0d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:01.682023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cab3d6-0ac7-48ea-9af3-cee563d371e3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:01.700017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:01.730111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d668d50-a2b9-43e2-9117-091c2cda9a1b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:01.739900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848135c-d330-463a-9380-e951f1b0d309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:01.740865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848135c-d330-463a-9380-e951f1b0d309 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:01.741308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848135c-d330-463a-9380-e951f1b0d309 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:01.741749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848135c-d330-463a-9380-e951f1b0d309 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:01.745095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848135c-d330-463a-9380-e951f1b0d309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:01.748531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848135c-d330-463a-9380-e951f1b0d309 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:01.765293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-14cab3d6-0ac7-48ea-9af3-cee563d371e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df55c1c6e6a4d72b287c309b4c00c0d', 'request_id': 'req-14cab3d6-0ac7-48ea-9af3-cee563d371e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:01.770383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-14cab3d6-0ac7-48ea-9af3-cee563d371e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df55c1c6e6a4d72b287c309b4c00c0d', 'request_id': 'req-14cab3d6-0ac7-48ea-9af3-cee563d371e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:01.783972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-14cab3d6-0ac7-48ea-9af3-cee563d371e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df55c1c6e6a4d72b287c309b4c00c0d', 'request_id': 'req-14cab3d6-0ac7-48ea-9af3-cee563d371e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:01.789129 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1117/2214] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:01.799454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3f2e2-1fe4-455c-9251-1756e175039d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:01.799903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3f2e2-1fe4-455c-9251-1756e175039d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:01.800182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3f2e2-1fe4-455c-9251-1756e175039d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:01.810897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-14cab3d6-0ac7-48ea-9af3-cee563d371e3 admin admin] The token cache is being invalidate because project 3df55c1c6e6a4d72b287c309b4c00c0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:01.812125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-14cab3d6-0ac7-48ea-9af3-cee563d371e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:01.812383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-14cab3d6-0ac7-48ea-9af3-cee563d371e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:01.818775 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1098/2215] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:01 2022] DELETE /identity/v3/projects/3df55c1c6e6a4d72b287c309b4c00c0d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:01.818775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cab3d6-0ac7-48ea-9af3-cee563d371e3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:01.818775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-14cab3d6-0ac7-48ea-9af3-cee563d371e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:01.838632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-15e3f2e2-1fe4-455c-9251-1756e175039d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:01.840710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-15e3f2e2-1fe4-455c-9251-1756e175039d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:01.918884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cab3d6-0ac7-48ea-9af3-cee563d371e3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:01.940357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6dd2a-372b-4edf-887e-dfadcab6ddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:01.942488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6dd2a-372b-4edf-887e-dfadcab6ddae admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:01.942896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6dd2a-372b-4edf-887e-dfadcab6ddae admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:01.943699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6dd2a-372b-4edf-887e-dfadcab6ddae admin admin] PATH_INFO: `/v3/projects/dcb663b87cd84f37a240bdd0353f07a7/users/ff1d165efa9f4c028ae9b2def6acd0f8/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:01.974411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6dd2a-372b-4edf-887e-dfadcab6ddae admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb663b87cd84f37a240bdd0353f07a7, user_id=ff1d165efa9f4c028ae9b2def6acd0f8, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:01.979148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6dd2a-372b-4edf-887e-dfadcab6ddae admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:01.982663 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1118/2216] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:01.987273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8501bca-db78-405e-986c-e094640130cf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:01.987826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8501bca-db78-405e-986c-e094640130cf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:01.988315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8501bca-db78-405e-986c-e094640130cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:02.007989 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1099/2217] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:01 2022] PUT /identity/v3/projects/dcb663b87cd84f37a240bdd0353f07a7/users/ff1d165efa9f4c028ae9b2def6acd0f8/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:02.010511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9f634-59a7-4e60-b4ba-9f4a706b8256 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:02.010912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9f634-59a7-4e60-b4ba-9f4a706b8256 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:02.011379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9f634-59a7-4e60-b4ba-9f4a706b8256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:02.033089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e8501bca-db78-405e-986c-e094640130cf None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:02.036232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e8501bca-db78-405e-986c-e094640130cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:02.038657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ebb9f634-59a7-4e60-b4ba-9f4a706b8256 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:02.040547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ebb9f634-59a7-4e60-b4ba-9f4a706b8256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:02.148370 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1100/2218] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:02.150703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a8f4c-5a59-46c6-bafa-043ae5785f39 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:02.151169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a8f4c-5a59-46c6-bafa-043ae5785f39 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:02.151644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a8f4c-5a59-46c6-bafa-043ae5785f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:02.174293 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1119/2219] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:02.176075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8501bca-db78-405e-986c-e094640130cf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:02.192386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-036a8f4c-5a59-46c6-bafa-043ae5785f39 None None] MFA Rules not processed for user `ff1d165efa9f4c028ae9b2def6acd0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:02.194081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-036a8f4c-5a59-46c6-bafa-043ae5785f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:02.199988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8501bca-db78-405e-986c-e094640130cf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:02.205892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:02.209304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead1633-bf0b-490b-90de-3c76d2d614b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:02.210525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead1633-bf0b-490b-90de-3c76d2d614b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:02.211125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead1633-bf0b-490b-90de-3c76d2d614b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:02.211833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead1633-bf0b-490b-90de-3c76d2d614b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:02.213078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead1633-bf0b-490b-90de-3c76d2d614b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:20:02.213780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead1633-bf0b-490b-90de-3c76d2d614b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:02.219301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead1633-bf0b-490b-90de-3c76d2d614b7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:02.238658 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1120/2220] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:20:02.243245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88194349-d11c-45cb-b35c-59223fc746f3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:02.243593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88194349-d11c-45cb-b35c-59223fc746f3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:02.244379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88194349-d11c-45cb-b35c-59223fc746f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:02.280170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-88194349-d11c-45cb-b35c-59223fc746f3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:02.282996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-88194349-d11c-45cb-b35c-59223fc746f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:02.292173 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1101/2221] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:02 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:02.292173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a8f4c-5a59-46c6-bafa-043ae5785f39 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:02.301513 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1121/2222] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:02.302606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88194349-d11c-45cb-b35c-59223fc746f3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:02.316811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88194349-d11c-45cb-b35c-59223fc746f3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:02.318659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a8f4c-5a59-46c6-bafa-043ae5785f39 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:02.324556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee5c0b-d5b4-4463-94fa-801f255df9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:02.325634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee5c0b-d5b4-4463-94fa-801f255df9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:02.326229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee5c0b-d5b4-4463-94fa-801f255df9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:02.326868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee5c0b-d5b4-4463-94fa-801f255df9e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:02.327971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee5c0b-d5b4-4463-94fa-801f255df9e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:02.330847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee5c0b-d5b4-4463-94fa-801f255df9e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:02.336805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68a86e-63fd-4cfe-aefd-dec605be5a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:02.339296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68a86e-63fd-4cfe-aefd-dec605be5a88 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:02.339942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68a86e-63fd-4cfe-aefd-dec605be5a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:02.340592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68a86e-63fd-4cfe-aefd-dec605be5a88 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:02.343179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68a86e-63fd-4cfe-aefd-dec605be5a88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:02.347385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68a86e-63fd-4cfe-aefd-dec605be5a88 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:02.353484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:02.383842 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1122/2223] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:02 2022] POST /identity/v3/projects => generated 397 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:02.387665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee5c0b-d5b4-4463-94fa-801f255df9e7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:02.413226 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1102/2224] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:02 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:02.415197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68a86e-63fd-4cfe-aefd-dec605be5a88 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:02.506785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68a86e-63fd-4cfe-aefd-dec605be5a88 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:02.514137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42065820-a2af-474c-9e01-9f7746a12f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:02.514885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065820-a2af-474c-9e01-9f7746a12f67 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:02.515229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065820-a2af-474c-9e01-9f7746a12f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:02.515567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065820-a2af-474c-9e01-9f7746a12f67 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:02.519885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42065820-a2af-474c-9e01-9f7746a12f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:02.536390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42065820-a2af-474c-9e01-9f7746a12f67 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:02.583405 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1103/2225] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:02 2022] POST /identity/v3/users => generated 305 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:02.585672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42065820-a2af-474c-9e01-9f7746a12f67 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:02.600655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee5c0b-d5b4-4463-94fa-801f255df9e7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:02.605853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42065820-a2af-474c-9e01-9f7746a12f67 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:02.611202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ba510-64fa-4bb3-974d-858e5b6ef8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:02.611916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ba510-64fa-4bb3-974d-858e5b6ef8dd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:02.612210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ba510-64fa-4bb3-974d-858e5b6ef8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:02.612466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ba510-64fa-4bb3-974d-858e5b6ef8dd admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:02.613133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ba510-64fa-4bb3-974d-858e5b6ef8dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:20:02.613437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ba510-64fa-4bb3-974d-858e5b6ef8dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:02.615129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ba510-64fa-4bb3-974d-858e5b6ef8dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:02.620678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061322a-11c2-4019-bb97-11bdcd8d54c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:02.623625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061322a-11c2-4019-bb97-11bdcd8d54c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:02.625391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061322a-11c2-4019-bb97-11bdcd8d54c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:02.626800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061322a-11c2-4019-bb97-11bdcd8d54c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:02.630086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061322a-11c2-4019-bb97-11bdcd8d54c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:02.635990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061322a-11c2-4019-bb97-11bdcd8d54c8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:02.653927 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1123/2226] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:20:02.655161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ba510-64fa-4bb3-974d-858e5b6ef8dd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:02.679401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ba510-64fa-4bb3-974d-858e5b6ef8dd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:02.682997 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1104/2227] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:02 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:02.682997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061322a-11c2-4019-bb97-11bdcd8d54c8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:02.692486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9240a6-92b7-4bca-8b33-74c90bb6c83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:02.693121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9240a6-92b7-4bca-8b33-74c90bb6c83f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:02.693398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9240a6-92b7-4bca-8b33-74c90bb6c83f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:02.693714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9240a6-92b7-4bca-8b33-74c90bb6c83f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:02.694727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9240a6-92b7-4bca-8b33-74c90bb6c83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:02.698374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9240a6-92b7-4bca-8b33-74c90bb6c83f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:02.707662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061322a-11c2-4019-bb97-11bdcd8d54c8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:02.717839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07aba5f-d88d-40f3-93a6-ada573d8080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:02.718952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aba5f-d88d-40f3-93a6-ada573d8080e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:02.719297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aba5f-d88d-40f3-93a6-ada573d8080e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:02.719706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aba5f-d88d-40f3-93a6-ada573d8080e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:02.721749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07aba5f-d88d-40f3-93a6-ada573d8080e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:02.727125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07aba5f-d88d-40f3-93a6-ada573d8080e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:02.729375 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1124/2228] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:02.731210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9240a6-92b7-4bca-8b33-74c90bb6c83f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:02.753613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9240a6-92b7-4bca-8b33-74c90bb6c83f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:02.767776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840270b-443a-4b28-8795-d71866d48164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:02.768536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840270b-443a-4b28-8795-d71866d48164 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:02.768652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840270b-443a-4b28-8795-d71866d48164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:02.768845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840270b-443a-4b28-8795-d71866d48164 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:02.769839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840270b-443a-4b28-8795-d71866d48164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:02.772061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840270b-443a-4b28-8795-d71866d48164 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:02.789896 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1125/2229] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:02.789896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840270b-443a-4b28-8795-d71866d48164 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:02.790179 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1105/2230] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:02 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:02.791395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07aba5f-d88d-40f3-93a6-ada573d8080e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:02.802631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840270b-443a-4b28-8795-d71866d48164 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:02.878447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:02.880633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe303b-75c5-40dd-b2b4-c73633b0f242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:02.881593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe303b-75c5-40dd-b2b4-c73633b0f242 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:02.881905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe303b-75c5-40dd-b2b4-c73633b0f242 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:02.882197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe303b-75c5-40dd-b2b4-c73633b0f242 admin admin] PATH_INFO: `/v3/projects/77d3d670b98b414385a6159a8d5582d3/users/f12719c4a40646a1b5d3d3134b3a569b/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:02.900980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe303b-75c5-40dd-b2b4-c73633b0f242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d3d670b98b414385a6159a8d5582d3, user_id=f12719c4a40646a1b5d3d3134b3a569b, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:02.903753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe303b-75c5-40dd-b2b4-c73633b0f242 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:02.921445 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1126/2231] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:02 2022] PUT /identity/v3/projects/77d3d670b98b414385a6159a8d5582d3/users/f12719c4a40646a1b5d3d3134b3a569b/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:02.922676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe303b-75c5-40dd-b2b4-c73633b0f242 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:02.924800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07aba5f-d88d-40f3-93a6-ada573d8080e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:03.047813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:03.076869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2500e-1af6-456f-8ae0-a784c9a7ed79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:03.077702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2500e-1af6-456f-8ae0-a784c9a7ed79 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:03.078185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe303b-75c5-40dd-b2b4-c73633b0f242 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:03.078592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2500e-1af6-456f-8ae0-a784c9a7ed79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:03.079719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2500e-1af6-456f-8ae0-a784c9a7ed79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:03.080517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2500e-1af6-456f-8ae0-a784c9a7ed79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:03.084865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2500e-1af6-456f-8ae0-a784c9a7ed79 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:03.089715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d935295-dbfc-4db0-9cdb-2f1f10e8c728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:03.092666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d935295-dbfc-4db0-9cdb-2f1f10e8c728 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:03.094537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d935295-dbfc-4db0-9cdb-2f1f10e8c728 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:03.096426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d935295-dbfc-4db0-9cdb-2f1f10e8c728 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:03.098415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d935295-dbfc-4db0-9cdb-2f1f10e8c728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:03.102139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d935295-dbfc-4db0-9cdb-2f1f10e8c728 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:03.115464 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1106/2232] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:03.116630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2500e-1af6-456f-8ae0-a784c9a7ed79 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:03.136807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2500e-1af6-456f-8ae0-a784c9a7ed79 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:03.157769 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1127/2233] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:02 2022] POST /identity/v3/users => generated 284 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:03.158394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d935295-dbfc-4db0-9cdb-2f1f10e8c728 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:03.161332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3da24-218c-4aec-8f1a-3e019e3361d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:03.165194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3da24-218c-4aec-8f1a-3e019e3361d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:03.165945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3da24-218c-4aec-8f1a-3e019e3361d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:03.166771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3da24-218c-4aec-8f1a-3e019e3361d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:03.169256 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3da24-218c-4aec-8f1a-3e019e3361d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:03.172129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3da24-218c-4aec-8f1a-3e019e3361d4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:03.184889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d935295-dbfc-4db0-9cdb-2f1f10e8c728 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:03.199620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93507493-196a-42d5-8daa-ac195c0a9278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:03.201282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93507493-196a-42d5-8daa-ac195c0a9278 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:03.202218 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1107/2234] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:03.203389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3da24-218c-4aec-8f1a-3e019e3361d4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:03.203758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93507493-196a-42d5-8daa-ac195c0a9278 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:03.204301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93507493-196a-42d5-8daa-ac195c0a9278 admin admin] PATH_INFO: `/v3/projects/f8e8850adaeb4365be8aa84e2cb5da46/users/22b999f5eb4b467e9dbf44d4d682b828/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:03.230739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3da24-218c-4aec-8f1a-3e019e3361d4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:03.241863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93507493-196a-42d5-8daa-ac195c0a9278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e8850adaeb4365be8aa84e2cb5da46, user_id=22b999f5eb4b467e9dbf44d4d682b828, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:03.245341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93507493-196a-42d5-8daa-ac195c0a9278 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:03.248050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880cf497-05c8-4685-94d4-3f5efc9df389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:03.251045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cf497-05c8-4685-94d4-3f5efc9df389 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:03.251850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cf497-05c8-4685-94d4-3f5efc9df389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:03.252475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cf497-05c8-4685-94d4-3f5efc9df389 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:03.254186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880cf497-05c8-4685-94d4-3f5efc9df389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:03.257510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880cf497-05c8-4685-94d4-3f5efc9df389 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:03.273651 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1128/2235] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:03 2022] PUT /identity/v3/projects/f8e8850adaeb4365be8aa84e2cb5da46/users/22b999f5eb4b467e9dbf44d4d682b828/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:03.273651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93507493-196a-42d5-8daa-ac195c0a9278 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:03.291109 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1108/2236] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:03.291109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fc944-593c-4396-9690-00f6708944f2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:03.291109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fc944-593c-4396-9690-00f6708944f2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:03.291109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fc944-593c-4396-9690-00f6708944f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:03.318805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5a1fc944-593c-4396-9690-00f6708944f2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:03.320809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5a1fc944-593c-4396-9690-00f6708944f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:03.399321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93507493-196a-42d5-8daa-ac195c0a9278 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:03.405391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86b14e-d7a2-4435-9e67-3fccf52555b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:03.406805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86b14e-d7a2-4435-9e67-3fccf52555b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:03.407350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86b14e-d7a2-4435-9e67-3fccf52555b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:03.407849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86b14e-d7a2-4435-9e67-3fccf52555b9 admin admin] PATH_INFO: `/v3/projects/77d3d670b98b414385a6159a8d5582d3/users/f12719c4a40646a1b5d3d3134b3a569b/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:03.410229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86b14e-d7a2-4435-9e67-3fccf52555b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d3d670b98b414385a6159a8d5582d3, user_id=f12719c4a40646a1b5d3d3134b3a569b, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:03.413760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86b14e-d7a2-4435-9e67-3fccf52555b9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:03.415405 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1109/2237] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:03.416786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fc944-593c-4396-9690-00f6708944f2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:03.428234 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1129/2238] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:03 2022] PUT /identity/v3/projects/77d3d670b98b414385a6159a8d5582d3/users/f12719c4a40646a1b5d3d3134b3a569b/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:03.428951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fc944-593c-4396-9690-00f6708944f2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:03.440310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b31a1-e337-40c2-816c-51ef66aabcfb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:03.441004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b31a1-e337-40c2-816c-51ef66aabcfb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:03.441492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b31a1-e337-40c2-816c-51ef66aabcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:03.511528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3c9b31a1-e337-40c2-816c-51ef66aabcfb None None] MFA Rules not processed for user `f12719c4a40646a1b5d3d3134b3a569b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:03.513876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3c9b31a1-e337-40c2-816c-51ef66aabcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:03.522362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338dd74-eb4a-4ba7-8153-cd995ba5c8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:03.523074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338dd74-eb4a-4ba7-8153-cd995ba5c8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:03.523725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338dd74-eb4a-4ba7-8153-cd995ba5c8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:03.524356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338dd74-eb4a-4ba7-8153-cd995ba5c8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:03.525114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338dd74-eb4a-4ba7-8153-cd995ba5c8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:03.526898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338dd74-eb4a-4ba7-8153-cd995ba5c8e4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:03.547812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:03.564865 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1110/2239] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:03.569548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338dd74-eb4a-4ba7-8153-cd995ba5c8e4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:03.591432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338dd74-eb4a-4ba7-8153-cd995ba5c8e4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:03.598698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b21a90-c964-4c4e-9fd9-db828cb4646e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:03.599631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b21a90-c964-4c4e-9fd9-db828cb4646e admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:03.599988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b21a90-c964-4c4e-9fd9-db828cb4646e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:03.600331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b21a90-c964-4c4e-9fd9-db828cb4646e admin admin] PATH_INFO: `/v3/projects/64e03464dba44122a858181271362ea0/users/a3f83d2a0be442cb83593a030e92c752/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:03.627215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b21a90-c964-4c4e-9fd9-db828cb4646e admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e03464dba44122a858181271362ea0, user_id=a3f83d2a0be442cb83593a030e92c752, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:03.633519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b21a90-c964-4c4e-9fd9-db828cb4646e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:03.662513 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1111/2240] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:03 2022] PUT /identity/v3/projects/64e03464dba44122a858181271362ea0/users/a3f83d2a0be442cb83593a030e92c752/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:03.668642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7e06c-4898-4c52-b2b7-1739ef43036e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:03.669123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7e06c-4898-4c52-b2b7-1739ef43036e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:03.670321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7e06c-4898-4c52-b2b7-1739ef43036e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:03.719895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f7a7e06c-4898-4c52-b2b7-1739ef43036e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:03.721398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f7a7e06c-4898-4c52-b2b7-1739ef43036e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:03.763827 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1130/2241] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:20:03.766799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b31a1-e337-40c2-816c-51ef66aabcfb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:03.773458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3c9b31a1-e337-40c2-816c-51ef66aabcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:03.852175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:03.860516 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1112/2242] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:03.885073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7e06c-4898-4c52-b2b7-1739ef43036e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:03.887669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f7a7e06c-4898-4c52-b2b7-1739ef43036e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:03.890490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b31a1-e337-40c2-816c-51ef66aabcfb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:03.986075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fca5b4-cdd8-4b81-bb43-feb2307f7d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:03.986864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fca5b4-cdd8-4b81-bb43-feb2307f7d53 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:03.987233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fca5b4-cdd8-4b81-bb43-feb2307f7d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:03.987763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fca5b4-cdd8-4b81-bb43-feb2307f7d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:04.004700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fca5b4-cdd8-4b81-bb43-feb2307f7d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:04.006698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fca5b4-cdd8-4b81-bb43-feb2307f7d53 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:04.027764 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1131/2243] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:04.064008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7e06c-4898-4c52-b2b7-1739ef43036e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:04.069145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063dc37-b223-44c2-a8cb-324c9e5a8169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:04.069887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063dc37-b223-44c2-a8cb-324c9e5a8169 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:04.070247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063dc37-b223-44c2-a8cb-324c9e5a8169 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:04.070808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063dc37-b223-44c2-a8cb-324c9e5a8169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:04.100050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d063dc37-b223-44c2-a8cb-324c9e5a8169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:04.118235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d063dc37-b223-44c2-a8cb-324c9e5a8169 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:04.141182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fca5b4-cdd8-4b81-bb43-feb2307f7d53 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:04.142883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9fca5b4-cdd8-4b81-bb43-feb2307f7d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:04.164833 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1113/2244] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:20:04.321009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fca5b4-cdd8-4b81-bb43-feb2307f7d53 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:04.336973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d90d3-b359-47d6-a8b9-cda0833a4f8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:04.337842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d90d3-b359-47d6-a8b9-cda0833a4f8a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:04.340154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d90d3-b359-47d6-a8b9-cda0833a4f8a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:04.340625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d90d3-b359-47d6-a8b9-cda0833a4f8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:04.479222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d90d3-b359-47d6-a8b9-cda0833a4f8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:04.481300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d90d3-b359-47d6-a8b9-cda0833a4f8a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:04.505142 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1132/2245] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:04 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:20:05.170736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063dc37-b223-44c2-a8cb-324c9e5a8169 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:05.174447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d063dc37-b223-44c2-a8cb-324c9e5a8169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:05.259583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063dc37-b223-44c2-a8cb-324c9e5a8169 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:05.281368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab2681-aa18-46d3-b854-76d453f4a925 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:05.282115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab2681-aa18-46d3-b854-76d453f4a925 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:05.282283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab2681-aa18-46d3-b854-76d453f4a925 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:05.283104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab2681-aa18-46d3-b854-76d453f4a925 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:05.434988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab2681-aa18-46d3-b854-76d453f4a925 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:05.450947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab2681-aa18-46d3-b854-76d453f4a925 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:05.469477 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1114/2246] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:05 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:06.141148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d90d3-b359-47d6-a8b9-cda0833a4f8a service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:06.179369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d90d3-b359-47d6-a8b9-cda0833a4f8a service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:06.209598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972678f9-5446-4f76-bedd-aaccc114552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:06.210259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972678f9-5446-4f76-bedd-aaccc114552b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:06.210535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972678f9-5446-4f76-bedd-aaccc114552b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:06.210869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972678f9-5446-4f76-bedd-aaccc114552b admin admin] PATH_INFO: `/v3/users/ff1d165efa9f4c028ae9b2def6acd0f8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:06.212603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972678f9-5446-4f76-bedd-aaccc114552b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1d165efa9f4c028ae9b2def6acd0f8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:06.216516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972678f9-5446-4f76-bedd-aaccc114552b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:06.299623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:06.354402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-972678f9-5446-4f76-bedd-aaccc114552b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1d165efa9f4c028ae9b2def6acd0f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:06.355409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-972678f9-5446-4f76-bedd-aaccc114552b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1d165efa9f4c028ae9b2def6acd0f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:06.368141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-972678f9-5446-4f76-bedd-aaccc114552b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1d165efa9f4c028ae9b2def6acd0f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:06.383437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-972678f9-5446-4f76-bedd-aaccc114552b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1d165efa9f4c028ae9b2def6acd0f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:06.459982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-972678f9-5446-4f76-bedd-aaccc114552b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1d165efa9f4c028ae9b2def6acd0f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:06.474715 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1133/2247] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:06 2022] DELETE /identity/v3/users/ff1d165efa9f4c028ae9b2def6acd0f8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:06.484305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab22437-e880-4939-8ecd-15b9e83e6c80 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:06.485218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab22437-e880-4939-8ecd-15b9e83e6c80 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:06.485728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab22437-e880-4939-8ecd-15b9e83e6c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:06.525283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fab22437-e880-4939-8ecd-15b9e83e6c80 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:06.528142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fab22437-e880-4939-8ecd-15b9e83e6c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:06.535444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:06.679815 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1115/2248] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:06.745056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972678f9-5446-4f76-bedd-aaccc114552b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:06.747819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-972678f9-5446-4f76-bedd-aaccc114552b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:06.887323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972678f9-5446-4f76-bedd-aaccc114552b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:06.891645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc29f9c-134c-4ac4-a132-4eef9657e336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:06.892410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc29f9c-134c-4ac4-a132-4eef9657e336 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:06.893300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc29f9c-134c-4ac4-a132-4eef9657e336 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:06.893652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc29f9c-134c-4ac4-a132-4eef9657e336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:06.906948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc29f9c-134c-4ac4-a132-4eef9657e336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:06.918183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc29f9c-134c-4ac4-a132-4eef9657e336 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:06.940516 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1134/2249] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:08.848799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab22437-e880-4939-8ecd-15b9e83e6c80 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:08.850175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fab22437-e880-4939-8ecd-15b9e83e6c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:08.880607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab22437-e880-4939-8ecd-15b9e83e6c80 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:08.894961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf30942-6977-4f46-ad4a-d4a9657eb1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:08.896656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf30942-6977-4f46-ad4a-d4a9657eb1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:08.897055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf30942-6977-4f46-ad4a-d4a9657eb1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:08.897435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf30942-6977-4f46-ad4a-d4a9657eb1c6 admin admin] PATH_INFO: `/v3/users/062028896c1f4599a1a0fc25d4260c02` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:08.904015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf30942-6977-4f46-ad4a-d4a9657eb1c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=062028896c1f4599a1a0fc25d4260c02)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:08.906915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf30942-6977-4f46-ad4a-d4a9657eb1c6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:08.946811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc29f9c-134c-4ac4-a132-4eef9657e336 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:08.949434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cdc29f9c-134c-4ac4-a132-4eef9657e336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:08.977968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc29f9c-134c-4ac4-a132-4eef9657e336 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:08.986198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:08.990657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:08.994005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:08.994602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79 admin admin] PATH_INFO: `/v3/projects/dcb663b87cd84f37a240bdd0353f07a7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:08.998584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb663b87cd84f37a240bdd0353f07a7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:09.002857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:09.062628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbf30942-6977-4f46-ad4a-d4a9657eb1c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062028896c1f4599a1a0fc25d4260c02'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:09.113356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbf30942-6977-4f46-ad4a-d4a9657eb1c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062028896c1f4599a1a0fc25d4260c02'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:09.114738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbf30942-6977-4f46-ad4a-d4a9657eb1c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062028896c1f4599a1a0fc25d4260c02'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:09.116584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbf30942-6977-4f46-ad4a-d4a9657eb1c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062028896c1f4599a1a0fc25d4260c02'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:09.118981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb663b87cd84f37a240bdd0353f07a7', 'request_id': 'req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:09.132354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb663b87cd84f37a240bdd0353f07a7', 'request_id': 'req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:09.137237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbf30942-6977-4f46-ad4a-d4a9657eb1c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062028896c1f4599a1a0fc25d4260c02'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:09.163761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb663b87cd84f37a240bdd0353f07a7', 'request_id': 'req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:09.185530 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1116/2250] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:08 2022] DELETE /identity/v3/users/062028896c1f4599a1a0fc25d4260c02 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:09.193928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79 admin admin] The token cache is being invalidate because project dcb663b87cd84f37a240bdd0353f07a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:09.196211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:09.197345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:09.199151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e68ef-9275-494a-b863-8c7e8635e494 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:09.199815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e68ef-9275-494a-b863-8c7e8635e494 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:09.200848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e68ef-9275-494a-b863-8c7e8635e494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:09.213838 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1135/2251] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:08 2022] DELETE /identity/v3/projects/dcb663b87cd84f37a240bdd0353f07a7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:20:09.215112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:09.220208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:09.270257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f66e68ef-9275-494a-b863-8c7e8635e494 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:09.272394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f66e68ef-9275-494a-b863-8c7e8635e494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:09.349902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:09.433133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90902b-ff69-4f4c-97ed-c7caf8c93f79 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:09.459043 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1117/2252] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:09.498258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e68ef-9275-494a-b863-8c7e8635e494 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:09.501883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f66e68ef-9275-494a-b863-8c7e8635e494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:09.570048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:09.573962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1805d9-1e74-4938-8b52-b3da5bb20591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:09.575378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1805d9-1e74-4938-8b52-b3da5bb20591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:09.575655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1805d9-1e74-4938-8b52-b3da5bb20591 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:09.576096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1805d9-1e74-4938-8b52-b3da5bb20591 admin admin] PATH_INFO: `/v3/users/f12719c4a40646a1b5d3d3134b3a569b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:09.577638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1805d9-1e74-4938-8b52-b3da5bb20591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f12719c4a40646a1b5d3d3134b3a569b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:09.579713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1805d9-1e74-4938-8b52-b3da5bb20591 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:09.638709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e68ef-9275-494a-b863-8c7e8635e494 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:09.645027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e767fa-060d-40c4-ade2-617e94211ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:09.646078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e767fa-060d-40c4-ade2-617e94211ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:09.646605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e767fa-060d-40c4-ade2-617e94211ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:09.646985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e767fa-060d-40c4-ade2-617e94211ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:09.658670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e767fa-060d-40c4-ade2-617e94211ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:09.660382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e767fa-060d-40c4-ade2-617e94211ce8 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:09.674943 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1118/2253] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:20:09.687865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c1805d9-1e74-4938-8b52-b3da5bb20591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f12719c4a40646a1b5d3d3134b3a569b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:09.690330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c1805d9-1e74-4938-8b52-b3da5bb20591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f12719c4a40646a1b5d3d3134b3a569b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:09.701146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c1805d9-1e74-4938-8b52-b3da5bb20591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f12719c4a40646a1b5d3d3134b3a569b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:09.716479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c1805d9-1e74-4938-8b52-b3da5bb20591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f12719c4a40646a1b5d3d3134b3a569b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:09.748623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c1805d9-1e74-4938-8b52-b3da5bb20591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f12719c4a40646a1b5d3d3134b3a569b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:09.766059 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1136/2254] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:09 2022] DELETE /identity/v3/users/f12719c4a40646a1b5d3d3134b3a569b => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:10.325569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e767fa-060d-40c4-ade2-617e94211ce8 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:10.327587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-51e767fa-060d-40c4-ade2-617e94211ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:10.365207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e767fa-060d-40c4-ade2-617e94211ce8 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:10.483885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fd868-c3e6-46b7-877c-5b8052543f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:10.484658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fd868-c3e6-46b7-877c-5b8052543f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:10.485430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fd868-c3e6-46b7-877c-5b8052543f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:10.485760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fd868-c3e6-46b7-877c-5b8052543f0e admin admin] PATH_INFO: `/v3/projects/db2c5054f72d497ab721ee57e9eddaba` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:10.488816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fd868-c3e6-46b7-877c-5b8052543f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=db2c5054f72d497ab721ee57e9eddaba)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:10.491302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fd868-c3e6-46b7-877c-5b8052543f0e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:10.614531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-716fd868-c3e6-46b7-877c-5b8052543f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db2c5054f72d497ab721ee57e9eddaba', 'request_id': 'req-716fd868-c3e6-46b7-877c-5b8052543f0e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:10.650905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-716fd868-c3e6-46b7-877c-5b8052543f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db2c5054f72d497ab721ee57e9eddaba', 'request_id': 'req-716fd868-c3e6-46b7-877c-5b8052543f0e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:10.667795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-716fd868-c3e6-46b7-877c-5b8052543f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db2c5054f72d497ab721ee57e9eddaba', 'request_id': 'req-716fd868-c3e6-46b7-877c-5b8052543f0e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:10.696647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-716fd868-c3e6-46b7-877c-5b8052543f0e admin admin] The token cache is being invalidate because project db2c5054f72d497ab721ee57e9eddaba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:10.697026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-716fd868-c3e6-46b7-877c-5b8052543f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:10.699650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-716fd868-c3e6-46b7-877c-5b8052543f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:10.701683 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1119/2255] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:10 2022] DELETE /identity/v3/projects/db2c5054f72d497ab721ee57e9eddaba => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:10.705659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1805d9-1e74-4938-8b52-b3da5bb20591 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:10.707434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8c1805d9-1e74-4938-8b52-b3da5bb20591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:10.733960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1805d9-1e74-4938-8b52-b3da5bb20591 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:10.859117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:10.883388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b7999-5248-4c85-8911-6ba13f8baa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:10.884042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7999-5248-4c85-8911-6ba13f8baa4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:10.884319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7999-5248-4c85-8911-6ba13f8baa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:10.884592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7999-5248-4c85-8911-6ba13f8baa4d admin admin] PATH_INFO: `/v3/users/df66f8811aac4793871fab96f5ceccc7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:10.885902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b7999-5248-4c85-8911-6ba13f8baa4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=df66f8811aac4793871fab96f5ceccc7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:10.889047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b7999-5248-4c85-8911-6ba13f8baa4d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:11.008824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8a6b7999-5248-4c85-8911-6ba13f8baa4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df66f8811aac4793871fab96f5ceccc7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:11.009301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8a6b7999-5248-4c85-8911-6ba13f8baa4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df66f8811aac4793871fab96f5ceccc7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:11.020271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8a6b7999-5248-4c85-8911-6ba13f8baa4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df66f8811aac4793871fab96f5ceccc7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:11.042492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8a6b7999-5248-4c85-8911-6ba13f8baa4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df66f8811aac4793871fab96f5ceccc7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:11.084844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8a6b7999-5248-4c85-8911-6ba13f8baa4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df66f8811aac4793871fab96f5ceccc7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:11.101957 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1137/2256] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:10 2022] DELETE /identity/v3/users/df66f8811aac4793871fab96f5ceccc7 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:11.610446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fd868-c3e6-46b7-877c-5b8052543f0e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:11.615452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-716fd868-c3e6-46b7-877c-5b8052543f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:11.658233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fd868-c3e6-46b7-877c-5b8052543f0e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:11.802551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b7999-5248-4c85-8911-6ba13f8baa4d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:11.805916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a6b7999-5248-4c85-8911-6ba13f8baa4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:11.850777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:11.886702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fd5e7-b625-4827-83c1-8cc6c7007436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:11.887376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fd5e7-b625-4827-83c1-8cc6c7007436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:11.887656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fd5e7-b625-4827-83c1-8cc6c7007436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:11.887936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fd5e7-b625-4827-83c1-8cc6c7007436 admin admin] PATH_INFO: `/v3/projects/173d0f8552c741fcb3ab0559d041d977` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:11.891587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fd5e7-b625-4827-83c1-8cc6c7007436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=173d0f8552c741fcb3ab0559d041d977)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:11.894423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fd5e7-b625-4827-83c1-8cc6c7007436 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:12.019860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b7999-5248-4c85-8911-6ba13f8baa4d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:12.039529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a94fd5e7-b625-4827-83c1-8cc6c7007436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173d0f8552c741fcb3ab0559d041d977', 'request_id': 'req-a94fd5e7-b625-4827-83c1-8cc6c7007436'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:12.060562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a94fd5e7-b625-4827-83c1-8cc6c7007436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173d0f8552c741fcb3ab0559d041d977', 'request_id': 'req-a94fd5e7-b625-4827-83c1-8cc6c7007436'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:12.094995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a94fd5e7-b625-4827-83c1-8cc6c7007436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173d0f8552c741fcb3ab0559d041d977', 'request_id': 'req-a94fd5e7-b625-4827-83c1-8cc6c7007436'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:12.129930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a94fd5e7-b625-4827-83c1-8cc6c7007436 admin admin] The token cache is being invalidate because project 173d0f8552c741fcb3ab0559d041d977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:12.130509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a94fd5e7-b625-4827-83c1-8cc6c7007436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:12.146757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a94fd5e7-b625-4827-83c1-8cc6c7007436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:12.151311 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1120/2257] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:11 2022] DELETE /identity/v3/projects/173d0f8552c741fcb3ab0559d041d977 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:12.158670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d96e-6e42-4714-9f11-8abaad42316a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:12.187597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d96e-6e42-4714-9f11-8abaad42316a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:12.188421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d96e-6e42-4714-9f11-8abaad42316a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:12.202344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c3d67-77f5-4a35-8fad-81f3fbab934e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:12.203985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c3d67-77f5-4a35-8fad-81f3fbab934e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:12.204297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c3d67-77f5-4a35-8fad-81f3fbab934e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:12.204570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c3d67-77f5-4a35-8fad-81f3fbab934e admin admin] PATH_INFO: `/v3/projects/77d3d670b98b414385a6159a8d5582d3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:12.206139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c3d67-77f5-4a35-8fad-81f3fbab934e admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d3d670b98b414385a6159a8d5582d3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:12.209107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c3d67-77f5-4a35-8fad-81f3fbab934e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:12.256058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:12.308662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-73d1d96e-6e42-4714-9f11-8abaad42316a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:12.311058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-73d1d96e-6e42-4714-9f11-8abaad42316a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:12.335487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea1c3d67-77f5-4a35-8fad-81f3fbab934e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d3d670b98b414385a6159a8d5582d3', 'request_id': 'req-ea1c3d67-77f5-4a35-8fad-81f3fbab934e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:12.359586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea1c3d67-77f5-4a35-8fad-81f3fbab934e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d3d670b98b414385a6159a8d5582d3', 'request_id': 'req-ea1c3d67-77f5-4a35-8fad-81f3fbab934e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:12.366958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea1c3d67-77f5-4a35-8fad-81f3fbab934e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d3d670b98b414385a6159a8d5582d3', 'request_id': 'req-ea1c3d67-77f5-4a35-8fad-81f3fbab934e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:12.397819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea1c3d67-77f5-4a35-8fad-81f3fbab934e admin admin] The token cache is being invalidate because project 77d3d670b98b414385a6159a8d5582d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:12.398183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea1c3d67-77f5-4a35-8fad-81f3fbab934e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:12.398894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea1c3d67-77f5-4a35-8fad-81f3fbab934e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:12.403844 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1138/2258] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:11 2022] DELETE /identity/v3/projects/77d3d670b98b414385a6159a8d5582d3 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:12.405437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64105f54-6685-436c-beb7-edf47730d6a2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:12.405732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64105f54-6685-436c-beb7-edf47730d6a2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:12.406010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64105f54-6685-436c-beb7-edf47730d6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:12.446124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-64105f54-6685-436c-beb7-edf47730d6a2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:12.447431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-64105f54-6685-436c-beb7-edf47730d6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:12.481087 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1121/2259] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:12.488709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319945b-f78d-44a4-ab61-b173378bd1b6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:12.489009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319945b-f78d-44a4-ab61-b173378bd1b6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:12.489347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319945b-f78d-44a4-ab61-b173378bd1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:12.523386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d319945b-f78d-44a4-ab61-b173378bd1b6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:12.525015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d319945b-f78d-44a4-ab61-b173378bd1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:12.545942 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1122/2260] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:12.548832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319945b-f78d-44a4-ab61-b173378bd1b6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:12.568864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319945b-f78d-44a4-ab61-b173378bd1b6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:12.587465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdced5c7-b918-41ec-b3a9-7680ab82e8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:12.588112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdced5c7-b918-41ec-b3a9-7680ab82e8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:12.588392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdced5c7-b918-41ec-b3a9-7680ab82e8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:12.589136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdced5c7-b918-41ec-b3a9-7680ab82e8f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:12.589334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdced5c7-b918-41ec-b3a9-7680ab82e8f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:20:12.589646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdced5c7-b918-41ec-b3a9-7680ab82e8f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:12.602683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdced5c7-b918-41ec-b3a9-7680ab82e8f6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:12.612596 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1139/2261] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:20:12.615703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45eae7-69ef-4c7d-b8c5-696235654767 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:12.616183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45eae7-69ef-4c7d-b8c5-696235654767 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:12.616716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45eae7-69ef-4c7d-b8c5-696235654767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:12.622473 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1123/2262] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:20:12.623506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdced5c7-b918-41ec-b3a9-7680ab82e8f6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:12.644085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdced5c7-b918-41ec-b3a9-7680ab82e8f6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:12.673653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a8d98-25a2-4dad-9b59-b04e0f3a5884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:12.674305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a8d98-25a2-4dad-9b59-b04e0f3a5884 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:12.674589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a8d98-25a2-4dad-9b59-b04e0f3a5884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:12.674866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a8d98-25a2-4dad-9b59-b04e0f3a5884 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:12.675561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a8d98-25a2-4dad-9b59-b04e0f3a5884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:12.683220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a8d98-25a2-4dad-9b59-b04e0f3a5884 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:12.696830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9f45eae7-69ef-4c7d-b8c5-696235654767 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:12.698157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f45eae7-69ef-4c7d-b8c5-696235654767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:12.738817 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1140/2263] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:12.744951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45eae7-69ef-4c7d-b8c5-696235654767 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:12.774088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45eae7-69ef-4c7d-b8c5-696235654767 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:12.790439 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1124/2264] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:12 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:12.793987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36551b8-fda4-4316-a662-43dd677a8748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:12.794633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36551b8-fda4-4316-a662-43dd677a8748 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:12.794909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36551b8-fda4-4316-a662-43dd677a8748 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:12.795183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36551b8-fda4-4316-a662-43dd677a8748 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:12.795727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a8d98-25a2-4dad-9b59-b04e0f3a5884 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:12.796052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36551b8-fda4-4316-a662-43dd677a8748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:20:12.796586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36551b8-fda4-4316-a662-43dd677a8748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:12.799156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36551b8-fda4-4316-a662-43dd677a8748 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:12.867103 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1141/2265] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:20:12.869030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36551b8-fda4-4316-a662-43dd677a8748 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:12.928650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36551b8-fda4-4316-a662-43dd677a8748 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:12.942940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:12.998223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a8d98-25a2-4dad-9b59-b04e0f3a5884 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:13.018505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42704c6-3afa-4c25-a294-42218e3dae73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:13.035866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42704c6-3afa-4c25-a294-42218e3dae73 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:13.036294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42704c6-3afa-4c25-a294-42218e3dae73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:13.036576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42704c6-3afa-4c25-a294-42218e3dae73 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:13.037311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42704c6-3afa-4c25-a294-42218e3dae73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:13.039476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42704c6-3afa-4c25-a294-42218e3dae73 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:13.108774 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1125/2266] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:12 2022] POST /identity/v3/users => generated 293 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:20:13.110753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42704c6-3afa-4c25-a294-42218e3dae73 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:13.123756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1292f-6b70-40bd-ad11-108db51d9abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:13.124751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1292f-6b70-40bd-ad11-108db51d9abb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:13.125027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1292f-6b70-40bd-ad11-108db51d9abb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:13.125291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1292f-6b70-40bd-ad11-108db51d9abb admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:13.125951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1292f-6b70-40bd-ad11-108db51d9abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:13.130413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1292f-6b70-40bd-ad11-108db51d9abb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:13.134092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42704c6-3afa-4c25-a294-42218e3dae73 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:13.144614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75762ede-96b9-456c-ba2e-482694c9769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:13.145244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75762ede-96b9-456c-ba2e-482694c9769b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:13.145528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75762ede-96b9-456c-ba2e-482694c9769b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:13.145803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75762ede-96b9-456c-ba2e-482694c9769b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:13.146616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75762ede-96b9-456c-ba2e-482694c9769b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:13.152467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75762ede-96b9-456c-ba2e-482694c9769b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:13.181237 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1126/2267] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:13.186123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75762ede-96b9-456c-ba2e-482694c9769b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:13.205572 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1142/2268] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:12 2022] POST /identity/v3/projects => generated 393 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:13.210855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1292f-6b70-40bd-ad11-108db51d9abb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:13.218961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75762ede-96b9-456c-ba2e-482694c9769b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:13.263122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:13.382643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1292f-6b70-40bd-ad11-108db51d9abb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:13.405253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5e9a7-d76f-4037-9320-8e58626eda48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:13.405901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5e9a7-d76f-4037-9320-8e58626eda48 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:13.406010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cab06-0efe-4803-8fdb-98cd60f8e03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:13.406186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5e9a7-d76f-4037-9320-8e58626eda48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:13.406463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5e9a7-d76f-4037-9320-8e58626eda48 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:13.406774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cab06-0efe-4803-8fdb-98cd60f8e03c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:13.407116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5e9a7-d76f-4037-9320-8e58626eda48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:13.407228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cab06-0efe-4803-8fdb-98cd60f8e03c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:13.407432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cab06-0efe-4803-8fdb-98cd60f8e03c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:13.408648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6cab06-0efe-4803-8fdb-98cd60f8e03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:13.409119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5e9a7-d76f-4037-9320-8e58626eda48 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:13.417061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6cab06-0efe-4803-8fdb-98cd60f8e03c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:13.446206 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1127/2269] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:13.450942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cab06-0efe-4803-8fdb-98cd60f8e03c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:13.453546 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1143/2270] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:13 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:13.457797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5e9a7-d76f-4037-9320-8e58626eda48 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:13.481791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cab06-0efe-4803-8fdb-98cd60f8e03c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:13.481924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5e9a7-d76f-4037-9320-8e58626eda48 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:13.487036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ca7c7-3843-417e-8cd3-7306c0ac84d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:13.487762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca7c7-3843-417e-8cd3-7306c0ac84d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:13.488130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca7c7-3843-417e-8cd3-7306c0ac84d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:13.488409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca7c7-3843-417e-8cd3-7306c0ac84d5 admin admin] PATH_INFO: `/v3/projects/758d3c617b1f4d7f87d994fbdd45a076/users/b7c1223d9edc4fb99c8967e089c10fa3/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:13.495610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92829b99-5e5f-4ce2-a02b-a7acc0188978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:13.496258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92829b99-5e5f-4ce2-a02b-a7acc0188978 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:13.496542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92829b99-5e5f-4ce2-a02b-a7acc0188978 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:13.496815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92829b99-5e5f-4ce2-a02b-a7acc0188978 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:13.497468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92829b99-5e5f-4ce2-a02b-a7acc0188978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:13.499125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92829b99-5e5f-4ce2-a02b-a7acc0188978 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:13.527904 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1144/2271] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:20:13.533002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92829b99-5e5f-4ce2-a02b-a7acc0188978 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:13.534644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ca7c7-3843-417e-8cd3-7306c0ac84d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758d3c617b1f4d7f87d994fbdd45a076, user_id=b7c1223d9edc4fb99c8967e089c10fa3, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:13.537432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ca7c7-3843-417e-8cd3-7306c0ac84d5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:13.561167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92829b99-5e5f-4ce2-a02b-a7acc0188978 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:13.587126 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1128/2272] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:13 2022] PUT /identity/v3/projects/758d3c617b1f4d7f87d994fbdd45a076/users/b7c1223d9edc4fb99c8967e089c10fa3/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:13.589331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35a093-3241-48e3-b4cd-eedc53d156e3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:13.589331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35a093-3241-48e3-b4cd-eedc53d156e3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:13.589331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35a093-3241-48e3-b4cd-eedc53d156e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:13.589993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc349c-f8b9-482a-93cf-404f829098f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:13.590622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc349c-f8b9-482a-93cf-404f829098f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:13.591115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc349c-f8b9-482a-93cf-404f829098f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:13.591564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc349c-f8b9-482a-93cf-404f829098f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:13.592272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc349c-f8b9-482a-93cf-404f829098f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:13.593959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc349c-f8b9-482a-93cf-404f829098f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:13.619112 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1145/2273] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:13.620292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc349c-f8b9-482a-93cf-404f829098f6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:13.626358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2d35a093-3241-48e3-b4cd-eedc53d156e3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:13.633825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2d35a093-3241-48e3-b4cd-eedc53d156e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:13.647971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc349c-f8b9-482a-93cf-404f829098f6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:13.808260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aeba94-26c5-4e82-886d-f9b0f56fd64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:13.811943 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1129/2274] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:20:13.812139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeba94-26c5-4e82-886d-f9b0f56fd64e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:13.816709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeba94-26c5-4e82-886d-f9b0f56fd64e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:13.816709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeba94-26c5-4e82-886d-f9b0f56fd64e admin admin] PATH_INFO: `/v3/projects/ccba6d85ca4246fa88efdb4beca607c6/users/be7920c7cc3849ca96346e3ddada0f2c/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:13.844100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aeba94-26c5-4e82-886d-f9b0f56fd64e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccba6d85ca4246fa88efdb4beca607c6, user_id=be7920c7cc3849ca96346e3ddada0f2c, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:13.848822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aeba94-26c5-4e82-886d-f9b0f56fd64e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:13.883311 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1146/2275] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:13 2022] PUT /identity/v3/projects/ccba6d85ca4246fa88efdb4beca607c6/users/be7920c7cc3849ca96346e3ddada0f2c/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:13.894629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aa3ff-4671-4f36-a103-62371c061438 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:13.895032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aa3ff-4671-4f36-a103-62371c061438 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:13.895368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aa3ff-4671-4f36-a103-62371c061438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:13.955802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aeba94-26c5-4e82-886d-f9b0f56fd64e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:13.959822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d7aeba94-26c5-4e82-886d-f9b0f56fd64e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:14.019694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-222aa3ff-4671-4f36-a103-62371c061438 None None] MFA Rules not processed for user `be7920c7cc3849ca96346e3ddada0f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:14.022564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-222aa3ff-4671-4f36-a103-62371c061438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:14.093898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:14.135916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aeba94-26c5-4e82-886d-f9b0f56fd64e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:14.155601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386bb01-83d0-4f25-a3b8-86c52c964ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:14.156352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386bb01-83d0-4f25-a3b8-86c52c964ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:14.156708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386bb01-83d0-4f25-a3b8-86c52c964ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:14.157812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386bb01-83d0-4f25-a3b8-86c52c964ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:14.208477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:14.253696 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1130/2276] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:14.255067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222aa3ff-4671-4f36-a103-62371c061438 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:14.371789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386bb01-83d0-4f25-a3b8-86c52c964ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:14.378608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386bb01-83d0-4f25-a3b8-86c52c964ae0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:14.402600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222aa3ff-4671-4f36-a103-62371c061438 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:14.403343 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1147/2277] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:14.423538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177f8e8-c0d2-42fe-85c3-9f6e067eec0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:14.424592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177f8e8-c0d2-42fe-85c3-9f6e067eec0c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:14.425024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177f8e8-c0d2-42fe-85c3-9f6e067eec0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:14.425530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177f8e8-c0d2-42fe-85c3-9f6e067eec0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:14.426405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177f8e8-c0d2-42fe-85c3-9f6e067eec0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:14.431088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177f8e8-c0d2-42fe-85c3-9f6e067eec0c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:14.514260 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1131/2278] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:14 2022] POST /identity/v3/projects => generated 393 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:14.517451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386bb01-83d0-4f25-a3b8-86c52c964ae0 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:14.536226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386bb01-83d0-4f25-a3b8-86c52c964ae0 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:14.693978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de955e0-bc72-4a92-b524-0ec22e9293a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:14.695343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de955e0-bc72-4a92-b524-0ec22e9293a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:14.695632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de955e0-bc72-4a92-b524-0ec22e9293a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:14.695912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de955e0-bc72-4a92-b524-0ec22e9293a9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:14.696991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de955e0-bc72-4a92-b524-0ec22e9293a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:14.699887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de955e0-bc72-4a92-b524-0ec22e9293a9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:14.741055 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1148/2279] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:14 2022] POST /identity/v3/users => generated 303 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:14.748690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177f8e8-c0d2-42fe-85c3-9f6e067eec0c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:14.764517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177f8e8-c0d2-42fe-85c3-9f6e067eec0c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:14.771791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34bc79-81d2-4cdb-820f-f6e0430491c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:14.772550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34bc79-81d2-4cdb-820f-f6e0430491c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:14.773626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34bc79-81d2-4cdb-820f-f6e0430491c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:14.773626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34bc79-81d2-4cdb-820f-f6e0430491c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:14.774112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34bc79-81d2-4cdb-820f-f6e0430491c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:14.776595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34bc79-81d2-4cdb-820f-f6e0430491c0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:14.794143 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1132/2280] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:14.797182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de955e0-bc72-4a92-b524-0ec22e9293a9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:14.813229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de955e0-bc72-4a92-b524-0ec22e9293a9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:14.821680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de0cda-94a6-4b18-8b47-06724d598376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:14.822687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de0cda-94a6-4b18-8b47-06724d598376 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:14.822913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de0cda-94a6-4b18-8b47-06724d598376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:14.823211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de0cda-94a6-4b18-8b47-06724d598376 admin admin] PATH_INFO: `/v3/projects/89fb692ad17c441cb2d12c987badb240/users/c2a0cd363acb468c864cefa1cec985cb/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:14.844247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de0cda-94a6-4b18-8b47-06724d598376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89fb692ad17c441cb2d12c987badb240, user_id=c2a0cd363acb468c864cefa1cec985cb, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:14.847131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de0cda-94a6-4b18-8b47-06724d598376 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:14.868103 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1149/2281] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:14 2022] PUT /identity/v3/projects/89fb692ad17c441cb2d12c987badb240/users/c2a0cd363acb468c864cefa1cec985cb/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:14.872093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34bc79-81d2-4cdb-820f-f6e0430491c0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:14.884136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34bc79-81d2-4cdb-820f-f6e0430491c0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:14.979554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427b593-3de1-44b0-af69-a3e211a37987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:14.980411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427b593-3de1-44b0-af69-a3e211a37987 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:14.980779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427b593-3de1-44b0-af69-a3e211a37987 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:14.981126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427b593-3de1-44b0-af69-a3e211a37987 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:14.981871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427b593-3de1-44b0-af69-a3e211a37987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:14.983799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427b593-3de1-44b0-af69-a3e211a37987 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:14.995496 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1133/2282] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:15.000576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de0cda-94a6-4b18-8b47-06724d598376 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:15.012885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de0cda-94a6-4b18-8b47-06724d598376 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:15.020515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51872e08-0e6e-4908-aec3-5441df31d003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:15.021336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51872e08-0e6e-4908-aec3-5441df31d003 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:15.022262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51872e08-0e6e-4908-aec3-5441df31d003 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:15.022262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51872e08-0e6e-4908-aec3-5441df31d003 admin admin] PATH_INFO: `/v3/projects/89fb692ad17c441cb2d12c987badb240/users/c2a0cd363acb468c864cefa1cec985cb/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:15.026175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51872e08-0e6e-4908-aec3-5441df31d003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89fb692ad17c441cb2d12c987badb240, user_id=c2a0cd363acb468c864cefa1cec985cb, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:15.030385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51872e08-0e6e-4908-aec3-5441df31d003 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:15.045280 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1150/2283] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:14 2022] PUT /identity/v3/projects/89fb692ad17c441cb2d12c987badb240/users/c2a0cd363acb468c864cefa1cec985cb/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:15.057602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fb463-b54f-4080-83c4-ff2cec4e7aea None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:15.058089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fb463-b54f-4080-83c4-ff2cec4e7aea None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:15.058447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fb463-b54f-4080-83c4-ff2cec4e7aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:15.099071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d55fb463-b54f-4080-83c4-ff2cec4e7aea None None] MFA Rules not processed for user `c2a0cd363acb468c864cefa1cec985cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:15.100518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d55fb463-b54f-4080-83c4-ff2cec4e7aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:15.130359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:15.194619 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1134/2284] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:15 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:15.206285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51872e08-0e6e-4908-aec3-5441df31d003 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:15.208287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51872e08-0e6e-4908-aec3-5441df31d003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:15.293570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51872e08-0e6e-4908-aec3-5441df31d003 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:15.299452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819be57-fbd0-41aa-add2-40006d8f651f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:15.300114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819be57-fbd0-41aa-add2-40006d8f651f service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:15.300391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819be57-fbd0-41aa-add2-40006d8f651f service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:15.300662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819be57-fbd0-41aa-add2-40006d8f651f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:15.307602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:15.310565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819be57-fbd0-41aa-add2-40006d8f651f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:15.312980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819be57-fbd0-41aa-add2-40006d8f651f service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:15.325150 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1151/2285] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:15 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:15.456670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fb463-b54f-4080-83c4-ff2cec4e7aea None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:15.713900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fb463-b54f-4080-83c4-ff2cec4e7aea None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:15.737794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58d207-5ce0-4290-b287-b5244191f0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:15.738891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58d207-5ce0-4290-b287-b5244191f0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:15.739419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58d207-5ce0-4290-b287-b5244191f0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:15.739927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58d207-5ce0-4290-b287-b5244191f0d0 admin admin] PATH_INFO: `/v3/users/be7920c7cc3849ca96346e3ddada0f2c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:15.744223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58d207-5ce0-4290-b287-b5244191f0d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7920c7cc3849ca96346e3ddada0f2c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:15.746543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58d207-5ce0-4290-b287-b5244191f0d0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:15.915568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a58d207-5ce0-4290-b287-b5244191f0d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7920c7cc3849ca96346e3ddada0f2c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:15.966131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a58d207-5ce0-4290-b287-b5244191f0d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7920c7cc3849ca96346e3ddada0f2c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:15.967418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a58d207-5ce0-4290-b287-b5244191f0d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7920c7cc3849ca96346e3ddada0f2c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:15.970482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a58d207-5ce0-4290-b287-b5244191f0d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7920c7cc3849ca96346e3ddada0f2c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:15.994390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a58d207-5ce0-4290-b287-b5244191f0d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7920c7cc3849ca96346e3ddada0f2c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:16.046385 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1135/2286] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:15 2022] DELETE /identity/v3/users/be7920c7cc3849ca96346e3ddada0f2c => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:16.050752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f26b-1292-439e-9f6f-28d95f5ed83a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:16.051340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f26b-1292-439e-9f6f-28d95f5ed83a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:16.051630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f26b-1292-439e-9f6f-28d95f5ed83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:16.089641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-77a2f26b-1292-439e-9f6f-28d95f5ed83a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:16.096305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77a2f26b-1292-439e-9f6f-28d95f5ed83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:16.231297 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1152/2287] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:16.262720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58d207-5ce0-4290-b287-b5244191f0d0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:16.266848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2a58d207-5ce0-4290-b287-b5244191f0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:16.366345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2f26b-1292-439e-9f6f-28d95f5ed83a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:16.367928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77a2f26b-1292-439e-9f6f-28d95f5ed83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:16.400881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2f26b-1292-439e-9f6f-28d95f5ed83a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:16.405994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:16.415860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ccb69-720b-4032-b570-5c24e2ca4197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:16.416523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ccb69-720b-4032-b570-5c24e2ca4197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:16.416797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ccb69-720b-4032-b570-5c24e2ca4197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:16.417066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ccb69-720b-4032-b570-5c24e2ca4197 admin admin] PATH_INFO: `/v3/users/c2187dbb36d84ea7be564d69b10e6302` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:16.425848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ccb69-720b-4032-b570-5c24e2ca4197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2187dbb36d84ea7be564d69b10e6302)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:16.431685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ccb69-720b-4032-b570-5c24e2ca4197 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:16.459193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58d207-5ce0-4290-b287-b5244191f0d0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:16.473826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b3018-fee3-40ec-bc18-fbbd4980a7e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:16.477384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b3018-fee3-40ec-bc18-fbbd4980a7e0 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:16.477737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b3018-fee3-40ec-bc18-fbbd4980a7e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:16.486514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b3018-fee3-40ec-bc18-fbbd4980a7e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:16.515046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b3018-fee3-40ec-bc18-fbbd4980a7e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:16.520134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b3018-fee3-40ec-bc18-fbbd4980a7e0 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:16.561392 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1136/2288] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:16.589542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef4ccb69-720b-4032-b570-5c24e2ca4197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2187dbb36d84ea7be564d69b10e6302'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:16.590188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef4ccb69-720b-4032-b570-5c24e2ca4197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2187dbb36d84ea7be564d69b10e6302'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:16.614824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef4ccb69-720b-4032-b570-5c24e2ca4197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2187dbb36d84ea7be564d69b10e6302'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:16.625966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef4ccb69-720b-4032-b570-5c24e2ca4197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2187dbb36d84ea7be564d69b10e6302'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:16.647351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef4ccb69-720b-4032-b570-5c24e2ca4197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2187dbb36d84ea7be564d69b10e6302'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:16.659624 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1153/2289] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:16 2022] DELETE /identity/v3/users/c2187dbb36d84ea7be564d69b10e6302 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:20:16.664324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0435bb0-904d-4bb6-98bf-858b7846f67f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:16.664967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0435bb0-904d-4bb6-98bf-858b7846f67f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:16.665587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0435bb0-904d-4bb6-98bf-858b7846f67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:16.704481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d0435bb0-904d-4bb6-98bf-858b7846f67f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:16.706166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d0435bb0-904d-4bb6-98bf-858b7846f67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:16.741953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ccb69-720b-4032-b570-5c24e2ca4197 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:16.743555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef4ccb69-720b-4032-b570-5c24e2ca4197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:16.794331 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1137/2290] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:16.818832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0435bb0-904d-4bb6-98bf-858b7846f67f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:16.820412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d0435bb0-904d-4bb6-98bf-858b7846f67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:16.902535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ccb69-720b-4032-b570-5c24e2ca4197 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:16.916055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12129a1d-aab9-4683-9e2e-791afbad40e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:16.916727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12129a1d-aab9-4683-9e2e-791afbad40e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:16.917005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12129a1d-aab9-4683-9e2e-791afbad40e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:16.917284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12129a1d-aab9-4683-9e2e-791afbad40e1 admin admin] PATH_INFO: `/v3/users/68aba97bb5c94a128fb66ca97e90ad70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:16.921208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12129a1d-aab9-4683-9e2e-791afbad40e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68aba97bb5c94a128fb66ca97e90ad70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:16.925879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12129a1d-aab9-4683-9e2e-791afbad40e1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:16.957421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0435bb0-904d-4bb6-98bf-858b7846f67f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:16.960414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:16.969127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a389f-9330-4fc3-8b0b-b45367cc607d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:16.970434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a389f-9330-4fc3-8b0b-b45367cc607d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:16.970950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a389f-9330-4fc3-8b0b-b45367cc607d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:16.971619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a389f-9330-4fc3-8b0b-b45367cc607d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:17.005804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a389f-9330-4fc3-8b0b-b45367cc607d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:17.010765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a389f-9330-4fc3-8b0b-b45367cc607d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:17.039611 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1138/2291] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:20:17.048890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12129a1d-aab9-4683-9e2e-791afbad40e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68aba97bb5c94a128fb66ca97e90ad70'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:17.049858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12129a1d-aab9-4683-9e2e-791afbad40e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68aba97bb5c94a128fb66ca97e90ad70'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:17.069459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12129a1d-aab9-4683-9e2e-791afbad40e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68aba97bb5c94a128fb66ca97e90ad70'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:17.091658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12129a1d-aab9-4683-9e2e-791afbad40e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68aba97bb5c94a128fb66ca97e90ad70'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:17.118773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12129a1d-aab9-4683-9e2e-791afbad40e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68aba97bb5c94a128fb66ca97e90ad70'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:17.133072 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1154/2292] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:16 2022] DELETE /identity/v3/users/68aba97bb5c94a128fb66ca97e90ad70 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:17.134767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296d7ff-7f08-434d-bca3-dd5be7534388 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:17.135628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296d7ff-7f08-434d-bca3-dd5be7534388 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:17.136120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296d7ff-7f08-434d-bca3-dd5be7534388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:17.176038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b296d7ff-7f08-434d-bca3-dd5be7534388 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:17.179285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b296d7ff-7f08-434d-bca3-dd5be7534388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:17.344738 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1139/2293] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:17.358439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12129a1d-aab9-4683-9e2e-791afbad40e1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:17.359928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-12129a1d-aab9-4683-9e2e-791afbad40e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:17.503847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12129a1d-aab9-4683-9e2e-791afbad40e1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:17.516940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14e53b-b83e-407b-9acf-ece24cedd6c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:17.517740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14e53b-b83e-407b-9acf-ece24cedd6c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:17.518028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14e53b-b83e-407b-9acf-ece24cedd6c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:17.518308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14e53b-b83e-407b-9acf-ece24cedd6c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:17.543088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14e53b-b83e-407b-9acf-ece24cedd6c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:17.544792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14e53b-b83e-407b-9acf-ece24cedd6c2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:17.575699 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1155/2294] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:20:18.251302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a343d4-55eb-46e9-96cb-90736e2c5b78 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:18.254231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a343d4-55eb-46e9-96cb-90736e2c5b78 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:18.256169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a343d4-55eb-46e9-96cb-90736e2c5b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:18.321008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14e53b-b83e-407b-9acf-ece24cedd6c2 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:18.323828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-be14e53b-b83e-407b-9acf-ece24cedd6c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:18.346187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14e53b-b83e-407b-9acf-ece24cedd6c2 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:18.354368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d7a343d4-55eb-46e9-96cb-90736e2c5b78 None None] MFA Rules not processed for user `2af1c9ed95b84cff82c1abb4416aff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:18.356437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d7a343d4-55eb-46e9-96cb-90736e2c5b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:18.357248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60732404-cbd9-4fc0-bb10-dcf15eddda6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:18.358101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60732404-cbd9-4fc0-bb10-dcf15eddda6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:18.358544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60732404-cbd9-4fc0-bb10-dcf15eddda6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:18.358961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60732404-cbd9-4fc0-bb10-dcf15eddda6a admin admin] PATH_INFO: `/v3/projects/285065cde91d4adb80d52f0dbda6ad11` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:18.364194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60732404-cbd9-4fc0-bb10-dcf15eddda6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=285065cde91d4adb80d52f0dbda6ad11)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:18.371001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60732404-cbd9-4fc0-bb10-dcf15eddda6a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:18.418275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:18.488703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60732404-cbd9-4fc0-bb10-dcf15eddda6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285065cde91d4adb80d52f0dbda6ad11', 'request_id': 'req-60732404-cbd9-4fc0-bb10-dcf15eddda6a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:18.509319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60732404-cbd9-4fc0-bb10-dcf15eddda6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285065cde91d4adb80d52f0dbda6ad11', 'request_id': 'req-60732404-cbd9-4fc0-bb10-dcf15eddda6a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:18.516870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60732404-cbd9-4fc0-bb10-dcf15eddda6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285065cde91d4adb80d52f0dbda6ad11', 'request_id': 'req-60732404-cbd9-4fc0-bb10-dcf15eddda6a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:18.541645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60732404-cbd9-4fc0-bb10-dcf15eddda6a admin admin] The token cache is being invalidate because project 285065cde91d4adb80d52f0dbda6ad11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:18.542023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60732404-cbd9-4fc0-bb10-dcf15eddda6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:18.542614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60732404-cbd9-4fc0-bb10-dcf15eddda6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:18.547447 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1156/2295] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:18 2022] DELETE /identity/v3/projects/285065cde91d4adb80d52f0dbda6ad11 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:18.557472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60732404-cbd9-4fc0-bb10-dcf15eddda6a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:18.557472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-60732404-cbd9-4fc0-bb10-dcf15eddda6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:18.576052 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1140/2296] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:18 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:18.577409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a343d4-55eb-46e9-96cb-90736e2c5b78 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:18.583068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d7a343d4-55eb-46e9-96cb-90736e2c5b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:18.587618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:18.612314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a343d4-55eb-46e9-96cb-90736e2c5b78 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:18.716438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60732404-cbd9-4fc0-bb10-dcf15eddda6a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:18.724950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab43801-cefc-4ff6-a1a2-b71afce36ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:18.725627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab43801-cefc-4ff6-a1a2-b71afce36ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:18.725939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab43801-cefc-4ff6-a1a2-b71afce36ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:18.726290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab43801-cefc-4ff6-a1a2-b71afce36ee9 admin admin] PATH_INFO: `/v3/users/d7e1941f3d244902b183b416fb44d5d0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:18.740244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab43801-cefc-4ff6-a1a2-b71afce36ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e1941f3d244902b183b416fb44d5d0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:18.742665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab43801-cefc-4ff6-a1a2-b71afce36ee9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:18.766323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7c77a-c8ec-4e29-8dae-dfd963315668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:18.766883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7c77a-c8ec-4e29-8dae-dfd963315668 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:18.767164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7c77a-c8ec-4e29-8dae-dfd963315668 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:18.767733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7c77a-c8ec-4e29-8dae-dfd963315668 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:18.768216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7c77a-c8ec-4e29-8dae-dfd963315668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:18.771084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7c77a-c8ec-4e29-8dae-dfd963315668 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:18.847003 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1141/2297] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:18 2022] POST /identity/v3/projects => generated 401 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:18.847003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7c77a-c8ec-4e29-8dae-dfd963315668 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:18.852003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e2a7c77a-c8ec-4e29-8dae-dfd963315668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:18.852991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ab43801-cefc-4ff6-a1a2-b71afce36ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e1941f3d244902b183b416fb44d5d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:18.853731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ab43801-cefc-4ff6-a1a2-b71afce36ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e1941f3d244902b183b416fb44d5d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:18.878588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ab43801-cefc-4ff6-a1a2-b71afce36ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e1941f3d244902b183b416fb44d5d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:18.889492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ab43801-cefc-4ff6-a1a2-b71afce36ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e1941f3d244902b183b416fb44d5d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:18.917161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ab43801-cefc-4ff6-a1a2-b71afce36ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e1941f3d244902b183b416fb44d5d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:18.944344 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1157/2298] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:18 2022] DELETE /identity/v3/users/d7e1941f3d244902b183b416fb44d5d0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:18.944344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab43801-cefc-4ff6-a1a2-b71afce36ee9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:18.944344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0ab43801-cefc-4ff6-a1a2-b71afce36ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:19.028307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7c77a-c8ec-4e29-8dae-dfd963315668 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:19.200847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:19.204846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab43801-cefc-4ff6-a1a2-b71afce36ee9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:19.232026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce0f69-094c-494f-ad37-81f9ff005240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:19.233102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce0f69-094c-494f-ad37-81f9ff005240 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:19.233591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce0f69-094c-494f-ad37-81f9ff005240 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:19.234229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce0f69-094c-494f-ad37-81f9ff005240 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:19.235111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce0f69-094c-494f-ad37-81f9ff005240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:19.235306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5ec81-80f2-4570-a12d-c79f9a186f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:19.239195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce0f69-094c-494f-ad37-81f9ff005240 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:19.243884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5ec81-80f2-4570-a12d-c79f9a186f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:19.243884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5ec81-80f2-4570-a12d-c79f9a186f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:19.243884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5ec81-80f2-4570-a12d-c79f9a186f03 admin admin] PATH_INFO: `/v3/projects/ccba6d85ca4246fa88efdb4beca607c6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:19.249790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5ec81-80f2-4570-a12d-c79f9a186f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccba6d85ca4246fa88efdb4beca607c6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:19.261607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5ec81-80f2-4570-a12d-c79f9a186f03 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:19.345330 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1158/2299] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:18 2022] POST /identity/v3/users => generated 307 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:19.347147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce0f69-094c-494f-ad37-81f9ff005240 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:19.382872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07e5ec81-80f2-4570-a12d-c79f9a186f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccba6d85ca4246fa88efdb4beca607c6', 'request_id': 'req-07e5ec81-80f2-4570-a12d-c79f9a186f03'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:19.396379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07e5ec81-80f2-4570-a12d-c79f9a186f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccba6d85ca4246fa88efdb4beca607c6', 'request_id': 'req-07e5ec81-80f2-4570-a12d-c79f9a186f03'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:19.398381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce0f69-094c-494f-ad37-81f9ff005240 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:19.425523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07e5ec81-80f2-4570-a12d-c79f9a186f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccba6d85ca4246fa88efdb4beca607c6', 'request_id': 'req-07e5ec81-80f2-4570-a12d-c79f9a186f03'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:19.458473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:19.461497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07e5ec81-80f2-4570-a12d-c79f9a186f03 admin admin] The token cache is being invalidate because project ccba6d85ca4246fa88efdb4beca607c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:19.461905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07e5ec81-80f2-4570-a12d-c79f9a186f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:19.462905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07e5ec81-80f2-4570-a12d-c79f9a186f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:19.465037 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1142/2300] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:18 2022] DELETE /identity/v3/projects/ccba6d85ca4246fa88efdb4beca607c6 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:19.469538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5ec81-80f2-4570-a12d-c79f9a186f03 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:19.471836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-07e5ec81-80f2-4570-a12d-c79f9a186f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:19.640993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5ec81-80f2-4570-a12d-c79f9a186f03 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:19.659016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5145cdb-639c-4f09-ab42-b41060d26081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:19.659834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5145cdb-639c-4f09-ab42-b41060d26081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:19.660216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5145cdb-639c-4f09-ab42-b41060d26081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:19.661328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5145cdb-639c-4f09-ab42-b41060d26081 admin admin] PATH_INFO: `/v3/users/c2a0cd363acb468c864cefa1cec985cb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:19.681361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5145cdb-639c-4f09-ab42-b41060d26081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a0cd363acb468c864cefa1cec985cb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:19.683602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5145cdb-639c-4f09-ab42-b41060d26081 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:19.686831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce226e-58bf-4b9e-ac80-4eb56aeb8f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:19.690145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce226e-58bf-4b9e-ac80-4eb56aeb8f1f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:19.690489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce226e-58bf-4b9e-ac80-4eb56aeb8f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:19.690758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce226e-58bf-4b9e-ac80-4eb56aeb8f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:19.693602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce226e-58bf-4b9e-ac80-4eb56aeb8f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:19.699062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce226e-58bf-4b9e-ac80-4eb56aeb8f1f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:19.725318 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1159/2301] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:19.730624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce226e-58bf-4b9e-ac80-4eb56aeb8f1f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:19.757746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e8ce226e-58bf-4b9e-ac80-4eb56aeb8f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:19.782940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce226e-58bf-4b9e-ac80-4eb56aeb8f1f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:19.790521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962c585-2eaf-4277-b0c2-3d19b2cc7d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:19.791383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962c585-2eaf-4277-b0c2-3d19b2cc7d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:19.791732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962c585-2eaf-4277-b0c2-3d19b2cc7d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:19.792162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962c585-2eaf-4277-b0c2-3d19b2cc7d19 admin admin] PATH_INFO: `/v3/projects/2183413d421d49a7a03cb534c8f8c048/users/f45275608e59449697de9800f3c80a04/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:19.823583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962c585-2eaf-4277-b0c2-3d19b2cc7d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2183413d421d49a7a03cb534c8f8c048, user_id=f45275608e59449697de9800f3c80a04, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:19.830350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962c585-2eaf-4277-b0c2-3d19b2cc7d19 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:19.858596 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1160/2302] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:19 2022] PUT /identity/v3/projects/2183413d421d49a7a03cb534c8f8c048/users/f45275608e59449697de9800f3c80a04/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:19.863708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962c585-2eaf-4277-b0c2-3d19b2cc7d19 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:19.876230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5145cdb-639c-4f09-ab42-b41060d26081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a0cd363acb468c864cefa1cec985cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:19.926042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5145cdb-639c-4f09-ab42-b41060d26081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a0cd363acb468c864cefa1cec985cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:19.935830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5145cdb-639c-4f09-ab42-b41060d26081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a0cd363acb468c864cefa1cec985cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:19.942255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5145cdb-639c-4f09-ab42-b41060d26081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a0cd363acb468c864cefa1cec985cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:19.966885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5145cdb-639c-4f09-ab42-b41060d26081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a0cd363acb468c864cefa1cec985cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:19.976055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:19.994278 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1143/2303] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:19 2022] DELETE /identity/v3/users/c2a0cd363acb468c864cefa1cec985cb => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:20:19.998214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962c585-2eaf-4277-b0c2-3d19b2cc7d19 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:20.087897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31095a-565a-4f93-ab3d-b936a7823eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:20.088489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31095a-565a-4f93-ab3d-b936a7823eea admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:20.088871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31095a-565a-4f93-ab3d-b936a7823eea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:20.089453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31095a-565a-4f93-ab3d-b936a7823eea admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:20.090304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31095a-565a-4f93-ab3d-b936a7823eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:20.092364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31095a-565a-4f93-ab3d-b936a7823eea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:20.107636 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1161/2304] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:20.110842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5145cdb-639c-4f09-ab42-b41060d26081 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:20.112574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b5145cdb-639c-4f09-ab42-b41060d26081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:20.129712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31095a-565a-4f93-ab3d-b936a7823eea admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:20.131907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6c31095a-565a-4f93-ab3d-b936a7823eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:20.146383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5145cdb-639c-4f09-ab42-b41060d26081 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:20.172105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb39399-1e3c-4353-8971-cc2d5b8431da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:20.172801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb39399-1e3c-4353-8971-cc2d5b8431da admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:20.173090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb39399-1e3c-4353-8971-cc2d5b8431da admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:20.173342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb39399-1e3c-4353-8971-cc2d5b8431da admin admin] PATH_INFO: `/v3/projects/2183413d421d49a7a03cb534c8f8c048/users/f45275608e59449697de9800f3c80a04/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:20.178207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb39399-1e3c-4353-8971-cc2d5b8431da admin admin] RBAC: Authorizing `identity:create_grant(project_id=2183413d421d49a7a03cb534c8f8c048, user_id=f45275608e59449697de9800f3c80a04, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:20.181476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb39399-1e3c-4353-8971-cc2d5b8431da admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:20.182287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31095a-565a-4f93-ab3d-b936a7823eea admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:20.191510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ab575-12fd-4e7f-befa-33120533e346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:20.192499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ab575-12fd-4e7f-befa-33120533e346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:20.192892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ab575-12fd-4e7f-befa-33120533e346 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:20.193302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ab575-12fd-4e7f-befa-33120533e346 admin admin] PATH_INFO: `/v3/projects/759b87aad6b345f6bfce02f8415624bb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:20.195555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ab575-12fd-4e7f-befa-33120533e346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=759b87aad6b345f6bfce02f8415624bb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:20.197867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ab575-12fd-4e7f-befa-33120533e346 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:20.238880 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1144/2305] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:20 2022] PUT /identity/v3/projects/2183413d421d49a7a03cb534c8f8c048/users/f45275608e59449697de9800f3c80a04/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:20.313508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:20.338012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a9ab575-12fd-4e7f-befa-33120533e346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '759b87aad6b345f6bfce02f8415624bb', 'request_id': 'req-5a9ab575-12fd-4e7f-befa-33120533e346'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:20.350180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a9ab575-12fd-4e7f-befa-33120533e346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '759b87aad6b345f6bfce02f8415624bb', 'request_id': 'req-5a9ab575-12fd-4e7f-befa-33120533e346'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:20.370906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a9ab575-12fd-4e7f-befa-33120533e346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '759b87aad6b345f6bfce02f8415624bb', 'request_id': 'req-5a9ab575-12fd-4e7f-befa-33120533e346'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:20.419293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a9ab575-12fd-4e7f-befa-33120533e346 admin admin] The token cache is being invalidate because project 759b87aad6b345f6bfce02f8415624bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:20.419784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a9ab575-12fd-4e7f-befa-33120533e346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:20.420973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a9ab575-12fd-4e7f-befa-33120533e346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:20.422784 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1162/2306] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:20 2022] DELETE /identity/v3/projects/759b87aad6b345f6bfce02f8415624bb => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:20.426706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb39399-1e3c-4353-8971-cc2d5b8431da admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:20.428703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2bb39399-1e3c-4353-8971-cc2d5b8431da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:20.635365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb39399-1e3c-4353-8971-cc2d5b8431da admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:20.765502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dab094-69ea-4d57-b82d-d9010cc7391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:20.771011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dab094-69ea-4d57-b82d-d9010cc7391c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:20.771697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dab094-69ea-4d57-b82d-d9010cc7391c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:20.773167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dab094-69ea-4d57-b82d-d9010cc7391c admin admin] PATH_INFO: `/v3/users/5c10d70451b841da992ddb4cf47229d8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:20.776690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dab094-69ea-4d57-b82d-d9010cc7391c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c10d70451b841da992ddb4cf47229d8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:20.789985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dab094-69ea-4d57-b82d-d9010cc7391c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:20.905418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1dab094-69ea-4d57-b82d-d9010cc7391c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c10d70451b841da992ddb4cf47229d8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:20.965387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1dab094-69ea-4d57-b82d-d9010cc7391c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c10d70451b841da992ddb4cf47229d8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:20.967020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1dab094-69ea-4d57-b82d-d9010cc7391c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c10d70451b841da992ddb4cf47229d8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:20.969344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1dab094-69ea-4d57-b82d-d9010cc7391c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c10d70451b841da992ddb4cf47229d8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:20.985639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1dab094-69ea-4d57-b82d-d9010cc7391c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c10d70451b841da992ddb4cf47229d8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:21.019523 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1145/2307] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:20 2022] DELETE /identity/v3/users/5c10d70451b841da992ddb4cf47229d8 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:21.440507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ab575-12fd-4e7f-befa-33120533e346 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:21.442540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a9ab575-12fd-4e7f-befa-33120533e346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:21.506500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ab575-12fd-4e7f-befa-33120533e346 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:21.728983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0eec7-f9f7-4d83-8de7-d64bc2d26f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:21.730052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0eec7-f9f7-4d83-8de7-d64bc2d26f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:21.730605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0eec7-f9f7-4d83-8de7-d64bc2d26f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:21.731138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0eec7-f9f7-4d83-8de7-d64bc2d26f47 admin admin] PATH_INFO: `/v3/projects/9c99d9920f7443e3ba5e1cf0ae4a3b11` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:21.734432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0eec7-f9f7-4d83-8de7-d64bc2d26f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c99d9920f7443e3ba5e1cf0ae4a3b11)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:21.739540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0eec7-f9f7-4d83-8de7-d64bc2d26f47 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:21.859168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ce0eec7-f9f7-4d83-8de7-d64bc2d26f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c99d9920f7443e3ba5e1cf0ae4a3b11', 'request_id': 'req-6ce0eec7-f9f7-4d83-8de7-d64bc2d26f47'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:21.885182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ce0eec7-f9f7-4d83-8de7-d64bc2d26f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c99d9920f7443e3ba5e1cf0ae4a3b11', 'request_id': 'req-6ce0eec7-f9f7-4d83-8de7-d64bc2d26f47'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:21.909389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ce0eec7-f9f7-4d83-8de7-d64bc2d26f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c99d9920f7443e3ba5e1cf0ae4a3b11', 'request_id': 'req-6ce0eec7-f9f7-4d83-8de7-d64bc2d26f47'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:21.983909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ce0eec7-f9f7-4d83-8de7-d64bc2d26f47 admin admin] The token cache is being invalidate because project 9c99d9920f7443e3ba5e1cf0ae4a3b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:21.984425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ce0eec7-f9f7-4d83-8de7-d64bc2d26f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:21.985802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ce0eec7-f9f7-4d83-8de7-d64bc2d26f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:21.991052 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1163/2308] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:21 2022] DELETE /identity/v3/projects/9c99d9920f7443e3ba5e1cf0ae4a3b11 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:21.996044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf04255-ef5b-4bf9-a0fd-bb6bb7f31049 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:21.996707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf04255-ef5b-4bf9-a0fd-bb6bb7f31049 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:21.996707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf04255-ef5b-4bf9-a0fd-bb6bb7f31049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:22.055399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-adf04255-ef5b-4bf9-a0fd-bb6bb7f31049 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:22.056727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-adf04255-ef5b-4bf9-a0fd-bb6bb7f31049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:22.101218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:22.110100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e7027-9a94-4b6a-b6b6-166d5248c2ca None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:22.110534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e7027-9a94-4b6a-b6b6-166d5248c2ca None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:22.111071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e7027-9a94-4b6a-b6b6-166d5248c2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:22.282025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ad0e7027-9a94-4b6a-b6b6-166d5248c2ca None None] MFA Rules not processed for user `a3f83d2a0be442cb83593a030e92c752`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:22.292608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad0e7027-9a94-4b6a-b6b6-166d5248c2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:22.312917 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1146/2309] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:22.320639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d0851-83ce-4d3c-a5f3-f7e0c426b405 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:22.321419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d0851-83ce-4d3c-a5f3-f7e0c426b405 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:22.321844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d0851-83ce-4d3c-a5f3-f7e0c426b405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:22.390310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-065d0851-83ce-4d3c-a5f3-f7e0c426b405 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:22.397566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-065d0851-83ce-4d3c-a5f3-f7e0c426b405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:22.435589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:22.451644 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1147/2310] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:20:22.453077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d0851-83ce-4d3c-a5f3-f7e0c426b405 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:22.474752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-065d0851-83ce-4d3c-a5f3-f7e0c426b405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:22.505054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d0851-83ce-4d3c-a5f3-f7e0c426b405 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:22.513562 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1164/2311] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:22.514556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e7027-9a94-4b6a-b6b6-166d5248c2ca None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:22.516164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad0e7027-9a94-4b6a-b6b6-166d5248c2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:22.520907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d4d20-7ef5-459d-96eb-ea690f391583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:22.521824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d4d20-7ef5-459d-96eb-ea690f391583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:22.522250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d4d20-7ef5-459d-96eb-ea690f391583 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:22.523582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d4d20-7ef5-459d-96eb-ea690f391583 admin admin] PATH_INFO: `/v3/projects/89fb692ad17c441cb2d12c987badb240` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:22.527739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d4d20-7ef5-459d-96eb-ea690f391583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89fb692ad17c441cb2d12c987badb240)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:22.530097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d4d20-7ef5-459d-96eb-ea690f391583 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:22.679606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d4d4d20-7ef5-459d-96eb-ea690f391583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89fb692ad17c441cb2d12c987badb240', 'request_id': 'req-9d4d4d20-7ef5-459d-96eb-ea690f391583'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:22.699038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d4d4d20-7ef5-459d-96eb-ea690f391583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89fb692ad17c441cb2d12c987badb240', 'request_id': 'req-9d4d4d20-7ef5-459d-96eb-ea690f391583'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:22.717391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e7027-9a94-4b6a-b6b6-166d5248c2ca None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:22.724827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d4d4d20-7ef5-459d-96eb-ea690f391583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89fb692ad17c441cb2d12c987badb240', 'request_id': 'req-9d4d4d20-7ef5-459d-96eb-ea690f391583'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:22.756137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d4d4d20-7ef5-459d-96eb-ea690f391583 admin admin] The token cache is being invalidate because project 89fb692ad17c441cb2d12c987badb240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:22.756437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d4d4d20-7ef5-459d-96eb-ea690f391583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:22.761482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d4d4d20-7ef5-459d-96eb-ea690f391583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:22.768937 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1148/2312] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:22 2022] DELETE /identity/v3/projects/89fb692ad17c441cb2d12c987badb240 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:22.769986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d4d20-7ef5-459d-96eb-ea690f391583 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:22.774107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9d4d4d20-7ef5-459d-96eb-ea690f391583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:22.949949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897113c-303c-4b41-a147-d1267db13d86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:22.950808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897113c-303c-4b41-a147-d1267db13d86 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:22.951503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897113c-303c-4b41-a147-d1267db13d86 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:22.951503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897113c-303c-4b41-a147-d1267db13d86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:22.960662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e897113c-303c-4b41-a147-d1267db13d86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:23.043764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d4d20-7ef5-459d-96eb-ea690f391583 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:23.056181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f8a02-6e49-465d-92e6-bc9d0530d7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:23.057084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f8a02-6e49-465d-92e6-bc9d0530d7af admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:23.058811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f8a02-6e49-465d-92e6-bc9d0530d7af admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:23.059280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f8a02-6e49-465d-92e6-bc9d0530d7af admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:23.061888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f8a02-6e49-465d-92e6-bc9d0530d7af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:20:23.063920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f8a02-6e49-465d-92e6-bc9d0530d7af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:23.067408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f8a02-6e49-465d-92e6-bc9d0530d7af admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:23.110216 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1149/2313] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:20:23.112305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f8a02-6e49-465d-92e6-bc9d0530d7af admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:23.118280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bb1f8a02-6e49-465d-92e6-bc9d0530d7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:23.163118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f8a02-6e49-465d-92e6-bc9d0530d7af admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:23.170177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897113c-303c-4b41-a147-d1267db13d86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:23.171880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897113c-303c-4b41-a147-d1267db13d86 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:23.177925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf09aa4-513a-4ed5-9746-057accfa68d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:23.178612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf09aa4-513a-4ed5-9746-057accfa68d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:23.178947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf09aa4-513a-4ed5-9746-057accfa68d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:23.179228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf09aa4-513a-4ed5-9746-057accfa68d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:23.179986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf09aa4-513a-4ed5-9746-057accfa68d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:23.186841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf09aa4-513a-4ed5-9746-057accfa68d1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:23.213381 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1165/2314] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:22 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:23.214716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0dcf4-32cf-471c-aa53-a4434a7555ed None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:23.214999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0dcf4-32cf-471c-aa53-a4434a7555ed None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:23.215290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0dcf4-32cf-471c-aa53-a4434a7555ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:23.267677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:23.285672 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1150/2315] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:23 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:23.290209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a4c0dcf4-32cf-471c-aa53-a4434a7555ed None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:23.290618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf09aa4-513a-4ed5-9746-057accfa68d1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:23.291038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a4c0dcf4-32cf-471c-aa53-a4434a7555ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:23.296712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8cf09aa4-513a-4ed5-9746-057accfa68d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:23.303519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:23.429300 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1166/2316] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:23.430498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0dcf4-32cf-471c-aa53-a4434a7555ed None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:23.456971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0dcf4-32cf-471c-aa53-a4434a7555ed None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:23.470049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ad246-3b9d-4fb1-ae9c-60a3f22a7650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:23.471105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ad246-3b9d-4fb1-ae9c-60a3f22a7650 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:23.471753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ad246-3b9d-4fb1-ae9c-60a3f22a7650 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:23.472177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ad246-3b9d-4fb1-ae9c-60a3f22a7650 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:23.474151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ad246-3b9d-4fb1-ae9c-60a3f22a7650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:23.476731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ad246-3b9d-4fb1-ae9c-60a3f22a7650 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:23.570496 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1167/2317] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:23 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:23.572836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9539e-2c66-4dcd-bb5c-be3d3598bccc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:23.573352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9539e-2c66-4dcd-bb5c-be3d3598bccc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:23.573917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9539e-2c66-4dcd-bb5c-be3d3598bccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:23.613293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f8a9539e-2c66-4dcd-bb5c-be3d3598bccc None None] MFA Rules not processed for user `76a98d75a6aa47f3ae3dff33d42f0f67`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:23.619567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f8a9539e-2c66-4dcd-bb5c-be3d3598bccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:23.631289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf09aa4-513a-4ed5-9746-057accfa68d1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:23.804038 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1168/2318] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:23.821940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6128e-96e9-41a1-a56b-1502560a9d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:23.822607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6128e-96e9-41a1-a56b-1502560a9d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:23.822891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6128e-96e9-41a1-a56b-1502560a9d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:23.823166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6128e-96e9-41a1-a56b-1502560a9d3d admin admin] PATH_INFO: `/v3/projects/d5bf41103ebe45d38555d04a1befcd47` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:23.824381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6128e-96e9-41a1-a56b-1502560a9d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5bf41103ebe45d38555d04a1befcd47)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:23.828150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6128e-96e9-41a1-a56b-1502560a9d3d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:23.831839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9539e-2c66-4dcd-bb5c-be3d3598bccc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:23.887366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9539e-2c66-4dcd-bb5c-be3d3598bccc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:23.907932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6eab7-2136-4231-a20e-b47b6123c97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:23.909519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6eab7-2136-4231-a20e-b47b6123c97c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:23.911390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6eab7-2136-4231-a20e-b47b6123c97c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:23.912017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6eab7-2136-4231-a20e-b47b6123c97c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:23.912906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6eab7-2136-4231-a20e-b47b6123c97c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:23.919754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6eab7-2136-4231-a20e-b47b6123c97c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:23.988508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9c6128e-96e9-41a1-a56b-1502560a9d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5bf41103ebe45d38555d04a1befcd47', 'request_id': 'req-b9c6128e-96e9-41a1-a56b-1502560a9d3d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:23.996519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9c6128e-96e9-41a1-a56b-1502560a9d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5bf41103ebe45d38555d04a1befcd47', 'request_id': 'req-b9c6128e-96e9-41a1-a56b-1502560a9d3d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:24.000546 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1169/2319] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:23 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:24.002703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f0a99-42c5-41a9-b9ae-33dedb5666c4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:24.005235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9c6128e-96e9-41a1-a56b-1502560a9d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5bf41103ebe45d38555d04a1befcd47', 'request_id': 'req-b9c6128e-96e9-41a1-a56b-1502560a9d3d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:24.005638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f0a99-42c5-41a9-b9ae-33dedb5666c4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:24.007552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f0a99-42c5-41a9-b9ae-33dedb5666c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:24.033282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9c6128e-96e9-41a1-a56b-1502560a9d3d admin admin] The token cache is being invalidate because project d5bf41103ebe45d38555d04a1befcd47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:24.033874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9c6128e-96e9-41a1-a56b-1502560a9d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:24.034730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9c6128e-96e9-41a1-a56b-1502560a9d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:24.042001 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1151/2320] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:23 2022] DELETE /identity/v3/projects/d5bf41103ebe45d38555d04a1befcd47 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:24.043285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6128e-96e9-41a1-a56b-1502560a9d3d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:24.044947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b9c6128e-96e9-41a1-a56b-1502560a9d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:24.066648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-234f0a99-42c5-41a9-b9ae-33dedb5666c4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:24.068358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-234f0a99-42c5-41a9-b9ae-33dedb5666c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:24.110672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:24.145010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6128e-96e9-41a1-a56b-1502560a9d3d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:24.150481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd12726-c2f8-46cc-bc2a-f466c6cbd78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:24.151118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd12726-c2f8-46cc-bc2a-f466c6cbd78b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:24.151431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd12726-c2f8-46cc-bc2a-f466c6cbd78b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:24.153121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd12726-c2f8-46cc-bc2a-f466c6cbd78b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:24.153849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd12726-c2f8-46cc-bc2a-f466c6cbd78b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:24.156328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd12726-c2f8-46cc-bc2a-f466c6cbd78b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:24.208939 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1152/2321] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:24 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:24.208939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd12726-c2f8-46cc-bc2a-f466c6cbd78b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:24.211823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5bd12726-c2f8-46cc-bc2a-f466c6cbd78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:24.242878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd12726-c2f8-46cc-bc2a-f466c6cbd78b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:24.246682 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1170/2322] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:24.248225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eb76e-1d54-44f9-9075-c0a94a80b1c1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:24.248639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eb76e-1d54-44f9-9075-c0a94a80b1c1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:24.249326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eb76e-1d54-44f9-9075-c0a94a80b1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:24.261273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea03ff-8933-423c-b160-042d1712c58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:24.264095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea03ff-8933-423c-b160-042d1712c58d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:24.264374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea03ff-8933-423c-b160-042d1712c58d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:24.264474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea03ff-8933-423c-b160-042d1712c58d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:24.265158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea03ff-8933-423c-b160-042d1712c58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:24.278390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea03ff-8933-423c-b160-042d1712c58d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:24.299679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d56eb76e-1d54-44f9-9075-c0a94a80b1c1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:24.301173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d56eb76e-1d54-44f9-9075-c0a94a80b1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:24.306793 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1153/2323] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:24.312747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea03ff-8933-423c-b160-042d1712c58d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:24.325763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea03ff-8933-423c-b160-042d1712c58d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:24.331371 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1171/2324] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:24.332499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56eb76e-1d54-44f9-9075-c0a94a80b1c1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:24.348672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75eb9f-0de0-493c-be89-cf569a813058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:24.349459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56eb76e-1d54-44f9-9075-c0a94a80b1c1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:24.352326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75eb9f-0de0-493c-be89-cf569a813058 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:24.354188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75eb9f-0de0-493c-be89-cf569a813058 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:24.354188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75eb9f-0de0-493c-be89-cf569a813058 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:24.357223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75eb9f-0de0-493c-be89-cf569a813058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:24.360013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f9bb7-1cdc-4279-a274-e993f93f3ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:24.360777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f9bb7-1cdc-4279-a274-e993f93f3ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:24.361096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f9bb7-1cdc-4279-a274-e993f93f3ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:24.361703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f9bb7-1cdc-4279-a274-e993f93f3ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:24.362301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f9bb7-1cdc-4279-a274-e993f93f3ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:20:24.362614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f9bb7-1cdc-4279-a274-e993f93f3ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:24.367733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f9bb7-1cdc-4279-a274-e993f93f3ba3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:24.371111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75eb9f-0de0-493c-be89-cf569a813058 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:24.394063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:24.411577 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1172/2325] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:20:24.412771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f9bb7-1cdc-4279-a274-e993f93f3ba3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:24.432626 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1154/2326] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:24.434298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94523d31-d549-40f0-93e5-b145be2d2c23 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:24.434583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94523d31-d549-40f0-93e5-b145be2d2c23 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:24.434857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94523d31-d549-40f0-93e5-b145be2d2c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:24.437934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f9bb7-1cdc-4279-a274-e993f93f3ba3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:24.452640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b7819-aad8-4f7a-8b89-b566936596bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:24.453336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b7819-aad8-4f7a-8b89-b566936596bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:24.453620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b7819-aad8-4f7a-8b89-b566936596bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:24.453901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b7819-aad8-4f7a-8b89-b566936596bf admin admin] PATH_INFO: `/v3/projects/3d63ad846c0d4b54919733cd9cd36f8b/users/c83fd67cc593459b9b52bbe50080680d/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:24.489862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-94523d31-d549-40f0-93e5-b145be2d2c23 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:24.490541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b7819-aad8-4f7a-8b89-b566936596bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d63ad846c0d4b54919733cd9cd36f8b, user_id=c83fd67cc593459b9b52bbe50080680d, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:24.491093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-94523d31-d549-40f0-93e5-b145be2d2c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:24.493607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b7819-aad8-4f7a-8b89-b566936596bf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:24.514212 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1155/2327] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:24.515752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94523d31-d549-40f0-93e5-b145be2d2c23 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:24.539881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94523d31-d549-40f0-93e5-b145be2d2c23 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:24.544113 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1173/2328] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:24 2022] PUT /identity/v3/projects/3d63ad846c0d4b54919733cd9cd36f8b/users/c83fd67cc593459b9b52bbe50080680d/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:24.545864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b7819-aad8-4f7a-8b89-b566936596bf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:24.713401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2ac8f-af3e-402a-aaa0-fe5fb8ed52b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:24.714968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2ac8f-af3e-402a-aaa0-fe5fb8ed52b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:24.715286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2ac8f-af3e-402a-aaa0-fe5fb8ed52b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:24.717762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2ac8f-af3e-402a-aaa0-fe5fb8ed52b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:24.719102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2ac8f-af3e-402a-aaa0-fe5fb8ed52b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:24.721190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2ac8f-af3e-402a-aaa0-fe5fb8ed52b9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:24.723777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b7819-aad8-4f7a-8b89-b566936596bf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:24.733038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b252d-8317-471b-9fcf-6f43d7e03a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:24.733855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b252d-8317-471b-9fcf-6f43d7e03a70 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:24.734141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b252d-8317-471b-9fcf-6f43d7e03a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:24.734413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b252d-8317-471b-9fcf-6f43d7e03a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:24.735088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b252d-8317-471b-9fcf-6f43d7e03a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:24.741857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b252d-8317-471b-9fcf-6f43d7e03a70 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:24.766638 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1174/2329] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:24.766638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b252d-8317-471b-9fcf-6f43d7e03a70 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:24.788803 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1156/2330] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:24 2022] POST /identity/v3/projects => generated 397 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:24.790307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2ac8f-af3e-402a-aaa0-fe5fb8ed52b9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:24.800215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b252d-8317-471b-9fcf-6f43d7e03a70 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:24.953528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2ac8f-af3e-402a-aaa0-fe5fb8ed52b9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:24.967134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428eafb1-bdec-4563-b0d9-f8bfd3ff0fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:24.968181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428eafb1-bdec-4563-b0d9-f8bfd3ff0fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:24.968459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428eafb1-bdec-4563-b0d9-f8bfd3ff0fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:24.969168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428eafb1-bdec-4563-b0d9-f8bfd3ff0fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:24.970261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428eafb1-bdec-4563-b0d9-f8bfd3ff0fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:24.978028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428eafb1-bdec-4563-b0d9-f8bfd3ff0fb6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:25.006968 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1157/2331] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:25.006968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428eafb1-bdec-4563-b0d9-f8bfd3ff0fb6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:25.020410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ee09b-78aa-46a1-832b-82d83c07b1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:25.021249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ee09b-78aa-46a1-832b-82d83c07b1df admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:25.022644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ee09b-78aa-46a1-832b-82d83c07b1df admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:25.022925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ee09b-78aa-46a1-832b-82d83c07b1df admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:25.025144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ee09b-78aa-46a1-832b-82d83c07b1df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:20:25.025298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ee09b-78aa-46a1-832b-82d83c07b1df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:25.026851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ee09b-78aa-46a1-832b-82d83c07b1df admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:25.027562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428eafb1-bdec-4563-b0d9-f8bfd3ff0fb6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:25.042279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c9304-6efe-4dfc-823f-9cbae9c71084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:25.042969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c9304-6efe-4dfc-823f-9cbae9c71084 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:25.043247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c9304-6efe-4dfc-823f-9cbae9c71084 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:25.043549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c9304-6efe-4dfc-823f-9cbae9c71084 admin admin] PATH_INFO: `/v3/projects/6a60036d4fa5414cbcefcffe58bfbf7d/users/35909f361dc74e86b02efd31cd82361a/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:25.089977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c9304-6efe-4dfc-823f-9cbae9c71084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a60036d4fa5414cbcefcffe58bfbf7d, user_id=35909f361dc74e86b02efd31cd82361a, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:25.092647 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1175/2332] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:20:25.096821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c9304-6efe-4dfc-823f-9cbae9c71084 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:25.106292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ee09b-78aa-46a1-832b-82d83c07b1df admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:25.109000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:25.132673 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1158/2333] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:25 2022] PUT /identity/v3/projects/6a60036d4fa5414cbcefcffe58bfbf7d/users/35909f361dc74e86b02efd31cd82361a/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:25.133480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c9304-6efe-4dfc-823f-9cbae9c71084 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:25.177733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ee09b-78aa-46a1-832b-82d83c07b1df admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:25.294766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c9304-6efe-4dfc-823f-9cbae9c71084 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:25.311561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca84db-9c3b-4ae5-941e-4e3c4c933264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:25.312613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca84db-9c3b-4ae5-941e-4e3c4c933264 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:25.313910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca84db-9c3b-4ae5-941e-4e3c4c933264 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:25.316047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca84db-9c3b-4ae5-941e-4e3c4c933264 admin admin] PATH_INFO: `/v3/projects/3d63ad846c0d4b54919733cd9cd36f8b/users/c83fd67cc593459b9b52bbe50080680d/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:25.321915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca84db-9c3b-4ae5-941e-4e3c4c933264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d63ad846c0d4b54919733cd9cd36f8b, user_id=c83fd67cc593459b9b52bbe50080680d, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:25.328593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca84db-9c3b-4ae5-941e-4e3c4c933264 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:25.359730 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1159/2334] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:25 2022] PUT /identity/v3/projects/3d63ad846c0d4b54919733cd9cd36f8b/users/c83fd67cc593459b9b52bbe50080680d/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:25.360624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca84db-9c3b-4ae5-941e-4e3c4c933264 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:25.360743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6153ee-620c-44d6-ad22-8d525184a406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:25.361498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6153ee-620c-44d6-ad22-8d525184a406 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:25.361888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6153ee-620c-44d6-ad22-8d525184a406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:25.362266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6153ee-620c-44d6-ad22-8d525184a406 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:25.365238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6153ee-620c-44d6-ad22-8d525184a406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:25.368140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6153ee-620c-44d6-ad22-8d525184a406 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:25.398102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:25.417217 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1176/2335] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:25 2022] POST /identity/v3/users => generated 299 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:25.419699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a5440-459e-42ae-b902-a84e2258c34b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:25.419865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a5440-459e-42ae-b902-a84e2258c34b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:25.423024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a5440-459e-42ae-b902-a84e2258c34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:25.523192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca84db-9c3b-4ae5-941e-4e3c4c933264 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:25.533530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a36a5440-459e-42ae-b902-a84e2258c34b None None] MFA Rules not processed for user `35909f361dc74e86b02efd31cd82361a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:25.535989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40ed3c-6f1a-4064-82da-61d046749a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:25.537318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a36a5440-459e-42ae-b902-a84e2258c34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:25.544386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40ed3c-6f1a-4064-82da-61d046749a1e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:25.544577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40ed3c-6f1a-4064-82da-61d046749a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:25.544969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40ed3c-6f1a-4064-82da-61d046749a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:25.545642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40ed3c-6f1a-4064-82da-61d046749a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:25.547942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40ed3c-6f1a-4064-82da-61d046749a1e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:25.618934 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1160/2336] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:25 2022] POST /identity/v3/projects => generated 391 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:25.620387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40ed3c-6f1a-4064-82da-61d046749a1e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:25.766407 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1177/2337] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:25.767242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a5440-459e-42ae-b902-a84e2258c34b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:25.792566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a5440-459e-42ae-b902-a84e2258c34b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:25.855290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40ed3c-6f1a-4064-82da-61d046749a1e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:25.884820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873efc0-4c99-4307-846e-5b46030c0059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:25.886646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873efc0-4c99-4307-846e-5b46030c0059 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:25.886937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873efc0-4c99-4307-846e-5b46030c0059 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:25.887714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873efc0-4c99-4307-846e-5b46030c0059 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:25.889352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873efc0-4c99-4307-846e-5b46030c0059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:25.895581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873efc0-4c99-4307-846e-5b46030c0059 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:25.920193 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1161/2338] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:25.921209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873efc0-4c99-4307-846e-5b46030c0059 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:25.936971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9b5a5-98d0-4bfe-9831-10bfdb50bb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:25.937614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9b5a5-98d0-4bfe-9831-10bfdb50bb5e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:25.937888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9b5a5-98d0-4bfe-9831-10bfdb50bb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:25.938156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9b5a5-98d0-4bfe-9831-10bfdb50bb5e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:25.938800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9b5a5-98d0-4bfe-9831-10bfdb50bb5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:25.940814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9b5a5-98d0-4bfe-9831-10bfdb50bb5e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:25.953523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873efc0-4c99-4307-846e-5b46030c0059 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:25.969562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0f286-71a9-4e39-850a-31e99dcca11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:25.970868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f286-71a9-4e39-850a-31e99dcca11d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:25.971209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f286-71a9-4e39-850a-31e99dcca11d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:25.971582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f286-71a9-4e39-850a-31e99dcca11d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:25.972175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0f286-71a9-4e39-850a-31e99dcca11d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:25.974264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0f286-71a9-4e39-850a-31e99dcca11d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:26.015827 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1178/2339] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:25 2022] POST /identity/v3/users => generated 296 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:26.016077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:26.016250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9b5a5-98d0-4bfe-9831-10bfdb50bb5e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:26.096840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9b5a5-98d0-4bfe-9831-10bfdb50bb5e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:26.115836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbd148-ebbe-4a7d-a7cd-cc20c52540d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:26.119630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbd148-ebbe-4a7d-a7cd-cc20c52540d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:26.119944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbd148-ebbe-4a7d-a7cd-cc20c52540d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:26.122766 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1162/2340] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:25 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:26.124137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbd148-ebbe-4a7d-a7cd-cc20c52540d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:26.124877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbd148-ebbe-4a7d-a7cd-cc20c52540d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:26.126590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0f286-71a9-4e39-850a-31e99dcca11d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:26.130943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbd148-ebbe-4a7d-a7cd-cc20c52540d0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:26.245295 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1179/2341] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:26.246612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbd148-ebbe-4a7d-a7cd-cc20c52540d0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:26.258599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0f286-71a9-4e39-850a-31e99dcca11d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:26.266688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2888f1-238a-463b-9611-d4c2031956f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:26.268653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2888f1-238a-463b-9611-d4c2031956f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:26.269045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2888f1-238a-463b-9611-d4c2031956f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:26.269570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2888f1-238a-463b-9611-d4c2031956f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:26.270197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2888f1-238a-463b-9611-d4c2031956f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:26.273674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2888f1-238a-463b-9611-d4c2031956f7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:26.277588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbd148-ebbe-4a7d-a7cd-cc20c52540d0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:26.289421 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1163/2342] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:26.290287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2888f1-238a-463b-9611-d4c2031956f7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:26.290625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a8c9b-3a39-44d6-b67a-e2d8a8261dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:26.292018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a8c9b-3a39-44d6-b67a-e2d8a8261dbc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:26.293032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a8c9b-3a39-44d6-b67a-e2d8a8261dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:26.293437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a8c9b-3a39-44d6-b67a-e2d8a8261dbc admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:26.308707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a8c9b-3a39-44d6-b67a-e2d8a8261dbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:26.310923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a8c9b-3a39-44d6-b67a-e2d8a8261dbc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:26.320550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2888f1-238a-463b-9611-d4c2031956f7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:26.340742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f59515-2c6b-4ff9-becb-98404e4c7d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:26.342349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f59515-2c6b-4ff9-becb-98404e4c7d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:26.343383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f59515-2c6b-4ff9-becb-98404e4c7d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:26.343889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f59515-2c6b-4ff9-becb-98404e4c7d55 admin admin] PATH_INFO: `/v3/projects/c1fe6c1d7a6b4f9fb793da81109ce93c/users/69c85b658b4d499fb6405b2e352358d0/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:26.378028 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1180/2343] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:26 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:26.379766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a8c9b-3a39-44d6-b67a-e2d8a8261dbc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:26.392033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f59515-2c6b-4ff9-becb-98404e4c7d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1fe6c1d7a6b4f9fb793da81109ce93c, user_id=69c85b658b4d499fb6405b2e352358d0, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:26.398563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f59515-2c6b-4ff9-becb-98404e4c7d55 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:26.427329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a8c9b-3a39-44d6-b67a-e2d8a8261dbc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:26.433207 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1164/2344] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:26 2022] PUT /identity/v3/projects/c1fe6c1d7a6b4f9fb793da81109ce93c/users/69c85b658b4d499fb6405b2e352358d0/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:26.433207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f59515-2c6b-4ff9-becb-98404e4c7d55 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:26.626189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:26.645510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f59515-2c6b-4ff9-becb-98404e4c7d55 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:26.669615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4ea09-8be4-441d-8a49-19e36ce11ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:26.672602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4ea09-8be4-441d-8a49-19e36ce11ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:26.673343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66e1b4-9e59-4b00-bcd2-8c121be11eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:26.673721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4ea09-8be4-441d-8a49-19e36ce11ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:26.673987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66e1b4-9e59-4b00-bcd2-8c121be11eec admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:26.674270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66e1b4-9e59-4b00-bcd2-8c121be11eec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:26.674533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4ea09-8be4-441d-8a49-19e36ce11ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:26.674632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66e1b4-9e59-4b00-bcd2-8c121be11eec admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:26.677967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4ea09-8be4-441d-8a49-19e36ce11ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:26.679882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4ea09-8be4-441d-8a49-19e36ce11ba4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:26.686402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66e1b4-9e59-4b00-bcd2-8c121be11eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:26.704188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66e1b4-9e59-4b00-bcd2-8c121be11eec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:26.726837 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1165/2345] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:26.728415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b4478-05fd-42a3-9853-ed5a73e0f96a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:26.728773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b4478-05fd-42a3-9853-ed5a73e0f96a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:26.729121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b4478-05fd-42a3-9853-ed5a73e0f96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:26.736637 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1181/2346] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:26.742336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac8a6d-99e5-4d60-acbc-c2c42ea11f47 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:26.742596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac8a6d-99e5-4d60-acbc-c2c42ea11f47 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:26.742888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac8a6d-99e5-4d60-acbc-c2c42ea11f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:26.766114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-035b4478-05fd-42a3-9853-ed5a73e0f96a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:26.767755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-035b4478-05fd-42a3-9853-ed5a73e0f96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:26.789197 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1166/2347] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:26.790314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b4478-05fd-42a3-9853-ed5a73e0f96a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:26.814214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b4478-05fd-42a3-9853-ed5a73e0f96a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:26.828260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04e4a3-d6de-4d3e-83cf-1c50f923b977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:26.828974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04e4a3-d6de-4d3e-83cf-1c50f923b977 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:26.829251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04e4a3-d6de-4d3e-83cf-1c50f923b977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:26.829528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04e4a3-d6de-4d3e-83cf-1c50f923b977 admin admin] PATH_INFO: `/v3/projects/43b01077d2f641f7a2fc2044f6a70085/users/278f6ad6da1b4550b47e10c60843c669/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:26.831377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9eac8a6d-99e5-4d60-acbc-c2c42ea11f47 None None] MFA Rules not processed for user `22b999f5eb4b467e9dbf44d4d682b828`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:26.832673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9eac8a6d-99e5-4d60-acbc-c2c42ea11f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:26.866512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04e4a3-d6de-4d3e-83cf-1c50f923b977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b01077d2f641f7a2fc2044f6a70085, user_id=278f6ad6da1b4550b47e10c60843c669, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:26.878513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04e4a3-d6de-4d3e-83cf-1c50f923b977 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:26.938993 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1167/2348] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:26 2022] PUT /identity/v3/projects/43b01077d2f641f7a2fc2044f6a70085/users/278f6ad6da1b4550b47e10c60843c669/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:26.940673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04e4a3-d6de-4d3e-83cf-1c50f923b977 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:27.065145 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1182/2349] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:27.075091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac8a6d-99e5-4d60-acbc-c2c42ea11f47 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:27.077124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9eac8a6d-99e5-4d60-acbc-c2c42ea11f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:27.091693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:27.239410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04e4a3-d6de-4d3e-83cf-1c50f923b977 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:27.252733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d321afe-1e06-4ceb-808c-b49547a3fbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:27.253499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d321afe-1e06-4ceb-808c-b49547a3fbab admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:27.253716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d321afe-1e06-4ceb-808c-b49547a3fbab admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:27.253987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d321afe-1e06-4ceb-808c-b49547a3fbab admin admin] PATH_INFO: `/v3/projects/963cbaea37d34ec580bb95d8793b7331/users/b3b55d02d9c34b45a7e7e7371ae4c6ad/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:27.301911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d321afe-1e06-4ceb-808c-b49547a3fbab admin admin] RBAC: Authorizing `identity:create_grant(project_id=963cbaea37d34ec580bb95d8793b7331, user_id=b3b55d02d9c34b45a7e7e7371ae4c6ad, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:27.304927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d321afe-1e06-4ceb-808c-b49547a3fbab admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:27.322160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac8a6d-99e5-4d60-acbc-c2c42ea11f47 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:27.385447 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1168/2350] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:26 2022] PUT /identity/v3/projects/963cbaea37d34ec580bb95d8793b7331/users/b3b55d02d9c34b45a7e7e7371ae4c6ad/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:27.391801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d321afe-1e06-4ceb-808c-b49547a3fbab admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:27.493039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952e3de-b1da-49dd-b939-4cbde638bca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:27.494256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952e3de-b1da-49dd-b939-4cbde638bca2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:27.495602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952e3de-b1da-49dd-b939-4cbde638bca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:27.496365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952e3de-b1da-49dd-b939-4cbde638bca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:27.521690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952e3de-b1da-49dd-b939-4cbde638bca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:27.525217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952e3de-b1da-49dd-b939-4cbde638bca2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:27.547403 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1183/2351] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:27.550241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952e3de-b1da-49dd-b939-4cbde638bca2 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:27.564021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4952e3de-b1da-49dd-b939-4cbde638bca2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:27.599497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d321afe-1e06-4ceb-808c-b49547a3fbab admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:27.612958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c0615-aa9a-449b-a77c-d0ba9af29082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:27.614039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c0615-aa9a-449b-a77c-d0ba9af29082 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:27.615466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c0615-aa9a-449b-a77c-d0ba9af29082 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:27.615849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c0615-aa9a-449b-a77c-d0ba9af29082 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:27.617118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c0615-aa9a-449b-a77c-d0ba9af29082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:27.622477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c0615-aa9a-449b-a77c-d0ba9af29082 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:27.659706 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1169/2352] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:27.662576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07930042-e66b-4e2e-b772-fad235ee3c0d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:27.664336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07930042-e66b-4e2e-b772-fad235ee3c0d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:27.665042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07930042-e66b-4e2e-b772-fad235ee3c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:27.665952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:27.741580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-07930042-e66b-4e2e-b772-fad235ee3c0d None None] MFA Rules not processed for user `b3b55d02d9c34b45a7e7e7371ae4c6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:27.743626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-07930042-e66b-4e2e-b772-fad235ee3c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:27.776791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952e3de-b1da-49dd-b939-4cbde638bca2 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:27.935013 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1170/2353] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:27.941722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07930042-e66b-4e2e-b772-fad235ee3c0d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:27.967696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcdbcd-8aab-45a5-a400-f2dcb8a2c2d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:27.968967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcdbcd-8aab-45a5-a400-f2dcb8a2c2d6 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:27.969600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcdbcd-8aab-45a5-a400-f2dcb8a2c2d6 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:27.971590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcdbcd-8aab-45a5-a400-f2dcb8a2c2d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:27.977346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07930042-e66b-4e2e-b772-fad235ee3c0d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:27.988829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263d2b5-780f-4e7b-8886-8f330aa56fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:27.989904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263d2b5-780f-4e7b-8886-8f330aa56fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:27.992777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263d2b5-780f-4e7b-8886-8f330aa56fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:27.993276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263d2b5-780f-4e7b-8886-8f330aa56fc3 admin admin] PATH_INFO: `/v3/projects/43b01077d2f641f7a2fc2044f6a70085/users/278f6ad6da1b4550b47e10c60843c669/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:28.000454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263d2b5-780f-4e7b-8886-8f330aa56fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b01077d2f641f7a2fc2044f6a70085, user_id=278f6ad6da1b4550b47e10c60843c669, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:28.009761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263d2b5-780f-4e7b-8886-8f330aa56fc3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:28.043693 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1171/2354] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:27 2022] PUT /identity/v3/projects/43b01077d2f641f7a2fc2044f6a70085/users/278f6ad6da1b4550b47e10c60843c669/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:28.044700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263d2b5-780f-4e7b-8886-8f330aa56fc3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:28.124803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:28.146924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcdbcd-8aab-45a5-a400-f2dcb8a2c2d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:28.148736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcdbcd-8aab-45a5-a400-f2dcb8a2c2d6 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:28.180829 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1184/2355] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:28.183469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee5eec-110e-4d99-ade7-82cf051964bd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:28.183973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee5eec-110e-4d99-ade7-82cf051964bd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:28.184436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee5eec-110e-4d99-ade7-82cf051964bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:28.240532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-acee5eec-110e-4d99-ade7-82cf051964bd None None] MFA Rules not processed for user `278f6ad6da1b4550b47e10c60843c669`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:28.242281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-acee5eec-110e-4d99-ade7-82cf051964bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:28.257237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263d2b5-780f-4e7b-8886-8f330aa56fc3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:28.272770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82c845-ab05-47c9-8306-65d0831518c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:28.273413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82c845-ab05-47c9-8306-65d0831518c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:28.273739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82c845-ab05-47c9-8306-65d0831518c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:28.274003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82c845-ab05-47c9-8306-65d0831518c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:28.274655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82c845-ab05-47c9-8306-65d0831518c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:28.280329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82c845-ab05-47c9-8306-65d0831518c0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:28.347246 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1172/2356] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:28 2022] POST /identity/v3/projects => generated 393 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:28.348585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82c845-ab05-47c9-8306-65d0831518c0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:28.350978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:28.375295 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1185/2357] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:28.447563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82c845-ab05-47c9-8306-65d0831518c0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:28.455619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e935e-6069-47a7-8379-0c02a30c6a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:28.456259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e935e-6069-47a7-8379-0c02a30c6a1a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:28.456540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e935e-6069-47a7-8379-0c02a30c6a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:28.456814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e935e-6069-47a7-8379-0c02a30c6a1a admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:28.457478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e935e-6069-47a7-8379-0c02a30c6a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:28.461241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e935e-6069-47a7-8379-0c02a30c6a1a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:28.499599 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1173/2358] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:28 2022] POST /identity/v3/users => generated 303 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:28.501107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee5eec-110e-4d99-ade7-82cf051964bd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:28.517760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee5eec-110e-4d99-ade7-82cf051964bd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:28.526791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53eb72-e494-4c42-a0b1-4ce3e5aa331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:28.528451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53eb72-e494-4c42-a0b1-4ce3e5aa331e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:28.528901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53eb72-e494-4c42-a0b1-4ce3e5aa331e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:28.529320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53eb72-e494-4c42-a0b1-4ce3e5aa331e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:28.530241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53eb72-e494-4c42-a0b1-4ce3e5aa331e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:28.533246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53eb72-e494-4c42-a0b1-4ce3e5aa331e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:28.550308 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1186/2359] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:28.556312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e935e-6069-47a7-8379-0c02a30c6a1a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:28.583272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e935e-6069-47a7-8379-0c02a30c6a1a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:28.597825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1e878-8bd7-482f-85ed-6aec2377a82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:28.599016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1e878-8bd7-482f-85ed-6aec2377a82f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:28.603312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53eb72-e494-4c42-a0b1-4ce3e5aa331e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:28.606790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a53eb72-e494-4c42-a0b1-4ce3e5aa331e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:28.614492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1e878-8bd7-482f-85ed-6aec2377a82f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:28.620013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1e878-8bd7-482f-85ed-6aec2377a82f admin admin] PATH_INFO: `/v3/projects/ed04aae24e1e4f698317bb70498d1a1c/users/ea6f2689623b443c9c2a3c0d105fdd10/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:28.653524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1e878-8bd7-482f-85ed-6aec2377a82f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed04aae24e1e4f698317bb70498d1a1c, user_id=ea6f2689623b443c9c2a3c0d105fdd10, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:28.660602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1e878-8bd7-482f-85ed-6aec2377a82f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:28.710833 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1174/2360] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:28 2022] PUT /identity/v3/projects/ed04aae24e1e4f698317bb70498d1a1c/users/ea6f2689623b443c9c2a3c0d105fdd10/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:28.714399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1e878-8bd7-482f-85ed-6aec2377a82f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:28.816222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53eb72-e494-4c42-a0b1-4ce3e5aa331e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:28.924197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1e878-8bd7-482f-85ed-6aec2377a82f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:28.939770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fc8b6-2717-4b06-8610-c953dc3eafb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:28.940704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc8b6-2717-4b06-8610-c953dc3eafb1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:28.941963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc8b6-2717-4b06-8610-c953dc3eafb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:28.942100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc8b6-2717-4b06-8610-c953dc3eafb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:28.942720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fc8b6-2717-4b06-8610-c953dc3eafb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:28.944509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fc8b6-2717-4b06-8610-c953dc3eafb1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:28.975241 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1175/2361] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:28.981519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fc8b6-2717-4b06-8610-c953dc3eafb1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:29.015887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fc8b6-2717-4b06-8610-c953dc3eafb1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:29.043766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157be63b-fd9a-438a-a6b2-a4c8eaedac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:29.044481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157be63b-fd9a-438a-a6b2-a4c8eaedac8a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:29.044764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157be63b-fd9a-438a-a6b2-a4c8eaedac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:29.045043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157be63b-fd9a-438a-a6b2-a4c8eaedac8a admin admin] PATH_INFO: `/v3/projects/ed04aae24e1e4f698317bb70498d1a1c/users/ea6f2689623b443c9c2a3c0d105fdd10/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:29.053973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78b1a5-f25d-4761-9d21-71e5d18994ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:29.054620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78b1a5-f25d-4761-9d21-71e5d18994ec service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:29.054896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78b1a5-f25d-4761-9d21-71e5d18994ec service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:29.055173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78b1a5-f25d-4761-9d21-71e5d18994ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:29.055889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157be63b-fd9a-438a-a6b2-a4c8eaedac8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed04aae24e1e4f698317bb70498d1a1c, user_id=ea6f2689623b443c9c2a3c0d105fdd10, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:29.060894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157be63b-fd9a-438a-a6b2-a4c8eaedac8a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:29.075389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:29.103309 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1176/2362] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:28 2022] PUT /identity/v3/projects/ed04aae24e1e4f698317bb70498d1a1c/users/ea6f2689623b443c9c2a3c0d105fdd10/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:29.109303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3eab8-1158-4eb9-81d1-86e808317dc2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:29.109750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3eab8-1158-4eb9-81d1-86e808317dc2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:29.110116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3eab8-1158-4eb9-81d1-86e808317dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:29.179929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-eea3eab8-1158-4eb9-81d1-86e808317dc2 None None] MFA Rules not processed for user `ea6f2689623b443c9c2a3c0d105fdd10`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:29.183233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eea3eab8-1158-4eb9-81d1-86e808317dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:29.282178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78b1a5-f25d-4761-9d21-71e5d18994ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:29.286992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78b1a5-f25d-4761-9d21-71e5d18994ec service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:29.369423 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1187/2363] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 767 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:20:29.476159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78b1a5-f25d-4761-9d21-71e5d18994ec service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:29.493640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78b1a5-f25d-4761-9d21-71e5d18994ec service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:29.510680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:29.601603 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1177/2364] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:29 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 494 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:20:29.713010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14fca1-c584-41f1-98f5-52950709bb70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:29.714057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14fca1-c584-41f1-98f5-52950709bb70 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:29.714514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14fca1-c584-41f1-98f5-52950709bb70 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:29.719924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14fca1-c584-41f1-98f5-52950709bb70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:29.920880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14fca1-c584-41f1-98f5-52950709bb70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:29.923481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14fca1-c584-41f1-98f5-52950709bb70 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:29.941690 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1188/2365] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:30.188496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3eab8-1158-4eb9-81d1-86e808317dc2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:30.213726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3eab8-1158-4eb9-81d1-86e808317dc2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:30.220641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4bef2-bd8b-4cc6-9446-b29fa5284e16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:30.221646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4bef2-bd8b-4cc6-9446-b29fa5284e16 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:30.224201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4bef2-bd8b-4cc6-9446-b29fa5284e16 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:30.225082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4bef2-bd8b-4cc6-9446-b29fa5284e16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:30.240056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4bef2-bd8b-4cc6-9446-b29fa5284e16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:30.244683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4bef2-bd8b-4cc6-9446-b29fa5284e16 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:30.261148 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1178/2366] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:30 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:31.269052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14fca1-c584-41f1-98f5-52950709bb70 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:31.415936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14fca1-c584-41f1-98f5-52950709bb70 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:31.426848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a4b47-65a8-439d-a6d1-12409116c152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:31.429200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a4b47-65a8-439d-a6d1-12409116c152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:31.435051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a4b47-65a8-439d-a6d1-12409116c152 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:31.436361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a4b47-65a8-439d-a6d1-12409116c152 admin admin] PATH_INFO: `/v3/users/35909f361dc74e86b02efd31cd82361a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:31.442889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a4b47-65a8-439d-a6d1-12409116c152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35909f361dc74e86b02efd31cd82361a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:31.447808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a4b47-65a8-439d-a6d1-12409116c152 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:31.567473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-866a4b47-65a8-439d-a6d1-12409116c152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35909f361dc74e86b02efd31cd82361a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:31.573492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-866a4b47-65a8-439d-a6d1-12409116c152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35909f361dc74e86b02efd31cd82361a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:31.577606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:31.599002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-866a4b47-65a8-439d-a6d1-12409116c152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35909f361dc74e86b02efd31cd82361a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:31.621790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-866a4b47-65a8-439d-a6d1-12409116c152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35909f361dc74e86b02efd31cd82361a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:31.642047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-866a4b47-65a8-439d-a6d1-12409116c152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35909f361dc74e86b02efd31cd82361a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:31.655957 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1189/2367] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:31 2022] DELETE /identity/v3/users/35909f361dc74e86b02efd31cd82361a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:31.656490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb93bb7-fd00-4c9b-8dbc-b80c99c1b27c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:31.656953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb93bb7-fd00-4c9b-8dbc-b80c99c1b27c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:31.657507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb93bb7-fd00-4c9b-8dbc-b80c99c1b27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:31.722071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3bb93bb7-fd00-4c9b-8dbc-b80c99c1b27c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:31.723554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3bb93bb7-fd00-4c9b-8dbc-b80c99c1b27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:31.857148 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1179/2368] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:32.242081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a4b47-65a8-439d-a6d1-12409116c152 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:32.244272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-866a4b47-65a8-439d-a6d1-12409116c152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:32.414257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a4b47-65a8-439d-a6d1-12409116c152 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:32.426498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751950c-fbee-4647-86bf-324b1130e942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:32.427770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751950c-fbee-4647-86bf-324b1130e942 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:32.428332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751950c-fbee-4647-86bf-324b1130e942 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:32.428803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751950c-fbee-4647-86bf-324b1130e942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:32.444203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751950c-fbee-4647-86bf-324b1130e942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:32.448408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751950c-fbee-4647-86bf-324b1130e942 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:32.463694 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1190/2369] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:33.520387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb93bb7-fd00-4c9b-8dbc-b80c99c1b27c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:33.523112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3bb93bb7-fd00-4c9b-8dbc-b80c99c1b27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:33.672977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb93bb7-fd00-4c9b-8dbc-b80c99c1b27c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:33.684232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606d0b6-246a-4d5b-bafe-e890a9e7e169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:33.685632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606d0b6-246a-4d5b-bafe-e890a9e7e169 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:33.686122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606d0b6-246a-4d5b-bafe-e890a9e7e169 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:33.686549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606d0b6-246a-4d5b-bafe-e890a9e7e169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:33.690147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2606d0b6-246a-4d5b-bafe-e890a9e7e169 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:33.710278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:33.834759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606d0b6-246a-4d5b-bafe-e890a9e7e169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:33.837003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606d0b6-246a-4d5b-bafe-e890a9e7e169 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:33.862931 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1180/2370] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:33.883109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751950c-fbee-4647-86bf-324b1130e942 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:33.884823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b751950c-fbee-4647-86bf-324b1130e942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:33.912160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751950c-fbee-4647-86bf-324b1130e942 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:33.930217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735d27-311a-40af-a095-87380eb1ffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:33.931443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735d27-311a-40af-a095-87380eb1ffb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:33.932459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735d27-311a-40af-a095-87380eb1ffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:33.933285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735d27-311a-40af-a095-87380eb1ffb2 admin admin] PATH_INFO: `/v3/users/b3b55d02d9c34b45a7e7e7371ae4c6ad` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:33.935751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03735d27-311a-40af-a095-87380eb1ffb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b55d02d9c34b45a7e7e7371ae4c6ad)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:33.945047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03735d27-311a-40af-a095-87380eb1ffb2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:34.027395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6d475-1626-40a7-bc3a-3964cef4d522 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:34.027815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6d475-1626-40a7-bc3a-3964cef4d522 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:34.028057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6d475-1626-40a7-bc3a-3964cef4d522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:34.091606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c4b6d475-1626-40a7-bc3a-3964cef4d522 None None] MFA Rules not processed for user `b7c1223d9edc4fb99c8967e089c10fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:34.092967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c4b6d475-1626-40a7-bc3a-3964cef4d522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:34.115340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03735d27-311a-40af-a095-87380eb1ffb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b55d02d9c34b45a7e7e7371ae4c6ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:34.118913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03735d27-311a-40af-a095-87380eb1ffb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b55d02d9c34b45a7e7e7371ae4c6ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:34.141572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03735d27-311a-40af-a095-87380eb1ffb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b55d02d9c34b45a7e7e7371ae4c6ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:34.156231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03735d27-311a-40af-a095-87380eb1ffb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b55d02d9c34b45a7e7e7371ae4c6ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:34.198684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03735d27-311a-40af-a095-87380eb1ffb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b55d02d9c34b45a7e7e7371ae4c6ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:34.236779 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1191/2371] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:33 2022] DELETE /identity/v3/users/b3b55d02d9c34b45a7e7e7371ae4c6ad => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:34.241218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad4eac-d335-4ff9-9251-98c2b2b34d9d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:34.241735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad4eac-d335-4ff9-9251-98c2b2b34d9d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:34.242132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad4eac-d335-4ff9-9251-98c2b2b34d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:34.301187 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1181/2372] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:20:34.301433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9cad4eac-d335-4ff9-9251-98c2b2b34d9d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:34.301433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9cad4eac-d335-4ff9-9251-98c2b2b34d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:34.303849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6d475-1626-40a7-bc3a-3964cef4d522 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:34.305448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c4b6d475-1626-40a7-bc3a-3964cef4d522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:34.343116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6d475-1626-40a7-bc3a-3964cef4d522 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:34.383801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:34.477754 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1192/2373] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:34.512604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fc83e-a2ef-4f67-bb45-507c4438ed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:34.513999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fc83e-a2ef-4f67-bb45-507c4438ed87 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:34.514124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fc83e-a2ef-4f67-bb45-507c4438ed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:34.514434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fc83e-a2ef-4f67-bb45-507c4438ed87 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:34.515114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fc83e-a2ef-4f67-bb45-507c4438ed87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:34.517471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fc83e-a2ef-4f67-bb45-507c4438ed87 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:34.518380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad4eac-d335-4ff9-9251-98c2b2b34d9d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:34.532395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9cad4eac-d335-4ff9-9251-98c2b2b34d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:34.596231 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1182/2374] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:34 2022] POST /identity/v3/projects => generated 385 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:34.600024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fc83e-a2ef-4f67-bb45-507c4438ed87 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:34.686088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:34.714056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad4eac-d335-4ff9-9251-98c2b2b34d9d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:34.829240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87cc62-f2bb-4718-85e0-89c96d53085e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:34.830912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87cc62-f2bb-4718-85e0-89c96d53085e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:34.831730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87cc62-f2bb-4718-85e0-89c96d53085e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:34.832622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87cc62-f2bb-4718-85e0-89c96d53085e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:34.839041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fc83e-a2ef-4f67-bb45-507c4438ed87 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:34.852224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d96de-a4d4-48ed-bd62-90e617b650dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:34.853149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d96de-a4d4-48ed-bd62-90e617b650dc admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:34.853400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d96de-a4d4-48ed-bd62-90e617b650dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:34.854807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d96de-a4d4-48ed-bd62-90e617b650dc admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:34.856855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d96de-a4d4-48ed-bd62-90e617b650dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:34.869764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d96de-a4d4-48ed-bd62-90e617b650dc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:34.880110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87cc62-f2bb-4718-85e0-89c96d53085e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:34.882701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87cc62-f2bb-4718-85e0-89c96d53085e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:34.927570 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1193/2375] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:34.935663 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1183/2376] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:34 2022] POST /identity/v3/users => generated 299 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:34.941394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87cc62-f2bb-4718-85e0-89c96d53085e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:34.976181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87cc62-f2bb-4718-85e0-89c96d53085e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:34.996253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdcd45-ea7d-4b84-8be3-70e68b87985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:34.997231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdcd45-ea7d-4b84-8be3-70e68b87985d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:34.997622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdcd45-ea7d-4b84-8be3-70e68b87985d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:34.998071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdcd45-ea7d-4b84-8be3-70e68b87985d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:34.999239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdcd45-ea7d-4b84-8be3-70e68b87985d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:35.001551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdcd45-ea7d-4b84-8be3-70e68b87985d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:35.019983 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1194/2377] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:35.022879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d96de-a4d4-48ed-bd62-90e617b650dc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:35.060814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d96de-a4d4-48ed-bd62-90e617b650dc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:35.073615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a6a9a-7a28-4851-a87e-567bc68294dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:35.074938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a6a9a-7a28-4851-a87e-567bc68294dc admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:35.075449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a6a9a-7a28-4851-a87e-567bc68294dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:35.075872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a6a9a-7a28-4851-a87e-567bc68294dc admin admin] PATH_INFO: `/v3/projects/cb55196d22684803b3c601fcc3319c5e/users/8ca76a8457cb47189ebdd0c8c12974c5/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:35.102895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a6a9a-7a28-4851-a87e-567bc68294dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb55196d22684803b3c601fcc3319c5e, user_id=8ca76a8457cb47189ebdd0c8c12974c5, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:35.109464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a6a9a-7a28-4851-a87e-567bc68294dc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:35.154776 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1184/2378] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:35 2022] PUT /identity/v3/projects/cb55196d22684803b3c601fcc3319c5e/users/8ca76a8457cb47189ebdd0c8c12974c5/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:35.158668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdcd45-ea7d-4b84-8be3-70e68b87985d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:35.180417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdcd45-ea7d-4b84-8be3-70e68b87985d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:35.296516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365024c1-f604-4bbb-a9c3-a226113f6e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:35.297285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365024c1-f604-4bbb-a9c3-a226113f6e77 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:35.298592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365024c1-f604-4bbb-a9c3-a226113f6e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:35.298716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365024c1-f604-4bbb-a9c3-a226113f6e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:35.300430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365024c1-f604-4bbb-a9c3-a226113f6e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:35.302134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365024c1-f604-4bbb-a9c3-a226113f6e77 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:35.337638 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1195/2379] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:35.339281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a6a9a-7a28-4851-a87e-567bc68294dc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:35.357910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a6a9a-7a28-4851-a87e-567bc68294dc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:35.380305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4680e-454c-435b-9cd7-10c67f15a9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:35.381718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4680e-454c-435b-9cd7-10c67f15a9b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:35.382271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4680e-454c-435b-9cd7-10c67f15a9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:35.382556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4680e-454c-435b-9cd7-10c67f15a9b2 admin admin] PATH_INFO: `/v3/projects/cb55196d22684803b3c601fcc3319c5e/users/8ca76a8457cb47189ebdd0c8c12974c5/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:35.393771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4680e-454c-435b-9cd7-10c67f15a9b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb55196d22684803b3c601fcc3319c5e, user_id=8ca76a8457cb47189ebdd0c8c12974c5, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:35.400326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4680e-454c-435b-9cd7-10c67f15a9b2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:35.437166 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1185/2380] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:35 2022] PUT /identity/v3/projects/cb55196d22684803b3c601fcc3319c5e/users/8ca76a8457cb47189ebdd0c8c12974c5/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:37.487047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365024c1-f604-4bbb-a9c3-a226113f6e77 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:37.488919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-365024c1-f604-4bbb-a9c3-a226113f6e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:37.509357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365024c1-f604-4bbb-a9c3-a226113f6e77 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:37.576528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:37.664196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407faf9-e059-4841-8a6d-1a1ce9e1c180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:37.664196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407faf9-e059-4841-8a6d-1a1ce9e1c180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:37.664616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407faf9-e059-4841-8a6d-1a1ce9e1c180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:37.664925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407faf9-e059-4841-8a6d-1a1ce9e1c180 admin admin] PATH_INFO: `/v3/projects/6a60036d4fa5414cbcefcffe58bfbf7d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:37.669204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407faf9-e059-4841-8a6d-1a1ce9e1c180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a60036d4fa5414cbcefcffe58bfbf7d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:37.671428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407faf9-e059-4841-8a6d-1a1ce9e1c180 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:37.789652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1407faf9-e059-4841-8a6d-1a1ce9e1c180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a60036d4fa5414cbcefcffe58bfbf7d', 'request_id': 'req-1407faf9-e059-4841-8a6d-1a1ce9e1c180'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:37.808316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1407faf9-e059-4841-8a6d-1a1ce9e1c180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a60036d4fa5414cbcefcffe58bfbf7d', 'request_id': 'req-1407faf9-e059-4841-8a6d-1a1ce9e1c180'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:37.815197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1407faf9-e059-4841-8a6d-1a1ce9e1c180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a60036d4fa5414cbcefcffe58bfbf7d', 'request_id': 'req-1407faf9-e059-4841-8a6d-1a1ce9e1c180'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:37.860783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1407faf9-e059-4841-8a6d-1a1ce9e1c180 admin admin] The token cache is being invalidate because project 6a60036d4fa5414cbcefcffe58bfbf7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:37.861240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1407faf9-e059-4841-8a6d-1a1ce9e1c180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:37.863375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1407faf9-e059-4841-8a6d-1a1ce9e1c180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:37.870534 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1196/2381] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:37 2022] DELETE /identity/v3/projects/6a60036d4fa5414cbcefcffe58bfbf7d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:37.871914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4680e-454c-435b-9cd7-10c67f15a9b2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:37.875153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0ff4680e-454c-435b-9cd7-10c67f15a9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:37.898044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4680e-454c-435b-9cd7-10c67f15a9b2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:37.990481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407faf9-e059-4841-8a6d-1a1ce9e1c180 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:37.991877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1407faf9-e059-4841-8a6d-1a1ce9e1c180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:38.003848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f84303-bc28-4feb-8140-c1ac439b198f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:38.004515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f84303-bc28-4feb-8140-c1ac439b198f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:38.004793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f84303-bc28-4feb-8140-c1ac439b198f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:38.005067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f84303-bc28-4feb-8140-c1ac439b198f admin admin] PATH_INFO: `/v3/users/278f6ad6da1b4550b47e10c60843c669` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:38.011882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f84303-bc28-4feb-8140-c1ac439b198f admin admin] RBAC: Authorizing `identity:delete_user(user_id=278f6ad6da1b4550b47e10c60843c669)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:38.025106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f84303-bc28-4feb-8140-c1ac439b198f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:38.152940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62f84303-bc28-4feb-8140-c1ac439b198f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '278f6ad6da1b4550b47e10c60843c669'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:38.173722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407faf9-e059-4841-8a6d-1a1ce9e1c180 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:38.180504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62f84303-bc28-4feb-8140-c1ac439b198f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '278f6ad6da1b4550b47e10c60843c669'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:38.181223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62f84303-bc28-4feb-8140-c1ac439b198f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '278f6ad6da1b4550b47e10c60843c669'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:38.181829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62f84303-bc28-4feb-8140-c1ac439b198f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '278f6ad6da1b4550b47e10c60843c669'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:38.188318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d52a2-9b75-4567-9958-fd02dd4a5735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:38.189552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d52a2-9b75-4567-9958-fd02dd4a5735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:38.190062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d52a2-9b75-4567-9958-fd02dd4a5735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:38.190627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d52a2-9b75-4567-9958-fd02dd4a5735 admin admin] PATH_INFO: `/v3/projects/963cbaea37d34ec580bb95d8793b7331` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:38.195091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d52a2-9b75-4567-9958-fd02dd4a5735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=963cbaea37d34ec580bb95d8793b7331)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:38.198172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d52a2-9b75-4567-9958-fd02dd4a5735 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:38.200411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62f84303-bc28-4feb-8140-c1ac439b198f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '278f6ad6da1b4550b47e10c60843c669'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:38.204035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:38.234314 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1186/2382] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:37 2022] DELETE /identity/v3/users/278f6ad6da1b4550b47e10c60843c669 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:38.317191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-973d52a2-9b75-4567-9958-fd02dd4a5735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '963cbaea37d34ec580bb95d8793b7331', 'request_id': 'req-973d52a2-9b75-4567-9958-fd02dd4a5735'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:38.351825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-973d52a2-9b75-4567-9958-fd02dd4a5735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '963cbaea37d34ec580bb95d8793b7331', 'request_id': 'req-973d52a2-9b75-4567-9958-fd02dd4a5735'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:38.356499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:38.364390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-973d52a2-9b75-4567-9958-fd02dd4a5735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '963cbaea37d34ec580bb95d8793b7331', 'request_id': 'req-973d52a2-9b75-4567-9958-fd02dd4a5735'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:38.386952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-973d52a2-9b75-4567-9958-fd02dd4a5735 admin admin] The token cache is being invalidate because project 963cbaea37d34ec580bb95d8793b7331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:38.387737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-973d52a2-9b75-4567-9958-fd02dd4a5735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:38.388717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-973d52a2-9b75-4567-9958-fd02dd4a5735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:38.391450 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1197/2383] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:37 2022] DELETE /identity/v3/projects/963cbaea37d34ec580bb95d8793b7331 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:20:38.397134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f84303-bc28-4feb-8140-c1ac439b198f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:38.399219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-62f84303-bc28-4feb-8140-c1ac439b198f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:38.518028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f84303-bc28-4feb-8140-c1ac439b198f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:38.645358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bb5eb-1a89-4cf3-8ab1-44039312bc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:38.646609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bb5eb-1a89-4cf3-8ab1-44039312bc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:38.646887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bb5eb-1a89-4cf3-8ab1-44039312bc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:38.647644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bb5eb-1a89-4cf3-8ab1-44039312bc0f admin admin] PATH_INFO: `/v3/users/ea6f2689623b443c9c2a3c0d105fdd10` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:38.649109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bb5eb-1a89-4cf3-8ab1-44039312bc0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea6f2689623b443c9c2a3c0d105fdd10)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:38.652541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bb5eb-1a89-4cf3-8ab1-44039312bc0f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:38.752182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-751bb5eb-1a89-4cf3-8ab1-44039312bc0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea6f2689623b443c9c2a3c0d105fdd10'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:38.773080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-751bb5eb-1a89-4cf3-8ab1-44039312bc0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea6f2689623b443c9c2a3c0d105fdd10'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:38.773418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-751bb5eb-1a89-4cf3-8ab1-44039312bc0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea6f2689623b443c9c2a3c0d105fdd10'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:38.774294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-751bb5eb-1a89-4cf3-8ab1-44039312bc0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea6f2689623b443c9c2a3c0d105fdd10'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:38.787583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-751bb5eb-1a89-4cf3-8ab1-44039312bc0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea6f2689623b443c9c2a3c0d105fdd10'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:38.813766 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1187/2384] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:38 2022] DELETE /identity/v3/users/ea6f2689623b443c9c2a3c0d105fdd10 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:20:39.562648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d52a2-9b75-4567-9958-fd02dd4a5735 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:39.566299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-973d52a2-9b75-4567-9958-fd02dd4a5735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:39.624755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d52a2-9b75-4567-9958-fd02dd4a5735 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:39.775029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf314dd-0dd8-4514-836d-1105755f4473 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:39.775478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf314dd-0dd8-4514-836d-1105755f4473 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:39.775722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf314dd-0dd8-4514-836d-1105755f4473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:39.877107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0cf314dd-0dd8-4514-836d-1105755f4473 None None] MFA Rules not processed for user `f45275608e59449697de9800f3c80a04`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:39.878382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0cf314dd-0dd8-4514-836d-1105755f4473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:39.889286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:39.898154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283e0b6-c218-4601-85e4-296ec864daed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:39.898822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283e0b6-c218-4601-85e4-296ec864daed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:39.899483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283e0b6-c218-4601-85e4-296ec864daed admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:39.899850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283e0b6-c218-4601-85e4-296ec864daed admin admin] PATH_INFO: `/v3/projects/43b01077d2f641f7a2fc2044f6a70085` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:39.902719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283e0b6-c218-4601-85e4-296ec864daed admin admin] RBAC: Authorizing `identity:delete_project(project_id=43b01077d2f641f7a2fc2044f6a70085)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:39.909696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283e0b6-c218-4601-85e4-296ec864daed admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:40.032842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3283e0b6-c218-4601-85e4-296ec864daed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b01077d2f641f7a2fc2044f6a70085', 'request_id': 'req-3283e0b6-c218-4601-85e4-296ec864daed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:40.052153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3283e0b6-c218-4601-85e4-296ec864daed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b01077d2f641f7a2fc2044f6a70085', 'request_id': 'req-3283e0b6-c218-4601-85e4-296ec864daed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:40.052875 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1188/2385] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:39 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:40.060170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf314dd-0dd8-4514-836d-1105755f4473 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:40.062374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0cf314dd-0dd8-4514-836d-1105755f4473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:40.068827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3283e0b6-c218-4601-85e4-296ec864daed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b01077d2f641f7a2fc2044f6a70085', 'request_id': 'req-3283e0b6-c218-4601-85e4-296ec864daed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:40.102245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3283e0b6-c218-4601-85e4-296ec864daed admin admin] The token cache is being invalidate because project 43b01077d2f641f7a2fc2044f6a70085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:40.102546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3283e0b6-c218-4601-85e4-296ec864daed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:40.107868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3283e0b6-c218-4601-85e4-296ec864daed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:40.114345 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1198/2386] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:39 2022] DELETE /identity/v3/projects/43b01077d2f641f7a2fc2044f6a70085 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:40.119622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9494b2e-4776-4cc5-88ed-c793c7e325c2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:40.119868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9494b2e-4776-4cc5-88ed-c793c7e325c2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:40.120065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9494b2e-4776-4cc5-88ed-c793c7e325c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:40.172723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f9494b2e-4776-4cc5-88ed-c793c7e325c2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:40.174453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9494b2e-4776-4cc5-88ed-c793c7e325c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:40.311865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf314dd-0dd8-4514-836d-1105755f4473 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:40.352914 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1199/2387] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:40.355754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9494b2e-4776-4cc5-88ed-c793c7e325c2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:40.361897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9494b2e-4776-4cc5-88ed-c793c7e325c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:40.419363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9494b2e-4776-4cc5-88ed-c793c7e325c2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:40.430811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d31f42-a684-4c7b-b299-051b946c5f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:40.433927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d31f42-a684-4c7b-b299-051b946c5f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:40.434866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d31f42-a684-4c7b-b299-051b946c5f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:40.435115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d31f42-a684-4c7b-b299-051b946c5f2c admin admin] PATH_INFO: `/v3/projects/ed04aae24e1e4f698317bb70498d1a1c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:40.438906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d31f42-a684-4c7b-b299-051b946c5f2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed04aae24e1e4f698317bb70498d1a1c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:40.441720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d31f42-a684-4c7b-b299-051b946c5f2c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:40.516616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:40.565080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06232f6b-2263-4bd9-b7fa-8f6c8d0b954a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:40.565719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06232f6b-2263-4bd9-b7fa-8f6c8d0b954a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:40.566002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06232f6b-2263-4bd9-b7fa-8f6c8d0b954a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:40.566277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06232f6b-2263-4bd9-b7fa-8f6c8d0b954a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:40.572703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-06232f6b-2263-4bd9-b7fa-8f6c8d0b954a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:40.636823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83d31f42-a684-4c7b-b299-051b946c5f2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed04aae24e1e4f698317bb70498d1a1c', 'request_id': 'req-83d31f42-a684-4c7b-b299-051b946c5f2c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:40.660910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83d31f42-a684-4c7b-b299-051b946c5f2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed04aae24e1e4f698317bb70498d1a1c', 'request_id': 'req-83d31f42-a684-4c7b-b299-051b946c5f2c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:40.676197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83d31f42-a684-4c7b-b299-051b946c5f2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed04aae24e1e4f698317bb70498d1a1c', 'request_id': 'req-83d31f42-a684-4c7b-b299-051b946c5f2c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:40.705268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83d31f42-a684-4c7b-b299-051b946c5f2c admin admin] The token cache is being invalidate because project ed04aae24e1e4f698317bb70498d1a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:40.705584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83d31f42-a684-4c7b-b299-051b946c5f2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:40.709541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:40.710694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83d31f42-a684-4c7b-b299-051b946c5f2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:40.713210 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1200/2388] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:40 2022] DELETE /identity/v3/projects/ed04aae24e1e4f698317bb70498d1a1c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:40.718833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d04a65-5f6f-47a4-9cea-2117fa2f1a69 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:40.719147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d04a65-5f6f-47a4-9cea-2117fa2f1a69 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:40.719456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d04a65-5f6f-47a4-9cea-2117fa2f1a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:40.759055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-56d04a65-5f6f-47a4-9cea-2117fa2f1a69 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:40.762406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56d04a65-5f6f-47a4-9cea-2117fa2f1a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:40.788383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06232f6b-2263-4bd9-b7fa-8f6c8d0b954a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:40.790206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06232f6b-2263-4bd9-b7fa-8f6c8d0b954a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:40.812570 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1189/2389] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:40 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 753 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:20:40.818841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeac2c-a363-4277-ad34-c370acc939ac None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:40.819364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeac2c-a363-4277-ad34-c370acc939ac None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:40.819899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeac2c-a363-4277-ad34-c370acc939ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:40.871510 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1201/2390] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:40.876369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d04a65-5f6f-47a4-9cea-2117fa2f1a69 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:40.878236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-01eeac2c-a363-4277-ad34-c370acc939ac None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:40.884437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-01eeac2c-a363-4277-ad34-c370acc939ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:40.898076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d04a65-5f6f-47a4-9cea-2117fa2f1a69 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:40.910670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d32411-86aa-4cf5-a784-bb2bfc4ba290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:40.911457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d32411-86aa-4cf5-a784-bb2bfc4ba290 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:40.913104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d32411-86aa-4cf5-a784-bb2bfc4ba290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:40.913325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d32411-86aa-4cf5-a784-bb2bfc4ba290 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:40.915153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d32411-86aa-4cf5-a784-bb2bfc4ba290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:20:40.915797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d32411-86aa-4cf5-a784-bb2bfc4ba290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:40.921461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d32411-86aa-4cf5-a784-bb2bfc4ba290 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:40.925153 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1190/2391] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:40.926671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e7c8a-3fbe-4c52-a723-0f88d7a0f3f9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:40.926953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e7c8a-3fbe-4c52-a723-0f88d7a0f3f9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:40.927227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e7c8a-3fbe-4c52-a723-0f88d7a0f3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:40.965849 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1202/2392] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:20:40.967503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d32411-86aa-4cf5-a784-bb2bfc4ba290 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:40.993491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-178e7c8a-3fbe-4c52-a723-0f88d7a0f3f9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:40.995085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-178e7c8a-3fbe-4c52-a723-0f88d7a0f3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:40.998312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d32411-86aa-4cf5-a784-bb2bfc4ba290 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:41.009740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8ab7b-d424-4dc2-9433-691f2df9b292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:41.010375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8ab7b-d424-4dc2-9433-691f2df9b292 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:41.010655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8ab7b-d424-4dc2-9433-691f2df9b292 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:41.010925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8ab7b-d424-4dc2-9433-691f2df9b292 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:41.011637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8ab7b-d424-4dc2-9433-691f2df9b292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:41.021504 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1191/2393] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:41.022536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e7c8a-3fbe-4c52-a723-0f88d7a0f3f9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:41.024097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8ab7b-d424-4dc2-9433-691f2df9b292 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:41.045597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e7c8a-3fbe-4c52-a723-0f88d7a0f3f9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:41.064908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba684ecd-0cd4-414c-9077-2955f47f200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:41.065701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba684ecd-0cd4-414c-9077-2955f47f200f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:41.065988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba684ecd-0cd4-414c-9077-2955f47f200f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:41.066265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba684ecd-0cd4-414c-9077-2955f47f200f admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:41.069367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba684ecd-0cd4-414c-9077-2955f47f200f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:20:41.069678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba684ecd-0cd4-414c-9077-2955f47f200f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:41.077283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba684ecd-0cd4-414c-9077-2955f47f200f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:41.127656 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1203/2394] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:40 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:41.129819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8ab7b-d424-4dc2-9433-691f2df9b292 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:41.131768 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1192/2395] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:20:41.137503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba684ecd-0cd4-414c-9077-2955f47f200f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:41.162545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba684ecd-0cd4-414c-9077-2955f47f200f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:41.284393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8ab7b-d424-4dc2-9433-691f2df9b292 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:41.290903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f5b38-ebef-46d8-abac-03938a498a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:41.291608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f5b38-ebef-46d8-abac-03938a498a72 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:41.293369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f5b38-ebef-46d8-abac-03938a498a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:41.293687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f5b38-ebef-46d8-abac-03938a498a72 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:41.294360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f5b38-ebef-46d8-abac-03938a498a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:41.297217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f5b38-ebef-46d8-abac-03938a498a72 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:41.311019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:41.315561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cbbf3-267b-44b4-bd08-0f2537c5dd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:41.316410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cbbf3-267b-44b4-bd08-0f2537c5dd61 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:41.316705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cbbf3-267b-44b4-bd08-0f2537c5dd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:41.316988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cbbf3-267b-44b4-bd08-0f2537c5dd61 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:41.317741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4cbbf3-267b-44b4-bd08-0f2537c5dd61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:41.323601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4cbbf3-267b-44b4-bd08-0f2537c5dd61 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:41.336068 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1204/2396] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:41 2022] POST /identity/v3/users => generated 291 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:41.340257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f5b38-ebef-46d8-abac-03938a498a72 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:41.361041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f5b38-ebef-46d8-abac-03938a498a72 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:41.369166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134a193-6e27-449b-80a7-ce00b58d17f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:41.370924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134a193-6e27-449b-80a7-ce00b58d17f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:41.371488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134a193-6e27-449b-80a7-ce00b58d17f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:41.372526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134a193-6e27-449b-80a7-ce00b58d17f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:41.374203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134a193-6e27-449b-80a7-ce00b58d17f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:41.377787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134a193-6e27-449b-80a7-ce00b58d17f7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:41.396009 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1193/2397] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:41 2022] POST /identity/v3/projects => generated 399 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:41.397712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cbbf3-267b-44b4-bd08-0f2537c5dd61 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:41.399910 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1205/2398] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:20:41.404078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134a193-6e27-449b-80a7-ce00b58d17f7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:41.429406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134a193-6e27-449b-80a7-ce00b58d17f7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:41.503580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cbbf3-267b-44b4-bd08-0f2537c5dd61 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:41.525716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe41a1a-7370-43d6-8181-71be30c98005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:41.527234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe41a1a-7370-43d6-8181-71be30c98005 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:41.528042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe41a1a-7370-43d6-8181-71be30c98005 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:41.528850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe41a1a-7370-43d6-8181-71be30c98005 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:41.530178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe41a1a-7370-43d6-8181-71be30c98005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:41.532492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe41a1a-7370-43d6-8181-71be30c98005 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:41.601570 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1194/2399] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:41 2022] POST /identity/v3/users => generated 300 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:41.606522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe41a1a-7370-43d6-8181-71be30c98005 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:41.628870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06291180-f1e3-432f-b244-4472b1de9966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:41.629465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06291180-f1e3-432f-b244-4472b1de9966 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:41.629742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06291180-f1e3-432f-b244-4472b1de9966 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:41.630048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06291180-f1e3-432f-b244-4472b1de9966 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:41.630750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06291180-f1e3-432f-b244-4472b1de9966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:41.638643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06291180-f1e3-432f-b244-4472b1de9966 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:41.644991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe41a1a-7370-43d6-8181-71be30c98005 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:41.663412 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1206/2400] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:20:41.663412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06291180-f1e3-432f-b244-4472b1de9966 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:41.663690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b469ec-d3ef-4b59-9d43-f40dd2934d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:41.664599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-06291180-f1e3-432f-b244-4472b1de9966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:41.665005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b469ec-d3ef-4b59-9d43-f40dd2934d7c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:41.665459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b469ec-d3ef-4b59-9d43-f40dd2934d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:41.665881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b469ec-d3ef-4b59-9d43-f40dd2934d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:41.667084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b469ec-d3ef-4b59-9d43-f40dd2934d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:41.674742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b469ec-d3ef-4b59-9d43-f40dd2934d7c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:41.733657 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1195/2401] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:41.736264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b469ec-d3ef-4b59-9d43-f40dd2934d7c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:41.755664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b469ec-d3ef-4b59-9d43-f40dd2934d7c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:41.766414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c9710-1f70-46b7-91be-f3a3bce01a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:41.769518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c9710-1f70-46b7-91be-f3a3bce01a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:41.770082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c9710-1f70-46b7-91be-f3a3bce01a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:41.770979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c9710-1f70-46b7-91be-f3a3bce01a98 admin admin] PATH_INFO: `/v3/projects/7867530504b94692bb110f136cddcbd9/users/75381e87110b4850bb790bdaf3e4e50d/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:41.815136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:41.824182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c9710-1f70-46b7-91be-f3a3bce01a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7867530504b94692bb110f136cddcbd9, user_id=75381e87110b4850bb790bdaf3e4e50d, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:41.833082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c9710-1f70-46b7-91be-f3a3bce01a98 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:41.849393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06291180-f1e3-432f-b244-4472b1de9966 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:41.867704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019c07b-80d6-4773-ba4c-dad462ec76d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:41.868412 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1196/2402] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:41 2022] PUT /identity/v3/projects/7867530504b94692bb110f136cddcbd9/users/75381e87110b4850bb790bdaf3e4e50d/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:41.869515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019c07b-80d6-4773-ba4c-dad462ec76d8 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:41.869983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019c07b-80d6-4773-ba4c-dad462ec76d8 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:41.870434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c9710-1f70-46b7-91be-f3a3bce01a98 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:41.870891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019c07b-80d6-4773-ba4c-dad462ec76d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:41.879990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5019c07b-80d6-4773-ba4c-dad462ec76d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:42.010353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c9710-1f70-46b7-91be-f3a3bce01a98 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:42.016835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb4219-57c5-4eb2-8879-902505910d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:42.018609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb4219-57c5-4eb2-8879-902505910d11 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:42.018909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb4219-57c5-4eb2-8879-902505910d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:42.019396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb4219-57c5-4eb2-8879-902505910d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:42.020163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb4219-57c5-4eb2-8879-902505910d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:42.022697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb4219-57c5-4eb2-8879-902505910d11 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:42.051158 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1197/2403] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:42.059294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a503c4-99cf-47b5-a9ef-f23a69673982 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:42.059619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a503c4-99cf-47b5-a9ef-f23a69673982 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:42.060074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a503c4-99cf-47b5-a9ef-f23a69673982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:42.060856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019c07b-80d6-4773-ba4c-dad462ec76d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:42.063530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019c07b-80d6-4773-ba4c-dad462ec76d8 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:42.092393 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1207/2404] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:41 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:42.093960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019c07b-80d6-4773-ba4c-dad462ec76d8 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:42.119585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f0a503c4-99cf-47b5-a9ef-f23a69673982 None None] MFA Rules not processed for user `75381e87110b4850bb790bdaf3e4e50d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:42.123014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f0a503c4-99cf-47b5-a9ef-f23a69673982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:42.125516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019c07b-80d6-4773-ba4c-dad462ec76d8 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:42.137321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1d910-3a1b-4bd4-9f5f-7ff03f570c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:42.139348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1d910-3a1b-4bd4-9f5f-7ff03f570c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:42.145710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1d910-3a1b-4bd4-9f5f-7ff03f570c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:42.147474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1d910-3a1b-4bd4-9f5f-7ff03f570c2e admin admin] PATH_INFO: `/v3/projects/fa35c8e6530d4b979b2c7c6063d30d25/users/76acdfa98f63412d967e325180a9fd4d/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:42.180046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:42.197234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1d910-3a1b-4bd4-9f5f-7ff03f570c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa35c8e6530d4b979b2c7c6063d30d25, user_id=76acdfa98f63412d967e325180a9fd4d, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:42.199783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1d910-3a1b-4bd4-9f5f-7ff03f570c2e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:42.245400 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1208/2405] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:42 2022] PUT /identity/v3/projects/fa35c8e6530d4b979b2c7c6063d30d25/users/76acdfa98f63412d967e325180a9fd4d/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:42.249951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c27c8-5fe6-49cf-8dd3-a4d25a96be98 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:42.250223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c27c8-5fe6-49cf-8dd3-a4d25a96be98 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:42.250498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c27c8-5fe6-49cf-8dd3-a4d25a96be98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:42.322465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-533c27c8-5fe6-49cf-8dd3-a4d25a96be98 None None] MFA Rules not processed for user `76acdfa98f63412d967e325180a9fd4d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:42.323959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-533c27c8-5fe6-49cf-8dd3-a4d25a96be98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:42.334072 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1198/2406] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:42.339216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a503c4-99cf-47b5-a9ef-f23a69673982 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:42.372801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a503c4-99cf-47b5-a9ef-f23a69673982 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:42.588525 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1209/2407] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:20:42.589495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18fa91-56f7-41d7-9219-e2fd309f997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:42.590141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18fa91-56f7-41d7-9219-e2fd309f997a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:42.590424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18fa91-56f7-41d7-9219-e2fd309f997a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:42.590702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18fa91-56f7-41d7-9219-e2fd309f997a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:42.591414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18fa91-56f7-41d7-9219-e2fd309f997a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:42.593659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18fa91-56f7-41d7-9219-e2fd309f997a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:42.597534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c27c8-5fe6-49cf-8dd3-a4d25a96be98 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:42.686409 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1199/2408] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:42 2022] POST /identity/v3/projects => generated 381 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:42.692495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18fa91-56f7-41d7-9219-e2fd309f997a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:42.702865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:42.862020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c27c8-5fe6-49cf-8dd3-a4d25a96be98 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:42.872961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18fa91-56f7-41d7-9219-e2fd309f997a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:42.889237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39804a95-5c79-493c-b319-fc351f545b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:42.890439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39804a95-5c79-493c-b319-fc351f545b81 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:42.890439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39804a95-5c79-493c-b319-fc351f545b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:42.890439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39804a95-5c79-493c-b319-fc351f545b81 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:42.891790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39804a95-5c79-493c-b319-fc351f545b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:42.893574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39804a95-5c79-493c-b319-fc351f545b81 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:42.994515 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1200/2409] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:42 2022] POST /identity/v3/users => generated 297 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:42.998765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39804a95-5c79-493c-b319-fc351f545b81 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:43.023687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39804a95-5c79-493c-b319-fc351f545b81 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:43.030911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e0888-76c3-4219-a8dd-e41937be9bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:43.035467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e0888-76c3-4219-a8dd-e41937be9bd1 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:43.035467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e0888-76c3-4219-a8dd-e41937be9bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:43.035467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e0888-76c3-4219-a8dd-e41937be9bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:43.057838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286e628-4112-4b49-bb6d-8b5cc8a807f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:43.058262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286e628-4112-4b49-bb6d-8b5cc8a807f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:43.058475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286e628-4112-4b49-bb6d-8b5cc8a807f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:43.058784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286e628-4112-4b49-bb6d-8b5cc8a807f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:43.059501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286e628-4112-4b49-bb6d-8b5cc8a807f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:43.061354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286e628-4112-4b49-bb6d-8b5cc8a807f1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:43.063043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:43.111606 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1201/2410] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:43.117242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286e628-4112-4b49-bb6d-8b5cc8a807f1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:43.137884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286e628-4112-4b49-bb6d-8b5cc8a807f1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:43.151468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be5ed1-ba02-43ef-9977-e1bf4b095518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:43.152164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be5ed1-ba02-43ef-9977-e1bf4b095518 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:43.152442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be5ed1-ba02-43ef-9977-e1bf4b095518 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:43.152720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be5ed1-ba02-43ef-9977-e1bf4b095518 admin admin] PATH_INFO: `/v3/projects/8a343249aad04144a422d23597fb76c4/users/0eff06ccdf1f434eb704161fc2bbdb9f/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:43.196794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be5ed1-ba02-43ef-9977-e1bf4b095518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a343249aad04144a422d23597fb76c4, user_id=0eff06ccdf1f434eb704161fc2bbdb9f, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:43.199567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be5ed1-ba02-43ef-9977-e1bf4b095518 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:43.201913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e0888-76c3-4219-a8dd-e41937be9bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:43.203617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e0888-76c3-4219-a8dd-e41937be9bd1 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:43.221313 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1210/2411] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:42 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:20:43.236463 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1202/2412] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:43 2022] PUT /identity/v3/projects/8a343249aad04144a422d23597fb76c4/users/0eff06ccdf1f434eb704161fc2bbdb9f/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:20:43.239214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e0888-76c3-4219-a8dd-e41937be9bd1 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:43.258193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e0888-76c3-4219-a8dd-e41937be9bd1 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:43.317461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be5ed1-ba02-43ef-9977-e1bf4b095518 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:43.404435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952e93e-a5b5-4676-8432-05ce40bc06fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:43.405080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952e93e-a5b5-4676-8432-05ce40bc06fe admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:43.405363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952e93e-a5b5-4676-8432-05ce40bc06fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:43.405640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952e93e-a5b5-4676-8432-05ce40bc06fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:43.406384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952e93e-a5b5-4676-8432-05ce40bc06fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:43.408161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952e93e-a5b5-4676-8432-05ce40bc06fe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:43.436979 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1211/2413] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:20:43.437976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952e93e-a5b5-4676-8432-05ce40bc06fe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:43.461491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952e93e-a5b5-4676-8432-05ce40bc06fe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:43.476684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b34a1-d140-4646-96ff-9e19caedb77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:43.477386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b34a1-d140-4646-96ff-9e19caedb77a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:43.477668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b34a1-d140-4646-96ff-9e19caedb77a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:43.477953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b34a1-d140-4646-96ff-9e19caedb77a admin admin] PATH_INFO: `/v3/projects/8a343249aad04144a422d23597fb76c4/users/0eff06ccdf1f434eb704161fc2bbdb9f/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:43.478922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be5ed1-ba02-43ef-9977-e1bf4b095518 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:43.484507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b34a1-d140-4646-96ff-9e19caedb77a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a343249aad04144a422d23597fb76c4, user_id=0eff06ccdf1f434eb704161fc2bbdb9f, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:43.487593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b34a1-d140-4646-96ff-9e19caedb77a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:43.500156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346855a-ebb6-4eef-9aca-301a05c0de69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:43.501087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346855a-ebb6-4eef-9aca-301a05c0de69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:43.501436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346855a-ebb6-4eef-9aca-301a05c0de69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:43.501779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346855a-ebb6-4eef-9aca-301a05c0de69 admin admin] PATH_INFO: `/v3/users/76acdfa98f63412d967e325180a9fd4d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:43.503078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346855a-ebb6-4eef-9aca-301a05c0de69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76acdfa98f63412d967e325180a9fd4d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:43.505146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346855a-ebb6-4eef-9aca-301a05c0de69 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:43.513184 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1212/2414] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:43 2022] PUT /identity/v3/projects/8a343249aad04144a422d23597fb76c4/users/0eff06ccdf1f434eb704161fc2bbdb9f/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:43.524490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03289-02fe-43e9-a92e-43c11b3ccc8d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:43.524781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03289-02fe-43e9-a92e-43c11b3ccc8d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:43.525069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03289-02fe-43e9-a92e-43c11b3ccc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:43.607415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6346855a-ebb6-4eef-9aca-301a05c0de69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76acdfa98f63412d967e325180a9fd4d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:43.620413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:43.632467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6346855a-ebb6-4eef-9aca-301a05c0de69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76acdfa98f63412d967e325180a9fd4d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:43.634450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a8c03289-02fe-43e9-a92e-43c11b3ccc8d None None] MFA Rules not processed for user `0eff06ccdf1f434eb704161fc2bbdb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:43.635737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6346855a-ebb6-4eef-9aca-301a05c0de69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76acdfa98f63412d967e325180a9fd4d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:43.636767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6346855a-ebb6-4eef-9aca-301a05c0de69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76acdfa98f63412d967e325180a9fd4d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:43.637358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a8c03289-02fe-43e9-a92e-43c11b3ccc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:43.653631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6346855a-ebb6-4eef-9aca-301a05c0de69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76acdfa98f63412d967e325180a9fd4d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:43.679948 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1203/2415] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:43 2022] DELETE /identity/v3/users/76acdfa98f63412d967e325180a9fd4d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:43.687410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd6eec-9f4f-4214-8b56-f5246b66ed97 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:43.699190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd6eec-9f4f-4214-8b56-f5246b66ed97 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:43.700015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd6eec-9f4f-4214-8b56-f5246b66ed97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:43.741737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b1dd6eec-9f4f-4214-8b56-f5246b66ed97 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:43.748606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b1dd6eec-9f4f-4214-8b56-f5246b66ed97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:43.830071 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1213/2416] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:43.837113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c03289-02fe-43e9-a92e-43c11b3ccc8d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:43.838767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a8c03289-02fe-43e9-a92e-43c11b3ccc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:43.901713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:43.946209 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1204/2417] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:43.977819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd6eec-9f4f-4214-8b56-f5246b66ed97 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:43.979448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b1dd6eec-9f4f-4214-8b56-f5246b66ed97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:44.150190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c03289-02fe-43e9-a92e-43c11b3ccc8d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:44.190326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd6eec-9f4f-4214-8b56-f5246b66ed97 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:44.196919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f208907-e146-419f-868e-c2d6116650f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:44.197557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208907-e146-419f-868e-c2d6116650f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:44.197836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208907-e146-419f-868e-c2d6116650f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:44.198146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208907-e146-419f-868e-c2d6116650f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:44.223432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f208907-e146-419f-868e-c2d6116650f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:44.226365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f208907-e146-419f-868e-c2d6116650f0 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:44.236868 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1205/2418] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:20:44.330112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97667f26-ad2c-4362-b52d-5db83e0948e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:44.330765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97667f26-ad2c-4362-b52d-5db83e0948e7 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:44.331042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97667f26-ad2c-4362-b52d-5db83e0948e7 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:44.331341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97667f26-ad2c-4362-b52d-5db83e0948e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:44.513090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97667f26-ad2c-4362-b52d-5db83e0948e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:44.515286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97667f26-ad2c-4362-b52d-5db83e0948e7 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:44.539003 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1214/2419] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:20:44.754117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f208907-e146-419f-868e-c2d6116650f0 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:44.755849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0f208907-e146-419f-868e-c2d6116650f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:44.779875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f208907-e146-419f-868e-c2d6116650f0 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:44.802655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a94d5d-f77b-4e7a-98a3-347a89749acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:44.803560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a94d5d-f77b-4e7a-98a3-347a89749acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:44.804190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a94d5d-f77b-4e7a-98a3-347a89749acf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:44.807555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a94d5d-f77b-4e7a-98a3-347a89749acf admin admin] PATH_INFO: `/v3/users/75381e87110b4850bb790bdaf3e4e50d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:44.809757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a94d5d-f77b-4e7a-98a3-347a89749acf admin admin] RBAC: Authorizing `identity:delete_user(user_id=75381e87110b4850bb790bdaf3e4e50d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:44.812832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a94d5d-f77b-4e7a-98a3-347a89749acf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:44.940570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23a94d5d-f77b-4e7a-98a3-347a89749acf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75381e87110b4850bb790bdaf3e4e50d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:44.974664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23a94d5d-f77b-4e7a-98a3-347a89749acf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75381e87110b4850bb790bdaf3e4e50d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:44.977542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23a94d5d-f77b-4e7a-98a3-347a89749acf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75381e87110b4850bb790bdaf3e4e50d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:44.980644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23a94d5d-f77b-4e7a-98a3-347a89749acf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75381e87110b4850bb790bdaf3e4e50d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:45.003033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23a94d5d-f77b-4e7a-98a3-347a89749acf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75381e87110b4850bb790bdaf3e4e50d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:45.006688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:45.039547 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1206/2420] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:44 2022] DELETE /identity/v3/users/75381e87110b4850bb790bdaf3e4e50d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:45.044361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1a795-da1d-4c5f-bd2b-cfcfd57cf9f3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:45.044960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1a795-da1d-4c5f-bd2b-cfcfd57cf9f3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:45.045459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1a795-da1d-4c5f-bd2b-cfcfd57cf9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:45.322183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-97a1a795-da1d-4c5f-bd2b-cfcfd57cf9f3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:45.324146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97a1a795-da1d-4c5f-bd2b-cfcfd57cf9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:45.438597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:45.478243 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1215/2421] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:45.507146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a94d5d-f77b-4e7a-98a3-347a89749acf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:45.510500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-23a94d5d-f77b-4e7a-98a3-347a89749acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:45.713607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a94d5d-f77b-4e7a-98a3-347a89749acf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:45.718321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796562b-5466-43c1-9be3-9465641c5b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:45.719238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796562b-5466-43c1-9be3-9465641c5b66 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:45.719647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796562b-5466-43c1-9be3-9465641c5b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:45.720023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796562b-5466-43c1-9be3-9465641c5b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:45.749766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796562b-5466-43c1-9be3-9465641c5b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:45.751539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796562b-5466-43c1-9be3-9465641c5b66 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:45.768866 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1207/2422] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:46.675145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1a795-da1d-4c5f-bd2b-cfcfd57cf9f3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:46.676669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97a1a795-da1d-4c5f-bd2b-cfcfd57cf9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:46.701852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1a795-da1d-4c5f-bd2b-cfcfd57cf9f3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:46.714903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fe150-6b85-4ff7-bba3-be735c101397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:46.715634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe150-6b85-4ff7-bba3-be735c101397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:46.716059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe150-6b85-4ff7-bba3-be735c101397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:46.716358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe150-6b85-4ff7-bba3-be735c101397 admin admin] PATH_INFO: `/v3/projects/fa35c8e6530d4b979b2c7c6063d30d25` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:46.717794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fe150-6b85-4ff7-bba3-be735c101397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa35c8e6530d4b979b2c7c6063d30d25)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:46.719792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fe150-6b85-4ff7-bba3-be735c101397 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:46.871812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-740fe150-6b85-4ff7-bba3-be735c101397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa35c8e6530d4b979b2c7c6063d30d25', 'request_id': 'req-740fe150-6b85-4ff7-bba3-be735c101397'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:46.890059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-740fe150-6b85-4ff7-bba3-be735c101397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa35c8e6530d4b979b2c7c6063d30d25', 'request_id': 'req-740fe150-6b85-4ff7-bba3-be735c101397'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:46.906348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-740fe150-6b85-4ff7-bba3-be735c101397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa35c8e6530d4b979b2c7c6063d30d25', 'request_id': 'req-740fe150-6b85-4ff7-bba3-be735c101397'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:46.945242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-740fe150-6b85-4ff7-bba3-be735c101397 admin admin] The token cache is being invalidate because project fa35c8e6530d4b979b2c7c6063d30d25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:46.945983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-740fe150-6b85-4ff7-bba3-be735c101397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:46.947222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-740fe150-6b85-4ff7-bba3-be735c101397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:46.950864 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1216/2423] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:46 2022] DELETE /identity/v3/projects/fa35c8e6530d4b979b2c7c6063d30d25 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:46.958198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445104ae-ff5a-4119-ad8f-2d66ae55a969 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:46.959839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445104ae-ff5a-4119-ad8f-2d66ae55a969 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:46.961613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445104ae-ff5a-4119-ad8f-2d66ae55a969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:47.010706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-445104ae-ff5a-4119-ad8f-2d66ae55a969 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:47.014834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-445104ae-ff5a-4119-ad8f-2d66ae55a969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:47.139376 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1208/2424] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:47.147055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c797439-ad68-45a6-a77f-cbcf8fdd8283 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:47.148176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c797439-ad68-45a6-a77f-cbcf8fdd8283 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:47.148628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c797439-ad68-45a6-a77f-cbcf8fdd8283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:47.196224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7c797439-ad68-45a6-a77f-cbcf8fdd8283 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:47.197902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7c797439-ad68-45a6-a77f-cbcf8fdd8283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:47.216978 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1217/2425] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:47.221070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445104ae-ff5a-4119-ad8f-2d66ae55a969 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:47.239758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445104ae-ff5a-4119-ad8f-2d66ae55a969 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:47.253464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8117d1-2a84-4cac-8a3a-75f334eaf94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:47.256059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8117d1-2a84-4cac-8a3a-75f334eaf94e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:47.256351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8117d1-2a84-4cac-8a3a-75f334eaf94e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:47.256634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8117d1-2a84-4cac-8a3a-75f334eaf94e admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:47.257437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8117d1-2a84-4cac-8a3a-75f334eaf94e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:20:47.257835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8117d1-2a84-4cac-8a3a-75f334eaf94e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:47.260138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8117d1-2a84-4cac-8a3a-75f334eaf94e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:47.287076 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1209/2426] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:20:47.291356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c797439-ad68-45a6-a77f-cbcf8fdd8283 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:47.309959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c797439-ad68-45a6-a77f-cbcf8fdd8283 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:47.314869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81d567-2ff8-4e2e-8e1a-c6a506e23cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:47.315739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81d567-2ff8-4e2e-8e1a-c6a506e23cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:47.316183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81d567-2ff8-4e2e-8e1a-c6a506e23cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:47.317481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81d567-2ff8-4e2e-8e1a-c6a506e23cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:47.318382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81d567-2ff8-4e2e-8e1a-c6a506e23cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:47.324205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81d567-2ff8-4e2e-8e1a-c6a506e23cd9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:47.389069 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1218/2427] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:47 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:47.390373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8117d1-2a84-4cac-8a3a-75f334eaf94e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:47.419679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8117d1-2a84-4cac-8a3a-75f334eaf94e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:47.557083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db50a9-059b-4f55-8e45-64451b63ded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:47.557083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db50a9-059b-4f55-8e45-64451b63ded5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:47.557083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db50a9-059b-4f55-8e45-64451b63ded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:47.557083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db50a9-059b-4f55-8e45-64451b63ded5 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:47.557562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db50a9-059b-4f55-8e45-64451b63ded5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:47.557562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db50a9-059b-4f55-8e45-64451b63ded5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:47.605312 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1210/2428] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:47 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:47.609598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81d567-2ff8-4e2e-8e1a-c6a506e23cd9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:47.620831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81d567-2ff8-4e2e-8e1a-c6a506e23cd9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:47.639229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473ff52-d9ab-48ad-8942-7f4a448987e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:47.640430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473ff52-d9ab-48ad-8942-7f4a448987e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:47.640816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473ff52-d9ab-48ad-8942-7f4a448987e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:47.644468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473ff52-d9ab-48ad-8942-7f4a448987e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:47.645316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473ff52-d9ab-48ad-8942-7f4a448987e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:47.647532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473ff52-d9ab-48ad-8942-7f4a448987e8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:47.668174 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1219/2429] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:47.671784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db50a9-059b-4f55-8e45-64451b63ded5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:47.707761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db50a9-059b-4f55-8e45-64451b63ded5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:47.725740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12432f5f-8abd-47e4-8ac3-08432a49b691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:47.726541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12432f5f-8abd-47e4-8ac3-08432a49b691 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:47.726930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12432f5f-8abd-47e4-8ac3-08432a49b691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:47.727364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12432f5f-8abd-47e4-8ac3-08432a49b691 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:47.728842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12432f5f-8abd-47e4-8ac3-08432a49b691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:47.730779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12432f5f-8abd-47e4-8ac3-08432a49b691 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:47.744741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:47.765460 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1211/2430] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:20:47.768026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473ff52-d9ab-48ad-8942-7f4a448987e8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:47.796330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473ff52-d9ab-48ad-8942-7f4a448987e8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:47.801504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5253e75-6f4c-4fb8-a610-4884e622ee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:47.804150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5253e75-6f4c-4fb8-a610-4884e622ee61 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:47.804547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5253e75-6f4c-4fb8-a610-4884e622ee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:47.804838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5253e75-6f4c-4fb8-a610-4884e622ee61 admin admin] PATH_INFO: `/v3/projects/e49bbab98b54421ea2861118b23ffcaa/users/53d18719bae54f7aae765e0d02979170/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:47.851061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5253e75-6f4c-4fb8-a610-4884e622ee61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49bbab98b54421ea2861118b23ffcaa, user_id=53d18719bae54f7aae765e0d02979170, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:47.855632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5253e75-6f4c-4fb8-a610-4884e622ee61 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:47.892391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c92228-47ac-4673-b2cc-779a63c3147a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:47.892789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c92228-47ac-4673-b2cc-779a63c3147a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:47.893166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c92228-47ac-4673-b2cc-779a63c3147a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:47.897323 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1220/2431] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:47 2022] PUT /identity/v3/projects/e49bbab98b54421ea2861118b23ffcaa/users/53d18719bae54f7aae765e0d02979170/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:47.934542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-35c92228-47ac-4673-b2cc-779a63c3147a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:47.936768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-35c92228-47ac-4673-b2cc-779a63c3147a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:48.133525 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1212/2432] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:48.178438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5253e75-6f4c-4fb8-a610-4884e622ee61 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:48.180441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5253e75-6f4c-4fb8-a610-4884e622ee61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:48.313607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5253e75-6f4c-4fb8-a610-4884e622ee61 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:48.331959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084bf0a-3606-44a2-aa89-46e42e9be792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:48.333296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084bf0a-3606-44a2-aa89-46e42e9be792 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:48.333679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084bf0a-3606-44a2-aa89-46e42e9be792 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:48.334025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084bf0a-3606-44a2-aa89-46e42e9be792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:48.351787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084bf0a-3606-44a2-aa89-46e42e9be792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:48.354411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084bf0a-3606-44a2-aa89-46e42e9be792 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:48.376006 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1221/2433] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:49.372335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c92228-47ac-4673-b2cc-779a63c3147a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:49.374520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-35c92228-47ac-4673-b2cc-779a63c3147a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:49.399469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddabc72-656e-4309-aafd-7fa93f9c3d31 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:49.400567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddabc72-656e-4309-aafd-7fa93f9c3d31 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:49.400989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddabc72-656e-4309-aafd-7fa93f9c3d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:49.425766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c92228-47ac-4673-b2cc-779a63c3147a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:49.444571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe6a5a-b1a9-4857-be5f-3a544240783c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:49.445456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6a5a-b1a9-4857-be5f-3a544240783c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:49.445895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6a5a-b1a9-4857-be5f-3a544240783c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:49.446320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6a5a-b1a9-4857-be5f-3a544240783c admin admin] PATH_INFO: `/v3/projects/7867530504b94692bb110f136cddcbd9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:49.447852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe6a5a-b1a9-4857-be5f-3a544240783c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7867530504b94692bb110f136cddcbd9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:49.450031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe6a5a-b1a9-4857-be5f-3a544240783c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:49.476324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:49.488805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5ddabc72-656e-4309-aafd-7fa93f9c3d31 None None] MFA Rules not processed for user `c83fd67cc593459b9b52bbe50080680d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:49.492964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ddabc72-656e-4309-aafd-7fa93f9c3d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:49.580761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8bbe6a5a-b1a9-4857-be5f-3a544240783c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7867530504b94692bb110f136cddcbd9', 'request_id': 'req-8bbe6a5a-b1a9-4857-be5f-3a544240783c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:49.595603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8bbe6a5a-b1a9-4857-be5f-3a544240783c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7867530504b94692bb110f136cddcbd9', 'request_id': 'req-8bbe6a5a-b1a9-4857-be5f-3a544240783c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:49.612744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8bbe6a5a-b1a9-4857-be5f-3a544240783c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7867530504b94692bb110f136cddcbd9', 'request_id': 'req-8bbe6a5a-b1a9-4857-be5f-3a544240783c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:49.634037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8bbe6a5a-b1a9-4857-be5f-3a544240783c admin admin] The token cache is being invalidate because project 7867530504b94692bb110f136cddcbd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:49.634328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8bbe6a5a-b1a9-4857-be5f-3a544240783c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:49.635678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8bbe6a5a-b1a9-4857-be5f-3a544240783c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:49.645032 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1213/2434] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:49 2022] DELETE /identity/v3/projects/7867530504b94692bb110f136cddcbd9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:49.646501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da542489-d96f-4a25-a4eb-dd07161d2c88 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:49.646788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da542489-d96f-4a25-a4eb-dd07161d2c88 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:49.647062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da542489-d96f-4a25-a4eb-dd07161d2c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:49.693034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-da542489-d96f-4a25-a4eb-dd07161d2c88 None None] MFA Rules not processed for user `2af1c9ed95b84cff82c1abb4416aff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:49.694559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-da542489-d96f-4a25-a4eb-dd07161d2c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:49.716579 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1222/2435] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:49.718499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddabc72-656e-4309-aafd-7fa93f9c3d31 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:49.723670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ddabc72-656e-4309-aafd-7fa93f9c3d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:49.763916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddabc72-656e-4309-aafd-7fa93f9c3d31 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:49.873477 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1214/2436] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:49 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:49.875400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93dffa-d4c3-4bec-aeab-3d9c03b8cfaf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:49.875832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93dffa-d4c3-4bec-aeab-3d9c03b8cfaf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:49.876272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93dffa-d4c3-4bec-aeab-3d9c03b8cfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:49.920326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dd93dffa-d4c3-4bec-aeab-3d9c03b8cfaf None None] MFA Rules not processed for user `a3f83d2a0be442cb83593a030e92c752`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:49.921564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dd93dffa-d4c3-4bec-aeab-3d9c03b8cfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:49.973536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf000487-ffb8-4454-b9b6-406b23001f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:49.977234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000487-ffb8-4454-b9b6-406b23001f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:49.977526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000487-ffb8-4454-b9b6-406b23001f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:49.979262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:49.980337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000487-ffb8-4454-b9b6-406b23001f35 admin admin] PATH_INFO: `/v3/users/0eff06ccdf1f434eb704161fc2bbdb9f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:49.985401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf000487-ffb8-4454-b9b6-406b23001f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eff06ccdf1f434eb704161fc2bbdb9f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:49.991878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf000487-ffb8-4454-b9b6-406b23001f35 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:50.078211 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1215/2437] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:50.124847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf000487-ffb8-4454-b9b6-406b23001f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eff06ccdf1f434eb704161fc2bbdb9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:50.132175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf000487-ffb8-4454-b9b6-406b23001f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eff06ccdf1f434eb704161fc2bbdb9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:50.149450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf000487-ffb8-4454-b9b6-406b23001f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eff06ccdf1f434eb704161fc2bbdb9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:50.172582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf000487-ffb8-4454-b9b6-406b23001f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eff06ccdf1f434eb704161fc2bbdb9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:50.202572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf000487-ffb8-4454-b9b6-406b23001f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eff06ccdf1f434eb704161fc2bbdb9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:50.223902 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1223/2438] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:20:49 2022] DELETE /identity/v3/users/0eff06ccdf1f434eb704161fc2bbdb9f => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:51.818216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fceb6-b516-4469-97b6-0c42716d7bf4 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:51.818750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fceb6-b516-4469-97b6-0c42716d7bf4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:51.818750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fceb6-b516-4469-97b6-0c42716d7bf4 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:51.820523 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1216/2439] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:20:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:20:51.839109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42583235-0bcb-4d0b-81f9-09596e640f95 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:51.840076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42583235-0bcb-4d0b-81f9-09596e640f95 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:51.840523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42583235-0bcb-4d0b-81f9-09596e640f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:51.896457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-42583235-0bcb-4d0b-81f9-09596e640f95 None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:51.899814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-42583235-0bcb-4d0b-81f9-09596e640f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:52.005584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:52.098778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fceb6-b516-4469-97b6-0c42716d7bf4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:52.101695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b52fceb6-b516-4469-97b6-0c42716d7bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:52.144724 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1224/2440] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:20:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:52.146485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42583235-0bcb-4d0b-81f9-09596e640f95 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:52.156723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-42583235-0bcb-4d0b-81f9-09596e640f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:52.466248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fceb6-b516-4469-97b6-0c42716d7bf4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:52.476361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7f30a-b62d-4a71-acd2-09b1240f1049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:52.481438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f30a-b62d-4a71-acd2-09b1240f1049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:52.481886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f30a-b62d-4a71-acd2-09b1240f1049 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:52.482167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f30a-b62d-4a71-acd2-09b1240f1049 admin admin] PATH_INFO: `/v3/projects/8a343249aad04144a422d23597fb76c4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:52.483542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7f30a-b62d-4a71-acd2-09b1240f1049 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a343249aad04144a422d23597fb76c4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:52.485809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7f30a-b62d-4a71-acd2-09b1240f1049 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:52.515851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42583235-0bcb-4d0b-81f9-09596e640f95 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:52.549712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a129824-f473-4840-92cc-6e73392eb778 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:52.550910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a129824-f473-4840-92cc-6e73392eb778 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:52.551531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a129824-f473-4840-92cc-6e73392eb778 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:52.552186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a129824-f473-4840-92cc-6e73392eb778 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:52.555585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a129824-f473-4840-92cc-6e73392eb778 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:52.617023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62c7f30a-b62d-4a71-acd2-09b1240f1049 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a343249aad04144a422d23597fb76c4', 'request_id': 'req-62c7f30a-b62d-4a71-acd2-09b1240f1049'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:52.634076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62c7f30a-b62d-4a71-acd2-09b1240f1049 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a343249aad04144a422d23597fb76c4', 'request_id': 'req-62c7f30a-b62d-4a71-acd2-09b1240f1049'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:52.651086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62c7f30a-b62d-4a71-acd2-09b1240f1049 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a343249aad04144a422d23597fb76c4', 'request_id': 'req-62c7f30a-b62d-4a71-acd2-09b1240f1049'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:52.679999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62c7f30a-b62d-4a71-acd2-09b1240f1049 admin admin] The token cache is being invalidate because project 8a343249aad04144a422d23597fb76c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:20:52.680373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62c7f30a-b62d-4a71-acd2-09b1240f1049 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:52.684229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62c7f30a-b62d-4a71-acd2-09b1240f1049 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:20:52.687087 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1217/2441] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:20:52 2022] DELETE /identity/v3/projects/8a343249aad04144a422d23597fb76c4 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:52.689047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7f30a-b62d-4a71-acd2-09b1240f1049 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:52.690615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-62c7f30a-b62d-4a71-acd2-09b1240f1049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:52.766584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a129824-f473-4840-92cc-6e73392eb778 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:52.771044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a129824-f473-4840-92cc-6e73392eb778 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:52.810854 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1225/2442] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:52.811237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7f30a-b62d-4a71-acd2-09b1240f1049 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:52.834222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9148d62-b52a-46cb-bed2-c5e866666a22 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:52.845684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9148d62-b52a-46cb-bed2-c5e866666a22 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:52.846448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a186b-1ae1-4495-be6f-1438506e6c80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:52.846807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a186b-1ae1-4495-be6f-1438506e6c80 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:52.846944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a186b-1ae1-4495-be6f-1438506e6c80 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:52.847222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a186b-1ae1-4495-be6f-1438506e6c80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:52.847719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9148d62-b52a-46cb-bed2-c5e866666a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:52.849420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-174a186b-1ae1-4495-be6f-1438506e6c80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:52.875382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a186b-1ae1-4495-be6f-1438506e6c80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:52.878100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a186b-1ae1-4495-be6f-1438506e6c80 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:52.901522 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1218/2443] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:52.916857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d150c58-17cb-4624-b916-2bbec195c4a0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:52.916857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d150c58-17cb-4624-b916-2bbec195c4a0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:52.916857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d150c58-17cb-4624-b916-2bbec195c4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:52.936024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c9148d62-b52a-46cb-bed2-c5e866666a22 None None] MFA Rules not processed for user `69c85b658b4d499fb6405b2e352358d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:52.942934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c9148d62-b52a-46cb-bed2-c5e866666a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:52.970145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:52.989884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9d150c58-17cb-4624-b916-2bbec195c4a0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:52.995410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9d150c58-17cb-4624-b916-2bbec195c4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:53.162897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:53.194951 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1226/2444] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:53.201158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9148d62-b52a-46cb-bed2-c5e866666a22 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:53.202966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c9148d62-b52a-46cb-bed2-c5e866666a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:53.215805 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1219/2445] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:53.233818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b2b00-df72-4714-a9ca-c62e98947d05 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:53.234360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b2b00-df72-4714-a9ca-c62e98947d05 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:53.235322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b2b00-df72-4714-a9ca-c62e98947d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:53.261830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9148d62-b52a-46cb-bed2-c5e866666a22 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:53.279601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92700ea5-5bce-44a0-bb69-675e9dbfe494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:53.280137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92700ea5-5bce-44a0-bb69-675e9dbfe494 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:53.280415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92700ea5-5bce-44a0-bb69-675e9dbfe494 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:53.280693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92700ea5-5bce-44a0-bb69-675e9dbfe494 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:53.281332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92700ea5-5bce-44a0-bb69-675e9dbfe494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:53.282663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2d5b2b00-df72-4714-a9ca-c62e98947d05 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:53.283326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92700ea5-5bce-44a0-bb69-675e9dbfe494 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:53.288679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2d5b2b00-df72-4714-a9ca-c62e98947d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:53.343975 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1220/2446] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:53.355924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b2b00-df72-4714-a9ca-c62e98947d05 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:53.357385 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1227/2447] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:53 2022] POST /identity/v3/projects => generated 395 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:53.365103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92700ea5-5bce-44a0-bb69-675e9dbfe494 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:53.394142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b2b00-df72-4714-a9ca-c62e98947d05 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:53.547917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92700ea5-5bce-44a0-bb69-675e9dbfe494 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:53.564484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb72f24-c23c-4f77-a991-cb525e1c06f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:53.565095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb72f24-c23c-4f77-a991-cb525e1c06f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:53.565371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb72f24-c23c-4f77-a991-cb525e1c06f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:53.565643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb72f24-c23c-4f77-a991-cb525e1c06f0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:53.566284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb72f24-c23c-4f77-a991-cb525e1c06f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:53.576147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb72f24-c23c-4f77-a991-cb525e1c06f0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:53.608806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452bc09-6f90-4ef4-9cc3-46c061250cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:53.609434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452bc09-6f90-4ef4-9cc3-46c061250cfd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:53.609712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452bc09-6f90-4ef4-9cc3-46c061250cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:53.609985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452bc09-6f90-4ef4-9cc3-46c061250cfd admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:53.610685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452bc09-6f90-4ef4-9cc3-46c061250cfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:20:53.610959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452bc09-6f90-4ef4-9cc3-46c061250cfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:53.612639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452bc09-6f90-4ef4-9cc3-46c061250cfd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:53.639602 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1228/2448] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:53 2022] POST /identity/v3/users => generated 304 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:20:53.641829 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1221/2449] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:20:53.647736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452bc09-6f90-4ef4-9cc3-46c061250cfd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:53.648767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb72f24-c23c-4f77-a991-cb525e1c06f0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:53.667229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452bc09-6f90-4ef4-9cc3-46c061250cfd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:53.671642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb72f24-c23c-4f77-a991-cb525e1c06f0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:53.686015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f4d32-37d0-46e3-b0c8-6fefb78bf472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:53.686762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f4d32-37d0-46e3-b0c8-6fefb78bf472 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:53.687033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f4d32-37d0-46e3-b0c8-6fefb78bf472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:53.687334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f4d32-37d0-46e3-b0c8-6fefb78bf472 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:53.687838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7038d9-e7a5-43c4-b7d5-7955813f7891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:53.688050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f4d32-37d0-46e3-b0c8-6fefb78bf472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:53.689819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7038d9-e7a5-43c4-b7d5-7955813f7891 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:53.690736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7038d9-e7a5-43c4-b7d5-7955813f7891 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:53.691991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7038d9-e7a5-43c4-b7d5-7955813f7891 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:53.692977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7038d9-e7a5-43c4-b7d5-7955813f7891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:53.694888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f4d32-37d0-46e3-b0c8-6fefb78bf472 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:53.695333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7038d9-e7a5-43c4-b7d5-7955813f7891 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:53.713933 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1222/2450] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:53.715052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7038d9-e7a5-43c4-b7d5-7955813f7891 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:53.726821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7038d9-e7a5-43c4-b7d5-7955813f7891 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:53.733273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c6ffc-96a7-49b7-bbab-9bf88234e240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:53.734250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6ffc-96a7-49b7-bbab-9bf88234e240 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:53.734651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6ffc-96a7-49b7-bbab-9bf88234e240 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:53.735024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6ffc-96a7-49b7-bbab-9bf88234e240 admin admin] PATH_INFO: `/v3/projects/135af64ec82d4f7db186184a301151f3/users/23ceef31a71c41688c1a70446b7f8006/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:53.762117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c6ffc-96a7-49b7-bbab-9bf88234e240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=135af64ec82d4f7db186184a301151f3, user_id=23ceef31a71c41688c1a70446b7f8006, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:53.765518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c6ffc-96a7-49b7-bbab-9bf88234e240 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:53.765821 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1229/2451] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:53 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:53.772094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f4d32-37d0-46e3-b0c8-6fefb78bf472 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:53.796113 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1223/2452] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:53 2022] PUT /identity/v3/projects/135af64ec82d4f7db186184a301151f3/users/23ceef31a71c41688c1a70446b7f8006/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:53.802835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c6ffc-96a7-49b7-bbab-9bf88234e240 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:53.950470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c6ffc-96a7-49b7-bbab-9bf88234e240 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:53.963199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fea17-f7c1-4144-8127-76eca91e80c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:53.963871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fea17-f7c1-4144-8127-76eca91e80c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:53.964473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fea17-f7c1-4144-8127-76eca91e80c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:53.964473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fea17-f7c1-4144-8127-76eca91e80c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:53.965064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fea17-f7c1-4144-8127-76eca91e80c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:53.966723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fea17-f7c1-4144-8127-76eca91e80c4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:53.968315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:53.973813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f4d32-37d0-46e3-b0c8-6fefb78bf472 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:53.990409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6481682-c290-4968-8ef7-c841525de0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:53.991061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6481682-c290-4968-8ef7-c841525de0a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:53.991370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6481682-c290-4968-8ef7-c841525de0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:53.991646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6481682-c290-4968-8ef7-c841525de0a7 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:53.992297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6481682-c290-4968-8ef7-c841525de0a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:53.994265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6481682-c290-4968-8ef7-c841525de0a7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:53.998363 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1224/2453] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:53.999206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fea17-f7c1-4144-8127-76eca91e80c4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:54.013018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fea17-f7c1-4144-8127-76eca91e80c4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:54.057779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda3781-c1bc-459c-89b3-a7f7d6b2c98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:54.058705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda3781-c1bc-459c-89b3-a7f7d6b2c98a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:54.058988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda3781-c1bc-459c-89b3-a7f7d6b2c98a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:54.059282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda3781-c1bc-459c-89b3-a7f7d6b2c98a admin admin] PATH_INFO: `/v3/projects/135af64ec82d4f7db186184a301151f3/users/23ceef31a71c41688c1a70446b7f8006/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:54.065964 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1230/2454] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:53 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:54.066946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6481682-c290-4968-8ef7-c841525de0a7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:54.070593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda3781-c1bc-459c-89b3-a7f7d6b2c98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=135af64ec82d4f7db186184a301151f3, user_id=23ceef31a71c41688c1a70446b7f8006, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:54.073584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda3781-c1bc-459c-89b3-a7f7d6b2c98a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:54.106637 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1225/2455] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:53 2022] PUT /identity/v3/projects/135af64ec82d4f7db186184a301151f3/users/23ceef31a71c41688c1a70446b7f8006/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:20:54.114109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6481682-c290-4968-8ef7-c841525de0a7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:54.249704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:54.265009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa57e1f-10e6-4069-90d4-d595e5bdff7b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:54.265136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa57e1f-10e6-4069-90d4-d595e5bdff7b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:54.265311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa57e1f-10e6-4069-90d4-d595e5bdff7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:54.329900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7aa57e1f-10e6-4069-90d4-d595e5bdff7b None None] MFA Rules not processed for user `8ca76a8457cb47189ebdd0c8c12974c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:54.331364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7aa57e1f-10e6-4069-90d4-d595e5bdff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:54.385623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba611d10-feb1-4628-b32a-ec8bb8b8903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:54.386452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba611d10-feb1-4628-b32a-ec8bb8b8903a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:54.386703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba611d10-feb1-4628-b32a-ec8bb8b8903a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:54.386803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba611d10-feb1-4628-b32a-ec8bb8b8903a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:54.387480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba611d10-feb1-4628-b32a-ec8bb8b8903a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:54.389205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba611d10-feb1-4628-b32a-ec8bb8b8903a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:54.419618 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1231/2456] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:54.423125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c033538-bda4-44ba-af02-62d70bd9b8a4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:54.423546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c033538-bda4-44ba-af02-62d70bd9b8a4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:54.423877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c033538-bda4-44ba-af02-62d70bd9b8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:54.477984 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1226/2457] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:54.479960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa57e1f-10e6-4069-90d4-d595e5bdff7b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:54.490881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5c033538-bda4-44ba-af02-62d70bd9b8a4 None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:54.491502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5c033538-bda4-44ba-af02-62d70bd9b8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:54.514427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa57e1f-10e6-4069-90d4-d595e5bdff7b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:54.522008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465859d-a525-40ba-a09d-faf127e4a8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:54.523146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465859d-a525-40ba-a09d-faf127e4a8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:54.523889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465859d-a525-40ba-a09d-faf127e4a8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:54.524397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465859d-a525-40ba-a09d-faf127e4a8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:54.525886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465859d-a525-40ba-a09d-faf127e4a8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:54.528572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465859d-a525-40ba-a09d-faf127e4a8c6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:54.543792 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1227/2458] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:54.545608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465859d-a525-40ba-a09d-faf127e4a8c6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:54.548950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e465859d-a525-40ba-a09d-faf127e4a8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:54.592011 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1232/2459] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:20:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:54.593271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c033538-bda4-44ba-af02-62d70bd9b8a4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:54.615998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c033538-bda4-44ba-af02-62d70bd9b8a4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:54.623733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cc842-3e8d-460e-8c3f-a2c57335df30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:54.624266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cc842-3e8d-460e-8c3f-a2c57335df30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:54.624548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cc842-3e8d-460e-8c3f-a2c57335df30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:54.624829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cc842-3e8d-460e-8c3f-a2c57335df30 admin admin] PATH_INFO: `/v3/projects/02b2569b5d894098a095cae74c2f9a2d/users/7fa2ccce773c48e79f4e207debd5b4f1/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:54.646855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cc842-3e8d-460e-8c3f-a2c57335df30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b2569b5d894098a095cae74c2f9a2d, user_id=7fa2ccce773c48e79f4e207debd5b4f1, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:54.652279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cc842-3e8d-460e-8c3f-a2c57335df30 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:54.653176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465859d-a525-40ba-a09d-faf127e4a8c6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:54.657807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe14e3-12d4-4e97-9577-f042c3eacced service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:54.658388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe14e3-12d4-4e97-9577-f042c3eacced service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:54.658699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe14e3-12d4-4e97-9577-f042c3eacced service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:54.659010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe14e3-12d4-4e97-9577-f042c3eacced service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:54.670875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe14e3-12d4-4e97-9577-f042c3eacced service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:54.672421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe14e3-12d4-4e97-9577-f042c3eacced service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:54.683459 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1233/2460] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:54 2022] PUT /identity/v3/projects/02b2569b5d894098a095cae74c2f9a2d/users/7fa2ccce773c48e79f4e207debd5b4f1/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:54.684511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cc842-3e8d-460e-8c3f-a2c57335df30 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:54.685009 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1228/2461] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:54.704329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff8004-7416-4b54-a7d0-4aa65f9ee6d5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:54.705449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff8004-7416-4b54-a7d0-4aa65f9ee6d5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:54.705880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff8004-7416-4b54-a7d0-4aa65f9ee6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:54.760455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cc842-3e8d-460e-8c3f-a2c57335df30 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:54.765928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc6d4c-2314-44e3-ba0d-28053fb4e922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:54.766821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc6d4c-2314-44e3-ba0d-28053fb4e922 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:54.767586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc6d4c-2314-44e3-ba0d-28053fb4e922 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:54.767971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc6d4c-2314-44e3-ba0d-28053fb4e922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:54.770005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-79ff8004-7416-4b54-a7d0-4aa65f9ee6d5 None None] MFA Rules not processed for user `7fa2ccce773c48e79f4e207debd5b4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:54.772482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-79ff8004-7416-4b54-a7d0-4aa65f9ee6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:54.796001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc6d4c-2314-44e3-ba0d-28053fb4e922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:54.798603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc6d4c-2314-44e3-ba0d-28053fb4e922 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:54.813709 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1234/2462] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:20:54.892725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:54.952907 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1229/2463] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:54.958520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc6d4c-2314-44e3-ba0d-28053fb4e922 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:55.065187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:55.092523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc6d4c-2314-44e3-ba0d-28053fb4e922 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:55.103243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660dbe2-8246-4bdd-bf0d-fd585cc457a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:55.103689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660dbe2-8246-4bdd-bf0d-fd585cc457a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:55.104019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660dbe2-8246-4bdd-bf0d-fd585cc457a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:55.104401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660dbe2-8246-4bdd-bf0d-fd585cc457a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:55.105291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660dbe2-8246-4bdd-bf0d-fd585cc457a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:55.107770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660dbe2-8246-4bdd-bf0d-fd585cc457a3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:55.188723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff8004-7416-4b54-a7d0-4aa65f9ee6d5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:55.212992 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1235/2464] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:20:54 2022] POST /identity/v3/projects => generated 387 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:55.236162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff8004-7416-4b54-a7d0-4aa65f9ee6d5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:55.343478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfe16c-5324-49ed-b6ad-6c1614e2e5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:55.345919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfe16c-5324-49ed-b6ad-6c1614e2e5ad admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:55.345919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfe16c-5324-49ed-b6ad-6c1614e2e5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:55.345919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfe16c-5324-49ed-b6ad-6c1614e2e5ad admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:55.353869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfe16c-5324-49ed-b6ad-6c1614e2e5ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:55.365690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfe16c-5324-49ed-b6ad-6c1614e2e5ad admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:55.412541 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1230/2465] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:20:55 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:20:55.413954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660dbe2-8246-4bdd-bf0d-fd585cc457a3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:55.443443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660dbe2-8246-4bdd-bf0d-fd585cc457a3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:55.467542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6b569-b790-4e23-95d7-c19007412426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:55.477213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6b569-b790-4e23-95d7-c19007412426 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:55.477694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6b569-b790-4e23-95d7-c19007412426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:55.477973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6b569-b790-4e23-95d7-c19007412426 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:55.480298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6b569-b790-4e23-95d7-c19007412426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:55.492556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6b569-b790-4e23-95d7-c19007412426 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:55.519887 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1236/2466] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:20:55.521492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfe16c-5324-49ed-b6ad-6c1614e2e5ad admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:55.549929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfe16c-5324-49ed-b6ad-6c1614e2e5ad admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:55.585280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d122249-024a-442d-9b8e-7fb06c8a2674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:55.591577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d122249-024a-442d-9b8e-7fb06c8a2674 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:55.592045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d122249-024a-442d-9b8e-7fb06c8a2674 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:55.596278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d122249-024a-442d-9b8e-7fb06c8a2674 admin admin] PATH_INFO: `/v3/projects/39f5ed62bc2e461aa7be4e7fab221c3b/users/91f8fee1f0d8454289aa5949ae7f50ea/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:55.635813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d122249-024a-442d-9b8e-7fb06c8a2674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f5ed62bc2e461aa7be4e7fab221c3b, user_id=91f8fee1f0d8454289aa5949ae7f50ea, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:55.644488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d122249-024a-442d-9b8e-7fb06c8a2674 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:55.688941 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1231/2467] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:55 2022] PUT /identity/v3/projects/39f5ed62bc2e461aa7be4e7fab221c3b/users/91f8fee1f0d8454289aa5949ae7f50ea/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:55.690210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6b569-b790-4e23-95d7-c19007412426 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:55.710314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6b569-b790-4e23-95d7-c19007412426 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:55.979116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650db14d-d28d-4ef4-8293-21f9b6c92695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:55.980281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650db14d-d28d-4ef4-8293-21f9b6c92695 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:55.980598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650db14d-d28d-4ef4-8293-21f9b6c92695 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:55.980896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650db14d-d28d-4ef4-8293-21f9b6c92695 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:55.981566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650db14d-d28d-4ef4-8293-21f9b6c92695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:55.996111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650db14d-d28d-4ef4-8293-21f9b6c92695 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:56.045679 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1237/2468] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:20:56.047173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d122249-024a-442d-9b8e-7fb06c8a2674 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:56.067040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d122249-024a-442d-9b8e-7fb06c8a2674 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:56.092382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07026817-b240-41e7-9015-5f0ce118a4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:56.094684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07026817-b240-41e7-9015-5f0ce118a4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:56.095038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07026817-b240-41e7-9015-5f0ce118a4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:56.095454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07026817-b240-41e7-9015-5f0ce118a4eb admin admin] PATH_INFO: `/v3/projects/39f5ed62bc2e461aa7be4e7fab221c3b/users/91f8fee1f0d8454289aa5949ae7f50ea/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:56.108842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07026817-b240-41e7-9015-5f0ce118a4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f5ed62bc2e461aa7be4e7fab221c3b, user_id=91f8fee1f0d8454289aa5949ae7f50ea, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:56.116253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07026817-b240-41e7-9015-5f0ce118a4eb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:56.170104 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1232/2469] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:20:56 2022] PUT /identity/v3/projects/39f5ed62bc2e461aa7be4e7fab221c3b/users/91f8fee1f0d8454289aa5949ae7f50ea/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:20:56.172232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a917b3-8f15-408c-9b83-26bbc554f154 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:56.173119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a917b3-8f15-408c-9b83-26bbc554f154 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:56.173559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a917b3-8f15-408c-9b83-26bbc554f154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:56.236679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d6a917b3-8f15-408c-9b83-26bbc554f154 None None] MFA Rules not processed for user `91f8fee1f0d8454289aa5949ae7f50ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:56.246212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6a917b3-8f15-408c-9b83-26bbc554f154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:56.418545 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1238/2470] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:20:56.421554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e728f-aa1c-4d45-a785-f7f1f572fe41 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:56.421842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e728f-aa1c-4d45-a785-f7f1f572fe41 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:56.422519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e728f-aa1c-4d45-a785-f7f1f572fe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:56.453871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bd7e728f-aa1c-4d45-a785-f7f1f572fe41 None None] MFA Rules not processed for user `7fa2ccce773c48e79f4e207debd5b4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:20:56.455552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bd7e728f-aa1c-4d45-a785-f7f1f572fe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:56.688931 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1233/2471] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:20:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:20:58.212752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a917b3-8f15-408c-9b83-26bbc554f154 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:20:58.232720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6a917b3-8f15-408c-9b83-26bbc554f154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:20:58.424601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:20:58.584912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a917b3-8f15-408c-9b83-26bbc554f154 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:20:58.613015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8864d4a-0136-48b2-a21b-9058195b2c99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:20:58.615388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8864d4a-0136-48b2-a21b-9058195b2c99 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:20:58.616104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8864d4a-0136-48b2-a21b-9058195b2c99 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:20:58.621626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8864d4a-0136-48b2-a21b-9058195b2c99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:20:58.693428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8864d4a-0136-48b2-a21b-9058195b2c99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:20:58.700663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8864d4a-0136-48b2-a21b-9058195b2c99 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:20:58.735533 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1239/2472] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:20:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:21:06.656566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=74,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:08.275524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6d07a-f7e1-463c-9d3b-5ea1e046fbb2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:08.276718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6d07a-f7e1-463c-9d3b-5ea1e046fbb2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:08.277153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6d07a-f7e1-463c-9d3b-5ea1e046fbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:08.324089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-39c6d07a-f7e1-463c-9d3b-5ea1e046fbb2 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:08.325610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-39c6d07a-f7e1-463c-9d3b-5ea1e046fbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:08.416178 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1234/2473] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:21:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:08.496273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8864d4a-0136-48b2-a21b-9058195b2c99 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:08.498616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b8864d4a-0136-48b2-a21b-9058195b2c99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:08.667519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8864d4a-0136-48b2-a21b-9058195b2c99 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:08.681084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631e103-0d1f-4a6a-b067-b141e40ca3f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:08.683561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631e103-0d1f-4a6a-b067-b141e40ca3f0 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:08.683858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631e103-0d1f-4a6a-b067-b141e40ca3f0 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:08.684138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631e103-0d1f-4a6a-b067-b141e40ca3f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:08.706118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631e103-0d1f-4a6a-b067-b141e40ca3f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:08.708368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631e103-0d1f-4a6a-b067-b141e40ca3f0 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:08.734786 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1240/2474] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:21:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:21:14.680883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128114a-654f-4267-94c6-cab10403b776 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:14.681794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128114a-654f-4267-94c6-cab10403b776 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:14.682600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128114a-654f-4267-94c6-cab10403b776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:14.757186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9128114a-654f-4267-94c6-cab10403b776 None None] MFA Rules not processed for user `23ceef31a71c41688c1a70446b7f8006`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:14.758939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9128114a-654f-4267-94c6-cab10403b776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:14.911290 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1235/2475] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:14 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:14.913035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8276136-9c78-4fb2-b448-e3bd8036690e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:14.913622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8276136-9c78-4fb2-b448-e3bd8036690e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:14.913622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8276136-9c78-4fb2-b448-e3bd8036690e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:14.961050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b8276136-9c78-4fb2-b448-e3bd8036690e None None] MFA Rules not processed for user `69c85b658b4d499fb6405b2e352358d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:14.962314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b8276136-9c78-4fb2-b448-e3bd8036690e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:15.073696 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1241/2476] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:16.054765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ca144-cb4c-42c8-bb72-6aad52129c76 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:16.055214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ca144-cb4c-42c8-bb72-6aad52129c76 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:16.055445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ca144-cb4c-42c8-bb72-6aad52129c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:16.132860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8276136-9c78-4fb2-b448-e3bd8036690e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:16.155274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-156ca144-cb4c-42c8-bb72-6aad52129c76 None None] MFA Rules not processed for user `53d18719bae54f7aae765e0d02979170`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:16.155919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8276136-9c78-4fb2-b448-e3bd8036690e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:16.164505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-156ca144-cb4c-42c8-bb72-6aad52129c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:16.168835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81672f04-79c0-4d19-b59f-ac51d84ec56a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:16.169516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81672f04-79c0-4d19-b59f-ac51d84ec56a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:16.169963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81672f04-79c0-4d19-b59f-ac51d84ec56a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:16.170387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81672f04-79c0-4d19-b59f-ac51d84ec56a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:16.187657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81672f04-79c0-4d19-b59f-ac51d84ec56a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:16.190909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81672f04-79c0-4d19-b59f-ac51d84ec56a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:16.232999 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1242/2477] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:16 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:21:16.404310 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1236/2478] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:16.414982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81672f04-79c0-4d19-b59f-ac51d84ec56a service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:16.416538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-81672f04-79c0-4d19-b59f-ac51d84ec56a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:16.520487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81672f04-79c0-4d19-b59f-ac51d84ec56a service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:16.525007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d107df2-f902-4c4f-959b-9c7b56bbf2f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:16.526217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d107df2-f902-4c4f-959b-9c7b56bbf2f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:16.526498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d107df2-f902-4c4f-959b-9c7b56bbf2f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:16.526771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d107df2-f902-4c4f-959b-9c7b56bbf2f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:16.539224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d107df2-f902-4c4f-959b-9c7b56bbf2f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:16.542303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d107df2-f902-4c4f-959b-9c7b56bbf2f8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:16.547386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:16.586670 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1243/2479] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:21:19.817177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e78b0d-176d-4386-bef2-8f0926e5f0cb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:19.817662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e78b0d-176d-4386-bef2-8f0926e5f0cb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:19.817775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e78b0d-176d-4386-bef2-8f0926e5f0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:19.859913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e9e78b0d-176d-4386-bef2-8f0926e5f0cb None None] MFA Rules not processed for user `53d18719bae54f7aae765e0d02979170`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:19.861249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e9e78b0d-176d-4386-bef2-8f0926e5f0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:19.889221 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1237/2480] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:26.555277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:27.696655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d107df2-f902-4c4f-959b-9c7b56bbf2f8 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:27.698250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d107df2-f902-4c4f-959b-9c7b56bbf2f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:27.750187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d107df2-f902-4c4f-959b-9c7b56bbf2f8 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:27.769966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4aead-b850-4e17-ad8f-9aed89b27d23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:27.770596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4aead-b850-4e17-ad8f-9aed89b27d23 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:27.770874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4aead-b850-4e17-ad8f-9aed89b27d23 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:27.771145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4aead-b850-4e17-ad8f-9aed89b27d23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:27.779426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e5f4aead-b850-4e17-ad8f-9aed89b27d23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:28.018122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4aead-b850-4e17-ad8f-9aed89b27d23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:28.023483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4aead-b850-4e17-ad8f-9aed89b27d23 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:28.072966 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1244/2481] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:21:29.025398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e78b0d-176d-4386-bef2-8f0926e5f0cb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:29.026586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e9e78b0d-176d-4386-bef2-8f0926e5f0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:29.051579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:29.202704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e78b0d-176d-4386-bef2-8f0926e5f0cb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:29.210805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd7a5e-13e0-4a2d-950b-f6db2f4156b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:29.211488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd7a5e-13e0-4a2d-950b-f6db2f4156b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:29.214387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd7a5e-13e0-4a2d-950b-f6db2f4156b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:29.214663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd7a5e-13e0-4a2d-950b-f6db2f4156b6 admin admin] PATH_INFO: `/v3/users/76a98d75a6aa47f3ae3dff33d42f0f67` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:29.220238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd7a5e-13e0-4a2d-950b-f6db2f4156b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a98d75a6aa47f3ae3dff33d42f0f67)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:29.223026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd7a5e-13e0-4a2d-950b-f6db2f4156b6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:29.332417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ebdd7a5e-13e0-4a2d-950b-f6db2f4156b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a98d75a6aa47f3ae3dff33d42f0f67'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:29.368138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ebdd7a5e-13e0-4a2d-950b-f6db2f4156b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a98d75a6aa47f3ae3dff33d42f0f67'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:29.369920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ebdd7a5e-13e0-4a2d-950b-f6db2f4156b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a98d75a6aa47f3ae3dff33d42f0f67'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:29.373035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ebdd7a5e-13e0-4a2d-950b-f6db2f4156b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a98d75a6aa47f3ae3dff33d42f0f67'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:29.400161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ebdd7a5e-13e0-4a2d-950b-f6db2f4156b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a98d75a6aa47f3ae3dff33d42f0f67'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:29.444692 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1238/2482] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:21:29 2022] DELETE /identity/v3/users/76a98d75a6aa47f3ae3dff33d42f0f67 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:21:29.449677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e98ba-a21b-4df7-b616-c21c74988104 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:29.451011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e98ba-a21b-4df7-b616-c21c74988104 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:29.451708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e98ba-a21b-4df7-b616-c21c74988104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:29.503636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0f8e98ba-a21b-4df7-b616-c21c74988104 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:29.505680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f8e98ba-a21b-4df7-b616-c21c74988104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:29.656153 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1245/2483] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:29.726040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd7a5e-13e0-4a2d-950b-f6db2f4156b6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:29.727965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ebdd7a5e-13e0-4a2d-950b-f6db2f4156b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:29.940708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd7a5e-13e0-4a2d-950b-f6db2f4156b6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:29.955831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f21b4-90c1-44a7-b65c-35e9fe14ef62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:29.957654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f21b4-90c1-44a7-b65c-35e9fe14ef62 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:29.958157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f21b4-90c1-44a7-b65c-35e9fe14ef62 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:29.958694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f21b4-90c1-44a7-b65c-35e9fe14ef62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:29.975930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f21b4-90c1-44a7-b65c-35e9fe14ef62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:29.977889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f21b4-90c1-44a7-b65c-35e9fe14ef62 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:29.994879 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1239/2484] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:21:30.419607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e98ba-a21b-4df7-b616-c21c74988104 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:30.424274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f8e98ba-a21b-4df7-b616-c21c74988104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:30.430687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f21b4-90c1-44a7-b65c-35e9fe14ef62 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:30.432385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-849f21b4-90c1-44a7-b65c-35e9fe14ef62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:30.457092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e98ba-a21b-4df7-b616-c21c74988104 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:30.471362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:30.472451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:30.472948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:30.473439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa admin admin] PATH_INFO: `/v3/projects/fc1abd01f4074cffbe8bb5b383ef8972` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:30.475677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc1abd01f4074cffbe8bb5b383ef8972)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:30.491741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:30.538436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:30.626448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f21b4-90c1-44a7-b65c-35e9fe14ef62 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:30.656510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1abd01f4074cffbe8bb5b383ef8972', 'request_id': 'req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:30.671936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1abd01f4074cffbe8bb5b383ef8972', 'request_id': 'req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:30.693021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1abd01f4074cffbe8bb5b383ef8972', 'request_id': 'req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:30.738523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa admin admin] The token cache is being invalidate because project fc1abd01f4074cffbe8bb5b383ef8972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:21:30.741625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:30.742645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:30.750880 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1246/2485] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:21:30 2022] DELETE /identity/v3/projects/fc1abd01f4074cffbe8bb5b383ef8972 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:21:30.755992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:30.759544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:30.805221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:30.869971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87baf71-8fdc-4736-aa7e-9c2ef556f646 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:30.870611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87baf71-8fdc-4736-aa7e-9c2ef556f646 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:30.870891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87baf71-8fdc-4736-aa7e-9c2ef556f646 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:30.871159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87baf71-8fdc-4736-aa7e-9c2ef556f646 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:30.876084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d87baf71-8fdc-4736-aa7e-9c2ef556f646 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:30.920038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87baf71-8fdc-4736-aa7e-9c2ef556f646 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:30.932268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87baf71-8fdc-4736-aa7e-9c2ef556f646 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:30.945640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94010d0d-eb54-43e4-b6aa-fbcaafccb2aa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:30.952222 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1240/2486] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:21:30.967906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b944ac8-26c4-440b-a6b1-5ed474cf5d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:30.969901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b944ac8-26c4-440b-a6b1-5ed474cf5d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:30.971439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b944ac8-26c4-440b-a6b1-5ed474cf5d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:30.971957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b944ac8-26c4-440b-a6b1-5ed474cf5d8c admin admin] PATH_INFO: `/v3/users/fe5d01ced4d84f4bb1286643b219effc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:30.981762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b944ac8-26c4-440b-a6b1-5ed474cf5d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5d01ced4d84f4bb1286643b219effc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:30.986825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b944ac8-26c4-440b-a6b1-5ed474cf5d8c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:31.235870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b944ac8-26c4-440b-a6b1-5ed474cf5d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5d01ced4d84f4bb1286643b219effc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:31.238330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b944ac8-26c4-440b-a6b1-5ed474cf5d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5d01ced4d84f4bb1286643b219effc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:31.269298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b944ac8-26c4-440b-a6b1-5ed474cf5d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5d01ced4d84f4bb1286643b219effc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:31.299697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b944ac8-26c4-440b-a6b1-5ed474cf5d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5d01ced4d84f4bb1286643b219effc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:31.338292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b944ac8-26c4-440b-a6b1-5ed474cf5d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5d01ced4d84f4bb1286643b219effc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:31.368189 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1247/2487] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:21:30 2022] DELETE /identity/v3/users/fe5d01ced4d84f4bb1286643b219effc => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:21:32.455194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfae91-7beb-4796-8407-2dd3d23e8546 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:32.455734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfae91-7beb-4796-8407-2dd3d23e8546 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:32.455863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfae91-7beb-4796-8407-2dd3d23e8546 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:32.457462 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1241/2488] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 18:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:21:32.463144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411cb40-80c5-432e-93fa-bc5612315852 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:32.463691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411cb40-80c5-432e-93fa-bc5612315852 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:32.463789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411cb40-80c5-432e-93fa-bc5612315852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:32.503592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c411cb40-80c5-432e-93fa-bc5612315852 None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:32.505660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c411cb40-80c5-432e-93fa-bc5612315852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:32.663244 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1248/2489] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 18:21:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:32.678572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfae91-7beb-4796-8407-2dd3d23e8546 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:32.681974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9abfae91-7beb-4796-8407-2dd3d23e8546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:32.883979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfae91-7beb-4796-8407-2dd3d23e8546 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:32.893485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea50fc-658d-4b03-872b-f56712ee2be2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:32.894375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea50fc-658d-4b03-872b-f56712ee2be2 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:32.894660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea50fc-658d-4b03-872b-f56712ee2be2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:32.894934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea50fc-658d-4b03-872b-f56712ee2be2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:32.921050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea50fc-658d-4b03-872b-f56712ee2be2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:32.922881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea50fc-658d-4b03-872b-f56712ee2be2 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:32.966509 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1242/2490] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:21:33.000564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6dccf-753e-41e2-9dc9-315f7a1d3a4d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:33.001036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6dccf-753e-41e2-9dc9-315f7a1d3a4d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:33.001489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6dccf-753e-41e2-9dc9-315f7a1d3a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:33.034324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea50fc-658d-4b03-872b-f56712ee2be2 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:33.036207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e7ea50fc-658d-4b03-872b-f56712ee2be2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:33.064929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f4c6dccf-753e-41e2-9dc9-315f7a1d3a4d None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:33.068826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4c6dccf-753e-41e2-9dc9-315f7a1d3a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:33.115854 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1249/2491] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 18:21:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:33.120950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6dccf-753e-41e2-9dc9-315f7a1d3a4d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:33.127442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4c6dccf-753e-41e2-9dc9-315f7a1d3a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:33.182536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6dccf-753e-41e2-9dc9-315f7a1d3a4d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:33.196022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4524e8c-2f5b-4ca2-a3d6-9cfe363515ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:33.197024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4524e8c-2f5b-4ca2-a3d6-9cfe363515ee service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:33.197485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4524e8c-2f5b-4ca2-a3d6-9cfe363515ee service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:33.197980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4524e8c-2f5b-4ca2-a3d6-9cfe363515ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:33.202453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e4524e8c-2f5b-4ca2-a3d6-9cfe363515ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:33.228932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea50fc-658d-4b03-872b-f56712ee2be2 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:33.269973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba57b0-60c7-4bbb-9128-76324b25a661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:33.270710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba57b0-60c7-4bbb-9128-76324b25a661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:33.270998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba57b0-60c7-4bbb-9128-76324b25a661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:33.271292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba57b0-60c7-4bbb-9128-76324b25a661 admin admin] PATH_INFO: `/v3/projects/c284426be5f94b219663bd1b1238b081` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:33.272605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba57b0-60c7-4bbb-9128-76324b25a661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c284426be5f94b219663bd1b1238b081)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:33.274863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba57b0-60c7-4bbb-9128-76324b25a661 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:33.281013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:33.307736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:33.428322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f0ba57b0-60c7-4bbb-9128-76324b25a661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c284426be5f94b219663bd1b1238b081', 'request_id': 'req-f0ba57b0-60c7-4bbb-9128-76324b25a661'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:33.442752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4524e8c-2f5b-4ca2-a3d6-9cfe363515ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:33.444415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4524e8c-2f5b-4ca2-a3d6-9cfe363515ee service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:33.447969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f0ba57b0-60c7-4bbb-9128-76324b25a661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c284426be5f94b219663bd1b1238b081', 'request_id': 'req-f0ba57b0-60c7-4bbb-9128-76324b25a661'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:33.467243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f0ba57b0-60c7-4bbb-9128-76324b25a661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c284426be5f94b219663bd1b1238b081', 'request_id': 'req-f0ba57b0-60c7-4bbb-9128-76324b25a661'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:33.506370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f0ba57b0-60c7-4bbb-9128-76324b25a661 admin admin] The token cache is being invalidate because project c284426be5f94b219663bd1b1238b081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:21:33.507456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f0ba57b0-60c7-4bbb-9128-76324b25a661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:33.508894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f0ba57b0-60c7-4bbb-9128-76324b25a661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:33.513082 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1243/2492] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:21:33 2022] DELETE /identity/v3/projects/c284426be5f94b219663bd1b1238b081 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:21:33.515818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba57b0-60c7-4bbb-9128-76324b25a661 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:33.521722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f0ba57b0-60c7-4bbb-9128-76324b25a661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:33.524004 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1250/2493] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:33 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:21:33.526400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f7e40-22cb-4dea-8ebd-902894dc2663 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:33.526843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f7e40-22cb-4dea-8ebd-902894dc2663 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:33.527306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f7e40-22cb-4dea-8ebd-902894dc2663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:33.558694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-232f7e40-22cb-4dea-8ebd-902894dc2663 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:33.569866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-232f7e40-22cb-4dea-8ebd-902894dc2663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:33.651774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba57b0-60c7-4bbb-9128-76324b25a661 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:33.661607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58e8a2-ada8-45c3-96f7-30fa859b987b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:33.662987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58e8a2-ada8-45c3-96f7-30fa859b987b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:33.663489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58e8a2-ada8-45c3-96f7-30fa859b987b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:33.664140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58e8a2-ada8-45c3-96f7-30fa859b987b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:33.666674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2f58e8a2-ada8-45c3-96f7-30fa859b987b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:33.686292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58e8a2-ada8-45c3-96f7-30fa859b987b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:33.688053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58e8a2-ada8-45c3-96f7-30fa859b987b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:33.697988 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1244/2494] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:21:33.709107 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1251/2495] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:33.717198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeaa39-6663-4060-bbb3-a1624130560d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:33.717482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeaa39-6663-4060-bbb3-a1624130560d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:33.717760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeaa39-6663-4060-bbb3-a1624130560d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:33.761712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1eeeaa39-6663-4060-bbb3-a1624130560d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:33.763072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1eeeaa39-6663-4060-bbb3-a1624130560d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:33.783754 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1245/2496] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:33.784549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f7e40-22cb-4dea-8ebd-902894dc2663 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:33.803577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f7e40-22cb-4dea-8ebd-902894dc2663 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:33.811479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16b9d4-279c-40bb-9a32-e0ec1427d023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:33.812377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16b9d4-279c-40bb-9a32-e0ec1427d023 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:33.812912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16b9d4-279c-40bb-9a32-e0ec1427d023 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:33.813352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16b9d4-279c-40bb-9a32-e0ec1427d023 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:33.814167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16b9d4-279c-40bb-9a32-e0ec1427d023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:21:33.814628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16b9d4-279c-40bb-9a32-e0ec1427d023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:33.816437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16b9d4-279c-40bb-9a32-e0ec1427d023 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:33.836809 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1252/2497] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:21:33.841622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeeaa39-6663-4060-bbb3-a1624130560d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:33.853284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeeaa39-6663-4060-bbb3-a1624130560d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:33.860316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d4a67-9aea-494e-828b-125c7d101867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:33.861941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d4a67-9aea-494e-828b-125c7d101867 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:33.864922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d4a67-9aea-494e-828b-125c7d101867 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:33.865553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d4a67-9aea-494e-828b-125c7d101867 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:33.866443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d4a67-9aea-494e-828b-125c7d101867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:33.869516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d4a67-9aea-494e-828b-125c7d101867 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:33.923150 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1246/2498] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:21:33 2022] POST /identity/v3/projects => generated 401 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:21:33.923549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16b9d4-279c-40bb-9a32-e0ec1427d023 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:33.945040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16b9d4-279c-40bb-9a32-e0ec1427d023 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:34.069989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf189c-00b9-4405-9595-a1e2c4d5b643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:34.071014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf189c-00b9-4405-9595-a1e2c4d5b643 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:34.071496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf189c-00b9-4405-9595-a1e2c4d5b643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:34.072464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf189c-00b9-4405-9595-a1e2c4d5b643 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:34.074345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf189c-00b9-4405-9595-a1e2c4d5b643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:34.090415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf189c-00b9-4405-9595-a1e2c4d5b643 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:34.139024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d4a67-9aea-494e-828b-125c7d101867 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:34.141799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ac6d4a67-9aea-494e-828b-125c7d101867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:34.159391 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1253/2499] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:21:33 2022] POST /identity/v3/users => generated 301 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:21:34.163683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf189c-00b9-4405-9595-a1e2c4d5b643 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:34.189518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf189c-00b9-4405-9595-a1e2c4d5b643 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:34.199538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb22c56-9d40-4cf9-9ae7-15d6576458a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:34.200147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb22c56-9d40-4cf9-9ae7-15d6576458a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:34.200431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb22c56-9d40-4cf9-9ae7-15d6576458a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:34.200709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb22c56-9d40-4cf9-9ae7-15d6576458a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:34.201390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb22c56-9d40-4cf9-9ae7-15d6576458a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:34.202967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb22c56-9d40-4cf9-9ae7-15d6576458a1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:34.243736 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1254/2500] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:21:34.244802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb22c56-9d40-4cf9-9ae7-15d6576458a1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:34.257575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb22c56-9d40-4cf9-9ae7-15d6576458a1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:34.271860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393d14f-498f-4e25-bf73-84b1db19d228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:34.272485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393d14f-498f-4e25-bf73-84b1db19d228 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:34.272759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393d14f-498f-4e25-bf73-84b1db19d228 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:34.273028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393d14f-498f-4e25-bf73-84b1db19d228 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:34.273744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393d14f-498f-4e25-bf73-84b1db19d228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:34.275294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393d14f-498f-4e25-bf73-84b1db19d228 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:34.299743 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1255/2501] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:21:34.306406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393d14f-498f-4e25-bf73-84b1db19d228 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:34.308495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d4a67-9aea-494e-828b-125c7d101867 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:34.315938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1009a7-3da6-4678-998d-069dd42fd2e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:34.317036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1009a7-3da6-4678-998d-069dd42fd2e7 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:34.317466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1009a7-3da6-4678-998d-069dd42fd2e7 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:34.317932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1009a7-3da6-4678-998d-069dd42fd2e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:34.320016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a1009a7-3da6-4678-998d-069dd42fd2e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:34.322453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393d14f-498f-4e25-bf73-84b1db19d228 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:34.337996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045cb65-2cbe-4764-9a9f-aa7e2114bd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:34.338687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045cb65-2cbe-4764-9a9f-aa7e2114bd36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:34.338960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045cb65-2cbe-4764-9a9f-aa7e2114bd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:34.339240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045cb65-2cbe-4764-9a9f-aa7e2114bd36 admin admin] PATH_INFO: `/v3/projects/28ffca59ff6f4a35ad06f6f8ea90c05e/users/cb8451f51ffe4d31b42de675488ccd08/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:34.346896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:34.363372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:34.374445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045cb65-2cbe-4764-9a9f-aa7e2114bd36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ffca59ff6f4a35ad06f6f8ea90c05e, user_id=cb8451f51ffe4d31b42de675488ccd08, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:34.381788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045cb65-2cbe-4764-9a9f-aa7e2114bd36 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:34.415385 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1256/2502] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:21:34 2022] PUT /identity/v3/projects/28ffca59ff6f4a35ad06f6f8ea90c05e/users/cb8451f51ffe4d31b42de675488ccd08/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:21:34.417786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379ca3-5f3f-4f71-9eb2-348df66bf500 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:34.418189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379ca3-5f3f-4f71-9eb2-348df66bf500 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:34.418561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379ca3-5f3f-4f71-9eb2-348df66bf500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:34.462486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1009a7-3da6-4678-998d-069dd42fd2e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:34.465025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4b379ca3-5f3f-4f71-9eb2-348df66bf500 None None] MFA Rules not processed for user `cb8451f51ffe4d31b42de675488ccd08`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:34.465864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1009a7-3da6-4678-998d-069dd42fd2e7 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:34.466496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4b379ca3-5f3f-4f71-9eb2-348df66bf500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:34.478610 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1247/2503] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:21:34.579864 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1257/2504] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:34 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:34.584505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1009a7-3da6-4678-998d-069dd42fd2e7 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:34.597828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1009a7-3da6-4678-998d-069dd42fd2e7 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:34.618331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b379ca3-5f3f-4f71-9eb2-348df66bf500 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:34.619997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4b379ca3-5f3f-4f71-9eb2-348df66bf500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:34.681553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6a698-79f8-453b-9ccc-4225f80fbce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:34.682257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6a698-79f8-453b-9ccc-4225f80fbce3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:34.682531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6a698-79f8-453b-9ccc-4225f80fbce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:34.682915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6a698-79f8-453b-9ccc-4225f80fbce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:34.683722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6a698-79f8-453b-9ccc-4225f80fbce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:34.686431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6a698-79f8-453b-9ccc-4225f80fbce3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:34.726180 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1248/2505] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:21:34 2022] POST /identity/v3/projects => generated 403 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:21:34.731127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6a698-79f8-453b-9ccc-4225f80fbce3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:34.754754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b379ca3-5f3f-4f71-9eb2-348df66bf500 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:34.824881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b3199-b5d0-41b0-893d-053a24ef7490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:34.825926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b3199-b5d0-41b0-893d-053a24ef7490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:34.826416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b3199-b5d0-41b0-893d-053a24ef7490 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:34.826745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b3199-b5d0-41b0-893d-053a24ef7490 admin admin] PATH_INFO: `/v3/users/22b999f5eb4b467e9dbf44d4d682b828` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:34.828028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b3199-b5d0-41b0-893d-053a24ef7490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b999f5eb4b467e9dbf44d4d682b828)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:34.828139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6a698-79f8-453b-9ccc-4225f80fbce3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:34.830056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b3199-b5d0-41b0-893d-053a24ef7490 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:34.833231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7de2b-319e-4f19-aaf9-cd4fe4adb154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:34.833889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7de2b-319e-4f19-aaf9-cd4fe4adb154 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:34.834168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7de2b-319e-4f19-aaf9-cd4fe4adb154 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:34.834439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7de2b-319e-4f19-aaf9-cd4fe4adb154 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:34.835161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7de2b-319e-4f19-aaf9-cd4fe4adb154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:34.837700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7de2b-319e-4f19-aaf9-cd4fe4adb154 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:34.863966 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1249/2506] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:21:34 2022] POST /identity/v3/users => generated 308 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:21:34.868024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7de2b-319e-4f19-aaf9-cd4fe4adb154 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:34.869681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:34.880054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7de2b-319e-4f19-aaf9-cd4fe4adb154 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:34.885895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f22bae-765e-4dc3-8a7e-57bfdb8c7858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:34.886265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f22bae-765e-4dc3-8a7e-57bfdb8c7858 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:34.886550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f22bae-765e-4dc3-8a7e-57bfdb8c7858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:34.886821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f22bae-765e-4dc3-8a7e-57bfdb8c7858 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:34.887513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f22bae-765e-4dc3-8a7e-57bfdb8c7858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:34.889121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f22bae-765e-4dc3-8a7e-57bfdb8c7858 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:34.900859 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1250/2507] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:21:34.904764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b1b3199-b5d0-41b0-893d-053a24ef7490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b999f5eb4b467e9dbf44d4d682b828'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:34.905213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f22bae-765e-4dc3-8a7e-57bfdb8c7858 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:34.906137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b1b3199-b5d0-41b0-893d-053a24ef7490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b999f5eb4b467e9dbf44d4d682b828'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:34.915822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b1b3199-b5d0-41b0-893d-053a24ef7490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b999f5eb4b467e9dbf44d4d682b828'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:34.916024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f22bae-765e-4dc3-8a7e-57bfdb8c7858 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:34.920738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc9fb6-70f0-4887-917d-2020be5dacdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:34.921400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc9fb6-70f0-4887-917d-2020be5dacdf admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:34.921757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc9fb6-70f0-4887-917d-2020be5dacdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:34.922089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc9fb6-70f0-4887-917d-2020be5dacdf admin admin] PATH_INFO: `/v3/projects/ba726f45e1b14a38a2ea4b0795210de5/users/7794608a815147e0a54d0752cc2a6ea5/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:34.927979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b1b3199-b5d0-41b0-893d-053a24ef7490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b999f5eb4b467e9dbf44d4d682b828'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:34.936677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:34.941371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc9fb6-70f0-4887-917d-2020be5dacdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba726f45e1b14a38a2ea4b0795210de5, user_id=7794608a815147e0a54d0752cc2a6ea5, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:34.944966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b1b3199-b5d0-41b0-893d-053a24ef7490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b999f5eb4b467e9dbf44d4d682b828'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:34.946151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc9fb6-70f0-4887-917d-2020be5dacdf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:34.952722 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1258/2508] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:21:34 2022] DELETE /identity/v3/users/22b999f5eb4b467e9dbf44d4d682b828 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:21:34.971154 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1251/2509] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:21:34 2022] PUT /identity/v3/projects/ba726f45e1b14a38a2ea4b0795210de5/users/7794608a815147e0a54d0752cc2a6ea5/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:21:34.973137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b3199-b5d0-41b0-893d-053a24ef7490 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:34.976455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b1b3199-b5d0-41b0-893d-053a24ef7490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:35.132494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b3199-b5d0-41b0-893d-053a24ef7490 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:35.257447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc9fb6-70f0-4887-917d-2020be5dacdf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:35.259760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-26bc9fb6-70f0-4887-917d-2020be5dacdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:35.333131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155ce6e-ef2e-4f56-8786-21b23a93d304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:35.334115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155ce6e-ef2e-4f56-8786-21b23a93d304 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:35.334546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155ce6e-ef2e-4f56-8786-21b23a93d304 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:35.334821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155ce6e-ef2e-4f56-8786-21b23a93d304 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:35.335810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155ce6e-ef2e-4f56-8786-21b23a93d304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:35.363443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc9fb6-70f0-4887-917d-2020be5dacdf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:35.364560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155ce6e-ef2e-4f56-8786-21b23a93d304 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:35.373240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3e7a0-7be9-436d-8102-4b7160c7989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:35.374569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3e7a0-7be9-436d-8102-4b7160c7989d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:35.374861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3e7a0-7be9-436d-8102-4b7160c7989d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:35.375150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3e7a0-7be9-436d-8102-4b7160c7989d admin admin] PATH_INFO: `/v3/projects/f8e8850adaeb4365be8aa84e2cb5da46` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:35.377210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3e7a0-7be9-436d-8102-4b7160c7989d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8e8850adaeb4365be8aa84e2cb5da46)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:35.379822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3e7a0-7be9-436d-8102-4b7160c7989d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:35.383420 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1259/2510] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:21:35.383420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910063c8-5185-42bb-a310-fbb3fe977a97 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:35.385424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910063c8-5185-42bb-a310-fbb3fe977a97 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:35.385869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910063c8-5185-42bb-a310-fbb3fe977a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:35.414671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-910063c8-5185-42bb-a310-fbb3fe977a97 None None] MFA Rules not processed for user `7fa2ccce773c48e79f4e207debd5b4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:35.416998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-910063c8-5185-42bb-a310-fbb3fe977a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:35.455604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9aa3e7a0-7be9-436d-8102-4b7160c7989d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8e8850adaeb4365be8aa84e2cb5da46', 'request_id': 'req-9aa3e7a0-7be9-436d-8102-4b7160c7989d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:35.464825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9aa3e7a0-7be9-436d-8102-4b7160c7989d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8e8850adaeb4365be8aa84e2cb5da46', 'request_id': 'req-9aa3e7a0-7be9-436d-8102-4b7160c7989d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:35.471943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9aa3e7a0-7be9-436d-8102-4b7160c7989d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8e8850adaeb4365be8aa84e2cb5da46', 'request_id': 'req-9aa3e7a0-7be9-436d-8102-4b7160c7989d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:35.475425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:35.488677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9aa3e7a0-7be9-436d-8102-4b7160c7989d admin admin] The token cache is being invalidate because project f8e8850adaeb4365be8aa84e2cb5da46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:21:35.489275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9aa3e7a0-7be9-436d-8102-4b7160c7989d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:35.491086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9aa3e7a0-7be9-436d-8102-4b7160c7989d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:35.492673 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1252/2511] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:21:35 2022] DELETE /identity/v3/projects/f8e8850adaeb4365be8aa84e2cb5da46 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:21:35.493556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3e7a0-7be9-436d-8102-4b7160c7989d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:35.494935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9aa3e7a0-7be9-436d-8102-4b7160c7989d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:35.497744 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1260/2512] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:35.499560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95ea47-4bdd-45ef-a966-b11db7acda87 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:35.500047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95ea47-4bdd-45ef-a966-b11db7acda87 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:35.500621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95ea47-4bdd-45ef-a966-b11db7acda87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:35.525465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6a95ea47-4bdd-45ef-a966-b11db7acda87 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:35.526995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a95ea47-4bdd-45ef-a966-b11db7acda87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:35.581302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3e7a0-7be9-436d-8102-4b7160c7989d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:35.593362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8527e-de32-4fae-8cdf-79482f7f1b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:35.593362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8527e-de32-4fae-8cdf-79482f7f1b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:35.593362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8527e-de32-4fae-8cdf-79482f7f1b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:35.593362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8527e-de32-4fae-8cdf-79482f7f1b9c admin admin] PATH_INFO: `/v3/projects/ba726f45e1b14a38a2ea4b0795210de5/users/7794608a815147e0a54d0752cc2a6ea5/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:35.605307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8527e-de32-4fae-8cdf-79482f7f1b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba726f45e1b14a38a2ea4b0795210de5, user_id=7794608a815147e0a54d0752cc2a6ea5, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:35.606857 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1261/2513] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:35.609463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8527e-de32-4fae-8cdf-79482f7f1b9c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:35.615647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef6c2c-fa7e-496f-abfb-bfe6ba7caedb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:35.616654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef6c2c-fa7e-496f-abfb-bfe6ba7caedb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:35.617144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef6c2c-fa7e-496f-abfb-bfe6ba7caedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:35.623711 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1253/2514] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:21:35 2022] PUT /identity/v3/projects/ba726f45e1b14a38a2ea4b0795210de5/users/7794608a815147e0a54d0752cc2a6ea5/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:21:35.635553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b904b4-d13d-4cb2-9728-14da712af871 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:35.636003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b904b4-d13d-4cb2-9728-14da712af871 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:35.636420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b904b4-d13d-4cb2-9728-14da712af871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:35.653754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e5ef6c2c-fa7e-496f-abfb-bfe6ba7caedb None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:35.655707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e5ef6c2c-fa7e-496f-abfb-bfe6ba7caedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:35.691235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b5b904b4-d13d-4cb2-9728-14da712af871 None None] MFA Rules not processed for user `7794608a815147e0a54d0752cc2a6ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:35.693169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b5b904b4-d13d-4cb2-9728-14da712af871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:35.701230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:35.730065 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1262/2515] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:35.744104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef6c2c-fa7e-496f-abfb-bfe6ba7caedb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:35.777253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef6c2c-fa7e-496f-abfb-bfe6ba7caedb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:35.788312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d24277-fabb-4fda-8325-14aa8d3cc1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:35.789133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d24277-fabb-4fda-8325-14aa8d3cc1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:35.789434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d24277-fabb-4fda-8325-14aa8d3cc1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:35.789747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d24277-fabb-4fda-8325-14aa8d3cc1b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:35.791764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d24277-fabb-4fda-8325-14aa8d3cc1b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:21:35.792138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d24277-fabb-4fda-8325-14aa8d3cc1b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:35.794335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d24277-fabb-4fda-8325-14aa8d3cc1b3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:35.814934 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1263/2516] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:21:35.817050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d24277-fabb-4fda-8325-14aa8d3cc1b3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:35.836222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d24277-fabb-4fda-8325-14aa8d3cc1b3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:35.842405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc902b90-acd7-432a-bb64-a914bc71cda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:35.843021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc902b90-acd7-432a-bb64-a914bc71cda4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:35.843329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc902b90-acd7-432a-bb64-a914bc71cda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:35.843605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc902b90-acd7-432a-bb64-a914bc71cda4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:35.844556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc902b90-acd7-432a-bb64-a914bc71cda4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:35.846613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc902b90-acd7-432a-bb64-a914bc71cda4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:35.879792 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1254/2517] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:21:35.884115 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1264/2518] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:21:35 2022] POST /identity/v3/projects => generated 397 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:21:35.889544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b904b4-d13d-4cb2-9728-14da712af871 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:35.899936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b904b4-d13d-4cb2-9728-14da712af871 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:35.955281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af578ac3-bc81-478e-94e9-95eaba70914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:35.955899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af578ac3-bc81-478e-94e9-95eaba70914c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:35.956245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af578ac3-bc81-478e-94e9-95eaba70914c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:35.956525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af578ac3-bc81-478e-94e9-95eaba70914c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:35.957168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af578ac3-bc81-478e-94e9-95eaba70914c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:35.959080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af578ac3-bc81-478e-94e9-95eaba70914c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:35.985916 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1255/2519] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:21:35 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:21:35.987399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc902b90-acd7-432a-bb64-a914bc71cda4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:35.999674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc902b90-acd7-432a-bb64-a914bc71cda4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:36.005307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d6c7b-9c14-4e0e-bfaa-3e254c66cc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:36.006236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d6c7b-9c14-4e0e-bfaa-3e254c66cc30 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:36.006525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d6c7b-9c14-4e0e-bfaa-3e254c66cc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:36.006867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d6c7b-9c14-4e0e-bfaa-3e254c66cc30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:36.007694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d6c7b-9c14-4e0e-bfaa-3e254c66cc30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:36.009452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d6c7b-9c14-4e0e-bfaa-3e254c66cc30 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:36.027884 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1265/2520] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:21:36.032229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af578ac3-bc81-478e-94e9-95eaba70914c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:36.044078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af578ac3-bc81-478e-94e9-95eaba70914c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:36.052278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f71a26-88aa-4afe-b196-79ef8ad3cb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:36.052721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f71a26-88aa-4afe-b196-79ef8ad3cb5d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:36.053105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f71a26-88aa-4afe-b196-79ef8ad3cb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:36.053207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f71a26-88aa-4afe-b196-79ef8ad3cb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:36.054013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f71a26-88aa-4afe-b196-79ef8ad3cb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:36.055909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f71a26-88aa-4afe-b196-79ef8ad3cb5d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:36.067619 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1256/2521] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:21:36.073018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d6c7b-9c14-4e0e-bfaa-3e254c66cc30 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:36.084297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d6c7b-9c14-4e0e-bfaa-3e254c66cc30 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:36.092292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f227b68-7e1b-4f2f-ab26-ccb8e0905eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:36.093025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f227b68-7e1b-4f2f-ab26-ccb8e0905eee admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:36.093284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f227b68-7e1b-4f2f-ab26-ccb8e0905eee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:36.093715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f227b68-7e1b-4f2f-ab26-ccb8e0905eee admin admin] PATH_INFO: `/v3/projects/437fa0b06c804b76973d65b99ff805b9/users/7db80dea09194b2189682d81e54c7c90/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:36.112284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f227b68-7e1b-4f2f-ab26-ccb8e0905eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=437fa0b06c804b76973d65b99ff805b9, user_id=7db80dea09194b2189682d81e54c7c90, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:36.115078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f227b68-7e1b-4f2f-ab26-ccb8e0905eee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:36.139874 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1266/2522] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:21:36 2022] PUT /identity/v3/projects/437fa0b06c804b76973d65b99ff805b9/users/7db80dea09194b2189682d81e54c7c90/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:21:36.141588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd418f62-f9e6-46bd-835a-493a36d10a57 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:36.141868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd418f62-f9e6-46bd-835a-493a36d10a57 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:36.142214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd418f62-f9e6-46bd-835a-493a36d10a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:36.162769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bd418f62-f9e6-46bd-835a-493a36d10a57 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:36.164110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bd418f62-f9e6-46bd-835a-493a36d10a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:36.236036 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1257/2523] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:36.243635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f227b68-7e1b-4f2f-ab26-ccb8e0905eee admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:36.246090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f227b68-7e1b-4f2f-ab26-ccb8e0905eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:36.282942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:36.315895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f227b68-7e1b-4f2f-ab26-ccb8e0905eee admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:36.319512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54b286-e952-4ed7-a53e-24cbfe1b760c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:36.320128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54b286-e952-4ed7-a53e-24cbfe1b760c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:36.320414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54b286-e952-4ed7-a53e-24cbfe1b760c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:36.320673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54b286-e952-4ed7-a53e-24cbfe1b760c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:36.331661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54b286-e952-4ed7-a53e-24cbfe1b760c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:36.333293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54b286-e952-4ed7-a53e-24cbfe1b760c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:36.349976 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1267/2524] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:21:36.354003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd418f62-f9e6-46bd-835a-493a36d10a57 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:36.355537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bd418f62-f9e6-46bd-835a-493a36d10a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:36.382009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:36.449505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd418f62-f9e6-46bd-835a-493a36d10a57 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:36.456809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41892d8-b38d-43e9-94f5-36579e8509f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:36.457493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41892d8-b38d-43e9-94f5-36579e8509f2 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:36.457771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41892d8-b38d-43e9-94f5-36579e8509f2 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:36.458043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41892d8-b38d-43e9-94f5-36579e8509f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:36.550903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41892d8-b38d-43e9-94f5-36579e8509f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:36.552945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41892d8-b38d-43e9-94f5-36579e8509f2 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:36.577807 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1258/2525] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:36 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:21:37.760752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abd543-ef22-4bd5-8281-686dea1eca5e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:37.761374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abd543-ef22-4bd5-8281-686dea1eca5e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:37.761374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abd543-ef22-4bd5-8281-686dea1eca5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:37.788944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-64abd543-ef22-4bd5-8281-686dea1eca5e None None] MFA Rules not processed for user `b7c1223d9edc4fb99c8967e089c10fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:37.790172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-64abd543-ef22-4bd5-8281-686dea1eca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:37.921614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41892d8-b38d-43e9-94f5-36579e8509f2 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:37.923112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f41892d8-b38d-43e9-94f5-36579e8509f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:37.943394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41892d8-b38d-43e9-94f5-36579e8509f2 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:37.943914 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1268/2526] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:37.948298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998eb29-3b2c-409f-9fd5-e41b0559c015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:37.948920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998eb29-3b2c-409f-9fd5-e41b0559c015 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:37.949199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998eb29-3b2c-409f-9fd5-e41b0559c015 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:37.949474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998eb29-3b2c-409f-9fd5-e41b0559c015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:37.951442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c998eb29-3b2c-409f-9fd5-e41b0559c015 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:38.038530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998eb29-3b2c-409f-9fd5-e41b0559c015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:38.040359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998eb29-3b2c-409f-9fd5-e41b0559c015 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:38.064673 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1259/2527] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:37 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:21:38.086399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abd543-ef22-4bd5-8281-686dea1eca5e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:38.097920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abd543-ef22-4bd5-8281-686dea1eca5e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:38.104898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03f688-95ef-4894-abce-7419cb395080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:38.106061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03f688-95ef-4894-abce-7419cb395080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:38.106544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03f688-95ef-4894-abce-7419cb395080 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:38.107015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03f688-95ef-4894-abce-7419cb395080 admin admin] PATH_INFO: `/v3/users/cb8451f51ffe4d31b42de675488ccd08` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:38.108840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03f688-95ef-4894-abce-7419cb395080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb8451f51ffe4d31b42de675488ccd08)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:38.111618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03f688-95ef-4894-abce-7419cb395080 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:38.122801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998eb29-3b2c-409f-9fd5-e41b0559c015 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:38.134823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998eb29-3b2c-409f-9fd5-e41b0559c015 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:38.141766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc4fc8-1370-489f-abf5-5a74ca416c16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:38.142389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc4fc8-1370-489f-abf5-5a74ca416c16 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:38.142665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc4fc8-1370-489f-abf5-5a74ca416c16 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:38.142947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc4fc8-1370-489f-abf5-5a74ca416c16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:38.145215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3dbc4fc8-1370-489f-abf5-5a74ca416c16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:38.196340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7a03f688-95ef-4894-abce-7419cb395080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb8451f51ffe4d31b42de675488ccd08'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:38.198245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7a03f688-95ef-4894-abce-7419cb395080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb8451f51ffe4d31b42de675488ccd08'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:38.216333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:38.218569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7a03f688-95ef-4894-abce-7419cb395080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb8451f51ffe4d31b42de675488ccd08'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:38.239590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7a03f688-95ef-4894-abce-7419cb395080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb8451f51ffe4d31b42de675488ccd08'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:38.241207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc4fc8-1370-489f-abf5-5a74ca416c16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:38.243269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc4fc8-1370-489f-abf5-5a74ca416c16 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:38.259348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7a03f688-95ef-4894-abce-7419cb395080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb8451f51ffe4d31b42de675488ccd08'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:38.268351 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1260/2528] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:38 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:21:38.272351 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1269/2529] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:21:38 2022] DELETE /identity/v3/users/cb8451f51ffe4d31b42de675488ccd08 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:21:38.281073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5edac6-c132-4ff0-b90e-dd23e7a3ac6e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:38.281471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5edac6-c132-4ff0-b90e-dd23e7a3ac6e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:38.281913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5edac6-c132-4ff0-b90e-dd23e7a3ac6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:38.332354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6a5edac6-c132-4ff0-b90e-dd23e7a3ac6e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:38.336422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6a5edac6-c132-4ff0-b90e-dd23e7a3ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:38.450642 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1261/2530] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:38.477752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03f688-95ef-4894-abce-7419cb395080 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:38.480320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a03f688-95ef-4894-abce-7419cb395080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:38.599389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:38.630305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03f688-95ef-4894-abce-7419cb395080 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:38.636819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854b82c-72ad-4332-9246-5f29b6335e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:38.637763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b82c-72ad-4332-9246-5f29b6335e99 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:38.638134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b82c-72ad-4332-9246-5f29b6335e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:38.638500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b82c-72ad-4332-9246-5f29b6335e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:38.651832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854b82c-72ad-4332-9246-5f29b6335e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:38.653720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854b82c-72ad-4332-9246-5f29b6335e99 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:38.666872 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1270/2531] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:21:39.700529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5edac6-c132-4ff0-b90e-dd23e7a3ac6e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:39.702940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6a5edac6-c132-4ff0-b90e-dd23e7a3ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:39.727816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5edac6-c132-4ff0-b90e-dd23e7a3ac6e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:39.735233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d993743-ae8c-424f-9dc2-8aee903b5bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:39.736338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d993743-ae8c-424f-9dc2-8aee903b5bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:39.736338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d993743-ae8c-424f-9dc2-8aee903b5bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:39.736605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d993743-ae8c-424f-9dc2-8aee903b5bb9 admin admin] PATH_INFO: `/v3/projects/28ffca59ff6f4a35ad06f6f8ea90c05e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:39.737897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d993743-ae8c-424f-9dc2-8aee903b5bb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28ffca59ff6f4a35ad06f6f8ea90c05e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:39.744680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d993743-ae8c-424f-9dc2-8aee903b5bb9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:39.819719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d993743-ae8c-424f-9dc2-8aee903b5bb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28ffca59ff6f4a35ad06f6f8ea90c05e', 'request_id': 'req-5d993743-ae8c-424f-9dc2-8aee903b5bb9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:39.829837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d993743-ae8c-424f-9dc2-8aee903b5bb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28ffca59ff6f4a35ad06f6f8ea90c05e', 'request_id': 'req-5d993743-ae8c-424f-9dc2-8aee903b5bb9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:39.838310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d993743-ae8c-424f-9dc2-8aee903b5bb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28ffca59ff6f4a35ad06f6f8ea90c05e', 'request_id': 'req-5d993743-ae8c-424f-9dc2-8aee903b5bb9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:39.872974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d993743-ae8c-424f-9dc2-8aee903b5bb9 admin admin] The token cache is being invalidate because project 28ffca59ff6f4a35ad06f6f8ea90c05e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:21:39.873360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d993743-ae8c-424f-9dc2-8aee903b5bb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:39.874204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d993743-ae8c-424f-9dc2-8aee903b5bb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:39.878862 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1262/2532] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:21:39 2022] DELETE /identity/v3/projects/28ffca59ff6f4a35ad06f6f8ea90c05e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:21:39.880573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854b82c-72ad-4332-9246-5f29b6335e99 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:39.893471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854b82c-72ad-4332-9246-5f29b6335e99 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:40.006933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4648511-604d-4b16-8fd6-5a11f059465b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:40.007626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4648511-604d-4b16-8fd6-5a11f059465b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:40.008520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4648511-604d-4b16-8fd6-5a11f059465b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:40.008812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4648511-604d-4b16-8fd6-5a11f059465b admin admin] PATH_INFO: `/v3/users/7794608a815147e0a54d0752cc2a6ea5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:40.010954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4648511-604d-4b16-8fd6-5a11f059465b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7794608a815147e0a54d0752cc2a6ea5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:40.012969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4648511-604d-4b16-8fd6-5a11f059465b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:40.133629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4648511-604d-4b16-8fd6-5a11f059465b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7794608a815147e0a54d0752cc2a6ea5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:40.134761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4648511-604d-4b16-8fd6-5a11f059465b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7794608a815147e0a54d0752cc2a6ea5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:40.147502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4648511-604d-4b16-8fd6-5a11f059465b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7794608a815147e0a54d0752cc2a6ea5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:40.163714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4648511-604d-4b16-8fd6-5a11f059465b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7794608a815147e0a54d0752cc2a6ea5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:40.194132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4648511-604d-4b16-8fd6-5a11f059465b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7794608a815147e0a54d0752cc2a6ea5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:40.208195 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1271/2533] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:21:39 2022] DELETE /identity/v3/users/7794608a815147e0a54d0752cc2a6ea5 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:21:40.993974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d993743-ae8c-424f-9dc2-8aee903b5bb9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:40.995553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5d993743-ae8c-424f-9dc2-8aee903b5bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:41.014769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d993743-ae8c-424f-9dc2-8aee903b5bb9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:41.170613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48cf3d-ba0e-4f5b-b897-f43a12d3469c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:41.172762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48cf3d-ba0e-4f5b-b897-f43a12d3469c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:41.172984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48cf3d-ba0e-4f5b-b897-f43a12d3469c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:41.173326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48cf3d-ba0e-4f5b-b897-f43a12d3469c admin admin] PATH_INFO: `/v3/projects/ba726f45e1b14a38a2ea4b0795210de5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:41.182830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48cf3d-ba0e-4f5b-b897-f43a12d3469c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba726f45e1b14a38a2ea4b0795210de5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:41.188500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48cf3d-ba0e-4f5b-b897-f43a12d3469c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:41.215270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:41.288202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c48cf3d-ba0e-4f5b-b897-f43a12d3469c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba726f45e1b14a38a2ea4b0795210de5', 'request_id': 'req-3c48cf3d-ba0e-4f5b-b897-f43a12d3469c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:41.300023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c48cf3d-ba0e-4f5b-b897-f43a12d3469c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba726f45e1b14a38a2ea4b0795210de5', 'request_id': 'req-3c48cf3d-ba0e-4f5b-b897-f43a12d3469c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:41.312309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c48cf3d-ba0e-4f5b-b897-f43a12d3469c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba726f45e1b14a38a2ea4b0795210de5', 'request_id': 'req-3c48cf3d-ba0e-4f5b-b897-f43a12d3469c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:41.343976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c48cf3d-ba0e-4f5b-b897-f43a12d3469c admin admin] The token cache is being invalidate because project ba726f45e1b14a38a2ea4b0795210de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:21:41.352667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c48cf3d-ba0e-4f5b-b897-f43a12d3469c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:41.354030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c48cf3d-ba0e-4f5b-b897-f43a12d3469c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:21:41.361922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6214c-3590-47e6-b4dd-6ed0ed894b73 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:41.362616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6214c-3590-47e6-b4dd-6ed0ed894b73 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:41.362616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6214c-3590-47e6-b4dd-6ed0ed894b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:41.363180 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1263/2534] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:21:40 2022] DELETE /identity/v3/projects/ba726f45e1b14a38a2ea4b0795210de5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:21:41.404776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-91b6214c-3590-47e6-b4dd-6ed0ed894b73 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:41.406410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-91b6214c-3590-47e6-b4dd-6ed0ed894b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:41.520339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9731b3a-1c90-462a-b6cd-36e7b2cad5df None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:41.520825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9731b3a-1c90-462a-b6cd-36e7b2cad5df None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:41.521192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9731b3a-1c90-462a-b6cd-36e7b2cad5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:41.523447 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1272/2535] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:41.553625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f9731b3a-1c90-462a-b6cd-36e7b2cad5df None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:41.554938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f9731b3a-1c90-462a-b6cd-36e7b2cad5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:41.575062 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1264/2536] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:41.579430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6214c-3590-47e6-b4dd-6ed0ed894b73 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:41.586837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:41.592896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6214c-3590-47e6-b4dd-6ed0ed894b73 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:41.603729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3c4ba-734e-4d31-b6c9-09c4b983b409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:41.606720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3c4ba-734e-4d31-b6c9-09c4b983b409 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:41.607756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3c4ba-734e-4d31-b6c9-09c4b983b409 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:41.607756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3c4ba-734e-4d31-b6c9-09c4b983b409 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:41.608401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3c4ba-734e-4d31-b6c9-09c4b983b409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:21:41.608774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3c4ba-734e-4d31-b6c9-09c4b983b409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:41.611038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3c4ba-734e-4d31-b6c9-09c4b983b409 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:41.628054 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1273/2537] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:21:41.632031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9731b3a-1c90-462a-b6cd-36e7b2cad5df None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:41.643765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9731b3a-1c90-462a-b6cd-36e7b2cad5df None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:41.650287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457be529-3a48-4148-97a8-75f12428b556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:41.651482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457be529-3a48-4148-97a8-75f12428b556 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:41.651612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457be529-3a48-4148-97a8-75f12428b556 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:41.651874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457be529-3a48-4148-97a8-75f12428b556 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:41.652720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457be529-3a48-4148-97a8-75f12428b556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:41.654807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457be529-3a48-4148-97a8-75f12428b556 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:41.704238 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1265/2538] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:21:41 2022] POST /identity/v3/projects => generated 411 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:21:41.708921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3c4ba-734e-4d31-b6c9-09c4b983b409 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:41.722130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3c4ba-734e-4d31-b6c9-09c4b983b409 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:41.845181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cc3c9-5993-4a8b-87ba-4395fc2dff8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:41.846047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cc3c9-5993-4a8b-87ba-4395fc2dff8d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:41.846328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cc3c9-5993-4a8b-87ba-4395fc2dff8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:41.846640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cc3c9-5993-4a8b-87ba-4395fc2dff8d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:41.847476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cc3c9-5993-4a8b-87ba-4395fc2dff8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:41.851903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cc3c9-5993-4a8b-87ba-4395fc2dff8d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:41.903438 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1274/2539] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:21:41 2022] POST /identity/v3/users => generated 306 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:21:41.904595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457be529-3a48-4148-97a8-75f12428b556 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:41.917996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457be529-3a48-4148-97a8-75f12428b556 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:41.922962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9aa29-02b7-49bd-9fb9-d43a6aefc641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:41.923632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9aa29-02b7-49bd-9fb9-d43a6aefc641 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:41.923907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9aa29-02b7-49bd-9fb9-d43a6aefc641 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:41.924193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9aa29-02b7-49bd-9fb9-d43a6aefc641 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:41.925067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9aa29-02b7-49bd-9fb9-d43a6aefc641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:41.929179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9aa29-02b7-49bd-9fb9-d43a6aefc641 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:41.954895 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1266/2540] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:21:41.956773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cc3c9-5993-4a8b-87ba-4395fc2dff8d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:41.969607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cc3c9-5993-4a8b-87ba-4395fc2dff8d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:41.982907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4e6ae-13dc-4b93-ad63-40efa34d675f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:41.983627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4e6ae-13dc-4b93-ad63-40efa34d675f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:41.983902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4e6ae-13dc-4b93-ad63-40efa34d675f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:41.984684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4e6ae-13dc-4b93-ad63-40efa34d675f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:41.984817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4e6ae-13dc-4b93-ad63-40efa34d675f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:41.990310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4e6ae-13dc-4b93-ad63-40efa34d675f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:42.009261 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1275/2541] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:21:42.013557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9aa29-02b7-49bd-9fb9-d43a6aefc641 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:42.053814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9aa29-02b7-49bd-9fb9-d43a6aefc641 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:42.058980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17574ba-6cd5-493d-8f10-832e1dfd5759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:42.059881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17574ba-6cd5-493d-8f10-832e1dfd5759 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:42.060339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17574ba-6cd5-493d-8f10-832e1dfd5759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:42.060765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17574ba-6cd5-493d-8f10-832e1dfd5759 admin admin] PATH_INFO: `/v3/projects/578306b0406a4b78a7fc425e1563880c/users/0d5f065094a74e3e8ffa17b9f53a6926/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:42.084647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17574ba-6cd5-493d-8f10-832e1dfd5759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578306b0406a4b78a7fc425e1563880c, user_id=0d5f065094a74e3e8ffa17b9f53a6926, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:42.087333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17574ba-6cd5-493d-8f10-832e1dfd5759 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:42.123335 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1267/2542] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:21:42 2022] PUT /identity/v3/projects/578306b0406a4b78a7fc425e1563880c/users/0d5f065094a74e3e8ffa17b9f53a6926/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:21:42.129077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d0499-6a3f-4679-8699-2fb970ff154c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:42.129519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d0499-6a3f-4679-8699-2fb970ff154c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:42.129816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d0499-6a3f-4679-8699-2fb970ff154c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:42.157619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-de1d0499-6a3f-4679-8699-2fb970ff154c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:42.159324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-de1d0499-6a3f-4679-8699-2fb970ff154c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:42.251530 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1276/2543] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:42.261850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17574ba-6cd5-493d-8f10-832e1dfd5759 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:42.263985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a17574ba-6cd5-493d-8f10-832e1dfd5759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:42.331038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17574ba-6cd5-493d-8f10-832e1dfd5759 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:42.334871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5017a7-15e1-43e9-bd7a-46c9f260067c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:42.335633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5017a7-15e1-43e9-bd7a-46c9f260067c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:42.336033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5017a7-15e1-43e9-bd7a-46c9f260067c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:42.336401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5017a7-15e1-43e9-bd7a-46c9f260067c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:42.350142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5017a7-15e1-43e9-bd7a-46c9f260067c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:42.351777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5017a7-15e1-43e9-bd7a-46c9f260067c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:42.364209 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1268/2544] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:21:43.118130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15d4a8-ef12-42bc-b74e-0a6445478a9b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:43.119333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15d4a8-ef12-42bc-b74e-0a6445478a9b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:43.119832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15d4a8-ef12-42bc-b74e-0a6445478a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:43.144710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bb15d4a8-ef12-42bc-b74e-0a6445478a9b None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:43.146452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb15d4a8-ef12-42bc-b74e-0a6445478a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:43.299663 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1277/2545] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:21:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:21:43.324717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5017a7-15e1-43e9-bd7a-46c9f260067c service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:43.327040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d5017a7-15e1-43e9-bd7a-46c9f260067c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:43.396314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:43.433159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5017a7-15e1-43e9-bd7a-46c9f260067c service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:43.439129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631569cf-0b72-43eb-9571-09aff5644084 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:43.440001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631569cf-0b72-43eb-9571-09aff5644084 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:43.440502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631569cf-0b72-43eb-9571-09aff5644084 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:43.440932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631569cf-0b72-43eb-9571-09aff5644084 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:43.451693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631569cf-0b72-43eb-9571-09aff5644084 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:43.453950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631569cf-0b72-43eb-9571-09aff5644084 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:43.475677 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1269/2546] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:21:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:21:49.465898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221995c4-bb1f-426d-a1f3-ef2241b0bf53 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:49.466512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221995c4-bb1f-426d-a1f3-ef2241b0bf53 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:49.466512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221995c4-bb1f-426d-a1f3-ef2241b0bf53 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:49.468295 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1278/2547] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 18:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:21:49.482144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e975f8-a63d-4ee5-b245-bbc647f46a24 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:49.482653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e975f8-a63d-4ee5-b245-bbc647f46a24 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:49.483010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e975f8-a63d-4ee5-b245-bbc647f46a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:49.486263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a60b2f-d7f0-4983-8846-2e363f4ff141 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:49.486545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a60b2f-d7f0-4983-8846-2e363f4ff141 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:49.486932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a60b2f-d7f0-4983-8846-2e363f4ff141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:49.564771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-87e975f8-a63d-4ee5-b245-bbc647f46a24 None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:49.575471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-87e975f8-a63d-4ee5-b245-bbc647f46a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:49.632412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-41a60b2f-d7f0-4983-8846-2e363f4ff141 None None] MFA Rules not processed for user `7db80dea09194b2189682d81e54c7c90`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:49.638312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-41a60b2f-d7f0-4983-8846-2e363f4ff141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:49.658319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:21:49.951505 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1270/2548] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 18:21:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:50.037712 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1279/2549] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 550 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:21:50.068429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e975f8-a63d-4ee5-b245-bbc647f46a24 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:50.069364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-87e975f8-a63d-4ee5-b245-bbc647f46a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:50.100183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e975f8-a63d-4ee5-b245-bbc647f46a24 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:50.110563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471ee8f-35de-44e0-90f0-63232f62da6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:50.119599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471ee8f-35de-44e0-90f0-63232f62da6b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:50.120106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471ee8f-35de-44e0-90f0-63232f62da6b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:50.120400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471ee8f-35de-44e0-90f0-63232f62da6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:50.171143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471ee8f-35de-44e0-90f0-63232f62da6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:50.172807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471ee8f-35de-44e0-90f0-63232f62da6b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:50.221846 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1271/2550] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:21:50.251526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4a685-abf7-42f1-bee6-447ed36b1d49 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:50.251806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4a685-abf7-42f1-bee6-447ed36b1d49 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:50.252264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4a685-abf7-42f1-bee6-447ed36b1d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:50.341807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f3c4a685-abf7-42f1-bee6-447ed36b1d49 None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:50.348104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f3c4a685-abf7-42f1-bee6-447ed36b1d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:50.389535 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1280/2551] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 18:21:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:21:50.458154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471ee8f-35de-44e0-90f0-63232f62da6b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:50.469190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471ee8f-35de-44e0-90f0-63232f62da6b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:50.486603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50768c6-4545-489e-b8f5-85235fd1f0a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:50.488468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50768c6-4545-489e-b8f5-85235fd1f0a8 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:50.489491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50768c6-4545-489e-b8f5-85235fd1f0a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:50.489799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50768c6-4545-489e-b8f5-85235fd1f0a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:50.530421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50768c6-4545-489e-b8f5-85235fd1f0a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:50.532584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50768c6-4545-489e-b8f5-85235fd1f0a8 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:50.556205 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1272/2552] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:21:52.883644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4a685-abf7-42f1-bee6-447ed36b1d49 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:52.885973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f3c4a685-abf7-42f1-bee6-447ed36b1d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:52.918896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4a685-abf7-42f1-bee6-447ed36b1d49 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:52.936272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492f4c6-1524-4641-8228-99ff5a35c9a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:52.936911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492f4c6-1524-4641-8228-99ff5a35c9a6 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:52.937192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492f4c6-1524-4641-8228-99ff5a35c9a6 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:52.937465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492f4c6-1524-4641-8228-99ff5a35c9a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:53.000666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492f4c6-1524-4641-8228-99ff5a35c9a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:53.002386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492f4c6-1524-4641-8228-99ff5a35c9a6 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:53.048031 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1281/2553] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:52 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:21:53.901730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27d75b-52f8-46be-a07d-04cac2ea970b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:53.902576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27d75b-52f8-46be-a07d-04cac2ea970b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:53.903003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27d75b-52f8-46be-a07d-04cac2ea970b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:54.020314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dd27d75b-52f8-46be-a07d-04cac2ea970b None None] MFA Rules not processed for user `0d5f065094a74e3e8ffa17b9f53a6926`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:54.021567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dd27d75b-52f8-46be-a07d-04cac2ea970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:54.173729 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1273/2554] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:53 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:54.187685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ea273-62cd-4e3e-9c39-e339b9727038 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:54.188517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ea273-62cd-4e3e-9c39-e339b9727038 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:54.188992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ea273-62cd-4e3e-9c39-e339b9727038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:54.248630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2d3ea273-62cd-4e3e-9c39-e339b9727038 None None] MFA Rules not processed for user `0d5f065094a74e3e8ffa17b9f53a6926`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:21:54.249899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d3ea273-62cd-4e3e-9c39-e339b9727038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:21:54.289339 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1282/2555] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:21:54.975886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27d75b-52f8-46be-a07d-04cac2ea970b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:21:55.011141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27d75b-52f8-46be-a07d-04cac2ea970b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:21:55.039618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fd2b0-526b-4bd0-baff-860ce2ef2548 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:21:55.040487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fd2b0-526b-4bd0-baff-860ce2ef2548 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:21:55.041001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fd2b0-526b-4bd0-baff-860ce2ef2548 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:21:55.042022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fd2b0-526b-4bd0-baff-860ce2ef2548 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:21:55.063728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fd2b0-526b-4bd0-baff-860ce2ef2548 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:21:55.067354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fd2b0-526b-4bd0-baff-860ce2ef2548 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:21:55.097128 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1274/2556] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:21:54 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:22:01.204297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ea273-62cd-4e3e-9c39-e339b9727038 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:01.205767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d3ea273-62cd-4e3e-9c39-e339b9727038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:01.314727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ea273-62cd-4e3e-9c39-e339b9727038 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:01.326515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40020c-8eaa-43a5-a30e-38e17385dea1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:01.327148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40020c-8eaa-43a5-a30e-38e17385dea1 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:01.327469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40020c-8eaa-43a5-a30e-38e17385dea1 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:01.327745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40020c-8eaa-43a5-a30e-38e17385dea1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:01.329668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d40020c-8eaa-43a5-a30e-38e17385dea1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:01.343915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40020c-8eaa-43a5-a30e-38e17385dea1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:01.345662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40020c-8eaa-43a5-a30e-38e17385dea1 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:01.356999 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1283/2557] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:22:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:22:05.083602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:05.431634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19ed1d-b158-45f9-85d3-a8e965f3a0fd None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:05.432210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19ed1d-b158-45f9-85d3-a8e965f3a0fd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:05.432700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19ed1d-b158-45f9-85d3-a8e965f3a0fd None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:05.434664 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1275/2558] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 18:22:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:22:05.491864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf91b2d-252c-4d38-8411-c2661dacee05 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:05.492397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf91b2d-252c-4d38-8411-c2661dacee05 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:05.492397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf91b2d-252c-4d38-8411-c2661dacee05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:05.530507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9cf91b2d-252c-4d38-8411-c2661dacee05 None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:05.531988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9cf91b2d-252c-4d38-8411-c2661dacee05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:05.541520 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1284/2559] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 18:22:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:05.580250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19ed1d-b158-45f9-85d3-a8e965f3a0fd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:05.582919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dc19ed1d-b158-45f9-85d3-a8e965f3a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:05.609180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19ed1d-b158-45f9-85d3-a8e965f3a0fd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:05.616035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9805b0-8ec9-4b13-b5f8-e59c3948856d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:05.617111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9805b0-8ec9-4b13-b5f8-e59c3948856d service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:05.617367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9805b0-8ec9-4b13-b5f8-e59c3948856d service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:05.617851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9805b0-8ec9-4b13-b5f8-e59c3948856d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:05.631184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9805b0-8ec9-4b13-b5f8-e59c3948856d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:05.633962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9805b0-8ec9-4b13-b5f8-e59c3948856d service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:05.650675 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1276/2560] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:22:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:22:05.692377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf91b2d-252c-4d38-8411-c2661dacee05 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:05.694376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9cf91b2d-252c-4d38-8411-c2661dacee05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:05.712247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf91b2d-252c-4d38-8411-c2661dacee05 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:05.717189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3db0d3-fe27-48ac-8eb8-f778b36b3444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:05.718069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3db0d3-fe27-48ac-8eb8-f778b36b3444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:05.718512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3db0d3-fe27-48ac-8eb8-f778b36b3444 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:05.718788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3db0d3-fe27-48ac-8eb8-f778b36b3444 admin admin] PATH_INFO: `/v3/users/7db80dea09194b2189682d81e54c7c90` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:05.719960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3db0d3-fe27-48ac-8eb8-f778b36b3444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7db80dea09194b2189682d81e54c7c90)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:05.721959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3db0d3-fe27-48ac-8eb8-f778b36b3444 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:05.779350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b3db0d3-fe27-48ac-8eb8-f778b36b3444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7db80dea09194b2189682d81e54c7c90'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:05.780020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b3db0d3-fe27-48ac-8eb8-f778b36b3444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7db80dea09194b2189682d81e54c7c90'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:05.788199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b3db0d3-fe27-48ac-8eb8-f778b36b3444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7db80dea09194b2189682d81e54c7c90'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:05.790206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:05.798535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b3db0d3-fe27-48ac-8eb8-f778b36b3444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7db80dea09194b2189682d81e54c7c90'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:05.814932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b3db0d3-fe27-48ac-8eb8-f778b36b3444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7db80dea09194b2189682d81e54c7c90'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:05.822034 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1285/2561] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:22:05 2022] DELETE /identity/v3/users/7db80dea09194b2189682d81e54c7c90 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:06.211194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9805b0-8ec9-4b13-b5f8-e59c3948856d service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:06.225595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9805b0-8ec9-4b13-b5f8-e59c3948856d service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:06.311882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f09d1d-5e32-449b-94c5-2a12f41a6d91 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:06.312173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f09d1d-5e32-449b-94c5-2a12f41a6d91 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:06.312451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f09d1d-5e32-449b-94c5-2a12f41a6d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:06.323815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846eb25-940f-4d88-8dcc-3efce6aa3465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:06.324456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846eb25-940f-4d88-8dcc-3efce6aa3465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:06.324738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846eb25-940f-4d88-8dcc-3efce6aa3465 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:06.325015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846eb25-940f-4d88-8dcc-3efce6aa3465 admin admin] PATH_INFO: `/v3/projects/437fa0b06c804b76973d65b99ff805b9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:06.326143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846eb25-940f-4d88-8dcc-3efce6aa3465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=437fa0b06c804b76973d65b99ff805b9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:06.328079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846eb25-940f-4d88-8dcc-3efce6aa3465 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:06.332490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-11f09d1d-5e32-449b-94c5-2a12f41a6d91 None None] MFA Rules not processed for user `a3f83d2a0be442cb83593a030e92c752`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:06.333707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-11f09d1d-5e32-449b-94c5-2a12f41a6d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:06.378419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0846eb25-940f-4d88-8dcc-3efce6aa3465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '437fa0b06c804b76973d65b99ff805b9', 'request_id': 'req-0846eb25-940f-4d88-8dcc-3efce6aa3465'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:06.385118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0846eb25-940f-4d88-8dcc-3efce6aa3465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '437fa0b06c804b76973d65b99ff805b9', 'request_id': 'req-0846eb25-940f-4d88-8dcc-3efce6aa3465'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:06.391137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0846eb25-940f-4d88-8dcc-3efce6aa3465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '437fa0b06c804b76973d65b99ff805b9', 'request_id': 'req-0846eb25-940f-4d88-8dcc-3efce6aa3465'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:06.393291 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1286/2562] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:22:06.410968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0846eb25-940f-4d88-8dcc-3efce6aa3465 admin admin] The token cache is being invalidate because project 437fa0b06c804b76973d65b99ff805b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:22:06.411283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0846eb25-940f-4d88-8dcc-3efce6aa3465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:06.411976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0846eb25-940f-4d88-8dcc-3efce6aa3465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:06.414536 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1277/2563] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:22:06 2022] DELETE /identity/v3/projects/437fa0b06c804b76973d65b99ff805b9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:06.420290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7e764-e6b4-436d-80ca-4c9b2bb0266e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:06.420647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7e764-e6b4-436d-80ca-4c9b2bb0266e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:06.420983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7e764-e6b4-436d-80ca-4c9b2bb0266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:06.442272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5ec7e764-e6b4-436d-80ca-4c9b2bb0266e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:06.443739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ec7e764-e6b4-436d-80ca-4c9b2bb0266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:06.515089 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1287/2564] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:06.523306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356a494-2cf4-4878-af44-deb2a2d24485 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:06.523811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356a494-2cf4-4878-af44-deb2a2d24485 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:06.524099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356a494-2cf4-4878-af44-deb2a2d24485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:06.544081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c356a494-2cf4-4878-af44-deb2a2d24485 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:06.545505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c356a494-2cf4-4878-af44-deb2a2d24485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:06.553602 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1278/2565] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:06.559245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7e764-e6b4-436d-80ca-4c9b2bb0266e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:06.569694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7e764-e6b4-436d-80ca-4c9b2bb0266e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:06.574494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a18ca-e314-4085-89e7-4cf982b456f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:06.575117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a18ca-e314-4085-89e7-4cf982b456f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:06.575653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a18ca-e314-4085-89e7-4cf982b456f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:06.575938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a18ca-e314-4085-89e7-4cf982b456f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:06.576598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a18ca-e314-4085-89e7-4cf982b456f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:22:06.576902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a18ca-e314-4085-89e7-4cf982b456f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:06.578531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a18ca-e314-4085-89e7-4cf982b456f8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:06.591743 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1288/2566] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:06.596096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356a494-2cf4-4878-af44-deb2a2d24485 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:06.607143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356a494-2cf4-4878-af44-deb2a2d24485 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:06.612558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c0516-f1a6-4daf-8516-b476e564339c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:06.613291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c0516-f1a6-4daf-8516-b476e564339c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:06.613914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c0516-f1a6-4daf-8516-b476e564339c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:06.614285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c0516-f1a6-4daf-8516-b476e564339c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:06.615135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c0516-f1a6-4daf-8516-b476e564339c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:06.617076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c0516-f1a6-4daf-8516-b476e564339c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:06.658414 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1279/2567] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:22:06 2022] POST /identity/v3/projects => generated 359 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:22:06.661863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a18ca-e314-4085-89e7-4cf982b456f8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:06.672485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a18ca-e314-4085-89e7-4cf982b456f8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:06.740496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b856e-2b9f-466e-9a9c-6e6a12586256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:06.741245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b856e-2b9f-466e-9a9c-6e6a12586256 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:06.741655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b856e-2b9f-466e-9a9c-6e6a12586256 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:06.741996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b856e-2b9f-466e-9a9c-6e6a12586256 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:06.742754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b856e-2b9f-466e-9a9c-6e6a12586256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:06.744783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b856e-2b9f-466e-9a9c-6e6a12586256 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:06.758011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:06.775941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c0516-f1a6-4daf-8516-b476e564339c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:06.779356 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1289/2568] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:22:06 2022] POST /identity/v3/users => generated 280 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:22:06.787756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c0516-f1a6-4daf-8516-b476e564339c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:06.793671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee0871-2aa2-4382-957c-3958470895b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:06.794409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee0871-2aa2-4382-957c-3958470895b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:06.794814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee0871-2aa2-4382-957c-3958470895b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:06.795421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee0871-2aa2-4382-957c-3958470895b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:06.796292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee0871-2aa2-4382-957c-3958470895b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:06.798693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee0871-2aa2-4382-957c-3958470895b0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:06.817004 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1280/2569] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:22:06.817981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b856e-2b9f-466e-9a9c-6e6a12586256 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:06.831137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b856e-2b9f-466e-9a9c-6e6a12586256 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:06.836717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006e49e-4bb3-49b3-9b38-236ecfb5bce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:06.837410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006e49e-4bb3-49b3-9b38-236ecfb5bce0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:06.837772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006e49e-4bb3-49b3-9b38-236ecfb5bce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:06.838781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006e49e-4bb3-49b3-9b38-236ecfb5bce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:06.841154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006e49e-4bb3-49b3-9b38-236ecfb5bce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:06.843976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006e49e-4bb3-49b3-9b38-236ecfb5bce0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:06.860029 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1290/2570] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:22:06.864712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee0871-2aa2-4382-957c-3958470895b0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:06.878498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee0871-2aa2-4382-957c-3958470895b0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:06.885071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51293b22-bf06-4af7-800a-4c17a6682b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:06.886094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293b22-bf06-4af7-800a-4c17a6682b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:06.886481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293b22-bf06-4af7-800a-4c17a6682b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:06.887179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293b22-bf06-4af7-800a-4c17a6682b6b admin admin] PATH_INFO: `/v3/projects/3fad6fe2024c4b7ea1a146f38247dfb3/users/f1a9a107177f4bf4b5e573129b3bac25/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:06.911483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51293b22-bf06-4af7-800a-4c17a6682b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fad6fe2024c4b7ea1a146f38247dfb3, user_id=f1a9a107177f4bf4b5e573129b3bac25, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:06.914538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51293b22-bf06-4af7-800a-4c17a6682b6b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:06.971664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5023b-9fd5-4053-a427-77f2150d6766 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:06.971935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5023b-9fd5-4053-a427-77f2150d6766 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:06.972216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5023b-9fd5-4053-a427-77f2150d6766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:07.001171 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1281/2571] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:22:06 2022] PUT /identity/v3/projects/3fad6fe2024c4b7ea1a146f38247dfb3/users/f1a9a107177f4bf4b5e573129b3bac25/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:22:07.029189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-80c5023b-9fd5-4053-a427-77f2150d6766 None None] MFA Rules not processed for user `f1a9a107177f4bf4b5e573129b3bac25`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:07.032196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80c5023b-9fd5-4053-a427-77f2150d6766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:07.127148 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1291/2572] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:07.338772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51293b22-bf06-4af7-800a-4c17a6682b6b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:07.341852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-51293b22-bf06-4af7-800a-4c17a6682b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:07.362090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:07.459408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51293b22-bf06-4af7-800a-4c17a6682b6b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:07.466799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795be6dc-5e81-42c7-9c7b-a1c6dbc58a87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:07.467584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795be6dc-5e81-42c7-9c7b-a1c6dbc58a87 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:07.467961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795be6dc-5e81-42c7-9c7b-a1c6dbc58a87 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:07.468331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795be6dc-5e81-42c7-9c7b-a1c6dbc58a87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:07.503785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795be6dc-5e81-42c7-9c7b-a1c6dbc58a87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:07.506005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795be6dc-5e81-42c7-9c7b-a1c6dbc58a87 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:07.530108 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1282/2573] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:22:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:22:07.585540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5023b-9fd5-4053-a427-77f2150d6766 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:07.726988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5023b-9fd5-4053-a427-77f2150d6766 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:07.737609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c116e7-986a-41f4-bca4-f1f585f54571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:07.740154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c116e7-986a-41f4-bca4-f1f585f54571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:07.743613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c116e7-986a-41f4-bca4-f1f585f54571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:07.743985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c116e7-986a-41f4-bca4-f1f585f54571 admin admin] PATH_INFO: `/v3/users/f1a9a107177f4bf4b5e573129b3bac25` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:07.745706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c116e7-986a-41f4-bca4-f1f585f54571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1a9a107177f4bf4b5e573129b3bac25)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:07.748911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c116e7-986a-41f4-bca4-f1f585f54571 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:07.843652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49c116e7-986a-41f4-bca4-f1f585f54571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1a9a107177f4bf4b5e573129b3bac25'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:07.844388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49c116e7-986a-41f4-bca4-f1f585f54571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1a9a107177f4bf4b5e573129b3bac25'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:07.853114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49c116e7-986a-41f4-bca4-f1f585f54571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1a9a107177f4bf4b5e573129b3bac25'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:07.863308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49c116e7-986a-41f4-bca4-f1f585f54571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1a9a107177f4bf4b5e573129b3bac25'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:07.876926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:07.879902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49c116e7-986a-41f4-bca4-f1f585f54571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1a9a107177f4bf4b5e573129b3bac25'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:07.888376 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1292/2574] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:22:07 2022] DELETE /identity/v3/users/f1a9a107177f4bf4b5e573129b3bac25 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:07.893840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d42cab-e160-445f-bb03-740117f110e7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:07.894429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d42cab-e160-445f-bb03-740117f110e7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:07.894732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d42cab-e160-445f-bb03-740117f110e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:07.915117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e0d42cab-e160-445f-bb03-740117f110e7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:07.929396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e0d42cab-e160-445f-bb03-740117f110e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:07.999368 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1283/2575] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:08.009417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c116e7-986a-41f4-bca4-f1f585f54571 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:08.011214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-49c116e7-986a-41f4-bca4-f1f585f54571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:08.074632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c116e7-986a-41f4-bca4-f1f585f54571 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:08.080218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47156b-55fe-4cf2-b3f0-d192fe136198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:08.080979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47156b-55fe-4cf2-b3f0-d192fe136198 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:08.081328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47156b-55fe-4cf2-b3f0-d192fe136198 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:08.081669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47156b-55fe-4cf2-b3f0-d192fe136198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:08.093795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47156b-55fe-4cf2-b3f0-d192fe136198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:08.095520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47156b-55fe-4cf2-b3f0-d192fe136198 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:08.108094 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1293/2576] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:22:08.209857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d42cab-e160-445f-bb03-740117f110e7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:08.211931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e0d42cab-e160-445f-bb03-740117f110e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:08.311885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d42cab-e160-445f-bb03-740117f110e7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:08.318299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da08f0e-3abe-45e4-8554-a11a4eefa78b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:08.318932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da08f0e-3abe-45e4-8554-a11a4eefa78b service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:08.319215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da08f0e-3abe-45e4-8554-a11a4eefa78b service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:08.319946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da08f0e-3abe-45e4-8554-a11a4eefa78b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:08.321584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1da08f0e-3abe-45e4-8554-a11a4eefa78b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:08.337233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da08f0e-3abe-45e4-8554-a11a4eefa78b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:08.339552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da08f0e-3abe-45e4-8554-a11a4eefa78b service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:08.368161 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1284/2577] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:22:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:22:09.195004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47156b-55fe-4cf2-b3f0-d192fe136198 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:09.197003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8f47156b-55fe-4cf2-b3f0-d192fe136198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:09.230801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47156b-55fe-4cf2-b3f0-d192fe136198 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:09.251096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cce824-0726-4315-890a-9cbfbdec817e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:09.251881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cce824-0726-4315-890a-9cbfbdec817e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:09.252159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cce824-0726-4315-890a-9cbfbdec817e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:09.252431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cce824-0726-4315-890a-9cbfbdec817e admin admin] PATH_INFO: `/v3/projects/3fad6fe2024c4b7ea1a146f38247dfb3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:09.254621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cce824-0726-4315-890a-9cbfbdec817e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fad6fe2024c4b7ea1a146f38247dfb3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:09.256732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cce824-0726-4315-890a-9cbfbdec817e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:09.402928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33cce824-0726-4315-890a-9cbfbdec817e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fad6fe2024c4b7ea1a146f38247dfb3', 'request_id': 'req-33cce824-0726-4315-890a-9cbfbdec817e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:09.458665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33cce824-0726-4315-890a-9cbfbdec817e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fad6fe2024c4b7ea1a146f38247dfb3', 'request_id': 'req-33cce824-0726-4315-890a-9cbfbdec817e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:09.483845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33cce824-0726-4315-890a-9cbfbdec817e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fad6fe2024c4b7ea1a146f38247dfb3', 'request_id': 'req-33cce824-0726-4315-890a-9cbfbdec817e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:09.504805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33cce824-0726-4315-890a-9cbfbdec817e admin admin] The token cache is being invalidate because project 3fad6fe2024c4b7ea1a146f38247dfb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:22:09.505376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33cce824-0726-4315-890a-9cbfbdec817e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:09.506889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33cce824-0726-4315-890a-9cbfbdec817e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:09.509125 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1294/2578] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:22:09 2022] DELETE /identity/v3/projects/3fad6fe2024c4b7ea1a146f38247dfb3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:09.514054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da7ea9-0d88-4a2a-9ba7-efca2b204dfd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:09.514630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da7ea9-0d88-4a2a-9ba7-efca2b204dfd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:09.514728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da7ea9-0d88-4a2a-9ba7-efca2b204dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:09.551083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-98da7ea9-0d88-4a2a-9ba7-efca2b204dfd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:09.552676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-98da7ea9-0d88-4a2a-9ba7-efca2b204dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:09.627443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:09.681075 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1285/2579] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:09.689952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1ebd4-b44f-4329-bc0b-6b8f56bc1115 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:09.690276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1ebd4-b44f-4329-bc0b-6b8f56bc1115 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:09.690558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1ebd4-b44f-4329-bc0b-6b8f56bc1115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:09.711120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9cc1ebd4-b44f-4329-bc0b-6b8f56bc1115 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:09.712406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9cc1ebd4-b44f-4329-bc0b-6b8f56bc1115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:09.721179 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1295/2580] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:09.725332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da7ea9-0d88-4a2a-9ba7-efca2b204dfd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:09.736127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da7ea9-0d88-4a2a-9ba7-efca2b204dfd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:09.740917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5fd34-a4fc-46b6-b7a9-d31dd0d4c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:09.741596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5fd34-a4fc-46b6-b7a9-d31dd0d4c5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:09.742116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5fd34-a4fc-46b6-b7a9-d31dd0d4c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:09.742552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5fd34-a4fc-46b6-b7a9-d31dd0d4c5c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:09.743232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5fd34-a4fc-46b6-b7a9-d31dd0d4c5c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:22:09.743571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5fd34-a4fc-46b6-b7a9-d31dd0d4c5c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:09.745245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5fd34-a4fc-46b6-b7a9-d31dd0d4c5c1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:09.759272 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1286/2581] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:09.763840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1ebd4-b44f-4329-bc0b-6b8f56bc1115 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:09.773923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1ebd4-b44f-4329-bc0b-6b8f56bc1115 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:09.779117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5f547-6d59-4c60-9321-01b837b71a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:09.779799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5f547-6d59-4c60-9321-01b837b71a60 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:09.780079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5f547-6d59-4c60-9321-01b837b71a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:09.780347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5f547-6d59-4c60-9321-01b837b71a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:09.780993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5f547-6d59-4c60-9321-01b837b71a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:09.782972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5f547-6d59-4c60-9321-01b837b71a60 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:09.824815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5fd34-a4fc-46b6-b7a9-d31dd0d4c5c1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:09.833478 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1296/2582] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:22:09 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:22:09.837929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5fd34-a4fc-46b6-b7a9-d31dd0d4c5c1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:09.922207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eeda28-8bdc-40c2-bbf7-381bb5237478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:09.922623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeda28-8bdc-40c2-bbf7-381bb5237478 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:09.922902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeda28-8bdc-40c2-bbf7-381bb5237478 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:09.923398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeda28-8bdc-40c2-bbf7-381bb5237478 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:09.924056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eeda28-8bdc-40c2-bbf7-381bb5237478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:09.926115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eeda28-8bdc-40c2-bbf7-381bb5237478 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:09.959127 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1287/2583] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:22:09 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:22:10.017434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5f547-6d59-4c60-9321-01b837b71a60 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:10.028349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5f547-6d59-4c60-9321-01b837b71a60 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:10.033600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5517a4-f401-432a-976b-e2601b8ac8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:10.034389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5517a4-f401-432a-976b-e2601b8ac8bc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:10.034497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5517a4-f401-432a-976b-e2601b8ac8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:10.034742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5517a4-f401-432a-976b-e2601b8ac8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:10.035427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5517a4-f401-432a-976b-e2601b8ac8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:10.037058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5517a4-f401-432a-976b-e2601b8ac8bc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:10.048339 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1297/2584] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:22:10.052403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eeda28-8bdc-40c2-bbf7-381bb5237478 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:10.072287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eeda28-8bdc-40c2-bbf7-381bb5237478 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:10.083955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747abf9-c286-44eb-aa36-1eded19715bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:10.084694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747abf9-c286-44eb-aa36-1eded19715bf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:10.085041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747abf9-c286-44eb-aa36-1eded19715bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:10.085324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747abf9-c286-44eb-aa36-1eded19715bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:10.086082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747abf9-c286-44eb-aa36-1eded19715bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:10.087826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747abf9-c286-44eb-aa36-1eded19715bf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:10.113019 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1288/2585] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:22:10.116959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5517a4-f401-432a-976b-e2601b8ac8bc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:10.130474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5517a4-f401-432a-976b-e2601b8ac8bc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:10.141419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac7c25-7495-494d-8ee6-1548961d77df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:10.142368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac7c25-7495-494d-8ee6-1548961d77df admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:10.143166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac7c25-7495-494d-8ee6-1548961d77df admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:10.143712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac7c25-7495-494d-8ee6-1548961d77df admin admin] PATH_INFO: `/v3/projects/b35bbd921788425798539693ff54ebab/users/d14d1e556e644fcdbab72647f2c47960/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:10.182828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac7c25-7495-494d-8ee6-1548961d77df admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35bbd921788425798539693ff54ebab, user_id=d14d1e556e644fcdbab72647f2c47960, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:10.190307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac7c25-7495-494d-8ee6-1548961d77df admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:10.209746 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1298/2586] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:22:10 2022] PUT /identity/v3/projects/b35bbd921788425798539693ff54ebab/users/d14d1e556e644fcdbab72647f2c47960/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:10.215430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0fa5f-f177-4b1b-b652-2e88e1c511a0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:10.215947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0fa5f-f177-4b1b-b652-2e88e1c511a0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:10.216972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0fa5f-f177-4b1b-b652-2e88e1c511a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:10.238308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3dc0fa5f-f177-4b1b-b652-2e88e1c511a0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:10.240556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3dc0fa5f-f177-4b1b-b652-2e88e1c511a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:10.300806 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1289/2587] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:22:10.310961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac7c25-7495-494d-8ee6-1548961d77df admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:10.312712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-caac7c25-7495-494d-8ee6-1548961d77df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:10.333594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:10.373953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac7c25-7495-494d-8ee6-1548961d77df admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:10.377768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149c836-efee-4537-8a1d-7d87c1452b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:10.378385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c836-efee-4537-8a1d-7d87c1452b1b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:10.378654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c836-efee-4537-8a1d-7d87c1452b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:10.378926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c836-efee-4537-8a1d-7d87c1452b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:10.388421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149c836-efee-4537-8a1d-7d87c1452b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:10.389860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149c836-efee-4537-8a1d-7d87c1452b1b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:10.399654 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1299/2588] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:22:18.677130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf1f1b-8372-4d9f-9b44-a271b4ec4688 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:18.678001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf1f1b-8372-4d9f-9b44-a271b4ec4688 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:18.678298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf1f1b-8372-4d9f-9b44-a271b4ec4688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:18.719333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9bdf1f1b-8372-4d9f-9b44-a271b4ec4688 None None] MFA Rules not processed for user `d14d1e556e644fcdbab72647f2c47960`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:18.721172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9bdf1f1b-8372-4d9f-9b44-a271b4ec4688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:18.758355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:18.815408 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1290/2589] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:18.825845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d09702-7c54-4da2-b171-f960ba7cf195 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:18.826378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d09702-7c54-4da2-b171-f960ba7cf195 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:18.826772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d09702-7c54-4da2-b171-f960ba7cf195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:18.849912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-13d09702-7c54-4da2-b171-f960ba7cf195 None None] MFA Rules not processed for user `d14d1e556e644fcdbab72647f2c47960`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:18.851504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13d09702-7c54-4da2-b171-f960ba7cf195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:18.867403 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1300/2590] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:18.875713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf1f1b-8372-4d9f-9b44-a271b4ec4688 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:18.876863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9bdf1f1b-8372-4d9f-9b44-a271b4ec4688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:19.058536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf1f1b-8372-4d9f-9b44-a271b4ec4688 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:19.075546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4686d-bc8c-4383-a975-b956732c530a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:19.077351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4686d-bc8c-4383-a975-b956732c530a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:19.077639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4686d-bc8c-4383-a975-b956732c530a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:19.079002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4686d-bc8c-4383-a975-b956732c530a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:19.096412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4686d-bc8c-4383-a975-b956732c530a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:19.098067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4686d-bc8c-4383-a975-b956732c530a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:19.111755 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1291/2591] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:22:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:22:20.597075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d09702-7c54-4da2-b171-f960ba7cf195 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:20.597075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13d09702-7c54-4da2-b171-f960ba7cf195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:20.610737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d09702-7c54-4da2-b171-f960ba7cf195 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:20.616865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7f1d4-3fd1-4963-8a85-602b7b8a0193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:20.617536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7f1d4-3fd1-4963-8a85-602b7b8a0193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:20.617816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7f1d4-3fd1-4963-8a85-602b7b8a0193 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:20.618087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7f1d4-3fd1-4963-8a85-602b7b8a0193 admin admin] PATH_INFO: `/v3/users/7fa2ccce773c48e79f4e207debd5b4f1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:20.619629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7f1d4-3fd1-4963-8a85-602b7b8a0193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa2ccce773c48e79f4e207debd5b4f1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:20.622827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7f1d4-3fd1-4963-8a85-602b7b8a0193 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:20.751337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8b7f1d4-3fd1-4963-8a85-602b7b8a0193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa2ccce773c48e79f4e207debd5b4f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:20.753846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8b7f1d4-3fd1-4963-8a85-602b7b8a0193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa2ccce773c48e79f4e207debd5b4f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:20.772546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8b7f1d4-3fd1-4963-8a85-602b7b8a0193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa2ccce773c48e79f4e207debd5b4f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:20.792560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8b7f1d4-3fd1-4963-8a85-602b7b8a0193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa2ccce773c48e79f4e207debd5b4f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:20.821233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8b7f1d4-3fd1-4963-8a85-602b7b8a0193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa2ccce773c48e79f4e207debd5b4f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:20.836712 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1301/2592] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:22:20 2022] DELETE /identity/v3/users/7fa2ccce773c48e79f4e207debd5b4f1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:20.837488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c522bf-5e91-45fa-8656-61d734565d38 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:20.837957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c522bf-5e91-45fa-8656-61d734565d38 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:20.838074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c522bf-5e91-45fa-8656-61d734565d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:20.872991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-30c522bf-5e91-45fa-8656-61d734565d38 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:20.874324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-30c522bf-5e91-45fa-8656-61d734565d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:20.972901 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1292/2593] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:20.983958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7f1d4-3fd1-4963-8a85-602b7b8a0193 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:20.985505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f8b7f1d4-3fd1-4963-8a85-602b7b8a0193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:21.072383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7f1d4-3fd1-4963-8a85-602b7b8a0193 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:21.076698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3af58-91c3-41af-ba7e-6f3cd81ffeab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:21.077452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3af58-91c3-41af-ba7e-6f3cd81ffeab service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:21.077732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3af58-91c3-41af-ba7e-6f3cd81ffeab service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:21.078007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3af58-91c3-41af-ba7e-6f3cd81ffeab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:21.090418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3af58-91c3-41af-ba7e-6f3cd81ffeab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:21.091914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3af58-91c3-41af-ba7e-6f3cd81ffeab service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:21.117092 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1302/2594] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:22:21.333720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c522bf-5e91-45fa-8656-61d734565d38 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:21.335788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-30c522bf-5e91-45fa-8656-61d734565d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:21.360424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c522bf-5e91-45fa-8656-61d734565d38 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:21.396632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3d836-589e-4a99-aaa7-93e0a55a5964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:21.397418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3d836-589e-4a99-aaa7-93e0a55a5964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:21.397601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3d836-589e-4a99-aaa7-93e0a55a5964 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:21.398418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3d836-589e-4a99-aaa7-93e0a55a5964 admin admin] PATH_INFO: `/v3/projects/02b2569b5d894098a095cae74c2f9a2d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:21.401970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3d836-589e-4a99-aaa7-93e0a55a5964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b2569b5d894098a095cae74c2f9a2d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:21.404085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3d836-589e-4a99-aaa7-93e0a55a5964 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:21.484871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:21.507833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ff3d836-589e-4a99-aaa7-93e0a55a5964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b2569b5d894098a095cae74c2f9a2d', 'request_id': 'req-0ff3d836-589e-4a99-aaa7-93e0a55a5964'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:21.510189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf22e3-143c-49ec-acb2-ceba98350c6a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:21.511044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf22e3-143c-49ec-acb2-ceba98350c6a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:21.511911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf22e3-143c-49ec-acb2-ceba98350c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:21.530852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ff3d836-589e-4a99-aaa7-93e0a55a5964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b2569b5d894098a095cae74c2f9a2d', 'request_id': 'req-0ff3d836-589e-4a99-aaa7-93e0a55a5964'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:21.538212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ff3d836-589e-4a99-aaa7-93e0a55a5964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b2569b5d894098a095cae74c2f9a2d', 'request_id': 'req-0ff3d836-589e-4a99-aaa7-93e0a55a5964'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:21.561914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-08bf22e3-143c-49ec-acb2-ceba98350c6a None None] MFA Rules not processed for user `69c85b658b4d499fb6405b2e352358d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:21.563455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08bf22e3-143c-49ec-acb2-ceba98350c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:21.574212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ff3d836-589e-4a99-aaa7-93e0a55a5964 admin admin] The token cache is being invalidate because project 02b2569b5d894098a095cae74c2f9a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:22:21.576262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ff3d836-589e-4a99-aaa7-93e0a55a5964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:21.578273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ff3d836-589e-4a99-aaa7-93e0a55a5964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:21.598471 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1293/2595] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:22:21 2022] DELETE /identity/v3/projects/02b2569b5d894098a095cae74c2f9a2d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:22:21.602344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3d836-589e-4a99-aaa7-93e0a55a5964 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:21.603649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:21.604628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0ff3d836-589e-4a99-aaa7-93e0a55a5964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:21.703731 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1303/2596] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:21 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:21.725733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3d836-589e-4a99-aaa7-93e0a55a5964 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:21.730605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6188220-4856-4493-b439-d6aba4dbd7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:21.731287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6188220-4856-4493-b439-d6aba4dbd7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:21.731602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6188220-4856-4493-b439-d6aba4dbd7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:21.732016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6188220-4856-4493-b439-d6aba4dbd7a1 admin admin] PATH_INFO: `/v3/users/91f8fee1f0d8454289aa5949ae7f50ea` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:21.733256 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6188220-4856-4493-b439-d6aba4dbd7a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91f8fee1f0d8454289aa5949ae7f50ea)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:21.735391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6188220-4856-4493-b439-d6aba4dbd7a1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:21.796277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c6188220-4856-4493-b439-d6aba4dbd7a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91f8fee1f0d8454289aa5949ae7f50ea'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:21.814591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c6188220-4856-4493-b439-d6aba4dbd7a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91f8fee1f0d8454289aa5949ae7f50ea'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:21.817201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c6188220-4856-4493-b439-d6aba4dbd7a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91f8fee1f0d8454289aa5949ae7f50ea'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:21.818017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c6188220-4856-4493-b439-d6aba4dbd7a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91f8fee1f0d8454289aa5949ae7f50ea'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:21.829986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c6188220-4856-4493-b439-d6aba4dbd7a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91f8fee1f0d8454289aa5949ae7f50ea'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:21.851312 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1294/2597] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:22:21 2022] DELETE /identity/v3/users/91f8fee1f0d8454289aa5949ae7f50ea => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:22.134351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf22e3-143c-49ec-acb2-ceba98350c6a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:22.146852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf22e3-143c-49ec-acb2-ceba98350c6a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:22.230481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228015af-2f02-4936-a29d-5a30190fffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:22.231482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228015af-2f02-4936-a29d-5a30190fffb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:22.231959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228015af-2f02-4936-a29d-5a30190fffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:22.232235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228015af-2f02-4936-a29d-5a30190fffb1 admin admin] PATH_INFO: `/v3/projects/39f5ed62bc2e461aa7be4e7fab221c3b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:22.233490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228015af-2f02-4936-a29d-5a30190fffb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f5ed62bc2e461aa7be4e7fab221c3b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:22.235732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228015af-2f02-4936-a29d-5a30190fffb1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:22.296998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-228015af-2f02-4936-a29d-5a30190fffb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f5ed62bc2e461aa7be4e7fab221c3b', 'request_id': 'req-228015af-2f02-4936-a29d-5a30190fffb1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:22.307772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-228015af-2f02-4936-a29d-5a30190fffb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f5ed62bc2e461aa7be4e7fab221c3b', 'request_id': 'req-228015af-2f02-4936-a29d-5a30190fffb1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:22.315452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-228015af-2f02-4936-a29d-5a30190fffb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f5ed62bc2e461aa7be4e7fab221c3b', 'request_id': 'req-228015af-2f02-4936-a29d-5a30190fffb1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:22.340410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-228015af-2f02-4936-a29d-5a30190fffb1 admin admin] The token cache is being invalidate because project 39f5ed62bc2e461aa7be4e7fab221c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:22:22.340952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-228015af-2f02-4936-a29d-5a30190fffb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:22.341858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-228015af-2f02-4936-a29d-5a30190fffb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:22.344222 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1304/2598] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:22:22 2022] DELETE /identity/v3/projects/39f5ed62bc2e461aa7be4e7fab221c3b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:22.348715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89706ce-ef88-45d4-9155-f9466739ea36 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:22.349238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89706ce-ef88-45d4-9155-f9466739ea36 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:22.349732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89706ce-ef88-45d4-9155-f9466739ea36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:22.378317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a89706ce-ef88-45d4-9155-f9466739ea36 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:22.380012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a89706ce-ef88-45d4-9155-f9466739ea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:22.463778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:22.484134 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1295/2599] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:22.491572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f94b4-fe4a-4fe8-8ed1-b9cf57e318dd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:22.491858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f94b4-fe4a-4fe8-8ed1-b9cf57e318dd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:22.492132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f94b4-fe4a-4fe8-8ed1-b9cf57e318dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:22.520701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aa1f94b4-fe4a-4fe8-8ed1-b9cf57e318dd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:22.521973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa1f94b4-fe4a-4fe8-8ed1-b9cf57e318dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:22.539451 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1305/2600] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:22:22.541962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89706ce-ef88-45d4-9155-f9466739ea36 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:22.560200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89706ce-ef88-45d4-9155-f9466739ea36 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:22.577720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3b82e-273a-4d8a-a5dc-3c4695721fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:22.578807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3b82e-273a-4d8a-a5dc-3c4695721fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:22.579386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3b82e-273a-4d8a-a5dc-3c4695721fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:22.579859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3b82e-273a-4d8a-a5dc-3c4695721fd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:22.580854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3b82e-273a-4d8a-a5dc-3c4695721fd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:22:22.581377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3b82e-273a-4d8a-a5dc-3c4695721fd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:22.584183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3b82e-273a-4d8a-a5dc-3c4695721fd9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:22.606095 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1296/2601] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:22.606906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f94b4-fe4a-4fe8-8ed1-b9cf57e318dd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:22.629845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f94b4-fe4a-4fe8-8ed1-b9cf57e318dd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:22.638647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94d6e7-9fce-4ec3-80e4-62fa0424341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:22.639351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94d6e7-9fce-4ec3-80e4-62fa0424341c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:22.639631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94d6e7-9fce-4ec3-80e4-62fa0424341c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:22.639901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94d6e7-9fce-4ec3-80e4-62fa0424341c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:22.640913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94d6e7-9fce-4ec3-80e4-62fa0424341c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:22.642926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94d6e7-9fce-4ec3-80e4-62fa0424341c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:22.689033 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1306/2602] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:22:22 2022] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:22:22.693286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3b82e-273a-4d8a-a5dc-3c4695721fd9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:22.705392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3b82e-273a-4d8a-a5dc-3c4695721fd9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:22.804952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe5125-e1bd-488c-a526-428ed72ec533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:22.806205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe5125-e1bd-488c-a526-428ed72ec533 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:22.806205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe5125-e1bd-488c-a526-428ed72ec533 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:22.806452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe5125-e1bd-488c-a526-428ed72ec533 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:22.807161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe5125-e1bd-488c-a526-428ed72ec533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:22.809671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe5125-e1bd-488c-a526-428ed72ec533 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:22.836542 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1297/2603] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:22:22 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:22:22.842277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94d6e7-9fce-4ec3-80e4-62fa0424341c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:22.858664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94d6e7-9fce-4ec3-80e4-62fa0424341c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:22.872371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af8cb0-e468-4882-96a9-b97208a679ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:22.873026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af8cb0-e468-4882-96a9-b97208a679ce admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:22.874011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af8cb0-e468-4882-96a9-b97208a679ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:22.875427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af8cb0-e468-4882-96a9-b97208a679ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:22.876951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af8cb0-e468-4882-96a9-b97208a679ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:22.881086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af8cb0-e468-4882-96a9-b97208a679ce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:22.896056 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1307/2604] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:22:22.900020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe5125-e1bd-488c-a526-428ed72ec533 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:22.911837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe5125-e1bd-488c-a526-428ed72ec533 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:22.918883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925d94e-46a4-4c11-af61-9bc100460cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:22.919854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925d94e-46a4-4c11-af61-9bc100460cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:22.920303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925d94e-46a4-4c11-af61-9bc100460cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:22.921599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925d94e-46a4-4c11-af61-9bc100460cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:22.922291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925d94e-46a4-4c11-af61-9bc100460cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:22.924025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925d94e-46a4-4c11-af61-9bc100460cb9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:22.958060 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1298/2605] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:22:22.961347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af8cb0-e468-4882-96a9-b97208a679ce admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:22.978809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af8cb0-e468-4882-96a9-b97208a679ce admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:23.007521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf230f-2a2c-407f-8436-98353e2a8b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:23.018907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf230f-2a2c-407f-8436-98353e2a8b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:23.019210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf230f-2a2c-407f-8436-98353e2a8b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:23.019525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf230f-2a2c-407f-8436-98353e2a8b87 admin admin] PATH_INFO: `/v3/projects/0499de335d9e48bdbe84d6fea60f0c9d/users/1d63503961bc4cb38bf4613b1e70f915/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:23.070324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf230f-2a2c-407f-8436-98353e2a8b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0499de335d9e48bdbe84d6fea60f0c9d, user_id=1d63503961bc4cb38bf4613b1e70f915, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:23.073292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf230f-2a2c-407f-8436-98353e2a8b87 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:23.102012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:23.118313 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1308/2606] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:22:22 2022] PUT /identity/v3/projects/0499de335d9e48bdbe84d6fea60f0c9d/users/1d63503961bc4cb38bf4613b1e70f915/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:23.130256 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5713ac4-5775-4a21-ba3a-0bed206352f6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:23.130536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5713ac4-5775-4a21-ba3a-0bed206352f6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:23.130819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5713ac4-5775-4a21-ba3a-0bed206352f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:23.266170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a5713ac4-5775-4a21-ba3a-0bed206352f6 None None] MFA Rules not processed for user `1d63503961bc4cb38bf4613b1e70f915`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:23.267862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a5713ac4-5775-4a21-ba3a-0bed206352f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:23.364424 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1299/2607] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:23.369006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf230f-2a2c-407f-8436-98353e2a8b87 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:23.596014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf230f-2a2c-407f-8436-98353e2a8b87 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:23.608632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a613f9-4f8e-4e21-91e0-a8280543ade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:23.609417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a613f9-4f8e-4e21-91e0-a8280543ade5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:23.609703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a613f9-4f8e-4e21-91e0-a8280543ade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:23.610013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a613f9-4f8e-4e21-91e0-a8280543ade5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:23.610680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a613f9-4f8e-4e21-91e0-a8280543ade5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:23.612929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a613f9-4f8e-4e21-91e0-a8280543ade5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:23.683542 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1309/2608] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:22:23 2022] POST /identity/v3/projects => generated 375 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:22:23.686673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5713ac4-5775-4a21-ba3a-0bed206352f6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:23.722749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5713ac4-5775-4a21-ba3a-0bed206352f6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:23.881870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:23.910658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600e7e7-5553-44d3-aaed-601b451858b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:23.911468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600e7e7-5553-44d3-aaed-601b451858b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:23.911852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600e7e7-5553-44d3-aaed-601b451858b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:23.912227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600e7e7-5553-44d3-aaed-601b451858b7 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:23.912995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600e7e7-5553-44d3-aaed-601b451858b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:23.915391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600e7e7-5553-44d3-aaed-601b451858b7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:23.979837 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1300/2609] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:22:23 2022] POST /identity/v3/users => generated 294 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:22:23.983199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a613f9-4f8e-4e21-91e0-a8280543ade5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:24.004947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a613f9-4f8e-4e21-91e0-a8280543ade5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:24.024338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495acd6-65f4-4ff8-846e-96ead9ea3a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:24.025310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495acd6-65f4-4ff8-846e-96ead9ea3a5a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:24.027221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495acd6-65f4-4ff8-846e-96ead9ea3a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:24.027731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495acd6-65f4-4ff8-846e-96ead9ea3a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:24.028443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495acd6-65f4-4ff8-846e-96ead9ea3a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:24.037090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495acd6-65f4-4ff8-846e-96ead9ea3a5a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:24.064138 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1310/2610] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:22:24.068302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600e7e7-5553-44d3-aaed-601b451858b7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:24.081559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600e7e7-5553-44d3-aaed-601b451858b7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:24.105426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f78289-1f21-4417-8650-ca6d54039c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:24.106760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f78289-1f21-4417-8650-ca6d54039c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:24.107144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f78289-1f21-4417-8650-ca6d54039c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:24.107552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f78289-1f21-4417-8650-ca6d54039c7f admin admin] PATH_INFO: `/v3/projects/80184d2caec447c8905b554e56a091df/users/0c63feb5cd8e458abb5891a18b1ede50/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:24.134176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f78289-1f21-4417-8650-ca6d54039c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=80184d2caec447c8905b554e56a091df, user_id=0c63feb5cd8e458abb5891a18b1ede50, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:24.138808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f78289-1f21-4417-8650-ca6d54039c7f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:24.169841 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1301/2611] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:22:24 2022] PUT /identity/v3/projects/80184d2caec447c8905b554e56a091df/users/0c63feb5cd8e458abb5891a18b1ede50/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:24.174122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495acd6-65f4-4ff8-846e-96ead9ea3a5a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:24.189259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495acd6-65f4-4ff8-846e-96ead9ea3a5a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:24.296467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd8526-cb2c-4637-90f6-b3bebfde7f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:24.297398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd8526-cb2c-4637-90f6-b3bebfde7f69 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:24.297714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd8526-cb2c-4637-90f6-b3bebfde7f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:24.297982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd8526-cb2c-4637-90f6-b3bebfde7f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:24.298654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd8526-cb2c-4637-90f6-b3bebfde7f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:24.307826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd8526-cb2c-4637-90f6-b3bebfde7f69 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:24.327313 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1311/2612] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:22:24.331622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f78289-1f21-4417-8650-ca6d54039c7f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:24.359651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f78289-1f21-4417-8650-ca6d54039c7f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:24.367334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c68512-a0ea-4c22-98e0-772d1ffbd7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:24.368290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c68512-a0ea-4c22-98e0-772d1ffbd7da admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:24.368727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c68512-a0ea-4c22-98e0-772d1ffbd7da admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:24.369159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c68512-a0ea-4c22-98e0-772d1ffbd7da admin admin] PATH_INFO: `/v3/projects/80184d2caec447c8905b554e56a091df/users/0c63feb5cd8e458abb5891a18b1ede50/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:24.374988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c68512-a0ea-4c22-98e0-772d1ffbd7da admin admin] RBAC: Authorizing `identity:create_grant(project_id=80184d2caec447c8905b554e56a091df, user_id=0c63feb5cd8e458abb5891a18b1ede50, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:24.383338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c68512-a0ea-4c22-98e0-772d1ffbd7da admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:24.412489 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1302/2613] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:22:24 2022] PUT /identity/v3/projects/80184d2caec447c8905b554e56a091df/users/0c63feb5cd8e458abb5891a18b1ede50/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:22:24.424958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b90b4c-bc45-4365-ac8d-e78587615d86 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:24.425251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b90b4c-bc45-4365-ac8d-e78587615d86 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:24.425714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b90b4c-bc45-4365-ac8d-e78587615d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:24.493058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d3b90b4c-bc45-4365-ac8d-e78587615d86 None None] MFA Rules not processed for user `0c63feb5cd8e458abb5891a18b1ede50`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:24.496411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3b90b4c-bc45-4365-ac8d-e78587615d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:24.709823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:24.742299 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1312/2614] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:24.749000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c68512-a0ea-4c22-98e0-772d1ffbd7da admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:24.769658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c68512-a0ea-4c22-98e0-772d1ffbd7da admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:24.777914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3bb3b-9e29-4dd3-91bf-296cbc78beda tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:24.778808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3bb3b-9e29-4dd3-91bf-296cbc78beda tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:24.779210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3bb3b-9e29-4dd3-91bf-296cbc78beda tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:24.779547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3bb3b-9e29-4dd3-91bf-296cbc78beda tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:24.780251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3bb3b-9e29-4dd3-91bf-296cbc78beda tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:22:24.780558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3bb3b-9e29-4dd3-91bf-296cbc78beda tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:24.782458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3bb3b-9e29-4dd3-91bf-296cbc78beda tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:24.810208 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1303/2615] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:24.814714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b90b4c-bc45-4365-ac8d-e78587615d86 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:24.835589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b90b4c-bc45-4365-ac8d-e78587615d86 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:24.842413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca5bcf-1bb3-4270-9558-b35a2ed0b336 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:24.844351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca5bcf-1bb3-4270-9558-b35a2ed0b336 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:24.844798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca5bcf-1bb3-4270-9558-b35a2ed0b336 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:24.845387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca5bcf-1bb3-4270-9558-b35a2ed0b336 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:24.846381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca5bcf-1bb3-4270-9558-b35a2ed0b336 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:24.848908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca5bcf-1bb3-4270-9558-b35a2ed0b336 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:24.889743 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1313/2616] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:22:24 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:22:24.894192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3bb3b-9e29-4dd3-91bf-296cbc78beda tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:24.905174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3bb3b-9e29-4dd3-91bf-296cbc78beda tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:24.991752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2734ba-abfb-4d4c-b7c0-9f92fbfc4f4d tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:24.992507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2734ba-abfb-4d4c-b7c0-9f92fbfc4f4d tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:24.993085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2734ba-abfb-4d4c-b7c0-9f92fbfc4f4d tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:24.993734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2734ba-abfb-4d4c-b7c0-9f92fbfc4f4d tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:24.994653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2734ba-abfb-4d4c-b7c0-9f92fbfc4f4d tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:22:24.995217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2734ba-abfb-4d4c-b7c0-9f92fbfc4f4d tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:24.998385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2734ba-abfb-4d4c-b7c0-9f92fbfc4f4d tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:25.033430 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1304/2617] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:25.499188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca5bcf-1bb3-4270-9558-b35a2ed0b336 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:25.502457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bdca5bcf-1bb3-4270-9558-b35a2ed0b336 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:25.615829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca5bcf-1bb3-4270-9558-b35a2ed0b336 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:25.625460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3c93e-3160-40c8-b661-93757f7b9e55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:25.626595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3c93e-3160-40c8-b661-93757f7b9e55 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:25.627088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3c93e-3160-40c8-b661-93757f7b9e55 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:25.627676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3c93e-3160-40c8-b661-93757f7b9e55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:25.641932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3c93e-3160-40c8-b661-93757f7b9e55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:25.644095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3c93e-3160-40c8-b661-93757f7b9e55 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:25.657907 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1314/2618] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:22:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:22:25.689209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7758ee5-09a5-4493-9788-91ae83f6f427 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:25.689921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7758ee5-09a5-4493-9788-91ae83f6f427 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:25.690360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7758ee5-09a5-4493-9788-91ae83f6f427 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:25.693293 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1305/2619] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:22:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:22:25.699107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3c93e-3160-40c8-b661-93757f7b9e55 service nova] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:22:25.713964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3c93e-3160-40c8-b661-93757f7b9e55 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:25.725131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3c93e-3160-40c8-b661-93757f7b9e55 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:25.732362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918aae7d-bd38-4c2a-961e-00fb2a553ac4 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:25.735077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aae7d-bd38-4c2a-961e-00fb2a553ac4 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:25.735579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aae7d-bd38-4c2a-961e-00fb2a553ac4 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:25.736056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aae7d-bd38-4c2a-961e-00fb2a553ac4 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/projects/3053c450dd7a4d53afd9892a74f45a09` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:25.737644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918aae7d-bd38-4c2a-961e-00fb2a553ac4 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:get_project(project_id=3053c450dd7a4d53afd9892a74f45a09)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:25.739990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918aae7d-bd38-4c2a-961e-00fb2a553ac4 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:25.742256 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1315/2620] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:22:25 2022] GET /identity/v3/projects/3053c450dd7a4d53afd9892a74f45a09 => generated 371 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:26.448304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74991-e76b-4ba5-8e89-a45de3fc2b71 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:26.449413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74991-e76b-4ba5-8e89-a45de3fc2b71 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:26.449876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74991-e76b-4ba5-8e89-a45de3fc2b71 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:26.451878 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1306/2621] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:22:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:22:26.457313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918aae7d-bd38-4c2a-961e-00fb2a553ac4 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:22:26.484457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918aae7d-bd38-4c2a-961e-00fb2a553ac4 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:26.502609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918aae7d-bd38-4c2a-961e-00fb2a553ac4 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:26.511533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcc80e-de8e-4273-8f07-04315d429c4e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:26.514350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcc80e-de8e-4273-8f07-04315d429c4e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:26.514893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcc80e-de8e-4273-8f07-04315d429c4e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:26.515436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcc80e-de8e-4273-8f07-04315d429c4e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/projects/3053c450dd7a4d53afd9892a74f45a09` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:26.520349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcc80e-de8e-4273-8f07-04315d429c4e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:get_project(project_id=3053c450dd7a4d53afd9892a74f45a09)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:26.522851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcc80e-de8e-4273-8f07-04315d429c4e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:26.530667 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1316/2622] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:22:26 2022] GET /identity/v3/projects/3053c450dd7a4d53afd9892a74f45a09 => generated 371 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:27.524085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e2d92-9887-495f-b270-2b0ddad061ae None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:27.525241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e2d92-9887-495f-b270-2b0ddad061ae None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:27.525739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e2d92-9887-495f-b270-2b0ddad061ae None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:27.527784 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1307/2623] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:22:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:22:27.533900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcc80e-de8e-4273-8f07-04315d429c4e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:22:27.549777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcc80e-de8e-4273-8f07-04315d429c4e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:27.590599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcc80e-de8e-4273-8f07-04315d429c4e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:27.596691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dca4a-abe7-451e-a440-743c95369909 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:27.597635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dca4a-abe7-451e-a440-743c95369909 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:27.598130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dca4a-abe7-451e-a440-743c95369909 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:27.598653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dca4a-abe7-451e-a440-743c95369909 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/projects/3053c450dd7a4d53afd9892a74f45a09` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:27.600071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dca4a-abe7-451e-a440-743c95369909 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:get_project(project_id=3053c450dd7a4d53afd9892a74f45a09)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:27.602642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dca4a-abe7-451e-a440-743c95369909 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:27.605595 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1317/2624] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:22:27 2022] GET /identity/v3/projects/3053c450dd7a4d53afd9892a74f45a09 => generated 371 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:27.635340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e2d92-9887-495f-b270-2b0ddad061ae None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:27.652720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e2d92-9887-495f-b270-2b0ddad061ae None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:27.659791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:27.661078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:27.661908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:27.662805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/projects/3053c450dd7a4d53afd9892a74f45a09` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:27.665239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3053c450dd7a4d53afd9892a74f45a09)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:27.668171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:27.729378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3053c450dd7a4d53afd9892a74f45a09', 'request_id': 'req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:27.740041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3053c450dd7a4d53afd9892a74f45a09', 'request_id': 'req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:27.747774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3053c450dd7a4d53afd9892a74f45a09', 'request_id': 'req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:27.762568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] The token cache is being invalidate because project 3053c450dd7a4d53afd9892a74f45a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:22:27.763835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:27.763978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:27.765971 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1308/2625] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:22:27 2022] DELETE /identity/v3/projects/3053c450dd7a4d53afd9892a74f45a09 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:28.699966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bf05e-f2ae-4a1b-a333-ae1b05102207 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:28.700604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bf05e-f2ae-4a1b-a333-ae1b05102207 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:28.700604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bf05e-f2ae-4a1b-a333-ae1b05102207 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:28.702622 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1318/2626] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:22:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:22:28.709139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:22:28.711481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:28.720073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:28.805755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:28.808604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:28.890525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efad2a-4d5d-4b7f-b490-a576cf0d5b0c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:28.899900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059dd22-2512-4b11-82ba-86c7b165bca3 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:28.900727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059dd22-2512-4b11-82ba-86c7b165bca3 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:28.901109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059dd22-2512-4b11-82ba-86c7b165bca3 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:28.901526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059dd22-2512-4b11-82ba-86c7b165bca3 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/projects/0499de335d9e48bdbe84d6fea60f0c9d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:28.902865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059dd22-2512-4b11-82ba-86c7b165bca3 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:get_project(project_id=0499de335d9e48bdbe84d6fea60f0c9d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:28.905270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059dd22-2512-4b11-82ba-86c7b165bca3 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:28.907439 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1309/2627] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:22:28 2022] GET /identity/v3/projects/0499de335d9e48bdbe84d6fea60f0c9d => generated 375 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:22:28.933809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bf05e-f2ae-4a1b-a333-ae1b05102207 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:28.955172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bf05e-f2ae-4a1b-a333-ae1b05102207 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:28.960805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb514019-06b4-4a90-83f4-733e645db310 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:28.961847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb514019-06b4-4a90-83f4-733e645db310 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:28.962417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb514019-06b4-4a90-83f4-733e645db310 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:28.962903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb514019-06b4-4a90-83f4-733e645db310 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:28.964239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb514019-06b4-4a90-83f4-733e645db310 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:22:28.964721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb514019-06b4-4a90-83f4-733e645db310 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:28.966800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb514019-06b4-4a90-83f4-733e645db310 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:29.003563 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1319/2628] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:29.004361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059dd22-2512-4b11-82ba-86c7b165bca3 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:29.018593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059dd22-2512-4b11-82ba-86c7b165bca3 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:29.033858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82f40c-9631-464f-823f-e1aad121f0d7 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:29.035001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f40c-9631-464f-823f-e1aad121f0d7 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:29.035305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f40c-9631-464f-823f-e1aad121f0d7 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:29.035590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f40c-9631-464f-823f-e1aad121f0d7 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:29.036252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82f40c-9631-464f-823f-e1aad121f0d7 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:29.040855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82f40c-9631-464f-823f-e1aad121f0d7 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:29.105637 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1310/2629] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:22:29 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:22:29.109882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb514019-06b4-4a90-83f4-733e645db310 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:29.127337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb514019-06b4-4a90-83f4-733e645db310 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:29.247532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b87183-6163-4be1-8f34-e759bfaaf325 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:29.248384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b87183-6163-4be1-8f34-e759bfaaf325 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:29.248761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b87183-6163-4be1-8f34-e759bfaaf325 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:29.249211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b87183-6163-4be1-8f34-e759bfaaf325 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:29.250153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b87183-6163-4be1-8f34-e759bfaaf325 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:22:29.250658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b87183-6163-4be1-8f34-e759bfaaf325 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:29.252581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b87183-6163-4be1-8f34-e759bfaaf325 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:29.295327 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1320/2630] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:29.837276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b83ac-efdd-4a15-9cb4-ae5930d073d4 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:29.837276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b83ac-efdd-4a15-9cb4-ae5930d073d4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:29.837276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b83ac-efdd-4a15-9cb4-ae5930d073d4 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:29.837276 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1311/2631] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:22:29.843486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b87183-6163-4be1-8f34-e759bfaaf325 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:22:29.845513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-31b87183-6163-4be1-8f34-e759bfaaf325 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:29.863204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:29.968130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b87183-6163-4be1-8f34-e759bfaaf325 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:29.988293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b87183-6163-4be1-8f34-e759bfaaf325 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:30.000714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b4fd3-1138-4cc9-b185-a4248c23ba02 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:30.001653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b4fd3-1138-4cc9-b185-a4248c23ba02 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:30.002011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b4fd3-1138-4cc9-b185-a4248c23ba02 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:30.002757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b4fd3-1138-4cc9-b185-a4248c23ba02 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/projects/7923ee703f3c4790a9caabb4721dd8de` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:30.004758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b4fd3-1138-4cc9-b185-a4248c23ba02 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:get_project(project_id=7923ee703f3c4790a9caabb4721dd8de)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:30.008598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b4fd3-1138-4cc9-b185-a4248c23ba02 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:30.023567 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1321/2632] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:22:29 2022] GET /identity/v3/projects/7923ee703f3c4790a9caabb4721dd8de => generated 365 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:22:32.538272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4347cc4-b2ce-4d42-9394-a96288bbf16b None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:32.538893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4347cc4-b2ce-4d42-9394-a96288bbf16b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:32.538893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4347cc4-b2ce-4d42-9394-a96288bbf16b None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:32.541152 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1312/2633] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:22:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:22:32.550761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b4fd3-1138-4cc9-b185-a4248c23ba02 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:22:32.581226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b4fd3-1138-4cc9-b185-a4248c23ba02 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:32.592708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b4fd3-1138-4cc9-b185-a4248c23ba02 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:32.599828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d273e-fef7-492d-b2e5-2e123276605e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:32.600605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d273e-fef7-492d-b2e5-2e123276605e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:32.600958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d273e-fef7-492d-b2e5-2e123276605e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:32.601524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d273e-fef7-492d-b2e5-2e123276605e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/projects/7923ee703f3c4790a9caabb4721dd8de` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:32.603482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d273e-fef7-492d-b2e5-2e123276605e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:get_project(project_id=7923ee703f3c4790a9caabb4721dd8de)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:32.605988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d273e-fef7-492d-b2e5-2e123276605e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:32.608752 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1322/2634] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:22:32 2022] GET /identity/v3/projects/7923ee703f3c4790a9caabb4721dd8de => generated 365 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:32.664391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4347cc4-b2ce-4d42-9394-a96288bbf16b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:32.685147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4347cc4-b2ce-4d42-9394-a96288bbf16b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:32.691645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee28e4-8be0-4bbe-a19e-7c38cdd92938 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:32.693769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee28e4-8be0-4bbe-a19e-7c38cdd92938 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:32.694494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee28e4-8be0-4bbe-a19e-7c38cdd92938 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:32.695595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee28e4-8be0-4bbe-a19e-7c38cdd92938 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:32.697330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee28e4-8be0-4bbe-a19e-7c38cdd92938 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:22:32.698340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee28e4-8be0-4bbe-a19e-7c38cdd92938 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:32.702189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee28e4-8be0-4bbe-a19e-7c38cdd92938 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:32.737138 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1313/2635] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:32.741388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d273e-fef7-492d-b2e5-2e123276605e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:32.753858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d273e-fef7-492d-b2e5-2e123276605e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:32.759088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c761a5d-3ba6-47a2-8df2-5252ab80afa4 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:32.760043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c761a5d-3ba6-47a2-8df2-5252ab80afa4 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:32.760659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c761a5d-3ba6-47a2-8df2-5252ab80afa4 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:32.761124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c761a5d-3ba6-47a2-8df2-5252ab80afa4 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:32.761819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c761a5d-3ba6-47a2-8df2-5252ab80afa4 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:32.764067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c761a5d-3ba6-47a2-8df2-5252ab80afa4 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:32.795754 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1323/2636] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:22:32 2022] POST /identity/v3/users => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:22:32.800236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee28e4-8be0-4bbe-a19e-7c38cdd92938 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:32.814141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee28e4-8be0-4bbe-a19e-7c38cdd92938 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:32.819926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7388d-92a6-475b-bc45-622cc9be7486 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:32.820752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7388d-92a6-475b-bc45-622cc9be7486 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:32.821113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7388d-92a6-475b-bc45-622cc9be7486 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:32.821467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7388d-92a6-475b-bc45-622cc9be7486 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:32.822326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7388d-92a6-475b-bc45-622cc9be7486 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:22:32.822699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7388d-92a6-475b-bc45-622cc9be7486 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:32.824391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7388d-92a6-475b-bc45-622cc9be7486 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:32.839191 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1314/2637] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:33.251616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f0f39-c9c1-494f-b9f1-4a87b7240a61 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:33.251933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f0f39-c9c1-494f-b9f1-4a87b7240a61 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:33.252216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f0f39-c9c1-494f-b9f1-4a87b7240a61 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:33.254310 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1324/2638] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:22:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:22:33.259888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7388d-92a6-475b-bc45-622cc9be7486 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:22:33.274075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7388d-92a6-475b-bc45-622cc9be7486 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:33.285757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7388d-92a6-475b-bc45-622cc9be7486 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:33.291560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea1142-9e1e-4e9d-9fae-806ee419c981 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:33.292217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea1142-9e1e-4e9d-9fae-806ee419c981 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:33.292498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea1142-9e1e-4e9d-9fae-806ee419c981 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:33.292771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea1142-9e1e-4e9d-9fae-806ee419c981 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/projects/7923ee703f3c4790a9caabb4721dd8de` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:33.293970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea1142-9e1e-4e9d-9fae-806ee419c981 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:get_project(project_id=7923ee703f3c4790a9caabb4721dd8de)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:33.296071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea1142-9e1e-4e9d-9fae-806ee419c981 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:33.297824 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1315/2639] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:22:33 2022] GET /identity/v3/projects/7923ee703f3c4790a9caabb4721dd8de => generated 365 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:33.496681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c8741-ffad-4c48-8bbd-8c2885ba36d2 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:33.497505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c8741-ffad-4c48-8bbd-8c2885ba36d2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:33.498778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c8741-ffad-4c48-8bbd-8c2885ba36d2 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:33.505176 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1325/2640] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:22:33 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:22:33.516756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea1142-9e1e-4e9d-9fae-806ee419c981 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:22:33.538185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea1142-9e1e-4e9d-9fae-806ee419c981 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:33.562665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea1142-9e1e-4e9d-9fae-806ee419c981 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:33.577405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f4bd8-2e1a-461e-9c68-da1f51276f7c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:33.578063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f4bd8-2e1a-461e-9c68-da1f51276f7c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:33.578421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f4bd8-2e1a-461e-9c68-da1f51276f7c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:33.579182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f4bd8-2e1a-461e-9c68-da1f51276f7c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/projects/7923ee703f3c4790a9caabb4721dd8de` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:33.580516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f4bd8-2e1a-461e-9c68-da1f51276f7c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:get_project(project_id=7923ee703f3c4790a9caabb4721dd8de)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:33.582663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f4bd8-2e1a-461e-9c68-da1f51276f7c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:33.584526 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1316/2641] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:22:33 2022] GET /identity/v3/projects/7923ee703f3c4790a9caabb4721dd8de => generated 365 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:33.629581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c8741-ffad-4c48-8bbd-8c2885ba36d2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:33.665349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c8741-ffad-4c48-8bbd-8c2885ba36d2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:33.674893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789edd2-c81b-47dc-aad7-6188aa932902 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:33.675779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789edd2-c81b-47dc-aad7-6188aa932902 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:33.678510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789edd2-c81b-47dc-aad7-6188aa932902 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:33.679306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789edd2-c81b-47dc-aad7-6188aa932902 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/users/367b9a69b208441884bd41ce09795f4e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:33.717690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789edd2-c81b-47dc-aad7-6188aa932902 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:delete_user(user_id=367b9a69b208441884bd41ce09795f4e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:33.719916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789edd2-c81b-47dc-aad7-6188aa932902 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:33.785495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b789edd2-c81b-47dc-aad7-6188aa932902 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367b9a69b208441884bd41ce09795f4e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:33.786243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b789edd2-c81b-47dc-aad7-6188aa932902 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367b9a69b208441884bd41ce09795f4e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:33.795076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b789edd2-c81b-47dc-aad7-6188aa932902 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367b9a69b208441884bd41ce09795f4e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:33.808413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b789edd2-c81b-47dc-aad7-6188aa932902 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367b9a69b208441884bd41ce09795f4e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:33.840392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b789edd2-c81b-47dc-aad7-6188aa932902 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367b9a69b208441884bd41ce09795f4e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:33.853705 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1326/2642] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:22:33 2022] DELETE /identity/v3/users/367b9a69b208441884bd41ce09795f4e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:33.857876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f4bd8-2e1a-461e-9c68-da1f51276f7c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:33.861640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1f8f4bd8-2e1a-461e-9c68-da1f51276f7c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:33.878729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f4bd8-2e1a-461e-9c68-da1f51276f7c tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:33.923236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:33.959966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca503d-392d-4a33-9151-b98295801aa0 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:33.960606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca503d-392d-4a33-9151-b98295801aa0 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:33.961086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca503d-392d-4a33-9151-b98295801aa0 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:33.961198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca503d-392d-4a33-9151-b98295801aa0 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/projects/7923ee703f3c4790a9caabb4721dd8de` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:33.962586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca503d-392d-4a33-9151-b98295801aa0 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7923ee703f3c4790a9caabb4721dd8de)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:33.965456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca503d-392d-4a33-9151-b98295801aa0 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:34.069807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-aeca503d-392d-4a33-9151-b98295801aa0 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7923ee703f3c4790a9caabb4721dd8de', 'request_id': 'req-aeca503d-392d-4a33-9151-b98295801aa0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:34.078403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-aeca503d-392d-4a33-9151-b98295801aa0 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7923ee703f3c4790a9caabb4721dd8de', 'request_id': 'req-aeca503d-392d-4a33-9151-b98295801aa0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:34.085519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-aeca503d-392d-4a33-9151-b98295801aa0 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7923ee703f3c4790a9caabb4721dd8de', 'request_id': 'req-aeca503d-392d-4a33-9151-b98295801aa0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:34.110296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-aeca503d-392d-4a33-9151-b98295801aa0 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] The token cache is being invalidate because project 7923ee703f3c4790a9caabb4721dd8de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:22:34.110296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-aeca503d-392d-4a33-9151-b98295801aa0 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:34.118129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-aeca503d-392d-4a33-9151-b98295801aa0 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:34.128812 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1317/2643] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:22:33 2022] DELETE /identity/v3/projects/7923ee703f3c4790a9caabb4721dd8de => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:34.611579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86eb04-2a16-4e24-b193-db53c2de9702 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:34.612009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86eb04-2a16-4e24-b193-db53c2de9702 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:34.612110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86eb04-2a16-4e24-b193-db53c2de9702 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:34.613650 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1327/2644] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:22:34.621364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca503d-392d-4a33-9151-b98295801aa0 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:22:34.623615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aeca503d-392d-4a33-9151-b98295801aa0 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:34.753363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca503d-392d-4a33-9151-b98295801aa0 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:34.755017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aeca503d-392d-4a33-9151-b98295801aa0 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:34.854934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca503d-392d-4a33-9151-b98295801aa0 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:34.860528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80ffbe-b5e4-4431-aae4-701cfb360424 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:34.861363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80ffbe-b5e4-4431-aae4-701cfb360424 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:34.861919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80ffbe-b5e4-4431-aae4-701cfb360424 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:34.862545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80ffbe-b5e4-4431-aae4-701cfb360424 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/projects/0499de335d9e48bdbe84d6fea60f0c9d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:34.864148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80ffbe-b5e4-4431-aae4-701cfb360424 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:get_project(project_id=0499de335d9e48bdbe84d6fea60f0c9d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:34.866901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80ffbe-b5e4-4431-aae4-701cfb360424 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:34.871041 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1318/2645] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:22:34 2022] GET /identity/v3/projects/0499de335d9e48bdbe84d6fea60f0c9d => generated 375 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:35.365490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec10a9e-9672-4f76-9966-083047234659 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:35.366094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec10a9e-9672-4f76-9966-083047234659 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:35.366394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec10a9e-9672-4f76-9966-083047234659 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:35.368257 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1328/2646] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:22:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:22:35.373859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80ffbe-b5e4-4431-aae4-701cfb360424 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:22:35.384774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:35.391783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80ffbe-b5e4-4431-aae4-701cfb360424 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:35.408563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80ffbe-b5e4-4431-aae4-701cfb360424 tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:35.420806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eca51d-3da0-46fa-89af-ae820a887e8f tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:35.422118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eca51d-3da0-46fa-89af-ae820a887e8f tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:35.422588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eca51d-3da0-46fa-89af-ae820a887e8f tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:35.423032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eca51d-3da0-46fa-89af-ae820a887e8f tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/projects/0499de335d9e48bdbe84d6fea60f0c9d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:35.425897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eca51d-3da0-46fa-89af-ae820a887e8f tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:get_project(project_id=0499de335d9e48bdbe84d6fea60f0c9d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:35.431158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eca51d-3da0-46fa-89af-ae820a887e8f tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:35.437200 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1319/2647] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:22:35 2022] GET /identity/v3/projects/0499de335d9e48bdbe84d6fea60f0c9d => generated 375 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:35.842491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1fe25-7f3c-4acb-a564-11fa5f3728bd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:35.843424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1fe25-7f3c-4acb-a564-11fa5f3728bd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:35.844299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1fe25-7f3c-4acb-a564-11fa5f3728bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:35.872246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8cb1fe25-7f3c-4acb-a564-11fa5f3728bd None None] MFA Rules not processed for user `53d18719bae54f7aae765e0d02979170`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:35.874396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8cb1fe25-7f3c-4acb-a564-11fa5f3728bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:35.928189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:35.985949 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1329/2648] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:36.272260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe4588-2d2e-44cc-a986-449771dfc6c7 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:36.273497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe4588-2d2e-44cc-a986-449771dfc6c7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:36.273957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe4588-2d2e-44cc-a986-449771dfc6c7 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:36.275833 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1320/2649] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:22:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:22:36.286077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1fe25-7f3c-4acb-a564-11fa5f3728bd None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:22:36.302078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1fe25-7f3c-4acb-a564-11fa5f3728bd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:36.314792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1fe25-7f3c-4acb-a564-11fa5f3728bd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:36.320805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01ca59-d6f8-44e8-8fef-5039c142447e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c63feb5cd8e458abb5891a18b1ede50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80184d2caec447c8905b554e56a091df', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:36.320922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01ca59-d6f8-44e8-8fef-5039c142447e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:36.321134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01ca59-d6f8-44e8-8fef-5039c142447e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:36.321372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01ca59-d6f8-44e8-8fef-5039c142447e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] PATH_INFO: `/v3/projects/0499de335d9e48bdbe84d6fea60f0c9d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:36.329339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01ca59-d6f8-44e8-8fef-5039c142447e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorizing `identity:get_project(project_id=0499de335d9e48bdbe84d6fea60f0c9d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:36.334835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01ca59-d6f8-44e8-8fef-5039c142447e tempest-QuotasAdminTestJSON-1856258384 tempest-QuotasAdminTestJSON-1856258384-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:36.336947 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1330/2650] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:22:36 2022] GET /identity/v3/projects/0499de335d9e48bdbe84d6fea60f0c9d => generated 375 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:36.799345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe4588-2d2e-44cc-a986-449771dfc6c7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:36.801146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2ffe4588-2d2e-44cc-a986-449771dfc6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:36.965688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe4588-2d2e-44cc-a986-449771dfc6c7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:36.981523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7da625-af5f-47db-96a7-f9458f38c9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:36.982862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7da625-af5f-47db-96a7-f9458f38c9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:36.983150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7da625-af5f-47db-96a7-f9458f38c9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:36.983583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7da625-af5f-47db-96a7-f9458f38c9dc admin admin] PATH_INFO: `/v3/users/1d63503961bc4cb38bf4613b1e70f915` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:36.985024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7da625-af5f-47db-96a7-f9458f38c9dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d63503961bc4cb38bf4613b1e70f915)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:36.988100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7da625-af5f-47db-96a7-f9458f38c9dc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:37.123513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9c7da625-af5f-47db-96a7-f9458f38c9dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d63503961bc4cb38bf4613b1e70f915'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:37.161704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9c7da625-af5f-47db-96a7-f9458f38c9dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d63503961bc4cb38bf4613b1e70f915'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:37.163368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9c7da625-af5f-47db-96a7-f9458f38c9dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d63503961bc4cb38bf4613b1e70f915'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:37.164524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9c7da625-af5f-47db-96a7-f9458f38c9dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d63503961bc4cb38bf4613b1e70f915'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:37.189596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9c7da625-af5f-47db-96a7-f9458f38c9dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d63503961bc4cb38bf4613b1e70f915'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:37.236565 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1321/2651] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:22:36 2022] DELETE /identity/v3/users/1d63503961bc4cb38bf4613b1e70f915 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:37.238341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0ab57-209c-4709-9a64-622c7238c5f5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:37.239190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0ab57-209c-4709-9a64-622c7238c5f5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:37.239959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0ab57-209c-4709-9a64-622c7238c5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:37.314351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d5b0ab57-209c-4709-9a64-622c7238c5f5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:37.315714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5b0ab57-209c-4709-9a64-622c7238c5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:37.481457 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1331/2652] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:37.506464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7da625-af5f-47db-96a7-f9458f38c9dc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:37.508103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9c7da625-af5f-47db-96a7-f9458f38c9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:37.636930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7da625-af5f-47db-96a7-f9458f38c9dc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:37.642678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfb948-0e3b-4e54-9789-7d336d83b07c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:37.643971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfb948-0e3b-4e54-9789-7d336d83b07c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:37.644408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfb948-0e3b-4e54-9789-7d336d83b07c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:37.644882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfb948-0e3b-4e54-9789-7d336d83b07c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:37.657445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfb948-0e3b-4e54-9789-7d336d83b07c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:37.659900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfb948-0e3b-4e54-9789-7d336d83b07c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:37.683713 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1322/2653] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:22:38.332977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0ab57-209c-4709-9a64-622c7238c5f5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:38.336479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5b0ab57-209c-4709-9a64-622c7238c5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:38.360396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0ab57-209c-4709-9a64-622c7238c5f5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:38.377574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d22c2-ec8e-47cf-b266-adfc12802db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:38.378253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d22c2-ec8e-47cf-b266-adfc12802db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:38.378528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d22c2-ec8e-47cf-b266-adfc12802db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:38.378804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d22c2-ec8e-47cf-b266-adfc12802db3 admin admin] PATH_INFO: `/v3/projects/0499de335d9e48bdbe84d6fea60f0c9d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:38.381476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d22c2-ec8e-47cf-b266-adfc12802db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0499de335d9e48bdbe84d6fea60f0c9d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:38.383942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d22c2-ec8e-47cf-b266-adfc12802db3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:38.464399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-843d22c2-ec8e-47cf-b266-adfc12802db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0499de335d9e48bdbe84d6fea60f0c9d', 'request_id': 'req-843d22c2-ec8e-47cf-b266-adfc12802db3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:38.478706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-843d22c2-ec8e-47cf-b266-adfc12802db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0499de335d9e48bdbe84d6fea60f0c9d', 'request_id': 'req-843d22c2-ec8e-47cf-b266-adfc12802db3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:38.492508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-843d22c2-ec8e-47cf-b266-adfc12802db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0499de335d9e48bdbe84d6fea60f0c9d', 'request_id': 'req-843d22c2-ec8e-47cf-b266-adfc12802db3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:38.508223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-843d22c2-ec8e-47cf-b266-adfc12802db3 admin admin] The token cache is being invalidate because project 0499de335d9e48bdbe84d6fea60f0c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:22:38.508999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-843d22c2-ec8e-47cf-b266-adfc12802db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:38.509838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-843d22c2-ec8e-47cf-b266-adfc12802db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:38.511925 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1332/2654] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:22:38 2022] DELETE /identity/v3/projects/0499de335d9e48bdbe84d6fea60f0c9d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:38.516310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfb948-0e3b-4e54-9789-7d336d83b07c service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:38.536544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfb948-0e3b-4e54-9789-7d336d83b07c service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:38.553559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:38.631211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcdf4c-caab-4c8d-9284-a1b2fc6bf37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:38.632108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcdf4c-caab-4c8d-9284-a1b2fc6bf37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:38.632575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcdf4c-caab-4c8d-9284-a1b2fc6bf37d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:38.632870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcdf4c-caab-4c8d-9284-a1b2fc6bf37d admin admin] PATH_INFO: `/v3/users/0c63feb5cd8e458abb5891a18b1ede50` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:38.634243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcdf4c-caab-4c8d-9284-a1b2fc6bf37d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c63feb5cd8e458abb5891a18b1ede50)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:38.636711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcdf4c-caab-4c8d-9284-a1b2fc6bf37d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:38.712242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-92dcdf4c-caab-4c8d-9284-a1b2fc6bf37d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c63feb5cd8e458abb5891a18b1ede50'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:38.732454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-92dcdf4c-caab-4c8d-9284-a1b2fc6bf37d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c63feb5cd8e458abb5891a18b1ede50'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:38.733770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-92dcdf4c-caab-4c8d-9284-a1b2fc6bf37d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c63feb5cd8e458abb5891a18b1ede50'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:38.735186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-92dcdf4c-caab-4c8d-9284-a1b2fc6bf37d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c63feb5cd8e458abb5891a18b1ede50'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:38.750856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-92dcdf4c-caab-4c8d-9284-a1b2fc6bf37d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c63feb5cd8e458abb5891a18b1ede50'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:38.809032 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1323/2655] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:22:38 2022] DELETE /identity/v3/users/0c63feb5cd8e458abb5891a18b1ede50 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:22:39.851522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d22c2-ec8e-47cf-b266-adfc12802db3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:39.853072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-843d22c2-ec8e-47cf-b266-adfc12802db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:39.878358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d22c2-ec8e-47cf-b266-adfc12802db3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:40.001799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:40.024602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec1208-bd26-4f77-ac69-86cfe11c8420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:40.025279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec1208-bd26-4f77-ac69-86cfe11c8420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:40.026278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec1208-bd26-4f77-ac69-86cfe11c8420 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:40.026693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec1208-bd26-4f77-ac69-86cfe11c8420 admin admin] PATH_INFO: `/v3/projects/80184d2caec447c8905b554e56a091df` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:40.028269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec1208-bd26-4f77-ac69-86cfe11c8420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80184d2caec447c8905b554e56a091df)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:40.040599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec1208-bd26-4f77-ac69-86cfe11c8420 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:40.144741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-37ec1208-bd26-4f77-ac69-86cfe11c8420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80184d2caec447c8905b554e56a091df', 'request_id': 'req-37ec1208-bd26-4f77-ac69-86cfe11c8420'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:40.160051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-37ec1208-bd26-4f77-ac69-86cfe11c8420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80184d2caec447c8905b554e56a091df', 'request_id': 'req-37ec1208-bd26-4f77-ac69-86cfe11c8420'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:40.168645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-37ec1208-bd26-4f77-ac69-86cfe11c8420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80184d2caec447c8905b554e56a091df', 'request_id': 'req-37ec1208-bd26-4f77-ac69-86cfe11c8420'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:40.202568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-37ec1208-bd26-4f77-ac69-86cfe11c8420 admin admin] The token cache is being invalidate because project 80184d2caec447c8905b554e56a091df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:22:40.203036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-37ec1208-bd26-4f77-ac69-86cfe11c8420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:40.203859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-37ec1208-bd26-4f77-ac69-86cfe11c8420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:40.206282 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1333/2656] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:22:39 2022] DELETE /identity/v3/projects/80184d2caec447c8905b554e56a091df => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:40.215820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63838bd0-2a6f-4ff7-ac42-ff5bb4d18089 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:40.216968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63838bd0-2a6f-4ff7-ac42-ff5bb4d18089 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:40.216968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63838bd0-2a6f-4ff7-ac42-ff5bb4d18089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:40.257069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-63838bd0-2a6f-4ff7-ac42-ff5bb4d18089 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:40.258327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-63838bd0-2a6f-4ff7-ac42-ff5bb4d18089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:40.391031 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1324/2657] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:40.466819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d559a-3971-44da-b895-c7050c194500 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:40.467639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d559a-3971-44da-b895-c7050c194500 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:40.468642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d559a-3971-44da-b895-c7050c194500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:40.503770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ce1d559a-3971-44da-b895-c7050c194500 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:40.505022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce1d559a-3971-44da-b895-c7050c194500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:40.513526 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1334/2658] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:40.518150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63838bd0-2a6f-4ff7-ac42-ff5bb4d18089 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:40.528275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63838bd0-2a6f-4ff7-ac42-ff5bb4d18089 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:40.539912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e632ef6-7378-4229-b52c-381f47eec208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:40.540672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e632ef6-7378-4229-b52c-381f47eec208 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:40.541010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e632ef6-7378-4229-b52c-381f47eec208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:40.541343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e632ef6-7378-4229-b52c-381f47eec208 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:40.542068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e632ef6-7378-4229-b52c-381f47eec208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:22:40.542455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e632ef6-7378-4229-b52c-381f47eec208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:40.544210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e632ef6-7378-4229-b52c-381f47eec208 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:40.568503 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1325/2659] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:22:40.570218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d559a-3971-44da-b895-c7050c194500 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:40.583187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d559a-3971-44da-b895-c7050c194500 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:40.589071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84d533-5dfb-48f3-ab27-4e760a1c936b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:40.589849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84d533-5dfb-48f3-ab27-4e760a1c936b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:40.590231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84d533-5dfb-48f3-ab27-4e760a1c936b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:40.590608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84d533-5dfb-48f3-ab27-4e760a1c936b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:40.592096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84d533-5dfb-48f3-ab27-4e760a1c936b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:40.594495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84d533-5dfb-48f3-ab27-4e760a1c936b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:40.663131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e632ef6-7378-4229-b52c-381f47eec208 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:40.664152 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1335/2660] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:22:40 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:22:40.675887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e632ef6-7378-4229-b52c-381f47eec208 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:40.708474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:40.801453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422c0e1-0099-4b5d-9f05-b143a4404ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:40.802638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422c0e1-0099-4b5d-9f05-b143a4404ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:40.803125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422c0e1-0099-4b5d-9f05-b143a4404ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:40.803641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422c0e1-0099-4b5d-9f05-b143a4404ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:40.806461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422c0e1-0099-4b5d-9f05-b143a4404ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:40.810844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422c0e1-0099-4b5d-9f05-b143a4404ba5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:40.850337 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1326/2661] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:22:40 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:22:40.854691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84d533-5dfb-48f3-ab27-4e760a1c936b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:40.873129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84d533-5dfb-48f3-ab27-4e760a1c936b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:40.883421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b097120-cb9d-4e34-b087-618e73f71f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:40.884113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b097120-cb9d-4e34-b087-618e73f71f26 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:40.884454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b097120-cb9d-4e34-b087-618e73f71f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:40.884806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b097120-cb9d-4e34-b087-618e73f71f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:40.885532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b097120-cb9d-4e34-b087-618e73f71f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:40.887375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b097120-cb9d-4e34-b087-618e73f71f26 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:40.905760 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1336/2662] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:22:40.911550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422c0e1-0099-4b5d-9f05-b143a4404ba5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:40.931377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422c0e1-0099-4b5d-9f05-b143a4404ba5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:40.943362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af51da-c73d-4823-854c-c5cc51c12eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:40.945173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af51da-c73d-4823-854c-c5cc51c12eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:40.945862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af51da-c73d-4823-854c-c5cc51c12eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:40.946397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af51da-c73d-4823-854c-c5cc51c12eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:40.947954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af51da-c73d-4823-854c-c5cc51c12eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:40.951421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af51da-c73d-4823-854c-c5cc51c12eb4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:40.969348 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1327/2663] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:22:40.974028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b097120-cb9d-4e34-b087-618e73f71f26 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:40.986895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b097120-cb9d-4e34-b087-618e73f71f26 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:40.993530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe135f7e-ddc5-4ebc-adf2-50d060fb2ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:40.994344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe135f7e-ddc5-4ebc-adf2-50d060fb2ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:40.994681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe135f7e-ddc5-4ebc-adf2-50d060fb2ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:40.996316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe135f7e-ddc5-4ebc-adf2-50d060fb2ddd admin admin] PATH_INFO: `/v3/projects/065fb16e985e476f9c01b29ab1ce22c6/users/54f4c72942e94fb8a618f18482c79a21/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:41.033098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe135f7e-ddc5-4ebc-adf2-50d060fb2ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=065fb16e985e476f9c01b29ab1ce22c6, user_id=54f4c72942e94fb8a618f18482c79a21, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:41.035930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe135f7e-ddc5-4ebc-adf2-50d060fb2ddd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:41.055131 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1337/2664] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:22:40 2022] PUT /identity/v3/projects/065fb16e985e476f9c01b29ab1ce22c6/users/54f4c72942e94fb8a618f18482c79a21/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:22:41.069272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb7689-4c10-491c-bad8-9157ddbf383b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:41.069560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb7689-4c10-491c-bad8-9157ddbf383b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:41.069847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb7689-4c10-491c-bad8-9157ddbf383b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:41.108633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1dbb7689-4c10-491c-bad8-9157ddbf383b None None] MFA Rules not processed for user `54f4c72942e94fb8a618f18482c79a21`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:41.110616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1dbb7689-4c10-491c-bad8-9157ddbf383b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:41.272759 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1328/2665] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:41.274824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe135f7e-ddc5-4ebc-adf2-50d060fb2ddd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:41.411214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe135f7e-ddc5-4ebc-adf2-50d060fb2ddd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:41.427226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d765b-86c4-4c34-a329-435e4e86cf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:41.428541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d765b-86c4-4c34-a329-435e4e86cf44 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:41.429935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d765b-86c4-4c34-a329-435e4e86cf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:41.430501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d765b-86c4-4c34-a329-435e4e86cf44 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:41.432756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d765b-86c4-4c34-a329-435e4e86cf44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:41.437176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d765b-86c4-4c34-a329-435e4e86cf44 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:41.504439 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1338/2666] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:22:41 2022] POST /identity/v3/projects => generated 373 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:22:41.506654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb7689-4c10-491c-bad8-9157ddbf383b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:41.525230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb7689-4c10-491c-bad8-9157ddbf383b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:41.676379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc85acf-d501-4128-8d88-6b00c83a277f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:41.677479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc85acf-d501-4128-8d88-6b00c83a277f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:41.678057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc85acf-d501-4128-8d88-6b00c83a277f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:41.678543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc85acf-d501-4128-8d88-6b00c83a277f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:41.679531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc85acf-d501-4128-8d88-6b00c83a277f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:41.682698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc85acf-d501-4128-8d88-6b00c83a277f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:41.714967 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1329/2667] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:22:41 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:22:41.721191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d765b-86c4-4c34-a329-435e4e86cf44 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:41.738734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d765b-86c4-4c34-a329-435e4e86cf44 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:41.745697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81f165-d20c-43ff-a144-d5b8484f9342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:41.746448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81f165-d20c-43ff-a144-d5b8484f9342 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:41.746776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81f165-d20c-43ff-a144-d5b8484f9342 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:41.747051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81f165-d20c-43ff-a144-d5b8484f9342 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:41.747744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81f165-d20c-43ff-a144-d5b8484f9342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:41.749558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81f165-d20c-43ff-a144-d5b8484f9342 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:41.752949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:41.772923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc85acf-d501-4128-8d88-6b00c83a277f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:41.774115 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1339/2668] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:22:41.784913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc85acf-d501-4128-8d88-6b00c83a277f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:41.791830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194619da-80be-40be-a92e-505bca964b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:41.792647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194619da-80be-40be-a92e-505bca964b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:41.792956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194619da-80be-40be-a92e-505bca964b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:41.793207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194619da-80be-40be-a92e-505bca964b87 admin admin] PATH_INFO: `/v3/projects/f8c35904e81a46218949daec63308c8c/users/7c0b21eb58124b6d87d3b511dbc8e9e0/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:41.814735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194619da-80be-40be-a92e-505bca964b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c35904e81a46218949daec63308c8c, user_id=7c0b21eb58124b6d87d3b511dbc8e9e0, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:41.818418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194619da-80be-40be-a92e-505bca964b87 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:41.822421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:41.849025 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1330/2669] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:22:41 2022] PUT /identity/v3/projects/f8c35904e81a46218949daec63308c8c/users/7c0b21eb58124b6d87d3b511dbc8e9e0/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:22:41.854896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81f165-d20c-43ff-a144-d5b8484f9342 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:41.871600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81f165-d20c-43ff-a144-d5b8484f9342 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:42.013636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7c27c-1cb9-45c9-b0d4-44d6a914c70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:42.015316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7c27c-1cb9-45c9-b0d4-44d6a914c70d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:42.015316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7c27c-1cb9-45c9-b0d4-44d6a914c70d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:42.015788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7c27c-1cb9-45c9-b0d4-44d6a914c70d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:42.016746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7c27c-1cb9-45c9-b0d4-44d6a914c70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:42.018867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7c27c-1cb9-45c9-b0d4-44d6a914c70d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:42.051157 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1340/2670] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:22:42.055232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194619da-80be-40be-a92e-505bca964b87 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:42.075650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194619da-80be-40be-a92e-505bca964b87 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:42.083966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647853b1-d0ca-4fdc-b8fe-d56755ded342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:42.084874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647853b1-d0ca-4fdc-b8fe-d56755ded342 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:42.085259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647853b1-d0ca-4fdc-b8fe-d56755ded342 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:42.085638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647853b1-d0ca-4fdc-b8fe-d56755ded342 admin admin] PATH_INFO: `/v3/projects/f8c35904e81a46218949daec63308c8c/users/7c0b21eb58124b6d87d3b511dbc8e9e0/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:42.087987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647853b1-d0ca-4fdc-b8fe-d56755ded342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c35904e81a46218949daec63308c8c, user_id=7c0b21eb58124b6d87d3b511dbc8e9e0, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:42.091802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647853b1-d0ca-4fdc-b8fe-d56755ded342 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:42.113972 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1331/2671] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:22:42 2022] PUT /identity/v3/projects/f8c35904e81a46218949daec63308c8c/users/7c0b21eb58124b6d87d3b511dbc8e9e0/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:42.128317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb22b3-c2d8-4fb8-b36d-fa5fcd21fbdb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:42.128612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb22b3-c2d8-4fb8-b36d-fa5fcd21fbdb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:42.128895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb22b3-c2d8-4fb8-b36d-fa5fcd21fbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:42.193533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fdeb22b3-c2d8-4fb8-b36d-fa5fcd21fbdb None None] MFA Rules not processed for user `7c0b21eb58124b6d87d3b511dbc8e9e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:42.195429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fdeb22b3-c2d8-4fb8-b36d-fa5fcd21fbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:42.341393 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1341/2672] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:42.343507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301df8f-c10b-4e42-9185-180fbb5bca82 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:42.344059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301df8f-c10b-4e42-9185-180fbb5bca82 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:42.344293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301df8f-c10b-4e42-9185-180fbb5bca82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:42.446170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8301df8f-c10b-4e42-9185-180fbb5bca82 None None] MFA Rules not processed for user `54f4c72942e94fb8a618f18482c79a21`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:42.447465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8301df8f-c10b-4e42-9185-180fbb5bca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:42.489438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abc5c7-ebd4-4173-816a-ed900dd5f092 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:42.489894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abc5c7-ebd4-4173-816a-ed900dd5f092 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:42.490177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abc5c7-ebd4-4173-816a-ed900dd5f092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:42.536836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d6abc5c7-ebd4-4173-816a-ed900dd5f092 None None] MFA Rules not processed for user `2af1c9ed95b84cff82c1abb4416aff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:42.537854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6abc5c7-ebd4-4173-816a-ed900dd5f092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:42.582075 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1332/2673] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:42.610337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301df8f-c10b-4e42-9185-180fbb5bca82 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:42.612603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8301df8f-c10b-4e42-9185-180fbb5bca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:42.654114 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1342/2674] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:42 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:22:42.718310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301df8f-c10b-4e42-9185-180fbb5bca82 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:42.724178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32574932-99fc-4982-9aec-8c37b751cd54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:42.724978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32574932-99fc-4982-9aec-8c37b751cd54 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:42.725330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32574932-99fc-4982-9aec-8c37b751cd54 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:42.725925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32574932-99fc-4982-9aec-8c37b751cd54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:42.747786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32574932-99fc-4982-9aec-8c37b751cd54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:42.750499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32574932-99fc-4982-9aec-8c37b751cd54 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:42.769228 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1333/2675] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:22:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:22:52.639218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:52.765523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=66,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:54.904952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af956932-4e93-4adc-bbc2-ac9753a308e5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:54.905569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af956932-4e93-4adc-bbc2-ac9753a308e5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:54.906171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af956932-4e93-4adc-bbc2-ac9753a308e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:54.941164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-af956932-4e93-4adc-bbc2-ac9753a308e5 None None] MFA Rules not processed for user `a3f83d2a0be442cb83593a030e92c752`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:54.943631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af956932-4e93-4adc-bbc2-ac9753a308e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:55.039136 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1343/2676] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:58.343528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32574932-99fc-4982-9aec-8c37b751cd54 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:58.344975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-32574932-99fc-4982-9aec-8c37b751cd54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:58.434273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32574932-99fc-4982-9aec-8c37b751cd54 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:58.439025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4021b-8a74-4166-b104-1684cf645183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:58.439985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4021b-8a74-4166-b104-1684cf645183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:58.439985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4021b-8a74-4166-b104-1684cf645183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:58.440305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4021b-8a74-4166-b104-1684cf645183 admin admin] PATH_INFO: `/v3/users/0d5f065094a74e3e8ffa17b9f53a6926` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:58.441504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4021b-8a74-4166-b104-1684cf645183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d5f065094a74e3e8ffa17b9f53a6926)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:58.443700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4021b-8a74-4166-b104-1684cf645183 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:58.499880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5d4021b-8a74-4166-b104-1684cf645183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d5f065094a74e3e8ffa17b9f53a6926'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:58.512830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5d4021b-8a74-4166-b104-1684cf645183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d5f065094a74e3e8ffa17b9f53a6926'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:58.513583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5d4021b-8a74-4166-b104-1684cf645183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d5f065094a74e3e8ffa17b9f53a6926'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:58.514187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5d4021b-8a74-4166-b104-1684cf645183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d5f065094a74e3e8ffa17b9f53a6926'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:58.523832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5d4021b-8a74-4166-b104-1684cf645183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d5f065094a74e3e8ffa17b9f53a6926'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:58.541067 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1334/2677] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:22:58 2022] DELETE /identity/v3/users/0d5f065094a74e3e8ffa17b9f53a6926 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:22:58.760735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af956932-4e93-4adc-bbc2-ac9753a308e5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:58.782872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af956932-4e93-4adc-bbc2-ac9753a308e5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:58.880323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff6c7d-abb0-4b59-8ab4-edaf8f6925ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:58.881390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff6c7d-abb0-4b59-8ab4-edaf8f6925ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:58.881666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff6c7d-abb0-4b59-8ab4-edaf8f6925ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:58.881938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff6c7d-abb0-4b59-8ab4-edaf8f6925ff admin admin] PATH_INFO: `/v3/projects/578306b0406a4b78a7fc425e1563880c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:58.883764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff6c7d-abb0-4b59-8ab4-edaf8f6925ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=578306b0406a4b78a7fc425e1563880c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:58.887198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff6c7d-abb0-4b59-8ab4-edaf8f6925ff admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:58.969011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13ff6c7d-abb0-4b59-8ab4-edaf8f6925ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578306b0406a4b78a7fc425e1563880c', 'request_id': 'req-13ff6c7d-abb0-4b59-8ab4-edaf8f6925ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:58.989020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13ff6c7d-abb0-4b59-8ab4-edaf8f6925ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578306b0406a4b78a7fc425e1563880c', 'request_id': 'req-13ff6c7d-abb0-4b59-8ab4-edaf8f6925ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:58.996227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13ff6c7d-abb0-4b59-8ab4-edaf8f6925ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578306b0406a4b78a7fc425e1563880c', 'request_id': 'req-13ff6c7d-abb0-4b59-8ab4-edaf8f6925ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:59.010491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13ff6c7d-abb0-4b59-8ab4-edaf8f6925ff admin admin] The token cache is being invalidate because project 578306b0406a4b78a7fc425e1563880c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:22:59.010823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13ff6c7d-abb0-4b59-8ab4-edaf8f6925ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:59.011630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13ff6c7d-abb0-4b59-8ab4-edaf8f6925ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:22:59.013175 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1344/2678] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:22:58 2022] DELETE /identity/v3/projects/578306b0406a4b78a7fc425e1563880c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:59.018292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3225d-90a9-4502-8e59-4005a0d0f388 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:59.018573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3225d-90a9-4502-8e59-4005a0d0f388 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:59.018875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3225d-90a9-4502-8e59-4005a0d0f388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:59.180660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3cf3225d-90a9-4502-8e59-4005a0d0f388 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:59.182543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3cf3225d-90a9-4502-8e59-4005a0d0f388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:59.285277 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1335/2679] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:59.294456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c061b-02a0-4224-8125-1109641c15e6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:59.294814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c061b-02a0-4224-8125-1109641c15e6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:59.295160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c061b-02a0-4224-8125-1109641c15e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:59.316183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-966c061b-02a0-4224-8125-1109641c15e6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:59.317419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-966c061b-02a0-4224-8125-1109641c15e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:59.328711 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1345/2680] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:59.334925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3225d-90a9-4502-8e59-4005a0d0f388 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:59.346875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3225d-90a9-4502-8e59-4005a0d0f388 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:59.352020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108c5e8-09f3-40a3-a32b-e05d6194babc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:59.352630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c5e8-09f3-40a3-a32b-e05d6194babc admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:59.352903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c5e8-09f3-40a3-a32b-e05d6194babc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:59.353170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c5e8-09f3-40a3-a32b-e05d6194babc admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:59.353828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108c5e8-09f3-40a3-a32b-e05d6194babc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:22:59.354122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108c5e8-09f3-40a3-a32b-e05d6194babc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:59.355765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108c5e8-09f3-40a3-a32b-e05d6194babc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:59.368391 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1336/2681] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:22:59.373427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c061b-02a0-4224-8125-1109641c15e6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:59.383291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c061b-02a0-4224-8125-1109641c15e6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:59.389095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eec86e-fe6e-4aaf-bb8f-bbe0d6eada83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:59.389521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eec86e-fe6e-4aaf-bb8f-bbe0d6eada83 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:59.389868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eec86e-fe6e-4aaf-bb8f-bbe0d6eada83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:59.390195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eec86e-fe6e-4aaf-bb8f-bbe0d6eada83 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:59.391048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eec86e-fe6e-4aaf-bb8f-bbe0d6eada83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:59.393052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eec86e-fe6e-4aaf-bb8f-bbe0d6eada83 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:59.431579 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1346/2682] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:22:59 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:22:59.435721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108c5e8-09f3-40a3-a32b-e05d6194babc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:59.449342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108c5e8-09f3-40a3-a32b-e05d6194babc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:59.454606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:59.536541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c884b-fdfd-4caf-a067-359b27f1ae90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:59.537168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c884b-fdfd-4caf-a067-359b27f1ae90 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:59.537449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c884b-fdfd-4caf-a067-359b27f1ae90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:59.537722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c884b-fdfd-4caf-a067-359b27f1ae90 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:59.538379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c884b-fdfd-4caf-a067-359b27f1ae90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:59.540521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c884b-fdfd-4caf-a067-359b27f1ae90 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:59.563931 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1337/2683] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:22:59 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:22:59.568724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eec86e-fe6e-4aaf-bb8f-bbe0d6eada83 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:59.580032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eec86e-fe6e-4aaf-bb8f-bbe0d6eada83 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:59.585004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2098a3-a7b6-4cb3-b3f9-fba0f1494e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:59.585618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2098a3-a7b6-4cb3-b3f9-fba0f1494e2f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:59.585892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2098a3-a7b6-4cb3-b3f9-fba0f1494e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:59.586160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2098a3-a7b6-4cb3-b3f9-fba0f1494e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:59.586799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2098a3-a7b6-4cb3-b3f9-fba0f1494e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:59.588449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2098a3-a7b6-4cb3-b3f9-fba0f1494e2f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:59.590076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:22:59.606138 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1347/2684] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:22:59.610478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c884b-fdfd-4caf-a067-359b27f1ae90 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:59.621039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c884b-fdfd-4caf-a067-359b27f1ae90 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:59.629282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992d873-9ccd-4564-96f0-b1b83d21fc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:59.629913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992d873-9ccd-4564-96f0-b1b83d21fc7c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:59.630439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992d873-9ccd-4564-96f0-b1b83d21fc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:59.630874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992d873-9ccd-4564-96f0-b1b83d21fc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:59.632076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992d873-9ccd-4564-96f0-b1b83d21fc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:59.634707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992d873-9ccd-4564-96f0-b1b83d21fc7c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:59.649395 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1338/2685] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:22:59.654270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2098a3-a7b6-4cb3-b3f9-fba0f1494e2f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:59.671574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2098a3-a7b6-4cb3-b3f9-fba0f1494e2f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:22:59.677403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccccf3-0832-41b6-bb08-dd6d342b90fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:22:59.678088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccccf3-0832-41b6-bb08-dd6d342b90fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:59.678361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccccf3-0832-41b6-bb08-dd6d342b90fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:59.678627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccccf3-0832-41b6-bb08-dd6d342b90fd admin admin] PATH_INFO: `/v3/projects/345374d4f0e44be8b6b87e649099b0fe/users/09b2bc87ae9c4882989ff79bc38bebcd/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:59.697974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccccf3-0832-41b6-bb08-dd6d342b90fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=345374d4f0e44be8b6b87e649099b0fe, user_id=09b2bc87ae9c4882989ff79bc38bebcd, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:22:59.701419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccccf3-0832-41b6-bb08-dd6d342b90fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:22:59.738973 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1348/2686] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:22:59 2022] PUT /identity/v3/projects/345374d4f0e44be8b6b87e649099b0fe/users/09b2bc87ae9c4882989ff79bc38bebcd/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:22:59.741274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d7724-b584-4133-bead-9ea5f89c21d0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:22:59.741550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d7724-b584-4133-bead-9ea5f89c21d0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:22:59.742551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d7724-b584-4133-bead-9ea5f89c21d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:22:59.772417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-150d7724-b584-4133-bead-9ea5f89c21d0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:22:59.773702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-150d7724-b584-4133-bead-9ea5f89c21d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:22:59.890687 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1339/2687] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:22:59.912399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccccf3-0832-41b6-bb08-dd6d342b90fd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:22:59.915619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3fccccf3-0832-41b6-bb08-dd6d342b90fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:00.023659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccccf3-0832-41b6-bb08-dd6d342b90fd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:00.027762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630408c1-97f0-43f6-b627-32dd983be5e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:00.028636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630408c1-97f0-43f6-b627-32dd983be5e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:00.029096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630408c1-97f0-43f6-b627-32dd983be5e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:00.029366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630408c1-97f0-43f6-b627-32dd983be5e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:00.039788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630408c1-97f0-43f6-b627-32dd983be5e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:00.041245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630408c1-97f0-43f6-b627-32dd983be5e2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:00.052505 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1349/2688] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:22:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:23:08.881452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c4ed0-cb73-4405-9152-1d04d4a06331 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:08.882817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c4ed0-cb73-4405-9152-1d04d4a06331 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:08.883070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c4ed0-cb73-4405-9152-1d04d4a06331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:08.930358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-df2c4ed0-cb73-4405-9152-1d04d4a06331 None None] MFA Rules not processed for user `09b2bc87ae9c4882989ff79bc38bebcd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:23:08.931643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-df2c4ed0-cb73-4405-9152-1d04d4a06331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:09.019982 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1340/2689] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:23:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:23:09.032121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630408c1-97f0-43f6-b627-32dd983be5e2 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:09.033623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-630408c1-97f0-43f6-b627-32dd983be5e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:09.196556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630408c1-97f0-43f6-b627-32dd983be5e2 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:09.204056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0371a05-0849-4f1f-a577-d943289c03a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:09.205317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371a05-0849-4f1f-a577-d943289c03a8 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:09.205759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371a05-0849-4f1f-a577-d943289c03a8 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:09.206190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371a05-0849-4f1f-a577-d943289c03a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:09.216133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0371a05-0849-4f1f-a577-d943289c03a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:09.218437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0371a05-0849-4f1f-a577-d943289c03a8 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:09.230626 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1350/2690] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:23:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:23:15.110524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c4ed0-cb73-4405-9152-1d04d4a06331 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:15.128735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c4ed0-cb73-4405-9152-1d04d4a06331 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:15.136656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249d8c1-524b-4634-a760-1e07f34ab588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:15.137242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d8c1-524b-4634-a760-1e07f34ab588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:15.137639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d8c1-524b-4634-a760-1e07f34ab588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:15.138156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d8c1-524b-4634-a760-1e07f34ab588 admin admin] PATH_INFO: `/v3/users/09b2bc87ae9c4882989ff79bc38bebcd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:15.139886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249d8c1-524b-4634-a760-1e07f34ab588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b2bc87ae9c4882989ff79bc38bebcd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:15.142347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249d8c1-524b-4634-a760-1e07f34ab588 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:15.187029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:23:15.268504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b249d8c1-524b-4634-a760-1e07f34ab588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b2bc87ae9c4882989ff79bc38bebcd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:15.311766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b249d8c1-524b-4634-a760-1e07f34ab588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b2bc87ae9c4882989ff79bc38bebcd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:15.312548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b249d8c1-524b-4634-a760-1e07f34ab588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b2bc87ae9c4882989ff79bc38bebcd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:15.313175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b249d8c1-524b-4634-a760-1e07f34ab588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b2bc87ae9c4882989ff79bc38bebcd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:15.326526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b249d8c1-524b-4634-a760-1e07f34ab588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b2bc87ae9c4882989ff79bc38bebcd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:15.350588 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1341/2691] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:23:15 2022] DELETE /identity/v3/users/09b2bc87ae9c4882989ff79bc38bebcd => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:23:15.657840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0371a05-0849-4f1f-a577-d943289c03a8 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:15.672395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0371a05-0849-4f1f-a577-d943289c03a8 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:15.811390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf77c3-195a-4384-97fa-fcb78ffed6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:15.812994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf77c3-195a-4384-97fa-fcb78ffed6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:15.813497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf77c3-195a-4384-97fa-fcb78ffed6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:15.813892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf77c3-195a-4384-97fa-fcb78ffed6b7 admin admin] PATH_INFO: `/v3/projects/345374d4f0e44be8b6b87e649099b0fe` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:15.815229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf77c3-195a-4384-97fa-fcb78ffed6b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=345374d4f0e44be8b6b87e649099b0fe)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:15.817764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf77c3-195a-4384-97fa-fcb78ffed6b7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:15.820729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:23:15.934602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5faf77c3-195a-4384-97fa-fcb78ffed6b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '345374d4f0e44be8b6b87e649099b0fe', 'request_id': 'req-5faf77c3-195a-4384-97fa-fcb78ffed6b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:15.959292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5faf77c3-195a-4384-97fa-fcb78ffed6b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '345374d4f0e44be8b6b87e649099b0fe', 'request_id': 'req-5faf77c3-195a-4384-97fa-fcb78ffed6b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:15.969407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5faf77c3-195a-4384-97fa-fcb78ffed6b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '345374d4f0e44be8b6b87e649099b0fe', 'request_id': 'req-5faf77c3-195a-4384-97fa-fcb78ffed6b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:15.986910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5faf77c3-195a-4384-97fa-fcb78ffed6b7 admin admin] The token cache is being invalidate because project 345374d4f0e44be8b6b87e649099b0fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:23:15.987222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5faf77c3-195a-4384-97fa-fcb78ffed6b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:15.993721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5faf77c3-195a-4384-97fa-fcb78ffed6b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:15.999140 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1351/2692] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:23:15 2022] DELETE /identity/v3/projects/345374d4f0e44be8b6b87e649099b0fe => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:23:16.001212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a45e7-3ccd-468c-b679-f82676eb239e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:16.001771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a45e7-3ccd-468c-b679-f82676eb239e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:16.002301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a45e7-3ccd-468c-b679-f82676eb239e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:16.056998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ea2a45e7-3ccd-468c-b679-f82676eb239e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:23:16.059038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ea2a45e7-3ccd-468c-b679-f82676eb239e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:16.175347 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1342/2693] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:23:16.184886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75494c0-00a4-41b7-8c16-d78d20ddc822 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:16.185170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75494c0-00a4-41b7-8c16-d78d20ddc822 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:16.185484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75494c0-00a4-41b7-8c16-d78d20ddc822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:16.224793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d75494c0-00a4-41b7-8c16-d78d20ddc822 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:23:16.226066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d75494c0-00a4-41b7-8c16-d78d20ddc822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:16.239348 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1352/2694] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:23:16.240574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a45e7-3ccd-468c-b679-f82676eb239e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:16.257994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a45e7-3ccd-468c-b679-f82676eb239e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:16.271142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd46377-7ca3-4b10-89f1-0f1be5624eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:16.273682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd46377-7ca3-4b10-89f1-0f1be5624eac admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:16.274475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd46377-7ca3-4b10-89f1-0f1be5624eac admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:16.275110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd46377-7ca3-4b10-89f1-0f1be5624eac admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:16.276017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd46377-7ca3-4b10-89f1-0f1be5624eac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:23:16.276338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd46377-7ca3-4b10-89f1-0f1be5624eac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:16.278228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd46377-7ca3-4b10-89f1-0f1be5624eac admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:16.301821 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1343/2695] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:23:16.305185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75494c0-00a4-41b7-8c16-d78d20ddc822 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:16.316618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75494c0-00a4-41b7-8c16-d78d20ddc822 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:16.324989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31e21d-fbe7-47ee-b21f-45680d87051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:16.324989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31e21d-fbe7-47ee-b21f-45680d87051b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:16.324989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31e21d-fbe7-47ee-b21f-45680d87051b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:16.324989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31e21d-fbe7-47ee-b21f-45680d87051b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:16.325576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31e21d-fbe7-47ee-b21f-45680d87051b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:16.327330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31e21d-fbe7-47ee-b21f-45680d87051b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:16.376283 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1353/2696] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:23:16 2022] POST /identity/v3/projects => generated 391 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:23:16.387547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd46377-7ca3-4b10-89f1-0f1be5624eac admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:16.398884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd46377-7ca3-4b10-89f1-0f1be5624eac admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:16.542373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66645b0b-6a73-4481-ba06-6bb9d3e2e1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:16.543784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66645b0b-6a73-4481-ba06-6bb9d3e2e1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:16.544210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66645b0b-6a73-4481-ba06-6bb9d3e2e1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:16.545159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66645b0b-6a73-4481-ba06-6bb9d3e2e1d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:16.546578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66645b0b-6a73-4481-ba06-6bb9d3e2e1d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:16.549893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66645b0b-6a73-4481-ba06-6bb9d3e2e1d5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:16.598145 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1344/2697] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:23:16 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:23:16.603950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31e21d-fbe7-47ee-b21f-45680d87051b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:16.621661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31e21d-fbe7-47ee-b21f-45680d87051b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:16.629459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a9289-3cb7-4808-a58f-1ae7200165c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:16.632120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a9289-3cb7-4808-a58f-1ae7200165c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:16.632671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a9289-3cb7-4808-a58f-1ae7200165c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:16.633501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a9289-3cb7-4808-a58f-1ae7200165c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:16.634814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a9289-3cb7-4808-a58f-1ae7200165c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:16.636800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a9289-3cb7-4808-a58f-1ae7200165c5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:16.659240 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1354/2698] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:23:16.659885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66645b0b-6a73-4481-ba06-6bb9d3e2e1d5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:16.667888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:23:16.677054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66645b0b-6a73-4481-ba06-6bb9d3e2e1d5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:16.685624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35300591-d4df-4112-bde8-e3c835a40ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:16.686613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35300591-d4df-4112-bde8-e3c835a40ddd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:16.686995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35300591-d4df-4112-bde8-e3c835a40ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:16.687595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35300591-d4df-4112-bde8-e3c835a40ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:16.688611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35300591-d4df-4112-bde8-e3c835a40ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:16.691287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35300591-d4df-4112-bde8-e3c835a40ddd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:16.712256 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1345/2699] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:23:16.714602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a9289-3cb7-4808-a58f-1ae7200165c5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:16.740917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a9289-3cb7-4808-a58f-1ae7200165c5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:16.752264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e85edf-1ed5-48f8-843d-4f3e15aedb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:16.753710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e85edf-1ed5-48f8-843d-4f3e15aedb7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:16.754234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e85edf-1ed5-48f8-843d-4f3e15aedb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:16.754789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e85edf-1ed5-48f8-843d-4f3e15aedb7c admin admin] PATH_INFO: `/v3/projects/e6f344315d2e42618e6ee5aa2045da97/users/d976ffdf800d4ed49b47e6943d003109/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:16.780149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e85edf-1ed5-48f8-843d-4f3e15aedb7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f344315d2e42618e6ee5aa2045da97, user_id=d976ffdf800d4ed49b47e6943d003109, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:16.782745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e85edf-1ed5-48f8-843d-4f3e15aedb7c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:16.800963 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1355/2700] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:23:16 2022] PUT /identity/v3/projects/e6f344315d2e42618e6ee5aa2045da97/users/d976ffdf800d4ed49b47e6943d003109/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:23:16.817350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4abd7-803d-45b3-9fef-dd895806f038 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:16.817616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4abd7-803d-45b3-9fef-dd895806f038 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:16.817892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4abd7-803d-45b3-9fef-dd895806f038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:16.853433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fbb4abd7-803d-45b3-9fef-dd895806f038 None None] MFA Rules not processed for user `d976ffdf800d4ed49b47e6943d003109`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:23:16.854855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fbb4abd7-803d-45b3-9fef-dd895806f038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:16.974390 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1346/2701] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:23:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:23:16.982688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e85edf-1ed5-48f8-843d-4f3e15aedb7c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:16.985758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a3e85edf-1ed5-48f8-843d-4f3e15aedb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:17.103343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e85edf-1ed5-48f8-843d-4f3e15aedb7c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:17.112889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9d4d3-707e-4f03-bc74-7bd4e1f387e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:17.113575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9d4d3-707e-4f03-bc74-7bd4e1f387e0 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:17.113871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9d4d3-707e-4f03-bc74-7bd4e1f387e0 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:17.114132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9d4d3-707e-4f03-bc74-7bd4e1f387e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:17.124455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9d4d3-707e-4f03-bc74-7bd4e1f387e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:17.127732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9d4d3-707e-4f03-bc74-7bd4e1f387e0 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:17.145180 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1356/2702] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:23:16 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:23:17.488108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4abd7-803d-45b3-9fef-dd895806f038 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:17.586375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4abd7-803d-45b3-9fef-dd895806f038 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:17.591237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626e56e-c8b3-4b8b-8e99-1b62a508b548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:17.592282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626e56e-c8b3-4b8b-8e99-1b62a508b548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:17.592282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626e56e-c8b3-4b8b-8e99-1b62a508b548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:17.592770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626e56e-c8b3-4b8b-8e99-1b62a508b548 admin admin] PATH_INFO: `/v3/users/d976ffdf800d4ed49b47e6943d003109` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:17.594162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626e56e-c8b3-4b8b-8e99-1b62a508b548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d976ffdf800d4ed49b47e6943d003109)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:17.596322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626e56e-c8b3-4b8b-8e99-1b62a508b548 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:17.682325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a626e56e-c8b3-4b8b-8e99-1b62a508b548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd976ffdf800d4ed49b47e6943d003109'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:17.698923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a626e56e-c8b3-4b8b-8e99-1b62a508b548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd976ffdf800d4ed49b47e6943d003109'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:17.700031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a626e56e-c8b3-4b8b-8e99-1b62a508b548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd976ffdf800d4ed49b47e6943d003109'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:17.700976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a626e56e-c8b3-4b8b-8e99-1b62a508b548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd976ffdf800d4ed49b47e6943d003109'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:17.714102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a626e56e-c8b3-4b8b-8e99-1b62a508b548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd976ffdf800d4ed49b47e6943d003109'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:17.731916 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1347/2703] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:23:17 2022] DELETE /identity/v3/users/d976ffdf800d4ed49b47e6943d003109 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:23:17.736085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6847d-2a5b-4416-9a80-fd7181eac877 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:17.736927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6847d-2a5b-4416-9a80-fd7181eac877 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:17.737217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6847d-2a5b-4416-9a80-fd7181eac877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:17.783176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-81b6847d-2a5b-4416-9a80-fd7181eac877 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:23:17.788211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-81b6847d-2a5b-4416-9a80-fd7181eac877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:17.798846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:23:17.871637 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1357/2704] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:23:17.883519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626e56e-c8b3-4b8b-8e99-1b62a508b548 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:17.883861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a626e56e-c8b3-4b8b-8e99-1b62a508b548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:17.890262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:23:17.967349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626e56e-c8b3-4b8b-8e99-1b62a508b548 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:17.971983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f30bbe-16b2-41e8-93da-b025dfdd4fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:17.972613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f30bbe-16b2-41e8-93da-b025dfdd4fde service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:17.972893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f30bbe-16b2-41e8-93da-b025dfdd4fde service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:17.973165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f30bbe-16b2-41e8-93da-b025dfdd4fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:17.984061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f30bbe-16b2-41e8-93da-b025dfdd4fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:17.985510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f30bbe-16b2-41e8-93da-b025dfdd4fde service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:17.997201 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1348/2705] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:23:18.318184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6847d-2a5b-4416-9a80-fd7181eac877 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:18.324611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-81b6847d-2a5b-4416-9a80-fd7181eac877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:18.348905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2cec4-5e37-49ec-bdf2-8f004b8371cc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:18.349366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2cec4-5e37-49ec-bdf2-8f004b8371cc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:18.349816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2cec4-5e37-49ec-bdf2-8f004b8371cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:18.353830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6847d-2a5b-4416-9a80-fd7181eac877 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:18.359311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63dcc8-fdbc-49e0-9cd1-1d22055f1195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:18.359979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63dcc8-fdbc-49e0-9cd1-1d22055f1195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:18.360531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63dcc8-fdbc-49e0-9cd1-1d22055f1195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:18.361821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63dcc8-fdbc-49e0-9cd1-1d22055f1195 admin admin] PATH_INFO: `/v3/projects/e6f344315d2e42618e6ee5aa2045da97` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:18.363290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63dcc8-fdbc-49e0-9cd1-1d22055f1195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6f344315d2e42618e6ee5aa2045da97)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:18.369732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63dcc8-fdbc-49e0-9cd1-1d22055f1195 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:18.377858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ecb2cec4-5e37-49ec-bdf2-8f004b8371cc None None] MFA Rules not processed for user `69c85b658b4d499fb6405b2e352358d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:23:18.379091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ecb2cec4-5e37-49ec-bdf2-8f004b8371cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:18.431826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3b63dcc8-fdbc-49e0-9cd1-1d22055f1195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f344315d2e42618e6ee5aa2045da97', 'request_id': 'req-3b63dcc8-fdbc-49e0-9cd1-1d22055f1195'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:18.441400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3b63dcc8-fdbc-49e0-9cd1-1d22055f1195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f344315d2e42618e6ee5aa2045da97', 'request_id': 'req-3b63dcc8-fdbc-49e0-9cd1-1d22055f1195'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:18.451243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3b63dcc8-fdbc-49e0-9cd1-1d22055f1195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f344315d2e42618e6ee5aa2045da97', 'request_id': 'req-3b63dcc8-fdbc-49e0-9cd1-1d22055f1195'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:18.466436 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1349/2706] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:23:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:23:18.466706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3b63dcc8-fdbc-49e0-9cd1-1d22055f1195 admin admin] The token cache is being invalidate because project e6f344315d2e42618e6ee5aa2045da97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:23:18.466706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3b63dcc8-fdbc-49e0-9cd1-1d22055f1195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:18.466706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3b63dcc8-fdbc-49e0-9cd1-1d22055f1195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:18.470520 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1358/2707] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:23:18 2022] DELETE /identity/v3/projects/e6f344315d2e42618e6ee5aa2045da97 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:23:18.472802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563bc99-9128-42fc-85eb-695a1f7fb390 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:18.473144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563bc99-9128-42fc-85eb-695a1f7fb390 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:18.473341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563bc99-9128-42fc-85eb-695a1f7fb390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:18.497131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b563bc99-9128-42fc-85eb-695a1f7fb390 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:23:18.498789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b563bc99-9128-42fc-85eb-695a1f7fb390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:18.580509 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1350/2708] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:23:18.590418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff0895-82d9-4099-97d0-bbefd3162aba None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:18.590788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff0895-82d9-4099-97d0-bbefd3162aba None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:18.591371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff0895-82d9-4099-97d0-bbefd3162aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:18.615988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-81ff0895-82d9-4099-97d0-bbefd3162aba None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:23:18.617437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-81ff0895-82d9-4099-97d0-bbefd3162aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:18.630432 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1359/2709] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:23:18.634605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563bc99-9128-42fc-85eb-695a1f7fb390 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:18.663749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563bc99-9128-42fc-85eb-695a1f7fb390 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:18.670700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce201b-1a8b-4917-ab43-cdd76f097c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:18.671604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce201b-1a8b-4917-ab43-cdd76f097c44 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:18.671883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce201b-1a8b-4917-ab43-cdd76f097c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:18.672190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce201b-1a8b-4917-ab43-cdd76f097c44 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:18.672877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce201b-1a8b-4917-ab43-cdd76f097c44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:23:18.673183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce201b-1a8b-4917-ab43-cdd76f097c44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:18.674896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce201b-1a8b-4917-ab43-cdd76f097c44 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:18.692874 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1351/2710] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:23:18.693482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff0895-82d9-4099-97d0-bbefd3162aba None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:18.705655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff0895-82d9-4099-97d0-bbefd3162aba None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:18.713347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d667f8-8d33-4618-aed5-93c434d1993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:18.713986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d667f8-8d33-4618-aed5-93c434d1993f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:18.715567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d667f8-8d33-4618-aed5-93c434d1993f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:18.715927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d667f8-8d33-4618-aed5-93c434d1993f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:18.716723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d667f8-8d33-4618-aed5-93c434d1993f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:18.720153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d667f8-8d33-4618-aed5-93c434d1993f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:18.778394 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1360/2711] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:23:18 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:23:18.779627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce201b-1a8b-4917-ab43-cdd76f097c44 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:18.790530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce201b-1a8b-4917-ab43-cdd76f097c44 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:18.843427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:23:18.884586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0a6a0-02f0-42cd-b0db-96debf64d1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:18.885207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0a6a0-02f0-42cd-b0db-96debf64d1ae admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:18.885672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0a6a0-02f0-42cd-b0db-96debf64d1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:18.885947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0a6a0-02f0-42cd-b0db-96debf64d1ae admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:18.886592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0a6a0-02f0-42cd-b0db-96debf64d1ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:18.888610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0a6a0-02f0-42cd-b0db-96debf64d1ae admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:18.917262 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1352/2712] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:23:18 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:23:18.922213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d667f8-8d33-4618-aed5-93c434d1993f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:18.934347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d667f8-8d33-4618-aed5-93c434d1993f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:18.940839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f4792-d77c-4625-802e-8f42cda109c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:18.941471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f4792-d77c-4625-802e-8f42cda109c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:18.941749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f4792-d77c-4625-802e-8f42cda109c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:18.942024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f4792-d77c-4625-802e-8f42cda109c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:18.942688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f4792-d77c-4625-802e-8f42cda109c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:18.944385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f4792-d77c-4625-802e-8f42cda109c7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:18.957701 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1361/2713] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:23:18.962384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0a6a0-02f0-42cd-b0db-96debf64d1ae admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:18.975741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0a6a0-02f0-42cd-b0db-96debf64d1ae admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:18.982335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2df34-b2f6-46ce-a55f-77ea5cc718b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:18.983017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2df34-b2f6-46ce-a55f-77ea5cc718b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:18.983230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2df34-b2f6-46ce-a55f-77ea5cc718b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:18.983537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2df34-b2f6-46ce-a55f-77ea5cc718b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:18.984188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2df34-b2f6-46ce-a55f-77ea5cc718b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:18.985798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2df34-b2f6-46ce-a55f-77ea5cc718b3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:19.002598 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1353/2714] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:23:19.003872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f4792-d77c-4625-802e-8f42cda109c7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:19.014387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f4792-d77c-4625-802e-8f42cda109c7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:19.019233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9129e-0ece-4092-a1f3-3dda9944b321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:19.019952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9129e-0ece-4092-a1f3-3dda9944b321 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:19.020229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9129e-0ece-4092-a1f3-3dda9944b321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:19.020765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9129e-0ece-4092-a1f3-3dda9944b321 admin admin] PATH_INFO: `/v3/projects/2c617f7d692c4a0eaea617302c655858/users/5a2845ef87b14966a220d8c4e43f1c5c/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:19.038362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9129e-0ece-4092-a1f3-3dda9944b321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c617f7d692c4a0eaea617302c655858, user_id=5a2845ef87b14966a220d8c4e43f1c5c, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:19.041253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9129e-0ece-4092-a1f3-3dda9944b321 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:19.057038 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1362/2715] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:23:19 2022] PUT /identity/v3/projects/2c617f7d692c4a0eaea617302c655858/users/5a2845ef87b14966a220d8c4e43f1c5c/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:23:19.067968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df3dc3-eed0-4119-9cf1-9656f35d6611 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:19.068244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df3dc3-eed0-4119-9cf1-9656f35d6611 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:19.068519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df3dc3-eed0-4119-9cf1-9656f35d6611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:19.107278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-76df3dc3-eed0-4119-9cf1-9656f35d6611 None None] MFA Rules not processed for user `5a2845ef87b14966a220d8c4e43f1c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:23:19.107278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-76df3dc3-eed0-4119-9cf1-9656f35d6611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:19.207085 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1354/2716] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:23:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:23:19.217723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c1c28-d879-48d0-9e25-beeeb53db10d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:19.218010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c1c28-d879-48d0-9e25-beeeb53db10d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:19.218289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c1c28-d879-48d0-9e25-beeeb53db10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:19.244177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-310c1c28-d879-48d0-9e25-beeeb53db10d None None] MFA Rules not processed for user `5a2845ef87b14966a220d8c4e43f1c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:23:19.245666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-310c1c28-d879-48d0-9e25-beeeb53db10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:19.255635 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1363/2717] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:23:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:23:19.320604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df3dc3-eed0-4119-9cf1-9656f35d6611 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:19.322058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-76df3dc3-eed0-4119-9cf1-9656f35d6611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:19.436701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df3dc3-eed0-4119-9cf1-9656f35d6611 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:19.449630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd123b-dd6d-44fe-b898-f8b7d01fffc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:19.451846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd123b-dd6d-44fe-b898-f8b7d01fffc7 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:19.452370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd123b-dd6d-44fe-b898-f8b7d01fffc7 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:19.453020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd123b-dd6d-44fe-b898-f8b7d01fffc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:19.468372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd123b-dd6d-44fe-b898-f8b7d01fffc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:19.470972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd123b-dd6d-44fe-b898-f8b7d01fffc7 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:19.487115 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1355/2718] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:23:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:23:21.273372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58854283-2d3c-4d70-bc23-6d48a49feadc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:21.274319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58854283-2d3c-4d70-bc23-6d48a49feadc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:21.274928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58854283-2d3c-4d70-bc23-6d48a49feadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:21.333763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-58854283-2d3c-4d70-bc23-6d48a49feadc None None] MFA Rules not processed for user `d14d1e556e644fcdbab72647f2c47960`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:23:21.335083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58854283-2d3c-4d70-bc23-6d48a49feadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:21.377187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:23:21.431487 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1364/2719] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:23:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:23:25.562215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd123b-dd6d-44fe-b898-f8b7d01fffc7 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:25.596116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd123b-dd6d-44fe-b898-f8b7d01fffc7 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:25.604368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7f5a2-a945-466e-8174-e244529018b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:25.605002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7f5a2-a945-466e-8174-e244529018b2 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:25.605281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7f5a2-a945-466e-8174-e244529018b2 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:25.605553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7f5a2-a945-466e-8174-e244529018b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:25.612383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a5f7f5a2-a945-466e-8174-e244529018b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:25.712961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:23:25.770006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7f5a2-a945-466e-8174-e244529018b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:25.771797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7f5a2-a945-466e-8174-e244529018b2 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:25.801420 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1356/2720] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:23:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:23:31.421063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=14 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:23:34.403484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58854283-2d3c-4d70-bc23-6d48a49feadc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:34.404984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58854283-2d3c-4d70-bc23-6d48a49feadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:34.476517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58854283-2d3c-4d70-bc23-6d48a49feadc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:34.481860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce152c-76fd-4d80-8eb1-2ab07a2b8e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:34.482539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce152c-76fd-4d80-8eb1-2ab07a2b8e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:34.482955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce152c-76fd-4d80-8eb1-2ab07a2b8e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:34.483379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce152c-76fd-4d80-8eb1-2ab07a2b8e41 admin admin] PATH_INFO: `/v3/users/53d18719bae54f7aae765e0d02979170` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:34.484886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce152c-76fd-4d80-8eb1-2ab07a2b8e41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d18719bae54f7aae765e0d02979170)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:34.486938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce152c-76fd-4d80-8eb1-2ab07a2b8e41 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:34.547794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5ce152c-76fd-4d80-8eb1-2ab07a2b8e41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d18719bae54f7aae765e0d02979170'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:34.548505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5ce152c-76fd-4d80-8eb1-2ab07a2b8e41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d18719bae54f7aae765e0d02979170'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:34.556304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5ce152c-76fd-4d80-8eb1-2ab07a2b8e41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d18719bae54f7aae765e0d02979170'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:34.565239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5ce152c-76fd-4d80-8eb1-2ab07a2b8e41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d18719bae54f7aae765e0d02979170'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:34.580644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5ce152c-76fd-4d80-8eb1-2ab07a2b8e41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d18719bae54f7aae765e0d02979170'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:34.587299 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1365/2721] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:23:34 2022] DELETE /identity/v3/users/53d18719bae54f7aae765e0d02979170 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:23:34.781089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7f5a2-a945-466e-8174-e244529018b2 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:34.804962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7f5a2-a945-466e-8174-e244529018b2 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:34.881679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d2b1f-3ac2-4d53-923b-29bf097cda03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:34.882345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d2b1f-3ac2-4d53-923b-29bf097cda03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:34.882620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d2b1f-3ac2-4d53-923b-29bf097cda03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:34.882885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d2b1f-3ac2-4d53-923b-29bf097cda03 admin admin] PATH_INFO: `/v3/projects/e49bbab98b54421ea2861118b23ffcaa` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:34.884026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d2b1f-3ac2-4d53-923b-29bf097cda03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e49bbab98b54421ea2861118b23ffcaa)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:34.885909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d2b1f-3ac2-4d53-923b-29bf097cda03 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:34.938080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-364d2b1f-3ac2-4d53-923b-29bf097cda03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e49bbab98b54421ea2861118b23ffcaa', 'request_id': 'req-364d2b1f-3ac2-4d53-923b-29bf097cda03'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:34.945344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-364d2b1f-3ac2-4d53-923b-29bf097cda03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e49bbab98b54421ea2861118b23ffcaa', 'request_id': 'req-364d2b1f-3ac2-4d53-923b-29bf097cda03'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:34.951417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-364d2b1f-3ac2-4d53-923b-29bf097cda03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e49bbab98b54421ea2861118b23ffcaa', 'request_id': 'req-364d2b1f-3ac2-4d53-923b-29bf097cda03'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:34.968202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-364d2b1f-3ac2-4d53-923b-29bf097cda03 admin admin] The token cache is being invalidate because project e49bbab98b54421ea2861118b23ffcaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:23:34.968202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-364d2b1f-3ac2-4d53-923b-29bf097cda03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:34.980057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-364d2b1f-3ac2-4d53-923b-29bf097cda03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:23:34.983205 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1357/2722] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:23:34 2022] DELETE /identity/v3/projects/e49bbab98b54421ea2861118b23ffcaa => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:23:34.988509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e825c-e591-46bf-bbb3-7b1fa4b2b9bc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:34.989072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e825c-e591-46bf-bbb3-7b1fa4b2b9bc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:34.989712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e825c-e591-46bf-bbb3-7b1fa4b2b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:35.013678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2e5e825c-e591-46bf-bbb3-7b1fa4b2b9bc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:23:35.014910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2e5e825c-e591-46bf-bbb3-7b1fa4b2b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:35.075100 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1366/2723] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:23:35.082897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fd8c2-a716-4f2d-bf9a-26a7753431b3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:35.083188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fd8c2-a716-4f2d-bf9a-26a7753431b3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:35.083618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fd8c2-a716-4f2d-bf9a-26a7753431b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:35.106358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5a7fd8c2-a716-4f2d-bf9a-26a7753431b3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:23:35.107587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5a7fd8c2-a716-4f2d-bf9a-26a7753431b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:35.115705 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1358/2724] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:23:35.120322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e825c-e591-46bf-bbb3-7b1fa4b2b9bc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:35.132764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e825c-e591-46bf-bbb3-7b1fa4b2b9bc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:35.137384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a5018-616e-42c0-813a-165906435471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:35.138064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a5018-616e-42c0-813a-165906435471 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:35.138340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a5018-616e-42c0-813a-165906435471 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:35.138607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a5018-616e-42c0-813a-165906435471 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:35.139281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a5018-616e-42c0-813a-165906435471 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:23:35.139575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a5018-616e-42c0-813a-165906435471 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:35.141171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a5018-616e-42c0-813a-165906435471 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:35.153608 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1367/2725] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:23:35.157865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fd8c2-a716-4f2d-bf9a-26a7753431b3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:35.167508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fd8c2-a716-4f2d-bf9a-26a7753431b3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:35.182782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3ab38-d9ab-410f-8347-434f18e35e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:35.183582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3ab38-d9ab-410f-8347-434f18e35e4a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:35.183891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3ab38-d9ab-410f-8347-434f18e35e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:35.184163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3ab38-d9ab-410f-8347-434f18e35e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:35.184994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3ab38-d9ab-410f-8347-434f18e35e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:35.186911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3ab38-d9ab-410f-8347-434f18e35e4a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:35.229198 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1359/2726] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:23:35 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:23:35.230386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a5018-616e-42c0-813a-165906435471 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:35.243010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a5018-616e-42c0-813a-165906435471 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:35.247508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:23:35.305357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c0d1a-f6ce-438f-b62b-3783f6d9ae73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:35.305972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c0d1a-f6ce-438f-b62b-3783f6d9ae73 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:35.306247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c0d1a-f6ce-438f-b62b-3783f6d9ae73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:35.306515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c0d1a-f6ce-438f-b62b-3783f6d9ae73 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:35.307153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c0d1a-f6ce-438f-b62b-3783f6d9ae73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:35.309210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c0d1a-f6ce-438f-b62b-3783f6d9ae73 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:35.334190 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1368/2727] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:23:35 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:23:35.338193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3ab38-d9ab-410f-8347-434f18e35e4a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:35.349081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3ab38-d9ab-410f-8347-434f18e35e4a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:35.354679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54298a25-a7ce-4fa0-8210-647b02d8c6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:35.355457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54298a25-a7ce-4fa0-8210-647b02d8c6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:35.355736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54298a25-a7ce-4fa0-8210-647b02d8c6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:35.356139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54298a25-a7ce-4fa0-8210-647b02d8c6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:35.356667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54298a25-a7ce-4fa0-8210-647b02d8c6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:35.358271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54298a25-a7ce-4fa0-8210-647b02d8c6b6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:35.369914 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1360/2728] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:23:35.375625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c0d1a-f6ce-438f-b62b-3783f6d9ae73 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:35.394150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c0d1a-f6ce-438f-b62b-3783f6d9ae73 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:35.401849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db718a-5f59-4cd8-b542-45127b2619ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:35.401849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db718a-5f59-4cd8-b542-45127b2619ab admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:35.401849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db718a-5f59-4cd8-b542-45127b2619ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:35.401849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db718a-5f59-4cd8-b542-45127b2619ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:35.402470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db718a-5f59-4cd8-b542-45127b2619ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:35.402781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db718a-5f59-4cd8-b542-45127b2619ab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:35.414109 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1369/2729] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:23:35.418390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54298a25-a7ce-4fa0-8210-647b02d8c6b6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:35.429772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54298a25-a7ce-4fa0-8210-647b02d8c6b6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:35.435096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de101d8-4297-4f34-bc59-d8caceb4f15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:35.435900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de101d8-4297-4f34-bc59-d8caceb4f15c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:35.436273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de101d8-4297-4f34-bc59-d8caceb4f15c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:35.436549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de101d8-4297-4f34-bc59-d8caceb4f15c admin admin] PATH_INFO: `/v3/projects/2d7da5de7cfc40e3acb7ccaeb19678f1/users/d04ef0c295e14b1dbbdf3c29dcb2f966/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:35.449684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:23:35.453326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de101d8-4297-4f34-bc59-d8caceb4f15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7da5de7cfc40e3acb7ccaeb19678f1, user_id=d04ef0c295e14b1dbbdf3c29dcb2f966, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:35.456064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de101d8-4297-4f34-bc59-d8caceb4f15c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:35.474578 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1361/2730] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:23:35 2022] PUT /identity/v3/projects/2d7da5de7cfc40e3acb7ccaeb19678f1/users/d04ef0c295e14b1dbbdf3c29dcb2f966/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:23:35.480925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6563490-c886-4349-9733-39e1e0c71926 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:35.481391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6563490-c886-4349-9733-39e1e0c71926 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:35.481809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6563490-c886-4349-9733-39e1e0c71926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:35.505969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d6563490-c886-4349-9733-39e1e0c71926 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:23:35.507762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6563490-c886-4349-9733-39e1e0c71926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:35.575543 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1370/2731] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:23:35.585635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de101d8-4297-4f34-bc59-d8caceb4f15c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:35.587582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4de101d8-4297-4f34-bc59-d8caceb4f15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:35.649067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de101d8-4297-4f34-bc59-d8caceb4f15c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:35.654515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db32a2-3fe7-4f04-85de-8fd45beaea24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:35.655135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db32a2-3fe7-4f04-85de-8fd45beaea24 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:35.655449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db32a2-3fe7-4f04-85de-8fd45beaea24 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:35.655723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db32a2-3fe7-4f04-85de-8fd45beaea24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:35.665454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db32a2-3fe7-4f04-85de-8fd45beaea24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:35.666896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db32a2-3fe7-4f04-85de-8fd45beaea24 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:35.676715 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1362/2732] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:23:41.180841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8974f-7ba6-47ad-9274-4aa440793d15 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:41.181334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8974f-7ba6-47ad-9274-4aa440793d15 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:41.181459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8974f-7ba6-47ad-9274-4aa440793d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:41.217748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f0e8974f-7ba6-47ad-9274-4aa440793d15 None None] MFA Rules not processed for user `d04ef0c295e14b1dbbdf3c29dcb2f966`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:23:41.219181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f0e8974f-7ba6-47ad-9274-4aa440793d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:41.302535 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1371/2733] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:23:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:23:41.312569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf888b57-b7d5-4b78-bae4-1f708fe0463e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:41.313122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf888b57-b7d5-4b78-bae4-1f708fe0463e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:41.313122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf888b57-b7d5-4b78-bae4-1f708fe0463e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:41.333967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bf888b57-b7d5-4b78-bae4-1f708fe0463e None None] MFA Rules not processed for user `d04ef0c295e14b1dbbdf3c29dcb2f966`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:23:41.335626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bf888b57-b7d5-4b78-bae4-1f708fe0463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:41.343777 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1363/2734] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:23:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:23:41.358114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8974f-7ba6-47ad-9274-4aa440793d15 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:41.359889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f0e8974f-7ba6-47ad-9274-4aa440793d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:41.383376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:23:41.461581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8974f-7ba6-47ad-9274-4aa440793d15 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:41.467691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc553e8c-10aa-4eac-b8f3-d1eea484c2f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:41.468364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc553e8c-10aa-4eac-b8f3-d1eea484c2f8 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:41.468647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc553e8c-10aa-4eac-b8f3-d1eea484c2f8 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:41.469062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc553e8c-10aa-4eac-b8f3-d1eea484c2f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:41.480730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc553e8c-10aa-4eac-b8f3-d1eea484c2f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:41.483576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc553e8c-10aa-4eac-b8f3-d1eea484c2f8 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:41.514364 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1372/2735] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:23:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:23:51.327489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:23:51.504650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=27 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:23:51.834627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b1642-7796-470a-80b7-7188560fd3d3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:51.834909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b1642-7796-470a-80b7-7188560fd3d3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:51.835185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b1642-7796-470a-80b7-7188560fd3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:51.856442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ec3b1642-7796-470a-80b7-7188560fd3d3 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:23:51.857691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ec3b1642-7796-470a-80b7-7188560fd3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:51.939457 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1364/2736] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:23:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:23:51.997505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc553e8c-10aa-4eac-b8f3-d1eea484c2f8 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:51.999002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc553e8c-10aa-4eac-b8f3-d1eea484c2f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:52.071737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc553e8c-10aa-4eac-b8f3-d1eea484c2f8 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:52.077246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609c5d5-302f-4536-aca0-25492d74114b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:52.077875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609c5d5-302f-4536-aca0-25492d74114b service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:52.078153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609c5d5-302f-4536-aca0-25492d74114b service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:52.078423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609c5d5-302f-4536-aca0-25492d74114b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:52.087545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609c5d5-302f-4536-aca0-25492d74114b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:52.089488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609c5d5-302f-4536-aca0-25492d74114b service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:52.098723 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1373/2737] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:23:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 18:23:58.670723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b1642-7796-470a-80b7-7188560fd3d3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:23:58.676571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ec3b1642-7796-470a-80b7-7188560fd3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:58.690736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b1642-7796-470a-80b7-7188560fd3d3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:23:58.699098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed9a99-c014-4dfd-8dca-496be136107c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:23:58.700505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed9a99-c014-4dfd-8dca-496be136107c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:23:58.701242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed9a99-c014-4dfd-8dca-496be136107c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:23:58.701740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed9a99-c014-4dfd-8dca-496be136107c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:23:58.705091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-39ed9a99-c014-4dfd-8dca-496be136107c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:23:58.722443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed9a99-c014-4dfd-8dca-496be136107c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:23:58.724554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed9a99-c014-4dfd-8dca-496be136107c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:23:58.765000 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1365/2738] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:23:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:01.362051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609c5d5-302f-4536-aca0-25492d74114b service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:01.373020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609c5d5-302f-4536-aca0-25492d74114b service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:01.377160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e45431-0a72-417f-bbb9-bc3d63fe7cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:01.377836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e45431-0a72-417f-bbb9-bc3d63fe7cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:01.378113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e45431-0a72-417f-bbb9-bc3d63fe7cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:01.378385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e45431-0a72-417f-bbb9-bc3d63fe7cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:01.380426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-42e45431-0a72-417f-bbb9-bc3d63fe7cf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:01.400009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e45431-0a72-417f-bbb9-bc3d63fe7cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:01.401578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e45431-0a72-417f-bbb9-bc3d63fe7cf8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:01.417876 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1374/2739] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:04.576235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862346-4fdc-4254-943c-e85113aba239 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:04.576742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862346-4fdc-4254-943c-e85113aba239 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:04.576742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862346-4fdc-4254-943c-e85113aba239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:04.596163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4c862346-4fdc-4254-943c-e85113aba239 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:04.597374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4c862346-4fdc-4254-943c-e85113aba239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:04.605891 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1366/2740] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:24:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:04.622635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e45431-0a72-417f-bbb9-bc3d63fe7cf8 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:04.635479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e45431-0a72-417f-bbb9-bc3d63fe7cf8 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:04.641386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47faae75-aa7f-49c5-a538-acf8c9297955 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:04.641992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47faae75-aa7f-49c5-a538-acf8c9297955 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:04.642278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47faae75-aa7f-49c5-a538-acf8c9297955 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:04.642550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47faae75-aa7f-49c5-a538-acf8c9297955 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:04.651839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47faae75-aa7f-49c5-a538-acf8c9297955 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:04.653726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47faae75-aa7f-49c5-a538-acf8c9297955 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:04.668853 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1375/2741] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:24:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:24:05.435098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c862346-4fdc-4254-943c-e85113aba239 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:05.445865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c862346-4fdc-4254-943c-e85113aba239 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:05.450043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df892d11-b33c-4637-b7e1-08941d5b725b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:05.451069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df892d11-b33c-4637-b7e1-08941d5b725b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:05.451549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df892d11-b33c-4637-b7e1-08941d5b725b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:05.451966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df892d11-b33c-4637-b7e1-08941d5b725b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:05.454457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-df892d11-b33c-4637-b7e1-08941d5b725b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:05.471813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df892d11-b33c-4637-b7e1-08941d5b725b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:05.473722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df892d11-b33c-4637-b7e1-08941d5b725b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:05.512795 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1367/2742] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:08.928737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47faae75-aa7f-49c5-a538-acf8c9297955 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:08.931584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-47faae75-aa7f-49c5-a538-acf8c9297955 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:09.003548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47faae75-aa7f-49c5-a538-acf8c9297955 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:09.022008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c978b-c5bc-4599-a76a-22dc2fcf72af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:09.022672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c978b-c5bc-4599-a76a-22dc2fcf72af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:09.022953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c978b-c5bc-4599-a76a-22dc2fcf72af admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:09.023227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c978b-c5bc-4599-a76a-22dc2fcf72af admin admin] PATH_INFO: `/v3/users/54f4c72942e94fb8a618f18482c79a21` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:09.026094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c978b-c5bc-4599-a76a-22dc2fcf72af admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f4c72942e94fb8a618f18482c79a21)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:09.028173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c978b-c5bc-4599-a76a-22dc2fcf72af admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:09.108884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b01c978b-c5bc-4599-a76a-22dc2fcf72af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f4c72942e94fb8a618f18482c79a21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:09.109984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b01c978b-c5bc-4599-a76a-22dc2fcf72af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f4c72942e94fb8a618f18482c79a21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:09.120392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b01c978b-c5bc-4599-a76a-22dc2fcf72af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f4c72942e94fb8a618f18482c79a21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:09.131943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b01c978b-c5bc-4599-a76a-22dc2fcf72af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f4c72942e94fb8a618f18482c79a21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:09.147530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b01c978b-c5bc-4599-a76a-22dc2fcf72af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f4c72942e94fb8a618f18482c79a21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:09.156906 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1376/2743] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:24:08 2022] DELETE /identity/v3/users/54f4c72942e94fb8a618f18482c79a21 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:09.161153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29267e2-a8f3-4554-b177-acadfbd26006 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:09.162173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29267e2-a8f3-4554-b177-acadfbd26006 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:09.163204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29267e2-a8f3-4554-b177-acadfbd26006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:09.193230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f29267e2-a8f3-4554-b177-acadfbd26006 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:09.194661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f29267e2-a8f3-4554-b177-acadfbd26006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:09.279806 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1368/2744] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:24:09.291125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c978b-c5bc-4599-a76a-22dc2fcf72af admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:09.292784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b01c978b-c5bc-4599-a76a-22dc2fcf72af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:09.340307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:09.362186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c978b-c5bc-4599-a76a-22dc2fcf72af admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:09.366302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca296c4-9440-49c0-aab5-d1aad19743e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:09.367131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca296c4-9440-49c0-aab5-d1aad19743e0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:09.367912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca296c4-9440-49c0-aab5-d1aad19743e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:09.368982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca296c4-9440-49c0-aab5-d1aad19743e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:09.379952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca296c4-9440-49c0-aab5-d1aad19743e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:09.381426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca296c4-9440-49c0-aab5-d1aad19743e0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:09.391963 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1377/2745] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:09.805870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29267e2-a8f3-4554-b177-acadfbd26006 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:09.809222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f29267e2-a8f3-4554-b177-acadfbd26006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:09.834782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29267e2-a8f3-4554-b177-acadfbd26006 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:09.842571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2973448-0e26-4b31-baab-8c5380600b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:09.843864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2973448-0e26-4b31-baab-8c5380600b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:09.844316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2973448-0e26-4b31-baab-8c5380600b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:09.844899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2973448-0e26-4b31-baab-8c5380600b26 admin admin] PATH_INFO: `/v3/projects/065fb16e985e476f9c01b29ab1ce22c6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:09.846436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2973448-0e26-4b31-baab-8c5380600b26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=065fb16e985e476f9c01b29ab1ce22c6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:09.849092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2973448-0e26-4b31-baab-8c5380600b26 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:09.938177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a2973448-0e26-4b31-baab-8c5380600b26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '065fb16e985e476f9c01b29ab1ce22c6', 'request_id': 'req-a2973448-0e26-4b31-baab-8c5380600b26'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:09.950460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a2973448-0e26-4b31-baab-8c5380600b26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '065fb16e985e476f9c01b29ab1ce22c6', 'request_id': 'req-a2973448-0e26-4b31-baab-8c5380600b26'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:09.958774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a2973448-0e26-4b31-baab-8c5380600b26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '065fb16e985e476f9c01b29ab1ce22c6', 'request_id': 'req-a2973448-0e26-4b31-baab-8c5380600b26'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:09.964250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:09.991290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a2973448-0e26-4b31-baab-8c5380600b26 admin admin] The token cache is being invalidate because project 065fb16e985e476f9c01b29ab1ce22c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:24:09.993833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a2973448-0e26-4b31-baab-8c5380600b26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:09.997820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a2973448-0e26-4b31-baab-8c5380600b26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:10.001733 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1369/2746] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:24:09 2022] DELETE /identity/v3/projects/065fb16e985e476f9c01b29ab1ce22c6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:10.005657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca296c4-9440-49c0-aab5-d1aad19743e0 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:10.018027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca296c4-9440-49c0-aab5-d1aad19743e0 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:10.145200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d8bd1-2a9e-4b4b-a326-c9b9901d99b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:10.145868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d8bd1-2a9e-4b4b-a326-c9b9901d99b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:10.146148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d8bd1-2a9e-4b4b-a326-c9b9901d99b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:10.146422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d8bd1-2a9e-4b4b-a326-c9b9901d99b1 admin admin] PATH_INFO: `/v3/users/7c0b21eb58124b6d87d3b511dbc8e9e0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:10.147984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d8bd1-2a9e-4b4b-a326-c9b9901d99b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0b21eb58124b6d87d3b511dbc8e9e0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:10.150241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d8bd1-2a9e-4b4b-a326-c9b9901d99b1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:10.213837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-151d8bd1-2a9e-4b4b-a326-c9b9901d99b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0b21eb58124b6d87d3b511dbc8e9e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:10.214473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-151d8bd1-2a9e-4b4b-a326-c9b9901d99b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0b21eb58124b6d87d3b511dbc8e9e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:10.221952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-151d8bd1-2a9e-4b4b-a326-c9b9901d99b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0b21eb58124b6d87d3b511dbc8e9e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:10.237910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-151d8bd1-2a9e-4b4b-a326-c9b9901d99b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0b21eb58124b6d87d3b511dbc8e9e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:10.257378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-151d8bd1-2a9e-4b4b-a326-c9b9901d99b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0b21eb58124b6d87d3b511dbc8e9e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:10.264176 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1378/2747] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:24:10 2022] DELETE /identity/v3/users/7c0b21eb58124b6d87d3b511dbc8e9e0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:10.611843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2973448-0e26-4b31-baab-8c5380600b26 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:10.613448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a2973448-0e26-4b31-baab-8c5380600b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:10.631065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2973448-0e26-4b31-baab-8c5380600b26 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:10.713231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc266e-5cc7-4f84-9404-a2c72a86937c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:10.713652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc266e-5cc7-4f84-9404-a2c72a86937c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:10.714169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc266e-5cc7-4f84-9404-a2c72a86937c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:10.714322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc266e-5cc7-4f84-9404-a2c72a86937c admin admin] PATH_INFO: `/v3/projects/f8c35904e81a46218949daec63308c8c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:10.715480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc266e-5cc7-4f84-9404-a2c72a86937c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c35904e81a46218949daec63308c8c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:10.717655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc266e-5cc7-4f84-9404-a2c72a86937c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:10.731749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d8bd1-2a9e-4b4b-a326-c9b9901d99b1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:10.731749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-151d8bd1-2a9e-4b4b-a326-c9b9901d99b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:10.748876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d8bd1-2a9e-4b4b-a326-c9b9901d99b1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:10.759200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87316a9-a4dd-4fac-b30b-6bc04c7a798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:10.760431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87316a9-a4dd-4fac-b30b-6bc04c7a798f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:10.761299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87316a9-a4dd-4fac-b30b-6bc04c7a798f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:10.761635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87316a9-a4dd-4fac-b30b-6bc04c7a798f admin admin] PATH_INFO: `/v3/users/d04ef0c295e14b1dbbdf3c29dcb2f966` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:10.763853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87316a9-a4dd-4fac-b30b-6bc04c7a798f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d04ef0c295e14b1dbbdf3c29dcb2f966)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:10.767564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87316a9-a4dd-4fac-b30b-6bc04c7a798f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:10.793363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fbfc266e-5cc7-4f84-9404-a2c72a86937c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c35904e81a46218949daec63308c8c', 'request_id': 'req-fbfc266e-5cc7-4f84-9404-a2c72a86937c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:10.801375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fbfc266e-5cc7-4f84-9404-a2c72a86937c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c35904e81a46218949daec63308c8c', 'request_id': 'req-fbfc266e-5cc7-4f84-9404-a2c72a86937c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:10.809074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fbfc266e-5cc7-4f84-9404-a2c72a86937c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c35904e81a46218949daec63308c8c', 'request_id': 'req-fbfc266e-5cc7-4f84-9404-a2c72a86937c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:10.836144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fbfc266e-5cc7-4f84-9404-a2c72a86937c admin admin] The token cache is being invalidate because project f8c35904e81a46218949daec63308c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:24:10.836480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fbfc266e-5cc7-4f84-9404-a2c72a86937c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:10.837312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fbfc266e-5cc7-4f84-9404-a2c72a86937c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:10.839367 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1370/2748] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:24:10 2022] DELETE /identity/v3/projects/f8c35904e81a46218949daec63308c8c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:10.844564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0422b-4758-4a02-9661-1fcb172b1913 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:10.844844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0422b-4758-4a02-9661-1fcb172b1913 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:10.845138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0422b-4758-4a02-9661-1fcb172b1913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:10.851061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e87316a9-a4dd-4fac-b30b-6bc04c7a798f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd04ef0c295e14b1dbbdf3c29dcb2f966'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:10.852448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e87316a9-a4dd-4fac-b30b-6bc04c7a798f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd04ef0c295e14b1dbbdf3c29dcb2f966'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:10.861960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:10.867724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e87316a9-a4dd-4fac-b30b-6bc04c7a798f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd04ef0c295e14b1dbbdf3c29dcb2f966'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:10.871207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-36f0422b-4758-4a02-9661-1fcb172b1913 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:10.872539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-36f0422b-4758-4a02-9661-1fcb172b1913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:10.878411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e87316a9-a4dd-4fac-b30b-6bc04c7a798f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd04ef0c295e14b1dbbdf3c29dcb2f966'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:10.895442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e87316a9-a4dd-4fac-b30b-6bc04c7a798f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd04ef0c295e14b1dbbdf3c29dcb2f966'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:10.902318 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1379/2749] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:24:10 2022] DELETE /identity/v3/users/d04ef0c295e14b1dbbdf3c29dcb2f966 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:10.959813 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1371/2750] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:10.968532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0491e90-1c43-4c57-bff4-acf6e7224775 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:10.968819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0491e90-1c43-4c57-bff4-acf6e7224775 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:10.969193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0491e90-1c43-4c57-bff4-acf6e7224775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:10.995637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b0491e90-1c43-4c57-bff4-acf6e7224775 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:10.997020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0491e90-1c43-4c57-bff4-acf6e7224775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:11.086194 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1380/2751] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:11.092989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0422b-4758-4a02-9661-1fcb172b1913 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:11.111799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0422b-4758-4a02-9661-1fcb172b1913 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:11.125726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0524d1-a713-47e3-94f7-ce9f96d0ff86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:11.127528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0524d1-a713-47e3-94f7-ce9f96d0ff86 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:11.128157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0524d1-a713-47e3-94f7-ce9f96d0ff86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:11.128687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0524d1-a713-47e3-94f7-ce9f96d0ff86 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:11.130251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0524d1-a713-47e3-94f7-ce9f96d0ff86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:24:11.130976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0524d1-a713-47e3-94f7-ce9f96d0ff86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:11.137190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0524d1-a713-47e3-94f7-ce9f96d0ff86 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:11.152864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0491e90-1c43-4c57-bff4-acf6e7224775 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:11.154458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0491e90-1c43-4c57-bff4-acf6e7224775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:11.170901 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1372/2752] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:24:11.174504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0491e90-1c43-4c57-bff4-acf6e7224775 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:11.176797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0524d1-a713-47e3-94f7-ce9f96d0ff86 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:11.185606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7c2ff-2f64-4b1a-82d5-58b19b12c117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:11.186604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7c2ff-2f64-4b1a-82d5-58b19b12c117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:11.186972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7c2ff-2f64-4b1a-82d5-58b19b12c117 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:11.188086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7c2ff-2f64-4b1a-82d5-58b19b12c117 admin admin] PATH_INFO: `/v3/projects/2d7da5de7cfc40e3acb7ccaeb19678f1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:11.189979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7c2ff-2f64-4b1a-82d5-58b19b12c117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7da5de7cfc40e3acb7ccaeb19678f1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:11.191532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0524d1-a713-47e3-94f7-ce9f96d0ff86 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:11.192442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7c2ff-2f64-4b1a-82d5-58b19b12c117 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:11.211732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fa942-211e-4abb-a0f2-ee32ef7ec675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:11.212363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fa942-211e-4abb-a0f2-ee32ef7ec675 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:11.212782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fa942-211e-4abb-a0f2-ee32ef7ec675 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:11.213054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fa942-211e-4abb-a0f2-ee32ef7ec675 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:11.213874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fa942-211e-4abb-a0f2-ee32ef7ec675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:11.215883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fa942-211e-4abb-a0f2-ee32ef7ec675 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:11.231154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:11.258229 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1373/2753] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:24:11 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:24:11.262096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fa942-211e-4abb-a0f2-ee32ef7ec675 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:11.280186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05e7c2ff-2f64-4b1a-82d5-58b19b12c117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7da5de7cfc40e3acb7ccaeb19678f1', 'request_id': 'req-05e7c2ff-2f64-4b1a-82d5-58b19b12c117'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:11.289729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05e7c2ff-2f64-4b1a-82d5-58b19b12c117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7da5de7cfc40e3acb7ccaeb19678f1', 'request_id': 'req-05e7c2ff-2f64-4b1a-82d5-58b19b12c117'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:11.302884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05e7c2ff-2f64-4b1a-82d5-58b19b12c117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7da5de7cfc40e3acb7ccaeb19678f1', 'request_id': 'req-05e7c2ff-2f64-4b1a-82d5-58b19b12c117'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:11.316679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05e7c2ff-2f64-4b1a-82d5-58b19b12c117 admin admin] The token cache is being invalidate because project 2d7da5de7cfc40e3acb7ccaeb19678f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:24:11.317262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05e7c2ff-2f64-4b1a-82d5-58b19b12c117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:11.318151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05e7c2ff-2f64-4b1a-82d5-58b19b12c117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:11.320558 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1381/2754] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:24:11 2022] DELETE /identity/v3/projects/2d7da5de7cfc40e3acb7ccaeb19678f1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:24:11.325627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcb6cc-b1ab-4691-b5c1-db1e2d22e6e2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:11.325903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcb6cc-b1ab-4691-b5c1-db1e2d22e6e2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:11.326196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcb6cc-b1ab-4691-b5c1-db1e2d22e6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:11.363917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fa942-211e-4abb-a0f2-ee32ef7ec675 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:11.365594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-98dcb6cc-b1ab-4691-b5c1-db1e2d22e6e2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:11.366836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98dcb6cc-b1ab-4691-b5c1-db1e2d22e6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:11.472854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:11.497214 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1382/2755] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:11.505732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbcbb0-ca0e-423c-90b6-a3f8a0a582bb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:11.506012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbcbb0-ca0e-423c-90b6-a3f8a0a582bb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:11.506656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbcbb0-ca0e-423c-90b6-a3f8a0a582bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:11.520472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1e01e-56f9-4b0e-9fb6-1c91e05f4381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:11.521196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1e01e-56f9-4b0e-9fb6-1c91e05f4381 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:11.521380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1e01e-56f9-4b0e-9fb6-1c91e05f4381 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:11.521801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1e01e-56f9-4b0e-9fb6-1c91e05f4381 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:11.522504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1e01e-56f9-4b0e-9fb6-1c91e05f4381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:11.526391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1e01e-56f9-4b0e-9fb6-1c91e05f4381 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:11.541527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dcfbcbb0-ca0e-423c-90b6-a3f8a0a582bb None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:11.543587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dcfbcbb0-ca0e-423c-90b6-a3f8a0a582bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:11.561069 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1374/2756] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:24:11 2022] POST /identity/v3/users => generated 289 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:24:11.564052 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1383/2757] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:24:11.565032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1e01e-56f9-4b0e-9fb6-1c91e05f4381 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:11.566833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-73d1e01e-56f9-4b0e-9fb6-1c91e05f4381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:11.568011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbcbb0-ca0e-423c-90b6-a3f8a0a582bb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:11.580977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbcbb0-ca0e-423c-90b6-a3f8a0a582bb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:11.581653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1e01e-56f9-4b0e-9fb6-1c91e05f4381 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:11.588416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d47c6e-4ec5-41ad-a839-8b311cfd5461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:11.588706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b380532-0261-44fc-8719-8a429a8c0a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:11.589100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d47c6e-4ec5-41ad-a839-8b311cfd5461 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:11.589377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d47c6e-4ec5-41ad-a839-8b311cfd5461 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:11.589649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d47c6e-4ec5-41ad-a839-8b311cfd5461 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:11.589872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b380532-0261-44fc-8719-8a429a8c0a37 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:11.589988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b380532-0261-44fc-8719-8a429a8c0a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:11.590236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b380532-0261-44fc-8719-8a429a8c0a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:11.590356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d47c6e-4ec5-41ad-a839-8b311cfd5461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:24:11.590600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d47c6e-4ec5-41ad-a839-8b311cfd5461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:11.591295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b380532-0261-44fc-8719-8a429a8c0a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:11.592999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d47c6e-4ec5-41ad-a839-8b311cfd5461 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:11.596372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b380532-0261-44fc-8719-8a429a8c0a37 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:11.607877 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1384/2758] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:24:11.612509 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1375/2759] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:24:11.613002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d47c6e-4ec5-41ad-a839-8b311cfd5461 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:11.614775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b380532-0261-44fc-8719-8a429a8c0a37 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:11.625183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d47c6e-4ec5-41ad-a839-8b311cfd5461 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:11.626561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b380532-0261-44fc-8719-8a429a8c0a37 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:11.631511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a91f4-05ac-4d80-9ace-23aeab0fb8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:11.632070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28ca10-d390-4d48-9a31-5d92d90e3a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:11.632363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a91f4-05ac-4d80-9ace-23aeab0fb8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:11.632641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a91f4-05ac-4d80-9ace-23aeab0fb8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:11.632748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ca10-d390-4d48-9a31-5d92d90e3a88 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:11.632905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a91f4-05ac-4d80-9ace-23aeab0fb8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:11.633024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ca10-d390-4d48-9a31-5d92d90e3a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:11.633224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ca10-d390-4d48-9a31-5d92d90e3a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:11.633726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a91f4-05ac-4d80-9ace-23aeab0fb8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:11.633902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28ca10-d390-4d48-9a31-5d92d90e3a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:11.635748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a91f4-05ac-4d80-9ace-23aeab0fb8f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:11.636054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28ca10-d390-4d48-9a31-5d92d90e3a88 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:11.651047 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1376/2760] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:24:11.656125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28ca10-d390-4d48-9a31-5d92d90e3a88 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:11.668684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28ca10-d390-4d48-9a31-5d92d90e3a88 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:11.675088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e33a7-dfef-43f3-bfa7-f80474ee49f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:11.676239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e33a7-dfef-43f3-bfa7-f80474ee49f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:11.676687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e33a7-dfef-43f3-bfa7-f80474ee49f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:11.677385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e33a7-dfef-43f3-bfa7-f80474ee49f5 admin admin] PATH_INFO: `/v3/projects/861b93f6092340adb333f83c7e154e7f/users/f66ef495d0fa48edb3c7e25ec8a5ffda/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:11.679608 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1385/2761] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:24:11 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:24:11.684785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a91f4-05ac-4d80-9ace-23aeab0fb8f6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:11.698229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e33a7-dfef-43f3-bfa7-f80474ee49f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=861b93f6092340adb333f83c7e154e7f, user_id=f66ef495d0fa48edb3c7e25ec8a5ffda, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:11.701779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e33a7-dfef-43f3-bfa7-f80474ee49f5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:11.729695 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1377/2762] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:24:11 2022] PUT /identity/v3/projects/861b93f6092340adb333f83c7e154e7f/users/f66ef495d0fa48edb3c7e25ec8a5ffda/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:24:11.732464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312344e7-92b5-4efd-aae2-d1208039cfa3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:11.732883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312344e7-92b5-4efd-aae2-d1208039cfa3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:11.733162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312344e7-92b5-4efd-aae2-d1208039cfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:11.772691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a91f4-05ac-4d80-9ace-23aeab0fb8f6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:11.802856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-312344e7-92b5-4efd-aae2-d1208039cfa3 None None] MFA Rules not processed for user `f66ef495d0fa48edb3c7e25ec8a5ffda`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:11.804125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-312344e7-92b5-4efd-aae2-d1208039cfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:11.869373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:11.902549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5e548-3dab-455b-8e06-8e61f2236d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:11.903351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5e548-3dab-455b-8e06-8e61f2236d6f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:11.903816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5e548-3dab-455b-8e06-8e61f2236d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:11.904166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5e548-3dab-455b-8e06-8e61f2236d6f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:11.904829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5e548-3dab-455b-8e06-8e61f2236d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:11.907165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5e548-3dab-455b-8e06-8e61f2236d6f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:11.931028 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1378/2763] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:11.936091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312344e7-92b5-4efd-aae2-d1208039cfa3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:11.944177 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1386/2764] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:24:11 2022] POST /identity/v3/users => generated 295 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:24:11.945850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5e548-3dab-455b-8e06-8e61f2236d6f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:11.960896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312344e7-92b5-4efd-aae2-d1208039cfa3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:11.968231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5e548-3dab-455b-8e06-8e61f2236d6f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:11.969222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cbeea-e837-47be-9e46-53887477d763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:11.970991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cbeea-e837-47be-9e46-53887477d763 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:11.971573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cbeea-e837-47be-9e46-53887477d763 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:11.972100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cbeea-e837-47be-9e46-53887477d763 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:11.973143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cbeea-e837-47be-9e46-53887477d763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:11.974957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c6edf-9543-420c-a44d-38a2bee1987e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:11.975728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c6edf-9543-420c-a44d-38a2bee1987e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:11.976108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c6edf-9543-420c-a44d-38a2bee1987e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:11.976476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c6edf-9543-420c-a44d-38a2bee1987e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:11.977177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cbeea-e837-47be-9e46-53887477d763 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:11.977358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c6edf-9543-420c-a44d-38a2bee1987e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:11.979372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c6edf-9543-420c-a44d-38a2bee1987e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:11.994166 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1387/2765] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:24:11.995544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c6edf-9543-420c-a44d-38a2bee1987e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:12.007239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c6edf-9543-420c-a44d-38a2bee1987e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:12.011311 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1379/2766] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:24:11 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:24:12.012759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9233874-33e5-4308-88a0-793be4fafba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:12.013410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9233874-33e5-4308-88a0-793be4fafba3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:12.013686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9233874-33e5-4308-88a0-793be4fafba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:12.013994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9233874-33e5-4308-88a0-793be4fafba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:12.014657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9233874-33e5-4308-88a0-793be4fafba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:12.015591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cbeea-e837-47be-9e46-53887477d763 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:12.016304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9233874-33e5-4308-88a0-793be4fafba3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:12.028152 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1388/2767] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:24:12.032557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9233874-33e5-4308-88a0-793be4fafba3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:12.048302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9233874-33e5-4308-88a0-793be4fafba3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:12.075891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:12.111733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cbeea-e837-47be-9e46-53887477d763 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:12.117134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d0f22-7194-46a0-9cc3-a685af7df6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:12.118128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d0f22-7194-46a0-9cc3-a685af7df6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:12.118413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d0f22-7194-46a0-9cc3-a685af7df6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:12.118667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98956954-33b9-4f04-9eac-fcf9f000fe90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:12.119142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d0f22-7194-46a0-9cc3-a685af7df6e5 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:12.120261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98956954-33b9-4f04-9eac-fcf9f000fe90 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:12.120386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d0f22-7194-46a0-9cc3-a685af7df6e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:12.120838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98956954-33b9-4f04-9eac-fcf9f000fe90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:12.121449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98956954-33b9-4f04-9eac-fcf9f000fe90 admin admin] PATH_INFO: `/v3/projects/ebb3b3a3e61d419b93d6c92b925aec09/users/447e92e13f1842d0942e72f02005ea10/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:12.122166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d0f22-7194-46a0-9cc3-a685af7df6e5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:12.140641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98956954-33b9-4f04-9eac-fcf9f000fe90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb3b3a3e61d419b93d6c92b925aec09, user_id=447e92e13f1842d0942e72f02005ea10, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:12.144118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98956954-33b9-4f04-9eac-fcf9f000fe90 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:12.150460 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1380/2768] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:24:12 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:24:12.151749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d0f22-7194-46a0-9cc3-a685af7df6e5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:12.164249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d0f22-7194-46a0-9cc3-a685af7df6e5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:12.168243 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1389/2769] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:24:12 2022] PUT /identity/v3/projects/ebb3b3a3e61d419b93d6c92b925aec09/users/447e92e13f1842d0942e72f02005ea10/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:24:12.189442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c855b-2f81-4484-abda-fe764f54c532 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:12.189922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c855b-2f81-4484-abda-fe764f54c532 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:12.191403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c855b-2f81-4484-abda-fe764f54c532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:12.219623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d74c855b-2f81-4484-abda-fe764f54c532 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:12.220901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d74c855b-2f81-4484-abda-fe764f54c532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:12.276022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bbd88-67f7-4106-ba27-48020fba239f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:12.277438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bbd88-67f7-4106-ba27-48020fba239f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:12.278433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bbd88-67f7-4106-ba27-48020fba239f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:12.278709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bbd88-67f7-4106-ba27-48020fba239f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:12.279950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bbd88-67f7-4106-ba27-48020fba239f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:12.281739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bbd88-67f7-4106-ba27-48020fba239f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:12.296938 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1381/2770] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:24:12.302351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bbd88-67f7-4106-ba27-48020fba239f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:12.352356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bbd88-67f7-4106-ba27-48020fba239f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:12.372533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06880a22-8f61-4592-8289-10b67c1c9b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:12.375446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06880a22-8f61-4592-8289-10b67c1c9b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:12.375817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06880a22-8f61-4592-8289-10b67c1c9b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:12.376199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06880a22-8f61-4592-8289-10b67c1c9b4c admin admin] PATH_INFO: `/v3/projects/4c20182064544f3c96302c7a4175810d/users/33b92691235b41ec82c610fa8507dbb4/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:12.397118 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1390/2771] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:12.408790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c855b-2f81-4484-abda-fe764f54c532 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:12.411618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d74c855b-2f81-4484-abda-fe764f54c532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:12.413195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06880a22-8f61-4592-8289-10b67c1c9b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c20182064544f3c96302c7a4175810d, user_id=33b92691235b41ec82c610fa8507dbb4, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:12.417516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06880a22-8f61-4592-8289-10b67c1c9b4c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:12.435160 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1382/2772] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:24:12 2022] PUT /identity/v3/projects/4c20182064544f3c96302c7a4175810d/users/33b92691235b41ec82c610fa8507dbb4/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:12.439732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06880a22-8f61-4592-8289-10b67c1c9b4c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:12.455642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:12.520357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06880a22-8f61-4592-8289-10b67c1c9b4c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:12.527409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02419907-c4f6-45f5-a2c6-f3cf712f27de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:12.528216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419907-c4f6-45f5-a2c6-f3cf712f27de admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:12.528561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419907-c4f6-45f5-a2c6-f3cf712f27de admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:12.528900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419907-c4f6-45f5-a2c6-f3cf712f27de admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:12.529784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02419907-c4f6-45f5-a2c6-f3cf712f27de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:12.533004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02419907-c4f6-45f5-a2c6-f3cf712f27de admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:12.538747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c855b-2f81-4484-abda-fe764f54c532 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:12.545822 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1383/2773] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:24:12.550023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02419907-c4f6-45f5-a2c6-f3cf712f27de admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:12.562739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02419907-c4f6-45f5-a2c6-f3cf712f27de admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:12.577637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f0266-2629-48ea-bedb-79c40faf4596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:12.579177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f0266-2629-48ea-bedb-79c40faf4596 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:12.579489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f0266-2629-48ea-bedb-79c40faf4596 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:12.579762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f0266-2629-48ea-bedb-79c40faf4596 admin admin] PATH_INFO: `/v3/projects/4c20182064544f3c96302c7a4175810d/users/33b92691235b41ec82c610fa8507dbb4/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:12.582499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f0266-2629-48ea-bedb-79c40faf4596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c20182064544f3c96302c7a4175810d, user_id=33b92691235b41ec82c610fa8507dbb4, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:12.585564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f0266-2629-48ea-bedb-79c40faf4596 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:12.598736 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1384/2774] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:24:12 2022] PUT /identity/v3/projects/4c20182064544f3c96302c7a4175810d/users/33b92691235b41ec82c610fa8507dbb4/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:24:12.610087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b36555-8023-4b21-b45c-b792c3a3511e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:12.610484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b36555-8023-4b21-b45c-b792c3a3511e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:12.610773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b36555-8023-4b21-b45c-b792c3a3511e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:12.620834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf3431-4ead-4ef6-8d1c-407d06aafde0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:12.621736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf3431-4ead-4ef6-8d1c-407d06aafde0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:12.622104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf3431-4ead-4ef6-8d1c-407d06aafde0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:12.622448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf3431-4ead-4ef6-8d1c-407d06aafde0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:12.633845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf3431-4ead-4ef6-8d1c-407d06aafde0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:12.635461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf3431-4ead-4ef6-8d1c-407d06aafde0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:12.647100 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1391/2775] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:12.656779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-15b36555-8023-4b21-b45c-b792c3a3511e None None] MFA Rules not processed for user `33b92691235b41ec82c610fa8507dbb4`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:12.658169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-15b36555-8023-4b21-b45c-b792c3a3511e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:12.763537 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1385/2776] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:24:12.772347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf3431-4ead-4ef6-8d1c-407d06aafde0 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:12.774082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3ddf3431-4ead-4ef6-8d1c-407d06aafde0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:12.789311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:12.887227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf3431-4ead-4ef6-8d1c-407d06aafde0 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:12.971676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85e9d2-18aa-4a0e-9fdf-affc7a4fdc87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:12.972536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85e9d2-18aa-4a0e-9fdf-affc7a4fdc87 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:12.972985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85e9d2-18aa-4a0e-9fdf-affc7a4fdc87 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:12.973452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85e9d2-18aa-4a0e-9fdf-affc7a4fdc87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:12.984602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85e9d2-18aa-4a0e-9fdf-affc7a4fdc87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:12.987865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85e9d2-18aa-4a0e-9fdf-affc7a4fdc87 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:13.000861 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1392/2777] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:13.297573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b36555-8023-4b21-b45c-b792c3a3511e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:13.372993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b36555-8023-4b21-b45c-b792c3a3511e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:13.378715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04a4d3-a13a-4217-a1b8-d608caf07230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:13.380062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04a4d3-a13a-4217-a1b8-d608caf07230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:13.380062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04a4d3-a13a-4217-a1b8-d608caf07230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:13.380062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04a4d3-a13a-4217-a1b8-d608caf07230 admin admin] PATH_INFO: `/v3/users/f66ef495d0fa48edb3c7e25ec8a5ffda` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:13.381134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04a4d3-a13a-4217-a1b8-d608caf07230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f66ef495d0fa48edb3c7e25ec8a5ffda)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:13.383103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04a4d3-a13a-4217-a1b8-d608caf07230 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:13.409600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:13.450679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d04a4d3-a13a-4217-a1b8-d608caf07230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f66ef495d0fa48edb3c7e25ec8a5ffda'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:13.472600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d04a4d3-a13a-4217-a1b8-d608caf07230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f66ef495d0fa48edb3c7e25ec8a5ffda'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:13.473357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d04a4d3-a13a-4217-a1b8-d608caf07230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f66ef495d0fa48edb3c7e25ec8a5ffda'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:13.473997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d04a4d3-a13a-4217-a1b8-d608caf07230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f66ef495d0fa48edb3c7e25ec8a5ffda'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:13.489904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d04a4d3-a13a-4217-a1b8-d608caf07230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f66ef495d0fa48edb3c7e25ec8a5ffda'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:13.506408 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1386/2778] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:24:13 2022] DELETE /identity/v3/users/f66ef495d0fa48edb3c7e25ec8a5ffda => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:13.510981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8d1c1-1e44-4576-a14d-ee02b5053c1c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:13.511588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8d1c1-1e44-4576-a14d-ee02b5053c1c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:13.511791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8d1c1-1e44-4576-a14d-ee02b5053c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:13.533434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-89f8d1c1-1e44-4576-a14d-ee02b5053c1c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:13.534746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89f8d1c1-1e44-4576-a14d-ee02b5053c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:13.628422 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1393/2779] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:13.640572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04a4d3-a13a-4217-a1b8-d608caf07230 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:13.642957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5d04a4d3-a13a-4217-a1b8-d608caf07230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:13.708420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04a4d3-a13a-4217-a1b8-d608caf07230 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:13.713309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2183d-dfcd-46b4-8a89-b3791e599c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:13.714226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2183d-dfcd-46b4-8a89-b3791e599c4f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:13.714750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2183d-dfcd-46b4-8a89-b3791e599c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:13.715243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2183d-dfcd-46b4-8a89-b3791e599c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:13.726106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2183d-dfcd-46b4-8a89-b3791e599c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:13.728731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2183d-dfcd-46b4-8a89-b3791e599c4f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:13.741513 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1387/2780] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:14.368923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8d1c1-1e44-4576-a14d-ee02b5053c1c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:14.370715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89f8d1c1-1e44-4576-a14d-ee02b5053c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:14.387995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8d1c1-1e44-4576-a14d-ee02b5053c1c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:14.393597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf008d1-9e68-4eec-aaa0-5bd66644792d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:14.394568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf008d1-9e68-4eec-aaa0-5bd66644792d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:14.394925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf008d1-9e68-4eec-aaa0-5bd66644792d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:14.395281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf008d1-9e68-4eec-aaa0-5bd66644792d admin admin] PATH_INFO: `/v3/projects/861b93f6092340adb333f83c7e154e7f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:14.396776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf008d1-9e68-4eec-aaa0-5bd66644792d admin admin] RBAC: Authorizing `identity:delete_project(project_id=861b93f6092340adb333f83c7e154e7f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:14.399622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf008d1-9e68-4eec-aaa0-5bd66644792d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:14.509652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:14.582239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdf008d1-9e68-4eec-aaa0-5bd66644792d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861b93f6092340adb333f83c7e154e7f', 'request_id': 'req-fdf008d1-9e68-4eec-aaa0-5bd66644792d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:14.606346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdf008d1-9e68-4eec-aaa0-5bd66644792d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861b93f6092340adb333f83c7e154e7f', 'request_id': 'req-fdf008d1-9e68-4eec-aaa0-5bd66644792d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:14.624269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdf008d1-9e68-4eec-aaa0-5bd66644792d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861b93f6092340adb333f83c7e154e7f', 'request_id': 'req-fdf008d1-9e68-4eec-aaa0-5bd66644792d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:14.650867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdf008d1-9e68-4eec-aaa0-5bd66644792d admin admin] The token cache is being invalidate because project 861b93f6092340adb333f83c7e154e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:24:14.651732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdf008d1-9e68-4eec-aaa0-5bd66644792d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:14.652659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdf008d1-9e68-4eec-aaa0-5bd66644792d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:14.657479 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1394/2781] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:24:14 2022] DELETE /identity/v3/projects/861b93f6092340adb333f83c7e154e7f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:14.659012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2183d-dfcd-46b4-8a89-b3791e599c4f service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:14.686080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2183d-dfcd-46b4-8a89-b3791e599c4f service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:14.794698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4024756-0588-4a31-97d1-a5bda37801ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:14.795648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4024756-0588-4a31-97d1-a5bda37801ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:14.795756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4024756-0588-4a31-97d1-a5bda37801ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:14.796017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4024756-0588-4a31-97d1-a5bda37801ed admin admin] PATH_INFO: `/v3/users/33b92691235b41ec82c610fa8507dbb4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:14.797238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4024756-0588-4a31-97d1-a5bda37801ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b92691235b41ec82c610fa8507dbb4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:14.799170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4024756-0588-4a31-97d1-a5bda37801ed admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:14.817207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840e5f5-a89c-478e-bac3-42807c404415 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:14.818045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840e5f5-a89c-478e-bac3-42807c404415 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:14.818513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840e5f5-a89c-478e-bac3-42807c404415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:14.851068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b840e5f5-a89c-478e-bac3-42807c404415 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:14.852915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b840e5f5-a89c-478e-bac3-42807c404415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:14.869769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:14.883617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d4024756-0588-4a31-97d1-a5bda37801ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b92691235b41ec82c610fa8507dbb4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:14.919961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d4024756-0588-4a31-97d1-a5bda37801ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b92691235b41ec82c610fa8507dbb4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:14.922361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d4024756-0588-4a31-97d1-a5bda37801ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b92691235b41ec82c610fa8507dbb4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:14.923693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d4024756-0588-4a31-97d1-a5bda37801ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b92691235b41ec82c610fa8507dbb4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:14.942889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d4024756-0588-4a31-97d1-a5bda37801ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b92691235b41ec82c610fa8507dbb4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:14.956825 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1395/2782] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:24:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:14.959082 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1388/2783] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:24:14 2022] DELETE /identity/v3/users/33b92691235b41ec82c610fa8507dbb4 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:14.978445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840e5f5-a89c-478e-bac3-42807c404415 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:14.981297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b840e5f5-a89c-478e-bac3-42807c404415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:15.098864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840e5f5-a89c-478e-bac3-42807c404415 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:15.201863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3c32f-9d76-4cc3-9675-00364514500c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:15.202606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3c32f-9d76-4cc3-9675-00364514500c service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:15.202999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3c32f-9d76-4cc3-9675-00364514500c service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:15.203409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3c32f-9d76-4cc3-9675-00364514500c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:15.208704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:15.318895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4024756-0588-4a31-97d1-a5bda37801ed admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:15.325043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d4024756-0588-4a31-97d1-a5bda37801ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:15.326926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3c32f-9d76-4cc3-9675-00364514500c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:15.331187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3c32f-9d76-4cc3-9675-00364514500c service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:15.349168 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1396/2784] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:24:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:24:15.445633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4024756-0588-4a31-97d1-a5bda37801ed admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:15.453177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672f5ae-bf20-4af1-b51c-5995866ce959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:15.453848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672f5ae-bf20-4af1-b51c-5995866ce959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:15.454163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672f5ae-bf20-4af1-b51c-5995866ce959 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:15.454556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672f5ae-bf20-4af1-b51c-5995866ce959 admin admin] PATH_INFO: `/v3/projects/4c20182064544f3c96302c7a4175810d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:15.460706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672f5ae-bf20-4af1-b51c-5995866ce959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c20182064544f3c96302c7a4175810d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:15.463009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672f5ae-bf20-4af1-b51c-5995866ce959 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:15.597407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c672f5ae-bf20-4af1-b51c-5995866ce959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c20182064544f3c96302c7a4175810d', 'request_id': 'req-c672f5ae-bf20-4af1-b51c-5995866ce959'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:15.649433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c672f5ae-bf20-4af1-b51c-5995866ce959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c20182064544f3c96302c7a4175810d', 'request_id': 'req-c672f5ae-bf20-4af1-b51c-5995866ce959'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:15.672746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c672f5ae-bf20-4af1-b51c-5995866ce959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c20182064544f3c96302c7a4175810d', 'request_id': 'req-c672f5ae-bf20-4af1-b51c-5995866ce959'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:15.716062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c672f5ae-bf20-4af1-b51c-5995866ce959 admin admin] The token cache is being invalidate because project 4c20182064544f3c96302c7a4175810d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:24:15.716455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c672f5ae-bf20-4af1-b51c-5995866ce959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:15.723974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c672f5ae-bf20-4af1-b51c-5995866ce959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:15.728790 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1389/2785] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:24:15 2022] DELETE /identity/v3/projects/4c20182064544f3c96302c7a4175810d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:24:15.739627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65af704-4767-497f-b2a7-bc105875ec7c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:15.740229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65af704-4767-497f-b2a7-bc105875ec7c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:15.740372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65af704-4767-497f-b2a7-bc105875ec7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:15.779610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b65af704-4767-497f-b2a7-bc105875ec7c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:15.782839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b65af704-4767-497f-b2a7-bc105875ec7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:15.938387 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1397/2786] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:15.940720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03381758-63b6-40ac-8d9f-8a8590f2b688 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:15.942236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03381758-63b6-40ac-8d9f-8a8590f2b688 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:15.942866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03381758-63b6-40ac-8d9f-8a8590f2b688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:15.969989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-03381758-63b6-40ac-8d9f-8a8590f2b688 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:15.971324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-03381758-63b6-40ac-8d9f-8a8590f2b688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:15.981048 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1390/2787] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:15.985589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65af704-4767-497f-b2a7-bc105875ec7c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:15.997046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65af704-4767-497f-b2a7-bc105875ec7c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:16.002549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c170d6-5c2c-47ee-9f02-301d831d6c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:16.004398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c170d6-5c2c-47ee-9f02-301d831d6c3f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:16.004811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c170d6-5c2c-47ee-9f02-301d831d6c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:16.005186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c170d6-5c2c-47ee-9f02-301d831d6c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:16.006568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c170d6-5c2c-47ee-9f02-301d831d6c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:24:16.006987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c170d6-5c2c-47ee-9f02-301d831d6c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:16.009306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c170d6-5c2c-47ee-9f02-301d831d6c3f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:16.026267 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1398/2788] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:24:16.031146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03381758-63b6-40ac-8d9f-8a8590f2b688 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:16.045438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03381758-63b6-40ac-8d9f-8a8590f2b688 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:16.060644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb4433-991c-4b36-a6e9-8058607e7f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:16.061287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb4433-991c-4b36-a6e9-8058607e7f8e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:16.062022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb4433-991c-4b36-a6e9-8058607e7f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:16.062301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb4433-991c-4b36-a6e9-8058607e7f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:16.062986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb4433-991c-4b36-a6e9-8058607e7f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:16.065502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb4433-991c-4b36-a6e9-8058607e7f8e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:16.132886 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1391/2789] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:24:16 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:24:16.137276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c170d6-5c2c-47ee-9f02-301d831d6c3f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:16.150501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c170d6-5c2c-47ee-9f02-301d831d6c3f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:16.271597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815ee4d-bd6c-41c4-a1de-f1177a040bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:16.272236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815ee4d-bd6c-41c4-a1de-f1177a040bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:16.272511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815ee4d-bd6c-41c4-a1de-f1177a040bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:16.272783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815ee4d-bd6c-41c4-a1de-f1177a040bd3 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:16.273591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815ee4d-bd6c-41c4-a1de-f1177a040bd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:16.276086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815ee4d-bd6c-41c4-a1de-f1177a040bd3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:16.328691 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1399/2790] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:24:16 2022] POST /identity/v3/users => generated 282 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:24:16.330773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb4433-991c-4b36-a6e9-8058607e7f8e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:16.348798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb4433-991c-4b36-a6e9-8058607e7f8e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:16.363752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14092aa2-1f67-4432-a464-e42a35744487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:16.364401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14092aa2-1f67-4432-a464-e42a35744487 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:16.364678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14092aa2-1f67-4432-a464-e42a35744487 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:16.364952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14092aa2-1f67-4432-a464-e42a35744487 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:16.365686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14092aa2-1f67-4432-a464-e42a35744487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:16.367914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14092aa2-1f67-4432-a464-e42a35744487 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:16.394932 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1392/2791] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:24:16.396336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815ee4d-bd6c-41c4-a1de-f1177a040bd3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:16.407776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815ee4d-bd6c-41c4-a1de-f1177a040bd3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:16.433325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eac7d-f5d6-4cf2-a3fe-a35588146cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:16.434002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eac7d-f5d6-4cf2-a3fe-a35588146cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:16.434280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eac7d-f5d6-4cf2-a3fe-a35588146cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:16.434551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eac7d-f5d6-4cf2-a3fe-a35588146cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:16.443332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86eac7d-f5d6-4cf2-a3fe-a35588146cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:16.445244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86eac7d-f5d6-4cf2-a3fe-a35588146cf7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:16.481487 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1400/2792] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:24:16.482308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14092aa2-1f67-4432-a464-e42a35744487 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:16.501435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14092aa2-1f67-4432-a464-e42a35744487 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:16.518857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3740b-59dc-4337-b668-6d51927a61a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:16.519613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3740b-59dc-4337-b668-6d51927a61a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:16.519892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3740b-59dc-4337-b668-6d51927a61a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:16.520265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3740b-59dc-4337-b668-6d51927a61a3 admin admin] PATH_INFO: `/v3/projects/e4dbca9f71ac4a208e050eb7be880699/users/bc2c3257ad8a48c6adbfef6617e379d8/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:16.545339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:16.564519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3740b-59dc-4337-b668-6d51927a61a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4dbca9f71ac4a208e050eb7be880699, user_id=bc2c3257ad8a48c6adbfef6617e379d8, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:16.570655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3740b-59dc-4337-b668-6d51927a61a3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:16.606305 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1393/2793] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:24:16 2022] PUT /identity/v3/projects/e4dbca9f71ac4a208e050eb7be880699/users/bc2c3257ad8a48c6adbfef6617e379d8/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:24:16.611309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4e9a6-e8af-4c94-9c1d-144cc975cfcc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:16.611856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4e9a6-e8af-4c94-9c1d-144cc975cfcc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:16.612280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4e9a6-e8af-4c94-9c1d-144cc975cfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:16.678195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9bf4e9a6-e8af-4c94-9c1d-144cc975cfcc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:16.679468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9bf4e9a6-e8af-4c94-9c1d-144cc975cfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:16.693435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:16.816709 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1401/2794] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:16.828000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3740b-59dc-4337-b668-6d51927a61a3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:16.830248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-52a3740b-59dc-4337-b668-6d51927a61a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:16.963131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3740b-59dc-4337-b668-6d51927a61a3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:16.973680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34f898-f4d4-4be7-8a13-b72ace0bd28a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:16.974400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f898-f4d4-4be7-8a13-b72ace0bd28a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:16.974679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f898-f4d4-4be7-8a13-b72ace0bd28a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:16.974954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f898-f4d4-4be7-8a13-b72ace0bd28a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:16.997385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34f898-f4d4-4be7-8a13-b72ace0bd28a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:17.006156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34f898-f4d4-4be7-8a13-b72ace0bd28a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:17.040150 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1394/2795] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:17.577205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403f55d-2d4c-4386-a638-a2ec89fab626 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:17.577493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403f55d-2d4c-4386-a638-a2ec89fab626 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:17.577832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403f55d-2d4c-4386-a638-a2ec89fab626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:17.647491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2403f55d-2d4c-4386-a638-a2ec89fab626 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:17.651168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2403f55d-2d4c-4386-a638-a2ec89fab626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:17.883314 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1402/2796] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:24:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:17.898120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34f898-f4d4-4be7-8a13-b72ace0bd28a service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:17.900234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7d34f898-f4d4-4be7-8a13-b72ace0bd28a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:18.063504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34f898-f4d4-4be7-8a13-b72ace0bd28a service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:18.070583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e1657-6462-401f-85ea-93bbd71cef12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:18.073061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e1657-6462-401f-85ea-93bbd71cef12 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:18.073404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e1657-6462-401f-85ea-93bbd71cef12 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:18.073771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e1657-6462-401f-85ea-93bbd71cef12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:18.097808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e1657-6462-401f-85ea-93bbd71cef12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:18.100079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e1657-6462-401f-85ea-93bbd71cef12 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:18.121705 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1395/2797] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:24:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:24:20.340198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7476f8-e291-4ea2-9fe7-60ec7cfe870f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:20.340714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7476f8-e291-4ea2-9fe7-60ec7cfe870f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:20.340799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7476f8-e291-4ea2-9fe7-60ec7cfe870f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:20.417408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fc7476f8-e291-4ea2-9fe7-60ec7cfe870f None None] MFA Rules not processed for user `447e92e13f1842d0942e72f02005ea10`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:20.423471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc7476f8-e291-4ea2-9fe7-60ec7cfe870f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:20.619828 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1403/2798] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:20.630594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e46254-6e48-4d8d-b9bd-9731342c0cc4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:20.631137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e46254-6e48-4d8d-b9bd-9731342c0cc4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:20.631137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e46254-6e48-4d8d-b9bd-9731342c0cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:20.674414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-98e46254-6e48-4d8d-b9bd-9731342c0cc4 None None] MFA Rules not processed for user `447e92e13f1842d0942e72f02005ea10`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:20.676533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-98e46254-6e48-4d8d-b9bd-9731342c0cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:20.698668 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1396/2799] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:20.715150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7476f8-e291-4ea2-9fe7-60ec7cfe870f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:20.716956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc7476f8-e291-4ea2-9fe7-60ec7cfe870f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:20.862511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:20.932711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7476f8-e291-4ea2-9fe7-60ec7cfe870f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:20.951561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaec68e-3b1f-4b9f-9952-8b8d2344f5e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:20.952814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaec68e-3b1f-4b9f-9952-8b8d2344f5e9 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:20.953308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaec68e-3b1f-4b9f-9952-8b8d2344f5e9 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:20.953882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaec68e-3b1f-4b9f-9952-8b8d2344f5e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:20.971208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaec68e-3b1f-4b9f-9952-8b8d2344f5e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:20.972977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaec68e-3b1f-4b9f-9952-8b8d2344f5e9 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:20.988379 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1404/2800] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:22.582005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e46254-6e48-4d8d-b9bd-9731342c0cc4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:22.584113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-98e46254-6e48-4d8d-b9bd-9731342c0cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:22.811968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e46254-6e48-4d8d-b9bd-9731342c0cc4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:22.824373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84885b61-d4e7-4ca7-a085-6201853e11a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:22.825399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84885b61-d4e7-4ca7-a085-6201853e11a6 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:22.825894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84885b61-d4e7-4ca7-a085-6201853e11a6 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:22.826407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84885b61-d4e7-4ca7-a085-6201853e11a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:22.832409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-84885b61-d4e7-4ca7-a085-6201853e11a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:22.856947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84885b61-d4e7-4ca7-a085-6201853e11a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:22.858706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84885b61-d4e7-4ca7-a085-6201853e11a6 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:22.882635 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1397/2801] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:27.244431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaec68e-3b1f-4b9f-9952-8b8d2344f5e9 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:27.246615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1aaec68e-3b1f-4b9f-9952-8b8d2344f5e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:27.362407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaec68e-3b1f-4b9f-9952-8b8d2344f5e9 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:27.397341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119993c-4114-4735-8c26-6549efffff00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:27.400433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119993c-4114-4735-8c26-6549efffff00 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:27.402350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119993c-4114-4735-8c26-6549efffff00 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:27.403041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119993c-4114-4735-8c26-6549efffff00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:27.408089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6119993c-4114-4735-8c26-6549efffff00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:27.448000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119993c-4114-4735-8c26-6549efffff00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:27.453230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119993c-4114-4735-8c26-6549efffff00 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:27.490008 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1405/2802] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:32.044240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84885b61-d4e7-4ca7-a085-6201853e11a6 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:32.051562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:32.068966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84885b61-d4e7-4ca7-a085-6201853e11a6 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:32.079374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431edf86-496b-4c1e-9485-6187385ff75c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:32.080115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431edf86-496b-4c1e-9485-6187385ff75c service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:32.080390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431edf86-496b-4c1e-9485-6187385ff75c service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:32.081054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431edf86-496b-4c1e-9485-6187385ff75c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:32.083302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-431edf86-496b-4c1e-9485-6187385ff75c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:32.099299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431edf86-496b-4c1e-9485-6187385ff75c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:32.104118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431edf86-496b-4c1e-9485-6187385ff75c service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:32.118913 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1398/2803] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:32.521775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119993c-4114-4735-8c26-6549efffff00 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:32.535174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119993c-4114-4735-8c26-6549efffff00 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:32.552858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b45cc-9768-4cfa-845d-bd6b7ea080aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:32.565684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b45cc-9768-4cfa-845d-bd6b7ea080aa service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:32.566129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b45cc-9768-4cfa-845d-bd6b7ea080aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:32.566408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b45cc-9768-4cfa-845d-bd6b7ea080aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:32.577484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-533b45cc-9768-4cfa-845d-bd6b7ea080aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:32.611409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b45cc-9768-4cfa-845d-bd6b7ea080aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:32.613586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b45cc-9768-4cfa-845d-bd6b7ea080aa service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:32.650558 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1406/2804] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:32.820785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31fadb-de97-4400-841f-b7adbde04fac None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:32.821193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31fadb-de97-4400-841f-b7adbde04fac None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:32.821592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31fadb-de97-4400-841f-b7adbde04fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:32.865399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1a31fadb-de97-4400-841f-b7adbde04fac None None] MFA Rules not processed for user `bc2c3257ad8a48c6adbfef6617e379d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:32.867777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1a31fadb-de97-4400-841f-b7adbde04fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:33.011973 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1399/2805] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:33.014315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d81ae-4319-46ae-b81a-08afa312a60d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:33.014814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d81ae-4319-46ae-b81a-08afa312a60d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:33.015318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d81ae-4319-46ae-b81a-08afa312a60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:33.127759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dd8d81ae-4319-46ae-b81a-08afa312a60d None None] MFA Rules not processed for user `bc2c3257ad8a48c6adbfef6617e379d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:33.129817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dd8d81ae-4319-46ae-b81a-08afa312a60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:33.150326 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1407/2806] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:33.166746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31fadb-de97-4400-841f-b7adbde04fac None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:33.192261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31fadb-de97-4400-841f-b7adbde04fac None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:33.205108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc249449-4f5d-45e1-9c86-343ba2f27938 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:33.208960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc249449-4f5d-45e1-9c86-343ba2f27938 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:33.209249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc249449-4f5d-45e1-9c86-343ba2f27938 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:33.209531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc249449-4f5d-45e1-9c86-343ba2f27938 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:33.229270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc249449-4f5d-45e1-9c86-343ba2f27938 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:33.237105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc249449-4f5d-45e1-9c86-343ba2f27938 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:33.263233 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1400/2807] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:38.720571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339044cd-3830-4b07-97de-88bca02fb4d8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:38.721236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339044cd-3830-4b07-97de-88bca02fb4d8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:38.721236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339044cd-3830-4b07-97de-88bca02fb4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:38.797075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-339044cd-3830-4b07-97de-88bca02fb4d8 None None] MFA Rules not processed for user `d14d1e556e644fcdbab72647f2c47960`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:38.808508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-339044cd-3830-4b07-97de-88bca02fb4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:38.953972 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1408/2808] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:40.636104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc249449-4f5d-45e1-9c86-343ba2f27938 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:40.638256 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dc249449-4f5d-45e1-9c86-343ba2f27938 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:40.678440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc249449-4f5d-45e1-9c86-343ba2f27938 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:40.701251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88195264-cbb0-475f-9ee9-a512946ccf52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:40.702242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88195264-cbb0-475f-9ee9-a512946ccf52 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:40.702934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88195264-cbb0-475f-9ee9-a512946ccf52 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:40.703441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88195264-cbb0-475f-9ee9-a512946ccf52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:40.706127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-88195264-cbb0-475f-9ee9-a512946ccf52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:40.751281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88195264-cbb0-475f-9ee9-a512946ccf52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:40.753286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88195264-cbb0-475f-9ee9-a512946ccf52 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:40.787487 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1401/2809] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:41.336970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339044cd-3830-4b07-97de-88bca02fb4d8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:41.338723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-339044cd-3830-4b07-97de-88bca02fb4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:41.363393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339044cd-3830-4b07-97de-88bca02fb4d8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:41.376465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca4187-cd04-4daa-85ee-4e79cf851d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:41.382661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca4187-cd04-4daa-85ee-4e79cf851d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:41.383722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca4187-cd04-4daa-85ee-4e79cf851d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:41.384799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca4187-cd04-4daa-85ee-4e79cf851d72 admin admin] PATH_INFO: `/v3/users/b7c1223d9edc4fb99c8967e089c10fa3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:41.387816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca4187-cd04-4daa-85ee-4e79cf851d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c1223d9edc4fb99c8967e089c10fa3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:41.394262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca4187-cd04-4daa-85ee-4e79cf851d72 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:41.495191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98ca4187-cd04-4daa-85ee-4e79cf851d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c1223d9edc4fb99c8967e089c10fa3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:41.496170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98ca4187-cd04-4daa-85ee-4e79cf851d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c1223d9edc4fb99c8967e089c10fa3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:41.507997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98ca4187-cd04-4daa-85ee-4e79cf851d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c1223d9edc4fb99c8967e089c10fa3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:41.530979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98ca4187-cd04-4daa-85ee-4e79cf851d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c1223d9edc4fb99c8967e089c10fa3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:41.549732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98ca4187-cd04-4daa-85ee-4e79cf851d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c1223d9edc4fb99c8967e089c10fa3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:41.563503 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1409/2810] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:24:41 2022] DELETE /identity/v3/users/b7c1223d9edc4fb99c8967e089c10fa3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:42.591836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88195264-cbb0-475f-9ee9-a512946ccf52 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:42.606863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88195264-cbb0-475f-9ee9-a512946ccf52 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:42.831598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8542c-a59b-471f-a66b-52e319eae075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:42.833625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8542c-a59b-471f-a66b-52e319eae075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:42.834128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8542c-a59b-471f-a66b-52e319eae075 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:42.834624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8542c-a59b-471f-a66b-52e319eae075 admin admin] PATH_INFO: `/v3/projects/758d3c617b1f4d7f87d994fbdd45a076` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:42.836440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8542c-a59b-471f-a66b-52e319eae075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=758d3c617b1f4d7f87d994fbdd45a076)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:42.839800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8542c-a59b-471f-a66b-52e319eae075 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:43.015490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfc8542c-a59b-471f-a66b-52e319eae075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758d3c617b1f4d7f87d994fbdd45a076', 'request_id': 'req-cfc8542c-a59b-471f-a66b-52e319eae075'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:43.045155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfc8542c-a59b-471f-a66b-52e319eae075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758d3c617b1f4d7f87d994fbdd45a076', 'request_id': 'req-cfc8542c-a59b-471f-a66b-52e319eae075'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:43.056809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:43.073887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfc8542c-a59b-471f-a66b-52e319eae075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758d3c617b1f4d7f87d994fbdd45a076', 'request_id': 'req-cfc8542c-a59b-471f-a66b-52e319eae075'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:43.123808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfc8542c-a59b-471f-a66b-52e319eae075 admin admin] The token cache is being invalidate because project 758d3c617b1f4d7f87d994fbdd45a076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:24:43.124225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfc8542c-a59b-471f-a66b-52e319eae075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:43.125639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfc8542c-a59b-471f-a66b-52e319eae075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:43.134447 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1402/2811] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:24:42 2022] DELETE /identity/v3/projects/758d3c617b1f4d7f87d994fbdd45a076 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:43.137558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca4187-cd04-4daa-85ee-4e79cf851d72 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:43.143816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98ca4187-cd04-4daa-85ee-4e79cf851d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:43.245854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca4187-cd04-4daa-85ee-4e79cf851d72 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:43.313494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:43.442730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65accf17-c6e7-4be7-a6ec-89b39302725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:43.443735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65accf17-c6e7-4be7-a6ec-89b39302725c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:43.446538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65accf17-c6e7-4be7-a6ec-89b39302725c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:43.447224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65accf17-c6e7-4be7-a6ec-89b39302725c admin admin] PATH_INFO: `/v3/users/8ca76a8457cb47189ebdd0c8c12974c5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:43.449799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65accf17-c6e7-4be7-a6ec-89b39302725c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ca76a8457cb47189ebdd0c8c12974c5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:43.461772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65accf17-c6e7-4be7-a6ec-89b39302725c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:43.583187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-65accf17-c6e7-4be7-a6ec-89b39302725c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ca76a8457cb47189ebdd0c8c12974c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:43.586262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-65accf17-c6e7-4be7-a6ec-89b39302725c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ca76a8457cb47189ebdd0c8c12974c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:43.644023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-65accf17-c6e7-4be7-a6ec-89b39302725c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ca76a8457cb47189ebdd0c8c12974c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:43.685571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-65accf17-c6e7-4be7-a6ec-89b39302725c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ca76a8457cb47189ebdd0c8c12974c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:43.764349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-65accf17-c6e7-4be7-a6ec-89b39302725c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ca76a8457cb47189ebdd0c8c12974c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:43.808934 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1410/2812] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:24:43 2022] DELETE /identity/v3/users/8ca76a8457cb47189ebdd0c8c12974c5 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:45.401873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8542c-a59b-471f-a66b-52e319eae075 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:45.403444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cfc8542c-a59b-471f-a66b-52e319eae075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:45.418835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8542c-a59b-471f-a66b-52e319eae075 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:45.560644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1d739-9a39-4129-903f-287e1aac030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:45.565114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1d739-9a39-4129-903f-287e1aac030c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:45.565415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1d739-9a39-4129-903f-287e1aac030c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:45.565695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1d739-9a39-4129-903f-287e1aac030c admin admin] PATH_INFO: `/v3/projects/cb55196d22684803b3c601fcc3319c5e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:45.567133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1d739-9a39-4129-903f-287e1aac030c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb55196d22684803b3c601fcc3319c5e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:45.570018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1d739-9a39-4129-903f-287e1aac030c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:45.657354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7ba1d739-9a39-4129-903f-287e1aac030c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb55196d22684803b3c601fcc3319c5e', 'request_id': 'req-7ba1d739-9a39-4129-903f-287e1aac030c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:45.670006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7ba1d739-9a39-4129-903f-287e1aac030c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb55196d22684803b3c601fcc3319c5e', 'request_id': 'req-7ba1d739-9a39-4129-903f-287e1aac030c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:45.688337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7ba1d739-9a39-4129-903f-287e1aac030c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb55196d22684803b3c601fcc3319c5e', 'request_id': 'req-7ba1d739-9a39-4129-903f-287e1aac030c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:45.729966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7ba1d739-9a39-4129-903f-287e1aac030c admin admin] The token cache is being invalidate because project cb55196d22684803b3c601fcc3319c5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:24:45.730273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7ba1d739-9a39-4129-903f-287e1aac030c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:45.731300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7ba1d739-9a39-4129-903f-287e1aac030c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:45.736447 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1403/2813] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:24:45 2022] DELETE /identity/v3/projects/cb55196d22684803b3c601fcc3319c5e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:45.738298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf755152-b97e-4c55-a0d7-3be8a2e5f094 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:45.738866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf755152-b97e-4c55-a0d7-3be8a2e5f094 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:45.738866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf755152-b97e-4c55-a0d7-3be8a2e5f094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:45.791312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bf755152-b97e-4c55-a0d7-3be8a2e5f094 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:45.792894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf755152-b97e-4c55-a0d7-3be8a2e5f094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:45.871482 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1411/2814] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:45.880422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e13a3-24cb-4194-991e-3f16a5f381de None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:45.880793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e13a3-24cb-4194-991e-3f16a5f381de None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:45.881136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e13a3-24cb-4194-991e-3f16a5f381de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:45.904618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0b9e13a3-24cb-4194-991e-3f16a5f381de None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:45.905993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0b9e13a3-24cb-4194-991e-3f16a5f381de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:45.918077 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1404/2815] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:45.919142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf755152-b97e-4c55-a0d7-3be8a2e5f094 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:45.931807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf755152-b97e-4c55-a0d7-3be8a2e5f094 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:45.942772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0f37b-72e4-457b-a470-dc79a37c1bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:45.943786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0f37b-72e4-457b-a470-dc79a37c1bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:45.944241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0f37b-72e4-457b-a470-dc79a37c1bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:45.944674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0f37b-72e4-457b-a470-dc79a37c1bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:45.945490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0f37b-72e4-457b-a470-dc79a37c1bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:24:45.946018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0f37b-72e4-457b-a470-dc79a37c1bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:45.947932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0f37b-72e4-457b-a470-dc79a37c1bc4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:45.964487 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1412/2816] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:24:45.968749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e13a3-24cb-4194-991e-3f16a5f381de None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:45.981067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e13a3-24cb-4194-991e-3f16a5f381de None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:45.986337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316165e4-c3eb-4fdb-949a-ea2fa5ad452a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:45.986967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316165e4-c3eb-4fdb-949a-ea2fa5ad452a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:45.987275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316165e4-c3eb-4fdb-949a-ea2fa5ad452a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:45.987552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316165e4-c3eb-4fdb-949a-ea2fa5ad452a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:45.988228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316165e4-c3eb-4fdb-949a-ea2fa5ad452a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:45.990196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316165e4-c3eb-4fdb-949a-ea2fa5ad452a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:46.065658 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1405/2817] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:24:45 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:24:46.071490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0f37b-72e4-457b-a470-dc79a37c1bc4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:46.088193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0f37b-72e4-457b-a470-dc79a37c1bc4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:46.174171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:46.312343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86bb4e-c3d4-4863-b8f9-9190ee499330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:46.313677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86bb4e-c3d4-4863-b8f9-9190ee499330 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:46.314161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86bb4e-c3d4-4863-b8f9-9190ee499330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:46.314631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86bb4e-c3d4-4863-b8f9-9190ee499330 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:46.315811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86bb4e-c3d4-4863-b8f9-9190ee499330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:46.319302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86bb4e-c3d4-4863-b8f9-9190ee499330 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:46.395491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316165e4-c3eb-4fdb-949a-ea2fa5ad452a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:46.395765 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1413/2818] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:24:46 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:24:46.426689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316165e4-c3eb-4fdb-949a-ea2fa5ad452a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:46.448829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417d58d-7c76-4278-b7de-781cd2298357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:46.457601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417d58d-7c76-4278-b7de-781cd2298357 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:46.458076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417d58d-7c76-4278-b7de-781cd2298357 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:46.461099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417d58d-7c76-4278-b7de-781cd2298357 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:46.461882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417d58d-7c76-4278-b7de-781cd2298357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:46.471341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417d58d-7c76-4278-b7de-781cd2298357 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:46.523616 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1406/2819] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:24:46.527398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86bb4e-c3d4-4863-b8f9-9190ee499330 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:46.556603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86bb4e-c3d4-4863-b8f9-9190ee499330 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:46.569698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c005508-60bd-47c1-83ae-e401c804999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:46.570401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c005508-60bd-47c1-83ae-e401c804999d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:46.570688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c005508-60bd-47c1-83ae-e401c804999d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:46.570966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c005508-60bd-47c1-83ae-e401c804999d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:46.571709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c005508-60bd-47c1-83ae-e401c804999d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:46.590748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c005508-60bd-47c1-83ae-e401c804999d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:46.627532 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1414/2820] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:24:46.628644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417d58d-7c76-4278-b7de-781cd2298357 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:46.641615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417d58d-7c76-4278-b7de-781cd2298357 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:46.665945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44165d63-f4e6-48b6-aa91-3ce98e62b5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:46.667317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44165d63-f4e6-48b6-aa91-3ce98e62b5fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:46.667901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44165d63-f4e6-48b6-aa91-3ce98e62b5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:46.668650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44165d63-f4e6-48b6-aa91-3ce98e62b5fd admin admin] PATH_INFO: `/v3/projects/a5878cbcdfa94745b3069c4dd371f47f/users/1ea47409a7304d32bebd75e8273b14a7/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:46.708150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44165d63-f4e6-48b6-aa91-3ce98e62b5fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5878cbcdfa94745b3069c4dd371f47f, user_id=1ea47409a7304d32bebd75e8273b14a7, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:46.712367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44165d63-f4e6-48b6-aa91-3ce98e62b5fd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:46.741541 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1407/2821] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:24:46 2022] PUT /identity/v3/projects/a5878cbcdfa94745b3069c4dd371f47f/users/1ea47409a7304d32bebd75e8273b14a7/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:46.743591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de118e03-be8c-444d-80f0-085c7eee5b56 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:46.744072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de118e03-be8c-444d-80f0-085c7eee5b56 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:46.744160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de118e03-be8c-444d-80f0-085c7eee5b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:46.775470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-de118e03-be8c-444d-80f0-085c7eee5b56 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:46.777134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-de118e03-be8c-444d-80f0-085c7eee5b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:47.044515 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1415/2822] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:47.166706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44165d63-f4e6-48b6-aa91-3ce98e62b5fd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:47.168500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-44165d63-f4e6-48b6-aa91-3ce98e62b5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:47.194864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:47.276020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44165d63-f4e6-48b6-aa91-3ce98e62b5fd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:47.280100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d79158-fcb9-49e9-9dda-4279c7bfb326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:47.280735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d79158-fcb9-49e9-9dda-4279c7bfb326 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:47.281003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d79158-fcb9-49e9-9dda-4279c7bfb326 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:47.281277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d79158-fcb9-49e9-9dda-4279c7bfb326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:47.291306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d79158-fcb9-49e9-9dda-4279c7bfb326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:47.292767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d79158-fcb9-49e9-9dda-4279c7bfb326 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:47.338436 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1408/2823] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:47.831126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a83d9b-602a-4350-b989-d4f4475b8e2d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:47.832104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a83d9b-602a-4350-b989-d4f4475b8e2d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:47.832561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a83d9b-602a-4350-b989-d4f4475b8e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:47.863884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-72a83d9b-602a-4350-b989-d4f4475b8e2d None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:47.865711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-72a83d9b-602a-4350-b989-d4f4475b8e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:47.982545 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1416/2824] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:24:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:48.000776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d79158-fcb9-49e9-9dda-4279c7bfb326 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:48.003982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-33d79158-fcb9-49e9-9dda-4279c7bfb326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:48.123772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d79158-fcb9-49e9-9dda-4279c7bfb326 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:48.133730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af7bda-4dfd-417d-8a5d-8387eeea774c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:48.134454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af7bda-4dfd-417d-8a5d-8387eeea774c service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:48.134802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af7bda-4dfd-417d-8a5d-8387eeea774c service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:48.135409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af7bda-4dfd-417d-8a5d-8387eeea774c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:48.146647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af7bda-4dfd-417d-8a5d-8387eeea774c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:48.151614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af7bda-4dfd-417d-8a5d-8387eeea774c service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:48.170568 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1409/2825] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:24:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:24:51.404631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a83d9b-602a-4350-b989-d4f4475b8e2d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:51.406907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-72a83d9b-602a-4350-b989-d4f4475b8e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:51.526251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:51.588749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a83d9b-602a-4350-b989-d4f4475b8e2d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:51.594686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8966308-5b58-4753-9dce-a0c1a1adc54f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:51.595571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8966308-5b58-4753-9dce-a0c1a1adc54f service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:51.595946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8966308-5b58-4753-9dce-a0c1a1adc54f service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:51.596414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8966308-5b58-4753-9dce-a0c1a1adc54f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:51.614666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d8966308-5b58-4753-9dce-a0c1a1adc54f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:51.646871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8966308-5b58-4753-9dce-a0c1a1adc54f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:51.648725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8966308-5b58-4753-9dce-a0c1a1adc54f service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:51.688075 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1417/2826] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:54.887210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af7bda-4dfd-417d-8a5d-8387eeea774c service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:54.888741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-46af7bda-4dfd-417d-8a5d-8387eeea774c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:54.904390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af7bda-4dfd-417d-8a5d-8387eeea774c service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:54.910763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34b0c2-f53d-4026-ab15-b21ad4c82208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:54.911772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34b0c2-f53d-4026-ab15-b21ad4c82208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:54.912064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34b0c2-f53d-4026-ab15-b21ad4c82208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:54.912315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34b0c2-f53d-4026-ab15-b21ad4c82208 admin admin] PATH_INFO: `/v3/users/2af1c9ed95b84cff82c1abb4416aff3f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:54.913529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34b0c2-f53d-4026-ab15-b21ad4c82208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af1c9ed95b84cff82c1abb4416aff3f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:54.915537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34b0c2-f53d-4026-ab15-b21ad4c82208 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:54.980691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7c34b0c2-f53d-4026-ab15-b21ad4c82208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af1c9ed95b84cff82c1abb4416aff3f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:54.998474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7c34b0c2-f53d-4026-ab15-b21ad4c82208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af1c9ed95b84cff82c1abb4416aff3f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:54.999275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7c34b0c2-f53d-4026-ab15-b21ad4c82208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af1c9ed95b84cff82c1abb4416aff3f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:55.000076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7c34b0c2-f53d-4026-ab15-b21ad4c82208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af1c9ed95b84cff82c1abb4416aff3f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:55.010139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7c34b0c2-f53d-4026-ab15-b21ad4c82208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af1c9ed95b84cff82c1abb4416aff3f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:55.026474 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1410/2827] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:24:54 2022] DELETE /identity/v3/users/2af1c9ed95b84cff82c1abb4416aff3f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:55.315568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8966308-5b58-4753-9dce-a0c1a1adc54f service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:55.335667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8966308-5b58-4753-9dce-a0c1a1adc54f service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:55.426162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23212544-1619-4dfd-9c81-6012b0be0d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:55.427432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23212544-1619-4dfd-9c81-6012b0be0d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:55.429096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23212544-1619-4dfd-9c81-6012b0be0d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:55.429498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23212544-1619-4dfd-9c81-6012b0be0d4a admin admin] PATH_INFO: `/v3/projects/ff6fafa42b16479bbe5209dd0a953b2c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:55.430974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23212544-1619-4dfd-9c81-6012b0be0d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff6fafa42b16479bbe5209dd0a953b2c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:55.433302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23212544-1619-4dfd-9c81-6012b0be0d4a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:55.511348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-23212544-1619-4dfd-9c81-6012b0be0d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6fafa42b16479bbe5209dd0a953b2c', 'request_id': 'req-23212544-1619-4dfd-9c81-6012b0be0d4a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:55.528228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-23212544-1619-4dfd-9c81-6012b0be0d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6fafa42b16479bbe5209dd0a953b2c', 'request_id': 'req-23212544-1619-4dfd-9c81-6012b0be0d4a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:55.539621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-23212544-1619-4dfd-9c81-6012b0be0d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6fafa42b16479bbe5209dd0a953b2c', 'request_id': 'req-23212544-1619-4dfd-9c81-6012b0be0d4a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:55.555524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-23212544-1619-4dfd-9c81-6012b0be0d4a admin admin] The token cache is being invalidate because project ff6fafa42b16479bbe5209dd0a953b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:24:55.555905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-23212544-1619-4dfd-9c81-6012b0be0d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:55.556510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-23212544-1619-4dfd-9c81-6012b0be0d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:55.561337 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1418/2828] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:24:55 2022] DELETE /identity/v3/projects/ff6fafa42b16479bbe5209dd0a953b2c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:55.562432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34b0c2-f53d-4026-ab15-b21ad4c82208 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:55.563979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7c34b0c2-f53d-4026-ab15-b21ad4c82208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:55.592436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34b0c2-f53d-4026-ab15-b21ad4c82208 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:55.640589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:55.767217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843e951-437d-4494-b24d-ae7097e35a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:55.767829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843e951-437d-4494-b24d-ae7097e35a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:55.768117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843e951-437d-4494-b24d-ae7097e35a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:55.768397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843e951-437d-4494-b24d-ae7097e35a4c admin admin] PATH_INFO: `/v3/users/f45275608e59449697de9800f3c80a04` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:55.770019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843e951-437d-4494-b24d-ae7097e35a4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f45275608e59449697de9800f3c80a04)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:55.772031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843e951-437d-4494-b24d-ae7097e35a4c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:55.839896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e843e951-437d-4494-b24d-ae7097e35a4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f45275608e59449697de9800f3c80a04'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:55.855024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e843e951-437d-4494-b24d-ae7097e35a4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f45275608e59449697de9800f3c80a04'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:55.856109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e843e951-437d-4494-b24d-ae7097e35a4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f45275608e59449697de9800f3c80a04'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:55.856629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e843e951-437d-4494-b24d-ae7097e35a4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f45275608e59449697de9800f3c80a04'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:55.872441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e843e951-437d-4494-b24d-ae7097e35a4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f45275608e59449697de9800f3c80a04'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:55.894218 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1411/2829] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:24:55 2022] DELETE /identity/v3/users/f45275608e59449697de9800f3c80a04 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:56.364921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23212544-1619-4dfd-9c81-6012b0be0d4a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:56.368481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-23212544-1619-4dfd-9c81-6012b0be0d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:56.404929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23212544-1619-4dfd-9c81-6012b0be0d4a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:56.549701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c28f91-e384-4e59-8ebe-542fc6759400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:56.550812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c28f91-e384-4e59-8ebe-542fc6759400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:56.551154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c28f91-e384-4e59-8ebe-542fc6759400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:56.551724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c28f91-e384-4e59-8ebe-542fc6759400 admin admin] PATH_INFO: `/v3/projects/2183413d421d49a7a03cb534c8f8c048` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:56.556033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c28f91-e384-4e59-8ebe-542fc6759400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2183413d421d49a7a03cb534c8f8c048)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:56.558161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c28f91-e384-4e59-8ebe-542fc6759400 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:56.561271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:56.671316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2c28f91-e384-4e59-8ebe-542fc6759400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2183413d421d49a7a03cb534c8f8c048', 'request_id': 'req-f2c28f91-e384-4e59-8ebe-542fc6759400'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:56.693820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2c28f91-e384-4e59-8ebe-542fc6759400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2183413d421d49a7a03cb534c8f8c048', 'request_id': 'req-f2c28f91-e384-4e59-8ebe-542fc6759400'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:56.704671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2c28f91-e384-4e59-8ebe-542fc6759400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2183413d421d49a7a03cb534c8f8c048', 'request_id': 'req-f2c28f91-e384-4e59-8ebe-542fc6759400'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:56.723612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2c28f91-e384-4e59-8ebe-542fc6759400 admin admin] The token cache is being invalidate because project 2183413d421d49a7a03cb534c8f8c048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:24:56.724168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2c28f91-e384-4e59-8ebe-542fc6759400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:56.724968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2c28f91-e384-4e59-8ebe-542fc6759400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:56.728084 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1419/2830] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:24:56 2022] DELETE /identity/v3/projects/2183413d421d49a7a03cb534c8f8c048 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:24:56.733397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d47a5-0693-468f-bcf6-831310e532c6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:56.733906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d47a5-0693-468f-bcf6-831310e532c6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:56.734397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d47a5-0693-468f-bcf6-831310e532c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:56.778351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9a3d47a5-0693-468f-bcf6-831310e532c6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:56.781919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9a3d47a5-0693-468f-bcf6-831310e532c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:56.947332 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1412/2831] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:56.950569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7083d1b-f95c-4736-9c1b-a5bef2c968c8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:56.951939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7083d1b-f95c-4736-9c1b-a5bef2c968c8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:56.952613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7083d1b-f95c-4736-9c1b-a5bef2c968c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:56.978420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c7083d1b-f95c-4736-9c1b-a5bef2c968c8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:56.980186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c7083d1b-f95c-4736-9c1b-a5bef2c968c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:56.994542 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1420/2832] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:56.998982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d47a5-0693-468f-bcf6-831310e532c6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:57.015929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d47a5-0693-468f-bcf6-831310e532c6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:57.024699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed79ada-339e-49a8-8f03-bf5630aed643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:57.025737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed79ada-339e-49a8-8f03-bf5630aed643 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:57.027226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed79ada-339e-49a8-8f03-bf5630aed643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:57.027758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed79ada-339e-49a8-8f03-bf5630aed643 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:57.029002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed79ada-339e-49a8-8f03-bf5630aed643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:24:57.031070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed79ada-339e-49a8-8f03-bf5630aed643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:57.035704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed79ada-339e-49a8-8f03-bf5630aed643 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:57.074979 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1413/2833] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:24:57.080185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7083d1b-f95c-4736-9c1b-a5bef2c968c8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:57.097955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7083d1b-f95c-4736-9c1b-a5bef2c968c8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:57.106235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7abbf-cca0-4dac-9638-2aa5fecef56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:57.107189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7abbf-cca0-4dac-9638-2aa5fecef56b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:57.107652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7abbf-cca0-4dac-9638-2aa5fecef56b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:57.108085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7abbf-cca0-4dac-9638-2aa5fecef56b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:57.108912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7abbf-cca0-4dac-9638-2aa5fecef56b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:57.111064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7abbf-cca0-4dac-9638-2aa5fecef56b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:57.173658 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1421/2834] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:24:57 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:24:57.175678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed79ada-339e-49a8-8f03-bf5630aed643 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:57.193109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed79ada-339e-49a8-8f03-bf5630aed643 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:57.262907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:57.394368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5434b7-a5be-4503-8f4a-d78293496fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:57.395281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5434b7-a5be-4503-8f4a-d78293496fdd admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:57.395568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5434b7-a5be-4503-8f4a-d78293496fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:57.395842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5434b7-a5be-4503-8f4a-d78293496fdd admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:57.396527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5434b7-a5be-4503-8f4a-d78293496fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:57.398947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5434b7-a5be-4503-8f4a-d78293496fdd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:57.435212 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1414/2835] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:24:57 2022] POST /identity/v3/users => generated 288 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:24:57.439095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7abbf-cca0-4dac-9638-2aa5fecef56b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:57.453632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7abbf-cca0-4dac-9638-2aa5fecef56b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:57.459038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50837d6-c8b2-4876-843a-a975e3780cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:57.459877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50837d6-c8b2-4876-843a-a975e3780cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:57.460163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50837d6-c8b2-4876-843a-a975e3780cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:57.460445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50837d6-c8b2-4876-843a-a975e3780cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:57.461106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50837d6-c8b2-4876-843a-a975e3780cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:57.464534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50837d6-c8b2-4876-843a-a975e3780cb6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:57.499880 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1422/2836] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:24:57.501667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5434b7-a5be-4503-8f4a-d78293496fdd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:57.517909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5434b7-a5be-4503-8f4a-d78293496fdd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:57.531107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d2507-5232-43d5-8b18-c4084cffa9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:57.531916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d2507-5232-43d5-8b18-c4084cffa9dc admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:57.532284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d2507-5232-43d5-8b18-c4084cffa9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:57.532658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d2507-5232-43d5-8b18-c4084cffa9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:57.533569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d2507-5232-43d5-8b18-c4084cffa9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:57.535403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d2507-5232-43d5-8b18-c4084cffa9dc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:57.563430 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1415/2837] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:24:57.565399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50837d6-c8b2-4876-843a-a975e3780cb6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:57.581620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50837d6-c8b2-4876-843a-a975e3780cb6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:57.586989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccf1e0-6b83-44e9-ac09-a3ce9306a08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:57.587964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf1e0-6b83-44e9-ac09-a3ce9306a08a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:57.588322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf1e0-6b83-44e9-ac09-a3ce9306a08a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:57.588672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf1e0-6b83-44e9-ac09-a3ce9306a08a admin admin] PATH_INFO: `/v3/projects/907a3256e3bc433f9ff9948082c90973/users/d8488b6dcc6642e48d40f624a56a52bc/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:57.618948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccf1e0-6b83-44e9-ac09-a3ce9306a08a admin admin] RBAC: Authorizing `identity:create_grant(project_id=907a3256e3bc433f9ff9948082c90973, user_id=d8488b6dcc6642e48d40f624a56a52bc, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:57.622154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccf1e0-6b83-44e9-ac09-a3ce9306a08a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:57.656273 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1423/2838] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:24:57 2022] PUT /identity/v3/projects/907a3256e3bc433f9ff9948082c90973/users/d8488b6dcc6642e48d40f624a56a52bc/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:57.660285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4853f-bfa3-4417-af4e-1a3ec893dc19 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:57.660758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4853f-bfa3-4417-af4e-1a3ec893dc19 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:57.661330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4853f-bfa3-4417-af4e-1a3ec893dc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:57.757667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6cb4853f-bfa3-4417-af4e-1a3ec893dc19 None None] MFA Rules not processed for user `d8488b6dcc6642e48d40f624a56a52bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:57.758954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6cb4853f-bfa3-4417-af4e-1a3ec893dc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:57.979901 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1416/2839] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:57.981552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccf1e0-6b83-44e9-ac09-a3ce9306a08a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:58.082078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d66c7-4e59-444a-a294-fda93dd5a49d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:58.082757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d66c7-4e59-444a-a294-fda93dd5a49d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:58.083246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d66c7-4e59-444a-a294-fda93dd5a49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:58.136228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccf1e0-6b83-44e9-ac09-a3ce9306a08a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:58.146129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d18dff-b03b-40f6-bf3a-65d869c67d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:58.147618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d18dff-b03b-40f6-bf3a-65d869c67d8c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:58.147904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d18dff-b03b-40f6-bf3a-65d869c67d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:58.148200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d18dff-b03b-40f6-bf3a-65d869c67d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:58.150051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d18dff-b03b-40f6-bf3a-65d869c67d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:58.153705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d18dff-b03b-40f6-bf3a-65d869c67d8c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:58.157799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f71d66c7-4e59-444a-a294-fda93dd5a49d None None] MFA Rules not processed for user `1ea47409a7304d32bebd75e8273b14a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:58.159487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f71d66c7-4e59-444a-a294-fda93dd5a49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:58.196327 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1424/2840] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:24:57 2022] POST /identity/v3/projects => generated 377 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:24:58.200736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d18dff-b03b-40f6-bf3a-65d869c67d8c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:58.231036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:58.286669 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1417/2841] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:58.291389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d66c7-4e59-444a-a294-fda93dd5a49d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:58.294642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f71d66c7-4e59-444a-a294-fda93dd5a49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:58.314764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d66c7-4e59-444a-a294-fda93dd5a49d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:58.334616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:58.357842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d18dff-b03b-40f6-bf3a-65d869c67d8c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:58.381429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4b82d-ac96-4e5e-aef3-f6680cec3469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:58.382052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4b82d-ac96-4e5e-aef3-f6680cec3469 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:58.382329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4b82d-ac96-4e5e-aef3-f6680cec3469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:58.382613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4b82d-ac96-4e5e-aef3-f6680cec3469 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:58.383349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4b82d-ac96-4e5e-aef3-f6680cec3469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:58.392051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4b82d-ac96-4e5e-aef3-f6680cec3469 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:58.406682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27082e-3a15-4eff-8f09-a8a54ed960db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:58.407997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27082e-3a15-4eff-8f09-a8a54ed960db admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:58.408499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27082e-3a15-4eff-8f09-a8a54ed960db admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:58.409002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27082e-3a15-4eff-8f09-a8a54ed960db admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:58.409904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27082e-3a15-4eff-8f09-a8a54ed960db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:58.413423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27082e-3a15-4eff-8f09-a8a54ed960db admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:58.444433 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1425/2842] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:24:58 2022] POST /identity/v3/users => generated 295 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:24:58.455894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4b82d-ac96-4e5e-aef3-f6680cec3469 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:58.491862 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1418/2843] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:24:58 2022] POST /identity/v3/projects => generated 383 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:24:58.493117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4b82d-ac96-4e5e-aef3-f6680cec3469 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:58.496416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27082e-3a15-4eff-8f09-a8a54ed960db admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:58.650873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27082e-3a15-4eff-8f09-a8a54ed960db admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:58.657518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86542034-fecd-47be-a4d5-aad0b34d6f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:58.658756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86542034-fecd-47be-a4d5-aad0b34d6f81 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:58.659197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86542034-fecd-47be-a4d5-aad0b34d6f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:58.659721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86542034-fecd-47be-a4d5-aad0b34d6f81 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:58.660579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86542034-fecd-47be-a4d5-aad0b34d6f81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:58.664376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86542034-fecd-47be-a4d5-aad0b34d6f81 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:58.672424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c9eb2-af98-4a51-9d96-1b7b48de9d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:58.673450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c9eb2-af98-4a51-9d96-1b7b48de9d66 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:58.673734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c9eb2-af98-4a51-9d96-1b7b48de9d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:58.674006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c9eb2-af98-4a51-9d96-1b7b48de9d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:58.674680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c9eb2-af98-4a51-9d96-1b7b48de9d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:58.676865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c9eb2-af98-4a51-9d96-1b7b48de9d66 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:58.700891 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1426/2844] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:24:58.702475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c9eb2-af98-4a51-9d96-1b7b48de9d66 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:58.706475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-336c9eb2-af98-4a51-9d96-1b7b48de9d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:58.718281 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1419/2845] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:24:58 2022] POST /identity/v3/users => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:24:58.722993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86542034-fecd-47be-a4d5-aad0b34d6f81 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:58.734056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c9eb2-af98-4a51-9d96-1b7b48de9d66 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:58.740143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749778-4366-400e-a8ef-a370de87a69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:58.740479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749778-4366-400e-a8ef-a370de87a69f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:58.740814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749778-4366-400e-a8ef-a370de87a69f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:58.741416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749778-4366-400e-a8ef-a370de87a69f admin admin] PATH_INFO: `/v3/users/5a2845ef87b14966a220d8c4e43f1c5c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:58.745580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac749778-4366-400e-a8ef-a370de87a69f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a2845ef87b14966a220d8c4e43f1c5c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:58.748730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac749778-4366-400e-a8ef-a370de87a69f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:58.753759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86542034-fecd-47be-a4d5-aad0b34d6f81 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:58.769722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99910a1-940f-4122-8543-5cb2fab2fd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:58.770548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99910a1-940f-4122-8543-5cb2fab2fd7d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:58.772139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99910a1-940f-4122-8543-5cb2fab2fd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:58.772666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99910a1-940f-4122-8543-5cb2fab2fd7d admin admin] PATH_INFO: `/v3/projects/36f56fb3ceb44967bd5b05ca45ad7ec8/users/becd310e2c3f42bc88ae06ad732df672/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:58.819452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99910a1-940f-4122-8543-5cb2fab2fd7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f56fb3ceb44967bd5b05ca45ad7ec8, user_id=becd310e2c3f42bc88ae06ad732df672, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:58.823793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99910a1-940f-4122-8543-5cb2fab2fd7d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:58.842418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac749778-4366-400e-a8ef-a370de87a69f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a2845ef87b14966a220d8c4e43f1c5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:58.843622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac749778-4366-400e-a8ef-a370de87a69f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a2845ef87b14966a220d8c4e43f1c5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:58.855289 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1420/2846] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:24:58 2022] PUT /identity/v3/projects/36f56fb3ceb44967bd5b05ca45ad7ec8/users/becd310e2c3f42bc88ae06ad732df672/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:58.855289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99910a1-940f-4122-8543-5cb2fab2fd7d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:58.856526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d99910a1-940f-4122-8543-5cb2fab2fd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:58.860434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac749778-4366-400e-a8ef-a370de87a69f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a2845ef87b14966a220d8c4e43f1c5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:58.880237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac749778-4366-400e-a8ef-a370de87a69f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a2845ef87b14966a220d8c4e43f1c5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:58.922657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac749778-4366-400e-a8ef-a370de87a69f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a2845ef87b14966a220d8c4e43f1c5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:24:58.937592 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1427/2847] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:24:58 2022] DELETE /identity/v3/users/5a2845ef87b14966a220d8c4e43f1c5c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:58.938752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749778-4366-400e-a8ef-a370de87a69f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:58.941815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac749778-4366-400e-a8ef-a370de87a69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:58.966516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:59.046909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749778-4366-400e-a8ef-a370de87a69f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:59.051205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99910a1-940f-4122-8543-5cb2fab2fd7d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:59.051933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac9d2f-be9d-441d-88f5-04cb6e6b372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:59.052717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac9d2f-be9d-441d-88f5-04cb6e6b372a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:59.052717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac9d2f-be9d-441d-88f5-04cb6e6b372a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:59.053018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac9d2f-be9d-441d-88f5-04cb6e6b372a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:59.053926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac9d2f-be9d-441d-88f5-04cb6e6b372a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:59.056053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac9d2f-be9d-441d-88f5-04cb6e6b372a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:59.074039 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1428/2848] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:24:59.075745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d33034-ecb2-440b-9fa1-18ccd7394ee4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:59.076131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d33034-ecb2-440b-9fa1-18ccd7394ee4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:59.076526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d33034-ecb2-440b-9fa1-18ccd7394ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:59.089895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0712ab7-1af1-4247-9fd9-2b2652f22ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:59.090913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0712ab7-1af1-4247-9fd9-2b2652f22ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:59.091723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0712ab7-1af1-4247-9fd9-2b2652f22ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:59.092829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0712ab7-1af1-4247-9fd9-2b2652f22ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:59.093753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0712ab7-1af1-4247-9fd9-2b2652f22ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:59.096610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0712ab7-1af1-4247-9fd9-2b2652f22ab5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:59.100790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-54d33034-ecb2-440b-9fa1-18ccd7394ee4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:59.103810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54d33034-ecb2-440b-9fa1-18ccd7394ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:59.133692 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1429/2849] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:59.136454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d33034-ecb2-440b-9fa1-18ccd7394ee4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:59.161036 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1421/2850] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:24:59.162055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0712ab7-1af1-4247-9fd9-2b2652f22ab5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:59.162720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d33034-ecb2-440b-9fa1-18ccd7394ee4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:59.165495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b0712ab7-1af1-4247-9fd9-2b2652f22ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:59.175926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40ef6f-b320-4d9c-8bc4-a35c79b18e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:59.176995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40ef6f-b320-4d9c-8bc4-a35c79b18e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:59.177276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40ef6f-b320-4d9c-8bc4-a35c79b18e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:59.177637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40ef6f-b320-4d9c-8bc4-a35c79b18e53 admin admin] PATH_INFO: `/v3/projects/36f56fb3ceb44967bd5b05ca45ad7ec8/users/becd310e2c3f42bc88ae06ad732df672/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:59.183344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:59.186744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40ef6f-b320-4d9c-8bc4-a35c79b18e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f56fb3ceb44967bd5b05ca45ad7ec8, user_id=becd310e2c3f42bc88ae06ad732df672, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:59.189921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40ef6f-b320-4d9c-8bc4-a35c79b18e53 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:59.221454 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1430/2851] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:24:59 2022] PUT /identity/v3/projects/36f56fb3ceb44967bd5b05ca45ad7ec8/users/becd310e2c3f42bc88ae06ad732df672/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:59.223023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40ef6f-b320-4d9c-8bc4-a35c79b18e53 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:59.337401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40ef6f-b320-4d9c-8bc4-a35c79b18e53 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:59.344394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642711f-8720-4172-be9e-482b76590c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:59.345095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642711f-8720-4172-be9e-482b76590c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:59.346084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642711f-8720-4172-be9e-482b76590c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:59.346366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642711f-8720-4172-be9e-482b76590c66 admin admin] PATH_INFO: `/v3/projects/4ca5b2c108f64401b03ab23d1cd4d375/users/27349f6769014bc689ec22a1e2383ca2/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:59.364292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0712ab7-1af1-4247-9fd9-2b2652f22ab5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:59.367430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642711f-8720-4172-be9e-482b76590c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca5b2c108f64401b03ab23d1cd4d375, user_id=27349f6769014bc689ec22a1e2383ca2, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:59.371765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642711f-8720-4172-be9e-482b76590c66 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:59.394246 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1431/2852] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:24:59 2022] PUT /identity/v3/projects/4ca5b2c108f64401b03ab23d1cd4d375/users/27349f6769014bc689ec22a1e2383ca2/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:59.395967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf14b4-1bb6-43ad-8ecd-ba685a0f2f33 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:59.396254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf14b4-1bb6-43ad-8ecd-ba685a0f2f33 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:59.396531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf14b4-1bb6-43ad-8ecd-ba685a0f2f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:59.441012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1ccf14b4-1bb6-43ad-8ecd-ba685a0f2f33 None None] MFA Rules not processed for user `becd310e2c3f42bc88ae06ad732df672`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:24:59.442919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1ccf14b4-1bb6-43ad-8ecd-ba685a0f2f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:59.466589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834f04e-686e-4284-954d-a717ef73882c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:59.467859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834f04e-686e-4284-954d-a717ef73882c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:59.471175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834f04e-686e-4284-954d-a717ef73882c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:59.472973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834f04e-686e-4284-954d-a717ef73882c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:59.512912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834f04e-686e-4284-954d-a717ef73882c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:59.517038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834f04e-686e-4284-954d-a717ef73882c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:59.548271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:24:59.554811 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1422/2853] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:24:59.556668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834f04e-686e-4284-954d-a717ef73882c service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:59.576871 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1432/2854] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:24:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:24:59.596199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834f04e-686e-4284-954d-a717ef73882c service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:59.599993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf14b4-1bb6-43ad-8ecd-ba685a0f2f33 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:59.601462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1ccf14b4-1bb6-43ad-8ecd-ba685a0f2f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:24:59.741869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815130c-18d9-49ef-8392-57ab7d195861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:59.743715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815130c-18d9-49ef-8392-57ab7d195861 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:59.744893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815130c-18d9-49ef-8392-57ab7d195861 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:59.745784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815130c-18d9-49ef-8392-57ab7d195861 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:59.746687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815130c-18d9-49ef-8392-57ab7d195861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:59.754635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815130c-18d9-49ef-8392-57ab7d195861 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:59.780183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf14b4-1bb6-43ad-8ecd-ba685a0f2f33 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:59.785188 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1423/2855] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:24:59.790297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815130c-18d9-49ef-8392-57ab7d195861 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:24:59.800319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3239f-20d3-44ab-865d-f5a2a7631ee4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:59.800615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815130c-18d9-49ef-8392-57ab7d195861 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:24:59.801919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3239f-20d3-44ab-865d-f5a2a7631ee4 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:59.802383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3239f-20d3-44ab-865d-f5a2a7631ee4 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:59.802852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3239f-20d3-44ab-865d-f5a2a7631ee4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:59.805615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5f602-e120-43e6-bdd4-ee70a25bc682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:24:59.806297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5f602-e120-43e6-bdd4-ee70a25bc682 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:24:59.806576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5f602-e120-43e6-bdd4-ee70a25bc682 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:24:59.806850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5f602-e120-43e6-bdd4-ee70a25bc682 admin admin] PATH_INFO: `/v3/projects/4ca5b2c108f64401b03ab23d1cd4d375/users/27349f6769014bc689ec22a1e2383ca2/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:24:59.808868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5f602-e120-43e6-bdd4-ee70a25bc682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca5b2c108f64401b03ab23d1cd4d375, user_id=27349f6769014bc689ec22a1e2383ca2, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:59.811562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5f602-e120-43e6-bdd4-ee70a25bc682 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:59.827968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3239f-20d3-44ab-865d-f5a2a7631ee4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:24:59.830919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3239f-20d3-44ab-865d-f5a2a7631ee4 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:24:59.836582 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1424/2856] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:24:59 2022] PUT /identity/v3/projects/4ca5b2c108f64401b03ab23d1cd4d375/users/27349f6769014bc689ec22a1e2383ca2/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:24:59.851857 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1433/2857] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:24:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:25:00.216730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5f602-e120-43e6-bdd4-ee70a25bc682 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:00.219383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d7d5f602-e120-43e6-bdd4-ee70a25bc682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:00.340472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:00.378868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5f602-e120-43e6-bdd4-ee70a25bc682 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:00.403820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842a9b2-9d27-4a3b-948a-f467aa77cb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:00.405641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842a9b2-9d27-4a3b-948a-f467aa77cb7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:00.406103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842a9b2-9d27-4a3b-948a-f467aa77cb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:00.406394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842a9b2-9d27-4a3b-948a-f467aa77cb7c admin admin] PATH_INFO: `/v3/projects/2c617f7d692c4a0eaea617302c655858` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:00.409278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842a9b2-9d27-4a3b-948a-f467aa77cb7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c617f7d692c4a0eaea617302c655858)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:00.411889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842a9b2-9d27-4a3b-948a-f467aa77cb7c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:00.495500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2842a9b2-9d27-4a3b-948a-f467aa77cb7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c617f7d692c4a0eaea617302c655858', 'request_id': 'req-2842a9b2-9d27-4a3b-948a-f467aa77cb7c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:00.505026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2842a9b2-9d27-4a3b-948a-f467aa77cb7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c617f7d692c4a0eaea617302c655858', 'request_id': 'req-2842a9b2-9d27-4a3b-948a-f467aa77cb7c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:00.512617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2842a9b2-9d27-4a3b-948a-f467aa77cb7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c617f7d692c4a0eaea617302c655858', 'request_id': 'req-2842a9b2-9d27-4a3b-948a-f467aa77cb7c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:00.536401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2842a9b2-9d27-4a3b-948a-f467aa77cb7c admin admin] The token cache is being invalidate because project 2c617f7d692c4a0eaea617302c655858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:25:00.537519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2842a9b2-9d27-4a3b-948a-f467aa77cb7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:00.539440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2842a9b2-9d27-4a3b-948a-f467aa77cb7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:00.544777 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1425/2858] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:25:00 2022] DELETE /identity/v3/projects/2c617f7d692c4a0eaea617302c655858 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:00.550101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dac398-23d7-42a7-8640-bce5365da4f5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:00.550646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dac398-23d7-42a7-8640-bce5365da4f5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:00.550833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dac398-23d7-42a7-8640-bce5365da4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:00.599044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-16dac398-23d7-42a7-8640-bce5365da4f5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:00.602619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-16dac398-23d7-42a7-8640-bce5365da4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:00.778267 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1434/2859] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:00.787385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602d381-1b53-4b91-98ee-0a21f72062b8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:00.787762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602d381-1b53-4b91-98ee-0a21f72062b8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:00.788007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602d381-1b53-4b91-98ee-0a21f72062b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:00.833926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7602d381-1b53-4b91-98ee-0a21f72062b8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:00.835283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7602d381-1b53-4b91-98ee-0a21f72062b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:00.852321 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1426/2860] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:00.854201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dac398-23d7-42a7-8640-bce5365da4f5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:00.866161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dac398-23d7-42a7-8640-bce5365da4f5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:00.888355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ba4c8-429e-466a-b3c1-151194ed68ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:00.889046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ba4c8-429e-466a-b3c1-151194ed68ba admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:00.889418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ba4c8-429e-466a-b3c1-151194ed68ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:00.889805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ba4c8-429e-466a-b3c1-151194ed68ba admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:00.890571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ba4c8-429e-466a-b3c1-151194ed68ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:25:00.890969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ba4c8-429e-466a-b3c1-151194ed68ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:00.892881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ba4c8-429e-466a-b3c1-151194ed68ba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:00.916353 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1435/2861] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:25:00.916836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602d381-1b53-4b91-98ee-0a21f72062b8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:00.957766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602d381-1b53-4b91-98ee-0a21f72062b8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:00.996898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739c3ec-8f28-4bc6-9fe3-9f3c151ec068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:00.997224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739c3ec-8f28-4bc6-9fe3-9f3c151ec068 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:00.997427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739c3ec-8f28-4bc6-9fe3-9f3c151ec068 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:00.997709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739c3ec-8f28-4bc6-9fe3-9f3c151ec068 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:01.002205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739c3ec-8f28-4bc6-9fe3-9f3c151ec068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:01.010848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739c3ec-8f28-4bc6-9fe3-9f3c151ec068 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:01.150501 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1427/2862] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:25:00 2022] POST /identity/v3/projects => generated 387 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:01.154583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ba4c8-429e-466a-b3c1-151194ed68ba admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:01.168474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ba4c8-429e-466a-b3c1-151194ed68ba admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:01.302260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a1e9d-e1e1-453e-99e8-9b385785b6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:01.303031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a1e9d-e1e1-453e-99e8-9b385785b6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:01.303303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a1e9d-e1e1-453e-99e8-9b385785b6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:01.303585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a1e9d-e1e1-453e-99e8-9b385785b6b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:01.304441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a1e9d-e1e1-453e-99e8-9b385785b6b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:01.307851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a1e9d-e1e1-453e-99e8-9b385785b6b8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:01.348492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:01.364752 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1436/2863] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:25:01 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:01.365186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739c3ec-8f28-4bc6-9fe3-9f3c151ec068 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:01.380328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739c3ec-8f28-4bc6-9fe3-9f3c151ec068 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:01.407570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1fd72-3c48-4196-92fc-0bd06243a197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:01.420826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1fd72-3c48-4196-92fc-0bd06243a197 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:01.421175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1fd72-3c48-4196-92fc-0bd06243a197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:01.421456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1fd72-3c48-4196-92fc-0bd06243a197 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:01.430366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b1fd72-3c48-4196-92fc-0bd06243a197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:01.439444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b1fd72-3c48-4196-92fc-0bd06243a197 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:01.484182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a1e9d-e1e1-453e-99e8-9b385785b6b8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:01.485454 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1428/2864] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:25:01.502545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a1e9d-e1e1-453e-99e8-9b385785b6b8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:01.521399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f463a36-cb09-4917-b50f-6c97c06c4209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:01.522508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f463a36-cb09-4917-b50f-6c97c06c4209 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:01.529656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f463a36-cb09-4917-b50f-6c97c06c4209 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:01.529656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f463a36-cb09-4917-b50f-6c97c06c4209 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:01.534948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f463a36-cb09-4917-b50f-6c97c06c4209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:01.538946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f463a36-cb09-4917-b50f-6c97c06c4209 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:01.567149 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1437/2865] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:01.577072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1fd72-3c48-4196-92fc-0bd06243a197 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:01.592882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1fd72-3c48-4196-92fc-0bd06243a197 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:01.601358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec4955-f54e-4b58-ae67-13a49c845c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:01.602153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec4955-f54e-4b58-ae67-13a49c845c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:01.602520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec4955-f54e-4b58-ae67-13a49c845c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:01.603484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec4955-f54e-4b58-ae67-13a49c845c71 admin admin] PATH_INFO: `/v3/projects/ee45ea494d4a4c95aaac2a35f15ac32d/users/d60e254814924b44843a420ca3ba21c7/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:01.624645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec4955-f54e-4b58-ae67-13a49c845c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee45ea494d4a4c95aaac2a35f15ac32d, user_id=d60e254814924b44843a420ca3ba21c7, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:01.627648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec4955-f54e-4b58-ae67-13a49c845c71 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:01.648289 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1429/2866] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:01 2022] PUT /identity/v3/projects/ee45ea494d4a4c95aaac2a35f15ac32d/users/d60e254814924b44843a420ca3ba21c7/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:01.653408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac32e97-858b-4537-9944-2e14d5d196dd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:01.653671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac32e97-858b-4537-9944-2e14d5d196dd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:01.653966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac32e97-858b-4537-9944-2e14d5d196dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:01.679426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dac32e97-858b-4537-9944-2e14d5d196dd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:01.680733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dac32e97-858b-4537-9944-2e14d5d196dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:01.803213 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1438/2867] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:01.823009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec4955-f54e-4b58-ae67-13a49c845c71 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:01.825107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-37ec4955-f54e-4b58-ae67-13a49c845c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:01.986174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec4955-f54e-4b58-ae67-13a49c845c71 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:01.997277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3776e0-bb1e-468d-8f0c-2c759c4f5681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:01.998098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3776e0-bb1e-468d-8f0c-2c759c4f5681 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:01.998385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3776e0-bb1e-468d-8f0c-2c759c4f5681 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:01.998715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3776e0-bb1e-468d-8f0c-2c759c4f5681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:02.032932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3776e0-bb1e-468d-8f0c-2c759c4f5681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:02.042087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3776e0-bb1e-468d-8f0c-2c759c4f5681 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:02.078497 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1430/2868] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:02.218481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac32e97-858b-4537-9944-2e14d5d196dd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:02.220352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dac32e97-858b-4537-9944-2e14d5d196dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:02.326332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac32e97-858b-4537-9944-2e14d5d196dd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:02.337738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36bc3e-127e-439a-b96f-407244957c07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:02.338570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36bc3e-127e-439a-b96f-407244957c07 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:02.338889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36bc3e-127e-439a-b96f-407244957c07 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:02.339908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36bc3e-127e-439a-b96f-407244957c07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:02.343579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a36bc3e-127e-439a-b96f-407244957c07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:02.451639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36bc3e-127e-439a-b96f-407244957c07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:02.453806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36bc3e-127e-439a-b96f-407244957c07 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:02.478450 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1439/2869] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:05.776301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c94d56-fcbe-42a5-849d-d8d4005cd7ad None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:05.776861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c94d56-fcbe-42a5-849d-d8d4005cd7ad None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:05.776986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c94d56-fcbe-42a5-849d-d8d4005cd7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:05.814545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-59c94d56-fcbe-42a5-849d-d8d4005cd7ad None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:05.817114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-59c94d56-fcbe-42a5-849d-d8d4005cd7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:05.851936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:05.970026 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1431/2870] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:25:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:06.008486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36bc3e-127e-439a-b96f-407244957c07 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:06.010871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a36bc3e-127e-439a-b96f-407244957c07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:06.072357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:06.172471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36bc3e-127e-439a-b96f-407244957c07 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:06.185614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbb43c-7af7-44a3-a224-e35365dd9e65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:06.186418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbb43c-7af7-44a3-a224-e35365dd9e65 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:06.186875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbb43c-7af7-44a3-a224-e35365dd9e65 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:06.187158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbb43c-7af7-44a3-a224-e35365dd9e65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:06.211014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbb43c-7af7-44a3-a224-e35365dd9e65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:06.212585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbb43c-7af7-44a3-a224-e35365dd9e65 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:06.247243 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1440/2871] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:25:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:25:06.565638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c94d56-fcbe-42a5-849d-d8d4005cd7ad None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:06.567195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-59c94d56-fcbe-42a5-849d-d8d4005cd7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:06.634585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c94d56-fcbe-42a5-849d-d8d4005cd7ad None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:06.662424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdd658-6f9f-48d7-a0fc-20fa58e57843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:06.665071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdd658-6f9f-48d7-a0fc-20fa58e57843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:06.666050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdd658-6f9f-48d7-a0fc-20fa58e57843 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:06.669085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdd658-6f9f-48d7-a0fc-20fa58e57843 admin admin] PATH_INFO: `/v3/users/d8488b6dcc6642e48d40f624a56a52bc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:06.674653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cdd658-6f9f-48d7-a0fc-20fa58e57843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8488b6dcc6642e48d40f624a56a52bc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:06.676668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cdd658-6f9f-48d7-a0fc-20fa58e57843 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:06.867919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f7cdd658-6f9f-48d7-a0fc-20fa58e57843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8488b6dcc6642e48d40f624a56a52bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:06.923501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f7cdd658-6f9f-48d7-a0fc-20fa58e57843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8488b6dcc6642e48d40f624a56a52bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:06.925164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f7cdd658-6f9f-48d7-a0fc-20fa58e57843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8488b6dcc6642e48d40f624a56a52bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:06.934690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f7cdd658-6f9f-48d7-a0fc-20fa58e57843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8488b6dcc6642e48d40f624a56a52bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:06.949748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f7cdd658-6f9f-48d7-a0fc-20fa58e57843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8488b6dcc6642e48d40f624a56a52bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:06.983174 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1432/2872] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:25:06 2022] DELETE /identity/v3/users/d8488b6dcc6642e48d40f624a56a52bc => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:06.988946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080193e6-6575-4ba7-923c-e92d2711aff2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:06.989369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080193e6-6575-4ba7-923c-e92d2711aff2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:06.991548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080193e6-6575-4ba7-923c-e92d2711aff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:07.033492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-080193e6-6575-4ba7-923c-e92d2711aff2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:07.047930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-080193e6-6575-4ba7-923c-e92d2711aff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:07.100118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdd658-6f9f-48d7-a0fc-20fa58e57843 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:07.101741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f7cdd658-6f9f-48d7-a0fc-20fa58e57843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:07.266636 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1441/2873] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:07.302643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdd658-6f9f-48d7-a0fc-20fa58e57843 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:07.314892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080193e6-6575-4ba7-923c-e92d2711aff2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:07.316584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-080193e6-6575-4ba7-923c-e92d2711aff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:07.325591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba68273-b4d2-4589-b1c1-8cb2f64e95db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:07.325591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba68273-b4d2-4589-b1c1-8cb2f64e95db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:07.325591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba68273-b4d2-4589-b1c1-8cb2f64e95db admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:07.325591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba68273-b4d2-4589-b1c1-8cb2f64e95db admin admin] PATH_INFO: `/v3/users/447e92e13f1842d0942e72f02005ea10` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:07.330484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba68273-b4d2-4589-b1c1-8cb2f64e95db admin admin] RBAC: Authorizing `identity:delete_user(user_id=447e92e13f1842d0942e72f02005ea10)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:07.331672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba68273-b4d2-4589-b1c1-8cb2f64e95db admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:07.517106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080193e6-6575-4ba7-923c-e92d2711aff2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:07.523054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8507fd6-fe95-499e-ad7c-218d45f8189e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:07.523756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8507fd6-fe95-499e-ad7c-218d45f8189e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:07.524032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8507fd6-fe95-499e-ad7c-218d45f8189e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:07.525496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8507fd6-fe95-499e-ad7c-218d45f8189e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:07.534225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:07.545928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8507fd6-fe95-499e-ad7c-218d45f8189e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:07.562701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8507fd6-fe95-499e-ad7c-218d45f8189e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:07.587040 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1442/2874] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:07.614382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9ba68273-b4d2-4589-b1c1-8cb2f64e95db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '447e92e13f1842d0942e72f02005ea10'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:07.675731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9ba68273-b4d2-4589-b1c1-8cb2f64e95db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '447e92e13f1842d0942e72f02005ea10'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:07.678127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9ba68273-b4d2-4589-b1c1-8cb2f64e95db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '447e92e13f1842d0942e72f02005ea10'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:07.682093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9ba68273-b4d2-4589-b1c1-8cb2f64e95db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '447e92e13f1842d0942e72f02005ea10'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:07.734402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9ba68273-b4d2-4589-b1c1-8cb2f64e95db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '447e92e13f1842d0942e72f02005ea10'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:07.805983 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1433/2875] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:25:07 2022] DELETE /identity/v3/users/447e92e13f1842d0942e72f02005ea10 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:25:10.468571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8507fd6-fe95-499e-ad7c-218d45f8189e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:10.487062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8507fd6-fe95-499e-ad7c-218d45f8189e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:10.708604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:10.736085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d15b4-eae1-4996-8325-2824ea963af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:10.736940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d15b4-eae1-4996-8325-2824ea963af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:10.737217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d15b4-eae1-4996-8325-2824ea963af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:10.737529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d15b4-eae1-4996-8325-2824ea963af2 admin admin] PATH_INFO: `/v3/projects/ebb3b3a3e61d419b93d6c92b925aec09` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:10.738852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d15b4-eae1-4996-8325-2824ea963af2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb3b3a3e61d419b93d6c92b925aec09)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:10.741932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d15b4-eae1-4996-8325-2824ea963af2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:10.905847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-616d15b4-eae1-4996-8325-2824ea963af2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb3b3a3e61d419b93d6c92b925aec09', 'request_id': 'req-616d15b4-eae1-4996-8325-2824ea963af2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:10.963156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-616d15b4-eae1-4996-8325-2824ea963af2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb3b3a3e61d419b93d6c92b925aec09', 'request_id': 'req-616d15b4-eae1-4996-8325-2824ea963af2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:10.986444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-616d15b4-eae1-4996-8325-2824ea963af2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb3b3a3e61d419b93d6c92b925aec09', 'request_id': 'req-616d15b4-eae1-4996-8325-2824ea963af2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:11.022028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-616d15b4-eae1-4996-8325-2824ea963af2 admin admin] The token cache is being invalidate because project ebb3b3a3e61d419b93d6c92b925aec09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:25:11.023777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-616d15b4-eae1-4996-8325-2824ea963af2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:11.025788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-616d15b4-eae1-4996-8325-2824ea963af2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:11.031154 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1443/2876] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:25:10 2022] DELETE /identity/v3/projects/ebb3b3a3e61d419b93d6c92b925aec09 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:11.037636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f3eaa-e421-461b-9b97-17b2f34396a7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:11.038702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f3eaa-e421-461b-9b97-17b2f34396a7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:11.039244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f3eaa-e421-461b-9b97-17b2f34396a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:11.104882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cf4f3eaa-e421-461b-9b97-17b2f34396a7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:11.106601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cf4f3eaa-e421-461b-9b97-17b2f34396a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:11.280672 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1434/2877] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:11.292782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd92033-edb8-4acb-a016-5a3cca21bbc5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:11.293612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd92033-edb8-4acb-a016-5a3cca21bbc5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:11.294039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd92033-edb8-4acb-a016-5a3cca21bbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:11.335735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9cd92033-edb8-4acb-a016-5a3cca21bbc5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:11.337420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9cd92033-edb8-4acb-a016-5a3cca21bbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:11.344544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f3eaa-e421-461b-9b97-17b2f34396a7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:11.348432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cf4f3eaa-e421-461b-9b97-17b2f34396a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:11.362612 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1444/2878] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:11.368474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd92033-edb8-4acb-a016-5a3cca21bbc5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:11.371239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f3eaa-e421-461b-9b97-17b2f34396a7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:11.378706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db967cea-2ef8-4e00-95b4-d83133ff21b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:11.379465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db967cea-2ef8-4e00-95b4-d83133ff21b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:11.379817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db967cea-2ef8-4e00-95b4-d83133ff21b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:11.380225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db967cea-2ef8-4e00-95b4-d83133ff21b6 admin admin] PATH_INFO: `/v3/projects/907a3256e3bc433f9ff9948082c90973` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:11.381504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db967cea-2ef8-4e00-95b4-d83133ff21b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=907a3256e3bc433f9ff9948082c90973)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:11.383767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db967cea-2ef8-4e00-95b4-d83133ff21b6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:11.400329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd92033-edb8-4acb-a016-5a3cca21bbc5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:11.421757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929ab65-8be9-40c2-9617-360bc805f402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:11.422445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929ab65-8be9-40c2-9617-360bc805f402 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:11.422717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929ab65-8be9-40c2-9617-360bc805f402 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:11.423040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929ab65-8be9-40c2-9617-360bc805f402 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:11.424735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929ab65-8be9-40c2-9617-360bc805f402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:25:11.425698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929ab65-8be9-40c2-9617-360bc805f402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:11.427041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929ab65-8be9-40c2-9617-360bc805f402 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:11.452448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db967cea-2ef8-4e00-95b4-d83133ff21b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907a3256e3bc433f9ff9948082c90973', 'request_id': 'req-db967cea-2ef8-4e00-95b4-d83133ff21b6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:11.481562 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1445/2879] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:25:11.489110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929ab65-8be9-40c2-9617-360bc805f402 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:11.502727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db967cea-2ef8-4e00-95b4-d83133ff21b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907a3256e3bc433f9ff9948082c90973', 'request_id': 'req-db967cea-2ef8-4e00-95b4-d83133ff21b6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:11.525140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929ab65-8be9-40c2-9617-360bc805f402 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:11.525579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db967cea-2ef8-4e00-95b4-d83133ff21b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907a3256e3bc433f9ff9948082c90973', 'request_id': 'req-db967cea-2ef8-4e00-95b4-d83133ff21b6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:11.563044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db967cea-2ef8-4e00-95b4-d83133ff21b6 admin admin] The token cache is being invalidate because project 907a3256e3bc433f9ff9948082c90973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:25:11.564839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db967cea-2ef8-4e00-95b4-d83133ff21b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:11.567329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db967cea-2ef8-4e00-95b4-d83133ff21b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:11.582200 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1435/2880] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:25:11 2022] DELETE /identity/v3/projects/907a3256e3bc433f9ff9948082c90973 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:11.587215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db967cea-2ef8-4e00-95b4-d83133ff21b6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:11.592998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db967cea-2ef8-4e00-95b4-d83133ff21b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:11.691536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb74a1-8b01-453d-916f-11b0299c9fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:11.692469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb74a1-8b01-453d-916f-11b0299c9fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:11.692995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb74a1-8b01-453d-916f-11b0299c9fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:11.693429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb74a1-8b01-453d-916f-11b0299c9fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:11.694239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb74a1-8b01-453d-916f-11b0299c9fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:11.698887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb74a1-8b01-453d-916f-11b0299c9fb3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:11.704515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:11.764480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db967cea-2ef8-4e00-95b4-d83133ff21b6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:11.776808 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1446/2881] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:25:11 2022] POST /identity/v3/projects => generated 371 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:25:11.780490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46fd9c-579c-4151-a6df-8dc084cbca82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:11.781168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46fd9c-579c-4151-a6df-8dc084cbca82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:11.781443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46fd9c-579c-4151-a6df-8dc084cbca82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:11.782602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb74a1-8b01-453d-916f-11b0299c9fb3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:11.783936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46fd9c-579c-4151-a6df-8dc084cbca82 admin admin] PATH_INFO: `/v3/users/becd310e2c3f42bc88ae06ad732df672` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:11.787148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68eb74a1-8b01-453d-916f-11b0299c9fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:11.787410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46fd9c-579c-4151-a6df-8dc084cbca82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=becd310e2c3f42bc88ae06ad732df672)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:11.807719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46fd9c-579c-4151-a6df-8dc084cbca82 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:11.938285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:11.977573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb74a1-8b01-453d-916f-11b0299c9fb3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:11.981811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df46fd9c-579c-4151-a6df-8dc084cbca82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'becd310e2c3f42bc88ae06ad732df672'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:12.005731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdd8e9-1012-4008-805c-026c41ddc3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:12.012854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdd8e9-1012-4008-805c-026c41ddc3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:12.013891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdd8e9-1012-4008-805c-026c41ddc3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:12.014648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df46fd9c-579c-4151-a6df-8dc084cbca82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'becd310e2c3f42bc88ae06ad732df672'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:12.015110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdd8e9-1012-4008-805c-026c41ddc3b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:12.016579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df46fd9c-579c-4151-a6df-8dc084cbca82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'becd310e2c3f42bc88ae06ad732df672'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:12.018497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df46fd9c-579c-4151-a6df-8dc084cbca82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'becd310e2c3f42bc88ae06ad732df672'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:12.020155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdd8e9-1012-4008-805c-026c41ddc3b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:12.030515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdd8e9-1012-4008-805c-026c41ddc3b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:12.035510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df46fd9c-579c-4151-a6df-8dc084cbca82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'becd310e2c3f42bc88ae06ad732df672'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:12.064526 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1436/2882] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:25:11 2022] DELETE /identity/v3/users/becd310e2c3f42bc88ae06ad732df672 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:12.090964 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1447/2883] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:25:11 2022] POST /identity/v3/users => generated 286 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:25:12.095212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46fd9c-579c-4151-a6df-8dc084cbca82 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:12.097375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-df46fd9c-579c-4151-a6df-8dc084cbca82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:12.280236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46fd9c-579c-4151-a6df-8dc084cbca82 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:12.295702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eb6a8-1903-4d13-bd34-6e0e8a198a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:12.296464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eb6a8-1903-4d13-bd34-6e0e8a198a59 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:12.296748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eb6a8-1903-4d13-bd34-6e0e8a198a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:12.297074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eb6a8-1903-4d13-bd34-6e0e8a198a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:12.298826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2eb6a8-1903-4d13-bd34-6e0e8a198a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:12.302099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2eb6a8-1903-4d13-bd34-6e0e8a198a59 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:12.318309 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1437/2884] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:12.320014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdd8e9-1012-4008-805c-026c41ddc3b2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:12.354131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdd8e9-1012-4008-805c-026c41ddc3b2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:12.360855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09d835-c2a3-47f3-8489-dd4b0efa3dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:12.361132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09d835-c2a3-47f3-8489-dd4b0efa3dee admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:12.361335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09d835-c2a3-47f3-8489-dd4b0efa3dee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:12.361607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09d835-c2a3-47f3-8489-dd4b0efa3dee admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:12.362266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09d835-c2a3-47f3-8489-dd4b0efa3dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:12.365400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09d835-c2a3-47f3-8489-dd4b0efa3dee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:12.399430 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1448/2885] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:12.399652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eb6a8-1903-4d13-bd34-6e0e8a198a59 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:12.418027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eb6a8-1903-4d13-bd34-6e0e8a198a59 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:12.427144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e83bb0-6183-4e96-aa9b-3e8bdf95cd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:12.427905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e83bb0-6183-4e96-aa9b-3e8bdf95cd22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:12.428186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e83bb0-6183-4e96-aa9b-3e8bdf95cd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:12.428502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e83bb0-6183-4e96-aa9b-3e8bdf95cd22 admin admin] PATH_INFO: `/v3/projects/23e57590bec2494891b0a39fa6e9ee9d/users/2995563d841d4baba4da789f62c4962b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:12.469949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e83bb0-6183-4e96-aa9b-3e8bdf95cd22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e57590bec2494891b0a39fa6e9ee9d, user_id=2995563d841d4baba4da789f62c4962b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:12.472768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e83bb0-6183-4e96-aa9b-3e8bdf95cd22 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:12.504106 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1438/2886] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:12 2022] PUT /identity/v3/projects/23e57590bec2494891b0a39fa6e9ee9d/users/2995563d841d4baba4da789f62c4962b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:12.513945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65eae6-b9a6-4e03-831f-333e98a3b167 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:12.514536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65eae6-b9a6-4e03-831f-333e98a3b167 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:12.514536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65eae6-b9a6-4e03-831f-333e98a3b167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:12.577442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6f65eae6-b9a6-4e03-831f-333e98a3b167 None None] MFA Rules not processed for user `2995563d841d4baba4da789f62c4962b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:12.579586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6f65eae6-b9a6-4e03-831f-333e98a3b167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:12.843173 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1449/2887] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:12.846174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefa8ef-773f-40fe-ac3c-f123cad72c9f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:12.846454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefa8ef-773f-40fe-ac3c-f123cad72c9f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:12.846733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefa8ef-773f-40fe-ac3c-f123cad72c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:12.930527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-eeefa8ef-773f-40fe-ac3c-f123cad72c9f None None] MFA Rules not processed for user `2995563d841d4baba4da789f62c4962b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:12.938251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eeefa8ef-773f-40fe-ac3c-f123cad72c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:12.979440 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1439/2888] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:13.046893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65eae6-b9a6-4e03-831f-333e98a3b167 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:13.051053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6f65eae6-b9a6-4e03-831f-333e98a3b167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:13.369694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65eae6-b9a6-4e03-831f-333e98a3b167 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:13.401880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93f83b-bdfc-4170-8c3e-b1f0a55623f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:13.408153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93f83b-bdfc-4170-8c3e-b1f0a55623f0 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:13.408418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93f83b-bdfc-4170-8c3e-b1f0a55623f0 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:13.408751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93f83b-bdfc-4170-8c3e-b1f0a55623f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:13.450469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93f83b-bdfc-4170-8c3e-b1f0a55623f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:13.452160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93f83b-bdfc-4170-8c3e-b1f0a55623f0 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:13.501985 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1450/2889] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:13.703346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefa8ef-773f-40fe-ac3c-f123cad72c9f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:13.708147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eeefa8ef-773f-40fe-ac3c-f123cad72c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:13.785837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:13.852500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefa8ef-773f-40fe-ac3c-f123cad72c9f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:13.858807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8964a1-8194-4bb6-b407-feaf81aa14f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:13.861650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8964a1-8194-4bb6-b407-feaf81aa14f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:13.862234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8964a1-8194-4bb6-b407-feaf81aa14f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:13.862935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8964a1-8194-4bb6-b407-feaf81aa14f2 admin admin] PATH_INFO: `/v3/projects/36f56fb3ceb44967bd5b05ca45ad7ec8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:13.865024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8964a1-8194-4bb6-b407-feaf81aa14f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f56fb3ceb44967bd5b05ca45ad7ec8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:13.868320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8964a1-8194-4bb6-b407-feaf81aa14f2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:14.007537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-af8964a1-8194-4bb6-b407-feaf81aa14f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f56fb3ceb44967bd5b05ca45ad7ec8', 'request_id': 'req-af8964a1-8194-4bb6-b407-feaf81aa14f2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:14.022848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-af8964a1-8194-4bb6-b407-feaf81aa14f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f56fb3ceb44967bd5b05ca45ad7ec8', 'request_id': 'req-af8964a1-8194-4bb6-b407-feaf81aa14f2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:14.067518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-af8964a1-8194-4bb6-b407-feaf81aa14f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f56fb3ceb44967bd5b05ca45ad7ec8', 'request_id': 'req-af8964a1-8194-4bb6-b407-feaf81aa14f2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:14.089962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-af8964a1-8194-4bb6-b407-feaf81aa14f2 admin admin] The token cache is being invalidate because project 36f56fb3ceb44967bd5b05ca45ad7ec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:25:14.090986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-af8964a1-8194-4bb6-b407-feaf81aa14f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:14.091501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-af8964a1-8194-4bb6-b407-feaf81aa14f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:14.096838 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1440/2890] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:25:13 2022] DELETE /identity/v3/projects/36f56fb3ceb44967bd5b05ca45ad7ec8 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:14.098584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17ad8b-9964-4591-bc1d-42ecfb514a5e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:14.100025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17ad8b-9964-4591-bc1d-42ecfb514a5e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:14.100503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17ad8b-9964-4591-bc1d-42ecfb514a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:14.168303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9d17ad8b-9964-4591-bc1d-42ecfb514a5e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:14.177361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9d17ad8b-9964-4591-bc1d-42ecfb514a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:14.183141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8f3fd-6723-444d-bfeb-f4c08c9a02af None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:14.183411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8f3fd-6723-444d-bfeb-f4c08c9a02af None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:14.183738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8f3fd-6723-444d-bfeb-f4c08c9a02af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:14.242170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0eb8f3fd-6723-444d-bfeb-f4c08c9a02af None None] MFA Rules not processed for user `2995563d841d4baba4da789f62c4962b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:14.243569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0eb8f3fd-6723-444d-bfeb-f4c08c9a02af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:14.365320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:14.451615 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1451/2891] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:14.456297 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1441/2892] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:14.459528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa64845-6b26-4ff0-82ae-911c334e04e6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:14.459813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa64845-6b26-4ff0-82ae-911c334e04e6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:14.460093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa64845-6b26-4ff0-82ae-911c334e04e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:14.550875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-efa64845-6b26-4ff0-82ae-911c334e04e6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:14.557916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-efa64845-6b26-4ff0-82ae-911c334e04e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:14.607370 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1452/2893] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:14.609568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8f3fd-6723-444d-bfeb-f4c08c9a02af None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:14.680078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8f3fd-6723-444d-bfeb-f4c08c9a02af None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:14.711817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef45f99-fb90-41f9-84d9-3a97eb1232f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:14.712502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef45f99-fb90-41f9-84d9-3a97eb1232f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:14.712720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef45f99-fb90-41f9-84d9-3a97eb1232f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:14.718046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef45f99-fb90-41f9-84d9-3a97eb1232f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:14.722501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef45f99-fb90-41f9-84d9-3a97eb1232f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:25:14.722898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef45f99-fb90-41f9-84d9-3a97eb1232f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:14.732337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef45f99-fb90-41f9-84d9-3a97eb1232f4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:14.809765 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1442/2894] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:25:14.810144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa64845-6b26-4ff0-82ae-911c334e04e6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:14.827476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa64845-6b26-4ff0-82ae-911c334e04e6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:14.846623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200c9ed-da7b-406f-9dff-955b09253ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:14.849156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200c9ed-da7b-406f-9dff-955b09253ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:14.850084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200c9ed-da7b-406f-9dff-955b09253ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:14.850382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200c9ed-da7b-406f-9dff-955b09253ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:14.856991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200c9ed-da7b-406f-9dff-955b09253ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:14.866631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200c9ed-da7b-406f-9dff-955b09253ea8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:15.010780 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1453/2895] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:25:14 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:25:15.012708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef45f99-fb90-41f9-84d9-3a97eb1232f4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:15.034196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef45f99-fb90-41f9-84d9-3a97eb1232f4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:15.108115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e1b3c-3f8b-42a4-887b-43a641bc660a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:15.108690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e1b3c-3f8b-42a4-887b-43a641bc660a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:15.108969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e1b3c-3f8b-42a4-887b-43a641bc660a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:15.206383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:15.252468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce6984-6638-4622-8c2a-b4df76d27d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:15.253208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce6984-6638-4622-8c2a-b4df76d27d6e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:15.253590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce6984-6638-4622-8c2a-b4df76d27d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:15.254531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce6984-6638-4622-8c2a-b4df76d27d6e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:15.254942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce6984-6638-4622-8c2a-b4df76d27d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:15.260541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce6984-6638-4622-8c2a-b4df76d27d6e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:15.285651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7a5e1b3c-3f8b-42a4-887b-43a641bc660a None None] MFA Rules not processed for user `27349f6769014bc689ec22a1e2383ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:15.294760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a5e1b3c-3f8b-42a4-887b-43a641bc660a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:15.313270 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1443/2896] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:25:15 2022] POST /identity/v3/users => generated 290 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:15.318055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce6984-6638-4622-8c2a-b4df76d27d6e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:15.341595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce6984-6638-4622-8c2a-b4df76d27d6e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:15.359703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba4e08-97df-4329-adb6-d9a32bd37370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:15.366808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba4e08-97df-4329-adb6-d9a32bd37370 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:15.367357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba4e08-97df-4329-adb6-d9a32bd37370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:15.370521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba4e08-97df-4329-adb6-d9a32bd37370 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:15.371525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba4e08-97df-4329-adb6-d9a32bd37370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:15.373578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba4e08-97df-4329-adb6-d9a32bd37370 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:15.423831 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1444/2897] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:15.429009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba4e08-97df-4329-adb6-d9a32bd37370 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:15.476173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba4e08-97df-4329-adb6-d9a32bd37370 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:15.500648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43320324-2a7f-4d9b-a3aa-08cc18970526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:15.506133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43320324-2a7f-4d9b-a3aa-08cc18970526 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:15.506707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43320324-2a7f-4d9b-a3aa-08cc18970526 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:15.508531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43320324-2a7f-4d9b-a3aa-08cc18970526 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:15.509940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43320324-2a7f-4d9b-a3aa-08cc18970526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:15.514534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43320324-2a7f-4d9b-a3aa-08cc18970526 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:15.566484 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1454/2898] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:25:15.611420 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1445/2899] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:15.616150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e1b3c-3f8b-42a4-887b-43a641bc660a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:15.631640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e1b3c-3f8b-42a4-887b-43a641bc660a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:15.671683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd331ec3-d3f2-4d0b-83ce-db5594d5fc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:15.672391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd331ec3-d3f2-4d0b-83ce-db5594d5fc4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:15.672670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd331ec3-d3f2-4d0b-83ce-db5594d5fc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:15.672948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd331ec3-d3f2-4d0b-83ce-db5594d5fc4c admin admin] PATH_INFO: `/v3/projects/3b84a93b441b47e2b174c1607fe41cc0/users/69c1f1d0f2f54dd5af9d2ec162895c9f/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:15.748342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd331ec3-d3f2-4d0b-83ce-db5594d5fc4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b84a93b441b47e2b174c1607fe41cc0, user_id=69c1f1d0f2f54dd5af9d2ec162895c9f, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:15.751315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd331ec3-d3f2-4d0b-83ce-db5594d5fc4c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:15.793995 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1455/2900] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:15 2022] PUT /identity/v3/projects/3b84a93b441b47e2b174c1607fe41cc0/users/69c1f1d0f2f54dd5af9d2ec162895c9f/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:15.805406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8476157-0a78-4953-80f2-770559b75443 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:15.807111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8476157-0a78-4953-80f2-770559b75443 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:15.807662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8476157-0a78-4953-80f2-770559b75443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:15.868316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd331ec3-d3f2-4d0b-83ce-db5594d5fc4c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:15.871427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bd331ec3-d3f2-4d0b-83ce-db5594d5fc4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:15.939095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f8476157-0a78-4953-80f2-770559b75443 None None] MFA Rules not processed for user `69c1f1d0f2f54dd5af9d2ec162895c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:15.943871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f8476157-0a78-4953-80f2-770559b75443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:16.183215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd331ec3-d3f2-4d0b-83ce-db5594d5fc4c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:16.226632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d97af-564b-4d6e-8031-c4cf91cf5eef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:16.228474 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1446/2901] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:16.229485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d97af-564b-4d6e-8031-c4cf91cf5eef service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:16.235409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d97af-564b-4d6e-8031-c4cf91cf5eef service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:16.236094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d97af-564b-4d6e-8031-c4cf91cf5eef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:16.237319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8476157-0a78-4953-80f2-770559b75443 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:16.254169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9d9d97af-564b-4d6e-8031-c4cf91cf5eef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:16.323869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:16.454266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d97af-564b-4d6e-8031-c4cf91cf5eef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:16.462152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d97af-564b-4d6e-8031-c4cf91cf5eef service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:16.473354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8476157-0a78-4953-80f2-770559b75443 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:16.485756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966d6ad-da66-46e8-9cc4-96f84d2a0ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:16.488730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966d6ad-da66-46e8-9cc4-96f84d2a0ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:16.490230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966d6ad-da66-46e8-9cc4-96f84d2a0ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:16.491786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966d6ad-da66-46e8-9cc4-96f84d2a0ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:16.494024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966d6ad-da66-46e8-9cc4-96f84d2a0ce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:16.502147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966d6ad-da66-46e8-9cc4-96f84d2a0ce6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:16.510312 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1456/2902] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:16.644734 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1447/2903] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:25:16 2022] POST /identity/v3/projects => generated 377 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:16.647337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d97af-564b-4d6e-8031-c4cf91cf5eef service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:16.688075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d97af-564b-4d6e-8031-c4cf91cf5eef service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:17.098680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da704427-572a-48c5-bb2c-5b797deb11cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:17.099816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704427-572a-48c5-bb2c-5b797deb11cd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:17.100113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704427-572a-48c5-bb2c-5b797deb11cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:17.100390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704427-572a-48c5-bb2c-5b797deb11cd admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:17.102841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da704427-572a-48c5-bb2c-5b797deb11cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:17.106714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da704427-572a-48c5-bb2c-5b797deb11cd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:17.156781 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1457/2904] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:25:16 2022] POST /identity/v3/users => generated 295 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:17.162087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966d6ad-da66-46e8-9cc4-96f84d2a0ce6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:17.193272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966d6ad-da66-46e8-9cc4-96f84d2a0ce6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:17.248874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7650732-cbd0-4809-b5d7-2c28f8545224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:17.253815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7650732-cbd0-4809-b5d7-2c28f8545224 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:17.255806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7650732-cbd0-4809-b5d7-2c28f8545224 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:17.257353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7650732-cbd0-4809-b5d7-2c28f8545224 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:17.262528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7650732-cbd0-4809-b5d7-2c28f8545224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:17.277867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7650732-cbd0-4809-b5d7-2c28f8545224 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:17.389534 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1448/2905] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:17.391078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da704427-572a-48c5-bb2c-5b797deb11cd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:17.406185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da704427-572a-48c5-bb2c-5b797deb11cd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:17.463486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aeeff8-1509-46fb-b391-5fa9ef3bc9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:17.470009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aeeff8-1509-46fb-b391-5fa9ef3bc9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:17.471193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aeeff8-1509-46fb-b391-5fa9ef3bc9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:17.477756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aeeff8-1509-46fb-b391-5fa9ef3bc9a5 admin admin] PATH_INFO: `/v3/projects/65d7113e326346e1ba6ec40dd51b76d3/users/e3847223b5a44b9d9608d28138b9d36c/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:17.624993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aeeff8-1509-46fb-b391-5fa9ef3bc9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d7113e326346e1ba6ec40dd51b76d3, user_id=e3847223b5a44b9d9608d28138b9d36c, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:17.638496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aeeff8-1509-46fb-b391-5fa9ef3bc9a5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:17.690619 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1458/2906] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:17 2022] PUT /identity/v3/projects/65d7113e326346e1ba6ec40dd51b76d3/users/e3847223b5a44b9d9608d28138b9d36c/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:17.696000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7650732-cbd0-4809-b5d7-2c28f8545224 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:17.718826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7650732-cbd0-4809-b5d7-2c28f8545224 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:17.760958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:18.062139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86976e-68bf-4bba-b4c9-7d9d18fc7b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:18.066943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86976e-68bf-4bba-b4c9-7d9d18fc7b71 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:18.067408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86976e-68bf-4bba-b4c9-7d9d18fc7b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:18.069231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86976e-68bf-4bba-b4c9-7d9d18fc7b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:18.072278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86976e-68bf-4bba-b4c9-7d9d18fc7b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:18.083318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86976e-68bf-4bba-b4c9-7d9d18fc7b71 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:18.233691 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1449/2907] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 538 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:18.239054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aeeff8-1509-46fb-b391-5fa9ef3bc9a5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:18.280089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aeeff8-1509-46fb-b391-5fa9ef3bc9a5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:18.333236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad0b7d-de84-48c4-8f94-04f57ea2c8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:18.339473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad0b7d-de84-48c4-8f94-04f57ea2c8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:18.339770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad0b7d-de84-48c4-8f94-04f57ea2c8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:18.357637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad0b7d-de84-48c4-8f94-04f57ea2c8e0 admin admin] PATH_INFO: `/v3/projects/65d7113e326346e1ba6ec40dd51b76d3/users/e3847223b5a44b9d9608d28138b9d36c/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:18.371960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad0b7d-de84-48c4-8f94-04f57ea2c8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d7113e326346e1ba6ec40dd51b76d3, user_id=e3847223b5a44b9d9608d28138b9d36c, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:18.377822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad0b7d-de84-48c4-8f94-04f57ea2c8e0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:18.472368 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1459/2908] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:18 2022] PUT /identity/v3/projects/65d7113e326346e1ba6ec40dd51b76d3/users/e3847223b5a44b9d9608d28138b9d36c/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:25:18.484403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eab39-6fe6-47d8-9ef8-3ad70fda7517 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:18.484691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eab39-6fe6-47d8-9ef8-3ad70fda7517 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:18.485204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eab39-6fe6-47d8-9ef8-3ad70fda7517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:18.608667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0f8eab39-6fe6-47d8-9ef8-3ad70fda7517 None None] MFA Rules not processed for user `e3847223b5a44b9d9608d28138b9d36c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:18.610185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0f8eab39-6fe6-47d8-9ef8-3ad70fda7517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:18.973646 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1450/2909] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:25:19.139382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad0b7d-de84-48c4-8f94-04f57ea2c8e0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:19.143318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56ad0b7d-de84-48c4-8f94-04f57ea2c8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:19.452741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad0b7d-de84-48c4-8f94-04f57ea2c8e0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:19.472125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115519c-c852-47f5-ae04-73d4289e6b96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:19.472987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115519c-c852-47f5-ae04-73d4289e6b96 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:19.473868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115519c-c852-47f5-ae04-73d4289e6b96 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:19.473868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115519c-c852-47f5-ae04-73d4289e6b96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:19.490064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:19.501010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115519c-c852-47f5-ae04-73d4289e6b96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:19.508884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115519c-c852-47f5-ae04-73d4289e6b96 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:19.548170 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1460/2910] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:19.721366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c677d2-52d1-479f-8891-2b1dc33d3bd3 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:19.721966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c677d2-52d1-479f-8891-2b1dc33d3bd3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:19.721966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c677d2-52d1-479f-8891-2b1dc33d3bd3 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:19.723382 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1451/2911] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:25:19.730145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115519c-c852-47f5-ae04-73d4289e6b96 service nova] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:25:19.748447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115519c-c852-47f5-ae04-73d4289e6b96 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:19.770144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115519c-c852-47f5-ae04-73d4289e6b96 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:19.782425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19425c-8892-4ab5-b436-4c1cadb3f64a tempest-FlavorsAccessTestJSON-722710747 tempest-FlavorsAccessTestJSON-722710747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3847223b5a44b9d9608d28138b9d36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d7113e326346e1ba6ec40dd51b76d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:19.783099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19425c-8892-4ab5-b436-4c1cadb3f64a tempest-FlavorsAccessTestJSON-722710747 tempest-FlavorsAccessTestJSON-722710747-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:19.783404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19425c-8892-4ab5-b436-4c1cadb3f64a tempest-FlavorsAccessTestJSON-722710747 tempest-FlavorsAccessTestJSON-722710747-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:19.783682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19425c-8892-4ab5-b436-4c1cadb3f64a tempest-FlavorsAccessTestJSON-722710747 tempest-FlavorsAccessTestJSON-722710747-project-admin] PATH_INFO: `/v3/projects/3b84a93b441b47e2b174c1607fe41cc0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:19.788384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19425c-8892-4ab5-b436-4c1cadb3f64a tempest-FlavorsAccessTestJSON-722710747 tempest-FlavorsAccessTestJSON-722710747-project-admin] RBAC: Authorizing `identity:get_project(project_id=3b84a93b441b47e2b174c1607fe41cc0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:19.797645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19425c-8892-4ab5-b436-4c1cadb3f64a tempest-FlavorsAccessTestJSON-722710747 tempest-FlavorsAccessTestJSON-722710747-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:19.799626 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1461/2912] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:25:19 2022] GET /identity/v3/projects/3b84a93b441b47e2b174c1607fe41cc0 => generated 379 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:25:19.860705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c677d2-52d1-479f-8891-2b1dc33d3bd3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:19.903148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c677d2-52d1-479f-8891-2b1dc33d3bd3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:19.916312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7f4a3-6992-4c0e-aad8-60079ab85584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:19.917214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7f4a3-6992-4c0e-aad8-60079ab85584 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:19.917682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7f4a3-6992-4c0e-aad8-60079ab85584 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:19.918112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7f4a3-6992-4c0e-aad8-60079ab85584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:20.113098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7f4a3-6992-4c0e-aad8-60079ab85584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:20.114876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7f4a3-6992-4c0e-aad8-60079ab85584 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:20.146106 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1452/2913] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:20.532100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910b496-0014-4ee2-ab38-55c3c4f6ab4c None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:20.533052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910b496-0014-4ee2-ab38-55c3c4f6ab4c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:20.533475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910b496-0014-4ee2-ab38-55c3c4f6ab4c None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:20.535396 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1462/2914] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:25:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:25:20.544229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7f4a3-6992-4c0e-aad8-60079ab85584 service nova] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:25:20.577272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7f4a3-6992-4c0e-aad8-60079ab85584 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:20.588452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7f4a3-6992-4c0e-aad8-60079ab85584 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:20.601686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd72b3-9740-46ca-bdc9-0a2c6908b2eb tempest-FlavorsAccessTestJSON-722710747 tempest-FlavorsAccessTestJSON-722710747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3847223b5a44b9d9608d28138b9d36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d7113e326346e1ba6ec40dd51b76d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:20.602347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd72b3-9740-46ca-bdc9-0a2c6908b2eb tempest-FlavorsAccessTestJSON-722710747 tempest-FlavorsAccessTestJSON-722710747-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:20.602630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd72b3-9740-46ca-bdc9-0a2c6908b2eb tempest-FlavorsAccessTestJSON-722710747 tempest-FlavorsAccessTestJSON-722710747-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:20.603095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd72b3-9740-46ca-bdc9-0a2c6908b2eb tempest-FlavorsAccessTestJSON-722710747 tempest-FlavorsAccessTestJSON-722710747-project-admin] PATH_INFO: `/v3/projects/3b84a93b441b47e2b174c1607fe41cc0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:20.606807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd72b3-9740-46ca-bdc9-0a2c6908b2eb tempest-FlavorsAccessTestJSON-722710747 tempest-FlavorsAccessTestJSON-722710747-project-admin] RBAC: Authorizing `identity:get_project(project_id=3b84a93b441b47e2b174c1607fe41cc0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:20.617090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd72b3-9740-46ca-bdc9-0a2c6908b2eb tempest-FlavorsAccessTestJSON-722710747 tempest-FlavorsAccessTestJSON-722710747-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:20.620232 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1453/2915] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:25:20 2022] GET /identity/v3/projects/3b84a93b441b47e2b174c1607fe41cc0 => generated 379 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:25:21.280378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910b496-0014-4ee2-ab38-55c3c4f6ab4c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:21.469749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9fd07-236b-480c-8c80-bc49a93e0d4b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:21.470282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9fd07-236b-480c-8c80-bc49a93e0d4b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:21.470874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9fd07-236b-480c-8c80-bc49a93e0d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:21.592323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910b496-0014-4ee2-ab38-55c3c4f6ab4c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:21.593846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e8a9fd07-236b-480c-8c80-bc49a93e0d4b None None] MFA Rules not processed for user `d60e254814924b44843a420ca3ba21c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:21.597686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e8a9fd07-236b-480c-8c80-bc49a93e0d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:21.611380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a77c4c-60f8-4aae-9fea-f985cd6afabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:21.616026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a77c4c-60f8-4aae-9fea-f985cd6afabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:21.616709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a77c4c-60f8-4aae-9fea-f985cd6afabf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:21.617225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a77c4c-60f8-4aae-9fea-f985cd6afabf admin admin] PATH_INFO: `/v3/users/69c1f1d0f2f54dd5af9d2ec162895c9f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:21.623770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a77c4c-60f8-4aae-9fea-f985cd6afabf admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c1f1d0f2f54dd5af9d2ec162895c9f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:21.645501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a77c4c-60f8-4aae-9fea-f985cd6afabf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:21.662728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:21.777659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66a77c4c-60f8-4aae-9fea-f985cd6afabf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c1f1d0f2f54dd5af9d2ec162895c9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:21.780057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66a77c4c-60f8-4aae-9fea-f985cd6afabf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c1f1d0f2f54dd5af9d2ec162895c9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:21.803555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66a77c4c-60f8-4aae-9fea-f985cd6afabf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c1f1d0f2f54dd5af9d2ec162895c9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:21.824615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66a77c4c-60f8-4aae-9fea-f985cd6afabf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c1f1d0f2f54dd5af9d2ec162895c9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:21.829535 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1454/2916] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:25:21.844593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66a77c4c-60f8-4aae-9fea-f985cd6afabf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c1f1d0f2f54dd5af9d2ec162895c9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:21.862649 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1463/2917] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:25:21 2022] DELETE /identity/v3/users/69c1f1d0f2f54dd5af9d2ec162895c9f => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:21.868896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8496a5-71d3-4323-8013-4562d58474c7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:21.869663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8496a5-71d3-4323-8013-4562d58474c7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:21.870162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8496a5-71d3-4323-8013-4562d58474c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:21.909352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ba8496a5-71d3-4323-8013-4562d58474c7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:21.911080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ba8496a5-71d3-4323-8013-4562d58474c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:22.066556 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1455/2918] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:22.103896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a77c4c-60f8-4aae-9fea-f985cd6afabf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:22.105724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-66a77c4c-60f8-4aae-9fea-f985cd6afabf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:22.247676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a77c4c-60f8-4aae-9fea-f985cd6afabf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:22.273175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8496a5-71d3-4323-8013-4562d58474c7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:22.274803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ba8496a5-71d3-4323-8013-4562d58474c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:22.280211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcbf45-7204-4dff-b63d-d0a9b88a79cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:22.280857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcbf45-7204-4dff-b63d-d0a9b88a79cc service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:22.281133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcbf45-7204-4dff-b63d-d0a9b88a79cc service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:22.282290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcbf45-7204-4dff-b63d-d0a9b88a79cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:22.342356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcbf45-7204-4dff-b63d-d0a9b88a79cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:22.356240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcbf45-7204-4dff-b63d-d0a9b88a79cc service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:22.387972 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1464/2919] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:25:22.445739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8496a5-71d3-4323-8013-4562d58474c7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:22.469221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839bb23-e71b-45fe-84ac-7b659e6fc3e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:22.470456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839bb23-e71b-45fe-84ac-7b659e6fc3e0 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:22.478304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839bb23-e71b-45fe-84ac-7b659e6fc3e0 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:22.483667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839bb23-e71b-45fe-84ac-7b659e6fc3e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:22.637962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:22.656340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839bb23-e71b-45fe-84ac-7b659e6fc3e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:22.658565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839bb23-e71b-45fe-84ac-7b659e6fc3e0 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:22.671375 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1456/2920] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:23.864828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21177fc0-6b76-4f65-96d2-9ac69af6974b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:23.866276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21177fc0-6b76-4f65-96d2-9ac69af6974b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:23.866699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21177fc0-6b76-4f65-96d2-9ac69af6974b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:23.904181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839bb23-e71b-45fe-84ac-7b659e6fc3e0 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:23.906229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1839bb23-e71b-45fe-84ac-7b659e6fc3e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:23.917449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:23.931931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-21177fc0-6b76-4f65-96d2-9ac69af6974b None None] MFA Rules not processed for user `1ea47409a7304d32bebd75e8273b14a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:23.934696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-21177fc0-6b76-4f65-96d2-9ac69af6974b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:23.939707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839bb23-e71b-45fe-84ac-7b659e6fc3e0 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:23.955661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecf798-7932-4a81-974c-435067830015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:23.957033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecf798-7932-4a81-974c-435067830015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:23.957463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecf798-7932-4a81-974c-435067830015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:23.957987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecf798-7932-4a81-974c-435067830015 admin admin] PATH_INFO: `/v3/projects/3b84a93b441b47e2b174c1607fe41cc0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:23.959988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecf798-7932-4a81-974c-435067830015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b84a93b441b47e2b174c1607fe41cc0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:23.962079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecf798-7932-4a81-974c-435067830015 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:24.018291 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1465/2921] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:24.116398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36ecf798-7932-4a81-974c-435067830015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b84a93b441b47e2b174c1607fe41cc0', 'request_id': 'req-36ecf798-7932-4a81-974c-435067830015'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:24.124236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36ecf798-7932-4a81-974c-435067830015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b84a93b441b47e2b174c1607fe41cc0', 'request_id': 'req-36ecf798-7932-4a81-974c-435067830015'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:24.130689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36ecf798-7932-4a81-974c-435067830015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b84a93b441b47e2b174c1607fe41cc0', 'request_id': 'req-36ecf798-7932-4a81-974c-435067830015'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:24.159004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36ecf798-7932-4a81-974c-435067830015 admin admin] The token cache is being invalidate because project 3b84a93b441b47e2b174c1607fe41cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:25:24.160185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36ecf798-7932-4a81-974c-435067830015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:24.166873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36ecf798-7932-4a81-974c-435067830015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:24.171722 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1457/2922] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:25:23 2022] DELETE /identity/v3/projects/3b84a93b441b47e2b174c1607fe41cc0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:24.175704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21177fc0-6b76-4f65-96d2-9ac69af6974b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:24.201249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21177fc0-6b76-4f65-96d2-9ac69af6974b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:24.354287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62efff1-fdcb-4296-a14e-f0c776da4a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:24.355115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62efff1-fdcb-4296-a14e-f0c776da4a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:24.355587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62efff1-fdcb-4296-a14e-f0c776da4a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:24.356039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62efff1-fdcb-4296-a14e-f0c776da4a18 admin admin] PATH_INFO: `/v3/users/e3847223b5a44b9d9608d28138b9d36c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:24.363950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62efff1-fdcb-4296-a14e-f0c776da4a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3847223b5a44b9d9608d28138b9d36c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:24.371899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62efff1-fdcb-4296-a14e-f0c776da4a18 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:24.500040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e62efff1-fdcb-4296-a14e-f0c776da4a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3847223b5a44b9d9608d28138b9d36c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:24.501289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e62efff1-fdcb-4296-a14e-f0c776da4a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3847223b5a44b9d9608d28138b9d36c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:24.520102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e62efff1-fdcb-4296-a14e-f0c776da4a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3847223b5a44b9d9608d28138b9d36c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:24.545462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e62efff1-fdcb-4296-a14e-f0c776da4a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3847223b5a44b9d9608d28138b9d36c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:24.598949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e62efff1-fdcb-4296-a14e-f0c776da4a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3847223b5a44b9d9608d28138b9d36c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:24.609909 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1466/2923] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:25:24 2022] DELETE /identity/v3/users/e3847223b5a44b9d9608d28138b9d36c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:25.146462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecf798-7932-4a81-974c-435067830015 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:25.149441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-36ecf798-7932-4a81-974c-435067830015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:25.182641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecf798-7932-4a81-974c-435067830015 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:25.319647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8590b-aa94-46dc-8419-5f2d2e2f30bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:25.320305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8590b-aa94-46dc-8419-5f2d2e2f30bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:25.320592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8590b-aa94-46dc-8419-5f2d2e2f30bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:25.320889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8590b-aa94-46dc-8419-5f2d2e2f30bc admin admin] PATH_INFO: `/v3/projects/65d7113e326346e1ba6ec40dd51b76d3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:25.324037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8590b-aa94-46dc-8419-5f2d2e2f30bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d7113e326346e1ba6ec40dd51b76d3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:25.326020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8590b-aa94-46dc-8419-5f2d2e2f30bc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:25.525496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6da8590b-aa94-46dc-8419-5f2d2e2f30bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d7113e326346e1ba6ec40dd51b76d3', 'request_id': 'req-6da8590b-aa94-46dc-8419-5f2d2e2f30bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:25.562286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6da8590b-aa94-46dc-8419-5f2d2e2f30bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d7113e326346e1ba6ec40dd51b76d3', 'request_id': 'req-6da8590b-aa94-46dc-8419-5f2d2e2f30bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:25.596336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6da8590b-aa94-46dc-8419-5f2d2e2f30bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d7113e326346e1ba6ec40dd51b76d3', 'request_id': 'req-6da8590b-aa94-46dc-8419-5f2d2e2f30bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:25.628076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6da8590b-aa94-46dc-8419-5f2d2e2f30bc admin admin] The token cache is being invalidate because project 65d7113e326346e1ba6ec40dd51b76d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:25:25.629190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6da8590b-aa94-46dc-8419-5f2d2e2f30bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:25.631810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6da8590b-aa94-46dc-8419-5f2d2e2f30bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:25.638789 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1458/2924] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:25:25 2022] DELETE /identity/v3/projects/65d7113e326346e1ba6ec40dd51b76d3 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:25.650925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3250d84-47d5-48f4-85cc-a1f10fb3ce7f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:25.653244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3250d84-47d5-48f4-85cc-a1f10fb3ce7f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:25.653612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3250d84-47d5-48f4-85cc-a1f10fb3ce7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:25.780623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d3250d84-47d5-48f4-85cc-a1f10fb3ce7f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:25.784760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3250d84-47d5-48f4-85cc-a1f10fb3ce7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:25.932694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:26.066602 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1467/2925] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:25:26.075636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e74134-9dd4-457e-8e21-a7b99c1d62e3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:26.076184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e74134-9dd4-457e-8e21-a7b99c1d62e3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:26.076498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e74134-9dd4-457e-8e21-a7b99c1d62e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:26.098378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:26.175763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-21e74134-9dd4-457e-8e21-a7b99c1d62e3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:26.177025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-21e74134-9dd4-457e-8e21-a7b99c1d62e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:26.237728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3250d84-47d5-48f4-85cc-a1f10fb3ce7f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:26.238293 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1459/2926] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:26.271145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3250d84-47d5-48f4-85cc-a1f10fb3ce7f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:26.279223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af700298-9975-4bf1-ba01-679801fa70e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:26.279461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af700298-9975-4bf1-ba01-679801fa70e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:26.280065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af700298-9975-4bf1-ba01-679801fa70e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:26.280452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af700298-9975-4bf1-ba01-679801fa70e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:26.281595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af700298-9975-4bf1-ba01-679801fa70e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:25:26.282018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af700298-9975-4bf1-ba01-679801fa70e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:26.283994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af700298-9975-4bf1-ba01-679801fa70e6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:26.320401 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1468/2927] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:25:26.326398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e74134-9dd4-457e-8e21-a7b99c1d62e3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:26.343710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e74134-9dd4-457e-8e21-a7b99c1d62e3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:26.367413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b81ac-02eb-486e-89e1-63be7c5e959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:26.368098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b81ac-02eb-486e-89e1-63be7c5e959c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:26.368396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b81ac-02eb-486e-89e1-63be7c5e959c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:26.368683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b81ac-02eb-486e-89e1-63be7c5e959c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:26.374978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b81ac-02eb-486e-89e1-63be7c5e959c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:26.377247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b81ac-02eb-486e-89e1-63be7c5e959c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:26.453918 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1460/2928] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:25:26 2022] POST /identity/v3/projects => generated 403 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:26.454329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af700298-9975-4bf1-ba01-679801fa70e6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:26.476912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af700298-9975-4bf1-ba01-679801fa70e6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:26.655534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eba4ba-8be2-4223-a75d-a93906df6c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:26.656901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eba4ba-8be2-4223-a75d-a93906df6c8a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:26.657189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eba4ba-8be2-4223-a75d-a93906df6c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:26.657468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eba4ba-8be2-4223-a75d-a93906df6c8a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:26.658133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eba4ba-8be2-4223-a75d-a93906df6c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:26.660788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eba4ba-8be2-4223-a75d-a93906df6c8a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:26.700762 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1469/2929] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:25:26 2022] POST /identity/v3/users => generated 302 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:26.705159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b81ac-02eb-486e-89e1-63be7c5e959c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:26.721207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b81ac-02eb-486e-89e1-63be7c5e959c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:26.732528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ceb98-7b82-4101-860a-d8a5bdeb158f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:26.739092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ceb98-7b82-4101-860a-d8a5bdeb158f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:26.739436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ceb98-7b82-4101-860a-d8a5bdeb158f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:26.739815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ceb98-7b82-4101-860a-d8a5bdeb158f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:26.741084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ceb98-7b82-4101-860a-d8a5bdeb158f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:26.743122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ceb98-7b82-4101-860a-d8a5bdeb158f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:26.776339 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1461/2930] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:26.778224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eba4ba-8be2-4223-a75d-a93906df6c8a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:26.796507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eba4ba-8be2-4223-a75d-a93906df6c8a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:26.817773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c446e-acf9-4edb-b4cc-82ae305a92ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:26.818707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c446e-acf9-4edb-b4cc-82ae305a92ec admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:26.819587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c446e-acf9-4edb-b4cc-82ae305a92ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:26.820071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c446e-acf9-4edb-b4cc-82ae305a92ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:26.820958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c446e-acf9-4edb-b4cc-82ae305a92ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:26.823455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c446e-acf9-4edb-b4cc-82ae305a92ec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:26.856986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ceb98-7b82-4101-860a-d8a5bdeb158f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:26.858171 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1470/2931] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:26.890435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ceb98-7b82-4101-860a-d8a5bdeb158f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:26.910653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09dfbf-688d-402e-a463-51e14c09fef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:26.913941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09dfbf-688d-402e-a463-51e14c09fef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:26.914257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09dfbf-688d-402e-a463-51e14c09fef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:26.914633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09dfbf-688d-402e-a463-51e14c09fef3 admin admin] PATH_INFO: `/v3/projects/494e4f006ccd40b292c5b8e2dfe208d4/users/565df00b65684ab6b309fd0e9d3f5b9d/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:26.954274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09dfbf-688d-402e-a463-51e14c09fef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=494e4f006ccd40b292c5b8e2dfe208d4, user_id=565df00b65684ab6b309fd0e9d3f5b9d, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:26.958578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09dfbf-688d-402e-a463-51e14c09fef3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:27.042965 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1462/2932] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:26 2022] PUT /identity/v3/projects/494e4f006ccd40b292c5b8e2dfe208d4/users/565df00b65684ab6b309fd0e9d3f5b9d/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:27.060362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8d870-b015-4782-8c6b-0b0cb87a2ebd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:27.060644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8d870-b015-4782-8c6b-0b0cb87a2ebd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:27.061980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8d870-b015-4782-8c6b-0b0cb87a2ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:27.144005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-97e8d870-b015-4782-8c6b-0b0cb87a2ebd None None] MFA Rules not processed for user `565df00b65684ab6b309fd0e9d3f5b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:27.148100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97e8d870-b015-4782-8c6b-0b0cb87a2ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:27.434437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef350b0b-910f-4d48-bed1-fb7d42ee5e21 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:27.434969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef350b0b-910f-4d48-bed1-fb7d42ee5e21 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:27.435325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef350b0b-910f-4d48-bed1-fb7d42ee5e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:27.441527 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1471/2933] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:27 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:27.442522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8d870-b015-4782-8c6b-0b0cb87a2ebd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:27.556118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ef350b0b-910f-4d48-bed1-fb7d42ee5e21 None None] MFA Rules not processed for user `d60e254814924b44843a420ca3ba21c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:27.560810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ef350b0b-910f-4d48-bed1-fb7d42ee5e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:27.665870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:27.747230 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1463/2934] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:25:27.832599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8d870-b015-4782-8c6b-0b0cb87a2ebd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:27.851960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc1663-a605-4273-8492-b8367491c43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:27.863924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc1663-a605-4273-8492-b8367491c43b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:27.867048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc1663-a605-4273-8492-b8367491c43b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:27.867048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc1663-a605-4273-8492-b8367491c43b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:27.867048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc1663-a605-4273-8492-b8367491c43b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:27.868523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc1663-a605-4273-8492-b8367491c43b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:27.964930 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1472/2935] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:25:27 2022] POST /identity/v3/projects => generated 399 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:27.965641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef350b0b-910f-4d48-bed1-fb7d42ee5e21 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:28.025789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef350b0b-910f-4d48-bed1-fb7d42ee5e21 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:28.329321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf4be2-b209-4311-90dc-36019ba22d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:28.331426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf4be2-b209-4311-90dc-36019ba22d82 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:28.332474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf4be2-b209-4311-90dc-36019ba22d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:28.332756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf4be2-b209-4311-90dc-36019ba22d82 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:28.333419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf4be2-b209-4311-90dc-36019ba22d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:28.341341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf4be2-b209-4311-90dc-36019ba22d82 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:28.390222 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1464/2936] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:25:27 2022] POST /identity/v3/users => generated 306 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:28.394699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc1663-a605-4273-8492-b8367491c43b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:28.424179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc1663-a605-4273-8492-b8367491c43b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:28.442928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d63c5-5d20-446c-9698-cdd0e36f0a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:28.443899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d63c5-5d20-446c-9698-cdd0e36f0a05 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:28.444382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d63c5-5d20-446c-9698-cdd0e36f0a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:28.444817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d63c5-5d20-446c-9698-cdd0e36f0a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:28.445650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d63c5-5d20-446c-9698-cdd0e36f0a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:28.452027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d63c5-5d20-446c-9698-cdd0e36f0a05 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:28.500210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf4be2-b209-4311-90dc-36019ba22d82 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:28.500802 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1473/2937] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:28.520566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf4be2-b209-4311-90dc-36019ba22d82 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:28.552702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58631ba-ccfa-4aec-8596-e541c015f31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:28.554860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58631ba-ccfa-4aec-8596-e541c015f31c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:28.555145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58631ba-ccfa-4aec-8596-e541c015f31c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:28.556612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58631ba-ccfa-4aec-8596-e541c015f31c admin admin] PATH_INFO: `/v3/projects/f279b593f49b4bc5b80a04fe58a3e50e/users/82537f8f472c4502859acd5bfa696ca1/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:28.602665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58631ba-ccfa-4aec-8596-e541c015f31c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f279b593f49b4bc5b80a04fe58a3e50e, user_id=82537f8f472c4502859acd5bfa696ca1, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:28.605728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58631ba-ccfa-4aec-8596-e541c015f31c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:28.636262 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1465/2938] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:28 2022] PUT /identity/v3/projects/f279b593f49b4bc5b80a04fe58a3e50e/users/82537f8f472c4502859acd5bfa696ca1/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:28.640653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d63c5-5d20-446c-9698-cdd0e36f0a05 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:28.655638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d63c5-5d20-446c-9698-cdd0e36f0a05 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:28.785970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c08fc2-084d-4cbb-8d49-d1ebd77fedeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:28.786835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c08fc2-084d-4cbb-8d49-d1ebd77fedeb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:28.787172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c08fc2-084d-4cbb-8d49-d1ebd77fedeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:28.787555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c08fc2-084d-4cbb-8d49-d1ebd77fedeb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:28.788421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c08fc2-084d-4cbb-8d49-d1ebd77fedeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:28.790695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c08fc2-084d-4cbb-8d49-d1ebd77fedeb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:28.807222 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1474/2939] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:28.810898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58631ba-ccfa-4aec-8596-e541c015f31c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:28.838560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58631ba-ccfa-4aec-8596-e541c015f31c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:28.877504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d308aa-fa28-4ce0-abd3-52a2c07cddb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:28.878451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d308aa-fa28-4ce0-abd3-52a2c07cddb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:28.881991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d308aa-fa28-4ce0-abd3-52a2c07cddb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:28.882519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d308aa-fa28-4ce0-abd3-52a2c07cddb0 admin admin] PATH_INFO: `/v3/projects/f279b593f49b4bc5b80a04fe58a3e50e/users/82537f8f472c4502859acd5bfa696ca1/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:28.890255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d308aa-fa28-4ce0-abd3-52a2c07cddb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f279b593f49b4bc5b80a04fe58a3e50e, user_id=82537f8f472c4502859acd5bfa696ca1, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:28.899690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d308aa-fa28-4ce0-abd3-52a2c07cddb0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:28.919916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:28.933387 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1466/2940] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:28 2022] PUT /identity/v3/projects/f279b593f49b4bc5b80a04fe58a3e50e/users/82537f8f472c4502859acd5bfa696ca1/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:28.945076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1b49c-d9c0-4739-a5d3-ee48dde5a748 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:28.947305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1b49c-d9c0-4739-a5d3-ee48dde5a748 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:28.947602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1b49c-d9c0-4739-a5d3-ee48dde5a748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:29.032363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bbb1b49c-d9c0-4739-a5d3-ee48dde5a748 None None] MFA Rules not processed for user `82537f8f472c4502859acd5bfa696ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:29.037890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bbb1b49c-d9c0-4739-a5d3-ee48dde5a748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:29.427708 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1475/2941] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:28 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:29.455980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d308aa-fa28-4ce0-abd3-52a2c07cddb0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:29.458728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f2d308aa-fa28-4ce0-abd3-52a2c07cddb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:29.732358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d308aa-fa28-4ce0-abd3-52a2c07cddb0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:29.749299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001cdfb-f0e4-4b36-a752-71194a3acc44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:29.750389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001cdfb-f0e4-4b36-a752-71194a3acc44 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:29.751690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001cdfb-f0e4-4b36-a752-71194a3acc44 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:29.752674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001cdfb-f0e4-4b36-a752-71194a3acc44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:29.789467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001cdfb-f0e4-4b36-a752-71194a3acc44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:29.794854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001cdfb-f0e4-4b36-a752-71194a3acc44 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:29.828279 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1467/2942] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:29 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:30.087246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1b49c-d9c0-4739-a5d3-ee48dde5a748 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:30.088803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bbb1b49c-d9c0-4739-a5d3-ee48dde5a748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:30.127102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1b49c-d9c0-4739-a5d3-ee48dde5a748 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:30.148283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64c64e-55be-41d5-9930-4346e2566246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:30.150973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64c64e-55be-41d5-9930-4346e2566246 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:30.151281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64c64e-55be-41d5-9930-4346e2566246 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:30.152578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64c64e-55be-41d5-9930-4346e2566246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:30.198984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:30.282668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64c64e-55be-41d5-9930-4346e2566246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:30.284792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64c64e-55be-41d5-9930-4346e2566246 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:30.299007 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1476/2943] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:30 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:31.575394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001cdfb-f0e4-4b36-a752-71194a3acc44 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:31.773575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001cdfb-f0e4-4b36-a752-71194a3acc44 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:31.781981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22fa15-abcf-4d82-80f9-08456d61da53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:31.782818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22fa15-abcf-4d82-80f9-08456d61da53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:31.783273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22fa15-abcf-4d82-80f9-08456d61da53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:31.783738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22fa15-abcf-4d82-80f9-08456d61da53 admin admin] PATH_INFO: `/v3/users/565df00b65684ab6b309fd0e9d3f5b9d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:31.792775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22fa15-abcf-4d82-80f9-08456d61da53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=565df00b65684ab6b309fd0e9d3f5b9d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:31.795397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22fa15-abcf-4d82-80f9-08456d61da53 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:31.995392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db22fa15-abcf-4d82-80f9-08456d61da53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565df00b65684ab6b309fd0e9d3f5b9d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:32.018454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db22fa15-abcf-4d82-80f9-08456d61da53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565df00b65684ab6b309fd0e9d3f5b9d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:32.019522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db22fa15-abcf-4d82-80f9-08456d61da53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565df00b65684ab6b309fd0e9d3f5b9d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:32.022314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db22fa15-abcf-4d82-80f9-08456d61da53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565df00b65684ab6b309fd0e9d3f5b9d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:32.057941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db22fa15-abcf-4d82-80f9-08456d61da53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565df00b65684ab6b309fd0e9d3f5b9d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:32.095864 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1468/2944] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:25:31 2022] DELETE /identity/v3/users/565df00b65684ab6b309fd0e9d3f5b9d => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:32.097523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ab10-d55f-41db-81e6-19b93e7158e9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:32.098032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ab10-d55f-41db-81e6-19b93e7158e9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:32.098297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ab10-d55f-41db-81e6-19b93e7158e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:32.143043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ffa3ab10-d55f-41db-81e6-19b93e7158e9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:32.144256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ffa3ab10-d55f-41db-81e6-19b93e7158e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:32.356098 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1477/2945] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:25:32.376950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22fa15-abcf-4d82-80f9-08456d61da53 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:32.379836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db22fa15-abcf-4d82-80f9-08456d61da53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:32.393540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:32.484314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22fa15-abcf-4d82-80f9-08456d61da53 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:32.494122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2a5a3-e60d-4c97-aecc-27bf2d96d3de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:32.495791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2a5a3-e60d-4c97-aecc-27bf2d96d3de service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:32.496391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2a5a3-e60d-4c97-aecc-27bf2d96d3de service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:32.496894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2a5a3-e60d-4c97-aecc-27bf2d96d3de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:32.510144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2a5a3-e60d-4c97-aecc-27bf2d96d3de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:32.512595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2a5a3-e60d-4c97-aecc-27bf2d96d3de service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:32.534387 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1469/2946] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:35.154363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3ab10-d55f-41db-81e6-19b93e7158e9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:35.155882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ffa3ab10-d55f-41db-81e6-19b93e7158e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:35.183691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3ab10-d55f-41db-81e6-19b93e7158e9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:35.207191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c33a3-e926-42e5-8429-68beb8ee2c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:35.207893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c33a3-e926-42e5-8429-68beb8ee2c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:35.208179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c33a3-e926-42e5-8429-68beb8ee2c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:35.208458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c33a3-e926-42e5-8429-68beb8ee2c81 admin admin] PATH_INFO: `/v3/projects/494e4f006ccd40b292c5b8e2dfe208d4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:35.217605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c33a3-e926-42e5-8429-68beb8ee2c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=494e4f006ccd40b292c5b8e2dfe208d4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:35.229458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c33a3-e926-42e5-8429-68beb8ee2c81 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:35.417872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-da3c33a3-e926-42e5-8429-68beb8ee2c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494e4f006ccd40b292c5b8e2dfe208d4', 'request_id': 'req-da3c33a3-e926-42e5-8429-68beb8ee2c81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:35.438457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-da3c33a3-e926-42e5-8429-68beb8ee2c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494e4f006ccd40b292c5b8e2dfe208d4', 'request_id': 'req-da3c33a3-e926-42e5-8429-68beb8ee2c81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:35.452871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-da3c33a3-e926-42e5-8429-68beb8ee2c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494e4f006ccd40b292c5b8e2dfe208d4', 'request_id': 'req-da3c33a3-e926-42e5-8429-68beb8ee2c81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:35.490730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-da3c33a3-e926-42e5-8429-68beb8ee2c81 admin admin] The token cache is being invalidate because project 494e4f006ccd40b292c5b8e2dfe208d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:25:35.491363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-da3c33a3-e926-42e5-8429-68beb8ee2c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:35.499125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-da3c33a3-e926-42e5-8429-68beb8ee2c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:35.503889 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1478/2947] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:25:35 2022] DELETE /identity/v3/projects/494e4f006ccd40b292c5b8e2dfe208d4 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:35.515097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2a5a3-e60d-4c97-aecc-27bf2d96d3de service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:35.543881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2a5a3-e60d-4c97-aecc-27bf2d96d3de service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:35.738267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e26ba-7561-4f49-aa9f-74df66677b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:35.738966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e26ba-7561-4f49-aa9f-74df66677b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:35.739322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e26ba-7561-4f49-aa9f-74df66677b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:35.741199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e26ba-7561-4f49-aa9f-74df66677b0b admin admin] PATH_INFO: `/v3/users/82537f8f472c4502859acd5bfa696ca1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:35.743016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e26ba-7561-4f49-aa9f-74df66677b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=82537f8f472c4502859acd5bfa696ca1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:35.744996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e26ba-7561-4f49-aa9f-74df66677b0b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:35.867553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-482e26ba-7561-4f49-aa9f-74df66677b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82537f8f472c4502859acd5bfa696ca1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:35.913830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-482e26ba-7561-4f49-aa9f-74df66677b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82537f8f472c4502859acd5bfa696ca1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:35.916665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-482e26ba-7561-4f49-aa9f-74df66677b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82537f8f472c4502859acd5bfa696ca1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:35.918017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-482e26ba-7561-4f49-aa9f-74df66677b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82537f8f472c4502859acd5bfa696ca1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:35.958165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-482e26ba-7561-4f49-aa9f-74df66677b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82537f8f472c4502859acd5bfa696ca1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:36.014509 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1470/2948] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:25:35 2022] DELETE /identity/v3/users/82537f8f472c4502859acd5bfa696ca1 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:37.063354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c33a3-e926-42e5-8429-68beb8ee2c81 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:37.065155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-da3c33a3-e926-42e5-8429-68beb8ee2c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:37.091596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c33a3-e926-42e5-8429-68beb8ee2c81 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:37.280034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:37.322548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e6951-53c1-4cc3-af82-dbd1abd965c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:37.323999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e6951-53c1-4cc3-af82-dbd1abd965c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:37.324285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e6951-53c1-4cc3-af82-dbd1abd965c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:37.324566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e6951-53c1-4cc3-af82-dbd1abd965c8 admin admin] PATH_INFO: `/v3/projects/f279b593f49b4bc5b80a04fe58a3e50e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:37.331201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e6951-53c1-4cc3-af82-dbd1abd965c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f279b593f49b4bc5b80a04fe58a3e50e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:37.341499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e6951-53c1-4cc3-af82-dbd1abd965c8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:37.444823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-039e6951-53c1-4cc3-af82-dbd1abd965c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f279b593f49b4bc5b80a04fe58a3e50e', 'request_id': 'req-039e6951-53c1-4cc3-af82-dbd1abd965c8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:37.459307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-039e6951-53c1-4cc3-af82-dbd1abd965c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f279b593f49b4bc5b80a04fe58a3e50e', 'request_id': 'req-039e6951-53c1-4cc3-af82-dbd1abd965c8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:37.469194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-039e6951-53c1-4cc3-af82-dbd1abd965c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f279b593f49b4bc5b80a04fe58a3e50e', 'request_id': 'req-039e6951-53c1-4cc3-af82-dbd1abd965c8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:37.520381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-039e6951-53c1-4cc3-af82-dbd1abd965c8 admin admin] The token cache is being invalidate because project f279b593f49b4bc5b80a04fe58a3e50e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:25:37.521829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-039e6951-53c1-4cc3-af82-dbd1abd965c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:37.525278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-039e6951-53c1-4cc3-af82-dbd1abd965c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:37.536213 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1479/2949] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:25:37 2022] DELETE /identity/v3/projects/f279b593f49b4bc5b80a04fe58a3e50e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:37.541155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17240a6-b802-4e9f-958e-504d80fbf777 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:37.541671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17240a6-b802-4e9f-958e-504d80fbf777 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:37.541810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17240a6-b802-4e9f-958e-504d80fbf777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:37.602236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c17240a6-b802-4e9f-958e-504d80fbf777 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:37.610583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c17240a6-b802-4e9f-958e-504d80fbf777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:37.719498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:37.833269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d51f7-70a4-4ab0-8307-a599d6c42104 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:37.834681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d51f7-70a4-4ab0-8307-a599d6c42104 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:37.835473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d51f7-70a4-4ab0-8307-a599d6c42104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:37.900982 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1471/2950] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:37.901779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-222d51f7-70a4-4ab0-8307-a599d6c42104 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:37.903042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f6207-7c62-409c-9ac8-85c11c1ffae9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:37.903632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f6207-7c62-409c-9ac8-85c11c1ffae9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:37.904080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f6207-7c62-409c-9ac8-85c11c1ffae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:37.905303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-222d51f7-70a4-4ab0-8307-a599d6c42104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:37.968783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b68f6207-7c62-409c-9ac8-85c11c1ffae9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:37.970720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b68f6207-7c62-409c-9ac8-85c11c1ffae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:37.994867 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1472/2951] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:38.007311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f6207-7c62-409c-9ac8-85c11c1ffae9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:38.028054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f6207-7c62-409c-9ac8-85c11c1ffae9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:38.036756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b30d1b-c7e8-4428-9745-fcab454e1d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:38.038152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b30d1b-c7e8-4428-9745-fcab454e1d08 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:38.038441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b30d1b-c7e8-4428-9745-fcab454e1d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:38.038715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b30d1b-c7e8-4428-9745-fcab454e1d08 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:38.040937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b30d1b-c7e8-4428-9745-fcab454e1d08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:25:38.041259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b30d1b-c7e8-4428-9745-fcab454e1d08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:38.043755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b30d1b-c7e8-4428-9745-fcab454e1d08 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:38.060401 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1480/2952] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:25:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:38.066828 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1473/2953] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:25:38.071192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d51f7-70a4-4ab0-8307-a599d6c42104 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:38.073348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b30d1b-c7e8-4428-9745-fcab454e1d08 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:38.076568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-87b30d1b-c7e8-4428-9745-fcab454e1d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:38.096780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d51f7-70a4-4ab0-8307-a599d6c42104 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:38.105144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907fe5e-0189-4b9a-9643-9d5c45e62f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:38.106279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907fe5e-0189-4b9a-9643-9d5c45e62f21 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:38.106714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907fe5e-0189-4b9a-9643-9d5c45e62f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:38.107162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907fe5e-0189-4b9a-9643-9d5c45e62f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:38.107995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907fe5e-0189-4b9a-9643-9d5c45e62f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:38.117246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907fe5e-0189-4b9a-9643-9d5c45e62f21 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:38.204583 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1481/2954] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:25:38 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:38.207190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907fe5e-0189-4b9a-9643-9d5c45e62f21 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:38.257597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b30d1b-c7e8-4428-9745-fcab454e1d08 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:38.364258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:38.368792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907fe5e-0189-4b9a-9643-9d5c45e62f21 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:38.383123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4fcf37-5938-410d-a6a9-e1e7f089aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:38.383797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fcf37-5938-410d-a6a9-e1e7f089aacd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:38.384075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fcf37-5938-410d-a6a9-e1e7f089aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:38.384381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fcf37-5938-410d-a6a9-e1e7f089aacd admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:38.384992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4fcf37-5938-410d-a6a9-e1e7f089aacd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:38.387321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4fcf37-5938-410d-a6a9-e1e7f089aacd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:38.431547 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1482/2955] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:25:38 2022] POST /identity/v3/users => generated 288 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:38.432932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4fcf37-5938-410d-a6a9-e1e7f089aacd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:38.455587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4fcf37-5938-410d-a6a9-e1e7f089aacd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:38.467664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dd0de-e1f8-4667-bae9-ff1ad0875290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:38.468607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dd0de-e1f8-4667-bae9-ff1ad0875290 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:38.468902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dd0de-e1f8-4667-bae9-ff1ad0875290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:38.469619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dd0de-e1f8-4667-bae9-ff1ad0875290 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:38.469808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dd0de-e1f8-4667-bae9-ff1ad0875290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:38.472282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dd0de-e1f8-4667-bae9-ff1ad0875290 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:38.495406 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1483/2956] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:38.496611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dd0de-e1f8-4667-bae9-ff1ad0875290 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:38.504127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961efe63-06fe-4649-8e6c-8dba0be85b8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:38.505191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961efe63-06fe-4649-8e6c-8dba0be85b8d service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:38.506880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961efe63-06fe-4649-8e6c-8dba0be85b8d service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:38.511714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961efe63-06fe-4649-8e6c-8dba0be85b8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:38.522231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dd0de-e1f8-4667-bae9-ff1ad0875290 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:38.548011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1952c8-2dd9-429b-9378-0163b99e55ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:38.548769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1952c8-2dd9-429b-9378-0163b99e55ab admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:38.548931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1952c8-2dd9-429b-9378-0163b99e55ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:38.549537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1952c8-2dd9-429b-9378-0163b99e55ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:38.550289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1952c8-2dd9-429b-9378-0163b99e55ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:38.554112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1952c8-2dd9-429b-9378-0163b99e55ab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:38.585046 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1484/2957] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:25:38.587552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1952c8-2dd9-429b-9378-0163b99e55ab admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:38.618072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1952c8-2dd9-429b-9378-0163b99e55ab admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:38.634752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e29df0-aa2b-4b56-b6fd-0741fe020dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:38.636075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e29df0-aa2b-4b56-b6fd-0741fe020dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:38.636542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e29df0-aa2b-4b56-b6fd-0741fe020dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:38.637110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e29df0-aa2b-4b56-b6fd-0741fe020dc9 admin admin] PATH_INFO: `/v3/projects/a5b98b462c70469d9e953e56c9296e1e/users/54fb0b7e451040da9879d106b73bf907/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:38.693620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e29df0-aa2b-4b56-b6fd-0741fe020dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b98b462c70469d9e953e56c9296e1e, user_id=54fb0b7e451040da9879d106b73bf907, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:38.696487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e29df0-aa2b-4b56-b6fd-0741fe020dc9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:38.702781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:38.725215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961efe63-06fe-4649-8e6c-8dba0be85b8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:38.727921 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1485/2958] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:38 2022] PUT /identity/v3/projects/a5b98b462c70469d9e953e56c9296e1e/users/54fb0b7e451040da9879d106b73bf907/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:38.738193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d643b24-3f43-4f39-8cc5-77d62c62e0d1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:38.738476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d643b24-3f43-4f39-8cc5-77d62c62e0d1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:38.738756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d643b24-3f43-4f39-8cc5-77d62c62e0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:38.739622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961efe63-06fe-4649-8e6c-8dba0be85b8d service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:38.773157 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1474/2959] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:25:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 18:25:38.805121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1d643b24-3f43-4f39-8cc5-77d62c62e0d1 None None] MFA Rules not processed for user `54fb0b7e451040da9879d106b73bf907`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:38.806385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d643b24-3f43-4f39-8cc5-77d62c62e0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:38.952510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961efe63-06fe-4649-8e6c-8dba0be85b8d service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:38.953018 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1486/2960] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:25:38.988429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961efe63-06fe-4649-8e6c-8dba0be85b8d service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:39.164389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf934e45-1729-4b3a-87fc-ffced8b95bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:39.165157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf934e45-1729-4b3a-87fc-ffced8b95bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:39.166231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf934e45-1729-4b3a-87fc-ffced8b95bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:39.166615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf934e45-1729-4b3a-87fc-ffced8b95bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:39.167740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf934e45-1729-4b3a-87fc-ffced8b95bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:39.170137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf934e45-1729-4b3a-87fc-ffced8b95bd6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:39.235353 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1475/2961] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:25:38 2022] POST /identity/v3/projects => generated 373 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:39.238841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d643b24-3f43-4f39-8cc5-77d62c62e0d1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:39.267597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d643b24-3f43-4f39-8cc5-77d62c62e0d1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:39.400092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf68343-e3eb-450a-95ad-d1f6f6484371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:39.401932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf68343-e3eb-450a-95ad-d1f6f6484371 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:39.402453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf68343-e3eb-450a-95ad-d1f6f6484371 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:39.403543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf68343-e3eb-450a-95ad-d1f6f6484371 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:39.404932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf68343-e3eb-450a-95ad-d1f6f6484371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:39.411890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf68343-e3eb-450a-95ad-d1f6f6484371 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:39.450767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880651ff-5b00-43de-9665-57564a310607 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:39.451465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880651ff-5b00-43de-9665-57564a310607 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:39.451978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880651ff-5b00-43de-9665-57564a310607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:39.465212 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1487/2962] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:25:39 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:39.468973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf68343-e3eb-450a-95ad-d1f6f6484371 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:39.480009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-880651ff-5b00-43de-9665-57564a310607 None None] MFA Rules not processed for user `bc2c3257ad8a48c6adbfef6617e379d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:39.484116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-880651ff-5b00-43de-9665-57564a310607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:39.489374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf68343-e3eb-450a-95ad-d1f6f6484371 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:39.536406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04119c8f-a4c6-4a3f-a80f-4e28a7d996c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:39.537503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04119c8f-a4c6-4a3f-a80f-4e28a7d996c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:39.537969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04119c8f-a4c6-4a3f-a80f-4e28a7d996c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:39.538414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04119c8f-a4c6-4a3f-a80f-4e28a7d996c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:39.539245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04119c8f-a4c6-4a3f-a80f-4e28a7d996c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:39.544424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04119c8f-a4c6-4a3f-a80f-4e28a7d996c7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:39.578450 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1488/2963] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:25:39.579457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04119c8f-a4c6-4a3f-a80f-4e28a7d996c7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:39.619045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04119c8f-a4c6-4a3f-a80f-4e28a7d996c7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:39.635158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592650f0-62be-40f0-a3ca-382a3529b7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:39.637713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592650f0-62be-40f0-a3ca-382a3529b7d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:39.639987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592650f0-62be-40f0-a3ca-382a3529b7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:39.640768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592650f0-62be-40f0-a3ca-382a3529b7d0 admin admin] PATH_INFO: `/v3/projects/b547cd1ee24e426d98b296161be7602c/users/3fa26f18f406414b94f45537cd1067c9/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:39.652706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:39.682623 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1476/2964] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:39.694137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592650f0-62be-40f0-a3ca-382a3529b7d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b547cd1ee24e426d98b296161be7602c, user_id=3fa26f18f406414b94f45537cd1067c9, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:39.700323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592650f0-62be-40f0-a3ca-382a3529b7d0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:39.728196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880651ff-5b00-43de-9665-57564a310607 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:39.729871 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1489/2965] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:39 2022] PUT /identity/v3/projects/b547cd1ee24e426d98b296161be7602c/users/3fa26f18f406414b94f45537cd1067c9/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:39.744774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880651ff-5b00-43de-9665-57564a310607 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:39.901264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cb471-7b2e-43a2-807a-8697dc76a6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:39.901939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cb471-7b2e-43a2-807a-8697dc76a6bd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:39.902795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cb471-7b2e-43a2-807a-8697dc76a6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:39.903080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cb471-7b2e-43a2-807a-8697dc76a6bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:39.903800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cb471-7b2e-43a2-807a-8697dc76a6bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:39.905414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cb471-7b2e-43a2-807a-8697dc76a6bd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:39.919918 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1477/2966] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:25:39.923906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592650f0-62be-40f0-a3ca-382a3529b7d0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:39.939385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592650f0-62be-40f0-a3ca-382a3529b7d0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:39.946754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db429a-3874-4167-afad-795192e322b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:39.947847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db429a-3874-4167-afad-795192e322b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:39.948311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db429a-3874-4167-afad-795192e322b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:39.948744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db429a-3874-4167-afad-795192e322b9 admin admin] PATH_INFO: `/v3/projects/b547cd1ee24e426d98b296161be7602c/users/3fa26f18f406414b94f45537cd1067c9/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:39.951144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db429a-3874-4167-afad-795192e322b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b547cd1ee24e426d98b296161be7602c, user_id=3fa26f18f406414b94f45537cd1067c9, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:39.955407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db429a-3874-4167-afad-795192e322b9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:39.970641 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1490/2967] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:39 2022] PUT /identity/v3/projects/b547cd1ee24e426d98b296161be7602c/users/3fa26f18f406414b94f45537cd1067c9/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:39.981239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370f2f9-23d4-4d0e-b3c9-7f09b63b4b96 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:39.981550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370f2f9-23d4-4d0e-b3c9-7f09b63b4b96 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:39.981805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370f2f9-23d4-4d0e-b3c9-7f09b63b4b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:40.021900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8370f2f9-23d4-4d0e-b3c9-7f09b63b4b96 None None] MFA Rules not processed for user `3fa26f18f406414b94f45537cd1067c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:40.023478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8370f2f9-23d4-4d0e-b3c9-7f09b63b4b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:40.029973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:40.117939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db429a-3874-4167-afad-795192e322b9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:40.120292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-02db429a-3874-4167-afad-795192e322b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:40.179532 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1478/2968] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:40.195284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370f2f9-23d4-4d0e-b3c9-7f09b63b4b96 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:40.197104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8370f2f9-23d4-4d0e-b3c9-7f09b63b4b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:40.236680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db429a-3874-4167-afad-795192e322b9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:40.243867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a617d7d-ff1d-4bba-8c4b-c4998cc86dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:40.244592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a617d7d-ff1d-4bba-8c4b-c4998cc86dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:40.244948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a617d7d-ff1d-4bba-8c4b-c4998cc86dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:40.245272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a617d7d-ff1d-4bba-8c4b-c4998cc86dc7 admin admin] PATH_INFO: `/v3/users/d14d1e556e644fcdbab72647f2c47960` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:40.253716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a617d7d-ff1d-4bba-8c4b-c4998cc86dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14d1e556e644fcdbab72647f2c47960)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:40.256110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a617d7d-ff1d-4bba-8c4b-c4998cc86dc7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:40.338002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370f2f9-23d4-4d0e-b3c9-7f09b63b4b96 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:40.351188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71455c-53db-4789-9598-6dd386033f58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:40.351817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a617d7d-ff1d-4bba-8c4b-c4998cc86dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14d1e556e644fcdbab72647f2c47960'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:40.352201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71455c-53db-4789-9598-6dd386033f58 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:40.353088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a617d7d-ff1d-4bba-8c4b-c4998cc86dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14d1e556e644fcdbab72647f2c47960'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:40.353320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71455c-53db-4789-9598-6dd386033f58 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:40.354452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71455c-53db-4789-9598-6dd386033f58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:40.369374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a617d7d-ff1d-4bba-8c4b-c4998cc86dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14d1e556e644fcdbab72647f2c47960'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:40.370716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5f71455c-53db-4789-9598-6dd386033f58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:40.386663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a617d7d-ff1d-4bba-8c4b-c4998cc86dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14d1e556e644fcdbab72647f2c47960'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:40.412097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71455c-53db-4789-9598-6dd386033f58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:40.415615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71455c-53db-4789-9598-6dd386033f58 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:40.418035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a617d7d-ff1d-4bba-8c4b-c4998cc86dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14d1e556e644fcdbab72647f2c47960'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:40.429359 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1491/2969] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:25:40 2022] DELETE /identity/v3/users/d14d1e556e644fcdbab72647f2c47960 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:25:40.440834 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1479/2970] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:25:40.522894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a617d7d-ff1d-4bba-8c4b-c4998cc86dc7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:40.529913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a617d7d-ff1d-4bba-8c4b-c4998cc86dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:40.668617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:40.705491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a617d7d-ff1d-4bba-8c4b-c4998cc86dc7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:40.715535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299f648-2765-4b80-9184-d3d2beb2e99e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:40.716382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299f648-2765-4b80-9184-d3d2beb2e99e service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:40.716762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299f648-2765-4b80-9184-d3d2beb2e99e service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:40.717202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299f648-2765-4b80-9184-d3d2beb2e99e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:40.719554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e299f648-2765-4b80-9184-d3d2beb2e99e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:40.806339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71455c-53db-4789-9598-6dd386033f58 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:40.809408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5f71455c-53db-4789-9598-6dd386033f58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:40.825881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299f648-2765-4b80-9184-d3d2beb2e99e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:40.828055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299f648-2765-4b80-9184-d3d2beb2e99e service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:40.832549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71455c-53db-4789-9598-6dd386033f58 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:40.850402 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1492/2971] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:40.917750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa705c6-c155-43b9-aacc-c50d8155dad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:40.918497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa705c6-c155-43b9-aacc-c50d8155dad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:40.918905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa705c6-c155-43b9-aacc-c50d8155dad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:40.919281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa705c6-c155-43b9-aacc-c50d8155dad5 admin admin] PATH_INFO: `/v3/projects/b35bbd921788425798539693ff54ebab` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:40.920941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa705c6-c155-43b9-aacc-c50d8155dad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b35bbd921788425798539693ff54ebab)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:40.947408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa705c6-c155-43b9-aacc-c50d8155dad5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:41.024648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:41.051080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0fa705c6-c155-43b9-aacc-c50d8155dad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b35bbd921788425798539693ff54ebab', 'request_id': 'req-0fa705c6-c155-43b9-aacc-c50d8155dad5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:41.062607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0fa705c6-c155-43b9-aacc-c50d8155dad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b35bbd921788425798539693ff54ebab', 'request_id': 'req-0fa705c6-c155-43b9-aacc-c50d8155dad5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:41.079060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0fa705c6-c155-43b9-aacc-c50d8155dad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b35bbd921788425798539693ff54ebab', 'request_id': 'req-0fa705c6-c155-43b9-aacc-c50d8155dad5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:41.122041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0fa705c6-c155-43b9-aacc-c50d8155dad5 admin admin] The token cache is being invalidate because project b35bbd921788425798539693ff54ebab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:25:41.123230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0fa705c6-c155-43b9-aacc-c50d8155dad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:41.126472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0fa705c6-c155-43b9-aacc-c50d8155dad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:41.129663 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1480/2972] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:25:40 2022] DELETE /identity/v3/projects/b35bbd921788425798539693ff54ebab => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:41.137499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959bf99-4a3f-49b5-8809-129538b482b9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:41.137804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959bf99-4a3f-49b5-8809-129538b482b9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:41.138085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959bf99-4a3f-49b5-8809-129538b482b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:41.194880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8959bf99-4a3f-49b5-8809-129538b482b9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:41.208454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8959bf99-4a3f-49b5-8809-129538b482b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:41.304800 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1493/2973] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:41.311992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1aaed-63c6-40a2-ae06-ff11487478c2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:41.312533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1aaed-63c6-40a2-ae06-ff11487478c2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:41.312979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1aaed-63c6-40a2-ae06-ff11487478c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:41.362396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f4e1aaed-63c6-40a2-ae06-ff11487478c2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:41.365575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f4e1aaed-63c6-40a2-ae06-ff11487478c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:41.375536 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1481/2974] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:41.379852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959bf99-4a3f-49b5-8809-129538b482b9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:41.390924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959bf99-4a3f-49b5-8809-129538b482b9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:41.397924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a2d02-624f-4d8b-af93-5517e271179b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:41.399216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a2d02-624f-4d8b-af93-5517e271179b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:41.399713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a2d02-624f-4d8b-af93-5517e271179b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:41.400199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a2d02-624f-4d8b-af93-5517e271179b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:41.401144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a2d02-624f-4d8b-af93-5517e271179b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:25:41.401634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a2d02-624f-4d8b-af93-5517e271179b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:41.403545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a2d02-624f-4d8b-af93-5517e271179b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:41.420648 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1494/2975] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:25:41.424676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1aaed-63c6-40a2-ae06-ff11487478c2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:41.437077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1aaed-63c6-40a2-ae06-ff11487478c2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:41.442928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d08c6-d4b8-4043-a49a-f1d0057e17d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:41.444155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d08c6-d4b8-4043-a49a-f1d0057e17d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:41.444539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d08c6-d4b8-4043-a49a-f1d0057e17d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:41.444914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d08c6-d4b8-4043-a49a-f1d0057e17d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:41.445714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d08c6-d4b8-4043-a49a-f1d0057e17d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:41.447815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d08c6-d4b8-4043-a49a-f1d0057e17d9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:41.510348 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1482/2976] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:25:41 2022] POST /identity/v3/projects => generated 397 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:41.512958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a2d02-624f-4d8b-af93-5517e271179b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:41.527813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a2d02-624f-4d8b-af93-5517e271179b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:41.653944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe768a5-3ccb-40a7-8dd1-a50856b3ba04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:41.655992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe768a5-3ccb-40a7-8dd1-a50856b3ba04 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:41.657313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe768a5-3ccb-40a7-8dd1-a50856b3ba04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:41.657886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe768a5-3ccb-40a7-8dd1-a50856b3ba04 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:41.659890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe768a5-3ccb-40a7-8dd1-a50856b3ba04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:41.664042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe768a5-3ccb-40a7-8dd1-a50856b3ba04 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:41.707992 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1495/2977] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:25:41 2022] POST /identity/v3/users => generated 299 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:25:41.709524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d08c6-d4b8-4043-a49a-f1d0057e17d9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:41.725428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d08c6-d4b8-4043-a49a-f1d0057e17d9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:41.738734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d28ab-41d2-47bc-a912-273f9283c70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:41.739485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d28ab-41d2-47bc-a912-273f9283c70f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:41.740198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d28ab-41d2-47bc-a912-273f9283c70f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:41.740753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d28ab-41d2-47bc-a912-273f9283c70f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:41.741535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d28ab-41d2-47bc-a912-273f9283c70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:41.743448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d28ab-41d2-47bc-a912-273f9283c70f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:41.778654 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1483/2978] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:41.779869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe768a5-3ccb-40a7-8dd1-a50856b3ba04 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:41.786775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:41.793827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe768a5-3ccb-40a7-8dd1-a50856b3ba04 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:41.804797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe609e13-d5a4-4406-8df5-9f25934f9195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:41.805429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe609e13-d5a4-4406-8df5-9f25934f9195 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:41.805706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe609e13-d5a4-4406-8df5-9f25934f9195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:41.805980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe609e13-d5a4-4406-8df5-9f25934f9195 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:41.806628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe609e13-d5a4-4406-8df5-9f25934f9195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:41.808276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe609e13-d5a4-4406-8df5-9f25934f9195 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:41.846133 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1496/2979] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:41.847162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d28ab-41d2-47bc-a912-273f9283c70f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:41.863736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d28ab-41d2-47bc-a912-273f9283c70f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:41.876596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4f121-5cde-4a8c-a2ae-95d5a5e937ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:41.877434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4f121-5cde-4a8c-a2ae-95d5a5e937ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:41.877823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4f121-5cde-4a8c-a2ae-95d5a5e937ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:41.878193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4f121-5cde-4a8c-a2ae-95d5a5e937ab admin admin] PATH_INFO: `/v3/projects/c80f9ef9415647c494b81a39abbb95bf/users/2da56a6076bb474b957763142c6eec0a/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:41.917230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4f121-5cde-4a8c-a2ae-95d5a5e937ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c80f9ef9415647c494b81a39abbb95bf, user_id=2da56a6076bb474b957763142c6eec0a, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:41.921534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4f121-5cde-4a8c-a2ae-95d5a5e937ab admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:41.967439 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1484/2980] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:41 2022] PUT /identity/v3/projects/c80f9ef9415647c494b81a39abbb95bf/users/2da56a6076bb474b957763142c6eec0a/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:41.972667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f646a6-be84-4985-b217-a43765b5974b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:41.972965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f646a6-be84-4985-b217-a43765b5974b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:41.973278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f646a6-be84-4985-b217-a43765b5974b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:42.026137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-89f646a6-be84-4985-b217-a43765b5974b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:42.027457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89f646a6-be84-4985-b217-a43765b5974b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:42.179105 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1497/2981] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:42.193372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4f121-5cde-4a8c-a2ae-95d5a5e937ab admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:42.196054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d7e4f121-5cde-4a8c-a2ae-95d5a5e937ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:42.426836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4f121-5cde-4a8c-a2ae-95d5a5e937ab admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:42.445545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b6b8f-2fd8-4bfd-b9c9-0b75b0126565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:42.446535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b6b8f-2fd8-4bfd-b9c9-0b75b0126565 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:42.447001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b6b8f-2fd8-4bfd-b9c9-0b75b0126565 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:42.447621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b6b8f-2fd8-4bfd-b9c9-0b75b0126565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:42.494162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b6b8f-2fd8-4bfd-b9c9-0b75b0126565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:42.495690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b6b8f-2fd8-4bfd-b9c9-0b75b0126565 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:42.508453 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1485/2982] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:42.900018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f646a6-be84-4985-b217-a43765b5974b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:42.901485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89f646a6-be84-4985-b217-a43765b5974b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:42.914499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f646a6-be84-4985-b217-a43765b5974b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:42.920514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54540aa2-87f0-4f4d-8b6e-8e72bca35621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:42.921236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54540aa2-87f0-4f4d-8b6e-8e72bca35621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:42.921678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54540aa2-87f0-4f4d-8b6e-8e72bca35621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:42.922034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54540aa2-87f0-4f4d-8b6e-8e72bca35621 admin admin] PATH_INFO: `/v3/users/54fb0b7e451040da9879d106b73bf907` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:42.924932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54540aa2-87f0-4f4d-8b6e-8e72bca35621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54fb0b7e451040da9879d106b73bf907)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:42.926826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54540aa2-87f0-4f4d-8b6e-8e72bca35621 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:43.026096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-54540aa2-87f0-4f4d-8b6e-8e72bca35621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54fb0b7e451040da9879d106b73bf907'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:43.026922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-54540aa2-87f0-4f4d-8b6e-8e72bca35621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54fb0b7e451040da9879d106b73bf907'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:43.035596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-54540aa2-87f0-4f4d-8b6e-8e72bca35621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54fb0b7e451040da9879d106b73bf907'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:43.047218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-54540aa2-87f0-4f4d-8b6e-8e72bca35621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54fb0b7e451040da9879d106b73bf907'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:43.067519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-54540aa2-87f0-4f4d-8b6e-8e72bca35621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54fb0b7e451040da9879d106b73bf907'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:43.074856 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1498/2983] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:25:42 2022] DELETE /identity/v3/users/54fb0b7e451040da9879d106b73bf907 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:25:43.079188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c6099-b99e-4719-8c1c-24ed753e2f7f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:43.079724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c6099-b99e-4719-8c1c-24ed753e2f7f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:43.079846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c6099-b99e-4719-8c1c-24ed753e2f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:43.107507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-221c6099-b99e-4719-8c1c-24ed753e2f7f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:43.109194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-221c6099-b99e-4719-8c1c-24ed753e2f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:43.188103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:43.208751 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1486/2984] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:25:43.216581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54540aa2-87f0-4f4d-8b6e-8e72bca35621 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:43.220128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54540aa2-87f0-4f4d-8b6e-8e72bca35621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:43.350215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54540aa2-87f0-4f4d-8b6e-8e72bca35621 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:43.356090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855a001-c567-4737-8afe-f6172b0052be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:43.356786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855a001-c567-4737-8afe-f6172b0052be service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:43.357207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855a001-c567-4737-8afe-f6172b0052be service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:43.357481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855a001-c567-4737-8afe-f6172b0052be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:43.368779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855a001-c567-4737-8afe-f6172b0052be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:43.370270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855a001-c567-4737-8afe-f6172b0052be service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:43.381239 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1499/2985] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:44.041288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c6099-b99e-4719-8c1c-24ed753e2f7f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:44.042766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-221c6099-b99e-4719-8c1c-24ed753e2f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:44.067487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c6099-b99e-4719-8c1c-24ed753e2f7f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:44.074790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:44.075695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:44.076091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:44.076454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a admin admin] PATH_INFO: `/v3/projects/a5b98b462c70469d9e953e56c9296e1e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:44.077740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b98b462c70469d9e953e56c9296e1e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:44.079841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:44.156536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b98b462c70469d9e953e56c9296e1e', 'request_id': 'req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:44.168526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b98b462c70469d9e953e56c9296e1e', 'request_id': 'req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:44.176739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b98b462c70469d9e953e56c9296e1e', 'request_id': 'req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:44.200683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a admin admin] The token cache is being invalidate because project a5b98b462c70469d9e953e56c9296e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:25:44.200977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:44.211732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:44.217971 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1487/2986] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:25:44 2022] DELETE /identity/v3/projects/a5b98b462c70469d9e953e56c9296e1e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:44.219569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855a001-c567-4737-8afe-f6172b0052be service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:44.230510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855a001-c567-4737-8afe-f6172b0052be service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:44.244996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:44.360454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3f322-9297-43c7-a469-27895094bccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:44.363906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3f322-9297-43c7-a469-27895094bccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:44.364194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3f322-9297-43c7-a469-27895094bccd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:44.364774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3f322-9297-43c7-a469-27895094bccd admin admin] PATH_INFO: `/v3/users/3fa26f18f406414b94f45537cd1067c9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:44.367733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3f322-9297-43c7-a469-27895094bccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa26f18f406414b94f45537cd1067c9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:44.372486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3f322-9297-43c7-a469-27895094bccd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:44.470849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fc3f322-9297-43c7-a469-27895094bccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa26f18f406414b94f45537cd1067c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:44.471070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fc3f322-9297-43c7-a469-27895094bccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa26f18f406414b94f45537cd1067c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:44.490375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fc3f322-9297-43c7-a469-27895094bccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa26f18f406414b94f45537cd1067c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:44.506709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fc3f322-9297-43c7-a469-27895094bccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa26f18f406414b94f45537cd1067c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:44.541970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fc3f322-9297-43c7-a469-27895094bccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa26f18f406414b94f45537cd1067c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:44.555193 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1500/2987] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:25:44 2022] DELETE /identity/v3/users/3fa26f18f406414b94f45537cd1067c9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:44.993593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:44.995981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:45.018018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f803e9b-ef65-4ed3-be0b-5dadf5d6e43a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:45.182479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f868c6-f300-4f30-bd58-ac1217e9996a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:45.186461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f868c6-f300-4f30-bd58-ac1217e9996a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:45.186771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f868c6-f300-4f30-bd58-ac1217e9996a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:45.187322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f868c6-f300-4f30-bd58-ac1217e9996a admin admin] PATH_INFO: `/v3/projects/b547cd1ee24e426d98b296161be7602c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:45.189937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f868c6-f300-4f30-bd58-ac1217e9996a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b547cd1ee24e426d98b296161be7602c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:45.191935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f868c6-f300-4f30-bd58-ac1217e9996a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:45.302652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-18f868c6-f300-4f30-bd58-ac1217e9996a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b547cd1ee24e426d98b296161be7602c', 'request_id': 'req-18f868c6-f300-4f30-bd58-ac1217e9996a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:45.317265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-18f868c6-f300-4f30-bd58-ac1217e9996a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b547cd1ee24e426d98b296161be7602c', 'request_id': 'req-18f868c6-f300-4f30-bd58-ac1217e9996a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:45.330544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-18f868c6-f300-4f30-bd58-ac1217e9996a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b547cd1ee24e426d98b296161be7602c', 'request_id': 'req-18f868c6-f300-4f30-bd58-ac1217e9996a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:45.357944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-18f868c6-f300-4f30-bd58-ac1217e9996a admin admin] The token cache is being invalidate because project b547cd1ee24e426d98b296161be7602c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:25:45.358389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-18f868c6-f300-4f30-bd58-ac1217e9996a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:45.361063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-18f868c6-f300-4f30-bd58-ac1217e9996a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:45.368869 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1488/2988] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:25:44 2022] DELETE /identity/v3/projects/b547cd1ee24e426d98b296161be7602c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:45.371494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaab67-023d-4083-aa94-e4df7e89dc25 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:45.372464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaab67-023d-4083-aa94-e4df7e89dc25 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:45.372944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaab67-023d-4083-aa94-e4df7e89dc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:45.407141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-63eaab67-023d-4083-aa94-e4df7e89dc25 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:45.408949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-63eaab67-023d-4083-aa94-e4df7e89dc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:45.543422 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1501/2989] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:45.554900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fe0a1-9039-4976-bedc-81a55039b317 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:45.555307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fe0a1-9039-4976-bedc-81a55039b317 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:45.555550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fe0a1-9039-4976-bedc-81a55039b317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:45.584500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-db3fe0a1-9039-4976-bedc-81a55039b317 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:45.587169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db3fe0a1-9039-4976-bedc-81a55039b317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:45.612670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaab67-023d-4083-aa94-e4df7e89dc25 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:45.628686 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1489/2990] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:45.641432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaab67-023d-4083-aa94-e4df7e89dc25 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:45.652860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd30421-c67c-4c62-ac8b-5cf71388712b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:45.659313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd30421-c67c-4c62-ac8b-5cf71388712b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:45.659313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd30421-c67c-4c62-ac8b-5cf71388712b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:45.659313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd30421-c67c-4c62-ac8b-5cf71388712b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:45.660557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd30421-c67c-4c62-ac8b-5cf71388712b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:25:45.660886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd30421-c67c-4c62-ac8b-5cf71388712b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:45.662969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd30421-c67c-4c62-ac8b-5cf71388712b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:45.706024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fe0a1-9039-4976-bedc-81a55039b317 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:45.711831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:45.713135 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1502/2991] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:25:45.721805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fe0a1-9039-4976-bedc-81a55039b317 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:45.735412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f685c-3a79-4ec7-915f-134e19ba7272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:45.750791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f685c-3a79-4ec7-915f-134e19ba7272 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:45.750791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f685c-3a79-4ec7-915f-134e19ba7272 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:45.756311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f685c-3a79-4ec7-915f-134e19ba7272 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:45.758655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f685c-3a79-4ec7-915f-134e19ba7272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:45.777068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f685c-3a79-4ec7-915f-134e19ba7272 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:45.854570 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1490/2992] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:25:45 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:45.858532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd30421-c67c-4c62-ac8b-5cf71388712b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:45.872405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd30421-c67c-4c62-ac8b-5cf71388712b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:45.903809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:46.017265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4be4b8-edb5-4328-bcd8-9ad0c0f369a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:46.017921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4be4b8-edb5-4328-bcd8-9ad0c0f369a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:46.018195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4be4b8-edb5-4328-bcd8-9ad0c0f369a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:46.018650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4be4b8-edb5-4328-bcd8-9ad0c0f369a2 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:46.019725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4be4b8-edb5-4328-bcd8-9ad0c0f369a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:46.022483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4be4b8-edb5-4328-bcd8-9ad0c0f369a2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:46.052865 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1503/2993] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:25:45 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:46.056819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f685c-3a79-4ec7-915f-134e19ba7272 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:46.070435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f685c-3a79-4ec7-915f-134e19ba7272 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:46.076091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1786ceb-10ec-4a67-a62f-70e16e621464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:46.076724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1786ceb-10ec-4a67-a62f-70e16e621464 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:46.077013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1786ceb-10ec-4a67-a62f-70e16e621464 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:46.083578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1786ceb-10ec-4a67-a62f-70e16e621464 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:46.084358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1786ceb-10ec-4a67-a62f-70e16e621464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:46.086009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1786ceb-10ec-4a67-a62f-70e16e621464 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:46.100952 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1491/2994] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:46.104794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4be4b8-edb5-4328-bcd8-9ad0c0f369a2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:46.117040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4be4b8-edb5-4328-bcd8-9ad0c0f369a2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:46.123912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97caf4a-eb3c-45e9-9e4f-d2085d3faebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:46.124601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97caf4a-eb3c-45e9-9e4f-d2085d3faebe admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:46.124884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97caf4a-eb3c-45e9-9e4f-d2085d3faebe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:46.125162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97caf4a-eb3c-45e9-9e4f-d2085d3faebe admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:46.125810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97caf4a-eb3c-45e9-9e4f-d2085d3faebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:46.127479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97caf4a-eb3c-45e9-9e4f-d2085d3faebe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:46.145163 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1504/2995] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:46.148380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1786ceb-10ec-4a67-a62f-70e16e621464 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:46.169116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1786ceb-10ec-4a67-a62f-70e16e621464 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:46.183402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164d7aa-c8af-42c0-96f4-b2ddb8bc588b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:46.185276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164d7aa-c8af-42c0-96f4-b2ddb8bc588b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:46.186367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164d7aa-c8af-42c0-96f4-b2ddb8bc588b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:46.187449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164d7aa-c8af-42c0-96f4-b2ddb8bc588b admin admin] PATH_INFO: `/v3/projects/1a223f01df1e40d6a7bfa5a0408f74d3/users/606617fb3aee4b4fa8029a5e80950a75/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:46.211135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164d7aa-c8af-42c0-96f4-b2ddb8bc588b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a223f01df1e40d6a7bfa5a0408f74d3, user_id=606617fb3aee4b4fa8029a5e80950a75, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:46.214836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164d7aa-c8af-42c0-96f4-b2ddb8bc588b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:46.233394 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1492/2996] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:46 2022] PUT /identity/v3/projects/1a223f01df1e40d6a7bfa5a0408f74d3/users/606617fb3aee4b4fa8029a5e80950a75/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:46.243960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe409bbb-6b02-40d6-93b4-370102480d41 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:46.244537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe409bbb-6b02-40d6-93b4-370102480d41 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:46.245220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe409bbb-6b02-40d6-93b4-370102480d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:46.301087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fe409bbb-6b02-40d6-93b4-370102480d41 None None] MFA Rules not processed for user `606617fb3aee4b4fa8029a5e80950a75`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:46.302203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe409bbb-6b02-40d6-93b4-370102480d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:46.448758 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1505/2997] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:46.449547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164d7aa-c8af-42c0-96f4-b2ddb8bc588b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:46.545125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164d7aa-c8af-42c0-96f4-b2ddb8bc588b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:46.550680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5ebf1-50e6-447a-a353-51c9b5f03918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:46.551363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5ebf1-50e6-447a-a353-51c9b5f03918 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:46.551718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5ebf1-50e6-447a-a353-51c9b5f03918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:46.552007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5ebf1-50e6-447a-a353-51c9b5f03918 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:46.561814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5ebf1-50e6-447a-a353-51c9b5f03918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:46.566083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5ebf1-50e6-447a-a353-51c9b5f03918 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:46.609555 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1493/2998] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:25:46 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:25:46.613277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe409bbb-6b02-40d6-93b4-370102480d41 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:46.627127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe409bbb-6b02-40d6-93b4-370102480d41 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:46.749145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa80bb-0daa-4563-9cac-73ae4f31d75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:46.750515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa80bb-0daa-4563-9cac-73ae4f31d75d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:46.750902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa80bb-0daa-4563-9cac-73ae4f31d75d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:46.753426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa80bb-0daa-4563-9cac-73ae4f31d75d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:46.754115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa80bb-0daa-4563-9cac-73ae4f31d75d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:46.756226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa80bb-0daa-4563-9cac-73ae4f31d75d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:46.787871 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1506/2999] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:25:46 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:46.791822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5ebf1-50e6-447a-a353-51c9b5f03918 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:46.807814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5ebf1-50e6-447a-a353-51c9b5f03918 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:46.814748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc5b39-3dbd-4a8c-a855-e2b75fda434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:46.815704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc5b39-3dbd-4a8c-a855-e2b75fda434a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:46.816022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc5b39-3dbd-4a8c-a855-e2b75fda434a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:46.816303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc5b39-3dbd-4a8c-a855-e2b75fda434a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:46.817084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc5b39-3dbd-4a8c-a855-e2b75fda434a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:46.819036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc5b39-3dbd-4a8c-a855-e2b75fda434a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:46.837828 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1494/3000] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:46.841693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa80bb-0daa-4563-9cac-73ae4f31d75d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:46.858296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa80bb-0daa-4563-9cac-73ae4f31d75d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:46.869141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c61187-4f5d-4b84-a851-274958553d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:46.870669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c61187-4f5d-4b84-a851-274958553d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:46.870949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c61187-4f5d-4b84-a851-274958553d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:46.871233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c61187-4f5d-4b84-a851-274958553d89 admin admin] PATH_INFO: `/v3/projects/8c4963154bef43fdb0952997ab275c10/users/453f8f6f2d574d8cbafb0cb35a905977/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:46.888300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:46.893808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c61187-4f5d-4b84-a851-274958553d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4963154bef43fdb0952997ab275c10, user_id=453f8f6f2d574d8cbafb0cb35a905977, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:46.897600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c61187-4f5d-4b84-a851-274958553d89 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:46.930915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc5b39-3dbd-4a8c-a855-e2b75fda434a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:46.932873 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1507/3001] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:46 2022] PUT /identity/v3/projects/8c4963154bef43fdb0952997ab275c10/users/453f8f6f2d574d8cbafb0cb35a905977/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:46.951317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc5b39-3dbd-4a8c-a855-e2b75fda434a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:47.061371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb4125-f52a-4c3e-bc9b-cdf7ad9ece18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:47.062318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb4125-f52a-4c3e-bc9b-cdf7ad9ece18 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:47.063363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb4125-f52a-4c3e-bc9b-cdf7ad9ece18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:47.063810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb4125-f52a-4c3e-bc9b-cdf7ad9ece18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:47.064637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb4125-f52a-4c3e-bc9b-cdf7ad9ece18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:47.067659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb4125-f52a-4c3e-bc9b-cdf7ad9ece18 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:47.080583 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1495/3002] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:25:47.085668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c61187-4f5d-4b84-a851-274958553d89 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:47.101311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c61187-4f5d-4b84-a851-274958553d89 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:47.114205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511814d-89c1-4951-8602-8c853d395980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:47.115544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511814d-89c1-4951-8602-8c853d395980 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:47.115827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511814d-89c1-4951-8602-8c853d395980 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:47.116102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511814d-89c1-4951-8602-8c853d395980 admin admin] PATH_INFO: `/v3/projects/8c4963154bef43fdb0952997ab275c10/users/453f8f6f2d574d8cbafb0cb35a905977/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:47.118662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511814d-89c1-4951-8602-8c853d395980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4963154bef43fdb0952997ab275c10, user_id=453f8f6f2d574d8cbafb0cb35a905977, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:47.123340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511814d-89c1-4951-8602-8c853d395980 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:47.163051 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1508/3003] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:47 2022] PUT /identity/v3/projects/8c4963154bef43fdb0952997ab275c10/users/453f8f6f2d574d8cbafb0cb35a905977/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:47.164734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51705ce-42f7-4a1b-b4ca-011818fb5f2d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:47.165024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51705ce-42f7-4a1b-b4ca-011818fb5f2d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:47.165429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51705ce-42f7-4a1b-b4ca-011818fb5f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:47.201801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f51705ce-42f7-4a1b-b4ca-011818fb5f2d None None] MFA Rules not processed for user `453f8f6f2d574d8cbafb0cb35a905977`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:47.203128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f51705ce-42f7-4a1b-b4ca-011818fb5f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:47.208299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:47.308136 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1496/3004] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:47.320195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511814d-89c1-4951-8602-8c853d395980 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:47.322116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4511814d-89c1-4951-8602-8c853d395980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:47.477551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511814d-89c1-4951-8602-8c853d395980 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:47.483779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eca293-91ce-421f-8307-2475ecc149ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:47.484410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eca293-91ce-421f-8307-2475ecc149ab service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:47.484687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eca293-91ce-421f-8307-2475ecc149ab service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:47.484961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eca293-91ce-421f-8307-2475ecc149ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:47.494944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eca293-91ce-421f-8307-2475ecc149ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:47.497115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eca293-91ce-421f-8307-2475ecc149ab service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:47.511928 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1509/3005] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:48.453681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51705ce-42f7-4a1b-b4ca-011818fb5f2d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:48.588157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51705ce-42f7-4a1b-b4ca-011818fb5f2d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:48.593629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c32982-0024-4965-8f4d-9c8ec352a975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:48.594414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c32982-0024-4965-8f4d-9c8ec352a975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:48.594841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c32982-0024-4965-8f4d-9c8ec352a975 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:48.595191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c32982-0024-4965-8f4d-9c8ec352a975 admin admin] PATH_INFO: `/v3/users/606617fb3aee4b4fa8029a5e80950a75` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:48.596636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c32982-0024-4965-8f4d-9c8ec352a975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=606617fb3aee4b4fa8029a5e80950a75)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:48.598933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c32982-0024-4965-8f4d-9c8ec352a975 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:48.701967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-75c32982-0024-4965-8f4d-9c8ec352a975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '606617fb3aee4b4fa8029a5e80950a75'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:48.722651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-75c32982-0024-4965-8f4d-9c8ec352a975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '606617fb3aee4b4fa8029a5e80950a75'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:48.724136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-75c32982-0024-4965-8f4d-9c8ec352a975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '606617fb3aee4b4fa8029a5e80950a75'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:48.725783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-75c32982-0024-4965-8f4d-9c8ec352a975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '606617fb3aee4b4fa8029a5e80950a75'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:48.746765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-75c32982-0024-4965-8f4d-9c8ec352a975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '606617fb3aee4b4fa8029a5e80950a75'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:48.768833 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1497/3006] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:25:48 2022] DELETE /identity/v3/users/606617fb3aee4b4fa8029a5e80950a75 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:48.774426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84466020-d2c6-4bd8-8b24-166e0d80f5a2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:48.775012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84466020-d2c6-4bd8-8b24-166e0d80f5a2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:48.775238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84466020-d2c6-4bd8-8b24-166e0d80f5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:48.797680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-84466020-d2c6-4bd8-8b24-166e0d80f5a2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:48.799244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-84466020-d2c6-4bd8-8b24-166e0d80f5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:48.895431 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1510/3007] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:48.906909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c32982-0024-4965-8f4d-9c8ec352a975 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:48.908574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-75c32982-0024-4965-8f4d-9c8ec352a975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:48.942132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:48.996874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c32982-0024-4965-8f4d-9c8ec352a975 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:49.001402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc419579-6757-469d-be28-a3d7f6dc5a39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:49.002600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc419579-6757-469d-be28-a3d7f6dc5a39 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:49.003360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc419579-6757-469d-be28-a3d7f6dc5a39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:49.003864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc419579-6757-469d-be28-a3d7f6dc5a39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:49.015209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc419579-6757-469d-be28-a3d7f6dc5a39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:49.016988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc419579-6757-469d-be28-a3d7f6dc5a39 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:49.060780 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1498/3008] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:49.518583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84466020-d2c6-4bd8-8b24-166e0d80f5a2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:49.524065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-84466020-d2c6-4bd8-8b24-166e0d80f5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:49.550600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84466020-d2c6-4bd8-8b24-166e0d80f5a2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:49.556350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262d300-75fd-429f-ac4e-ca6be72d6b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:49.557759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262d300-75fd-429f-ac4e-ca6be72d6b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:49.557759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262d300-75fd-429f-ac4e-ca6be72d6b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:49.557989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262d300-75fd-429f-ac4e-ca6be72d6b89 admin admin] PATH_INFO: `/v3/projects/1a223f01df1e40d6a7bfa5a0408f74d3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:49.559179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262d300-75fd-429f-ac4e-ca6be72d6b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a223f01df1e40d6a7bfa5a0408f74d3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:49.561546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262d300-75fd-429f-ac4e-ca6be72d6b89 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:49.645460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3262d300-75fd-429f-ac4e-ca6be72d6b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a223f01df1e40d6a7bfa5a0408f74d3', 'request_id': 'req-3262d300-75fd-429f-ac4e-ca6be72d6b89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:49.658897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3262d300-75fd-429f-ac4e-ca6be72d6b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a223f01df1e40d6a7bfa5a0408f74d3', 'request_id': 'req-3262d300-75fd-429f-ac4e-ca6be72d6b89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:49.661262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:49.670027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3262d300-75fd-429f-ac4e-ca6be72d6b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a223f01df1e40d6a7bfa5a0408f74d3', 'request_id': 'req-3262d300-75fd-429f-ac4e-ca6be72d6b89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:49.704392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3262d300-75fd-429f-ac4e-ca6be72d6b89 admin admin] The token cache is being invalidate because project 1a223f01df1e40d6a7bfa5a0408f74d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:25:49.704959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3262d300-75fd-429f-ac4e-ca6be72d6b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:49.706004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3262d300-75fd-429f-ac4e-ca6be72d6b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:49.708669 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1511/3009] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:25:49 2022] DELETE /identity/v3/projects/1a223f01df1e40d6a7bfa5a0408f74d3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:49.712338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc419579-6757-469d-be28-a3d7f6dc5a39 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:49.726655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc419579-6757-469d-be28-a3d7f6dc5a39 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:49.809993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2c2c9-36bb-4d0e-a7ef-70921e29cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:49.812205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2c2c9-36bb-4d0e-a7ef-70921e29cc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:49.812622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2c2c9-36bb-4d0e-a7ef-70921e29cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:49.812906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2c2c9-36bb-4d0e-a7ef-70921e29cc18 admin admin] PATH_INFO: `/v3/users/453f8f6f2d574d8cbafb0cb35a905977` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:49.816265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2c2c9-36bb-4d0e-a7ef-70921e29cc18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453f8f6f2d574d8cbafb0cb35a905977)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:49.821963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2c2c9-36bb-4d0e-a7ef-70921e29cc18 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:49.947975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbe2c2c9-36bb-4d0e-a7ef-70921e29cc18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453f8f6f2d574d8cbafb0cb35a905977'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:49.970661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbe2c2c9-36bb-4d0e-a7ef-70921e29cc18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453f8f6f2d574d8cbafb0cb35a905977'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:49.971890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbe2c2c9-36bb-4d0e-a7ef-70921e29cc18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453f8f6f2d574d8cbafb0cb35a905977'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:49.972607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbe2c2c9-36bb-4d0e-a7ef-70921e29cc18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453f8f6f2d574d8cbafb0cb35a905977'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:50.004031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbe2c2c9-36bb-4d0e-a7ef-70921e29cc18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453f8f6f2d574d8cbafb0cb35a905977'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:50.022885 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1499/3010] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:25:49 2022] DELETE /identity/v3/users/453f8f6f2d574d8cbafb0cb35a905977 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:51.574498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262d300-75fd-429f-ac4e-ca6be72d6b89 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:51.576774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3262d300-75fd-429f-ac4e-ca6be72d6b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:51.627903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262d300-75fd-429f-ac4e-ca6be72d6b89 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:51.780063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b4044-5d61-464d-a8e8-b21d8206c4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:51.781191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b4044-5d61-464d-a8e8-b21d8206c4c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:51.781693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b4044-5d61-464d-a8e8-b21d8206c4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:51.782207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b4044-5d61-464d-a8e8-b21d8206c4c3 admin admin] PATH_INFO: `/v3/projects/8c4963154bef43fdb0952997ab275c10` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:51.783963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b4044-5d61-464d-a8e8-b21d8206c4c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4963154bef43fdb0952997ab275c10)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:51.786343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b4044-5d61-464d-a8e8-b21d8206c4c3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:51.915385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa9b4044-5d61-464d-a8e8-b21d8206c4c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4963154bef43fdb0952997ab275c10', 'request_id': 'req-aa9b4044-5d61-464d-a8e8-b21d8206c4c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:51.935406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa9b4044-5d61-464d-a8e8-b21d8206c4c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4963154bef43fdb0952997ab275c10', 'request_id': 'req-aa9b4044-5d61-464d-a8e8-b21d8206c4c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:51.969946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa9b4044-5d61-464d-a8e8-b21d8206c4c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4963154bef43fdb0952997ab275c10', 'request_id': 'req-aa9b4044-5d61-464d-a8e8-b21d8206c4c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:52.001151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa9b4044-5d61-464d-a8e8-b21d8206c4c3 admin admin] The token cache is being invalidate because project 8c4963154bef43fdb0952997ab275c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:25:52.001832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa9b4044-5d61-464d-a8e8-b21d8206c4c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:52.004650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa9b4044-5d61-464d-a8e8-b21d8206c4c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:52.011635 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1512/3011] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:25:51 2022] DELETE /identity/v3/projects/8c4963154bef43fdb0952997ab275c10 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:52.014606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49352488-a042-41cd-8c29-2c7b8c4a5e22 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:52.015085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49352488-a042-41cd-8c29-2c7b8c4a5e22 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:52.015179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49352488-a042-41cd-8c29-2c7b8c4a5e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:52.101286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-49352488-a042-41cd-8c29-2c7b8c4a5e22 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:52.108675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-49352488-a042-41cd-8c29-2c7b8c4a5e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:52.199450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:52.263482 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1500/3012] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:52.331601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538512a5-037d-4e87-8a46-8852020431e3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:52.332031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538512a5-037d-4e87-8a46-8852020431e3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:52.332395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538512a5-037d-4e87-8a46-8852020431e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:52.362931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-538512a5-037d-4e87-8a46-8852020431e3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:52.364725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-538512a5-037d-4e87-8a46-8852020431e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:52.395787 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1513/3013] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:52.396831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49352488-a042-41cd-8c29-2c7b8c4a5e22 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:52.401607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538512a5-037d-4e87-8a46-8852020431e3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:52.403375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-538512a5-037d-4e87-8a46-8852020431e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:52.415460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49352488-a042-41cd-8c29-2c7b8c4a5e22 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:52.432900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67370d95-b557-4fe7-9b7d-728a8f8fef89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:52.433412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67370d95-b557-4fe7-9b7d-728a8f8fef89 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:52.434557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67370d95-b557-4fe7-9b7d-728a8f8fef89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:52.434993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67370d95-b557-4fe7-9b7d-728a8f8fef89 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:52.437852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67370d95-b557-4fe7-9b7d-728a8f8fef89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:25:52.438165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67370d95-b557-4fe7-9b7d-728a8f8fef89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:52.440467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67370d95-b557-4fe7-9b7d-728a8f8fef89 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:52.484693 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1501/3014] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:25:52.489547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67370d95-b557-4fe7-9b7d-728a8f8fef89 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:52.505499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67370d95-b557-4fe7-9b7d-728a8f8fef89 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:52.512208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c877ef-29a1-43e1-a39c-3cb2d18751b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:52.513488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c877ef-29a1-43e1-a39c-3cb2d18751b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:52.513861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c877ef-29a1-43e1-a39c-3cb2d18751b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:52.514143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c877ef-29a1-43e1-a39c-3cb2d18751b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:52.515384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c877ef-29a1-43e1-a39c-3cb2d18751b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:52.519033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c877ef-29a1-43e1-a39c-3cb2d18751b3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:52.571972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538512a5-037d-4e87-8a46-8852020431e3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:52.592008 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1502/3015] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:25:52 2022] POST /identity/v3/projects => generated 411 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:52.594086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c877ef-29a1-43e1-a39c-3cb2d18751b3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:52.594259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1899b3-8fd1-4fb2-b75e-884addd3972a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:52.595528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1899b3-8fd1-4fb2-b75e-884addd3972a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:52.595966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1899b3-8fd1-4fb2-b75e-884addd3972a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:52.596394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1899b3-8fd1-4fb2-b75e-884addd3972a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:52.604863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3d1899b3-8fd1-4fb2-b75e-884addd3972a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:52.625162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:52.727632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c877ef-29a1-43e1-a39c-3cb2d18751b3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:52.742375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97d5b0-27b2-4191-a2ff-bde21367fcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:52.743130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97d5b0-27b2-4191-a2ff-bde21367fcd0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:52.743507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97d5b0-27b2-4191-a2ff-bde21367fcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:52.743718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97d5b0-27b2-4191-a2ff-bde21367fcd0 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:52.744359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97d5b0-27b2-4191-a2ff-bde21367fcd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:52.746630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97d5b0-27b2-4191-a2ff-bde21367fcd0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:52.749871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1899b3-8fd1-4fb2-b75e-884addd3972a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:52.751532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1899b3-8fd1-4fb2-b75e-884addd3972a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:52.770353 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1514/3016] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:52.789423 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1503/3017] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:25:52 2022] POST /identity/v3/users => generated 306 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:52.793868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1899b3-8fd1-4fb2-b75e-884addd3972a service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:52.808688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1899b3-8fd1-4fb2-b75e-884addd3972a service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:52.825320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c567b0-eb88-418b-bf7e-17c3cdba416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:52.826050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c567b0-eb88-418b-bf7e-17c3cdba416a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:52.826394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c567b0-eb88-418b-bf7e-17c3cdba416a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:52.826886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c567b0-eb88-418b-bf7e-17c3cdba416a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:52.827808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c567b0-eb88-418b-bf7e-17c3cdba416a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:52.829875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c567b0-eb88-418b-bf7e-17c3cdba416a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:52.860497 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1515/3018] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:52.865009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97d5b0-27b2-4191-a2ff-bde21367fcd0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:52.879610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97d5b0-27b2-4191-a2ff-bde21367fcd0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:52.897301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dd601-06f6-42b1-874c-90cf0a0de098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:52.898270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dd601-06f6-42b1-874c-90cf0a0de098 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:52.898619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dd601-06f6-42b1-874c-90cf0a0de098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:52.899050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dd601-06f6-42b1-874c-90cf0a0de098 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:52.899866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dd601-06f6-42b1-874c-90cf0a0de098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:52.905872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dd601-06f6-42b1-874c-90cf0a0de098 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:52.932022 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1504/3019] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:52.935948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c567b0-eb88-418b-bf7e-17c3cdba416a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:52.950492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c567b0-eb88-418b-bf7e-17c3cdba416a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:52.955459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aee1f-8d89-4278-8032-caf5d8d0bb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:52.956422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aee1f-8d89-4278-8032-caf5d8d0bb02 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:52.956874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aee1f-8d89-4278-8032-caf5d8d0bb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:52.957311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aee1f-8d89-4278-8032-caf5d8d0bb02 admin admin] PATH_INFO: `/v3/projects/b8ddef04a1f84a06bbc78989b3003845/users/1719e77e3d4048238a2f485b2a4538ff/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:52.989789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6aee1f-8d89-4278-8032-caf5d8d0bb02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ddef04a1f84a06bbc78989b3003845, user_id=1719e77e3d4048238a2f485b2a4538ff, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:52.998592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6aee1f-8d89-4278-8032-caf5d8d0bb02 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:53.040162 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1516/3020] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:52 2022] PUT /identity/v3/projects/b8ddef04a1f84a06bbc78989b3003845/users/1719e77e3d4048238a2f485b2a4538ff/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:53.050496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95a41c-4118-4070-8b1f-2413b123195e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:53.050990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95a41c-4118-4070-8b1f-2413b123195e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:53.050990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95a41c-4118-4070-8b1f-2413b123195e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:53.113425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9a95a41c-4118-4070-8b1f-2413b123195e None None] MFA Rules not processed for user `1719e77e3d4048238a2f485b2a4538ff`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:53.115402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9a95a41c-4118-4070-8b1f-2413b123195e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:53.306495 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1505/3021] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:53 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:53.307469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aee1f-8d89-4278-8032-caf5d8d0bb02 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:53.462266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aee1f-8d89-4278-8032-caf5d8d0bb02 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:53.471232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5a7a4-df8f-49b5-86cf-91f6622bb6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:53.471909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5a7a4-df8f-49b5-86cf-91f6622bb6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:53.472311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5a7a4-df8f-49b5-86cf-91f6622bb6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:53.472600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5a7a4-df8f-49b5-86cf-91f6622bb6a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:53.473260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5a7a4-df8f-49b5-86cf-91f6622bb6a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:53.475893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5a7a4-df8f-49b5-86cf-91f6622bb6a1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:53.550204 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1517/3022] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:25:53 2022] POST /identity/v3/projects => generated 411 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:53.554469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95a41c-4118-4070-8b1f-2413b123195e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:53.584081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95a41c-4118-4070-8b1f-2413b123195e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:53.615582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:53.742407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346715ad-4a37-49e7-bc89-9e95e7225bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:53.743047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346715ad-4a37-49e7-bc89-9e95e7225bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:53.743372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346715ad-4a37-49e7-bc89-9e95e7225bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:53.743653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346715ad-4a37-49e7-bc89-9e95e7225bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:53.744308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346715ad-4a37-49e7-bc89-9e95e7225bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:53.746312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346715ad-4a37-49e7-bc89-9e95e7225bd8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:53.774485 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1506/3023] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:25:53 2022] POST /identity/v3/users => generated 312 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:25:53.778023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5a7a4-df8f-49b5-86cf-91f6622bb6a1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:53.794965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5a7a4-df8f-49b5-86cf-91f6622bb6a1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:53.802258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673131e8-78b0-4d5b-978c-0348e745849b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:53.803565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673131e8-78b0-4d5b-978c-0348e745849b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:53.804168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673131e8-78b0-4d5b-978c-0348e745849b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:53.804714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673131e8-78b0-4d5b-978c-0348e745849b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:53.805707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673131e8-78b0-4d5b-978c-0348e745849b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:53.808866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673131e8-78b0-4d5b-978c-0348e745849b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:53.830659 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1518/3024] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:53.833882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346715ad-4a37-49e7-bc89-9e95e7225bd8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:53.847772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346715ad-4a37-49e7-bc89-9e95e7225bd8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:53.853056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e45b0b-4859-4a88-b70d-384e00a648b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:53.853766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e45b0b-4859-4a88-b70d-384e00a648b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:53.854108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e45b0b-4859-4a88-b70d-384e00a648b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:53.854903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e45b0b-4859-4a88-b70d-384e00a648b8 admin admin] PATH_INFO: `/v3/projects/b5dd2f8550d5451f80634c3ff990f61d/users/12b1949601374ccbbfc369ce03a5766f/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:53.878225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e45b0b-4859-4a88-b70d-384e00a648b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dd2f8550d5451f80634c3ff990f61d, user_id=12b1949601374ccbbfc369ce03a5766f, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:53.881229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e45b0b-4859-4a88-b70d-384e00a648b8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:53.914681 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1507/3025] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:53 2022] PUT /identity/v3/projects/b5dd2f8550d5451f80634c3ff990f61d/users/12b1949601374ccbbfc369ce03a5766f/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:53.916752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673131e8-78b0-4d5b-978c-0348e745849b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:53.935575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673131e8-78b0-4d5b-978c-0348e745849b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:54.048545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:54.102280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d669ee-804d-4177-9c11-655376a7c239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:54.103033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d669ee-804d-4177-9c11-655376a7c239 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:54.103333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d669ee-804d-4177-9c11-655376a7c239 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:54.103609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d669ee-804d-4177-9c11-655376a7c239 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:54.110141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d669ee-804d-4177-9c11-655376a7c239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:54.117206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d669ee-804d-4177-9c11-655376a7c239 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:54.144688 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1519/3026] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:25:54.149295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e45b0b-4859-4a88-b70d-384e00a648b8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:54.170397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e45b0b-4859-4a88-b70d-384e00a648b8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:54.188209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0411a7-5a97-4fba-9ce8-0652df1c81e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:54.188911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0411a7-5a97-4fba-9ce8-0652df1c81e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:54.189191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0411a7-5a97-4fba-9ce8-0652df1c81e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:54.189462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0411a7-5a97-4fba-9ce8-0652df1c81e1 admin admin] PATH_INFO: `/v3/projects/b5dd2f8550d5451f80634c3ff990f61d/users/12b1949601374ccbbfc369ce03a5766f/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:54.193221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0411a7-5a97-4fba-9ce8-0652df1c81e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dd2f8550d5451f80634c3ff990f61d, user_id=12b1949601374ccbbfc369ce03a5766f, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:54.196110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0411a7-5a97-4fba-9ce8-0652df1c81e1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:54.217102 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1508/3027] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:25:54 2022] PUT /identity/v3/projects/b5dd2f8550d5451f80634c3ff990f61d/users/12b1949601374ccbbfc369ce03a5766f/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:54.228225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31ffcc-e0c1-49ef-8780-83b84eb876cb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:54.228512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31ffcc-e0c1-49ef-8780-83b84eb876cb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:54.228792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31ffcc-e0c1-49ef-8780-83b84eb876cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:54.230941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec38db-3934-46df-9825-042d99b3ba37 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:54.231680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec38db-3934-46df-9825-042d99b3ba37 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:54.232707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec38db-3934-46df-9825-042d99b3ba37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:54.296687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b2ec38db-3934-46df-9825-042d99b3ba37 None None] MFA Rules not processed for user `2da56a6076bb474b957763142c6eec0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:54.297945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b2ec38db-3934-46df-9825-042d99b3ba37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:54.352005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4a31ffcc-e0c1-49ef-8780-83b84eb876cb None None] MFA Rules not processed for user `12b1949601374ccbbfc369ce03a5766f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:54.369388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a31ffcc-e0c1-49ef-8780-83b84eb876cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:54.460985 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1509/3028] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:54.462624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba209-f80c-47d9-8c3c-323e7cad5402 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:54.462918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba209-f80c-47d9-8c3c-323e7cad5402 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:54.463200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba209-f80c-47d9-8c3c-323e7cad5402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:54.502939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-deeba209-f80c-47d9-8c3c-323e7cad5402 None None] MFA Rules not processed for user `2da56a6076bb474b957763142c6eec0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:54.504217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-deeba209-f80c-47d9-8c3c-323e7cad5402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:54.509109 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1520/3029] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:54 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:54.516746 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1510/3030] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:55.132782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31ffcc-e0c1-49ef-8780-83b84eb876cb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:55.239877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31ffcc-e0c1-49ef-8780-83b84eb876cb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:55.248292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ddeb6-3532-48c9-98f8-16fa4125599e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:55.249156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ddeb6-3532-48c9-98f8-16fa4125599e service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:55.249618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ddeb6-3532-48c9-98f8-16fa4125599e service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:55.250186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ddeb6-3532-48c9-98f8-16fa4125599e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:55.261911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ddeb6-3532-48c9-98f8-16fa4125599e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:55.264176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ddeb6-3532-48c9-98f8-16fa4125599e service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:55.293832 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1521/3031] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:55 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:55.329081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeba209-f80c-47d9-8c3c-323e7cad5402 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:55.379106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeba209-f80c-47d9-8c3c-323e7cad5402 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:55.398412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266074d-dae4-477f-95cb-537c47065f73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:55.399927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266074d-dae4-477f-95cb-537c47065f73 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:55.400214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266074d-dae4-477f-95cb-537c47065f73 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:55.401154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266074d-dae4-477f-95cb-537c47065f73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:55.442708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266074d-dae4-477f-95cb-537c47065f73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:55.444669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266074d-dae4-477f-95cb-537c47065f73 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:55.471779 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1511/3032] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:55 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:55.870090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ddeb6-3532-48c9-98f8-16fa4125599e service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:55.871726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d28ddeb6-3532-48c9-98f8-16fa4125599e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:55.888195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ddeb6-3532-48c9-98f8-16fa4125599e service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:55.893911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b838908-a6bb-4c92-a2fa-ee8d091738bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:55.895357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b838908-a6bb-4c92-a2fa-ee8d091738bf service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:55.895708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b838908-a6bb-4c92-a2fa-ee8d091738bf service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:55.896049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b838908-a6bb-4c92-a2fa-ee8d091738bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:55.951587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:55.963845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b838908-a6bb-4c92-a2fa-ee8d091738bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:55.967039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b838908-a6bb-4c92-a2fa-ee8d091738bf service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:55.982177 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1522/3033] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:55 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:56.092296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266074d-dae4-477f-95cb-537c47065f73 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:56.093847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8266074d-dae4-477f-95cb-537c47065f73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:56.180879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:56.227489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266074d-dae4-477f-95cb-537c47065f73 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:56.236325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e4f9f-f66a-4371-92ab-5288af5fbf28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:56.237190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e4f9f-f66a-4371-92ab-5288af5fbf28 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:56.237628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e4f9f-f66a-4371-92ab-5288af5fbf28 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:56.247635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e4f9f-f66a-4371-92ab-5288af5fbf28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:56.257887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-556e4f9f-f66a-4371-92ab-5288af5fbf28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:56.285779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e4f9f-f66a-4371-92ab-5288af5fbf28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:56.288574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e4f9f-f66a-4371-92ab-5288af5fbf28 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:56.301991 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1512/3034] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:56.952400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b838908-a6bb-4c92-a2fa-ee8d091738bf service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:57.117667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b838908-a6bb-4c92-a2fa-ee8d091738bf service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:57.126180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ff03b-d728-4af4-9a34-f6f9c324d75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:57.126844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ff03b-d728-4af4-9a34-f6f9c324d75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:57.127119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ff03b-d728-4af4-9a34-f6f9c324d75f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:57.127427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ff03b-d728-4af4-9a34-f6f9c324d75f admin admin] PATH_INFO: `/v3/users/1719e77e3d4048238a2f485b2a4538ff` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:57.129525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ff03b-d728-4af4-9a34-f6f9c324d75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1719e77e3d4048238a2f485b2a4538ff)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:57.136571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ff03b-d728-4af4-9a34-f6f9c324d75f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:57.256838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b54ff03b-d728-4af4-9a34-f6f9c324d75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1719e77e3d4048238a2f485b2a4538ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:57.257803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b54ff03b-d728-4af4-9a34-f6f9c324d75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1719e77e3d4048238a2f485b2a4538ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:57.268000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b54ff03b-d728-4af4-9a34-f6f9c324d75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1719e77e3d4048238a2f485b2a4538ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:57.285924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b54ff03b-d728-4af4-9a34-f6f9c324d75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1719e77e3d4048238a2f485b2a4538ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:57.356676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b54ff03b-d728-4af4-9a34-f6f9c324d75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1719e77e3d4048238a2f485b2a4538ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:57.374479 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1523/3035] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:25:56 2022] DELETE /identity/v3/users/1719e77e3d4048238a2f485b2a4538ff => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:57.400395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478bd6e-d098-4e3d-92a1-d04f9b49cd99 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:57.401248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478bd6e-d098-4e3d-92a1-d04f9b49cd99 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:57.402025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478bd6e-d098-4e3d-92a1-d04f9b49cd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:57.435733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c478bd6e-d098-4e3d-92a1-d04f9b49cd99 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:25:57.439329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c478bd6e-d098-4e3d-92a1-d04f9b49cd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:57.698599 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1513/3036] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:25:57.727675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ff03b-d728-4af4-9a34-f6f9c324d75f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:57.732126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b54ff03b-d728-4af4-9a34-f6f9c324d75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:57.929252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ff03b-d728-4af4-9a34-f6f9c324d75f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:57.934528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47789d2c-27bf-4720-9768-a08165e4efe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:57.935419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47789d2c-27bf-4720-9768-a08165e4efe1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:57.935723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47789d2c-27bf-4720-9768-a08165e4efe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:57.936009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47789d2c-27bf-4720-9768-a08165e4efe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:57.949577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47789d2c-27bf-4720-9768-a08165e4efe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:57.952232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47789d2c-27bf-4720-9768-a08165e4efe1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:57.985335 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1524/3037] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:25:58.661073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478bd6e-d098-4e3d-92a1-d04f9b49cd99 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:58.662748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c478bd6e-d098-4e3d-92a1-d04f9b49cd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:25:58.688618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478bd6e-d098-4e3d-92a1-d04f9b49cd99 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:58.706607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872112a-ed27-4ad4-b416-4934a5393719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:58.707807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872112a-ed27-4ad4-b416-4934a5393719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:58.708308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872112a-ed27-4ad4-b416-4934a5393719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:58.708736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872112a-ed27-4ad4-b416-4934a5393719 admin admin] PATH_INFO: `/v3/projects/b8ddef04a1f84a06bbc78989b3003845` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:58.713155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872112a-ed27-4ad4-b416-4934a5393719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ddef04a1f84a06bbc78989b3003845)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:58.718288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872112a-ed27-4ad4-b416-4934a5393719 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:58.843956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d872112a-ed27-4ad4-b416-4934a5393719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ddef04a1f84a06bbc78989b3003845', 'request_id': 'req-d872112a-ed27-4ad4-b416-4934a5393719'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:58.859435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d872112a-ed27-4ad4-b416-4934a5393719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ddef04a1f84a06bbc78989b3003845', 'request_id': 'req-d872112a-ed27-4ad4-b416-4934a5393719'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:58.874212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d872112a-ed27-4ad4-b416-4934a5393719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ddef04a1f84a06bbc78989b3003845', 'request_id': 'req-d872112a-ed27-4ad4-b416-4934a5393719'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:58.921616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d872112a-ed27-4ad4-b416-4934a5393719 admin admin] The token cache is being invalidate because project b8ddef04a1f84a06bbc78989b3003845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:25:58.922227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d872112a-ed27-4ad4-b416-4934a5393719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:58.924981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d872112a-ed27-4ad4-b416-4934a5393719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:58.929643 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1514/3038] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:25:58 2022] DELETE /identity/v3/projects/b8ddef04a1f84a06bbc78989b3003845 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:25:58.933529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47789d2c-27bf-4720-9768-a08165e4efe1 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:25:58.952710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47789d2c-27bf-4720-9768-a08165e4efe1 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:25:58.997170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:25:59.185218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58476086-9189-462f-9226-fbad34bc4f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:25:59.186085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58476086-9189-462f-9226-fbad34bc4f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:25:59.186541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58476086-9189-462f-9226-fbad34bc4f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:25:59.186979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58476086-9189-462f-9226-fbad34bc4f49 admin admin] PATH_INFO: `/v3/users/12b1949601374ccbbfc369ce03a5766f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:25:59.188387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58476086-9189-462f-9226-fbad34bc4f49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b1949601374ccbbfc369ce03a5766f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:25:59.193585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58476086-9189-462f-9226-fbad34bc4f49 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:25:59.346478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-58476086-9189-462f-9226-fbad34bc4f49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b1949601374ccbbfc369ce03a5766f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:59.347524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-58476086-9189-462f-9226-fbad34bc4f49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b1949601374ccbbfc369ce03a5766f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:59.359864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-58476086-9189-462f-9226-fbad34bc4f49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b1949601374ccbbfc369ce03a5766f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:59.374612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-58476086-9189-462f-9226-fbad34bc4f49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b1949601374ccbbfc369ce03a5766f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:59.395975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-58476086-9189-462f-9226-fbad34bc4f49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b1949601374ccbbfc369ce03a5766f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:25:59.417730 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1525/3039] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:25:58 2022] DELETE /identity/v3/users/12b1949601374ccbbfc369ce03a5766f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:00.169351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872112a-ed27-4ad4-b416-4934a5393719 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:00.169822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d872112a-ed27-4ad4-b416-4934a5393719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:00.198964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872112a-ed27-4ad4-b416-4934a5393719 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:00.297983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f4f45-36fd-42ac-9541-49eccf918f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:00.299385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f4f45-36fd-42ac-9541-49eccf918f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:00.299631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f4f45-36fd-42ac-9541-49eccf918f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:00.299977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f4f45-36fd-42ac-9541-49eccf918f77 admin admin] PATH_INFO: `/v3/projects/b5dd2f8550d5451f80634c3ff990f61d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:00.301948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f4f45-36fd-42ac-9541-49eccf918f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5dd2f8550d5451f80634c3ff990f61d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:00.305102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f4f45-36fd-42ac-9541-49eccf918f77 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:00.319612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:00.387245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-601f4f45-36fd-42ac-9541-49eccf918f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5dd2f8550d5451f80634c3ff990f61d', 'request_id': 'req-601f4f45-36fd-42ac-9541-49eccf918f77'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:00.393954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-601f4f45-36fd-42ac-9541-49eccf918f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5dd2f8550d5451f80634c3ff990f61d', 'request_id': 'req-601f4f45-36fd-42ac-9541-49eccf918f77'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:00.400596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-601f4f45-36fd-42ac-9541-49eccf918f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5dd2f8550d5451f80634c3ff990f61d', 'request_id': 'req-601f4f45-36fd-42ac-9541-49eccf918f77'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:00.417457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-601f4f45-36fd-42ac-9541-49eccf918f77 admin admin] The token cache is being invalidate because project b5dd2f8550d5451f80634c3ff990f61d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:26:00.417902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-601f4f45-36fd-42ac-9541-49eccf918f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:00.418671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-601f4f45-36fd-42ac-9541-49eccf918f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:00.420437 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1515/3040] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:26:00 2022] DELETE /identity/v3/projects/b5dd2f8550d5451f80634c3ff990f61d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:00.425369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4865c-3694-4c4c-83c0-644c681cacbe None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:00.425952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4865c-3694-4c4c-83c0-644c681cacbe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:00.425952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4865c-3694-4c4c-83c0-644c681cacbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:00.449896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-12a4865c-3694-4c4c-83c0-644c681cacbe None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:00.451181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-12a4865c-3694-4c4c-83c0-644c681cacbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:00.527938 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1526/3041] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:00.529735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b36b7-de13-4cfb-a2fc-068a9139b2d8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:00.530119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b36b7-de13-4cfb-a2fc-068a9139b2d8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:00.530512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b36b7-de13-4cfb-a2fc-068a9139b2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:00.551075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cd8b36b7-de13-4cfb-a2fc-068a9139b2d8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:00.552315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cd8b36b7-de13-4cfb-a2fc-068a9139b2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:00.579146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4865c-3694-4c4c-83c0-644c681cacbe None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:00.585680 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1516/3042] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:00.589902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4865c-3694-4c4c-83c0-644c681cacbe None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:00.594835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a53ed-b27e-4b4f-b8df-b3e25553a02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:00.595569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a53ed-b27e-4b4f-b8df-b3e25553a02b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:00.595918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a53ed-b27e-4b4f-b8df-b3e25553a02b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:00.596261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a53ed-b27e-4b4f-b8df-b3e25553a02b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:00.596991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a53ed-b27e-4b4f-b8df-b3e25553a02b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:26:00.597363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a53ed-b27e-4b4f-b8df-b3e25553a02b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:00.599113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a53ed-b27e-4b4f-b8df-b3e25553a02b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:00.611619 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1527/3043] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:26:00.616523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b36b7-de13-4cfb-a2fc-068a9139b2d8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:00.629608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b36b7-de13-4cfb-a2fc-068a9139b2d8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:00.643567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51410a2f-0ec2-4268-8236-8b16346d7399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:00.645079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51410a2f-0ec2-4268-8236-8b16346d7399 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:00.645660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51410a2f-0ec2-4268-8236-8b16346d7399 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:00.646074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51410a2f-0ec2-4268-8236-8b16346d7399 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:00.646798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51410a2f-0ec2-4268-8236-8b16346d7399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:00.648881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51410a2f-0ec2-4268-8236-8b16346d7399 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:00.687394 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1517/3044] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:26:00 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:26:00.690400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a53ed-b27e-4b4f-b8df-b3e25553a02b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:00.702399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a53ed-b27e-4b4f-b8df-b3e25553a02b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:00.718047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:00.772966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22927829-db3f-45f1-818c-6d0f604eba82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:00.773602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927829-db3f-45f1-818c-6d0f604eba82 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:00.773890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927829-db3f-45f1-818c-6d0f604eba82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:00.774162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927829-db3f-45f1-818c-6d0f604eba82 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:00.774829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22927829-db3f-45f1-818c-6d0f604eba82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:00.776870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22927829-db3f-45f1-818c-6d0f604eba82 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:00.801764 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1528/3045] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:26:00 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:26:00.805627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51410a2f-0ec2-4268-8236-8b16346d7399 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:00.817934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51410a2f-0ec2-4268-8236-8b16346d7399 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:00.823108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88c18d-a3d9-47ee-ae88-a2ad557f6c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:00.823918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88c18d-a3d9-47ee-ae88-a2ad557f6c8a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:00.824300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88c18d-a3d9-47ee-ae88-a2ad557f6c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:00.824671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88c18d-a3d9-47ee-ae88-a2ad557f6c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:00.825434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88c18d-a3d9-47ee-ae88-a2ad557f6c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:00.827157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88c18d-a3d9-47ee-ae88-a2ad557f6c8a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:00.843303 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1518/3046] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:26:00.846101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22927829-db3f-45f1-818c-6d0f604eba82 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:00.857539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22927829-db3f-45f1-818c-6d0f604eba82 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:00.863689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf428f-64e6-4577-b6cf-814bf1a8a691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:00.865097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf428f-64e6-4577-b6cf-814bf1a8a691 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:00.865669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf428f-64e6-4577-b6cf-814bf1a8a691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:00.866169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf428f-64e6-4577-b6cf-814bf1a8a691 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:00.867299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf428f-64e6-4577-b6cf-814bf1a8a691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:00.870991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf428f-64e6-4577-b6cf-814bf1a8a691 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:00.885941 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1529/3047] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:26:00.890082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88c18d-a3d9-47ee-ae88-a2ad557f6c8a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:00.903228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88c18d-a3d9-47ee-ae88-a2ad557f6c8a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:00.910014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf61aab-2d55-4e0e-89a3-00912fa885ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:00.911070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf61aab-2d55-4e0e-89a3-00912fa885ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:00.911624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf61aab-2d55-4e0e-89a3-00912fa885ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:00.912146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf61aab-2d55-4e0e-89a3-00912fa885ac admin admin] PATH_INFO: `/v3/projects/b337d5aefa994bff9525b80828c65b49/users/412a4232f67c4d33ba59b166abd05a06/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:00.932322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf61aab-2d55-4e0e-89a3-00912fa885ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b337d5aefa994bff9525b80828c65b49, user_id=412a4232f67c4d33ba59b166abd05a06, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:00.936170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf61aab-2d55-4e0e-89a3-00912fa885ac admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:00.980983 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1519/3048] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:26:00 2022] PUT /identity/v3/projects/b337d5aefa994bff9525b80828c65b49/users/412a4232f67c4d33ba59b166abd05a06/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:00.981591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec267-6baf-401b-924d-f427d563236b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:00.981987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec267-6baf-401b-924d-f427d563236b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:00.982305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec267-6baf-401b-924d-f427d563236b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:01.055677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f40ec267-6baf-401b-924d-f427d563236b None None] MFA Rules not processed for user `412a4232f67c4d33ba59b166abd05a06`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:01.057762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f40ec267-6baf-401b-924d-f427d563236b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:01.179310 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1530/3049] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:01.181352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf61aab-2d55-4e0e-89a3-00912fa885ac admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:01.278501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf61aab-2d55-4e0e-89a3-00912fa885ac admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:01.284042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee352570-39fc-49b4-bb69-d15263da72b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:01.284744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee352570-39fc-49b4-bb69-d15263da72b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:01.285091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee352570-39fc-49b4-bb69-d15263da72b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:01.285429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee352570-39fc-49b4-bb69-d15263da72b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:01.286194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee352570-39fc-49b4-bb69-d15263da72b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:01.288757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee352570-39fc-49b4-bb69-d15263da72b7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:01.329510 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1520/3050] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:26:01 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:26:01.333691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ec267-6baf-401b-924d-f427d563236b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:01.366847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ec267-6baf-401b-924d-f427d563236b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:01.494194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019ddf8-128b-43f6-bec4-b3743f017310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:01.494823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019ddf8-128b-43f6-bec4-b3743f017310 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:01.495085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019ddf8-128b-43f6-bec4-b3743f017310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:01.495394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019ddf8-128b-43f6-bec4-b3743f017310 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:01.496140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1019ddf8-128b-43f6-bec4-b3743f017310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:01.497972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1019ddf8-128b-43f6-bec4-b3743f017310 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:01.532194 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1531/3051] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:26:01 2022] POST /identity/v3/users => generated 299 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:26:01.536978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee352570-39fc-49b4-bb69-d15263da72b7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:01.550693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee352570-39fc-49b4-bb69-d15263da72b7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:01.563357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b774321-a558-4701-9c1c-4cf8c267c506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:01.564038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b774321-a558-4701-9c1c-4cf8c267c506 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:01.564254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b774321-a558-4701-9c1c-4cf8c267c506 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:01.564523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b774321-a558-4701-9c1c-4cf8c267c506 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:01.565638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b774321-a558-4701-9c1c-4cf8c267c506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:01.567404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b774321-a558-4701-9c1c-4cf8c267c506 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:01.594397 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1521/3052] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:26:01.598742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019ddf8-128b-43f6-bec4-b3743f017310 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:01.609203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019ddf8-128b-43f6-bec4-b3743f017310 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:01.617802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91b14b-f3ae-4283-a802-283f11d2ef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:01.618490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91b14b-f3ae-4283-a802-283f11d2ef71 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:01.618769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91b14b-f3ae-4283-a802-283f11d2ef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:01.619044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91b14b-f3ae-4283-a802-283f11d2ef71 admin admin] PATH_INFO: `/v3/projects/3710fc0f15fa4e1da95f7de9f6456d85/users/8b8dfc45252c441f9a531ae271c34201/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:01.663667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:01.669002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91b14b-f3ae-4283-a802-283f11d2ef71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3710fc0f15fa4e1da95f7de9f6456d85, user_id=8b8dfc45252c441f9a531ae271c34201, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:01.672516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91b14b-f3ae-4283-a802-283f11d2ef71 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:01.691329 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1532/3053] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:26:01 2022] PUT /identity/v3/projects/3710fc0f15fa4e1da95f7de9f6456d85/users/8b8dfc45252c441f9a531ae271c34201/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:01.695987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b774321-a558-4701-9c1c-4cf8c267c506 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:01.703375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:01.708080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b774321-a558-4701-9c1c-4cf8c267c506 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:01.804176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a6dfd-e1f4-4fd3-af4b-0331d33b914b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:01.804808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a6dfd-e1f4-4fd3-af4b-0331d33b914b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:01.805088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a6dfd-e1f4-4fd3-af4b-0331d33b914b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:01.805384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a6dfd-e1f4-4fd3-af4b-0331d33b914b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:01.806011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a6dfd-e1f4-4fd3-af4b-0331d33b914b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:01.807740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a6dfd-e1f4-4fd3-af4b-0331d33b914b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:01.822727 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1522/3054] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:26:01.827000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91b14b-f3ae-4283-a802-283f11d2ef71 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:01.840605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91b14b-f3ae-4283-a802-283f11d2ef71 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:01.845419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06904a9-c175-4b36-a241-fb9f3489f6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:01.846099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06904a9-c175-4b36-a241-fb9f3489f6db admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:01.846377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06904a9-c175-4b36-a241-fb9f3489f6db admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:01.846645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06904a9-c175-4b36-a241-fb9f3489f6db admin admin] PATH_INFO: `/v3/projects/3710fc0f15fa4e1da95f7de9f6456d85/users/8b8dfc45252c441f9a531ae271c34201/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:01.848769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06904a9-c175-4b36-a241-fb9f3489f6db admin admin] RBAC: Authorizing `identity:create_grant(project_id=3710fc0f15fa4e1da95f7de9f6456d85, user_id=8b8dfc45252c441f9a531ae271c34201, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:01.851470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06904a9-c175-4b36-a241-fb9f3489f6db admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:01.877988 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1533/3055] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:26:01 2022] PUT /identity/v3/projects/3710fc0f15fa4e1da95f7de9f6456d85/users/8b8dfc45252c441f9a531ae271c34201/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:26:01.892098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd6be8-ff4a-4ed1-95d0-83c7776b142d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:01.892379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd6be8-ff4a-4ed1-95d0-83c7776b142d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:01.892659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd6be8-ff4a-4ed1-95d0-83c7776b142d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:01.944735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-12fd6be8-ff4a-4ed1-95d0-83c7776b142d None None] MFA Rules not processed for user `8b8dfc45252c441f9a531ae271c34201`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:01.946860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-12fd6be8-ff4a-4ed1-95d0-83c7776b142d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:02.058935 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1523/3056] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:02.070992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06904a9-c175-4b36-a241-fb9f3489f6db admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:02.072823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f06904a9-c175-4b36-a241-fb9f3489f6db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:02.193868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06904a9-c175-4b36-a241-fb9f3489f6db admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:02.202220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036a6a5-dae9-4a6f-aceb-119803f82e8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:02.203145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036a6a5-dae9-4a6f-aceb-119803f82e8e service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:02.203566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036a6a5-dae9-4a6f-aceb-119803f82e8e service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:02.203967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036a6a5-dae9-4a6f-aceb-119803f82e8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:02.215533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036a6a5-dae9-4a6f-aceb-119803f82e8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:02.228777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036a6a5-dae9-4a6f-aceb-119803f82e8e service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:02.256713 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1534/3057] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:26:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:26:02.897936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd6be8-ff4a-4ed1-95d0-83c7776b142d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:02.996697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd6be8-ff4a-4ed1-95d0-83c7776b142d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:03.001723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76e043-3c39-44fe-8326-1b1dafd32ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:03.002430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76e043-3c39-44fe-8326-1b1dafd32ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:03.002723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76e043-3c39-44fe-8326-1b1dafd32ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:03.003184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76e043-3c39-44fe-8326-1b1dafd32ee5 admin admin] PATH_INFO: `/v3/users/412a4232f67c4d33ba59b166abd05a06` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:03.004720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76e043-3c39-44fe-8326-1b1dafd32ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=412a4232f67c4d33ba59b166abd05a06)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:03.006797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76e043-3c39-44fe-8326-1b1dafd32ee5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:03.051593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:03.087836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4b76e043-3c39-44fe-8326-1b1dafd32ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412a4232f67c4d33ba59b166abd05a06'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:03.105888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4b76e043-3c39-44fe-8326-1b1dafd32ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412a4232f67c4d33ba59b166abd05a06'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:03.107616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4b76e043-3c39-44fe-8326-1b1dafd32ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412a4232f67c4d33ba59b166abd05a06'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:03.108182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4b76e043-3c39-44fe-8326-1b1dafd32ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412a4232f67c4d33ba59b166abd05a06'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:03.118443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4b76e043-3c39-44fe-8326-1b1dafd32ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412a4232f67c4d33ba59b166abd05a06'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:03.136626 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1524/3058] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:26:02 2022] DELETE /identity/v3/users/412a4232f67c4d33ba59b166abd05a06 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:03.140866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bace6-dba0-4d56-ac88-bd867f0872cf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:03.141380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bace6-dba0-4d56-ac88-bd867f0872cf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:03.141493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bace6-dba0-4d56-ac88-bd867f0872cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:03.172824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6c2bace6-dba0-4d56-ac88-bd867f0872cf None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:03.174529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6c2bace6-dba0-4d56-ac88-bd867f0872cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:03.265984 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1535/3059] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:26:03.274677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76e043-3c39-44fe-8326-1b1dafd32ee5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:03.276907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4b76e043-3c39-44fe-8326-1b1dafd32ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:03.363301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76e043-3c39-44fe-8326-1b1dafd32ee5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:03.377767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416cf12-ce74-43e0-bef3-b79a6a4c4fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:03.378499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416cf12-ce74-43e0-bef3-b79a6a4c4fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:03.378819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416cf12-ce74-43e0-bef3-b79a6a4c4fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:03.379300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416cf12-ce74-43e0-bef3-b79a6a4c4fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:03.389356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416cf12-ce74-43e0-bef3-b79a6a4c4fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:03.390795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416cf12-ce74-43e0-bef3-b79a6a4c4fa7 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:03.401130 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1525/3060] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:26:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:26:03.720752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bace6-dba0-4d56-ac88-bd867f0872cf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:03.724303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6c2bace6-dba0-4d56-ac88-bd867f0872cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:03.754897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bace6-dba0-4d56-ac88-bd867f0872cf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:03.759942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe6f54-879c-47e6-a4b3-9610cd856c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:03.760724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe6f54-879c-47e6-a4b3-9610cd856c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:03.761067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe6f54-879c-47e6-a4b3-9610cd856c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:03.761461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe6f54-879c-47e6-a4b3-9610cd856c95 admin admin] PATH_INFO: `/v3/projects/b337d5aefa994bff9525b80828c65b49` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:03.762637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe6f54-879c-47e6-a4b3-9610cd856c95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b337d5aefa994bff9525b80828c65b49)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:03.764821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe6f54-879c-47e6-a4b3-9610cd856c95 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:03.821286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12fe6f54-879c-47e6-a4b3-9610cd856c95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b337d5aefa994bff9525b80828c65b49', 'request_id': 'req-12fe6f54-879c-47e6-a4b3-9610cd856c95'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:03.830267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12fe6f54-879c-47e6-a4b3-9610cd856c95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b337d5aefa994bff9525b80828c65b49', 'request_id': 'req-12fe6f54-879c-47e6-a4b3-9610cd856c95'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:03.833268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:03.839971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12fe6f54-879c-47e6-a4b3-9610cd856c95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b337d5aefa994bff9525b80828c65b49', 'request_id': 'req-12fe6f54-879c-47e6-a4b3-9610cd856c95'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:03.857682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12fe6f54-879c-47e6-a4b3-9610cd856c95 admin admin] The token cache is being invalidate because project b337d5aefa994bff9525b80828c65b49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:26:03.858258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12fe6f54-879c-47e6-a4b3-9610cd856c95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:03.859135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12fe6f54-879c-47e6-a4b3-9610cd856c95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:03.861123 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1536/3061] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:26:03 2022] DELETE /identity/v3/projects/b337d5aefa994bff9525b80828c65b49 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:03.865405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416cf12-ce74-43e0-bef3-b79a6a4c4fa7 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:03.876464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416cf12-ce74-43e0-bef3-b79a6a4c4fa7 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:03.937413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ee5a0-a7ba-4010-8688-20036046448f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:03.938138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ee5a0-a7ba-4010-8688-20036046448f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:03.938302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ee5a0-a7ba-4010-8688-20036046448f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:03.938573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ee5a0-a7ba-4010-8688-20036046448f admin admin] PATH_INFO: `/v3/users/8b8dfc45252c441f9a531ae271c34201` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:03.939723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ee5a0-a7ba-4010-8688-20036046448f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b8dfc45252c441f9a531ae271c34201)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:03.941622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ee5a0-a7ba-4010-8688-20036046448f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:03.991480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b1ee5a0-a7ba-4010-8688-20036046448f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b8dfc45252c441f9a531ae271c34201'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:03.993731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:04.007111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b1ee5a0-a7ba-4010-8688-20036046448f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b8dfc45252c441f9a531ae271c34201'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:04.007889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b1ee5a0-a7ba-4010-8688-20036046448f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b8dfc45252c441f9a531ae271c34201'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:04.008481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b1ee5a0-a7ba-4010-8688-20036046448f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b8dfc45252c441f9a531ae271c34201'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:04.016671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b1ee5a0-a7ba-4010-8688-20036046448f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b8dfc45252c441f9a531ae271c34201'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:04.030120 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1526/3062] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:26:03 2022] DELETE /identity/v3/users/8b8dfc45252c441f9a531ae271c34201 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:04.321767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe6f54-879c-47e6-a4b3-9610cd856c95 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:04.323281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-12fe6f54-879c-47e6-a4b3-9610cd856c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:04.338359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe6f54-879c-47e6-a4b3-9610cd856c95 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:04.408318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58222aa-2a3c-4fbe-934c-102db9b4e219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:04.409279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58222aa-2a3c-4fbe-934c-102db9b4e219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:04.409607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58222aa-2a3c-4fbe-934c-102db9b4e219 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:04.409991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58222aa-2a3c-4fbe-934c-102db9b4e219 admin admin] PATH_INFO: `/v3/projects/3710fc0f15fa4e1da95f7de9f6456d85` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:04.411339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58222aa-2a3c-4fbe-934c-102db9b4e219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3710fc0f15fa4e1da95f7de9f6456d85)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:04.416554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58222aa-2a3c-4fbe-934c-102db9b4e219 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:04.487088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f58222aa-2a3c-4fbe-934c-102db9b4e219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3710fc0f15fa4e1da95f7de9f6456d85', 'request_id': 'req-f58222aa-2a3c-4fbe-934c-102db9b4e219'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:04.498152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f58222aa-2a3c-4fbe-934c-102db9b4e219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3710fc0f15fa4e1da95f7de9f6456d85', 'request_id': 'req-f58222aa-2a3c-4fbe-934c-102db9b4e219'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:04.510932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f58222aa-2a3c-4fbe-934c-102db9b4e219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3710fc0f15fa4e1da95f7de9f6456d85', 'request_id': 'req-f58222aa-2a3c-4fbe-934c-102db9b4e219'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:04.525980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f58222aa-2a3c-4fbe-934c-102db9b4e219 admin admin] The token cache is being invalidate because project 3710fc0f15fa4e1da95f7de9f6456d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:26:04.526453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f58222aa-2a3c-4fbe-934c-102db9b4e219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:04.527468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f58222aa-2a3c-4fbe-934c-102db9b4e219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:04.529657 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1537/3063] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:26:04 2022] DELETE /identity/v3/projects/3710fc0f15fa4e1da95f7de9f6456d85 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:04.534532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740886c-f56f-47ac-8f0b-a6b31a11ce82 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:04.534822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740886c-f56f-47ac-8f0b-a6b31a11ce82 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:04.535142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740886c-f56f-47ac-8f0b-a6b31a11ce82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:04.568991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f740886c-f56f-47ac-8f0b-a6b31a11ce82 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:04.570582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f740886c-f56f-47ac-8f0b-a6b31a11ce82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:04.635488 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1527/3064] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:04.643976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79aa0c1-3ecd-4746-a116-4c222c9408ef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:04.644369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79aa0c1-3ecd-4746-a116-4c222c9408ef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:04.644740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79aa0c1-3ecd-4746-a116-4c222c9408ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:04.666011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e79aa0c1-3ecd-4746-a116-4c222c9408ef None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:04.667459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e79aa0c1-3ecd-4746-a116-4c222c9408ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:04.676687 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1538/3065] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:04.680580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740886c-f56f-47ac-8f0b-a6b31a11ce82 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:04.693532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740886c-f56f-47ac-8f0b-a6b31a11ce82 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:04.700476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c182916-03dc-460c-9c00-6edb2c62cddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:04.700656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c182916-03dc-460c-9c00-6edb2c62cddc admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:04.700975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c182916-03dc-460c-9c00-6edb2c62cddc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:04.701341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c182916-03dc-460c-9c00-6edb2c62cddc admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:04.702230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c182916-03dc-460c-9c00-6edb2c62cddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:26:04.702628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c182916-03dc-460c-9c00-6edb2c62cddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:04.704379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c182916-03dc-460c-9c00-6edb2c62cddc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:04.722127 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1528/3066] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:26:04.727412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79aa0c1-3ecd-4746-a116-4c222c9408ef None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:04.737540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79aa0c1-3ecd-4746-a116-4c222c9408ef None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:04.742543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd936a7e-2429-483b-b10b-cc2133650d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:04.743161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd936a7e-2429-483b-b10b-cc2133650d58 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:04.743471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd936a7e-2429-483b-b10b-cc2133650d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:04.743745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd936a7e-2429-483b-b10b-cc2133650d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:04.744617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd936a7e-2429-483b-b10b-cc2133650d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:04.749294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd936a7e-2429-483b-b10b-cc2133650d58 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:04.785131 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1539/3067] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:26:04 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:26:04.786371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c182916-03dc-460c-9c00-6edb2c62cddc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:04.797786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c182916-03dc-460c-9c00-6edb2c62cddc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:04.882514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fe158-2149-432c-99e8-221c059b41fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:04.883341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fe158-2149-432c-99e8-221c059b41fb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:04.883626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fe158-2149-432c-99e8-221c059b41fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:04.883902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fe158-2149-432c-99e8-221c059b41fb admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:04.884550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3fe158-2149-432c-99e8-221c059b41fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:04.886619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3fe158-2149-432c-99e8-221c059b41fb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:04.913685 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1529/3068] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:26:04 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:26:04.918040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd936a7e-2429-483b-b10b-cc2133650d58 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:04.929618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd936a7e-2429-483b-b10b-cc2133650d58 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:04.935368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77484a-1e7f-4e32-80ac-7df72e0efb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:04.936108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77484a-1e7f-4e32-80ac-7df72e0efb41 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:04.936450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77484a-1e7f-4e32-80ac-7df72e0efb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:04.936646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77484a-1e7f-4e32-80ac-7df72e0efb41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:04.937291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77484a-1e7f-4e32-80ac-7df72e0efb41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:04.939134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77484a-1e7f-4e32-80ac-7df72e0efb41 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:04.951838 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1540/3069] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:26:04.954963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fe158-2149-432c-99e8-221c059b41fb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:04.969106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fe158-2149-432c-99e8-221c059b41fb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:04.976533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923f1f5-8087-45ee-9519-9dc438fc25c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:04.977516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923f1f5-8087-45ee-9519-9dc438fc25c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:04.978082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923f1f5-8087-45ee-9519-9dc438fc25c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:04.978576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923f1f5-8087-45ee-9519-9dc438fc25c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:04.979511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923f1f5-8087-45ee-9519-9dc438fc25c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:04.981364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923f1f5-8087-45ee-9519-9dc438fc25c3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:04.995745 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1530/3070] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:26:04.999996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77484a-1e7f-4e32-80ac-7df72e0efb41 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:05.010521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77484a-1e7f-4e32-80ac-7df72e0efb41 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:05.015169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fd4ba-5eaa-482d-a1cb-e43e230a4ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:05.015877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fd4ba-5eaa-482d-a1cb-e43e230a4ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:05.016166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fd4ba-5eaa-482d-a1cb-e43e230a4ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:05.016438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fd4ba-5eaa-482d-a1cb-e43e230a4ad4 admin admin] PATH_INFO: `/v3/projects/b85024c393984914b3adb2e0b34cd507/users/0513ade385a24ca59a54ffbf20dcba9b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:05.033151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fd4ba-5eaa-482d-a1cb-e43e230a4ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85024c393984914b3adb2e0b34cd507, user_id=0513ade385a24ca59a54ffbf20dcba9b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:05.035886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fd4ba-5eaa-482d-a1cb-e43e230a4ad4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:05.051582 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1541/3071] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:26:04 2022] PUT /identity/v3/projects/b85024c393984914b3adb2e0b34cd507/users/0513ade385a24ca59a54ffbf20dcba9b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:05.057232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305f0a3-bf05-4735-ada4-ab5e962711a1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:05.057772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305f0a3-bf05-4735-ada4-ab5e962711a1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:05.058046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305f0a3-bf05-4735-ada4-ab5e962711a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:05.078111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f305f0a3-bf05-4735-ada4-ab5e962711a1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:05.079372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f305f0a3-bf05-4735-ada4-ab5e962711a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:05.110702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:05.143429 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1531/3072] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:05.153328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fd4ba-5eaa-482d-a1cb-e43e230a4ad4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:05.155174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-961fd4ba-5eaa-482d-a1cb-e43e230a4ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:05.170388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:05.215481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fd4ba-5eaa-482d-a1cb-e43e230a4ad4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:05.219199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38c6e9-8feb-433a-96c2-34ed1c1dc819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:05.219856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38c6e9-8feb-433a-96c2-34ed1c1dc819 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:05.220134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38c6e9-8feb-433a-96c2-34ed1c1dc819 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:05.220411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38c6e9-8feb-433a-96c2-34ed1c1dc819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:05.229874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38c6e9-8feb-433a-96c2-34ed1c1dc819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:05.231463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38c6e9-8feb-433a-96c2-34ed1c1dc819 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:05.241781 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1542/3073] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:26:07.993285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305f0a3-bf05-4735-ada4-ab5e962711a1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:07.994882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f305f0a3-bf05-4735-ada4-ab5e962711a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:08.033266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305f0a3-bf05-4735-ada4-ab5e962711a1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:08.052509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb166790-bf33-40c6-9c61-7d784b187b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:08.053145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb166790-bf33-40c6-9c61-7d784b187b52 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:08.053613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb166790-bf33-40c6-9c61-7d784b187b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:08.054064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb166790-bf33-40c6-9c61-7d784b187b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:08.061005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bb166790-bf33-40c6-9c61-7d784b187b52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:08.108532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb166790-bf33-40c6-9c61-7d784b187b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:08.110260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb166790-bf33-40c6-9c61-7d784b187b52 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:08.130396 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1532/3074] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:26:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:26:08.334400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9e8f9-9d85-4cd3-b65d-7bacd164c835 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:08.334940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9e8f9-9d85-4cd3-b65d-7bacd164c835 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:08.334940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9e8f9-9d85-4cd3-b65d-7bacd164c835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:08.355537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-09b9e8f9-9d85-4cd3-b65d-7bacd164c835 None None] MFA Rules not processed for user `a3f83d2a0be442cb83593a030e92c752`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:08.358449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09b9e8f9-9d85-4cd3-b65d-7bacd164c835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:08.458313 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1543/3075] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:12.760034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9feaf-ffb3-428b-ba57-842305f58804 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:12.760557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9feaf-ffb3-428b-ba57-842305f58804 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:12.760752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9feaf-ffb3-428b-ba57-842305f58804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:12.799493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ddc9feaf-ffb3-428b-ba57-842305f58804 None None] MFA Rules not processed for user `0513ade385a24ca59a54ffbf20dcba9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:12.801304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ddc9feaf-ffb3-428b-ba57-842305f58804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:12.935302 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1533/3076] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:12.975658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9e8f9-9d85-4cd3-b65d-7bacd164c835 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:12.977409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09b9e8f9-9d85-4cd3-b65d-7bacd164c835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:13.131555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9e8f9-9d85-4cd3-b65d-7bacd164c835 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:13.139287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e576c6e-2795-45c3-8a53-2d9e2b5f3128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:13.140029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e576c6e-2795-45c3-8a53-2d9e2b5f3128 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:13.141213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e576c6e-2795-45c3-8a53-2d9e2b5f3128 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:13.141609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e576c6e-2795-45c3-8a53-2d9e2b5f3128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:13.157591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e576c6e-2795-45c3-8a53-2d9e2b5f3128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:13.160006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e576c6e-2795-45c3-8a53-2d9e2b5f3128 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:13.171083 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1544/3077] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:26:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:26:17.015578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9feaf-ffb3-428b-ba57-842305f58804 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:17.019469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ddc9feaf-ffb3-428b-ba57-842305f58804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:17.059003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9feaf-ffb3-428b-ba57-842305f58804 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:17.077645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eae98-095d-4a0e-80b4-464605847460 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:17.080051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eae98-095d-4a0e-80b4-464605847460 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:17.080336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eae98-095d-4a0e-80b4-464605847460 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:17.080614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eae98-095d-4a0e-80b4-464605847460 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:17.091159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-749eae98-095d-4a0e-80b4-464605847460 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:17.202004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749eae98-095d-4a0e-80b4-464605847460 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:17.204037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749eae98-095d-4a0e-80b4-464605847460 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:17.258906 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1534/3078] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:26:17 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:26:20.020657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e576c6e-2795-45c3-8a53-2d9e2b5f3128 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:20.020657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e576c6e-2795-45c3-8a53-2d9e2b5f3128 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:20.044451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e576c6e-2795-45c3-8a53-2d9e2b5f3128 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:20.053332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebac7ef-a823-43f3-90f1-2ebf1ee8d538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:20.054291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebac7ef-a823-43f3-90f1-2ebf1ee8d538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:20.054745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebac7ef-a823-43f3-90f1-2ebf1ee8d538 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:20.055181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebac7ef-a823-43f3-90f1-2ebf1ee8d538 admin admin] PATH_INFO: `/v3/users/2995563d841d4baba4da789f62c4962b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:20.056769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebac7ef-a823-43f3-90f1-2ebf1ee8d538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2995563d841d4baba4da789f62c4962b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:20.058936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebac7ef-a823-43f3-90f1-2ebf1ee8d538 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:20.116950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:20.128405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aebac7ef-a823-43f3-90f1-2ebf1ee8d538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2995563d841d4baba4da789f62c4962b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:20.129530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aebac7ef-a823-43f3-90f1-2ebf1ee8d538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2995563d841d4baba4da789f62c4962b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:20.138827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aebac7ef-a823-43f3-90f1-2ebf1ee8d538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2995563d841d4baba4da789f62c4962b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:20.158723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aebac7ef-a823-43f3-90f1-2ebf1ee8d538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2995563d841d4baba4da789f62c4962b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:20.180353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aebac7ef-a823-43f3-90f1-2ebf1ee8d538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2995563d841d4baba4da789f62c4962b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:20.190035 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1545/3079] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:26:20 2022] DELETE /identity/v3/users/2995563d841d4baba4da789f62c4962b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:20.194580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304efc9-c279-45cc-8b7d-8367339c65ba None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:20.195115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304efc9-c279-45cc-8b7d-8367339c65ba None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:20.195306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304efc9-c279-45cc-8b7d-8367339c65ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:20.224962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9304efc9-c279-45cc-8b7d-8367339c65ba None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:20.226676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9304efc9-c279-45cc-8b7d-8367339c65ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:20.326280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:20.368494 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1535/3080] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:20.424764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebac7ef-a823-43f3-90f1-2ebf1ee8d538 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:20.424764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aebac7ef-a823-43f3-90f1-2ebf1ee8d538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:20.582043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebac7ef-a823-43f3-90f1-2ebf1ee8d538 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:20.600160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bad60a-d164-463d-81b1-726f90c1eafd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:20.600946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bad60a-d164-463d-81b1-726f90c1eafd service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:20.601336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bad60a-d164-463d-81b1-726f90c1eafd service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:20.601715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bad60a-d164-463d-81b1-726f90c1eafd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:20.619163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bad60a-d164-463d-81b1-726f90c1eafd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:20.621565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bad60a-d164-463d-81b1-726f90c1eafd service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:20.662878 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1546/3081] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:26:21.240200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304efc9-c279-45cc-8b7d-8367339c65ba None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:21.241840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9304efc9-c279-45cc-8b7d-8367339c65ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:21.307224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304efc9-c279-45cc-8b7d-8367339c65ba None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:21.319710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdde8c-b1eb-4c92-a8a6-3ac764bd290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:21.320260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdde8c-b1eb-4c92-a8a6-3ac764bd290f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:21.320541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdde8c-b1eb-4c92-a8a6-3ac764bd290f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:21.320819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdde8c-b1eb-4c92-a8a6-3ac764bd290f admin admin] PATH_INFO: `/v3/projects/23e57590bec2494891b0a39fa6e9ee9d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:21.322041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdde8c-b1eb-4c92-a8a6-3ac764bd290f admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e57590bec2494891b0a39fa6e9ee9d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:21.324190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdde8c-b1eb-4c92-a8a6-3ac764bd290f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:21.421677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-46cdde8c-b1eb-4c92-a8a6-3ac764bd290f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e57590bec2494891b0a39fa6e9ee9d', 'request_id': 'req-46cdde8c-b1eb-4c92-a8a6-3ac764bd290f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:21.433115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-46cdde8c-b1eb-4c92-a8a6-3ac764bd290f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e57590bec2494891b0a39fa6e9ee9d', 'request_id': 'req-46cdde8c-b1eb-4c92-a8a6-3ac764bd290f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:21.441392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-46cdde8c-b1eb-4c92-a8a6-3ac764bd290f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e57590bec2494891b0a39fa6e9ee9d', 'request_id': 'req-46cdde8c-b1eb-4c92-a8a6-3ac764bd290f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:21.484993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-46cdde8c-b1eb-4c92-a8a6-3ac764bd290f admin admin] The token cache is being invalidate because project 23e57590bec2494891b0a39fa6e9ee9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:26:21.484993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-46cdde8c-b1eb-4c92-a8a6-3ac764bd290f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:21.484993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-46cdde8c-b1eb-4c92-a8a6-3ac764bd290f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:21.501155 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1536/3082] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:26:21 2022] DELETE /identity/v3/projects/23e57590bec2494891b0a39fa6e9ee9d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:21.502250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651cb12-932e-4128-bd61-cd8219bf912a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:21.502754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651cb12-932e-4128-bd61-cd8219bf912a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:21.503136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651cb12-932e-4128-bd61-cd8219bf912a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:21.550335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6651cb12-932e-4128-bd61-cd8219bf912a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:21.552192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6651cb12-932e-4128-bd61-cd8219bf912a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:21.665313 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1547/3083] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:21.667528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb566f1-e715-443d-9d50-95366d3e7e56 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:21.667813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb566f1-e715-443d-9d50-95366d3e7e56 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:21.668105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb566f1-e715-443d-9d50-95366d3e7e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:21.726804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6eb566f1-e715-443d-9d50-95366d3e7e56 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:21.731932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6eb566f1-e715-443d-9d50-95366d3e7e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:21.760327 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1537/3084] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:21.760903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651cb12-932e-4128-bd61-cd8219bf912a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:21.776524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651cb12-932e-4128-bd61-cd8219bf912a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:21.788261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e51bdc-9a24-4aa0-8031-97e9115c7828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:21.788901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e51bdc-9a24-4aa0-8031-97e9115c7828 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:21.789185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e51bdc-9a24-4aa0-8031-97e9115c7828 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:21.789461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e51bdc-9a24-4aa0-8031-97e9115c7828 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:21.795168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e51bdc-9a24-4aa0-8031-97e9115c7828 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:26:21.797261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e51bdc-9a24-4aa0-8031-97e9115c7828 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:21.799822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e51bdc-9a24-4aa0-8031-97e9115c7828 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:21.838691 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1548/3085] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:26:21.839569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb566f1-e715-443d-9d50-95366d3e7e56 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:21.858250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb566f1-e715-443d-9d50-95366d3e7e56 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:21.872446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247154a6-fee8-429b-9a89-fccf33b93378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:21.873100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247154a6-fee8-429b-9a89-fccf33b93378 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:21.873385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247154a6-fee8-429b-9a89-fccf33b93378 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:21.873669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247154a6-fee8-429b-9a89-fccf33b93378 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:21.874330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247154a6-fee8-429b-9a89-fccf33b93378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:21.876321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247154a6-fee8-429b-9a89-fccf33b93378 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:21.952643 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1538/3086] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:26:21 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:26:21.957090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e51bdc-9a24-4aa0-8031-97e9115c7828 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:21.970734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e51bdc-9a24-4aa0-8031-97e9115c7828 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:22.029928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:22.047289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79786d6d-c517-41a1-8bb0-bd47cf9f9d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:22.047289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79786d6d-c517-41a1-8bb0-bd47cf9f9d52 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:22.047613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79786d6d-c517-41a1-8bb0-bd47cf9f9d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:22.047698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79786d6d-c517-41a1-8bb0-bd47cf9f9d52 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:22.048806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79786d6d-c517-41a1-8bb0-bd47cf9f9d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:22.052316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79786d6d-c517-41a1-8bb0-bd47cf9f9d52 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:22.086743 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1549/3087] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:26:21 2022] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:26:22.090586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247154a6-fee8-429b-9a89-fccf33b93378 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:22.106248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247154a6-fee8-429b-9a89-fccf33b93378 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:22.108509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d4c7b-e9bb-4067-8283-d37ba42f9bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:22.109122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d4c7b-e9bb-4067-8283-d37ba42f9bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:22.109400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d4c7b-e9bb-4067-8283-d37ba42f9bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:22.109670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d4c7b-e9bb-4067-8283-d37ba42f9bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:22.110334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d4c7b-e9bb-4067-8283-d37ba42f9bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:22.112717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d4c7b-e9bb-4067-8283-d37ba42f9bb6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:22.130887 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1539/3088] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:26:22.134933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79786d6d-c517-41a1-8bb0-bd47cf9f9d52 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:22.150522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79786d6d-c517-41a1-8bb0-bd47cf9f9d52 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:22.168671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af58d0-ed69-4dff-80da-47785fb168f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:22.169313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af58d0-ed69-4dff-80da-47785fb168f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:22.169592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af58d0-ed69-4dff-80da-47785fb168f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:22.169865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af58d0-ed69-4dff-80da-47785fb168f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:22.170517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af58d0-ed69-4dff-80da-47785fb168f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:22.172179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af58d0-ed69-4dff-80da-47785fb168f1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:22.185221 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1550/3089] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:26:22.189239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d4c7b-e9bb-4067-8283-d37ba42f9bb6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:22.202080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d4c7b-e9bb-4067-8283-d37ba42f9bb6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:22.210209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f0b14-00f7-41b7-80d6-a7515d91195d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:22.211138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0b14-00f7-41b7-80d6-a7515d91195d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:22.211693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0b14-00f7-41b7-80d6-a7515d91195d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:22.212211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0b14-00f7-41b7-80d6-a7515d91195d admin admin] PATH_INFO: `/v3/projects/6d4af3cd3c434f9c98773e9b99f32572/users/7eacd8c6cbf84a2fa726e0c26e587d09/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:22.232602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f0b14-00f7-41b7-80d6-a7515d91195d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d4af3cd3c434f9c98773e9b99f32572, user_id=7eacd8c6cbf84a2fa726e0c26e587d09, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:22.236713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f0b14-00f7-41b7-80d6-a7515d91195d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:22.257146 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1540/3090] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:26:22 2022] PUT /identity/v3/projects/6d4af3cd3c434f9c98773e9b99f32572/users/7eacd8c6cbf84a2fa726e0c26e587d09/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:22.270030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e6d51-abf1-406a-b304-1db09ddd632b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:22.270292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e6d51-abf1-406a-b304-1db09ddd632b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:22.270634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e6d51-abf1-406a-b304-1db09ddd632b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:22.327450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8f5e6d51-abf1-406a-b304-1db09ddd632b None None] MFA Rules not processed for user `7eacd8c6cbf84a2fa726e0c26e587d09`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:22.332460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8f5e6d51-abf1-406a-b304-1db09ddd632b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:22.497810 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1551/3091] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:22.499528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ea91-185a-4d51-a8f0-e9c1d6e7a3fe None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:22.499978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ea91-185a-4d51-a8f0-e9c1d6e7a3fe None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:22.500427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ea91-185a-4d51-a8f0-e9c1d6e7a3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:22.537616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4cd2ea91-185a-4d51-a8f0-e9c1d6e7a3fe None None] MFA Rules not processed for user `7eacd8c6cbf84a2fa726e0c26e587d09`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:22.538865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4cd2ea91-185a-4d51-a8f0-e9c1d6e7a3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:22.563965 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1541/3092] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:23.152311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e6d51-abf1-406a-b304-1db09ddd632b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:23.154051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8f5e6d51-abf1-406a-b304-1db09ddd632b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:23.244121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e6d51-abf1-406a-b304-1db09ddd632b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:23.250203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cd3e6-894d-4ee4-a3c9-7da53c8082b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:23.250831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cd3e6-894d-4ee4-a3c9-7da53c8082b3 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:23.251111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cd3e6-894d-4ee4-a3c9-7da53c8082b3 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:23.251439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cd3e6-894d-4ee4-a3c9-7da53c8082b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:23.263001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cd3e6-894d-4ee4-a3c9-7da53c8082b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:23.265080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cd3e6-894d-4ee4-a3c9-7da53c8082b3 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:23.276551 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1552/3093] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:26:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:26:29.050440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2ea91-185a-4d51-a8f0-e9c1d6e7a3fe None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:29.053525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4cd2ea91-185a-4d51-a8f0-e9c1d6e7a3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:29.224287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2ea91-185a-4d51-a8f0-e9c1d6e7a3fe None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:29.231995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82037156-efcc-490a-8d32-0fb9481e7042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:29.232993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82037156-efcc-490a-8d32-0fb9481e7042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:29.233424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82037156-efcc-490a-8d32-0fb9481e7042 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:29.234012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82037156-efcc-490a-8d32-0fb9481e7042 admin admin] PATH_INFO: `/v3/users/2da56a6076bb474b957763142c6eec0a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:29.235535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82037156-efcc-490a-8d32-0fb9481e7042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2da56a6076bb474b957763142c6eec0a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:29.239571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82037156-efcc-490a-8d32-0fb9481e7042 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:29.242844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:29.332511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-82037156-efcc-490a-8d32-0fb9481e7042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2da56a6076bb474b957763142c6eec0a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:29.348664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-82037156-efcc-490a-8d32-0fb9481e7042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2da56a6076bb474b957763142c6eec0a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:29.349321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-82037156-efcc-490a-8d32-0fb9481e7042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2da56a6076bb474b957763142c6eec0a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:29.350203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-82037156-efcc-490a-8d32-0fb9481e7042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2da56a6076bb474b957763142c6eec0a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:29.365108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-82037156-efcc-490a-8d32-0fb9481e7042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2da56a6076bb474b957763142c6eec0a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:29.417614 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1542/3094] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:26:29 2022] DELETE /identity/v3/users/2da56a6076bb474b957763142c6eec0a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:29.819560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cd3e6-894d-4ee4-a3c9-7da53c8082b3 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:29.865308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cd3e6-894d-4ee4-a3c9-7da53c8082b3 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:29.952009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:30.006438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc7089-e317-4ce5-ae14-1b34c209508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:30.008032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc7089-e317-4ce5-ae14-1b34c209508f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:30.008495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc7089-e317-4ce5-ae14-1b34c209508f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:30.008947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc7089-e317-4ce5-ae14-1b34c209508f admin admin] PATH_INFO: `/v3/projects/c80f9ef9415647c494b81a39abbb95bf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:30.010993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc7089-e317-4ce5-ae14-1b34c209508f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c80f9ef9415647c494b81a39abbb95bf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:30.013165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc7089-e317-4ce5-ae14-1b34c209508f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:30.133246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51fc7089-e317-4ce5-ae14-1b34c209508f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c80f9ef9415647c494b81a39abbb95bf', 'request_id': 'req-51fc7089-e317-4ce5-ae14-1b34c209508f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:30.149639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51fc7089-e317-4ce5-ae14-1b34c209508f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c80f9ef9415647c494b81a39abbb95bf', 'request_id': 'req-51fc7089-e317-4ce5-ae14-1b34c209508f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:30.158317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51fc7089-e317-4ce5-ae14-1b34c209508f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c80f9ef9415647c494b81a39abbb95bf', 'request_id': 'req-51fc7089-e317-4ce5-ae14-1b34c209508f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:30.195940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51fc7089-e317-4ce5-ae14-1b34c209508f admin admin] The token cache is being invalidate because project c80f9ef9415647c494b81a39abbb95bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:26:30.196654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51fc7089-e317-4ce5-ae14-1b34c209508f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:30.197700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51fc7089-e317-4ce5-ae14-1b34c209508f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:30.202735 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1553/3095] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:26:29 2022] DELETE /identity/v3/projects/c80f9ef9415647c494b81a39abbb95bf => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:30.208220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a251f39-a1a6-4e35-b017-d96ac80eaba8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:30.208879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a251f39-a1a6-4e35-b017-d96ac80eaba8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:30.208879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a251f39-a1a6-4e35-b017-d96ac80eaba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:30.287222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6a251f39-a1a6-4e35-b017-d96ac80eaba8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:30.289050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6a251f39-a1a6-4e35-b017-d96ac80eaba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:30.441536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4679e65-4575-466d-9cc6-aec492f21feb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:30.441796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4679e65-4575-466d-9cc6-aec492f21feb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:30.442065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4679e65-4575-466d-9cc6-aec492f21feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:30.451638 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1543/3096] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:30.505364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f4679e65-4575-466d-9cc6-aec492f21feb None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:30.506917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4679e65-4575-466d-9cc6-aec492f21feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:30.523057 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1554/3097] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:26:30.528968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a251f39-a1a6-4e35-b017-d96ac80eaba8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:30.577335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a251f39-a1a6-4e35-b017-d96ac80eaba8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:30.590641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fdb1f-c0c3-46df-be14-4f8caf964e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:30.591937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fdb1f-c0c3-46df-be14-4f8caf964e93 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:30.592215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fdb1f-c0c3-46df-be14-4f8caf964e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:30.596053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fdb1f-c0c3-46df-be14-4f8caf964e93 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:30.599770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913fdb1f-c0c3-46df-be14-4f8caf964e93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:26:30.599770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913fdb1f-c0c3-46df-be14-4f8caf964e93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:30.601834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913fdb1f-c0c3-46df-be14-4f8caf964e93 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:30.634123 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1544/3098] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:26:30.635055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4679e65-4575-466d-9cc6-aec492f21feb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:30.647105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4679e65-4575-466d-9cc6-aec492f21feb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:30.661308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec005bb-9787-43c7-9348-0339124444b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:30.663126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec005bb-9787-43c7-9348-0339124444b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:30.666817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec005bb-9787-43c7-9348-0339124444b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:30.668088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec005bb-9787-43c7-9348-0339124444b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:30.668889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec005bb-9787-43c7-9348-0339124444b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:30.673708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec005bb-9787-43c7-9348-0339124444b7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:30.738549 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1555/3099] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:26:30 2022] POST /identity/v3/projects => generated 399 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:26:30.742423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fdb1f-c0c3-46df-be14-4f8caf964e93 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:30.758059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fdb1f-c0c3-46df-be14-4f8caf964e93 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:30.888845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7106c98-d0a1-4555-837a-352bad96f7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:30.889646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7106c98-d0a1-4555-837a-352bad96f7ce admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:30.890038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7106c98-d0a1-4555-837a-352bad96f7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:30.890411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7106c98-d0a1-4555-837a-352bad96f7ce admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:30.891185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7106c98-d0a1-4555-837a-352bad96f7ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:30.894338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7106c98-d0a1-4555-837a-352bad96f7ce admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:30.932510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:30.942513 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1545/3100] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:26:30 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:26:30.946472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec005bb-9787-43c7-9348-0339124444b7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:30.958954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec005bb-9787-43c7-9348-0339124444b7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:30.975641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa980ab9-c3cf-40ec-8939-a96d5f758192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:30.976921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980ab9-c3cf-40ec-8939-a96d5f758192 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:30.978040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980ab9-c3cf-40ec-8939-a96d5f758192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:30.978879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980ab9-c3cf-40ec-8939-a96d5f758192 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:30.979896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa980ab9-c3cf-40ec-8939-a96d5f758192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:30.981961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa980ab9-c3cf-40ec-8939-a96d5f758192 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:31.010215 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1556/3101] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:26:31.014803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7106c98-d0a1-4555-837a-352bad96f7ce admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:31.045435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7106c98-d0a1-4555-837a-352bad96f7ce admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:31.053393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b1933-b058-42d7-abf4-df5558a2200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:31.054127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1933-b058-42d7-abf4-df5558a2200b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:31.054497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1933-b058-42d7-abf4-df5558a2200b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:31.054996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1933-b058-42d7-abf4-df5558a2200b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:31.056120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b1933-b058-42d7-abf4-df5558a2200b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:31.057975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b1933-b058-42d7-abf4-df5558a2200b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:31.071713 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1546/3102] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:26:31.075788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa980ab9-c3cf-40ec-8939-a96d5f758192 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:31.086597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa980ab9-c3cf-40ec-8939-a96d5f758192 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:31.103743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b67ec5-6f96-461e-839b-d6701479d7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:31.104436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b67ec5-6f96-461e-839b-d6701479d7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:31.104719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b67ec5-6f96-461e-839b-d6701479d7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:31.105013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b67ec5-6f96-461e-839b-d6701479d7a6 admin admin] PATH_INFO: `/v3/projects/a14dcd6412774fdc842af92fd1c5cd67/users/8f4bc37e4f9b474389e34af0a65151cf/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:31.134311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b67ec5-6f96-461e-839b-d6701479d7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14dcd6412774fdc842af92fd1c5cd67, user_id=8f4bc37e4f9b474389e34af0a65151cf, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:31.144662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b67ec5-6f96-461e-839b-d6701479d7a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:31.168193 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1557/3103] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:26:31 2022] PUT /identity/v3/projects/a14dcd6412774fdc842af92fd1c5cd67/users/8f4bc37e4f9b474389e34af0a65151cf/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:31.173373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee511d09-6f13-4484-8231-f98be5c92b13 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:31.173696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee511d09-6f13-4484-8231-f98be5c92b13 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:31.173974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee511d09-6f13-4484-8231-f98be5c92b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:31.201956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b67ec5-6f96-461e-839b-d6701479d7a6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:31.224186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68b67ec5-6f96-461e-839b-d6701479d7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:31.239760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ee511d09-6f13-4484-8231-f98be5c92b13 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:31.241813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ee511d09-6f13-4484-8231-f98be5c92b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:31.387111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b67ec5-6f96-461e-839b-d6701479d7a6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:31.393571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4ca29-0cd5-41ce-b9c0-20960d619f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:31.394258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4ca29-0cd5-41ce-b9c0-20960d619f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:31.394537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4ca29-0cd5-41ce-b9c0-20960d619f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:31.394921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4ca29-0cd5-41ce-b9c0-20960d619f46 admin admin] PATH_INFO: `/v3/users/0513ade385a24ca59a54ffbf20dcba9b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:31.396897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4ca29-0cd5-41ce-b9c0-20960d619f46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0513ade385a24ca59a54ffbf20dcba9b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:31.399605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4ca29-0cd5-41ce-b9c0-20960d619f46 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:31.414045 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1547/3104] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:31.416369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:31.427329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee511d09-6f13-4484-8231-f98be5c92b13 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:31.440241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ee511d09-6f13-4484-8231-f98be5c92b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:31.497998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aea4ca29-0cd5-41ce-b9c0-20960d619f46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0513ade385a24ca59a54ffbf20dcba9b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:31.500564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aea4ca29-0cd5-41ce-b9c0-20960d619f46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0513ade385a24ca59a54ffbf20dcba9b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:31.533194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aea4ca29-0cd5-41ce-b9c0-20960d619f46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0513ade385a24ca59a54ffbf20dcba9b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:31.559937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aea4ca29-0cd5-41ce-b9c0-20960d619f46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0513ade385a24ca59a54ffbf20dcba9b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:31.578102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee511d09-6f13-4484-8231-f98be5c92b13 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:31.595296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aea4ca29-0cd5-41ce-b9c0-20960d619f46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0513ade385a24ca59a54ffbf20dcba9b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:31.597923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab75c5c-7d8b-4a48-bed5-07e7fb14eccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:31.598494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab75c5c-7d8b-4a48-bed5-07e7fb14eccd service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:31.598772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab75c5c-7d8b-4a48-bed5-07e7fb14eccd service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:31.599047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab75c5c-7d8b-4a48-bed5-07e7fb14eccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:31.601233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5ab75c5c-7d8b-4a48-bed5-07e7fb14eccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:31.609057 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1558/3105] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:26:31 2022] DELETE /identity/v3/users/0513ade385a24ca59a54ffbf20dcba9b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:31.641652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab75c5c-7d8b-4a48-bed5-07e7fb14eccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:31.643219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab75c5c-7d8b-4a48-bed5-07e7fb14eccd service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:31.654367 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1548/3106] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:26:32.080963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4ca29-0cd5-41ce-b9c0-20960d619f46 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:32.082679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aea4ca29-0cd5-41ce-b9c0-20960d619f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:32.199663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4ca29-0cd5-41ce-b9c0-20960d619f46 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:32.205079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7103d-82b3-4ba0-94c2-b222baccdc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:32.206447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7103d-82b3-4ba0-94c2-b222baccdc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:32.206903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7103d-82b3-4ba0-94c2-b222baccdc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:32.207408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7103d-82b3-4ba0-94c2-b222baccdc6d admin admin] PATH_INFO: `/v3/projects/b85024c393984914b3adb2e0b34cd507` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:32.209660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7103d-82b3-4ba0-94c2-b222baccdc6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85024c393984914b3adb2e0b34cd507)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:32.211817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7103d-82b3-4ba0-94c2-b222baccdc6d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:32.337671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1a7103d-82b3-4ba0-94c2-b222baccdc6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85024c393984914b3adb2e0b34cd507', 'request_id': 'req-f1a7103d-82b3-4ba0-94c2-b222baccdc6d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:32.350883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1a7103d-82b3-4ba0-94c2-b222baccdc6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85024c393984914b3adb2e0b34cd507', 'request_id': 'req-f1a7103d-82b3-4ba0-94c2-b222baccdc6d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:32.360182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1a7103d-82b3-4ba0-94c2-b222baccdc6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85024c393984914b3adb2e0b34cd507', 'request_id': 'req-f1a7103d-82b3-4ba0-94c2-b222baccdc6d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:32.375640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1a7103d-82b3-4ba0-94c2-b222baccdc6d admin admin] The token cache is being invalidate because project b85024c393984914b3adb2e0b34cd507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:26:32.375863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1a7103d-82b3-4ba0-94c2-b222baccdc6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:32.376584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1a7103d-82b3-4ba0-94c2-b222baccdc6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:26:32.384537 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1559/3107] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:26:32 2022] DELETE /identity/v3/projects/b85024c393984914b3adb2e0b34cd507 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:32.385690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b5a6b-57f7-45e0-bb09-c7231dc72082 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:32.386213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b5a6b-57f7-45e0-bb09-c7231dc72082 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:32.386316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b5a6b-57f7-45e0-bb09-c7231dc72082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:32.412931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5a6b5a6b-57f7-45e0-bb09-c7231dc72082 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:32.414397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5a6b5a6b-57f7-45e0-bb09-c7231dc72082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:32.587797 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1549/3108] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:32.596916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb6c49-2d5d-4532-ba34-8ee9fb195bfe None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:32.597341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb6c49-2d5d-4532-ba34-8ee9fb195bfe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:32.597729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb6c49-2d5d-4532-ba34-8ee9fb195bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:32.624930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-01cb6c49-2d5d-4532-ba34-8ee9fb195bfe None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:32.626890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-01cb6c49-2d5d-4532-ba34-8ee9fb195bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:32.641074 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1560/3109] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:32.645514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b5a6b-57f7-45e0-bb09-c7231dc72082 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:32.656685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b5a6b-57f7-45e0-bb09-c7231dc72082 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:32.671485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294d3c3-a809-4c4f-8c02-fca5cee588e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:32.672885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294d3c3-a809-4c4f-8c02-fca5cee588e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:32.673406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294d3c3-a809-4c4f-8c02-fca5cee588e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:32.673922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294d3c3-a809-4c4f-8c02-fca5cee588e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:32.675274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294d3c3-a809-4c4f-8c02-fca5cee588e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:26:32.675826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294d3c3-a809-4c4f-8c02-fca5cee588e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:32.678608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294d3c3-a809-4c4f-8c02-fca5cee588e3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:32.696445 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1550/3110] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:26:32.698000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb6c49-2d5d-4532-ba34-8ee9fb195bfe None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:32.708170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb6c49-2d5d-4532-ba34-8ee9fb195bfe None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:32.713332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c5e3d-1052-4096-8ca5-c88ac2d07f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:32.713978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c5e3d-1052-4096-8ca5-c88ac2d07f94 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:32.714480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c5e3d-1052-4096-8ca5-c88ac2d07f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:32.714848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c5e3d-1052-4096-8ca5-c88ac2d07f94 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:32.715504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c5e3d-1052-4096-8ca5-c88ac2d07f94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:32.717632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c5e3d-1052-4096-8ca5-c88ac2d07f94 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:32.729421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:32.763889 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1561/3111] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:26:32 2022] POST /identity/v3/projects => generated 397 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:26:32.768739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294d3c3-a809-4c4f-8c02-fca5cee588e3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:32.784542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294d3c3-a809-4c4f-8c02-fca5cee588e3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:32.797702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:32.853632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c709f1-9ec1-4cb6-9f6e-e60c2cd04a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:32.854371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c709f1-9ec1-4cb6-9f6e-e60c2cd04a02 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:32.854881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c709f1-9ec1-4cb6-9f6e-e60c2cd04a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:32.855348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c709f1-9ec1-4cb6-9f6e-e60c2cd04a02 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:32.856327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c709f1-9ec1-4cb6-9f6e-e60c2cd04a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:32.859555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c709f1-9ec1-4cb6-9f6e-e60c2cd04a02 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:32.886904 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1551/3112] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:26:32 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:26:32.888497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c5e3d-1052-4096-8ca5-c88ac2d07f94 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:32.902185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c5e3d-1052-4096-8ca5-c88ac2d07f94 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:32.907080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf9775-f495-47f9-8a02-64364c3cb0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:32.908037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf9775-f495-47f9-8a02-64364c3cb0ca admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:32.908453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf9775-f495-47f9-8a02-64364c3cb0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:32.908795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf9775-f495-47f9-8a02-64364c3cb0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:32.910392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf9775-f495-47f9-8a02-64364c3cb0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:32.912381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf9775-f495-47f9-8a02-64364c3cb0ca admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:32.927349 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1562/3113] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:26:32.928574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c709f1-9ec1-4cb6-9f6e-e60c2cd04a02 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:32.939668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c709f1-9ec1-4cb6-9f6e-e60c2cd04a02 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:32.945591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff46958-c9da-4e84-b330-e100842613d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:32.946198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff46958-c9da-4e84-b330-e100842613d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:32.946661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff46958-c9da-4e84-b330-e100842613d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:32.947007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff46958-c9da-4e84-b330-e100842613d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:32.948261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff46958-c9da-4e84-b330-e100842613d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:32.949728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff46958-c9da-4e84-b330-e100842613d6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:32.969295 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1552/3114] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:26:32.970999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf9775-f495-47f9-8a02-64364c3cb0ca admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:32.985200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf9775-f495-47f9-8a02-64364c3cb0ca admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:33.005084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebea9d2-ddee-47b5-90e6-c0c8ae52f548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:33.011152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebea9d2-ddee-47b5-90e6-c0c8ae52f548 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:33.012513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebea9d2-ddee-47b5-90e6-c0c8ae52f548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:33.012513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebea9d2-ddee-47b5-90e6-c0c8ae52f548 admin admin] PATH_INFO: `/v3/projects/d32af09a74f542c2aae7259e59277025/users/6a000e1296e34cdea76d81725df18832/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:33.045339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebea9d2-ddee-47b5-90e6-c0c8ae52f548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32af09a74f542c2aae7259e59277025, user_id=6a000e1296e34cdea76d81725df18832, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:33.048492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebea9d2-ddee-47b5-90e6-c0c8ae52f548 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:33.089776 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1563/3115] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:26:32 2022] PUT /identity/v3/projects/d32af09a74f542c2aae7259e59277025/users/6a000e1296e34cdea76d81725df18832/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:26:33.095345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a74da-0188-4705-9875-ca749ee7b001 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:33.095958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a74da-0188-4705-9875-ca749ee7b001 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:33.096535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a74da-0188-4705-9875-ca749ee7b001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:33.124511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a99a74da-0188-4705-9875-ca749ee7b001 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:33.126176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a99a74da-0188-4705-9875-ca749ee7b001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:33.255524 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1553/3116] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:33.296947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebea9d2-ddee-47b5-90e6-c0c8ae52f548 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:33.299282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cebea9d2-ddee-47b5-90e6-c0c8ae52f548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:33.471478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebea9d2-ddee-47b5-90e6-c0c8ae52f548 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:33.478662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c91ce-8f82-40e4-ab88-4d11e4f3c2ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:33.479680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c91ce-8f82-40e4-ab88-4d11e4f3c2ad service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:33.480053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c91ce-8f82-40e4-ab88-4d11e4f3c2ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:33.480574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c91ce-8f82-40e4-ab88-4d11e4f3c2ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:33.503506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c91ce-8f82-40e4-ab88-4d11e4f3c2ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:33.514159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c91ce-8f82-40e4-ab88-4d11e4f3c2ad service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:33.527570 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1564/3117] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:26:40.222902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea24fd0-2336-42ee-a6ab-4029f7ab69c9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:40.223417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea24fd0-2336-42ee-a6ab-4029f7ab69c9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:40.223849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea24fd0-2336-42ee-a6ab-4029f7ab69c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:40.270852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9ea24fd0-2336-42ee-a6ab-4029f7ab69c9 None None] MFA Rules not processed for user `8f4bc37e4f9b474389e34af0a65151cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:40.272534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9ea24fd0-2336-42ee-a6ab-4029f7ab69c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:40.362549 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1554/3118] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:40 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:40.373488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60b9db-c09b-4616-8214-3d07cf439fd0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:40.374442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60b9db-c09b-4616-8214-3d07cf439fd0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:40.374903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60b9db-c09b-4616-8214-3d07cf439fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:40.442325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9d60b9db-c09b-4616-8214-3d07cf439fd0 None None] MFA Rules not processed for user `8f4bc37e4f9b474389e34af0a65151cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:40.445538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9d60b9db-c09b-4616-8214-3d07cf439fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:40.468700 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1565/3119] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:40 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:40.630756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea24fd0-2336-42ee-a6ab-4029f7ab69c9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:40.633102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9ea24fd0-2336-42ee-a6ab-4029f7ab69c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:40.685408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:40.749110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea24fd0-2336-42ee-a6ab-4029f7ab69c9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:40.755830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446a2c8-7ad1-41b6-a6af-28276fab372d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:40.756586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446a2c8-7ad1-41b6-a6af-28276fab372d service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:40.756965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446a2c8-7ad1-41b6-a6af-28276fab372d service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:40.757340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446a2c8-7ad1-41b6-a6af-28276fab372d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:40.767364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446a2c8-7ad1-41b6-a6af-28276fab372d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:40.769290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446a2c8-7ad1-41b6-a6af-28276fab372d service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:40.781546 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1555/3120] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:26:40 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:26:43.713492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8ead3-8377-41de-935b-b674e20a19c6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:43.714017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8ead3-8377-41de-935b-b674e20a19c6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:43.714129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8ead3-8377-41de-935b-b674e20a19c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:43.783468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f3d8ead3-8377-41de-935b-b674e20a19c6 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:43.804909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f3d8ead3-8377-41de-935b-b674e20a19c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:44.046157 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1566/3121] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:26:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:44.131684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446a2c8-7ad1-41b6-a6af-28276fab372d service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:44.134194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9446a2c8-7ad1-41b6-a6af-28276fab372d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:44.389948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446a2c8-7ad1-41b6-a6af-28276fab372d service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:44.401156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adc0a3-bcdb-42cd-b67a-98d469b78741 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:44.401804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adc0a3-bcdb-42cd-b67a-98d469b78741 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:44.402089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adc0a3-bcdb-42cd-b67a-98d469b78741 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:44.402362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adc0a3-bcdb-42cd-b67a-98d469b78741 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:44.426895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adc0a3-bcdb-42cd-b67a-98d469b78741 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:44.428988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adc0a3-bcdb-42cd-b67a-98d469b78741 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:44.447482 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1556/3122] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:26:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:26:49.658577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53879219-24a9-4423-bd55-a21bd4db73e8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:49.659903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53879219-24a9-4423-bd55-a21bd4db73e8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:49.660501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53879219-24a9-4423-bd55-a21bd4db73e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:49.730926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-53879219-24a9-4423-bd55-a21bd4db73e8 None None] MFA Rules not processed for user `6a000e1296e34cdea76d81725df18832`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:49.732582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-53879219-24a9-4423-bd55-a21bd4db73e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:49.816199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:26:49.872757 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1567/3123] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:49.874562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc0381-7e7c-4852-aabb-9f27010a1dbd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:49.875050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc0381-7e7c-4852-aabb-9f27010a1dbd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:49.875160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc0381-7e7c-4852-aabb-9f27010a1dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:49.907381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-64bc0381-7e7c-4852-aabb-9f27010a1dbd None None] MFA Rules not processed for user `6a000e1296e34cdea76d81725df18832`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:49.912652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-64bc0381-7e7c-4852-aabb-9f27010a1dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:49.935207 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1557/3124] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:26:49.944750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53879219-24a9-4423-bd55-a21bd4db73e8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:26:49.946410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-53879219-24a9-4423-bd55-a21bd4db73e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:49.975035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53879219-24a9-4423-bd55-a21bd4db73e8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:26:49.992997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a8866-7b77-4ad0-8471-41d134fb9487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:26:49.993787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a8866-7b77-4ad0-8471-41d134fb9487 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:49.994169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a8866-7b77-4ad0-8471-41d134fb9487 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:49.994535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a8866-7b77-4ad0-8471-41d134fb9487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:50.005416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a8866-7b77-4ad0-8471-41d134fb9487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:26:50.013727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a8866-7b77-4ad0-8471-41d134fb9487 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:26:50.042351 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1568/3125] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:26:49 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:26:51.469737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e776f5-a4ff-483c-a87f-729c65167aa6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:26:51.470646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e776f5-a4ff-483c-a87f-729c65167aa6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:26:51.471102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e776f5-a4ff-483c-a87f-729c65167aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:26:51.511077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-23e776f5-a4ff-483c-a87f-729c65167aa6 None None] MFA Rules not processed for user `69c85b658b4d499fb6405b2e352358d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:26:51.513903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-23e776f5-a4ff-483c-a87f-729c65167aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:26:51.732952 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1558/3126] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:26:51 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:27:00.026216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=13 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:27:01.683418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=82 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:27:04.088302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a8866-7b77-4ad0-8471-41d134fb9487 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:04.090578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d85a8866-7b77-4ad0-8471-41d134fb9487 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:04.387449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a8866-7b77-4ad0-8471-41d134fb9487 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:04.394366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f2f42-c5c0-40b1-9a03-2f5f4cd39d4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:04.395730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f2f42-c5c0-40b1-9a03-2f5f4cd39d4c service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:04.396013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f2f42-c5c0-40b1-9a03-2f5f4cd39d4c service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:04.396285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f2f42-c5c0-40b1-9a03-2f5f4cd39d4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:04.409104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-583f2f42-c5c0-40b1-9a03-2f5f4cd39d4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:04.469243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f2f42-c5c0-40b1-9a03-2f5f4cd39d4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:04.471607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f2f42-c5c0-40b1-9a03-2f5f4cd39d4c service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:04.499847 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1569/3127] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:27:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:27:05.077183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08466a11-78cd-4b92-bca2-669fb2b429a0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:05.077684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08466a11-78cd-4b92-bca2-669fb2b429a0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:05.077800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08466a11-78cd-4b92-bca2-669fb2b429a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:05.109410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-08466a11-78cd-4b92-bca2-669fb2b429a0 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:05.110585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-08466a11-78cd-4b92-bca2-669fb2b429a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:05.126404 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1559/3128] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:27:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:27:05.134589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f2f42-c5c0-40b1-9a03-2f5f4cd39d4c service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:05.154682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f2f42-c5c0-40b1-9a03-2f5f4cd39d4c service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:05.162581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf6117-4c47-49ce-ad94-6704c77b7fdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:05.163184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf6117-4c47-49ce-ad94-6704c77b7fdf service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:05.163522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf6117-4c47-49ce-ad94-6704c77b7fdf service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:05.163795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf6117-4c47-49ce-ad94-6704c77b7fdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:05.184521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf6117-4c47-49ce-ad94-6704c77b7fdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:05.186476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf6117-4c47-49ce-ad94-6704c77b7fdf service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:05.197421 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1570/3129] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:27:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:27:05.734180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003cfae-f6bb-4160-9086-76ff74b5e9fe None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:05.734446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003cfae-f6bb-4160-9086-76ff74b5e9fe None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:05.734728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003cfae-f6bb-4160-9086-76ff74b5e9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:05.755095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1003cfae-f6bb-4160-9086-76ff74b5e9fe None None] MFA Rules not processed for user `bc2c3257ad8a48c6adbfef6617e379d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:05.756594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1003cfae-f6bb-4160-9086-76ff74b5e9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:05.821006 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1560/3130] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:27:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:27:07.876723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf6117-4c47-49ce-ad94-6704c77b7fdf service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:07.893917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf6117-4c47-49ce-ad94-6704c77b7fdf service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:07.908447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7310d9b-3c9d-44e0-a6fc-a87181d2ce70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:07.910433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7310d9b-3c9d-44e0-a6fc-a87181d2ce70 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:07.910942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7310d9b-3c9d-44e0-a6fc-a87181d2ce70 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:07.911445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7310d9b-3c9d-44e0-a6fc-a87181d2ce70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:07.914176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e7310d9b-3c9d-44e0-a6fc-a87181d2ce70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:07.977908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7310d9b-3c9d-44e0-a6fc-a87181d2ce70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:07.980311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7310d9b-3c9d-44e0-a6fc-a87181d2ce70 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:07.996455 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1571/3131] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:27:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:27:15.810772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=32 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:27:16.481357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003cfae-f6bb-4160-9086-76ff74b5e9fe None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:16.482773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1003cfae-f6bb-4160-9086-76ff74b5e9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:16.506976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003cfae-f6bb-4160-9086-76ff74b5e9fe None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:16.529478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d704dd1-35ff-4f2b-b53e-9d7e926e80d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:16.532279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d704dd1-35ff-4f2b-b53e-9d7e926e80d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:16.533864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d704dd1-35ff-4f2b-b53e-9d7e926e80d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:16.535972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d704dd1-35ff-4f2b-b53e-9d7e926e80d6 admin admin] PATH_INFO: `/v3/users/7eacd8c6cbf84a2fa726e0c26e587d09` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:16.538622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d704dd1-35ff-4f2b-b53e-9d7e926e80d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eacd8c6cbf84a2fa726e0c26e587d09)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:16.543009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d704dd1-35ff-4f2b-b53e-9d7e926e80d6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:16.685747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d704dd1-35ff-4f2b-b53e-9d7e926e80d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eacd8c6cbf84a2fa726e0c26e587d09'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:16.716023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d704dd1-35ff-4f2b-b53e-9d7e926e80d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eacd8c6cbf84a2fa726e0c26e587d09'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:16.720619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d704dd1-35ff-4f2b-b53e-9d7e926e80d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eacd8c6cbf84a2fa726e0c26e587d09'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:16.721676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d704dd1-35ff-4f2b-b53e-9d7e926e80d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eacd8c6cbf84a2fa726e0c26e587d09'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:16.739847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d704dd1-35ff-4f2b-b53e-9d7e926e80d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eacd8c6cbf84a2fa726e0c26e587d09'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:16.765089 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1561/3132] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:27:16 2022] DELETE /identity/v3/users/7eacd8c6cbf84a2fa726e0c26e587d09 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:27:16.768500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bfa67-222a-43d3-afad-9706de9b1e71 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:16.769084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bfa67-222a-43d3-afad-9706de9b1e71 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:16.769084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bfa67-222a-43d3-afad-9706de9b1e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:16.858455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-474bfa67-222a-43d3-afad-9706de9b1e71 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:16.861181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-474bfa67-222a-43d3-afad-9706de9b1e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:17.059134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:27:17.101263 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1572/3133] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:27:17.150650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d704dd1-35ff-4f2b-b53e-9d7e926e80d6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:17.152873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5d704dd1-35ff-4f2b-b53e-9d7e926e80d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:17.320734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d704dd1-35ff-4f2b-b53e-9d7e926e80d6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:17.335919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524b620-ea62-4a0d-930f-059ac96500c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:17.336846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524b620-ea62-4a0d-930f-059ac96500c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:17.338126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524b620-ea62-4a0d-930f-059ac96500c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:17.338940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524b620-ea62-4a0d-930f-059ac96500c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:17.353087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524b620-ea62-4a0d-930f-059ac96500c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:17.354440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524b620-ea62-4a0d-930f-059ac96500c4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:17.369675 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1562/3134] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:27:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:27:19.121646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bfa67-222a-43d3-afad-9706de9b1e71 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:19.122214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524b620-ea62-4a0d-930f-059ac96500c4 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:19.123910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-474bfa67-222a-43d3-afad-9706de9b1e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:19.124942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f524b620-ea62-4a0d-930f-059ac96500c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:19.242791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:27:19.253021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bfa67-222a-43d3-afad-9706de9b1e71 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:19.267311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d6fbb-2c9a-40c9-be6d-d4ec4cb537e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:19.268115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d6fbb-2c9a-40c9-be6d-d4ec4cb537e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:19.268395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d6fbb-2c9a-40c9-be6d-d4ec4cb537e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:19.268667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d6fbb-2c9a-40c9-be6d-d4ec4cb537e5 admin admin] PATH_INFO: `/v3/projects/6d4af3cd3c434f9c98773e9b99f32572` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:19.269998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d6fbb-2c9a-40c9-be6d-d4ec4cb537e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d4af3cd3c434f9c98773e9b99f32572)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:19.272432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d6fbb-2c9a-40c9-be6d-d4ec4cb537e5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:19.285752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524b620-ea62-4a0d-930f-059ac96500c4 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:19.295627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017e13c-0427-47c4-876b-52a518146f3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:19.296764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017e13c-0427-47c4-876b-52a518146f3c service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:19.297050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017e13c-0427-47c4-876b-52a518146f3c service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:19.297367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017e13c-0427-47c4-876b-52a518146f3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:19.299203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5017e13c-0427-47c4-876b-52a518146f3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:19.349630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f54d6fbb-2c9a-40c9-be6d-d4ec4cb537e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d4af3cd3c434f9c98773e9b99f32572', 'request_id': 'req-f54d6fbb-2c9a-40c9-be6d-d4ec4cb537e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:19.390253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f54d6fbb-2c9a-40c9-be6d-d4ec4cb537e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d4af3cd3c434f9c98773e9b99f32572', 'request_id': 'req-f54d6fbb-2c9a-40c9-be6d-d4ec4cb537e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:19.411967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f54d6fbb-2c9a-40c9-be6d-d4ec4cb537e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d4af3cd3c434f9c98773e9b99f32572', 'request_id': 'req-f54d6fbb-2c9a-40c9-be6d-d4ec4cb537e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:19.424830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017e13c-0427-47c4-876b-52a518146f3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:19.429501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017e13c-0427-47c4-876b-52a518146f3c service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:19.443457 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1563/3135] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:27:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:27:19.444422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017e13c-0427-47c4-876b-52a518146f3c service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:19.446050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f54d6fbb-2c9a-40c9-be6d-d4ec4cb537e5 admin admin] The token cache is being invalidate because project 6d4af3cd3c434f9c98773e9b99f32572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:27:19.446501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5017e13c-0427-47c4-876b-52a518146f3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:19.447185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f54d6fbb-2c9a-40c9-be6d-d4ec4cb537e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:19.449152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f54d6fbb-2c9a-40c9-be6d-d4ec4cb537e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:19.456221 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1573/3136] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:27:19 2022] DELETE /identity/v3/projects/6d4af3cd3c434f9c98773e9b99f32572 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:27:19.462641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a1d74-ea15-470a-8c62-e735eb23e4f6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:19.462916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a1d74-ea15-470a-8c62-e735eb23e4f6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:19.463195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a1d74-ea15-470a-8c62-e735eb23e4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:19.467942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017e13c-0427-47c4-876b-52a518146f3c service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:19.579141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5b36e-dc30-4d1c-94a6-fec45163ef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:19.579141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5b36e-dc30-4d1c-94a6-fec45163ef92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:19.579141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5b36e-dc30-4d1c-94a6-fec45163ef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:19.579141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5b36e-dc30-4d1c-94a6-fec45163ef92 admin admin] PATH_INFO: `/v3/users/8f4bc37e4f9b474389e34af0a65151cf` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:19.579800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5b36e-dc30-4d1c-94a6-fec45163ef92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f4bc37e4f9b474389e34af0a65151cf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:19.582328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5b36e-dc30-4d1c-94a6-fec45163ef92 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:19.582550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c82a1d74-ea15-470a-8c62-e735eb23e4f6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:19.583955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c82a1d74-ea15-470a-8c62-e735eb23e4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:19.611245 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1574/3137] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:27:19.614349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8a5fe-7181-45ba-8778-8aae8784ad43 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:19.614634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8a5fe-7181-45ba-8778-8aae8784ad43 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:19.615693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8a5fe-7181-45ba-8778-8aae8784ad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:19.643285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-76a8a5fe-7181-45ba-8778-8aae8784ad43 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:19.644532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-76a8a5fe-7181-45ba-8778-8aae8784ad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:19.648911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57c5b36e-dc30-4d1c-94a6-fec45163ef92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f4bc37e4f9b474389e34af0a65151cf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:19.658807 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1575/3138] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:27:19.660184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8a5fe-7181-45ba-8778-8aae8784ad43 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:19.664082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57c5b36e-dc30-4d1c-94a6-fec45163ef92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f4bc37e4f9b474389e34af0a65151cf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:19.665079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57c5b36e-dc30-4d1c-94a6-fec45163ef92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f4bc37e4f9b474389e34af0a65151cf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:19.665987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57c5b36e-dc30-4d1c-94a6-fec45163ef92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f4bc37e4f9b474389e34af0a65151cf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:19.674011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8a5fe-7181-45ba-8778-8aae8784ad43 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:19.677974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57c5b36e-dc30-4d1c-94a6-fec45163ef92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f4bc37e4f9b474389e34af0a65151cf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:19.679959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22378845-bb56-4e43-93e8-8b77c06fdd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:19.681068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22378845-bb56-4e43-93e8-8b77c06fdd3b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:19.681417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22378845-bb56-4e43-93e8-8b77c06fdd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:19.681755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22378845-bb56-4e43-93e8-8b77c06fdd3b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:19.682550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22378845-bb56-4e43-93e8-8b77c06fdd3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:27:19.683002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22378845-bb56-4e43-93e8-8b77c06fdd3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:19.685165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22378845-bb56-4e43-93e8-8b77c06fdd3b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:19.690627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:27:19.699406 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1564/3139] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:27:19 2022] DELETE /identity/v3/users/8f4bc37e4f9b474389e34af0a65151cf => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:27:19.704568 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1576/3140] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:27:19.708314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5b36e-dc30-4d1c-94a6-fec45163ef92 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:19.709727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-57c5b36e-dc30-4d1c-94a6-fec45163ef92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:19.814018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5b36e-dc30-4d1c-94a6-fec45163ef92 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:19.821065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89214cb1-112d-42eb-956b-583f2dd11441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:19.821823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89214cb1-112d-42eb-956b-583f2dd11441 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:19.822196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89214cb1-112d-42eb-956b-583f2dd11441 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:19.822716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89214cb1-112d-42eb-956b-583f2dd11441 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:19.823632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89214cb1-112d-42eb-956b-583f2dd11441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:19.826282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89214cb1-112d-42eb-956b-583f2dd11441 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:19.865367 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1565/3141] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:27:19 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:27:19.866343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22378845-bb56-4e43-93e8-8b77c06fdd3b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:19.878028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22378845-bb56-4e43-93e8-8b77c06fdd3b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:19.936758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:27:19.946466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067406df-4bbe-4898-8cd7-a5ae9c78a185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:19.947174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067406df-4bbe-4898-8cd7-a5ae9c78a185 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:19.947629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067406df-4bbe-4898-8cd7-a5ae9c78a185 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:19.947972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067406df-4bbe-4898-8cd7-a5ae9c78a185 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:19.948709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067406df-4bbe-4898-8cd7-a5ae9c78a185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:19.953894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067406df-4bbe-4898-8cd7-a5ae9c78a185 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:19.985096 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1577/3142] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:27:19 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:27:19.989665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89214cb1-112d-42eb-956b-583f2dd11441 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:20.000109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89214cb1-112d-42eb-956b-583f2dd11441 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:20.005948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64678690-a533-4af9-858c-5df4bc777bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:20.006574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64678690-a533-4af9-858c-5df4bc777bcb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:20.006855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64678690-a533-4af9-858c-5df4bc777bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:20.007125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64678690-a533-4af9-858c-5df4bc777bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:20.007829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64678690-a533-4af9-858c-5df4bc777bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:20.009427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64678690-a533-4af9-858c-5df4bc777bcb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:20.021514 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1566/3143] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:27:20.025384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067406df-4bbe-4898-8cd7-a5ae9c78a185 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:20.036584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067406df-4bbe-4898-8cd7-a5ae9c78a185 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:20.041226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9049d-dd9d-46d9-8377-755c6240072e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:20.041848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9049d-dd9d-46d9-8377-755c6240072e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:20.042589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9049d-dd9d-46d9-8377-755c6240072e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:20.042589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9049d-dd9d-46d9-8377-755c6240072e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:20.043039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9049d-dd9d-46d9-8377-755c6240072e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:20.044698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9049d-dd9d-46d9-8377-755c6240072e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:20.058626 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1578/3144] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:27:20.059951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64678690-a533-4af9-858c-5df4bc777bcb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:20.070607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64678690-a533-4af9-858c-5df4bc777bcb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:20.076025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c12df-4161-4a67-9557-b0021b0c6c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:20.076785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c12df-4161-4a67-9557-b0021b0c6c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:20.077583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c12df-4161-4a67-9557-b0021b0c6c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:20.077583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c12df-4161-4a67-9557-b0021b0c6c21 admin admin] PATH_INFO: `/v3/projects/ece04783cf9540a48a100be2f53d76b5/users/7127c83048e74e2e98cb97aae410018f/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:20.096585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c12df-4161-4a67-9557-b0021b0c6c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece04783cf9540a48a100be2f53d76b5, user_id=7127c83048e74e2e98cb97aae410018f, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:20.099627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c12df-4161-4a67-9557-b0021b0c6c21 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:20.124879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9049d-dd9d-46d9-8377-755c6240072e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:20.127189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00c9049d-dd9d-46d9-8377-755c6240072e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:20.133212 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1567/3145] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:27:20 2022] PUT /identity/v3/projects/ece04783cf9540a48a100be2f53d76b5/users/7127c83048e74e2e98cb97aae410018f/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:27:20.135146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb881ca2-28fa-4f96-bf30-db10042add3a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:20.135559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb881ca2-28fa-4f96-bf30-db10042add3a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:20.135992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb881ca2-28fa-4f96-bf30-db10042add3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:20.157997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cb881ca2-28fa-4f96-bf30-db10042add3a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:20.159411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cb881ca2-28fa-4f96-bf30-db10042add3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:20.169902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9049d-dd9d-46d9-8377-755c6240072e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:20.271025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc251552-31f2-4b84-9a79-c6d05da4dc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:20.273603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc251552-31f2-4b84-9a79-c6d05da4dc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:20.273979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc251552-31f2-4b84-9a79-c6d05da4dc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:20.274542 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1568/3146] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:27:20.278149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc251552-31f2-4b84-9a79-c6d05da4dc50 admin admin] PATH_INFO: `/v3/projects/a14dcd6412774fdc842af92fd1c5cd67` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:20.278149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc251552-31f2-4b84-9a79-c6d05da4dc50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14dcd6412774fdc842af92fd1c5cd67)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:20.284690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb881ca2-28fa-4f96-bf30-db10042add3a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:20.286073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc251552-31f2-4b84-9a79-c6d05da4dc50 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:20.288009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cb881ca2-28fa-4f96-bf30-db10042add3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:20.377466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb881ca2-28fa-4f96-bf30-db10042add3a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:20.385660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:27:20.392374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc251552-31f2-4b84-9a79-c6d05da4dc50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14dcd6412774fdc842af92fd1c5cd67', 'request_id': 'req-dc251552-31f2-4b84-9a79-c6d05da4dc50'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:20.405947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc251552-31f2-4b84-9a79-c6d05da4dc50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14dcd6412774fdc842af92fd1c5cd67', 'request_id': 'req-dc251552-31f2-4b84-9a79-c6d05da4dc50'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:20.420325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc251552-31f2-4b84-9a79-c6d05da4dc50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14dcd6412774fdc842af92fd1c5cd67', 'request_id': 'req-dc251552-31f2-4b84-9a79-c6d05da4dc50'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:20.438335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc251552-31f2-4b84-9a79-c6d05da4dc50 admin admin] The token cache is being invalidate because project a14dcd6412774fdc842af92fd1c5cd67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:27:20.438928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc251552-31f2-4b84-9a79-c6d05da4dc50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:20.439800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc251552-31f2-4b84-9a79-c6d05da4dc50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:27:20.456277 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1579/3147] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:27:20 2022] DELETE /identity/v3/projects/a14dcd6412774fdc842af92fd1c5cd67 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:27:20.457684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472cbd6-6266-4429-bc33-424c94ba9703 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:20.458097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472cbd6-6266-4429-bc33-424c94ba9703 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:20.458385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472cbd6-6266-4429-bc33-424c94ba9703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:20.476615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859d2a4-1280-4bc5-bf6b-8dc7b2c8397e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:20.477619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859d2a4-1280-4bc5-bf6b-8dc7b2c8397e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:20.478385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859d2a4-1280-4bc5-bf6b-8dc7b2c8397e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:20.478385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859d2a4-1280-4bc5-bf6b-8dc7b2c8397e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:20.480774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3859d2a4-1280-4bc5-bf6b-8dc7b2c8397e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:20.524947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e472cbd6-6266-4429-bc33-424c94ba9703 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:20.526766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e472cbd6-6266-4429-bc33-424c94ba9703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:20.617150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859d2a4-1280-4bc5-bf6b-8dc7b2c8397e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:20.621377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859d2a4-1280-4bc5-bf6b-8dc7b2c8397e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:20.642846 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1569/3148] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:27:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:27:20.642846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859d2a4-1280-4bc5-bf6b-8dc7b2c8397e service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:20.644804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3859d2a4-1280-4bc5-bf6b-8dc7b2c8397e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:20.659310 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1580/3149] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:27:20.666384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab53808-7284-41a7-920e-fd613324d612 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:20.666860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab53808-7284-41a7-920e-fd613324d612 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:20.667318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab53808-7284-41a7-920e-fd613324d612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:20.690037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:27:20.729017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2ab53808-7284-41a7-920e-fd613324d612 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:20.730589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2ab53808-7284-41a7-920e-fd613324d612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:20.748773 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1581/3150] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:27:20.752712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab53808-7284-41a7-920e-fd613324d612 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:20.761502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859d2a4-1280-4bc5-bf6b-8dc7b2c8397e service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:20.764792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab53808-7284-41a7-920e-fd613324d612 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:20.768688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2502dc-2adc-4521-b3c4-0a49aa6f9ac9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:20.769748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2502dc-2adc-4521-b3c4-0a49aa6f9ac9 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:20.770096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2502dc-2adc-4521-b3c4-0a49aa6f9ac9 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:20.770534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2502dc-2adc-4521-b3c4-0a49aa6f9ac9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:20.771383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f110b-25b5-40a0-b2c9-cc297b7e070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:20.772123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f110b-25b5-40a0-b2c9-cc297b7e070d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:20.772570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f110b-25b5-40a0-b2c9-cc297b7e070d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:20.772715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cf2502dc-2adc-4521-b3c4-0a49aa6f9ac9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:20.772974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f110b-25b5-40a0-b2c9-cc297b7e070d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:20.773728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f110b-25b5-40a0-b2c9-cc297b7e070d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:27:20.774271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f110b-25b5-40a0-b2c9-cc297b7e070d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:20.776262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f110b-25b5-40a0-b2c9-cc297b7e070d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:20.798177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2502dc-2adc-4521-b3c4-0a49aa6f9ac9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:20.799210 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1582/3151] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:27:20.803580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f110b-25b5-40a0-b2c9-cc297b7e070d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:20.805037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2502dc-2adc-4521-b3c4-0a49aa6f9ac9 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:20.822534 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1570/3152] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:27:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:27:20.825405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f110b-25b5-40a0-b2c9-cc297b7e070d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:20.843027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb847c-3708-4498-a89b-f4c25039c7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:20.843679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb847c-3708-4498-a89b-f4c25039c7ee admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:20.843955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb847c-3708-4498-a89b-f4c25039c7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:20.844455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb847c-3708-4498-a89b-f4c25039c7ee admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:20.844916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb847c-3708-4498-a89b-f4c25039c7ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:20.846835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb847c-3708-4498-a89b-f4c25039c7ee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:20.907466 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1583/3153] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:27:20 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:27:20.909249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2502dc-2adc-4521-b3c4-0a49aa6f9ac9 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:20.924721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2502dc-2adc-4521-b3c4-0a49aa6f9ac9 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:20.986198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:27:21.005876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e2681-01da-4799-9f85-3e5fbb72e262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:21.006714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e2681-01da-4799-9f85-3e5fbb72e262 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:21.007239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e2681-01da-4799-9f85-3e5fbb72e262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:21.007533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e2681-01da-4799-9f85-3e5fbb72e262 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:21.010319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e2681-01da-4799-9f85-3e5fbb72e262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:21.012891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e2681-01da-4799-9f85-3e5fbb72e262 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:21.047406 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1571/3154] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:27:20 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:27:21.051748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb847c-3708-4498-a89b-f4c25039c7ee admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:21.067001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb847c-3708-4498-a89b-f4c25039c7ee admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:21.081700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c55c7-c647-484a-aa68-71ac4e9c9f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:21.082894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c55c7-c647-484a-aa68-71ac4e9c9f64 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:21.083606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c55c7-c647-484a-aa68-71ac4e9c9f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:21.084259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c55c7-c647-484a-aa68-71ac4e9c9f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:21.086672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c55c7-c647-484a-aa68-71ac4e9c9f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:21.090244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c55c7-c647-484a-aa68-71ac4e9c9f64 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:21.110938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e2681-01da-4799-9f85-3e5fbb72e262 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:21.119322 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1584/3155] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:27:21.124871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e2681-01da-4799-9f85-3e5fbb72e262 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:21.138021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7771a-70a0-4c86-8743-9923bbc70d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:21.138743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7771a-70a0-4c86-8743-9923bbc70d76 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:21.138930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7771a-70a0-4c86-8743-9923bbc70d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:21.139207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7771a-70a0-4c86-8743-9923bbc70d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:21.139900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7771a-70a0-4c86-8743-9923bbc70d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:21.143292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7771a-70a0-4c86-8743-9923bbc70d76 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:21.168323 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1572/3156] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:27:21.172589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c55c7-c647-484a-aa68-71ac4e9c9f64 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:21.189421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c55c7-c647-484a-aa68-71ac4e9c9f64 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:21.199729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2d1a3-afae-448a-ab79-dc0e2ce3a7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:21.201333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2d1a3-afae-448a-ab79-dc0e2ce3a7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:21.202228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2d1a3-afae-448a-ab79-dc0e2ce3a7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:21.203118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2d1a3-afae-448a-ab79-dc0e2ce3a7e4 admin admin] PATH_INFO: `/v3/projects/d50100bb5ff24e96a77bda255cc9a9f6/users/d6bdf86e6ab64cf79ac70c471b9b2ab2/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:21.244015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2d1a3-afae-448a-ab79-dc0e2ce3a7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50100bb5ff24e96a77bda255cc9a9f6, user_id=d6bdf86e6ab64cf79ac70c471b9b2ab2, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:21.247985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2d1a3-afae-448a-ab79-dc0e2ce3a7e4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:21.288581 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1585/3157] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:27:21 2022] PUT /identity/v3/projects/d50100bb5ff24e96a77bda255cc9a9f6/users/d6bdf86e6ab64cf79ac70c471b9b2ab2/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:27:21.294171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad085e6-f47a-4867-b400-4c9c57eb9b3b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:21.294453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad085e6-f47a-4867-b400-4c9c57eb9b3b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:21.294728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad085e6-f47a-4867-b400-4c9c57eb9b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:21.363975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-aad085e6-f47a-4867-b400-4c9c57eb9b3b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:21.366855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aad085e6-f47a-4867-b400-4c9c57eb9b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:21.453183 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1573/3158] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:27:21.475407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2d1a3-afae-448a-ab79-dc0e2ce3a7e4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:21.480337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cec2d1a3-afae-448a-ab79-dc0e2ce3a7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:21.564980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2d1a3-afae-448a-ab79-dc0e2ce3a7e4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:21.570483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298a943-e205-417b-afc5-f5c36b90f647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:21.571208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298a943-e205-417b-afc5-f5c36b90f647 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:21.572081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298a943-e205-417b-afc5-f5c36b90f647 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:21.572456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298a943-e205-417b-afc5-f5c36b90f647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:21.588314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298a943-e205-417b-afc5-f5c36b90f647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:21.590093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298a943-e205-417b-afc5-f5c36b90f647 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:21.603091 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1586/3159] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:27:21.653481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad085e6-f47a-4867-b400-4c9c57eb9b3b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:21.655098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aad085e6-f47a-4867-b400-4c9c57eb9b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:21.674613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad085e6-f47a-4867-b400-4c9c57eb9b3b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:21.679365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527862b-f55c-49fa-b2bb-8a521e5843e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:21.680754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527862b-f55c-49fa-b2bb-8a521e5843e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:21.681080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527862b-f55c-49fa-b2bb-8a521e5843e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:21.681392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527862b-f55c-49fa-b2bb-8a521e5843e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:21.684999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6527862b-f55c-49fa-b2bb-8a521e5843e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:21.831905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527862b-f55c-49fa-b2bb-8a521e5843e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:21.835875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527862b-f55c-49fa-b2bb-8a521e5843e8 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:21.859302 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1574/3160] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:27:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:27:22.015563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298a943-e205-417b-afc5-f5c36b90f647 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:22.033706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298a943-e205-417b-afc5-f5c36b90f647 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:22.055131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c158a3-96b9-435b-877c-98d08c0f0de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:22.055786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c158a3-96b9-435b-877c-98d08c0f0de0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:22.056064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c158a3-96b9-435b-877c-98d08c0f0de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:22.056385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c158a3-96b9-435b-877c-98d08c0f0de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:22.072220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d1c158a3-96b9-435b-877c-98d08c0f0de0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:22.090561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c158a3-96b9-435b-877c-98d08c0f0de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:22.092146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c158a3-96b9-435b-877c-98d08c0f0de0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:22.112716 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1587/3161] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:27:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:27:28.088999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527862b-f55c-49fa-b2bb-8a521e5843e8 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:28.090478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6527862b-f55c-49fa-b2bb-8a521e5843e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:28.111727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527862b-f55c-49fa-b2bb-8a521e5843e8 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:28.126296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c65151-a83a-468c-b347-686832ce5d29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:28.127198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c65151-a83a-468c-b347-686832ce5d29 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:28.127676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c65151-a83a-468c-b347-686832ce5d29 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:28.128276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c65151-a83a-468c-b347-686832ce5d29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:28.130587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-49c65151-a83a-468c-b347-686832ce5d29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:28.254589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:27:28.305000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c65151-a83a-468c-b347-686832ce5d29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:28.307307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c65151-a83a-468c-b347-686832ce5d29 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:28.340132 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1575/3162] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:27:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:27:32.101228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=64,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:27:34.402489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed308dab-b3de-4b31-9a6f-20803443e372 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:34.403031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed308dab-b3de-4b31-9a6f-20803443e372 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:34.403031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed308dab-b3de-4b31-9a6f-20803443e372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:34.459686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ed308dab-b3de-4b31-9a6f-20803443e372 None None] MFA Rules not processed for user `d6bdf86e6ab64cf79ac70c471b9b2ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:34.460285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ed308dab-b3de-4b31-9a6f-20803443e372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:34.598218 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1588/3163] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:27:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:27:34.608483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5103b20-cd74-429c-b5fb-763efdf65044 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:34.609945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5103b20-cd74-429c-b5fb-763efdf65044 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:34.610419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5103b20-cd74-429c-b5fb-763efdf65044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:34.645163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d5103b20-cd74-429c-b5fb-763efdf65044 None None] MFA Rules not processed for user `d6bdf86e6ab64cf79ac70c471b9b2ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:34.646785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d5103b20-cd74-429c-b5fb-763efdf65044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:34.661362 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1576/3164] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:27:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:27:35.043512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9310e5e-f648-48a6-84d0-d22bf4479f08 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:35.043801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9310e5e-f648-48a6-84d0-d22bf4479f08 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:35.044084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9310e5e-f648-48a6-84d0-d22bf4479f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:35.101869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a9310e5e-f648-48a6-84d0-d22bf4479f08 None None] MFA Rules not processed for user `7127c83048e74e2e98cb97aae410018f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:35.103193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a9310e5e-f648-48a6-84d0-d22bf4479f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:35.198974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5103b20-cd74-429c-b5fb-763efdf65044 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:35.225027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5103b20-cd74-429c-b5fb-763efdf65044 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:35.233807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2e4ec-c0e1-40c9-909a-8e0f65053979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:35.234990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2e4ec-c0e1-40c9-909a-8e0f65053979 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:35.235511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2e4ec-c0e1-40c9-909a-8e0f65053979 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:35.236885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2e4ec-c0e1-40c9-909a-8e0f65053979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:35.248935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2e4ec-c0e1-40c9-909a-8e0f65053979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:35.250935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2e4ec-c0e1-40c9-909a-8e0f65053979 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:35.270773 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1589/3165] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:27:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:27:35.280540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edfaeb-9409-498f-89ba-95da67792571 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:35.280877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edfaeb-9409-498f-89ba-95da67792571 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:35.281178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edfaeb-9409-498f-89ba-95da67792571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:35.289970 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1577/3166] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:27:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:27:35.316415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-68edfaeb-9409-498f-89ba-95da67792571 None None] MFA Rules not processed for user `7127c83048e74e2e98cb97aae410018f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:35.319811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68edfaeb-9409-498f-89ba-95da67792571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:35.336666 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1590/3167] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:27:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:27:36.392877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065665-7ded-4a5a-8174-2a11a5bd173f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:36.393391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065665-7ded-4a5a-8174-2a11a5bd173f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:36.395671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065665-7ded-4a5a-8174-2a11a5bd173f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:36.432350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e1065665-7ded-4a5a-8174-2a11a5bd173f None None] MFA Rules not processed for user `6a000e1296e34cdea76d81725df18832`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:36.434090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e1065665-7ded-4a5a-8174-2a11a5bd173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:36.529808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edfaeb-9409-498f-89ba-95da67792571 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:36.541291 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1578/3168] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:27:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:27:36.548652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edfaeb-9409-498f-89ba-95da67792571 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:36.571882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8019e54-b302-413a-9539-04c51819a0c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:36.571882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8019e54-b302-413a-9539-04c51819a0c1 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:36.571882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8019e54-b302-413a-9539-04c51819a0c1 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:36.571882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8019e54-b302-413a-9539-04c51819a0c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:36.585372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8019e54-b302-413a-9539-04c51819a0c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:36.587015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8019e54-b302-413a-9539-04c51819a0c1 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:36.601209 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1591/3169] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:27:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:27:39.639535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af38e03-3d46-4f37-9a2a-cb2761e016cc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:39.640133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af38e03-3d46-4f37-9a2a-cb2761e016cc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:39.640269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af38e03-3d46-4f37-9a2a-cb2761e016cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:39.678560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9af38e03-3d46-4f37-9a2a-cb2761e016cc None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:39.679443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9af38e03-3d46-4f37-9a2a-cb2761e016cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:39.768707 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1579/3170] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:27:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:27:39.786145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8019e54-b302-413a-9539-04c51819a0c1 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:39.788298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f8019e54-b302-413a-9539-04c51819a0c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:40.048202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:27:40.053863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8019e54-b302-413a-9539-04c51819a0c1 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:40.074758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f1a5a-5255-4f38-9a9e-30ccca5ff87d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:40.076205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f1a5a-5255-4f38-9a9e-30ccca5ff87d service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:40.076890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f1a5a-5255-4f38-9a9e-30ccca5ff87d service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:40.077915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f1a5a-5255-4f38-9a9e-30ccca5ff87d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:40.093801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f1a5a-5255-4f38-9a9e-30ccca5ff87d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:40.096498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f1a5a-5255-4f38-9a9e-30ccca5ff87d service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:40.108968 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1592/3171] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:27:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:27:49.757911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=66 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:27:50.102975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:27:57.430113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875de372-12d7-4817-8b4d-0015f1050867 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:57.430637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875de372-12d7-4817-8b4d-0015f1050867 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:57.430888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875de372-12d7-4817-8b4d-0015f1050867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:57.472641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-875de372-12d7-4817-8b4d-0015f1050867 None None] MFA Rules not processed for user `7127c83048e74e2e98cb97aae410018f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:57.474507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-875de372-12d7-4817-8b4d-0015f1050867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:57.495997 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1580/3172] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:27:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:27:58.638560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55431-072d-4985-acf7-e5e79b59b906 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:58.639152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55431-072d-4985-acf7-e5e79b59b906 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:58.639240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55431-072d-4985-acf7-e5e79b59b906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:58.664652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-37a55431-072d-4985-acf7-e5e79b59b906 None None] MFA Rules not processed for user `1ea47409a7304d32bebd75e8273b14a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:58.666376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-37a55431-072d-4985-acf7-e5e79b59b906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:58.826393 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1593/3173] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:27:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:27:59.054709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b650d60-15ed-4481-b926-72fe7457a525 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:59.055168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b650d60-15ed-4481-b926-72fe7457a525 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:59.055530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b650d60-15ed-4481-b926-72fe7457a525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:59.100229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6b650d60-15ed-4481-b926-72fe7457a525 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:27:59.102178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6b650d60-15ed-4481-b926-72fe7457a525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:27:59.118361 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1581/3174] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:27:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:27:59.126214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a55431-072d-4985-acf7-e5e79b59b906 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:27:59.145975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a55431-072d-4985-acf7-e5e79b59b906 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:27:59.162247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96790e9b-ec3e-458e-bc24-d28549186819 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:27:59.162863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96790e9b-ec3e-458e-bc24-d28549186819 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:27:59.163143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96790e9b-ec3e-458e-bc24-d28549186819 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:27:59.163447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96790e9b-ec3e-458e-bc24-d28549186819 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:27:59.211671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96790e9b-ec3e-458e-bc24-d28549186819 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:27:59.213188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96790e9b-ec3e-458e-bc24-d28549186819 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:27:59.243430 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1594/3175] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:27:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:28:00.617626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1bed6-9790-411d-a42f-2b156f6f9e43 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:00.618127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1bed6-9790-411d-a42f-2b156f6f9e43 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:00.618231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1bed6-9790-411d-a42f-2b156f6f9e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:00.655353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0fa1bed6-9790-411d-a42f-2b156f6f9e43 None None] MFA Rules not processed for user `bc2c3257ad8a48c6adbfef6617e379d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:00.656974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0fa1bed6-9790-411d-a42f-2b156f6f9e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:00.802778 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1582/3176] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:03.655171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96790e9b-ec3e-458e-bc24-d28549186819 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:03.657110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-96790e9b-ec3e-458e-bc24-d28549186819 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:03.684993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96790e9b-ec3e-458e-bc24-d28549186819 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:03.712923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb365ab-70a7-488a-a537-b5470cdaf458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:03.713689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb365ab-70a7-488a-a537-b5470cdaf458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:03.713968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb365ab-70a7-488a-a537-b5470cdaf458 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:03.714398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb365ab-70a7-488a-a537-b5470cdaf458 admin admin] PATH_INFO: `/v3/users/d60e254814924b44843a420ca3ba21c7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:03.716940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb365ab-70a7-488a-a537-b5470cdaf458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60e254814924b44843a420ca3ba21c7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:03.718918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb365ab-70a7-488a-a537-b5470cdaf458 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:03.868872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eeb365ab-70a7-488a-a537-b5470cdaf458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60e254814924b44843a420ca3ba21c7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:03.870634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eeb365ab-70a7-488a-a537-b5470cdaf458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60e254814924b44843a420ca3ba21c7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:03.885841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eeb365ab-70a7-488a-a537-b5470cdaf458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60e254814924b44843a420ca3ba21c7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:03.904251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eeb365ab-70a7-488a-a537-b5470cdaf458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60e254814924b44843a420ca3ba21c7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:03.952798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eeb365ab-70a7-488a-a537-b5470cdaf458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60e254814924b44843a420ca3ba21c7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:03.968755 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1595/3177] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:28:03 2022] DELETE /identity/v3/users/d60e254814924b44843a420ca3ba21c7 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:28:04.470752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1bed6-9790-411d-a42f-2b156f6f9e43 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:04.502171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1bed6-9790-411d-a42f-2b156f6f9e43 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:04.601990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31df08-651b-4d51-aded-9b4160fe52ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:04.603008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31df08-651b-4d51-aded-9b4160fe52ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:04.603571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31df08-651b-4d51-aded-9b4160fe52ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:04.604014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31df08-651b-4d51-aded-9b4160fe52ac admin admin] PATH_INFO: `/v3/projects/ee45ea494d4a4c95aaac2a35f15ac32d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:04.605641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31df08-651b-4d51-aded-9b4160fe52ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee45ea494d4a4c95aaac2a35f15ac32d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:04.608024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31df08-651b-4d51-aded-9b4160fe52ac admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:04.692628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee31df08-651b-4d51-aded-9b4160fe52ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee45ea494d4a4c95aaac2a35f15ac32d', 'request_id': 'req-ee31df08-651b-4d51-aded-9b4160fe52ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:04.701776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee31df08-651b-4d51-aded-9b4160fe52ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee45ea494d4a4c95aaac2a35f15ac32d', 'request_id': 'req-ee31df08-651b-4d51-aded-9b4160fe52ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:04.709487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee31df08-651b-4d51-aded-9b4160fe52ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee45ea494d4a4c95aaac2a35f15ac32d', 'request_id': 'req-ee31df08-651b-4d51-aded-9b4160fe52ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:04.729268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee31df08-651b-4d51-aded-9b4160fe52ac admin admin] The token cache is being invalidate because project ee45ea494d4a4c95aaac2a35f15ac32d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:28:04.729616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee31df08-651b-4d51-aded-9b4160fe52ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:04.731399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee31df08-651b-4d51-aded-9b4160fe52ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:04.734728 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1583/3178] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:28:04 2022] DELETE /identity/v3/projects/ee45ea494d4a4c95aaac2a35f15ac32d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:28:04.739640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59b9a5-ff9e-48c6-9881-7a474aba1b5d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:04.740104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59b9a5-ff9e-48c6-9881-7a474aba1b5d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:04.740197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59b9a5-ff9e-48c6-9881-7a474aba1b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:04.776901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1a59b9a5-ff9e-48c6-9881-7a474aba1b5d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:04.778190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1a59b9a5-ff9e-48c6-9881-7a474aba1b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:04.899341 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1596/3179] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:04.907508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7d942-72a7-466a-b93f-9bfc31877d94 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:04.907919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7d942-72a7-466a-b93f-9bfc31877d94 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:04.908178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7d942-72a7-466a-b93f-9bfc31877d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:04.950974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-16a7d942-72a7-466a-b93f-9bfc31877d94 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:04.952296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-16a7d942-72a7-466a-b93f-9bfc31877d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:04.971302 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1584/3180] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:04.975180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59b9a5-ff9e-48c6-9881-7a474aba1b5d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:04.982818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:28:04.994392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59b9a5-ff9e-48c6-9881-7a474aba1b5d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:05.006405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc49f07-92be-4932-a511-0a41cb484c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:05.007031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc49f07-92be-4932-a511-0a41cb484c75 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:05.007359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc49f07-92be-4932-a511-0a41cb484c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:05.007628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc49f07-92be-4932-a511-0a41cb484c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:05.008533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc49f07-92be-4932-a511-0a41cb484c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:28:05.008850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc49f07-92be-4932-a511-0a41cb484c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:05.010942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc49f07-92be-4932-a511-0a41cb484c75 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:05.024905 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1597/3181] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:28:05.029360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7d942-72a7-466a-b93f-9bfc31877d94 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:05.039705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7d942-72a7-466a-b93f-9bfc31877d94 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:05.045096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b52e85-9425-470a-beb3-d22269d0e252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:05.045719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b52e85-9425-470a-beb3-d22269d0e252 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:05.046179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b52e85-9425-470a-beb3-d22269d0e252 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:05.046512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b52e85-9425-470a-beb3-d22269d0e252 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:05.047671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b52e85-9425-470a-beb3-d22269d0e252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:05.049722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b52e85-9425-470a-beb3-d22269d0e252 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:05.071074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:28:05.120161 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1585/3182] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:28:05 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:28:05.133117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc49f07-92be-4932-a511-0a41cb484c75 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:05.149265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc49f07-92be-4932-a511-0a41cb484c75 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:05.251569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1b8e8-8382-49e6-a8c5-3aa0fa6cb24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:05.252611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1b8e8-8382-49e6-a8c5-3aa0fa6cb24f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:05.253100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1b8e8-8382-49e6-a8c5-3aa0fa6cb24f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:05.253738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1b8e8-8382-49e6-a8c5-3aa0fa6cb24f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:05.254586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1b8e8-8382-49e6-a8c5-3aa0fa6cb24f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:05.257021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1b8e8-8382-49e6-a8c5-3aa0fa6cb24f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:05.292573 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1598/3183] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:28:05 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:28:05.296336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b52e85-9425-470a-beb3-d22269d0e252 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:05.307742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b52e85-9425-470a-beb3-d22269d0e252 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:05.320527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe142a6-69fc-41bc-816c-b4890598c629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:05.320814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe142a6-69fc-41bc-816c-b4890598c629 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:05.321076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe142a6-69fc-41bc-816c-b4890598c629 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:05.321341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe142a6-69fc-41bc-816c-b4890598c629 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:05.322072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe142a6-69fc-41bc-816c-b4890598c629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:05.323863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe142a6-69fc-41bc-816c-b4890598c629 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:05.336626 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1586/3184] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:28:05.341412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1b8e8-8382-49e6-a8c5-3aa0fa6cb24f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:05.364873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1b8e8-8382-49e6-a8c5-3aa0fa6cb24f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:05.377427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540534d-0883-49f7-9d53-bdb7e1d606c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:05.378065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540534d-0883-49f7-9d53-bdb7e1d606c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:05.378348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540534d-0883-49f7-9d53-bdb7e1d606c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:05.378623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540534d-0883-49f7-9d53-bdb7e1d606c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:05.379676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540534d-0883-49f7-9d53-bdb7e1d606c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:05.380974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540534d-0883-49f7-9d53-bdb7e1d606c0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:05.419518 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1599/3185] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:28:05.420871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe142a6-69fc-41bc-816c-b4890598c629 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:05.433082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe142a6-69fc-41bc-816c-b4890598c629 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:05.439322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f884870-f80e-4985-925c-c8cef7516390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:05.440254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f884870-f80e-4985-925c-c8cef7516390 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:05.440730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f884870-f80e-4985-925c-c8cef7516390 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:05.441210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f884870-f80e-4985-925c-c8cef7516390 admin admin] PATH_INFO: `/v3/projects/b7fc572a8cae45d68d992a638ef3422a/users/47aab8bfff21443891308d80f7059b2e/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:05.459545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f884870-f80e-4985-925c-c8cef7516390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fc572a8cae45d68d992a638ef3422a, user_id=47aab8bfff21443891308d80f7059b2e, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:05.462892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f884870-f80e-4985-925c-c8cef7516390 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:05.481125 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1587/3186] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:28:05 2022] PUT /identity/v3/projects/b7fc572a8cae45d68d992a638ef3422a/users/47aab8bfff21443891308d80f7059b2e/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:28:05.487012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8d70c-7244-4b2a-882c-38e8c670f707 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:05.487574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8d70c-7244-4b2a-882c-38e8c670f707 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:05.488084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8d70c-7244-4b2a-882c-38e8c670f707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:05.512596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5be8d70c-7244-4b2a-882c-38e8c670f707 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:05.514745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5be8d70c-7244-4b2a-882c-38e8c670f707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:05.647598 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1600/3187] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:05.654600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f884870-f80e-4985-925c-c8cef7516390 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:05.656708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8f884870-f80e-4985-925c-c8cef7516390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:05.793457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f884870-f80e-4985-925c-c8cef7516390 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:05.798904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac510fab-b16b-4090-8f8b-ebb9ad0ed76c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:05.799837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac510fab-b16b-4090-8f8b-ebb9ad0ed76c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:05.800187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac510fab-b16b-4090-8f8b-ebb9ad0ed76c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:05.800708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac510fab-b16b-4090-8f8b-ebb9ad0ed76c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:05.814136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac510fab-b16b-4090-8f8b-ebb9ad0ed76c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:05.815908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac510fab-b16b-4090-8f8b-ebb9ad0ed76c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:05.840876 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1588/3188] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:28:06.887477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8d70c-7244-4b2a-882c-38e8c670f707 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:06.889547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5be8d70c-7244-4b2a-882c-38e8c670f707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:07.172130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8d70c-7244-4b2a-882c-38e8c670f707 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:07.190412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad80ef3-ce42-4359-827e-ce796b3f97c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:07.191194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad80ef3-ce42-4359-827e-ce796b3f97c4 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:07.191550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad80ef3-ce42-4359-827e-ce796b3f97c4 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:07.191937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad80ef3-ce42-4359-827e-ce796b3f97c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:07.193853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ad80ef3-ce42-4359-827e-ce796b3f97c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:07.244797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:28:07.441867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad80ef3-ce42-4359-827e-ce796b3f97c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:07.445927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad80ef3-ce42-4359-827e-ce796b3f97c4 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:07.562510 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1601/3189] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:28:06 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:28:14.144902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bdef4-d5c0-4e54-8e9f-47e035cbcf5f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:14.145411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bdef4-d5c0-4e54-8e9f-47e035cbcf5f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:14.145501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bdef4-d5c0-4e54-8e9f-47e035cbcf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:14.174383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-317bdef4-d5c0-4e54-8e9f-47e035cbcf5f None None] MFA Rules not processed for user `47aab8bfff21443891308d80f7059b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:14.175628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-317bdef4-d5c0-4e54-8e9f-47e035cbcf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:14.277626 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1589/3190] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:14.289985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1e8d3-e838-4ef0-94c1-895eb19b7c5f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:14.291032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1e8d3-e838-4ef0-94c1-895eb19b7c5f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:14.291522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1e8d3-e838-4ef0-94c1-895eb19b7c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:14.311437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b8d1e8d3-e838-4ef0-94c1-895eb19b7c5f None None] MFA Rules not processed for user `47aab8bfff21443891308d80f7059b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:14.312637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b8d1e8d3-e838-4ef0-94c1-895eb19b7c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:14.323217 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1602/3191] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:14.824343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bdef4-d5c0-4e54-8e9f-47e035cbcf5f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:14.826693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-317bdef4-d5c0-4e54-8e9f-47e035cbcf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:14.845100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bdef4-d5c0-4e54-8e9f-47e035cbcf5f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:14.850613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f30a58-56a9-47a8-9e2d-c16bc7aab06e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:14.851276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f30a58-56a9-47a8-9e2d-c16bc7aab06e service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:14.851570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f30a58-56a9-47a8-9e2d-c16bc7aab06e service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:14.851843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f30a58-56a9-47a8-9e2d-c16bc7aab06e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:14.862453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f30a58-56a9-47a8-9e2d-c16bc7aab06e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:14.864347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f30a58-56a9-47a8-9e2d-c16bc7aab06e service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:14.874146 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1590/3192] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:28:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:28:24.306139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=29 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:28:24.870567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=2,keystone:SELECT=90 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:28:26.515458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5d401-b410-49de-b770-d0957a68447a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:26.515948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5d401-b410-49de-b770-d0957a68447a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:26.516019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5d401-b410-49de-b770-d0957a68447a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:26.575872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1da5d401-b410-49de-b770-d0957a68447a None None] MFA Rules not processed for user `6a000e1296e34cdea76d81725df18832`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:26.583364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1da5d401-b410-49de-b770-d0957a68447a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:26.752713 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1603/3193] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:30.050091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f81b11-9d0c-4142-aa45-dfb057736eff None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:30.051451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f81b11-9d0c-4142-aa45-dfb057736eff None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:30.051868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f81b11-9d0c-4142-aa45-dfb057736eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:30.084399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-66f81b11-9d0c-4142-aa45-dfb057736eff None None] MFA Rules not processed for user `7127c83048e74e2e98cb97aae410018f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:30.085814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-66f81b11-9d0c-4142-aa45-dfb057736eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:30.240172 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1591/3194] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:36.057052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f5318-2d04-4e81-b05d-f0869761c9ba None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:36.057901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f5318-2d04-4e81-b05d-f0869761c9ba None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:36.058338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f5318-2d04-4e81-b05d-f0869761c9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:36.113650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dc9f5318-2d04-4e81-b05d-f0869761c9ba None None] MFA Rules not processed for user `7127c83048e74e2e98cb97aae410018f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:36.114896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc9f5318-2d04-4e81-b05d-f0869761c9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:36.156096 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1604/3195] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:36.469934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f81b11-9d0c-4142-aa45-dfb057736eff None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:36.472658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-66f81b11-9d0c-4142-aa45-dfb057736eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:36.501258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f81b11-9d0c-4142-aa45-dfb057736eff None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:36.507935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfec70-17c0-466f-ac86-ba1b1f1e9d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:36.508973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfec70-17c0-466f-ac86-ba1b1f1e9d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:36.509425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfec70-17c0-466f-ac86-ba1b1f1e9d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:36.509903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfec70-17c0-466f-ac86-ba1b1f1e9d5d admin admin] PATH_INFO: `/v3/users/d6bdf86e6ab64cf79ac70c471b9b2ab2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:36.511364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfec70-17c0-466f-ac86-ba1b1f1e9d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6bdf86e6ab64cf79ac70c471b9b2ab2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:36.514884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfec70-17c0-466f-ac86-ba1b1f1e9d5d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:36.601255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-91cfec70-17c0-466f-ac86-ba1b1f1e9d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6bdf86e6ab64cf79ac70c471b9b2ab2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:36.620141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-91cfec70-17c0-466f-ac86-ba1b1f1e9d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6bdf86e6ab64cf79ac70c471b9b2ab2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:36.622212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-91cfec70-17c0-466f-ac86-ba1b1f1e9d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6bdf86e6ab64cf79ac70c471b9b2ab2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:36.623063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-91cfec70-17c0-466f-ac86-ba1b1f1e9d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6bdf86e6ab64cf79ac70c471b9b2ab2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:36.641333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-91cfec70-17c0-466f-ac86-ba1b1f1e9d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6bdf86e6ab64cf79ac70c471b9b2ab2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:36.665060 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1592/3196] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:28:36 2022] DELETE /identity/v3/users/d6bdf86e6ab64cf79ac70c471b9b2ab2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:28:38.014393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f5318-2d04-4e81-b05d-f0869761c9ba None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:38.028325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f5318-2d04-4e81-b05d-f0869761c9ba None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:38.150760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dc1d6-1fbd-409c-b916-fc041686ccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:38.151435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dc1d6-1fbd-409c-b916-fc041686ccb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:38.151716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dc1d6-1fbd-409c-b916-fc041686ccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:38.151989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dc1d6-1fbd-409c-b916-fc041686ccb6 admin admin] PATH_INFO: `/v3/projects/d50100bb5ff24e96a77bda255cc9a9f6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:38.153985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dc1d6-1fbd-409c-b916-fc041686ccb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50100bb5ff24e96a77bda255cc9a9f6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:38.156470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dc1d6-1fbd-409c-b916-fc041686ccb6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:38.214009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f0dc1d6-1fbd-409c-b916-fc041686ccb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50100bb5ff24e96a77bda255cc9a9f6', 'request_id': 'req-7f0dc1d6-1fbd-409c-b916-fc041686ccb6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:38.226980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f0dc1d6-1fbd-409c-b916-fc041686ccb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50100bb5ff24e96a77bda255cc9a9f6', 'request_id': 'req-7f0dc1d6-1fbd-409c-b916-fc041686ccb6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:38.248287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f0dc1d6-1fbd-409c-b916-fc041686ccb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50100bb5ff24e96a77bda255cc9a9f6', 'request_id': 'req-7f0dc1d6-1fbd-409c-b916-fc041686ccb6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:38.261647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f0dc1d6-1fbd-409c-b916-fc041686ccb6 admin admin] The token cache is being invalidate because project d50100bb5ff24e96a77bda255cc9a9f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:28:38.262123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f0dc1d6-1fbd-409c-b916-fc041686ccb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:38.262911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f0dc1d6-1fbd-409c-b916-fc041686ccb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:38.269355 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1605/3197] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:28:38 2022] DELETE /identity/v3/projects/d50100bb5ff24e96a77bda255cc9a9f6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:28:38.273006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de47dc-e576-4a2b-b7c4-0e3053507c94 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:38.273436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de47dc-e576-4a2b-b7c4-0e3053507c94 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:38.273436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de47dc-e576-4a2b-b7c4-0e3053507c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:38.318349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-47de47dc-e576-4a2b-b7c4-0e3053507c94 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:38.320653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-47de47dc-e576-4a2b-b7c4-0e3053507c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:38.503433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d3c0f-dd54-40cb-b9be-91a7e34d86d6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:38.503640 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1593/3198] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:38.503736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d3c0f-dd54-40cb-b9be-91a7e34d86d6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:38.504020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d3c0f-dd54-40cb-b9be-91a7e34d86d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:38.552447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d83d3c0f-dd54-40cb-b9be-91a7e34d86d6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:38.564589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d83d3c0f-dd54-40cb-b9be-91a7e34d86d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:38.585414 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1606/3199] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:38.593173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de47dc-e576-4a2b-b7c4-0e3053507c94 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:38.604599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de47dc-e576-4a2b-b7c4-0e3053507c94 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:38.614449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d38d7e-1aba-4df3-adb5-b092a8164d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:38.615080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d38d7e-1aba-4df3-adb5-b092a8164d3b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:38.616004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d38d7e-1aba-4df3-adb5-b092a8164d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:38.616287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d38d7e-1aba-4df3-adb5-b092a8164d3b admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:38.616968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d38d7e-1aba-4df3-adb5-b092a8164d3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:28:38.617277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d38d7e-1aba-4df3-adb5-b092a8164d3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:38.619091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d38d7e-1aba-4df3-adb5-b092a8164d3b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:38.647877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d3c0f-dd54-40cb-b9be-91a7e34d86d6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:38.656405 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1594/3200] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:28:38.661497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d3c0f-dd54-40cb-b9be-91a7e34d86d6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:38.670304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c920de-6dd1-4b43-bdb4-31ecda7f2148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:38.671410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c920de-6dd1-4b43-bdb4-31ecda7f2148 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:38.671697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c920de-6dd1-4b43-bdb4-31ecda7f2148 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:38.672681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c920de-6dd1-4b43-bdb4-31ecda7f2148 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:38.673945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c920de-6dd1-4b43-bdb4-31ecda7f2148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:38.677935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c920de-6dd1-4b43-bdb4-31ecda7f2148 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:38.740861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:28:38.763296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d38d7e-1aba-4df3-adb5-b092a8164d3b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:38.770546 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1607/3201] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:28:38 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:28:38.772688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:28:38.786605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d38d7e-1aba-4df3-adb5-b092a8164d3b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:38.902794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c864e-18d1-4870-81b3-d7913e7f71c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:38.904380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c864e-18d1-4870-81b3-d7913e7f71c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:38.904879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c864e-18d1-4870-81b3-d7913e7f71c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:38.905315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c864e-18d1-4870-81b3-d7913e7f71c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:38.906767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c864e-18d1-4870-81b3-d7913e7f71c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:38.910112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c864e-18d1-4870-81b3-d7913e7f71c8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:38.952540 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1595/3202] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:28:38 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:28:38.956461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c920de-6dd1-4b43-bdb4-31ecda7f2148 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:38.969429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c920de-6dd1-4b43-bdb4-31ecda7f2148 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:38.976155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dc38e-f3af-4ca1-b417-f5061e2571f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:38.978666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc38e-f3af-4ca1-b417-f5061e2571f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:38.979352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc38e-f3af-4ca1-b417-f5061e2571f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:38.979811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc38e-f3af-4ca1-b417-f5061e2571f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:38.980756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dc38e-f3af-4ca1-b417-f5061e2571f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:38.982736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dc38e-f3af-4ca1-b417-f5061e2571f8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:39.001149 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1608/3203] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:28:39.004775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c864e-18d1-4870-81b3-d7913e7f71c8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:39.019169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c864e-18d1-4870-81b3-d7913e7f71c8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:39.024296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18c71c-537e-4667-ac51-cffe4a43dddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:39.025163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18c71c-537e-4667-ac51-cffe4a43dddc admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:39.025462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18c71c-537e-4667-ac51-cffe4a43dddc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:39.025873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18c71c-537e-4667-ac51-cffe4a43dddc admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:39.027013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18c71c-537e-4667-ac51-cffe4a43dddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:39.031399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18c71c-537e-4667-ac51-cffe4a43dddc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:39.054584 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1596/3204] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:28:39.058251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dc38e-f3af-4ca1-b417-f5061e2571f8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:39.079615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dc38e-f3af-4ca1-b417-f5061e2571f8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:39.086087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dae52-aa73-41c1-9f0b-63d8e44548a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:39.087090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dae52-aa73-41c1-9f0b-63d8e44548a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:39.088355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dae52-aa73-41c1-9f0b-63d8e44548a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:39.088739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dae52-aa73-41c1-9f0b-63d8e44548a3 admin admin] PATH_INFO: `/v3/projects/8f01489a0dad4f68b3ac28585ded94e7/users/dbf15e3294dc4450835847a05ad0ee7b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:39.111916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dae52-aa73-41c1-9f0b-63d8e44548a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f01489a0dad4f68b3ac28585ded94e7, user_id=dbf15e3294dc4450835847a05ad0ee7b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:39.116265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dae52-aa73-41c1-9f0b-63d8e44548a3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:39.147006 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1609/3205] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:28:39 2022] PUT /identity/v3/projects/8f01489a0dad4f68b3ac28585ded94e7/users/dbf15e3294dc4450835847a05ad0ee7b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:28:39.152842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c140760-dff2-4cea-a990-89d6f1dee96b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:39.153524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c140760-dff2-4cea-a990-89d6f1dee96b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:39.153946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c140760-dff2-4cea-a990-89d6f1dee96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:39.212840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2c140760-dff2-4cea-a990-89d6f1dee96b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:39.216812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2c140760-dff2-4cea-a990-89d6f1dee96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:39.379925 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1597/3206] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:39.391243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dae52-aa73-41c1-9f0b-63d8e44548a3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:39.393245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b8dae52-aa73-41c1-9f0b-63d8e44548a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:39.533413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dae52-aa73-41c1-9f0b-63d8e44548a3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:39.542925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfe356-67c8-4595-9a72-cf4fa78422c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:39.543786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfe356-67c8-4595-9a72-cf4fa78422c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:39.544141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfe356-67c8-4595-9a72-cf4fa78422c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:39.544432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfe356-67c8-4595-9a72-cf4fa78422c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:39.555811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfe356-67c8-4595-9a72-cf4fa78422c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:39.557402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfe356-67c8-4595-9a72-cf4fa78422c5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:39.569574 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1610/3207] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:28:41.051643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc9984-9e34-4557-bfaa-60a8c06db6c5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:41.052282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc9984-9e34-4557-bfaa-60a8c06db6c5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:41.052598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc9984-9e34-4557-bfaa-60a8c06db6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:41.090323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ebcc9984-9e34-4557-bfaa-60a8c06db6c5 None None] MFA Rules not processed for user `7127c83048e74e2e98cb97aae410018f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:41.092049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ebcc9984-9e34-4557-bfaa-60a8c06db6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:41.227479 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1598/3208] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:28:42.594091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab529e0-c01e-4cad-aa41-457bb479f1f6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:42.594091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab529e0-c01e-4cad-aa41-457bb479f1f6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:42.594091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab529e0-c01e-4cad-aa41-457bb479f1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:42.667018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3ab529e0-c01e-4cad-aa41-457bb479f1f6 None None] MFA Rules not processed for user `7127c83048e74e2e98cb97aae410018f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:42.671391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3ab529e0-c01e-4cad-aa41-457bb479f1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:42.706764 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1611/3209] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:44.023704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bf255-4fe2-4141-a003-212dc4ad0c32 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:44.024085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bf255-4fe2-4141-a003-212dc4ad0c32 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:44.024624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bf255-4fe2-4141-a003-212dc4ad0c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:44.060676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-719bf255-4fe2-4141-a003-212dc4ad0c32 None None] MFA Rules not processed for user `7127c83048e74e2e98cb97aae410018f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:44.062863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-719bf255-4fe2-4141-a003-212dc4ad0c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:44.077783 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1599/3210] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:45.305144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf0cdc-a008-4aeb-a004-0173171ced90 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:45.305144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf0cdc-a008-4aeb-a004-0173171ced90 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:45.305144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf0cdc-a008-4aeb-a004-0173171ced90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:45.353449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-05cf0cdc-a008-4aeb-a004-0173171ced90 None None] MFA Rules not processed for user `7127c83048e74e2e98cb97aae410018f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:45.357989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-05cf0cdc-a008-4aeb-a004-0173171ced90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:45.381887 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1612/3211] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:47.227755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347781e8-404d-4aa8-b5a7-ea48f46381b8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:47.228226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347781e8-404d-4aa8-b5a7-ea48f46381b8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:47.228337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347781e8-404d-4aa8-b5a7-ea48f46381b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:47.260447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab173ea-474b-451e-9798-e9d7b327b93b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:47.261436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab173ea-474b-451e-9798-e9d7b327b93b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:47.262028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab173ea-474b-451e-9798-e9d7b327b93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:47.266284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-347781e8-404d-4aa8-b5a7-ea48f46381b8 None None] MFA Rules not processed for user `7127c83048e74e2e98cb97aae410018f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:47.271557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-347781e8-404d-4aa8-b5a7-ea48f46381b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:47.289142 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1600/3212] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:47.328048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1ab173ea-474b-451e-9798-e9d7b327b93b None None] MFA Rules not processed for user `dbf15e3294dc4450835847a05ad0ee7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:47.336120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1ab173ea-474b-451e-9798-e9d7b327b93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:47.518319 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1613/3213] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:28:47.679436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347781e8-404d-4aa8-b5a7-ea48f46381b8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:47.680957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-347781e8-404d-4aa8-b5a7-ea48f46381b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:47.710715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:28:47.791602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347781e8-404d-4aa8-b5a7-ea48f46381b8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:47.798396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649ab34-6a72-44bd-899e-8bad96e4220d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:47.799028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649ab34-6a72-44bd-899e-8bad96e4220d service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:47.799489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649ab34-6a72-44bd-899e-8bad96e4220d service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:47.799921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649ab34-6a72-44bd-899e-8bad96e4220d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:47.823468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649ab34-6a72-44bd-899e-8bad96e4220d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:47.825605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649ab34-6a72-44bd-899e-8bad96e4220d service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:47.844791 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1601/3214] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:28:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:28:48.874544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8503ae-d49d-47d2-8bcf-be2592d7de72 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:48.875465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8503ae-d49d-47d2-8bcf-be2592d7de72 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:48.875852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8503ae-d49d-47d2-8bcf-be2592d7de72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:48.899243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9e8503ae-d49d-47d2-8bcf-be2592d7de72 None None] MFA Rules not processed for user `7127c83048e74e2e98cb97aae410018f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:48.900682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e8503ae-d49d-47d2-8bcf-be2592d7de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:48.908301 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1614/3215] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:49.979206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c6f6b-bc80-449e-ba03-23c246baf751 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:49.979903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c6f6b-bc80-449e-ba03-23c246baf751 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:49.980512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c6f6b-bc80-449e-ba03-23c246baf751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:50.024264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4f1c6f6b-bc80-449e-ba03-23c246baf751 None None] MFA Rules not processed for user `7127c83048e74e2e98cb97aae410018f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:50.025962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4f1c6f6b-bc80-449e-ba03-23c246baf751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:50.043651 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1602/3216] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:28:51.293325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b868dbc-70f9-4e4b-a749-7d057604db59 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:51.293854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b868dbc-70f9-4e4b-a749-7d057604db59 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:51.294039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b868dbc-70f9-4e4b-a749-7d057604db59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:51.339303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0b868dbc-70f9-4e4b-a749-7d057604db59 None None] MFA Rules not processed for user `dbf15e3294dc4450835847a05ad0ee7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:51.341167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0b868dbc-70f9-4e4b-a749-7d057604db59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:51.363731 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1615/3217] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:52.780632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580ac83-8d63-4df8-b670-45f04ffd7e16 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:52.781144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580ac83-8d63-4df8-b670-45f04ffd7e16 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:52.781221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580ac83-8d63-4df8-b670-45f04ffd7e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:52.836065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f580ac83-8d63-4df8-b670-45f04ffd7e16 None None] MFA Rules not processed for user `7127c83048e74e2e98cb97aae410018f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:52.837368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f580ac83-8d63-4df8-b670-45f04ffd7e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:52.859525 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1603/3218] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:55.954449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b868dbc-70f9-4e4b-a749-7d057604db59 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:55.976526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b868dbc-70f9-4e4b-a749-7d057604db59 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:55.997513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580ac83-8d63-4df8-b670-45f04ffd7e16 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:55.999192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f580ac83-8d63-4df8-b670-45f04ffd7e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:56.009187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d317c4-b3b3-409f-bdc2-2003623a12c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:56.022518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d317c4-b3b3-409f-bdc2-2003623a12c6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:56.022518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d317c4-b3b3-409f-bdc2-2003623a12c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:56.025923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d317c4-b3b3-409f-bdc2-2003623a12c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:56.037327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c2d317c4-b3b3-409f-bdc2-2003623a12c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:56.051074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580ac83-8d63-4df8-b670-45f04ffd7e16 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:56.067672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d317c4-b3b3-409f-bdc2-2003623a12c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:56.069655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d317c4-b3b3-409f-bdc2-2003623a12c6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:56.072022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608299f-3136-440b-88a3-b91a52e8fe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:56.073718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608299f-3136-440b-88a3-b91a52e8fe68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:56.075956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608299f-3136-440b-88a3-b91a52e8fe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:56.076525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608299f-3136-440b-88a3-b91a52e8fe68 admin admin] PATH_INFO: `/v3/users/bc2c3257ad8a48c6adbfef6617e379d8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:56.081191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608299f-3136-440b-88a3-b91a52e8fe68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc2c3257ad8a48c6adbfef6617e379d8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:56.084465 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1616/3219] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:28:56.089336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608299f-3136-440b-88a3-b91a52e8fe68 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:56.156891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfb132-0d4a-4276-abab-c0ea3f1beff3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:56.157416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfb132-0d4a-4276-abab-c0ea3f1beff3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:56.159073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfb132-0d4a-4276-abab-c0ea3f1beff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:56.209590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-79dfb132-0d4a-4276-abab-c0ea3f1beff3 None None] MFA Rules not processed for user `47aab8bfff21443891308d80f7059b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:56.212147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79dfb132-0d4a-4276-abab-c0ea3f1beff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:56.242488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:28:56.288686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c608299f-3136-440b-88a3-b91a52e8fe68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc2c3257ad8a48c6adbfef6617e379d8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:56.297658 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1617/3220] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:56.335403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c608299f-3136-440b-88a3-b91a52e8fe68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc2c3257ad8a48c6adbfef6617e379d8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:56.337258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c608299f-3136-440b-88a3-b91a52e8fe68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc2c3257ad8a48c6adbfef6617e379d8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:56.340094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c608299f-3136-440b-88a3-b91a52e8fe68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc2c3257ad8a48c6adbfef6617e379d8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:56.360597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c608299f-3136-440b-88a3-b91a52e8fe68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc2c3257ad8a48c6adbfef6617e379d8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:56.394769 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1604/3221] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:28:55 2022] DELETE /identity/v3/users/bc2c3257ad8a48c6adbfef6617e379d8 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:28:56.831857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfb132-0d4a-4276-abab-c0ea3f1beff3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:56.844828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfb132-0d4a-4276-abab-c0ea3f1beff3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:56.934878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b0d65-07d9-4ef7-8ccd-894b480136df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:56.935607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b0d65-07d9-4ef7-8ccd-894b480136df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:56.935889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b0d65-07d9-4ef7-8ccd-894b480136df admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:56.936165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b0d65-07d9-4ef7-8ccd-894b480136df admin admin] PATH_INFO: `/v3/projects/e4dbca9f71ac4a208e050eb7be880699` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:56.939068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b0d65-07d9-4ef7-8ccd-894b480136df admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4dbca9f71ac4a208e050eb7be880699)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:56.943319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b0d65-07d9-4ef7-8ccd-894b480136df admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:57.011850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f1b0d65-07d9-4ef7-8ccd-894b480136df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4dbca9f71ac4a208e050eb7be880699', 'request_id': 'req-3f1b0d65-07d9-4ef7-8ccd-894b480136df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:57.041980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f1b0d65-07d9-4ef7-8ccd-894b480136df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4dbca9f71ac4a208e050eb7be880699', 'request_id': 'req-3f1b0d65-07d9-4ef7-8ccd-894b480136df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:57.056693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f1b0d65-07d9-4ef7-8ccd-894b480136df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4dbca9f71ac4a208e050eb7be880699', 'request_id': 'req-3f1b0d65-07d9-4ef7-8ccd-894b480136df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:57.074724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f1b0d65-07d9-4ef7-8ccd-894b480136df admin admin] The token cache is being invalidate because project e4dbca9f71ac4a208e050eb7be880699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:28:57.074923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f1b0d65-07d9-4ef7-8ccd-894b480136df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:57.075704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f1b0d65-07d9-4ef7-8ccd-894b480136df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:28:57.081805 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1618/3222] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:28:56 2022] DELETE /identity/v3/projects/e4dbca9f71ac4a208e050eb7be880699 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:28:57.083568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9803a-4850-4807-a379-b9ca84a6d104 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:57.085124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9803a-4850-4807-a379-b9ca84a6d104 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:57.085421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9803a-4850-4807-a379-b9ca84a6d104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:57.128709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-68a9803a-4850-4807-a379-b9ca84a6d104 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:57.132180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-68a9803a-4850-4807-a379-b9ca84a6d104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:57.236231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:28:57.274806 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1605/3223] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:57.279245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a1b54-ccb2-4c36-bb14-cbb990744521 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:57.279555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a1b54-ccb2-4c36-bb14-cbb990744521 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:57.279832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a1b54-ccb2-4c36-bb14-cbb990744521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:57.311272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-797a1b54-ccb2-4c36-bb14-cbb990744521 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:57.313180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-797a1b54-ccb2-4c36-bb14-cbb990744521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:57.321356 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1619/3224] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:57.325839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9803a-4850-4807-a379-b9ca84a6d104 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:57.337102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9803a-4850-4807-a379-b9ca84a6d104 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:57.344287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac788cf-1b4f-47cf-9f6d-ab077cf14dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:57.344924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac788cf-1b4f-47cf-9f6d-ab077cf14dcc admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:57.345406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac788cf-1b4f-47cf-9f6d-ab077cf14dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:57.346233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac788cf-1b4f-47cf-9f6d-ab077cf14dcc admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:57.347107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac788cf-1b4f-47cf-9f6d-ab077cf14dcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:28:57.347820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac788cf-1b4f-47cf-9f6d-ab077cf14dcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:57.351135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac788cf-1b4f-47cf-9f6d-ab077cf14dcc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:57.367307 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1606/3225] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:28:57.371046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a1b54-ccb2-4c36-bb14-cbb990744521 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:57.383148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a1b54-ccb2-4c36-bb14-cbb990744521 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:57.388942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac802b-70ef-467c-a3cd-f0553079cd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:57.389740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac802b-70ef-467c-a3cd-f0553079cd21 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:57.390285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac802b-70ef-467c-a3cd-f0553079cd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:57.390561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac802b-70ef-467c-a3cd-f0553079cd21 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:57.391231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac802b-70ef-467c-a3cd-f0553079cd21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:57.393258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac802b-70ef-467c-a3cd-f0553079cd21 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:57.459299 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1620/3226] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:28:57 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:28:57.463631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac788cf-1b4f-47cf-9f6d-ab077cf14dcc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:57.477711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac788cf-1b4f-47cf-9f6d-ab077cf14dcc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:57.562740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d5ec1-468e-414c-b168-f28c7288aa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:57.563397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d5ec1-468e-414c-b168-f28c7288aa11 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:57.563673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d5ec1-468e-414c-b168-f28c7288aa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:57.564036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d5ec1-468e-414c-b168-f28c7288aa11 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:57.564677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d5ec1-468e-414c-b168-f28c7288aa11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:57.566653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d5ec1-468e-414c-b168-f28c7288aa11 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:57.595331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac802b-70ef-467c-a3cd-f0553079cd21 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:57.600904 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1607/3227] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:28:57 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:28:57.606819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac802b-70ef-467c-a3cd-f0553079cd21 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:57.612503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e461d-7ad7-484b-b3bf-e1a80a70ef9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:57.613291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e461d-7ad7-484b-b3bf-e1a80a70ef9b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:57.613675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e461d-7ad7-484b-b3bf-e1a80a70ef9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:57.614018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e461d-7ad7-484b-b3bf-e1a80a70ef9b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:57.614808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e461d-7ad7-484b-b3bf-e1a80a70ef9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:57.617299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e461d-7ad7-484b-b3bf-e1a80a70ef9b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:57.636327 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1621/3228] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:28:57.638019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d5ec1-468e-414c-b168-f28c7288aa11 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:57.652511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d5ec1-468e-414c-b168-f28c7288aa11 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:57.658453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba896d-33cf-4bda-ba3c-0071cf01bffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:57.659185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba896d-33cf-4bda-ba3c-0071cf01bffb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:57.659559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba896d-33cf-4bda-ba3c-0071cf01bffb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:57.660133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba896d-33cf-4bda-ba3c-0071cf01bffb admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:57.661863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba896d-33cf-4bda-ba3c-0071cf01bffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:57.663646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba896d-33cf-4bda-ba3c-0071cf01bffb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:57.679733 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1608/3229] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:28:57.683610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e461d-7ad7-484b-b3bf-e1a80a70ef9b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:57.691119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:28:57.695799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e461d-7ad7-484b-b3bf-e1a80a70ef9b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:57.706565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1450d7-0aa5-4941-9449-49a6a24b2578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:57.707289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1450d7-0aa5-4941-9449-49a6a24b2578 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:57.707583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1450d7-0aa5-4941-9449-49a6a24b2578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:57.707878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1450d7-0aa5-4941-9449-49a6a24b2578 admin admin] PATH_INFO: `/v3/projects/606b0dcabea8477e96fe9f5af5e9551b/users/1ecfc657949249078e4affb4c3b6aa57/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:57.726970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1450d7-0aa5-4941-9449-49a6a24b2578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=606b0dcabea8477e96fe9f5af5e9551b, user_id=1ecfc657949249078e4affb4c3b6aa57, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:57.729873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1450d7-0aa5-4941-9449-49a6a24b2578 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:57.748043 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1622/3230] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:28:57 2022] PUT /identity/v3/projects/606b0dcabea8477e96fe9f5af5e9551b/users/1ecfc657949249078e4affb4c3b6aa57/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:28:57.753055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622847a-788f-4a06-9ae0-13c0671501fd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:57.753332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622847a-788f-4a06-9ae0-13c0671501fd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:57.753607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622847a-788f-4a06-9ae0-13c0671501fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:57.779061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f622847a-788f-4a06-9ae0-13c0671501fd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:28:57.780326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f622847a-788f-4a06-9ae0-13c0671501fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:57.882519 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1609/3231] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:28:57.891215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1450d7-0aa5-4941-9449-49a6a24b2578 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:57.893260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ed1450d7-0aa5-4941-9449-49a6a24b2578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:57.965132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1450d7-0aa5-4941-9449-49a6a24b2578 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:57.971004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c5041-2b6a-494b-9b99-d1cea18263f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:57.971836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c5041-2b6a-494b-9b99-d1cea18263f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:57.972222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c5041-2b6a-494b-9b99-d1cea18263f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:57.972602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c5041-2b6a-494b-9b99-d1cea18263f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:57.982651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c5041-2b6a-494b-9b99-d1cea18263f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:57.984801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c5041-2b6a-494b-9b99-d1cea18263f1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:57.996242 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1623/3232] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:28:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:28:59.266122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622847a-788f-4a06-9ae0-13c0671501fd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:28:59.267690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f622847a-788f-4a06-9ae0-13c0671501fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:59.304624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622847a-788f-4a06-9ae0-13c0671501fd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:28:59.315707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c7bcc-37fc-461d-8828-91f6191b6a35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:28:59.316452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c7bcc-37fc-461d-8828-91f6191b6a35 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:28:59.316738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c7bcc-37fc-461d-8828-91f6191b6a35 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:28:59.317103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c7bcc-37fc-461d-8828-91f6191b6a35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:28:59.322209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c50c7bcc-37fc-461d-8828-91f6191b6a35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:28:59.517006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:28:59.543413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c7bcc-37fc-461d-8828-91f6191b6a35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:28:59.544861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c7bcc-37fc-461d-8828-91f6191b6a35 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:28:59.560709 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1610/3233] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:28:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:29:00.922243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c5041-2b6a-494b-9b99-d1cea18263f1 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:00.941747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c5041-2b6a-494b-9b99-d1cea18263f1 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:00.973525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067b050-4589-41ad-ae02-b18c36f555ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:00.975399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b050-4589-41ad-ae02-b18c36f555ad service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:00.982023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b050-4589-41ad-ae02-b18c36f555ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:00.982439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b050-4589-41ad-ae02-b18c36f555ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:00.995887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3067b050-4589-41ad-ae02-b18c36f555ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:01.039199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067b050-4589-41ad-ae02-b18c36f555ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:01.040700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067b050-4589-41ad-ae02-b18c36f555ad service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:01.076016 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1624/3234] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:29:07.022834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067b050-4589-41ad-ae02-b18c36f555ad service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:07.023524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c7bcc-37fc-461d-8828-91f6191b6a35 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:07.040798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c7bcc-37fc-461d-8828-91f6191b6a35 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:07.054306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067b050-4589-41ad-ae02-b18c36f555ad service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:07.065489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1abf3-019f-417e-8dcc-6fb781a0cae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:07.066729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1abf3-019f-417e-8dcc-6fb781a0cae0 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:07.068337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1abf3-019f-417e-8dcc-6fb781a0cae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:07.068724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1abf3-019f-417e-8dcc-6fb781a0cae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:07.074182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ccd1abf3-019f-417e-8dcc-6fb781a0cae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:07.075917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1230302-219f-4cae-b27d-0f1552b96c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:07.076573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1230302-219f-4cae-b27d-0f1552b96c41 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:07.076846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1230302-219f-4cae-b27d-0f1552b96c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:07.078434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1230302-219f-4cae-b27d-0f1552b96c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:07.087355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d1230302-219f-4cae-b27d-0f1552b96c41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:07.126583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1230302-219f-4cae-b27d-0f1552b96c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:07.133655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1230302-219f-4cae-b27d-0f1552b96c41 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:07.142806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1abf3-019f-417e-8dcc-6fb781a0cae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:07.146361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1abf3-019f-417e-8dcc-6fb781a0cae0 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:07.162214 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1625/3235] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:29:07.177318 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1611/3236] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:29:09.552488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537cfa5-fbd5-4989-b5c7-841cb34130c9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:09.553330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537cfa5-fbd5-4989-b5c7-841cb34130c9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:09.553779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537cfa5-fbd5-4989-b5c7-841cb34130c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:09.590517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0537cfa5-fbd5-4989-b5c7-841cb34130c9 None None] MFA Rules not processed for user `7127c83048e74e2e98cb97aae410018f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:09.591824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0537cfa5-fbd5-4989-b5c7-841cb34130c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:09.686277 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1626/3237] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:11.843537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40fb7e-d608-435c-add4-9c6b09c67414 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:11.844413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40fb7e-d608-435c-add4-9c6b09c67414 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:11.844900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40fb7e-d608-435c-add4-9c6b09c67414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:11.874998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3b40fb7e-d608-435c-add4-9c6b09c67414 None None] MFA Rules not processed for user `7127c83048e74e2e98cb97aae410018f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:11.876597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3b40fb7e-d608-435c-add4-9c6b09c67414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:11.887110 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1612/3238] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:13.864081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93812243-3ab3-4938-93d8-abc117cb1eb4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:13.864922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93812243-3ab3-4938-93d8-abc117cb1eb4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:13.865339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93812243-3ab3-4938-93d8-abc117cb1eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:13.917733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-93812243-3ab3-4938-93d8-abc117cb1eb4 None None] MFA Rules not processed for user `1ecfc657949249078e4affb4c3b6aa57`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:13.919126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-93812243-3ab3-4938-93d8-abc117cb1eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:14.041913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:14.076681 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1627/3239] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:14.120929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40fb7e-d608-435c-add4-9c6b09c67414 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:14.122868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3b40fb7e-d608-435c-add4-9c6b09c67414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:14.151660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40fb7e-d608-435c-add4-9c6b09c67414 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:14.158476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7484c-c6c5-40ff-8eea-4be98877ea55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:14.160297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7484c-c6c5-40ff-8eea-4be98877ea55 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:14.160586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7484c-c6c5-40ff-8eea-4be98877ea55 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:14.160868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7484c-c6c5-40ff-8eea-4be98877ea55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:14.178851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7484c-c6c5-40ff-8eea-4be98877ea55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:14.183886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7484c-c6c5-40ff-8eea-4be98877ea55 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:14.201889 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1613/3240] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:29:15.025173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93812243-3ab3-4938-93d8-abc117cb1eb4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:15.033872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-93812243-3ab3-4938-93d8-abc117cb1eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:15.071290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93812243-3ab3-4938-93d8-abc117cb1eb4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:15.083048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7956fa1-bbb4-455c-a9ed-55f7d006b3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:15.084293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956fa1-bbb4-455c-a9ed-55f7d006b3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:15.085586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956fa1-bbb4-455c-a9ed-55f7d006b3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:15.086886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956fa1-bbb4-455c-a9ed-55f7d006b3c2 admin admin] PATH_INFO: `/v3/users/6a000e1296e34cdea76d81725df18832` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:15.091370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7956fa1-bbb4-455c-a9ed-55f7d006b3c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a000e1296e34cdea76d81725df18832)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:15.094903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7956fa1-bbb4-455c-a9ed-55f7d006b3c2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:15.215190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e7956fa1-bbb4-455c-a9ed-55f7d006b3c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a000e1296e34cdea76d81725df18832'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:15.216565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e7956fa1-bbb4-455c-a9ed-55f7d006b3c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a000e1296e34cdea76d81725df18832'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:15.227185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e7956fa1-bbb4-455c-a9ed-55f7d006b3c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a000e1296e34cdea76d81725df18832'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:15.244283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e7956fa1-bbb4-455c-a9ed-55f7d006b3c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a000e1296e34cdea76d81725df18832'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:15.266252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e7956fa1-bbb4-455c-a9ed-55f7d006b3c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a000e1296e34cdea76d81725df18832'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:15.275448 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1628/3241] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:29:15 2022] DELETE /identity/v3/users/6a000e1296e34cdea76d81725df18832 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:15.887382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7484c-c6c5-40ff-8eea-4be98877ea55 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:15.905974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7484c-c6c5-40ff-8eea-4be98877ea55 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:16.052530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dfaf1-1f50-429c-97ff-50a07e1db149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:16.053462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dfaf1-1f50-429c-97ff-50a07e1db149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:16.053923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dfaf1-1f50-429c-97ff-50a07e1db149 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:16.054351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dfaf1-1f50-429c-97ff-50a07e1db149 admin admin] PATH_INFO: `/v3/projects/d32af09a74f542c2aae7259e59277025` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:16.055693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dfaf1-1f50-429c-97ff-50a07e1db149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32af09a74f542c2aae7259e59277025)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:16.057801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dfaf1-1f50-429c-97ff-50a07e1db149 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:16.154751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c67dfaf1-1f50-429c-97ff-50a07e1db149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32af09a74f542c2aae7259e59277025', 'request_id': 'req-c67dfaf1-1f50-429c-97ff-50a07e1db149'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:16.172352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c67dfaf1-1f50-429c-97ff-50a07e1db149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32af09a74f542c2aae7259e59277025', 'request_id': 'req-c67dfaf1-1f50-429c-97ff-50a07e1db149'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:16.185953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c67dfaf1-1f50-429c-97ff-50a07e1db149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32af09a74f542c2aae7259e59277025', 'request_id': 'req-c67dfaf1-1f50-429c-97ff-50a07e1db149'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:16.216925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c67dfaf1-1f50-429c-97ff-50a07e1db149 admin admin] The token cache is being invalidate because project d32af09a74f542c2aae7259e59277025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:29:16.218028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c67dfaf1-1f50-429c-97ff-50a07e1db149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:16.219468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c67dfaf1-1f50-429c-97ff-50a07e1db149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:16.226426 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1614/3242] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:29:15 2022] DELETE /identity/v3/projects/d32af09a74f542c2aae7259e59277025 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:16.228658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94af1e0-a4e6-4813-9b76-6ad73a307c5f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:16.229070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94af1e0-a4e6-4813-9b76-6ad73a307c5f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:16.229144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94af1e0-a4e6-4813-9b76-6ad73a307c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:16.313036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a94af1e0-a4e6-4813-9b76-6ad73a307c5f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:16.322382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a94af1e0-a4e6-4813-9b76-6ad73a307c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:16.499602 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1629/3243] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:16.507537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c8f6d-3190-41e0-8e6d-9561a590600f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:16.509540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c8f6d-3190-41e0-8e6d-9561a590600f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:16.509993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c8f6d-3190-41e0-8e6d-9561a590600f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:16.575530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8f0c8f6d-3190-41e0-8e6d-9561a590600f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:16.576788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8f0c8f6d-3190-41e0-8e6d-9561a590600f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:16.605682 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1615/3244] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:16.608570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94af1e0-a4e6-4813-9b76-6ad73a307c5f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:16.620757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94af1e0-a4e6-4813-9b76-6ad73a307c5f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:16.637241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4649b-8320-4c64-9637-0f60159a95a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:16.638107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4649b-8320-4c64-9637-0f60159a95a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:16.638528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4649b-8320-4c64-9637-0f60159a95a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:16.638941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4649b-8320-4c64-9637-0f60159a95a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:16.639912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4649b-8320-4c64-9637-0f60159a95a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:29:16.640498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4649b-8320-4c64-9637-0f60159a95a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:16.642273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4649b-8320-4c64-9637-0f60159a95a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:16.687427 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1630/3245] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:29:16.692152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c8f6d-3190-41e0-8e6d-9561a590600f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:16.703742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c8f6d-3190-41e0-8e6d-9561a590600f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:16.720868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e0ca0-727e-4f96-b615-dd71e97a7fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:16.727609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e0ca0-727e-4f96-b615-dd71e97a7fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:16.728312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e0ca0-727e-4f96-b615-dd71e97a7fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:16.728312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e0ca0-727e-4f96-b615-dd71e97a7fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:16.728893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e0ca0-727e-4f96-b615-dd71e97a7fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:16.730833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e0ca0-727e-4f96-b615-dd71e97a7fd9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:16.835593 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1616/3246] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:29:16 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:29:16.840388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4649b-8320-4c64-9637-0f60159a95a6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:16.857175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4649b-8320-4c64-9637-0f60159a95a6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:16.970003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:16.989680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78988ac7-e2af-4c7c-9634-f081d13a8dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:16.991553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78988ac7-e2af-4c7c-9634-f081d13a8dac admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:16.992304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78988ac7-e2af-4c7c-9634-f081d13a8dac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:16.992955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78988ac7-e2af-4c7c-9634-f081d13a8dac admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:16.993836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78988ac7-e2af-4c7c-9634-f081d13a8dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:16.996444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78988ac7-e2af-4c7c-9634-f081d13a8dac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:17.033985 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1631/3247] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:29:16 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:29:17.034861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e0ca0-727e-4f96-b615-dd71e97a7fd9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:17.054414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e0ca0-727e-4f96-b615-dd71e97a7fd9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:17.066927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f441bb4-387f-4667-8e54-a5f3ac6c4fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:17.068839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f441bb4-387f-4667-8e54-a5f3ac6c4fdf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:17.070433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f441bb4-387f-4667-8e54-a5f3ac6c4fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:17.070883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f441bb4-387f-4667-8e54-a5f3ac6c4fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:17.073289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f441bb4-387f-4667-8e54-a5f3ac6c4fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:17.081071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f441bb4-387f-4667-8e54-a5f3ac6c4fdf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:17.128426 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1617/3248] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:29:17.134252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78988ac7-e2af-4c7c-9634-f081d13a8dac admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:17.148533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78988ac7-e2af-4c7c-9634-f081d13a8dac admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:17.162659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adeb7b-062a-4f68-b455-410e6a9ae351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:17.164312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adeb7b-062a-4f68-b455-410e6a9ae351 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:17.165940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adeb7b-062a-4f68-b455-410e6a9ae351 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:17.166366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adeb7b-062a-4f68-b455-410e6a9ae351 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:17.167149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adeb7b-062a-4f68-b455-410e6a9ae351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:17.173333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adeb7b-062a-4f68-b455-410e6a9ae351 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:17.204503 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1632/3249] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:29:17.205334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f441bb4-387f-4667-8e54-a5f3ac6c4fdf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:17.220090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f441bb4-387f-4667-8e54-a5f3ac6c4fdf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:17.226199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f49e65-dc80-4db0-abbf-e2c659b8729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:17.228754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f49e65-dc80-4db0-abbf-e2c659b8729c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:17.229492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f49e65-dc80-4db0-abbf-e2c659b8729c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:17.231228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f49e65-dc80-4db0-abbf-e2c659b8729c admin admin] PATH_INFO: `/v3/projects/05de1bc32efc4801bc9b439d58d1921e/users/be640d7176394898a58879a22ae6524c/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:17.236097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:17.267694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f49e65-dc80-4db0-abbf-e2c659b8729c admin admin] RBAC: Authorizing `identity:create_grant(project_id=05de1bc32efc4801bc9b439d58d1921e, user_id=be640d7176394898a58879a22ae6524c, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:17.271713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f49e65-dc80-4db0-abbf-e2c659b8729c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:17.306966 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1618/3250] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:29:17 2022] PUT /identity/v3/projects/05de1bc32efc4801bc9b439d58d1921e/users/be640d7176394898a58879a22ae6524c/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:29:17.317598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ab0bd-6977-469c-aa8b-a4015eb886fb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:17.318186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ab0bd-6977-469c-aa8b-a4015eb886fb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:17.318186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ab0bd-6977-469c-aa8b-a4015eb886fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:17.396251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ac6ab0bd-6977-469c-aa8b-a4015eb886fb None None] MFA Rules not processed for user `be640d7176394898a58879a22ae6524c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:17.399299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac6ab0bd-6977-469c-aa8b-a4015eb886fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:17.664748 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1633/3251] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:17.938416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783f16b-f147-4be4-9aef-5d75436257ce None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:17.938692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783f16b-f147-4be4-9aef-5d75436257ce None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:17.939000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783f16b-f147-4be4-9aef-5d75436257ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:17.978668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c783f16b-f147-4be4-9aef-5d75436257ce None None] MFA Rules not processed for user `1ecfc657949249078e4affb4c3b6aa57`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:17.979992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c783f16b-f147-4be4-9aef-5d75436257ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:18.112505 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1619/3252] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:18.392088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ab0bd-6977-469c-aa8b-a4015eb886fb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:18.394194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac6ab0bd-6977-469c-aa8b-a4015eb886fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:18.535734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ab0bd-6977-469c-aa8b-a4015eb886fb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:18.543357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586a17d-08cf-4d51-a89c-3795939ca6c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:18.544205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586a17d-08cf-4d51-a89c-3795939ca6c6 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:18.545263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586a17d-08cf-4d51-a89c-3795939ca6c6 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:18.545742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586a17d-08cf-4d51-a89c-3795939ca6c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:18.574475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586a17d-08cf-4d51-a89c-3795939ca6c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:18.576442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586a17d-08cf-4d51-a89c-3795939ca6c6 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:18.617141 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1634/3253] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:29:21.266525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783f16b-f147-4be4-9aef-5d75436257ce None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:21.268361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c783f16b-f147-4be4-9aef-5d75436257ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:21.411245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783f16b-f147-4be4-9aef-5d75436257ce None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:21.418215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708419b-8d5c-435c-a3aa-872316df2a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:21.419585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708419b-8d5c-435c-a3aa-872316df2a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:21.420082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708419b-8d5c-435c-a3aa-872316df2a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:21.420908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708419b-8d5c-435c-a3aa-872316df2a9a admin admin] PATH_INFO: `/v3/users/a3f83d2a0be442cb83593a030e92c752` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:21.422996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708419b-8d5c-435c-a3aa-872316df2a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3f83d2a0be442cb83593a030e92c752)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:21.427073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708419b-8d5c-435c-a3aa-872316df2a9a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:21.527699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a708419b-8d5c-435c-a3aa-872316df2a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3f83d2a0be442cb83593a030e92c752'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:21.563179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a708419b-8d5c-435c-a3aa-872316df2a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3f83d2a0be442cb83593a030e92c752'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:21.570977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a708419b-8d5c-435c-a3aa-872316df2a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3f83d2a0be442cb83593a030e92c752'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:21.572145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a708419b-8d5c-435c-a3aa-872316df2a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3f83d2a0be442cb83593a030e92c752'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:21.586321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a708419b-8d5c-435c-a3aa-872316df2a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3f83d2a0be442cb83593a030e92c752'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:21.628731 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1620/3254] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:29:21 2022] DELETE /identity/v3/users/a3f83d2a0be442cb83593a030e92c752 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:23.220178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586a17d-08cf-4d51-a89c-3795939ca6c6 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:23.239970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586a17d-08cf-4d51-a89c-3795939ca6c6 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:23.324645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:23.358892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6f5e9-71ad-4768-aca3-b838441b8828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:23.360075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6f5e9-71ad-4768-aca3-b838441b8828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:23.374118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6f5e9-71ad-4768-aca3-b838441b8828 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:23.374744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6f5e9-71ad-4768-aca3-b838441b8828 admin admin] PATH_INFO: `/v3/projects/64e03464dba44122a858181271362ea0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:23.376688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6f5e9-71ad-4768-aca3-b838441b8828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e03464dba44122a858181271362ea0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:23.381319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6f5e9-71ad-4768-aca3-b838441b8828 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:23.468882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6e6f5e9-71ad-4768-aca3-b838441b8828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e03464dba44122a858181271362ea0', 'request_id': 'req-a6e6f5e9-71ad-4768-aca3-b838441b8828'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:23.487075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6e6f5e9-71ad-4768-aca3-b838441b8828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e03464dba44122a858181271362ea0', 'request_id': 'req-a6e6f5e9-71ad-4768-aca3-b838441b8828'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:23.510634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6e6f5e9-71ad-4768-aca3-b838441b8828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e03464dba44122a858181271362ea0', 'request_id': 'req-a6e6f5e9-71ad-4768-aca3-b838441b8828'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:23.563407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6e6f5e9-71ad-4768-aca3-b838441b8828 admin admin] The token cache is being invalidate because project 64e03464dba44122a858181271362ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:29:23.563800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6e6f5e9-71ad-4768-aca3-b838441b8828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:23.572128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6e6f5e9-71ad-4768-aca3-b838441b8828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:23.574621 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1635/3255] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:29:23 2022] DELETE /identity/v3/projects/64e03464dba44122a858181271362ea0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:23.575577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708419b-8d5c-435c-a3aa-872316df2a9a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:23.578306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a708419b-8d5c-435c-a3aa-872316df2a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:23.603475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708419b-8d5c-435c-a3aa-872316df2a9a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:23.627032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:23.807735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f882690-b340-4948-b936-2aaad1030bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:23.808538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f882690-b340-4948-b936-2aaad1030bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:23.808945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f882690-b340-4948-b936-2aaad1030bca admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:23.809324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f882690-b340-4948-b936-2aaad1030bca admin admin] PATH_INFO: `/v3/users/c83fd67cc593459b9b52bbe50080680d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:23.815425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f882690-b340-4948-b936-2aaad1030bca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83fd67cc593459b9b52bbe50080680d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:23.817627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f882690-b340-4948-b936-2aaad1030bca admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:23.967609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8f882690-b340-4948-b936-2aaad1030bca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83fd67cc593459b9b52bbe50080680d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:24.004025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8f882690-b340-4948-b936-2aaad1030bca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83fd67cc593459b9b52bbe50080680d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:24.004908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8f882690-b340-4948-b936-2aaad1030bca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83fd67cc593459b9b52bbe50080680d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:24.005627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8f882690-b340-4948-b936-2aaad1030bca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83fd67cc593459b9b52bbe50080680d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:24.024118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8f882690-b340-4948-b936-2aaad1030bca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83fd67cc593459b9b52bbe50080680d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:24.060607 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1621/3256] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:29:23 2022] DELETE /identity/v3/users/c83fd67cc593459b9b52bbe50080680d => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:25.396017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6f5e9-71ad-4768-aca3-b838441b8828 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:25.397546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a6e6f5e9-71ad-4768-aca3-b838441b8828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:25.425009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6f5e9-71ad-4768-aca3-b838441b8828 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:25.587032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04d98d-a2d4-464d-91da-7a3e266f005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:25.588024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04d98d-a2d4-464d-91da-7a3e266f005a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:25.588472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04d98d-a2d4-464d-91da-7a3e266f005a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:25.588883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04d98d-a2d4-464d-91da-7a3e266f005a admin admin] PATH_INFO: `/v3/users/be640d7176394898a58879a22ae6524c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:25.591784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04d98d-a2d4-464d-91da-7a3e266f005a admin admin] RBAC: Authorizing `identity:delete_user(user_id=be640d7176394898a58879a22ae6524c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:25.593914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04d98d-a2d4-464d-91da-7a3e266f005a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:25.725801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca04d98d-a2d4-464d-91da-7a3e266f005a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be640d7176394898a58879a22ae6524c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:25.728386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca04d98d-a2d4-464d-91da-7a3e266f005a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be640d7176394898a58879a22ae6524c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:25.755976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca04d98d-a2d4-464d-91da-7a3e266f005a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be640d7176394898a58879a22ae6524c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:25.793039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca04d98d-a2d4-464d-91da-7a3e266f005a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be640d7176394898a58879a22ae6524c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:25.829570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:25.837865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca04d98d-a2d4-464d-91da-7a3e266f005a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be640d7176394898a58879a22ae6524c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:25.852543 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1636/3257] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:29:25 2022] DELETE /identity/v3/users/be640d7176394898a58879a22ae6524c => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:25.857088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcb3cf-bbc1-4269-b04e-274783bcb5f3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:25.858392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcb3cf-bbc1-4269-b04e-274783bcb5f3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:25.858821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcb3cf-bbc1-4269-b04e-274783bcb5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:25.926352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-abbcb3cf-bbc1-4269-b04e-274783bcb5f3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:25.926352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-abbcb3cf-bbc1-4269-b04e-274783bcb5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:26.133998 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1622/3258] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:26.181740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04d98d-a2d4-464d-91da-7a3e266f005a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:26.183630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ca04d98d-a2d4-464d-91da-7a3e266f005a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:26.380632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04d98d-a2d4-464d-91da-7a3e266f005a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:26.392474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556d75c-173a-4890-ac7e-47e01407eedc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:26.393121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556d75c-173a-4890-ac7e-47e01407eedc service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:26.393404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556d75c-173a-4890-ac7e-47e01407eedc service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:26.393683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556d75c-173a-4890-ac7e-47e01407eedc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:26.426605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556d75c-173a-4890-ac7e-47e01407eedc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:26.429464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556d75c-173a-4890-ac7e-47e01407eedc service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:26.468804 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1637/3259] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:29:26.626907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcb3cf-bbc1-4269-b04e-274783bcb5f3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:26.628793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-abbcb3cf-bbc1-4269-b04e-274783bcb5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:26.652522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcb3cf-bbc1-4269-b04e-274783bcb5f3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:26.668631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063091a8-913a-46a0-846f-ec8b2b8c1370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:26.670489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063091a8-913a-46a0-846f-ec8b2b8c1370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:26.670930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063091a8-913a-46a0-846f-ec8b2b8c1370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:26.671420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063091a8-913a-46a0-846f-ec8b2b8c1370 admin admin] PATH_INFO: `/v3/projects/3d63ad846c0d4b54919733cd9cd36f8b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:26.673072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063091a8-913a-46a0-846f-ec8b2b8c1370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d63ad846c0d4b54919733cd9cd36f8b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:26.675229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063091a8-913a-46a0-846f-ec8b2b8c1370 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:26.718285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:26.795200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-063091a8-913a-46a0-846f-ec8b2b8c1370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d63ad846c0d4b54919733cd9cd36f8b', 'request_id': 'req-063091a8-913a-46a0-846f-ec8b2b8c1370'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:26.815787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-063091a8-913a-46a0-846f-ec8b2b8c1370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d63ad846c0d4b54919733cd9cd36f8b', 'request_id': 'req-063091a8-913a-46a0-846f-ec8b2b8c1370'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:26.828537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-063091a8-913a-46a0-846f-ec8b2b8c1370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d63ad846c0d4b54919733cd9cd36f8b', 'request_id': 'req-063091a8-913a-46a0-846f-ec8b2b8c1370'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:26.889548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-063091a8-913a-46a0-846f-ec8b2b8c1370 admin admin] The token cache is being invalidate because project 3d63ad846c0d4b54919733cd9cd36f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:29:26.890110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-063091a8-913a-46a0-846f-ec8b2b8c1370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:26.892701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-063091a8-913a-46a0-846f-ec8b2b8c1370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:26.899756 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1623/3260] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:29:26 2022] DELETE /identity/v3/projects/3d63ad846c0d4b54919733cd9cd36f8b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:26.901642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0056b9-1fb1-4ad4-98a7-9995072b6977 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:26.901936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0056b9-1fb1-4ad4-98a7-9995072b6977 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:26.902270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0056b9-1fb1-4ad4-98a7-9995072b6977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:26.942985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3f0056b9-1fb1-4ad4-98a7-9995072b6977 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:26.944301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f0056b9-1fb1-4ad4-98a7-9995072b6977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:27.132362 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1638/3261] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:27.133397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd9d52-9366-4011-9008-724c09b7b9b8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:27.133682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd9d52-9366-4011-9008-724c09b7b9b8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:27.133954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd9d52-9366-4011-9008-724c09b7b9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:27.200333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dddd9d52-9366-4011-9008-724c09b7b9b8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:27.201616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dddd9d52-9366-4011-9008-724c09b7b9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:27.229266 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1624/3262] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:29:27.234374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0056b9-1fb1-4ad4-98a7-9995072b6977 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:27.246886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0056b9-1fb1-4ad4-98a7-9995072b6977 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:27.252144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235390bd-cf55-4eb1-affb-42f9e6f0ee87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:27.253003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235390bd-cf55-4eb1-affb-42f9e6f0ee87 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:27.253358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235390bd-cf55-4eb1-affb-42f9e6f0ee87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:27.254315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235390bd-cf55-4eb1-affb-42f9e6f0ee87 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:27.256008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235390bd-cf55-4eb1-affb-42f9e6f0ee87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:29:27.256399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235390bd-cf55-4eb1-affb-42f9e6f0ee87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:27.258146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235390bd-cf55-4eb1-affb-42f9e6f0ee87 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:27.272468 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1639/3263] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:29:27.278863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd9d52-9366-4011-9008-724c09b7b9b8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:27.294401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd9d52-9366-4011-9008-724c09b7b9b8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:27.299744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e43f1-cb99-4b3a-b787-1611e8ae81a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:27.308893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e43f1-cb99-4b3a-b787-1611e8ae81a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:27.308893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e43f1-cb99-4b3a-b787-1611e8ae81a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:27.309188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e43f1-cb99-4b3a-b787-1611e8ae81a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:27.312007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e43f1-cb99-4b3a-b787-1611e8ae81a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:27.317395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e43f1-cb99-4b3a-b787-1611e8ae81a5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:27.379197 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1625/3264] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:29:27 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:29:27.383599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235390bd-cf55-4eb1-affb-42f9e6f0ee87 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:27.398607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235390bd-cf55-4eb1-affb-42f9e6f0ee87 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:27.531574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb3d66-73de-452c-829c-de99a1494dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:27.532424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb3d66-73de-452c-829c-de99a1494dcb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:27.532937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb3d66-73de-452c-829c-de99a1494dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:27.533419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb3d66-73de-452c-829c-de99a1494dcb admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:27.534336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb3d66-73de-452c-829c-de99a1494dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:27.546146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb3d66-73de-452c-829c-de99a1494dcb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:27.591796 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1640/3265] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:29:27 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:29:27.595595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e43f1-cb99-4b3a-b787-1611e8ae81a5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:27.608944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e43f1-cb99-4b3a-b787-1611e8ae81a5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:27.631079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3b5c4-d460-4224-8d76-90e537c9ff34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:27.632199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3b5c4-d460-4224-8d76-90e537c9ff34 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:27.633053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3b5c4-d460-4224-8d76-90e537c9ff34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:27.633594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3b5c4-d460-4224-8d76-90e537c9ff34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:27.634987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3b5c4-d460-4224-8d76-90e537c9ff34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:27.643640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3b5c4-d460-4224-8d76-90e537c9ff34 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:27.678266 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1626/3266] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:29:27.682739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb3d66-73de-452c-829c-de99a1494dcb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:27.700603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb3d66-73de-452c-829c-de99a1494dcb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:27.716533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81960f3f-9422-45b8-a9c7-e26711dc625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:27.722506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3b5c4-d460-4224-8d76-90e537c9ff34 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:27.724528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6de3b5c4-d460-4224-8d76-90e537c9ff34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:27.736825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81960f3f-9422-45b8-a9c7-e26711dc625b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:27.740189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81960f3f-9422-45b8-a9c7-e26711dc625b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:27.740737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81960f3f-9422-45b8-a9c7-e26711dc625b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:27.741859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81960f3f-9422-45b8-a9c7-e26711dc625b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:27.759891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81960f3f-9422-45b8-a9c7-e26711dc625b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:27.789051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3b5c4-d460-4224-8d76-90e537c9ff34 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:27.799507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6263466-f3a6-4e85-85ac-1478029d80df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:27.800808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263466-f3a6-4e85-85ac-1478029d80df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:27.801353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263466-f3a6-4e85-85ac-1478029d80df admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:27.801841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263466-f3a6-4e85-85ac-1478029d80df admin admin] PATH_INFO: `/v3/projects/05de1bc32efc4801bc9b439d58d1921e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:27.803552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6263466-f3a6-4e85-85ac-1478029d80df admin admin] RBAC: Authorizing `identity:delete_project(project_id=05de1bc32efc4801bc9b439d58d1921e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:27.807657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6263466-f3a6-4e85-85ac-1478029d80df admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:27.812842 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1641/3267] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:29:27.816731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81960f3f-9422-45b8-a9c7-e26711dc625b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:27.826833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:27.836199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81960f3f-9422-45b8-a9c7-e26711dc625b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:27.852249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ae959-4f41-49e6-8b62-5e7fa6eec6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:27.853075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ae959-4f41-49e6-8b62-5e7fa6eec6b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:27.853355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ae959-4f41-49e6-8b62-5e7fa6eec6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:27.854209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ae959-4f41-49e6-8b62-5e7fa6eec6b6 admin admin] PATH_INFO: `/v3/projects/38b6047ebd7e49a2a0afebf88cbc3183/users/ed083a289526439ea93593880be3ef86/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:27.890572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ae959-4f41-49e6-8b62-5e7fa6eec6b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b6047ebd7e49a2a0afebf88cbc3183, user_id=ed083a289526439ea93593880be3ef86, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:27.893554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ae959-4f41-49e6-8b62-5e7fa6eec6b6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:27.918720 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1642/3268] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:29:27 2022] PUT /identity/v3/projects/38b6047ebd7e49a2a0afebf88cbc3183/users/ed083a289526439ea93593880be3ef86/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:27.929041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312303-4933-4002-804f-899f6acc9f72 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:27.929326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312303-4933-4002-804f-899f6acc9f72 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:27.929605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312303-4933-4002-804f-899f6acc9f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:27.971569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6263466-f3a6-4e85-85ac-1478029d80df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05de1bc32efc4801bc9b439d58d1921e', 'request_id': 'req-d6263466-f3a6-4e85-85ac-1478029d80df'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:27.989525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6263466-f3a6-4e85-85ac-1478029d80df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05de1bc32efc4801bc9b439d58d1921e', 'request_id': 'req-d6263466-f3a6-4e85-85ac-1478029d80df'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:28.013825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6263466-f3a6-4e85-85ac-1478029d80df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05de1bc32efc4801bc9b439d58d1921e', 'request_id': 'req-d6263466-f3a6-4e85-85ac-1478029d80df'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:28.018929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1d312303-4933-4002-804f-899f6acc9f72 None None] MFA Rules not processed for user `ed083a289526439ea93593880be3ef86`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:28.020190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d312303-4933-4002-804f-899f6acc9f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:28.046311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6263466-f3a6-4e85-85ac-1478029d80df admin admin] The token cache is being invalidate because project 05de1bc32efc4801bc9b439d58d1921e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:29:28.046604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6263466-f3a6-4e85-85ac-1478029d80df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:28.050138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6263466-f3a6-4e85-85ac-1478029d80df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:28.055417 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1627/3269] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:29:27 2022] DELETE /identity/v3/projects/05de1bc32efc4801bc9b439d58d1921e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:28.061173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df182b-849b-4553-ba01-d5f6ad934031 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:28.062069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df182b-849b-4553-ba01-d5f6ad934031 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:28.063366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df182b-849b-4553-ba01-d5f6ad934031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:28.132564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b4df182b-849b-4553-ba01-d5f6ad934031 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:28.134133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b4df182b-849b-4553-ba01-d5f6ad934031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:28.169869 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1643/3270] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:29:28.177083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d312303-4933-4002-804f-899f6acc9f72 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:28.178612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d312303-4933-4002-804f-899f6acc9f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:28.241847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:28.274079 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1628/3271] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:29:28.277384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444d15c-3910-443c-806a-cc9cc27b644d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:28.277672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444d15c-3910-443c-806a-cc9cc27b644d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:28.277942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444d15c-3910-443c-806a-cc9cc27b644d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:28.314763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d312303-4933-4002-804f-899f6acc9f72 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:28.324692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2933c3-64bf-4f69-a67f-7f1c9ef33f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:28.325340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2933c3-64bf-4f69-a67f-7f1c9ef33f3c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:28.325621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2933c3-64bf-4f69-a67f-7f1c9ef33f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:28.325899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2933c3-64bf-4f69-a67f-7f1c9ef33f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:28.326549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2933c3-64bf-4f69-a67f-7f1c9ef33f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:28.328687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2933c3-64bf-4f69-a67f-7f1c9ef33f3c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:28.340062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2444d15c-3910-443c-806a-cc9cc27b644d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:28.351906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2444d15c-3910-443c-806a-cc9cc27b644d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:28.380898 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1629/3272] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:28.387403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444d15c-3910-443c-806a-cc9cc27b644d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:28.408571 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1644/3273] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:29:28 2022] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:29:28.412323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2933c3-64bf-4f69-a67f-7f1c9ef33f3c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:28.414678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444d15c-3910-443c-806a-cc9cc27b644d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:28.501864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f37099-5577-4d87-ac80-654392da2d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:28.502978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f37099-5577-4d87-ac80-654392da2d02 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:28.503719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f37099-5577-4d87-ac80-654392da2d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:28.504162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f37099-5577-4d87-ac80-654392da2d02 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:28.504995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f37099-5577-4d87-ac80-654392da2d02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:29:28.505357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f37099-5577-4d87-ac80-654392da2d02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:28.507553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f37099-5577-4d87-ac80-654392da2d02 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:28.520214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:28.523292 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1630/3274] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:29:28.527578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f37099-5577-4d87-ac80-654392da2d02 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:28.537639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2933c3-64bf-4f69-a67f-7f1c9ef33f3c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:28.542330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f37099-5577-4d87-ac80-654392da2d02 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:28.547946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe6587-d162-4e0b-a47c-241452b8c62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:28.548791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe6587-d162-4e0b-a47c-241452b8c62b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:28.549271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe6587-d162-4e0b-a47c-241452b8c62b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:28.549732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe6587-d162-4e0b-a47c-241452b8c62b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:28.550542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe6587-d162-4e0b-a47c-241452b8c62b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:28.551788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712c6e5-9d21-45b3-9dc8-8ab85cd96dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:28.552425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712c6e5-9d21-45b3-9dc8-8ab85cd96dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:28.552704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712c6e5-9d21-45b3-9dc8-8ab85cd96dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:28.552983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712c6e5-9d21-45b3-9dc8-8ab85cd96dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:28.554414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe6587-d162-4e0b-a47c-241452b8c62b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:28.562936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712c6e5-9d21-45b3-9dc8-8ab85cd96dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:28.564693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712c6e5-9d21-45b3-9dc8-8ab85cd96dc0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:28.596553 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1645/3275] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:29:28 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:29:28.600483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712c6e5-9d21-45b3-9dc8-8ab85cd96dc0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:28.602526 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1631/3276] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:29:28 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:29:28.607355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe6587-d162-4e0b-a47c-241452b8c62b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:28.614469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712c6e5-9d21-45b3-9dc8-8ab85cd96dc0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:28.695037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ca9f3-7f3d-4983-9250-d07251713a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:28.695781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ca9f3-7f3d-4983-9250-d07251713a36 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:28.696165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ca9f3-7f3d-4983-9250-d07251713a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:28.697233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ca9f3-7f3d-4983-9250-d07251713a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:28.698841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ca9f3-7f3d-4983-9250-d07251713a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:28.701203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ca9f3-7f3d-4983-9250-d07251713a36 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:28.719492 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1646/3277] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:29:28.720908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ca9f3-7f3d-4983-9250-d07251713a36 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:28.737267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ca9f3-7f3d-4983-9250-d07251713a36 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:28.740233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe6587-d162-4e0b-a47c-241452b8c62b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:28.754527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a87c-8d9d-4017-a4e7-579b9291d3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:28.755364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a87c-8d9d-4017-a4e7-579b9291d3fc admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:28.755754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a87c-8d9d-4017-a4e7-579b9291d3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:28.756131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a87c-8d9d-4017-a4e7-579b9291d3fc admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:28.756259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a869a-9c4b-4840-b83a-e4517cb17523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:28.756873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a869a-9c4b-4840-b83a-e4517cb17523 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:28.757073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3a87c-8d9d-4017-a4e7-579b9291d3fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:28.757184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a869a-9c4b-4840-b83a-e4517cb17523 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:28.757413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a869a-9c4b-4840-b83a-e4517cb17523 admin admin] PATH_INFO: `/v3/projects/af0ce1ad10aa42b789e2cffdb55dc348/users/14284c0aaa6048edbf6c2b95d67085e4/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:28.766262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3a87c-8d9d-4017-a4e7-579b9291d3fc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:28.777114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a869a-9c4b-4840-b83a-e4517cb17523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0ce1ad10aa42b789e2cffdb55dc348, user_id=14284c0aaa6048edbf6c2b95d67085e4, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:28.781244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a869a-9c4b-4840-b83a-e4517cb17523 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:28.815428 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1647/3278] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:29:28 2022] PUT /identity/v3/projects/af0ce1ad10aa42b789e2cffdb55dc348/users/14284c0aaa6048edbf6c2b95d67085e4/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:28.818492 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1632/3279] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:29:28 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:29:28.821927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a87c-8d9d-4017-a4e7-579b9291d3fc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:28.822859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a869a-9c4b-4840-b83a-e4517cb17523 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:28.856934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a87c-8d9d-4017-a4e7-579b9291d3fc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:28.953833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a869a-9c4b-4840-b83a-e4517cb17523 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:28.963600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae7990-3f05-48cc-9524-547c9f8c75a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:28.964653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7990-3f05-48cc-9524-547c9f8c75a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:28.965079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7990-3f05-48cc-9524-547c9f8c75a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:28.965497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7990-3f05-48cc-9524-547c9f8c75a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:28.966732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae7990-3f05-48cc-9524-547c9f8c75a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:28.970258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:28.974910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae7990-3f05-48cc-9524-547c9f8c75a7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:28.985000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeb6b7-68f6-4f20-a97a-694161e7cd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:28.986773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeb6b7-68f6-4f20-a97a-694161e7cd88 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:28.986773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeb6b7-68f6-4f20-a97a-694161e7cd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:28.986773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeb6b7-68f6-4f20-a97a-694161e7cd88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:28.987365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeb6b7-68f6-4f20-a97a-694161e7cd88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:28.990877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeb6b7-68f6-4f20-a97a-694161e7cd88 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:29.000281 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1648/3280] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:29:29.001514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae7990-3f05-48cc-9524-547c9f8c75a7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:29.013246 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1633/3281] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:29:29.019169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeb6b7-68f6-4f20-a97a-694161e7cd88 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:29.028388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae7990-3f05-48cc-9524-547c9f8c75a7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:29.044566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd8e98-7a89-4d3f-8537-5c79c2102da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:29.047009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd8e98-7a89-4d3f-8537-5c79c2102da2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:29.049552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeb6b7-68f6-4f20-a97a-694161e7cd88 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:29.052300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd8e98-7a89-4d3f-8537-5c79c2102da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:29.052741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd8e98-7a89-4d3f-8537-5c79c2102da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:29.053764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd8e98-7a89-4d3f-8537-5c79c2102da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:29.055455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd8e98-7a89-4d3f-8537-5c79c2102da2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:29.067141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea94b5-fbd7-49be-8de7-0bddb16e012b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:29.067892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea94b5-fbd7-49be-8de7-0bddb16e012b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:29.068498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea94b5-fbd7-49be-8de7-0bddb16e012b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:29.068649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea94b5-fbd7-49be-8de7-0bddb16e012b admin admin] PATH_INFO: `/v3/projects/af0ce1ad10aa42b789e2cffdb55dc348/users/14284c0aaa6048edbf6c2b95d67085e4/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:29.072266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea94b5-fbd7-49be-8de7-0bddb16e012b admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0ce1ad10aa42b789e2cffdb55dc348, user_id=14284c0aaa6048edbf6c2b95d67085e4, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:29.074919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea94b5-fbd7-49be-8de7-0bddb16e012b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:29.081332 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1649/3282] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:29:29.082949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd8e98-7a89-4d3f-8537-5c79c2102da2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:29.115427 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1634/3283] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:29:29 2022] PUT /identity/v3/projects/af0ce1ad10aa42b789e2cffdb55dc348/users/14284c0aaa6048edbf6c2b95d67085e4/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:29.115868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd8e98-7a89-4d3f-8537-5c79c2102da2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:29.133732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c14168-35d3-43b3-9fab-2ae78e7303e6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:29.134050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c14168-35d3-43b3-9fab-2ae78e7303e6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:29.134613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c14168-35d3-43b3-9fab-2ae78e7303e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:29.208556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-52c14168-35d3-43b3-9fab-2ae78e7303e6 None None] MFA Rules not processed for user `14284c0aaa6048edbf6c2b95d67085e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:29.217675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-52c14168-35d3-43b3-9fab-2ae78e7303e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:29.226372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:29.303504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbdda2-e65b-4276-8709-af9996e33120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:29.304192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbdda2-e65b-4276-8709-af9996e33120 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:29.304459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbdda2-e65b-4276-8709-af9996e33120 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:29.304735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbdda2-e65b-4276-8709-af9996e33120 admin admin] PATH_INFO: `/v3/projects/49fc5b0f8f3b4514a98886d41d38b890/users/20b3956bf2d14c1ea1940fd29cc0f7cd/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:29.339131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbdda2-e65b-4276-8709-af9996e33120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49fc5b0f8f3b4514a98886d41d38b890, user_id=20b3956bf2d14c1ea1940fd29cc0f7cd, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:29.339131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbdda2-e65b-4276-8709-af9996e33120 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:29.365019 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1650/3284] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:29:29 2022] PUT /identity/v3/projects/49fc5b0f8f3b4514a98886d41d38b890/users/20b3956bf2d14c1ea1940fd29cc0f7cd/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:29.369887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f282a-83d2-43a3-8c0e-9bb2675b7354 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:29.370179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f282a-83d2-43a3-8c0e-9bb2675b7354 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:29.370470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f282a-83d2-43a3-8c0e-9bb2675b7354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:29.419877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-176f282a-83d2-43a3-8c0e-9bb2675b7354 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:29.424478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-176f282a-83d2-43a3-8c0e-9bb2675b7354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:29.487422 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1635/3285] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:29:29.487422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c14168-35d3-43b3-9fab-2ae78e7303e6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:29.494181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-52c14168-35d3-43b3-9fab-2ae78e7303e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:29.596548 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1651/3286] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:29.597919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa35b0-8f74-4cd1-bd78-e3c592ed4f92 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:29.598490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa35b0-8f74-4cd1-bd78-e3c592ed4f92 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:29.598855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa35b0-8f74-4cd1-bd78-e3c592ed4f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:29.642841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-90aa35b0-8f74-4cd1-bd78-e3c592ed4f92 None None] MFA Rules not processed for user `ed083a289526439ea93593880be3ef86`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:29.650650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-90aa35b0-8f74-4cd1-bd78-e3c592ed4f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:29.666658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c14168-35d3-43b3-9fab-2ae78e7303e6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:29.794413 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1652/3287] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:29.794413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa35b0-8f74-4cd1-bd78-e3c592ed4f92 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:29.796515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:29.797832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-90aa35b0-8f74-4cd1-bd78-e3c592ed4f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:29.838780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0eba9-5ed8-46d7-94d3-cfe9ce3e35f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:29.840598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0eba9-5ed8-46d7-94d3-cfe9ce3e35f7 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:29.841087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0eba9-5ed8-46d7-94d3-cfe9ce3e35f7 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:29.841578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0eba9-5ed8-46d7-94d3-cfe9ce3e35f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:29.844717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-64e0eba9-5ed8-46d7-94d3-cfe9ce3e35f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:29.860731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0eba9-5ed8-46d7-94d3-cfe9ce3e35f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:29.862670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0eba9-5ed8-46d7-94d3-cfe9ce3e35f7 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:29.892690 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1636/3288] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:29:29.964714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa35b0-8f74-4cd1-bd78-e3c592ed4f92 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:29.973049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa3a6f-3cdc-4ac7-9d53-ca2114312ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:29.973898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa3a6f-3cdc-4ac7-9d53-ca2114312ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:29.974799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa3a6f-3cdc-4ac7-9d53-ca2114312ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:29.976931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa3a6f-3cdc-4ac7-9d53-ca2114312ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:30.000353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa3a6f-3cdc-4ac7-9d53-ca2114312ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:30.002587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa3a6f-3cdc-4ac7-9d53-ca2114312ad4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:30.026372 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1653/3289] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:29:30.063740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0eba9-5ed8-46d7-94d3-cfe9ce3e35f7 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:30.079626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0eba9-5ed8-46d7-94d3-cfe9ce3e35f7 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:30.085567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f8955-1f8e-48e7-87a2-adfeca6e879a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:30.086199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f8955-1f8e-48e7-87a2-adfeca6e879a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:30.086603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f8955-1f8e-48e7-87a2-adfeca6e879a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:30.086880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f8955-1f8e-48e7-87a2-adfeca6e879a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:30.099794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f8955-1f8e-48e7-87a2-adfeca6e879a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:30.103061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f8955-1f8e-48e7-87a2-adfeca6e879a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:30.130472 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1637/3290] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:29:30.865724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa3a6f-3cdc-4ac7-9d53-ca2114312ad4 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:30.867167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27fa3a6f-3cdc-4ac7-9d53-ca2114312ad4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:30.889676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:30.997813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa3a6f-3cdc-4ac7-9d53-ca2114312ad4 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:31.009835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71418ecf-aabd-4f46-98f6-3b06521f53c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:31.010447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71418ecf-aabd-4f46-98f6-3b06521f53c9 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:31.010722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71418ecf-aabd-4f46-98f6-3b06521f53c9 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:31.011405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71418ecf-aabd-4f46-98f6-3b06521f53c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:31.016202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-71418ecf-aabd-4f46-98f6-3b06521f53c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:31.046888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71418ecf-aabd-4f46-98f6-3b06521f53c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:31.048164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71418ecf-aabd-4f46-98f6-3b06521f53c9 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:31.061398 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1654/3291] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:29:32.965940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f8955-1f8e-48e7-87a2-adfeca6e879a service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:32.990307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f8955-1f8e-48e7-87a2-adfeca6e879a service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:33.001190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7870920-d01d-47ee-9248-dc820d6d279d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:33.007173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7870920-d01d-47ee-9248-dc820d6d279d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:33.007711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7870920-d01d-47ee-9248-dc820d6d279d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:33.010724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7870920-d01d-47ee-9248-dc820d6d279d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:33.015933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f7870920-d01d-47ee-9248-dc820d6d279d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:33.057810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7870920-d01d-47ee-9248-dc820d6d279d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:33.060505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7870920-d01d-47ee-9248-dc820d6d279d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:33.101749 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1638/3292] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:29:34.144558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3353a24-f2e1-4345-b607-e8cbad481525 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:34.145194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3353a24-f2e1-4345-b607-e8cbad481525 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:34.145194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3353a24-f2e1-4345-b607-e8cbad481525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:34.186634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d3353a24-f2e1-4345-b607-e8cbad481525 None None] MFA Rules not processed for user `7127c83048e74e2e98cb97aae410018f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:34.189099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3353a24-f2e1-4345-b607-e8cbad481525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:34.329049 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1655/3293] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:36.933720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7870920-d01d-47ee-9248-dc820d6d279d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:36.955159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7870920-d01d-47ee-9248-dc820d6d279d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:36.977093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47888c-0590-4288-981a-c7f3fd8547cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:36.977997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47888c-0590-4288-981a-c7f3fd8547cd service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:36.978367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47888c-0590-4288-981a-c7f3fd8547cd service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:36.978726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47888c-0590-4288-981a-c7f3fd8547cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:36.981251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9c47888c-0590-4288-981a-c7f3fd8547cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:37.010958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47888c-0590-4288-981a-c7f3fd8547cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:37.013071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47888c-0590-4288-981a-c7f3fd8547cd service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:37.038831 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1639/3294] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:29:37.615649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3353a24-f2e1-4345-b607-e8cbad481525 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:37.617689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3353a24-f2e1-4345-b607-e8cbad481525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:37.634613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3353a24-f2e1-4345-b607-e8cbad481525 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:37.647045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e945aea-fa27-4549-9f8e-f9f0ae01d5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:37.649029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e945aea-fa27-4549-9f8e-f9f0ae01d5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:37.649435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e945aea-fa27-4549-9f8e-f9f0ae01d5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:37.649775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e945aea-fa27-4549-9f8e-f9f0ae01d5f6 admin admin] PATH_INFO: `/v3/users/1ea47409a7304d32bebd75e8273b14a7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:37.651025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e945aea-fa27-4549-9f8e-f9f0ae01d5f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea47409a7304d32bebd75e8273b14a7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:37.653389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e945aea-fa27-4549-9f8e-f9f0ae01d5f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:37.711110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e945aea-fa27-4549-9f8e-f9f0ae01d5f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea47409a7304d32bebd75e8273b14a7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:37.711995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e945aea-fa27-4549-9f8e-f9f0ae01d5f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea47409a7304d32bebd75e8273b14a7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:37.724606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e945aea-fa27-4549-9f8e-f9f0ae01d5f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea47409a7304d32bebd75e8273b14a7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:37.735631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e945aea-fa27-4549-9f8e-f9f0ae01d5f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea47409a7304d32bebd75e8273b14a7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:37.758806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e945aea-fa27-4549-9f8e-f9f0ae01d5f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea47409a7304d32bebd75e8273b14a7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:37.777186 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1656/3295] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:29:37 2022] DELETE /identity/v3/users/1ea47409a7304d32bebd75e8273b14a7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:38.234952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47888c-0590-4288-981a-c7f3fd8547cd service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:38.249159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47888c-0590-4288-981a-c7f3fd8547cd service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:38.367770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:38.368454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:38.369012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:38.370137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d admin admin] PATH_INFO: `/v3/projects/a5878cbcdfa94745b3069c4dd371f47f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:38.373798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5878cbcdfa94745b3069c4dd371f47f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:38.376843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:38.474458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5878cbcdfa94745b3069c4dd371f47f', 'request_id': 'req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:38.482666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5878cbcdfa94745b3069c4dd371f47f', 'request_id': 'req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:38.488812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5878cbcdfa94745b3069c4dd371f47f', 'request_id': 'req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:38.508318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d admin admin] The token cache is being invalidate because project a5878cbcdfa94745b3069c4dd371f47f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:29:38.508713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:38.510164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:38.517980 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1640/3296] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:29:38 2022] DELETE /identity/v3/projects/a5878cbcdfa94745b3069c4dd371f47f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:38.518612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e945aea-fa27-4549-9f8e-f9f0ae01d5f6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:38.520185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0e945aea-fa27-4549-9f8e-f9f0ae01d5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:38.537049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e945aea-fa27-4549-9f8e-f9f0ae01d5f6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:38.563749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:38.649531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64252023-cb12-4258-b5ca-4d7b58077e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:38.650930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64252023-cb12-4258-b5ca-4d7b58077e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:38.651114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64252023-cb12-4258-b5ca-4d7b58077e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:38.651463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64252023-cb12-4258-b5ca-4d7b58077e4c admin admin] PATH_INFO: `/v3/users/27349f6769014bc689ec22a1e2383ca2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:38.654161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64252023-cb12-4258-b5ca-4d7b58077e4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=27349f6769014bc689ec22a1e2383ca2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:38.656051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64252023-cb12-4258-b5ca-4d7b58077e4c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:38.771590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64252023-cb12-4258-b5ca-4d7b58077e4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27349f6769014bc689ec22a1e2383ca2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:38.772417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64252023-cb12-4258-b5ca-4d7b58077e4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27349f6769014bc689ec22a1e2383ca2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:38.781721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64252023-cb12-4258-b5ca-4d7b58077e4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27349f6769014bc689ec22a1e2383ca2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:38.795916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64252023-cb12-4258-b5ca-4d7b58077e4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27349f6769014bc689ec22a1e2383ca2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:38.817495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64252023-cb12-4258-b5ca-4d7b58077e4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27349f6769014bc689ec22a1e2383ca2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:38.830357 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1657/3297] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:29:38 2022] DELETE /identity/v3/users/27349f6769014bc689ec22a1e2383ca2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:39.576582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:39.578038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:39.592213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccf92e-5f9d-44e6-9fd9-b181bca2636d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:39.632707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:39.664725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5820b-8570-46b9-b3d4-0e6481fba760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:39.666104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5820b-8570-46b9-b3d4-0e6481fba760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:39.666473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5820b-8570-46b9-b3d4-0e6481fba760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:39.666818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5820b-8570-46b9-b3d4-0e6481fba760 admin admin] PATH_INFO: `/v3/projects/4ca5b2c108f64401b03ab23d1cd4d375` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:39.668112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5820b-8570-46b9-b3d4-0e6481fba760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ca5b2c108f64401b03ab23d1cd4d375)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:39.670082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5820b-8570-46b9-b3d4-0e6481fba760 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:39.747897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-28d5820b-8570-46b9-b3d4-0e6481fba760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca5b2c108f64401b03ab23d1cd4d375', 'request_id': 'req-28d5820b-8570-46b9-b3d4-0e6481fba760'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:39.768674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-28d5820b-8570-46b9-b3d4-0e6481fba760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca5b2c108f64401b03ab23d1cd4d375', 'request_id': 'req-28d5820b-8570-46b9-b3d4-0e6481fba760'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:39.792569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-28d5820b-8570-46b9-b3d4-0e6481fba760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca5b2c108f64401b03ab23d1cd4d375', 'request_id': 'req-28d5820b-8570-46b9-b3d4-0e6481fba760'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:39.813474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-28d5820b-8570-46b9-b3d4-0e6481fba760 admin admin] The token cache is being invalidate because project 4ca5b2c108f64401b03ab23d1cd4d375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:29:39.813905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-28d5820b-8570-46b9-b3d4-0e6481fba760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:39.814635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-28d5820b-8570-46b9-b3d4-0e6481fba760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:29:39.816387 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1641/3298] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:29:39 2022] DELETE /identity/v3/projects/4ca5b2c108f64401b03ab23d1cd4d375 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:39.821940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efa50f-d320-4d14-8fd6-3b6caec9219e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:39.822776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efa50f-d320-4d14-8fd6-3b6caec9219e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:39.823185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efa50f-d320-4d14-8fd6-3b6caec9219e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:39.874618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e5efa50f-d320-4d14-8fd6-3b6caec9219e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:39.877013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e5efa50f-d320-4d14-8fd6-3b6caec9219e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:40.023127 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1658/3299] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:40.031204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d068b-f867-443d-9960-84821d92aa21 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:40.031621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d068b-f867-443d-9960-84821d92aa21 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:40.032158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d068b-f867-443d-9960-84821d92aa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:40.060306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4e9d068b-f867-443d-9960-84821d92aa21 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:40.062722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4e9d068b-f867-443d-9960-84821d92aa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:40.090065 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1642/3300] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:40.094654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efa50f-d320-4d14-8fd6-3b6caec9219e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:40.110041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efa50f-d320-4d14-8fd6-3b6caec9219e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:40.117078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c454f-4e41-424c-bbea-9823f5bb6a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:40.117807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c454f-4e41-424c-bbea-9823f5bb6a9d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:40.118158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c454f-4e41-424c-bbea-9823f5bb6a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:40.118507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c454f-4e41-424c-bbea-9823f5bb6a9d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:40.119297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c454f-4e41-424c-bbea-9823f5bb6a9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:29:40.119603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c454f-4e41-424c-bbea-9823f5bb6a9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:40.121327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c454f-4e41-424c-bbea-9823f5bb6a9d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:40.141980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d068b-f867-443d-9960-84821d92aa21 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:40.149502 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1659/3301] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:29:40.159057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d068b-f867-443d-9960-84821d92aa21 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:40.165565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04eeb77-e95d-4134-9e08-8325bbf06d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:40.166225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04eeb77-e95d-4134-9e08-8325bbf06d7e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:40.166512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04eeb77-e95d-4134-9e08-8325bbf06d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:40.166788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04eeb77-e95d-4134-9e08-8325bbf06d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:40.167782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04eeb77-e95d-4134-9e08-8325bbf06d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:40.170551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04eeb77-e95d-4134-9e08-8325bbf06d7e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:40.223475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c454f-4e41-424c-bbea-9823f5bb6a9d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:40.229265 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1643/3302] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:29:40 2022] POST /identity/v3/projects => generated 403 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:29:40.235982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c454f-4e41-424c-bbea-9823f5bb6a9d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:40.270705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:40.323575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be61b3-417b-47a5-a5ba-f5959de13b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:40.324300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be61b3-417b-47a5-a5ba-f5959de13b7d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:40.324665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be61b3-417b-47a5-a5ba-f5959de13b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:40.325047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be61b3-417b-47a5-a5ba-f5959de13b7d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:40.325770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be61b3-417b-47a5-a5ba-f5959de13b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:40.328037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be61b3-417b-47a5-a5ba-f5959de13b7d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:40.357728 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1660/3303] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:29:40 2022] POST /identity/v3/users => generated 302 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:29:40.359472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04eeb77-e95d-4134-9e08-8325bbf06d7e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:40.370451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04eeb77-e95d-4134-9e08-8325bbf06d7e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:40.375851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd6bbf-28dc-4152-ab25-2d57e83f6ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:40.376482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd6bbf-28dc-4152-ab25-2d57e83f6ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:40.377866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd6bbf-28dc-4152-ab25-2d57e83f6ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:40.378148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd6bbf-28dc-4152-ab25-2d57e83f6ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:40.382366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd6bbf-28dc-4152-ab25-2d57e83f6ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:40.384294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd6bbf-28dc-4152-ab25-2d57e83f6ae1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:40.398191 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1644/3304] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:29:40.399483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be61b3-417b-47a5-a5ba-f5959de13b7d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:40.410873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be61b3-417b-47a5-a5ba-f5959de13b7d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:40.416817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680039e6-955e-45bc-864a-c0a0e9a2df44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:40.417700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680039e6-955e-45bc-864a-c0a0e9a2df44 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:40.418187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680039e6-955e-45bc-864a-c0a0e9a2df44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:40.418607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680039e6-955e-45bc-864a-c0a0e9a2df44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:40.419784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680039e6-955e-45bc-864a-c0a0e9a2df44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:40.422896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680039e6-955e-45bc-864a-c0a0e9a2df44 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:40.435488 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1661/3305] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:29:40.439999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd6bbf-28dc-4152-ab25-2d57e83f6ae1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:40.451374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd6bbf-28dc-4152-ab25-2d57e83f6ae1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:40.457335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed791e0-0566-45dd-a786-a6e2f22d2b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:40.458774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed791e0-0566-45dd-a786-a6e2f22d2b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:40.459220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed791e0-0566-45dd-a786-a6e2f22d2b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:40.459607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed791e0-0566-45dd-a786-a6e2f22d2b08 admin admin] PATH_INFO: `/v3/projects/e2060a6a00d3456fafe7120aea87552d/users/2717e7f717554a07a6129569c3688ef0/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:40.476764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed791e0-0566-45dd-a786-a6e2f22d2b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2060a6a00d3456fafe7120aea87552d, user_id=2717e7f717554a07a6129569c3688ef0, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:40.479582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed791e0-0566-45dd-a786-a6e2f22d2b08 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:40.500603 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1645/3306] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:29:40 2022] PUT /identity/v3/projects/e2060a6a00d3456fafe7120aea87552d/users/2717e7f717554a07a6129569c3688ef0/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:40.507960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ffe7e-c580-490f-b06a-a3f1fe1439ef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:40.508248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ffe7e-c580-490f-b06a-a3f1fe1439ef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:40.508552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ffe7e-c580-490f-b06a-a3f1fe1439ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:40.536849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-698ffe7e-c580-490f-b06a-a3f1fe1439ef None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:40.538525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-698ffe7e-c580-490f-b06a-a3f1fe1439ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:40.637872 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1662/3307] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:40.647745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed791e0-0566-45dd-a786-a6e2f22d2b08 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:40.656869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2ed791e0-0566-45dd-a786-a6e2f22d2b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:40.731610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed791e0-0566-45dd-a786-a6e2f22d2b08 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:40.736430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd2cd1-287f-46cf-8882-f7188857e82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:40.737170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd2cd1-287f-46cf-8882-f7188857e82d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:40.737329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd2cd1-287f-46cf-8882-f7188857e82d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:40.737595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd2cd1-287f-46cf-8882-f7188857e82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:40.747794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd2cd1-287f-46cf-8882-f7188857e82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:40.749278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd2cd1-287f-46cf-8882-f7188857e82d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:40.759913 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1646/3308] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:29:41.186236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4744142-f813-4b40-b9d8-2d995b57cd87 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:41.186772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4744142-f813-4b40-b9d8-2d995b57cd87 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:41.186772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4744142-f813-4b40-b9d8-2d995b57cd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:41.264456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d4744142-f813-4b40-b9d8-2d995b57cd87 None None] MFA Rules not processed for user `20b3956bf2d14c1ea1940fd29cc0f7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:41.268253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d4744142-f813-4b40-b9d8-2d995b57cd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:41.398511 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1663/3309] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:41.403145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd2cd1-287f-46cf-8882-f7188857e82d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:41.404633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0bbd2cd1-287f-46cf-8882-f7188857e82d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:41.417358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:41.430008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd2cd1-287f-46cf-8882-f7188857e82d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:41.442042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7b536-65dd-431a-bb7d-641b19d1971d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:41.442681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7b536-65dd-431a-bb7d-641b19d1971d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:41.443377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7b536-65dd-431a-bb7d-641b19d1971d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:41.443718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7b536-65dd-431a-bb7d-641b19d1971d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:41.444378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7b536-65dd-431a-bb7d-641b19d1971d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:41.446415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7b536-65dd-431a-bb7d-641b19d1971d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:41.519880 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1647/3310] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:29:41 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:29:41.520595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4744142-f813-4b40-b9d8-2d995b57cd87 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:41.536682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4744142-f813-4b40-b9d8-2d995b57cd87 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:41.603519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:41.648436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55d353-9c22-4ebf-b506-5458fa9db567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:41.649760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55d353-9c22-4ebf-b506-5458fa9db567 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:41.650220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55d353-9c22-4ebf-b506-5458fa9db567 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:41.650506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55d353-9c22-4ebf-b506-5458fa9db567 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:41.651550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55d353-9c22-4ebf-b506-5458fa9db567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:41.653721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55d353-9c22-4ebf-b506-5458fa9db567 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:41.689450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7b536-65dd-431a-bb7d-641b19d1971d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:41.698363 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1664/3311] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:29:41 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:29:41.700942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7b536-65dd-431a-bb7d-641b19d1971d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:41.723210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81d1c2-56bf-420e-a98a-53b21ce40a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:41.724229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81d1c2-56bf-420e-a98a-53b21ce40a72 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:41.724667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81d1c2-56bf-420e-a98a-53b21ce40a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:41.725097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81d1c2-56bf-420e-a98a-53b21ce40a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:41.725918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81d1c2-56bf-420e-a98a-53b21ce40a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:41.727812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81d1c2-56bf-420e-a98a-53b21ce40a72 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:41.753699 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1648/3312] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:29:41.755092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55d353-9c22-4ebf-b506-5458fa9db567 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:41.768362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55d353-9c22-4ebf-b506-5458fa9db567 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:41.774558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cd4d0-319f-42b8-9bf5-64363675e767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:41.775833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cd4d0-319f-42b8-9bf5-64363675e767 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:41.776265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cd4d0-319f-42b8-9bf5-64363675e767 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:41.776684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cd4d0-319f-42b8-9bf5-64363675e767 admin admin] PATH_INFO: `/v3/projects/535c52e2036b48979a309a565d08559e/users/2f88b207579d4a23ba97a02e1d78af49/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:41.802899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cd4d0-319f-42b8-9bf5-64363675e767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535c52e2036b48979a309a565d08559e, user_id=2f88b207579d4a23ba97a02e1d78af49, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:41.807202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cd4d0-319f-42b8-9bf5-64363675e767 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:41.834945 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1665/3313] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:29:41 2022] PUT /identity/v3/projects/535c52e2036b48979a309a565d08559e/users/2f88b207579d4a23ba97a02e1d78af49/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:41.839300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81d1c2-56bf-420e-a98a-53b21ce40a72 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:41.852190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81d1c2-56bf-420e-a98a-53b21ce40a72 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:41.981408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315bc55-7ad3-4be5-96bf-d5e22da98b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:41.982618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315bc55-7ad3-4be5-96bf-d5e22da98b1c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:41.983079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315bc55-7ad3-4be5-96bf-d5e22da98b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:41.983547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315bc55-7ad3-4be5-96bf-d5e22da98b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:41.985134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315bc55-7ad3-4be5-96bf-d5e22da98b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:41.987428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315bc55-7ad3-4be5-96bf-d5e22da98b1c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:42.003907 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1649/3314] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:29:42.006050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cd4d0-319f-42b8-9bf5-64363675e767 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:42.025050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cd4d0-319f-42b8-9bf5-64363675e767 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:42.031455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6d6d0-bbfe-4f43-b370-2afab00156ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:42.032416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6d6d0-bbfe-4f43-b370-2afab00156ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:42.032815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6d6d0-bbfe-4f43-b370-2afab00156ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:42.033903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6d6d0-bbfe-4f43-b370-2afab00156ef admin admin] PATH_INFO: `/v3/projects/535c52e2036b48979a309a565d08559e/users/2f88b207579d4a23ba97a02e1d78af49/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:42.036550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6d6d0-bbfe-4f43-b370-2afab00156ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=535c52e2036b48979a309a565d08559e, user_id=2f88b207579d4a23ba97a02e1d78af49, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:42.040709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6d6d0-bbfe-4f43-b370-2afab00156ef admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:42.059125 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1666/3315] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:29:42 2022] PUT /identity/v3/projects/535c52e2036b48979a309a565d08559e/users/2f88b207579d4a23ba97a02e1d78af49/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:29:47.675688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315bc55-7ad3-4be5-96bf-d5e22da98b1c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:47.677724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7315bc55-7ad3-4be5-96bf-d5e22da98b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:47.826472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315bc55-7ad3-4be5-96bf-d5e22da98b1c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:47.933152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592ea75-e108-4040-942a-2a2a9d66178e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:47.934047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592ea75-e108-4040-942a-2a2a9d66178e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:47.934503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592ea75-e108-4040-942a-2a2a9d66178e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:47.935009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592ea75-e108-4040-942a-2a2a9d66178e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:47.937382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a592ea75-e108-4040-942a-2a2a9d66178e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:48.006077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:48.065237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592ea75-e108-4040-942a-2a2a9d66178e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:48.066896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592ea75-e108-4040-942a-2a2a9d66178e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:48.084412 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1650/3316] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:29:51.501964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de60285-a3b6-4bab-ab40-41da470d640e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:51.502535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de60285-a3b6-4bab-ab40-41da470d640e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:51.502535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de60285-a3b6-4bab-ab40-41da470d640e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:51.587165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5de60285-a3b6-4bab-ab40-41da470d640e None None] MFA Rules not processed for user `2f88b207579d4a23ba97a02e1d78af49`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:51.591807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5de60285-a3b6-4bab-ab40-41da470d640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:51.758782 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1667/3317] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:29:51.770188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592ea75-e108-4040-942a-2a2a9d66178e service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:51.778807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a592ea75-e108-4040-942a-2a2a9d66178e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:51.945786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592ea75-e108-4040-942a-2a2a9d66178e service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:51.961638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e11b4-d768-44e1-a105-8c5bce6e7156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:51.963200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e11b4-d768-44e1-a105-8c5bce6e7156 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:51.965951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e11b4-d768-44e1-a105-8c5bce6e7156 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:51.966182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e11b4-d768-44e1-a105-8c5bce6e7156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:52.176024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e11b4-d768-44e1-a105-8c5bce6e7156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:52.177405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e11b4-d768-44e1-a105-8c5bce6e7156 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:52.193345 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1651/3318] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:29:53.360383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e0773-e49b-4a6e-ba61-2655a53261ed None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:53.360795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e0773-e49b-4a6e-ba61-2655a53261ed None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:53.360935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e0773-e49b-4a6e-ba61-2655a53261ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:53.387431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-190e0773-e49b-4a6e-ba61-2655a53261ed None None] MFA Rules not processed for user `47aab8bfff21443891308d80f7059b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:53.389415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-190e0773-e49b-4a6e-ba61-2655a53261ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:53.462329 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1668/3319] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:55.172092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e11b4-d768-44e1-a105-8c5bce6e7156 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:55.173647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-795e11b4-d768-44e1-a105-8c5bce6e7156 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:55.398749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bef62-352b-44b2-b56e-4e10c354e3ec None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:55.399366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bef62-352b-44b2-b56e-4e10c354e3ec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:55.399366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bef62-352b-44b2-b56e-4e10c354e3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:55.468224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:55.491565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e11b4-d768-44e1-a105-8c5bce6e7156 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:55.528238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c69bef62-352b-44b2-b56e-4e10c354e3ec None None] MFA Rules not processed for user `2717e7f717554a07a6129569c3688ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:55.529649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c69bef62-352b-44b2-b56e-4e10c354e3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:55.534624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10630783-71e7-48d3-bfcd-791f9c908d57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:55.535291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10630783-71e7-48d3-bfcd-791f9c908d57 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:55.535559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10630783-71e7-48d3-bfcd-791f9c908d57 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:55.535836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10630783-71e7-48d3-bfcd-791f9c908d57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:55.543775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:29:55.544408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-10630783-71e7-48d3-bfcd-791f9c908d57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:55.755986 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1669/3320] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:55 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:29:55.783642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10630783-71e7-48d3-bfcd-791f9c908d57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:55.785270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10630783-71e7-48d3-bfcd-791f9c908d57 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:55.822336 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1652/3321] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:29:55.883066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bef62-352b-44b2-b56e-4e10c354e3ec None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:55.884522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c69bef62-352b-44b2-b56e-4e10c354e3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:56.100657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bef62-352b-44b2-b56e-4e10c354e3ec None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:56.111755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12139e-fd46-4c3c-ae38-376551dc1656 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:56.112767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12139e-fd46-4c3c-ae38-376551dc1656 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:56.113534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12139e-fd46-4c3c-ae38-376551dc1656 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:56.115035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12139e-fd46-4c3c-ae38-376551dc1656 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:56.117869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8e12139e-fd46-4c3c-ae38-376551dc1656 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:56.151237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12139e-fd46-4c3c-ae38-376551dc1656 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:56.154013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12139e-fd46-4c3c-ae38-376551dc1656 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:56.205435 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1670/3322] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:29:56.260769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10630783-71e7-48d3-bfcd-791f9c908d57 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:56.262316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-10630783-71e7-48d3-bfcd-791f9c908d57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:56.293436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10630783-71e7-48d3-bfcd-791f9c908d57 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:56.310557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa89b0-dd89-4122-b6be-496b27391177 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:56.311193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa89b0-dd89-4122-b6be-496b27391177 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:56.311504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa89b0-dd89-4122-b6be-496b27391177 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:56.311777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa89b0-dd89-4122-b6be-496b27391177 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:56.350595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa89b0-dd89-4122-b6be-496b27391177 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:56.352916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa89b0-dd89-4122-b6be-496b27391177 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:56.379286 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1653/3323] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:56 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:29:56.663813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ccb20-2a46-46cd-b73b-0b06716690e8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:56.664378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ccb20-2a46-46cd-b73b-0b06716690e8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:56.664630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ccb20-2a46-46cd-b73b-0b06716690e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:56.721736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1c0ccb20-2a46-46cd-b73b-0b06716690e8 None None] MFA Rules not processed for user `47aab8bfff21443891308d80f7059b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:56.723373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c0ccb20-2a46-46cd-b73b-0b06716690e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:56.737128 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1671/3324] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:29:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:57.760579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de372e-7a56-4bde-8603-f03ae46fd386 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:57.761581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de372e-7a56-4bde-8603-f03ae46fd386 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:57.762036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de372e-7a56-4bde-8603-f03ae46fd386 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:57.764058 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1654/3325] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 18:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:29:57.770121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0aec69-0476-4cf2-86a2-d48ceb5d3a61 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:57.770622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0aec69-0476-4cf2-86a2-d48ceb5d3a61 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:57.770702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0aec69-0476-4cf2-86a2-d48ceb5d3a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:57.865391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9c0aec69-0476-4cf2-86a2-d48ceb5d3a61 None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:29:57.868544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c0aec69-0476-4cf2-86a2-d48ceb5d3a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:29:57.899417 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1672/3326] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 18:29:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:29:57.914378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de372e-7a56-4bde-8603-f03ae46fd386 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:29:57.929320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de372e-7a56-4bde-8603-f03ae46fd386 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:29:57.935894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1757d-0355-430d-a242-e13333ecb6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:29:57.971182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1757d-0355-430d-a242-e13333ecb6ae service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:29:57.972907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1757d-0355-430d-a242-e13333ecb6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:29:57.976897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1757d-0355-430d-a242-e13333ecb6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:29:58.002337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1757d-0355-430d-a242-e13333ecb6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:29:58.004198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1757d-0355-430d-a242-e13333ecb6ae service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:29:58.031827 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1655/3327] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:29:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:00.045648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0aec69-0476-4cf2-86a2-d48ceb5d3a61 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:00.048062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c0aec69-0476-4cf2-86a2-d48ceb5d3a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:00.089037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0aec69-0476-4cf2-86a2-d48ceb5d3a61 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:00.119897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d0d8d-90b9-468d-bee0-3e1227fab0e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:00.121520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d0d8d-90b9-468d-bee0-3e1227fab0e4 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:00.125010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d0d8d-90b9-468d-bee0-3e1227fab0e4 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:00.125562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d0d8d-90b9-468d-bee0-3e1227fab0e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:00.135635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-536d0d8d-90b9-468d-bee0-3e1227fab0e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:00.184718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d0d8d-90b9-468d-bee0-3e1227fab0e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:00.187123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d0d8d-90b9-468d-bee0-3e1227fab0e4 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:00.218522 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1673/3328] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:00.536689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f9ea4-37ae-4407-a3c7-a2c71ba16a8b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:00.537248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f9ea4-37ae-4407-a3c7-a2c71ba16a8b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:00.537751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f9ea4-37ae-4407-a3c7-a2c71ba16a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:00.656594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-801f9ea4-37ae-4407-a3c7-a2c71ba16a8b None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:00.662305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-801f9ea4-37ae-4407-a3c7-a2c71ba16a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:00.822574 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1656/3329] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:30:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:00.912280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d0d8d-90b9-468d-bee0-3e1227fab0e4 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:00.913912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-536d0d8d-90b9-468d-bee0-3e1227fab0e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:01.040708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:01.108066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d0d8d-90b9-468d-bee0-3e1227fab0e4 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:01.114847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5101d69-5b7e-42c6-a90b-68f77177262c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:01.115778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5101d69-5b7e-42c6-a90b-68f77177262c service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:01.116207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5101d69-5b7e-42c6-a90b-68f77177262c service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:01.116725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5101d69-5b7e-42c6-a90b-68f77177262c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:01.126981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5101d69-5b7e-42c6-a90b-68f77177262c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:01.128891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5101d69-5b7e-42c6-a90b-68f77177262c service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:01.148695 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1674/3330] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:30:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:30:09.759788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f9ea4-37ae-4407-a3c7-a2c71ba16a8b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:09.781965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f9ea4-37ae-4407-a3c7-a2c71ba16a8b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:09.793431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c04da0-ad68-445d-ada6-b96887f39233 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:09.794927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5101d69-5b7e-42c6-a90b-68f77177262c service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:09.795543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c04da0-ad68-445d-ada6-b96887f39233 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:09.795833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c04da0-ad68-445d-ada6-b96887f39233 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:09.797202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c04da0-ad68-445d-ada6-b96887f39233 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:09.801636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-43c04da0-ad68-445d-ada6-b96887f39233 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:09.809792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5101d69-5b7e-42c6-a90b-68f77177262c service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:09.825773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c4042-102b-4542-8ed0-82e0797c96ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:09.828514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c4042-102b-4542-8ed0-82e0797c96ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:09.828797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c4042-102b-4542-8ed0-82e0797c96ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:09.829077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c4042-102b-4542-8ed0-82e0797c96ee admin admin] PATH_INFO: `/v3/users/2717e7f717554a07a6129569c3688ef0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:09.830820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c04da0-ad68-445d-ada6-b96887f39233 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:09.832656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c04da0-ad68-445d-ada6-b96887f39233 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:09.836661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c4042-102b-4542-8ed0-82e0797c96ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2717e7f717554a07a6129569c3688ef0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:09.848446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c4042-102b-4542-8ed0-82e0797c96ee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:09.852311 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1657/3331] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:09.950941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fa5c4042-102b-4542-8ed0-82e0797c96ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2717e7f717554a07a6129569c3688ef0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:09.952178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fa5c4042-102b-4542-8ed0-82e0797c96ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2717e7f717554a07a6129569c3688ef0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:10.008103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fa5c4042-102b-4542-8ed0-82e0797c96ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2717e7f717554a07a6129569c3688ef0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:10.045503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fa5c4042-102b-4542-8ed0-82e0797c96ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2717e7f717554a07a6129569c3688ef0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:10.096401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fa5c4042-102b-4542-8ed0-82e0797c96ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2717e7f717554a07a6129569c3688ef0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:10.114153 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1675/3332] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:30:09 2022] DELETE /identity/v3/users/2717e7f717554a07a6129569c3688ef0 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:30:11.027027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c04da0-ad68-445d-ada6-b96887f39233 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:11.045911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c04da0-ad68-445d-ada6-b96887f39233 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:11.112193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:11.152851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f178f3-ee8a-4059-8af6-b8fd1c62101a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:11.154245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f178f3-ee8a-4059-8af6-b8fd1c62101a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:11.154693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f178f3-ee8a-4059-8af6-b8fd1c62101a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:11.155120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f178f3-ee8a-4059-8af6-b8fd1c62101a admin admin] PATH_INFO: `/v3/projects/e2060a6a00d3456fafe7120aea87552d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:11.156504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f178f3-ee8a-4059-8af6-b8fd1c62101a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2060a6a00d3456fafe7120aea87552d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:11.159898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f178f3-ee8a-4059-8af6-b8fd1c62101a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:11.260682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-95f178f3-ee8a-4059-8af6-b8fd1c62101a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2060a6a00d3456fafe7120aea87552d', 'request_id': 'req-95f178f3-ee8a-4059-8af6-b8fd1c62101a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:11.294517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-95f178f3-ee8a-4059-8af6-b8fd1c62101a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2060a6a00d3456fafe7120aea87552d', 'request_id': 'req-95f178f3-ee8a-4059-8af6-b8fd1c62101a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:11.307127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-95f178f3-ee8a-4059-8af6-b8fd1c62101a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2060a6a00d3456fafe7120aea87552d', 'request_id': 'req-95f178f3-ee8a-4059-8af6-b8fd1c62101a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:11.329667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-95f178f3-ee8a-4059-8af6-b8fd1c62101a admin admin] The token cache is being invalidate because project e2060a6a00d3456fafe7120aea87552d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:30:11.329667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-95f178f3-ee8a-4059-8af6-b8fd1c62101a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:11.331530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-95f178f3-ee8a-4059-8af6-b8fd1c62101a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:11.335618 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1658/3333] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:30:11 2022] DELETE /identity/v3/projects/e2060a6a00d3456fafe7120aea87552d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:11.341023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a4239-22b8-4522-8de2-dfb875305e18 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:11.342842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a4239-22b8-4522-8de2-dfb875305e18 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:11.343299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a4239-22b8-4522-8de2-dfb875305e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:11.376291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4c4a4239-22b8-4522-8de2-dfb875305e18 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:11.378223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4c4a4239-22b8-4522-8de2-dfb875305e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:11.485240 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1676/3334] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:11.494271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da558c-73d7-487f-a571-09226444d489 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:11.494552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da558c-73d7-487f-a571-09226444d489 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:11.494858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da558c-73d7-487f-a571-09226444d489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:11.534608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-02da558c-73d7-487f-a571-09226444d489 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:11.535783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-02da558c-73d7-487f-a571-09226444d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:11.561771 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1659/3335] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:11.565917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a4239-22b8-4522-8de2-dfb875305e18 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:11.584777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a4239-22b8-4522-8de2-dfb875305e18 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:11.601093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d072d7-c834-48e7-9b14-3e926abbcbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:11.603345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d072d7-c834-48e7-9b14-3e926abbcbfb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:11.603345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d072d7-c834-48e7-9b14-3e926abbcbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:11.603345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d072d7-c834-48e7-9b14-3e926abbcbfb admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:11.603345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d072d7-c834-48e7-9b14-3e926abbcbfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:30:11.603728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d072d7-c834-48e7-9b14-3e926abbcbfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:11.605073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d072d7-c834-48e7-9b14-3e926abbcbfb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:11.638503 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1677/3336] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:11.639381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da558c-73d7-487f-a571-09226444d489 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:11.655291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da558c-73d7-487f-a571-09226444d489 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:11.662987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935839e-a61f-4348-8a6c-d43d11868627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:11.664153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935839e-a61f-4348-8a6c-d43d11868627 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:11.664640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935839e-a61f-4348-8a6c-d43d11868627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:11.665056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935839e-a61f-4348-8a6c-d43d11868627 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:11.666608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935839e-a61f-4348-8a6c-d43d11868627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:11.669137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935839e-a61f-4348-8a6c-d43d11868627 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:11.737534 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1660/3337] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:30:11 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:30:11.741758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d072d7-c834-48e7-9b14-3e926abbcbfb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:11.756629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d072d7-c834-48e7-9b14-3e926abbcbfb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:11.791876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:11.903331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da3ea2-729d-4ed6-8026-faeaa7e25b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:11.910216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da3ea2-729d-4ed6-8026-faeaa7e25b00 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:11.911228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da3ea2-729d-4ed6-8026-faeaa7e25b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:11.911544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da3ea2-729d-4ed6-8026-faeaa7e25b00 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:11.914621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da3ea2-729d-4ed6-8026-faeaa7e25b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:11.918854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da3ea2-729d-4ed6-8026-faeaa7e25b00 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:11.941353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935839e-a61f-4348-8a6c-d43d11868627 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:11.952292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6935839e-a61f-4348-8a6c-d43d11868627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:11.979954 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1678/3338] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:30:11 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:30:11.986660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da3ea2-729d-4ed6-8026-faeaa7e25b00 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:12.007588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da3ea2-729d-4ed6-8026-faeaa7e25b00 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:12.019671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935839e-a61f-4348-8a6c-d43d11868627 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:12.025116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e4b4a-2885-4ba9-bd8b-da1f8ed32974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:12.025891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e4b4a-2885-4ba9-bd8b-da1f8ed32974 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:12.027703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e4b4a-2885-4ba9-bd8b-da1f8ed32974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:12.028248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e4b4a-2885-4ba9-bd8b-da1f8ed32974 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:12.029846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e4b4a-2885-4ba9-bd8b-da1f8ed32974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:12.035051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e4b4a-2885-4ba9-bd8b-da1f8ed32974 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:12.037159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3c219-1231-4684-a666-f90250c8284c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:12.038738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3c219-1231-4684-a666-f90250c8284c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:12.039183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3c219-1231-4684-a666-f90250c8284c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:12.039644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3c219-1231-4684-a666-f90250c8284c admin admin] PATH_INFO: `/v3/users/69c85b658b4d499fb6405b2e352358d0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:12.042020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3c219-1231-4684-a666-f90250c8284c admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c85b658b4d499fb6405b2e352358d0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:12.046992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3c219-1231-4684-a666-f90250c8284c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:12.093327 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1679/3339] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:30:12.097663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e4b4a-2885-4ba9-bd8b-da1f8ed32974 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:12.125165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e4b4a-2885-4ba9-bd8b-da1f8ed32974 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:12.134434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0b1a9-8bf7-4223-bea3-aa6946c0cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:12.135079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0b1a9-8bf7-4223-bea3-aa6946c0cb25 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:12.135410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0b1a9-8bf7-4223-bea3-aa6946c0cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:12.135875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0b1a9-8bf7-4223-bea3-aa6946c0cb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:12.136343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0b1a9-8bf7-4223-bea3-aa6946c0cb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:12.138340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0b1a9-8bf7-4223-bea3-aa6946c0cb25 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:12.151873 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1680/3340] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:12.155702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0b1a9-8bf7-4223-bea3-aa6946c0cb25 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:12.168399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0b1a9-8bf7-4223-bea3-aa6946c0cb25 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:12.169445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-01c3c219-1231-4684-a666-f90250c8284c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c85b658b4d499fb6405b2e352358d0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:12.182895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3adea3-97a0-41c1-8fb8-8a8abfc6037d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:12.184863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3adea3-97a0-41c1-8fb8-8a8abfc6037d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:12.185150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3adea3-97a0-41c1-8fb8-8a8abfc6037d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:12.185430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3adea3-97a0-41c1-8fb8-8a8abfc6037d admin admin] PATH_INFO: `/v3/projects/25ef0b8daf8446a3bb1bf5599c60b9dd/users/88949e2a2ed64e2693feef79b2822074/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:12.193053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-01c3c219-1231-4684-a666-f90250c8284c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c85b658b4d499fb6405b2e352358d0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:12.194373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-01c3c219-1231-4684-a666-f90250c8284c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c85b658b4d499fb6405b2e352358d0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:12.196119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-01c3c219-1231-4684-a666-f90250c8284c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c85b658b4d499fb6405b2e352358d0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:12.216767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-01c3c219-1231-4684-a666-f90250c8284c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c85b658b4d499fb6405b2e352358d0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:12.222641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3adea3-97a0-41c1-8fb8-8a8abfc6037d admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ef0b8daf8446a3bb1bf5599c60b9dd, user_id=88949e2a2ed64e2693feef79b2822074, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:12.226557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3adea3-97a0-41c1-8fb8-8a8abfc6037d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:12.242366 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1661/3341] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:30:11 2022] DELETE /identity/v3/users/69c85b658b4d499fb6405b2e352358d0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:12.262335 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1681/3342] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:30:12 2022] PUT /identity/v3/projects/25ef0b8daf8446a3bb1bf5599c60b9dd/users/88949e2a2ed64e2693feef79b2822074/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:12.272767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e9477-5826-4fa2-9163-65dc29d541e3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:12.273190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e9477-5826-4fa2-9163-65dc29d541e3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:12.273594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e9477-5826-4fa2-9163-65dc29d541e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:12.288653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:12.330781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d61e9477-5826-4fa2-9163-65dc29d541e3 None None] MFA Rules not processed for user `88949e2a2ed64e2693feef79b2822074`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:12.332696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d61e9477-5826-4fa2-9163-65dc29d541e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:12.474336 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1662/3343] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:30:12.588211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3adea3-97a0-41c1-8fb8-8a8abfc6037d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:12.591182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d3adea3-97a0-41c1-8fb8-8a8abfc6037d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:12.743418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3adea3-97a0-41c1-8fb8-8a8abfc6037d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:12.757815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97406f56-4869-4c8f-ba8d-1e818fe318fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:12.757815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97406f56-4869-4c8f-ba8d-1e818fe318fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:12.757815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97406f56-4869-4c8f-ba8d-1e818fe318fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:12.757815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97406f56-4869-4c8f-ba8d-1e818fe318fe admin admin] PATH_INFO: `/v3/projects/c1fe6c1d7a6b4f9fb793da81109ce93c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:12.781043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97406f56-4869-4c8f-ba8d-1e818fe318fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1fe6c1d7a6b4f9fb793da81109ce93c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:12.785554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97406f56-4869-4c8f-ba8d-1e818fe318fe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:12.941479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97406f56-4869-4c8f-ba8d-1e818fe318fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1fe6c1d7a6b4f9fb793da81109ce93c', 'request_id': 'req-97406f56-4869-4c8f-ba8d-1e818fe318fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:12.972692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97406f56-4869-4c8f-ba8d-1e818fe318fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1fe6c1d7a6b4f9fb793da81109ce93c', 'request_id': 'req-97406f56-4869-4c8f-ba8d-1e818fe318fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:12.997036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97406f56-4869-4c8f-ba8d-1e818fe318fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1fe6c1d7a6b4f9fb793da81109ce93c', 'request_id': 'req-97406f56-4869-4c8f-ba8d-1e818fe318fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:13.078624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:13.129518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97406f56-4869-4c8f-ba8d-1e818fe318fe admin admin] The token cache is being invalidate because project c1fe6c1d7a6b4f9fb793da81109ce93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:30:13.130168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97406f56-4869-4c8f-ba8d-1e818fe318fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:13.139243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97406f56-4869-4c8f-ba8d-1e818fe318fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:13.139243 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1682/3344] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:30:12 2022] DELETE /identity/v3/projects/c1fe6c1d7a6b4f9fb793da81109ce93c => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:13.140395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e9477-5826-4fa2-9163-65dc29d541e3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:13.144016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97406f56-4869-4c8f-ba8d-1e818fe318fe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:13.146614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97406f56-4869-4c8f-ba8d-1e818fe318fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:13.152817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e9477-5826-4fa2-9163-65dc29d541e3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:13.303401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a56713-5cce-4049-873c-13f252b48dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:13.304683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a56713-5cce-4049-873c-13f252b48dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:13.305447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a56713-5cce-4049-873c-13f252b48dac admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:13.305962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a56713-5cce-4049-873c-13f252b48dac admin admin] PATH_INFO: `/v3/users/23ceef31a71c41688c1a70446b7f8006` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:13.307865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a56713-5cce-4049-873c-13f252b48dac admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ceef31a71c41688c1a70446b7f8006)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:13.310930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a56713-5cce-4049-873c-13f252b48dac admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:13.350619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97406f56-4869-4c8f-ba8d-1e818fe318fe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:13.370606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cc2cb-6023-4f97-90ee-4a0ef5d44eae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:13.377880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cc2cb-6023-4f97-90ee-4a0ef5d44eae service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:13.378240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cc2cb-6023-4f97-90ee-4a0ef5d44eae service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:13.380224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cc2cb-6023-4f97-90ee-4a0ef5d44eae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:13.386511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-031cc2cb-6023-4f97-90ee-4a0ef5d44eae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:13.500388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8a56713-5cce-4049-873c-13f252b48dac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ceef31a71c41688c1a70446b7f8006'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:13.566078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031cc2cb-6023-4f97-90ee-4a0ef5d44eae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:13.567989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031cc2cb-6023-4f97-90ee-4a0ef5d44eae service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:13.589668 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1683/3345] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:13.649296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8a56713-5cce-4049-873c-13f252b48dac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ceef31a71c41688c1a70446b7f8006'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:13.655173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8a56713-5cce-4049-873c-13f252b48dac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ceef31a71c41688c1a70446b7f8006'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:13.659988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8a56713-5cce-4049-873c-13f252b48dac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ceef31a71c41688c1a70446b7f8006'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:13.713891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8a56713-5cce-4049-873c-13f252b48dac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ceef31a71c41688c1a70446b7f8006'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:13.759927 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1663/3346] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:30:13 2022] DELETE /identity/v3/users/23ceef31a71c41688c1a70446b7f8006 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:14.006199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d812e3e-c10a-4112-8c26-009d145ad90a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:14.006801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d812e3e-c10a-4112-8c26-009d145ad90a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:14.007083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d812e3e-c10a-4112-8c26-009d145ad90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:14.044650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5d812e3e-c10a-4112-8c26-009d145ad90a None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:14.045566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d812e3e-c10a-4112-8c26-009d145ad90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:14.280327 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1684/3347] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:30:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:14.397522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a56713-5cce-4049-873c-13f252b48dac admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:14.408303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a8a56713-5cce-4049-873c-13f252b48dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:14.410603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d812e3e-c10a-4112-8c26-009d145ad90a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:14.417252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d812e3e-c10a-4112-8c26-009d145ad90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:14.494593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:14.536634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:14.725439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d812e3e-c10a-4112-8c26-009d145ad90a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:14.739674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aac127-6ee3-4003-a991-cf914e0ace7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:14.739859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aac127-6ee3-4003-a991-cf914e0ace7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:14.740143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aac127-6ee3-4003-a991-cf914e0ace7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:14.740420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aac127-6ee3-4003-a991-cf914e0ace7d admin admin] PATH_INFO: `/v3/projects/135af64ec82d4f7db186184a301151f3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:14.741670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aac127-6ee3-4003-a991-cf914e0ace7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=135af64ec82d4f7db186184a301151f3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:14.743900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aac127-6ee3-4003-a991-cf914e0ace7d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:14.811385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a56713-5cce-4049-873c-13f252b48dac admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:14.834780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77aac127-6ee3-4003-a991-cf914e0ace7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '135af64ec82d4f7db186184a301151f3', 'request_id': 'req-77aac127-6ee3-4003-a991-cf914e0ace7d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:14.855689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77aac127-6ee3-4003-a991-cf914e0ace7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '135af64ec82d4f7db186184a301151f3', 'request_id': 'req-77aac127-6ee3-4003-a991-cf914e0ace7d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:14.868566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77aac127-6ee3-4003-a991-cf914e0ace7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '135af64ec82d4f7db186184a301151f3', 'request_id': 'req-77aac127-6ee3-4003-a991-cf914e0ace7d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:14.893883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77aac127-6ee3-4003-a991-cf914e0ace7d admin admin] The token cache is being invalidate because project 135af64ec82d4f7db186184a301151f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:30:14.895439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77aac127-6ee3-4003-a991-cf914e0ace7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:14.896237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77aac127-6ee3-4003-a991-cf914e0ace7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:14.901085 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1685/3348] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:30:14 2022] DELETE /identity/v3/projects/135af64ec82d4f7db186184a301151f3 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:14.905861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112df53c-2392-49e1-bd6f-b146d068a1ea None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:14.906301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112df53c-2392-49e1-bd6f-b146d068a1ea None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:14.906731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112df53c-2392-49e1-bd6f-b146d068a1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:14.916108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad68b2-cc11-447e-b223-7251a89fbca7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:14.916746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad68b2-cc11-447e-b223-7251a89fbca7 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:14.917212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad68b2-cc11-447e-b223-7251a89fbca7 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:14.917495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad68b2-cc11-447e-b223-7251a89fbca7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:14.920102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0bad68b2-cc11-447e-b223-7251a89fbca7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:14.950309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-112df53c-2392-49e1-bd6f-b146d068a1ea None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:14.953558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-112df53c-2392-49e1-bd6f-b146d068a1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:15.095126 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1686/3349] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:15.096318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad68b2-cc11-447e-b223-7251a89fbca7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:15.097959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad68b2-cc11-447e-b223-7251a89fbca7 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:15.103553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab317dbf-0efc-4725-9863-54b6a3ebfa72 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:15.104225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab317dbf-0efc-4725-9863-54b6a3ebfa72 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:15.104720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab317dbf-0efc-4725-9863-54b6a3ebfa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:15.127017 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1664/3350] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:30:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:30:15.151350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ab317dbf-0efc-4725-9863-54b6a3ebfa72 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:15.152659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab317dbf-0efc-4725-9863-54b6a3ebfa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:15.173265 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1687/3351] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:30:15.177295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad68b2-cc11-447e-b223-7251a89fbca7 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:15.207629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad68b2-cc11-447e-b223-7251a89fbca7 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:15.221479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c64b2-8918-4da8-8218-62c0546b03c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:15.222105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c64b2-8918-4da8-8218-62c0546b03c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:15.222375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c64b2-8918-4da8-8218-62c0546b03c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:15.222649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c64b2-8918-4da8-8218-62c0546b03c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:15.223381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c64b2-8918-4da8-8218-62c0546b03c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:30:15.223693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c64b2-8918-4da8-8218-62c0546b03c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:15.225598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c64b2-8918-4da8-8218-62c0546b03c9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:15.278615 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1665/3352] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:15.282485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab317dbf-0efc-4725-9863-54b6a3ebfa72 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:15.293340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab317dbf-0efc-4725-9863-54b6a3ebfa72 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:15.299597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b450681-7eb9-4fad-bbe1-629dcd1e95a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:15.300226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b450681-7eb9-4fad-bbe1-629dcd1e95a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:15.300577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b450681-7eb9-4fad-bbe1-629dcd1e95a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:15.300865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b450681-7eb9-4fad-bbe1-629dcd1e95a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:15.301587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b450681-7eb9-4fad-bbe1-629dcd1e95a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:15.303746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b450681-7eb9-4fad-bbe1-629dcd1e95a2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:15.355160 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1688/3353] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:30:15 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:30:15.359443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c64b2-8918-4da8-8218-62c0546b03c9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:15.370569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c64b2-8918-4da8-8218-62c0546b03c9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:15.458852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:15.496168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ac605-e5da-45ad-80c2-0452bc9a3591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:15.496870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ac605-e5da-45ad-80c2-0452bc9a3591 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:15.497223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ac605-e5da-45ad-80c2-0452bc9a3591 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:15.497567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ac605-e5da-45ad-80c2-0452bc9a3591 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:15.498208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ac605-e5da-45ad-80c2-0452bc9a3591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:15.500432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ac605-e5da-45ad-80c2-0452bc9a3591 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:15.528689 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1666/3354] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:30:15 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:30:15.533171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b450681-7eb9-4fad-bbe1-629dcd1e95a2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:15.548798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b450681-7eb9-4fad-bbe1-629dcd1e95a2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:15.562733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c0fac-116a-47c2-af71-b10656453e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:15.563410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c0fac-116a-47c2-af71-b10656453e0f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:15.563693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c0fac-116a-47c2-af71-b10656453e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:15.563966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c0fac-116a-47c2-af71-b10656453e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:15.564901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c0fac-116a-47c2-af71-b10656453e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:15.571004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c0fac-116a-47c2-af71-b10656453e0f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:15.603706 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1689/3355] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:15.604210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ac605-e5da-45ad-80c2-0452bc9a3591 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:15.651334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ac605-e5da-45ad-80c2-0452bc9a3591 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:15.677663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09b183-5083-4186-a878-4b46becdc98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:15.679086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09b183-5083-4186-a878-4b46becdc98d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:15.691742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09b183-5083-4186-a878-4b46becdc98d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:15.692700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09b183-5083-4186-a878-4b46becdc98d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:15.693041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09b183-5083-4186-a878-4b46becdc98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:15.699533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09b183-5083-4186-a878-4b46becdc98d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:15.765789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c0fac-116a-47c2-af71-b10656453e0f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:15.767894 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1667/3356] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:30:15.780203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c0fac-116a-47c2-af71-b10656453e0f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:15.808377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb5672-c107-4c8d-9b3f-38d8200bf4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:15.810162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb5672-c107-4c8d-9b3f-38d8200bf4c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:15.813825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb5672-c107-4c8d-9b3f-38d8200bf4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:15.815798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb5672-c107-4c8d-9b3f-38d8200bf4c2 admin admin] PATH_INFO: `/v3/projects/5b53cf04dded4bb78e306ea344354b28/users/ae02caa9ffdc46f584c01cf4f07f1726/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:15.861134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb5672-c107-4c8d-9b3f-38d8200bf4c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b53cf04dded4bb78e306ea344354b28, user_id=ae02caa9ffdc46f584c01cf4f07f1726, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:15.865391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb5672-c107-4c8d-9b3f-38d8200bf4c2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:15.913489 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1690/3357] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:30:15 2022] PUT /identity/v3/projects/5b53cf04dded4bb78e306ea344354b28/users/ae02caa9ffdc46f584c01cf4f07f1726/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:15.986509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cda2a-312d-4484-8a5a-bfdd5203265c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:15.986872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cda2a-312d-4484-8a5a-bfdd5203265c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:15.987325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cda2a-312d-4484-8a5a-bfdd5203265c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:16.054682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-919cda2a-312d-4484-8a5a-bfdd5203265c None None] MFA Rules not processed for user `ae02caa9ffdc46f584c01cf4f07f1726`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:16.058255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-919cda2a-312d-4484-8a5a-bfdd5203265c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:16.199855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb5672-c107-4c8d-9b3f-38d8200bf4c2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:16.211350 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1668/3358] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:16.211635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:16.358637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb5672-c107-4c8d-9b3f-38d8200bf4c2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:16.380443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ebfce-08b4-40d3-9103-dd98cecca15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:16.380443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ebfce-08b4-40d3-9103-dd98cecca15f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:16.380945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ebfce-08b4-40d3-9103-dd98cecca15f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:16.384373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ebfce-08b4-40d3-9103-dd98cecca15f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:16.390977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ebfce-08b4-40d3-9103-dd98cecca15f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:16.392954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ebfce-08b4-40d3-9103-dd98cecca15f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:16.455397 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1691/3359] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:30:16 2022] POST /identity/v3/projects => generated 375 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:30:16.458385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cda2a-312d-4484-8a5a-bfdd5203265c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:16.473807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cda2a-312d-4484-8a5a-bfdd5203265c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:16.649991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a208e-5a84-4247-9153-873339657eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:16.650329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a208e-5a84-4247-9153-873339657eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:16.650679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a208e-5a84-4247-9153-873339657eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:16.651054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a208e-5a84-4247-9153-873339657eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:16.652435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a208e-5a84-4247-9153-873339657eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:16.655233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a208e-5a84-4247-9153-873339657eb7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:16.724311 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1669/3360] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:30:16 2022] POST /identity/v3/users => generated 294 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:30:16.727580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ebfce-08b4-40d3-9103-dd98cecca15f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:16.747233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ebfce-08b4-40d3-9103-dd98cecca15f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:16.758111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f93721-5fdd-447c-b039-f59495cee1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:16.758899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f93721-5fdd-447c-b039-f59495cee1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:16.759549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f93721-5fdd-447c-b039-f59495cee1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:16.760084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f93721-5fdd-447c-b039-f59495cee1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:16.760850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f93721-5fdd-447c-b039-f59495cee1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:16.762692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f93721-5fdd-447c-b039-f59495cee1e3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:16.794441 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1692/3361] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:16.798759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a208e-5a84-4247-9153-873339657eb7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:16.814802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a208e-5a84-4247-9153-873339657eb7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:16.834885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c071e5-c7ce-4ef1-8012-5f594f02d1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:16.835692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c071e5-c7ce-4ef1-8012-5f594f02d1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:16.836410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c071e5-c7ce-4ef1-8012-5f594f02d1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:16.836410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c071e5-c7ce-4ef1-8012-5f594f02d1ec admin admin] PATH_INFO: `/v3/projects/fe09b0867b084386a7679cb0ba0ef5a5/users/0e622b5024074c939f7842c775ebbe32/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:16.872630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c071e5-c7ce-4ef1-8012-5f594f02d1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe09b0867b084386a7679cb0ba0ef5a5, user_id=0e622b5024074c939f7842c775ebbe32, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:16.886664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c071e5-c7ce-4ef1-8012-5f594f02d1ec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:16.921477 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1670/3362] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:30:16 2022] PUT /identity/v3/projects/fe09b0867b084386a7679cb0ba0ef5a5/users/0e622b5024074c939f7842c775ebbe32/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:30:16.925974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f93721-5fdd-447c-b039-f59495cee1e3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:16.941186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f93721-5fdd-447c-b039-f59495cee1e3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:17.042134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaa96f-a74b-4aba-abb0-89c89d528fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:17.043221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaa96f-a74b-4aba-abb0-89c89d528fea admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:17.043698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaa96f-a74b-4aba-abb0-89c89d528fea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:17.044425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaa96f-a74b-4aba-abb0-89c89d528fea admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:17.045349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaa96f-a74b-4aba-abb0-89c89d528fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:17.050884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaa96f-a74b-4aba-abb0-89c89d528fea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:17.082548 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1693/3363] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:17.087641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c071e5-c7ce-4ef1-8012-5f594f02d1ec admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:17.106579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c071e5-c7ce-4ef1-8012-5f594f02d1ec admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:17.120771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dae924-be34-45ae-8cd0-cbc71e1b0273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:17.121864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dae924-be34-45ae-8cd0-cbc71e1b0273 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:17.122296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dae924-be34-45ae-8cd0-cbc71e1b0273 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:17.122745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dae924-be34-45ae-8cd0-cbc71e1b0273 admin admin] PATH_INFO: `/v3/projects/fe09b0867b084386a7679cb0ba0ef5a5/users/0e622b5024074c939f7842c775ebbe32/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:17.128225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dae924-be34-45ae-8cd0-cbc71e1b0273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe09b0867b084386a7679cb0ba0ef5a5, user_id=0e622b5024074c939f7842c775ebbe32, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:17.134955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dae924-be34-45ae-8cd0-cbc71e1b0273 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:17.163643 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1671/3364] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:30:17 2022] PUT /identity/v3/projects/fe09b0867b084386a7679cb0ba0ef5a5/users/0e622b5024074c939f7842c775ebbe32/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:17.176537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1643d5-7b79-45de-8b2e-855b3dec0b0a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:17.177115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1643d5-7b79-45de-8b2e-855b3dec0b0a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:17.177571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1643d5-7b79-45de-8b2e-855b3dec0b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:17.261386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0f1643d5-7b79-45de-8b2e-855b3dec0b0a None None] MFA Rules not processed for user `0e622b5024074c939f7842c775ebbe32`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:17.263296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f1643d5-7b79-45de-8b2e-855b3dec0b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:17.480612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:17.499372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dae924-be34-45ae-8cd0-cbc71e1b0273 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:17.500548 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1694/3365] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:17.507924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:17.517120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dae924-be34-45ae-8cd0-cbc71e1b0273 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:17.534719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35fd4a-feba-40a1-b3a6-d863a8bb3eeb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e622b5024074c939f7842c775ebbe32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe09b0867b084386a7679cb0ba0ef5a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:17.535396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35fd4a-feba-40a1-b3a6-d863a8bb3eeb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:17.535680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35fd4a-feba-40a1-b3a6-d863a8bb3eeb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:17.535946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35fd4a-feba-40a1-b3a6-d863a8bb3eeb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:17.537061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35fd4a-feba-40a1-b3a6-d863a8bb3eeb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:30:17.537377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35fd4a-feba-40a1-b3a6-d863a8bb3eeb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:17.542307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35fd4a-feba-40a1-b3a6-d863a8bb3eeb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:17.612897 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1672/3366] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:30:17.617234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1643d5-7b79-45de-8b2e-855b3dec0b0a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:17.627825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1643d5-7b79-45de-8b2e-855b3dec0b0a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:17.649908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368139b3-477c-4936-8ac8-9f836a085d20 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e622b5024074c939f7842c775ebbe32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe09b0867b084386a7679cb0ba0ef5a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:17.650547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368139b3-477c-4936-8ac8-9f836a085d20 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:17.650832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368139b3-477c-4936-8ac8-9f836a085d20 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:17.651114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368139b3-477c-4936-8ac8-9f836a085d20 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:17.651874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368139b3-477c-4936-8ac8-9f836a085d20 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:17.672304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368139b3-477c-4936-8ac8-9f836a085d20 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:17.800729 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1695/3367] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:30:17 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:30:17.804749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35fd4a-feba-40a1-b3a6-d863a8bb3eeb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:17.820286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35fd4a-feba-40a1-b3a6-d863a8bb3eeb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:18.019442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca482b27-40b2-41c4-9745-3d23533a23b1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e622b5024074c939f7842c775ebbe32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe09b0867b084386a7679cb0ba0ef5a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:18.020182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca482b27-40b2-41c4-9745-3d23533a23b1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:18.028000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca482b27-40b2-41c4-9745-3d23533a23b1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:18.028458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca482b27-40b2-41c4-9745-3d23533a23b1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:18.029998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca482b27-40b2-41c4-9745-3d23533a23b1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:30:18.031583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca482b27-40b2-41c4-9745-3d23533a23b1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:18.033323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca482b27-40b2-41c4-9745-3d23533a23b1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:18.089004 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1673/3368] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:18.184072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368139b3-477c-4936-8ac8-9f836a085d20 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:18.187368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-368139b3-477c-4936-8ac8-9f836a085d20 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:18.310331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368139b3-477c-4936-8ac8-9f836a085d20 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:18.316215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6628576-5fca-4cea-bcf8-868c3e8a7dde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:18.316841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6628576-5fca-4cea-bcf8-868c3e8a7dde service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:18.317179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6628576-5fca-4cea-bcf8-868c3e8a7dde service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:18.317462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6628576-5fca-4cea-bcf8-868c3e8a7dde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:18.326799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6628576-5fca-4cea-bcf8-868c3e8a7dde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:18.328835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6628576-5fca-4cea-bcf8-868c3e8a7dde service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:18.341325 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1696/3369] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:18.375329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a1e06-f193-4694-b46e-29ded6e192b0 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:18.375623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a1e06-f193-4694-b46e-29ded6e192b0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:18.375906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a1e06-f193-4694-b46e-29ded6e192b0 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:18.377592 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1674/3370] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:30:18.382282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6628576-5fca-4cea-bcf8-868c3e8a7dde service nova] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:30:18.403864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6628576-5fca-4cea-bcf8-868c3e8a7dde service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:18.426950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6628576-5fca-4cea-bcf8-868c3e8a7dde service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:18.438220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a82f3-90e3-4bca-b284-6a54de289c7b tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e622b5024074c939f7842c775ebbe32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe09b0867b084386a7679cb0ba0ef5a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:18.439168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a82f3-90e3-4bca-b284-6a54de289c7b tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:18.440638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a82f3-90e3-4bca-b284-6a54de289c7b tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:18.441235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a82f3-90e3-4bca-b284-6a54de289c7b tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] PATH_INFO: `/v3/projects/acf565bd146348cabadbc55bd7543e6f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:18.443093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a82f3-90e3-4bca-b284-6a54de289c7b tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorizing `identity:get_project(project_id=acf565bd146348cabadbc55bd7543e6f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:18.445535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a82f3-90e3-4bca-b284-6a54de289c7b tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:18.447447 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1697/3371] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:30:18 2022] GET /identity/v3/projects/acf565bd146348cabadbc55bd7543e6f => generated 371 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:30:18.642556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cae572-2c25-4fb8-b81e-fdb0093ebef8 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:18.643096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cae572-2c25-4fb8-b81e-fdb0093ebef8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:18.643380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cae572-2c25-4fb8-b81e-fdb0093ebef8 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:18.647738 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1675/3372] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:30:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:30:18.653193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a82f3-90e3-4bca-b284-6a54de289c7b tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:30:18.655315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-859a82f3-90e3-4bca-b284-6a54de289c7b tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:18.678384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a82f3-90e3-4bca-b284-6a54de289c7b tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:18.701670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a82f3-90e3-4bca-b284-6a54de289c7b tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:18.709819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc4ed1-8612-46ca-ba8d-3d5f1e785930 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e622b5024074c939f7842c775ebbe32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe09b0867b084386a7679cb0ba0ef5a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:18.711063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc4ed1-8612-46ca-ba8d-3d5f1e785930 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:18.711594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc4ed1-8612-46ca-ba8d-3d5f1e785930 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:18.712278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc4ed1-8612-46ca-ba8d-3d5f1e785930 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] PATH_INFO: `/v3/projects/acf565bd146348cabadbc55bd7543e6f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:18.714362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc4ed1-8612-46ca-ba8d-3d5f1e785930 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorizing `identity:get_project(project_id=acf565bd146348cabadbc55bd7543e6f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:18.717430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc4ed1-8612-46ca-ba8d-3d5f1e785930 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:18.724467 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1698/3373] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:30:18 2022] GET /identity/v3/projects/acf565bd146348cabadbc55bd7543e6f => generated 371 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:18.777443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cae572-2c25-4fb8-b81e-fdb0093ebef8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:18.797825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cae572-2c25-4fb8-b81e-fdb0093ebef8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:18.802873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5881430-521c-43f3-a771-2665bf568544 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e622b5024074c939f7842c775ebbe32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe09b0867b084386a7679cb0ba0ef5a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:18.803592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5881430-521c-43f3-a771-2665bf568544 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:18.804530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5881430-521c-43f3-a771-2665bf568544 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:18.804811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5881430-521c-43f3-a771-2665bf568544 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:18.805487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5881430-521c-43f3-a771-2665bf568544 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:30:18.805890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5881430-521c-43f3-a771-2665bf568544 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:18.807861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5881430-521c-43f3-a771-2665bf568544 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:18.834398 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1676/3374] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:18.838829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc4ed1-8612-46ca-ba8d-3d5f1e785930 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:18.852880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc4ed1-8612-46ca-ba8d-3d5f1e785930 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:18.858910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c29c3-1fe5-4efd-8702-d7f8fde26310 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e622b5024074c939f7842c775ebbe32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe09b0867b084386a7679cb0ba0ef5a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:18.859903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c29c3-1fe5-4efd-8702-d7f8fde26310 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:18.860356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c29c3-1fe5-4efd-8702-d7f8fde26310 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:18.860783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c29c3-1fe5-4efd-8702-d7f8fde26310 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:18.861612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c29c3-1fe5-4efd-8702-d7f8fde26310 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:18.863980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c29c3-1fe5-4efd-8702-d7f8fde26310 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:18.906447 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1699/3375] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:30:18 2022] POST /identity/v3/users => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:30:18.907951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5881430-521c-43f3-a771-2665bf568544 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:18.922983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5881430-521c-43f3-a771-2665bf568544 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:18.945939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee906c3e-7f7b-451f-99c9-d978c9d806ef tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e622b5024074c939f7842c775ebbe32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe09b0867b084386a7679cb0ba0ef5a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:18.947524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee906c3e-7f7b-451f-99c9-d978c9d806ef tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:18.947979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee906c3e-7f7b-451f-99c9-d978c9d806ef tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:18.948492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee906c3e-7f7b-451f-99c9-d978c9d806ef tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:18.950198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee906c3e-7f7b-451f-99c9-d978c9d806ef tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:30:18.950617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee906c3e-7f7b-451f-99c9-d978c9d806ef tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:18.953012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee906c3e-7f7b-451f-99c9-d978c9d806ef tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:18.967591 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1677/3376] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:19.173882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8baecd-67a7-40f4-940c-f591bb0cd0c0 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:19.174398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8baecd-67a7-40f4-940c-f591bb0cd0c0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:19.174842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8baecd-67a7-40f4-940c-f591bb0cd0c0 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:19.176303 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1700/3377] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:30:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:30:19.182615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee906c3e-7f7b-451f-99c9-d978c9d806ef tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:30:19.200729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee906c3e-7f7b-451f-99c9-d978c9d806ef tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:19.213245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee906c3e-7f7b-451f-99c9-d978c9d806ef tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:19.218632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b15714-376a-49bc-ae60-187a39926bdb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e622b5024074c939f7842c775ebbe32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe09b0867b084386a7679cb0ba0ef5a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:19.219334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b15714-376a-49bc-ae60-187a39926bdb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:19.219624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b15714-376a-49bc-ae60-187a39926bdb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:19.219891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b15714-376a-49bc-ae60-187a39926bdb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] PATH_INFO: `/v3/projects/acf565bd146348cabadbc55bd7543e6f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:19.221021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b15714-376a-49bc-ae60-187a39926bdb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorizing `identity:get_project(project_id=acf565bd146348cabadbc55bd7543e6f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:19.223491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b15714-376a-49bc-ae60-187a39926bdb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:19.225567 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1678/3378] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:30:19 2022] GET /identity/v3/projects/acf565bd146348cabadbc55bd7543e6f => generated 371 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:19.526503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57227c1b-8110-4976-ac23-bf97c8953405 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:19.526787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57227c1b-8110-4976-ac23-bf97c8953405 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:19.527363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57227c1b-8110-4976-ac23-bf97c8953405 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:19.528742 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1701/3379] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:30:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:30:19.534722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b15714-376a-49bc-ae60-187a39926bdb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:30:19.552925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b15714-376a-49bc-ae60-187a39926bdb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:19.564868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b15714-376a-49bc-ae60-187a39926bdb tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:19.578872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abac9b-93da-4be2-8d62-890f6a6ee497 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e622b5024074c939f7842c775ebbe32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe09b0867b084386a7679cb0ba0ef5a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:19.580298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abac9b-93da-4be2-8d62-890f6a6ee497 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:19.580640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abac9b-93da-4be2-8d62-890f6a6ee497 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:19.581215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abac9b-93da-4be2-8d62-890f6a6ee497 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] PATH_INFO: `/v3/projects/acf565bd146348cabadbc55bd7543e6f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:19.583515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abac9b-93da-4be2-8d62-890f6a6ee497 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorizing `identity:get_project(project_id=acf565bd146348cabadbc55bd7543e6f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:19.597877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abac9b-93da-4be2-8d62-890f6a6ee497 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:19.609794 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1679/3380] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:30:19 2022] GET /identity/v3/projects/acf565bd146348cabadbc55bd7543e6f => generated 371 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:19.648472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57227c1b-8110-4976-ac23-bf97c8953405 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:19.664279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57227c1b-8110-4976-ac23-bf97c8953405 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:19.670419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960e800-2845-4455-92a8-c829972cb9d1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e622b5024074c939f7842c775ebbe32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe09b0867b084386a7679cb0ba0ef5a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:19.671541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960e800-2845-4455-92a8-c829972cb9d1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:19.689315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960e800-2845-4455-92a8-c829972cb9d1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:19.689852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960e800-2845-4455-92a8-c829972cb9d1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] PATH_INFO: `/v3/users/f095d06140ed491c8f6bda27c1e00acb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:19.722879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960e800-2845-4455-92a8-c829972cb9d1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f095d06140ed491c8f6bda27c1e00acb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:19.730551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960e800-2845-4455-92a8-c829972cb9d1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:19.824618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5960e800-2845-4455-92a8-c829972cb9d1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f095d06140ed491c8f6bda27c1e00acb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:19.826218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5960e800-2845-4455-92a8-c829972cb9d1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f095d06140ed491c8f6bda27c1e00acb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:19.856431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5960e800-2845-4455-92a8-c829972cb9d1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f095d06140ed491c8f6bda27c1e00acb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:19.875169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5960e800-2845-4455-92a8-c829972cb9d1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f095d06140ed491c8f6bda27c1e00acb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:19.884712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:19.901363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5960e800-2845-4455-92a8-c829972cb9d1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f095d06140ed491c8f6bda27c1e00acb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:19.913579 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1702/3381] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:30:19 2022] DELETE /identity/v3/users/f095d06140ed491c8f6bda27c1e00acb => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:19.918821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abac9b-93da-4be2-8d62-890f6a6ee497 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:19.923008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-15abac9b-93da-4be2-8d62-890f6a6ee497 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:19.945406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abac9b-93da-4be2-8d62-890f6a6ee497 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:20.102752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dfa02-aa0c-4310-b1bc-9b9da5f23591 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e622b5024074c939f7842c775ebbe32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe09b0867b084386a7679cb0ba0ef5a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:20.104060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dfa02-aa0c-4310-b1bc-9b9da5f23591 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:20.104556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dfa02-aa0c-4310-b1bc-9b9da5f23591 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:20.105205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dfa02-aa0c-4310-b1bc-9b9da5f23591 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] PATH_INFO: `/v3/projects/acf565bd146348cabadbc55bd7543e6f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:20.108909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dfa02-aa0c-4310-b1bc-9b9da5f23591 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorizing `identity:delete_project(project_id=acf565bd146348cabadbc55bd7543e6f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:20.112956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dfa02-aa0c-4310-b1bc-9b9da5f23591 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:20.274191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:20.279884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-542dfa02-aa0c-4310-b1bc-9b9da5f23591 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf565bd146348cabadbc55bd7543e6f', 'request_id': 'req-542dfa02-aa0c-4310-b1bc-9b9da5f23591'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:20.289228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-542dfa02-aa0c-4310-b1bc-9b9da5f23591 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf565bd146348cabadbc55bd7543e6f', 'request_id': 'req-542dfa02-aa0c-4310-b1bc-9b9da5f23591'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:20.313559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-542dfa02-aa0c-4310-b1bc-9b9da5f23591 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf565bd146348cabadbc55bd7543e6f', 'request_id': 'req-542dfa02-aa0c-4310-b1bc-9b9da5f23591'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:20.340825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-542dfa02-aa0c-4310-b1bc-9b9da5f23591 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] The token cache is being invalidate because project acf565bd146348cabadbc55bd7543e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:30:20.347987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-542dfa02-aa0c-4310-b1bc-9b9da5f23591 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:20.348530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-542dfa02-aa0c-4310-b1bc-9b9da5f23591 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:20.360136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960e800-2845-4455-92a8-c829972cb9d1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:20.361980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5960e800-2845-4455-92a8-c829972cb9d1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:20.373093 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1680/3382] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:30:19 2022] DELETE /identity/v3/projects/acf565bd146348cabadbc55bd7543e6f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:20.484715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960e800-2845-4455-92a8-c829972cb9d1 tempest-QuotasAdminTestV257-1718426783 tempest-QuotasAdminTestV257-1718426783-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:20.607566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b0104-fe50-4cff-8b9f-05eb275aaa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:20.608816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b0104-fe50-4cff-8b9f-05eb275aaa42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:20.609309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b0104-fe50-4cff-8b9f-05eb275aaa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:20.609819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b0104-fe50-4cff-8b9f-05eb275aaa42 admin admin] PATH_INFO: `/v3/users/ae02caa9ffdc46f584c01cf4f07f1726` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:20.611589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b0104-fe50-4cff-8b9f-05eb275aaa42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae02caa9ffdc46f584c01cf4f07f1726)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:20.614959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b0104-fe50-4cff-8b9f-05eb275aaa42 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:20.712401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d55b0104-fe50-4cff-8b9f-05eb275aaa42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae02caa9ffdc46f584c01cf4f07f1726'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:20.713141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d55b0104-fe50-4cff-8b9f-05eb275aaa42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae02caa9ffdc46f584c01cf4f07f1726'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:20.733805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d55b0104-fe50-4cff-8b9f-05eb275aaa42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae02caa9ffdc46f584c01cf4f07f1726'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:20.755229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d55b0104-fe50-4cff-8b9f-05eb275aaa42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae02caa9ffdc46f584c01cf4f07f1726'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:20.770369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d55b0104-fe50-4cff-8b9f-05eb275aaa42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae02caa9ffdc46f584c01cf4f07f1726'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:20.777752 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1703/3383] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:30:20 2022] DELETE /identity/v3/users/ae02caa9ffdc46f584c01cf4f07f1726 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:20.782112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedecfa7-2986-463c-acda-5c6132a1e121 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:20.782773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedecfa7-2986-463c-acda-5c6132a1e121 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:20.782974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedecfa7-2986-463c-acda-5c6132a1e121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:20.858774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fedecfa7-2986-463c-acda-5c6132a1e121 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:20.860077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fedecfa7-2986-463c-acda-5c6132a1e121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:20.999288 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1681/3384] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:21.008450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b0104-fe50-4cff-8b9f-05eb275aaa42 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:21.010019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d55b0104-fe50-4cff-8b9f-05eb275aaa42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:21.037380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:21.094251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b0104-fe50-4cff-8b9f-05eb275aaa42 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:21.113928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaa677-54d2-43aa-b4c4-9c51c00cc965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:21.114849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaa677-54d2-43aa-b4c4-9c51c00cc965 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:21.115236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaa677-54d2-43aa-b4c4-9c51c00cc965 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:21.115720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaa677-54d2-43aa-b4c4-9c51c00cc965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:21.132501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaa677-54d2-43aa-b4c4-9c51c00cc965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:21.138335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaa677-54d2-43aa-b4c4-9c51c00cc965 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:21.156272 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1704/3385] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:21.966622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedecfa7-2986-463c-acda-5c6132a1e121 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:21.971972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fedecfa7-2986-463c-acda-5c6132a1e121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:21.994401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedecfa7-2986-463c-acda-5c6132a1e121 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:22.018585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce6ba4-6dda-46c0-9e4f-62d74072f650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:22.022681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce6ba4-6dda-46c0-9e4f-62d74072f650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:22.023499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce6ba4-6dda-46c0-9e4f-62d74072f650 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:22.024251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce6ba4-6dda-46c0-9e4f-62d74072f650 admin admin] PATH_INFO: `/v3/projects/5b53cf04dded4bb78e306ea344354b28` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:22.031432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce6ba4-6dda-46c0-9e4f-62d74072f650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b53cf04dded4bb78e306ea344354b28)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:22.036554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce6ba4-6dda-46c0-9e4f-62d74072f650 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:22.167530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-19ce6ba4-6dda-46c0-9e4f-62d74072f650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b53cf04dded4bb78e306ea344354b28', 'request_id': 'req-19ce6ba4-6dda-46c0-9e4f-62d74072f650'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:22.180742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-19ce6ba4-6dda-46c0-9e4f-62d74072f650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b53cf04dded4bb78e306ea344354b28', 'request_id': 'req-19ce6ba4-6dda-46c0-9e4f-62d74072f650'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:22.187813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-19ce6ba4-6dda-46c0-9e4f-62d74072f650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b53cf04dded4bb78e306ea344354b28', 'request_id': 'req-19ce6ba4-6dda-46c0-9e4f-62d74072f650'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:22.209775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-19ce6ba4-6dda-46c0-9e4f-62d74072f650 admin admin] The token cache is being invalidate because project 5b53cf04dded4bb78e306ea344354b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:30:22.210517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-19ce6ba4-6dda-46c0-9e4f-62d74072f650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:22.212055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-19ce6ba4-6dda-46c0-9e4f-62d74072f650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:22.215334 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1682/3386] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:30:21 2022] DELETE /identity/v3/projects/5b53cf04dded4bb78e306ea344354b28 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:22.218421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaa677-54d2-43aa-b4c4-9c51c00cc965 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:22.234410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaa677-54d2-43aa-b4c4-9c51c00cc965 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:22.312291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab4bea-5b7a-4fb9-8311-c5305ad1abf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:22.313633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab4bea-5b7a-4fb9-8311-c5305ad1abf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:22.313873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab4bea-5b7a-4fb9-8311-c5305ad1abf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:22.314160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab4bea-5b7a-4fb9-8311-c5305ad1abf6 admin admin] PATH_INFO: `/v3/users/0e622b5024074c939f7842c775ebbe32` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:22.318173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab4bea-5b7a-4fb9-8311-c5305ad1abf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e622b5024074c939f7842c775ebbe32)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:22.320363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab4bea-5b7a-4fb9-8311-c5305ad1abf6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:22.390548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3ab4bea-5b7a-4fb9-8311-c5305ad1abf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e622b5024074c939f7842c775ebbe32'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:22.391597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3ab4bea-5b7a-4fb9-8311-c5305ad1abf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e622b5024074c939f7842c775ebbe32'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:22.406700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3ab4bea-5b7a-4fb9-8311-c5305ad1abf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e622b5024074c939f7842c775ebbe32'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:22.418342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3ab4bea-5b7a-4fb9-8311-c5305ad1abf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e622b5024074c939f7842c775ebbe32'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:22.451105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3ab4bea-5b7a-4fb9-8311-c5305ad1abf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e622b5024074c939f7842c775ebbe32'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:22.462672 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1705/3387] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:30:22 2022] DELETE /identity/v3/users/0e622b5024074c939f7842c775ebbe32 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:30:22.619125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216626cf-d1a0-44cf-aec5-987de8c787d6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:22.619792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216626cf-d1a0-44cf-aec5-987de8c787d6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:22.620476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216626cf-d1a0-44cf-aec5-987de8c787d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:22.645195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-216626cf-d1a0-44cf-aec5-987de8c787d6 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:22.646541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-216626cf-d1a0-44cf-aec5-987de8c787d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:22.745496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:22.761367 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1683/3388] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:30:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:22.778295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab4bea-5b7a-4fb9-8311-c5305ad1abf6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:22.780654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c3ab4bea-5b7a-4fb9-8311-c5305ad1abf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:22.864883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:22.949612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab4bea-5b7a-4fb9-8311-c5305ad1abf6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:22.986476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23096434-df40-4a53-94c5-cf83a5a1b816 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:22.990416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23096434-df40-4a53-94c5-cf83a5a1b816 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:22.991027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23096434-df40-4a53-94c5-cf83a5a1b816 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:22.991506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23096434-df40-4a53-94c5-cf83a5a1b816 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:23.007512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23096434-df40-4a53-94c5-cf83a5a1b816 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:23.010546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23096434-df40-4a53-94c5-cf83a5a1b816 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:23.026147 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1706/3389] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:30:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:30:23.204387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216626cf-d1a0-44cf-aec5-987de8c787d6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:23.206301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-216626cf-d1a0-44cf-aec5-987de8c787d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:23.223747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23096434-df40-4a53-94c5-cf83a5a1b816 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:23.225942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-23096434-df40-4a53-94c5-cf83a5a1b816 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:23.319925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216626cf-d1a0-44cf-aec5-987de8c787d6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:23.325369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a53cdc-a511-4a5c-be57-b56e382b460d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:23.326836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53cdc-a511-4a5c-be57-b56e382b460d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:23.327471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53cdc-a511-4a5c-be57-b56e382b460d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:23.327983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53cdc-a511-4a5c-be57-b56e382b460d admin admin] PATH_INFO: `/v3/users/88949e2a2ed64e2693feef79b2822074` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:23.329901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a53cdc-a511-4a5c-be57-b56e382b460d admin admin] RBAC: Authorizing `identity:delete_user(user_id=88949e2a2ed64e2693feef79b2822074)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:23.333283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a53cdc-a511-4a5c-be57-b56e382b460d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:23.346773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23096434-df40-4a53-94c5-cf83a5a1b816 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:23.359294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab37363-0dd5-4066-b8c5-52fb4e05d80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:23.360595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab37363-0dd5-4066-b8c5-52fb4e05d80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:23.361425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab37363-0dd5-4066-b8c5-52fb4e05d80a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:23.362619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab37363-0dd5-4066-b8c5-52fb4e05d80a admin admin] PATH_INFO: `/v3/projects/fe09b0867b084386a7679cb0ba0ef5a5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:23.365052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab37363-0dd5-4066-b8c5-52fb4e05d80a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe09b0867b084386a7679cb0ba0ef5a5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:23.368326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab37363-0dd5-4066-b8c5-52fb4e05d80a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:23.454393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-21a53cdc-a511-4a5c-be57-b56e382b460d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88949e2a2ed64e2693feef79b2822074'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:23.483825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-21a53cdc-a511-4a5c-be57-b56e382b460d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88949e2a2ed64e2693feef79b2822074'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:23.484764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-21a53cdc-a511-4a5c-be57-b56e382b460d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88949e2a2ed64e2693feef79b2822074'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:23.485630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-21a53cdc-a511-4a5c-be57-b56e382b460d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88949e2a2ed64e2693feef79b2822074'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:23.489169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eab37363-0dd5-4066-b8c5-52fb4e05d80a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe09b0867b084386a7679cb0ba0ef5a5', 'request_id': 'req-eab37363-0dd5-4066-b8c5-52fb4e05d80a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:23.498276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-21a53cdc-a511-4a5c-be57-b56e382b460d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88949e2a2ed64e2693feef79b2822074'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:23.502631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eab37363-0dd5-4066-b8c5-52fb4e05d80a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe09b0867b084386a7679cb0ba0ef5a5', 'request_id': 'req-eab37363-0dd5-4066-b8c5-52fb4e05d80a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:23.518970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eab37363-0dd5-4066-b8c5-52fb4e05d80a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe09b0867b084386a7679cb0ba0ef5a5', 'request_id': 'req-eab37363-0dd5-4066-b8c5-52fb4e05d80a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:23.531639 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1684/3390] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:30:23 2022] DELETE /identity/v3/users/88949e2a2ed64e2693feef79b2822074 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:23.533759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37a637-2409-4272-be62-b4b8eb21aa17 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:23.534072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37a637-2409-4272-be62-b4b8eb21aa17 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:23.534337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37a637-2409-4272-be62-b4b8eb21aa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:23.536316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eab37363-0dd5-4066-b8c5-52fb4e05d80a admin admin] The token cache is being invalidate because project fe09b0867b084386a7679cb0ba0ef5a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:30:23.536668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eab37363-0dd5-4066-b8c5-52fb4e05d80a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:23.537661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eab37363-0dd5-4066-b8c5-52fb4e05d80a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:23.544290 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1707/3391] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:30:23 2022] DELETE /identity/v3/projects/fe09b0867b084386a7679cb0ba0ef5a5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:30:23.546963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caecfb-f636-400b-873f-70b3ed08cb9e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:23.547423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caecfb-f636-400b-873f-70b3ed08cb9e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:23.547835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caecfb-f636-400b-873f-70b3ed08cb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:23.563049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4c37a637-2409-4272-be62-b4b8eb21aa17 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:23.565034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4c37a637-2409-4272-be62-b4b8eb21aa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:23.586252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e1caecfb-f636-400b-873f-70b3ed08cb9e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:23.587671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1caecfb-f636-400b-873f-70b3ed08cb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:23.650856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:23.669319 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1708/3392] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:23.676798 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1685/3393] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:23.677429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caecfb-f636-400b-873f-70b3ed08cb9e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:23.679085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1caecfb-f636-400b-873f-70b3ed08cb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:23.679575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8c6a2-4c12-4a88-b6be-b19bea84962f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:23.679866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8c6a2-4c12-4a88-b6be-b19bea84962f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:23.680143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8c6a2-4c12-4a88-b6be-b19bea84962f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:23.763422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-05d8c6a2-4c12-4a88-b6be-b19bea84962f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:23.767447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-05d8c6a2-4c12-4a88-b6be-b19bea84962f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:23.778523 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1686/3394] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:23.782609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caecfb-f636-400b-873f-70b3ed08cb9e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:23.785583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8c6a2-4c12-4a88-b6be-b19bea84962f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:23.786993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a494d7f-34ca-4cb2-8c0b-7a5720916638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:23.792015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a494d7f-34ca-4cb2-8c0b-7a5720916638 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:23.792304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a494d7f-34ca-4cb2-8c0b-7a5720916638 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:23.792583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a494d7f-34ca-4cb2-8c0b-7a5720916638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:23.802065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8c6a2-4c12-4a88-b6be-b19bea84962f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:23.807230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a6c90-de6f-4e04-8f0c-97dd99ef01dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:23.808776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a6c90-de6f-4e04-8f0c-97dd99ef01dd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:23.809138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a6c90-de6f-4e04-8f0c-97dd99ef01dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:23.809477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a6c90-de6f-4e04-8f0c-97dd99ef01dd admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:23.810276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a6c90-de6f-4e04-8f0c-97dd99ef01dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:30:23.810642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a6c90-de6f-4e04-8f0c-97dd99ef01dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:23.812055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a494d7f-34ca-4cb2-8c0b-7a5720916638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:23.812651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a6c90-de6f-4e04-8f0c-97dd99ef01dd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:23.814819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a494d7f-34ca-4cb2-8c0b-7a5720916638 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:23.825824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:23.833271 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1709/3395] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:23.855069 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1687/3396] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:23.857583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a494d7f-34ca-4cb2-8c0b-7a5720916638 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:23.871124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a494d7f-34ca-4cb2-8c0b-7a5720916638 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:23.879741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791be71a-8071-4782-a438-4c87ca246cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:23.880800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791be71a-8071-4782-a438-4c87ca246cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:23.881332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791be71a-8071-4782-a438-4c87ca246cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:23.882064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791be71a-8071-4782-a438-4c87ca246cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:23.883807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791be71a-8071-4782-a438-4c87ca246cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:23.886469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791be71a-8071-4782-a438-4c87ca246cd4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:23.933586 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1710/3397] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:30:23 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:30:23.937805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a6c90-de6f-4e04-8f0c-97dd99ef01dd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:23.954046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a6c90-de6f-4e04-8f0c-97dd99ef01dd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:24.106759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77897c-7c03-4821-8da6-ee8d7952d80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:24.107868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77897c-7c03-4821-8da6-ee8d7952d80b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:24.108328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77897c-7c03-4821-8da6-ee8d7952d80b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:24.108770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77897c-7c03-4821-8da6-ee8d7952d80b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:24.109575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77897c-7c03-4821-8da6-ee8d7952d80b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:24.111782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77897c-7c03-4821-8da6-ee8d7952d80b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:24.146593 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1688/3398] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:30:23 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:30:24.152330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791be71a-8071-4782-a438-4c87ca246cd4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:24.163374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791be71a-8071-4782-a438-4c87ca246cd4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:24.170960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48342fe4-bcc7-484a-a23e-dbcd4380c5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:24.171662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48342fe4-bcc7-484a-a23e-dbcd4380c5ed admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:24.174627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48342fe4-bcc7-484a-a23e-dbcd4380c5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:24.174916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48342fe4-bcc7-484a-a23e-dbcd4380c5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:24.175624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48342fe4-bcc7-484a-a23e-dbcd4380c5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:24.187724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48342fe4-bcc7-484a-a23e-dbcd4380c5ed admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:24.200229 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1711/3399] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:24.204641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77897c-7c03-4821-8da6-ee8d7952d80b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:24.221339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77897c-7c03-4821-8da6-ee8d7952d80b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:24.228680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd483e6-7d97-4c2b-9a71-31c7552781e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:24.229788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd483e6-7d97-4c2b-9a71-31c7552781e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:24.230289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd483e6-7d97-4c2b-9a71-31c7552781e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:24.230666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd483e6-7d97-4c2b-9a71-31c7552781e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:24.232635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd483e6-7d97-4c2b-9a71-31c7552781e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:24.234764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd483e6-7d97-4c2b-9a71-31c7552781e3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:24.253568 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1689/3400] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:24.254475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48342fe4-bcc7-484a-a23e-dbcd4380c5ed admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:24.272232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48342fe4-bcc7-484a-a23e-dbcd4380c5ed admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:24.282284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d9ab7-bae2-4644-a303-f8989934856e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:24.283865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d9ab7-bae2-4644-a303-f8989934856e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:24.284422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d9ab7-bae2-4644-a303-f8989934856e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:24.285976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d9ab7-bae2-4644-a303-f8989934856e admin admin] PATH_INFO: `/v3/projects/097cef0f05b1495087d456993c6bdf61/users/43e94ef43f754d8582e2f1ba2f4fe2b1/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:24.309988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d9ab7-bae2-4644-a303-f8989934856e admin admin] RBAC: Authorizing `identity:create_grant(project_id=097cef0f05b1495087d456993c6bdf61, user_id=43e94ef43f754d8582e2f1ba2f4fe2b1, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:24.313402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d9ab7-bae2-4644-a303-f8989934856e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:24.346063 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1712/3401] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:30:24 2022] PUT /identity/v3/projects/097cef0f05b1495087d456993c6bdf61/users/43e94ef43f754d8582e2f1ba2f4fe2b1/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:24.359095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0089c5c-3d09-4a32-a993-656d9fdf3c56 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:24.359417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0089c5c-3d09-4a32-a993-656d9fdf3c56 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:24.359698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0089c5c-3d09-4a32-a993-656d9fdf3c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:24.397938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e0089c5c-3d09-4a32-a993-656d9fdf3c56 None None] MFA Rules not processed for user `43e94ef43f754d8582e2f1ba2f4fe2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:24.402571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e0089c5c-3d09-4a32-a993-656d9fdf3c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:24.477212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d9ab7-bae2-4644-a303-f8989934856e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:24.480222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-448d9ab7-bae2-4644-a303-f8989934856e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:24.532818 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1690/3402] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:24.537263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0089c5c-3d09-4a32-a993-656d9fdf3c56 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:24.599812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d9ab7-bae2-4644-a303-f8989934856e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:24.604845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52111d6-0a2e-4ad5-8db5-26133d5f84b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:24.605553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52111d6-0a2e-4ad5-8db5-26133d5f84b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:24.606344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52111d6-0a2e-4ad5-8db5-26133d5f84b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:24.606695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52111d6-0a2e-4ad5-8db5-26133d5f84b2 admin admin] PATH_INFO: `/v3/projects/25ef0b8daf8446a3bb1bf5599c60b9dd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:24.608010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52111d6-0a2e-4ad5-8db5-26133d5f84b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25ef0b8daf8446a3bb1bf5599c60b9dd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:24.610411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52111d6-0a2e-4ad5-8db5-26133d5f84b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:24.631756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0089c5c-3d09-4a32-a993-656d9fdf3c56 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:24.637833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db233ec-c2c2-4526-a60d-2ca92f1fa75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:24.638548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db233ec-c2c2-4526-a60d-2ca92f1fa75e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:24.638835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db233ec-c2c2-4526-a60d-2ca92f1fa75e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:24.639247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db233ec-c2c2-4526-a60d-2ca92f1fa75e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:24.640337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db233ec-c2c2-4526-a60d-2ca92f1fa75e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:24.642347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db233ec-c2c2-4526-a60d-2ca92f1fa75e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:24.661459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:24.676377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:24.680773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c52111d6-0a2e-4ad5-8db5-26133d5f84b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25ef0b8daf8446a3bb1bf5599c60b9dd', 'request_id': 'req-c52111d6-0a2e-4ad5-8db5-26133d5f84b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:24.681674 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1691/3403] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:30:24 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:30:24.686208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db233ec-c2c2-4526-a60d-2ca92f1fa75e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:24.694434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c52111d6-0a2e-4ad5-8db5-26133d5f84b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25ef0b8daf8446a3bb1bf5599c60b9dd', 'request_id': 'req-c52111d6-0a2e-4ad5-8db5-26133d5f84b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:24.701762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c52111d6-0a2e-4ad5-8db5-26133d5f84b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25ef0b8daf8446a3bb1bf5599c60b9dd', 'request_id': 'req-c52111d6-0a2e-4ad5-8db5-26133d5f84b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:24.714664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c52111d6-0a2e-4ad5-8db5-26133d5f84b2 admin admin] The token cache is being invalidate because project 25ef0b8daf8446a3bb1bf5599c60b9dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:30:24.715070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c52111d6-0a2e-4ad5-8db5-26133d5f84b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:24.715886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c52111d6-0a2e-4ad5-8db5-26133d5f84b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:24.721680 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1713/3404] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:30:24 2022] DELETE /identity/v3/projects/25ef0b8daf8446a3bb1bf5599c60b9dd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:24.723342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d8d10-1dd9-4ed5-97cb-c909981e8e99 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:24.723706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d8d10-1dd9-4ed5-97cb-c909981e8e99 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:24.724043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d8d10-1dd9-4ed5-97cb-c909981e8e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:24.746185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-423d8d10-1dd9-4ed5-97cb-c909981e8e99 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:24.747690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-423d8d10-1dd9-4ed5-97cb-c909981e8e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:24.771860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db233ec-c2c2-4526-a60d-2ca92f1fa75e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:24.776869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136bfc4-6f60-456c-84c1-e7652ea9c753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:24.777501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136bfc4-6f60-456c-84c1-e7652ea9c753 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:24.777786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136bfc4-6f60-456c-84c1-e7652ea9c753 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:24.778123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136bfc4-6f60-456c-84c1-e7652ea9c753 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:24.778855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136bfc4-6f60-456c-84c1-e7652ea9c753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:24.780955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136bfc4-6f60-456c-84c1-e7652ea9c753 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:24.809206 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1692/3405] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:30:24 2022] POST /identity/v3/users => generated 298 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:30:24.810458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136bfc4-6f60-456c-84c1-e7652ea9c753 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:24.813386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2136bfc4-6f60-456c-84c1-e7652ea9c753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:24.833028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136bfc4-6f60-456c-84c1-e7652ea9c753 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:24.852263 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1714/3406] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:24.852435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b9d39-4e78-471d-a831-0fc069b4929a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:24.852435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b9d39-4e78-471d-a831-0fc069b4929a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:24.852435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b9d39-4e78-471d-a831-0fc069b4929a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:24.852435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b9d39-4e78-471d-a831-0fc069b4929a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:24.852807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b9d39-4e78-471d-a831-0fc069b4929a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:24.852807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b9d39-4e78-471d-a831-0fc069b4929a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:24.853756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d01ab6-ae1b-49e2-95a3-4df52699ef11 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:24.854145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d01ab6-ae1b-49e2-95a3-4df52699ef11 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:24.854532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d01ab6-ae1b-49e2-95a3-4df52699ef11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:24.870679 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1693/3407] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:24.870679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a06b06-bc60-4851-bc61-7627bae19546 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:24.870679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a06b06-bc60-4851-bc61-7627bae19546 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:24.870679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a06b06-bc60-4851-bc61-7627bae19546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:24.876495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-35d01ab6-ae1b-49e2-95a3-4df52699ef11 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:24.877760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-35d01ab6-ae1b-49e2-95a3-4df52699ef11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:24.886074 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1715/3408] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:30:24.886860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d01ab6-ae1b-49e2-95a3-4df52699ef11 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:24.889495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-44a06b06-bc60-4851-bc61-7627bae19546 None None] MFA Rules not processed for user `47aab8bfff21443891308d80f7059b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:24.890769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-44a06b06-bc60-4851-bc61-7627bae19546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:24.896936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d01ab6-ae1b-49e2-95a3-4df52699ef11 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:24.901849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a92dc-0479-4910-8b56-579b55bb7d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:24.902590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a92dc-0479-4910-8b56-579b55bb7d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:24.902910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a92dc-0479-4910-8b56-579b55bb7d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:24.903177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a92dc-0479-4910-8b56-579b55bb7d23 admin admin] PATH_INFO: `/v3/projects/29fa5a6f20914dc595e26edf21c2e9c7/users/e7dd76661b3a4fac9d19b0eb7a3c867e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:24.919654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a92dc-0479-4910-8b56-579b55bb7d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29fa5a6f20914dc595e26edf21c2e9c7, user_id=e7dd76661b3a4fac9d19b0eb7a3c867e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:24.922418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a92dc-0479-4910-8b56-579b55bb7d23 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:24.937610 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1716/3409] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:30:24 2022] PUT /identity/v3/projects/29fa5a6f20914dc595e26edf21c2e9c7/users/e7dd76661b3a4fac9d19b0eb7a3c867e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:24.938135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a92dc-0479-4910-8b56-579b55bb7d23 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:24.949693 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1694/3410] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:24.950739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a06b06-bc60-4851-bc61-7627bae19546 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:24.961080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a06b06-bc60-4851-bc61-7627bae19546 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:25.015721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a92dc-0479-4910-8b56-579b55bb7d23 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:25.020632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f57a0f-265c-45e0-b8d5-02102064e1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:25.021247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f57a0f-265c-45e0-b8d5-02102064e1dd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:25.021583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f57a0f-265c-45e0-b8d5-02102064e1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:25.021862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f57a0f-265c-45e0-b8d5-02102064e1dd admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:25.022516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f57a0f-265c-45e0-b8d5-02102064e1dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:30:25.022820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f57a0f-265c-45e0-b8d5-02102064e1dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:25.024969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f57a0f-265c-45e0-b8d5-02102064e1dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:25.027661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9d8f0-23be-4f59-a61a-8cbc15c8aa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:25.028905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9d8f0-23be-4f59-a61a-8cbc15c8aa5b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:25.029168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9d8f0-23be-4f59-a61a-8cbc15c8aa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:25.029487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9d8f0-23be-4f59-a61a-8cbc15c8aa5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:25.030830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9d8f0-23be-4f59-a61a-8cbc15c8aa5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:25.032531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9d8f0-23be-4f59-a61a-8cbc15c8aa5b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:25.039970 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1717/3411] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:25.044541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f57a0f-265c-45e0-b8d5-02102064e1dd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:25.051346 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1695/3412] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:25.053547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9d8f0-23be-4f59-a61a-8cbc15c8aa5b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:25.055570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f57a0f-265c-45e0-b8d5-02102064e1dd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:25.060658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130067f9-2ab1-417d-86ee-fa45eb478963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:25.061351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130067f9-2ab1-417d-86ee-fa45eb478963 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:25.061728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130067f9-2ab1-417d-86ee-fa45eb478963 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:25.062201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130067f9-2ab1-417d-86ee-fa45eb478963 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:25.063025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130067f9-2ab1-417d-86ee-fa45eb478963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:25.065093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9d8f0-23be-4f59-a61a-8cbc15c8aa5b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:25.065242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130067f9-2ab1-417d-86ee-fa45eb478963 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:25.072691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaede5a-f64c-482f-8ec4-50574cd432c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:25.073441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaede5a-f64c-482f-8ec4-50574cd432c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:25.073823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaede5a-f64c-482f-8ec4-50574cd432c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:25.074197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaede5a-f64c-482f-8ec4-50574cd432c9 admin admin] PATH_INFO: `/v3/projects/29fa5a6f20914dc595e26edf21c2e9c7/users/e7dd76661b3a4fac9d19b0eb7a3c867e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:25.076315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaede5a-f64c-482f-8ec4-50574cd432c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29fa5a6f20914dc595e26edf21c2e9c7, user_id=e7dd76661b3a4fac9d19b0eb7a3c867e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:25.079447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaede5a-f64c-482f-8ec4-50574cd432c9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:25.088884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:25.094104 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1696/3413] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:30:25 2022] PUT /identity/v3/projects/29fa5a6f20914dc595e26edf21c2e9c7/users/e7dd76661b3a4fac9d19b0eb7a3c867e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:30:25.105122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a67306-3e25-422e-a69a-49d74fb9d5fc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:25.105351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a67306-3e25-422e-a69a-49d74fb9d5fc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:25.106296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a67306-3e25-422e-a69a-49d74fb9d5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:25.118238 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1718/3414] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:30:25 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:30:25.119645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130067f9-2ab1-417d-86ee-fa45eb478963 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:25.141990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:25.153855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f6a67306-3e25-422e-a69a-49d74fb9d5fc None None] MFA Rules not processed for user `e7dd76661b3a4fac9d19b0eb7a3c867e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:25.155281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f6a67306-3e25-422e-a69a-49d74fb9d5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:25.207975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130067f9-2ab1-417d-86ee-fa45eb478963 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:25.214451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79507636-a8ad-4ac4-8a87-712e8894b137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:25.215154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79507636-a8ad-4ac4-8a87-712e8894b137 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:25.216365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79507636-a8ad-4ac4-8a87-712e8894b137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:25.216722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79507636-a8ad-4ac4-8a87-712e8894b137 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:25.217443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79507636-a8ad-4ac4-8a87-712e8894b137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:25.220554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79507636-a8ad-4ac4-8a87-712e8894b137 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:25.246897 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1719/3415] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:30:25 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:30:25.251599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79507636-a8ad-4ac4-8a87-712e8894b137 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:25.260135 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1697/3416] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:30:25.264459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79507636-a8ad-4ac4-8a87-712e8894b137 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:25.269608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a531a-0a6d-4254-b024-256a97f0e83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:25.270415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a531a-0a6d-4254-b024-256a97f0e83c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:25.270760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a531a-0a6d-4254-b024-256a97f0e83c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:25.271380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a531a-0a6d-4254-b024-256a97f0e83c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:25.271723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a67306-3e25-422e-a69a-49d74fb9d5fc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:25.272251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a531a-0a6d-4254-b024-256a97f0e83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:25.273932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a531a-0a6d-4254-b024-256a97f0e83c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:25.274181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f6a67306-3e25-422e-a69a-49d74fb9d5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:25.290321 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1720/3417] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:25.291360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a531a-0a6d-4254-b024-256a97f0e83c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:25.305437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a531a-0a6d-4254-b024-256a97f0e83c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:25.311022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d822541-890f-489e-b417-d7a9fcf8de08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:25.312268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d822541-890f-489e-b417-d7a9fcf8de08 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:25.312745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d822541-890f-489e-b417-d7a9fcf8de08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:25.312937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d822541-890f-489e-b417-d7a9fcf8de08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:25.313675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d822541-890f-489e-b417-d7a9fcf8de08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:25.315807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d822541-890f-489e-b417-d7a9fcf8de08 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:25.328209 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1721/3418] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:25.332640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d822541-890f-489e-b417-d7a9fcf8de08 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:25.343079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d822541-890f-489e-b417-d7a9fcf8de08 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:25.348621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacff36b-a220-40ed-a709-bcf7828e9ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:25.349373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacff36b-a220-40ed-a709-bcf7828e9ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:25.349828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacff36b-a220-40ed-a709-bcf7828e9ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:25.350174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacff36b-a220-40ed-a709-bcf7828e9ff8 admin admin] PATH_INFO: `/v3/projects/9a3ccba61a1d4093a5b38e3f33e90438/users/ae5af1a94df34233a30b106608ed0564/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:25.373018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacff36b-a220-40ed-a709-bcf7828e9ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a3ccba61a1d4093a5b38e3f33e90438, user_id=ae5af1a94df34233a30b106608ed0564, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:25.375920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacff36b-a220-40ed-a709-bcf7828e9ff8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:25.378138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a67306-3e25-422e-a69a-49d74fb9d5fc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:25.393312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924a250-902e-41b2-b645-f3895e06fda9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:25.393946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924a250-902e-41b2-b645-f3895e06fda9 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:25.394234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924a250-902e-41b2-b645-f3895e06fda9 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:25.394510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924a250-902e-41b2-b645-f3895e06fda9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:25.399885 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1722/3419] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:30:25 2022] PUT /identity/v3/projects/9a3ccba61a1d4093a5b38e3f33e90438/users/ae5af1a94df34233a30b106608ed0564/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:25.406936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcb4a3-59e8-4cdb-8f29-53d67360a523 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:25.408764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcb4a3-59e8-4cdb-8f29-53d67360a523 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:25.409155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcb4a3-59e8-4cdb-8f29-53d67360a523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:25.410973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924a250-902e-41b2-b645-f3895e06fda9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:25.412977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924a250-902e-41b2-b645-f3895e06fda9 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:25.443308 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1698/3420] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:25.449610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32606ae5-aafa-4689-bc33-177020b6b51c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:25.450004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32606ae5-aafa-4689-bc33-177020b6b51c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:25.450262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32606ae5-aafa-4689-bc33-177020b6b51c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:25.452144 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1699/3421] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:30:25.457510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32606ae5-aafa-4689-bc33-177020b6b51c None None] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:30:25.462213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4cdcb4a3-59e8-4cdb-8f29-53d67360a523 None None] MFA Rules not processed for user `ae5af1a94df34233a30b106608ed0564`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:25.463580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4cdcb4a3-59e8-4cdb-8f29-53d67360a523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:25.550155 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1723/3422] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:30:25.592901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32606ae5-aafa-4689-bc33-177020b6b51c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:25.598070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:25.677534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32606ae5-aafa-4689-bc33-177020b6b51c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:25.687415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48709cae-6cf0-4ba2-8c9d-56baac601ddf tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd76661b3a4fac9d19b0eb7a3c867e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29fa5a6f20914dc595e26edf21c2e9c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:25.688077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48709cae-6cf0-4ba2-8c9d-56baac601ddf tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:25.688354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48709cae-6cf0-4ba2-8c9d-56baac601ddf tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:25.688688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48709cae-6cf0-4ba2-8c9d-56baac601ddf tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] PATH_INFO: `/v3/projects/097cef0f05b1495087d456993c6bdf61` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:25.689947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48709cae-6cf0-4ba2-8c9d-56baac601ddf tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorizing `identity:get_project(project_id=097cef0f05b1495087d456993c6bdf61)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:25.692364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48709cae-6cf0-4ba2-8c9d-56baac601ddf tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:25.694424 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1700/3423] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:30:25 2022] GET /identity/v3/projects/097cef0f05b1495087d456993c6bdf61 => generated 383 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:25.905170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcb4a3-59e8-4cdb-8f29-53d67360a523 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:25.906739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4cdcb4a3-59e8-4cdb-8f29-53d67360a523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:25.925119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcb4a3-59e8-4cdb-8f29-53d67360a523 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:25.931791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69390ff0-4615-4ba7-bf96-6eaae9735597 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:25.932410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69390ff0-4615-4ba7-bf96-6eaae9735597 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:25.932785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69390ff0-4615-4ba7-bf96-6eaae9735597 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:25.933321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69390ff0-4615-4ba7-bf96-6eaae9735597 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:25.942402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69390ff0-4615-4ba7-bf96-6eaae9735597 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:25.944131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69390ff0-4615-4ba7-bf96-6eaae9735597 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:25.972172 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1724/3424] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:26.069548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed19c6a-18c2-4879-9627-82bb66d952e1 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:26.069903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed19c6a-18c2-4879-9627-82bb66d952e1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:26.070265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed19c6a-18c2-4879-9627-82bb66d952e1 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:26.071927 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1701/3425] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:30:26.077709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69390ff0-4615-4ba7-bf96-6eaae9735597 service nova] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:30:26.098552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69390ff0-4615-4ba7-bf96-6eaae9735597 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:26.112468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69390ff0-4615-4ba7-bf96-6eaae9735597 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:26.122244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851e58c-628c-4427-9bbb-b0661f73835e tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd76661b3a4fac9d19b0eb7a3c867e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29fa5a6f20914dc595e26edf21c2e9c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:26.122971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851e58c-628c-4427-9bbb-b0661f73835e tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:26.123356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851e58c-628c-4427-9bbb-b0661f73835e tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:26.123639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851e58c-628c-4427-9bbb-b0661f73835e tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] PATH_INFO: `/v3/projects/097cef0f05b1495087d456993c6bdf61` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:26.125359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851e58c-628c-4427-9bbb-b0661f73835e tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorizing `identity:get_project(project_id=097cef0f05b1495087d456993c6bdf61)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:26.128398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851e58c-628c-4427-9bbb-b0661f73835e tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:26.131019 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1725/3426] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:30:26 2022] GET /identity/v3/projects/097cef0f05b1495087d456993c6bdf61 => generated 383 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:26.233591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74297ef5-eb6f-43fb-8bd7-e7db1c72cc51 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:26.233818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74297ef5-eb6f-43fb-8bd7-e7db1c72cc51 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:26.234126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74297ef5-eb6f-43fb-8bd7-e7db1c72cc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:26.260610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851e58c-628c-4427-9bbb-b0661f73835e tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:26.269040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-74297ef5-eb6f-43fb-8bd7-e7db1c72cc51 None None] MFA Rules not processed for user `43e94ef43f754d8582e2f1ba2f4fe2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:26.270278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-74297ef5-eb6f-43fb-8bd7-e7db1c72cc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:26.296429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:26.380090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851e58c-628c-4427-9bbb-b0661f73835e tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:26.394195 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1702/3427] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:26.400500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b7fe8-7992-46f5-ae7c-1916f41cd335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:26.401470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b7fe8-7992-46f5-ae7c-1916f41cd335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:26.401758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b7fe8-7992-46f5-ae7c-1916f41cd335 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:26.402075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b7fe8-7992-46f5-ae7c-1916f41cd335 admin admin] PATH_INFO: `/v3/users/ae5af1a94df34233a30b106608ed0564` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:26.403852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b7fe8-7992-46f5-ae7c-1916f41cd335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae5af1a94df34233a30b106608ed0564)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:26.406273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b7fe8-7992-46f5-ae7c-1916f41cd335 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:26.409523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74297ef5-eb6f-43fb-8bd7-e7db1c72cc51 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:26.424667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74297ef5-eb6f-43fb-8bd7-e7db1c72cc51 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:26.431349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bb384-dc78-4e87-b3ff-92e443d0ad6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:26.432317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bb384-dc78-4e87-b3ff-92e443d0ad6a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:26.432603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bb384-dc78-4e87-b3ff-92e443d0ad6a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:26.432874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bb384-dc78-4e87-b3ff-92e443d0ad6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:26.436894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-519bb384-dc78-4e87-b3ff-92e443d0ad6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:26.453833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bb384-dc78-4e87-b3ff-92e443d0ad6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:26.459464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bb384-dc78-4e87-b3ff-92e443d0ad6a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:26.470640 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1703/3428] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:26.476940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-748b7fe8-7992-46f5-ae7c-1916f41cd335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae5af1a94df34233a30b106608ed0564'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:26.477635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-748b7fe8-7992-46f5-ae7c-1916f41cd335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae5af1a94df34233a30b106608ed0564'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:26.486394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-748b7fe8-7992-46f5-ae7c-1916f41cd335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae5af1a94df34233a30b106608ed0564'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:26.496407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-748b7fe8-7992-46f5-ae7c-1916f41cd335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae5af1a94df34233a30b106608ed0564'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:26.516000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-748b7fe8-7992-46f5-ae7c-1916f41cd335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae5af1a94df34233a30b106608ed0564'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:26.526095 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1726/3429] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:30:26 2022] DELETE /identity/v3/users/ae5af1a94df34233a30b106608ed0564 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:30:26.530944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f51471-eaa8-41a2-8b5a-7b5b6676ab3f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:26.531547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f51471-eaa8-41a2-8b5a-7b5b6676ab3f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:26.532087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f51471-eaa8-41a2-8b5a-7b5b6676ab3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:26.573352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e3f51471-eaa8-41a2-8b5a-7b5b6676ab3f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:26.574734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e3f51471-eaa8-41a2-8b5a-7b5b6676ab3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:26.664232 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1704/3430] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:26.673990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b7fe8-7992-46f5-ae7c-1916f41cd335 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:26.676248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-748b7fe8-7992-46f5-ae7c-1916f41cd335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:26.774298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b7fe8-7992-46f5-ae7c-1916f41cd335 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:26.780976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed84db5-557d-4200-83f2-9e62e076fff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:26.781804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed84db5-557d-4200-83f2-9e62e076fff7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:26.782088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed84db5-557d-4200-83f2-9e62e076fff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:26.782363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed84db5-557d-4200-83f2-9e62e076fff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:26.797715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed84db5-557d-4200-83f2-9e62e076fff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:26.799874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed84db5-557d-4200-83f2-9e62e076fff7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:26.811785 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1727/3431] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:27.206003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71126b-e780-4d43-a0f9-772b6f92a44c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:27.206295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71126b-e780-4d43-a0f9-772b6f92a44c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:27.206574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71126b-e780-4d43-a0f9-772b6f92a44c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:27.208258 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1705/3432] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:30:27.213505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed84db5-557d-4200-83f2-9e62e076fff7 service neutron] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:30:27.215109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3ed84db5-557d-4200-83f2-9e62e076fff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:27.286048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:27.323664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed84db5-557d-4200-83f2-9e62e076fff7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:27.326332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3ed84db5-557d-4200-83f2-9e62e076fff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:27.433318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed84db5-557d-4200-83f2-9e62e076fff7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:27.440463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c4fdd-13b8-47e4-b6e2-ef28692a1a80 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd76661b3a4fac9d19b0eb7a3c867e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29fa5a6f20914dc595e26edf21c2e9c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:27.441458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c4fdd-13b8-47e4-b6e2-ef28692a1a80 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:27.441797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c4fdd-13b8-47e4-b6e2-ef28692a1a80 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:27.442107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c4fdd-13b8-47e4-b6e2-ef28692a1a80 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] PATH_INFO: `/v3/projects/097cef0f05b1495087d456993c6bdf61` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:27.443747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c4fdd-13b8-47e4-b6e2-ef28692a1a80 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorizing `identity:get_project(project_id=097cef0f05b1495087d456993c6bdf61)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:27.446504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c4fdd-13b8-47e4-b6e2-ef28692a1a80 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:27.448795 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1728/3433] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:30:27 2022] GET /identity/v3/projects/097cef0f05b1495087d456993c6bdf61 => generated 383 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:27.494610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71126b-e780-4d43-a0f9-772b6f92a44c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:27.496386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0f71126b-e780-4d43-a0f9-772b6f92a44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:27.535634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71126b-e780-4d43-a0f9-772b6f92a44c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:27.550459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6348e-c2d2-4bd1-b424-b20ea8f357ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:27.551092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6348e-c2d2-4bd1-b424-b20ea8f357ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:27.551473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6348e-c2d2-4bd1-b424-b20ea8f357ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:27.551727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6348e-c2d2-4bd1-b424-b20ea8f357ac admin admin] PATH_INFO: `/v3/projects/9a3ccba61a1d4093a5b38e3f33e90438` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:27.556413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6348e-c2d2-4bd1-b424-b20ea8f357ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a3ccba61a1d4093a5b38e3f33e90438)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:27.560048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6348e-c2d2-4bd1-b424-b20ea8f357ac admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:27.654241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:27.659423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406f0a0-ea69-40af-9412-8dffcd838f32 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:27.659715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406f0a0-ea69-40af-9412-8dffcd838f32 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:27.659994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406f0a0-ea69-40af-9412-8dffcd838f32 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:27.661486 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1729/3434] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:30:27.666462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406f0a0-ea69-40af-9412-8dffcd838f32 None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:30:27.672388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0dc6348e-c2d2-4bd1-b424-b20ea8f357ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a3ccba61a1d4093a5b38e3f33e90438', 'request_id': 'req-0dc6348e-c2d2-4bd1-b424-b20ea8f357ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:27.681090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0dc6348e-c2d2-4bd1-b424-b20ea8f357ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a3ccba61a1d4093a5b38e3f33e90438', 'request_id': 'req-0dc6348e-c2d2-4bd1-b424-b20ea8f357ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:27.688267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0dc6348e-c2d2-4bd1-b424-b20ea8f357ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a3ccba61a1d4093a5b38e3f33e90438', 'request_id': 'req-0dc6348e-c2d2-4bd1-b424-b20ea8f357ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:27.713134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0dc6348e-c2d2-4bd1-b424-b20ea8f357ac admin admin] The token cache is being invalidate because project 9a3ccba61a1d4093a5b38e3f33e90438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:30:27.713942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0dc6348e-c2d2-4bd1-b424-b20ea8f357ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:27.714809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0dc6348e-c2d2-4bd1-b424-b20ea8f357ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:27.718492 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1706/3435] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:30:27 2022] DELETE /identity/v3/projects/9a3ccba61a1d4093a5b38e3f33e90438 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:27.723226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c978b1-585d-4bfc-b937-0b85d6aa5ea4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:27.723682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c978b1-585d-4bfc-b937-0b85d6aa5ea4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:27.724024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c978b1-585d-4bfc-b937-0b85d6aa5ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:27.756981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-84c978b1-585d-4bfc-b937-0b85d6aa5ea4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:27.758492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-84c978b1-585d-4bfc-b937-0b85d6aa5ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:27.812651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406f0a0-ea69-40af-9412-8dffcd838f32 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:27.838574 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1707/3436] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:27.847431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f142a8e-21a3-4e13-a360-f3dfc410e162 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:27.847873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f142a8e-21a3-4e13-a360-f3dfc410e162 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:27.848246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f142a8e-21a3-4e13-a360-f3dfc410e162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:27.877864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0f142a8e-21a3-4e13-a360-f3dfc410e162 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:27.879204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0f142a8e-21a3-4e13-a360-f3dfc410e162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:27.889161 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1708/3437] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:30:27.896246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f142a8e-21a3-4e13-a360-f3dfc410e162 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:27.919667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f142a8e-21a3-4e13-a360-f3dfc410e162 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:27.930593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d8dd6-4e1e-4754-997a-497ba4970aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:27.934261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d8dd6-4e1e-4754-997a-497ba4970aae admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:27.934261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d8dd6-4e1e-4754-997a-497ba4970aae admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:27.934681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d8dd6-4e1e-4754-997a-497ba4970aae admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:27.935465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d8dd6-4e1e-4754-997a-497ba4970aae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:30:27.935715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d8dd6-4e1e-4754-997a-497ba4970aae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:27.937339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d8dd6-4e1e-4754-997a-497ba4970aae admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:27.977212 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1709/3438] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:27.978128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d8dd6-4e1e-4754-997a-497ba4970aae admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:27.999499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406f0a0-ea69-40af-9412-8dffcd838f32 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:28.000612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d8dd6-4e1e-4754-997a-497ba4970aae admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:28.005840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09476823-c935-4140-a912-ef92ce739d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:28.006315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dad96f-991e-42bf-8b8a-2c6faabe2027 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd76661b3a4fac9d19b0eb7a3c867e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29fa5a6f20914dc595e26edf21c2e9c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:28.006475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09476823-c935-4140-a912-ef92ce739d27 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:28.006722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09476823-c935-4140-a912-ef92ce739d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:28.006957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dad96f-991e-42bf-8b8a-2c6faabe2027 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:28.007066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09476823-c935-4140-a912-ef92ce739d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:28.007237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dad96f-991e-42bf-8b8a-2c6faabe2027 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:28.007556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dad96f-991e-42bf-8b8a-2c6faabe2027 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] PATH_INFO: `/v3/projects/097cef0f05b1495087d456993c6bdf61` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:28.007664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09476823-c935-4140-a912-ef92ce739d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:28.008844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dad96f-991e-42bf-8b8a-2c6faabe2027 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorizing `identity:get_project(project_id=097cef0f05b1495087d456993c6bdf61)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:28.009629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09476823-c935-4140-a912-ef92ce739d27 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:28.011010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dad96f-991e-42bf-8b8a-2c6faabe2027 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:28.013217 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1730/3439] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:30:27 2022] GET /identity/v3/projects/097cef0f05b1495087d456993c6bdf61 => generated 383 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:30:28.076058 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1710/3440] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:30:27 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:30:28.081587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dad96f-991e-42bf-8b8a-2c6faabe2027 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:28.085164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b213b-6a92-442f-ab54-f0f0792e39de None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:28.085632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b213b-6a92-442f-ab54-f0f0792e39de None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:28.086369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b213b-6a92-442f-ab54-f0f0792e39de None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:28.089286 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1711/3441] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:30:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:30:28.100138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dad96f-991e-42bf-8b8a-2c6faabe2027 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:28.102992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b213b-6a92-442f-ab54-f0f0792e39de None None] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:30:28.106869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-da7b213b-6a92-442f-ab54-f0f0792e39de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:28.134293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:28.232836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e8a5d-94dc-47bd-bebb-58f232016cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:28.233277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e8a5d-94dc-47bd-bebb-58f232016cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:28.233556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e8a5d-94dc-47bd-bebb-58f232016cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:28.233830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e8a5d-94dc-47bd-bebb-58f232016cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:28.234572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e8a5d-94dc-47bd-bebb-58f232016cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:28.236680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e8a5d-94dc-47bd-bebb-58f232016cb9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:28.293426 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1731/3442] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:30:28 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:30:28.297265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e8a5d-94dc-47bd-bebb-58f232016cb9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:28.313524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e8a5d-94dc-47bd-bebb-58f232016cb9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:28.327660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cd70b-00d6-4601-82b6-9a79a3d85666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:28.328298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cd70b-00d6-4601-82b6-9a79a3d85666 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:28.328543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cd70b-00d6-4601-82b6-9a79a3d85666 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:28.334998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cd70b-00d6-4601-82b6-9a79a3d85666 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:28.336146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320cd70b-00d6-4601-82b6-9a79a3d85666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:28.337943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320cd70b-00d6-4601-82b6-9a79a3d85666 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:28.354923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b213b-6a92-442f-ab54-f0f0792e39de None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:28.357364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-da7b213b-6a92-442f-ab54-f0f0792e39de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:28.378494 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1732/3443] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:30:28.379588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:28.380084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cd70b-00d6-4601-82b6-9a79a3d85666 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:28.387393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-320cd70b-00d6-4601-82b6-9a79a3d85666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:28.492657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b213b-6a92-442f-ab54-f0f0792e39de None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:28.500411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7904c3-c577-4132-8c0d-e05ad82cd429 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd76661b3a4fac9d19b0eb7a3c867e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29fa5a6f20914dc595e26edf21c2e9c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:28.501789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7904c3-c577-4132-8c0d-e05ad82cd429 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:28.502249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7904c3-c577-4132-8c0d-e05ad82cd429 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:28.502670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7904c3-c577-4132-8c0d-e05ad82cd429 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] PATH_INFO: `/v3/projects/097cef0f05b1495087d456993c6bdf61` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:28.504795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7904c3-c577-4132-8c0d-e05ad82cd429 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorizing `identity:get_project(project_id=097cef0f05b1495087d456993c6bdf61)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:28.510009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7904c3-c577-4132-8c0d-e05ad82cd429 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:28.530657 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1712/3444] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:30:28 2022] GET /identity/v3/projects/097cef0f05b1495087d456993c6bdf61 => generated 383 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:28.534762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7904c3-c577-4132-8c0d-e05ad82cd429 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:28.544838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cd70b-00d6-4601-82b6-9a79a3d85666 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:28.551389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e233e1e-84a4-496c-9959-591e81b60fe4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:28.552416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e233e1e-84a4-496c-9959-591e81b60fe4 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:28.552851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e233e1e-84a4-496c-9959-591e81b60fe4 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:28.553220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e233e1e-84a4-496c-9959-591e81b60fe4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:28.561068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8e233e1e-84a4-496c-9959-591e81b60fe4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:28.575721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7904c3-c577-4132-8c0d-e05ad82cd429 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:28.588999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28e012-fa77-44e6-aa13-81bbefd0801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:28.589628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28e012-fa77-44e6-aa13-81bbefd0801d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:28.589904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28e012-fa77-44e6-aa13-81bbefd0801d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:28.590173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28e012-fa77-44e6-aa13-81bbefd0801d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:28.590875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28e012-fa77-44e6-aa13-81bbefd0801d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:28.603780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e233e1e-84a4-496c-9959-591e81b60fe4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:28.606245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28e012-fa77-44e6-aa13-81bbefd0801d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:28.616771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e233e1e-84a4-496c-9959-591e81b60fe4 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:28.645534 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1713/3445] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:28.659371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28e012-fa77-44e6-aa13-81bbefd0801d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:28.663233 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1733/3446] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:28.682793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28e012-fa77-44e6-aa13-81bbefd0801d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:28.690399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b703124-3702-4942-9d43-e4fa538f2405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:28.691655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b703124-3702-4942-9d43-e4fa538f2405 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:28.692281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b703124-3702-4942-9d43-e4fa538f2405 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:28.692741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b703124-3702-4942-9d43-e4fa538f2405 admin admin] PATH_INFO: `/v3/projects/377c7a06a76e455dbbb231bcb530694e/users/5859e51b852d4f6bad6c9371576203af/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:28.752939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07ad41-686b-4cd2-9300-00101b04abe0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:28.754158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07ad41-686b-4cd2-9300-00101b04abe0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:28.754834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07ad41-686b-4cd2-9300-00101b04abe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:28.755987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b703124-3702-4942-9d43-e4fa538f2405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=377c7a06a76e455dbbb231bcb530694e, user_id=5859e51b852d4f6bad6c9371576203af, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:28.780978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b703124-3702-4942-9d43-e4fa538f2405 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:28.810476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6a07ad41-686b-4cd2-9300-00101b04abe0 None None] MFA Rules not processed for user `43e94ef43f754d8582e2f1ba2f4fe2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:28.814930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a07ad41-686b-4cd2-9300-00101b04abe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:28.824587 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1714/3447] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:30:28 2022] PUT /identity/v3/projects/377c7a06a76e455dbbb231bcb530694e/users/5859e51b852d4f6bad6c9371576203af/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:28.838191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b703124-3702-4942-9d43-e4fa538f2405 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:28.841386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3b703124-3702-4942-9d43-e4fa538f2405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:28.945920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b703124-3702-4942-9d43-e4fa538f2405 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:28.951348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dcf4d-3dda-475d-ab12-931a3eecd4c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:28.952420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dcf4d-3dda-475d-ab12-931a3eecd4c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:28.953201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dcf4d-3dda-475d-ab12-931a3eecd4c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:28.953201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dcf4d-3dda-475d-ab12-931a3eecd4c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:28.956771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-294dcf4d-3dda-475d-ab12-931a3eecd4c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:28.982546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294dcf4d-3dda-475d-ab12-931a3eecd4c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:28.982546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294dcf4d-3dda-475d-ab12-931a3eecd4c4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:28.982811 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1734/3448] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:28.987454 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1715/3449] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:28.989226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e092dad-3cdd-4ce3-8616-6bd89507770a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:28.989226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e092dad-3cdd-4ce3-8616-6bd89507770a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:28.989407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e092dad-3cdd-4ce3-8616-6bd89507770a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:29.045289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6e092dad-3cdd-4ce3-8616-6bd89507770a None None] MFA Rules not processed for user `5859e51b852d4f6bad6c9371576203af`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:29.048575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e092dad-3cdd-4ce3-8616-6bd89507770a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:29.114454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:29.148873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e5a79-c67e-407c-9727-a0d26fbd0bde None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:29.149164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e5a79-c67e-407c-9727-a0d26fbd0bde None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:29.149446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e5a79-c67e-407c-9727-a0d26fbd0bde None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:29.152562 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1716/3450] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 18:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:30:29.160029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32807a3-da76-467d-8bcb-4bbd7bc8aeda None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:29.160518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32807a3-da76-467d-8bcb-4bbd7bc8aeda None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:29.161654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32807a3-da76-467d-8bcb-4bbd7bc8aeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:29.179953 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1735/3451] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:29.197664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a32807a3-da76-467d-8bcb-4bbd7bc8aeda None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:29.199614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a32807a3-da76-467d-8bcb-4bbd7bc8aeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:29.300906 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1717/3452] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 18:30:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:29.337386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e092dad-3cdd-4ce3-8616-6bd89507770a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:29.352040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e092dad-3cdd-4ce3-8616-6bd89507770a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:29.358718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b74bf-d1ab-4d74-a3b1-dba00d2fbffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:29.359384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b74bf-d1ab-4d74-a3b1-dba00d2fbffd service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:29.359663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b74bf-d1ab-4d74-a3b1-dba00d2fbffd service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:29.359932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b74bf-d1ab-4d74-a3b1-dba00d2fbffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:29.393625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b74bf-d1ab-4d74-a3b1-dba00d2fbffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:29.395129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b74bf-d1ab-4d74-a3b1-dba00d2fbffd service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:29.425350 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1736/3453] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:29.428183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32807a3-da76-467d-8bcb-4bbd7bc8aeda None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:29.450005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32807a3-da76-467d-8bcb-4bbd7bc8aeda None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:29.461611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dee9d4-eacb-4e9d-9c98-b13ae7855706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:29.462608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dee9d4-eacb-4e9d-9c98-b13ae7855706 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:29.462966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dee9d4-eacb-4e9d-9c98-b13ae7855706 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:29.463393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dee9d4-eacb-4e9d-9c98-b13ae7855706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:29.478818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dee9d4-eacb-4e9d-9c98-b13ae7855706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:29.481058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dee9d4-eacb-4e9d-9c98-b13ae7855706 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:29.492898 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1718/3454] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:29.961605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ec4fd-5510-471b-a4a3-d3c356184a86 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:29.961923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ec4fd-5510-471b-a4a3-d3c356184a86 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:29.962206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ec4fd-5510-471b-a4a3-d3c356184a86 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:29.965914 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1737/3455] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:30:29 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:30:29.972863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dee9d4-eacb-4e9d-9c98-b13ae7855706 service nova] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:30:29.976371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-34dee9d4-eacb-4e9d-9c98-b13ae7855706 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:30.003563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:30.011903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dee9d4-eacb-4e9d-9c98-b13ae7855706 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:30.176959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dee9d4-eacb-4e9d-9c98-b13ae7855706 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:30.189224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425a027-417c-4db8-9132-c9d3df777cbb tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd76661b3a4fac9d19b0eb7a3c867e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29fa5a6f20914dc595e26edf21c2e9c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:30.192808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425a027-417c-4db8-9132-c9d3df777cbb tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:30.192808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425a027-417c-4db8-9132-c9d3df777cbb tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:30.192808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425a027-417c-4db8-9132-c9d3df777cbb tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] PATH_INFO: `/v3/projects/097cef0f05b1495087d456993c6bdf61` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:30.195729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425a027-417c-4db8-9132-c9d3df777cbb tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorizing `identity:get_project(project_id=097cef0f05b1495087d456993c6bdf61)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:30.200174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425a027-417c-4db8-9132-c9d3df777cbb tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:30.222471 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1719/3456] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:30:29 2022] GET /identity/v3/projects/097cef0f05b1495087d456993c6bdf61 => generated 383 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:30:30.604419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec7f47-269a-48a9-8e2f-31cfebb88380 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:30.604932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec7f47-269a-48a9-8e2f-31cfebb88380 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:30.605043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec7f47-269a-48a9-8e2f-31cfebb88380 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:30.606721 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1738/3457] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:30:30.613921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425a027-417c-4db8-9132-c9d3df777cbb tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:30:30.635023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425a027-417c-4db8-9132-c9d3df777cbb tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:30.658816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425a027-417c-4db8-9132-c9d3df777cbb tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:30.664582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f2c10-158f-48fa-aa84-ee00d857e000 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd76661b3a4fac9d19b0eb7a3c867e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29fa5a6f20914dc595e26edf21c2e9c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:30.665342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f2c10-158f-48fa-aa84-ee00d857e000 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:30.665691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f2c10-158f-48fa-aa84-ee00d857e000 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:30.666027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f2c10-158f-48fa-aa84-ee00d857e000 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] PATH_INFO: `/v3/projects/097cef0f05b1495087d456993c6bdf61` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:30.677060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f2c10-158f-48fa-aa84-ee00d857e000 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorizing `identity:get_project(project_id=097cef0f05b1495087d456993c6bdf61)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:30.680013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f2c10-158f-48fa-aa84-ee00d857e000 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:30.693245 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1720/3458] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:30:30 2022] GET /identity/v3/projects/097cef0f05b1495087d456993c6bdf61 => generated 383 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:30.813409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec7f47-269a-48a9-8e2f-31cfebb88380 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:30.844327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec7f47-269a-48a9-8e2f-31cfebb88380 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:30.857510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb21821-7ed1-45a9-b06d-5437e58e0b2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:30.859471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb21821-7ed1-45a9-b06d-5437e58e0b2a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:30.862934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb21821-7ed1-45a9-b06d-5437e58e0b2a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:30.863506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb21821-7ed1-45a9-b06d-5437e58e0b2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:30.868983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5bb21821-7ed1-45a9-b06d-5437e58e0b2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:30.910737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb21821-7ed1-45a9-b06d-5437e58e0b2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:30.913386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb21821-7ed1-45a9-b06d-5437e58e0b2a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:30.957113 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1739/3459] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:31.120227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe40b0-773f-41a7-837b-16bdf8e9190b None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:31.120727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe40b0-773f-41a7-837b-16bdf8e9190b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:31.120810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe40b0-773f-41a7-837b-16bdf8e9190b None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:31.122512 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1721/3460] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:30:31.132336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb21821-7ed1-45a9-b06d-5437e58e0b2a service nova] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:30:31.208397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb21821-7ed1-45a9-b06d-5437e58e0b2a service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:31.229621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb21821-7ed1-45a9-b06d-5437e58e0b2a service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:31.241771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21083e-ddfc-4b41-9fea-96ee1b6b2e27 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd76661b3a4fac9d19b0eb7a3c867e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29fa5a6f20914dc595e26edf21c2e9c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:31.242430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21083e-ddfc-4b41-9fea-96ee1b6b2e27 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:31.242711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21083e-ddfc-4b41-9fea-96ee1b6b2e27 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:31.243156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21083e-ddfc-4b41-9fea-96ee1b6b2e27 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] PATH_INFO: `/v3/projects/097cef0f05b1495087d456993c6bdf61` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:31.244693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21083e-ddfc-4b41-9fea-96ee1b6b2e27 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorizing `identity:get_project(project_id=097cef0f05b1495087d456993c6bdf61)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:31.251096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21083e-ddfc-4b41-9fea-96ee1b6b2e27 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:31.256016 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1740/3461] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:30:31 2022] GET /identity/v3/projects/097cef0f05b1495087d456993c6bdf61 => generated 383 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:31.369884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b00a4-f706-48eb-adae-e300f040456a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:31.370650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b00a4-f706-48eb-adae-e300f040456a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:31.371409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b00a4-f706-48eb-adae-e300f040456a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:31.418792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fd2b00a4-f706-48eb-adae-e300f040456a None None] MFA Rules not processed for user `43e94ef43f754d8582e2f1ba2f4fe2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:31.423850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fd2b00a4-f706-48eb-adae-e300f040456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:31.449209 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1722/3462] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:32.135398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21083e-ddfc-4b41-9fea-96ee1b6b2e27 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:32.168639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558814f-bea7-418c-a0ea-da8fa9cde723 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:32.169583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558814f-bea7-418c-a0ea-da8fa9cde723 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:32.170065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558814f-bea7-418c-a0ea-da8fa9cde723 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:32.173081 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1723/3463] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:30:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:30:32.182560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558814f-bea7-418c-a0ea-da8fa9cde723 None None] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:30:32.210955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558814f-bea7-418c-a0ea-da8fa9cde723 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:32.231187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558814f-bea7-418c-a0ea-da8fa9cde723 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:32.240748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e4798-138e-4388-8f47-16aadfed63b9 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dd76661b3a4fac9d19b0eb7a3c867e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29fa5a6f20914dc595e26edf21c2e9c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:32.241786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e4798-138e-4388-8f47-16aadfed63b9 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:32.242756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e4798-138e-4388-8f47-16aadfed63b9 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:32.243282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e4798-138e-4388-8f47-16aadfed63b9 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] PATH_INFO: `/v3/projects/097cef0f05b1495087d456993c6bdf61` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:32.245134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e4798-138e-4388-8f47-16aadfed63b9 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorizing `identity:get_project(project_id=097cef0f05b1495087d456993c6bdf61)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:32.250260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e4798-138e-4388-8f47-16aadfed63b9 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:32.253520 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1724/3464] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:30:32 2022] GET /identity/v3/projects/097cef0f05b1495087d456993c6bdf61 => generated 383 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:32.268390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21083e-ddfc-4b41-9fea-96ee1b6b2e27 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:32.277060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3396c0e-2364-4304-a6e4-957c17a89d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:32.280173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3396c0e-2364-4304-a6e4-957c17a89d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:32.280669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3396c0e-2364-4304-a6e4-957c17a89d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:32.283427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3396c0e-2364-4304-a6e4-957c17a89d52 admin admin] PATH_INFO: `/v3/users/5859e51b852d4f6bad6c9371576203af` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:32.287572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3396c0e-2364-4304-a6e4-957c17a89d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5859e51b852d4f6bad6c9371576203af)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:32.290877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3396c0e-2364-4304-a6e4-957c17a89d52 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:32.383441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3396c0e-2364-4304-a6e4-957c17a89d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5859e51b852d4f6bad6c9371576203af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:32.384549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3396c0e-2364-4304-a6e4-957c17a89d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5859e51b852d4f6bad6c9371576203af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:32.398147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3396c0e-2364-4304-a6e4-957c17a89d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5859e51b852d4f6bad6c9371576203af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:32.427127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3396c0e-2364-4304-a6e4-957c17a89d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5859e51b852d4f6bad6c9371576203af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:32.451776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3396c0e-2364-4304-a6e4-957c17a89d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5859e51b852d4f6bad6c9371576203af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:32.474830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e4798-138e-4388-8f47-16aadfed63b9 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:32.476746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-df6e4798-138e-4388-8f47-16aadfed63b9 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:32.479835 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1741/3465] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:30:32 2022] DELETE /identity/v3/users/5859e51b852d4f6bad6c9371576203af => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:32.481627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de25c37-0a25-477c-80d4-7fd68a3d036e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:32.484668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de25c37-0a25-477c-80d4-7fd68a3d036e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:32.485383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de25c37-0a25-477c-80d4-7fd68a3d036e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:32.507225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e4798-138e-4388-8f47-16aadfed63b9 tempest-QuotasAdminNegativeTest-1923999324 tempest-QuotasAdminNegativeTest-1923999324-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:32.542303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3de25c37-0a25-477c-80d4-7fd68a3d036e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:32.547210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3de25c37-0a25-477c-80d4-7fd68a3d036e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:32.603191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:32.681182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480336d0-92f1-45bf-bc83-ab01844b4d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:32.681845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480336d0-92f1-45bf-bc83-ab01844b4d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:32.682208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480336d0-92f1-45bf-bc83-ab01844b4d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:32.682488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480336d0-92f1-45bf-bc83-ab01844b4d16 admin admin] PATH_INFO: `/v3/users/43e94ef43f754d8582e2f1ba2f4fe2b1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:32.684798 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1742/3466] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:32.687773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480336d0-92f1-45bf-bc83-ab01844b4d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e94ef43f754d8582e2f1ba2f4fe2b1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:32.689819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480336d0-92f1-45bf-bc83-ab01844b4d16 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:32.692752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de25c37-0a25-477c-80d4-7fd68a3d036e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:32.705102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3de25c37-0a25-477c-80d4-7fd68a3d036e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:32.811450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de25c37-0a25-477c-80d4-7fd68a3d036e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:32.821670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e08abe-b0d1-452c-b331-540ebd7b2d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:32.822457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e08abe-b0d1-452c-b331-540ebd7b2d94 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:32.822839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e08abe-b0d1-452c-b331-540ebd7b2d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:32.823137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-480336d0-92f1-45bf-bc83-ab01844b4d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e94ef43f754d8582e2f1ba2f4fe2b1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:32.823338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e08abe-b0d1-452c-b331-540ebd7b2d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:32.841544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e08abe-b0d1-452c-b331-540ebd7b2d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:32.843458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e08abe-b0d1-452c-b331-540ebd7b2d94 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:32.861149 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1743/3467] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:32.865614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d9412-88d4-49cc-814e-fd46051c6969 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:32.867612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d9412-88d4-49cc-814e-fd46051c6969 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:32.868047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d9412-88d4-49cc-814e-fd46051c6969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:32.873337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-480336d0-92f1-45bf-bc83-ab01844b4d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e94ef43f754d8582e2f1ba2f4fe2b1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:32.874986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-480336d0-92f1-45bf-bc83-ab01844b4d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e94ef43f754d8582e2f1ba2f4fe2b1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:32.876982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-480336d0-92f1-45bf-bc83-ab01844b4d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e94ef43f754d8582e2f1ba2f4fe2b1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:32.891566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-480336d0-92f1-45bf-bc83-ab01844b4d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e94ef43f754d8582e2f1ba2f4fe2b1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:32.894061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-110d9412-88d4-49cc-814e-fd46051c6969 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:32.895635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-110d9412-88d4-49cc-814e-fd46051c6969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:32.908889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:32.931607 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1725/3468] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:30:32 2022] DELETE /identity/v3/users/43e94ef43f754d8582e2f1ba2f4fe2b1 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:30:32.936588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e67e8-5f5f-411d-b6a2-0256fb03ccc8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:32.936920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e67e8-5f5f-411d-b6a2-0256fb03ccc8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:32.937210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e67e8-5f5f-411d-b6a2-0256fb03ccc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:32.981980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-976e67e8-5f5f-411d-b6a2-0256fb03ccc8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:32.983234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-976e67e8-5f5f-411d-b6a2-0256fb03ccc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:33.070843 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1744/3469] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:30:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:33.089005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d9412-88d4-49cc-814e-fd46051c6969 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:33.094078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-110d9412-88d4-49cc-814e-fd46051c6969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:33.140573 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1726/3470] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:33.158143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e67e8-5f5f-411d-b6a2-0256fb03ccc8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:33.164395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-976e67e8-5f5f-411d-b6a2-0256fb03ccc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:33.321019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d9412-88d4-49cc-814e-fd46051c6969 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:33.344184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:33.347134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e67e8-5f5f-411d-b6a2-0256fb03ccc8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:33.354546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe5a0c-6f38-4ca3-abc0-639a281495ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:33.356724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe5a0c-6f38-4ca3-abc0-639a281495ed service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:33.357269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe5a0c-6f38-4ca3-abc0-639a281495ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:33.357789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe5a0c-6f38-4ca3-abc0-639a281495ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:33.384681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe5a0c-6f38-4ca3-abc0-639a281495ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:33.388886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe5a0c-6f38-4ca3-abc0-639a281495ed service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:33.417619 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1727/3471] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:33.478794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdabec0-bc79-4d20-b0eb-e795c34c84c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:33.479495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdabec0-bc79-4d20-b0eb-e795c34c84c4 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:33.479782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdabec0-bc79-4d20-b0eb-e795c34c84c4 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:33.481071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdabec0-bc79-4d20-b0eb-e795c34c84c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:33.568415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdabec0-bc79-4d20-b0eb-e795c34c84c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:33.570297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdabec0-bc79-4d20-b0eb-e795c34c84c4 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:33.591211 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1745/3472] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:30:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:30:37.425664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe5a0c-6f38-4ca3-abc0-639a281495ed service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:37.427818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2dfe5a0c-6f38-4ca3-abc0-639a281495ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:37.474198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe5a0c-6f38-4ca3-abc0-639a281495ed service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:37.488510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bcc17-8048-4ec9-9d60-5b23da985e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:37.489164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bcc17-8048-4ec9-9d60-5b23da985e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:37.489683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bcc17-8048-4ec9-9d60-5b23da985e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:37.492455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bcc17-8048-4ec9-9d60-5b23da985e0d admin admin] PATH_INFO: `/v3/projects/377c7a06a76e455dbbb231bcb530694e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:37.502140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bcc17-8048-4ec9-9d60-5b23da985e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=377c7a06a76e455dbbb231bcb530694e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:37.505271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bcc17-8048-4ec9-9d60-5b23da985e0d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:37.768869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-963bcc17-8048-4ec9-9d60-5b23da985e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '377c7a06a76e455dbbb231bcb530694e', 'request_id': 'req-963bcc17-8048-4ec9-9d60-5b23da985e0d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:37.798338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-963bcc17-8048-4ec9-9d60-5b23da985e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '377c7a06a76e455dbbb231bcb530694e', 'request_id': 'req-963bcc17-8048-4ec9-9d60-5b23da985e0d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:37.835853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-963bcc17-8048-4ec9-9d60-5b23da985e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '377c7a06a76e455dbbb231bcb530694e', 'request_id': 'req-963bcc17-8048-4ec9-9d60-5b23da985e0d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:37.903299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-963bcc17-8048-4ec9-9d60-5b23da985e0d admin admin] The token cache is being invalidate because project 377c7a06a76e455dbbb231bcb530694e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:30:37.903808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-963bcc17-8048-4ec9-9d60-5b23da985e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:37.905472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-963bcc17-8048-4ec9-9d60-5b23da985e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:37.916218 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1728/3473] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:30:37 2022] DELETE /identity/v3/projects/377c7a06a76e455dbbb231bcb530694e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:37.917022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db23d74-d67b-4010-b7e7-42f2d3205f7b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:37.917477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db23d74-d67b-4010-b7e7-42f2d3205f7b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:37.917582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db23d74-d67b-4010-b7e7-42f2d3205f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:37.958888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1db23d74-d67b-4010-b7e7-42f2d3205f7b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:37.960222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1db23d74-d67b-4010-b7e7-42f2d3205f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:38.220396 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1746/3474] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:38.229420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12725ec8-15fe-4be2-8e37-154fbc99567c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:38.232799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12725ec8-15fe-4be2-8e37-154fbc99567c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:38.232799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12725ec8-15fe-4be2-8e37-154fbc99567c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:38.292373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-12725ec8-15fe-4be2-8e37-154fbc99567c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:38.295572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-12725ec8-15fe-4be2-8e37-154fbc99567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:38.315748 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1729/3475] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:38.323320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db23d74-d67b-4010-b7e7-42f2d3205f7b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:38.353587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12725ec8-15fe-4be2-8e37-154fbc99567c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:38.357045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db23d74-d67b-4010-b7e7-42f2d3205f7b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:38.358547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-12725ec8-15fe-4be2-8e37-154fbc99567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:38.391713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15ab41-8a80-4dc8-91b2-f363229e42e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:38.394812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ab41-8a80-4dc8-91b2-f363229e42e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:38.395102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ab41-8a80-4dc8-91b2-f363229e42e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:38.395412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ab41-8a80-4dc8-91b2-f363229e42e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:38.396176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15ab41-8a80-4dc8-91b2-f363229e42e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:30:38.396484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15ab41-8a80-4dc8-91b2-f363229e42e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:38.409370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15ab41-8a80-4dc8-91b2-f363229e42e3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:38.420759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12725ec8-15fe-4be2-8e37-154fbc99567c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:38.448222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:38.451128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:38.451636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:38.454057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6 admin admin] PATH_INFO: `/v3/projects/097cef0f05b1495087d456993c6bdf61` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:38.461492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=097cef0f05b1495087d456993c6bdf61)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:38.463445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:38.470667 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1747/3476] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:38.472684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15ab41-8a80-4dc8-91b2-f363229e42e3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:38.541052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15ab41-8a80-4dc8-91b2-f363229e42e3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:38.602125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:38.623235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3deb5f-dfb2-4f6b-8734-8c18f177460e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:38.632730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3deb5f-dfb2-4f6b-8734-8c18f177460e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:38.635728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3deb5f-dfb2-4f6b-8734-8c18f177460e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:38.637586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3deb5f-dfb2-4f6b-8734-8c18f177460e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:38.642966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3deb5f-dfb2-4f6b-8734-8c18f177460e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:38.645860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3deb5f-dfb2-4f6b-8734-8c18f177460e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:38.738158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '097cef0f05b1495087d456993c6bdf61', 'request_id': 'req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:38.768194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '097cef0f05b1495087d456993c6bdf61', 'request_id': 'req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:38.792632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '097cef0f05b1495087d456993c6bdf61', 'request_id': 'req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:38.838711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6 admin admin] The token cache is being invalidate because project 097cef0f05b1495087d456993c6bdf61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:30:38.839092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:38.839744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:38.852508 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1730/3477] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:30:38 2022] DELETE /identity/v3/projects/097cef0f05b1495087d456993c6bdf61 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:38.856170 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1748/3478] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:30:38 2022] POST /identity/v3/projects => generated 381 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:30:38.857316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:38.860576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:38.862602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3deb5f-dfb2-4f6b-8734-8c18f177460e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:38.879631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7b3deb5f-dfb2-4f6b-8734-8c18f177460e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:39.031499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:39.127606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245f413-c174-43c6-b5ee-c9eb00d2e7b6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:39.243326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3deb5f-dfb2-4f6b-8734-8c18f177460e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:39.252102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a5dcd-5845-415f-b3c2-39a6a8980817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:39.253034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a5dcd-5845-415f-b3c2-39a6a8980817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:39.255946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a5dcd-5845-415f-b3c2-39a6a8980817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:39.255946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a5dcd-5845-415f-b3c2-39a6a8980817 admin admin] PATH_INFO: `/v3/users/e7dd76661b3a4fac9d19b0eb7a3c867e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:39.255946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a5dcd-5845-415f-b3c2-39a6a8980817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7dd76661b3a4fac9d19b0eb7a3c867e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:39.261342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a5dcd-5845-415f-b3c2-39a6a8980817 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:39.415793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb3a5dcd-5845-415f-b3c2-39a6a8980817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7dd76661b3a4fac9d19b0eb7a3c867e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:39.417396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb3a5dcd-5845-415f-b3c2-39a6a8980817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7dd76661b3a4fac9d19b0eb7a3c867e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:39.434536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb3a5dcd-5845-415f-b3c2-39a6a8980817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7dd76661b3a4fac9d19b0eb7a3c867e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:39.461177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb3a5dcd-5845-415f-b3c2-39a6a8980817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7dd76661b3a4fac9d19b0eb7a3c867e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:39.496530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb3a5dcd-5845-415f-b3c2-39a6a8980817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7dd76661b3a4fac9d19b0eb7a3c867e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:39.533032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bead36-be08-42ec-8da9-17b8e6b83ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:39.533715 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1749/3479] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:30:38 2022] DELETE /identity/v3/users/e7dd76661b3a4fac9d19b0eb7a3c867e => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:39.534865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bead36-be08-42ec-8da9-17b8e6b83ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:39.535454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bead36-be08-42ec-8da9-17b8e6b83ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:39.535874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bead36-be08-42ec-8da9-17b8e6b83ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:39.537282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bead36-be08-42ec-8da9-17b8e6b83ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:39.545074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bead36-be08-42ec-8da9-17b8e6b83ca9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:39.629776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a5dcd-5845-415f-b3c2-39a6a8980817 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:39.630081 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1731/3480] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:30:38 2022] POST /identity/v3/users => generated 291 bytes in 776 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:30:39.632065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb3a5dcd-5845-415f-b3c2-39a6a8980817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:39.954438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a5dcd-5845-415f-b3c2-39a6a8980817 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:39.997987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c5c15-1ae1-47a1-b2c0-a0d1cface743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:39.998664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c5c15-1ae1-47a1-b2c0-a0d1cface743 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:39.998902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c5c15-1ae1-47a1-b2c0-a0d1cface743 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:39.999195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c5c15-1ae1-47a1-b2c0-a0d1cface743 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:39.999870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c5c15-1ae1-47a1-b2c0-a0d1cface743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:40.001494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c5c15-1ae1-47a1-b2c0-a0d1cface743 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:40.069271 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1750/3481] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:40.074941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bead36-be08-42ec-8da9-17b8e6b83ca9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:40.114027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bead36-be08-42ec-8da9-17b8e6b83ca9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:40.154752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088258e7-ad7c-4b23-b6e2-9221f7e4cdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:40.155244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088258e7-ad7c-4b23-b6e2-9221f7e4cdaf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:40.155591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088258e7-ad7c-4b23-b6e2-9221f7e4cdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:40.155873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088258e7-ad7c-4b23-b6e2-9221f7e4cdaf admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:40.167085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088258e7-ad7c-4b23-b6e2-9221f7e4cdaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:40.173072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088258e7-ad7c-4b23-b6e2-9221f7e4cdaf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:40.265106 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1732/3482] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:40.270027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c5c15-1ae1-47a1-b2c0-a0d1cface743 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:40.281607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c5c15-1ae1-47a1-b2c0-a0d1cface743 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:40.299846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d314f5f-95e4-4acf-884b-0c2aeb3a9903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:40.300576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d314f5f-95e4-4acf-884b-0c2aeb3a9903 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:40.300859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d314f5f-95e4-4acf-884b-0c2aeb3a9903 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:40.301176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d314f5f-95e4-4acf-884b-0c2aeb3a9903 admin admin] PATH_INFO: `/v3/projects/e7212b6a3de243f8a94e670c42286964/users/ca90f2ea81bf4e978a31f51fe1d5cea5/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:40.357994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d314f5f-95e4-4acf-884b-0c2aeb3a9903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7212b6a3de243f8a94e670c42286964, user_id=ca90f2ea81bf4e978a31f51fe1d5cea5, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:40.360653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d314f5f-95e4-4acf-884b-0c2aeb3a9903 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:40.460460 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1751/3483] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:30:40 2022] PUT /identity/v3/projects/e7212b6a3de243f8a94e670c42286964/users/ca90f2ea81bf4e978a31f51fe1d5cea5/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:40.476187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d500e5c-71f8-4dfd-9c48-53ae0f5cc516 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:40.476476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d500e5c-71f8-4dfd-9c48-53ae0f5cc516 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:40.479609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d500e5c-71f8-4dfd-9c48-53ae0f5cc516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:40.674893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9d500e5c-71f8-4dfd-9c48-53ae0f5cc516 None None] MFA Rules not processed for user `ca90f2ea81bf4e978a31f51fe1d5cea5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:40.680824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9d500e5c-71f8-4dfd-9c48-53ae0f5cc516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:40.730628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:40.992932 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1733/3484] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 519 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:41.013051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d314f5f-95e4-4acf-884b-0c2aeb3a9903 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:41.015098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3d314f5f-95e4-4acf-884b-0c2aeb3a9903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:41.100275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:41.430500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d314f5f-95e4-4acf-884b-0c2aeb3a9903 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:41.460888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987b1a7-466e-458c-9caf-cf7dcee6c25e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:41.464004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987b1a7-466e-458c-9caf-cf7dcee6c25e service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:41.465871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987b1a7-466e-458c-9caf-cf7dcee6c25e service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:41.466275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987b1a7-466e-458c-9caf-cf7dcee6c25e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:41.505342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987b1a7-466e-458c-9caf-cf7dcee6c25e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:41.509261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987b1a7-466e-458c-9caf-cf7dcee6c25e service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:41.576109 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1752/3485] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:41.680130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d500e5c-71f8-4dfd-9c48-53ae0f5cc516 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:41.875414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d500e5c-71f8-4dfd-9c48-53ae0f5cc516 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:41.889926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183e615-605a-400c-ba60-9dfc18d86d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:41.891007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183e615-605a-400c-ba60-9dfc18d86d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:41.891554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183e615-605a-400c-ba60-9dfc18d86d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:41.892012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183e615-605a-400c-ba60-9dfc18d86d74 admin admin] PATH_INFO: `/v3/users/ca90f2ea81bf4e978a31f51fe1d5cea5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:41.895729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183e615-605a-400c-ba60-9dfc18d86d74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca90f2ea81bf4e978a31f51fe1d5cea5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:41.898621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183e615-605a-400c-ba60-9dfc18d86d74 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:42.075934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7183e615-605a-400c-ba60-9dfc18d86d74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca90f2ea81bf4e978a31f51fe1d5cea5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:42.104050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7183e615-605a-400c-ba60-9dfc18d86d74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca90f2ea81bf4e978a31f51fe1d5cea5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:42.105080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7183e615-605a-400c-ba60-9dfc18d86d74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca90f2ea81bf4e978a31f51fe1d5cea5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:42.106876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7183e615-605a-400c-ba60-9dfc18d86d74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca90f2ea81bf4e978a31f51fe1d5cea5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:42.125367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7183e615-605a-400c-ba60-9dfc18d86d74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca90f2ea81bf4e978a31f51fe1d5cea5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:42.149835 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1734/3486] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:30:41 2022] DELETE /identity/v3/users/ca90f2ea81bf4e978a31f51fe1d5cea5 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:42.170918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d74eb-3524-40af-bf6f-40e5b9fd3db1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:42.172393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d74eb-3524-40af-bf6f-40e5b9fd3db1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:42.173655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d74eb-3524-40af-bf6f-40e5b9fd3db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:42.223895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2f0d74eb-3524-40af-bf6f-40e5b9fd3db1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:42.225172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2f0d74eb-3524-40af-bf6f-40e5b9fd3db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:42.306474 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1753/3487] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:42.350460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183e615-605a-400c-ba60-9dfc18d86d74 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:42.352218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7183e615-605a-400c-ba60-9dfc18d86d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:42.453523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:42.516314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183e615-605a-400c-ba60-9dfc18d86d74 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:42.520874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2735a4-80e8-4028-8b65-18127a07b814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:42.521502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2735a4-80e8-4028-8b65-18127a07b814 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:42.521775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2735a4-80e8-4028-8b65-18127a07b814 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:42.522074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2735a4-80e8-4028-8b65-18127a07b814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:42.542798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2735a4-80e8-4028-8b65-18127a07b814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:42.544320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2735a4-80e8-4028-8b65-18127a07b814 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:42.567225 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1735/3488] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:42.608691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d74eb-3524-40af-bf6f-40e5b9fd3db1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:42.610226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2f0d74eb-3524-40af-bf6f-40e5b9fd3db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:42.634282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d74eb-3524-40af-bf6f-40e5b9fd3db1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:42.654594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9936d-2984-443b-a5f5-6368cfcac211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:42.655541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9936d-2984-443b-a5f5-6368cfcac211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:42.656093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9936d-2984-443b-a5f5-6368cfcac211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:42.656465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9936d-2984-443b-a5f5-6368cfcac211 admin admin] PATH_INFO: `/v3/projects/29fa5a6f20914dc595e26edf21c2e9c7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:42.657746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9936d-2984-443b-a5f5-6368cfcac211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29fa5a6f20914dc595e26edf21c2e9c7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:42.659817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9936d-2984-443b-a5f5-6368cfcac211 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:42.788123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fe9936d-2984-443b-a5f5-6368cfcac211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29fa5a6f20914dc595e26edf21c2e9c7', 'request_id': 'req-0fe9936d-2984-443b-a5f5-6368cfcac211'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:42.820886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fe9936d-2984-443b-a5f5-6368cfcac211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29fa5a6f20914dc595e26edf21c2e9c7', 'request_id': 'req-0fe9936d-2984-443b-a5f5-6368cfcac211'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:42.831719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fe9936d-2984-443b-a5f5-6368cfcac211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29fa5a6f20914dc595e26edf21c2e9c7', 'request_id': 'req-0fe9936d-2984-443b-a5f5-6368cfcac211'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:42.906624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fe9936d-2984-443b-a5f5-6368cfcac211 admin admin] The token cache is being invalidate because project 29fa5a6f20914dc595e26edf21c2e9c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:30:42.906932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fe9936d-2984-443b-a5f5-6368cfcac211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:42.909819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fe9936d-2984-443b-a5f5-6368cfcac211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:42.928884 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1754/3489] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:30:42 2022] DELETE /identity/v3/projects/29fa5a6f20914dc595e26edf21c2e9c7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:42.932461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e00e4-736f-4cb6-9966-e1ea15f68151 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:42.932951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e00e4-736f-4cb6-9966-e1ea15f68151 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:42.937137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e00e4-736f-4cb6-9966-e1ea15f68151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:43.082794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1e0e00e4-736f-4cb6-9966-e1ea15f68151 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:43.089135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1e0e00e4-736f-4cb6-9966-e1ea15f68151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:43.371312 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1736/3490] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:43.371704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f541ba-e0c3-4510-9b3f-9fe66b2820a8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:43.371704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f541ba-e0c3-4510-9b3f-9fe66b2820a8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:43.372471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f541ba-e0c3-4510-9b3f-9fe66b2820a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:43.400996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d2f541ba-e0c3-4510-9b3f-9fe66b2820a8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:43.404762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d2f541ba-e0c3-4510-9b3f-9fe66b2820a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:43.443047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e00e4-736f-4cb6-9966-e1ea15f68151 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:43.450314 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1755/3491] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:43.463241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e00e4-736f-4cb6-9966-e1ea15f68151 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:43.471961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740597b-3638-435b-8e93-e06c4af0a3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:43.472939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740597b-3638-435b-8e93-e06c4af0a3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:43.473277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740597b-3638-435b-8e93-e06c4af0a3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:43.475043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740597b-3638-435b-8e93-e06c4af0a3a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:43.475043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740597b-3638-435b-8e93-e06c4af0a3a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:30:43.475043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740597b-3638-435b-8e93-e06c4af0a3a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:43.478475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740597b-3638-435b-8e93-e06c4af0a3a5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:43.497508 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1737/3492] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:43.502345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f541ba-e0c3-4510-9b3f-9fe66b2820a8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:43.515787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f541ba-e0c3-4510-9b3f-9fe66b2820a8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:43.532815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f8ab5-7b92-4f1f-84ea-87352ea0ce74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:43.536246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f8ab5-7b92-4f1f-84ea-87352ea0ce74 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:43.536547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f8ab5-7b92-4f1f-84ea-87352ea0ce74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:43.536914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f8ab5-7b92-4f1f-84ea-87352ea0ce74 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:43.539445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f8ab5-7b92-4f1f-84ea-87352ea0ce74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:43.543964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f8ab5-7b92-4f1f-84ea-87352ea0ce74 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:43.571654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:43.657375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740597b-3638-435b-8e93-e06c4af0a3a5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:43.660864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8740597b-3638-435b-8e93-e06c4af0a3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:43.690008 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1756/3493] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:30:43 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:30:43.691293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f8ab5-7b92-4f1f-84ea-87352ea0ce74 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:43.744358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740597b-3638-435b-8e93-e06c4af0a3a5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:43.873300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f8ab5-7b92-4f1f-84ea-87352ea0ce74 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:43.895775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870a30c-2186-4ebf-a60d-c5d8e3114c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:43.896470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870a30c-2186-4ebf-a60d-c5d8e3114c92 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:43.896856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870a30c-2186-4ebf-a60d-c5d8e3114c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:43.897300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870a30c-2186-4ebf-a60d-c5d8e3114c92 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:43.898526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870a30c-2186-4ebf-a60d-c5d8e3114c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:43.901549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870a30c-2186-4ebf-a60d-c5d8e3114c92 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:44.003674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad393754-aa9b-4ce7-806f-851043baf600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:44.005930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad393754-aa9b-4ce7-806f-851043baf600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:44.008300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad393754-aa9b-4ce7-806f-851043baf600 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:44.009448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad393754-aa9b-4ce7-806f-851043baf600 admin admin] PATH_INFO: `/v3/projects/e7212b6a3de243f8a94e670c42286964` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:44.011948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad393754-aa9b-4ce7-806f-851043baf600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7212b6a3de243f8a94e670c42286964)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:44.014725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad393754-aa9b-4ce7-806f-851043baf600 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:44.019360 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1757/3494] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:30:43 2022] POST /identity/v3/users => generated 288 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:30:44.021896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870a30c-2186-4ebf-a60d-c5d8e3114c92 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:44.097660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870a30c-2186-4ebf-a60d-c5d8e3114c92 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:44.144371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bae108-691c-4481-bd10-a1cb947f4a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:44.144848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bae108-691c-4481-bd10-a1cb947f4a4d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:44.145126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bae108-691c-4481-bd10-a1cb947f4a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:44.145401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bae108-691c-4481-bd10-a1cb947f4a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:44.146141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bae108-691c-4481-bd10-a1cb947f4a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:44.166289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bae108-691c-4481-bd10-a1cb947f4a4d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:44.202142 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1758/3495] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:44.204137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bae108-691c-4481-bd10-a1cb947f4a4d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:44.205976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ad393754-aa9b-4ce7-806f-851043baf600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7212b6a3de243f8a94e670c42286964', 'request_id': 'req-ad393754-aa9b-4ce7-806f-851043baf600'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:44.223321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ad393754-aa9b-4ce7-806f-851043baf600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7212b6a3de243f8a94e670c42286964', 'request_id': 'req-ad393754-aa9b-4ce7-806f-851043baf600'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:44.228792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bae108-691c-4481-bd10-a1cb947f4a4d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:44.237080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ad393754-aa9b-4ce7-806f-851043baf600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7212b6a3de243f8a94e670c42286964', 'request_id': 'req-ad393754-aa9b-4ce7-806f-851043baf600'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:44.248693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:44.265768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ad393754-aa9b-4ce7-806f-851043baf600 admin admin] The token cache is being invalidate because project e7212b6a3de243f8a94e670c42286964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:30:44.268126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ad393754-aa9b-4ce7-806f-851043baf600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:44.270959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ad393754-aa9b-4ce7-806f-851043baf600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:30:44.282378 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1738/3496] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:30:43 2022] DELETE /identity/v3/projects/e7212b6a3de243f8a94e670c42286964 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:30:44.284359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c751c7-dfa2-44f0-b74a-e308b0c0bc76 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:44.284779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c751c7-dfa2-44f0-b74a-e308b0c0bc76 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:44.285335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c751c7-dfa2-44f0-b74a-e308b0c0bc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:44.353567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-22c751c7-dfa2-44f0-b74a-e308b0c0bc76 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:44.357518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-22c751c7-dfa2-44f0-b74a-e308b0c0bc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:44.379543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f672f0-e8c2-4d49-aaf9-b899e68ec42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:44.380908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f672f0-e8c2-4d49-aaf9-b899e68ec42c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:44.381447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f672f0-e8c2-4d49-aaf9-b899e68ec42c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:44.381827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f672f0-e8c2-4d49-aaf9-b899e68ec42c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:44.382853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f672f0-e8c2-4d49-aaf9-b899e68ec42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:44.385020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f672f0-e8c2-4d49-aaf9-b899e68ec42c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:44.402798 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1759/3497] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:44.403993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f672f0-e8c2-4d49-aaf9-b899e68ec42c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:44.405859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-22f672f0-e8c2-4d49-aaf9-b899e68ec42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:44.444496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f672f0-e8c2-4d49-aaf9-b899e68ec42c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:44.469520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de64b79-7a6c-4c37-9626-bb80b178d2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:44.473667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de64b79-7a6c-4c37-9626-bb80b178d2b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:44.475124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de64b79-7a6c-4c37-9626-bb80b178d2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:44.475584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de64b79-7a6c-4c37-9626-bb80b178d2b9 admin admin] PATH_INFO: `/v3/projects/71dc74119c624dc2ac3fe0f308d2779d/users/71b6984aad2a4d23a688d6a811f119b3/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:44.520679 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1739/3498] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:44.529641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e3670-2a8f-4e82-ad06-60b186a434fb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:44.530650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e3670-2a8f-4e82-ad06-60b186a434fb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:44.531120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e3670-2a8f-4e82-ad06-60b186a434fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:44.541715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de64b79-7a6c-4c37-9626-bb80b178d2b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71dc74119c624dc2ac3fe0f308d2779d, user_id=71b6984aad2a4d23a688d6a811f119b3, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:44.551378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de64b79-7a6c-4c37-9626-bb80b178d2b9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:44.593279 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1760/3499] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:30:44 2022] PUT /identity/v3/projects/71dc74119c624dc2ac3fe0f308d2779d/users/71b6984aad2a4d23a688d6a811f119b3/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:44.607013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8cf87-b0c9-4d8b-b81b-f9b576b92694 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:44.610465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8cf87-b0c9-4d8b-b81b-f9b576b92694 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:44.610870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8cf87-b0c9-4d8b-b81b-f9b576b92694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:44.618312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dc3e3670-2a8f-4e82-ad06-60b186a434fb None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:44.621591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dc3e3670-2a8f-4e82-ad06-60b186a434fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:44.695291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e4f8cf87-b0c9-4d8b-b81b-f9b576b92694 None None] MFA Rules not processed for user `71b6984aad2a4d23a688d6a811f119b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:44.698511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e4f8cf87-b0c9-4d8b-b81b-f9b576b92694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:44.773254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:44.788906 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1740/3500] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:44.790363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e3670-2a8f-4e82-ad06-60b186a434fb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:44.818902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e3670-2a8f-4e82-ad06-60b186a434fb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:44.831628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4f4e4-6089-41fb-96b2-2216081d3a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:44.832540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4f4e4-6089-41fb-96b2-2216081d3a34 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:44.832827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4f4e4-6089-41fb-96b2-2216081d3a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:44.833142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4f4e4-6089-41fb-96b2-2216081d3a34 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:44.833809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4f4e4-6089-41fb-96b2-2216081d3a34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:30:44.834297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4f4e4-6089-41fb-96b2-2216081d3a34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:44.836311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4f4e4-6089-41fb-96b2-2216081d3a34 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:44.852671 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1761/3501] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:44.853816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8cf87-b0c9-4d8b-b81b-f9b576b92694 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:44.875899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8cf87-b0c9-4d8b-b81b-f9b576b92694 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:44.888458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c94c-1376-4eed-b3c4-d51b2672f22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:44.889753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c94c-1376-4eed-b3c4-d51b2672f22e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:44.890178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c94c-1376-4eed-b3c4-d51b2672f22e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:44.899397 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1741/3502] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:30:44.900928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4f4e4-6089-41fb-96b2-2216081d3a34 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:44.910521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c94c-1376-4eed-b3c4-d51b2672f22e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:44.912264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8c94c-1376-4eed-b3c4-d51b2672f22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:44.917406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8c94c-1376-4eed-b3c4-d51b2672f22e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:44.925926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4f4e4-6089-41fb-96b2-2216081d3a34 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:44.945359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfaa06-699c-4cf2-8ad4-85a8c9032dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:44.946992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfaa06-699c-4cf2-8ad4-85a8c9032dde admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:44.948849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfaa06-699c-4cf2-8ad4-85a8c9032dde admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:44.949329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfaa06-699c-4cf2-8ad4-85a8c9032dde admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:44.950723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfaa06-699c-4cf2-8ad4-85a8c9032dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:44.953572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfaa06-699c-4cf2-8ad4-85a8c9032dde admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:45.024078 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1762/3503] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:30:44 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:30:45.029110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c94c-1376-4eed-b3c4-d51b2672f22e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:45.032785 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1742/3504] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:30:44 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:30:45.052313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfaa06-699c-4cf2-8ad4-85a8c9032dde admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:45.240146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c94c-1376-4eed-b3c4-d51b2672f22e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:45.245056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfaa06-699c-4cf2-8ad4-85a8c9032dde admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:45.251908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677c858-98b5-4f01-a408-5a41f22e1c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:45.253630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677c858-98b5-4f01-a408-5a41f22e1c97 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:45.254757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677c858-98b5-4f01-a408-5a41f22e1c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:45.255633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677c858-98b5-4f01-a408-5a41f22e1c97 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:45.256966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677c858-98b5-4f01-a408-5a41f22e1c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:45.260813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f4948-e719-44d7-961e-d41b71bf172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:45.261505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f4948-e719-44d7-961e-d41b71bf172d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:45.261829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f4948-e719-44d7-961e-d41b71bf172d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:45.262180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f4948-e719-44d7-961e-d41b71bf172d admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:45.262901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f4948-e719-44d7-961e-d41b71bf172d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:45.263347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677c858-98b5-4f01-a408-5a41f22e1c97 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:45.268438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f4948-e719-44d7-961e-d41b71bf172d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:45.289137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:45.387490 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1743/3505] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:30:45 2022] POST /identity/v3/users => generated 293 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:30:45.390148 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1763/3506] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:30:45 2022] POST /identity/v3/users => generated 295 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:30:45.392005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f4948-e719-44d7-961e-d41b71bf172d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:45.393477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677c858-98b5-4f01-a408-5a41f22e1c97 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:45.442946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677c858-98b5-4f01-a408-5a41f22e1c97 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:45.444486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f4948-e719-44d7-961e-d41b71bf172d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:45.458799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe45a3-53cf-4d43-9f59-463cf8366437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:45.461191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0153f-8ccf-4e96-a6d3-9e68fa176d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:45.462215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe45a3-53cf-4d43-9f59-463cf8366437 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:45.462560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe45a3-53cf-4d43-9f59-463cf8366437 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:45.463016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe45a3-53cf-4d43-9f59-463cf8366437 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:45.474358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0153f-8ccf-4e96-a6d3-9e68fa176d72 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:45.474663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0153f-8ccf-4e96-a6d3-9e68fa176d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:45.474940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0153f-8ccf-4e96-a6d3-9e68fa176d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:45.475694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe45a3-53cf-4d43-9f59-463cf8366437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:45.477655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe45a3-53cf-4d43-9f59-463cf8366437 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:45.478742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0153f-8ccf-4e96-a6d3-9e68fa176d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:45.485452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0153f-8ccf-4e96-a6d3-9e68fa176d72 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:45.532051 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1744/3507] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:45.534081 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1764/3508] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:45.534384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe45a3-53cf-4d43-9f59-463cf8366437 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:45.545233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0153f-8ccf-4e96-a6d3-9e68fa176d72 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:45.558332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe45a3-53cf-4d43-9f59-463cf8366437 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:45.566904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0153f-8ccf-4e96-a6d3-9e68fa176d72 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:45.571767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930991d7-b61b-487c-a02e-c4949a8c0da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:45.572725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930991d7-b61b-487c-a02e-c4949a8c0da6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:45.573175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930991d7-b61b-487c-a02e-c4949a8c0da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:45.573521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930991d7-b61b-487c-a02e-c4949a8c0da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:45.574179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930991d7-b61b-487c-a02e-c4949a8c0da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:45.575826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930991d7-b61b-487c-a02e-c4949a8c0da6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:45.592618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b6b5a-20ad-48cf-aba2-65435e013def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:45.593519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b6b5a-20ad-48cf-aba2-65435e013def admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:45.593963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b6b5a-20ad-48cf-aba2-65435e013def admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:45.594397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b6b5a-20ad-48cf-aba2-65435e013def admin admin] PATH_INFO: `/v3/projects/57a75e253f8c4063a781f5427f1fbfe6/users/fadaa2796df44732b02aba7ffe25caf1/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:45.611885 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1745/3509] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:45.613087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930991d7-b61b-487c-a02e-c4949a8c0da6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:45.631846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b6b5a-20ad-48cf-aba2-65435e013def admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a75e253f8c4063a781f5427f1fbfe6, user_id=fadaa2796df44732b02aba7ffe25caf1, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:45.634789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b6b5a-20ad-48cf-aba2-65435e013def admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:45.665656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930991d7-b61b-487c-a02e-c4949a8c0da6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:45.723872 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1765/3510] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:30:45 2022] PUT /identity/v3/projects/57a75e253f8c4063a781f5427f1fbfe6/users/fadaa2796df44732b02aba7ffe25caf1/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:45.729215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b6b5a-20ad-48cf-aba2-65435e013def admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:45.898983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d928d-0aaa-432a-a098-f4d8674e41d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:45.898983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d928d-0aaa-432a-a098-f4d8674e41d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:45.898983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d928d-0aaa-432a-a098-f4d8674e41d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:45.898983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d928d-0aaa-432a-a098-f4d8674e41d9 admin admin] PATH_INFO: `/v3/projects/85c27ea703774cda8616fd9ce1be1b02/users/fa8091f56de8476b9161efb9269155ad/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:45.945398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d928d-0aaa-432a-a098-f4d8674e41d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c27ea703774cda8616fd9ce1be1b02, user_id=fa8091f56de8476b9161efb9269155ad, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:45.949758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d928d-0aaa-432a-a098-f4d8674e41d9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:46.000179 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1746/3511] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:30:45 2022] PUT /identity/v3/projects/85c27ea703774cda8616fd9ce1be1b02/users/fa8091f56de8476b9161efb9269155ad/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:46.003158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3f3ae-4726-42ab-941e-12aea137de70 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:46.003158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3f3ae-4726-42ab-941e-12aea137de70 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:46.003158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3f3ae-4726-42ab-941e-12aea137de70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:46.028640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b6b5a-20ad-48cf-aba2-65435e013def admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:46.065543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:46.068333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-73c3f3ae-4726-42ab-941e-12aea137de70 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:46.077314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-73c3f3ae-4726-42ab-941e-12aea137de70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:46.264813 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1747/3512] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:46.285705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee6fbf-c1da-4b4c-a8e8-9560ddd7a2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:46.286353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6fbf-c1da-4b4c-a8e8-9560ddd7a2ad admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:46.286710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6fbf-c1da-4b4c-a8e8-9560ddd7a2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:46.287334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6fbf-c1da-4b4c-a8e8-9560ddd7a2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:46.288665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee6fbf-c1da-4b4c-a8e8-9560ddd7a2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:46.290321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee6fbf-c1da-4b4c-a8e8-9560ddd7a2ad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:46.304878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3f3ae-4726-42ab-941e-12aea137de70 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:46.307543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-73c3f3ae-4726-42ab-941e-12aea137de70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:46.320046 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1766/3513] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 592 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:30:46.324079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee6fbf-c1da-4b4c-a8e8-9560ddd7a2ad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:46.350453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee6fbf-c1da-4b4c-a8e8-9560ddd7a2ad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:46.376975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aef76f-4b44-4e13-a6f3-b6d6a6a61b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:46.378098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aef76f-4b44-4e13-a6f3-b6d6a6a61b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:46.379242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aef76f-4b44-4e13-a6f3-b6d6a6a61b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:46.381477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aef76f-4b44-4e13-a6f3-b6d6a6a61b8b admin admin] PATH_INFO: `/v3/projects/57a75e253f8c4063a781f5427f1fbfe6/users/fadaa2796df44732b02aba7ffe25caf1/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:46.389416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aef76f-4b44-4e13-a6f3-b6d6a6a61b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a75e253f8c4063a781f5427f1fbfe6, user_id=fadaa2796df44732b02aba7ffe25caf1, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:46.410120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aef76f-4b44-4e13-a6f3-b6d6a6a61b8b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:46.464510 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1767/3514] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:30:46 2022] PUT /identity/v3/projects/57a75e253f8c4063a781f5427f1fbfe6/users/fadaa2796df44732b02aba7ffe25caf1/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:30:46.474715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce1c8a-89ba-4c1c-aa12-92afd9aa4c02 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:46.475408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce1c8a-89ba-4c1c-aa12-92afd9aa4c02 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:46.476638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce1c8a-89ba-4c1c-aa12-92afd9aa4c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:46.505302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3f3ae-4726-42ab-941e-12aea137de70 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:46.517680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:46.554544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-06ce1c8a-89ba-4c1c-aa12-92afd9aa4c02 None None] MFA Rules not processed for user `fadaa2796df44732b02aba7ffe25caf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:46.556073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-06ce1c8a-89ba-4c1c-aa12-92afd9aa4c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:46.642973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc156356-794d-4e83-94eb-987a69a575f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:46.644229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc156356-794d-4e83-94eb-987a69a575f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:46.644644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc156356-794d-4e83-94eb-987a69a575f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:46.645177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc156356-794d-4e83-94eb-987a69a575f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:46.723105 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1768/3515] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:30:46.735934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ac72e-99f3-4cac-b076-158a0eaba625 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:46.736400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ac72e-99f3-4cac-b076-158a0eaba625 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:46.737938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ac72e-99f3-4cac-b076-158a0eaba625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:46.783033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c30ac72e-99f3-4cac-b076-158a0eaba625 None None] MFA Rules not processed for user `71b6984aad2a4d23a688d6a811f119b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:46.786026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c30ac72e-99f3-4cac-b076-158a0eaba625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:46.826148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc156356-794d-4e83-94eb-987a69a575f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:46.833173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc156356-794d-4e83-94eb-987a69a575f7 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:46.870734 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1748/3516] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:46.951361 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1769/3517] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:30:46.967756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc156356-794d-4e83-94eb-987a69a575f7 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:46.969456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fc156356-794d-4e83-94eb-987a69a575f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:47.202862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc156356-794d-4e83-94eb-987a69a575f7 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:47.224195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4974ad-c149-49a3-9fe2-d17f43e18888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:47.225644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4974ad-c149-49a3-9fe2-d17f43e18888 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:47.226207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4974ad-c149-49a3-9fe2-d17f43e18888 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:47.226802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4974ad-c149-49a3-9fe2-d17f43e18888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:47.249929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4974ad-c149-49a3-9fe2-d17f43e18888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:47.252341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4974ad-c149-49a3-9fe2-d17f43e18888 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:47.290885 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1749/3518] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:47.902578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdd679-4098-458a-a44f-6a9b00c21eb0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:47.903129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdd679-4098-458a-a44f-6a9b00c21eb0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:47.903235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdd679-4098-458a-a44f-6a9b00c21eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:47.960389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-58bdd679-4098-458a-a44f-6a9b00c21eb0 None None] MFA Rules not processed for user `20b3956bf2d14c1ea1940fd29cc0f7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:47.961607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58bdd679-4098-458a-a44f-6a9b00c21eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:48.012692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:48.086963 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1770/3519] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:48.098117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a474585-31c2-4ede-9dbe-c9c9e518b4cd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:48.098524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a474585-31c2-4ede-9dbe-c9c9e518b4cd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:48.098690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a474585-31c2-4ede-9dbe-c9c9e518b4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:48.183219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3a474585-31c2-4ede-9dbe-c9c9e518b4cd None None] MFA Rules not processed for user `20b3956bf2d14c1ea1940fd29cc0f7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:48.184480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a474585-31c2-4ede-9dbe-c9c9e518b4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:48.203407 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1750/3520] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:48.521923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f1b1f-b94a-47e9-acf5-238b4fd7b177 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:48.522471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f1b1f-b94a-47e9-acf5-238b4fd7b177 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:48.522819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f1b1f-b94a-47e9-acf5-238b4fd7b177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:48.616469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8d8f1b1f-b94a-47e9-acf5-238b4fd7b177 None None] MFA Rules not processed for user `71b6984aad2a4d23a688d6a811f119b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:48.619626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d8f1b1f-b94a-47e9-acf5-238b4fd7b177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:48.653937 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1771/3521] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:51.258424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f5d47-6f41-44bc-ba9f-6bb9a50f6a71 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:51.259290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f5d47-6f41-44bc-ba9f-6bb9a50f6a71 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:51.259601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f5d47-6f41-44bc-ba9f-6bb9a50f6a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:51.307676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a08f5d47-6f41-44bc-ba9f-6bb9a50f6a71 None None] MFA Rules not processed for user `ed083a289526439ea93593880be3ef86`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:51.308953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a08f5d47-6f41-44bc-ba9f-6bb9a50f6a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:51.383931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:30:51.442695 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1751/3522] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:54.309449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cfc7f-eaf7-4269-8345-cf31fab38749 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:54.310503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cfc7f-eaf7-4269-8345-cf31fab38749 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:54.310786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cfc7f-eaf7-4269-8345-cf31fab38749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:54.394216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1c0cfc7f-eaf7-4269-8345-cf31fab38749 None None] MFA Rules not processed for user `fa8091f56de8476b9161efb9269155ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:54.396413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c0cfc7f-eaf7-4269-8345-cf31fab38749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:54.488123 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1772/3523] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:30:54.502979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f5d47-6f41-44bc-ba9f-6bb9a50f6a71 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:30:54.505189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a08f5d47-6f41-44bc-ba9f-6bb9a50f6a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:54.523582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f5d47-6f41-44bc-ba9f-6bb9a50f6a71 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:30:54.530409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841eb1f-f55a-47e3-bd7a-405b13a8ff44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:30:54.531051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841eb1f-f55a-47e3-bd7a-405b13a8ff44 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:54.531373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841eb1f-f55a-47e3-bd7a-405b13a8ff44 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:54.531682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841eb1f-f55a-47e3-bd7a-405b13a8ff44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:54.541245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841eb1f-f55a-47e3-bd7a-405b13a8ff44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:30:54.543177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841eb1f-f55a-47e3-bd7a-405b13a8ff44 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:30:54.560137 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1752/3524] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:30:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:30:59.670066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc393f48-40b8-43d1-ae47-66d1436f1f5c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:30:59.673183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc393f48-40b8-43d1-ae47-66d1436f1f5c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:30:59.673591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc393f48-40b8-43d1-ae47-66d1436f1f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:30:59.785150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fc393f48-40b8-43d1-ae47-66d1436f1f5c None None] MFA Rules not processed for user `fa8091f56de8476b9161efb9269155ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:30:59.789351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc393f48-40b8-43d1-ae47-66d1436f1f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:30:59.817379 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1773/3525] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:30:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:31:00.505296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841eb1f-f55a-47e3-bd7a-405b13a8ff44 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:00.520680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841eb1f-f55a-47e3-bd7a-405b13a8ff44 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:00.552121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06543a14-2c9a-4fed-ae67-a1fdf1737e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:00.552818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06543a14-2c9a-4fed-ae67-a1fdf1737e1c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:00.553096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06543a14-2c9a-4fed-ae67-a1fdf1737e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:00.553543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06543a14-2c9a-4fed-ae67-a1fdf1737e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:00.557625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-06543a14-2c9a-4fed-ae67-a1fdf1737e1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:00.611476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06543a14-2c9a-4fed-ae67-a1fdf1737e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:00.613247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06543a14-2c9a-4fed-ae67-a1fdf1737e1c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:00.634412 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1753/3526] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:31:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:31:05.473630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9583d70-bc6d-4d4d-8f28-b1b56e6dd3d9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:05.474136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9583d70-bc6d-4d4d-8f28-b1b56e6dd3d9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:05.474296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9583d70-bc6d-4d4d-8f28-b1b56e6dd3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:05.495627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c9583d70-bc6d-4d4d-8f28-b1b56e6dd3d9 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:31:05.497281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c9583d70-bc6d-4d4d-8f28-b1b56e6dd3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:05.588103 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1774/3527] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:31:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:31:05.609032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06543a14-2c9a-4fed-ae67-a1fdf1737e1c service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:05.611372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-06543a14-2c9a-4fed-ae67-a1fdf1737e1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:05.785645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06543a14-2c9a-4fed-ae67-a1fdf1737e1c service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:05.804431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6f6cd-df58-428a-bdbc-605a09231ad3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:05.804705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6f6cd-df58-428a-bdbc-605a09231ad3 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:05.805044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6f6cd-df58-428a-bdbc-605a09231ad3 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:05.805413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6f6cd-df58-428a-bdbc-605a09231ad3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:05.817162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6f6cd-df58-428a-bdbc-605a09231ad3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:05.819245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6f6cd-df58-428a-bdbc-605a09231ad3 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:05.830685 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1754/3528] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:31:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 18:31:15.570500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=77 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:31:15.826241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=52 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:31:21.700919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865be77-3ab6-4d41-a874-0099e1e74dd9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:21.701523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865be77-3ab6-4d41-a874-0099e1e74dd9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:21.701523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865be77-3ab6-4d41-a874-0099e1e74dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:21.725422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1865be77-3ab6-4d41-a874-0099e1e74dd9 None None] MFA Rules not processed for user `71b6984aad2a4d23a688d6a811f119b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:31:21.727076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1865be77-3ab6-4d41-a874-0099e1e74dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:21.738541 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1775/3529] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:31:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:31:24.034155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d8c1-0aec-4d3a-8c02-2362278c05b1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:24.034738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d8c1-0aec-4d3a-8c02-2362278c05b1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:24.034738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d8c1-0aec-4d3a-8c02-2362278c05b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:24.064390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-56f5d8c1-0aec-4d3a-8c02-2362278c05b1 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:31:24.067566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-56f5d8c1-0aec-4d3a-8c02-2362278c05b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:24.076635 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1755/3530] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:31:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:31:24.091869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865be77-3ab6-4d41-a874-0099e1e74dd9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:24.107482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865be77-3ab6-4d41-a874-0099e1e74dd9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:24.114102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954cc27-97c7-4f1e-acb3-af1ff0389cf0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:24.114661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954cc27-97c7-4f1e-acb3-af1ff0389cf0 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:24.114944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954cc27-97c7-4f1e-acb3-af1ff0389cf0 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:24.115296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954cc27-97c7-4f1e-acb3-af1ff0389cf0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:24.129318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954cc27-97c7-4f1e-acb3-af1ff0389cf0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:24.131838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954cc27-97c7-4f1e-acb3-af1ff0389cf0 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:24.144248 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1776/3531] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:31:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:31:28.499290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5d8c1-0aec-4d3a-8c02-2362278c05b1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:28.500802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-56f5d8c1-0aec-4d3a-8c02-2362278c05b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:28.538601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5d8c1-0aec-4d3a-8c02-2362278c05b1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:28.548351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb0090-cc23-4ea3-8e11-5d8eee970642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:28.549693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb0090-cc23-4ea3-8e11-5d8eee970642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:28.550279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb0090-cc23-4ea3-8e11-5d8eee970642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:28.550629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb0090-cc23-4ea3-8e11-5d8eee970642 admin admin] PATH_INFO: `/v3/users/1ecfc657949249078e4affb4c3b6aa57` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:28.552900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb0090-cc23-4ea3-8e11-5d8eee970642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ecfc657949249078e4affb4c3b6aa57)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:28.555070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb0090-cc23-4ea3-8e11-5d8eee970642 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:28.694565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-46eb0090-cc23-4ea3-8e11-5d8eee970642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ecfc657949249078e4affb4c3b6aa57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:28.733683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-46eb0090-cc23-4ea3-8e11-5d8eee970642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ecfc657949249078e4affb4c3b6aa57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:28.734925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-46eb0090-cc23-4ea3-8e11-5d8eee970642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ecfc657949249078e4affb4c3b6aa57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:28.736223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-46eb0090-cc23-4ea3-8e11-5d8eee970642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ecfc657949249078e4affb4c3b6aa57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:28.771393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-46eb0090-cc23-4ea3-8e11-5d8eee970642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ecfc657949249078e4affb4c3b6aa57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:28.813618 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1756/3532] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:31:28 2022] DELETE /identity/v3/users/1ecfc657949249078e4affb4c3b6aa57 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:31:29.574668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954cc27-97c7-4f1e-acb3-af1ff0389cf0 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:29.589962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954cc27-97c7-4f1e-acb3-af1ff0389cf0 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:29.724235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89db94-3a42-4ee9-99a0-a10f13b17ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:29.736824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89db94-3a42-4ee9-99a0-a10f13b17ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:29.737115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89db94-3a42-4ee9-99a0-a10f13b17ace admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:29.737398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89db94-3a42-4ee9-99a0-a10f13b17ace admin admin] PATH_INFO: `/v3/projects/606b0dcabea8477e96fe9f5af5e9551b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:29.744344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89db94-3a42-4ee9-99a0-a10f13b17ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=606b0dcabea8477e96fe9f5af5e9551b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:29.747153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89db94-3a42-4ee9-99a0-a10f13b17ace admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:29.822377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c89db94-3a42-4ee9-99a0-a10f13b17ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '606b0dcabea8477e96fe9f5af5e9551b', 'request_id': 'req-2c89db94-3a42-4ee9-99a0-a10f13b17ace'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:29.841254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c89db94-3a42-4ee9-99a0-a10f13b17ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '606b0dcabea8477e96fe9f5af5e9551b', 'request_id': 'req-2c89db94-3a42-4ee9-99a0-a10f13b17ace'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:29.851722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c89db94-3a42-4ee9-99a0-a10f13b17ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '606b0dcabea8477e96fe9f5af5e9551b', 'request_id': 'req-2c89db94-3a42-4ee9-99a0-a10f13b17ace'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:29.875051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c89db94-3a42-4ee9-99a0-a10f13b17ace admin admin] The token cache is being invalidate because project 606b0dcabea8477e96fe9f5af5e9551b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:31:29.879442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c89db94-3a42-4ee9-99a0-a10f13b17ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:29.880555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c89db94-3a42-4ee9-99a0-a10f13b17ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:29.882874 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1777/3533] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:31:29 2022] DELETE /identity/v3/projects/606b0dcabea8477e96fe9f5af5e9551b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:31:29.887931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b737d-2877-4b6d-bf19-9096a1ee4729 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:29.888910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b737d-2877-4b6d-bf19-9096a1ee4729 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:29.889329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b737d-2877-4b6d-bf19-9096a1ee4729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:29.956185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a64b737d-2877-4b6d-bf19-9096a1ee4729 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:31:29.957996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a64b737d-2877-4b6d-bf19-9096a1ee4729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:30.047469 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1757/3534] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:31:30.057848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f111fc-4648-4119-848d-721f89e4ae8c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:30.057848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f111fc-4648-4119-848d-721f89e4ae8c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:30.057848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f111fc-4648-4119-848d-721f89e4ae8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:30.097405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-90f111fc-4648-4119-848d-721f89e4ae8c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:31:30.098654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-90f111fc-4648-4119-848d-721f89e4ae8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:30.114393 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1778/3535] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:31:30.119180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b737d-2877-4b6d-bf19-9096a1ee4729 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:30.129112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b737d-2877-4b6d-bf19-9096a1ee4729 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:30.134038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1065437-978c-4a8a-bf63-4fced391f34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:30.134889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1065437-978c-4a8a-bf63-4fced391f34e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:30.135365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1065437-978c-4a8a-bf63-4fced391f34e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:30.135811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1065437-978c-4a8a-bf63-4fced391f34e admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:30.136476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1065437-978c-4a8a-bf63-4fced391f34e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:31:30.136770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1065437-978c-4a8a-bf63-4fced391f34e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:30.138527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1065437-978c-4a8a-bf63-4fced391f34e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:30.155826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f111fc-4648-4119-848d-721f89e4ae8c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:30.163292 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1758/3536] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:31:30.168762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f111fc-4648-4119-848d-721f89e4ae8c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:30.174421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb6b9f-60ac-411b-8df2-fa70edf08f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:30.175399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb6b9f-60ac-411b-8df2-fa70edf08f3b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:30.175881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb6b9f-60ac-411b-8df2-fa70edf08f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:30.176366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb6b9f-60ac-411b-8df2-fa70edf08f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:30.177212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb6b9f-60ac-411b-8df2-fa70edf08f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:30.179388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb6b9f-60ac-411b-8df2-fa70edf08f3b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:30.246903 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1779/3537] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:31:30 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:31:30.248205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1065437-978c-4a8a-bf63-4fced391f34e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:30.271150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1065437-978c-4a8a-bf63-4fced391f34e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:30.354598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:31:30.370484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edab36-df92-4c57-bcfb-b29f4a269d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:30.372304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edab36-df92-4c57-bcfb-b29f4a269d27 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:30.372820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edab36-df92-4c57-bcfb-b29f4a269d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:30.373452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edab36-df92-4c57-bcfb-b29f4a269d27 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:30.374581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edab36-df92-4c57-bcfb-b29f4a269d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:30.377061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edab36-df92-4c57-bcfb-b29f4a269d27 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:30.415930 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1759/3538] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:31:30 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:31:30.420997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb6b9f-60ac-411b-8df2-fa70edf08f3b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:30.437493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb6b9f-60ac-411b-8df2-fa70edf08f3b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:30.445867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2475205-eafb-4dd3-9bd1-f90bd054588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:30.446885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2475205-eafb-4dd3-9bd1-f90bd054588a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:30.447231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2475205-eafb-4dd3-9bd1-f90bd054588a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:30.447608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2475205-eafb-4dd3-9bd1-f90bd054588a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:30.448326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2475205-eafb-4dd3-9bd1-f90bd054588a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:30.450239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2475205-eafb-4dd3-9bd1-f90bd054588a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:30.474755 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1780/3539] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:31:30.475528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edab36-df92-4c57-bcfb-b29f4a269d27 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:30.487927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edab36-df92-4c57-bcfb-b29f4a269d27 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:30.498998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778734-264f-456a-b1c1-44de756df800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:30.501675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778734-264f-456a-b1c1-44de756df800 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:30.502024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778734-264f-456a-b1c1-44de756df800 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:30.502588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778734-264f-456a-b1c1-44de756df800 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:30.503460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778734-264f-456a-b1c1-44de756df800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:30.505149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778734-264f-456a-b1c1-44de756df800 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:30.517721 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1760/3540] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:31:30.522046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2475205-eafb-4dd3-9bd1-f90bd054588a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:30.532802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2475205-eafb-4dd3-9bd1-f90bd054588a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:30.539781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6484505-d69f-4ed9-ab4f-76be4b0e56f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:30.541127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6484505-d69f-4ed9-ab4f-76be4b0e56f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:30.541724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6484505-d69f-4ed9-ab4f-76be4b0e56f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:30.542181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6484505-d69f-4ed9-ab4f-76be4b0e56f6 admin admin] PATH_INFO: `/v3/projects/8e04d2c889624b7896caeda18ba278f2/users/077919f932db4786af564965a5fb2c68/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:30.560762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6484505-d69f-4ed9-ab4f-76be4b0e56f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e04d2c889624b7896caeda18ba278f2, user_id=077919f932db4786af564965a5fb2c68, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:30.565401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6484505-d69f-4ed9-ab4f-76be4b0e56f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:30.591909 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1781/3541] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:31:30 2022] PUT /identity/v3/projects/8e04d2c889624b7896caeda18ba278f2/users/077919f932db4786af564965a5fb2c68/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:31:30.596947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c9eb9-b397-4845-8958-6756e27b4557 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:30.597652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c9eb9-b397-4845-8958-6756e27b4557 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:30.598026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c9eb9-b397-4845-8958-6756e27b4557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:30.623542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b13c9eb9-b397-4845-8958-6756e27b4557 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:31:30.625042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b13c9eb9-b397-4845-8958-6756e27b4557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:30.735722 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1761/3542] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:31:30.742893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6484505-d69f-4ed9-ab4f-76be4b0e56f6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:30.746730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f6484505-d69f-4ed9-ab4f-76be4b0e56f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:30.758134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:31:30.832219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6484505-d69f-4ed9-ab4f-76be4b0e56f6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:30.836883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16e362-b4aa-43a9-b67e-0c07d0a2dde3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:30.837633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16e362-b4aa-43a9-b67e-0c07d0a2dde3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:30.837879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16e362-b4aa-43a9-b67e-0c07d0a2dde3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:30.838682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16e362-b4aa-43a9-b67e-0c07d0a2dde3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:30.852316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16e362-b4aa-43a9-b67e-0c07d0a2dde3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:30.866320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16e362-b4aa-43a9-b67e-0c07d0a2dde3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:30.878369 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1782/3543] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:31:40.154244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c9eb9-b397-4845-8958-6756e27b4557 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:40.155980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b13c9eb9-b397-4845-8958-6756e27b4557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:40.271324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c9eb9-b397-4845-8958-6756e27b4557 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:40.277590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21891602-e22d-4004-aeef-020308f8da9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:40.278458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21891602-e22d-4004-aeef-020308f8da9d service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:40.278810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21891602-e22d-4004-aeef-020308f8da9d service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:40.279195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21891602-e22d-4004-aeef-020308f8da9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:40.281287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-21891602-e22d-4004-aeef-020308f8da9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:40.463564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21891602-e22d-4004-aeef-020308f8da9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:40.474706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21891602-e22d-4004-aeef-020308f8da9d service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:40.488852 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1762/3544] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:31:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:31:40.873143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=23 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:31:41.399800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb55372-11a1-421c-86ae-84d207e026d8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:41.399800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb55372-11a1-421c-86ae-84d207e026d8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:41.399800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb55372-11a1-421c-86ae-84d207e026d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:41.455417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fcb55372-11a1-421c-86ae-84d207e026d8 None None] MFA Rules not processed for user `077919f932db4786af564965a5fb2c68`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:31:41.457520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fcb55372-11a1-421c-86ae-84d207e026d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:41.644429 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1783/3545] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:31:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:31:41.645744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ef701-7633-4b8d-ac03-463377347e32 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:41.646248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ef701-7633-4b8d-ac03-463377347e32 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:41.646333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ef701-7633-4b8d-ac03-463377347e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:41.669618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:31:41.694611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f60ef701-7633-4b8d-ac03-463377347e32 None None] MFA Rules not processed for user `077919f932db4786af564965a5fb2c68`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:31:41.696006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f60ef701-7633-4b8d-ac03-463377347e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:41.715774 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1763/3546] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:31:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:31:42.080731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb55372-11a1-421c-86ae-84d207e026d8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:42.104318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb55372-11a1-421c-86ae-84d207e026d8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:42.110243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537db3f-7c15-4a50-aca9-08c3bb083beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:42.110900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537db3f-7c15-4a50-aca9-08c3bb083beb service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:42.111296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537db3f-7c15-4a50-aca9-08c3bb083beb service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:42.111577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537db3f-7c15-4a50-aca9-08c3bb083beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:42.121966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537db3f-7c15-4a50-aca9-08c3bb083beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:42.123734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537db3f-7c15-4a50-aca9-08c3bb083beb service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:42.149212 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1784/3547] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:31:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:31:42.477468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ef701-7633-4b8d-ac03-463377347e32 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:42.489142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ef701-7633-4b8d-ac03-463377347e32 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:42.493332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aac3e-6399-41a8-82db-7b8c49772f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:42.494083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aac3e-6399-41a8-82db-7b8c49772f43 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:42.494361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aac3e-6399-41a8-82db-7b8c49772f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:42.494633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aac3e-6399-41a8-82db-7b8c49772f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:42.496462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-023aac3e-6399-41a8-82db-7b8c49772f43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:42.511028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023aac3e-6399-41a8-82db-7b8c49772f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:42.514091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023aac3e-6399-41a8-82db-7b8c49772f43 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:42.523708 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1764/3548] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:31:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:31:49.256696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be4079-3667-4311-851c-cda712584169 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:49.257198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be4079-3667-4311-851c-cda712584169 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:49.257513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be4079-3667-4311-851c-cda712584169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:49.290758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-79be4079-3667-4311-851c-cda712584169 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:31:49.292262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79be4079-3667-4311-851c-cda712584169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:49.352617 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1785/3549] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:31:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:31:49.364905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aac3e-6399-41a8-82db-7b8c49772f43 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:49.366797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-023aac3e-6399-41a8-82db-7b8c49772f43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:49.437776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aac3e-6399-41a8-82db-7b8c49772f43 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:49.442859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6614a7e-c32e-4d87-97c2-57786fc0a6e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:49.443518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6614a7e-c32e-4d87-97c2-57786fc0a6e4 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:49.443803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6614a7e-c32e-4d87-97c2-57786fc0a6e4 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:49.444081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6614a7e-c32e-4d87-97c2-57786fc0a6e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:49.452528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6614a7e-c32e-4d87-97c2-57786fc0a6e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:49.454128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6614a7e-c32e-4d87-97c2-57786fc0a6e4 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:49.462902 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1765/3550] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:31:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 18:31:52.491096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be4079-3667-4311-851c-cda712584169 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:52.492706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79be4079-3667-4311-851c-cda712584169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:52.511327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be4079-3667-4311-851c-cda712584169 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:52.517195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ab581-6c00-4ea3-9d1b-60f5c72bb34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:52.517799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ab581-6c00-4ea3-9d1b-60f5c72bb34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:52.518202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ab581-6c00-4ea3-9d1b-60f5c72bb34e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:52.518484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ab581-6c00-4ea3-9d1b-60f5c72bb34e admin admin] PATH_INFO: `/v3/users/7127c83048e74e2e98cb97aae410018f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:52.519773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ab581-6c00-4ea3-9d1b-60f5c72bb34e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7127c83048e74e2e98cb97aae410018f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:52.521963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ab581-6c00-4ea3-9d1b-60f5c72bb34e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:52.598270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae7ab581-6c00-4ea3-9d1b-60f5c72bb34e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7127c83048e74e2e98cb97aae410018f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:52.599421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae7ab581-6c00-4ea3-9d1b-60f5c72bb34e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7127c83048e74e2e98cb97aae410018f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:52.608559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae7ab581-6c00-4ea3-9d1b-60f5c72bb34e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7127c83048e74e2e98cb97aae410018f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:52.618276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae7ab581-6c00-4ea3-9d1b-60f5c72bb34e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7127c83048e74e2e98cb97aae410018f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:52.634668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:31:52.636938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae7ab581-6c00-4ea3-9d1b-60f5c72bb34e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7127c83048e74e2e98cb97aae410018f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:52.651386 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1786/3551] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:31:52 2022] DELETE /identity/v3/users/7127c83048e74e2e98cb97aae410018f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:31:52.911479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6614a7e-c32e-4d87-97c2-57786fc0a6e4 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:52.928767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6614a7e-c32e-4d87-97c2-57786fc0a6e4 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:52.990839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685f968-4de4-4a4d-8680-0a078495e856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:52.991971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685f968-4de4-4a4d-8680-0a078495e856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:52.992168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685f968-4de4-4a4d-8680-0a078495e856 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:52.992612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685f968-4de4-4a4d-8680-0a078495e856 admin admin] PATH_INFO: `/v3/projects/ece04783cf9540a48a100be2f53d76b5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:52.993980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685f968-4de4-4a4d-8680-0a078495e856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece04783cf9540a48a100be2f53d76b5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:52.996116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685f968-4de4-4a4d-8680-0a078495e856 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:53.070640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0685f968-4de4-4a4d-8680-0a078495e856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece04783cf9540a48a100be2f53d76b5', 'request_id': 'req-0685f968-4de4-4a4d-8680-0a078495e856'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:53.078252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0685f968-4de4-4a4d-8680-0a078495e856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece04783cf9540a48a100be2f53d76b5', 'request_id': 'req-0685f968-4de4-4a4d-8680-0a078495e856'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:53.084495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0685f968-4de4-4a4d-8680-0a078495e856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece04783cf9540a48a100be2f53d76b5', 'request_id': 'req-0685f968-4de4-4a4d-8680-0a078495e856'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:53.132818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0685f968-4de4-4a4d-8680-0a078495e856 admin admin] The token cache is being invalidate because project ece04783cf9540a48a100be2f53d76b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:31:53.133298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0685f968-4de4-4a4d-8680-0a078495e856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:53.134567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0685f968-4de4-4a4d-8680-0a078495e856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:31:53.140475 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1766/3552] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:31:52 2022] DELETE /identity/v3/projects/ece04783cf9540a48a100be2f53d76b5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:31:53.142696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd7b48-11b2-4ed7-935e-54b087443823 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:53.148067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd7b48-11b2-4ed7-935e-54b087443823 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:53.148353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd7b48-11b2-4ed7-935e-54b087443823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:53.190470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8bcd7b48-11b2-4ed7-935e-54b087443823 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:31:53.193447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8bcd7b48-11b2-4ed7-935e-54b087443823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:53.332685 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1787/3553] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:31:53.333790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808335c-c075-479f-a080-d4108d28797f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:53.334080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808335c-c075-479f-a080-d4108d28797f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:53.334381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808335c-c075-479f-a080-d4108d28797f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:53.345524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:31:53.359878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c808335c-c075-479f-a080-d4108d28797f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:31:53.362045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c808335c-c075-479f-a080-d4108d28797f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:53.371523 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1767/3554] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:31:53.377552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd7b48-11b2-4ed7-935e-54b087443823 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:53.389984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd7b48-11b2-4ed7-935e-54b087443823 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:53.395773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ea869-39a5-4a9b-8a2f-46f7c9310a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:53.396486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea869-39a5-4a9b-8a2f-46f7c9310a50 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:53.396827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea869-39a5-4a9b-8a2f-46f7c9310a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:53.397100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea869-39a5-4a9b-8a2f-46f7c9310a50 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:53.397757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ea869-39a5-4a9b-8a2f-46f7c9310a50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:31:53.398052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ea869-39a5-4a9b-8a2f-46f7c9310a50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:53.399692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ea869-39a5-4a9b-8a2f-46f7c9310a50 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:53.415643 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1788/3555] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:31:53.416598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808335c-c075-479f-a080-d4108d28797f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:53.429915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808335c-c075-479f-a080-d4108d28797f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:53.434715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8a1cc-28e1-4c05-956f-35ca76c75aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:53.435364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8a1cc-28e1-4c05-956f-35ca76c75aba admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:53.435640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8a1cc-28e1-4c05-956f-35ca76c75aba admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:53.435908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8a1cc-28e1-4c05-956f-35ca76c75aba admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:53.436539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8a1cc-28e1-4c05-956f-35ca76c75aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:53.438463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8a1cc-28e1-4c05-956f-35ca76c75aba admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:53.471501 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1768/3556] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:31:53 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:31:53.472607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ea869-39a5-4a9b-8a2f-46f7c9310a50 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:53.489078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ea869-39a5-4a9b-8a2f-46f7c9310a50 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:53.548762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd603a9b-91b4-4446-a263-6984c2ce6d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:53.549411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd603a9b-91b4-4446-a263-6984c2ce6d32 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:53.549641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd603a9b-91b4-4446-a263-6984c2ce6d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:53.549914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd603a9b-91b4-4446-a263-6984c2ce6d32 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:53.550553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd603a9b-91b4-4446-a263-6984c2ce6d32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:53.552613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd603a9b-91b4-4446-a263-6984c2ce6d32 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:53.579519 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1789/3557] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:31:53 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:31:53.583743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8a1cc-28e1-4c05-956f-35ca76c75aba admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:53.594095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8a1cc-28e1-4c05-956f-35ca76c75aba admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:53.598704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccbe6a-4eb7-49f6-a8f7-bf130b3485c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:53.599329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccbe6a-4eb7-49f6-a8f7-bf130b3485c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:53.599608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccbe6a-4eb7-49f6-a8f7-bf130b3485c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:53.599877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccbe6a-4eb7-49f6-a8f7-bf130b3485c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:53.600513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ccbe6a-4eb7-49f6-a8f7-bf130b3485c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:53.602351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ccbe6a-4eb7-49f6-a8f7-bf130b3485c1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:53.612970 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1769/3558] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:31:53.617374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd603a9b-91b4-4446-a263-6984c2ce6d32 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:53.627357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd603a9b-91b4-4446-a263-6984c2ce6d32 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:53.631961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ff33e-e84c-41c6-9c4d-2efef27d4a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:53.632751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ff33e-e84c-41c6-9c4d-2efef27d4a54 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:53.633024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ff33e-e84c-41c6-9c4d-2efef27d4a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:53.633294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ff33e-e84c-41c6-9c4d-2efef27d4a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:53.633928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ff33e-e84c-41c6-9c4d-2efef27d4a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:53.635567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ff33e-e84c-41c6-9c4d-2efef27d4a54 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:53.646380 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1790/3559] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:31:53.650740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccbe6a-4eb7-49f6-a8f7-bf130b3485c1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:53.664992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccbe6a-4eb7-49f6-a8f7-bf130b3485c1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:53.670065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f317275-bb7c-4f06-b2fd-fd260739a112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:53.670842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f317275-bb7c-4f06-b2fd-fd260739a112 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:53.671186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f317275-bb7c-4f06-b2fd-fd260739a112 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:53.671658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f317275-bb7c-4f06-b2fd-fd260739a112 admin admin] PATH_INFO: `/v3/projects/b8921b78abc9419a991b4d0a6027e43c/users/f2d62e73e5024dde96d48cdd0e375d1d/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:53.687150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f317275-bb7c-4f06-b2fd-fd260739a112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8921b78abc9419a991b4d0a6027e43c, user_id=f2d62e73e5024dde96d48cdd0e375d1d, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:53.689880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f317275-bb7c-4f06-b2fd-fd260739a112 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:53.704590 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1770/3560] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:31:53 2022] PUT /identity/v3/projects/b8921b78abc9419a991b4d0a6027e43c/users/f2d62e73e5024dde96d48cdd0e375d1d/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:31:53.709556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64204c-e7ec-45d4-b62a-985d9deda873 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:53.709827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64204c-e7ec-45d4-b62a-985d9deda873 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:53.710100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64204c-e7ec-45d4-b62a-985d9deda873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:53.731948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9e64204c-e7ec-45d4-b62a-985d9deda873 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:31:53.733202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e64204c-e7ec-45d4-b62a-985d9deda873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:53.784454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:31:53.794915 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1791/3561] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:31:53.804872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f317275-bb7c-4f06-b2fd-fd260739a112 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:31:53.806691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7f317275-bb7c-4f06-b2fd-fd260739a112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:31:53.866986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f317275-bb7c-4f06-b2fd-fd260739a112 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:31:53.871066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe5e1d-c55d-4ed0-8093-e50aeaa40245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:31:53.871692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5e1d-c55d-4ed0-8093-e50aeaa40245 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:31:53.871953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5e1d-c55d-4ed0-8093-e50aeaa40245 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:31:53.872220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5e1d-c55d-4ed0-8093-e50aeaa40245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:31:53.881543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe5e1d-c55d-4ed0-8093-e50aeaa40245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:31:53.883132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe5e1d-c55d-4ed0-8093-e50aeaa40245 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:31:53.893711 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1771/3562] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:32:01.384524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39bb06-54cb-42c4-a7d8-dc727c7be096 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:32:01.385007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39bb06-54cb-42c4-a7d8-dc727c7be096 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:32:01.385007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39bb06-54cb-42c4-a7d8-dc727c7be096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:32:01.412563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9e39bb06-54cb-42c4-a7d8-dc727c7be096 None None] MFA Rules not processed for user `47aab8bfff21443891308d80f7059b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:32:01.414879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e39bb06-54cb-42c4-a7d8-dc727c7be096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:32:01.533256 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1792/3563] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:32:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:32:03.888951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=51,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:32:04.107837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b81ae-e23d-4b1d-a780-85389e6f64d0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:32:04.108011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b81ae-e23d-4b1d-a780-85389e6f64d0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:32:04.108300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b81ae-e23d-4b1d-a780-85389e6f64d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:32:04.130008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a19b81ae-e23d-4b1d-a780-85389e6f64d0 None None] MFA Rules not processed for user `ed083a289526439ea93593880be3ef86`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:32:04.131267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a19b81ae-e23d-4b1d-a780-85389e6f64d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:32:04.210225 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1772/3564] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:32:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:32:04.376252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f60941-59f5-43ab-8c94-923ecf25f8a6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:32:04.377378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f60941-59f5-43ab-8c94-923ecf25f8a6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:32:04.377875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f60941-59f5-43ab-8c94-923ecf25f8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:32:04.422307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-43f60941-59f5-43ab-8c94-923ecf25f8a6 None None] MFA Rules not processed for user `f2d62e73e5024dde96d48cdd0e375d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:32:04.424107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-43f60941-59f5-43ab-8c94-923ecf25f8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:32:04.539923 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1793/3565] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:32:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:32:04.631811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b81ae-e23d-4b1d-a780-85389e6f64d0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:32:04.635752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a19b81ae-e23d-4b1d-a780-85389e6f64d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:32:04.648991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f60941-59f5-43ab-8c94-923ecf25f8a6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:32:04.651119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-43f60941-59f5-43ab-8c94-923ecf25f8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:32:04.745763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f60941-59f5-43ab-8c94-923ecf25f8a6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:32:04.748945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b81ae-e23d-4b1d-a780-85389e6f64d0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:32:04.752413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8d4dc-066b-42d1-baed-d6c63991e1af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:32:04.753459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8d4dc-066b-42d1-baed-d6c63991e1af service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:32:04.753901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8d4dc-066b-42d1-baed-d6c63991e1af service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:32:04.754180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8d4dc-066b-42d1-baed-d6c63991e1af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:32:04.754892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72beac75-b8bc-491b-a10b-5b1dc9e91668 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:32:04.755692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72beac75-b8bc-491b-a10b-5b1dc9e91668 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:32:04.756136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72beac75-b8bc-491b-a10b-5b1dc9e91668 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:32:04.756734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72beac75-b8bc-491b-a10b-5b1dc9e91668 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:32:04.758910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-72beac75-b8bc-491b-a10b-5b1dc9e91668 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:32:04.763196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8d4dc-066b-42d1-baed-d6c63991e1af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:32:04.764852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8d4dc-066b-42d1-baed-d6c63991e1af service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:32:04.776704 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1794/3566] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:32:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:32:04.777893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72beac75-b8bc-491b-a10b-5b1dc9e91668 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:32:04.779762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72beac75-b8bc-491b-a10b-5b1dc9e91668 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:32:04.793884 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1773/3567] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:32:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:32:06.830530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e9367-4095-4aac-bf62-feb37f56f2cb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:32:06.831054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e9367-4095-4aac-bf62-feb37f56f2cb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:32:06.831151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e9367-4095-4aac-bf62-feb37f56f2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:32:06.854065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3f1e9367-4095-4aac-bf62-feb37f56f2cb None None] MFA Rules not processed for user `f2d62e73e5024dde96d48cdd0e375d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:32:06.855588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f1e9367-4095-4aac-bf62-feb37f56f2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:32:06.864877 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1795/3568] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:32:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:32:07.682467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72beac75-b8bc-491b-a10b-5b1dc9e91668 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:32:07.683936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-72beac75-b8bc-491b-a10b-5b1dc9e91668 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:32:07.705923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72beac75-b8bc-491b-a10b-5b1dc9e91668 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:32:07.724786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982ff63-1cf7-4e5d-903e-6f2bc7e1eb7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:32:07.725836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982ff63-1cf7-4e5d-903e-6f2bc7e1eb7f service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:32:07.726178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982ff63-1cf7-4e5d-903e-6f2bc7e1eb7f service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:32:07.726457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982ff63-1cf7-4e5d-903e-6f2bc7e1eb7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:32:07.728870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5982ff63-1cf7-4e5d-903e-6f2bc7e1eb7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:32:07.759584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982ff63-1cf7-4e5d-903e-6f2bc7e1eb7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:32:07.761513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982ff63-1cf7-4e5d-903e-6f2bc7e1eb7f service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:32:07.773785 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1774/3569] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:32:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:32:16.848483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:32:17.768673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=63 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:32:23.443318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c276b2-09b0-4a86-92bd-fe4ac2d0ca87 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:32:23.443899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c276b2-09b0-4a86-92bd-fe4ac2d0ca87 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:32:23.443899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c276b2-09b0-4a86-92bd-fe4ac2d0ca87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:32:23.465554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-77c276b2-09b0-4a86-92bd-fe4ac2d0ca87 None None] MFA Rules not processed for user `077919f932db4786af564965a5fb2c68`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:32:23.466857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77c276b2-09b0-4a86-92bd-fe4ac2d0ca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:32:23.528241 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1796/3570] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:32:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:32:25.507132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982ff63-1cf7-4e5d-903e-6f2bc7e1eb7f service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:32:25.508883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5982ff63-1cf7-4e5d-903e-6f2bc7e1eb7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:32:25.521818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982ff63-1cf7-4e5d-903e-6f2bc7e1eb7f service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:32:25.526069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44705bf-c19f-4322-8fb2-562ba1367901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:32:25.526965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44705bf-c19f-4322-8fb2-562ba1367901 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:32:25.527357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44705bf-c19f-4322-8fb2-562ba1367901 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:32:25.528079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44705bf-c19f-4322-8fb2-562ba1367901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:32:25.530526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b44705bf-c19f-4322-8fb2-562ba1367901 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:32:25.541440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44705bf-c19f-4322-8fb2-562ba1367901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:32:25.542881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44705bf-c19f-4322-8fb2-562ba1367901 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:32:25.551146 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1775/3571] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:32:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:32:25.715734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c276b2-09b0-4a86-92bd-fe4ac2d0ca87 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:32:25.739953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c276b2-09b0-4a86-92bd-fe4ac2d0ca87 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:32:25.745689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aaf2d1-96b6-4d0e-8535-d1821b2b09c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:32:25.746303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaf2d1-96b6-4d0e-8535-d1821b2b09c4 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:32:25.746704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaf2d1-96b6-4d0e-8535-d1821b2b09c4 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:32:25.746985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaf2d1-96b6-4d0e-8535-d1821b2b09c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:32:25.748870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-95aaf2d1-96b6-4d0e-8535-d1821b2b09c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:32:25.761159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aaf2d1-96b6-4d0e-8535-d1821b2b09c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:32:25.762784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aaf2d1-96b6-4d0e-8535-d1821b2b09c4 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:32:25.773284 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1797/3572] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:32:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:32:35.547487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:32:35.768711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=31 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:00.009388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44705bf-c19f-4322-8fb2-562ba1367901 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:00.010967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b44705bf-c19f-4322-8fb2-562ba1367901 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:00.030028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44705bf-c19f-4322-8fb2-562ba1367901 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:00.034833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7e598-114b-492b-a911-1d41fc1f70f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:00.035498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7e598-114b-492b-a911-1d41fc1f70f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:00.035782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7e598-114b-492b-a911-1d41fc1f70f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:00.036058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7e598-114b-492b-a911-1d41fc1f70f3 admin admin] PATH_INFO: `/v3/users/077919f932db4786af564965a5fb2c68` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:00.037369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7e598-114b-492b-a911-1d41fc1f70f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=077919f932db4786af564965a5fb2c68)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:00.039316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7e598-114b-492b-a911-1d41fc1f70f3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:00.106519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aaf2d1-96b6-4d0e-8535-d1821b2b09c4 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:00.110533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-95aaf2d1-96b6-4d0e-8535-d1821b2b09c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:00.124858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eae7e598-114b-492b-a911-1d41fc1f70f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '077919f932db4786af564965a5fb2c68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:00.130976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aaf2d1-96b6-4d0e-8535-d1821b2b09c4 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:00.136491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38916e0-3e70-4f69-9999-9a708792c4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:00.137515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38916e0-3e70-4f69-9999-9a708792c4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:00.137838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38916e0-3e70-4f69-9999-9a708792c4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:00.138179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38916e0-3e70-4f69-9999-9a708792c4c4 admin admin] PATH_INFO: `/v3/users/fa8091f56de8476b9161efb9269155ad` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:00.139562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38916e0-3e70-4f69-9999-9a708792c4c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa8091f56de8476b9161efb9269155ad)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:00.141705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38916e0-3e70-4f69-9999-9a708792c4c4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:00.149862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eae7e598-114b-492b-a911-1d41fc1f70f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '077919f932db4786af564965a5fb2c68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:00.150759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eae7e598-114b-492b-a911-1d41fc1f70f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '077919f932db4786af564965a5fb2c68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:00.151559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eae7e598-114b-492b-a911-1d41fc1f70f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '077919f932db4786af564965a5fb2c68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:00.168317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eae7e598-114b-492b-a911-1d41fc1f70f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '077919f932db4786af564965a5fb2c68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:00.185217 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1776/3573] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:00 2022] DELETE /identity/v3/users/077919f932db4786af564965a5fb2c68 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:00.208619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e38916e0-3e70-4f69-9999-9a708792c4c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa8091f56de8476b9161efb9269155ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:00.209227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e38916e0-3e70-4f69-9999-9a708792c4c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa8091f56de8476b9161efb9269155ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:00.219172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e38916e0-3e70-4f69-9999-9a708792c4c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa8091f56de8476b9161efb9269155ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:00.231442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e38916e0-3e70-4f69-9999-9a708792c4c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa8091f56de8476b9161efb9269155ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:00.256383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e38916e0-3e70-4f69-9999-9a708792c4c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa8091f56de8476b9161efb9269155ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:00.272224 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1798/3574] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:00 2022] DELETE /identity/v3/users/fa8091f56de8476b9161efb9269155ad => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:00.433292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7e598-114b-492b-a911-1d41fc1f70f3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:00.434856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eae7e598-114b-492b-a911-1d41fc1f70f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:00.518171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7e598-114b-492b-a911-1d41fc1f70f3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:00.587880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b7736-cb40-4ae8-a580-425d244749b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:00.588521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b7736-cb40-4ae8-a580-425d244749b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:00.588801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b7736-cb40-4ae8-a580-425d244749b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:00.589077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b7736-cb40-4ae8-a580-425d244749b2 admin admin] PATH_INFO: `/v3/projects/8e04d2c889624b7896caeda18ba278f2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:00.590267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b7736-cb40-4ae8-a580-425d244749b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e04d2c889624b7896caeda18ba278f2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:00.592538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b7736-cb40-4ae8-a580-425d244749b2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:00.624871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:00.653315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-350b7736-cb40-4ae8-a580-425d244749b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e04d2c889624b7896caeda18ba278f2', 'request_id': 'req-350b7736-cb40-4ae8-a580-425d244749b2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:00.662135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-350b7736-cb40-4ae8-a580-425d244749b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e04d2c889624b7896caeda18ba278f2', 'request_id': 'req-350b7736-cb40-4ae8-a580-425d244749b2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:00.669382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-350b7736-cb40-4ae8-a580-425d244749b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e04d2c889624b7896caeda18ba278f2', 'request_id': 'req-350b7736-cb40-4ae8-a580-425d244749b2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:00.694875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-350b7736-cb40-4ae8-a580-425d244749b2 admin admin] The token cache is being invalidate because project 8e04d2c889624b7896caeda18ba278f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:00.695365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-350b7736-cb40-4ae8-a580-425d244749b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:00.703817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-350b7736-cb40-4ae8-a580-425d244749b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:00.710076 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1777/3575] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:00 2022] DELETE /identity/v3/projects/8e04d2c889624b7896caeda18ba278f2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:00.711435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2ff2d-92b5-46b0-b491-3b5da3bf5f2c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:00.711828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2ff2d-92b5-46b0-b491-3b5da3bf5f2c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:00.712084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2ff2d-92b5-46b0-b491-3b5da3bf5f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:00.740225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a8b2ff2d-92b5-46b0-b491-3b5da3bf5f2c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:00.741914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a8b2ff2d-92b5-46b0-b491-3b5da3bf5f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:00.844636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b7736-cb40-4ae8-a580-425d244749b2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:00.846661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-350b7736-cb40-4ae8-a580-425d244749b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:00.875032 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1799/3576] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:00.876592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf783a-e070-4d53-99b4-d964ae02abda None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:00.877284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf783a-e070-4d53-99b4-d964ae02abda None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:00.877284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf783a-e070-4d53-99b4-d964ae02abda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:00.884548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b7736-cb40-4ae8-a580-425d244749b2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:00.891973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1442c-2ee5-424e-976c-2916d4554aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:00.892489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1442c-2ee5-424e-976c-2916d4554aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:00.892824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1442c-2ee5-424e-976c-2916d4554aad admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:00.893109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1442c-2ee5-424e-976c-2916d4554aad admin admin] PATH_INFO: `/v3/projects/85c27ea703774cda8616fd9ce1be1b02` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:00.894549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1442c-2ee5-424e-976c-2916d4554aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c27ea703774cda8616fd9ce1be1b02)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:00.896678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1442c-2ee5-424e-976c-2916d4554aad admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:00.900121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8ebf783a-e070-4d53-99b4-d964ae02abda None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:00.901333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ebf783a-e070-4d53-99b4-d964ae02abda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:00.910363 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1800/3577] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:00.914490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf783a-e070-4d53-99b4-d964ae02abda None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:00.926511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf783a-e070-4d53-99b4-d964ae02abda None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:00.933448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77317601-28f9-4fbe-8e37-cfb73ef2b5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:00.934171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77317601-28f9-4fbe-8e37-cfb73ef2b5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:00.934525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77317601-28f9-4fbe-8e37-cfb73ef2b5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:00.934947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77317601-28f9-4fbe-8e37-cfb73ef2b5e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:00.935836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77317601-28f9-4fbe-8e37-cfb73ef2b5e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:00.936250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77317601-28f9-4fbe-8e37-cfb73ef2b5e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:00.938030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77317601-28f9-4fbe-8e37-cfb73ef2b5e2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:00.952498 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1801/3578] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:00.957276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77317601-28f9-4fbe-8e37-cfb73ef2b5e2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:00.968393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e4f1442c-2ee5-424e-976c-2916d4554aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c27ea703774cda8616fd9ce1be1b02', 'request_id': 'req-e4f1442c-2ee5-424e-976c-2916d4554aad'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:00.970029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77317601-28f9-4fbe-8e37-cfb73ef2b5e2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:00.979324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e4f1442c-2ee5-424e-976c-2916d4554aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c27ea703774cda8616fd9ce1be1b02', 'request_id': 'req-e4f1442c-2ee5-424e-976c-2916d4554aad'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:00.991373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e4f1442c-2ee5-424e-976c-2916d4554aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c27ea703774cda8616fd9ce1be1b02', 'request_id': 'req-e4f1442c-2ee5-424e-976c-2916d4554aad'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:01.009556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e4f1442c-2ee5-424e-976c-2916d4554aad admin admin] The token cache is being invalidate because project 85c27ea703774cda8616fd9ce1be1b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:01.010236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e4f1442c-2ee5-424e-976c-2916d4554aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:01.010639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e4f1442c-2ee5-424e-976c-2916d4554aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:01.012188 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1778/3579] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:00 2022] DELETE /identity/v3/projects/85c27ea703774cda8616fd9ce1be1b02 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:01.017522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77c503-5392-46ce-a314-bed9114cd027 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.017998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77c503-5392-46ce-a314-bed9114cd027 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.018541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77c503-5392-46ce-a314-bed9114cd027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.031477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:01.039524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4b77c503-5392-46ce-a314-bed9114cd027 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:01.041018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4b77c503-5392-46ce-a314-bed9114cd027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:01.053997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87dcb6-c3b2-4a9c-bc98-ab4fefd4506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:01.054542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87dcb6-c3b2-4a9c-bc98-ab4fefd4506e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.054896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87dcb6-c3b2-4a9c-bc98-ab4fefd4506e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.055193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87dcb6-c3b2-4a9c-bc98-ab4fefd4506e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.056498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87dcb6-c3b2-4a9c-bc98-ab4fefd4506e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:01.058495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87dcb6-c3b2-4a9c-bc98-ab4fefd4506e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:01.091697 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1802/3580] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:00 2022] POST /identity/v3/projects => generated 395 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:01.096439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87dcb6-c3b2-4a9c-bc98-ab4fefd4506e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:01.098993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b87dcb6-c3b2-4a9c-bc98-ab4fefd4506e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:01.121364 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1779/3581] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:01.130307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9ac59-2ae1-444e-8c03-1c3cb0924584 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.131371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9ac59-2ae1-444e-8c03-1c3cb0924584 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.131764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9ac59-2ae1-444e-8c03-1c3cb0924584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.164220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a6a9ac59-2ae1-444e-8c03-1c3cb0924584 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:01.166029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a6a9ac59-2ae1-444e-8c03-1c3cb0924584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:01.198659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87dcb6-c3b2-4a9c-bc98-ab4fefd4506e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:01.206500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6ca95-c4ee-4e83-a7a5-45b6ceba20c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:01.207813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6ca95-c4ee-4e83-a7a5-45b6ceba20c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.208291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6ca95-c4ee-4e83-a7a5-45b6ceba20c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.208812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6ca95-c4ee-4e83-a7a5-45b6ceba20c4 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.209977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6ca95-c4ee-4e83-a7a5-45b6ceba20c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:01.210159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:01.213403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6ca95-c4ee-4e83-a7a5-45b6ceba20c4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:01.270007 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1780/3582] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:01.271157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9ac59-2ae1-444e-8c03-1c3cb0924584 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:01.272745 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1803/3583] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:01 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:01.273739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6ca95-c4ee-4e83-a7a5-45b6ceba20c4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:01.284683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9ac59-2ae1-444e-8c03-1c3cb0924584 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:01.290188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec8445-e5f6-4b1f-8962-14e4ab05334e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:01.291041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec8445-e5f6-4b1f-8962-14e4ab05334e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.291497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec8445-e5f6-4b1f-8962-14e4ab05334e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.292177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec8445-e5f6-4b1f-8962-14e4ab05334e admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.293245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec8445-e5f6-4b1f-8962-14e4ab05334e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:01.293733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec8445-e5f6-4b1f-8962-14e4ab05334e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:01.296593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec8445-e5f6-4b1f-8962-14e4ab05334e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:01.296897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6ca95-c4ee-4e83-a7a5-45b6ceba20c4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:01.307657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03e9a3-70a1-496d-98dc-26daf67e0467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:01.310072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03e9a3-70a1-496d-98dc-26daf67e0467 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.310514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03e9a3-70a1-496d-98dc-26daf67e0467 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.311624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03e9a3-70a1-496d-98dc-26daf67e0467 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.312459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03e9a3-70a1-496d-98dc-26daf67e0467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:01.319299 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1781/3584] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:01.325187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec8445-e5f6-4b1f-8962-14e4ab05334e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:01.327216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03e9a3-70a1-496d-98dc-26daf67e0467 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:01.363415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec8445-e5f6-4b1f-8962-14e4ab05334e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:01.364772 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1804/3585] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:01.369261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ed00f-7241-4685-9f9d-c77cfc4438ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:01.369975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ed00f-7241-4685-9f9d-c77cfc4438ee admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.370282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ed00f-7241-4685-9f9d-c77cfc4438ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.370564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ed00f-7241-4685-9f9d-c77cfc4438ee admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.371236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ed00f-7241-4685-9f9d-c77cfc4438ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:01.371405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03e9a3-70a1-496d-98dc-26daf67e0467 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:01.373291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ed00f-7241-4685-9f9d-c77cfc4438ee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:01.386805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03e9a3-70a1-496d-98dc-26daf67e0467 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:01.410363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda15df-5dee-43e4-aa12-ef30952ca295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:01.411597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda15df-5dee-43e4-aa12-ef30952ca295 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.413481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda15df-5dee-43e4-aa12-ef30952ca295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.413943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda15df-5dee-43e4-aa12-ef30952ca295 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.416985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda15df-5dee-43e4-aa12-ef30952ca295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:01.420178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda15df-5dee-43e4-aa12-ef30952ca295 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:01.427448 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1782/3586] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:01 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:01.429604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ed00f-7241-4685-9f9d-c77cfc4438ee admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:01.446068 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1805/3587] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:01.447052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda15df-5dee-43e4-aa12-ef30952ca295 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:01.459895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda15df-5dee-43e4-aa12-ef30952ca295 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:01.516199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ed00f-7241-4685-9f9d-c77cfc4438ee admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:01.523086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25d202-7417-4887-93f4-f60212235655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:01.524005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25d202-7417-4887-93f4-f60212235655 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.524476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25d202-7417-4887-93f4-f60212235655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.524749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25d202-7417-4887-93f4-f60212235655 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.525402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25d202-7417-4887-93f4-f60212235655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:01.527375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25d202-7417-4887-93f4-f60212235655 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:01.545289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6e3b7-0951-4769-b893-b3b5cbeeef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:01.545970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6e3b7-0951-4769-b893-b3b5cbeeef85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.547195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6e3b7-0951-4769-b893-b3b5cbeeef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.547551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6e3b7-0951-4769-b893-b3b5cbeeef85 admin admin] PATH_INFO: `/v3/projects/acee6c3e050744ec90c5b33f9c1c23dc/users/fde0e29c8a054b11acf508071cb27661/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.559098 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1783/3588] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:01 2022] POST /identity/v3/users => generated 282 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:01.560679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25d202-7417-4887-93f4-f60212235655 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:01.566199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6e3b7-0951-4769-b893-b3b5cbeeef85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acee6c3e050744ec90c5b33f9c1c23dc, user_id=fde0e29c8a054b11acf508071cb27661, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:01.569361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6e3b7-0951-4769-b893-b3b5cbeeef85 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:01.573519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25d202-7417-4887-93f4-f60212235655 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:01.581291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839059e8-6dfa-4ae0-8e00-f7d5943eeff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:01.582398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839059e8-6dfa-4ae0-8e00-f7d5943eeff0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.582863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839059e8-6dfa-4ae0-8e00-f7d5943eeff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.583035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839059e8-6dfa-4ae0-8e00-f7d5943eeff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.584242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839059e8-6dfa-4ae0-8e00-f7d5943eeff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:01.585790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839059e8-6dfa-4ae0-8e00-f7d5943eeff0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:01.598133 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1806/3589] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:01 2022] PUT /identity/v3/projects/acee6c3e050744ec90c5b33f9c1c23dc/users/fde0e29c8a054b11acf508071cb27661/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:01.616854 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1784/3590] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:01.617049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eba67-11ea-42fe-bd0f-e62b9a1f745a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.617049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eba67-11ea-42fe-bd0f-e62b9a1f745a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.617049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eba67-11ea-42fe-bd0f-e62b9a1f745a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.617343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839059e8-6dfa-4ae0-8e00-f7d5943eeff0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:01.622868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839059e8-6dfa-4ae0-8e00-f7d5943eeff0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:01.640619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4f5eba67-11ea-42fe-bd0f-e62b9a1f745a None None] MFA Rules not processed for user `fde0e29c8a054b11acf508071cb27661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:01.641934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f5eba67-11ea-42fe-bd0f-e62b9a1f745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:01.658858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:01.681328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5b588-86ce-4c95-9ce6-7e03cbb7fd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:01.682218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b588-86ce-4c95-9ce6-7e03cbb7fd95 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.682499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b588-86ce-4c95-9ce6-7e03cbb7fd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.682775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b588-86ce-4c95-9ce6-7e03cbb7fd95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.683451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5b588-86ce-4c95-9ce6-7e03cbb7fd95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:01.685096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5b588-86ce-4c95-9ce6-7e03cbb7fd95 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:01.694771 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1785/3591] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:33:01.698855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5b588-86ce-4c95-9ce6-7e03cbb7fd95 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:01.709130 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1807/3592] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:01.709292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5b588-86ce-4c95-9ce6-7e03cbb7fd95 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:01.714154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff8549-8553-45ef-9e6c-831ab53a8294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:01.714784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff8549-8553-45ef-9e6c-831ab53a8294 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.715062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff8549-8553-45ef-9e6c-831ab53a8294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.715418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff8549-8553-45ef-9e6c-831ab53a8294 admin admin] PATH_INFO: `/v3/projects/5a551b5591c4409e9c19b95ca99eecec/users/4d84581730a84c3baa33385bb14200ea/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.720145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864eb7d-d67f-4f28-9877-75bc1feb4a54 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.720433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864eb7d-d67f-4f28-9877-75bc1feb4a54 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.720709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864eb7d-d67f-4f28-9877-75bc1feb4a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.732427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:01.735958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff8549-8553-45ef-9e6c-831ab53a8294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a551b5591c4409e9c19b95ca99eecec, user_id=4d84581730a84c3baa33385bb14200ea, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:01.739577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff8549-8553-45ef-9e6c-831ab53a8294 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:01.740177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d864eb7d-d67f-4f28-9877-75bc1feb4a54 None None] MFA Rules not processed for user `fde0e29c8a054b11acf508071cb27661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:01.741384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d864eb7d-d67f-4f28-9877-75bc1feb4a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:01.749383 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1808/3593] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:01.755691 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1786/3594] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:01 2022] PUT /identity/v3/projects/5a551b5591c4409e9c19b95ca99eecec/users/4d84581730a84c3baa33385bb14200ea/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:01.760653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93a58f-ce9c-435a-90e8-d6349299c371 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.760933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93a58f-ce9c-435a-90e8-d6349299c371 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.761207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93a58f-ce9c-435a-90e8-d6349299c371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.764514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff8549-8553-45ef-9e6c-831ab53a8294 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:01.766406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b3ff8549-8553-45ef-9e6c-831ab53a8294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:01.782834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ea93a58f-ce9c-435a-90e8-d6349299c371 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:01.784222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea93a58f-ce9c-435a-90e8-d6349299c371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:01.851603 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1809/3595] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:01.854339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff8549-8553-45ef-9e6c-831ab53a8294 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:01.861307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93a58f-ce9c-435a-90e8-d6349299c371 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:01.862739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea93a58f-ce9c-435a-90e8-d6349299c371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:01.863030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c0caf-1cad-4e09-8531-fabd9cf409c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:01.863701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c0caf-1cad-4e09-8531-fabd9cf409c0 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.864050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c0caf-1cad-4e09-8531-fabd9cf409c0 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.864267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c0caf-1cad-4e09-8531-fabd9cf409c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.925988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c0caf-1cad-4e09-8531-fabd9cf409c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:01.927855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c0caf-1cad-4e09-8531-fabd9cf409c0 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:01.941100 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1787/3596] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:01 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:33:01.942576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93a58f-ce9c-435a-90e8-d6349299c371 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:01.946546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145572ed-52b7-46ac-9003-388460a5b067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:01.947166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145572ed-52b7-46ac-9003-388460a5b067 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.947526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145572ed-52b7-46ac-9003-388460a5b067 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.947763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145572ed-52b7-46ac-9003-388460a5b067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.962045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145572ed-52b7-46ac-9003-388460a5b067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:01.963586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145572ed-52b7-46ac-9003-388460a5b067 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:01.973745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833cd0a-4cb0-410b-9fa5-130f5c4b0dd9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:01.974108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833cd0a-4cb0-410b-9fa5-130f5c4b0dd9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:01.974452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833cd0a-4cb0-410b-9fa5-130f5c4b0dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:01.983581 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1810/3597] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:33:02.004167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f833cd0a-4cb0-410b-9fa5-130f5c4b0dd9 None None] MFA Rules not processed for user `fde0e29c8a054b11acf508071cb27661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:02.005810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f833cd0a-4cb0-410b-9fa5-130f5c4b0dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:02.014615 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1788/3598] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:02.130944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71344d0e-94f3-43ed-9458-3e86f3d36026 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:02.131238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71344d0e-94f3-43ed-9458-3e86f3d36026 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:02.131753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71344d0e-94f3-43ed-9458-3e86f3d36026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:02.151303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-71344d0e-94f3-43ed-9458-3e86f3d36026 None None] MFA Rules not processed for user `fde0e29c8a054b11acf508071cb27661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:02.152517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-71344d0e-94f3-43ed-9458-3e86f3d36026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:02.160290 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1811/3599] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:02.190020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a4fe2-708a-480b-a567-9f44ebce7b4d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:02.190392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a4fe2-708a-480b-a567-9f44ebce7b4d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:02.190743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a4fe2-708a-480b-a567-9f44ebce7b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:02.212884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-108a4fe2-708a-480b-a567-9f44ebce7b4d None None] MFA Rules not processed for user `fde0e29c8a054b11acf508071cb27661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:02.214179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-108a4fe2-708a-480b-a567-9f44ebce7b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:02.221803 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1789/3600] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:02.249608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f2f8f-082e-4975-9835-020cd50f1dd7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:02.250235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f2f8f-082e-4975-9835-020cd50f1dd7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:02.250235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f2f8f-082e-4975-9835-020cd50f1dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:02.270134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5c5f2f8f-082e-4975-9835-020cd50f1dd7 None None] MFA Rules not processed for user `fde0e29c8a054b11acf508071cb27661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:02.271301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5c5f2f8f-082e-4975-9835-020cd50f1dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:02.278422 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1812/3601] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:02.301087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a4fe2-708a-480b-a567-9f44ebce7b4d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:02.312562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a4fe2-708a-480b-a567-9f44ebce7b4d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:02.317155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae07fe-f055-4c0b-98d5-f8e629ababeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:02.317791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae07fe-f055-4c0b-98d5-f8e629ababeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:02.318070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae07fe-f055-4c0b-98d5-f8e629ababeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:02.318347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae07fe-f055-4c0b-98d5-f8e629ababeb admin admin] PATH_INFO: `/v3/users/fde0e29c8a054b11acf508071cb27661` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:02.319598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae07fe-f055-4c0b-98d5-f8e629ababeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde0e29c8a054b11acf508071cb27661)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:02.321531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae07fe-f055-4c0b-98d5-f8e629ababeb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:02.378887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6bae07fe-f055-4c0b-98d5-f8e629ababeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde0e29c8a054b11acf508071cb27661'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:02.399948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6bae07fe-f055-4c0b-98d5-f8e629ababeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde0e29c8a054b11acf508071cb27661'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:02.400837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6bae07fe-f055-4c0b-98d5-f8e629ababeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde0e29c8a054b11acf508071cb27661'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:02.401505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6bae07fe-f055-4c0b-98d5-f8e629ababeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde0e29c8a054b11acf508071cb27661'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:02.404175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:02.410950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6bae07fe-f055-4c0b-98d5-f8e629ababeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde0e29c8a054b11acf508071cb27661'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:02.427449 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1790/3602] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:02 2022] DELETE /identity/v3/users/fde0e29c8a054b11acf508071cb27661 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:02.433118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5621a-2921-4407-8de0-0d55b1685792 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:02.433637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5621a-2921-4407-8de0-0d55b1685792 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:02.433920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5621a-2921-4407-8de0-0d55b1685792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:02.457410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a2b5621a-2921-4407-8de0-0d55b1685792 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:02.458632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a2b5621a-2921-4407-8de0-0d55b1685792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:02.499666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:02.524691 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1813/3603] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:02.532886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae07fe-f055-4c0b-98d5-f8e629ababeb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:02.534421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6bae07fe-f055-4c0b-98d5-f8e629ababeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:02.609744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae07fe-f055-4c0b-98d5-f8e629ababeb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:02.615036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64027b29-c1d3-403c-8801-d8aadc502e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:02.615805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64027b29-c1d3-403c-8801-d8aadc502e85 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:02.616087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64027b29-c1d3-403c-8801-d8aadc502e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:02.616360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64027b29-c1d3-403c-8801-d8aadc502e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:02.629860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64027b29-c1d3-403c-8801-d8aadc502e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:02.631409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64027b29-c1d3-403c-8801-d8aadc502e85 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:02.647121 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1791/3604] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:33:03.301426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5621a-2921-4407-8de0-0d55b1685792 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:03.302937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a2b5621a-2921-4407-8de0-0d55b1685792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:03.324796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5621a-2921-4407-8de0-0d55b1685792 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:03.340383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8664c-6b5f-4ed5-8624-bd4d9641059d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:03.342702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8664c-6b5f-4ed5-8624-bd4d9641059d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:03.343202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8664c-6b5f-4ed5-8624-bd4d9641059d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:03.343805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8664c-6b5f-4ed5-8624-bd4d9641059d admin admin] PATH_INFO: `/v3/projects/acee6c3e050744ec90c5b33f9c1c23dc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:03.349045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8664c-6b5f-4ed5-8624-bd4d9641059d admin admin] RBAC: Authorizing `identity:delete_project(project_id=acee6c3e050744ec90c5b33f9c1c23dc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:03.355783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8664c-6b5f-4ed5-8624-bd4d9641059d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:03.438877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-78b8664c-6b5f-4ed5-8624-bd4d9641059d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acee6c3e050744ec90c5b33f9c1c23dc', 'request_id': 'req-78b8664c-6b5f-4ed5-8624-bd4d9641059d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:03.451046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-78b8664c-6b5f-4ed5-8624-bd4d9641059d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acee6c3e050744ec90c5b33f9c1c23dc', 'request_id': 'req-78b8664c-6b5f-4ed5-8624-bd4d9641059d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:03.480445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-78b8664c-6b5f-4ed5-8624-bd4d9641059d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acee6c3e050744ec90c5b33f9c1c23dc', 'request_id': 'req-78b8664c-6b5f-4ed5-8624-bd4d9641059d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:03.500572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-78b8664c-6b5f-4ed5-8624-bd4d9641059d admin admin] The token cache is being invalidate because project acee6c3e050744ec90c5b33f9c1c23dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:03.501010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-78b8664c-6b5f-4ed5-8624-bd4d9641059d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:03.502399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-78b8664c-6b5f-4ed5-8624-bd4d9641059d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:03.504538 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1814/3605] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:03 2022] DELETE /identity/v3/projects/acee6c3e050744ec90c5b33f9c1c23dc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:03.512269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b8119-abbc-4e46-80c9-6ed75fa201a4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:03.512873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b8119-abbc-4e46-80c9-6ed75fa201a4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:03.514451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b8119-abbc-4e46-80c9-6ed75fa201a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:03.544456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-687b8119-abbc-4e46-80c9-6ed75fa201a4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:03.545798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-687b8119-abbc-4e46-80c9-6ed75fa201a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:03.623932 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1792/3606] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:03.632489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82a0eb-bcde-484d-97c0-9731259cd46e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:03.632769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82a0eb-bcde-484d-97c0-9731259cd46e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:03.633046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82a0eb-bcde-484d-97c0-9731259cd46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:03.661053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fa82a0eb-bcde-484d-97c0-9731259cd46e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:03.662287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fa82a0eb-bcde-484d-97c0-9731259cd46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:03.675837 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1815/3607] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:03.678394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b8119-abbc-4e46-80c9-6ed75fa201a4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:03.691637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b8119-abbc-4e46-80c9-6ed75fa201a4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:03.698012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32343307-9449-4295-8234-938e113c36f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:03.698898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32343307-9449-4295-8234-938e113c36f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:03.699305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32343307-9449-4295-8234-938e113c36f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:03.699679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32343307-9449-4295-8234-938e113c36f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:03.700487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32343307-9449-4295-8234-938e113c36f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:03.700921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32343307-9449-4295-8234-938e113c36f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:03.703348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32343307-9449-4295-8234-938e113c36f8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:03.723670 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1793/3608] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:03.727586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82a0eb-bcde-484d-97c0-9731259cd46e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:03.738507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82a0eb-bcde-484d-97c0-9731259cd46e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:03.744096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabce092-2120-47aa-bc8c-71afe40f63d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:03.744827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabce092-2120-47aa-bc8c-71afe40f63d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:03.745198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabce092-2120-47aa-bc8c-71afe40f63d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:03.745567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabce092-2120-47aa-bc8c-71afe40f63d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:03.746308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabce092-2120-47aa-bc8c-71afe40f63d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:03.748447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabce092-2120-47aa-bc8c-71afe40f63d2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:03.780155 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1816/3609] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:03 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:03.784513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32343307-9449-4295-8234-938e113c36f8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:03.796504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32343307-9449-4295-8234-938e113c36f8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:03.881860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f57981-803a-4aa7-9c86-9497060d471c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:03.882551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f57981-803a-4aa7-9c86-9497060d471c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:03.882882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f57981-803a-4aa7-9c86-9497060d471c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:03.883157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f57981-803a-4aa7-9c86-9497060d471c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:03.883825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f57981-803a-4aa7-9c86-9497060d471c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:03.885752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f57981-803a-4aa7-9c86-9497060d471c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:03.911802 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1794/3610] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:03 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:03.915766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabce092-2120-47aa-bc8c-71afe40f63d2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:03.927478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabce092-2120-47aa-bc8c-71afe40f63d2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:03.932695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e397a-4f36-4c3f-a417-8e342345e473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:03.933930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e397a-4f36-4c3f-a417-8e342345e473 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:03.934214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e397a-4f36-4c3f-a417-8e342345e473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:03.934489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e397a-4f36-4c3f-a417-8e342345e473 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:03.935352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e397a-4f36-4c3f-a417-8e342345e473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:03.937000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e397a-4f36-4c3f-a417-8e342345e473 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:03.948773 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1817/3611] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:03.952964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f57981-803a-4aa7-9c86-9497060d471c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:03.959565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:03.964140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f57981-803a-4aa7-9c86-9497060d471c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:03.972594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ab20c-5284-4552-9f7a-f9f2b557ac68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:03.973384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ab20c-5284-4552-9f7a-f9f2b557ac68 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:03.973981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ab20c-5284-4552-9f7a-f9f2b557ac68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:03.974645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ab20c-5284-4552-9f7a-f9f2b557ac68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:03.975446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ab20c-5284-4552-9f7a-f9f2b557ac68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:03.979992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ab20c-5284-4552-9f7a-f9f2b557ac68 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:03.995560 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1795/3612] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:04.000507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e397a-4f36-4c3f-a417-8e342345e473 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:04.018010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e397a-4f36-4c3f-a417-8e342345e473 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:04.023305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69147ba-3b59-4f6e-84d1-0b27cc168649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:04.024570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69147ba-3b59-4f6e-84d1-0b27cc168649 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:04.024570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69147ba-3b59-4f6e-84d1-0b27cc168649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:04.024856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69147ba-3b59-4f6e-84d1-0b27cc168649 admin admin] PATH_INFO: `/v3/projects/238b44d1867943808fdfa40729dce1bf/users/c4db24ac23a84fc3ac93a885d8d3114f/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:04.040924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69147ba-3b59-4f6e-84d1-0b27cc168649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=238b44d1867943808fdfa40729dce1bf, user_id=c4db24ac23a84fc3ac93a885d8d3114f, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:04.043769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69147ba-3b59-4f6e-84d1-0b27cc168649 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:04.061060 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1818/3613] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:03 2022] PUT /identity/v3/projects/238b44d1867943808fdfa40729dce1bf/users/c4db24ac23a84fc3ac93a885d8d3114f/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:04.066080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc3fb4-240b-499f-9e63-0a62354d0bb5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:04.066372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc3fb4-240b-499f-9e63-0a62354d0bb5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:04.066654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc3fb4-240b-499f-9e63-0a62354d0bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:04.088399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5bdc3fb4-240b-499f-9e63-0a62354d0bb5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:04.089190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5bdc3fb4-240b-499f-9e63-0a62354d0bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:04.162049 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1796/3614] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:04.177335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69147ba-3b59-4f6e-84d1-0b27cc168649 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:04.179163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e69147ba-3b59-4f6e-84d1-0b27cc168649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:04.244793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69147ba-3b59-4f6e-84d1-0b27cc168649 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:04.248724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a935aaf-9a32-4545-ae80-2f96f87cb726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:04.250684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935aaf-9a32-4545-ae80-2f96f87cb726 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:04.250970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935aaf-9a32-4545-ae80-2f96f87cb726 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:04.251248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935aaf-9a32-4545-ae80-2f96f87cb726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:04.261708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a935aaf-9a32-4545-ae80-2f96f87cb726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:04.263192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a935aaf-9a32-4545-ae80-2f96f87cb726 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:04.273671 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1819/3615] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:33:05.033801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c53c8-2aed-4a8d-86af-207bf33d12e0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:05.034261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c53c8-2aed-4a8d-86af-207bf33d12e0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:05.034261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c53c8-2aed-4a8d-86af-207bf33d12e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:05.067158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fe6c53c8-2aed-4a8d-86af-207bf33d12e0 None None] MFA Rules not processed for user `c4db24ac23a84fc3ac93a885d8d3114f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:05.068324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fe6c53c8-2aed-4a8d-86af-207bf33d12e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:05.152118 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1797/3616] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:05.160855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52585631-321a-440d-bd91-fb30255b18c4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:05.161306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52585631-321a-440d-bd91-fb30255b18c4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:05.161389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52585631-321a-440d-bd91-fb30255b18c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:05.179996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:05.196112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-52585631-321a-440d-bd91-fb30255b18c4 None None] MFA Rules not processed for user `c4db24ac23a84fc3ac93a885d8d3114f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:05.197501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52585631-321a-440d-bd91-fb30255b18c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:05.210995 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1820/3617] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:05.222983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c53c8-2aed-4a8d-86af-207bf33d12e0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:05.224657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fe6c53c8-2aed-4a8d-86af-207bf33d12e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:05.366492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c53c8-2aed-4a8d-86af-207bf33d12e0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:05.376419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621226f3-17b8-42ef-bdf6-a787cfc99749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:05.377068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621226f3-17b8-42ef-bdf6-a787cfc99749 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:05.377406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621226f3-17b8-42ef-bdf6-a787cfc99749 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:05.377688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621226f3-17b8-42ef-bdf6-a787cfc99749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:05.388884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621226f3-17b8-42ef-bdf6-a787cfc99749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:05.390507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621226f3-17b8-42ef-bdf6-a787cfc99749 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:05.402695 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1798/3618] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:33:06.360130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52585631-321a-440d-bd91-fb30255b18c4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:06.381654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52585631-321a-440d-bd91-fb30255b18c4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:06.393658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62df774-6c68-4c43-8f3a-4efd3eebb29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:06.394319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62df774-6c68-4c43-8f3a-4efd3eebb29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:06.394611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62df774-6c68-4c43-8f3a-4efd3eebb29d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:06.394866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62df774-6c68-4c43-8f3a-4efd3eebb29d admin admin] PATH_INFO: `/v3/users/c4db24ac23a84fc3ac93a885d8d3114f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:06.396153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62df774-6c68-4c43-8f3a-4efd3eebb29d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4db24ac23a84fc3ac93a885d8d3114f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:06.398175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62df774-6c68-4c43-8f3a-4efd3eebb29d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:06.510032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c62df774-6c68-4c43-8f3a-4efd3eebb29d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4db24ac23a84fc3ac93a885d8d3114f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:06.512016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c62df774-6c68-4c43-8f3a-4efd3eebb29d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4db24ac23a84fc3ac93a885d8d3114f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:06.531155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c62df774-6c68-4c43-8f3a-4efd3eebb29d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4db24ac23a84fc3ac93a885d8d3114f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:06.544195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c62df774-6c68-4c43-8f3a-4efd3eebb29d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4db24ac23a84fc3ac93a885d8d3114f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:06.562246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c62df774-6c68-4c43-8f3a-4efd3eebb29d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4db24ac23a84fc3ac93a885d8d3114f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:06.575759 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1821/3619] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:06 2022] DELETE /identity/v3/users/c4db24ac23a84fc3ac93a885d8d3114f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:06.830012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621226f3-17b8-42ef-bdf6-a787cfc99749 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:06.852447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621226f3-17b8-42ef-bdf6-a787cfc99749 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:06.860250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:06.929131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744597d-b007-4a1e-ab6d-66841e862783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:06.929782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744597d-b007-4a1e-ab6d-66841e862783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:06.930063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744597d-b007-4a1e-ab6d-66841e862783 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:06.930340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744597d-b007-4a1e-ab6d-66841e862783 admin admin] PATH_INFO: `/v3/projects/238b44d1867943808fdfa40729dce1bf` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:06.931551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744597d-b007-4a1e-ab6d-66841e862783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=238b44d1867943808fdfa40729dce1bf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:06.933474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744597d-b007-4a1e-ab6d-66841e862783 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:06.992059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7744597d-b007-4a1e-ab6d-66841e862783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '238b44d1867943808fdfa40729dce1bf', 'request_id': 'req-7744597d-b007-4a1e-ab6d-66841e862783'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:06.998679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7744597d-b007-4a1e-ab6d-66841e862783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '238b44d1867943808fdfa40729dce1bf', 'request_id': 'req-7744597d-b007-4a1e-ab6d-66841e862783'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:07.005009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7744597d-b007-4a1e-ab6d-66841e862783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '238b44d1867943808fdfa40729dce1bf', 'request_id': 'req-7744597d-b007-4a1e-ab6d-66841e862783'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:07.019653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7744597d-b007-4a1e-ab6d-66841e862783 admin admin] The token cache is being invalidate because project 238b44d1867943808fdfa40729dce1bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:07.019960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7744597d-b007-4a1e-ab6d-66841e862783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:07.020597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7744597d-b007-4a1e-ab6d-66841e862783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:07.022366 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1799/3620] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:06 2022] DELETE /identity/v3/projects/238b44d1867943808fdfa40729dce1bf => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:07.031442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c79b-224b-4085-bc15-6d5582ad00f5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:07.031735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c79b-224b-4085-bc15-6d5582ad00f5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:07.032019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c79b-224b-4085-bc15-6d5582ad00f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:07.053080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b363c79b-224b-4085-bc15-6d5582ad00f5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:07.055030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b363c79b-224b-4085-bc15-6d5582ad00f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:07.133265 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1822/3621] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:07.141084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732aa09-a4b6-458e-a115-cebdd9c50bbc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:07.141609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732aa09-a4b6-458e-a115-cebdd9c50bbc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:07.142225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732aa09-a4b6-458e-a115-cebdd9c50bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:07.185497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8732aa09-a4b6-458e-a115-cebdd9c50bbc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:07.186923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8732aa09-a4b6-458e-a115-cebdd9c50bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:07.195086 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1800/3622] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:07.199501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363c79b-224b-4085-bc15-6d5582ad00f5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:07.217617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363c79b-224b-4085-bc15-6d5582ad00f5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:07.222664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2e223-f86c-4618-9714-68a4dfe5af4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:07.223340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2e223-f86c-4618-9714-68a4dfe5af4c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:07.223597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2e223-f86c-4618-9714-68a4dfe5af4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:07.224023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2e223-f86c-4618-9714-68a4dfe5af4c admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:07.224687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2e223-f86c-4618-9714-68a4dfe5af4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:07.224993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2e223-f86c-4618-9714-68a4dfe5af4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:07.227176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2e223-f86c-4618-9714-68a4dfe5af4c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:07.242143 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1823/3623] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:07.246527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732aa09-a4b6-458e-a115-cebdd9c50bbc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:07.261862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732aa09-a4b6-458e-a115-cebdd9c50bbc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:07.280896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20846af9-077d-4130-9c45-4812cabdbbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:07.282053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20846af9-077d-4130-9c45-4812cabdbbfd admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:07.282053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20846af9-077d-4130-9c45-4812cabdbbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:07.282270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20846af9-077d-4130-9c45-4812cabdbbfd admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:07.282801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20846af9-077d-4130-9c45-4812cabdbbfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:07.284776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20846af9-077d-4130-9c45-4812cabdbbfd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:07.322794 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1801/3624] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:07 2022] POST /identity/v3/projects => generated 389 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:07.326667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2e223-f86c-4618-9714-68a4dfe5af4c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:07.347429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2e223-f86c-4618-9714-68a4dfe5af4c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:07.458712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:07.475150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfdede-b855-46d5-8527-c0a3232a1319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:07.476134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfdede-b855-46d5-8527-c0a3232a1319 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:07.476414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfdede-b855-46d5-8527-c0a3232a1319 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:07.476688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfdede-b855-46d5-8527-c0a3232a1319 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:07.477332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfdede-b855-46d5-8527-c0a3232a1319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:07.479382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfdede-b855-46d5-8527-c0a3232a1319 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:07.528130 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1824/3625] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:07 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:07.532700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20846af9-077d-4130-9c45-4812cabdbbfd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:07.545106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20846af9-077d-4130-9c45-4812cabdbbfd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:07.558763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee39fc-a302-4758-b592-6e74a0b8e089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:07.558763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee39fc-a302-4758-b592-6e74a0b8e089 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:07.558763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee39fc-a302-4758-b592-6e74a0b8e089 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:07.558763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee39fc-a302-4758-b592-6e74a0b8e089 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:07.559498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee39fc-a302-4758-b592-6e74a0b8e089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:07.562021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee39fc-a302-4758-b592-6e74a0b8e089 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:07.603835 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1802/3626] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:07.605036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfdede-b855-46d5-8527-c0a3232a1319 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:07.621752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfdede-b855-46d5-8527-c0a3232a1319 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:07.630118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11c7f5-6563-424a-9377-51db54d2822a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:07.630759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11c7f5-6563-424a-9377-51db54d2822a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:07.631041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11c7f5-6563-424a-9377-51db54d2822a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:07.631358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11c7f5-6563-424a-9377-51db54d2822a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:07.632080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11c7f5-6563-424a-9377-51db54d2822a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:07.633650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11c7f5-6563-424a-9377-51db54d2822a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:07.665286 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1825/3627] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:07.669922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee39fc-a302-4758-b592-6e74a0b8e089 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:07.683833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee39fc-a302-4758-b592-6e74a0b8e089 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:07.691377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d0293-5ba3-445d-83a0-2b1f0a0c4bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:07.692360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d0293-5ba3-445d-83a0-2b1f0a0c4bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:07.693347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d0293-5ba3-445d-83a0-2b1f0a0c4bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:07.693347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d0293-5ba3-445d-83a0-2b1f0a0c4bd1 admin admin] PATH_INFO: `/v3/projects/1ce0c0ad267442f4b2b7bba6d0610fff/users/8d045cc7d04c432d905c7ac1068695ee/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:07.723388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d0293-5ba3-445d-83a0-2b1f0a0c4bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce0c0ad267442f4b2b7bba6d0610fff, user_id=8d045cc7d04c432d905c7ac1068695ee, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:07.723388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d0293-5ba3-445d-83a0-2b1f0a0c4bd1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:07.748529 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1803/3628] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:07 2022] PUT /identity/v3/projects/1ce0c0ad267442f4b2b7bba6d0610fff/users/8d045cc7d04c432d905c7ac1068695ee/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:07.760839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77837342-8ccd-43cc-9b8d-386003fbf54c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:07.761126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77837342-8ccd-43cc-9b8d-386003fbf54c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:07.761424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77837342-8ccd-43cc-9b8d-386003fbf54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:07.817952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-77837342-8ccd-43cc-9b8d-386003fbf54c None None] MFA Rules not processed for user `8d045cc7d04c432d905c7ac1068695ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:07.819193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77837342-8ccd-43cc-9b8d-386003fbf54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:07.927841 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1826/3629] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:07.932192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d0293-5ba3-445d-83a0-2b1f0a0c4bd1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:07.998778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:08.032619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d0293-5ba3-445d-83a0-2b1f0a0c4bd1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:08.040496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7476b58-61f8-44d3-a279-74aaae2b727c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:08.041170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7476b58-61f8-44d3-a279-74aaae2b727c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:08.041537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7476b58-61f8-44d3-a279-74aaae2b727c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:08.042018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7476b58-61f8-44d3-a279-74aaae2b727c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:08.042553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7476b58-61f8-44d3-a279-74aaae2b727c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:08.044758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7476b58-61f8-44d3-a279-74aaae2b727c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:08.083170 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1804/3630] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:07 2022] POST /identity/v3/projects => generated 391 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:08.085238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77837342-8ccd-43cc-9b8d-386003fbf54c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:08.096241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77837342-8ccd-43cc-9b8d-386003fbf54c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:08.191611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b811a-805f-4045-ba63-cee764d97cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:08.192712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b811a-805f-4045-ba63-cee764d97cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:08.193784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b811a-805f-4045-ba63-cee764d97cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:08.194297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b811a-805f-4045-ba63-cee764d97cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:08.196772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b811a-805f-4045-ba63-cee764d97cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:08.199417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b811a-805f-4045-ba63-cee764d97cc5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:08.229679 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1827/3631] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:08 2022] POST /identity/v3/users => generated 302 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:08.231110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7476b58-61f8-44d3-a279-74aaae2b727c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:08.250525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7476b58-61f8-44d3-a279-74aaae2b727c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:08.257464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b96a2b-3272-4f38-ab86-89aa2b19e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:08.259757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b96a2b-3272-4f38-ab86-89aa2b19e3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:08.259757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b96a2b-3272-4f38-ab86-89aa2b19e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:08.259757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b96a2b-3272-4f38-ab86-89aa2b19e3e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:08.272264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b96a2b-3272-4f38-ab86-89aa2b19e3e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:08.274454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b96a2b-3272-4f38-ab86-89aa2b19e3e1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:08.293829 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1805/3632] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:08.296414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b811a-805f-4045-ba63-cee764d97cc5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:08.315356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b811a-805f-4045-ba63-cee764d97cc5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:08.321064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243224c-18c6-4a64-a3cd-b781ed44549e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:08.321853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243224c-18c6-4a64-a3cd-b781ed44549e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:08.322131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243224c-18c6-4a64-a3cd-b781ed44549e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:08.322406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243224c-18c6-4a64-a3cd-b781ed44549e admin admin] PATH_INFO: `/v3/projects/26b39a2c4b304adcb177718435afe84e/users/ab1ceef516614c729c7b23ba70e09251/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:08.347059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243224c-18c6-4a64-a3cd-b781ed44549e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b39a2c4b304adcb177718435afe84e, user_id=ab1ceef516614c729c7b23ba70e09251, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:08.351070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243224c-18c6-4a64-a3cd-b781ed44549e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:08.371335 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1828/3633] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:08 2022] PUT /identity/v3/projects/26b39a2c4b304adcb177718435afe84e/users/ab1ceef516614c729c7b23ba70e09251/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:08.375576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b96a2b-3272-4f38-ab86-89aa2b19e3e1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:08.388714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b96a2b-3272-4f38-ab86-89aa2b19e3e1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:08.478058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a59661-6825-447e-8b8e-4f3f479c6547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:08.480202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59661-6825-447e-8b8e-4f3f479c6547 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:08.480597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59661-6825-447e-8b8e-4f3f479c6547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:08.481142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59661-6825-447e-8b8e-4f3f479c6547 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:08.482022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a59661-6825-447e-8b8e-4f3f479c6547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:08.484727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a59661-6825-447e-8b8e-4f3f479c6547 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:08.499623 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1806/3634] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:33:08.503958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243224c-18c6-4a64-a3cd-b781ed44549e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:08.517488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243224c-18c6-4a64-a3cd-b781ed44549e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:08.524184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6a38b-433a-49e8-b003-95e846d8f09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:08.525174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6a38b-433a-49e8-b003-95e846d8f09e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:08.525397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6a38b-433a-49e8-b003-95e846d8f09e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:08.525481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6a38b-433a-49e8-b003-95e846d8f09e admin admin] PATH_INFO: `/v3/projects/26b39a2c4b304adcb177718435afe84e/users/ab1ceef516614c729c7b23ba70e09251/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:08.529345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6a38b-433a-49e8-b003-95e846d8f09e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b39a2c4b304adcb177718435afe84e, user_id=ab1ceef516614c729c7b23ba70e09251, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:08.532502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6a38b-433a-49e8-b003-95e846d8f09e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:08.577963 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1829/3635] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:08 2022] PUT /identity/v3/projects/26b39a2c4b304adcb177718435afe84e/users/ab1ceef516614c729c7b23ba70e09251/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:08.589194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae9863-4be0-4111-8ea1-317f6d65a6f5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:08.589451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae9863-4be0-4111-8ea1-317f6d65a6f5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:08.589698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae9863-4be0-4111-8ea1-317f6d65a6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:08.651128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e8ae9863-4be0-4111-8ea1-317f6d65a6f5 None None] MFA Rules not processed for user `ab1ceef516614c729c7b23ba70e09251`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:08.656983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e8ae9863-4be0-4111-8ea1-317f6d65a6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:08.915732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6a38b-433a-49e8-b003-95e846d8f09e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:08.929078 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1807/3636] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:08 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:08.932188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6a38b-433a-49e8-b003-95e846d8f09e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:08.945404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1732668-8142-407c-913e-df86abd986b6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:08.946049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1732668-8142-407c-913e-df86abd986b6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:08.946334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1732668-8142-407c-913e-df86abd986b6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:08.946611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1732668-8142-407c-913e-df86abd986b6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:08.947329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1732668-8142-407c-913e-df86abd986b6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:08.948522 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-f1732668-8142-407c-913e-df86abd986b6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:08.948522 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:08.948522 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:08.949662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1732668-8142-407c-913e-df86abd986b6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:08.993081 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1830/3637] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:33:08 2022] POST /identity/v3/domains => generated 276 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:08.999990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae9863-4be0-4111-8ea1-317f6d65a6f5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:09.010257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae9863-4be0-4111-8ea1-317f6d65a6f5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:09.112281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:09.158190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4baa38-a62d-42ab-a203-f72fa6fa0d5e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:09.158960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4baa38-a62d-42ab-a203-f72fa6fa0d5e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:09.159348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4baa38-a62d-42ab-a203-f72fa6fa0d5e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:09.159628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4baa38-a62d-42ab-a203-f72fa6fa0d5e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141/config` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:09.160448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4baa38-a62d-42ab-a203-f72fa6fa0d5e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=bc9139c8a7674bd3b26b4dcdb018b141)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:09.161467 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-ca4baa38-a62d-42ab-a203-f72fa6fa0d5e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:09.161467 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:09.161467 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:09.163890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4baa38-a62d-42ab-a203-f72fa6fa0d5e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:09.251178 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1808/3638] 10.222.0.27 () {60 vars in 1269 bytes} [Sun Aug 28 18:33:08 2022] PUT /identity/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141/config => generated 138 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:09.255458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1732668-8142-407c-913e-df86abd986b6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:09.271636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:09.276125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1732668-8142-407c-913e-df86abd986b6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:09.291398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe59a4f-7099-441e-a90d-723d2daf93ea tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:09.292725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe59a4f-7099-441e-a90d-723d2daf93ea tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:09.293176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe59a4f-7099-441e-a90d-723d2daf93ea tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:09.300042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe59a4f-7099-441e-a90d-723d2daf93ea tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141/config/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:09.302081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe59a4f-7099-441e-a90d-723d2daf93ea tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=bc9139c8a7674bd3b26b4dcdb018b141, group=identity)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:09.303985 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-7fe59a4f-7099-441e-a90d-723d2daf93ea tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:09.303985 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:09.303985 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:09.305675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe59a4f-7099-441e-a90d-723d2daf93ea tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:09.322623 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1831/3639] 10.222.0.27 () {58 vars in 1275 bytes} [Sun Aug 28 18:33:09 2022] GET /identity/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141/config/identity => generated 45 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:09.326901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4baa38-a62d-42ab-a203-f72fa6fa0d5e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:09.339215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4baa38-a62d-42ab-a203-f72fa6fa0d5e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:09.344140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702770fe-c906-4bf5-bfce-1f456f0876cd tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:09.344813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702770fe-c906-4bf5-bfce-1f456f0876cd tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:09.345094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702770fe-c906-4bf5-bfce-1f456f0876cd tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:09.345372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702770fe-c906-4bf5-bfce-1f456f0876cd tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141/config/identity/driver` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:09.346657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702770fe-c906-4bf5-bfce-1f456f0876cd tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=bc9139c8a7674bd3b26b4dcdb018b141, group=identity, option=driver)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:09.347709 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-702770fe-c906-4bf5-bfce-1f456f0876cd tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:09.347709 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:09.347709 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:09.348620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702770fe-c906-4bf5-bfce-1f456f0876cd tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:09.355955 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1809/3640] 10.222.0.27 () {58 vars in 1296 bytes} [Sun Aug 28 18:33:09 2022] GET /identity/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141/config/identity/driver => generated 31 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 18:33:09.359991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe59a4f-7099-441e-a90d-723d2daf93ea tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:09.372626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe59a4f-7099-441e-a90d-723d2daf93ea tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:09.381065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd87f1-c845-49a6-b8cb-16e3c153b253 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:09.381065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd87f1-c845-49a6-b8cb-16e3c153b253 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:09.381065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd87f1-c845-49a6-b8cb-16e3c153b253 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:09.381333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd87f1-c845-49a6-b8cb-16e3c153b253 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141/config/ldap` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:09.382726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd87f1-c845-49a6-b8cb-16e3c153b253 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=bc9139c8a7674bd3b26b4dcdb018b141, group=ldap)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:09.386178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd87f1-c845-49a6-b8cb-16e3c153b253 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:09.392717 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1832/3641] 10.222.0.27 () {58 vars in 1263 bytes} [Sun Aug 28 18:33:09 2022] GET /identity/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141/config/ldap => generated 106 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:09.397230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702770fe-c906-4bf5-bfce-1f456f0876cd tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:09.410227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702770fe-c906-4bf5-bfce-1f456f0876cd tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:09.417693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a7295-3169-46f4-a4f8-d2a9975b0ea3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:09.418797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a7295-3169-46f4-a4f8-d2a9975b0ea3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:09.419093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a7295-3169-46f4-a4f8-d2a9975b0ea3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:09.419510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a7295-3169-46f4-a4f8-d2a9975b0ea3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141/config/ldap/url` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:09.423879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a7295-3169-46f4-a4f8-d2a9975b0ea3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=bc9139c8a7674bd3b26b4dcdb018b141, group=ldap, option=url)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:09.427107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a7295-3169-46f4-a4f8-d2a9975b0ea3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:09.436855 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1810/3642] 10.222.0.27 () {58 vars in 1275 bytes} [Sun Aug 28 18:33:09 2022] GET /identity/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141/config/ldap/url => generated 46 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:09.441025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd87f1-c845-49a6-b8cb-16e3c153b253 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:09.455296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd87f1-c845-49a6-b8cb-16e3c153b253 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:09.460774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d5eda-f08e-4055-9751-fcf42be857d6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:09.461576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d5eda-f08e-4055-9751-fcf42be857d6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:09.462070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d5eda-f08e-4055-9751-fcf42be857d6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:09.463100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d5eda-f08e-4055-9751-fcf42be857d6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141/config/ldap/user_tree_dn` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:09.464701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d5eda-f08e-4055-9751-fcf42be857d6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=bc9139c8a7674bd3b26b4dcdb018b141, group=ldap, option=user_tree_dn)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:09.466654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d5eda-f08e-4055-9751-fcf42be857d6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:09.474298 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1833/3643] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Aug 28 18:33:09 2022] GET /identity/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141/config/ldap/user_tree_dn => generated 63 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 18:33:09.480029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a7295-3169-46f4-a4f8-d2a9975b0ea3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:09.491135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a7295-3169-46f4-a4f8-d2a9975b0ea3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:09.496048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c614347-b02b-42f5-a707-cc2153f60e6a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:09.496756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c614347-b02b-42f5-a707-cc2153f60e6a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:09.497207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c614347-b02b-42f5-a707-cc2153f60e6a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:09.497557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c614347-b02b-42f5-a707-cc2153f60e6a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141/config` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:09.498330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c614347-b02b-42f5-a707-cc2153f60e6a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=bc9139c8a7674bd3b26b4dcdb018b141)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:09.500035 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-3c614347-b02b-42f5-a707-cc2153f60e6a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:09.500035 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:09.500035 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:09.501019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c614347-b02b-42f5-a707-cc2153f60e6a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:09.511999 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1811/3644] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Aug 28 18:33:09 2022] DELETE /identity/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141/config => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:09.516296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d5eda-f08e-4055-9751-fcf42be857d6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:09.527362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d5eda-f08e-4055-9751-fcf42be857d6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:09.532674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cb1c0-c6fc-4fd6-852a-f62beb1462a3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:09.533391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cb1c0-c6fc-4fd6-852a-f62beb1462a3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:09.533842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cb1c0-c6fc-4fd6-852a-f62beb1462a3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:09.534173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cb1c0-c6fc-4fd6-852a-f62beb1462a3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:09.535492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7cb1c0-c6fc-4fd6-852a-f62beb1462a3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bc9139c8a7674bd3b26b4dcdb018b141)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:09.536615 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-5d7cb1c0-c6fc-4fd6-852a-f62beb1462a3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:09.536615 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:09.536615 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:09.538055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7cb1c0-c6fc-4fd6-852a-f62beb1462a3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:09.571877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d7cb1c0-c6fc-4fd6-852a-f62beb1462a3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bc9139c8a7674bd3b26b4dcdb018b141'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:09.572887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d7cb1c0-c6fc-4fd6-852a-f62beb1462a3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bc9139c8a7674bd3b26b4dcdb018b141'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:09.655016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d7cb1c0-c6fc-4fd6-852a-f62beb1462a3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bc9139c8a7674bd3b26b4dcdb018b141'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:09.657044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d7cb1c0-c6fc-4fd6-852a-f62beb1462a3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bc9139c8a7674bd3b26b4dcdb018b141'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:09.666611 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1834/3645] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:09 2022] PATCH /identity/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141 => generated 277 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:09.667557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c614347-b02b-42f5-a707-cc2153f60e6a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:09.670079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3c614347-b02b-42f5-a707-cc2153f60e6a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:09.708724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c614347-b02b-42f5-a707-cc2153f60e6a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:09.774627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:09.775478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:09.775891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:09.776251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:09.788825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bc9139c8a7674bd3b26b4dcdb018b141)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:09.789857 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:09.789857 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:09.789857 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:09.790767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:09.815396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bc9139c8a7674bd3b26b4dcdb018b141'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:09.834670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bc9139c8a7674bd3b26b4dcdb018b141'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:09.876259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:09.880795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc9139c8a7674bd3b26b4dcdb018b141', 'request_id': 'req-97d8ce02-134f-4acd-896e-ac6f56428004'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:09.888011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc9139c8a7674bd3b26b4dcdb018b141', 'request_id': 'req-97d8ce02-134f-4acd-896e-ac6f56428004'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:09.894172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc9139c8a7674bd3b26b4dcdb018b141', 'request_id': 'req-97d8ce02-134f-4acd-896e-ac6f56428004'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:09.908244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] The token cache is being invalidate because project bc9139c8a7674bd3b26b4dcdb018b141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:09.908655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:09.909315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:09.920038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bc9139c8a7674bd3b26b4dcdb018b141', 'request_id': 'req-97d8ce02-134f-4acd-896e-ac6f56428004'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:09.924349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bc9139c8a7674bd3b26b4dcdb018b141', 'request_id': 'req-97d8ce02-134f-4acd-896e-ac6f56428004'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:09.925101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bc9139c8a7674bd3b26b4dcdb018b141', 'request_id': 'req-97d8ce02-134f-4acd-896e-ac6f56428004'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:09.931774 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1812/3646] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:33:09 2022] DELETE /identity/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:09.937577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cb1c0-c6fc-4fd6-852a-f62beb1462a3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:09.947924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cb1c0-c6fc-4fd6-852a-f62beb1462a3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:10.018646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c2c3f-c490-46c2-8517-15287d18ed62 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:10.019143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c2c3f-c490-46c2-8517-15287d18ed62 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:10.019463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c2c3f-c490-46c2-8517-15287d18ed62 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:10.019801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c2c3f-c490-46c2-8517-15287d18ed62 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:10.020431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c2c3f-c490-46c2-8517-15287d18ed62 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:10.022281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c2c3f-c490-46c2-8517-15287d18ed62 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:10.045560 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1835/3647] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:33:09 2022] POST /identity/v3/domains => generated 277 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:10.052650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:10.056342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:10.072988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8ce02-134f-4acd-896e-ac6f56428004 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:10.177296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11811e6-2c15-4995-beaf-17bb2e60a9bc tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:10.178371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11811e6-2c15-4995-beaf-17bb2e60a9bc tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:10.178840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11811e6-2c15-4995-beaf-17bb2e60a9bc tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:10.179360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11811e6-2c15-4995-beaf-17bb2e60a9bc tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/03e5ec803e27403893eb7caa04f939ac/config` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:10.180267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11811e6-2c15-4995-beaf-17bb2e60a9bc tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=03e5ec803e27403893eb7caa04f939ac)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:10.182852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11811e6-2c15-4995-beaf-17bb2e60a9bc tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:10.246660 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1813/3648] 10.222.0.27 () {60 vars in 1269 bytes} [Sun Aug 28 18:33:10 2022] PUT /identity/v3/domains/03e5ec803e27403893eb7caa04f939ac/config => generated 138 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:10.248444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c2c3f-c490-46c2-8517-15287d18ed62 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:10.312003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c2c3f-c490-46c2-8517-15287d18ed62 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:10.338569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acafae-d57d-4aa2-83e1-4e6e7ee7e476 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:10.339318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acafae-d57d-4aa2-83e1-4e6e7ee7e476 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:10.339689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acafae-d57d-4aa2-83e1-4e6e7ee7e476 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:10.339977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acafae-d57d-4aa2-83e1-4e6e7ee7e476 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/03e5ec803e27403893eb7caa04f939ac/config` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:10.340739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acafae-d57d-4aa2-83e1-4e6e7ee7e476 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=03e5ec803e27403893eb7caa04f939ac)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:10.341812 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-d1acafae-d57d-4aa2-83e1-4e6e7ee7e476 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:10.341812 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:10.341812 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:10.345778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acafae-d57d-4aa2-83e1-4e6e7ee7e476 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:10.410236 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1836/3649] 10.222.0.27 () {60 vars in 1271 bytes} [Sun Aug 28 18:33:10 2022] PATCH /identity/v3/domains/03e5ec803e27403893eb7caa04f939ac/config => generated 142 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:10.414636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11811e6-2c15-4995-beaf-17bb2e60a9bc tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:10.429583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11811e6-2c15-4995-beaf-17bb2e60a9bc tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:10.442213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e9ee6-fb99-4eac-b644-438c768d1b2b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:10.442877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e9ee6-fb99-4eac-b644-438c768d1b2b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:10.443174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e9ee6-fb99-4eac-b644-438c768d1b2b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:10.444307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e9ee6-fb99-4eac-b644-438c768d1b2b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/03e5ec803e27403893eb7caa04f939ac/config` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:10.444853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e9ee6-fb99-4eac-b644-438c768d1b2b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=03e5ec803e27403893eb7caa04f939ac)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:10.446479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e9ee6-fb99-4eac-b644-438c768d1b2b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:10.461312 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1814/3650] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Aug 28 18:33:10 2022] GET /identity/v3/domains/03e5ec803e27403893eb7caa04f939ac/config => generated 142 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:10.462552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acafae-d57d-4aa2-83e1-4e6e7ee7e476 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:10.475110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acafae-d57d-4aa2-83e1-4e6e7ee7e476 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:10.506790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49cb54-b97c-4769-bcb6-f7a436e6a93d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:10.507564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49cb54-b97c-4769-bcb6-f7a436e6a93d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:10.507848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49cb54-b97c-4769-bcb6-f7a436e6a93d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:10.508125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49cb54-b97c-4769-bcb6-f7a436e6a93d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/03e5ec803e27403893eb7caa04f939ac/config` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:10.508724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49cb54-b97c-4769-bcb6-f7a436e6a93d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=03e5ec803e27403893eb7caa04f939ac)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:10.509759 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-4e49cb54-b97c-4769-bcb6-f7a436e6a93d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:10.509759 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:10.509759 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:10.510655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49cb54-b97c-4769-bcb6-f7a436e6a93d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:10.525451 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1837/3651] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Aug 28 18:33:10 2022] DELETE /identity/v3/domains/03e5ec803e27403893eb7caa04f939ac/config => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:10.529776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e9ee6-fb99-4eac-b644-438c768d1b2b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:10.547662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e9ee6-fb99-4eac-b644-438c768d1b2b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:10.563504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f5ce4-50f7-4f52-8c21-a7dac369d369 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:10.564311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f5ce4-50f7-4f52-8c21-a7dac369d369 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:10.564720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f5ce4-50f7-4f52-8c21-a7dac369d369 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:10.565029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f5ce4-50f7-4f52-8c21-a7dac369d369 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/03e5ec803e27403893eb7caa04f939ac/config` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:10.567433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f5ce4-50f7-4f52-8c21-a7dac369d369 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=03e5ec803e27403893eb7caa04f939ac)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:10.570225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f5ce4-50f7-4f52-8c21-a7dac369d369 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:10.580855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-d05f5ce4-50f7-4f52-8c21-a7dac369d369 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Could not find any options in domain configuration for domain 03e5ec803e27403893eb7caa04f939ac.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 03e5ec803e27403893eb7caa04f939ac. Aug 28 18:33:10.580855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:10.580855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:10.580855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:10.580855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:10.580855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:10.580855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:10.580855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:10.580855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:10.580855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:10.580855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:10.580855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:10.580855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 28 18:33:10.582035 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 28 18:33:10.582035 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 28 18:33:10.582035 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 28 18:33:10.582035 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:10.582035 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:10.582035 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 28 18:33:10.582035 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 28 18:33:10.582035 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 03e5ec803e27403893eb7caa04f939ac. Aug 28 18:33:10.582035 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:10.585007 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1815/3652] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Aug 28 18:33:10 2022] GET /identity/v3/domains/03e5ec803e27403893eb7caa04f939ac/config => generated 151 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:33:10.589606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49cb54-b97c-4769-bcb6-f7a436e6a93d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:10.606893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49cb54-b97c-4769-bcb6-f7a436e6a93d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:10.613073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf25595-d5ab-4b62-a6c4-062aa32e861d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:10.613781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf25595-d5ab-4b62-a6c4-062aa32e861d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:10.614064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf25595-d5ab-4b62-a6c4-062aa32e861d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:10.614339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf25595-d5ab-4b62-a6c4-062aa32e861d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/03e5ec803e27403893eb7caa04f939ac/config` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:10.614988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf25595-d5ab-4b62-a6c4-062aa32e861d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=03e5ec803e27403893eb7caa04f939ac)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:10.616644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf25595-d5ab-4b62-a6c4-062aa32e861d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:10.624667 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1838/3653] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Aug 28 18:33:10 2022] DELETE /identity/v3/domains/03e5ec803e27403893eb7caa04f939ac/config => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:10.628920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f5ce4-50f7-4f52-8c21-a7dac369d369 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:10.641480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f5ce4-50f7-4f52-8c21-a7dac369d369 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:10.646555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b88021-e432-4965-b3e5-740194b0d34d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:10.647212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b88021-e432-4965-b3e5-740194b0d34d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:10.647931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b88021-e432-4965-b3e5-740194b0d34d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:10.648216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b88021-e432-4965-b3e5-740194b0d34d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/03e5ec803e27403893eb7caa04f939ac` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:10.649784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b88021-e432-4965-b3e5-740194b0d34d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=03e5ec803e27403893eb7caa04f939ac)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:10.650877 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-73b88021-e432-4965-b3e5-740194b0d34d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:10.650877 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:10.650877 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:10.651973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b88021-e432-4965-b3e5-740194b0d34d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:10.684032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-73b88021-e432-4965-b3e5-740194b0d34d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '03e5ec803e27403893eb7caa04f939ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:10.685373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-73b88021-e432-4965-b3e5-740194b0d34d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '03e5ec803e27403893eb7caa04f939ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:10.735913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-73b88021-e432-4965-b3e5-740194b0d34d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '03e5ec803e27403893eb7caa04f939ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:10.739135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-73b88021-e432-4965-b3e5-740194b0d34d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '03e5ec803e27403893eb7caa04f939ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:10.747966 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1816/3654] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:10 2022] PATCH /identity/v3/domains/03e5ec803e27403893eb7caa04f939ac => generated 278 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:10.749137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf25595-d5ab-4b62-a6c4-062aa32e861d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:10.750917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ebf25595-d5ab-4b62-a6c4-062aa32e861d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:10.767324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf25595-d5ab-4b62-a6c4-062aa32e861d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:10.807604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:10.842180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796e7f3-0698-4a54-9146-fd5ff795b61c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:10.842357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796e7f3-0698-4a54-9146-fd5ff795b61c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:10.842743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796e7f3-0698-4a54-9146-fd5ff795b61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:10.855761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:10.858329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:10.858488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:10.858750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/03e5ec803e27403893eb7caa04f939ac` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:10.878095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=03e5ec803e27403893eb7caa04f939ac)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:10.879434 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:10.879434 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:10.879434 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:10.879737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c796e7f3-0698-4a54-9146-fd5ff795b61c None None] MFA Rules not processed for user `4d84581730a84c3baa33385bb14200ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:10.880347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:10.880944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c796e7f3-0698-4a54-9146-fd5ff795b61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:10.898723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:10.926256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '03e5ec803e27403893eb7caa04f939ac'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:10.957126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '03e5ec803e27403893eb7caa04f939ac'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:10.972849 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1817/3655] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:10.987899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796e7f3-0698-4a54-9146-fd5ff795b61c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:10.989537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c796e7f3-0698-4a54-9146-fd5ff795b61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:11.020802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e5ec803e27403893eb7caa04f939ac', 'request_id': 'req-f83c2507-2360-4d01-8096-adb2fb5ccbbb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:11.034170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e5ec803e27403893eb7caa04f939ac', 'request_id': 'req-f83c2507-2360-4d01-8096-adb2fb5ccbbb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:11.044857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e5ec803e27403893eb7caa04f939ac', 'request_id': 'req-f83c2507-2360-4d01-8096-adb2fb5ccbbb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:11.066656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] The token cache is being invalidate because project 03e5ec803e27403893eb7caa04f939ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:11.066992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:11.069600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:11.079722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '03e5ec803e27403893eb7caa04f939ac', 'request_id': 'req-f83c2507-2360-4d01-8096-adb2fb5ccbbb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:11.080647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '03e5ec803e27403893eb7caa04f939ac', 'request_id': 'req-f83c2507-2360-4d01-8096-adb2fb5ccbbb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:11.086380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '03e5ec803e27403893eb7caa04f939ac', 'request_id': 'req-f83c2507-2360-4d01-8096-adb2fb5ccbbb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:11.102060 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1839/3656] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:33:10 2022] DELETE /identity/v3/domains/03e5ec803e27403893eb7caa04f939ac => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:11.103156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:11.104241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796e7f3-0698-4a54-9146-fd5ff795b61c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:11.105535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:11.208652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262671e-06d0-4832-9538-84c4405bbe58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:11.209301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262671e-06d0-4832-9538-84c4405bbe58 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:11.209584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262671e-06d0-4832-9538-84c4405bbe58 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:11.209861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262671e-06d0-4832-9538-84c4405bbe58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:11.212509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b262671e-06d0-4832-9538-84c4405bbe58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:11.233551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c2507-2360-4d01-8096-adb2fb5ccbbb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:11.237876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc98fa2-b247-40d2-9a3e-bf9f3a793214 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:11.238552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc98fa2-b247-40d2-9a3e-bf9f3a793214 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:11.238552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc98fa2-b247-40d2-9a3e-bf9f3a793214 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:11.238776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc98fa2-b247-40d2-9a3e-bf9f3a793214 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:11.239497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc98fa2-b247-40d2-9a3e-bf9f3a793214 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:11.242372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc98fa2-b247-40d2-9a3e-bf9f3a793214 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:11.269702 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1840/3657] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:33:11 2022] POST /identity/v3/domains => generated 275 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:11.271054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83ef5b-f1a6-4d7d-bc1c-41ffebeb0ec7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:11.271303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83ef5b-f1a6-4d7d-bc1c-41ffebeb0ec7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:11.271586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83ef5b-f1a6-4d7d-bc1c-41ffebeb0ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:11.292426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ab83ef5b-f1a6-4d7d-bc1c-41ffebeb0ec7 None None] MFA Rules not processed for user `47aab8bfff21443891308d80f7059b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:11.293714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab83ef5b-f1a6-4d7d-bc1c-41ffebeb0ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:11.297915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:11.301460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:11.317886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262671e-06d0-4832-9538-84c4405bbe58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:11.320357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262671e-06d0-4832-9538-84c4405bbe58 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:11.332819 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1818/3658] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:33:11.333508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262671e-06d0-4832-9538-84c4405bbe58 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:11.345242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262671e-06d0-4832-9538-84c4405bbe58 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:11.400663 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1841/3659] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:11.455229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95cf85-cd84-4742-b2af-86de769820d5 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:11.455912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95cf85-cd84-4742-b2af-86de769820d5 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:11.456194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95cf85-cd84-4742-b2af-86de769820d5 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:11.456477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95cf85-cd84-4742-b2af-86de769820d5 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/0b2ab3cb2734452884a193d5014d2786/config` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:11.457169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95cf85-cd84-4742-b2af-86de769820d5 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=0b2ab3cb2734452884a193d5014d2786)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:11.458974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95cf85-cd84-4742-b2af-86de769820d5 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:11.531313 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1819/3660] 10.222.0.27 () {60 vars in 1269 bytes} [Sun Aug 28 18:33:11 2022] PUT /identity/v3/domains/0b2ab3cb2734452884a193d5014d2786/config => generated 138 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:11.532921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83ef5b-f1a6-4d7d-bc1c-41ffebeb0ec7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:11.550212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83ef5b-f1a6-4d7d-bc1c-41ffebeb0ec7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:11.562572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b40f5d-026e-4264-a98b-01aa2ffb90de tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:11.563272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b40f5d-026e-4264-a98b-01aa2ffb90de tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:11.563558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b40f5d-026e-4264-a98b-01aa2ffb90de tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:11.563833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b40f5d-026e-4264-a98b-01aa2ffb90de tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/0b2ab3cb2734452884a193d5014d2786/config/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:11.565059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b40f5d-026e-4264-a98b-01aa2ffb90de tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=0b2ab3cb2734452884a193d5014d2786, group=identity)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:11.567526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b40f5d-026e-4264-a98b-01aa2ffb90de tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:11.613586 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1842/3661] 10.222.0.27 () {60 vars in 1297 bytes} [Sun Aug 28 18:33:11 2022] PATCH /identity/v3/domains/0b2ab3cb2734452884a193d5014d2786/config/identity => generated 176 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:11.618104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95cf85-cd84-4742-b2af-86de769820d5 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:11.632097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95cf85-cd84-4742-b2af-86de769820d5 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:11.637947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36ddfd-c14f-41d9-9977-68493700cfd1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:11.638968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36ddfd-c14f-41d9-9977-68493700cfd1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:11.639422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36ddfd-c14f-41d9-9977-68493700cfd1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:11.639774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36ddfd-c14f-41d9-9977-68493700cfd1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/0b2ab3cb2734452884a193d5014d2786/config/identity/driver` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:11.640807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36ddfd-c14f-41d9-9977-68493700cfd1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=0b2ab3cb2734452884a193d5014d2786, group=identity, option=driver)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:11.643001 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-bc36ddfd-c14f-41d9-9977-68493700cfd1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:11.643001 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:11.643001 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:11.644693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36ddfd-c14f-41d9-9977-68493700cfd1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:11.681601 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1820/3662] 10.222.0.27 () {60 vars in 1318 bytes} [Sun Aug 28 18:33:11 2022] PATCH /identity/v3/domains/0b2ab3cb2734452884a193d5014d2786/config/identity/driver => generated 176 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:11.685857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b40f5d-026e-4264-a98b-01aa2ffb90de tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:11.703022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b40f5d-026e-4264-a98b-01aa2ffb90de tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:11.709481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517eab9-20c8-42e7-9ee3-170e0ad92ad6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:11.710967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517eab9-20c8-42e7-9ee3-170e0ad92ad6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:11.711353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517eab9-20c8-42e7-9ee3-170e0ad92ad6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:11.711649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517eab9-20c8-42e7-9ee3-170e0ad92ad6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/0b2ab3cb2734452884a193d5014d2786/config/identity/driver` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:11.712360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517eab9-20c8-42e7-9ee3-170e0ad92ad6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=0b2ab3cb2734452884a193d5014d2786, group=identity, option=driver)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:11.714313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517eab9-20c8-42e7-9ee3-170e0ad92ad6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:11.743537 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1843/3663] 10.222.0.27 () {58 vars in 1299 bytes} [Sun Aug 28 18:33:11 2022] DELETE /identity/v3/domains/0b2ab3cb2734452884a193d5014d2786/config/identity/driver => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:11.745154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36ddfd-c14f-41d9-9977-68493700cfd1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:11.758797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36ddfd-c14f-41d9-9977-68493700cfd1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:11.764431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ccf30-55c0-4fa5-9096-c46c23cdb59e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:11.765193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ccf30-55c0-4fa5-9096-c46c23cdb59e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:11.765483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ccf30-55c0-4fa5-9096-c46c23cdb59e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:11.765793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ccf30-55c0-4fa5-9096-c46c23cdb59e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/0b2ab3cb2734452884a193d5014d2786/config/identity/driver` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:11.766973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ccf30-55c0-4fa5-9096-c46c23cdb59e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=0b2ab3cb2734452884a193d5014d2786, group=identity, option=driver)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:11.768703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ccf30-55c0-4fa5-9096-c46c23cdb59e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:11.781151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-879ccf30-55c0-4fa5-9096-c46c23cdb59e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Could not find option driver in group identity in domain configuration for domain 0b2ab3cb2734452884a193d5014d2786.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 0b2ab3cb2734452884a193d5014d2786. Aug 28 18:33:11.781151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:11.781151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:11.781151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:11.781151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:11.781151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:11.781151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:11.781151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:11.781151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:11.781151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:11.781151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:11.781151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:11.781151 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 28 18:33:11.782137 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 28 18:33:11.782137 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 28 18:33:11.782137 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 28 18:33:11.782137 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:11.782137 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:11.782137 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 28 18:33:11.782137 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 28 18:33:11.782137 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 0b2ab3cb2734452884a193d5014d2786. Aug 28 18:33:11.782137 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:11.787062 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1821/3664] 10.222.0.27 () {58 vars in 1296 bytes} [Sun Aug 28 18:33:11 2022] GET /identity/v3/domains/0b2ab3cb2734452884a193d5014d2786/config/identity/driver => generated 171 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:33:11.787618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517eab9-20c8-42e7-9ee3-170e0ad92ad6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:11.799084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517eab9-20c8-42e7-9ee3-170e0ad92ad6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:11.804271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5695492-b9b4-4b9d-ae4f-23877f4461f7 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:11.804971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5695492-b9b4-4b9d-ae4f-23877f4461f7 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:11.805792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5695492-b9b4-4b9d-ae4f-23877f4461f7 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:11.805792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5695492-b9b4-4b9d-ae4f-23877f4461f7 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/0b2ab3cb2734452884a193d5014d2786/config/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:11.806153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5695492-b9b4-4b9d-ae4f-23877f4461f7 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=0b2ab3cb2734452884a193d5014d2786, group=identity)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:11.807984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5695492-b9b4-4b9d-ae4f-23877f4461f7 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:11.831285 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1844/3665] 10.222.0.27 () {58 vars in 1278 bytes} [Sun Aug 28 18:33:11 2022] DELETE /identity/v3/domains/0b2ab3cb2734452884a193d5014d2786/config/identity => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:11.835169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ccf30-55c0-4fa5-9096-c46c23cdb59e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:11.850999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ccf30-55c0-4fa5-9096-c46c23cdb59e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:11.857236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5b328-0f26-4660-9b88-b23efabebc97 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:11.858561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5b328-0f26-4660-9b88-b23efabebc97 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:11.858847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5b328-0f26-4660-9b88-b23efabebc97 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:11.859148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5b328-0f26-4660-9b88-b23efabebc97 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/0b2ab3cb2734452884a193d5014d2786/config/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:11.860406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5b328-0f26-4660-9b88-b23efabebc97 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=0b2ab3cb2734452884a193d5014d2786, group=identity)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:11.862331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5b328-0f26-4660-9b88-b23efabebc97 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:11.875012 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-5fe5b328-0f26-4660-9b88-b23efabebc97 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Could not find group identity in domain configuration for domain 0b2ab3cb2734452884a193d5014d2786.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 0b2ab3cb2734452884a193d5014d2786. Aug 28 18:33:11.875012 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:11.875012 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:11.875012 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:11.875012 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:11.875012 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:11.875012 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:11.875012 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:11.875012 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:11.875012 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:11.875012 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:11.875012 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:11.875012 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 28 18:33:11.876391 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 28 18:33:11.876391 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 28 18:33:11.876391 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 28 18:33:11.876391 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:11.876391 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:11.876391 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 28 18:33:11.876391 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 28 18:33:11.876391 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 0b2ab3cb2734452884a193d5014d2786. Aug 28 18:33:11.876391 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:11.877379 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1822/3666] 10.222.0.27 () {58 vars in 1275 bytes} [Sun Aug 28 18:33:11 2022] GET /identity/v3/domains/0b2ab3cb2734452884a193d5014d2786/config/identity => generated 154 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:33:11.881993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5695492-b9b4-4b9d-ae4f-23877f4461f7 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:11.899991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5695492-b9b4-4b9d-ae4f-23877f4461f7 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:11.905808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf10ce-f747-4a77-9d42-ee9d2732c70f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:11.906613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf10ce-f747-4a77-9d42-ee9d2732c70f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:11.907020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf10ce-f747-4a77-9d42-ee9d2732c70f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:11.907402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf10ce-f747-4a77-9d42-ee9d2732c70f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/0b2ab3cb2734452884a193d5014d2786/config` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:11.908521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf10ce-f747-4a77-9d42-ee9d2732c70f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=0b2ab3cb2734452884a193d5014d2786)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:11.910437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf10ce-f747-4a77-9d42-ee9d2732c70f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:11.928136 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1845/3667] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Aug 28 18:33:11 2022] DELETE /identity/v3/domains/0b2ab3cb2734452884a193d5014d2786/config => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:11.933065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5b328-0f26-4660-9b88-b23efabebc97 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:11.956273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5b328-0f26-4660-9b88-b23efabebc97 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:11.962062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6918e18-affb-4145-a327-86ab8db8c128 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:11.962973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6918e18-affb-4145-a327-86ab8db8c128 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:11.962973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6918e18-affb-4145-a327-86ab8db8c128 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:11.963244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6918e18-affb-4145-a327-86ab8db8c128 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/0b2ab3cb2734452884a193d5014d2786` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:11.964808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6918e18-affb-4145-a327-86ab8db8c128 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0b2ab3cb2734452884a193d5014d2786)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:11.967055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6918e18-affb-4145-a327-86ab8db8c128 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:12.029491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6918e18-affb-4145-a327-86ab8db8c128 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0b2ab3cb2734452884a193d5014d2786'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:12.030483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6918e18-affb-4145-a327-86ab8db8c128 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0b2ab3cb2734452884a193d5014d2786'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:12.087438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6918e18-affb-4145-a327-86ab8db8c128 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0b2ab3cb2734452884a193d5014d2786'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:12.088683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6918e18-affb-4145-a327-86ab8db8c128 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0b2ab3cb2734452884a193d5014d2786'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:12.092615 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1823/3668] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:11 2022] PATCH /identity/v3/domains/0b2ab3cb2734452884a193d5014d2786 => generated 276 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:12.098133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf10ce-f747-4a77-9d42-ee9d2732c70f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:12.101028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-67cf10ce-f747-4a77-9d42-ee9d2732c70f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:12.126689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf10ce-f747-4a77-9d42-ee9d2732c70f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:12.245301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:12.245817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:12.246944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:12.248411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/0b2ab3cb2734452884a193d5014d2786` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:12.268942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0b2ab3cb2734452884a193d5014d2786)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:12.272749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:12.310316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0b2ab3cb2734452884a193d5014d2786'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:12.312541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:12.323482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0b2ab3cb2734452884a193d5014d2786'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:12.410219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2ab3cb2734452884a193d5014d2786', 'request_id': 'req-1f3f66ff-4eac-4668-81fe-536b157fc23a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:12.424672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2ab3cb2734452884a193d5014d2786', 'request_id': 'req-1f3f66ff-4eac-4668-81fe-536b157fc23a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:12.439981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2ab3cb2734452884a193d5014d2786', 'request_id': 'req-1f3f66ff-4eac-4668-81fe-536b157fc23a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:12.457228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] The token cache is being invalidate because project 0b2ab3cb2734452884a193d5014d2786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:12.457534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:12.458231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:12.467641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0b2ab3cb2734452884a193d5014d2786', 'request_id': 'req-1f3f66ff-4eac-4668-81fe-536b157fc23a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:12.468432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0b2ab3cb2734452884a193d5014d2786', 'request_id': 'req-1f3f66ff-4eac-4668-81fe-536b157fc23a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:12.472679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0b2ab3cb2734452884a193d5014d2786', 'request_id': 'req-1f3f66ff-4eac-4668-81fe-536b157fc23a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:12.485967 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1846/3669] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:33:12 2022] DELETE /identity/v3/domains/0b2ab3cb2734452884a193d5014d2786 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:12.487835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6918e18-affb-4145-a327-86ab8db8c128 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:12.508943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6918e18-affb-4145-a327-86ab8db8c128 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:12.573315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:12.627654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20fe7d-dec4-4b2f-b07b-4974034c769e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:12.628399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20fe7d-dec4-4b2f-b07b-4974034c769e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:12.628725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20fe7d-dec4-4b2f-b07b-4974034c769e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:12.629145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20fe7d-dec4-4b2f-b07b-4974034c769e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:12.629784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20fe7d-dec4-4b2f-b07b-4974034c769e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:12.631001 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-6b20fe7d-dec4-4b2f-b07b-4974034c769e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:12.631001 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:12.631001 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:12.632417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20fe7d-dec4-4b2f-b07b-4974034c769e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:12.642272 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1824/3670] 10.222.0.27 () {58 vars in 1173 bytes} [Sun Aug 28 18:33:12 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:12.643640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:12.645394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:12.660090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f66ff-4eac-4668-81fe-536b157fc23a tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:12.665275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084a74d-7a39-4233-b0cf-b8d007c17d4c tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:12.665985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a74d-7a39-4233-b0cf-b8d007c17d4c tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:12.666257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a74d-7a39-4233-b0cf-b8d007c17d4c tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:12.666607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a74d-7a39-4233-b0cf-b8d007c17d4c tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:12.667617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084a74d-7a39-4233-b0cf-b8d007c17d4c tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:12.668759 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-5084a74d-7a39-4233-b0cf-b8d007c17d4c tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:12.668759 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:12.668759 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:12.669698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084a74d-7a39-4233-b0cf-b8d007c17d4c tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:12.671004 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1847/3671] 10.222.0.27 () {58 vars in 1200 bytes} [Sun Aug 28 18:33:12 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:12.675669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20fe7d-dec4-4b2f-b07b-4974034c769e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:12.687493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20fe7d-dec4-4b2f-b07b-4974034c769e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:12.693251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c351c91-9dcf-4a89-93f8-9c15e0c02ee6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:12.693897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c351c91-9dcf-4a89-93f8-9c15e0c02ee6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:12.694308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c351c91-9dcf-4a89-93f8-9c15e0c02ee6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:12.694598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c351c91-9dcf-4a89-93f8-9c15e0c02ee6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:12.695216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c351c91-9dcf-4a89-93f8-9c15e0c02ee6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:12.696891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c351c91-9dcf-4a89-93f8-9c15e0c02ee6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:12.698314 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1825/3672] 10.222.0.27 () {58 vars in 1221 bytes} [Sun Aug 28 18:33:12 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:12.702985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084a74d-7a39-4233-b0cf-b8d007c17d4c tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:12.714775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084a74d-7a39-4233-b0cf-b8d007c17d4c tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:12.721941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5692572-179e-4a6f-9255-636327e69879 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:12.723522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5692572-179e-4a6f-9255-636327e69879 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:12.723990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5692572-179e-4a6f-9255-636327e69879 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:12.724279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5692572-179e-4a6f-9255-636327e69879 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:12.724944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5692572-179e-4a6f-9255-636327e69879 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:12.726955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5692572-179e-4a6f-9255-636327e69879 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:12.729115 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1848/3673] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:12 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:12.733337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c351c91-9dcf-4a89-93f8-9c15e0c02ee6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:12.744610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c351c91-9dcf-4a89-93f8-9c15e0c02ee6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:12.750578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7fe7b-cff7-46b3-8a1f-a18817debcaf tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:12.751303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7fe7b-cff7-46b3-8a1f-a18817debcaf tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:12.751590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7fe7b-cff7-46b3-8a1f-a18817debcaf tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:12.751921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7fe7b-cff7-46b3-8a1f-a18817debcaf tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:12.753679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7fe7b-cff7-46b3-8a1f-a18817debcaf tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:12.755538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7fe7b-cff7-46b3-8a1f-a18817debcaf tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:12.759302 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1826/3674] 10.222.0.27 () {58 vars in 1188 bytes} [Sun Aug 28 18:33:12 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:12.762287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5692572-179e-4a6f-9255-636327e69879 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:12.779602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5692572-179e-4a6f-9255-636327e69879 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:12.787585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db009ef-2c90-410c-9471-e41f14b79b8f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:12.788547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db009ef-2c90-410c-9471-e41f14b79b8f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:12.789058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db009ef-2c90-410c-9471-e41f14b79b8f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:12.789440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db009ef-2c90-410c-9471-e41f14b79b8f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:12.790159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db009ef-2c90-410c-9471-e41f14b79b8f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:12.792267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db009ef-2c90-410c-9471-e41f14b79b8f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:12.797570 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1849/3675] 10.222.0.27 () {58 vars in 1200 bytes} [Sun Aug 28 18:33:12 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:12.797898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7fe7b-cff7-46b3-8a1f-a18817debcaf tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:12.810596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7fe7b-cff7-46b3-8a1f-a18817debcaf tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:12.817910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebdf72-7b2f-4c2b-b7ae-1002cf798825 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:12.818591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebdf72-7b2f-4c2b-b7ae-1002cf798825 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:12.818875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebdf72-7b2f-4c2b-b7ae-1002cf798825 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:12.819150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebdf72-7b2f-4c2b-b7ae-1002cf798825 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:12.819937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebdf72-7b2f-4c2b-b7ae-1002cf798825 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:12.821611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebdf72-7b2f-4c2b-b7ae-1002cf798825 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:12.823864 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1827/3676] 10.222.0.27 () {58 vars in 1203 bytes} [Sun Aug 28 18:33:12 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:12.826872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db009ef-2c90-410c-9471-e41f14b79b8f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:12.841469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db009ef-2c90-410c-9471-e41f14b79b8f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:12.847909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8dece-4807-4fac-af83-bfe9b04ab0c3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:12.848437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8dece-4807-4fac-af83-bfe9b04ab0c3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:12.848871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8dece-4807-4fac-af83-bfe9b04ab0c3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:12.849196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8dece-4807-4fac-af83-bfe9b04ab0c3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:12.849807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8dece-4807-4fac-af83-bfe9b04ab0c3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:12.851945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8dece-4807-4fac-af83-bfe9b04ab0c3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:12.857438 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1850/3677] 10.222.0.27 () {58 vars in 1209 bytes} [Sun Aug 28 18:33:12 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:12.857987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebdf72-7b2f-4c2b-b7ae-1002cf798825 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:12.877241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebdf72-7b2f-4c2b-b7ae-1002cf798825 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:12.906276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b6089-d020-40f4-850f-585b22a9f893 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:12.909062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b6089-d020-40f4-850f-585b22a9f893 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:12.909356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b6089-d020-40f4-850f-585b22a9f893 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:12.909635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b6089-d020-40f4-850f-585b22a9f893 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:12.910255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b6089-d020-40f4-850f-585b22a9f893 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:12.937093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b6089-d020-40f4-850f-585b22a9f893 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:12.952793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8dece-4807-4fac-af83-bfe9b04ab0c3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:12.954105 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1828/3678] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:12 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 18:33:12.964674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8dece-4807-4fac-af83-bfe9b04ab0c3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:12.970476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1edbcb-e95c-4f94-8968-cd54045504f3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:12.970727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1edbcb-e95c-4f94-8968-cd54045504f3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:12.971086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1edbcb-e95c-4f94-8968-cd54045504f3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:12.971467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1edbcb-e95c-4f94-8968-cd54045504f3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:12.972272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1edbcb-e95c-4f94-8968-cd54045504f3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:12.973971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1edbcb-e95c-4f94-8968-cd54045504f3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:12.980283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b6089-d020-40f4-850f-585b22a9f893 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:12.980872 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1851/3679] 10.222.0.27 () {58 vars in 1218 bytes} [Sun Aug 28 18:33:12 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:12.995157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b6089-d020-40f4-850f-585b22a9f893 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.004248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373f6c7-a9df-4ba2-9f05-26b7b1b540e6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.005026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373f6c7-a9df-4ba2-9f05-26b7b1b540e6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.005383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373f6c7-a9df-4ba2-9f05-26b7b1b540e6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.005722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373f6c7-a9df-4ba2-9f05-26b7b1b540e6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.006388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373f6c7-a9df-4ba2-9f05-26b7b1b540e6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.008359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373f6c7-a9df-4ba2-9f05-26b7b1b540e6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.013298 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1829/3680] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Aug 28 18:33:12 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:13.014074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1edbcb-e95c-4f94-8968-cd54045504f3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.026727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1edbcb-e95c-4f94-8968-cd54045504f3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.032209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa3364-25df-4c0e-9352-b64343c5971d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.032943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa3364-25df-4c0e-9352-b64343c5971d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.033229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa3364-25df-4c0e-9352-b64343c5971d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.033509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa3364-25df-4c0e-9352-b64343c5971d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.034107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa3364-25df-4c0e-9352-b64343c5971d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.035815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa3364-25df-4c0e-9352-b64343c5971d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.037429 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1852/3681] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 18:33:13.041067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373f6c7-a9df-4ba2-9f05-26b7b1b540e6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.052573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373f6c7-a9df-4ba2-9f05-26b7b1b540e6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.060602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580bd33-aff8-4d9a-b696-196e10d480b2 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.061184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580bd33-aff8-4d9a-b696-196e10d480b2 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.061470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580bd33-aff8-4d9a-b696-196e10d480b2 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.061754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580bd33-aff8-4d9a-b696-196e10d480b2 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.062386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580bd33-aff8-4d9a-b696-196e10d480b2 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.064080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580bd33-aff8-4d9a-b696-196e10d480b2 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.070899 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1830/3682] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:13.071803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa3364-25df-4c0e-9352-b64343c5971d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.093742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa3364-25df-4c0e-9352-b64343c5971d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.112063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d016f-dced-4f2e-a0a3-894f2a03edc2 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.112749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d016f-dced-4f2e-a0a3-894f2a03edc2 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.113039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d016f-dced-4f2e-a0a3-894f2a03edc2 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.113323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d016f-dced-4f2e-a0a3-894f2a03edc2 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.118276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d016f-dced-4f2e-a0a3-894f2a03edc2 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.119988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d016f-dced-4f2e-a0a3-894f2a03edc2 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.130972 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1853/3683] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 18:33:13.135156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580bd33-aff8-4d9a-b696-196e10d480b2 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.148175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580bd33-aff8-4d9a-b696-196e10d480b2 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.153255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27208645-8bdf-488c-8530-87738aa1daf8 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.154199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27208645-8bdf-488c-8530-87738aa1daf8 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.155316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27208645-8bdf-488c-8530-87738aa1daf8 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.156052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27208645-8bdf-488c-8530-87738aa1daf8 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.156817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27208645-8bdf-488c-8530-87738aa1daf8 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.158734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27208645-8bdf-488c-8530-87738aa1daf8 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.160461 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1831/3684] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:13.165636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d016f-dced-4f2e-a0a3-894f2a03edc2 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.179599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d016f-dced-4f2e-a0a3-894f2a03edc2 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.184849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e49f0-6ac4-4b20-8729-cec6c7ce682e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.185511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e49f0-6ac4-4b20-8729-cec6c7ce682e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.185790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e49f0-6ac4-4b20-8729-cec6c7ce682e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.186065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e49f0-6ac4-4b20-8729-cec6c7ce682e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.186657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e49f0-6ac4-4b20-8729-cec6c7ce682e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.188546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e49f0-6ac4-4b20-8729-cec6c7ce682e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.189766 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1854/3685] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 18:33:13.193879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27208645-8bdf-488c-8530-87738aa1daf8 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.210836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27208645-8bdf-488c-8530-87738aa1daf8 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.216337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd5fb0-686e-4041-ae16-1706b92e3276 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.217000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd5fb0-686e-4041-ae16-1706b92e3276 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.217651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd5fb0-686e-4041-ae16-1706b92e3276 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.217939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd5fb0-686e-4041-ae16-1706b92e3276 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.218536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd5fb0-686e-4041-ae16-1706b92e3276 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.220161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd5fb0-686e-4041-ae16-1706b92e3276 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.223842 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1832/3686] 10.222.0.27 () {58 vars in 1242 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:13.227222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e49f0-6ac4-4b20-8729-cec6c7ce682e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.248580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e49f0-6ac4-4b20-8729-cec6c7ce682e tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.260154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219ef62-dc9d-435c-9c4c-af95b34856f0 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.261016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219ef62-dc9d-435c-9c4c-af95b34856f0 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.261212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219ef62-dc9d-435c-9c4c-af95b34856f0 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.261496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219ef62-dc9d-435c-9c4c-af95b34856f0 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.262185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219ef62-dc9d-435c-9c4c-af95b34856f0 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.264064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219ef62-dc9d-435c-9c4c-af95b34856f0 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.268880 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1855/3687] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:13.270433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd5fb0-686e-4041-ae16-1706b92e3276 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.281706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd5fb0-686e-4041-ae16-1706b92e3276 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.293852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6bfea-65bd-4c87-a704-dc658ed1c39b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.294528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6bfea-65bd-4c87-a704-dc658ed1c39b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.294979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6bfea-65bd-4c87-a704-dc658ed1c39b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.295437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6bfea-65bd-4c87-a704-dc658ed1c39b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.296309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6bfea-65bd-4c87-a704-dc658ed1c39b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.313908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6bfea-65bd-4c87-a704-dc658ed1c39b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.323407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219ef62-dc9d-435c-9c4c-af95b34856f0 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.338703 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1833/3688] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 18:33:13.346914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219ef62-dc9d-435c-9c4c-af95b34856f0 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.365484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609f8e4-c10a-434c-959b-c9d6c5d35e72 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.366497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f8e4-c10a-434c-959b-c9d6c5d35e72 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.366683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f8e4-c10a-434c-959b-c9d6c5d35e72 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.367012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f8e4-c10a-434c-959b-c9d6c5d35e72 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.367818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609f8e4-c10a-434c-959b-c9d6c5d35e72 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.369447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609f8e4-c10a-434c-959b-c9d6c5d35e72 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.375527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6bfea-65bd-4c87-a704-dc658ed1c39b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.376825 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1856/3689] 10.222.0.27 () {58 vars in 1269 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:13.388313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6bfea-65bd-4c87-a704-dc658ed1c39b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.397389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9d02e-5219-4a73-93f8-c47977a8d386 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.398399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9d02e-5219-4a73-93f8-c47977a8d386 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.398821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9d02e-5219-4a73-93f8-c47977a8d386 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.399245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9d02e-5219-4a73-93f8-c47977a8d386 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.400127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9d02e-5219-4a73-93f8-c47977a8d386 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.405534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9d02e-5219-4a73-93f8-c47977a8d386 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.407238 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1834/3690] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:13.411474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609f8e4-c10a-434c-959b-c9d6c5d35e72 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.427738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609f8e4-c10a-434c-959b-c9d6c5d35e72 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.438643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b57bc-5494-405b-8712-a512121daef0 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.439337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b57bc-5494-405b-8712-a512121daef0 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.439794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b57bc-5494-405b-8712-a512121daef0 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.440257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b57bc-5494-405b-8712-a512121daef0 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.440869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b57bc-5494-405b-8712-a512121daef0 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.442492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b57bc-5494-405b-8712-a512121daef0 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.452591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9d02e-5219-4a73-93f8-c47977a8d386 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.462028 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1857/3691] 10.222.0.27 () {58 vars in 1257 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:13.464252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9d02e-5219-4a73-93f8-c47977a8d386 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.483929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8107865-4fb5-4c76-a844-61fb5f7d5cb1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.484581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8107865-4fb5-4c76-a844-61fb5f7d5cb1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.485130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8107865-4fb5-4c76-a844-61fb5f7d5cb1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.485596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8107865-4fb5-4c76-a844-61fb5f7d5cb1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.486355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8107865-4fb5-4c76-a844-61fb5f7d5cb1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.488282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8107865-4fb5-4c76-a844-61fb5f7d5cb1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.494708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b57bc-5494-405b-8712-a512121daef0 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.501635 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1835/3692] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:13.507408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b57bc-5494-405b-8712-a512121daef0 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.522971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bc09e-d35a-43c9-9a09-77a02d219b8c tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.523879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bc09e-d35a-43c9-9a09-77a02d219b8c tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.524689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bc09e-d35a-43c9-9a09-77a02d219b8c tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.524890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bc09e-d35a-43c9-9a09-77a02d219b8c tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.525773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bc09e-d35a-43c9-9a09-77a02d219b8c tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.527444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bc09e-d35a-43c9-9a09-77a02d219b8c tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.533148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8107865-4fb5-4c76-a844-61fb5f7d5cb1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.554917 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1858/3693] 10.222.0.27 () {58 vars in 1242 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:13.557946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8107865-4fb5-4c76-a844-61fb5f7d5cb1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.575609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead78bef-e462-4770-b474-aacef70248c3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.576565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead78bef-e462-4770-b474-aacef70248c3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.577009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead78bef-e462-4770-b474-aacef70248c3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.577449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead78bef-e462-4770-b474-aacef70248c3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.578782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead78bef-e462-4770-b474-aacef70248c3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.580661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead78bef-e462-4770-b474-aacef70248c3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.588461 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1836/3694] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:13.593900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bc09e-d35a-43c9-9a09-77a02d219b8c tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.610328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bc09e-d35a-43c9-9a09-77a02d219b8c tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.629946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af716e8-21c6-48a4-9cd8-ac00a3203776 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.632093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af716e8-21c6-48a4-9cd8-ac00a3203776 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.634171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af716e8-21c6-48a4-9cd8-ac00a3203776 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.634710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af716e8-21c6-48a4-9cd8-ac00a3203776 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.637149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af716e8-21c6-48a4-9cd8-ac00a3203776 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.639329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af716e8-21c6-48a4-9cd8-ac00a3203776 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.644520 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1859/3695] 10.222.0.27 () {58 vars in 1254 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:13.647746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead78bef-e462-4770-b474-aacef70248c3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.667728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead78bef-e462-4770-b474-aacef70248c3 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.705037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb449f-b552-484a-9435-671e2565c355 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.706269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb449f-b552-484a-9435-671e2565c355 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.706724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb449f-b552-484a-9435-671e2565c355 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.707157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb449f-b552-484a-9435-671e2565c355 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.707937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb449f-b552-484a-9435-671e2565c355 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.716581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb449f-b552-484a-9435-671e2565c355 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.717825 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1837/3696] 10.222.0.27 () {58 vars in 1290 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:13.722258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af716e8-21c6-48a4-9cd8-ac00a3203776 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.742452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af716e8-21c6-48a4-9cd8-ac00a3203776 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.757276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc353e-3ca3-4924-b0e1-1bfaa68ccad4 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.758720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc353e-3ca3-4924-b0e1-1bfaa68ccad4 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.759239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc353e-3ca3-4924-b0e1-1bfaa68ccad4 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.759775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc353e-3ca3-4924-b0e1-1bfaa68ccad4 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.761473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc353e-3ca3-4924-b0e1-1bfaa68ccad4 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.764567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc353e-3ca3-4924-b0e1-1bfaa68ccad4 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.770899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb449f-b552-484a-9435-671e2565c355 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.772602 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1860/3697] 10.222.0.27 () {58 vars in 1257 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:13.789923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb449f-b552-484a-9435-671e2565c355 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.800572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f1fb7-906f-4ed1-a433-1dd1a65febb5 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.801257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f1fb7-906f-4ed1-a433-1dd1a65febb5 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.801540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f1fb7-906f-4ed1-a433-1dd1a65febb5 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.801818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f1fb7-906f-4ed1-a433-1dd1a65febb5 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.802424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f1fb7-906f-4ed1-a433-1dd1a65febb5 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.808558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f1fb7-906f-4ed1-a433-1dd1a65febb5 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.815434 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1838/3698] 10.222.0.27 () {58 vars in 1266 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:13.816586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc353e-3ca3-4924-b0e1-1bfaa68ccad4 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.836745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc353e-3ca3-4924-b0e1-1bfaa68ccad4 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.848702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14191548-9691-4d5d-a8c7-b25c91fd2eed tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.849521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14191548-9691-4d5d-a8c7-b25c91fd2eed tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.851416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14191548-9691-4d5d-a8c7-b25c91fd2eed tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.851815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14191548-9691-4d5d-a8c7-b25c91fd2eed tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.852602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14191548-9691-4d5d-a8c7-b25c91fd2eed tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.856760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14191548-9691-4d5d-a8c7-b25c91fd2eed tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.860037 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1861/3699] 10.222.0.27 () {58 vars in 1308 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 18:33:13.864568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f1fb7-906f-4ed1-a433-1dd1a65febb5 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.880453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f1fb7-906f-4ed1-a433-1dd1a65febb5 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.894696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473680b9-8c74-460b-9e26-ca25b2170fad tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.898931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473680b9-8c74-460b-9e26-ca25b2170fad tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.899618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473680b9-8c74-460b-9e26-ca25b2170fad tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.901187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473680b9-8c74-460b-9e26-ca25b2170fad tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.902606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473680b9-8c74-460b-9e26-ca25b2170fad tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.905005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473680b9-8c74-460b-9e26-ca25b2170fad tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.914915 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1839/3700] 10.222.0.27 () {58 vars in 1290 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:13.915965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14191548-9691-4d5d-a8c7-b25c91fd2eed tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.932961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14191548-9691-4d5d-a8c7-b25c91fd2eed tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.948380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb35b4-dd38-48aa-b956-e5a7385585d9 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.949242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb35b4-dd38-48aa-b956-e5a7385585d9 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.949639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb35b4-dd38-48aa-b956-e5a7385585d9 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.950097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb35b4-dd38-48aa-b956-e5a7385585d9 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.950925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb35b4-dd38-48aa-b956-e5a7385585d9 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.952807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb35b4-dd38-48aa-b956-e5a7385585d9 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.955765 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1862/3701] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:13.958927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473680b9-8c74-460b-9e26-ca25b2170fad tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:13.981912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473680b9-8c74-460b-9e26-ca25b2170fad tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:13.989698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebac16-c20a-4f16-b012-38fbb316d0b4 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:13.990364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebac16-c20a-4f16-b012-38fbb316d0b4 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:13.990646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebac16-c20a-4f16-b012-38fbb316d0b4 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:13.990921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebac16-c20a-4f16-b012-38fbb316d0b4 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:13.991567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebac16-c20a-4f16-b012-38fbb316d0b4 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:13.994590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebac16-c20a-4f16-b012-38fbb316d0b4 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:13.998015 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1840/3702] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:33:13 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.002023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb35b4-dd38-48aa-b956-e5a7385585d9 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.018553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb35b4-dd38-48aa-b956-e5a7385585d9 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.025125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c3ceb-4fb5-4b12-9464-1242043f3484 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.026030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c3ceb-4fb5-4b12-9464-1242043f3484 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.026482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c3ceb-4fb5-4b12-9464-1242043f3484 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.026842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c3ceb-4fb5-4b12-9464-1242043f3484 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.027611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c3ceb-4fb5-4b12-9464-1242043f3484 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.029604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c3ceb-4fb5-4b12-9464-1242043f3484 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.036224 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1863/3703] 10.222.0.27 () {58 vars in 1242 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.040018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebac16-c20a-4f16-b012-38fbb316d0b4 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.065431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebac16-c20a-4f16-b012-38fbb316d0b4 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.076051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5a0c9-57e3-44f3-8a57-534e10178f66 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.076923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5a0c9-57e3-44f3-8a57-534e10178f66 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.077243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5a0c9-57e3-44f3-8a57-534e10178f66 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.077704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5a0c9-57e3-44f3-8a57-534e10178f66 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.078645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5a0c9-57e3-44f3-8a57-534e10178f66 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.087870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5a0c9-57e3-44f3-8a57-534e10178f66 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.090062 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1841/3704] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.094475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c3ceb-4fb5-4b12-9464-1242043f3484 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.110117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c3ceb-4fb5-4b12-9464-1242043f3484 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.116416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e61a7-fd76-4f0a-b5ed-fc754b9e46bc tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.117138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e61a7-fd76-4f0a-b5ed-fc754b9e46bc tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.117771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e61a7-fd76-4f0a-b5ed-fc754b9e46bc tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.118147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e61a7-fd76-4f0a-b5ed-fc754b9e46bc tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.118954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e61a7-fd76-4f0a-b5ed-fc754b9e46bc tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.121348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e61a7-fd76-4f0a-b5ed-fc754b9e46bc tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.122656 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1864/3705] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.128120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5a0c9-57e3-44f3-8a57-534e10178f66 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.140366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5a0c9-57e3-44f3-8a57-534e10178f66 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.146451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a80d17-ebfc-477f-883f-a45ecaa85de1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.147480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80d17-ebfc-477f-883f-a45ecaa85de1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.147928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80d17-ebfc-477f-883f-a45ecaa85de1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.148511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80d17-ebfc-477f-883f-a45ecaa85de1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.149286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a80d17-ebfc-477f-883f-a45ecaa85de1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.157768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a80d17-ebfc-477f-883f-a45ecaa85de1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.159956 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1842/3706] 10.222.0.27 () {58 vars in 1254 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.163610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e61a7-fd76-4f0a-b5ed-fc754b9e46bc tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.184291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e61a7-fd76-4f0a-b5ed-fc754b9e46bc tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.193075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37470c6-66c0-4491-8469-b23e7aab3c51 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.194639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37470c6-66c0-4491-8469-b23e7aab3c51 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.195071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37470c6-66c0-4491-8469-b23e7aab3c51 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.196356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37470c6-66c0-4491-8469-b23e7aab3c51 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.197247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37470c6-66c0-4491-8469-b23e7aab3c51 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.200029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37470c6-66c0-4491-8469-b23e7aab3c51 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.203294 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1865/3707] 10.222.0.27 () {58 vars in 1257 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 18:33:14.206672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a80d17-ebfc-477f-883f-a45ecaa85de1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.225102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a80d17-ebfc-477f-883f-a45ecaa85de1 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.238068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349d399-4373-4584-ac30-26f1d67f5e06 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.239906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349d399-4373-4584-ac30-26f1d67f5e06 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.241057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349d399-4373-4584-ac30-26f1d67f5e06 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.241436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349d399-4373-4584-ac30-26f1d67f5e06 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.243076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349d399-4373-4584-ac30-26f1d67f5e06 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.246750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349d399-4373-4584-ac30-26f1d67f5e06 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.249191 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1843/3708] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.253320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37470c6-66c0-4491-8469-b23e7aab3c51 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.270615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37470c6-66c0-4491-8469-b23e7aab3c51 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.283878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc85553-fb24-45aa-825c-8db9069ad33d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.284180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc85553-fb24-45aa-825c-8db9069ad33d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.285530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc85553-fb24-45aa-825c-8db9069ad33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.289909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204c396-4579-4e5c-9da7-9a41ddb3bf7d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.290690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204c396-4579-4e5c-9da7-9a41ddb3bf7d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.291051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204c396-4579-4e5c-9da7-9a41ddb3bf7d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.291430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204c396-4579-4e5c-9da7-9a41ddb3bf7d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.292105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204c396-4579-4e5c-9da7-9a41ddb3bf7d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.294990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204c396-4579-4e5c-9da7-9a41ddb3bf7d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.299566 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1866/3709] 10.222.0.27 () {58 vars in 1257 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.306861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4cc85553-fb24-45aa-825c-8db9069ad33d None None] MFA Rules not processed for user `4d84581730a84c3baa33385bb14200ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:14.307062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204c396-4579-4e5c-9da7-9a41ddb3bf7d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.308209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4cc85553-fb24-45aa-825c-8db9069ad33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:14.320082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204c396-4579-4e5c-9da7-9a41ddb3bf7d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.327214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135192c-d1a3-43e0-b4c6-5eb4539f000b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.327923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135192c-d1a3-43e0-b4c6-5eb4539f000b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.328212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135192c-d1a3-43e0-b4c6-5eb4539f000b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.328493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135192c-d1a3-43e0-b4c6-5eb4539f000b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.329288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135192c-d1a3-43e0-b4c6-5eb4539f000b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.335901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135192c-d1a3-43e0-b4c6-5eb4539f000b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.339304 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1867/3710] 10.222.0.27 () {58 vars in 1293 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.344297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135192c-d1a3-43e0-b4c6-5eb4539f000b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.363821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135192c-d1a3-43e0-b4c6-5eb4539f000b tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.370842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9a945-98fd-4d75-96e6-fa5b66b18cb8 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.371609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9a945-98fd-4d75-96e6-fa5b66b18cb8 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.371893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9a945-98fd-4d75-96e6-fa5b66b18cb8 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.372176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9a945-98fd-4d75-96e6-fa5b66b18cb8 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.372782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9a945-98fd-4d75-96e6-fa5b66b18cb8 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.374552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9a945-98fd-4d75-96e6-fa5b66b18cb8 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.378753 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1868/3711] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.380144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9a945-98fd-4d75-96e6-fa5b66b18cb8 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.387388 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1844/3712] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:14.392330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9a945-98fd-4d75-96e6-fa5b66b18cb8 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.398568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee5d12-1b62-458a-ada6-7882eb7618af tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.400062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee5d12-1b62-458a-ada6-7882eb7618af tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.400530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee5d12-1b62-458a-ada6-7882eb7618af tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.400820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee5d12-1b62-458a-ada6-7882eb7618af tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.401420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee5d12-1b62-458a-ada6-7882eb7618af tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.404314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee5d12-1b62-458a-ada6-7882eb7618af tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.408310 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1869/3713] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 18:33:14.411332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc85553-fb24-45aa-825c-8db9069ad33d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.429178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc85553-fb24-45aa-825c-8db9069ad33d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.434753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b5122-8697-4b9c-9555-827bc972563d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.435457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b5122-8697-4b9c-9555-827bc972563d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.435771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b5122-8697-4b9c-9555-827bc972563d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.436078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b5122-8697-4b9c-9555-827bc972563d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.436684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b5122-8697-4b9c-9555-827bc972563d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.438294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b5122-8697-4b9c-9555-827bc972563d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.439785 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1845/3714] 10.222.0.27 () {58 vars in 1212 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.444036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee5d12-1b62-458a-ada6-7882eb7618af tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.455407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee5d12-1b62-458a-ada6-7882eb7618af tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.463322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dbf16-218e-4d23-a953-5c9a41d325ce tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.468268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dbf16-218e-4d23-a953-5c9a41d325ce tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.468723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dbf16-218e-4d23-a953-5c9a41d325ce tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.468966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dbf16-218e-4d23-a953-5c9a41d325ce tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.469542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424dbf16-218e-4d23-a953-5c9a41d325ce tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.471198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424dbf16-218e-4d23-a953-5c9a41d325ce tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.472534 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1870/3715] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.476925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b5122-8697-4b9c-9555-827bc972563d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.490686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b5122-8697-4b9c-9555-827bc972563d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.499106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d6c66-bd40-49a3-bc08-d98b483d2472 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.500153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d6c66-bd40-49a3-bc08-d98b483d2472 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.500631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d6c66-bd40-49a3-bc08-d98b483d2472 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.501208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d6c66-bd40-49a3-bc08-d98b483d2472 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.502005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d6c66-bd40-49a3-bc08-d98b483d2472 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.504552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d6c66-bd40-49a3-bc08-d98b483d2472 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.506152 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1846/3716] 10.222.0.27 () {58 vars in 1215 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.510452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dbf16-218e-4d23-a953-5c9a41d325ce tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.524356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dbf16-218e-4d23-a953-5c9a41d325ce tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.534617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebf87c-2899-4136-a34c-41eeacbf2108 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.535954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebf87c-2899-4136-a34c-41eeacbf2108 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.536445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebf87c-2899-4136-a34c-41eeacbf2108 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.537171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebf87c-2899-4136-a34c-41eeacbf2108 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.538147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebf87c-2899-4136-a34c-41eeacbf2108 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.540827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebf87c-2899-4136-a34c-41eeacbf2108 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.542731 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1871/3717] 10.222.0.27 () {58 vars in 1218 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 18:33:14.546705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d6c66-bd40-49a3-bc08-d98b483d2472 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.565853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d6c66-bd40-49a3-bc08-d98b483d2472 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.580229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d6f01-b5a5-4ca7-ba35-aee91d586a64 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.581249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d6f01-b5a5-4ca7-ba35-aee91d586a64 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.581826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d6f01-b5a5-4ca7-ba35-aee91d586a64 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.582496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d6f01-b5a5-4ca7-ba35-aee91d586a64 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.583374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d6f01-b5a5-4ca7-ba35-aee91d586a64 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.585603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d6f01-b5a5-4ca7-ba35-aee91d586a64 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.587399 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1847/3718] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.591413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebf87c-2899-4136-a34c-41eeacbf2108 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.603957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebf87c-2899-4136-a34c-41eeacbf2108 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.609922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7faa8-9f1a-410b-afc6-accf1f292f2d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.610797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7faa8-9f1a-410b-afc6-accf1f292f2d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.611231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7faa8-9f1a-410b-afc6-accf1f292f2d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.611710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7faa8-9f1a-410b-afc6-accf1f292f2d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.612477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7faa8-9f1a-410b-afc6-accf1f292f2d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.614246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7faa8-9f1a-410b-afc6-accf1f292f2d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.616332 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1872/3719] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.620749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d6f01-b5a5-4ca7-ba35-aee91d586a64 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.633541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d6f01-b5a5-4ca7-ba35-aee91d586a64 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.639914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce6687-9daa-42d3-a140-58eb790a9ced tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.640773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce6687-9daa-42d3-a140-58eb790a9ced tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.641202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce6687-9daa-42d3-a140-58eb790a9ced tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.641792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce6687-9daa-42d3-a140-58eb790a9ced tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.643524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce6687-9daa-42d3-a140-58eb790a9ced tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.645327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce6687-9daa-42d3-a140-58eb790a9ced tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.647004 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1848/3720] 10.222.0.27 () {58 vars in 1260 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.650747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7faa8-9f1a-410b-afc6-accf1f292f2d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.665452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7faa8-9f1a-410b-afc6-accf1f292f2d tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.672362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45e8b3-003f-474b-81c4-37d747e48335 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.673306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e8b3-003f-474b-81c4-37d747e48335 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.673594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e8b3-003f-474b-81c4-37d747e48335 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.673877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e8b3-003f-474b-81c4-37d747e48335 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.674500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45e8b3-003f-474b-81c4-37d747e48335 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.677710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45e8b3-003f-474b-81c4-37d747e48335 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.683774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce6687-9daa-42d3-a140-58eb790a9ced tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.684142 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1873/3721] 10.222.0.27 () {58 vars in 1263 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.708410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce6687-9daa-42d3-a140-58eb790a9ced tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.724459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd1a70-f175-4e38-91bf-6abb23f21f3f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.725878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd1a70-f175-4e38-91bf-6abb23f21f3f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.727049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd1a70-f175-4e38-91bf-6abb23f21f3f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.727530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd1a70-f175-4e38-91bf-6abb23f21f3f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.728570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd1a70-f175-4e38-91bf-6abb23f21f3f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.731909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd1a70-f175-4e38-91bf-6abb23f21f3f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.733636 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1849/3722] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.737995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45e8b3-003f-474b-81c4-37d747e48335 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.763726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45e8b3-003f-474b-81c4-37d747e48335 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.775813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb7206-c08b-4f69-8ca7-2f3a428ffcd6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.777613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb7206-c08b-4f69-8ca7-2f3a428ffcd6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.778196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb7206-c08b-4f69-8ca7-2f3a428ffcd6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.779436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb7206-c08b-4f69-8ca7-2f3a428ffcd6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.780393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb7206-c08b-4f69-8ca7-2f3a428ffcd6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.782341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb7206-c08b-4f69-8ca7-2f3a428ffcd6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.787758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd1a70-f175-4e38-91bf-6abb23f21f3f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.788181 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1874/3723] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:33:14.799921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd1a70-f175-4e38-91bf-6abb23f21f3f tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.805564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67adc90-42dc-4285-8fd4-9e71446180fe tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.810509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67adc90-42dc-4285-8fd4-9e71446180fe tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.811395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67adc90-42dc-4285-8fd4-9e71446180fe tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.811864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67adc90-42dc-4285-8fd4-9e71446180fe tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.812718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67adc90-42dc-4285-8fd4-9e71446180fe tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:14.814805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67adc90-42dc-4285-8fd4-9e71446180fe tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:14.816355 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1850/3724] 10.222.0.27 () {58 vars in 1278 bytes} [Sun Aug 28 18:33:14 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 18:33:14.822648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb7206-c08b-4f69-8ca7-2f3a428ffcd6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.830281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:14.841095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb7206-c08b-4f69-8ca7-2f3a428ffcd6 tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.851828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855e89f-e7e5-4cf3-b70f-044fbc93efce tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.852835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855e89f-e7e5-4cf3-b70f-044fbc93efce tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.853304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855e89f-e7e5-4cf3-b70f-044fbc93efce tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.853903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855e89f-e7e5-4cf3-b70f-044fbc93efce tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/0b2ab3cb2734452884a193d5014d2786` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.865614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855e89f-e7e5-4cf3-b70f-044fbc93efce tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:33:14.876086 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f855e89f-e7e5-4cf3-b70f-044fbc93efce tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Could not find domain: 0b2ab3cb2734452884a193d5014d2786.: keystone.exception.DomainNotFound: Could not find domain: 0b2ab3cb2734452884a193d5014d2786. Aug 28 18:33:14.876086 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:14.876086 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:33:14.876086 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:33:14.876086 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:33:14.876086 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:33:14.876086 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:33:14.876086 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:33:14.876086 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0b2ab3cb2734452884a193d5014d2786. Aug 28 18:33:14.876086 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:14.876086 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:33:14.876086 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:14.876086 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:14.876086 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:14.876086 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:14.877419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:14.877419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:14.877419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:14.877419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:14.877419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:14.877419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:14.877419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:14.877419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:14.877419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 18:33:14.877419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 18:33:14.877419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:33:14.877419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:33:14.877419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:33:14.877419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:33:14.877419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:14.877419 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:14.878930 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:33:14.878930 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:33:14.878930 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:33:14.878930 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:33:14.878930 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:33:14.878930 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:33:14.878930 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:33:14.878930 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:33:14.878930 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:33:14.878930 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:33:14.878930 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:33:14.878930 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:33:14.878930 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:33:14.878930 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:33:14.878930 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:33:14.878930 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:33:14.878930 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0b2ab3cb2734452884a193d5014d2786. Aug 28 18:33:14.880514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:14.882706 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1875/3725] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:14 2022] PATCH /identity/v3/domains/0b2ab3cb2734452884a193d5014d2786 => generated 112 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:33:14.889197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67adc90-42dc-4285-8fd4-9e71446180fe tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.902351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67adc90-42dc-4285-8fd4-9e71446180fe tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.910042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1eee0-359f-4203-a179-9581983198ba tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.910995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1eee0-359f-4203-a179-9581983198ba tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.912657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1eee0-359f-4203-a179-9581983198ba tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.914658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1eee0-359f-4203-a179-9581983198ba tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/03e5ec803e27403893eb7caa04f939ac` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.933287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1eee0-359f-4203-a179-9581983198ba tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:33:14.940461 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-dcf1eee0-359f-4203-a179-9581983198ba tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Could not find domain: 03e5ec803e27403893eb7caa04f939ac.: keystone.exception.DomainNotFound: Could not find domain: 03e5ec803e27403893eb7caa04f939ac. Aug 28 18:33:14.940461 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:14.940461 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:33:14.940461 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:33:14.940461 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:33:14.940461 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:33:14.940461 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:33:14.940461 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:33:14.940461 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 03e5ec803e27403893eb7caa04f939ac. Aug 28 18:33:14.940461 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:14.940461 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:33:14.940461 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:14.940461 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:14.940461 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:14.940461 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:14.941555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:14.941555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:14.941555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:14.941555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:14.941555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:14.941555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:14.941555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:14.941555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:14.941555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 18:33:14.941555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 18:33:14.941555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:33:14.941555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:33:14.941555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:33:14.941555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:33:14.941555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:14.941555 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:14.942512 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:33:14.942512 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:33:14.942512 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:33:14.942512 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:33:14.942512 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:33:14.942512 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:33:14.942512 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:33:14.942512 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:33:14.942512 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:33:14.942512 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:33:14.942512 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:33:14.942512 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:33:14.942512 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:33:14.942512 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:33:14.942512 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:33:14.942512 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:33:14.942512 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 03e5ec803e27403893eb7caa04f939ac. Aug 28 18:33:14.943637 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:14.950754 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1851/3726] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:14 2022] PATCH /identity/v3/domains/03e5ec803e27403893eb7caa04f939ac => generated 112 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:33:14.951748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855e89f-e7e5-4cf3-b70f-044fbc93efce tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:14.968027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855e89f-e7e5-4cf3-b70f-044fbc93efce tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:14.976762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2ded3-717a-42ea-94de-425c60de27eb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ceef516614c729c7b23ba70e09251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26b39a2c4b304adcb177718435afe84e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:14.977512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ded3-717a-42ea-94de-425c60de27eb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:14.977829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ded3-717a-42ea-94de-425c60de27eb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:14.978184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ded3-717a-42ea-94de-425c60de27eb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] PATH_INFO: `/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:14.988008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2ded3-717a-42ea-94de-425c60de27eb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:33:14.995644 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-d9e2ded3-717a-42ea-94de-425c60de27eb tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Could not find domain: bc9139c8a7674bd3b26b4dcdb018b141.: keystone.exception.DomainNotFound: Could not find domain: bc9139c8a7674bd3b26b4dcdb018b141. Aug 28 18:33:14.995644 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:14.995644 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:33:14.995644 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:33:14.995644 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:33:14.995644 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:33:14.995644 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:33:14.995644 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:33:14.995644 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bc9139c8a7674bd3b26b4dcdb018b141. Aug 28 18:33:14.995644 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:14.995644 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:33:14.995644 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:14.995644 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:14.995644 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:14.995644 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:14.996767 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:14.996767 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:14.996767 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:14.996767 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:14.996767 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:14.996767 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:14.996767 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:14.996767 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:14.996767 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 18:33:14.996767 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 18:33:14.996767 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:33:14.996767 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:33:14.996767 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:33:14.996767 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:33:14.996767 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:14.996767 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:15.001333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:33:15.001333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:33:15.001333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:33:15.001333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:33:15.001333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:33:15.001333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:33:15.001333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:33:15.001333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:33:15.001333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:33:15.001333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:33:15.001333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:33:15.001333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:33:15.001333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:33:15.001333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:33:15.001333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:33:15.001333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:33:15.001333 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: bc9139c8a7674bd3b26b4dcdb018b141. Aug 28 18:33:15.002683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:15.002683 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1876/3727] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:14 2022] PATCH /identity/v3/domains/bc9139c8a7674bd3b26b4dcdb018b141 => generated 112 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 18:33:15.004516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1eee0-359f-4203-a179-9581983198ba tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:15.006840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dcf1eee0-359f-4203-a179-9581983198ba tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:15.059620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:15.110069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1eee0-359f-4203-a179-9581983198ba tempest-DomainConfigurationTestJSON-1887656145 tempest-DomainConfigurationTestJSON-1887656145-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:15.124597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707d753-5b4e-4e23-9064-de2337a71771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:15.127461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d753-5b4e-4e23-9064-de2337a71771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:15.129360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d753-5b4e-4e23-9064-de2337a71771 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:15.130000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d753-5b4e-4e23-9064-de2337a71771 admin admin] PATH_INFO: `/v3/users/8d045cc7d04c432d905c7ac1068695ee` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:15.133337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707d753-5b4e-4e23-9064-de2337a71771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d045cc7d04c432d905c7ac1068695ee)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:15.138488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707d753-5b4e-4e23-9064-de2337a71771 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:15.233546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5707d753-5b4e-4e23-9064-de2337a71771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d045cc7d04c432d905c7ac1068695ee'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:15.248143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5707d753-5b4e-4e23-9064-de2337a71771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d045cc7d04c432d905c7ac1068695ee'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:15.250325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5707d753-5b4e-4e23-9064-de2337a71771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d045cc7d04c432d905c7ac1068695ee'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:15.251186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5707d753-5b4e-4e23-9064-de2337a71771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d045cc7d04c432d905c7ac1068695ee'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:15.262010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5707d753-5b4e-4e23-9064-de2337a71771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d045cc7d04c432d905c7ac1068695ee'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:15.283558 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1852/3728] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:15 2022] DELETE /identity/v3/users/8d045cc7d04c432d905c7ac1068695ee => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:15.288318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f95687-02c5-4cb3-bf52-f1261cec2b5f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:15.288653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f95687-02c5-4cb3-bf52-f1261cec2b5f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:15.288923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f95687-02c5-4cb3-bf52-f1261cec2b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:15.319325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-33f95687-02c5-4cb3-bf52-f1261cec2b5f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:15.320710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-33f95687-02c5-4cb3-bf52-f1261cec2b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:15.404115 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1877/3729] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:15.421555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707d753-5b4e-4e23-9064-de2337a71771 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:15.421708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f95687-02c5-4cb3-bf52-f1261cec2b5f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:15.423082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5707d753-5b4e-4e23-9064-de2337a71771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:15.423293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-33f95687-02c5-4cb3-bf52-f1261cec2b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:15.529494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f95687-02c5-4cb3-bf52-f1261cec2b5f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:15.534368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99603bdc-0993-4a73-a586-84e97c0e5c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:15.536759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99603bdc-0993-4a73-a586-84e97c0e5c04 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:15.537385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99603bdc-0993-4a73-a586-84e97c0e5c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:15.537874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99603bdc-0993-4a73-a586-84e97c0e5c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:15.560886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707d753-5b4e-4e23-9064-de2337a71771 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:15.584954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6b74c-5ee0-40de-9b89-abc5872c94fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:15.585604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6b74c-5ee0-40de-9b89-abc5872c94fe service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:15.585884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6b74c-5ee0-40de-9b89-abc5872c94fe service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:15.586159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6b74c-5ee0-40de-9b89-abc5872c94fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:15.587103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99603bdc-0993-4a73-a586-84e97c0e5c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:15.590212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aba6b74c-5ee0-40de-9b89-abc5872c94fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:15.592511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99603bdc-0993-4a73-a586-84e97c0e5c04 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:15.639144 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1878/3730] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:33:15.700604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99603bdc-0993-4a73-a586-84e97c0e5c04 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:15.702861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-99603bdc-0993-4a73-a586-84e97c0e5c04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:15.719175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:15.742862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99603bdc-0993-4a73-a586-84e97c0e5c04 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:15.760822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c5ea9-2d83-40cc-9174-45993199aa48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:15.761827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c5ea9-2d83-40cc-9174-45993199aa48 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:15.763235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c5ea9-2d83-40cc-9174-45993199aa48 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:15.765229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c5ea9-2d83-40cc-9174-45993199aa48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:15.768710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f71c5ea9-2d83-40cc-9174-45993199aa48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:15.797123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c5ea9-2d83-40cc-9174-45993199aa48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:15.801688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c5ea9-2d83-40cc-9174-45993199aa48 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:15.820368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6b74c-5ee0-40de-9b89-abc5872c94fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:15.830034 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1879/3731] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:33:15.835938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6b74c-5ee0-40de-9b89-abc5872c94fe service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:15.874386 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1853/3732] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:33:16.502546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c5ea9-2d83-40cc-9174-45993199aa48 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:16.503926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f71c5ea9-2d83-40cc-9174-45993199aa48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:16.528602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c5ea9-2d83-40cc-9174-45993199aa48 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:16.544052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32731f02-23f5-4d6b-9b56-16d78f1ec85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:16.544705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32731f02-23f5-4d6b-9b56-16d78f1ec85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:16.544985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32731f02-23f5-4d6b-9b56-16d78f1ec85f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:16.545263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32731f02-23f5-4d6b-9b56-16d78f1ec85f admin admin] PATH_INFO: `/v3/projects/1ce0c0ad267442f4b2b7bba6d0610fff` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:16.546435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32731f02-23f5-4d6b-9b56-16d78f1ec85f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ce0c0ad267442f4b2b7bba6d0610fff)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:16.548434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32731f02-23f5-4d6b-9b56-16d78f1ec85f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:16.562910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9d50a-2491-405e-9261-34f03c77dc9e None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:16.563424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9d50a-2491-405e-9261-34f03c77dc9e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:16.563525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9d50a-2491-405e-9261-34f03c77dc9e None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:16.565964 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1854/3733] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:33:16.574931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65830c-7f2f-495c-b116-6b5ecfd805f7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:16.575491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65830c-7f2f-495c-b116-6b5ecfd805f7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:16.576033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65830c-7f2f-495c-b116-6b5ecfd805f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:16.676817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32731f02-23f5-4d6b-9b56-16d78f1ec85f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce0c0ad267442f4b2b7bba6d0610fff', 'request_id': 'req-32731f02-23f5-4d6b-9b56-16d78f1ec85f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:16.681231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ac65830c-7f2f-495c-b116-6b5ecfd805f7 None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:16.686841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ac65830c-7f2f-495c-b116-6b5ecfd805f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:16.696954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32731f02-23f5-4d6b-9b56-16d78f1ec85f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce0c0ad267442f4b2b7bba6d0610fff', 'request_id': 'req-32731f02-23f5-4d6b-9b56-16d78f1ec85f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:16.708664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32731f02-23f5-4d6b-9b56-16d78f1ec85f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce0c0ad267442f4b2b7bba6d0610fff', 'request_id': 'req-32731f02-23f5-4d6b-9b56-16d78f1ec85f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:16.734571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:16.743045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32731f02-23f5-4d6b-9b56-16d78f1ec85f admin admin] The token cache is being invalidate because project 1ce0c0ad267442f4b2b7bba6d0610fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:16.745852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32731f02-23f5-4d6b-9b56-16d78f1ec85f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:16.745852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32731f02-23f5-4d6b-9b56-16d78f1ec85f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:16.747373 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1880/3734] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:16 2022] DELETE /identity/v3/projects/1ce0c0ad267442f4b2b7bba6d0610fff => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:16.751683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32731f02-23f5-4d6b-9b56-16d78f1ec85f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:16.760593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-32731f02-23f5-4d6b-9b56-16d78f1ec85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:16.857846 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1855/3735] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:33:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:16.885919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65830c-7f2f-495c-b116-6b5ecfd805f7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:16.888442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ac65830c-7f2f-495c-b116-6b5ecfd805f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:16.914257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32731f02-23f5-4d6b-9b56-16d78f1ec85f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:16.917108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65830c-7f2f-495c-b116-6b5ecfd805f7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:16.921220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a423f17-11e9-4eee-8c58-b56d4652294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:16.921691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a423f17-11e9-4eee-8c58-b56d4652294c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:16.921969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a423f17-11e9-4eee-8c58-b56d4652294c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:16.922543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a423f17-11e9-4eee-8c58-b56d4652294c admin admin] PATH_INFO: `/v3/users/ab1ceef516614c729c7b23ba70e09251` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:16.923809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a423f17-11e9-4eee-8c58-b56d4652294c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1ceef516614c729c7b23ba70e09251)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:16.926719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a423f17-11e9-4eee-8c58-b56d4652294c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:16.929623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb4232-e572-40f8-9b71-3d09826d04a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:16.931926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb4232-e572-40f8-9b71-3d09826d04a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:16.932207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb4232-e572-40f8-9b71-3d09826d04a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:16.932509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb4232-e572-40f8-9b71-3d09826d04a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:16.973115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb4232-e572-40f8-9b71-3d09826d04a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:16.974588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb4232-e572-40f8-9b71-3d09826d04a7 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:16.997366 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1856/3736] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:33:17.034247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a423f17-11e9-4eee-8c58-b56d4652294c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1ceef516614c729c7b23ba70e09251'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:17.034968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a423f17-11e9-4eee-8c58-b56d4652294c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1ceef516614c729c7b23ba70e09251'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:17.044986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a423f17-11e9-4eee-8c58-b56d4652294c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1ceef516614c729c7b23ba70e09251'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:17.069576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a423f17-11e9-4eee-8c58-b56d4652294c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1ceef516614c729c7b23ba70e09251'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:17.092089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a423f17-11e9-4eee-8c58-b56d4652294c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1ceef516614c729c7b23ba70e09251'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:17.104212 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1881/3737] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:16 2022] DELETE /identity/v3/users/ab1ceef516614c729c7b23ba70e09251 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:17.815903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb4232-e572-40f8-9b71-3d09826d04a7 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:17.839416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb4232-e572-40f8-9b71-3d09826d04a7 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:17.938811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df399fc1-e020-4a71-ace6-1c7491401f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:17.940506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df399fc1-e020-4a71-ace6-1c7491401f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:17.942045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df399fc1-e020-4a71-ace6-1c7491401f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:17.942236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df399fc1-e020-4a71-ace6-1c7491401f3f admin admin] PATH_INFO: `/v3/projects/26b39a2c4b304adcb177718435afe84e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:17.945770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df399fc1-e020-4a71-ace6-1c7491401f3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b39a2c4b304adcb177718435afe84e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:17.947650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df399fc1-e020-4a71-ace6-1c7491401f3f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:18.057702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df399fc1-e020-4a71-ace6-1c7491401f3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b39a2c4b304adcb177718435afe84e', 'request_id': 'req-df399fc1-e020-4a71-ace6-1c7491401f3f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:18.066527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df399fc1-e020-4a71-ace6-1c7491401f3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b39a2c4b304adcb177718435afe84e', 'request_id': 'req-df399fc1-e020-4a71-ace6-1c7491401f3f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:18.077478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df399fc1-e020-4a71-ace6-1c7491401f3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b39a2c4b304adcb177718435afe84e', 'request_id': 'req-df399fc1-e020-4a71-ace6-1c7491401f3f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:18.082376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:18.097852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df399fc1-e020-4a71-ace6-1c7491401f3f admin admin] The token cache is being invalidate because project 26b39a2c4b304adcb177718435afe84e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:18.098532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df399fc1-e020-4a71-ace6-1c7491401f3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:18.099444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df399fc1-e020-4a71-ace6-1c7491401f3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:18.101890 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1857/3738] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:17 2022] DELETE /identity/v3/projects/26b39a2c4b304adcb177718435afe84e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:18.107060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b4825-a38c-4e46-a68a-67b399b5487f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:18.107747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b4825-a38c-4e46-a68a-67b399b5487f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:18.107747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b4825-a38c-4e46-a68a-67b399b5487f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:18.130825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b63b4825-a38c-4e46-a68a-67b399b5487f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:18.132205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b63b4825-a38c-4e46-a68a-67b399b5487f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:18.217937 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1882/3739] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:18.220426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834350-33da-4669-8ac5-3dfba954cba2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:18.220815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834350-33da-4669-8ac5-3dfba954cba2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:18.221168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834350-33da-4669-8ac5-3dfba954cba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:18.252506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0e834350-33da-4669-8ac5-3dfba954cba2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:18.253794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0e834350-33da-4669-8ac5-3dfba954cba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:18.263192 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1858/3740] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:18.267545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b4825-a38c-4e46-a68a-67b399b5487f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:18.279797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b4825-a38c-4e46-a68a-67b399b5487f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:18.284539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f9d03-af88-472e-9690-a5762397b8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:18.285221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f9d03-af88-472e-9690-a5762397b8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:18.285566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f9d03-af88-472e-9690-a5762397b8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:18.285915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f9d03-af88-472e-9690-a5762397b8e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:18.286573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f9d03-af88-472e-9690-a5762397b8e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:18.286874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f9d03-af88-472e-9690-a5762397b8e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:18.288536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f9d03-af88-472e-9690-a5762397b8e4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:18.301349 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1883/3741] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:18.305807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834350-33da-4669-8ac5-3dfba954cba2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:18.316200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834350-33da-4669-8ac5-3dfba954cba2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:18.321216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678c56f-633e-4fd6-af19-187d2f621a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:18.321788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678c56f-633e-4fd6-af19-187d2f621a2d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:18.322074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678c56f-633e-4fd6-af19-187d2f621a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:18.322488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678c56f-633e-4fd6-af19-187d2f621a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:18.323290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678c56f-633e-4fd6-af19-187d2f621a2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:18.325693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678c56f-633e-4fd6-af19-187d2f621a2d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:18.364505 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1859/3742] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:18 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:18.366250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f9d03-af88-472e-9690-a5762397b8e4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:18.379974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f9d03-af88-472e-9690-a5762397b8e4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:18.385105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:18.464682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72760a0f-3318-4581-8bb6-5a8930041b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:18.465405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72760a0f-3318-4581-8bb6-5a8930041b1a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:18.465685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72760a0f-3318-4581-8bb6-5a8930041b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:18.465959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72760a0f-3318-4581-8bb6-5a8930041b1a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:18.466607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72760a0f-3318-4581-8bb6-5a8930041b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:18.468591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72760a0f-3318-4581-8bb6-5a8930041b1a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:18.496097 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1884/3743] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:18 2022] POST /identity/v3/users => generated 284 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:18.500376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678c56f-633e-4fd6-af19-187d2f621a2d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:18.512069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678c56f-633e-4fd6-af19-187d2f621a2d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:18.519919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf578a0-06d1-4f42-83cc-679abcfdd378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:18.520568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf578a0-06d1-4f42-83cc-679abcfdd378 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:18.520854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf578a0-06d1-4f42-83cc-679abcfdd378 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:18.521103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf578a0-06d1-4f42-83cc-679abcfdd378 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:18.521785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf578a0-06d1-4f42-83cc-679abcfdd378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:18.523605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf578a0-06d1-4f42-83cc-679abcfdd378 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:18.534846 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1860/3744] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:18.538993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72760a0f-3318-4581-8bb6-5a8930041b1a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:18.549586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72760a0f-3318-4581-8bb6-5a8930041b1a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:18.558912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0472a-5c32-4172-b7a6-30fc064398b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:18.558912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0472a-5c32-4172-b7a6-30fc064398b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:18.558912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0472a-5c32-4172-b7a6-30fc064398b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:18.558912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0472a-5c32-4172-b7a6-30fc064398b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:18.559346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0472a-5c32-4172-b7a6-30fc064398b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:18.559346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0472a-5c32-4172-b7a6-30fc064398b8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:18.582264 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1885/3745] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:18.586497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf578a0-06d1-4f42-83cc-679abcfdd378 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:18.597692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf578a0-06d1-4f42-83cc-679abcfdd378 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:18.604086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a61b97-e26e-4fae-9acc-72971de0a4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:18.604724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a61b97-e26e-4fae-9acc-72971de0a4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:18.605006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a61b97-e26e-4fae-9acc-72971de0a4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:18.605284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a61b97-e26e-4fae-9acc-72971de0a4f6 admin admin] PATH_INFO: `/v3/projects/f1d158a7e1f84c2b8bfd55278dc750ec/users/3dd9d42987fd452db6e60148f38d50ff/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:18.625362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a61b97-e26e-4fae-9acc-72971de0a4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d158a7e1f84c2b8bfd55278dc750ec, user_id=3dd9d42987fd452db6e60148f38d50ff, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:18.628331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a61b97-e26e-4fae-9acc-72971de0a4f6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:18.642382 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1861/3746] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:18 2022] PUT /identity/v3/projects/f1d158a7e1f84c2b8bfd55278dc750ec/users/3dd9d42987fd452db6e60148f38d50ff/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:18.653710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf04dd4-e7d3-477e-ae38-0a02a0f7cd8b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:18.654265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf04dd4-e7d3-477e-ae38-0a02a0f7cd8b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:18.654542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf04dd4-e7d3-477e-ae38-0a02a0f7cd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:18.685386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8bf04dd4-e7d3-477e-ae38-0a02a0f7cd8b None None] MFA Rules not processed for user `3dd9d42987fd452db6e60148f38d50ff`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:18.686735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8bf04dd4-e7d3-477e-ae38-0a02a0f7cd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:18.759302 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1886/3747] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:18.765346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a61b97-e26e-4fae-9acc-72971de0a4f6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:18.846881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a61b97-e26e-4fae-9acc-72971de0a4f6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:18.852124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593eee1-049c-4bb2-9adc-268d95dbdaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:18.852743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593eee1-049c-4bb2-9adc-268d95dbdaab admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:18.853022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593eee1-049c-4bb2-9adc-268d95dbdaab admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:18.853292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593eee1-049c-4bb2-9adc-268d95dbdaab admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:18.854039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593eee1-049c-4bb2-9adc-268d95dbdaab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:18.856318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593eee1-049c-4bb2-9adc-268d95dbdaab admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:18.888887 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1862/3748] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:18 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:18.893095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf04dd4-e7d3-477e-ae38-0a02a0f7cd8b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:18.907628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf04dd4-e7d3-477e-ae38-0a02a0f7cd8b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:18.966164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028e62f-b2a9-47a6-8848-f6d71088ffe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:18.966783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028e62f-b2a9-47a6-8848-f6d71088ffe8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:18.967055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028e62f-b2a9-47a6-8848-f6d71088ffe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:18.967353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028e62f-b2a9-47a6-8848-f6d71088ffe8 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:18.967979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028e62f-b2a9-47a6-8848-f6d71088ffe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:18.969913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028e62f-b2a9-47a6-8848-f6d71088ffe8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:18.992369 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1887/3749] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:18 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:18.996627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593eee1-049c-4bb2-9adc-268d95dbdaab admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:19.008432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593eee1-049c-4bb2-9adc-268d95dbdaab admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:19.013951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddda8f6-73f6-4d47-8053-a5fec57028b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:19.014573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda8f6-73f6-4d47-8053-a5fec57028b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:19.014851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda8f6-73f6-4d47-8053-a5fec57028b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:19.015394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda8f6-73f6-4d47-8053-a5fec57028b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:19.016227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddda8f6-73f6-4d47-8053-a5fec57028b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:19.017397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddda8f6-73f6-4d47-8053-a5fec57028b7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:19.029676 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1863/3750] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:19.033951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028e62f-b2a9-47a6-8848-f6d71088ffe8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:19.040858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:19.045246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028e62f-b2a9-47a6-8848-f6d71088ffe8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:19.053294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41106ec2-3bfd-47a7-9de0-1d80cfe91200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:19.054064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41106ec2-3bfd-47a7-9de0-1d80cfe91200 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:19.054387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41106ec2-3bfd-47a7-9de0-1d80cfe91200 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:19.054651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41106ec2-3bfd-47a7-9de0-1d80cfe91200 admin admin] PATH_INFO: `/v3/projects/fc03c5e540a845b4a7e4e8d8929d61c4/users/71e135daf8464025af8aa0e4f14a62d7/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:19.079549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41106ec2-3bfd-47a7-9de0-1d80cfe91200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc03c5e540a845b4a7e4e8d8929d61c4, user_id=71e135daf8464025af8aa0e4f14a62d7, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:19.082637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41106ec2-3bfd-47a7-9de0-1d80cfe91200 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:19.098271 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1888/3751] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:19 2022] PUT /identity/v3/projects/fc03c5e540a845b4a7e4e8d8929d61c4/users/71e135daf8464025af8aa0e4f14a62d7/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:19.102647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddda8f6-73f6-4d47-8053-a5fec57028b7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:19.113790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddda8f6-73f6-4d47-8053-a5fec57028b7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:19.170376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797b84c-fdf8-4ea8-ac1c-e08b011b37b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:19.170984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797b84c-fdf8-4ea8-ac1c-e08b011b37b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:19.171277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797b84c-fdf8-4ea8-ac1c-e08b011b37b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:19.171546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797b84c-fdf8-4ea8-ac1c-e08b011b37b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:19.172186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797b84c-fdf8-4ea8-ac1c-e08b011b37b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:19.173820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797b84c-fdf8-4ea8-ac1c-e08b011b37b7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:19.179183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:19.189558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41106ec2-3bfd-47a7-9de0-1d80cfe91200 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:19.196601 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1864/3752] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:19.200787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41106ec2-3bfd-47a7-9de0-1d80cfe91200 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:19.205881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa803ce-dd24-41fb-ab41-652b773b3f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:19.206547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa803ce-dd24-41fb-ab41-652b773b3f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:19.206828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa803ce-dd24-41fb-ab41-652b773b3f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:19.207100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa803ce-dd24-41fb-ab41-652b773b3f50 admin admin] PATH_INFO: `/v3/projects/fc03c5e540a845b4a7e4e8d8929d61c4/users/71e135daf8464025af8aa0e4f14a62d7/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:19.209208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa803ce-dd24-41fb-ab41-652b773b3f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc03c5e540a845b4a7e4e8d8929d61c4, user_id=71e135daf8464025af8aa0e4f14a62d7, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:19.211908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa803ce-dd24-41fb-ab41-652b773b3f50 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:19.223090 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1889/3753] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:19 2022] PUT /identity/v3/projects/fc03c5e540a845b4a7e4e8d8929d61c4/users/71e135daf8464025af8aa0e4f14a62d7/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:19.233938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5812b6-2a00-452a-9ee6-f647210afab8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:19.234214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5812b6-2a00-452a-9ee6-f647210afab8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:19.234484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5812b6-2a00-452a-9ee6-f647210afab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:19.264388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1e5812b6-2a00-452a-9ee6-f647210afab8 None None] MFA Rules not processed for user `71e135daf8464025af8aa0e4f14a62d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:19.265601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1e5812b6-2a00-452a-9ee6-f647210afab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:19.350837 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1865/3754] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:19.354588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa803ce-dd24-41fb-ab41-652b773b3f50 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:19.367284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa803ce-dd24-41fb-ab41-652b773b3f50 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:19.372755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c1f7a-59de-4d43-a181-e4b782e61489 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:19.373374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1f7a-59de-4d43-a181-e4b782e61489 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:19.373653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1f7a-59de-4d43-a181-e4b782e61489 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:19.373926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1f7a-59de-4d43-a181-e4b782e61489 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:19.374978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c1f7a-59de-4d43-a181-e4b782e61489 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:19.376374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c1f7a-59de-4d43-a181-e4b782e61489 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:19.394476 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1890/3755] 10.222.0.27 () {60 vars in 1150 bytes} [Sun Aug 28 18:33:19 2022] POST /identity/v3/domains => generated 276 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:19.398748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5812b6-2a00-452a-9ee6-f647210afab8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:19.413552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5812b6-2a00-452a-9ee6-f647210afab8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:19.475611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64dcdd-191d-4fea-8b61-64c9f7939ab5 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:19.476195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64dcdd-191d-4fea-8b61-64c9f7939ab5 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:19.476477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64dcdd-191d-4fea-8b61-64c9f7939ab5 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:19.476780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64dcdd-191d-4fea-8b61-64c9f7939ab5 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:19.477477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64dcdd-191d-4fea-8b61-64c9f7939ab5 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:19.478488 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-0a64dcdd-191d-4fea-8b61-64c9f7939ab5 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:19.478488 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:19.478488 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:19.479568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64dcdd-191d-4fea-8b61-64c9f7939ab5 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:19.498701 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1866/3756] 10.222.0.27 () {60 vars in 1150 bytes} [Sun Aug 28 18:33:19 2022] POST /identity/v3/domains => generated 276 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:19.501943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c1f7a-59de-4d43-a181-e4b782e61489 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:19.513750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c1f7a-59de-4d43-a181-e4b782e61489 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:19.574315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa043a9-2832-4114-a3a0-5ff28b0ba826 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:19.575142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa043a9-2832-4114-a3a0-5ff28b0ba826 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:19.575700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa043a9-2832-4114-a3a0-5ff28b0ba826 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:19.575839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa043a9-2832-4114-a3a0-5ff28b0ba826 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:19.576389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa043a9-2832-4114-a3a0-5ff28b0ba826 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:19.579153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa043a9-2832-4114-a3a0-5ff28b0ba826 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:19.623862 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1891/3757] 10.222.0.27 () {60 vars in 1150 bytes} [Sun Aug 28 18:33:19 2022] POST /identity/v3/domains => generated 277 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:19.624999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64dcdd-191d-4fea-8b61-64c9f7939ab5 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:19.650283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64dcdd-191d-4fea-8b61-64c9f7939ab5 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:19.750276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48bfc3-02ec-43aa-881c-7fa777f78d5a tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:19.750907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48bfc3-02ec-43aa-881c-7fa777f78d5a tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:19.751194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48bfc3-02ec-43aa-881c-7fa777f78d5a tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:19.751545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48bfc3-02ec-43aa-881c-7fa777f78d5a tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:19.752172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf48bfc3-02ec-43aa-881c-7fa777f78d5a tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:19.754185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf48bfc3-02ec-43aa-881c-7fa777f78d5a tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:19.779105 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1867/3758] 10.222.0.27 () {60 vars in 1150 bytes} [Sun Aug 28 18:33:19 2022] POST /identity/v3/domains => generated 279 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:19.781662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa043a9-2832-4114-a3a0-5ff28b0ba826 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:19.799936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa043a9-2832-4114-a3a0-5ff28b0ba826 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:19.882241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:19.883052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:19.883368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:19.883652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/9af605070d354fefa16fa0cf8806fdf3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:19.896889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9af605070d354fefa16fa0cf8806fdf3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:19.898535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:19.921370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9af605070d354fefa16fa0cf8806fdf3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:19.931615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9af605070d354fefa16fa0cf8806fdf3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:19.942162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:19.976577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af605070d354fefa16fa0cf8806fdf3', 'request_id': 'req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:19.984609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af605070d354fefa16fa0cf8806fdf3', 'request_id': 'req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:19.990833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af605070d354fefa16fa0cf8806fdf3', 'request_id': 'req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.004271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] The token cache is being invalidate because project 9af605070d354fefa16fa0cf8806fdf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:20.004566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.005338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.014176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9af605070d354fefa16fa0cf8806fdf3', 'request_id': 'req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.015336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9af605070d354fefa16fa0cf8806fdf3', 'request_id': 'req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.019168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9af605070d354fefa16fa0cf8806fdf3', 'request_id': 'req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.025474 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1892/3759] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:33:19 2022] DELETE /identity/v3/domains/9af605070d354fefa16fa0cf8806fdf3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:20.030810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48bfc3-02ec-43aa-881c-7fa777f78d5a tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:20.033341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bf48bfc3-02ec-43aa-881c-7fa777f78d5a tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:20.046493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48bfc3-02ec-43aa-881c-7fa777f78d5a tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:20.056439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:20.109313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c7b6d-f5ee-465d-8438-3e886572f6f3 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:20.110549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c7b6d-f5ee-465d-8438-3e886572f6f3 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:20.110876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c7b6d-f5ee-465d-8438-3e886572f6f3 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:20.111410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c7b6d-f5ee-465d-8438-3e886572f6f3 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:20.112244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c7b6d-f5ee-465d-8438-3e886572f6f3 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:20.114390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c7b6d-f5ee-465d-8438-3e886572f6f3 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:20.136455 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1868/3760] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:33:20 2022] POST /identity/v3/domains => generated 248 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:20.141263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:20.151952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5c51a-aed1-4d63-a8b9-ef51cd82a4d1 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:20.231039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c9d63-bda1-4bc4-9458-f0c22356e4b6 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:20.231890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c9d63-bda1-4bc4-9458-f0c22356e4b6 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:20.232182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c9d63-bda1-4bc4-9458-f0c22356e4b6 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:20.232441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c9d63-bda1-4bc4-9458-f0c22356e4b6 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/9b8d08a698404676bc66297a37afd04f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:20.245670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c9d63-bda1-4bc4-9458-f0c22356e4b6 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9b8d08a698404676bc66297a37afd04f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:20.247542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c9d63-bda1-4bc4-9458-f0c22356e4b6 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:20.270592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-507c9d63-bda1-4bc4-9458-f0c22356e4b6 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9b8d08a698404676bc66297a37afd04f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.270757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-507c9d63-bda1-4bc4-9458-f0c22356e4b6 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9b8d08a698404676bc66297a37afd04f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.304174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-507c9d63-bda1-4bc4-9458-f0c22356e4b6 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9b8d08a698404676bc66297a37afd04f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.304917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-507c9d63-bda1-4bc4-9458-f0c22356e4b6 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9b8d08a698404676bc66297a37afd04f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.311432 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1893/3761] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:20 2022] PATCH /identity/v3/domains/9b8d08a698404676bc66297a37afd04f => generated 249 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:20.313897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c7b6d-f5ee-465d-8438-3e886572f6f3 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:20.315761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-403c7b6d-f5ee-465d-8438-3e886572f6f3 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:20.329785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c7b6d-f5ee-465d-8438-3e886572f6f3 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:20.400840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:20.401493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:20.401785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:20.402064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/9b8d08a698404676bc66297a37afd04f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:20.414481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9b8d08a698404676bc66297a37afd04f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:20.416165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:20.464638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9b8d08a698404676bc66297a37afd04f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.498794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9b8d08a698404676bc66297a37afd04f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.548566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b8d08a698404676bc66297a37afd04f', 'request_id': 'req-f938f875-c359-4f9a-8a49-c32b0530bdf7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.564379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b8d08a698404676bc66297a37afd04f', 'request_id': 'req-f938f875-c359-4f9a-8a49-c32b0530bdf7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.606467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b8d08a698404676bc66297a37afd04f', 'request_id': 'req-f938f875-c359-4f9a-8a49-c32b0530bdf7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.624922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] The token cache is being invalidate because project 9b8d08a698404676bc66297a37afd04f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:20.625176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.626680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.632995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:20.646703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9b8d08a698404676bc66297a37afd04f', 'request_id': 'req-f938f875-c359-4f9a-8a49-c32b0530bdf7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.651150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9b8d08a698404676bc66297a37afd04f', 'request_id': 'req-f938f875-c359-4f9a-8a49-c32b0530bdf7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.652147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9b8d08a698404676bc66297a37afd04f', 'request_id': 'req-f938f875-c359-4f9a-8a49-c32b0530bdf7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:20.671158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c9d63-bda1-4bc4-9458-f0c22356e4b6 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:20.699582 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1869/3762] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:33:20 2022] DELETE /identity/v3/domains/9b8d08a698404676bc66297a37afd04f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:20.704721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c9d63-bda1-4bc4-9458-f0c22356e4b6 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:20.771633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:20.810519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52833df2-b7fc-4327-9ea7-47d2c8489ebf tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:20.811504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52833df2-b7fc-4327-9ea7-47d2c8489ebf tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:20.811863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52833df2-b7fc-4327-9ea7-47d2c8489ebf tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:20.812221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52833df2-b7fc-4327-9ea7-47d2c8489ebf tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:20.813703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52833df2-b7fc-4327-9ea7-47d2c8489ebf tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:20.816219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52833df2-b7fc-4327-9ea7-47d2c8489ebf tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:20.847617 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1894/3763] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:33:20 2022] POST /identity/v3/domains => generated 278 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:20.848318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:20.849997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:20.864096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938f875-c359-4f9a-8a49-c32b0530bdf7 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:20.961301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d5548-5416-48b3-92b2-8606a2ed174f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:20.962113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d5548-5416-48b3-92b2-8606a2ed174f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:20.962457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d5548-5416-48b3-92b2-8606a2ed174f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:20.962952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d5548-5416-48b3-92b2-8606a2ed174f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/2238c1780b6a46eca76b65cd22ea9f12` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:20.979390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d5548-5416-48b3-92b2-8606a2ed174f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2238c1780b6a46eca76b65cd22ea9f12)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:20.981397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d5548-5416-48b3-92b2-8606a2ed174f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:21.009210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-430d5548-5416-48b3-92b2-8606a2ed174f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2238c1780b6a46eca76b65cd22ea9f12'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.010039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-430d5548-5416-48b3-92b2-8606a2ed174f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2238c1780b6a46eca76b65cd22ea9f12'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.047126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-430d5548-5416-48b3-92b2-8606a2ed174f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2238c1780b6a46eca76b65cd22ea9f12'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.049693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-430d5548-5416-48b3-92b2-8606a2ed174f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2238c1780b6a46eca76b65cd22ea9f12'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.053310 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1870/3764] 10.222.0.27 () {60 vars in 1250 bytes} [Sun Aug 28 18:33:20 2022] PATCH /identity/v3/domains/2238c1780b6a46eca76b65cd22ea9f12 => generated 279 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:21.059014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52833df2-b7fc-4327-9ea7-47d2c8489ebf tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:21.061309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52833df2-b7fc-4327-9ea7-47d2c8489ebf tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:21.087048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52833df2-b7fc-4327-9ea7-47d2c8489ebf tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:21.219442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e7609-7022-4a08-8fdf-ef282c959e1b tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:21.220274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e7609-7022-4a08-8fdf-ef282c959e1b tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:21.220563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e7609-7022-4a08-8fdf-ef282c959e1b tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:21.220845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e7609-7022-4a08-8fdf-ef282c959e1b tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/2238c1780b6a46eca76b65cd22ea9f12` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:21.248105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e7609-7022-4a08-8fdf-ef282c959e1b tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=2238c1780b6a46eca76b65cd22ea9f12)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:21.252178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e7609-7022-4a08-8fdf-ef282c959e1b tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:21.256627 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1895/3765] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:33:21 2022] GET /identity/v3/domains/2238c1780b6a46eca76b65cd22ea9f12 => generated 279 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:21.262563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d5548-5416-48b3-92b2-8606a2ed174f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:21.302196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d5548-5416-48b3-92b2-8606a2ed174f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:21.308712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:21.309486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:21.309861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:21.310521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/2238c1780b6a46eca76b65cd22ea9f12` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:21.311445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2238c1780b6a46eca76b65cd22ea9f12)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:21.313651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:21.341680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2238c1780b6a46eca76b65cd22ea9f12'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.353000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2238c1780b6a46eca76b65cd22ea9f12'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.403055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2238c1780b6a46eca76b65cd22ea9f12', 'request_id': 'req-25be2501-1758-4d33-97ad-85c628869498'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.410583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2238c1780b6a46eca76b65cd22ea9f12', 'request_id': 'req-25be2501-1758-4d33-97ad-85c628869498'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.416118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2238c1780b6a46eca76b65cd22ea9f12', 'request_id': 'req-25be2501-1758-4d33-97ad-85c628869498'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.425826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:21.432130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] The token cache is being invalidate because project 2238c1780b6a46eca76b65cd22ea9f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:21.432457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.433041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.443642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2238c1780b6a46eca76b65cd22ea9f12', 'request_id': 'req-25be2501-1758-4d33-97ad-85c628869498'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.448048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2238c1780b6a46eca76b65cd22ea9f12', 'request_id': 'req-25be2501-1758-4d33-97ad-85c628869498'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.448932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2238c1780b6a46eca76b65cd22ea9f12', 'request_id': 'req-25be2501-1758-4d33-97ad-85c628869498'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.458530 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1871/3766] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:33:21 2022] DELETE /identity/v3/domains/2238c1780b6a46eca76b65cd22ea9f12 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:21.459700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e7609-7022-4a08-8fdf-ef282c959e1b tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:21.466479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-970e7609-7022-4a08-8fdf-ef282c959e1b tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:21.480656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e7609-7022-4a08-8fdf-ef282c959e1b tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:21.546730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0e848-81f8-48e1-93a8-9fd391d2607c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:21.547405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0e848-81f8-48e1-93a8-9fd391d2607c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:21.547711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0e848-81f8-48e1-93a8-9fd391d2607c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:21.547956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0e848-81f8-48e1-93a8-9fd391d2607c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:21.548582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0e848-81f8-48e1-93a8-9fd391d2607c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:21.550255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0e848-81f8-48e1-93a8-9fd391d2607c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:21.571196 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1896/3767] 10.222.0.27 () {58 vars in 1128 bytes} [Sun Aug 28 18:33:21 2022] GET /identity/v3/domains => generated 1347 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:21.576451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:21.598528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be2501-1758-4d33-97ad-85c628869498 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:21.614555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337287b-aa6f-4466-a5ce-cfe5ef83225a tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:21.614847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337287b-aa6f-4466-a5ce-cfe5ef83225a tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:21.615239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337287b-aa6f-4466-a5ce-cfe5ef83225a tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:21.615610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337287b-aa6f-4466-a5ce-cfe5ef83225a tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/2238c1780b6a46eca76b65cd22ea9f12` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:21.623616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337287b-aa6f-4466-a5ce-cfe5ef83225a tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:33:21.628812 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-0337287b-aa6f-4466-a5ce-cfe5ef83225a tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Could not find domain: 2238c1780b6a46eca76b65cd22ea9f12.: keystone.exception.DomainNotFound: Could not find domain: 2238c1780b6a46eca76b65cd22ea9f12. Aug 28 18:33:21.628812 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:21.628812 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:33:21.628812 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:33:21.628812 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:33:21.628812 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:33:21.628812 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:33:21.628812 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:33:21.628812 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2238c1780b6a46eca76b65cd22ea9f12. Aug 28 18:33:21.628812 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:21.628812 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:33:21.628812 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:21.628812 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:21.628812 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:21.628812 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:21.628812 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:21.630103 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:21.630103 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:21.630103 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:21.630103 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:21.630103 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:21.630103 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:21.630103 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:21.630103 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 18:33:21.630103 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 18:33:21.630103 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:33:21.630103 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:33:21.630103 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:33:21.630103 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:33:21.630103 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:21.630103 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:21.630103 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:33:21.631156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:33:21.631156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:33:21.631156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:33:21.631156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:33:21.631156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:33:21.631156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:33:21.631156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:33:21.631156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:33:21.631156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:33:21.631156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:33:21.631156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:33:21.631156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:33:21.631156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:33:21.631156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:33:21.631156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:33:21.631156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2238c1780b6a46eca76b65cd22ea9f12. Aug 28 18:33:21.631156 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:21.636673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0e848-81f8-48e1-93a8-9fd391d2607c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:21.644591 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1872/3768] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:21 2022] PATCH /identity/v3/domains/2238c1780b6a46eca76b65cd22ea9f12 => generated 112 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:33:21.649351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0e848-81f8-48e1-93a8-9fd391d2607c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:21.655340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6eba7-4f2c-45b9-be72-2a0021fd045f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:21.656670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6eba7-4f2c-45b9-be72-2a0021fd045f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:21.656670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6eba7-4f2c-45b9-be72-2a0021fd045f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:21.656670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6eba7-4f2c-45b9-be72-2a0021fd045f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:21.657146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6eba7-4f2c-45b9-be72-2a0021fd045f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:21.660286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6eba7-4f2c-45b9-be72-2a0021fd045f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:21.683478 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1897/3769] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:33:21 2022] POST /identity/v3/domains => generated 276 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:21.685951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337287b-aa6f-4466-a5ce-cfe5ef83225a tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:21.700940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337287b-aa6f-4466-a5ce-cfe5ef83225a tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:21.765650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adc08d-a21d-45c2-b478-088a8706e407 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:21.766642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adc08d-a21d-45c2-b478-088a8706e407 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:21.767085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adc08d-a21d-45c2-b478-088a8706e407 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:21.767467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adc08d-a21d-45c2-b478-088a8706e407 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:21.768111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5adc08d-a21d-45c2-b478-088a8706e407 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:21.770039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5adc08d-a21d-45c2-b478-088a8706e407 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:21.808044 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1873/3770] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:21 2022] POST /identity/v3/users => generated 346 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:21.812465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6eba7-4f2c-45b9-be72-2a0021fd045f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:21.826484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6eba7-4f2c-45b9-be72-2a0021fd045f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:21.838173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47756f7-5874-4fd0-a902-2da676439181 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:21.838943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47756f7-5874-4fd0-a902-2da676439181 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:21.839326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47756f7-5874-4fd0-a902-2da676439181 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:21.839733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47756f7-5874-4fd0-a902-2da676439181 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:21.840387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47756f7-5874-4fd0-a902-2da676439181 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:21.841551 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-b47756f7-5874-4fd0-a902-2da676439181 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:21.841551 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:21.841551 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:21.843016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47756f7-5874-4fd0-a902-2da676439181 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:21.865596 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1898/3771] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Aug 28 18:33:21 2022] POST /identity/v3/groups => generated 323 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:21.867136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adc08d-a21d-45c2-b478-088a8706e407 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:21.878435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adc08d-a21d-45c2-b478-088a8706e407 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:21.883777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cad437-2d21-4dbf-9315-258d56448f48 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:21.884331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cad437-2d21-4dbf-9315-258d56448f48 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:21.884621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cad437-2d21-4dbf-9315-258d56448f48 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:21.884968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cad437-2d21-4dbf-9315-258d56448f48 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/b09956d19eab431191ef206da74304b3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:21.886280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cad437-2d21-4dbf-9315-258d56448f48 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b09956d19eab431191ef206da74304b3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:21.888010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cad437-2d21-4dbf-9315-258d56448f48 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:21.918223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53cad437-2d21-4dbf-9315-258d56448f48 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b09956d19eab431191ef206da74304b3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.925160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53cad437-2d21-4dbf-9315-258d56448f48 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b09956d19eab431191ef206da74304b3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.958106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53cad437-2d21-4dbf-9315-258d56448f48 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b09956d19eab431191ef206da74304b3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.958771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53cad437-2d21-4dbf-9315-258d56448f48 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b09956d19eab431191ef206da74304b3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:21.961639 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1874/3772] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:21 2022] PATCH /identity/v3/domains/b09956d19eab431191ef206da74304b3 => generated 277 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:21.967387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47756f7-5874-4fd0-a902-2da676439181 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:21.976820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b47756f7-5874-4fd0-a902-2da676439181 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:21.998343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47756f7-5874-4fd0-a902-2da676439181 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:22.048345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:22.081073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:22.081867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:22.082227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:22.083119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/b09956d19eab431191ef206da74304b3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:22.097904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b09956d19eab431191ef206da74304b3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:22.101144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:22.135754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b09956d19eab431191ef206da74304b3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:22.289032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '407e82d2b9f84d3d8261fa3eec5034de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:22.289965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '407e82d2b9f84d3d8261fa3eec5034de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:22.300140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '407e82d2b9f84d3d8261fa3eec5034de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:22.314823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '407e82d2b9f84d3d8261fa3eec5034de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:22.336213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '407e82d2b9f84d3d8261fa3eec5034de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:22.348731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b09956d19eab431191ef206da74304b3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:22.379858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:22.407061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b09956d19eab431191ef206da74304b3', 'request_id': 'req-e85a5826-4423-47ff-8303-a1ca3dccd71c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:22.417603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b09956d19eab431191ef206da74304b3', 'request_id': 'req-e85a5826-4423-47ff-8303-a1ca3dccd71c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:22.428062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b09956d19eab431191ef206da74304b3', 'request_id': 'req-e85a5826-4423-47ff-8303-a1ca3dccd71c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:22.445181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] The token cache is being invalidate because project b09956d19eab431191ef206da74304b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:22.445658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:22.446786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:22.456721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b09956d19eab431191ef206da74304b3', 'request_id': 'req-e85a5826-4423-47ff-8303-a1ca3dccd71c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:22.458218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b09956d19eab431191ef206da74304b3', 'request_id': 'req-e85a5826-4423-47ff-8303-a1ca3dccd71c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:22.476197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b09956d19eab431191ef206da74304b3', 'request_id': 'req-e85a5826-4423-47ff-8303-a1ca3dccd71c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:22.498680 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1899/3773] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:33:21 2022] DELETE /identity/v3/domains/b09956d19eab431191ef206da74304b3 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:22.499001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cad437-2d21-4dbf-9315-258d56448f48 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:22.502542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cad437-2d21-4dbf-9315-258d56448f48 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:22.575179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc2018-94fa-41cd-a1ab-eb1983e46898 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:22.575892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2018-94fa-41cd-a1ab-eb1983e46898 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:22.576179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2018-94fa-41cd-a1ab-eb1983e46898 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:22.576461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2018-94fa-41cd-a1ab-eb1983e46898 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/b09956d19eab431191ef206da74304b3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:22.584185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc2018-94fa-41cd-a1ab-eb1983e46898 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=b09956d19eab431191ef206da74304b3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:22.586084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc2018-94fa-41cd-a1ab-eb1983e46898 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:22.598685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-76dc2018-94fa-41cd-a1ab-eb1983e46898 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Could not find domain: b09956d19eab431191ef206da74304b3.: keystone.exception.DomainNotFound: Could not find domain: b09956d19eab431191ef206da74304b3. Aug 28 18:33:22.598685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:22.598685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:33:22.598685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:33:22.598685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:33:22.598685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:33:22.598685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:33:22.598685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:33:22.598685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b09956d19eab431191ef206da74304b3. Aug 28 18:33:22.598685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:22.598685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:33:22.598685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:22.598685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:22.598685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:22.598685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:22.598685 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:22.600383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:22.600383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:22.600383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:22.600383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:22.600383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:22.600383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:22.600383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:22.600383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:33:22.600383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:33:22.600383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:33:22.600383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:33:22.600383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:22.600383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:22.600383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:33:22.600383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:33:22.600383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:33:22.600383 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:33:22.601710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:33:22.601710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:33:22.601710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:33:22.601710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:33:22.601710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:33:22.601710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:33:22.601710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:33:22.601710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:33:22.601710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:33:22.601710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:33:22.601710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:33:22.601710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:33:22.601710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b09956d19eab431191ef206da74304b3. Aug 28 18:33:22.601710 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:22.603043 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1875/3774] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:33:22 2022] GET /identity/v3/domains/b09956d19eab431191ef206da74304b3 => generated 112 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:33:22.604407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:22.606047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:22.619196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a5826-4423-47ff-8303-a1ca3dccd71c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:22.624027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8789c0a-637a-4726-882d-5562da8bb874 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:22.624666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8789c0a-637a-4726-882d-5562da8bb874 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:22.624950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8789c0a-637a-4726-882d-5562da8bb874 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:22.625227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8789c0a-637a-4726-882d-5562da8bb874 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/users/407e82d2b9f84d3d8261fa3eec5034de` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:22.633325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8789c0a-637a-4726-882d-5562da8bb874 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:get_user(user_id=407e82d2b9f84d3d8261fa3eec5034de)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:22.635461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8789c0a-637a-4726-882d-5562da8bb874 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:22.647228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f8789c0a-637a-4726-882d-5562da8bb874 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Could not find user: 407e82d2b9f84d3d8261fa3eec5034de.: keystone.exception.UserNotFound: Could not find user: 407e82d2b9f84d3d8261fa3eec5034de. Aug 28 18:33:22.647228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:22.647228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:22.647228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:22.647228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:22.647228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:22.647228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:22.647228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:22.647228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:22.647228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:22.647228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:22.647228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:22.647228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:33:22.647228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:33:22.647228 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:33:22.648490 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:33:22.648490 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:22.648490 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:22.648490 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:33:22.648490 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:33:22.648490 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:33:22.648490 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:33:22.648490 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:33:22.648490 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:33:22.648490 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:33:22.648490 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:33:22.648490 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:33:22.648490 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:33:22.648490 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:33:22.648490 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:33:22.648490 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:33:22.648490 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:33:22.649592 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:33:22.649592 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:33:22.649592 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:33:22.649592 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:33:22.649592 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:33:22.649592 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:33:22.649592 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:33:22.649592 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:33:22.649592 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:33:22.649592 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:33:22.649592 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 407e82d2b9f84d3d8261fa3eec5034de. Aug 28 18:33:22.649592 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:22.649592 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1900/3775] 10.222.0.27 () {58 vars in 1221 bytes} [Sun Aug 28 18:33:22 2022] GET /identity/v3/users/407e82d2b9f84d3d8261fa3eec5034de => generated 110 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:33:22.652737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc2018-94fa-41cd-a1ab-eb1983e46898 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:22.659082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:22.663458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc2018-94fa-41cd-a1ab-eb1983e46898 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:22.669841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a28f3a-3149-47c2-9bb5-bb54b41cf876 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:22.670600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a28f3a-3149-47c2-9bb5-bb54b41cf876 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:22.671030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a28f3a-3149-47c2-9bb5-bb54b41cf876 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:22.671368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a28f3a-3149-47c2-9bb5-bb54b41cf876 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/groups/2314cc759e8d4117b1c06ad6e46aa497` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:22.677451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a28f3a-3149-47c2-9bb5-bb54b41cf876 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:get_group(group_id=2314cc759e8d4117b1c06ad6e46aa497)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:22.678573 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-e2a28f3a-3149-47c2-9bb5-bb54b41cf876 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:22.678573 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:22.678573 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:22.679927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a28f3a-3149-47c2-9bb5-bb54b41cf876 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:22.694167 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-e2a28f3a-3149-47c2-9bb5-bb54b41cf876 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Could not find group: 2314cc759e8d4117b1c06ad6e46aa497.: keystone.exception.GroupNotFound: Could not find group: 2314cc759e8d4117b1c06ad6e46aa497. Aug 28 18:33:22.694167 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:22.694167 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:22.694167 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:22.694167 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:22.694167 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:22.694167 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:22.694167 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:22.694167 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:22.694167 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:22.694167 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:22.694167 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:22.694167 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Aug 28 18:33:22.694167 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_group(group_id) Aug 28 18:33:22.694167 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Aug 28 18:33:22.698762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Aug 28 18:33:22.698762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:22.698762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:22.698762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:33:22.698762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:33:22.698762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:33:22.698762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:33:22.698762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:33:22.698762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:33:22.698762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:33:22.698762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:33:22.698762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:33:22.698762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:33:22.698762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:33:22.698762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:33:22.698762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:33:22.698762 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:33:22.700219 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:33:22.700219 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:33:22.700219 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:33:22.700219 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:33:22.700219 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 28 18:33:22.700219 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 28 18:33:22.700219 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 28 18:33:22.700219 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 28 18:33:22.700219 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 28 18:33:22.700219 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 28 18:33:22.700219 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 2314cc759e8d4117b1c06ad6e46aa497. Aug 28 18:33:22.700219 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:22.700219 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1876/3776] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:22 2022] GET /identity/v3/groups/2314cc759e8d4117b1c06ad6e46aa497 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 18:33:22.701266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8789c0a-637a-4726-882d-5562da8bb874 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:22.711419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8789c0a-637a-4726-882d-5562da8bb874 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:22.717037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fb814-8974-418d-a4be-8265b641185f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:22.717681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fb814-8974-418d-a4be-8265b641185f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:22.717991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fb814-8974-418d-a4be-8265b641185f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:22.718240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fb814-8974-418d-a4be-8265b641185f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/groups/2314cc759e8d4117b1c06ad6e46aa497` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:22.726853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fb814-8974-418d-a4be-8265b641185f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:33:22.732211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-c54fb814-8974-418d-a4be-8265b641185f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Could not find group: 2314cc759e8d4117b1c06ad6e46aa497.: keystone.exception.GroupNotFound: Could not find group: 2314cc759e8d4117b1c06ad6e46aa497. Aug 28 18:33:22.732211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:22.732211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:22.732211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:22.732211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:22.732211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:22.732211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:22.732211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:22.732211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:22.732211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:22.732211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:22.732211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:22.732211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Aug 28 18:33:22.732211 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Aug 28 18:33:22.733330 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:33:22.733330 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:33:22.733330 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:33:22.733330 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:33:22.733330 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:22.733330 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:22.733330 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:33:22.733330 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:33:22.733330 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:33:22.733330 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:33:22.733330 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:33:22.733330 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:33:22.733330 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:33:22.733330 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:33:22.733330 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:33:22.733330 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:33:22.733330 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:33:22.737904 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:33:22.737904 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:33:22.737904 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:33:22.737904 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:33:22.737904 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:33:22.737904 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:33:22.737904 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:33:22.737904 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 28 18:33:22.737904 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 28 18:33:22.737904 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 28 18:33:22.737904 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 28 18:33:22.737904 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 28 18:33:22.737904 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 28 18:33:22.737904 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 2314cc759e8d4117b1c06ad6e46aa497. Aug 28 18:33:22.737904 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:22.737904 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1901/3777] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:33:22 2022] DELETE /identity/v3/groups/2314cc759e8d4117b1c06ad6e46aa497 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:33:22.739852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a28f3a-3149-47c2-9bb5-bb54b41cf876 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:22.751422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a28f3a-3149-47c2-9bb5-bb54b41cf876 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:22.759581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ece4c-4654-4cad-bdff-896b3e7696cc tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:22.760225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ece4c-4654-4cad-bdff-896b3e7696cc tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:22.760505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ece4c-4654-4cad-bdff-896b3e7696cc tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:22.760790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ece4c-4654-4cad-bdff-896b3e7696cc tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/users/407e82d2b9f84d3d8261fa3eec5034de` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:22.769127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ece4c-4654-4cad-bdff-896b3e7696cc tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:delete_user(user_id=407e82d2b9f84d3d8261fa3eec5034de)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:22.771003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ece4c-4654-4cad-bdff-896b3e7696cc tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:22.785854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-8d0ece4c-4654-4cad-bdff-896b3e7696cc tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Could not find user: 407e82d2b9f84d3d8261fa3eec5034de.: keystone.exception.UserNotFound: Could not find user: 407e82d2b9f84d3d8261fa3eec5034de. Aug 28 18:33:22.785854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:22.785854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:22.785854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:22.785854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:22.785854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:22.785854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:22.785854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:22.785854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:22.785854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:22.785854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:22.785854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:22.785854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Aug 28 18:33:22.785854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:33:22.786924 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 407e82d2b9f84d3d8261fa3eec5034de. Aug 28 18:33:22.788465 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:22.789554 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1877/3778] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:22 2022] DELETE /identity/v3/users/407e82d2b9f84d3d8261fa3eec5034de => generated 110 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:33:22.791322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fb814-8974-418d-a4be-8265b641185f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:22.802599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fb814-8974-418d-a4be-8265b641185f tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:22.807330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1568ce-ae66-4f45-89cf-010dabca6c81 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:22.807983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1568ce-ae66-4f45-89cf-010dabca6c81 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:22.808266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1568ce-ae66-4f45-89cf-010dabca6c81 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:22.808546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1568ce-ae66-4f45-89cf-010dabca6c81 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/b09956d19eab431191ef206da74304b3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:22.816656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1568ce-ae66-4f45-89cf-010dabca6c81 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:33:22.821627 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-7e1568ce-ae66-4f45-89cf-010dabca6c81 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Could not find domain: b09956d19eab431191ef206da74304b3.: keystone.exception.DomainNotFound: Could not find domain: b09956d19eab431191ef206da74304b3. Aug 28 18:33:22.821627 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:22.821627 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:33:22.821627 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:33:22.821627 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:33:22.821627 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:33:22.821627 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:33:22.821627 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:33:22.821627 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b09956d19eab431191ef206da74304b3. Aug 28 18:33:22.821627 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:22.821627 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:33:22.821627 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:22.821627 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:22.821627 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:22.821627 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:22.821627 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:22.822752 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:22.822752 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:22.822752 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:22.822752 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:22.822752 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:22.822752 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:22.822752 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:22.822752 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 18:33:22.822752 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 18:33:22.822752 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:33:22.822752 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:33:22.822752 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:33:22.822752 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:33:22.822752 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:22.822752 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:22.822752 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:33:22.825015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:33:22.825015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:33:22.825015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:33:22.825015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:33:22.825015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:33:22.825015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:33:22.825015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:33:22.825015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:33:22.825015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:33:22.825015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:33:22.825015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:33:22.825015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:33:22.825015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:33:22.825015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:33:22.825015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:33:22.825015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b09956d19eab431191ef206da74304b3. Aug 28 18:33:22.825015 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:22.826080 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1902/3779] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:22 2022] PATCH /identity/v3/domains/b09956d19eab431191ef206da74304b3 => generated 112 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:33:22.828121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ece4c-4654-4cad-bdff-896b3e7696cc tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:22.839403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ece4c-4654-4cad-bdff-896b3e7696cc tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:22.847593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5590a7a-d980-4ca1-adcf-f71802f7a8bf tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:22.848377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5590a7a-d980-4ca1-adcf-f71802f7a8bf tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:22.848512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5590a7a-d980-4ca1-adcf-f71802f7a8bf tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:22.848761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5590a7a-d980-4ca1-adcf-f71802f7a8bf tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:22.849392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5590a7a-d980-4ca1-adcf-f71802f7a8bf tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:22.851315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5590a7a-d980-4ca1-adcf-f71802f7a8bf tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:22.871387 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1878/3780] 10.222.0.27 () {58 vars in 1128 bytes} [Sun Aug 28 18:33:22 2022] GET /identity/v3/domains => generated 1347 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:22.876167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1568ce-ae66-4f45-89cf-010dabca6c81 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:22.886677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1568ce-ae66-4f45-89cf-010dabca6c81 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:22.893194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb67e66-4ac1-4df6-af17-c50d609ef178 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:22.893810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb67e66-4ac1-4df6-af17-c50d609ef178 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:22.894279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb67e66-4ac1-4df6-af17-c50d609ef178 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:22.894416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb67e66-4ac1-4df6-af17-c50d609ef178 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:22.895511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb67e66-4ac1-4df6-af17-c50d609ef178 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:22.895777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb67e66-4ac1-4df6-af17-c50d609ef178 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:22.897403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb67e66-4ac1-4df6-af17-c50d609ef178 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:22.923557 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1903/3781] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:33:22 2022] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:22.929957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5590a7a-d980-4ca1-adcf-f71802f7a8bf tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:22.942645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5590a7a-d980-4ca1-adcf-f71802f7a8bf tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:22.947681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b0b5a-1451-4045-be9c-98c5b35e5853 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:22.948459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b0b5a-1451-4045-be9c-98c5b35e5853 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:22.949174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b0b5a-1451-4045-be9c-98c5b35e5853 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:22.949587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b0b5a-1451-4045-be9c-98c5b35e5853 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:22.950326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b0b5a-1451-4045-be9c-98c5b35e5853 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1736685686) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:22.950640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b0b5a-1451-4045-be9c-98c5b35e5853 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:22.952433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b0b5a-1451-4045-be9c-98c5b35e5853 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:22.971683 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1879/3782] 10.222.0.27 () {58 vars in 1199 bytes} [Sun Aug 28 18:33:22 2022] GET /identity/v3/domains?name=tempest-test_domain-1736685686 => generated 408 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:22.977371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb67e66-4ac1-4df6-af17-c50d609ef178 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:22.985440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b0b5a-1451-4045-be9c-98c5b35e5853 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:22.987569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3c0b0b5a-1451-4045-be9c-98c5b35e5853 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:22.993265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb67e66-4ac1-4df6-af17-c50d609ef178 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:22.998357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75f7be-8d6b-40dc-95fb-4456c676de34 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:22.998999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75f7be-8d6b-40dc-95fb-4456c676de34 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:22.999318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75f7be-8d6b-40dc-95fb-4456c676de34 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:22.999615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75f7be-8d6b-40dc-95fb-4456c676de34 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/b09956d19eab431191ef206da74304b3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:23.006858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75f7be-8d6b-40dc-95fb-4456c676de34 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:33:23.011923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-1f75f7be-8d6b-40dc-95fb-4456c676de34 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Could not find domain: b09956d19eab431191ef206da74304b3.: keystone.exception.DomainNotFound: Could not find domain: b09956d19eab431191ef206da74304b3. Aug 28 18:33:23.011923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:23.011923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:33:23.011923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:33:23.011923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:33:23.011923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:33:23.011923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:33:23.011923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:33:23.011923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b09956d19eab431191ef206da74304b3. Aug 28 18:33:23.011923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:23.011923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:33:23.011923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:23.011923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:23.011923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:23.011923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:23.011923 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:23.013212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:23.013212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:23.013212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:23.013212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:23.013212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:23.013212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:23.013212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:23.013212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 18:33:23.013212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 18:33:23.013212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:33:23.013212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:33:23.013212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:33:23.013212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:33:23.013212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:23.013212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:23.013212 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:33:23.014463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:33:23.014463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:33:23.014463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:33:23.014463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:33:23.014463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:33:23.014463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:33:23.014463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:33:23.014463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:33:23.014463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:33:23.014463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:33:23.014463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:33:23.014463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:33:23.014463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:33:23.014463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:33:23.014463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:33:23.014463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b09956d19eab431191ef206da74304b3. Aug 28 18:33:23.014463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:23.016306 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1904/3783] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:22 2022] PATCH /identity/v3/domains/b09956d19eab431191ef206da74304b3 => generated 112 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:33:23.017033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75f7be-8d6b-40dc-95fb-4456c676de34 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:23.028492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75f7be-8d6b-40dc-95fb-4456c676de34 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:23.033392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2945f-4111-4061-baea-53c984d0c35c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:23.033981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2945f-4111-4061-baea-53c984d0c35c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:23.034263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2945f-4111-4061-baea-53c984d0c35c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:23.034539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2945f-4111-4061-baea-53c984d0c35c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/a1f33821b318434f9f926ef3e60484fd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:23.045585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2945f-4111-4061-baea-53c984d0c35c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a1f33821b318434f9f926ef3e60484fd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:23.047535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2945f-4111-4061-baea-53c984d0c35c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:23.058754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b0b5a-1451-4045-be9c-98c5b35e5853 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:23.064223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b992b0-34d5-476f-a6e3-574388f6bee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:23.065186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b992b0-34d5-476f-a6e3-574388f6bee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:23.065658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b992b0-34d5-476f-a6e3-574388f6bee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:23.066110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b992b0-34d5-476f-a6e3-574388f6bee3 admin admin] PATH_INFO: `/v3/users/71b6984aad2a4d23a688d6a811f119b3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:23.067363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b992b0-34d5-476f-a6e3-574388f6bee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b6984aad2a4d23a688d6a811f119b3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:23.069222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b992b0-34d5-476f-a6e3-574388f6bee3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:23.094108 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1905/3784] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:23 2022] PATCH /identity/v3/domains/a1f33821b318434f9f926ef3e60484fd => generated 277 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:23.098204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2945f-4111-4061-baea-53c984d0c35c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:23.109380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2945f-4111-4061-baea-53c984d0c35c tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:23.114216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:23.114825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:23.115112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:23.115420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/a1f33821b318434f9f926ef3e60484fd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:23.125417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2b992b0-34d5-476f-a6e3-574388f6bee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b6984aad2a4d23a688d6a811f119b3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.128395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a1f33821b318434f9f926ef3e60484fd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:23.130116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:23.139966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2b992b0-34d5-476f-a6e3-574388f6bee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b6984aad2a4d23a688d6a811f119b3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.140707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2b992b0-34d5-476f-a6e3-574388f6bee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b6984aad2a4d23a688d6a811f119b3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.141465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2b992b0-34d5-476f-a6e3-574388f6bee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b6984aad2a4d23a688d6a811f119b3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.150683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2b992b0-34d5-476f-a6e3-574388f6bee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b6984aad2a4d23a688d6a811f119b3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.154487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a1f33821b318434f9f926ef3e60484fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.163472 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1880/3785] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:22 2022] DELETE /identity/v3/users/71b6984aad2a4d23a688d6a811f119b3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:23.164711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a1f33821b318434f9f926ef3e60484fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.168474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162d24c-69f0-4886-aafc-f59f030f1e6d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:23.168764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162d24c-69f0-4886-aafc-f59f030f1e6d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:23.169217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162d24c-69f0-4886-aafc-f59f030f1e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:23.174769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:23.189428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f162d24c-69f0-4886-aafc-f59f030f1e6d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:23.190838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f162d24c-69f0-4886-aafc-f59f030f1e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:23.208988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f33821b318434f9f926ef3e60484fd', 'request_id': 'req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.217230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f33821b318434f9f926ef3e60484fd', 'request_id': 'req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.217430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:23.223398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f33821b318434f9f926ef3e60484fd', 'request_id': 'req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.235854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] The token cache is being invalidate because project a1f33821b318434f9f926ef3e60484fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:23.236149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.236828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.244818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a1f33821b318434f9f926ef3e60484fd', 'request_id': 'req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.245465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a1f33821b318434f9f926ef3e60484fd', 'request_id': 'req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.248823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a1f33821b318434f9f926ef3e60484fd', 'request_id': 'req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.254496 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1906/3786] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:33:23 2022] DELETE /identity/v3/domains/a1f33821b318434f9f926ef3e60484fd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:23.254760 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1881/3787] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:23.258539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:23.260077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:23.264278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162d24c-69f0-4886-aafc-f59f030f1e6d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:23.265906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f162d24c-69f0-4886-aafc-f59f030f1e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:23.322658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162d24c-69f0-4886-aafc-f59f030f1e6d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:23.324393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac6d7f-d612-4bef-9bf9-491e6e8b9382 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:23.329377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62a15a-fb4f-40bd-9792-31a06ccd2882 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:23.330018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62a15a-fb4f-40bd-9792-31a06ccd2882 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:23.330301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62a15a-fb4f-40bd-9792-31a06ccd2882 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:23.330702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62a15a-fb4f-40bd-9792-31a06ccd2882 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/182500ac56e649f5957d37bf81a853cb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:23.342079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62a15a-fb4f-40bd-9792-31a06ccd2882 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=182500ac56e649f5957d37bf81a853cb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:23.343761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62a15a-fb4f-40bd-9792-31a06ccd2882 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:23.366201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e62a15a-fb4f-40bd-9792-31a06ccd2882 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '182500ac56e649f5957d37bf81a853cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.366963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e62a15a-fb4f-40bd-9792-31a06ccd2882 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '182500ac56e649f5957d37bf81a853cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.380045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f9d56-286f-492a-a7e6-946ad4b96602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:23.381127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f9d56-286f-492a-a7e6-946ad4b96602 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:23.381583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f9d56-286f-492a-a7e6-946ad4b96602 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:23.381972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f9d56-286f-492a-a7e6-946ad4b96602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:23.384116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-141f9d56-286f-492a-a7e6-946ad4b96602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:23.397070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e62a15a-fb4f-40bd-9792-31a06ccd2882 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '182500ac56e649f5957d37bf81a853cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.399040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e62a15a-fb4f-40bd-9792-31a06ccd2882 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '182500ac56e649f5957d37bf81a853cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.403421 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1907/3788] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:23 2022] PATCH /identity/v3/domains/182500ac56e649f5957d37bf81a853cb => generated 277 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:23.405474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62a15a-fb4f-40bd-9792-31a06ccd2882 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:23.407436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e62a15a-fb4f-40bd-9792-31a06ccd2882 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:23.452154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f9d56-286f-492a-a7e6-946ad4b96602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:23.453611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f9d56-286f-492a-a7e6-946ad4b96602 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:23.457273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:23.464250 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1882/3789] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:33:23.485598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62a15a-fb4f-40bd-9792-31a06ccd2882 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:23.491440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:23.492171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:23.492453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:23.492729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/182500ac56e649f5957d37bf81a853cb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:23.504637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=182500ac56e649f5957d37bf81a853cb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:23.506298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:23.535392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '182500ac56e649f5957d37bf81a853cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.548196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '182500ac56e649f5957d37bf81a853cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.633921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '182500ac56e649f5957d37bf81a853cb', 'request_id': 'req-8d652939-6d61-4981-b17e-09751dcb0cb9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.644636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '182500ac56e649f5957d37bf81a853cb', 'request_id': 'req-8d652939-6d61-4981-b17e-09751dcb0cb9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.656905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f9d56-286f-492a-a7e6-946ad4b96602 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:23.658465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-141f9d56-286f-492a-a7e6-946ad4b96602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:23.661393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '182500ac56e649f5957d37bf81a853cb', 'request_id': 'req-8d652939-6d61-4981-b17e-09751dcb0cb9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.678359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] The token cache is being invalidate because project 182500ac56e649f5957d37bf81a853cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:23.678714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.679376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.683863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f9d56-286f-492a-a7e6-946ad4b96602 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:23.690244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '182500ac56e649f5957d37bf81a853cb', 'request_id': 'req-8d652939-6d61-4981-b17e-09751dcb0cb9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.691094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '182500ac56e649f5957d37bf81a853cb', 'request_id': 'req-8d652939-6d61-4981-b17e-09751dcb0cb9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.696136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '182500ac56e649f5957d37bf81a853cb', 'request_id': 'req-8d652939-6d61-4981-b17e-09751dcb0cb9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.706452 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1908/3790] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:33:23 2022] DELETE /identity/v3/domains/182500ac56e649f5957d37bf81a853cb => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:23.710812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:23.712343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:23.741357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:23.772863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98297d94-ca66-4d3e-970c-ec669d3ee725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:23.773886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98297d94-ca66-4d3e-970c-ec669d3ee725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:23.774561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98297d94-ca66-4d3e-970c-ec669d3ee725 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:23.774917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98297d94-ca66-4d3e-970c-ec669d3ee725 admin admin] PATH_INFO: `/v3/projects/71dc74119c624dc2ac3fe0f308d2779d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:23.776791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98297d94-ca66-4d3e-970c-ec669d3ee725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71dc74119c624dc2ac3fe0f308d2779d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:23.778887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98297d94-ca66-4d3e-970c-ec669d3ee725 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:23.794894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d652939-6d61-4981-b17e-09751dcb0cb9 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:23.800633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c15080-eeca-4aad-8709-6120f19472fd tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:23.801488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c15080-eeca-4aad-8709-6120f19472fd tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:23.801781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c15080-eeca-4aad-8709-6120f19472fd tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:23.802110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c15080-eeca-4aad-8709-6120f19472fd tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/7aae8ad7c81d4ad8b552efb5f691aced` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:23.815847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c15080-eeca-4aad-8709-6120f19472fd tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7aae8ad7c81d4ad8b552efb5f691aced)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:23.817566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c15080-eeca-4aad-8709-6120f19472fd tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:23.841599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:23.846154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49c15080-eeca-4aad-8709-6120f19472fd tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7aae8ad7c81d4ad8b552efb5f691aced'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.848076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49c15080-eeca-4aad-8709-6120f19472fd tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7aae8ad7c81d4ad8b552efb5f691aced'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.861874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98297d94-ca66-4d3e-970c-ec669d3ee725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71dc74119c624dc2ac3fe0f308d2779d', 'request_id': 'req-98297d94-ca66-4d3e-970c-ec669d3ee725'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.870769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98297d94-ca66-4d3e-970c-ec669d3ee725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71dc74119c624dc2ac3fe0f308d2779d', 'request_id': 'req-98297d94-ca66-4d3e-970c-ec669d3ee725'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.877568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98297d94-ca66-4d3e-970c-ec669d3ee725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71dc74119c624dc2ac3fe0f308d2779d', 'request_id': 'req-98297d94-ca66-4d3e-970c-ec669d3ee725'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.878308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49c15080-eeca-4aad-8709-6120f19472fd tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7aae8ad7c81d4ad8b552efb5f691aced'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.878952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49c15080-eeca-4aad-8709-6120f19472fd tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7aae8ad7c81d4ad8b552efb5f691aced'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.882954 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1909/3791] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:23 2022] PATCH /identity/v3/domains/7aae8ad7c81d4ad8b552efb5f691aced => generated 277 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:23.887230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c15080-eeca-4aad-8709-6120f19472fd tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:23.888785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-49c15080-eeca-4aad-8709-6120f19472fd tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:23.893515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98297d94-ca66-4d3e-970c-ec669d3ee725 admin admin] The token cache is being invalidate because project 71dc74119c624dc2ac3fe0f308d2779d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:23.893817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98297d94-ca66-4d3e-970c-ec669d3ee725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.894489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98297d94-ca66-4d3e-970c-ec669d3ee725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:23.896297 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1883/3792] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:23 2022] DELETE /identity/v3/projects/71dc74119c624dc2ac3fe0f308d2779d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:23.900616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98297d94-ca66-4d3e-970c-ec669d3ee725 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:23.902158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-98297d94-ca66-4d3e-970c-ec669d3ee725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:23.983105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c15080-eeca-4aad-8709-6120f19472fd tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:23.990220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98297d94-ca66-4d3e-970c-ec669d3ee725 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:23.991417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71e135daf8464025af8aa0e4f14a62d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:23.993266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:23.993563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:23.993846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] PATH_INFO: `/v3/domains/7aae8ad7c81d4ad8b552efb5f691aced` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:24.008162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7aae8ad7c81d4ad8b552efb5f691aced)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:24.011516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:24.038927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7aae8ad7c81d4ad8b552efb5f691aced'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.049919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7aae8ad7c81d4ad8b552efb5f691aced'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.094412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db8a49-f13d-4249-92f7-c8bf1d44c483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:24.095010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db8a49-f13d-4249-92f7-c8bf1d44c483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:24.099135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db8a49-f13d-4249-92f7-c8bf1d44c483 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:24.099480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db8a49-f13d-4249-92f7-c8bf1d44c483 admin admin] PATH_INFO: `/v3/users/fadaa2796df44732b02aba7ffe25caf1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:24.102918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db8a49-f13d-4249-92f7-c8bf1d44c483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fadaa2796df44732b02aba7ffe25caf1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:24.105113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db8a49-f13d-4249-92f7-c8bf1d44c483 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:24.115303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aae8ad7c81d4ad8b552efb5f691aced', 'request_id': 'req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.132591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aae8ad7c81d4ad8b552efb5f691aced', 'request_id': 'req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.136274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:24.149653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aae8ad7c81d4ad8b552efb5f691aced', 'request_id': 'req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.172046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] The token cache is being invalidate because project 7aae8ad7c81d4ad8b552efb5f691aced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:24.172339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.173018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.181824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7aae8ad7c81d4ad8b552efb5f691aced', 'request_id': 'req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.182572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7aae8ad7c81d4ad8b552efb5f691aced', 'request_id': 'req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.187358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7aae8ad7c81d4ad8b552efb5f691aced', 'request_id': 'req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.197259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9db8a49-f13d-4249-92f7-c8bf1d44c483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fadaa2796df44732b02aba7ffe25caf1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.198601 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1910/3793] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:33:23 2022] DELETE /identity/v3/domains/7aae8ad7c81d4ad8b552efb5f691aced => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:24.203003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:24.204907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:24.217296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9db8a49-f13d-4249-92f7-c8bf1d44c483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fadaa2796df44732b02aba7ffe25caf1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.218783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9db8a49-f13d-4249-92f7-c8bf1d44c483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fadaa2796df44732b02aba7ffe25caf1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.219840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9db8a49-f13d-4249-92f7-c8bf1d44c483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fadaa2796df44732b02aba7ffe25caf1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.228171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:24.237331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9db8a49-f13d-4249-92f7-c8bf1d44c483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fadaa2796df44732b02aba7ffe25caf1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.260547 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1884/3794] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:23 2022] DELETE /identity/v3/users/fadaa2796df44732b02aba7ffe25caf1 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:24.300972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dafc9b-8288-4053-a273-1c6f0cbc2a63 tempest-DomainsTestJSON-214703600 tempest-DomainsTestJSON-214703600-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:24.366807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b941a-ef05-490b-8862-c2606d3b70b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:24.367491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b941a-ef05-490b-8862-c2606d3b70b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:24.367762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b941a-ef05-490b-8862-c2606d3b70b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:24.367967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b941a-ef05-490b-8862-c2606d3b70b8 admin admin] PATH_INFO: `/v3/users/3dd9d42987fd452db6e60148f38d50ff` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:24.369473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b941a-ef05-490b-8862-c2606d3b70b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd9d42987fd452db6e60148f38d50ff)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:24.372172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b941a-ef05-490b-8862-c2606d3b70b8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:24.446867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b24b941a-ef05-490b-8862-c2606d3b70b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd9d42987fd452db6e60148f38d50ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.447646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b24b941a-ef05-490b-8862-c2606d3b70b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd9d42987fd452db6e60148f38d50ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.458435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b24b941a-ef05-490b-8862-c2606d3b70b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd9d42987fd452db6e60148f38d50ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.463906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db8a49-f13d-4249-92f7-c8bf1d44c483 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:24.465552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b9db8a49-f13d-4249-92f7-c8bf1d44c483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:24.478930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b24b941a-ef05-490b-8862-c2606d3b70b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd9d42987fd452db6e60148f38d50ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.484785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db8a49-f13d-4249-92f7-c8bf1d44c483 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:24.492441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28865cd-e772-4a64-8941-780ef958ea16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:24.493793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28865cd-e772-4a64-8941-780ef958ea16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:24.494716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28865cd-e772-4a64-8941-780ef958ea16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:24.495386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28865cd-e772-4a64-8941-780ef958ea16 admin admin] PATH_INFO: `/v3/projects/57a75e253f8c4063a781f5427f1fbfe6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:24.498343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28865cd-e772-4a64-8941-780ef958ea16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57a75e253f8c4063a781f5427f1fbfe6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:24.500610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b24b941a-ef05-490b-8862-c2606d3b70b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd9d42987fd452db6e60148f38d50ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.501818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28865cd-e772-4a64-8941-780ef958ea16 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:24.509046 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1911/3795] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:24 2022] DELETE /identity/v3/users/3dd9d42987fd452db6e60148f38d50ff => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:24.513734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1faba-b337-40c9-92ff-9c4d182b6bda None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:24.514172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1faba-b337-40c9-92ff-9c4d182b6bda None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:24.514466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1faba-b337-40c9-92ff-9c4d182b6bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:24.537188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-48f1faba-b337-40c9-92ff-9c4d182b6bda None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:24.538835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48f1faba-b337-40c9-92ff-9c4d182b6bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:24.574464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d28865cd-e772-4a64-8941-780ef958ea16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57a75e253f8c4063a781f5427f1fbfe6', 'request_id': 'req-d28865cd-e772-4a64-8941-780ef958ea16'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.576766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:24.584295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d28865cd-e772-4a64-8941-780ef958ea16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57a75e253f8c4063a781f5427f1fbfe6', 'request_id': 'req-d28865cd-e772-4a64-8941-780ef958ea16'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.591562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d28865cd-e772-4a64-8941-780ef958ea16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57a75e253f8c4063a781f5427f1fbfe6', 'request_id': 'req-d28865cd-e772-4a64-8941-780ef958ea16'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.607388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d28865cd-e772-4a64-8941-780ef958ea16 admin admin] The token cache is being invalidate because project 57a75e253f8c4063a781f5427f1fbfe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:24.607725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d28865cd-e772-4a64-8941-780ef958ea16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.608383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d28865cd-e772-4a64-8941-780ef958ea16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:24.610246 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1885/3796] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:24 2022] DELETE /identity/v3/projects/57a75e253f8c4063a781f5427f1fbfe6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:24.619067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7b660-363f-4a25-ade5-73376147543c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:24.619328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7b660-363f-4a25-ade5-73376147543c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:24.619582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7b660-363f-4a25-ade5-73376147543c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:24.642691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-86d7b660-363f-4a25-ade5-73376147543c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:24.644005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-86d7b660-363f-4a25-ade5-73376147543c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:24.713204 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1886/3797] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:24.721835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e065d83-e94d-488a-9903-c9c0c06f76aa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:24.722309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e065d83-e94d-488a-9903-c9c0c06f76aa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:24.722414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e065d83-e94d-488a-9903-c9c0c06f76aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:24.748188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0e065d83-e94d-488a-9903-c9c0c06f76aa None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:24.749470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0e065d83-e94d-488a-9903-c9c0c06f76aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:24.759109 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1912/3798] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:24.761012 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1887/3799] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:24.765181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1faba-b337-40c9-92ff-9c4d182b6bda None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:24.775695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1faba-b337-40c9-92ff-9c4d182b6bda None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:24.780197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e065d83-e94d-488a-9903-c9c0c06f76aa None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:24.781987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0e065d83-e94d-488a-9903-c9c0c06f76aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:24.788954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31074f68-2f95-4190-b0a4-353fe1bc6aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:24.790040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31074f68-2f95-4190-b0a4-353fe1bc6aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:24.790619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31074f68-2f95-4190-b0a4-353fe1bc6aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:24.791107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31074f68-2f95-4190-b0a4-353fe1bc6aa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:24.793269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31074f68-2f95-4190-b0a4-353fe1bc6aa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:24.794625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31074f68-2f95-4190-b0a4-353fe1bc6aa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:24.796932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31074f68-2f95-4190-b0a4-353fe1bc6aa6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:24.797302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:24.812789 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1913/3800] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:24.817985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31074f68-2f95-4190-b0a4-353fe1bc6aa6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:24.830309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31074f68-2f95-4190-b0a4-353fe1bc6aa6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:24.838006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7fc4a-78b1-4724-9dda-40ca6dcf0468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:24.839141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7fc4a-78b1-4724-9dda-40ca6dcf0468 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:24.840356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7fc4a-78b1-4724-9dda-40ca6dcf0468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:24.840833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7fc4a-78b1-4724-9dda-40ca6dcf0468 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:24.841718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7fc4a-78b1-4724-9dda-40ca6dcf0468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:24.844318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7fc4a-78b1-4724-9dda-40ca6dcf0468 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:24.852689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e065d83-e94d-488a-9903-c9c0c06f76aa None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:24.857003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0282c5c-0067-4afa-a630-d8a8fccc3f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:24.857633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0282c5c-0067-4afa-a630-d8a8fccc3f7d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:24.857915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0282c5c-0067-4afa-a630-d8a8fccc3f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:24.858195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0282c5c-0067-4afa-a630-d8a8fccc3f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:24.868790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0282c5c-0067-4afa-a630-d8a8fccc3f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:24.870874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0282c5c-0067-4afa-a630-d8a8fccc3f7d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:24.882530 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1888/3801] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:33:24.892227 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1914/3802] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:24 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:24.896398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0282c5c-0067-4afa-a630-d8a8fccc3f7d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:24.908128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0282c5c-0067-4afa-a630-d8a8fccc3f7d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:24.980395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066b4c5-700f-4b8a-b8e0-8dceed671119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:24.981258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066b4c5-700f-4b8a-b8e0-8dceed671119 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:24.981403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066b4c5-700f-4b8a-b8e0-8dceed671119 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:24.981768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066b4c5-700f-4b8a-b8e0-8dceed671119 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:24.982413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066b4c5-700f-4b8a-b8e0-8dceed671119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:24.984479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066b4c5-700f-4b8a-b8e0-8dceed671119 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:25.014897 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1889/3803] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:24 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:25.018834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7fc4a-78b1-4724-9dda-40ca6dcf0468 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:25.031676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7fc4a-78b1-4724-9dda-40ca6dcf0468 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:25.040591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea288f-0233-4c90-8f0a-528e651102b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:25.041315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea288f-0233-4c90-8f0a-528e651102b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:25.041688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea288f-0233-4c90-8f0a-528e651102b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:25.042062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea288f-0233-4c90-8f0a-528e651102b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:25.042807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea288f-0233-4c90-8f0a-528e651102b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:25.044791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea288f-0233-4c90-8f0a-528e651102b4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:25.058701 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1915/3804] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:25.063157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066b4c5-700f-4b8a-b8e0-8dceed671119 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:25.075734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066b4c5-700f-4b8a-b8e0-8dceed671119 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:25.081985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083b7be-9832-4745-a8d0-d9d9b1cda441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:25.082774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083b7be-9832-4745-a8d0-d9d9b1cda441 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:25.083183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083b7be-9832-4745-a8d0-d9d9b1cda441 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:25.083505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083b7be-9832-4745-a8d0-d9d9b1cda441 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:25.084250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083b7be-9832-4745-a8d0-d9d9b1cda441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:25.085876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083b7be-9832-4745-a8d0-d9d9b1cda441 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:25.102048 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1890/3805] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:25.106584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea288f-0233-4c90-8f0a-528e651102b4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:25.119680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea288f-0233-4c90-8f0a-528e651102b4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:25.127278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a78894-6045-4dcf-a301-507338068ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:25.127905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a78894-6045-4dcf-a301-507338068ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:25.128235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a78894-6045-4dcf-a301-507338068ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:25.128514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a78894-6045-4dcf-a301-507338068ee9 admin admin] PATH_INFO: `/v3/projects/1ea3b79fbe2141039d44a137726158c4/users/50d9f2d8968349b0a61208db64d3be23/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:25.150521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a78894-6045-4dcf-a301-507338068ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea3b79fbe2141039d44a137726158c4, user_id=50d9f2d8968349b0a61208db64d3be23, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:25.169789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a78894-6045-4dcf-a301-507338068ee9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:25.208392 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1916/3806] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:25 2022] PUT /identity/v3/projects/1ea3b79fbe2141039d44a137726158c4/users/50d9f2d8968349b0a61208db64d3be23/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:25.211538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f9664-9cb8-4af5-9064-1bb3fbca16cb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:25.211823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f9664-9cb8-4af5-9064-1bb3fbca16cb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:25.212097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f9664-9cb8-4af5-9064-1bb3fbca16cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:25.255875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-083f9664-9cb8-4af5-9064-1bb3fbca16cb None None] MFA Rules not processed for user `50d9f2d8968349b0a61208db64d3be23`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:25.257096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-083f9664-9cb8-4af5-9064-1bb3fbca16cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:25.354311 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1891/3807] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:25.405046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a78894-6045-4dcf-a301-507338068ee9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:25.414593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79a78894-6045-4dcf-a301-507338068ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:25.509953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a78894-6045-4dcf-a301-507338068ee9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:25.518694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35018b7-7ba1-4591-a6b6-f9d2e754e218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:25.519759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35018b7-7ba1-4591-a6b6-f9d2e754e218 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:25.519943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35018b7-7ba1-4591-a6b6-f9d2e754e218 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:25.521020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35018b7-7ba1-4591-a6b6-f9d2e754e218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:25.530330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35018b7-7ba1-4591-a6b6-f9d2e754e218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:25.532264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35018b7-7ba1-4591-a6b6-f9d2e754e218 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:25.542699 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1917/3808] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:33:25.598186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f9664-9cb8-4af5-9064-1bb3fbca16cb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:25.600564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-083f9664-9cb8-4af5-9064-1bb3fbca16cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:25.634754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:25.685895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f9664-9cb8-4af5-9064-1bb3fbca16cb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:25.690723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:25.691469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:25.691829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:25.692278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668 admin admin] PATH_INFO: `/v3/projects/f1d158a7e1f84c2b8bfd55278dc750ec` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:25.693485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d158a7e1f84c2b8bfd55278dc750ec)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:25.695706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:25.732106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c9713-066a-4a89-90b7-d4ffcd134495 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:25.733234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c9713-066a-4a89-90b7-d4ffcd134495 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:25.733234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c9713-066a-4a89-90b7-d4ffcd134495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:25.762546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-725c9713-066a-4a89-90b7-d4ffcd134495 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:25.763800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-725c9713-066a-4a89-90b7-d4ffcd134495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:25.779542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d158a7e1f84c2b8bfd55278dc750ec', 'request_id': 'req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:25.786722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d158a7e1f84c2b8bfd55278dc750ec', 'request_id': 'req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:25.795273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d158a7e1f84c2b8bfd55278dc750ec', 'request_id': 'req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:25.812307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668 admin admin] The token cache is being invalidate because project f1d158a7e1f84c2b8bfd55278dc750ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:25.812599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:25.813261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:25.814832 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1892/3809] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:25 2022] DELETE /identity/v3/projects/f1d158a7e1f84c2b8bfd55278dc750ec => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:25.819074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:25.820537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:25.828545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:25.840230 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1918/3810] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:33:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:25.897045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c9713-066a-4a89-90b7-d4ffcd134495 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:25.898521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-725c9713-066a-4a89-90b7-d4ffcd134495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:25.909435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc25def-16b8-47e8-ae6d-1ca01ca1b668 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:25.915806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642af33-0ff7-425d-abc7-d45b142af837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:25.916448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642af33-0ff7-425d-abc7-d45b142af837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:25.916728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642af33-0ff7-425d-abc7-d45b142af837 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:25.917056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642af33-0ff7-425d-abc7-d45b142af837 admin admin] PATH_INFO: `/v3/users/71e135daf8464025af8aa0e4f14a62d7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:25.918306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642af33-0ff7-425d-abc7-d45b142af837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e135daf8464025af8aa0e4f14a62d7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:25.921233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642af33-0ff7-425d-abc7-d45b142af837 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:25.979758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c642af33-0ff7-425d-abc7-d45b142af837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e135daf8464025af8aa0e4f14a62d7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:25.986207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:25.986659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c9713-066a-4a89-90b7-d4ffcd134495 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:25.993210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b5f12-4983-440a-ae20-56bed3de2f1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:25.993900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b5f12-4983-440a-ae20-56bed3de2f1c service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:25.994177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b5f12-4983-440a-ae20-56bed3de2f1c service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:25.994689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b5f12-4983-440a-ae20-56bed3de2f1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:25.997564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c642af33-0ff7-425d-abc7-d45b142af837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e135daf8464025af8aa0e4f14a62d7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:25.999702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c642af33-0ff7-425d-abc7-d45b142af837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e135daf8464025af8aa0e4f14a62d7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:26.000192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c642af33-0ff7-425d-abc7-d45b142af837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e135daf8464025af8aa0e4f14a62d7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:26.006396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b5f12-4983-440a-ae20-56bed3de2f1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:26.008364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b5f12-4983-440a-ae20-56bed3de2f1c service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:26.009275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c642af33-0ff7-425d-abc7-d45b142af837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e135daf8464025af8aa0e4f14a62d7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:26.020655 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1919/3811] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:33:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 18:33:26.029085 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1893/3812] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:25 2022] DELETE /identity/v3/users/71e135daf8464025af8aa0e4f14a62d7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:26.155145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff2ae8-e47b-43b0-93ee-a147f7b7c9b4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:26.155508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff2ae8-e47b-43b0-93ee-a147f7b7c9b4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:26.155745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff2ae8-e47b-43b0-93ee-a147f7b7c9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:26.181325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-29ff2ae8-e47b-43b0-93ee-a147f7b7c9b4 None None] MFA Rules not processed for user `50d9f2d8968349b0a61208db64d3be23`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:26.183540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-29ff2ae8-e47b-43b0-93ee-a147f7b7c9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:26.245639 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1920/3813] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:26.332146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642af33-0ff7-425d-abc7-d45b142af837 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:26.333669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c642af33-0ff7-425d-abc7-d45b142af837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:26.414286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642af33-0ff7-425d-abc7-d45b142af837 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:26.423021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a702b9-fa7b-4a5f-aac7-d47c77248520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:26.423886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a702b9-fa7b-4a5f-aac7-d47c77248520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:26.424647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a702b9-fa7b-4a5f-aac7-d47c77248520 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:26.425027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a702b9-fa7b-4a5f-aac7-d47c77248520 admin admin] PATH_INFO: `/v3/projects/fc03c5e540a845b4a7e4e8d8929d61c4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:26.426294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a702b9-fa7b-4a5f-aac7-d47c77248520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc03c5e540a845b4a7e4e8d8929d61c4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:26.428332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a702b9-fa7b-4a5f-aac7-d47c77248520 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:26.478799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-03a702b9-fa7b-4a5f-aac7-d47c77248520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'request_id': 'req-03a702b9-fa7b-4a5f-aac7-d47c77248520'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:26.485388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-03a702b9-fa7b-4a5f-aac7-d47c77248520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'request_id': 'req-03a702b9-fa7b-4a5f-aac7-d47c77248520'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:26.490988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-03a702b9-fa7b-4a5f-aac7-d47c77248520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc03c5e540a845b4a7e4e8d8929d61c4', 'request_id': 'req-03a702b9-fa7b-4a5f-aac7-d47c77248520'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:26.505471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-03a702b9-fa7b-4a5f-aac7-d47c77248520 admin admin] The token cache is being invalidate because project fc03c5e540a845b4a7e4e8d8929d61c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:26.505824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-03a702b9-fa7b-4a5f-aac7-d47c77248520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:26.506421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-03a702b9-fa7b-4a5f-aac7-d47c77248520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:26.508266 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1894/3814] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:26 2022] DELETE /identity/v3/projects/fc03c5e540a845b4a7e4e8d8929d61c4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:26.513149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1283620-e1b4-4a11-87db-be650b6421d0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:26.513660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1283620-e1b4-4a11-87db-be650b6421d0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:26.513895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1283620-e1b4-4a11-87db-be650b6421d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:26.534906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e1283620-e1b4-4a11-87db-be650b6421d0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:26.536193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1283620-e1b4-4a11-87db-be650b6421d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:26.619576 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1921/3815] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:26.628414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bae86-3d90-4b76-bfaa-7cf3f81268c7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:26.628669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b1b7a-a0be-4398-ab2a-9e559b2d8532 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:26.628775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bae86-3d90-4b76-bfaa-7cf3f81268c7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:26.628868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b1b7a-a0be-4398-ab2a-9e559b2d8532 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:26.628987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bae86-3d90-4b76-bfaa-7cf3f81268c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:26.629102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b1b7a-a0be-4398-ab2a-9e559b2d8532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:26.662893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7e9bae86-3d90-4b76-bfaa-7cf3f81268c7 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:26.664153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7e9bae86-3d90-4b76-bfaa-7cf3f81268c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:26.678422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e95b1b7a-a0be-4398-ab2a-9e559b2d8532 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:26.679722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e95b1b7a-a0be-4398-ab2a-9e559b2d8532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:26.688932 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1922/3816] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:26.693816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b1b7a-a0be-4398-ab2a-9e559b2d8532 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:26.708643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b1b7a-a0be-4398-ab2a-9e559b2d8532 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:26.717058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeafdc-d2cc-4b63-b1c2-b6a2b0edf065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:26.717853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeafdc-d2cc-4b63-b1c2-b6a2b0edf065 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:26.718198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeafdc-d2cc-4b63-b1c2-b6a2b0edf065 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:26.719178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeafdc-d2cc-4b63-b1c2-b6a2b0edf065 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:26.721737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeafdc-d2cc-4b63-b1c2-b6a2b0edf065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:26.722122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeafdc-d2cc-4b63-b1c2-b6a2b0edf065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:26.725791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeafdc-d2cc-4b63-b1c2-b6a2b0edf065 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:26.733036 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1895/3817] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:33:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:26.747028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bae86-3d90-4b76-bfaa-7cf3f81268c7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:26.748478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7e9bae86-3d90-4b76-bfaa-7cf3f81268c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:26.758038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:26.758631 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1923/3818] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:26.764025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeafdc-d2cc-4b63-b1c2-b6a2b0edf065 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:26.776927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeafdc-d2cc-4b63-b1c2-b6a2b0edf065 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:26.784986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cb9c7-09cf-45d6-a5ff-1bcab861cc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:26.785820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cb9c7-09cf-45d6-a5ff-1bcab861cc0f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:26.786209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cb9c7-09cf-45d6-a5ff-1bcab861cc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:26.786879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cb9c7-09cf-45d6-a5ff-1bcab861cc0f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:26.787658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cb9c7-09cf-45d6-a5ff-1bcab861cc0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:26.789839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cb9c7-09cf-45d6-a5ff-1bcab861cc0f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:26.806156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:26.827641 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1924/3819] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:26 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:26.831588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cb9c7-09cf-45d6-a5ff-1bcab861cc0f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:26.847492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bae86-3d90-4b76-bfaa-7cf3f81268c7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:26.910005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cb9c7-09cf-45d6-a5ff-1bcab861cc0f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:26.917706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370f3d9-d04d-4938-85c2-0f2312f6c753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:26.918769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f3d9-d04d-4938-85c2-0f2312f6c753 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:26.919074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f3d9-d04d-4938-85c2-0f2312f6c753 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:26.919366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f3d9-d04d-4938-85c2-0f2312f6c753 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:26.919988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370f3d9-d04d-4938-85c2-0f2312f6c753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:26.921902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370f3d9-d04d-4938-85c2-0f2312f6c753 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:26.933393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ad5c8-7611-4556-98ed-5fd2b96e04c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:26.934241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ad5c8-7611-4556-98ed-5fd2b96e04c0 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:26.934518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ad5c8-7611-4556-98ed-5fd2b96e04c0 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:26.934802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ad5c8-7611-4556-98ed-5fd2b96e04c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:26.947333 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1925/3820] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:26 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:26.948431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370f3d9-d04d-4938-85c2-0f2312f6c753 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:26.958719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370f3d9-d04d-4938-85c2-0f2312f6c753 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:26.963969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287103c6-85aa-4bdb-b1ad-45e677d0b421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:26.964571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287103c6-85aa-4bdb-b1ad-45e677d0b421 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:26.964900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287103c6-85aa-4bdb-b1ad-45e677d0b421 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:26.965171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287103c6-85aa-4bdb-b1ad-45e677d0b421 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:26.965806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287103c6-85aa-4bdb-b1ad-45e677d0b421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:26.967509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287103c6-85aa-4bdb-b1ad-45e677d0b421 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:26.978388 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1926/3821] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:26.982272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287103c6-85aa-4bdb-b1ad-45e677d0b421 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:26.991771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287103c6-85aa-4bdb-b1ad-45e677d0b421 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:26.993264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ad5c8-7611-4556-98ed-5fd2b96e04c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:26.994876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ad5c8-7611-4556-98ed-5fd2b96e04c0 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:26.996383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb88ae-8fed-4ab9-8505-c253a4269b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:26.996958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb88ae-8fed-4ab9-8505-c253a4269b61 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:26.997235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb88ae-8fed-4ab9-8505-c253a4269b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:26.997556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb88ae-8fed-4ab9-8505-c253a4269b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:26.998136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb88ae-8fed-4ab9-8505-c253a4269b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:26.999960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb88ae-8fed-4ab9-8505-c253a4269b61 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:27.002940 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1896/3822] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:33:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 18:33:27.010570 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1927/3823] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:33:27.015211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ad5c8-7611-4556-98ed-5fd2b96e04c0 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:27.026732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ad5c8-7611-4556-98ed-5fd2b96e04c0 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:27.031790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c44e05-d28e-4472-9fc1-94796c89671c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:27.032586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c44e05-d28e-4472-9fc1-94796c89671c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:27.032867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c44e05-d28e-4472-9fc1-94796c89671c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:27.033141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c44e05-d28e-4472-9fc1-94796c89671c admin admin] PATH_INFO: `/v3/projects/1198d389f06f43899561a88c9ae98fdf/users/42b8475cbdaf44eda49de5565bc74323/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:27.049054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c44e05-d28e-4472-9fc1-94796c89671c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1198d389f06f43899561a88c9ae98fdf, user_id=42b8475cbdaf44eda49de5565bc74323, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:27.051798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c44e05-d28e-4472-9fc1-94796c89671c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:27.068528 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1897/3824] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:27 2022] PUT /identity/v3/projects/1198d389f06f43899561a88c9ae98fdf/users/42b8475cbdaf44eda49de5565bc74323/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:27.077648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153236f-7f59-4d4f-9019-6e85ceac884f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:27.078065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153236f-7f59-4d4f-9019-6e85ceac884f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:27.078465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153236f-7f59-4d4f-9019-6e85ceac884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:27.108537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c44e05-d28e-4472-9fc1-94796c89671c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:27.109210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7153236f-7f59-4d4f-9019-6e85ceac884f None None] MFA Rules not processed for user `42b8475cbdaf44eda49de5565bc74323`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:27.110910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b7c44e05-d28e-4472-9fc1-94796c89671c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:27.111118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7153236f-7f59-4d4f-9019-6e85ceac884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:27.143040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:27.180296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c44e05-d28e-4472-9fc1-94796c89671c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:27.185067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0107caa-5fdb-4ebc-bb48-fffb0bd4715c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:27.185701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0107caa-5fdb-4ebc-bb48-fffb0bd4715c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:27.185976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0107caa-5fdb-4ebc-bb48-fffb0bd4715c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:27.186238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0107caa-5fdb-4ebc-bb48-fffb0bd4715c admin admin] PATH_INFO: `/v3/users/50d9f2d8968349b0a61208db64d3be23` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:27.187673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0107caa-5fdb-4ebc-bb48-fffb0bd4715c admin admin] RBAC: Authorizing `identity:delete_user(user_id=50d9f2d8968349b0a61208db64d3be23)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:27.189682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0107caa-5fdb-4ebc-bb48-fffb0bd4715c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:27.190595 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1928/3825] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:27.195031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153236f-7f59-4d4f-9019-6e85ceac884f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:27.207286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153236f-7f59-4d4f-9019-6e85ceac884f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:27.212376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ad242-b0c9-476c-9085-7a3e1b74c083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:27.213008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ad242-b0c9-476c-9085-7a3e1b74c083 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:27.213278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ad242-b0c9-476c-9085-7a3e1b74c083 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:27.213604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ad242-b0c9-476c-9085-7a3e1b74c083 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:27.214728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ad242-b0c9-476c-9085-7a3e1b74c083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:27.217462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ad242-b0c9-476c-9085-7a3e1b74c083 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:27.239767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0107caa-5fdb-4ebc-bb48-fffb0bd4715c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50d9f2d8968349b0a61208db64d3be23'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:27.247750 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1929/3826] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:27 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:27.253453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ad242-b0c9-476c-9085-7a3e1b74c083 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:27.257196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0107caa-5fdb-4ebc-bb48-fffb0bd4715c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50d9f2d8968349b0a61208db64d3be23'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:27.257884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0107caa-5fdb-4ebc-bb48-fffb0bd4715c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50d9f2d8968349b0a61208db64d3be23'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:27.258493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0107caa-5fdb-4ebc-bb48-fffb0bd4715c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50d9f2d8968349b0a61208db64d3be23'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:27.266966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0107caa-5fdb-4ebc-bb48-fffb0bd4715c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50d9f2d8968349b0a61208db64d3be23'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:27.280882 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1898/3827] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:27 2022] DELETE /identity/v3/users/50d9f2d8968349b0a61208db64d3be23 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:27.286174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897d6c8-9529-479d-b941-4366e10aa6be None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:27.286505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897d6c8-9529-479d-b941-4366e10aa6be None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:27.286783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897d6c8-9529-479d-b941-4366e10aa6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:27.290474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:27.306778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c897d6c8-9529-479d-b941-4366e10aa6be None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:27.308035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c897d6c8-9529-479d-b941-4366e10aa6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:27.325371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ad242-b0c9-476c-9085-7a3e1b74c083 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:27.367237 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1899/3828] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:27.377282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897d6c8-9529-479d-b941-4366e10aa6be None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:27.378822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c897d6c8-9529-479d-b941-4366e10aa6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:27.380968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0ac00-aa16-4997-90ce-47aa884a3309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:27.381585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0ac00-aa16-4997-90ce-47aa884a3309 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:27.381862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0ac00-aa16-4997-90ce-47aa884a3309 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:27.382129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0ac00-aa16-4997-90ce-47aa884a3309 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:27.382748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0ac00-aa16-4997-90ce-47aa884a3309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:27.384679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0ac00-aa16-4997-90ce-47aa884a3309 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:27.408808 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1930/3829] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:27 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:27.413167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0ac00-aa16-4997-90ce-47aa884a3309 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:27.414808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b6d0ac00-aa16-4997-90ce-47aa884a3309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:27.426509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0ac00-aa16-4997-90ce-47aa884a3309 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:27.431484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec6655-7770-487a-b3cd-cca6a534de4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:27.432015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec6655-7770-487a-b3cd-cca6a534de4c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:27.432304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec6655-7770-487a-b3cd-cca6a534de4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:27.432533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:27.432643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec6655-7770-487a-b3cd-cca6a534de4c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:27.433550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec6655-7770-487a-b3cd-cca6a534de4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:27.435664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec6655-7770-487a-b3cd-cca6a534de4c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:27.438952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897d6c8-9529-479d-b941-4366e10aa6be None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:27.445621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bcf68-92ae-4182-9cf6-a73a0067b892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:27.446487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bcf68-92ae-4182-9cf6-a73a0067b892 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:27.446719 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1931/3830] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:33:27.450198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bcf68-92ae-4182-9cf6-a73a0067b892 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:27.450198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bcf68-92ae-4182-9cf6-a73a0067b892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:27.450867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec6655-7770-487a-b3cd-cca6a534de4c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:27.460120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bcf68-92ae-4182-9cf6-a73a0067b892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:27.460369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec6655-7770-487a-b3cd-cca6a534de4c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:27.461670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bcf68-92ae-4182-9cf6-a73a0067b892 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:27.465055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ac8c6-b07c-497f-8b3d-57ac030f1598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:27.472794 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1900/3831] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:33:27.474046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ac8c6-b07c-497f-8b3d-57ac030f1598 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:27.474328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ac8c6-b07c-497f-8b3d-57ac030f1598 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:27.474603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ac8c6-b07c-497f-8b3d-57ac030f1598 admin admin] PATH_INFO: `/v3/projects/3e7557c0740b467eb4f64aca57912f68/users/36ec7da09bee4da89720cd702bc83693/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:27.491105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ac8c6-b07c-497f-8b3d-57ac030f1598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7557c0740b467eb4f64aca57912f68, user_id=36ec7da09bee4da89720cd702bc83693, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:27.493946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ac8c6-b07c-497f-8b3d-57ac030f1598 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:27.508889 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1932/3832] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:27 2022] PUT /identity/v3/projects/3e7557c0740b467eb4f64aca57912f68/users/36ec7da09bee4da89720cd702bc83693/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:27.512991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bcf68-92ae-4182-9cf6-a73a0067b892 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:27.522890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bcf68-92ae-4182-9cf6-a73a0067b892 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:27.610173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1708d8a-d6df-477e-8f1e-5415addb4fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:27.611771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1708d8a-d6df-477e-8f1e-5415addb4fca admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:27.612278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1708d8a-d6df-477e-8f1e-5415addb4fca admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:27.612766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1708d8a-d6df-477e-8f1e-5415addb4fca admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:27.613647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1708d8a-d6df-477e-8f1e-5415addb4fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:27.616433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1708d8a-d6df-477e-8f1e-5415addb4fca admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:27.633323 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1901/3833] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:27.635120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ac8c6-b07c-497f-8b3d-57ac030f1598 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:27.659689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ac8c6-b07c-497f-8b3d-57ac030f1598 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:27.670155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0628eb0-5400-4f5d-ad27-5d37539653d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:27.671726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0628eb0-5400-4f5d-ad27-5d37539653d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:27.672014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0628eb0-5400-4f5d-ad27-5d37539653d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:27.672307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0628eb0-5400-4f5d-ad27-5d37539653d3 admin admin] PATH_INFO: `/v3/projects/3e7557c0740b467eb4f64aca57912f68/users/36ec7da09bee4da89720cd702bc83693/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:27.674829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0628eb0-5400-4f5d-ad27-5d37539653d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7557c0740b467eb4f64aca57912f68, user_id=36ec7da09bee4da89720cd702bc83693, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:27.677869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0628eb0-5400-4f5d-ad27-5d37539653d3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:27.690631 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1933/3834] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:27 2022] PUT /identity/v3/projects/3e7557c0740b467eb4f64aca57912f68/users/36ec7da09bee4da89720cd702bc83693/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:27.701548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11bc0f-b3a5-4536-aa0f-c01db98df0a9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:27.702117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11bc0f-b3a5-4536-aa0f-c01db98df0a9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:27.702712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11bc0f-b3a5-4536-aa0f-c01db98df0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:27.739470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1b11bc0f-b3a5-4536-aa0f-c01db98df0a9 None None] MFA Rules not processed for user `36ec7da09bee4da89720cd702bc83693`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:27.740990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1b11bc0f-b3a5-4536-aa0f-c01db98df0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:27.825147 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1902/3835] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:27.829826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0628eb0-5400-4f5d-ad27-5d37539653d3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:27.847290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0628eb0-5400-4f5d-ad27-5d37539653d3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:27.855995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4782d-6af9-49b1-9dd5-569015fd1def tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:27.856657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4782d-6af9-49b1-9dd5-569015fd1def tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:27.857325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4782d-6af9-49b1-9dd5-569015fd1def tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:27.857616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4782d-6af9-49b1-9dd5-569015fd1def tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:27.858598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4782d-6af9-49b1-9dd5-569015fd1def tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:27.861091 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-54d4782d-6af9-49b1-9dd5-569015fd1def tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:27.861091 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:27.861091 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:27.861091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4782d-6af9-49b1-9dd5-569015fd1def tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:27.886917 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1934/3836] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:27 2022] POST /identity/v3/services => generated 290 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:27.888103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11bc0f-b3a5-4536-aa0f-c01db98df0a9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:27.912034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11bc0f-b3a5-4536-aa0f-c01db98df0a9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:27.928522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4782d-6af9-49b1-9dd5-569015fd1def tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:27.930273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54d4782d-6af9-49b1-9dd5-569015fd1def tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:27.962559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c6925-3337-4efb-a29c-3a6970b0e37e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:27.963989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c6925-3337-4efb-a29c-3a6970b0e37e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:27.965713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c6925-3337-4efb-a29c-3a6970b0e37e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:27.966039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c6925-3337-4efb-a29c-3a6970b0e37e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:27.967115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c6925-3337-4efb-a29c-3a6970b0e37e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:27.972078 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-925c6925-3337-4efb-a29c-3a6970b0e37e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:27.972078 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:27.972078 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:27.973135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c6925-3337-4efb-a29c-3a6970b0e37e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.034813 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-925c6925-3337-4efb-a29c-3a6970b0e37e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1936476258. To ensure interoperability, identifiers should be a valid uuid. Aug 28 18:33:28.034813 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 18:33:28.034813 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:28.087849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:28.111046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4782d-6af9-49b1-9dd5-569015fd1def tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.142689 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1903/3837] 10.222.0.27 () {60 vars in 1156 bytes} [Sun Aug 28 18:33:27 2022] POST /identity/v3/endpoints => generated 360 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:28.146887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c6925-3337-4efb-a29c-3a6970b0e37e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.152800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b55a9b-b65c-4f8d-8d15-3fed9e27ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.154295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b55a9b-b65c-4f8d-8d15-3fed9e27ebdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.154743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b55a9b-b65c-4f8d-8d15-3fed9e27ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.155938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b55a9b-b65c-4f8d-8d15-3fed9e27ebdf admin admin] PATH_INFO: `/v3/projects/1ea3b79fbe2141039d44a137726158c4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.157586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b55a9b-b65c-4f8d-8d15-3fed9e27ebdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea3b79fbe2141039d44a137726158c4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.160841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b55a9b-b65c-4f8d-8d15-3fed9e27ebdf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.172613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c6925-3337-4efb-a29c-3a6970b0e37e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.178514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f5d73-2ff6-4aa3-888b-f36a50784e26 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.179177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f5d73-2ff6-4aa3-888b-f36a50784e26 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.179613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f5d73-2ff6-4aa3-888b-f36a50784e26 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.179899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f5d73-2ff6-4aa3-888b-f36a50784e26 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/regions/tempest-region-1936476258` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.180577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f5d73-2ff6-4aa3-888b-f36a50784e26 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1936476258)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.182260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f5d73-2ff6-4aa3-888b-f36a50784e26 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.187353 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1904/3838] 10.222.0.27 () {58 vars in 1206 bytes} [Sun Aug 28 18:33:28 2022] GET /identity/v3/regions/tempest-region-1936476258 => generated 180 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:28.188339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f5d73-2ff6-4aa3-888b-f36a50784e26 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.205531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f5d73-2ff6-4aa3-888b-f36a50784e26 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.216554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f188e-aef5-4955-ab0b-dba8a6536158 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.217412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f188e-aef5-4955-ab0b-dba8a6536158 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.217854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f188e-aef5-4955-ab0b-dba8a6536158 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.218299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f188e-aef5-4955-ab0b-dba8a6536158 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.219134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f188e-aef5-4955-ab0b-dba8a6536158 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.220342 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-719f188e-aef5-4955-ab0b-dba8a6536158 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:28.220342 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:28.220342 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:28.221538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f188e-aef5-4955-ab0b-dba8a6536158 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.227138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:28.236666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47b55a9b-b65c-4f8d-8d15-3fed9e27ebdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea3b79fbe2141039d44a137726158c4', 'request_id': 'req-47b55a9b-b65c-4f8d-8d15-3fed9e27ebdf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:28.243128 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1905/3839] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:28 2022] POST /identity/v3/services => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:28.246683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47b55a9b-b65c-4f8d-8d15-3fed9e27ebdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea3b79fbe2141039d44a137726158c4', 'request_id': 'req-47b55a9b-b65c-4f8d-8d15-3fed9e27ebdf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:28.247509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f188e-aef5-4955-ab0b-dba8a6536158 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.253597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47b55a9b-b65c-4f8d-8d15-3fed9e27ebdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea3b79fbe2141039d44a137726158c4', 'request_id': 'req-47b55a9b-b65c-4f8d-8d15-3fed9e27ebdf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:28.278710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47b55a9b-b65c-4f8d-8d15-3fed9e27ebdf admin admin] The token cache is being invalidate because project 1ea3b79fbe2141039d44a137726158c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:28.278710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47b55a9b-b65c-4f8d-8d15-3fed9e27ebdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:28.278710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47b55a9b-b65c-4f8d-8d15-3fed9e27ebdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:28.278710 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1935/3840] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:27 2022] DELETE /identity/v3/projects/1ea3b79fbe2141039d44a137726158c4 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:28.279178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f188e-aef5-4955-ab0b-dba8a6536158 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.279385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63935ad3-c581-481f-a78b-5498767369f5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.279385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63935ad3-c581-481f-a78b-5498767369f5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.279385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63935ad3-c581-481f-a78b-5498767369f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.297573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-63935ad3-c581-481f-a78b-5498767369f5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:28.298859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-63935ad3-c581-481f-a78b-5498767369f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:28.335700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0643784-2f45-42b1-8505-d4c698a797cd tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.336310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0643784-2f45-42b1-8505-d4c698a797cd tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.336586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0643784-2f45-42b1-8505-d4c698a797cd tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.336857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0643784-2f45-42b1-8505-d4c698a797cd tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.337521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0643784-2f45-42b1-8505-d4c698a797cd tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.339129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0643784-2f45-42b1-8505-d4c698a797cd tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.356516 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-b0643784-2f45-42b1-8505-d4c698a797cd tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1958492515. To ensure interoperability, identifiers should be a valid uuid. Aug 28 18:33:28.356516 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 18:33:28.356516 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:28.369624 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1936/3841] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:28 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:28.377489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0097f-2d39-42eb-9a92-bd556b22fd63 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.377761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0097f-2d39-42eb-9a92-bd556b22fd63 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.378034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0097f-2d39-42eb-9a92-bd556b22fd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.384169 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1906/3842] 10.222.0.27 () {60 vars in 1156 bytes} [Sun Aug 28 18:33:28 2022] POST /identity/v3/endpoints => generated 362 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:28.388044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0643784-2f45-42b1-8505-d4c698a797cd tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.389928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b0643784-2f45-42b1-8505-d4c698a797cd tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:28.400851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c2c0097f-2d39-42eb-9a92-bd556b22fd63 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:28.402028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c2c0097f-2d39-42eb-9a92-bd556b22fd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:28.414294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0643784-2f45-42b1-8505-d4c698a797cd tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.419197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05083de1-59e1-495c-8bfd-6787bc367ebf tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.419854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05083de1-59e1-495c-8bfd-6787bc367ebf tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.420136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05083de1-59e1-495c-8bfd-6787bc367ebf tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.420444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05083de1-59e1-495c-8bfd-6787bc367ebf tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/regions/tempest-region-1958492515` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.421032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05083de1-59e1-495c-8bfd-6787bc367ebf tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1958492515)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.421552 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1937/3843] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:28 2022] POST /identity/v3/auth/tokens => generated 3872 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:28.422108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05083de1-59e1-495c-8bfd-6787bc367ebf tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.425812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0097f-2d39-42eb-9a92-bd556b22fd63 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.429665 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1907/3844] 10.222.0.27 () {58 vars in 1206 bytes} [Sun Aug 28 18:33:28 2022] GET /identity/v3/regions/tempest-region-1958492515 => generated 180 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:28.430675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05083de1-59e1-495c-8bfd-6787bc367ebf tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.435013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0097f-2d39-42eb-9a92-bd556b22fd63 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.440031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00848c-1764-41c0-aa2c-70b53ad2d401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.440632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00848c-1764-41c0-aa2c-70b53ad2d401 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.440749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05083de1-59e1-495c-8bfd-6787bc367ebf tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.440910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00848c-1764-41c0-aa2c-70b53ad2d401 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.441182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00848c-1764-41c0-aa2c-70b53ad2d401 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.441832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00848c-1764-41c0-aa2c-70b53ad2d401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:28.442139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00848c-1764-41c0-aa2c-70b53ad2d401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.443829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00848c-1764-41c0-aa2c-70b53ad2d401 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.445949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0733b-1636-4249-a264-c053707bd951 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.446539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0733b-1636-4249-a264-c053707bd951 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.446821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0733b-1636-4249-a264-c053707bd951 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.447099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0733b-1636-4249-a264-c053707bd951 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.447793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0733b-1636-4249-a264-c053707bd951 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.449364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0733b-1636-4249-a264-c053707bd951 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.456286 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1938/3845] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:28.460682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00848c-1764-41c0-aa2c-70b53ad2d401 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.467583 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-74b0733b-1636-4249-a264-c053707bd951 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1612767122. To ensure interoperability, identifiers should be a valid uuid. Aug 28 18:33:28.467583 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 18:33:28.467583 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:28.471569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00848c-1764-41c0-aa2c-70b53ad2d401 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.487782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f04b93-ff30-467f-aa15-af143616cefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.488380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f04b93-ff30-467f-aa15-af143616cefe admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.488710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f04b93-ff30-467f-aa15-af143616cefe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.488960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f04b93-ff30-467f-aa15-af143616cefe admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.489577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f04b93-ff30-467f-aa15-af143616cefe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.491587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f04b93-ff30-467f-aa15-af143616cefe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.495226 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1908/3846] 10.222.0.27 () {60 vars in 1156 bytes} [Sun Aug 28 18:33:28 2022] POST /identity/v3/endpoints => generated 360 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:28.496400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0733b-1636-4249-a264-c053707bd951 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.519276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0733b-1636-4249-a264-c053707bd951 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.523842 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1939/3847] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:28 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:28.525385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f04b93-ff30-467f-aa15-af143616cefe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.533825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:28.571337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:28.578939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75870323-e234-4667-a1a8-896ddb653d2f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.579792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75870323-e234-4667-a1a8-896ddb653d2f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.580275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75870323-e234-4667-a1a8-896ddb653d2f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.580730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75870323-e234-4667-a1a8-896ddb653d2f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/regions/tempest-region-1612767122` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.581536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75870323-e234-4667-a1a8-896ddb653d2f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1612767122)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.582609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75870323-e234-4667-a1a8-896ddb653d2f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.584617 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1909/3848] 10.222.0.27 () {58 vars in 1206 bytes} [Sun Aug 28 18:33:28 2022] GET /identity/v3/regions/tempest-region-1612767122 => generated 180 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:28.588577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75870323-e234-4667-a1a8-896ddb653d2f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.598665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75870323-e234-4667-a1a8-896ddb653d2f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.601829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f04b93-ff30-467f-aa15-af143616cefe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.604603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f1bf5-3397-4bb8-b614-dbc709067f64 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.605172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f1bf5-3397-4bb8-b614-dbc709067f64 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.605503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f1bf5-3397-4bb8-b614-dbc709067f64 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.605779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f1bf5-3397-4bb8-b614-dbc709067f64 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.606395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f1bf5-3397-4bb8-b614-dbc709067f64 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.607424 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-437f1bf5-3397-4bb8-b614-dbc709067f64 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:28.607424 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:28.607424 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:28.608313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f1bf5-3397-4bb8-b614-dbc709067f64 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.617645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdb913-dda4-4ddd-8728-157ec87189c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.617996 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1910/3849] 10.222.0.27 () {58 vars in 1134 bytes} [Sun Aug 28 18:33:28 2022] GET /identity/v3/endpoints => generated 4396 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:33:28.621281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdb913-dda4-4ddd-8728-157ec87189c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.621281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdb913-dda4-4ddd-8728-157ec87189c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.621281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdb913-dda4-4ddd-8728-157ec87189c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.621281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdb913-dda4-4ddd-8728-157ec87189c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.621632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdb913-dda4-4ddd-8728-157ec87189c9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.622195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f1bf5-3397-4bb8-b614-dbc709067f64 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.632784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f1bf5-3397-4bb8-b614-dbc709067f64 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.638518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639660f2-e5e9-4b2e-a36f-6d9c60ac6d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.639444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639660f2-e5e9-4b2e-a36f-6d9c60ac6d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.639735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639660f2-e5e9-4b2e-a36f-6d9c60ac6d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.640015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639660f2-e5e9-4b2e-a36f-6d9c60ac6d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints/82b246d6124341f2a0eb99558f28f792` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.643651 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1940/3850] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:28 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:28.647733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdb913-dda4-4ddd-8728-157ec87189c9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.650573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639660f2-e5e9-4b2e-a36f-6d9c60ac6d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=82b246d6124341f2a0eb99558f28f792)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.651660 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-639660f2-e5e9-4b2e-a36f-6d9c60ac6d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:28.651660 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:28.651660 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:28.652596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639660f2-e5e9-4b2e-a36f-6d9c60ac6d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.654373 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1911/3851] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:28 2022] GET /identity/v3/endpoints/82b246d6124341f2a0eb99558f28f792 => generated 360 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:28.658097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639660f2-e5e9-4b2e-a36f-6d9c60ac6d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.658219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdb913-dda4-4ddd-8728-157ec87189c9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.662892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfa341-2cb5-4a74-8845-f35576b78293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.663521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfa341-2cb5-4a74-8845-f35576b78293 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.663790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfa341-2cb5-4a74-8845-f35576b78293 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.664058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfa341-2cb5-4a74-8845-f35576b78293 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.664806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cfa341-2cb5-4a74-8845-f35576b78293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.666379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cfa341-2cb5-4a74-8845-f35576b78293 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.667900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639660f2-e5e9-4b2e-a36f-6d9c60ac6d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.672719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22da98-95fd-4e39-a751-f61979e4f889 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.673329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22da98-95fd-4e39-a751-f61979e4f889 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.673607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22da98-95fd-4e39-a751-f61979e4f889 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.674060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22da98-95fd-4e39-a751-f61979e4f889 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints/82b246d6124341f2a0eb99558f28f792` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.675286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22da98-95fd-4e39-a751-f61979e4f889 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=82b246d6124341f2a0eb99558f28f792)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.676313 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-9e22da98-95fd-4e39-a751-f61979e4f889 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:28.676313 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:28.676313 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:28.677188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22da98-95fd-4e39-a751-f61979e4f889 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.677304 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1941/3852] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:33:28.681221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfa341-2cb5-4a74-8845-f35576b78293 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.686473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9e22da98-95fd-4e39-a751-f61979e4f889 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '82b246d6124341f2a0eb99558f28f792', 'request_id': 'req-9e22da98-95fd-4e39-a751-f61979e4f889'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:28.691365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfa341-2cb5-4a74-8845-f35576b78293 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.696230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6351cc3-83b1-4ef8-b8b1-2502c174026d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.696925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6351cc3-83b1-4ef8-b8b1-2502c174026d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.697200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6351cc3-83b1-4ef8-b8b1-2502c174026d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.697466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6351cc3-83b1-4ef8-b8b1-2502c174026d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.698092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6351cc3-83b1-4ef8-b8b1-2502c174026d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.698309 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1912/3853] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Aug 28 18:33:28 2022] DELETE /identity/v3/endpoints/82b246d6124341f2a0eb99558f28f792 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:28.700744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6351cc3-83b1-4ef8-b8b1-2502c174026d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.702361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22da98-95fd-4e39-a751-f61979e4f889 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.714245 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1942/3854] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:33:28.715330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6351cc3-83b1-4ef8-b8b1-2502c174026d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.724041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22da98-95fd-4e39-a751-f61979e4f889 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.725342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6351cc3-83b1-4ef8-b8b1-2502c174026d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.729406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9409a-960a-445f-8116-8462c48a257d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.730089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9409a-960a-445f-8116-8462c48a257d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.730421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9409a-960a-445f-8116-8462c48a257d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.730704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9409a-960a-445f-8116-8462c48a257d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.731349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9409a-960a-445f-8116-8462c48a257d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.732952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9409a-960a-445f-8116-8462c48a257d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.740045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e987722-6edf-4e16-94df-eb338d26aae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.740682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e987722-6edf-4e16-94df-eb338d26aae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.740957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e987722-6edf-4e16-94df-eb338d26aae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.744560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e987722-6edf-4e16-94df-eb338d26aae0 admin admin] PATH_INFO: `/v3/projects/2a9635dc601347759aa5cbdb9df1905b/users/3c27c792ec89484ea1f8c7147195561a/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.744691 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1913/3855] 10.222.0.27 () {58 vars in 1134 bytes} [Sun Aug 28 18:33:28 2022] GET /identity/v3/endpoints => generated 4049 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:28.745366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9409a-960a-445f-8116-8462c48a257d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.754979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9409a-960a-445f-8116-8462c48a257d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.756561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e987722-6edf-4e16-94df-eb338d26aae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9635dc601347759aa5cbdb9df1905b, user_id=3c27c792ec89484ea1f8c7147195561a, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.759227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e987722-6edf-4e16-94df-eb338d26aae0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.759655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1cd6b-1ccb-47d7-80f3-a5ef75fd04c7 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.760277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1cd6b-1ccb-47d7-80f3-a5ef75fd04c7 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.760556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1cd6b-1ccb-47d7-80f3-a5ef75fd04c7 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.760826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1cd6b-1ccb-47d7-80f3-a5ef75fd04c7 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints/82b246d6124341f2a0eb99558f28f792` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.765324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1cd6b-1ccb-47d7-80f3-a5ef75fd04c7 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:33:28.773919 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1943/3856] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:28 2022] PUT /identity/v3/projects/2a9635dc601347759aa5cbdb9df1905b/users/3c27c792ec89484ea1f8c7147195561a/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:28.784206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d50c-50bf-440d-8b39-fb255dffe31f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.784516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d50c-50bf-440d-8b39-fb255dffe31f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.784796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d50c-50bf-440d-8b39-fb255dffe31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.804419 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-51b1cd6b-1ccb-47d7-80f3-a5ef75fd04c7 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Could not find endpoint: 82b246d6124341f2a0eb99558f28f792.: keystone.exception.EndpointNotFound: Could not find endpoint: 82b246d6124341f2a0eb99558f28f792. Aug 28 18:33:28.804419 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:28.804419 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Aug 28 18:33:28.804419 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Aug 28 18:33:28.804419 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 28 18:33:28.804419 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._iter().one() Aug 28 18:33:28.804419 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 28 18:33:28.804419 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._only_one_row( Aug 28 18:33:28.804419 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 28 18:33:28.804419 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 28 18:33:28.804419 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 28 18:33:28.804419 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:28.804419 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:33:28.804419 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:28.804419 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:28.804419 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Aug 28 18:33:28.805771 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Aug 28 18:33:28.805771 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Aug 28 18:33:28.805771 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Aug 28 18:33:28.805771 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Aug 28 18:33:28.805771 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 28 18:33:28.805771 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 82b246d6124341f2a0eb99558f28f792. Aug 28 18:33:28.805771 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:28.805771 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:33:28.805771 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:28.805771 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:28.805771 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:28.805771 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:28.805771 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:28.805771 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:28.805771 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:28.805771 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:28.805771 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:28.807015 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:28.807015 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:28.807015 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:28.807015 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Aug 28 18:33:28.807015 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Aug 28 18:33:28.807015 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:33:28.807015 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:33:28.807015 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:33:28.807015 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:33:28.807015 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:28.807015 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:28.807015 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:33:28.807015 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:33:28.807015 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:33:28.807015 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:33:28.807015 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:33:28.808290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:33:28.808290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:33:28.808290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:33:28.808290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:33:28.808290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:33:28.808290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:33:28.808290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:33:28.808290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:33:28.808290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:33:28.808290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Aug 28 18:33:28.808290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 28 18:33:28.808290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 82b246d6124341f2a0eb99558f28f792. Aug 28 18:33:28.808290 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:28.813040 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1914/3857] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Aug 28 18:33:28 2022] DELETE /identity/v3/endpoints/82b246d6124341f2a0eb99558f28f792 => generated 114 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 18:33:28.813577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e641d50c-50bf-440d-8b39-fb255dffe31f None None] MFA Rules not processed for user `3c27c792ec89484ea1f8c7147195561a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:28.814809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e641d50c-50bf-440d-8b39-fb255dffe31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:28.816934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1cd6b-1ccb-47d7-80f3-a5ef75fd04c7 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.828199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1cd6b-1ccb-47d7-80f3-a5ef75fd04c7 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.885801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194c814-027c-41c6-8eb6-b11eda8c3ab9 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.886482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194c814-027c-41c6-8eb6-b11eda8c3ab9 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.886765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194c814-027c-41c6-8eb6-b11eda8c3ab9 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.887037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194c814-027c-41c6-8eb6-b11eda8c3ab9 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/regions/tempest-region-1612767122` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.887660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194c814-027c-41c6-8eb6-b11eda8c3ab9 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1612767122)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.888668 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-1194c814-027c-41c6-8eb6-b11eda8c3ab9 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:28.888668 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:28.888668 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:28.889559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194c814-027c-41c6-8eb6-b11eda8c3ab9 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.890913 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1944/3858] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:28 2022] POST /identity/v3/auth/tokens => generated 3895 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:28.903104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641d50c-50bf-440d-8b39-fb255dffe31f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.904946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e641d50c-50bf-440d-8b39-fb255dffe31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:28.913573 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1915/3859] 10.222.0.27 () {58 vars in 1209 bytes} [Sun Aug 28 18:33:28 2022] DELETE /identity/v3/regions/tempest-region-1612767122 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:28.919292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194c814-027c-41c6-8eb6-b11eda8c3ab9 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.939539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:28.942414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194c814-027c-41c6-8eb6-b11eda8c3ab9 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.950766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624781-a092-4363-88c6-babf9c8fa31a tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.951581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624781-a092-4363-88c6-babf9c8fa31a tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.951783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624781-a092-4363-88c6-babf9c8fa31a tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.952072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624781-a092-4363-88c6-babf9c8fa31a tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.953285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624781-a092-4363-88c6-babf9c8fa31a tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.955216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624781-a092-4363-88c6-babf9c8fa31a tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:28.972628 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1916/3860] 10.222.0.27 () {58 vars in 1134 bytes} [Sun Aug 28 18:33:28 2022] GET /identity/v3/endpoints => generated 4049 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:28.974362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624781-a092-4363-88c6-babf9c8fa31a tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:28.988574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624781-a092-4363-88c6-babf9c8fa31a tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.994893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa152fe-4d8e-48aa-bbfb-6c0ec04237cf tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:28.995777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa152fe-4d8e-48aa-bbfb-6c0ec04237cf tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:28.996210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa152fe-4d8e-48aa-bbfb-6c0ec04237cf tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:28.996625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa152fe-4d8e-48aa-bbfb-6c0ec04237cf tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:28.997355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa152fe-4d8e-48aa-bbfb-6c0ec04237cf tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Adding query filter params (service_id=c1ddf627c2c148a68800cf40623909c6) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:28.997478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641d50c-50bf-440d-8b39-fb255dffe31f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:28.997770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa152fe-4d8e-48aa-bbfb-6c0ec04237cf tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:28.999675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa152fe-4d8e-48aa-bbfb-6c0ec04237cf tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:29.006699 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1917/3861] 10.222.0.27 () {58 vars in 1221 bytes} [Sun Aug 28 18:33:28 2022] GET /identity/v3/endpoints?service_id=c1ddf627c2c148a68800cf40623909c6 => generated 502 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:29.011013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa152fe-4d8e-48aa-bbfb-6c0ec04237cf tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:29.013516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df3cae-70dd-4193-94c5-62be0def53f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:29.014208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df3cae-70dd-4193-94c5-62be0def53f7 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:29.014558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df3cae-70dd-4193-94c5-62be0def53f7 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:29.014907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df3cae-70dd-4193-94c5-62be0def53f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:29.024783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df3cae-70dd-4193-94c5-62be0def53f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:29.025959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa152fe-4d8e-48aa-bbfb-6c0ec04237cf tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:29.028259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df3cae-70dd-4193-94c5-62be0def53f7 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:29.032188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00f30e-55f5-44f5-bc3c-b746df722168 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:29.032805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f30e-55f5-44f5-bc3c-b746df722168 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:29.033306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f30e-55f5-44f5-bc3c-b746df722168 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:29.033583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f30e-55f5-44f5-bc3c-b746df722168 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:29.034238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00f30e-55f5-44f5-bc3c-b746df722168 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Adding query filter params (service_id=4453dab46fb04af59ad4924187cc40ee) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:29.034540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00f30e-55f5-44f5-bc3c-b746df722168 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:29.036166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00f30e-55f5-44f5-bc3c-b746df722168 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:29.044934 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1918/3862] 10.222.0.27 () {58 vars in 1221 bytes} [Sun Aug 28 18:33:29 2022] GET /identity/v3/endpoints?service_id=4453dab46fb04af59ad4924187cc40ee => generated 504 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:29.045979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00f30e-55f5-44f5-bc3c-b746df722168 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:29.050755 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1945/3863] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:28 2022] GET /identity/v3/auth/tokens => generated 3895 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:33:29.063504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00f30e-55f5-44f5-bc3c-b746df722168 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:29.069565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ce057-a764-463d-b3bb-13213201f864 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:29.070195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ce057-a764-463d-b3bb-13213201f864 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:29.070620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ce057-a764-463d-b3bb-13213201f864 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:29.070915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ce057-a764-463d-b3bb-13213201f864 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:29.072009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ce057-a764-463d-b3bb-13213201f864 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:29.072009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ce057-a764-463d-b3bb-13213201f864 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:29.073512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ce057-a764-463d-b3bb-13213201f864 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:29.084179 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1919/3864] 10.222.0.27 () {58 vars in 1167 bytes} [Sun Aug 28 18:33:29 2022] GET /identity/v3/endpoints?interface=public => generated 3405 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:29.088402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df3cae-70dd-4193-94c5-62be0def53f7 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:29.103351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df3cae-70dd-4193-94c5-62be0def53f7 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:29.111853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893c048-ee4f-40a3-bc6f-5b238ca2508d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:29.112762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893c048-ee4f-40a3-bc6f-5b238ca2508d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:29.114560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893c048-ee4f-40a3-bc6f-5b238ca2508d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:29.114560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893c048-ee4f-40a3-bc6f-5b238ca2508d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:29.116135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893c048-ee4f-40a3-bc6f-5b238ca2508d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:29.117339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893c048-ee4f-40a3-bc6f-5b238ca2508d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:29.119457 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-7893c048-ee4f-40a3-bc6f-5b238ca2508d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:29.119457 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:29.119457 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:29.122412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893c048-ee4f-40a3-bc6f-5b238ca2508d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:29.134296 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1946/3865] 10.222.0.27 () {58 vars in 1171 bytes} [Sun Aug 28 18:33:29 2022] GET /identity/v3/endpoints?interface=internal => generated 479 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:29.141759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ce057-a764-463d-b3bb-13213201f864 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:29.152763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ce057-a764-463d-b3bb-13213201f864 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:29.160664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1134e3-34e0-4c5e-bbe8-40a0202ac23b tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:29.161509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1134e3-34e0-4c5e-bbe8-40a0202ac23b tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:29.162058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1134e3-34e0-4c5e-bbe8-40a0202ac23b tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:29.162451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1134e3-34e0-4c5e-bbe8-40a0202ac23b tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:29.163173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1134e3-34e0-4c5e-bbe8-40a0202ac23b tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:29.165107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1134e3-34e0-4c5e-bbe8-40a0202ac23b tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:29.187150 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1920/3866] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:29 2022] POST /identity/v3/services => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:29.191615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893c048-ee4f-40a3-bc6f-5b238ca2508d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:29.203311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893c048-ee4f-40a3-bc6f-5b238ca2508d tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:29.234966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f0fed-f4a9-4a99-a848-fdcb3f388c01 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:29.235540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f0fed-f4a9-4a99-a848-fdcb3f388c01 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:29.235817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f0fed-f4a9-4a99-a848-fdcb3f388c01 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:29.236205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f0fed-f4a9-4a99-a848-fdcb3f388c01 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:29.236752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f0fed-f4a9-4a99-a848-fdcb3f388c01 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:29.237794 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-250f0fed-f4a9-4a99-a848-fdcb3f388c01 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:29.237794 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:29.237794 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:29.238648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f0fed-f4a9-4a99-a848-fdcb3f388c01 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:29.258662 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-250f0fed-f4a9-4a99-a848-fdcb3f388c01 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2066659434. To ensure interoperability, identifiers should be a valid uuid. Aug 28 18:33:29.258662 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 18:33:29.258662 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:29.291047 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1947/3867] 10.222.0.27 () {60 vars in 1156 bytes} [Sun Aug 28 18:33:29 2022] POST /identity/v3/endpoints => generated 360 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:29.295437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1134e3-34e0-4c5e-bbe8-40a0202ac23b tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:29.316929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1134e3-34e0-4c5e-bbe8-40a0202ac23b tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:29.336371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9774c-94cb-498f-8317-d5010502a55f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:29.337245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9774c-94cb-498f-8317-d5010502a55f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:29.337689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9774c-94cb-498f-8317-d5010502a55f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:29.337969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9774c-94cb-498f-8317-d5010502a55f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/regions/tempest-region-2066659434` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:29.339902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9774c-94cb-498f-8317-d5010502a55f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2066659434)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:29.339902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9774c-94cb-498f-8317-d5010502a55f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:29.345181 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1921/3868] 10.222.0.27 () {58 vars in 1206 bytes} [Sun Aug 28 18:33:29 2022] GET /identity/v3/regions/tempest-region-2066659434 => generated 180 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:29.346612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f0fed-f4a9-4a99-a848-fdcb3f388c01 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:29.361618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f0fed-f4a9-4a99-a848-fdcb3f388c01 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:29.366340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8595bac-8e21-4d50-a00c-ac235292a3af tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:29.366996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8595bac-8e21-4d50-a00c-ac235292a3af tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:29.367710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8595bac-8e21-4d50-a00c-ac235292a3af tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:29.368072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8595bac-8e21-4d50-a00c-ac235292a3af tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints/2babf7aec0684cf1902c3eb38b5eaa79` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:29.375962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8595bac-8e21-4d50-a00c-ac235292a3af tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=2babf7aec0684cf1902c3eb38b5eaa79)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:29.377062 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-b8595bac-8e21-4d50-a00c-ac235292a3af tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:29.377062 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:29.377062 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:29.378945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8595bac-8e21-4d50-a00c-ac235292a3af tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:29.405585 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-b8595bac-8e21-4d50-a00c-ac235292a3af tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1667199218. To ensure interoperability, identifiers should be a valid uuid. Aug 28 18:33:29.405585 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 18:33:29.405585 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:29.444710 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1948/3869] 10.222.0.27 () {60 vars in 1256 bytes} [Sun Aug 28 18:33:29 2022] PATCH /identity/v3/endpoints/2babf7aec0684cf1902c3eb38b5eaa79 => generated 364 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:29.448953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9774c-94cb-498f-8317-d5010502a55f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:29.462902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9774c-94cb-498f-8317-d5010502a55f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:29.477689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:29.488375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09ad8e-1134-4501-9a1a-81817f018b63 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:29.489257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09ad8e-1134-4501-9a1a-81817f018b63 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:29.490047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09ad8e-1134-4501-9a1a-81817f018b63 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:29.490470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09ad8e-1134-4501-9a1a-81817f018b63 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/regions/tempest-region-1667199218` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:29.491565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09ad8e-1134-4501-9a1a-81817f018b63 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1667199218)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:29.493752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09ad8e-1134-4501-9a1a-81817f018b63 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:29.496782 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1922/3870] 10.222.0.27 () {58 vars in 1206 bytes} [Sun Aug 28 18:33:29 2022] GET /identity/v3/regions/tempest-region-1667199218 => generated 180 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:29.501084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8595bac-8e21-4d50-a00c-ac235292a3af tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:29.512276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8595bac-8e21-4d50-a00c-ac235292a3af tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:29.518622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6925f-3268-4a84-92d4-4369f637fa4e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:29.519288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6925f-3268-4a84-92d4-4369f637fa4e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:29.520267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6925f-3268-4a84-92d4-4369f637fa4e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:29.520267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6925f-3268-4a84-92d4-4369f637fa4e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints/2babf7aec0684cf1902c3eb38b5eaa79` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:29.527439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6925f-3268-4a84-92d4-4369f637fa4e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=2babf7aec0684cf1902c3eb38b5eaa79)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:29.528477 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-74c6925f-3268-4a84-92d4-4369f637fa4e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:29.528477 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:29.528477 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:29.529691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6925f-3268-4a84-92d4-4369f637fa4e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:29.545104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-74c6925f-3268-4a84-92d4-4369f637fa4e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '2babf7aec0684cf1902c3eb38b5eaa79', 'request_id': 'req-74c6925f-3268-4a84-92d4-4369f637fa4e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:29.583676 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1949/3871] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Aug 28 18:33:29 2022] DELETE /identity/v3/endpoints/2babf7aec0684cf1902c3eb38b5eaa79 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:29.587542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09ad8e-1134-4501-9a1a-81817f018b63 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:29.601042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09ad8e-1134-4501-9a1a-81817f018b63 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:29.623793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be15e51-aace-4561-a20b-b813ea5c1eb7 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:29.624434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be15e51-aace-4561-a20b-b813ea5c1eb7 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:29.624713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be15e51-aace-4561-a20b-b813ea5c1eb7 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:29.624985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be15e51-aace-4561-a20b-b813ea5c1eb7 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/regions/tempest-region-1667199218` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:29.625589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be15e51-aace-4561-a20b-b813ea5c1eb7 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1667199218)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:29.627839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be15e51-aace-4561-a20b-b813ea5c1eb7 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:29.640582 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-5be15e51-aace-4561-a20b-b813ea5c1eb7 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1667199218. To ensure interoperability, identifiers should be a valid uuid. Aug 28 18:33:29.640582 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 18:33:29.640582 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:29.649745 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1923/3872] 10.222.0.27 () {58 vars in 1209 bytes} [Sun Aug 28 18:33:29 2022] DELETE /identity/v3/regions/tempest-region-1667199218 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:29.653940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6925f-3268-4a84-92d4-4369f637fa4e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:29.665184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6925f-3268-4a84-92d4-4369f637fa4e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:29.680768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2d1ab-cca4-493b-bba5-770e516002da tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:29.681407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d1ab-cca4-493b-bba5-770e516002da tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:29.681685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d1ab-cca4-493b-bba5-770e516002da tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:29.681955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d1ab-cca4-493b-bba5-770e516002da tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/regions/tempest-region-2066659434` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:29.682533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2d1ab-cca4-493b-bba5-770e516002da tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2066659434)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:29.683604 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-d4e2d1ab-cca4-493b-bba5-770e516002da tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:29.683604 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:29.683604 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:29.684482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2d1ab-cca4-493b-bba5-770e516002da tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:29.707464 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1950/3873] 10.222.0.27 () {58 vars in 1209 bytes} [Sun Aug 28 18:33:29 2022] DELETE /identity/v3/regions/tempest-region-2066659434 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:29.711456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be15e51-aace-4561-a20b-b813ea5c1eb7 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:29.724007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be15e51-aace-4561-a20b-b813ea5c1eb7 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:29.743569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d31d6-cdf4-45b6-bfa7-33e2d6339e4a tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:29.744212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d31d6-cdf4-45b6-bfa7-33e2d6339e4a tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:29.744506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d31d6-cdf4-45b6-bfa7-33e2d6339e4a tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:29.744768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d31d6-cdf4-45b6-bfa7-33e2d6339e4a tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/services/7e98e92be3774b0da677d1aa025e81e5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:29.745367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d31d6-cdf4-45b6-bfa7-33e2d6339e4a tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7e98e92be3774b0da677d1aa025e81e5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:29.746523 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-cb9d31d6-cdf4-45b6-bfa7-33e2d6339e4a tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:29.746523 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:29.746523 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:29.747446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d31d6-cdf4-45b6-bfa7-33e2d6339e4a tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:29.784216 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1924/3874] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:29 2022] DELETE /identity/v3/services/7e98e92be3774b0da677d1aa025e81e5 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:29.789809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2d1ab-cca4-493b-bba5-770e516002da tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:29.796723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:29.801855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2d1ab-cca4-493b-bba5-770e516002da tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:29.834374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3f08b-7d11-4933-be75-0cfca179fea3 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:29.835785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3f08b-7d11-4933-be75-0cfca179fea3 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:29.836283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3f08b-7d11-4933-be75-0cfca179fea3 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:29.836562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3f08b-7d11-4933-be75-0cfca179fea3 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints/8f175bde8df948218c532e08d9bf7164` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:29.845478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3f08b-7d11-4933-be75-0cfca179fea3 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=8f175bde8df948218c532e08d9bf7164)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:29.848845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3f08b-7d11-4933-be75-0cfca179fea3 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:29.860765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c4c3f08b-7d11-4933-be75-0cfca179fea3 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '8f175bde8df948218c532e08d9bf7164', 'request_id': 'req-c4c3f08b-7d11-4933-be75-0cfca179fea3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:29.873411 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1951/3875] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Aug 28 18:33:29 2022] DELETE /identity/v3/endpoints/8f175bde8df948218c532e08d9bf7164 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:29.877245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d31d6-cdf4-45b6-bfa7-33e2d6339e4a tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:29.889419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d31d6-cdf4-45b6-bfa7-33e2d6339e4a tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:29.913828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e113fc-8abc-426a-b194-bd30d852561f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:29.914475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e113fc-8abc-426a-b194-bd30d852561f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:29.914757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e113fc-8abc-426a-b194-bd30d852561f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:29.915021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e113fc-8abc-426a-b194-bd30d852561f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/regions/tempest-region-1958492515` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:29.915652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e113fc-8abc-426a-b194-bd30d852561f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1958492515)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:29.917892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e113fc-8abc-426a-b194-bd30d852561f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:29.946381 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1925/3876] 10.222.0.27 () {58 vars in 1209 bytes} [Sun Aug 28 18:33:29 2022] DELETE /identity/v3/regions/tempest-region-1958492515 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:29.950527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3f08b-7d11-4933-be75-0cfca179fea3 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:29.969070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3f08b-7d11-4933-be75-0cfca179fea3 tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:29.988791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf0021-1e0f-4164-84f7-1fc8b8d08d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:29.989541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf0021-1e0f-4164-84f7-1fc8b8d08d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:29.989876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf0021-1e0f-4164-84f7-1fc8b8d08d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:29.990219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf0021-1e0f-4164-84f7-1fc8b8d08d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/services/4453dab46fb04af59ad4924187cc40ee` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:29.990933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf0021-1e0f-4164-84f7-1fc8b8d08d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4453dab46fb04af59ad4924187cc40ee)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:29.992090 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-4dbf0021-1e0f-4164-84f7-1fc8b8d08d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:29.992090 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:29.992090 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:29.993221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf0021-1e0f-4164-84f7-1fc8b8d08d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:30.030282 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1952/3877] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:29 2022] DELETE /identity/v3/services/4453dab46fb04af59ad4924187cc40ee => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:30.034262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e113fc-8abc-426a-b194-bd30d852561f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:30.045519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e113fc-8abc-426a-b194-bd30d852561f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:30.062085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855836b-f674-4330-bf03-2be001caf44f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:30.062877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855836b-f674-4330-bf03-2be001caf44f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:30.063159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855836b-f674-4330-bf03-2be001caf44f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:30.063468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855836b-f674-4330-bf03-2be001caf44f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/endpoints/e8a3c3382c9e4bb98de26049aa8e34a6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:30.068658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855836b-f674-4330-bf03-2be001caf44f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e8a3c3382c9e4bb98de26049aa8e34a6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:30.070321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855836b-f674-4330-bf03-2be001caf44f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:30.079742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a855836b-f674-4330-bf03-2be001caf44f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e8a3c3382c9e4bb98de26049aa8e34a6', 'request_id': 'req-a855836b-f674-4330-bf03-2be001caf44f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:30.089788 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1926/3878] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Aug 28 18:33:30 2022] DELETE /identity/v3/endpoints/e8a3c3382c9e4bb98de26049aa8e34a6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:30.093705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf0021-1e0f-4164-84f7-1fc8b8d08d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:30.104809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf0021-1e0f-4164-84f7-1fc8b8d08d1f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:30.119633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc72fa-6f19-45c7-830e-ac54a3cd945e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:30.120249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc72fa-6f19-45c7-830e-ac54a3cd945e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:30.120526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc72fa-6f19-45c7-830e-ac54a3cd945e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:30.120843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc72fa-6f19-45c7-830e-ac54a3cd945e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/regions/tempest-region-1936476258` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:30.121416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc72fa-6f19-45c7-830e-ac54a3cd945e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1936476258)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:30.123034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc72fa-6f19-45c7-830e-ac54a3cd945e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:30.135493 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-d9cc72fa-6f19-45c7-830e-ac54a3cd945e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1936476258. To ensure interoperability, identifiers should be a valid uuid. Aug 28 18:33:30.135493 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 18:33:30.135493 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:30.142590 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1953/3879] 10.222.0.27 () {58 vars in 1209 bytes} [Sun Aug 28 18:33:30 2022] DELETE /identity/v3/regions/tempest-region-1936476258 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:30.146635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855836b-f674-4330-bf03-2be001caf44f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:30.157987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855836b-f674-4330-bf03-2be001caf44f tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:30.174604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a0c18-b149-40a9-ac78-5a79c47db82e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec7da09bee4da89720cd702bc83693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e7557c0740b467eb4f64aca57912f68', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:30.175453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a0c18-b149-40a9-ac78-5a79c47db82e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:30.175760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a0c18-b149-40a9-ac78-5a79c47db82e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:30.176042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a0c18-b149-40a9-ac78-5a79c47db82e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] PATH_INFO: `/v3/services/c1ddf627c2c148a68800cf40623909c6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:30.176634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a0c18-b149-40a9-ac78-5a79c47db82e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c1ddf627c2c148a68800cf40623909c6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:30.178284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a0c18-b149-40a9-ac78-5a79c47db82e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:30.197171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5a94e-2896-4899-9dd3-b006d8111e9f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:30.197550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5a94e-2896-4899-9dd3-b006d8111e9f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:30.197728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5a94e-2896-4899-9dd3-b006d8111e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:30.204036 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1927/3880] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:30 2022] DELETE /identity/v3/services/c1ddf627c2c148a68800cf40623909c6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:30.207873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a0c18-b149-40a9-ac78-5a79c47db82e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:30.210058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c55a0c18-b149-40a9-ac78-5a79c47db82e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:30.220151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-07e5a94e-2896-4899-9dd3-b006d8111e9f None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:30.221525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-07e5a94e-2896-4899-9dd3-b006d8111e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:30.287750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:30.301818 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1954/3881] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:33:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:30.314451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a0c18-b149-40a9-ac78-5a79c47db82e tempest-EndPointsTestJSON-386690608 tempest-EndPointsTestJSON-386690608-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:30.317534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5a94e-2896-4899-9dd3-b006d8111e9f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:30.318934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-07e5a94e-2896-4899-9dd3-b006d8111e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:30.320025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c378b-5a72-481b-90c3-d3ad00de10d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:30.320908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c378b-5a72-481b-90c3-d3ad00de10d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:30.321196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c378b-5a72-481b-90c3-d3ad00de10d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:30.321572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c378b-5a72-481b-90c3-d3ad00de10d6 admin admin] PATH_INFO: `/v3/users/42b8475cbdaf44eda49de5565bc74323` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:30.322878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c378b-5a72-481b-90c3-d3ad00de10d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b8475cbdaf44eda49de5565bc74323)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:30.325796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c378b-5a72-481b-90c3-d3ad00de10d6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:30.380701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b21c378b-5a72-481b-90c3-d3ad00de10d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b8475cbdaf44eda49de5565bc74323'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:30.396002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b21c378b-5a72-481b-90c3-d3ad00de10d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b8475cbdaf44eda49de5565bc74323'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:30.396826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b21c378b-5a72-481b-90c3-d3ad00de10d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b8475cbdaf44eda49de5565bc74323'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:30.397477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b21c378b-5a72-481b-90c3-d3ad00de10d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b8475cbdaf44eda49de5565bc74323'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:30.400455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:30.408481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b21c378b-5a72-481b-90c3-d3ad00de10d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b8475cbdaf44eda49de5565bc74323'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:30.412107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5a94e-2896-4899-9dd3-b006d8111e9f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:30.418558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebb8a4-6165-40c2-bc71-3918ffb756c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:30.419336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb8a4-6165-40c2-bc71-3918ffb756c6 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:30.419860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb8a4-6165-40c2-bc71-3918ffb756c6 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:30.420310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb8a4-6165-40c2-bc71-3918ffb756c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:30.422244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-beebb8a4-6165-40c2-bc71-3918ffb756c6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:30.424546 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1928/3882] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:30 2022] DELETE /identity/v3/users/42b8475cbdaf44eda49de5565bc74323 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:30.429108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59213839-03de-4012-89d9-a78a1efec4de None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:30.429400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59213839-03de-4012-89d9-a78a1efec4de None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:30.429675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59213839-03de-4012-89d9-a78a1efec4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:30.434997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebb8a4-6165-40c2-bc71-3918ffb756c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:30.436798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebb8a4-6165-40c2-bc71-3918ffb756c6 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:30.448731 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1955/3883] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:33:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:33:30.452202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-59213839-03de-4012-89d9-a78a1efec4de None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:30.453439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-59213839-03de-4012-89d9-a78a1efec4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:30.546654 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1929/3884] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:30.561047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebb8a4-6165-40c2-bc71-3918ffb756c6 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:30.562881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-beebb8a4-6165-40c2-bc71-3918ffb756c6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:30.670513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebb8a4-6165-40c2-bc71-3918ffb756c6 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:30.722226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b548ac-621f-4056-82f7-07783d40d618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:30.722913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b548ac-621f-4056-82f7-07783d40d618 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:30.723271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b548ac-621f-4056-82f7-07783d40d618 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:30.723606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b548ac-621f-4056-82f7-07783d40d618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:30.733141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b548ac-621f-4056-82f7-07783d40d618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:30.734586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b548ac-621f-4056-82f7-07783d40d618 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:30.744320 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1956/3885] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:33:31.150728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59213839-03de-4012-89d9-a78a1efec4de None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:31.152488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-59213839-03de-4012-89d9-a78a1efec4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:31.165873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59213839-03de-4012-89d9-a78a1efec4de None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:31.172957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9584d1-b09b-47ae-81e2-940f51fa041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:31.173669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9584d1-b09b-47ae-81e2-940f51fa041a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:31.174016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9584d1-b09b-47ae-81e2-940f51fa041a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:31.174407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9584d1-b09b-47ae-81e2-940f51fa041a admin admin] PATH_INFO: `/v3/projects/1198d389f06f43899561a88c9ae98fdf` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:31.175662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9584d1-b09b-47ae-81e2-940f51fa041a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1198d389f06f43899561a88c9ae98fdf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:31.177899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9584d1-b09b-47ae-81e2-940f51fa041a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:31.245970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b9584d1-b09b-47ae-81e2-940f51fa041a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1198d389f06f43899561a88c9ae98fdf', 'request_id': 'req-8b9584d1-b09b-47ae-81e2-940f51fa041a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:31.253040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b9584d1-b09b-47ae-81e2-940f51fa041a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1198d389f06f43899561a88c9ae98fdf', 'request_id': 'req-8b9584d1-b09b-47ae-81e2-940f51fa041a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:31.255557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b694ad-e02c-4935-9321-e10870ff7f2d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:31.255826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b694ad-e02c-4935-9321-e10870ff7f2d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:31.256099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b694ad-e02c-4935-9321-e10870ff7f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:31.259026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b9584d1-b09b-47ae-81e2-940f51fa041a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1198d389f06f43899561a88c9ae98fdf', 'request_id': 'req-8b9584d1-b09b-47ae-81e2-940f51fa041a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:31.260795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:31.274930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b9584d1-b09b-47ae-81e2-940f51fa041a admin admin] The token cache is being invalidate because project 1198d389f06f43899561a88c9ae98fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:31.275276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b9584d1-b09b-47ae-81e2-940f51fa041a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:31.275889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b9584d1-b09b-47ae-81e2-940f51fa041a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:31.278089 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1930/3886] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:31 2022] DELETE /identity/v3/projects/1198d389f06f43899561a88c9ae98fdf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:31.279769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-53b694ad-e02c-4935-9321-e10870ff7f2d None None] MFA Rules not processed for user `ed083a289526439ea93593880be3ef86`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:31.282337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9584d1-b09b-47ae-81e2-940f51fa041a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:31.282484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-53b694ad-e02c-4935-9321-e10870ff7f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:31.284314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8b9584d1-b09b-47ae-81e2-940f51fa041a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:31.350506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9584d1-b09b-47ae-81e2-940f51fa041a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:31.352791 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1957/3887] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:31.355216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825052c-698d-4999-bffa-05c093e4edbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:31.355873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825052c-698d-4999-bffa-05c093e4edbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:31.356147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825052c-698d-4999-bffa-05c093e4edbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:31.356517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825052c-698d-4999-bffa-05c093e4edbf admin admin] PATH_INFO: `/v3/users/36ec7da09bee4da89720cd702bc83693` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:31.360517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825052c-698d-4999-bffa-05c093e4edbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ec7da09bee4da89720cd702bc83693)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:31.362816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825052c-698d-4999-bffa-05c093e4edbf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:31.416148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b825052c-698d-4999-bffa-05c093e4edbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ec7da09bee4da89720cd702bc83693'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:31.428311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b825052c-698d-4999-bffa-05c093e4edbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ec7da09bee4da89720cd702bc83693'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:31.429023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b825052c-698d-4999-bffa-05c093e4edbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ec7da09bee4da89720cd702bc83693'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:31.429638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b825052c-698d-4999-bffa-05c093e4edbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ec7da09bee4da89720cd702bc83693'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:31.437886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b825052c-698d-4999-bffa-05c093e4edbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ec7da09bee4da89720cd702bc83693'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:31.453455 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1931/3888] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:31 2022] DELETE /identity/v3/users/36ec7da09bee4da89720cd702bc83693 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:31.764889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b694ad-e02c-4935-9321-e10870ff7f2d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:31.778840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b694ad-e02c-4935-9321-e10870ff7f2d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:31.836087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:31.880805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11592770-77ac-459b-a089-64ea3b64ae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:31.881459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11592770-77ac-459b-a089-64ea3b64ae2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:31.881737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11592770-77ac-459b-a089-64ea3b64ae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:31.882012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11592770-77ac-459b-a089-64ea3b64ae2b admin admin] PATH_INFO: `/v3/projects/3e7557c0740b467eb4f64aca57912f68` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:31.884670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11592770-77ac-459b-a089-64ea3b64ae2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e7557c0740b467eb4f64aca57912f68)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:31.887505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11592770-77ac-459b-a089-64ea3b64ae2b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:31.985751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11592770-77ac-459b-a089-64ea3b64ae2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e7557c0740b467eb4f64aca57912f68', 'request_id': 'req-11592770-77ac-459b-a089-64ea3b64ae2b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:32.001755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11592770-77ac-459b-a089-64ea3b64ae2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e7557c0740b467eb4f64aca57912f68', 'request_id': 'req-11592770-77ac-459b-a089-64ea3b64ae2b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:32.026559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11592770-77ac-459b-a089-64ea3b64ae2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e7557c0740b467eb4f64aca57912f68', 'request_id': 'req-11592770-77ac-459b-a089-64ea3b64ae2b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:32.056942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11592770-77ac-459b-a089-64ea3b64ae2b admin admin] The token cache is being invalidate because project 3e7557c0740b467eb4f64aca57912f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:32.057911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11592770-77ac-459b-a089-64ea3b64ae2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:32.062409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11592770-77ac-459b-a089-64ea3b64ae2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:32.065563 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1958/3889] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:31 2022] DELETE /identity/v3/projects/3e7557c0740b467eb4f64aca57912f68 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:32.071289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915b162-02a6-4504-9f75-f52375a3fd70 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:32.071856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915b162-02a6-4504-9f75-f52375a3fd70 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:32.072578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915b162-02a6-4504-9f75-f52375a3fd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:32.116237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6915b162-02a6-4504-9f75-f52375a3fd70 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:32.121179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6915b162-02a6-4504-9f75-f52375a3fd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:32.186729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144e1ab-0bd9-48d1-b093-1e3b0168e231 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:32.186729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144e1ab-0bd9-48d1-b093-1e3b0168e231 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:32.186729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144e1ab-0bd9-48d1-b093-1e3b0168e231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:32.211099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6144e1ab-0bd9-48d1-b093-1e3b0168e231 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:32.212528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6144e1ab-0bd9-48d1-b093-1e3b0168e231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:32.241227 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1932/3890] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:32.249657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392be18-50fa-4b63-b450-d8593712f343 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:32.249657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392be18-50fa-4b63-b450-d8593712f343 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:32.249908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392be18-50fa-4b63-b450-d8593712f343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:32.287291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2392be18-50fa-4b63-b450-d8593712f343 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:32.288980 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1959/3891] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:33:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:32.290652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2392be18-50fa-4b63-b450-d8593712f343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:32.302533 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1933/3892] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:32.306761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392be18-50fa-4b63-b450-d8593712f343 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:32.306939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144e1ab-0bd9-48d1-b093-1e3b0168e231 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:32.308596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6144e1ab-0bd9-48d1-b093-1e3b0168e231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:32.313600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:32.321893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392be18-50fa-4b63-b450-d8593712f343 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:32.332024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3f48f-27aa-43ac-bc12-85ac6caf0cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:32.333212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3f48f-27aa-43ac-bc12-85ac6caf0cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:32.333694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3f48f-27aa-43ac-bc12-85ac6caf0cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:32.334368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3f48f-27aa-43ac-bc12-85ac6caf0cd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:32.335235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3f48f-27aa-43ac-bc12-85ac6caf0cd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:32.335672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3f48f-27aa-43ac-bc12-85ac6caf0cd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:32.337497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3f48f-27aa-43ac-bc12-85ac6caf0cd7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:32.354909 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1934/3893] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:32.359421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3f48f-27aa-43ac-bc12-85ac6caf0cd7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:32.371164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3f48f-27aa-43ac-bc12-85ac6caf0cd7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:32.380229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f87266-5ff9-473f-8e6d-bcd85b86efb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:32.381465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f87266-5ff9-473f-8e6d-bcd85b86efb3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:32.381838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f87266-5ff9-473f-8e6d-bcd85b86efb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:32.382202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f87266-5ff9-473f-8e6d-bcd85b86efb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:32.383290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f87266-5ff9-473f-8e6d-bcd85b86efb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:32.385117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f87266-5ff9-473f-8e6d-bcd85b86efb3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:32.425871 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1935/3894] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:32 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:32.430575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f87266-5ff9-473f-8e6d-bcd85b86efb3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:32.504742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144e1ab-0bd9-48d1-b093-1e3b0168e231 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:32.515236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:32.558017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f87266-5ff9-473f-8e6d-bcd85b86efb3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:32.563753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd2385-7721-42e0-bb40-a531ff1461ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:32.564515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd2385-7721-42e0-bb40-a531ff1461ce admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:32.564894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd2385-7721-42e0-bb40-a531ff1461ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:32.565288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd2385-7721-42e0-bb40-a531ff1461ce admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:32.566068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd2385-7721-42e0-bb40-a531ff1461ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:32.570252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd2385-7721-42e0-bb40-a531ff1461ce admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:32.604924 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1936/3895] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:32 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:32.608782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd2385-7721-42e0-bb40-a531ff1461ce admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:32.619902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3c7d5-d582-4640-a3c6-7909331f62af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:32.620750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3c7d5-d582-4640-a3c6-7909331f62af service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:32.621025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3c7d5-d582-4640-a3c6-7909331f62af service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:32.621300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3c7d5-d582-4640-a3c6-7909331f62af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:32.624519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd2385-7721-42e0-bb40-a531ff1461ce admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:32.629765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39e949-56a2-441c-ba44-a601343f9b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:32.630472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39e949-56a2-441c-ba44-a601343f9b7c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:32.630826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39e949-56a2-441c-ba44-a601343f9b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:32.631172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39e949-56a2-441c-ba44-a601343f9b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:32.631939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39e949-56a2-441c-ba44-a601343f9b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:32.633756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39e949-56a2-441c-ba44-a601343f9b7c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:32.645026 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1937/3896] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:33:32.648866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39e949-56a2-441c-ba44-a601343f9b7c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:32.659488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39e949-56a2-441c-ba44-a601343f9b7c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:32.666345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0087ab-f669-40ea-a8ef-a7be238ef739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:32.666652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0087ab-f669-40ea-a8ef-a7be238ef739 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:32.667011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0087ab-f669-40ea-a8ef-a7be238ef739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:32.667397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0087ab-f669-40ea-a8ef-a7be238ef739 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:32.668321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0087ab-f669-40ea-a8ef-a7be238ef739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:32.670091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0087ab-f669-40ea-a8ef-a7be238ef739 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:32.684689 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1938/3897] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:32.687435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0087ab-f669-40ea-a8ef-a7be238ef739 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:32.698169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0087ab-f669-40ea-a8ef-a7be238ef739 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:32.715443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304277f-388d-48b8-9ddd-f1ed51c50fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:32.715443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304277f-388d-48b8-9ddd-f1ed51c50fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:32.715443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304277f-388d-48b8-9ddd-f1ed51c50fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:32.715443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304277f-388d-48b8-9ddd-f1ed51c50fc8 admin admin] PATH_INFO: `/v3/projects/6670b64e77bb4b39a0196d67ba36656a/users/0a48bff7352a4e5db2d39013e0e2b9c9/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:32.724331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3c7d5-d582-4640-a3c6-7909331f62af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:32.726274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3c7d5-d582-4640-a3c6-7909331f62af service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:32.731757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304277f-388d-48b8-9ddd-f1ed51c50fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6670b64e77bb4b39a0196d67ba36656a, user_id=0a48bff7352a4e5db2d39013e0e2b9c9, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:32.734844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304277f-388d-48b8-9ddd-f1ed51c50fc8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:32.735712 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1960/3898] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:33:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:33:32.750496 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1939/3899] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:32 2022] PUT /identity/v3/projects/6670b64e77bb4b39a0196d67ba36656a/users/0a48bff7352a4e5db2d39013e0e2b9c9/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:32.763999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f88c47-7560-46e8-bbf2-eeb284bf02b1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:32.764394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f88c47-7560-46e8-bbf2-eeb284bf02b1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:32.764738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f88c47-7560-46e8-bbf2-eeb284bf02b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:32.795455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-11f88c47-7560-46e8-bbf2-eeb284bf02b1 None None] MFA Rules not processed for user `0a48bff7352a4e5db2d39013e0e2b9c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:32.796973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-11f88c47-7560-46e8-bbf2-eeb284bf02b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:32.880725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304277f-388d-48b8-9ddd-f1ed51c50fc8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:32.883966 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1961/3900] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:32.994354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304277f-388d-48b8-9ddd-f1ed51c50fc8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:33.003327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703498e5-0ce5-467c-bb47-6c514acff3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:33.003954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703498e5-0ce5-467c-bb47-6c514acff3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:33.004285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703498e5-0ce5-467c-bb47-6c514acff3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:33.007014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703498e5-0ce5-467c-bb47-6c514acff3d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:33.012142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703498e5-0ce5-467c-bb47-6c514acff3d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:33.014211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703498e5-0ce5-467c-bb47-6c514acff3d1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:33.037426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:33.046966 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1940/3901] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:32 2022] POST /identity/v3/projects => generated 369 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:33.051370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f88c47-7560-46e8-bbf2-eeb284bf02b1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:33.065600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f88c47-7560-46e8-bbf2-eeb284bf02b1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:33.108184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:33.136571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc4602-ed74-4fe4-a3d0-b243683a85fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:33.137470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc4602-ed74-4fe4-a3d0-b243683a85fc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:33.138356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc4602-ed74-4fe4-a3d0-b243683a85fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:33.138356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc4602-ed74-4fe4-a3d0-b243683a85fc admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:33.138862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc4602-ed74-4fe4-a3d0-b243683a85fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:33.141039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc4602-ed74-4fe4-a3d0-b243683a85fc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:33.167315 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1962/3902] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:33 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:33.171345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703498e5-0ce5-467c-bb47-6c514acff3d1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:33.181863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703498e5-0ce5-467c-bb47-6c514acff3d1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:33.187050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06fa7a-7f5e-400f-bedc-288209d2111b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:33.187742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06fa7a-7f5e-400f-bedc-288209d2111b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:33.188068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06fa7a-7f5e-400f-bedc-288209d2111b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:33.188342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06fa7a-7f5e-400f-bedc-288209d2111b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:33.188986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06fa7a-7f5e-400f-bedc-288209d2111b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:33.190642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06fa7a-7f5e-400f-bedc-288209d2111b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:33.202750 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1941/3903] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:33.207506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc4602-ed74-4fe4-a3d0-b243683a85fc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:33.218255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc4602-ed74-4fe4-a3d0-b243683a85fc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:33.223238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc128f6-5766-4351-9fe3-78369d895e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:33.223960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc128f6-5766-4351-9fe3-78369d895e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:33.224255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc128f6-5766-4351-9fe3-78369d895e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:33.224526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc128f6-5766-4351-9fe3-78369d895e19 admin admin] PATH_INFO: `/v3/projects/a63b9fb23de445719b2b9bf97e0a46c2/users/e3709b9636544a3fbcfe095185f9570f/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:33.240844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc128f6-5766-4351-9fe3-78369d895e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63b9fb23de445719b2b9bf97e0a46c2, user_id=e3709b9636544a3fbcfe095185f9570f, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:33.243628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc128f6-5766-4351-9fe3-78369d895e19 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:33.257841 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1963/3904] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:33 2022] PUT /identity/v3/projects/a63b9fb23de445719b2b9bf97e0a46c2/users/e3709b9636544a3fbcfe095185f9570f/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:33.261724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06fa7a-7f5e-400f-bedc-288209d2111b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:33.271870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06fa7a-7f5e-400f-bedc-288209d2111b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:33.331210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c046ca1-6fd5-493f-94e6-59d3d92680ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:33.331856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c046ca1-6fd5-493f-94e6-59d3d92680ea admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:33.332140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c046ca1-6fd5-493f-94e6-59d3d92680ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:33.332417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c046ca1-6fd5-493f-94e6-59d3d92680ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:33.333084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c046ca1-6fd5-493f-94e6-59d3d92680ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:33.334664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c046ca1-6fd5-493f-94e6-59d3d92680ea admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:33.344606 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1942/3905] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:33.348819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc128f6-5766-4351-9fe3-78369d895e19 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:33.359435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc128f6-5766-4351-9fe3-78369d895e19 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:33.364178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e5a17-4bd7-410c-92ca-07b06b636c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:33.364845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e5a17-4bd7-410c-92ca-07b06b636c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:33.365123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e5a17-4bd7-410c-92ca-07b06b636c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:33.365403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e5a17-4bd7-410c-92ca-07b06b636c77 admin admin] PATH_INFO: `/v3/projects/a63b9fb23de445719b2b9bf97e0a46c2/users/e3709b9636544a3fbcfe095185f9570f/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:33.367364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e5a17-4bd7-410c-92ca-07b06b636c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63b9fb23de445719b2b9bf97e0a46c2, user_id=e3709b9636544a3fbcfe095185f9570f, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:33.370025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e5a17-4bd7-410c-92ca-07b06b636c77 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:33.380500 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1964/3906] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:33 2022] PUT /identity/v3/projects/a63b9fb23de445719b2b9bf97e0a46c2/users/e3709b9636544a3fbcfe095185f9570f/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:33.392225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a1dc1-767e-48f2-9497-7cdc93ec4640 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:33.392584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a1dc1-767e-48f2-9497-7cdc93ec4640 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:33.392947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a1dc1-767e-48f2-9497-7cdc93ec4640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:33.424955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6e0a1dc1-767e-48f2-9497-7cdc93ec4640 None None] MFA Rules not processed for user `e3709b9636544a3fbcfe095185f9570f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:33.426213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6e0a1dc1-767e-48f2-9497-7cdc93ec4640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:33.522836 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1943/3907] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:33.527630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e5a17-4bd7-410c-92ca-07b06b636c77 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:33.606264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e5a17-4bd7-410c-92ca-07b06b636c77 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:33.612798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bcc3c7-aadc-4174-97e9-27ea82b09645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:33.615245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcc3c7-aadc-4174-97e9-27ea82b09645 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:33.615732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcc3c7-aadc-4174-97e9-27ea82b09645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:33.616679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcc3c7-aadc-4174-97e9-27ea82b09645 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:33.617850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bcc3c7-aadc-4174-97e9-27ea82b09645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:33.620777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bcc3c7-aadc-4174-97e9-27ea82b09645 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:33.663814 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1965/3908] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:33 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:33.667884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a1dc1-767e-48f2-9497-7cdc93ec4640 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:33.679238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a1dc1-767e-48f2-9497-7cdc93ec4640 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:33.755654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706db0f0-6990-4f92-9623-072574468da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:33.756126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db0f0-6990-4f92-9623-072574468da7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:33.756407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db0f0-6990-4f92-9623-072574468da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:33.756683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db0f0-6990-4f92-9623-072574468da7 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:33.757695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706db0f0-6990-4f92-9623-072574468da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:33.759661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706db0f0-6990-4f92-9623-072574468da7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:33.779797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:33.788324 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1944/3909] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:33 2022] POST /identity/v3/users => generated 285 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:33.792508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bcc3c7-aadc-4174-97e9-27ea82b09645 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:33.804521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bcc3c7-aadc-4174-97e9-27ea82b09645 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:33.811001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2195c-6270-4a22-b74e-80c50dffcdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:33.811904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2195c-6270-4a22-b74e-80c50dffcdbb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:33.812510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2195c-6270-4a22-b74e-80c50dffcdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:33.812951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2195c-6270-4a22-b74e-80c50dffcdbb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:33.814261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2195c-6270-4a22-b74e-80c50dffcdbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:33.816242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2195c-6270-4a22-b74e-80c50dffcdbb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:33.830172 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1966/3910] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:33.833872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706db0f0-6990-4f92-9623-072574468da7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:33.845558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706db0f0-6990-4f92-9623-072574468da7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:33.851294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ce37c-1e40-4aa9-9241-d5cb9d5080e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:33.852090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ce37c-1e40-4aa9-9241-d5cb9d5080e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:33.852588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ce37c-1e40-4aa9-9241-d5cb9d5080e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:33.853201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ce37c-1e40-4aa9-9241-d5cb9d5080e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:33.854007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ce37c-1e40-4aa9-9241-d5cb9d5080e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:33.857672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ce37c-1e40-4aa9-9241-d5cb9d5080e0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:33.874066 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1945/3911] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:33:33.878418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2195c-6270-4a22-b74e-80c50dffcdbb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:33.898073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2195c-6270-4a22-b74e-80c50dffcdbb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:33.911872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0504cbe-c72f-4b1b-8bcd-efdb840e9e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:33.913143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0504cbe-c72f-4b1b-8bcd-efdb840e9e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:33.913430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0504cbe-c72f-4b1b-8bcd-efdb840e9e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:33.913709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0504cbe-c72f-4b1b-8bcd-efdb840e9e5d admin admin] PATH_INFO: `/v3/projects/0c331189b45b40218bac4b7dfd75ac3c/users/32eb7cf6566446d494b2d1939b20807a/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:33.935369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0504cbe-c72f-4b1b-8bcd-efdb840e9e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c331189b45b40218bac4b7dfd75ac3c, user_id=32eb7cf6566446d494b2d1939b20807a, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:33.937761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0504cbe-c72f-4b1b-8bcd-efdb840e9e5d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:33.955387 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1967/3912] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:33 2022] PUT /identity/v3/projects/0c331189b45b40218bac4b7dfd75ac3c/users/32eb7cf6566446d494b2d1939b20807a/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:33.965370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35d618-307d-43a6-9f2a-2231f74e7202 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:33.965826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35d618-307d-43a6-9f2a-2231f74e7202 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:33.966201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35d618-307d-43a6-9f2a-2231f74e7202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:34.028267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fc35d618-307d-43a6-9f2a-2231f74e7202 None None] MFA Rules not processed for user `32eb7cf6566446d494b2d1939b20807a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:34.031811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fc35d618-307d-43a6-9f2a-2231f74e7202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:34.132920 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1946/3913] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:34.138424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0504cbe-c72f-4b1b-8bcd-efdb840e9e5d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:34.180786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43473a76-0be3-4297-8bd2-a7bfb20edc17 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:34.181306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43473a76-0be3-4297-8bd2-a7bfb20edc17 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:34.181751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43473a76-0be3-4297-8bd2-a7bfb20edc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:34.215021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-43473a76-0be3-4297-8bd2-a7bfb20edc17 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:34.216253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-43473a76-0be3-4297-8bd2-a7bfb20edc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:34.216876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:34.242921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0504cbe-c72f-4b1b-8bcd-efdb840e9e5d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:34.249961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73328d2b-7563-47ca-8ccb-aefa8b343a32 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:34.251871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73328d2b-7563-47ca-8ccb-aefa8b343a32 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:34.252645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73328d2b-7563-47ca-8ccb-aefa8b343a32 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:34.253713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73328d2b-7563-47ca-8ccb-aefa8b343a32 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:34.255283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73328d2b-7563-47ca-8ccb-aefa8b343a32 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:34.257494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73328d2b-7563-47ca-8ccb-aefa8b343a32 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:34.281529 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1968/3914] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:33:34 2022] POST /identity/v3/domains => generated 277 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:34.285551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73328d2b-7563-47ca-8ccb-aefa8b343a32 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:34.298046 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1947/3915] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:33:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:34.311586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43473a76-0be3-4297-8bd2-a7bfb20edc17 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:34.371822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73328d2b-7563-47ca-8ccb-aefa8b343a32 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:34.377605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2368d-5fc6-4328-9875-9c62727fe7dd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:34.378233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2368d-5fc6-4328-9875-9c62727fe7dd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:34.378516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2368d-5fc6-4328-9875-9c62727fe7dd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:34.378793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2368d-5fc6-4328-9875-9c62727fe7dd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:34.379500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2368d-5fc6-4328-9875-9c62727fe7dd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:34.380537 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-8bf2368d-5fc6-4328-9875-9c62727fe7dd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:34.380537 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:34.380537 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:34.381436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2368d-5fc6-4328-9875-9c62727fe7dd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:34.396034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43473a76-0be3-4297-8bd2-a7bfb20edc17 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:34.403082 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1969/3916] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:33:34 2022] POST /identity/v3/roles => generated 239 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:34.403897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2368d-5fc6-4328-9875-9c62727fe7dd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:34.414545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2368d-5fc6-4328-9875-9c62727fe7dd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:34.418880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:34.420022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb9a21-a2c2-4468-a673-7ff500f884c4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:34.420619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb9a21-a2c2-4468-a673-7ff500f884c4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:34.420974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb9a21-a2c2-4468-a673-7ff500f884c4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:34.421285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb9a21-a2c2-4468-a673-7ff500f884c4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/c43d3509e02242e2a00c83e0d45e32d1/users/32eb7cf6566446d494b2d1939b20807a/roles/58a793fcba524a23918d8f9725630dd5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:34.435950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb9a21-a2c2-4468-a673-7ff500f884c4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=c43d3509e02242e2a00c83e0d45e32d1, user_id=32eb7cf6566446d494b2d1939b20807a, role_id=58a793fcba524a23918d8f9725630dd5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:34.438618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb9a21-a2c2-4468-a673-7ff500f884c4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:34.454580 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1970/3917] 10.222.0.27 () {60 vars in 1480 bytes} [Sun Aug 28 18:33:34 2022] PUT /identity/v3/domains/c43d3509e02242e2a00c83e0d45e32d1/users/32eb7cf6566446d494b2d1939b20807a/roles/58a793fcba524a23918d8f9725630dd5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:34.460121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb9a21-a2c2-4468-a673-7ff500f884c4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:34.465702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecb452-49e3-4d19-8efd-6dbb995b74cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:34.466434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecb452-49e3-4d19-8efd-6dbb995b74cc service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:34.466775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecb452-49e3-4d19-8efd-6dbb995b74cc service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:34.467107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecb452-49e3-4d19-8efd-6dbb995b74cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:34.531767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb9a21-a2c2-4468-a673-7ff500f884c4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:34.536950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a10138-25a7-4eba-860c-4ca21507625c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:34.537793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a10138-25a7-4eba-860c-4ca21507625c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:34.538278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a10138-25a7-4eba-860c-4ca21507625c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:34.538715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a10138-25a7-4eba-860c-4ca21507625c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:34.539611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a10138-25a7-4eba-860c-4ca21507625c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:34.541232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a10138-25a7-4eba-860c-4ca21507625c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:34.544744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecb452-49e3-4d19-8efd-6dbb995b74cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:34.548550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecb452-49e3-4d19-8efd-6dbb995b74cc service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:34.560213 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1948/3918] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:33:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 18:33:34.567397 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1971/3919] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:33:34 2022] POST /identity/v3/domains => generated 276 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:34.569424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecb452-49e3-4d19-8efd-6dbb995b74cc service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:34.583162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecb452-49e3-4d19-8efd-6dbb995b74cc service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:34.652354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fafd46-17df-43a3-bcb9-a242ecae1de5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:34.653121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fafd46-17df-43a3-bcb9-a242ecae1de5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:34.653540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fafd46-17df-43a3-bcb9-a242ecae1de5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:34.653918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fafd46-17df-43a3-bcb9-a242ecae1de5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:34.654830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fafd46-17df-43a3-bcb9-a242ecae1de5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:34.655973 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-b0fafd46-17df-43a3-bcb9-a242ecae1de5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:34.655973 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:34.655973 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:34.657254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fafd46-17df-43a3-bcb9-a242ecae1de5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:34.674975 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1949/3920] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:33:34 2022] POST /identity/v3/roles => generated 239 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:34.679286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a10138-25a7-4eba-860c-4ca21507625c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:34.691538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a10138-25a7-4eba-860c-4ca21507625c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:34.696362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c12a2-94c1-4ad5-b9ea-116d3f0ef1cb tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:34.696986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c12a2-94c1-4ad5-b9ea-116d3f0ef1cb tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:34.697262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c12a2-94c1-4ad5-b9ea-116d3f0ef1cb tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:34.697536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c12a2-94c1-4ad5-b9ea-116d3f0ef1cb tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:34.698185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c12a2-94c1-4ad5-b9ea-116d3f0ef1cb tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:34.700264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c12a2-94c1-4ad5-b9ea-116d3f0ef1cb tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:34.733819 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1972/3921] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Aug 28 18:33:34 2022] POST /identity/v3/groups => generated 325 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:34.734901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fafd46-17df-43a3-bcb9-a242ecae1de5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:34.745809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fafd46-17df-43a3-bcb9-a242ecae1de5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:34.750979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f13cd-fd70-4d14-86c3-fe0b7ab6e17c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:34.751686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f13cd-fd70-4d14-86c3-fe0b7ab6e17c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:34.751964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f13cd-fd70-4d14-86c3-fe0b7ab6e17c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:34.752238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f13cd-fd70-4d14-86c3-fe0b7ab6e17c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/groups/ca5e3640c2f24a68a45f16ca93d78406/users/32eb7cf6566446d494b2d1939b20807a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:34.758755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f13cd-fd70-4d14-86c3-fe0b7ab6e17c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=ca5e3640c2f24a68a45f16ca93d78406, user_id=32eb7cf6566446d494b2d1939b20807a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:34.759888 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-138f13cd-fd70-4d14-86c3-fe0b7ab6e17c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:34.759888 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:34.759888 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:34.761150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f13cd-fd70-4d14-86c3-fe0b7ab6e17c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:34.790264 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1950/3922] 10.222.0.27 () {60 vars in 1360 bytes} [Sun Aug 28 18:33:34 2022] PUT /identity/v3/groups/ca5e3640c2f24a68a45f16ca93d78406/users/32eb7cf6566446d494b2d1939b20807a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:34.794315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c12a2-94c1-4ad5-b9ea-116d3f0ef1cb tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:34.805359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c12a2-94c1-4ad5-b9ea-116d3f0ef1cb tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:34.819501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cc33c-4b1a-4634-a28a-afb6c769416b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:34.819899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cc33c-4b1a-4634-a28a-afb6c769416b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:34.820174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cc33c-4b1a-4634-a28a-afb6c769416b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:34.825379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:34.847781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5a6cc33c-4b1a-4634-a28a-afb6c769416b None None] MFA Rules not processed for user `3c27c792ec89484ea1f8c7147195561a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:34.849320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5a6cc33c-4b1a-4634-a28a-afb6c769416b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:34.884095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:34.891989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac19b6-4103-4a6e-ab89-7a5b020c3001 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:34.893320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac19b6-4103-4a6e-ab89-7a5b020c3001 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:34.894012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac19b6-4103-4a6e-ab89-7a5b020c3001 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:34.894454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac19b6-4103-4a6e-ab89-7a5b020c3001 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/9fb71a91b173468f9ec3077aa09e1ec1/groups/ca5e3640c2f24a68a45f16ca93d78406/roles/5a454fa212df4baa800ac18dbc3e78c2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:34.896930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac19b6-4103-4a6e-ab89-7a5b020c3001 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9fb71a91b173468f9ec3077aa09e1ec1, group_id=ca5e3640c2f24a68a45f16ca93d78406, role_id=5a454fa212df4baa800ac18dbc3e78c2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:34.899877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac19b6-4103-4a6e-ab89-7a5b020c3001 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:34.924728 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1973/3923] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:34 2022] PUT /identity/v3/domains/9fb71a91b173468f9ec3077aa09e1ec1/groups/ca5e3640c2f24a68a45f16ca93d78406/roles/5a454fa212df4baa800ac18dbc3e78c2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:34.931812 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1951/3924] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:34.932229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac19b6-4103-4a6e-ab89-7a5b020c3001 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:35.039817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac19b6-4103-4a6e-ab89-7a5b020c3001 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:35.054226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be489c2c-1d30-43f8-bf97-a40071fc1343 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:35.054954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be489c2c-1d30-43f8-bf97-a40071fc1343 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:35.055457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be489c2c-1d30-43f8-bf97-a40071fc1343 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:35.055872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be489c2c-1d30-43f8-bf97-a40071fc1343 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:35.056916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be489c2c-1d30-43f8-bf97-a40071fc1343 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:35.059188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be489c2c-1d30-43f8-bf97-a40071fc1343 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:35.085328 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1974/3925] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:33:34 2022] POST /identity/v3/domains => generated 276 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:35.086091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cc33c-4b1a-4634-a28a-afb6c769416b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:35.101624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cc33c-4b1a-4634-a28a-afb6c769416b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:35.179000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9841e3-f079-4e69-a1d6-631800e8ba31 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:35.179734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9841e3-f079-4e69-a1d6-631800e8ba31 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:35.180032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9841e3-f079-4e69-a1d6-631800e8ba31 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:35.180300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9841e3-f079-4e69-a1d6-631800e8ba31 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:35.180968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9841e3-f079-4e69-a1d6-631800e8ba31 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:35.182567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9841e3-f079-4e69-a1d6-631800e8ba31 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:35.199629 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1952/3926] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:33:35 2022] POST /identity/v3/roles => generated 240 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:35.203975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be489c2c-1d30-43f8-bf97-a40071fc1343 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:35.215001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be489c2c-1d30-43f8-bf97-a40071fc1343 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:35.219813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e851dd-ef32-4d5b-afd9-6f1f3ccb4585 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:35.220584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e851dd-ef32-4d5b-afd9-6f1f3ccb4585 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:35.220884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e851dd-ef32-4d5b-afd9-6f1f3ccb4585 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:35.221142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e851dd-ef32-4d5b-afd9-6f1f3ccb4585 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/8b1bea71f9ae473cbd7bde4888e21b59/users/32eb7cf6566446d494b2d1939b20807a/roles/738ea52b92374bba8fbd35e52fe96476` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:35.237465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e851dd-ef32-4d5b-afd9-6f1f3ccb4585 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8b1bea71f9ae473cbd7bde4888e21b59, user_id=32eb7cf6566446d494b2d1939b20807a, role_id=738ea52b92374bba8fbd35e52fe96476)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:35.240275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e851dd-ef32-4d5b-afd9-6f1f3ccb4585 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:35.256076 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1975/3927] 10.222.0.27 () {60 vars in 1480 bytes} [Sun Aug 28 18:33:35 2022] PUT /identity/v3/domains/8b1bea71f9ae473cbd7bde4888e21b59/users/32eb7cf6566446d494b2d1939b20807a/roles/738ea52b92374bba8fbd35e52fe96476 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:35.260207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9841e3-f079-4e69-a1d6-631800e8ba31 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:35.270538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9841e3-f079-4e69-a1d6-631800e8ba31 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:35.339561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79782e5a-133d-41e4-8ee9-64d5453acab1 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:35.340959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79782e5a-133d-41e4-8ee9-64d5453acab1 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:35.340959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79782e5a-133d-41e4-8ee9-64d5453acab1 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:35.341172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79782e5a-133d-41e4-8ee9-64d5453acab1 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:35.342073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79782e5a-133d-41e4-8ee9-64d5453acab1 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:35.344129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79782e5a-133d-41e4-8ee9-64d5453acab1 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:35.380556 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1953/3928] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:33:35 2022] POST /identity/v3/domains => generated 274 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:35.384438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e851dd-ef32-4d5b-afd9-6f1f3ccb4585 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:35.400218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e851dd-ef32-4d5b-afd9-6f1f3ccb4585 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:35.490959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb9bcb-2cdd-4af2-bb06-7cec330ea4f6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:35.491618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb9bcb-2cdd-4af2-bb06-7cec330ea4f6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:35.491902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb9bcb-2cdd-4af2-bb06-7cec330ea4f6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:35.492177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb9bcb-2cdd-4af2-bb06-7cec330ea4f6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:35.492859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb9bcb-2cdd-4af2-bb06-7cec330ea4f6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:35.495574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb9bcb-2cdd-4af2-bb06-7cec330ea4f6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:35.516594 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1976/3929] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:33:35 2022] POST /identity/v3/roles => generated 239 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:35.521400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79782e5a-133d-41e4-8ee9-64d5453acab1 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:35.560934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79782e5a-133d-41e4-8ee9-64d5453acab1 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:35.570311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892034d5-55cf-4884-a6b4-6b38d11e8e7a tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:35.571227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892034d5-55cf-4884-a6b4-6b38d11e8e7a tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:35.571585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892034d5-55cf-4884-a6b4-6b38d11e8e7a tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:35.571861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892034d5-55cf-4884-a6b4-6b38d11e8e7a tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:35.572520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892034d5-55cf-4884-a6b4-6b38d11e8e7a tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:35.573602 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-892034d5-55cf-4884-a6b4-6b38d11e8e7a tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:35.573602 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:35.573602 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:35.577435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892034d5-55cf-4884-a6b4-6b38d11e8e7a tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:35.634304 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1954/3930] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Aug 28 18:33:35 2022] POST /identity/v3/groups => generated 326 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:35.638761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb9bcb-2cdd-4af2-bb06-7cec330ea4f6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:35.657362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb9bcb-2cdd-4af2-bb06-7cec330ea4f6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:35.662792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0000b-45fd-47cb-82ca-b1d989aba1ff tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:35.663512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0000b-45fd-47cb-82ca-b1d989aba1ff tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:35.663798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0000b-45fd-47cb-82ca-b1d989aba1ff tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:35.664075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0000b-45fd-47cb-82ca-b1d989aba1ff tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/groups/564079ea7ed64f7a96125e245634b3dd/users/32eb7cf6566446d494b2d1939b20807a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:35.679433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0000b-45fd-47cb-82ca-b1d989aba1ff tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=564079ea7ed64f7a96125e245634b3dd, user_id=32eb7cf6566446d494b2d1939b20807a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:35.680449 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-07e0000b-45fd-47cb-82ca-b1d989aba1ff tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:35.680449 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:35.680449 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:35.681984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0000b-45fd-47cb-82ca-b1d989aba1ff tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:35.731603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:35.780223 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1977/3931] 10.222.0.27 () {60 vars in 1360 bytes} [Sun Aug 28 18:33:35 2022] PUT /identity/v3/groups/564079ea7ed64f7a96125e245634b3dd/users/32eb7cf6566446d494b2d1939b20807a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:35.784478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892034d5-55cf-4884-a6b4-6b38d11e8e7a tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:35.802106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892034d5-55cf-4884-a6b4-6b38d11e8e7a tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:35.846163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47a157-9e73-4bbb-a982-88d5ca3e61c0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:35.846754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47a157-9e73-4bbb-a982-88d5ca3e61c0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:35.846754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47a157-9e73-4bbb-a982-88d5ca3e61c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:35.852090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:35.871118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1d47a157-9e73-4bbb-a982-88d5ca3e61c0 None None] MFA Rules not processed for user `3c27c792ec89484ea1f8c7147195561a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:35.872148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d47a157-9e73-4bbb-a982-88d5ca3e61c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:35.903900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb95171-32be-4bdb-bc61-a5b06bf29701 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:35.905025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb95171-32be-4bdb-bc61-a5b06bf29701 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:35.905312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb95171-32be-4bdb-bc61-a5b06bf29701 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:35.905590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb95171-32be-4bdb-bc61-a5b06bf29701 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/1de0b9ab060d4fd29a3245b164274a92/groups/564079ea7ed64f7a96125e245634b3dd/roles/323306a06a2a45799a8611a8b9315e36` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:35.915097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb95171-32be-4bdb-bc61-a5b06bf29701 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=1de0b9ab060d4fd29a3245b164274a92, group_id=564079ea7ed64f7a96125e245634b3dd, role_id=323306a06a2a45799a8611a8b9315e36)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:35.917793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb95171-32be-4bdb-bc61-a5b06bf29701 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:35.944716 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1955/3932] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:35 2022] PUT /identity/v3/domains/1de0b9ab060d4fd29a3245b164274a92/groups/564079ea7ed64f7a96125e245634b3dd/roles/323306a06a2a45799a8611a8b9315e36 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:35.951380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb95171-32be-4bdb-bc61-a5b06bf29701 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:35.998935 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1978/3933] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:36.110671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb95171-32be-4bdb-bc61-a5b06bf29701 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:36.115087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64b0fc-81e0-4f33-a4f4-8befd1301299 tempest-TokensV3TestJSON-2038045858 tempest-TokensV3TestJSON-2038045858-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32eb7cf6566446d494b2d1939b20807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c331189b45b40218bac4b7dfd75ac3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:36.115780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64b0fc-81e0-4f33-a4f4-8befd1301299 tempest-TokensV3TestJSON-2038045858 tempest-TokensV3TestJSON-2038045858-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:36.116178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64b0fc-81e0-4f33-a4f4-8befd1301299 tempest-TokensV3TestJSON-2038045858 tempest-TokensV3TestJSON-2038045858-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:36.116464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64b0fc-81e0-4f33-a4f4-8befd1301299 tempest-TokensV3TestJSON-2038045858 tempest-TokensV3TestJSON-2038045858-project] PATH_INFO: `/v3/auth/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:36.117041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64b0fc-81e0-4f33-a4f4-8befd1301299 tempest-TokensV3TestJSON-2038045858 tempest-TokensV3TestJSON-2038045858-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:36.118100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64b0fc-81e0-4f33-a4f4-8befd1301299 tempest-TokensV3TestJSON-2038045858 tempest-TokensV3TestJSON-2038045858-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:36.202753 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1956/3934] 10.222.0.27 () {58 vars in 1143 bytes} [Sun Aug 28 18:33:35 2022] GET /identity/v3/auth/domains => generated 1171 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:36.207038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47a157-9e73-4bbb-a982-88d5ca3e61c0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:36.220809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47a157-9e73-4bbb-a982-88d5ca3e61c0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:36.295676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11541b-3c45-4f5b-8bd8-2a95d3478de6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:36.296377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11541b-3c45-4f5b-8bd8-2a95d3478de6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:36.296659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11541b-3c45-4f5b-8bd8-2a95d3478de6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:36.296937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11541b-3c45-4f5b-8bd8-2a95d3478de6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/1de0b9ab060d4fd29a3245b164274a92/groups/564079ea7ed64f7a96125e245634b3dd/roles/323306a06a2a45799a8611a8b9315e36` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:36.299655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11541b-3c45-4f5b-8bd8-2a95d3478de6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=1de0b9ab060d4fd29a3245b164274a92, group_id=564079ea7ed64f7a96125e245634b3dd, role_id=323306a06a2a45799a8611a8b9315e36)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:36.300744 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-df11541b-3c45-4f5b-8bd8-2a95d3478de6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:36.300744 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:36.300744 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:36.302682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11541b-3c45-4f5b-8bd8-2a95d3478de6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:36.310685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-df11541b-3c45-4f5b-8bd8-2a95d3478de6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invalidating the token cache because role 323306a06a2a45799a8611a8b9315e36 was removed from group 564079ea7ed64f7a96125e245634b3dd on domain 1de0b9ab060d4fd29a3245b164274a92. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:36.311033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-df11541b-3c45-4f5b-8bd8-2a95d3478de6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:36.311784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-df11541b-3c45-4f5b-8bd8-2a95d3478de6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:36.329595 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1979/3935] 10.222.0.27 () {58 vars in 1467 bytes} [Sun Aug 28 18:33:36 2022] DELETE /identity/v3/domains/1de0b9ab060d4fd29a3245b164274a92/groups/564079ea7ed64f7a96125e245634b3dd/roles/323306a06a2a45799a8611a8b9315e36 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:36.333545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64b0fc-81e0-4f33-a4f4-8befd1301299 tempest-TokensV3TestJSON-2038045858 tempest-TokensV3TestJSON-2038045858-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:36.336438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3c64b0fc-81e0-4f33-a4f4-8befd1301299 tempest-TokensV3TestJSON-2038045858 tempest-TokensV3TestJSON-2038045858-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:36.356337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64b0fc-81e0-4f33-a4f4-8befd1301299 tempest-TokensV3TestJSON-2038045858 tempest-TokensV3TestJSON-2038045858-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:36.447838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:36.485416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c007e1-1304-4d79-aa08-3e22543af0b4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:36.486011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c007e1-1304-4d79-aa08-3e22543af0b4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:36.486847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c007e1-1304-4d79-aa08-3e22543af0b4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:36.487133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c007e1-1304-4d79-aa08-3e22543af0b4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/groups/564079ea7ed64f7a96125e245634b3dd/users/32eb7cf6566446d494b2d1939b20807a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:36.490787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c007e1-1304-4d79-aa08-3e22543af0b4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=564079ea7ed64f7a96125e245634b3dd, user_id=32eb7cf6566446d494b2d1939b20807a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:36.493875 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-71c007e1-1304-4d79-aa08-3e22543af0b4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:36.493875 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:36.493875 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:36.498147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c007e1-1304-4d79-aa08-3e22543af0b4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:36.523493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71c007e1-1304-4d79-aa08-3e22543af0b4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '32eb7cf6566446d494b2d1939b20807a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:36.553944 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1957/3936] 10.222.0.27 () {58 vars in 1344 bytes} [Sun Aug 28 18:33:36 2022] DELETE /identity/v3/groups/564079ea7ed64f7a96125e245634b3dd/users/32eb7cf6566446d494b2d1939b20807a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:36.560706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11541b-3c45-4f5b-8bd8-2a95d3478de6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:36.576198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11541b-3c45-4f5b-8bd8-2a95d3478de6 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:36.698927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c14b01-35bf-4589-a5fd-297d6b4c328b tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:36.699550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c14b01-35bf-4589-a5fd-297d6b4c328b tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:36.699841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c14b01-35bf-4589-a5fd-297d6b4c328b tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:36.700126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c14b01-35bf-4589-a5fd-297d6b4c328b tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/groups/564079ea7ed64f7a96125e245634b3dd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:36.705370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c14b01-35bf-4589-a5fd-297d6b4c328b tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:delete_group(group_id=564079ea7ed64f7a96125e245634b3dd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:36.706437 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-e7c14b01-35bf-4589-a5fd-297d6b4c328b tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:36.706437 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:36.706437 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:36.710224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c14b01-35bf-4589-a5fd-297d6b4c328b tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:36.786449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=1,keystone:SELECT=95,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:36.842136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c007e1-1304-4d79-aa08-3e22543af0b4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:36.842573 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1980/3937] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:33:36 2022] DELETE /identity/v3/groups/564079ea7ed64f7a96125e245634b3dd => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:36.872654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c007e1-1304-4d79-aa08-3e22543af0b4 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:37.041260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c641cb-854f-4dcf-8d61-e62702d88305 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:37.041916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c641cb-854f-4dcf-8d61-e62702d88305 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:37.042247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c641cb-854f-4dcf-8d61-e62702d88305 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:37.042612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c641cb-854f-4dcf-8d61-e62702d88305 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/roles/323306a06a2a45799a8611a8b9315e36` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:37.045488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c641cb-854f-4dcf-8d61-e62702d88305 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:delete_role(role_id=323306a06a2a45799a8611a8b9315e36)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:37.046219 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-e2c641cb-854f-4dcf-8d61-e62702d88305 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:37.046219 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:37.046219 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:37.048452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c641cb-854f-4dcf-8d61-e62702d88305 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:37.154492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e2c641cb-854f-4dcf-8d61-e62702d88305 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invalidating the token cache because role 323306a06a2a45799a8611a8b9315e36 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:37.154645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e2c641cb-854f-4dcf-8d61-e62702d88305 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.156862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e2c641cb-854f-4dcf-8d61-e62702d88305 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.162472 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1958/3938] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:36 2022] DELETE /identity/v3/roles/323306a06a2a45799a8611a8b9315e36 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:37.167079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c14b01-35bf-4589-a5fd-297d6b4c328b tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:37.169435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e7c14b01-35bf-4589-a5fd-297d6b4c328b tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:37.191075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c14b01-35bf-4589-a5fd-297d6b4c328b tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:37.294531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e43c1-d869-4460-9e84-e938c7415d23 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:37.295303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e43c1-d869-4460-9e84-e938c7415d23 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:37.295646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e43c1-d869-4460-9e84-e938c7415d23 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:37.295918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e43c1-d869-4460-9e84-e938c7415d23 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/1de0b9ab060d4fd29a3245b164274a92` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:37.298020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e43c1-d869-4460-9e84-e938c7415d23 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1de0b9ab060d4fd29a3245b164274a92)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:37.300511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e43c1-d869-4460-9e84-e938c7415d23 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:37.330633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-313e43c1-d869-4460-9e84-e938c7415d23 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1de0b9ab060d4fd29a3245b164274a92'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.331219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-313e43c1-d869-4460-9e84-e938c7415d23 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1de0b9ab060d4fd29a3245b164274a92'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.360418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-313e43c1-d869-4460-9e84-e938c7415d23 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1de0b9ab060d4fd29a3245b164274a92'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.362738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-313e43c1-d869-4460-9e84-e938c7415d23 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1de0b9ab060d4fd29a3245b164274a92'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.365687 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1981/3939] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:37 2022] PATCH /identity/v3/domains/1de0b9ab060d4fd29a3245b164274a92 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:37.369839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c641cb-854f-4dcf-8d61-e62702d88305 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:37.381760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c641cb-854f-4dcf-8d61-e62702d88305 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:37.440570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:37.441220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:37.441505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:37.441785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/1de0b9ab060d4fd29a3245b164274a92` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:37.452624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1de0b9ab060d4fd29a3245b164274a92)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:37.454261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:37.478242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1de0b9ab060d4fd29a3245b164274a92'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.484250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:37.489458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1de0b9ab060d4fd29a3245b164274a92'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.534638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de0b9ab060d4fd29a3245b164274a92', 'request_id': 'req-e91c7101-35d9-438e-85b3-f55de9189719'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.541717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de0b9ab060d4fd29a3245b164274a92', 'request_id': 'req-e91c7101-35d9-438e-85b3-f55de9189719'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.548152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de0b9ab060d4fd29a3245b164274a92', 'request_id': 'req-e91c7101-35d9-438e-85b3-f55de9189719'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.565566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] The token cache is being invalidate because project 1de0b9ab060d4fd29a3245b164274a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:37.565865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.566544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.575850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1de0b9ab060d4fd29a3245b164274a92', 'request_id': 'req-e91c7101-35d9-438e-85b3-f55de9189719'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.579880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1de0b9ab060d4fd29a3245b164274a92', 'request_id': 'req-e91c7101-35d9-438e-85b3-f55de9189719'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.580601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1de0b9ab060d4fd29a3245b164274a92', 'request_id': 'req-e91c7101-35d9-438e-85b3-f55de9189719'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.587104 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1959/3940] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:33:37 2022] DELETE /identity/v3/domains/1de0b9ab060d4fd29a3245b164274a92 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:37.591004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e43c1-d869-4460-9e84-e938c7415d23 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:37.592472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-313e43c1-d869-4460-9e84-e938c7415d23 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:37.607846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e43c1-d869-4460-9e84-e938c7415d23 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:37.681534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fda4d8-5f61-4f32-9a3f-c3f9d01c56b2 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:37.682691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fda4d8-5f61-4f32-9a3f-c3f9d01c56b2 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:37.683355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fda4d8-5f61-4f32-9a3f-c3f9d01c56b2 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:37.684187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fda4d8-5f61-4f32-9a3f-c3f9d01c56b2 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/8b1bea71f9ae473cbd7bde4888e21b59/users/32eb7cf6566446d494b2d1939b20807a/roles/738ea52b92374bba8fbd35e52fe96476` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:37.686861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fda4d8-5f61-4f32-9a3f-c3f9d01c56b2 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8b1bea71f9ae473cbd7bde4888e21b59, user_id=32eb7cf6566446d494b2d1939b20807a, role_id=738ea52b92374bba8fbd35e52fe96476)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:37.690694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fda4d8-5f61-4f32-9a3f-c3f9d01c56b2 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:37.704734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50fda4d8-5f61-4f32-9a3f-c3f9d01c56b2 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invalidating the token cache because role 738ea52b92374bba8fbd35e52fe96476 was removed from user 32eb7cf6566446d494b2d1939b20807a on domain 8b1bea71f9ae473cbd7bde4888e21b59. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:37.705039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50fda4d8-5f61-4f32-9a3f-c3f9d01c56b2 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.705778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50fda4d8-5f61-4f32-9a3f-c3f9d01c56b2 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.725510 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1982/3941] 10.222.0.27 () {58 vars in 1464 bytes} [Sun Aug 28 18:33:37 2022] DELETE /identity/v3/domains/8b1bea71f9ae473cbd7bde4888e21b59/users/32eb7cf6566446d494b2d1939b20807a/roles/738ea52b92374bba8fbd35e52fe96476 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:37.729424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:37.730940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:37.746454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c7101-35d9-438e-85b3-f55de9189719 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:37.823241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406a061-7258-4861-a37c-89313828ee38 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:37.823981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406a061-7258-4861-a37c-89313828ee38 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:37.824656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406a061-7258-4861-a37c-89313828ee38 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:37.824957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406a061-7258-4861-a37c-89313828ee38 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/roles/738ea52b92374bba8fbd35e52fe96476` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:37.826378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406a061-7258-4861-a37c-89313828ee38 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:delete_role(role_id=738ea52b92374bba8fbd35e52fe96476)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:37.828061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406a061-7258-4861-a37c-89313828ee38 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:37.901495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c406a061-7258-4861-a37c-89313828ee38 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invalidating the token cache because role 738ea52b92374bba8fbd35e52fe96476 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:37.901909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c406a061-7258-4861-a37c-89313828ee38 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.902567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c406a061-7258-4861-a37c-89313828ee38 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:37.904803 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1960/3942] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:37 2022] DELETE /identity/v3/roles/738ea52b92374bba8fbd35e52fe96476 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:37.909562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fda4d8-5f61-4f32-9a3f-c3f9d01c56b2 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:37.912141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-50fda4d8-5f61-4f32-9a3f-c3f9d01c56b2 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:37.939828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fda4d8-5f61-4f32-9a3f-c3f9d01c56b2 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:38.085094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:38.116143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078c4c7-0fb9-4b6d-b0aa-9aaf4f06261d tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:38.117066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078c4c7-0fb9-4b6d-b0aa-9aaf4f06261d tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:38.117487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078c4c7-0fb9-4b6d-b0aa-9aaf4f06261d tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:38.118038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078c4c7-0fb9-4b6d-b0aa-9aaf4f06261d tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/8b1bea71f9ae473cbd7bde4888e21b59` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:38.119456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078c4c7-0fb9-4b6d-b0aa-9aaf4f06261d tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8b1bea71f9ae473cbd7bde4888e21b59)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:38.122641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078c4c7-0fb9-4b6d-b0aa-9aaf4f06261d tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:38.155870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b078c4c7-0fb9-4b6d-b0aa-9aaf4f06261d tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8b1bea71f9ae473cbd7bde4888e21b59'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:38.157718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b078c4c7-0fb9-4b6d-b0aa-9aaf4f06261d tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8b1bea71f9ae473cbd7bde4888e21b59'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:38.189703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b078c4c7-0fb9-4b6d-b0aa-9aaf4f06261d tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8b1bea71f9ae473cbd7bde4888e21b59'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:38.190873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b078c4c7-0fb9-4b6d-b0aa-9aaf4f06261d tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8b1bea71f9ae473cbd7bde4888e21b59'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:38.193530 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1983/3943] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:37 2022] PATCH /identity/v3/domains/8b1bea71f9ae473cbd7bde4888e21b59 => generated 277 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:38.197775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406a061-7258-4861-a37c-89313828ee38 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:38.199301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c406a061-7258-4861-a37c-89313828ee38 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:38.211983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406a061-7258-4861-a37c-89313828ee38 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:38.249851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:38.283600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:38.284415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:38.284703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:38.284986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/8b1bea71f9ae473cbd7bde4888e21b59` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:38.301449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8b1bea71f9ae473cbd7bde4888e21b59)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:38.303492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:38.330186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8b1bea71f9ae473cbd7bde4888e21b59'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:38.345677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8b1bea71f9ae473cbd7bde4888e21b59'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:38.412609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1bea71f9ae473cbd7bde4888e21b59', 'request_id': 'req-fcac86a8-bfab-44f5-89dd-aacd3142f250'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:38.424957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1bea71f9ae473cbd7bde4888e21b59', 'request_id': 'req-fcac86a8-bfab-44f5-89dd-aacd3142f250'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:38.435147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1bea71f9ae473cbd7bde4888e21b59', 'request_id': 'req-fcac86a8-bfab-44f5-89dd-aacd3142f250'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:38.450869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] The token cache is being invalidate because project 8b1bea71f9ae473cbd7bde4888e21b59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:38.451281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:38.452188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:38.463575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8b1bea71f9ae473cbd7bde4888e21b59', 'request_id': 'req-fcac86a8-bfab-44f5-89dd-aacd3142f250'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:38.469066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8b1bea71f9ae473cbd7bde4888e21b59', 'request_id': 'req-fcac86a8-bfab-44f5-89dd-aacd3142f250'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:38.469573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8b1bea71f9ae473cbd7bde4888e21b59', 'request_id': 'req-fcac86a8-bfab-44f5-89dd-aacd3142f250'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:38.480227 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1961/3944] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:33:38 2022] DELETE /identity/v3/domains/8b1bea71f9ae473cbd7bde4888e21b59 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:38.484304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078c4c7-0fb9-4b6d-b0aa-9aaf4f06261d tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:38.485787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b078c4c7-0fb9-4b6d-b0aa-9aaf4f06261d tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:38.499669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078c4c7-0fb9-4b6d-b0aa-9aaf4f06261d tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:38.603943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820e8dc-e1c6-4db2-bb2a-805d7a96e6ab tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:38.605162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820e8dc-e1c6-4db2-bb2a-805d7a96e6ab tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:38.605656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820e8dc-e1c6-4db2-bb2a-805d7a96e6ab tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:38.606205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820e8dc-e1c6-4db2-bb2a-805d7a96e6ab tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/9fb71a91b173468f9ec3077aa09e1ec1/groups/ca5e3640c2f24a68a45f16ca93d78406/roles/5a454fa212df4baa800ac18dbc3e78c2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:38.608889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820e8dc-e1c6-4db2-bb2a-805d7a96e6ab tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9fb71a91b173468f9ec3077aa09e1ec1, group_id=ca5e3640c2f24a68a45f16ca93d78406, role_id=5a454fa212df4baa800ac18dbc3e78c2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:38.612139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820e8dc-e1c6-4db2-bb2a-805d7a96e6ab tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:38.618254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7820e8dc-e1c6-4db2-bb2a-805d7a96e6ab tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invalidating the token cache because role 5a454fa212df4baa800ac18dbc3e78c2 was removed from group ca5e3640c2f24a68a45f16ca93d78406 on domain 9fb71a91b173468f9ec3077aa09e1ec1. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:38.618887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7820e8dc-e1c6-4db2-bb2a-805d7a96e6ab tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:38.619323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7820e8dc-e1c6-4db2-bb2a-805d7a96e6ab tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:38.662002 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1984/3945] 10.222.0.27 () {58 vars in 1467 bytes} [Sun Aug 28 18:33:38 2022] DELETE /identity/v3/domains/9fb71a91b173468f9ec3077aa09e1ec1/groups/ca5e3640c2f24a68a45f16ca93d78406/roles/5a454fa212df4baa800ac18dbc3e78c2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:38.666106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:38.668031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:38.691167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac86a8-bfab-44f5-89dd-aacd3142f250 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:38.788200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63778f-4322-4a42-9a64-7a8c4d5cf3d5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:38.790913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63778f-4322-4a42-9a64-7a8c4d5cf3d5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:38.791211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63778f-4322-4a42-9a64-7a8c4d5cf3d5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:38.791527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63778f-4322-4a42-9a64-7a8c4d5cf3d5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/groups/ca5e3640c2f24a68a45f16ca93d78406/users/32eb7cf6566446d494b2d1939b20807a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:38.796393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63778f-4322-4a42-9a64-7a8c4d5cf3d5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=ca5e3640c2f24a68a45f16ca93d78406, user_id=32eb7cf6566446d494b2d1939b20807a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:38.798415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63778f-4322-4a42-9a64-7a8c4d5cf3d5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:38.809343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6d63778f-4322-4a42-9a64-7a8c4d5cf3d5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '32eb7cf6566446d494b2d1939b20807a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:38.823495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:38.830607 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1962/3946] 10.222.0.27 () {58 vars in 1344 bytes} [Sun Aug 28 18:33:38 2022] DELETE /identity/v3/groups/ca5e3640c2f24a68a45f16ca93d78406/users/32eb7cf6566446d494b2d1939b20807a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:38.835462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820e8dc-e1c6-4db2-bb2a-805d7a96e6ab tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:38.840313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7820e8dc-e1c6-4db2-bb2a-805d7a96e6ab tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:38.862282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820e8dc-e1c6-4db2-bb2a-805d7a96e6ab tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:38.968489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b96e5-d7cb-467f-bd37-ce65b885bb25 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:38.969928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b96e5-d7cb-467f-bd37-ce65b885bb25 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:38.970519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b96e5-d7cb-467f-bd37-ce65b885bb25 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:38.971011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b96e5-d7cb-467f-bd37-ce65b885bb25 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/groups/ca5e3640c2f24a68a45f16ca93d78406` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:38.972771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b96e5-d7cb-467f-bd37-ce65b885bb25 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ca5e3640c2f24a68a45f16ca93d78406)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:38.976041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b96e5-d7cb-467f-bd37-ce65b885bb25 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:39.042629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:39.055067 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1985/3947] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:33:38 2022] DELETE /identity/v3/groups/ca5e3640c2f24a68a45f16ca93d78406 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:39.060150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63778f-4322-4a42-9a64-7a8c4d5cf3d5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:39.075831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63778f-4322-4a42-9a64-7a8c4d5cf3d5 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:39.191413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2501210-3120-44fd-b67d-f26288294a59 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:39.192106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2501210-3120-44fd-b67d-f26288294a59 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:39.192364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2501210-3120-44fd-b67d-f26288294a59 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:39.192642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2501210-3120-44fd-b67d-f26288294a59 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/roles/5a454fa212df4baa800ac18dbc3e78c2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:39.196229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2501210-3120-44fd-b67d-f26288294a59 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5a454fa212df4baa800ac18dbc3e78c2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:39.198501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2501210-3120-44fd-b67d-f26288294a59 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:39.297752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d2501210-3120-44fd-b67d-f26288294a59 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invalidating the token cache because role 5a454fa212df4baa800ac18dbc3e78c2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:39.298014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d2501210-3120-44fd-b67d-f26288294a59 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:39.298666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d2501210-3120-44fd-b67d-f26288294a59 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:39.305448 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1963/3948] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:39 2022] DELETE /identity/v3/roles/5a454fa212df4baa800ac18dbc3e78c2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:39.307339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b96e5-d7cb-467f-bd37-ce65b885bb25 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:39.311963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e6b96e5-d7cb-467f-bd37-ce65b885bb25 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:39.352305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b96e5-d7cb-467f-bd37-ce65b885bb25 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:39.486196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c515c5-2e96-492d-a726-af7eff362546 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:39.487386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c515c5-2e96-492d-a726-af7eff362546 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:39.487761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c515c5-2e96-492d-a726-af7eff362546 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:39.488041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c515c5-2e96-492d-a726-af7eff362546 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/9fb71a91b173468f9ec3077aa09e1ec1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:39.490290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c515c5-2e96-492d-a726-af7eff362546 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9fb71a91b173468f9ec3077aa09e1ec1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:39.493266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c515c5-2e96-492d-a726-af7eff362546 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:39.565634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-26c515c5-2e96-492d-a726-af7eff362546 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9fb71a91b173468f9ec3077aa09e1ec1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:39.566383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-26c515c5-2e96-492d-a726-af7eff362546 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9fb71a91b173468f9ec3077aa09e1ec1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:39.616203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-26c515c5-2e96-492d-a726-af7eff362546 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9fb71a91b173468f9ec3077aa09e1ec1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:39.616859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-26c515c5-2e96-492d-a726-af7eff362546 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9fb71a91b173468f9ec3077aa09e1ec1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:39.623564 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1986/3949] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:39 2022] PATCH /identity/v3/domains/9fb71a91b173468f9ec3077aa09e1ec1 => generated 277 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:39.624755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2501210-3120-44fd-b67d-f26288294a59 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:39.642140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2501210-3120-44fd-b67d-f26288294a59 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:39.749915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:39.750577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:39.750862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:39.751139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/9fb71a91b173468f9ec3077aa09e1ec1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:39.766609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9fb71a91b173468f9ec3077aa09e1ec1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:39.768348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:39.807087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9fb71a91b173468f9ec3077aa09e1ec1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:39.809465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9fb71a91b173468f9ec3077aa09e1ec1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:39.861375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:39.876137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb71a91b173468f9ec3077aa09e1ec1', 'request_id': 'req-a92b0f2f-a426-4832-86e5-9a227ef6c317'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:39.886381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb71a91b173468f9ec3077aa09e1ec1', 'request_id': 'req-a92b0f2f-a426-4832-86e5-9a227ef6c317'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:39.894587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb71a91b173468f9ec3077aa09e1ec1', 'request_id': 'req-a92b0f2f-a426-4832-86e5-9a227ef6c317'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:39.913088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] The token cache is being invalidate because project 9fb71a91b173468f9ec3077aa09e1ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:39.914403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:39.915527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:39.925147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9fb71a91b173468f9ec3077aa09e1ec1', 'request_id': 'req-a92b0f2f-a426-4832-86e5-9a227ef6c317'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:39.931281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9fb71a91b173468f9ec3077aa09e1ec1', 'request_id': 'req-a92b0f2f-a426-4832-86e5-9a227ef6c317'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:39.932494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9fb71a91b173468f9ec3077aa09e1ec1', 'request_id': 'req-a92b0f2f-a426-4832-86e5-9a227ef6c317'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:39.940081 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1964/3950] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:33:39 2022] DELETE /identity/v3/domains/9fb71a91b173468f9ec3077aa09e1ec1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:39.944864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c515c5-2e96-492d-a726-af7eff362546 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:39.946273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-26c515c5-2e96-492d-a726-af7eff362546 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:39.968983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c515c5-2e96-492d-a726-af7eff362546 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:40.041401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24242925-beff-47b3-a417-857652417900 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:40.042221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24242925-beff-47b3-a417-857652417900 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:40.042580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24242925-beff-47b3-a417-857652417900 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:40.042929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24242925-beff-47b3-a417-857652417900 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/c43d3509e02242e2a00c83e0d45e32d1/users/32eb7cf6566446d494b2d1939b20807a/roles/58a793fcba524a23918d8f9725630dd5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:40.045276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24242925-beff-47b3-a417-857652417900 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=c43d3509e02242e2a00c83e0d45e32d1, user_id=32eb7cf6566446d494b2d1939b20807a, role_id=58a793fcba524a23918d8f9725630dd5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:40.048250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24242925-beff-47b3-a417-857652417900 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:40.054034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24242925-beff-47b3-a417-857652417900 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invalidating the token cache because role 58a793fcba524a23918d8f9725630dd5 was removed from user 32eb7cf6566446d494b2d1939b20807a on domain c43d3509e02242e2a00c83e0d45e32d1. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:40.054538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24242925-beff-47b3-a417-857652417900 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.055099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24242925-beff-47b3-a417-857652417900 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.076887 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1987/3951] 10.222.0.27 () {58 vars in 1464 bytes} [Sun Aug 28 18:33:39 2022] DELETE /identity/v3/domains/c43d3509e02242e2a00c83e0d45e32d1/users/32eb7cf6566446d494b2d1939b20807a/roles/58a793fcba524a23918d8f9725630dd5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:40.078210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:40.079891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:40.093330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b0f2f-a426-4832-86e5-9a227ef6c317 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:40.170345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a03fb-ace8-401e-9a2d-6dcb83fc0467 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:40.171616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a03fb-ace8-401e-9a2d-6dcb83fc0467 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:40.172239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a03fb-ace8-401e-9a2d-6dcb83fc0467 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:40.183628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a03fb-ace8-401e-9a2d-6dcb83fc0467 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/roles/58a793fcba524a23918d8f9725630dd5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:40.186850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a03fb-ace8-401e-9a2d-6dcb83fc0467 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:delete_role(role_id=58a793fcba524a23918d8f9725630dd5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:40.190060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a03fb-ace8-401e-9a2d-6dcb83fc0467 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:40.248971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-209a03fb-ace8-401e-9a2d-6dcb83fc0467 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invalidating the token cache because role 58a793fcba524a23918d8f9725630dd5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:40.249409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-209a03fb-ace8-401e-9a2d-6dcb83fc0467 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.250267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-209a03fb-ace8-401e-9a2d-6dcb83fc0467 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.253561 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1965/3952] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:40 2022] DELETE /identity/v3/roles/58a793fcba524a23918d8f9725630dd5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:40.258206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24242925-beff-47b3-a417-857652417900 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:40.259777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24242925-beff-47b3-a417-857652417900 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:40.274563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24242925-beff-47b3-a417-857652417900 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:40.339548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:40.352012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6859b-e0d2-48a3-8b6c-6c6d441b7284 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:40.352672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6859b-e0d2-48a3-8b6c-6c6d441b7284 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:40.352947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6859b-e0d2-48a3-8b6c-6c6d441b7284 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:40.353231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6859b-e0d2-48a3-8b6c-6c6d441b7284 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/c43d3509e02242e2a00c83e0d45e32d1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:40.355037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6859b-e0d2-48a3-8b6c-6c6d441b7284 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c43d3509e02242e2a00c83e0d45e32d1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:40.357315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6859b-e0d2-48a3-8b6c-6c6d441b7284 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:40.383217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09a6859b-e0d2-48a3-8b6c-6c6d441b7284 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c43d3509e02242e2a00c83e0d45e32d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.384278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09a6859b-e0d2-48a3-8b6c-6c6d441b7284 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c43d3509e02242e2a00c83e0d45e32d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.414476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09a6859b-e0d2-48a3-8b6c-6c6d441b7284 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c43d3509e02242e2a00c83e0d45e32d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.415513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09a6859b-e0d2-48a3-8b6c-6c6d441b7284 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c43d3509e02242e2a00c83e0d45e32d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.418472 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1988/3953] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:40 2022] PATCH /identity/v3/domains/c43d3509e02242e2a00c83e0d45e32d1 => generated 278 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:40.422314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a03fb-ace8-401e-9a2d-6dcb83fc0467 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:40.423872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-209a03fb-ace8-401e-9a2d-6dcb83fc0467 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:40.438044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a03fb-ace8-401e-9a2d-6dcb83fc0467 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:40.527248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:40.528205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:40.528470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:40.528765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/c43d3509e02242e2a00c83e0d45e32d1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:40.543930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c43d3509e02242e2a00c83e0d45e32d1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:40.545782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:40.548771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:40.606972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c43d3509e02242e2a00c83e0d45e32d1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.623015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c43d3509e02242e2a00c83e0d45e32d1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.675974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43d3509e02242e2a00c83e0d45e32d1', 'request_id': 'req-a8fc4f2b-6937-4e8a-bade-136355331912'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.686223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43d3509e02242e2a00c83e0d45e32d1', 'request_id': 'req-a8fc4f2b-6937-4e8a-bade-136355331912'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.699827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43d3509e02242e2a00c83e0d45e32d1', 'request_id': 'req-a8fc4f2b-6937-4e8a-bade-136355331912'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.718401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] The token cache is being invalidate because project c43d3509e02242e2a00c83e0d45e32d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:40.718735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.719476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.728551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c43d3509e02242e2a00c83e0d45e32d1', 'request_id': 'req-a8fc4f2b-6937-4e8a-bade-136355331912'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.732971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c43d3509e02242e2a00c83e0d45e32d1', 'request_id': 'req-a8fc4f2b-6937-4e8a-bade-136355331912'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.733739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c43d3509e02242e2a00c83e0d45e32d1', 'request_id': 'req-a8fc4f2b-6937-4e8a-bade-136355331912'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:40.743625 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1966/3954] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:33:40 2022] DELETE /identity/v3/domains/c43d3509e02242e2a00c83e0d45e32d1 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:40.746233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6859b-e0d2-48a3-8b6c-6c6d441b7284 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:40.748272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09a6859b-e0d2-48a3-8b6c-6c6d441b7284 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:40.765036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6859b-e0d2-48a3-8b6c-6c6d441b7284 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:40.847001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217d50e-b4b7-4990-9bdf-209523c00e9f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:40.847586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217d50e-b4b7-4990-9bdf-209523c00e9f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:40.847870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217d50e-b4b7-4990-9bdf-209523c00e9f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:40.848144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217d50e-b4b7-4990-9bdf-209523c00e9f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:40.848793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217d50e-b4b7-4990-9bdf-209523c00e9f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:40.850825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217d50e-b4b7-4990-9bdf-209523c00e9f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:40.862121 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1989/3955] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:40.866075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:40.867581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:40.880386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc4f2b-6937-4e8a-bade-136355331912 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:40.885149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd3143-b1f8-4e7a-a209-26b0125efc2a tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:40.885884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd3143-b1f8-4e7a-a209-26b0125efc2a tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:40.886170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd3143-b1f8-4e7a-a209-26b0125efc2a tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:40.886449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd3143-b1f8-4e7a-a209-26b0125efc2a tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/projects/6670b64e77bb4b39a0196d67ba36656a/users/e3709b9636544a3fbcfe095185f9570f/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:40.889020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd3143-b1f8-4e7a-a209-26b0125efc2a tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6670b64e77bb4b39a0196d67ba36656a, user_id=e3709b9636544a3fbcfe095185f9570f, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:40.892377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd3143-b1f8-4e7a-a209-26b0125efc2a tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:40.909490 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1967/3956] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:40 2022] PUT /identity/v3/projects/6670b64e77bb4b39a0196d67ba36656a/users/e3709b9636544a3fbcfe095185f9570f/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:40.913618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217d50e-b4b7-4990-9bdf-209523c00e9f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:40.924419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217d50e-b4b7-4990-9bdf-209523c00e9f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:40.993595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe9173-b245-4766-aea1-5036cdf3369c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:40.994217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe9173-b245-4766-aea1-5036cdf3369c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:40.994497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe9173-b245-4766-aea1-5036cdf3369c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:40.994772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe9173-b245-4766-aea1-5036cdf3369c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:40.995437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe9173-b245-4766-aea1-5036cdf3369c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:40.996530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe9173-b245-4766-aea1-5036cdf3369c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:41.046541 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1990/3957] 10.222.0.27 () {58 vars in 1146 bytes} [Sun Aug 28 18:33:40 2022] GET /identity/v3/auth/projects => generated 828 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:41.051183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd3143-b1f8-4e7a-a209-26b0125efc2a tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:41.065471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd3143-b1f8-4e7a-a209-26b0125efc2a tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:41.072288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f3e4b-d0f4-4212-bc88-e5f4d20d0dae tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:41.073086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f3e4b-d0f4-4212-bc88-e5f4d20d0dae tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:41.073433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f3e4b-d0f4-4212-bc88-e5f4d20d0dae tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:41.073784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f3e4b-d0f4-4212-bc88-e5f4d20d0dae tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/projects/6670b64e77bb4b39a0196d67ba36656a/users/e3709b9636544a3fbcfe095185f9570f/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:41.076240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f3e4b-d0f4-4212-bc88-e5f4d20d0dae tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6670b64e77bb4b39a0196d67ba36656a, user_id=e3709b9636544a3fbcfe095185f9570f, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:41.077339 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-986f3e4b-d0f4-4212-bc88-e5f4d20d0dae tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:41.077339 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:33:41.077339 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:33:41.080020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f3e4b-d0f4-4212-bc88-e5f4d20d0dae tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:41.088073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-986f3e4b-d0f4-4212-bc88-e5f4d20d0dae tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invalidating the token cache because role 57de4e6fb8c54c94bbcb10d57ae795e1 was removed from user e3709b9636544a3fbcfe095185f9570f on project 6670b64e77bb4b39a0196d67ba36656a. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:41.088445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-986f3e4b-d0f4-4212-bc88-e5f4d20d0dae tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:41.089520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-986f3e4b-d0f4-4212-bc88-e5f4d20d0dae tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:41.105946 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1968/3958] 10.222.0.27 () {58 vars in 1467 bytes} [Sun Aug 28 18:33:41 2022] DELETE /identity/v3/projects/6670b64e77bb4b39a0196d67ba36656a/users/e3709b9636544a3fbcfe095185f9570f/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:41.111475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe9173-b245-4766-aea1-5036cdf3369c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:41.113273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1cbe9173-b245-4766-aea1-5036cdf3369c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:41.126097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe9173-b245-4766-aea1-5036cdf3369c tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:41.135848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:41.186824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cc8ec-915c-413a-a843-a983c83d8c89 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:41.187472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cc8ec-915c-413a-a843-a983c83d8c89 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:41.187756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cc8ec-915c-413a-a843-a983c83d8c89 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:41.188032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cc8ec-915c-413a-a843-a983c83d8c89 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:41.188672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8cc8ec-915c-413a-a843-a983c83d8c89 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:41.190654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8cc8ec-915c-413a-a843-a983c83d8c89 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:41.214330 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1991/3959] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:41 2022] POST /identity/v3/users => generated 323 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:41.218627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f3e4b-d0f4-4212-bc88-e5f4d20d0dae tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:41.230149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f3e4b-d0f4-4212-bc88-e5f4d20d0dae tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:41.236228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb3830-e005-40e1-8c8f-c76cac7dcc41 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:41.236849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb3830-e005-40e1-8c8f-c76cac7dcc41 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:41.237132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb3830-e005-40e1-8c8f-c76cac7dcc41 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:41.237403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb3830-e005-40e1-8c8f-c76cac7dcc41 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:41.238047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb3830-e005-40e1-8c8f-c76cac7dcc41 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:41.240061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb3830-e005-40e1-8c8f-c76cac7dcc41 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:41.272668 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1969/3960] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:41 2022] POST /identity/v3/projects => generated 362 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:41.276832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cc8ec-915c-413a-a843-a983c83d8c89 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:41.288330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cc8ec-915c-413a-a843-a983c83d8c89 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:41.348497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb2815-505c-4a54-b86e-0377f063e7df tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:41.349158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb2815-505c-4a54-b86e-0377f063e7df tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:41.349384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb2815-505c-4a54-b86e-0377f063e7df tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:41.349993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb2815-505c-4a54-b86e-0377f063e7df tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:41.350631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb2815-505c-4a54-b86e-0377f063e7df tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:41.352604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb2815-505c-4a54-b86e-0377f063e7df tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:41.379661 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1992/3961] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:41 2022] POST /identity/v3/projects => generated 364 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:41.383837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb3830-e005-40e1-8c8f-c76cac7dcc41 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:41.394694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb3830-e005-40e1-8c8f-c76cac7dcc41 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:41.445561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:41.456560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88414580-7155-4144-a5a5-5d83598107fd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:41.457460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88414580-7155-4144-a5a5-5d83598107fd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:41.457739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88414580-7155-4144-a5a5-5d83598107fd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:41.458018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88414580-7155-4144-a5a5-5d83598107fd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:41.458985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88414580-7155-4144-a5a5-5d83598107fd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:41.461116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88414580-7155-4144-a5a5-5d83598107fd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:41.477437 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1970/3962] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:33:41 2022] POST /identity/v3/roles => generated 240 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:41.481856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb2815-505c-4a54-b86e-0377f063e7df tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:41.492695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb2815-505c-4a54-b86e-0377f063e7df tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:41.497784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4541b3b-5e65-4778-ba38-92f3082d8879 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:41.498441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541b3b-5e65-4778-ba38-92f3082d8879 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:41.498718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541b3b-5e65-4778-ba38-92f3082d8879 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:41.498987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541b3b-5e65-4778-ba38-92f3082d8879 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/projects/b76ea03423a94aba9edd4e325e1d6210/users/4a104a6b9a6946ca98b77664ba57869f/roles/5bbac2817e0f4125867de1871e9706b4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:41.514036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4541b3b-5e65-4778-ba38-92f3082d8879 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b76ea03423a94aba9edd4e325e1d6210, user_id=4a104a6b9a6946ca98b77664ba57869f, role_id=5bbac2817e0f4125867de1871e9706b4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:41.516742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4541b3b-5e65-4778-ba38-92f3082d8879 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:41.530762 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1993/3963] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:41 2022] PUT /identity/v3/projects/b76ea03423a94aba9edd4e325e1d6210/users/4a104a6b9a6946ca98b77664ba57869f/roles/5bbac2817e0f4125867de1871e9706b4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:41.534771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88414580-7155-4144-a5a5-5d83598107fd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:41.545354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88414580-7155-4144-a5a5-5d83598107fd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:41.612236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cbc02-d791-4360-8fba-8d57720e9c88 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:41.612902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cbc02-d791-4360-8fba-8d57720e9c88 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:41.613186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cbc02-d791-4360-8fba-8d57720e9c88 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:41.613511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cbc02-d791-4360-8fba-8d57720e9c88 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/projects/6d164c35d4564d289b197d427be3fbb3/users/4a104a6b9a6946ca98b77664ba57869f/roles/5bbac2817e0f4125867de1871e9706b4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:41.615708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cbc02-d791-4360-8fba-8d57720e9c88 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6d164c35d4564d289b197d427be3fbb3, user_id=4a104a6b9a6946ca98b77664ba57869f, role_id=5bbac2817e0f4125867de1871e9706b4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:41.618335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cbc02-d791-4360-8fba-8d57720e9c88 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:41.632636 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1971/3964] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:41 2022] PUT /identity/v3/projects/6d164c35d4564d289b197d427be3fbb3/users/4a104a6b9a6946ca98b77664ba57869f/roles/5bbac2817e0f4125867de1871e9706b4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:41.637050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b84d3d-3829-4c8d-ba5b-e2f72dc09a9d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:41.637332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b84d3d-3829-4c8d-ba5b-e2f72dc09a9d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:41.637605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b84d3d-3829-4c8d-ba5b-e2f72dc09a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:41.666107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-79b84d3d-3829-4c8d-ba5b-e2f72dc09a9d None None] MFA Rules not processed for user `4a104a6b9a6946ca98b77664ba57869f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:41.667462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79b84d3d-3829-4c8d-ba5b-e2f72dc09a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:41.671703 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1994/3965] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:41 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:33:41.676270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a179a-ad5d-40a0-adb7-6b5bf1e39754 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:41.676736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a179a-ad5d-40a0-adb7-6b5bf1e39754 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:41.676834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a179a-ad5d-40a0-adb7-6b5bf1e39754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:41.688500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9f7a179a-ad5d-40a0-adb7-6b5bf1e39754 None None] MFA Rules not processed for user `4a104a6b9a6946ca98b77664ba57869f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:41.689644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9f7a179a-ad5d-40a0-adb7-6b5bf1e39754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:41.753433 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1972/3966] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:41 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 28 18:33:41.757899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b84d3d-3829-4c8d-ba5b-e2f72dc09a9d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:41.820270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:41.837693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b84d3d-3829-4c8d-ba5b-e2f72dc09a9d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:41.842868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99dd0-5c6e-4437-b8a1-b47f50273109 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:41.843641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99dd0-5c6e-4437-b8a1-b47f50273109 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:41.843985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99dd0-5c6e-4437-b8a1-b47f50273109 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:41.844332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99dd0-5c6e-4437-b8a1-b47f50273109 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:41.860948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a99dd0-5c6e-4437-b8a1-b47f50273109 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:41.863092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a99dd0-5c6e-4437-b8a1-b47f50273109 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:41.881162 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1995/3967] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Aug 28 18:33:41 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:41.885691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99e5e2-537c-4fc3-90ec-636d50d59d0f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:41.885900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99e5e2-537c-4fc3-90ec-636d50d59d0f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:41.886173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99e5e2-537c-4fc3-90ec-636d50d59d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:41.897959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9f99e5e2-537c-4fc3-90ec-636d50d59d0f None None] MFA Rules not processed for user `4a104a6b9a6946ca98b77664ba57869f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:41.899194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9f99e5e2-537c-4fc3-90ec-636d50d59d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:41.985615 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1973/3968] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:41 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 28 18:33:41.990150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99dd0-5c6e-4437-b8a1-b47f50273109 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:42.001607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99dd0-5c6e-4437-b8a1-b47f50273109 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:42.006333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca6e15-afb8-4c50-8f64-729cfe80827f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:42.007298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca6e15-afb8-4c50-8f64-729cfe80827f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:42.007298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca6e15-afb8-4c50-8f64-729cfe80827f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:42.007608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca6e15-afb8-4c50-8f64-729cfe80827f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/roles/5bbac2817e0f4125867de1871e9706b4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:42.008975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca6e15-afb8-4c50-8f64-729cfe80827f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5bbac2817e0f4125867de1871e9706b4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:42.010019 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-46ca6e15-afb8-4c50-8f64-729cfe80827f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:33:42.010019 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:33:42.010019 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:33:42.010877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca6e15-afb8-4c50-8f64-729cfe80827f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:42.070225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-46ca6e15-afb8-4c50-8f64-729cfe80827f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invalidating the token cache because role 5bbac2817e0f4125867de1871e9706b4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:42.070521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-46ca6e15-afb8-4c50-8f64-729cfe80827f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:42.071193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-46ca6e15-afb8-4c50-8f64-729cfe80827f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:42.073438 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1996/3969] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:41 2022] DELETE /identity/v3/roles/5bbac2817e0f4125867de1871e9706b4 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:42.077498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99e5e2-537c-4fc3-90ec-636d50d59d0f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:42.091189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99e5e2-537c-4fc3-90ec-636d50d59d0f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:42.123530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:42.174060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16715fd2-51d4-451a-a883-506463229ed9 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:42.174746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16715fd2-51d4-451a-a883-506463229ed9 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:42.175102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16715fd2-51d4-451a-a883-506463229ed9 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:42.175486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16715fd2-51d4-451a-a883-506463229ed9 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/projects/6d164c35d4564d289b197d427be3fbb3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:42.176731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16715fd2-51d4-451a-a883-506463229ed9 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d164c35d4564d289b197d427be3fbb3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:42.178854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16715fd2-51d4-451a-a883-506463229ed9 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:42.231280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16715fd2-51d4-451a-a883-506463229ed9 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d164c35d4564d289b197d427be3fbb3', 'request_id': 'req-16715fd2-51d4-451a-a883-506463229ed9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:42.237798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16715fd2-51d4-451a-a883-506463229ed9 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d164c35d4564d289b197d427be3fbb3', 'request_id': 'req-16715fd2-51d4-451a-a883-506463229ed9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:42.244228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16715fd2-51d4-451a-a883-506463229ed9 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d164c35d4564d289b197d427be3fbb3', 'request_id': 'req-16715fd2-51d4-451a-a883-506463229ed9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:42.257844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16715fd2-51d4-451a-a883-506463229ed9 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] The token cache is being invalidate because project 6d164c35d4564d289b197d427be3fbb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:42.258164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16715fd2-51d4-451a-a883-506463229ed9 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:42.259505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16715fd2-51d4-451a-a883-506463229ed9 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:42.261388 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1974/3970] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:42 2022] DELETE /identity/v3/projects/6d164c35d4564d289b197d427be3fbb3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:42.265251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca6e15-afb8-4c50-8f64-729cfe80827f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:42.266793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-46ca6e15-afb8-4c50-8f64-729cfe80827f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:42.280332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca6e15-afb8-4c50-8f64-729cfe80827f tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:42.337595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe547a-a02f-440a-a814-093d632ed378 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:42.338240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe547a-a02f-440a-a814-093d632ed378 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:42.338520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe547a-a02f-440a-a814-093d632ed378 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:42.338800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe547a-a02f-440a-a814-093d632ed378 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/projects/6d164c35d4564d289b197d427be3fbb3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:42.346164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe547a-a02f-440a-a814-093d632ed378 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d164c35d4564d289b197d427be3fbb3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:42.348196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe547a-a02f-440a-a814-093d632ed378 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:42.359814 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-22fe547a-a02f-440a-a814-093d632ed378 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Could not find project: 6d164c35d4564d289b197d427be3fbb3.: keystone.exception.ProjectNotFound: Could not find project: 6d164c35d4564d289b197d427be3fbb3. Aug 28 18:33:42.359814 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:42.359814 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:42.359814 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:42.359814 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:42.359814 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:42.359814 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:42.359814 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:42.359814 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:42.359814 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:42.359814 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:42.359814 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:42.359814 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 28 18:33:42.359814 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 28 18:33:42.361400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:42.361400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:42.361400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 28 18:33:42.361400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 28 18:33:42.361400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:33:42.361400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:33:42.361400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:33:42.361400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:33:42.361400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6d164c35d4564d289b197d427be3fbb3. Aug 28 18:33:42.361400 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:42.361400 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1997/3971] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:42 2022] DELETE /identity/v3/projects/6d164c35d4564d289b197d427be3fbb3 => generated 113 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 18:33:42.365613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16715fd2-51d4-451a-a883-506463229ed9 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:42.367117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-16715fd2-51d4-451a-a883-506463229ed9 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:42.380265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16715fd2-51d4-451a-a883-506463229ed9 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:42.385547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc7267-0998-4edb-a8e9-47fb4f2a4624 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:42.386234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7267-0998-4edb-a8e9-47fb4f2a4624 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:42.386510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7267-0998-4edb-a8e9-47fb4f2a4624 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:42.386804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7267-0998-4edb-a8e9-47fb4f2a4624 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/projects/b76ea03423a94aba9edd4e325e1d6210` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:42.387965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc7267-0998-4edb-a8e9-47fb4f2a4624 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b76ea03423a94aba9edd4e325e1d6210)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:42.389847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc7267-0998-4edb-a8e9-47fb4f2a4624 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:42.440596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-01dc7267-0998-4edb-a8e9-47fb4f2a4624 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76ea03423a94aba9edd4e325e1d6210', 'request_id': 'req-01dc7267-0998-4edb-a8e9-47fb4f2a4624'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:42.446922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-01dc7267-0998-4edb-a8e9-47fb4f2a4624 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76ea03423a94aba9edd4e325e1d6210', 'request_id': 'req-01dc7267-0998-4edb-a8e9-47fb4f2a4624'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:42.453024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-01dc7267-0998-4edb-a8e9-47fb4f2a4624 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76ea03423a94aba9edd4e325e1d6210', 'request_id': 'req-01dc7267-0998-4edb-a8e9-47fb4f2a4624'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:42.469927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-01dc7267-0998-4edb-a8e9-47fb4f2a4624 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] The token cache is being invalidate because project b76ea03423a94aba9edd4e325e1d6210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:42.470276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-01dc7267-0998-4edb-a8e9-47fb4f2a4624 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:42.471009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-01dc7267-0998-4edb-a8e9-47fb4f2a4624 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:42.477358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe547a-a02f-440a-a814-093d632ed378 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:42.477685 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1975/3972] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:42 2022] DELETE /identity/v3/projects/b76ea03423a94aba9edd4e325e1d6210 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:42.479290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-22fe547a-a02f-440a-a814-093d632ed378 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:42.494180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe547a-a02f-440a-a814-093d632ed378 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:42.581215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32124c73-0ca8-4bbb-9fff-1e723e4278bd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:42.614917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32124c73-0ca8-4bbb-9fff-1e723e4278bd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:42.614917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32124c73-0ca8-4bbb-9fff-1e723e4278bd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:42.614917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32124c73-0ca8-4bbb-9fff-1e723e4278bd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/users/4a104a6b9a6946ca98b77664ba57869f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:42.614917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32124c73-0ca8-4bbb-9fff-1e723e4278bd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4a104a6b9a6946ca98b77664ba57869f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:42.614917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32124c73-0ca8-4bbb-9fff-1e723e4278bd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:42.650405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:42.674982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32124c73-0ca8-4bbb-9fff-1e723e4278bd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a104a6b9a6946ca98b77664ba57869f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:42.675777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32124c73-0ca8-4bbb-9fff-1e723e4278bd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a104a6b9a6946ca98b77664ba57869f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:42.687128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32124c73-0ca8-4bbb-9fff-1e723e4278bd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a104a6b9a6946ca98b77664ba57869f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:42.703515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32124c73-0ca8-4bbb-9fff-1e723e4278bd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a104a6b9a6946ca98b77664ba57869f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:42.723938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32124c73-0ca8-4bbb-9fff-1e723e4278bd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a104a6b9a6946ca98b77664ba57869f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:42.739211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc7267-0998-4edb-a8e9-47fb4f2a4624 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:42.741019 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1998/3973] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:42 2022] DELETE /identity/v3/users/4a104a6b9a6946ca98b77664ba57869f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:42.751063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc7267-0998-4edb-a8e9-47fb4f2a4624 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:42.803429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:42.839205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a21ec-1c8f-404b-8d8b-ede41e616c4e tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:42.840962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a21ec-1c8f-404b-8d8b-ede41e616c4e tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:42.841869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a21ec-1c8f-404b-8d8b-ede41e616c4e tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:42.842401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a21ec-1c8f-404b-8d8b-ede41e616c4e tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/1de0b9ab060d4fd29a3245b164274a92` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:42.853369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a21ec-1c8f-404b-8d8b-ede41e616c4e tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:33:42.858718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-995a21ec-1c8f-404b-8d8b-ede41e616c4e tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Could not find domain: 1de0b9ab060d4fd29a3245b164274a92.: keystone.exception.DomainNotFound: Could not find domain: 1de0b9ab060d4fd29a3245b164274a92. Aug 28 18:33:42.858718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:42.858718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:33:42.858718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:33:42.858718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:33:42.858718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:33:42.858718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:33:42.858718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:33:42.858718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1de0b9ab060d4fd29a3245b164274a92. Aug 28 18:33:42.858718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:42.858718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:33:42.858718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:42.858718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:42.858718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:42.858718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:42.858718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:42.860105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:42.860105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:42.860105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:42.860105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:42.860105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:42.860105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:42.860105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:42.860105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 18:33:42.860105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 18:33:42.860105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:33:42.860105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:33:42.860105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:33:42.860105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:33:42.860105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:42.860105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:42.860105 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:33:42.861255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:33:42.861255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:33:42.861255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:33:42.861255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:33:42.861255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:33:42.861255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:33:42.861255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:33:42.861255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:33:42.861255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:33:42.861255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:33:42.861255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:33:42.861255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:33:42.861255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:33:42.861255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:33:42.861255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:33:42.861255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1de0b9ab060d4fd29a3245b164274a92. Aug 28 18:33:42.861255 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:42.863336 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1976/3974] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:42 2022] PATCH /identity/v3/domains/1de0b9ab060d4fd29a3245b164274a92 => generated 112 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:33:42.866859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32124c73-0ca8-4bbb-9fff-1e723e4278bd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:42.868630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-32124c73-0ca8-4bbb-9fff-1e723e4278bd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:42.883740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32124c73-0ca8-4bbb-9fff-1e723e4278bd tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:42.889009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2724e-b567-4521-8027-09b95a244656 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:42.889780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2724e-b567-4521-8027-09b95a244656 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:42.890491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2724e-b567-4521-8027-09b95a244656 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:42.890860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2724e-b567-4521-8027-09b95a244656 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/8b1bea71f9ae473cbd7bde4888e21b59` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:42.900773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2724e-b567-4521-8027-09b95a244656 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:33:42.923725 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-fea2724e-b567-4521-8027-09b95a244656 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Could not find domain: 8b1bea71f9ae473cbd7bde4888e21b59.: keystone.exception.DomainNotFound: Could not find domain: 8b1bea71f9ae473cbd7bde4888e21b59. Aug 28 18:33:42.923725 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:42.923725 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:33:42.923725 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:33:42.923725 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:33:42.923725 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:33:42.923725 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:33:42.923725 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:33:42.923725 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8b1bea71f9ae473cbd7bde4888e21b59. Aug 28 18:33:42.923725 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:42.923725 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:33:42.923725 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:42.923725 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:42.923725 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:42.923725 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:42.923725 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:42.924821 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:42.924821 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:42.924821 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:42.924821 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:42.924821 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:42.924821 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:42.924821 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:42.924821 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 18:33:42.924821 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 18:33:42.924821 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:33:42.924821 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:33:42.924821 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:33:42.924821 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:33:42.924821 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:42.924821 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:42.924821 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:33:42.925953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:33:42.925953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:33:42.925953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:33:42.925953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:33:42.925953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:33:42.925953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:33:42.925953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:33:42.925953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:33:42.925953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:33:42.925953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:33:42.925953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:33:42.925953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:33:42.925953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:33:42.925953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:33:42.925953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:33:42.925953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8b1bea71f9ae473cbd7bde4888e21b59. Aug 28 18:33:42.925953 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:42.930051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a21ec-1c8f-404b-8d8b-ede41e616c4e tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:42.932004 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1999/3975] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:42 2022] PATCH /identity/v3/domains/8b1bea71f9ae473cbd7bde4888e21b59 => generated 112 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:33:42.947272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a21ec-1c8f-404b-8d8b-ede41e616c4e tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:42.954939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c29686-d08c-415d-80ab-ce3b28996865 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:42.955938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c29686-d08c-415d-80ab-ce3b28996865 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:42.956455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c29686-d08c-415d-80ab-ce3b28996865 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:42.956991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c29686-d08c-415d-80ab-ce3b28996865 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/9fb71a91b173468f9ec3077aa09e1ec1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:42.966145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c29686-d08c-415d-80ab-ce3b28996865 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:33:42.972109 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-c6c29686-d08c-415d-80ab-ce3b28996865 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Could not find domain: 9fb71a91b173468f9ec3077aa09e1ec1.: keystone.exception.DomainNotFound: Could not find domain: 9fb71a91b173468f9ec3077aa09e1ec1. Aug 28 18:33:42.972109 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:42.972109 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:33:42.972109 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:33:42.972109 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:33:42.972109 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:33:42.972109 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:33:42.972109 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:33:42.972109 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9fb71a91b173468f9ec3077aa09e1ec1. Aug 28 18:33:42.972109 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:42.972109 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:33:42.972109 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:42.972109 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:42.972109 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:42.972109 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:42.972109 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:42.973237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:42.973237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:42.973237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:42.973237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:42.973237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:42.973237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:42.973237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:42.973237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 18:33:42.973237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 18:33:42.973237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:33:42.973237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:33:42.973237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:33:42.973237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:33:42.973237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:42.973237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:42.973237 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:33:42.974300 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:33:42.974300 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:33:42.974300 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:33:42.974300 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:33:42.974300 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:33:42.974300 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:33:42.974300 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:33:42.974300 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:33:42.974300 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:33:42.974300 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:33:42.974300 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:33:42.974300 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:33:42.974300 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:33:42.974300 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:33:42.974300 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:33:42.974300 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9fb71a91b173468f9ec3077aa09e1ec1. Aug 28 18:33:42.974300 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:42.978332 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1977/3976] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:42 2022] PATCH /identity/v3/domains/9fb71a91b173468f9ec3077aa09e1ec1 => generated 112 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 18:33:42.982266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2724e-b567-4521-8027-09b95a244656 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:42.999296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2724e-b567-4521-8027-09b95a244656 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:43.014166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29710b7d-9010-486d-9c9c-ec6f2a81ffc3 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3709b9636544a3fbcfe095185f9570f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63b9fb23de445719b2b9bf97e0a46c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:43.014924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710b7d-9010-486d-9c9c-ec6f2a81ffc3 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:43.015212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710b7d-9010-486d-9c9c-ec6f2a81ffc3 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:43.015526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710b7d-9010-486d-9c9c-ec6f2a81ffc3 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] PATH_INFO: `/v3/domains/c43d3509e02242e2a00c83e0d45e32d1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:43.028607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29710b7d-9010-486d-9c9c-ec6f2a81ffc3 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:33:43.038878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-29710b7d-9010-486d-9c9c-ec6f2a81ffc3 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Could not find domain: c43d3509e02242e2a00c83e0d45e32d1.: keystone.exception.DomainNotFound: Could not find domain: c43d3509e02242e2a00c83e0d45e32d1. Aug 28 18:33:43.038878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:43.038878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:33:43.038878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:33:43.038878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:33:43.038878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:33:43.038878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:33:43.038878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:33:43.038878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c43d3509e02242e2a00c83e0d45e32d1. Aug 28 18:33:43.038878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:43.038878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:33:43.038878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:43.038878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:43.038878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:43.038878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:43.038878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:43.039988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:43.039988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:43.039988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:43.039988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:43.039988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:43.039988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:43.039988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:43.039988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 18:33:43.039988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 18:33:43.039988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:33:43.039988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:33:43.039988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:33:43.039988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:33:43.039988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:43.039988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:43.039988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:33:43.041050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:33:43.041050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:33:43.041050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:33:43.041050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:33:43.041050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:33:43.041050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:33:43.041050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:33:43.041050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:33:43.041050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:33:43.041050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:33:43.041050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:33:43.041050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:33:43.041050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:33:43.041050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:33:43.041050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:33:43.041050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c43d3509e02242e2a00c83e0d45e32d1. Aug 28 18:33:43.041050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:33:43.042195 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2000/3977] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:33:42 2022] PATCH /identity/v3/domains/c43d3509e02242e2a00c83e0d45e32d1 => generated 112 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 18:33:43.044715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c29686-d08c-415d-80ab-ce3b28996865 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:43.046782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c6c29686-d08c-415d-80ab-ce3b28996865 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:43.168330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c29686-d08c-415d-80ab-ce3b28996865 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:43.173564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ceb9e-a704-4e1d-924f-b03f0c098ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:43.174377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ceb9e-a704-4e1d-924f-b03f0c098ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:43.174654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ceb9e-a704-4e1d-924f-b03f0c098ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:43.174928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ceb9e-a704-4e1d-924f-b03f0c098ecd admin admin] PATH_INFO: `/v3/users/0a48bff7352a4e5db2d39013e0e2b9c9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:43.176125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ceb9e-a704-4e1d-924f-b03f0c098ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a48bff7352a4e5db2d39013e0e2b9c9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:43.178293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ceb9e-a704-4e1d-924f-b03f0c098ecd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:43.233444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29710b7d-9010-486d-9c9c-ec6f2a81ffc3 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:43.236355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-29710b7d-9010-486d-9c9c-ec6f2a81ffc3 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:43.259855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-993ceb9e-a704-4e1d-924f-b03f0c098ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a48bff7352a4e5db2d39013e0e2b9c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:43.300286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-993ceb9e-a704-4e1d-924f-b03f0c098ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a48bff7352a4e5db2d39013e0e2b9c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:43.301060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-993ceb9e-a704-4e1d-924f-b03f0c098ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a48bff7352a4e5db2d39013e0e2b9c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:43.301832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-993ceb9e-a704-4e1d-924f-b03f0c098ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a48bff7352a4e5db2d39013e0e2b9c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:43.311234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-993ceb9e-a704-4e1d-924f-b03f0c098ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a48bff7352a4e5db2d39013e0e2b9c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:43.328715 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1978/3978] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:43 2022] DELETE /identity/v3/users/0a48bff7352a4e5db2d39013e0e2b9c9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:43.333075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2df4e-9064-46d4-88a0-4c2011e59a1a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:43.333444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2df4e-9064-46d4-88a0-4c2011e59a1a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:43.333795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2df4e-9064-46d4-88a0-4c2011e59a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:43.368690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29710b7d-9010-486d-9c9c-ec6f2a81ffc3 tempest-TokensV3TestJSON-1977317511 tempest-TokensV3TestJSON-1977317511-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:43.370754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7ed2df4e-9064-46d4-88a0-4c2011e59a1a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:43.372988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7ed2df4e-9064-46d4-88a0-4c2011e59a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:43.477557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6068b-3776-4757-bcda-0591a71b1ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:43.478601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6068b-3776-4757-bcda-0591a71b1ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:43.478883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6068b-3776-4757-bcda-0591a71b1ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:43.479159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6068b-3776-4757-bcda-0591a71b1ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:43.481985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09a6068b-3776-4757-bcda-0591a71b1ea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:43.502898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:43.529516 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1979/3979] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:43.562265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2df4e-9064-46d4-88a0-4c2011e59a1a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:43.564773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7ed2df4e-9064-46d4-88a0-4c2011e59a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:43.596021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6068b-3776-4757-bcda-0591a71b1ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:43.597940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6068b-3776-4757-bcda-0591a71b1ea9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:43.599102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2df4e-9064-46d4-88a0-4c2011e59a1a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:43.603231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:43.610890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae94ba-3407-4542-9d10-7e95c9fee500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:43.611555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae94ba-3407-4542-9d10-7e95c9fee500 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:43.611841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae94ba-3407-4542-9d10-7e95c9fee500 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:43.612154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae94ba-3407-4542-9d10-7e95c9fee500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:43.613275 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2001/3980] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:33:43.623144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae94ba-3407-4542-9d10-7e95c9fee500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:43.624632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae94ba-3407-4542-9d10-7e95c9fee500 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:43.634685 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1980/3981] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:33:44.104823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6068b-3776-4757-bcda-0591a71b1ea9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:44.106780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09a6068b-3776-4757-bcda-0591a71b1ea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:44.119814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6068b-3776-4757-bcda-0591a71b1ea9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:44.125557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:44.126641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:44.127147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:44.127668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8 admin admin] PATH_INFO: `/v3/projects/6670b64e77bb4b39a0196d67ba36656a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:44.129095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6670b64e77bb4b39a0196d67ba36656a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:44.131164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:44.189410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6670b64e77bb4b39a0196d67ba36656a', 'request_id': 'req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:44.198799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6670b64e77bb4b39a0196d67ba36656a', 'request_id': 'req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:44.209596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6670b64e77bb4b39a0196d67ba36656a', 'request_id': 'req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:44.224832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8 admin admin] The token cache is being invalidate because project 6670b64e77bb4b39a0196d67ba36656a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:44.225291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:44.226846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:44.229088 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2002/3982] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:44 2022] DELETE /identity/v3/projects/6670b64e77bb4b39a0196d67ba36656a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:44.233195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae94ba-3407-4542-9d10-7e95c9fee500 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:44.244365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae94ba-3407-4542-9d10-7e95c9fee500 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:44.310871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce9d40-5d67-4af1-93f7-591c66b13073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:44.311561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce9d40-5d67-4af1-93f7-591c66b13073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:44.311844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce9d40-5d67-4af1-93f7-591c66b13073 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:44.312124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce9d40-5d67-4af1-93f7-591c66b13073 admin admin] PATH_INFO: `/v3/users/e3709b9636544a3fbcfe095185f9570f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:44.313324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce9d40-5d67-4af1-93f7-591c66b13073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3709b9636544a3fbcfe095185f9570f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:44.315361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce9d40-5d67-4af1-93f7-591c66b13073 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:44.362878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-efce9d40-5d67-4af1-93f7-591c66b13073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3709b9636544a3fbcfe095185f9570f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:44.374906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-efce9d40-5d67-4af1-93f7-591c66b13073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3709b9636544a3fbcfe095185f9570f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:44.375707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-efce9d40-5d67-4af1-93f7-591c66b13073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3709b9636544a3fbcfe095185f9570f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:44.376606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-efce9d40-5d67-4af1-93f7-591c66b13073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3709b9636544a3fbcfe095185f9570f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:44.384511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-efce9d40-5d67-4af1-93f7-591c66b13073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3709b9636544a3fbcfe095185f9570f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:44.399908 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1981/3983] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:44 2022] DELETE /identity/v3/users/e3709b9636544a3fbcfe095185f9570f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:44.714409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:44.716004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:44.732431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b19ebe-337f-44ea-b8eb-ce998e306eb8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:44.794467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aec417-df57-439e-b06f-1fb73ebf01f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:44.795277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aec417-df57-439e-b06f-1fb73ebf01f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:44.795630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aec417-df57-439e-b06f-1fb73ebf01f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:44.795904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aec417-df57-439e-b06f-1fb73ebf01f9 admin admin] PATH_INFO: `/v3/projects/a63b9fb23de445719b2b9bf97e0a46c2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:44.797120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aec417-df57-439e-b06f-1fb73ebf01f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a63b9fb23de445719b2b9bf97e0a46c2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:44.799276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aec417-df57-439e-b06f-1fb73ebf01f9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:44.851953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a5aec417-df57-439e-b06f-1fb73ebf01f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a63b9fb23de445719b2b9bf97e0a46c2', 'request_id': 'req-a5aec417-df57-439e-b06f-1fb73ebf01f9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:44.860024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a5aec417-df57-439e-b06f-1fb73ebf01f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a63b9fb23de445719b2b9bf97e0a46c2', 'request_id': 'req-a5aec417-df57-439e-b06f-1fb73ebf01f9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:44.866954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a5aec417-df57-439e-b06f-1fb73ebf01f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a63b9fb23de445719b2b9bf97e0a46c2', 'request_id': 'req-a5aec417-df57-439e-b06f-1fb73ebf01f9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:44.880493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a5aec417-df57-439e-b06f-1fb73ebf01f9 admin admin] The token cache is being invalidate because project a63b9fb23de445719b2b9bf97e0a46c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:44.880821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a5aec417-df57-439e-b06f-1fb73ebf01f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:44.881501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a5aec417-df57-439e-b06f-1fb73ebf01f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:44.883311 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2003/3984] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:44 2022] DELETE /identity/v3/projects/a63b9fb23de445719b2b9bf97e0a46c2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:44.887485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce9d40-5d67-4af1-93f7-591c66b13073 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:44.888975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-efce9d40-5d67-4af1-93f7-591c66b13073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:44.904220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce9d40-5d67-4af1-93f7-591c66b13073 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:44.968906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:44.985482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e056b-e2aa-4d73-bc11-b0985da9c7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:44.986995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e056b-e2aa-4d73-bc11-b0985da9c7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:44.987649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e056b-e2aa-4d73-bc11-b0985da9c7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:44.988186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e056b-e2aa-4d73-bc11-b0985da9c7f6 admin admin] PATH_INFO: `/v3/users/32eb7cf6566446d494b2d1939b20807a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:44.989870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e056b-e2aa-4d73-bc11-b0985da9c7f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32eb7cf6566446d494b2d1939b20807a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:44.992360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e056b-e2aa-4d73-bc11-b0985da9c7f6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:45.073680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f5e056b-e2aa-4d73-bc11-b0985da9c7f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32eb7cf6566446d494b2d1939b20807a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:45.099053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f5e056b-e2aa-4d73-bc11-b0985da9c7f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32eb7cf6566446d494b2d1939b20807a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:45.102757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f5e056b-e2aa-4d73-bc11-b0985da9c7f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32eb7cf6566446d494b2d1939b20807a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:45.103491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f5e056b-e2aa-4d73-bc11-b0985da9c7f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32eb7cf6566446d494b2d1939b20807a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:45.113540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f5e056b-e2aa-4d73-bc11-b0985da9c7f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32eb7cf6566446d494b2d1939b20807a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:45.154070 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1982/3985] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:44 2022] DELETE /identity/v3/users/32eb7cf6566446d494b2d1939b20807a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:45.449155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aec417-df57-439e-b06f-1fb73ebf01f9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:45.450850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a5aec417-df57-439e-b06f-1fb73ebf01f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:45.467016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aec417-df57-439e-b06f-1fb73ebf01f9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:45.478212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:45.530036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dff2fd-8c2c-4672-bd91-cda1ba4b3624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:45.530681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dff2fd-8c2c-4672-bd91-cda1ba4b3624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:45.530963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dff2fd-8c2c-4672-bd91-cda1ba4b3624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:45.531242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dff2fd-8c2c-4672-bd91-cda1ba4b3624 admin admin] PATH_INFO: `/v3/projects/0c331189b45b40218bac4b7dfd75ac3c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:45.532430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dff2fd-8c2c-4672-bd91-cda1ba4b3624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c331189b45b40218bac4b7dfd75ac3c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:45.534376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dff2fd-8c2c-4672-bd91-cda1ba4b3624 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:45.585945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6dff2fd-8c2c-4672-bd91-cda1ba4b3624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c331189b45b40218bac4b7dfd75ac3c', 'request_id': 'req-e6dff2fd-8c2c-4672-bd91-cda1ba4b3624'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:45.600559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6dff2fd-8c2c-4672-bd91-cda1ba4b3624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c331189b45b40218bac4b7dfd75ac3c', 'request_id': 'req-e6dff2fd-8c2c-4672-bd91-cda1ba4b3624'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:45.608830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6dff2fd-8c2c-4672-bd91-cda1ba4b3624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c331189b45b40218bac4b7dfd75ac3c', 'request_id': 'req-e6dff2fd-8c2c-4672-bd91-cda1ba4b3624'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:45.621046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6dff2fd-8c2c-4672-bd91-cda1ba4b3624 admin admin] The token cache is being invalidate because project 0c331189b45b40218bac4b7dfd75ac3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:45.622069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6dff2fd-8c2c-4672-bd91-cda1ba4b3624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:45.622767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6dff2fd-8c2c-4672-bd91-cda1ba4b3624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:45.624627 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2004/3986] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:45 2022] DELETE /identity/v3/projects/0c331189b45b40218bac4b7dfd75ac3c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:45.631219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4d25f-c7cc-4300-8012-45eaecc4f278 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:45.631782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4d25f-c7cc-4300-8012-45eaecc4f278 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:45.631892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4d25f-c7cc-4300-8012-45eaecc4f278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:45.652704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-13a4d25f-c7cc-4300-8012-45eaecc4f278 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:45.654322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-13a4d25f-c7cc-4300-8012-45eaecc4f278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:45.727440 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1983/3987] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:45.733380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a75426-bf37-4d72-bdcf-44c60084d9a9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:45.733380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a75426-bf37-4d72-bdcf-44c60084d9a9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:45.734086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a75426-bf37-4d72-bdcf-44c60084d9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:45.758852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-59a75426-bf37-4d72-bdcf-44c60084d9a9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:45.760134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-59a75426-bf37-4d72-bdcf-44c60084d9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:45.769055 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2005/3988] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:45.773423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4d25f-c7cc-4300-8012-45eaecc4f278 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:45.785128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4d25f-c7cc-4300-8012-45eaecc4f278 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:45.790534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d468f-1214-42cd-915b-01b1f321a0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:45.791161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d468f-1214-42cd-915b-01b1f321a0bb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:45.791495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d468f-1214-42cd-915b-01b1f321a0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:45.791807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d468f-1214-42cd-915b-01b1f321a0bb admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:45.793150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d468f-1214-42cd-915b-01b1f321a0bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:45.793150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d468f-1214-42cd-915b-01b1f321a0bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:45.794416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d468f-1214-42cd-915b-01b1f321a0bb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:45.811313 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1984/3989] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:45.812814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a75426-bf37-4d72-bdcf-44c60084d9a9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:45.822884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a75426-bf37-4d72-bdcf-44c60084d9a9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:45.828509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0801cc6-7ae6-4f17-9c3a-2c8bdf47433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:45.829149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0801cc6-7ae6-4f17-9c3a-2c8bdf47433d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:45.829428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0801cc6-7ae6-4f17-9c3a-2c8bdf47433d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:45.829703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0801cc6-7ae6-4f17-9c3a-2c8bdf47433d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:45.830351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0801cc6-7ae6-4f17-9c3a-2c8bdf47433d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:45.832487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0801cc6-7ae6-4f17-9c3a-2c8bdf47433d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:45.868016 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2006/3990] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:45 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:45.869624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d468f-1214-42cd-915b-01b1f321a0bb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:45.880641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d468f-1214-42cd-915b-01b1f321a0bb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:45.952102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52be0c-1a02-4de9-8f6f-b7aa220570ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:45.952769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52be0c-1a02-4de9-8f6f-b7aa220570ba admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:45.953159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52be0c-1a02-4de9-8f6f-b7aa220570ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:45.953438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52be0c-1a02-4de9-8f6f-b7aa220570ba admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:45.954419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52be0c-1a02-4de9-8f6f-b7aa220570ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:45.956097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52be0c-1a02-4de9-8f6f-b7aa220570ba admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:45.966064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:45.988657 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1985/3991] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:45 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:45.989721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0801cc6-7ae6-4f17-9c3a-2c8bdf47433d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:46.000420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0801cc6-7ae6-4f17-9c3a-2c8bdf47433d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:46.017825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88972726-e3a8-4462-8673-f122bf81a6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:46.018752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88972726-e3a8-4462-8673-f122bf81a6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:46.019035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88972726-e3a8-4462-8673-f122bf81a6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:46.019734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88972726-e3a8-4462-8673-f122bf81a6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:46.020396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88972726-e3a8-4462-8673-f122bf81a6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:46.022196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88972726-e3a8-4462-8673-f122bf81a6f7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:46.040127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52be0c-1a02-4de9-8f6f-b7aa220570ba admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:46.040824 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2007/3992] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:46.053284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52be0c-1a02-4de9-8f6f-b7aa220570ba admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:46.061736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72b0f0-a856-4621-b0f0-ce8ab991b1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:46.062582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72b0f0-a856-4621-b0f0-ce8ab991b1ed admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:46.063033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72b0f0-a856-4621-b0f0-ce8ab991b1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:46.063789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72b0f0-a856-4621-b0f0-ce8ab991b1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:46.065888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72b0f0-a856-4621-b0f0-ce8ab991b1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:46.067569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72b0f0-a856-4621-b0f0-ce8ab991b1ed admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:46.084502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88972726-e3a8-4462-8673-f122bf81a6f7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:46.087412 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1986/3993] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:46.096684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88972726-e3a8-4462-8673-f122bf81a6f7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:46.101598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89526c20-66d5-4b20-a6dd-d1303ea1b695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:46.102305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89526c20-66d5-4b20-a6dd-d1303ea1b695 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:46.102611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89526c20-66d5-4b20-a6dd-d1303ea1b695 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:46.102862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89526c20-66d5-4b20-a6dd-d1303ea1b695 admin admin] PATH_INFO: `/v3/projects/f9a72061e25e40e8b929eaed54b4f0dc/users/adbd83a596bf4532952ff22067d08838/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:46.120778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89526c20-66d5-4b20-a6dd-d1303ea1b695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a72061e25e40e8b929eaed54b4f0dc, user_id=adbd83a596bf4532952ff22067d08838, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:46.123704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89526c20-66d5-4b20-a6dd-d1303ea1b695 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:46.153430 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2008/3994] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:46 2022] PUT /identity/v3/projects/f9a72061e25e40e8b929eaed54b4f0dc/users/adbd83a596bf4532952ff22067d08838/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:46.159207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a0373-b75d-422b-a47b-e1d3adee29da None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:46.159546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a0373-b75d-422b-a47b-e1d3adee29da None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:46.159828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a0373-b75d-422b-a47b-e1d3adee29da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:46.198017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-466a0373-b75d-422b-a47b-e1d3adee29da None None] MFA Rules not processed for user `adbd83a596bf4532952ff22067d08838`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:46.199440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-466a0373-b75d-422b-a47b-e1d3adee29da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:46.294508 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1987/3995] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:46.302071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89526c20-66d5-4b20-a6dd-d1303ea1b695 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:46.314431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89526c20-66d5-4b20-a6dd-d1303ea1b695 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:46.320025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27705c-5916-4204-b903-71d8798127ae tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbd83a596bf4532952ff22067d08838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9a72061e25e40e8b929eaed54b4f0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:46.321442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27705c-5916-4204-b903-71d8798127ae tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:46.321961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27705c-5916-4204-b903-71d8798127ae tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:46.322398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27705c-5916-4204-b903-71d8798127ae tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] PATH_INFO: `/v3/users/adbd83a596bf4532952ff22067d08838/application_credentials` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:46.323293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27705c-5916-4204-b903-71d8798127ae tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorizing `identity:create_application_credential(user_id=adbd83a596bf4532952ff22067d08838)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:46.324750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27705c-5916-4204-b903-71d8798127ae tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:46.379161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:46.466113 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2009/3996] 10.222.0.27 () {60 vars in 1315 bytes} [Sun Aug 28 18:33:46 2022] POST /identity/v3/users/adbd83a596bf4532952ff22067d08838/application_credentials => generated 921 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:46.470620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a0373-b75d-422b-a47b-e1d3adee29da None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:46.480456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a0373-b75d-422b-a47b-e1d3adee29da None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:46.485156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d00bbf-524d-4dc5-8dee-dc67786fa996 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbd83a596bf4532952ff22067d08838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9a72061e25e40e8b929eaed54b4f0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:46.485935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d00bbf-524d-4dc5-8dee-dc67786fa996 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:46.487098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d00bbf-524d-4dc5-8dee-dc67786fa996 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:46.487098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d00bbf-524d-4dc5-8dee-dc67786fa996 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] PATH_INFO: `/v3/users/adbd83a596bf4532952ff22067d08838/access_rules/43845b41678a4de8803b2e6d7444b875` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:46.488087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d00bbf-524d-4dc5-8dee-dc67786fa996 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorizing `identity:delete_access_rule(user_id=adbd83a596bf4532952ff22067d08838, access_rule_id=43845b41678a4de8803b2e6d7444b875)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:46.489552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d00bbf-524d-4dc5-8dee-dc67786fa996 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:46.535854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-59d00bbf-524d-4dc5-8dee-dc67786fa996 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 28 18:33:46.535854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:46.535854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Aug 28 18:33:46.535854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application session.delete(ref) Aug 28 18:33:46.535854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:33:46.535854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:33:46.535854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 18:33:46.535854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application yield resource Aug 28 18:33:46.535854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:33:46.535854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:33:46.535854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 18:33:46.535854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 18:33:46.535854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 18:33:46.535854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 18:33:46.535854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 18:33:46.535854 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise self.value Aug 28 18:33:46.537285 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 18:33:46.537285 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 18:33:46.537285 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 18:33:46.537285 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application session.commit() Aug 28 18:33:46.537285 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 18:33:46.537285 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 18:33:46.537285 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 18:33:46.537285 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 18:33:46.537285 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 18:33:46.537285 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.session.flush() Aug 28 18:33:46.537285 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 18:33:46.537285 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 18:33:46.537285 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 18:33:46.537285 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 18:33:46.537285 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 18:33:46.537285 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application compat.raise_( Aug 28 18:33:46.538709 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 18:33:46.538709 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception Aug 28 18:33:46.538709 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 18:33:46.538709 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 18:33:46.538709 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 18:33:46.538709 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 18:33:46.538709 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Aug 28 18:33:46.538709 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Aug 28 18:33:46.538709 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Aug 28 18:33:46.538709 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._synchronize( Aug 28 18:33:46.538709 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Aug 28 18:33:46.538709 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Aug 28 18:33:46.538709 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Aug 28 18:33:46.538709 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise AssertionError( Aug 28 18:33:46.538709 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Aug 28 18:33:46.538709 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:46.540196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:33:46.540196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:46.540196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:33:46.540196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:33:46.540196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:33:46.540196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:33:46.540196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:33:46.540196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:33:46.540196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:33:46.540196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:33:46.540196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:33:46.540196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:33:46.540196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:33:46.540196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Aug 28 18:33:46.540196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Aug 28 18:33:46.540196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:33:46.540196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:33:46.541536 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Aug 28 18:33:46.541536 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Aug 28 18:33:46.541536 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Aug 28 18:33:46.541536 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 28 18:33:46.541536 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 28 18:33:46.541536 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:33:46.542930 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1988/3997] 10.222.0.27 () {58 vars in 1362 bytes} [Sun Aug 28 18:33:46 2022] DELETE /identity/v3/users/adbd83a596bf4532952ff22067d08838/access_rules/43845b41678a4de8803b2e6d7444b875 => generated 89 bytes in 73 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:33:46.547147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27705c-5916-4204-b903-71d8798127ae tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:46.564945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27705c-5916-4204-b903-71d8798127ae tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:46.570048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91e155-d5d5-4745-9e80-a912589029be tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbd83a596bf4532952ff22067d08838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9a72061e25e40e8b929eaed54b4f0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:46.570817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91e155-d5d5-4745-9e80-a912589029be tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:46.571170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91e155-d5d5-4745-9e80-a912589029be tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:46.571541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91e155-d5d5-4745-9e80-a912589029be tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] PATH_INFO: `/v3/users/adbd83a596bf4532952ff22067d08838/application_credentials/356354b9b61e48b2a6b3be55287835ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:46.589501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91e155-d5d5-4745-9e80-a912589029be tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorizing `identity:delete_application_credential(user_id=adbd83a596bf4532952ff22067d08838, application_credential_id=356354b9b61e48b2a6b3be55287835ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:46.591202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91e155-d5d5-4745-9e80-a912589029be tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:46.626436 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2010/3998] 10.222.0.27 () {58 vars in 1395 bytes} [Sun Aug 28 18:33:46 2022] DELETE /identity/v3/users/adbd83a596bf4532952ff22067d08838/application_credentials/356354b9b61e48b2a6b3be55287835ae => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:46.632989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d00bbf-524d-4dc5-8dee-dc67786fa996 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:46.646890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d00bbf-524d-4dc5-8dee-dc67786fa996 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:46.662297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90ba1b-52ce-4e16-9ff3-ae01058dbb2b tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbd83a596bf4532952ff22067d08838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9a72061e25e40e8b929eaed54b4f0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:46.663197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90ba1b-52ce-4e16-9ff3-ae01058dbb2b tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:46.663581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90ba1b-52ce-4e16-9ff3-ae01058dbb2b tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:46.663931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90ba1b-52ce-4e16-9ff3-ae01058dbb2b tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] PATH_INFO: `/v3/users/adbd83a596bf4532952ff22067d08838/access_rules` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:46.665813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90ba1b-52ce-4e16-9ff3-ae01058dbb2b tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorizing `identity:list_access_rules(user_id=adbd83a596bf4532952ff22067d08838)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:46.680173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90ba1b-52ce-4e16-9ff3-ae01058dbb2b tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:46.689651 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1989/3999] 10.222.0.27 () {58 vars in 1260 bytes} [Sun Aug 28 18:33:46 2022] GET /identity/v3/users/adbd83a596bf4532952ff22067d08838/access_rules => generated 369 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:46.693535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91e155-d5d5-4745-9e80-a912589029be tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:46.709048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91e155-d5d5-4745-9e80-a912589029be tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:46.720786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8887e-1b3f-4024-96ce-43628951325e tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbd83a596bf4532952ff22067d08838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9a72061e25e40e8b929eaed54b4f0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:46.721860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8887e-1b3f-4024-96ce-43628951325e tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:46.722143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8887e-1b3f-4024-96ce-43628951325e tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:46.722420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8887e-1b3f-4024-96ce-43628951325e tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] PATH_INFO: `/v3/users/adbd83a596bf4532952ff22067d08838/access_rules/43845b41678a4de8803b2e6d7444b875` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:46.726556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8887e-1b3f-4024-96ce-43628951325e tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorizing `identity:delete_access_rule(user_id=adbd83a596bf4532952ff22067d08838, access_rule_id=43845b41678a4de8803b2e6d7444b875)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:46.728019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8887e-1b3f-4024-96ce-43628951325e tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:46.765874 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2011/4000] 10.222.0.27 () {58 vars in 1362 bytes} [Sun Aug 28 18:33:46 2022] DELETE /identity/v3/users/adbd83a596bf4532952ff22067d08838/access_rules/43845b41678a4de8803b2e6d7444b875 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:46.770115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90ba1b-52ce-4e16-9ff3-ae01058dbb2b tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:46.784391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90ba1b-52ce-4e16-9ff3-ae01058dbb2b tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:46.793878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ae8cd-ba13-40e3-a1c8-6d2ee28fd204 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbd83a596bf4532952ff22067d08838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9a72061e25e40e8b929eaed54b4f0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:46.794685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ae8cd-ba13-40e3-a1c8-6d2ee28fd204 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:46.795360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ae8cd-ba13-40e3-a1c8-6d2ee28fd204 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:46.795360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ae8cd-ba13-40e3-a1c8-6d2ee28fd204 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] PATH_INFO: `/v3/users/adbd83a596bf4532952ff22067d08838/access_rules` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:46.796572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ae8cd-ba13-40e3-a1c8-6d2ee28fd204 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorizing `identity:list_access_rules(user_id=adbd83a596bf4532952ff22067d08838)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:46.798056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ae8cd-ba13-40e3-a1c8-6d2ee28fd204 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:46.806782 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1990/4001] 10.222.0.27 () {58 vars in 1260 bytes} [Sun Aug 28 18:33:46 2022] GET /identity/v3/users/adbd83a596bf4532952ff22067d08838/access_rules => generated 158 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:46.813360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8887e-1b3f-4024-96ce-43628951325e tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:46.827044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8887e-1b3f-4024-96ce-43628951325e tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:46.832548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261a8d0-6c92-458e-a849-048c56325e3f tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbd83a596bf4532952ff22067d08838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9a72061e25e40e8b929eaed54b4f0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:46.833181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261a8d0-6c92-458e-a849-048c56325e3f tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:46.833687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261a8d0-6c92-458e-a849-048c56325e3f tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:46.834147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261a8d0-6c92-458e-a849-048c56325e3f tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] PATH_INFO: `/v3/users/adbd83a596bf4532952ff22067d08838/application_credentials` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:46.834797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261a8d0-6c92-458e-a849-048c56325e3f tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorizing `identity:create_application_credential(user_id=adbd83a596bf4532952ff22067d08838)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:46.836065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261a8d0-6c92-458e-a849-048c56325e3f tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:46.952742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ae8cd-ba13-40e3-a1c8-6d2ee28fd204 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:46.955477 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2012/4002] 10.222.0.27 () {60 vars in 1315 bytes} [Sun Aug 28 18:33:46 2022] POST /identity/v3/users/adbd83a596bf4532952ff22067d08838/application_credentials => generated 921 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:46.963344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ae8cd-ba13-40e3-a1c8-6d2ee28fd204 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:46.968230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6b8ed-5659-43d3-924c-7646a3c7b672 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbd83a596bf4532952ff22067d08838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9a72061e25e40e8b929eaed54b4f0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:46.969009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6b8ed-5659-43d3-924c-7646a3c7b672 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:46.969384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6b8ed-5659-43d3-924c-7646a3c7b672 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:46.969787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6b8ed-5659-43d3-924c-7646a3c7b672 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] PATH_INFO: `/v3/users/adbd83a596bf4532952ff22067d08838/access_rules` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:46.971202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6b8ed-5659-43d3-924c-7646a3c7b672 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorizing `identity:list_access_rules(user_id=adbd83a596bf4532952ff22067d08838)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:46.972797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6b8ed-5659-43d3-924c-7646a3c7b672 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:46.984963 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1991/4003] 10.222.0.27 () {58 vars in 1260 bytes} [Sun Aug 28 18:33:46 2022] GET /identity/v3/users/adbd83a596bf4532952ff22067d08838/access_rules => generated 369 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:46.986146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261a8d0-6c92-458e-a849-048c56325e3f tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:46.997079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261a8d0-6c92-458e-a849-048c56325e3f tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:47.002260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d319858-609f-465b-949a-d55838af3dd0 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbd83a596bf4532952ff22067d08838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9a72061e25e40e8b929eaed54b4f0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:47.002916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d319858-609f-465b-949a-d55838af3dd0 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:47.003221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d319858-609f-465b-949a-d55838af3dd0 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:47.003530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d319858-609f-465b-949a-d55838af3dd0 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] PATH_INFO: `/v3/users/adbd83a596bf4532952ff22067d08838/application_credentials` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:47.004211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d319858-609f-465b-949a-d55838af3dd0 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorizing `identity:create_application_credential(user_id=adbd83a596bf4532952ff22067d08838)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:47.005383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d319858-609f-465b-949a-d55838af3dd0 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:47.089621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=8,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:47.112802 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2013/4004] 10.222.0.27 () {60 vars in 1315 bytes} [Sun Aug 28 18:33:46 2022] POST /identity/v3/users/adbd83a596bf4532952ff22067d08838/application_credentials => generated 921 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:47.117316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6b8ed-5659-43d3-924c-7646a3c7b672 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:47.130597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6b8ed-5659-43d3-924c-7646a3c7b672 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:47.135232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e2274-ff30-48b9-aa26-14f9147f57da tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbd83a596bf4532952ff22067d08838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9a72061e25e40e8b929eaed54b4f0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:47.136104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2274-ff30-48b9-aa26-14f9147f57da tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:47.136397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2274-ff30-48b9-aa26-14f9147f57da tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:47.136680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2274-ff30-48b9-aa26-14f9147f57da tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] PATH_INFO: `/v3/users/adbd83a596bf4532952ff22067d08838/access_rules/51ac4f0496034eddbb344e77e56b80e8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:47.137868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e2274-ff30-48b9-aa26-14f9147f57da tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorizing `identity:get_access_rule(user_id=adbd83a596bf4532952ff22067d08838, access_rule_id=51ac4f0496034eddbb344e77e56b80e8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:47.139392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e2274-ff30-48b9-aa26-14f9147f57da tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:47.153948 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1992/4005] 10.222.0.27 () {58 vars in 1359 bytes} [Sun Aug 28 18:33:47 2022] GET /identity/v3/users/adbd83a596bf4532952ff22067d08838/access_rules/51ac4f0496034eddbb344e77e56b80e8 => generated 229 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:47.155054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d319858-609f-465b-949a-d55838af3dd0 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:47.245688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d319858-609f-465b-949a-d55838af3dd0 tempest-AccessRulesV3Test-1023661895 tempest-AccessRulesV3Test-1023661895-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:47.253951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50384639-89ea-4ac1-8767-7863beffc170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:47.254783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50384639-89ea-4ac1-8767-7863beffc170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:47.255378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50384639-89ea-4ac1-8767-7863beffc170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:47.255820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50384639-89ea-4ac1-8767-7863beffc170 admin admin] PATH_INFO: `/v3/users/adbd83a596bf4532952ff22067d08838` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:47.257309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50384639-89ea-4ac1-8767-7863beffc170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adbd83a596bf4532952ff22067d08838)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:47.259816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50384639-89ea-4ac1-8767-7863beffc170 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:47.336746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50384639-89ea-4ac1-8767-7863beffc170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adbd83a596bf4532952ff22067d08838'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:47.337676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50384639-89ea-4ac1-8767-7863beffc170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adbd83a596bf4532952ff22067d08838'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:47.346512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50384639-89ea-4ac1-8767-7863beffc170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adbd83a596bf4532952ff22067d08838'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:47.359057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50384639-89ea-4ac1-8767-7863beffc170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adbd83a596bf4532952ff22067d08838'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:47.439891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50384639-89ea-4ac1-8767-7863beffc170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adbd83a596bf4532952ff22067d08838'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:47.448203 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2014/4006] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:47 2022] DELETE /identity/v3/users/adbd83a596bf4532952ff22067d08838 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:47.452603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4869a3-14db-4591-9cdd-f425a8384c4f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:47.452878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4869a3-14db-4591-9cdd-f425a8384c4f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:47.453163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4869a3-14db-4591-9cdd-f425a8384c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:47.487188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ef4869a3-14db-4591-9cdd-f425a8384c4f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:47.488774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ef4869a3-14db-4591-9cdd-f425a8384c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:47.638815 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1993/4007] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:47.652934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50384639-89ea-4ac1-8767-7863beffc170 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:47.654465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-50384639-89ea-4ac1-8767-7863beffc170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:47.674585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4869a3-14db-4591-9cdd-f425a8384c4f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:47.690029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ef4869a3-14db-4591-9cdd-f425a8384c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:47.690366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50384639-89ea-4ac1-8767-7863beffc170 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:47.694597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79a39f-1f38-4830-a92d-c76f26fa4062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:47.698362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a39f-1f38-4830-a92d-c76f26fa4062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:47.698362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a39f-1f38-4830-a92d-c76f26fa4062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:47.698362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a39f-1f38-4830-a92d-c76f26fa4062 admin admin] PATH_INFO: `/v3/users/47aab8bfff21443891308d80f7059b2e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:47.707634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79a39f-1f38-4830-a92d-c76f26fa4062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47aab8bfff21443891308d80f7059b2e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:47.709798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79a39f-1f38-4830-a92d-c76f26fa4062 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:47.719135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:47.756442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=4,keystone:SELECT=81,keystone:DELETE=15 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:47.772308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4869a3-14db-4591-9cdd-f425a8384c4f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:47.776157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39239808-dc77-498f-a3e4-7ab0b662803b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:47.776902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39239808-dc77-498f-a3e4-7ab0b662803b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:47.777207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f79a39f-1f38-4830-a92d-c76f26fa4062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47aab8bfff21443891308d80f7059b2e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:47.777648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f79a39f-1f38-4830-a92d-c76f26fa4062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47aab8bfff21443891308d80f7059b2e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:47.778119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39239808-dc77-498f-a3e4-7ab0b662803b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:47.778430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39239808-dc77-498f-a3e4-7ab0b662803b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:47.780386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-39239808-dc77-498f-a3e4-7ab0b662803b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:47.787587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f79a39f-1f38-4830-a92d-c76f26fa4062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47aab8bfff21443891308d80f7059b2e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:47.793097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39239808-dc77-498f-a3e4-7ab0b662803b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:47.795322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39239808-dc77-498f-a3e4-7ab0b662803b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:47.796670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f79a39f-1f38-4830-a92d-c76f26fa4062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47aab8bfff21443891308d80f7059b2e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:47.806986 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1994/4008] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:33:47.811218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f79a39f-1f38-4830-a92d-c76f26fa4062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47aab8bfff21443891308d80f7059b2e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:47.817416 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2015/4009] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:47 2022] DELETE /identity/v3/users/47aab8bfff21443891308d80f7059b2e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:48.000102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39239808-dc77-498f-a3e4-7ab0b662803b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:48.001602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-39239808-dc77-498f-a3e4-7ab0b662803b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:48.017003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39239808-dc77-498f-a3e4-7ab0b662803b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:48.092905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd1a45-2c98-4d76-8116-21c02a569331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:48.093508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd1a45-2c98-4d76-8116-21c02a569331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.093882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd1a45-2c98-4d76-8116-21c02a569331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.094144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd1a45-2c98-4d76-8116-21c02a569331 admin admin] PATH_INFO: `/v3/projects/b7fc572a8cae45d68d992a638ef3422a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.095484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd1a45-2c98-4d76-8116-21c02a569331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7fc572a8cae45d68d992a638ef3422a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:48.097690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd1a45-2c98-4d76-8116-21c02a569331 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:48.107648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79a39f-1f38-4830-a92d-c76f26fa4062 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:48.109422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8f79a39f-1f38-4830-a92d-c76f26fa4062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:48.129098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79a39f-1f38-4830-a92d-c76f26fa4062 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:48.139450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ada629-6d8f-487c-8028-7790af96d72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:48.141434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ada629-6d8f-487c-8028-7790af96d72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.141717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ada629-6d8f-487c-8028-7790af96d72d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.142145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ada629-6d8f-487c-8028-7790af96d72d admin admin] PATH_INFO: `/v3/projects/f9a72061e25e40e8b929eaed54b4f0dc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.144636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ada629-6d8f-487c-8028-7790af96d72d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a72061e25e40e8b929eaed54b4f0dc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:48.147974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ada629-6d8f-487c-8028-7790af96d72d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:48.163621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49bd1a45-2c98-4d76-8116-21c02a569331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7fc572a8cae45d68d992a638ef3422a', 'request_id': 'req-49bd1a45-2c98-4d76-8116-21c02a569331'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:48.170163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49bd1a45-2c98-4d76-8116-21c02a569331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7fc572a8cae45d68d992a638ef3422a', 'request_id': 'req-49bd1a45-2c98-4d76-8116-21c02a569331'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:48.176124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49bd1a45-2c98-4d76-8116-21c02a569331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7fc572a8cae45d68d992a638ef3422a', 'request_id': 'req-49bd1a45-2c98-4d76-8116-21c02a569331'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:48.191529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49bd1a45-2c98-4d76-8116-21c02a569331 admin admin] The token cache is being invalidate because project b7fc572a8cae45d68d992a638ef3422a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:48.191819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49bd1a45-2c98-4d76-8116-21c02a569331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:48.192443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49bd1a45-2c98-4d76-8116-21c02a569331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:48.194086 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1995/4010] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:47 2022] DELETE /identity/v3/projects/b7fc572a8cae45d68d992a638ef3422a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:48.198998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49006518-48dd-4b48-b439-7b34abc29542 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.199312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49006518-48dd-4b48-b439-7b34abc29542 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.199589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49006518-48dd-4b48-b439-7b34abc29542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.202281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75ada629-6d8f-487c-8028-7790af96d72d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a72061e25e40e8b929eaed54b4f0dc', 'request_id': 'req-75ada629-6d8f-487c-8028-7790af96d72d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:48.211299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75ada629-6d8f-487c-8028-7790af96d72d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a72061e25e40e8b929eaed54b4f0dc', 'request_id': 'req-75ada629-6d8f-487c-8028-7790af96d72d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:48.217177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75ada629-6d8f-487c-8028-7790af96d72d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a72061e25e40e8b929eaed54b4f0dc', 'request_id': 'req-75ada629-6d8f-487c-8028-7790af96d72d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:48.220399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-49006518-48dd-4b48-b439-7b34abc29542 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:48.221642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-49006518-48dd-4b48-b439-7b34abc29542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:48.230086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75ada629-6d8f-487c-8028-7790af96d72d admin admin] The token cache is being invalidate because project f9a72061e25e40e8b929eaed54b4f0dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:48.230380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75ada629-6d8f-487c-8028-7790af96d72d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:48.231029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75ada629-6d8f-487c-8028-7790af96d72d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:48.232802 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2016/4011] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:48 2022] DELETE /identity/v3/projects/f9a72061e25e40e8b929eaed54b4f0dc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:48.238738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77543a1-754d-4078-bdf8-71baf79d516b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.239028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77543a1-754d-4078-bdf8-71baf79d516b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.239345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77543a1-754d-4078-bdf8-71baf79d516b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.258196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a77543a1-754d-4078-bdf8-71baf79d516b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:48.259505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a77543a1-754d-4078-bdf8-71baf79d516b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:48.274189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:48.287481 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1996/4012] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:48.296052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c46d5-3c6c-4108-bc95-e64e7dcb7266 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.296338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c46d5-3c6c-4108-bc95-e64e7dcb7266 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.296617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c46d5-3c6c-4108-bc95-e64e7dcb7266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.316000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-489c46d5-3c6c-4108-bc95-e64e7dcb7266 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:48.317240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-489c46d5-3c6c-4108-bc95-e64e7dcb7266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:48.319817 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2017/4013] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:48.325396 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1997/4014] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:48.327634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdb0a2-4b07-4e96-9a3f-c0674cf8037b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.327924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdb0a2-4b07-4e96-9a3f-c0674cf8037b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.328234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdb0a2-4b07-4e96-9a3f-c0674cf8037b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.329583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c46d5-3c6c-4108-bc95-e64e7dcb7266 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:48.339564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c46d5-3c6c-4108-bc95-e64e7dcb7266 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:48.344843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e980f-ea31-4d3d-b35c-27d179c350be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:48.345439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e980f-ea31-4d3d-b35c-27d179c350be admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.345716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e980f-ea31-4d3d-b35c-27d179c350be admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.345985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e980f-ea31-4d3d-b35c-27d179c350be admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.346627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e980f-ea31-4d3d-b35c-27d179c350be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:48.346923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e980f-ea31-4d3d-b35c-27d179c350be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:48.347365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c5bdb0a2-4b07-4e96-9a3f-c0674cf8037b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:48.348559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e980f-ea31-4d3d-b35c-27d179c350be admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:48.348690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c5bdb0a2-4b07-4e96-9a3f-c0674cf8037b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:48.356743 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2018/4015] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:48.361273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdb0a2-4b07-4e96-9a3f-c0674cf8037b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:48.361425 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1998/4016] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:48.365534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e980f-ea31-4d3d-b35c-27d179c350be admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:48.370741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdb0a2-4b07-4e96-9a3f-c0674cf8037b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:48.375351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3a124-275d-4808-a590-f9e0c47f805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:48.375514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e980f-ea31-4d3d-b35c-27d179c350be admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:48.375947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3a124-275d-4808-a590-f9e0c47f805d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.376226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3a124-275d-4808-a590-f9e0c47f805d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.376527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3a124-275d-4808-a590-f9e0c47f805d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.377195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3a124-275d-4808-a590-f9e0c47f805d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:48.377495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3a124-275d-4808-a590-f9e0c47f805d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:48.379092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3a124-275d-4808-a590-f9e0c47f805d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:48.380537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a1ef6-8903-41a1-aac0-3ab14c3e978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:48.381117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a1ef6-8903-41a1-aac0-3ab14c3e978e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.381396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a1ef6-8903-41a1-aac0-3ab14c3e978e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.381734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a1ef6-8903-41a1-aac0-3ab14c3e978e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.382355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a1ef6-8903-41a1-aac0-3ab14c3e978e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:48.384286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a1ef6-8903-41a1-aac0-3ab14c3e978e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:48.391970 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2019/4017] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:33:48.396830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3a124-275d-4808-a590-f9e0c47f805d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:48.407726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3a124-275d-4808-a590-f9e0c47f805d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:48.414634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3389da-6d67-4507-88d7-dfe7a6e0132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:48.415259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3389da-6d67-4507-88d7-dfe7a6e0132c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.415549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3389da-6d67-4507-88d7-dfe7a6e0132c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.415823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3389da-6d67-4507-88d7-dfe7a6e0132c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.416498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3389da-6d67-4507-88d7-dfe7a6e0132c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:48.418073 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1999/4018] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:48 2022] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:48.418476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3389da-6d67-4507-88d7-dfe7a6e0132c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:48.422197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a1ef6-8903-41a1-aac0-3ab14c3e978e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:48.430827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:48.458173 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2020/4019] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:48 2022] POST /identity/v3/projects => generated 399 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:48.459168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3389da-6d67-4507-88d7-dfe7a6e0132c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:48.493521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a1ef6-8903-41a1-aac0-3ab14c3e978e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:48.521259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3389da-6d67-4507-88d7-dfe7a6e0132c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:48.526456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846035e-bbdf-43bc-af0f-d00b79296d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:48.527071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846035e-bbdf-43bc-af0f-d00b79296d7f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.527382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846035e-bbdf-43bc-af0f-d00b79296d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.527655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846035e-bbdf-43bc-af0f-d00b79296d7f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.528284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846035e-bbdf-43bc-af0f-d00b79296d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:48.530199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846035e-bbdf-43bc-af0f-d00b79296d7f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:48.551350 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2021/4020] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:48 2022] POST /identity/v3/users => generated 306 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:48.551873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1628e-ab9e-44e2-85df-83cb85f778e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:48.552564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1628e-ab9e-44e2-85df-83cb85f778e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.552844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1628e-ab9e-44e2-85df-83cb85f778e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.553104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1628e-ab9e-44e2-85df-83cb85f778e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.553751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1628e-ab9e-44e2-85df-83cb85f778e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:48.555884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1628e-ab9e-44e2-85df-83cb85f778e3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:48.561044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846035e-bbdf-43bc-af0f-d00b79296d7f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:48.571806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846035e-bbdf-43bc-af0f-d00b79296d7f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:48.577354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd4807-d467-4a2e-89f6-f774ac5a755b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:48.577981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd4807-d467-4a2e-89f6-f774ac5a755b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.578260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd4807-d467-4a2e-89f6-f774ac5a755b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.578536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd4807-d467-4a2e-89f6-f774ac5a755b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.579185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd4807-d467-4a2e-89f6-f774ac5a755b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:48.580831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd4807-d467-4a2e-89f6-f774ac5a755b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:48.583563 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2000/4021] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:48 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:48.587637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1628e-ab9e-44e2-85df-83cb85f778e3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:48.598048 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2022/4022] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:48.598223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1628e-ab9e-44e2-85df-83cb85f778e3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:48.599015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd4807-d467-4a2e-89f6-f774ac5a755b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:48.602496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd2e30-d8e3-496f-8ad1-2034b6a1ebb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:48.603087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2e30-d8e3-496f-8ad1-2034b6a1ebb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.603400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2e30-d8e3-496f-8ad1-2034b6a1ebb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.603678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2e30-d8e3-496f-8ad1-2034b6a1ebb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.604385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd2e30-d8e3-496f-8ad1-2034b6a1ebb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:48.606035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd2e30-d8e3-496f-8ad1-2034b6a1ebb7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:48.609505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd4807-d467-4a2e-89f6-f774ac5a755b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:48.616061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef9c80-5869-4eb8-96b1-8c0c6b92f02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:48.619406 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2001/4023] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:33:48.620258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef9c80-5869-4eb8-96b1-8c0c6b92f02c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.620542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef9c80-5869-4eb8-96b1-8c0c6b92f02c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.620817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef9c80-5869-4eb8-96b1-8c0c6b92f02c admin admin] PATH_INFO: `/v3/projects/55f87af41f944654bfa4586bdaf5fc45/users/bf8eaa43ce2740819e0b8dc18fcd8633/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.622473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd2e30-d8e3-496f-8ad1-2034b6a1ebb7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:48.632712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd2e30-d8e3-496f-8ad1-2034b6a1ebb7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:48.637924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef9c80-5869-4eb8-96b1-8c0c6b92f02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f87af41f944654bfa4586bdaf5fc45, user_id=bf8eaa43ce2740819e0b8dc18fcd8633, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:48.638740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7898f84-4392-4c8a-afa4-0e768b78a834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:48.639725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7898f84-4392-4c8a-afa4-0e768b78a834 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.640278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7898f84-4392-4c8a-afa4-0e768b78a834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.640846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7898f84-4392-4c8a-afa4-0e768b78a834 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.640968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef9c80-5869-4eb8-96b1-8c0c6b92f02c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:48.641273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7898f84-4392-4c8a-afa4-0e768b78a834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:48.642916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7898f84-4392-4c8a-afa4-0e768b78a834 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:48.659180 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2002/4025] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:48.659427 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2023/4025] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:48 2022] PUT /identity/v3/projects/55f87af41f944654bfa4586bdaf5fc45/users/bf8eaa43ce2740819e0b8dc18fcd8633/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:48.659580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7898f84-4392-4c8a-afa4-0e768b78a834 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:48.660197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef9c80-5869-4eb8-96b1-8c0c6b92f02c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:48.670343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7898f84-4392-4c8a-afa4-0e768b78a834 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:48.716016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:48.741756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef9c80-5869-4eb8-96b1-8c0c6b92f02c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:48.757739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9877fdd-5353-491d-8600-21095923f248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:48.758106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d4207-d6a6-47c2-bc3b-cb5f6e6f26da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:48.758355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9877fdd-5353-491d-8600-21095923f248 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.758642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9877fdd-5353-491d-8600-21095923f248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.758832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d4207-d6a6-47c2-bc3b-cb5f6e6f26da admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.758934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9877fdd-5353-491d-8600-21095923f248 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.759096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d4207-d6a6-47c2-bc3b-cb5f6e6f26da admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.759393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d4207-d6a6-47c2-bc3b-cb5f6e6f26da admin admin] PATH_INFO: `/v3/projects/e47b021d8b6a41d58e072bec7137ae20/users/88d03e1bf0b046018b4664606af4497a/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.759609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9877fdd-5353-491d-8600-21095923f248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:48.761283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9877fdd-5353-491d-8600-21095923f248 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:48.782546 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2003/4026] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:33:48.782870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d4207-d6a6-47c2-bc3b-cb5f6e6f26da admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47b021d8b6a41d58e072bec7137ae20, user_id=88d03e1bf0b046018b4664606af4497a, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:48.786014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d4207-d6a6-47c2-bc3b-cb5f6e6f26da admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:48.787451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9877fdd-5353-491d-8600-21095923f248 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:48.802205 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2024/4027] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:48 2022] PUT /identity/v3/projects/e47b021d8b6a41d58e072bec7137ae20/users/88d03e1bf0b046018b4664606af4497a/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:48.807405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675183-42cf-49f1-91d7-cce6dd5e009f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.807699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675183-42cf-49f1-91d7-cce6dd5e009f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.808131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675183-42cf-49f1-91d7-cce6dd5e009f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.809398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9877fdd-5353-491d-8600-21095923f248 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:48.829474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e8675183-42cf-49f1-91d7-cce6dd5e009f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:48.830720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e8675183-42cf-49f1-91d7-cce6dd5e009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:48.858471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:48.876190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebeda58-fa49-4977-93b6-dc3349487512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:48.877235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebeda58-fa49-4977-93b6-dc3349487512 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.877516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebeda58-fa49-4977-93b6-dc3349487512 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.877795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebeda58-fa49-4977-93b6-dc3349487512 admin admin] PATH_INFO: `/v3/projects/55f87af41f944654bfa4586bdaf5fc45/users/bf8eaa43ce2740819e0b8dc18fcd8633/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.879883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebeda58-fa49-4977-93b6-dc3349487512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f87af41f944654bfa4586bdaf5fc45, user_id=bf8eaa43ce2740819e0b8dc18fcd8633, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:48.886154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebeda58-fa49-4977-93b6-dc3349487512 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:48.902758 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2004/4028] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:48 2022] PUT /identity/v3/projects/55f87af41f944654bfa4586bdaf5fc45/users/bf8eaa43ce2740819e0b8dc18fcd8633/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:48.907756 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2025/4029] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:48.919707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebeda58-fa49-4977-93b6-dc3349487512 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:48.920081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e69f87-6c79-40f4-9075-599bb26f1342 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.920363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e69f87-6c79-40f4-9075-599bb26f1342 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.920639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e69f87-6c79-40f4-9075-599bb26f1342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:48.921550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1ebeda58-fa49-4977-93b6-dc3349487512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:48.955319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-56e69f87-6c79-40f4-9075-599bb26f1342 None None] MFA Rules not processed for user `bf8eaa43ce2740819e0b8dc18fcd8633`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:48.957124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56e69f87-6c79-40f4-9075-599bb26f1342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:48.992784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebeda58-fa49-4977-93b6-dc3349487512 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:48.996789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7478b1-5567-4180-a0a6-b3dcce7f8172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:48.997538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7478b1-5567-4180-a0a6-b3dcce7f8172 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:48.997824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7478b1-5567-4180-a0a6-b3dcce7f8172 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:48.998098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7478b1-5567-4180-a0a6-b3dcce7f8172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:49.042239 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2026/4030] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:48 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:49.046856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e69f87-6c79-40f4-9075-599bb26f1342 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:49.073057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7478b1-5567-4180-a0a6-b3dcce7f8172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:49.074509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7478b1-5567-4180-a0a6-b3dcce7f8172 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:49.085759 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2005/4031] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:33:49.123918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e69f87-6c79-40f4-9075-599bb26f1342 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:49.129089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e4815-6ee9-4af5-b18e-1d162d8d2314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:49.129723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e4815-6ee9-4af5-b18e-1d162d8d2314 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:49.130030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e4815-6ee9-4af5-b18e-1d162d8d2314 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:49.130379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e4815-6ee9-4af5-b18e-1d162d8d2314 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:49.131183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e4815-6ee9-4af5-b18e-1d162d8d2314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:49.133338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e4815-6ee9-4af5-b18e-1d162d8d2314 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:49.171229 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2027/4032] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:49 2022] POST /identity/v3/projects => generated 399 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:49.173006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7478b1-5567-4180-a0a6-b3dcce7f8172 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:49.183466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7478b1-5567-4180-a0a6-b3dcce7f8172 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:49.192565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:49.264551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11040fca-6d78-42ea-8de8-06bdfd337851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:49.265516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11040fca-6d78-42ea-8de8-06bdfd337851 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:49.265647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11040fca-6d78-42ea-8de8-06bdfd337851 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:49.266147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11040fca-6d78-42ea-8de8-06bdfd337851 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:49.267217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11040fca-6d78-42ea-8de8-06bdfd337851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:49.272112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11040fca-6d78-42ea-8de8-06bdfd337851 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:49.305380 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2006/4033] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:49 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:49.310157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e4815-6ee9-4af5-b18e-1d162d8d2314 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:49.321078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e4815-6ee9-4af5-b18e-1d162d8d2314 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:49.326363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a03ff-d3ed-4c67-8d27-b63565037515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:49.326983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a03ff-d3ed-4c67-8d27-b63565037515 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:49.327279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a03ff-d3ed-4c67-8d27-b63565037515 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:49.327579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a03ff-d3ed-4c67-8d27-b63565037515 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:49.328281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a03ff-d3ed-4c67-8d27-b63565037515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:49.329898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a03ff-d3ed-4c67-8d27-b63565037515 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:49.340745 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2028/4034] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:49.344872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11040fca-6d78-42ea-8de8-06bdfd337851 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:49.357235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11040fca-6d78-42ea-8de8-06bdfd337851 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:49.362753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df714cd-f6f0-4520-85b1-269aaf5495e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:49.363599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df714cd-f6f0-4520-85b1-269aaf5495e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:49.363871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df714cd-f6f0-4520-85b1-269aaf5495e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:49.364139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df714cd-f6f0-4520-85b1-269aaf5495e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:49.364778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df714cd-f6f0-4520-85b1-269aaf5495e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:49.366521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df714cd-f6f0-4520-85b1-269aaf5495e8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:49.379767 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2007/4035] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:49.382606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a03ff-d3ed-4c67-8d27-b63565037515 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:49.394863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a03ff-d3ed-4c67-8d27-b63565037515 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:49.400152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccbc30-bcdb-4779-beeb-6f0f317dc389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:49.401016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccbc30-bcdb-4779-beeb-6f0f317dc389 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:49.401450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccbc30-bcdb-4779-beeb-6f0f317dc389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:49.401647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccbc30-bcdb-4779-beeb-6f0f317dc389 admin admin] PATH_INFO: `/v3/projects/00ba901ad40a4f22b894082cb6def630/users/cfeca83ee8a441f6b50b3bc46867a1b5/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:49.418256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccbc30-bcdb-4779-beeb-6f0f317dc389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ba901ad40a4f22b894082cb6def630, user_id=cfeca83ee8a441f6b50b3bc46867a1b5, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:49.421151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccbc30-bcdb-4779-beeb-6f0f317dc389 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:49.449827 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2029/4036] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:49 2022] PUT /identity/v3/projects/00ba901ad40a4f22b894082cb6def630/users/cfeca83ee8a441f6b50b3bc46867a1b5/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:49.452438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fa7ea-ce83-476f-bebd-21d2965a55f1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:49.453004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fa7ea-ce83-476f-bebd-21d2965a55f1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:49.453406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fa7ea-ce83-476f-bebd-21d2965a55f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:49.485005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2e1fa7ea-ce83-476f-bebd-21d2965a55f1 None None] MFA Rules not processed for user `cfeca83ee8a441f6b50b3bc46867a1b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:49.486414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2e1fa7ea-ce83-476f-bebd-21d2965a55f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:49.586976 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2008/4037] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:49 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:49.599804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccbc30-bcdb-4779-beeb-6f0f317dc389 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:49.601654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-abccbc30-bcdb-4779-beeb-6f0f317dc389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:49.613180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:49.690896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccbc30-bcdb-4779-beeb-6f0f317dc389 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:49.697214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b503cf-a2a8-4899-90f9-a25ef91c09a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:49.697889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b503cf-a2a8-4899-90f9-a25ef91c09a3 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:49.698170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b503cf-a2a8-4899-90f9-a25ef91c09a3 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:49.698442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b503cf-a2a8-4899-90f9-a25ef91c09a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:49.761045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b503cf-a2a8-4899-90f9-a25ef91c09a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:49.762494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b503cf-a2a8-4899-90f9-a25ef91c09a3 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:49.772396 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2030/4038] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:49 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:33:50.476161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fa7ea-ce83-476f-bebd-21d2965a55f1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:50.560472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fa7ea-ce83-476f-bebd-21d2965a55f1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:50.572783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7eb85-e93b-4229-9c63-e77319d258d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:50.572783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7eb85-e93b-4229-9c63-e77319d258d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:50.572783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7eb85-e93b-4229-9c63-e77319d258d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:50.572783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7eb85-e93b-4229-9c63-e77319d258d6 admin admin] PATH_INFO: `/v3/users/bf8eaa43ce2740819e0b8dc18fcd8633` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:50.573253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7eb85-e93b-4229-9c63-e77319d258d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8eaa43ce2740819e0b8dc18fcd8633)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:50.575963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7eb85-e93b-4229-9c63-e77319d258d6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:50.635021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:50.670037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a6d7eb85-e93b-4229-9c63-e77319d258d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8eaa43ce2740819e0b8dc18fcd8633'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:50.684202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a6d7eb85-e93b-4229-9c63-e77319d258d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8eaa43ce2740819e0b8dc18fcd8633'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:50.685319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a6d7eb85-e93b-4229-9c63-e77319d258d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8eaa43ce2740819e0b8dc18fcd8633'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:50.686169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a6d7eb85-e93b-4229-9c63-e77319d258d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8eaa43ce2740819e0b8dc18fcd8633'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:50.698964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a6d7eb85-e93b-4229-9c63-e77319d258d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8eaa43ce2740819e0b8dc18fcd8633'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:50.720569 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2009/4039] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:50 2022] DELETE /identity/v3/users/bf8eaa43ce2740819e0b8dc18fcd8633 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:50.726433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0162-fa97-4833-82c6-c69409de4603 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:50.726983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0162-fa97-4833-82c6-c69409de4603 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:50.727566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0162-fa97-4833-82c6-c69409de4603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:50.747837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-232c0162-fa97-4833-82c6-c69409de4603 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:50.749051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-232c0162-fa97-4833-82c6-c69409de4603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:50.842220 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2031/4040] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:50.898322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7eb85-e93b-4229-9c63-e77319d258d6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:50.899795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a6d7eb85-e93b-4229-9c63-e77319d258d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:50.997305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7eb85-e93b-4229-9c63-e77319d258d6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:51.010770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961388a2-d708-48a3-9d86-e8d61cc0b0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:51.011448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961388a2-d708-48a3-9d86-e8d61cc0b0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:51.011723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961388a2-d708-48a3-9d86-e8d61cc0b0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:51.011999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961388a2-d708-48a3-9d86-e8d61cc0b0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:51.026740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961388a2-d708-48a3-9d86-e8d61cc0b0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:51.029497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961388a2-d708-48a3-9d86-e8d61cc0b0d1 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:51.042411 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2010/4041] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:33:51.516964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c0162-fa97-4833-82c6-c69409de4603 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:51.529890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-232c0162-fa97-4833-82c6-c69409de4603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:51.567093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c0162-fa97-4833-82c6-c69409de4603 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:51.601289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:51.601289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:51.601289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:51.604080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f admin admin] PATH_INFO: `/v3/projects/55f87af41f944654bfa4586bdaf5fc45` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:51.604841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=55f87af41f944654bfa4586bdaf5fc45)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:51.628548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:51.768027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:51.774050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f87af41f944654bfa4586bdaf5fc45', 'request_id': 'req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:51.799980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f87af41f944654bfa4586bdaf5fc45', 'request_id': 'req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:51.820763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f87af41f944654bfa4586bdaf5fc45', 'request_id': 'req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:51.839928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f admin admin] The token cache is being invalidate because project 55f87af41f944654bfa4586bdaf5fc45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:51.842129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:51.843099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:51.847734 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2032/4042] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:51 2022] DELETE /identity/v3/projects/55f87af41f944654bfa4586bdaf5fc45 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:51.849384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961388a2-d708-48a3-9d86-e8d61cc0b0d1 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:51.861721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961388a2-d708-48a3-9d86-e8d61cc0b0d1 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:52.051018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7284e9-782f-474a-b135-c61febeb9abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:52.052255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7284e9-782f-474a-b135-c61febeb9abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:52.052740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7284e9-782f-474a-b135-c61febeb9abc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:52.053218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7284e9-782f-474a-b135-c61febeb9abc admin admin] PATH_INFO: `/v3/users/cfeca83ee8a441f6b50b3bc46867a1b5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:52.054493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7284e9-782f-474a-b135-c61febeb9abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfeca83ee8a441f6b50b3bc46867a1b5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:52.071715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7284e9-782f-474a-b135-c61febeb9abc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:52.196640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:52.200114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b7284e9-782f-474a-b135-c61febeb9abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfeca83ee8a441f6b50b3bc46867a1b5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:52.220445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b7284e9-782f-474a-b135-c61febeb9abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfeca83ee8a441f6b50b3bc46867a1b5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:52.221671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b7284e9-782f-474a-b135-c61febeb9abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfeca83ee8a441f6b50b3bc46867a1b5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:52.223372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b7284e9-782f-474a-b135-c61febeb9abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfeca83ee8a441f6b50b3bc46867a1b5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:52.236423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b7284e9-782f-474a-b135-c61febeb9abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfeca83ee8a441f6b50b3bc46867a1b5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:52.253111 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2011/4043] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:51 2022] DELETE /identity/v3/users/cfeca83ee8a441f6b50b3bc46867a1b5 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:52.616866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:52.622527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:52.655097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd39eb-cc8a-4fa2-afda-7ba1dcc6cc0f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:52.794155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3627e1-14ac-49b4-9b06-56eac72c9b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:52.794852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3627e1-14ac-49b4-9b06-56eac72c9b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:52.795091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3627e1-14ac-49b4-9b06-56eac72c9b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:52.798365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3627e1-14ac-49b4-9b06-56eac72c9b72 admin admin] PATH_INFO: `/v3/projects/00ba901ad40a4f22b894082cb6def630` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:52.799963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3627e1-14ac-49b4-9b06-56eac72c9b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00ba901ad40a4f22b894082cb6def630)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:52.801914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3627e1-14ac-49b4-9b06-56eac72c9b72 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:52.883322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa3627e1-14ac-49b4-9b06-56eac72c9b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00ba901ad40a4f22b894082cb6def630', 'request_id': 'req-aa3627e1-14ac-49b4-9b06-56eac72c9b72'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:52.893062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa3627e1-14ac-49b4-9b06-56eac72c9b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00ba901ad40a4f22b894082cb6def630', 'request_id': 'req-aa3627e1-14ac-49b4-9b06-56eac72c9b72'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:52.900702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa3627e1-14ac-49b4-9b06-56eac72c9b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00ba901ad40a4f22b894082cb6def630', 'request_id': 'req-aa3627e1-14ac-49b4-9b06-56eac72c9b72'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:52.913864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa3627e1-14ac-49b4-9b06-56eac72c9b72 admin admin] The token cache is being invalidate because project 00ba901ad40a4f22b894082cb6def630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:52.914358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa3627e1-14ac-49b4-9b06-56eac72c9b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:52.915184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa3627e1-14ac-49b4-9b06-56eac72c9b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:52.917539 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2033/4044] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:52 2022] DELETE /identity/v3/projects/00ba901ad40a4f22b894082cb6def630 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:52.922958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64254b-2279-441f-addf-cb52b1198853 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:52.923479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64254b-2279-441f-addf-cb52b1198853 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:52.923675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64254b-2279-441f-addf-cb52b1198853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:52.951066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cf64254b-2279-441f-addf-cb52b1198853 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:52.952347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cf64254b-2279-441f-addf-cb52b1198853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:53.017370 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2012/4045] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:53.025122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82b359-6043-4c65-a883-01eec06b09e3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:53.025412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82b359-6043-4c65-a883-01eec06b09e3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:53.025721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82b359-6043-4c65-a883-01eec06b09e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:53.047211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6a82b359-6043-4c65-a883-01eec06b09e3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:53.048501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a82b359-6043-4c65-a883-01eec06b09e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:53.057752 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2034/4046] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:53.062595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64254b-2279-441f-addf-cb52b1198853 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:53.075351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64254b-2279-441f-addf-cb52b1198853 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:53.080311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f2838-4e0d-416c-b8a4-4aeffe1dfe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:53.080983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f2838-4e0d-416c-b8a4-4aeffe1dfe64 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:53.081308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f2838-4e0d-416c-b8a4-4aeffe1dfe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:53.081534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f2838-4e0d-416c-b8a4-4aeffe1dfe64 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:53.082182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f2838-4e0d-416c-b8a4-4aeffe1dfe64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:53.082623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f2838-4e0d-416c-b8a4-4aeffe1dfe64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:53.084280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f2838-4e0d-416c-b8a4-4aeffe1dfe64 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:53.100689 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2013/4047] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:53.102043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82b359-6043-4c65-a883-01eec06b09e3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:53.113908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82b359-6043-4c65-a883-01eec06b09e3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:53.120149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e0d49-90ab-413f-ae99-459a4e3a1f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:53.121173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e0d49-90ab-413f-ae99-459a4e3a1f92 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:53.121458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e0d49-90ab-413f-ae99-459a4e3a1f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:53.121961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e0d49-90ab-413f-ae99-459a4e3a1f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:53.122706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e0d49-90ab-413f-ae99-459a4e3a1f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:53.124888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e0d49-90ab-413f-ae99-459a4e3a1f92 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:53.203766 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2035/4048] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:53 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:53.207858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f2838-4e0d-416c-b8a4-4aeffe1dfe64 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:53.228665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f2838-4e0d-416c-b8a4-4aeffe1dfe64 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:53.340778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab19a15-1736-4743-ac6c-aea026328c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:53.342437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19a15-1736-4743-ac6c-aea026328c44 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:53.342731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19a15-1736-4743-ac6c-aea026328c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:53.343006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19a15-1736-4743-ac6c-aea026328c44 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:53.344275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab19a15-1736-4743-ac6c-aea026328c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:53.346076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab19a15-1736-4743-ac6c-aea026328c44 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:53.407307 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2014/4049] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:53 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:53.414669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e0d49-90ab-413f-ae99-459a4e3a1f92 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:53.428571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e0d49-90ab-413f-ae99-459a4e3a1f92 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:53.434242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b4a28-d5a8-4f22-b101-cc62ba7c8f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:53.435239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b4a28-d5a8-4f22-b101-cc62ba7c8f17 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:53.435239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b4a28-d5a8-4f22-b101-cc62ba7c8f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:53.435501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b4a28-d5a8-4f22-b101-cc62ba7c8f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:53.436344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b4a28-d5a8-4f22-b101-cc62ba7c8f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:53.438053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b4a28-d5a8-4f22-b101-cc62ba7c8f17 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:53.451313 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2036/4050] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:53.453732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab19a15-1736-4743-ac6c-aea026328c44 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:53.466776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab19a15-1736-4743-ac6c-aea026328c44 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:53.474773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bae649-7ee7-4fb0-bc84-34058bba0c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:53.475492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bae649-7ee7-4fb0-bc84-34058bba0c5b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:53.475777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bae649-7ee7-4fb0-bc84-34058bba0c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:53.476052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bae649-7ee7-4fb0-bc84-34058bba0c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:53.476876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bae649-7ee7-4fb0-bc84-34058bba0c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:53.479454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bae649-7ee7-4fb0-bc84-34058bba0c5b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:53.495317 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2015/4051] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:53.496929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b4a28-d5a8-4f22-b101-cc62ba7c8f17 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:53.508731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b4a28-d5a8-4f22-b101-cc62ba7c8f17 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:53.513757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c6698-7881-4032-82fe-f7bb23b35116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:53.514459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c6698-7881-4032-82fe-f7bb23b35116 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:53.514743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c6698-7881-4032-82fe-f7bb23b35116 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:53.515020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c6698-7881-4032-82fe-f7bb23b35116 admin admin] PATH_INFO: `/v3/projects/66f6287dc08345b9bec4a1d52754ee80/users/9413563683e244d091e2cb43885545d3/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:53.535743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c6698-7881-4032-82fe-f7bb23b35116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f6287dc08345b9bec4a1d52754ee80, user_id=9413563683e244d091e2cb43885545d3, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:53.552127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c6698-7881-4032-82fe-f7bb23b35116 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:53.563946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:53.590847 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2037/4052] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:53 2022] PUT /identity/v3/projects/66f6287dc08345b9bec4a1d52754ee80/users/9413563683e244d091e2cb43885545d3/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:53.602327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78861038-0c86-4164-9be3-63106e05c907 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:53.602609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78861038-0c86-4164-9be3-63106e05c907 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:53.602883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78861038-0c86-4164-9be3-63106e05c907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:53.657955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-78861038-0c86-4164-9be3-63106e05c907 None None] MFA Rules not processed for user `9413563683e244d091e2cb43885545d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:53.659546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-78861038-0c86-4164-9be3-63106e05c907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:53.677711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:53.809879 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2016/4053] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:53.814432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c6698-7881-4032-82fe-f7bb23b35116 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:53.887841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c6698-7881-4032-82fe-f7bb23b35116 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:53.892598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f65da4-8234-49f7-a64b-cccef2af9099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:53.893466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f65da4-8234-49f7-a64b-cccef2af9099 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:53.894244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f65da4-8234-49f7-a64b-cccef2af9099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:53.895073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f65da4-8234-49f7-a64b-cccef2af9099 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:53.895924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f65da4-8234-49f7-a64b-cccef2af9099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:53.898129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f65da4-8234-49f7-a64b-cccef2af9099 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:53.941435 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2038/4054] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:53 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:53.945424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78861038-0c86-4164-9be3-63106e05c907 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:53.965142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78861038-0c86-4164-9be3-63106e05c907 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:54.126271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fc4a5-4365-4438-9044-ea4f071db53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:54.127311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fc4a5-4365-4438-9044-ea4f071db53b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:54.127937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fc4a5-4365-4438-9044-ea4f071db53b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:54.128416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fc4a5-4365-4438-9044-ea4f071db53b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:54.129263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fc4a5-4365-4438-9044-ea4f071db53b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:54.133833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fc4a5-4365-4438-9044-ea4f071db53b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:54.181364 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2017/4055] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:53 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:54.185633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f65da4-8234-49f7-a64b-cccef2af9099 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:54.221690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f65da4-8234-49f7-a64b-cccef2af9099 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:54.236552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a18d34-f8f0-4ccf-8768-79e87a1a0f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:54.237150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a18d34-f8f0-4ccf-8768-79e87a1a0f19 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:54.237436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a18d34-f8f0-4ccf-8768-79e87a1a0f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:54.237700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a18d34-f8f0-4ccf-8768-79e87a1a0f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:54.238423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a18d34-f8f0-4ccf-8768-79e87a1a0f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:54.242516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a18d34-f8f0-4ccf-8768-79e87a1a0f19 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:54.257539 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2039/4056] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:33:54.261845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fc4a5-4365-4438-9044-ea4f071db53b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:54.277127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fc4a5-4365-4438-9044-ea4f071db53b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:54.313672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c93bc-ed0c-4360-b100-22928671eb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:54.314465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c93bc-ed0c-4360-b100-22928671eb87 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:54.314848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c93bc-ed0c-4360-b100-22928671eb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:54.315230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c93bc-ed0c-4360-b100-22928671eb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:54.316244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c93bc-ed0c-4360-b100-22928671eb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:54.317991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c93bc-ed0c-4360-b100-22928671eb87 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:54.361679 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2018/4057] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:54.365555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a18d34-f8f0-4ccf-8768-79e87a1a0f19 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:54.386574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a18d34-f8f0-4ccf-8768-79e87a1a0f19 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:54.401826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7caff7-ec3a-437b-8ade-34f14d7bba16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:54.403340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7caff7-ec3a-437b-8ade-34f14d7bba16 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:54.403817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7caff7-ec3a-437b-8ade-34f14d7bba16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:54.404910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7caff7-ec3a-437b-8ade-34f14d7bba16 admin admin] PATH_INFO: `/v3/projects/8803c4d3a89849c2a48aa2fa3dfa6d4c/users/6ab265fe01c74670b103473e3cbc14d5/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:54.435911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7caff7-ec3a-437b-8ade-34f14d7bba16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8803c4d3a89849c2a48aa2fa3dfa6d4c, user_id=6ab265fe01c74670b103473e3cbc14d5, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:54.439084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7caff7-ec3a-437b-8ade-34f14d7bba16 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:54.473973 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2040/4058] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:54 2022] PUT /identity/v3/projects/8803c4d3a89849c2a48aa2fa3dfa6d4c/users/6ab265fe01c74670b103473e3cbc14d5/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:54.499657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b94dc0-b99b-4d0c-9666-bdc622a5cb80 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:54.499657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b94dc0-b99b-4d0c-9666-bdc622a5cb80 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:54.499657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b94dc0-b99b-4d0c-9666-bdc622a5cb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:54.556697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-24b94dc0-b99b-4d0c-9666-bdc622a5cb80 None None] MFA Rules not processed for user `6ab265fe01c74670b103473e3cbc14d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:54.558070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-24b94dc0-b99b-4d0c-9666-bdc622a5cb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:54.672291 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2019/4059] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:54.685977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7caff7-ec3a-437b-8ade-34f14d7bba16 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:54.687778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d7caff7-ec3a-437b-8ade-34f14d7bba16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:54.755695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7caff7-ec3a-437b-8ade-34f14d7bba16 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:54.761388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0eb335-6f6b-47d1-a99c-a93344eeeed1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:54.762133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0eb335-6f6b-47d1-a99c-a93344eeeed1 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:54.762345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0eb335-6f6b-47d1-a99c-a93344eeeed1 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:54.762625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0eb335-6f6b-47d1-a99c-a93344eeeed1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:54.844545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0eb335-6f6b-47d1-a99c-a93344eeeed1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:54.848180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0eb335-6f6b-47d1-a99c-a93344eeeed1 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:54.854813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:54.861629 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2041/4060] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:33:55.011410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b94dc0-b99b-4d0c-9666-bdc622a5cb80 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:55.023203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b94dc0-b99b-4d0c-9666-bdc622a5cb80 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:55.027026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98467a-34ed-403b-9faf-07a5b80b8748 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:55.027759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98467a-34ed-403b-9faf-07a5b80b8748 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:55.028104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98467a-34ed-403b-9faf-07a5b80b8748 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:55.028446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98467a-34ed-403b-9faf-07a5b80b8748 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:55.037605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98467a-34ed-403b-9faf-07a5b80b8748 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:55.039296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98467a-34ed-403b-9faf-07a5b80b8748 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:55.049222 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2020/4061] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:33:55.542031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423bcd8-1b22-4d59-8515-fb29834bec60 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:55.542506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423bcd8-1b22-4d59-8515-fb29834bec60 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:55.542969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423bcd8-1b22-4d59-8515-fb29834bec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:55.615514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b423bcd8-1b22-4d59-8515-fb29834bec60 None None] MFA Rules not processed for user `88d03e1bf0b046018b4664606af4497a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:55.616768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b423bcd8-1b22-4d59-8515-fb29834bec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:55.688691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98467a-34ed-403b-9faf-07a5b80b8748 service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:55.705181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:55.729083 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2042/4062] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:55.749126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9cf8-4e9b-4c38-9055-487601c74a83 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:55.749414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9cf8-4e9b-4c38-9055-487601c74a83 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:55.749700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9cf8-4e9b-4c38-9055-487601c74a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:55.786070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ed4a9cf8-4e9b-4c38-9055-487601c74a83 None None] MFA Rules not processed for user `88d03e1bf0b046018b4664606af4497a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:55.787447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ed4a9cf8-4e9b-4c38-9055-487601c74a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:55.797977 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2043/4063] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:55.816054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a9cf8-4e9b-4c38-9055-487601c74a83 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:55.817132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ed4a9cf8-4e9b-4c38-9055-487601c74a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:55.945987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a9cf8-4e9b-4c38-9055-487601c74a83 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:55.951926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a459ad2-4802-4056-bd3c-f1500e9b3369 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:55.953819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a459ad2-4802-4056-bd3c-f1500e9b3369 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:55.954183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a459ad2-4802-4056-bd3c-f1500e9b3369 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:55.954462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a459ad2-4802-4056-bd3c-f1500e9b3369 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:55.958481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98467a-34ed-403b-9faf-07a5b80b8748 service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:55.963214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4231142-6752-4ce5-bd98-56e5a09418d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:55.963777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a459ad2-4802-4056-bd3c-f1500e9b3369 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:55.964032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4231142-6752-4ce5-bd98-56e5a09418d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:55.964315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4231142-6752-4ce5-bd98-56e5a09418d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:55.964586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4231142-6752-4ce5-bd98-56e5a09418d5 admin admin] PATH_INFO: `/v3/users/9413563683e244d091e2cb43885545d3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:55.965375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a459ad2-4802-4056-bd3c-f1500e9b3369 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:55.965715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4231142-6752-4ce5-bd98-56e5a09418d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9413563683e244d091e2cb43885545d3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:55.967669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4231142-6752-4ce5-bd98-56e5a09418d5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:55.979395 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2044/4064] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:55 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:33:56.025260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c4231142-6752-4ce5-bd98-56e5a09418d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9413563683e244d091e2cb43885545d3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:56.040440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c4231142-6752-4ce5-bd98-56e5a09418d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9413563683e244d091e2cb43885545d3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:56.041200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c4231142-6752-4ce5-bd98-56e5a09418d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9413563683e244d091e2cb43885545d3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:56.041860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c4231142-6752-4ce5-bd98-56e5a09418d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9413563683e244d091e2cb43885545d3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:56.052173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c4231142-6752-4ce5-bd98-56e5a09418d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9413563683e244d091e2cb43885545d3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:56.104174 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2021/4065] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:55 2022] DELETE /identity/v3/users/9413563683e244d091e2cb43885545d3 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:56.108755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa7258-7917-451a-a64d-e05b4e082fed None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:56.109044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa7258-7917-451a-a64d-e05b4e082fed None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:56.109318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa7258-7917-451a-a64d-e05b4e082fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:56.135554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5dfa7258-7917-451a-a64d-e05b4e082fed None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:56.137283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5dfa7258-7917-451a-a64d-e05b4e082fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:56.198893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:56.209762 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2045/4066] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:56.232561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4231142-6752-4ce5-bd98-56e5a09418d5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:56.234448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c4231142-6752-4ce5-bd98-56e5a09418d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:56.305888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4231142-6752-4ce5-bd98-56e5a09418d5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:56.309731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268bfab-bdf0-4ce3-b5e0-2ee643d3abe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:56.310350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268bfab-bdf0-4ce3-b5e0-2ee643d3abe2 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:56.310626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268bfab-bdf0-4ce3-b5e0-2ee643d3abe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:56.310925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268bfab-bdf0-4ce3-b5e0-2ee643d3abe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:56.320987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268bfab-bdf0-4ce3-b5e0-2ee643d3abe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:56.322739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268bfab-bdf0-4ce3-b5e0-2ee643d3abe2 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:56.333723 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2022/4067] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:33:56.725587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa7258-7917-451a-a64d-e05b4e082fed None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:56.726786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5dfa7258-7917-451a-a64d-e05b4e082fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:56.743541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa7258-7917-451a-a64d-e05b4e082fed None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:56.749463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:56.750464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:56.750811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:56.751158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36 admin admin] PATH_INFO: `/v3/projects/66f6287dc08345b9bec4a1d52754ee80` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:56.752490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f6287dc08345b9bec4a1d52754ee80)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:56.754528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:56.819360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f6287dc08345b9bec4a1d52754ee80', 'request_id': 'req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:56.834715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f6287dc08345b9bec4a1d52754ee80', 'request_id': 'req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:56.842951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f6287dc08345b9bec4a1d52754ee80', 'request_id': 'req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:56.857123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36 admin admin] The token cache is being invalidate because project 66f6287dc08345b9bec4a1d52754ee80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:56.857637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:56.858407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:56.860817 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2046/4068] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:56 2022] DELETE /identity/v3/projects/66f6287dc08345b9bec4a1d52754ee80 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:56.866608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268bfab-bdf0-4ce3-b5e0-2ee643d3abe2 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:56.880646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268bfab-bdf0-4ce3-b5e0-2ee643d3abe2 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:56.938386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:56.979143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91db9f-2d4a-4753-82e4-711222f247ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:56.979815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91db9f-2d4a-4753-82e4-711222f247ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:56.980093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91db9f-2d4a-4753-82e4-711222f247ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:56.980363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91db9f-2d4a-4753-82e4-711222f247ec admin admin] PATH_INFO: `/v3/users/6ab265fe01c74670b103473e3cbc14d5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:56.981605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91db9f-2d4a-4753-82e4-711222f247ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab265fe01c74670b103473e3cbc14d5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:56.984113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91db9f-2d4a-4753-82e4-711222f247ec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:57.089421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f91db9f-2d4a-4753-82e4-711222f247ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab265fe01c74670b103473e3cbc14d5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:57.119937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f91db9f-2d4a-4753-82e4-711222f247ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab265fe01c74670b103473e3cbc14d5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:57.120817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f91db9f-2d4a-4753-82e4-711222f247ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab265fe01c74670b103473e3cbc14d5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:57.121429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f91db9f-2d4a-4753-82e4-711222f247ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab265fe01c74670b103473e3cbc14d5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:57.138253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f91db9f-2d4a-4753-82e4-711222f247ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab265fe01c74670b103473e3cbc14d5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:57.162717 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2023/4069] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:33:56 2022] DELETE /identity/v3/users/6ab265fe01c74670b103473e3cbc14d5 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:57.758347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:57.760157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:57.780759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb91171-f2ea-4cbd-a4e0-7659935cdf36 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:57.849424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1632923-4f6c-4fbc-bea1-d34c28e3f1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:57.850208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1632923-4f6c-4fbc-bea1-d34c28e3f1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:57.850550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1632923-4f6c-4fbc-bea1-d34c28e3f1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:57.850890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1632923-4f6c-4fbc-bea1-d34c28e3f1e4 admin admin] PATH_INFO: `/v3/projects/8803c4d3a89849c2a48aa2fa3dfa6d4c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:57.852121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1632923-4f6c-4fbc-bea1-d34c28e3f1e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8803c4d3a89849c2a48aa2fa3dfa6d4c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:57.854166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1632923-4f6c-4fbc-bea1-d34c28e3f1e4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:57.907020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1632923-4f6c-4fbc-bea1-d34c28e3f1e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8803c4d3a89849c2a48aa2fa3dfa6d4c', 'request_id': 'req-e1632923-4f6c-4fbc-bea1-d34c28e3f1e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:57.917885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1632923-4f6c-4fbc-bea1-d34c28e3f1e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8803c4d3a89849c2a48aa2fa3dfa6d4c', 'request_id': 'req-e1632923-4f6c-4fbc-bea1-d34c28e3f1e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:57.924097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1632923-4f6c-4fbc-bea1-d34c28e3f1e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8803c4d3a89849c2a48aa2fa3dfa6d4c', 'request_id': 'req-e1632923-4f6c-4fbc-bea1-d34c28e3f1e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:57.935185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1632923-4f6c-4fbc-bea1-d34c28e3f1e4 admin admin] The token cache is being invalidate because project 8803c4d3a89849c2a48aa2fa3dfa6d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:33:57.935525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1632923-4f6c-4fbc-bea1-d34c28e3f1e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:57.936158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1632923-4f6c-4fbc-bea1-d34c28e3f1e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:33:57.937644 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2047/4070] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:33:57 2022] DELETE /identity/v3/projects/8803c4d3a89849c2a48aa2fa3dfa6d4c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:57.943977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae407e-8235-4bf7-85de-fe690ad792be None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:57.944255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae407e-8235-4bf7-85de-fe690ad792be None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:57.944541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae407e-8235-4bf7-85de-fe690ad792be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:57.966140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8cae407e-8235-4bf7-85de-fe690ad792be None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:57.967465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8cae407e-8235-4bf7-85de-fe690ad792be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:58.036556 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2024/4071] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:58.045086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d47d9d-0465-410e-a829-9bf5941ebd68 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:58.045461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d47d9d-0465-410e-a829-9bf5941ebd68 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:58.045804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d47d9d-0465-410e-a829-9bf5941ebd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:58.070406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-52d47d9d-0465-410e-a829-9bf5941ebd68 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:58.071905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52d47d9d-0465-410e-a829-9bf5941ebd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:58.081587 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2048/4072] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:33:58.085590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae407e-8235-4bf7-85de-fe690ad792be None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:58.097906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae407e-8235-4bf7-85de-fe690ad792be None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:58.105660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8982f8d-013c-4fe6-bfc0-d542114bd5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:58.106815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8982f8d-013c-4fe6-bfc0-d542114bd5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:58.108158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8982f8d-013c-4fe6-bfc0-d542114bd5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:58.108645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8982f8d-013c-4fe6-bfc0-d542114bd5d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:58.109466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8982f8d-013c-4fe6-bfc0-d542114bd5d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:33:58.110483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8982f8d-013c-4fe6-bfc0-d542114bd5d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:58.114947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8982f8d-013c-4fe6-bfc0-d542114bd5d7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:58.138838 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2025/4073] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:33:58.153218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d47d9d-0465-410e-a829-9bf5941ebd68 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:58.168962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d47d9d-0465-410e-a829-9bf5941ebd68 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:58.173961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a14bff-184f-4a8d-b629-b8d31e71a94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:58.174586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a14bff-184f-4a8d-b629-b8d31e71a94b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:58.174855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a14bff-184f-4a8d-b629-b8d31e71a94b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:58.175127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a14bff-184f-4a8d-b629-b8d31e71a94b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:58.175784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a14bff-184f-4a8d-b629-b8d31e71a94b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:58.177687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a14bff-184f-4a8d-b629-b8d31e71a94b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:58.183573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:58.212066 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2049/4074] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:58 2022] POST /identity/v3/projects => generated 411 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:33:58.216471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8982f8d-013c-4fe6-bfc0-d542114bd5d7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:58.227461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8982f8d-013c-4fe6-bfc0-d542114bd5d7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:58.268209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:58.291679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cd390-9e0d-4afe-98a6-eb4f58cf1cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:58.292211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cd390-9e0d-4afe-98a6-eb4f58cf1cea admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:58.292492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cd390-9e0d-4afe-98a6-eb4f58cf1cea admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:58.292813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cd390-9e0d-4afe-98a6-eb4f58cf1cea admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:58.293480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cd390-9e0d-4afe-98a6-eb4f58cf1cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:58.295561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cd390-9e0d-4afe-98a6-eb4f58cf1cea admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:58.321809 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2026/4075] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:58 2022] POST /identity/v3/users => generated 306 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:58.326416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a14bff-184f-4a8d-b629-b8d31e71a94b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:58.338106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a14bff-184f-4a8d-b629-b8d31e71a94b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:58.343241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0a2bc-e51d-45f0-a66f-95c38758fcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:58.344134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0a2bc-e51d-45f0-a66f-95c38758fcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:58.344407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0a2bc-e51d-45f0-a66f-95c38758fcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:58.344665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0a2bc-e51d-45f0-a66f-95c38758fcd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:58.345296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0a2bc-e51d-45f0-a66f-95c38758fcd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:58.347302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0a2bc-e51d-45f0-a66f-95c38758fcd5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:58.359924 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2050/4076] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:33:58.364123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cd390-9e0d-4afe-98a6-eb4f58cf1cea admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:58.385707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cd390-9e0d-4afe-98a6-eb4f58cf1cea admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:58.391134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20455dc-e848-42b5-9b68-e21618dd99f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:58.391924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20455dc-e848-42b5-9b68-e21618dd99f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:58.392270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20455dc-e848-42b5-9b68-e21618dd99f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:58.392604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20455dc-e848-42b5-9b68-e21618dd99f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:58.393503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20455dc-e848-42b5-9b68-e21618dd99f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:58.395213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20455dc-e848-42b5-9b68-e21618dd99f3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:58.407498 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2027/4077] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:58.411744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0a2bc-e51d-45f0-a66f-95c38758fcd5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:58.423960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0a2bc-e51d-45f0-a66f-95c38758fcd5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:58.429731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df881634-61fc-4eb1-b4ef-33f1f43f23de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:58.430403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df881634-61fc-4eb1-b4ef-33f1f43f23de admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:58.430676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df881634-61fc-4eb1-b4ef-33f1f43f23de admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:58.430945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df881634-61fc-4eb1-b4ef-33f1f43f23de admin admin] PATH_INFO: `/v3/projects/38514305f7fc42b48f6956b66a8223a1/users/c615585ff031468b924b7afca5101857/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:58.449287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df881634-61fc-4eb1-b4ef-33f1f43f23de admin admin] RBAC: Authorizing `identity:create_grant(project_id=38514305f7fc42b48f6956b66a8223a1, user_id=c615585ff031468b924b7afca5101857, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:58.452053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df881634-61fc-4eb1-b4ef-33f1f43f23de admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:58.468768 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2051/4078] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:58 2022] PUT /identity/v3/projects/38514305f7fc42b48f6956b66a8223a1/users/c615585ff031468b924b7afca5101857/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:58.482074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b6bb7-ad24-4499-b5a0-6d16bf545c3b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:58.482435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b6bb7-ad24-4499-b5a0-6d16bf545c3b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:58.482792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b6bb7-ad24-4499-b5a0-6d16bf545c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:58.516590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-481b6bb7-ad24-4499-b5a0-6d16bf545c3b None None] MFA Rules not processed for user `c615585ff031468b924b7afca5101857`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:58.517993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-481b6bb7-ad24-4499-b5a0-6d16bf545c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:58.647203 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2028/4079] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:58 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:58.651998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df881634-61fc-4eb1-b4ef-33f1f43f23de admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:58.753175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df881634-61fc-4eb1-b4ef-33f1f43f23de admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:58.758767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424accdb-8520-4d24-8cd8-14e780371de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:58.759435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424accdb-8520-4d24-8cd8-14e780371de6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:58.759702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424accdb-8520-4d24-8cd8-14e780371de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:58.760019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424accdb-8520-4d24-8cd8-14e780371de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:58.762235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424accdb-8520-4d24-8cd8-14e780371de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:58.778638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424accdb-8520-4d24-8cd8-14e780371de6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:58.829012 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2052/4080] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:33:58 2022] POST /identity/v3/projects => generated 409 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:58.833261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b6bb7-ad24-4499-b5a0-6d16bf545c3b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:58.854395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b6bb7-ad24-4499-b5a0-6d16bf545c3b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:58.956480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cc20d-ffec-4f15-a747-dfa69d349aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:58.957235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cc20d-ffec-4f15-a747-dfa69d349aff admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:58.957514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cc20d-ffec-4f15-a747-dfa69d349aff admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:58.958240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cc20d-ffec-4f15-a747-dfa69d349aff admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:58.958522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cc20d-ffec-4f15-a747-dfa69d349aff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:58.961023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cc20d-ffec-4f15-a747-dfa69d349aff admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:58.995995 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2029/4081] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:33:58 2022] POST /identity/v3/users => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:33:59.000313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424accdb-8520-4d24-8cd8-14e780371de6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:59.011659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424accdb-8520-4d24-8cd8-14e780371de6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:59.016943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae731aa2-d0c5-4ed5-8141-59400c0a7b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:59.017568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae731aa2-d0c5-4ed5-8141-59400c0a7b52 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:59.017842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae731aa2-d0c5-4ed5-8141-59400c0a7b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:59.018223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae731aa2-d0c5-4ed5-8141-59400c0a7b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:59.018874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae731aa2-d0c5-4ed5-8141-59400c0a7b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:59.020605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae731aa2-d0c5-4ed5-8141-59400c0a7b52 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:59.035296 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2053/4082] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:33:59.038411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cc20d-ffec-4f15-a747-dfa69d349aff admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:59.050551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cc20d-ffec-4f15-a747-dfa69d349aff admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:59.058134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcac67b-ab2e-4c94-8ea3-113dd679660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:59.059121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcac67b-ab2e-4c94-8ea3-113dd679660b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:59.059651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcac67b-ab2e-4c94-8ea3-113dd679660b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:59.060040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcac67b-ab2e-4c94-8ea3-113dd679660b admin admin] PATH_INFO: `/v3/projects/cbf786de23ac4f98bfb40359dc4fbaa9/users/2c3daf0857f74d88bc2f25ca3fdc75b9/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:59.082626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcac67b-ab2e-4c94-8ea3-113dd679660b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf786de23ac4f98bfb40359dc4fbaa9, user_id=2c3daf0857f74d88bc2f25ca3fdc75b9, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:59.087568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcac67b-ab2e-4c94-8ea3-113dd679660b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:59.113238 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2030/4083] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:59 2022] PUT /identity/v3/projects/cbf786de23ac4f98bfb40359dc4fbaa9/users/2c3daf0857f74d88bc2f25ca3fdc75b9/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:33:59.114158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae731aa2-d0c5-4ed5-8141-59400c0a7b52 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:59.130670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae731aa2-d0c5-4ed5-8141-59400c0a7b52 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:59.240554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0cab5-9fd2-4bfc-b031-354d906ccb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:59.241493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0cab5-9fd2-4bfc-b031-354d906ccb76 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:59.241985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0cab5-9fd2-4bfc-b031-354d906ccb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:59.242418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0cab5-9fd2-4bfc-b031-354d906ccb76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:59.243233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0cab5-9fd2-4bfc-b031-354d906ccb76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:59.245696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0cab5-9fd2-4bfc-b031-354d906ccb76 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:59.260241 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2054/4084] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:33:59.264073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcac67b-ab2e-4c94-8ea3-113dd679660b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:59.279074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcac67b-ab2e-4c94-8ea3-113dd679660b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:59.280840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0cab5-9fd2-4bfc-b031-354d906ccb76 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:59.283956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d7e0cab5-9fd2-4bfc-b031-354d906ccb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:59.295113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49232b3f-1f92-454e-ae9a-df105837dd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:59.295922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49232b3f-1f92-454e-ae9a-df105837dd06 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:59.296249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49232b3f-1f92-454e-ae9a-df105837dd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:59.296530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49232b3f-1f92-454e-ae9a-df105837dd06 admin admin] PATH_INFO: `/v3/projects/cbf786de23ac4f98bfb40359dc4fbaa9/users/2c3daf0857f74d88bc2f25ca3fdc75b9/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:59.298997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49232b3f-1f92-454e-ae9a-df105837dd06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf786de23ac4f98bfb40359dc4fbaa9, user_id=2c3daf0857f74d88bc2f25ca3fdc75b9, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:59.313774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49232b3f-1f92-454e-ae9a-df105837dd06 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:59.322423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:59.325722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:33:59.330242 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2031/4085] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:33:59 2022] PUT /identity/v3/projects/cbf786de23ac4f98bfb40359dc4fbaa9/users/2c3daf0857f74d88bc2f25ca3fdc75b9/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:33:59.341986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7616a3e-faad-4159-97d8-101984625118 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:59.342447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7616a3e-faad-4159-97d8-101984625118 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:59.342822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7616a3e-faad-4159-97d8-101984625118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:59.376605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0cab5-9fd2-4bfc-b031-354d906ccb76 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:59.400991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e7616a3e-faad-4159-97d8-101984625118 None None] MFA Rules not processed for user `2c3daf0857f74d88bc2f25ca3fdc75b9`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:33:59.402702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e7616a3e-faad-4159-97d8-101984625118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:59.468734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eb38c-3be2-43a8-9a1d-d844797c62a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:59.469548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb38c-3be2-43a8-9a1d-d844797c62a6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:59.469922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb38c-3be2-43a8-9a1d-d844797c62a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:59.470290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb38c-3be2-43a8-9a1d-d844797c62a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:59.472370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b51eb38c-3be2-43a8-9a1d-d844797c62a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:33:59.545545 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2032/4086] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:33:59 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:33:59.560967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7616a3e-faad-4159-97d8-101984625118 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:33:59.573944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7616a3e-faad-4159-97d8-101984625118 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:33:59.581638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d42e97-832c-46ab-ab94-186f7a245635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:33:59.582328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d42e97-832c-46ab-ab94-186f7a245635 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:33:59.582703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d42e97-832c-46ab-ab94-186f7a245635 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:33:59.583032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d42e97-832c-46ab-ab94-186f7a245635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:33:59.595577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eb38c-3be2-43a8-9a1d-d844797c62a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:59.596391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d42e97-832c-46ab-ab94-186f7a245635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:33:59.597853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d42e97-832c-46ab-ab94-186f7a245635 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:59.599512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eb38c-3be2-43a8-9a1d-d844797c62a6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:33:59.611411 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2033/4087] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:59 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:33:59.634472 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2055/4088] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:33:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:34:01.278993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d42e97-832c-46ab-ab94-186f7a245635 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:01.288856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d42e97-832c-46ab-ab94-186f7a245635 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:01.293011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf577372-fed1-46d0-895d-96ababe7c0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:01.293685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf577372-fed1-46d0-895d-96ababe7c0be service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:01.294020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf577372-fed1-46d0-895d-96ababe7c0be service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:01.294354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf577372-fed1-46d0-895d-96ababe7c0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:01.296098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bf577372-fed1-46d0-895d-96ababe7c0be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:01.310396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf577372-fed1-46d0-895d-96ababe7c0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:01.312012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf577372-fed1-46d0-895d-96ababe7c0be service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:01.324052 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2034/4089] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:34:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:34:01.664759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eb38c-3be2-43a8-9a1d-d844797c62a6 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:01.671513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b51eb38c-3be2-43a8-9a1d-d844797c62a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:01.752056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eb38c-3be2-43a8-9a1d-d844797c62a6 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:01.757474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a22858-87fa-4017-8cc2-a5dcad5d50ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:01.758312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a22858-87fa-4017-8cc2-a5dcad5d50ba service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:01.758795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a22858-87fa-4017-8cc2-a5dcad5d50ba service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:01.759896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a22858-87fa-4017-8cc2-a5dcad5d50ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:01.763700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-10a22858-87fa-4017-8cc2-a5dcad5d50ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:01.793912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:01.836638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a22858-87fa-4017-8cc2-a5dcad5d50ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:01.838140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a22858-87fa-4017-8cc2-a5dcad5d50ba service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:01.857412 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2056/4090] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:34:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:34:02.075377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf577372-fed1-46d0-895d-96ababe7c0be service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:02.140466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf577372-fed1-46d0-895d-96ababe7c0be service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:02.145523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbb125-a5ed-43be-a741-685bcc7fa1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:02.146133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbb125-a5ed-43be-a741-685bcc7fa1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:02.146410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbb125-a5ed-43be-a741-685bcc7fa1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:02.146681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbb125-a5ed-43be-a741-685bcc7fa1a3 admin admin] PATH_INFO: `/v3/users/c615585ff031468b924b7afca5101857` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:02.147917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbb125-a5ed-43be-a741-685bcc7fa1a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c615585ff031468b924b7afca5101857)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:02.149925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbb125-a5ed-43be-a741-685bcc7fa1a3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:02.201312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-adbbb125-a5ed-43be-a741-685bcc7fa1a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c615585ff031468b924b7afca5101857'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:02.212553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:02.215163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-adbbb125-a5ed-43be-a741-685bcc7fa1a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c615585ff031468b924b7afca5101857'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:02.216081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-adbbb125-a5ed-43be-a741-685bcc7fa1a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c615585ff031468b924b7afca5101857'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:02.216796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-adbbb125-a5ed-43be-a741-685bcc7fa1a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c615585ff031468b924b7afca5101857'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:02.226776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-adbbb125-a5ed-43be-a741-685bcc7fa1a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c615585ff031468b924b7afca5101857'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:02.246656 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2035/4091] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:34:02 2022] DELETE /identity/v3/users/c615585ff031468b924b7afca5101857 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:02.249293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd5cfc-e440-4b79-af98-28c92979d707 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:02.249581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd5cfc-e440-4b79-af98-28c92979d707 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:02.249878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd5cfc-e440-4b79-af98-28c92979d707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:02.273478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-acbd5cfc-e440-4b79-af98-28c92979d707 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:02.275304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-acbd5cfc-e440-4b79-af98-28c92979d707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:02.345265 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2057/4092] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:02.360188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbb125-a5ed-43be-a741-685bcc7fa1a3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:02.362058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-adbbb125-a5ed-43be-a741-685bcc7fa1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:02.446619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbb125-a5ed-43be-a741-685bcc7fa1a3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:02.450393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ed282-4744-447e-bfe7-669b6eeba88a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:02.451030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ed282-4744-447e-bfe7-669b6eeba88a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:02.451340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ed282-4744-447e-bfe7-669b6eeba88a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:02.451616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ed282-4744-447e-bfe7-669b6eeba88a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:02.461233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ed282-4744-447e-bfe7-669b6eeba88a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:02.462656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ed282-4744-447e-bfe7-669b6eeba88a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:02.472762 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2036/4093] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:34:02.915902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd5cfc-e440-4b79-af98-28c92979d707 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:02.917543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-acbd5cfc-e440-4b79-af98-28c92979d707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:02.929960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd5cfc-e440-4b79-af98-28c92979d707 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:02.935548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b05405-0c43-4a30-a251-ac0f2acfbc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:02.936357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b05405-0c43-4a30-a251-ac0f2acfbc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:02.936715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b05405-0c43-4a30-a251-ac0f2acfbc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:02.937033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b05405-0c43-4a30-a251-ac0f2acfbc57 admin admin] PATH_INFO: `/v3/projects/38514305f7fc42b48f6956b66a8223a1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:02.938375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b05405-0c43-4a30-a251-ac0f2acfbc57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38514305f7fc42b48f6956b66a8223a1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:02.940325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b05405-0c43-4a30-a251-ac0f2acfbc57 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:02.991044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3b05405-0c43-4a30-a251-ac0f2acfbc57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38514305f7fc42b48f6956b66a8223a1', 'request_id': 'req-a3b05405-0c43-4a30-a251-ac0f2acfbc57'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:02.999194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3b05405-0c43-4a30-a251-ac0f2acfbc57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38514305f7fc42b48f6956b66a8223a1', 'request_id': 'req-a3b05405-0c43-4a30-a251-ac0f2acfbc57'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:03.004754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3b05405-0c43-4a30-a251-ac0f2acfbc57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38514305f7fc42b48f6956b66a8223a1', 'request_id': 'req-a3b05405-0c43-4a30-a251-ac0f2acfbc57'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:03.015802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3b05405-0c43-4a30-a251-ac0f2acfbc57 admin admin] The token cache is being invalidate because project 38514305f7fc42b48f6956b66a8223a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:34:03.016092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3b05405-0c43-4a30-a251-ac0f2acfbc57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:03.016732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3b05405-0c43-4a30-a251-ac0f2acfbc57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:03.018285 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2058/4094] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:34:02 2022] DELETE /identity/v3/projects/38514305f7fc42b48f6956b66a8223a1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:03.022355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ed282-4744-447e-bfe7-669b6eeba88a service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:03.032559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ed282-4744-447e-bfe7-669b6eeba88a service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:03.093666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12cddc-0f86-4528-a959-65f02f048bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:03.094292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12cddc-0f86-4528-a959-65f02f048bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:03.094570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12cddc-0f86-4528-a959-65f02f048bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:03.094844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12cddc-0f86-4528-a959-65f02f048bbf admin admin] PATH_INFO: `/v3/users/2c3daf0857f74d88bc2f25ca3fdc75b9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:03.095988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12cddc-0f86-4528-a959-65f02f048bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c3daf0857f74d88bc2f25ca3fdc75b9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:03.097942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12cddc-0f86-4528-a959-65f02f048bbf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:03.148567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb12cddc-0f86-4528-a959-65f02f048bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c3daf0857f74d88bc2f25ca3fdc75b9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:03.162189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb12cddc-0f86-4528-a959-65f02f048bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c3daf0857f74d88bc2f25ca3fdc75b9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:03.163112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb12cddc-0f86-4528-a959-65f02f048bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c3daf0857f74d88bc2f25ca3fdc75b9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:03.163917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb12cddc-0f86-4528-a959-65f02f048bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c3daf0857f74d88bc2f25ca3fdc75b9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:03.178199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb12cddc-0f86-4528-a959-65f02f048bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c3daf0857f74d88bc2f25ca3fdc75b9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:03.191014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:03.195735 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2037/4095] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:34:03 2022] DELETE /identity/v3/users/2c3daf0857f74d88bc2f25ca3fdc75b9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:03.383577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b05405-0c43-4a30-a251-ac0f2acfbc57 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:03.385236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a3b05405-0c43-4a30-a251-ac0f2acfbc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:03.406467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b05405-0c43-4a30-a251-ac0f2acfbc57 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:03.450475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:03.487568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f11632-ec0b-4bde-8197-fbd65a2973e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:03.488368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f11632-ec0b-4bde-8197-fbd65a2973e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:03.488554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f11632-ec0b-4bde-8197-fbd65a2973e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:03.488880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f11632-ec0b-4bde-8197-fbd65a2973e1 admin admin] PATH_INFO: `/v3/projects/cbf786de23ac4f98bfb40359dc4fbaa9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:03.490106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f11632-ec0b-4bde-8197-fbd65a2973e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf786de23ac4f98bfb40359dc4fbaa9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:03.492547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f11632-ec0b-4bde-8197-fbd65a2973e1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:03.563922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-45f11632-ec0b-4bde-8197-fbd65a2973e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf786de23ac4f98bfb40359dc4fbaa9', 'request_id': 'req-45f11632-ec0b-4bde-8197-fbd65a2973e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:03.584035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-45f11632-ec0b-4bde-8197-fbd65a2973e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf786de23ac4f98bfb40359dc4fbaa9', 'request_id': 'req-45f11632-ec0b-4bde-8197-fbd65a2973e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:03.592721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-45f11632-ec0b-4bde-8197-fbd65a2973e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf786de23ac4f98bfb40359dc4fbaa9', 'request_id': 'req-45f11632-ec0b-4bde-8197-fbd65a2973e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:03.606941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-45f11632-ec0b-4bde-8197-fbd65a2973e1 admin admin] The token cache is being invalidate because project cbf786de23ac4f98bfb40359dc4fbaa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:34:03.607314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-45f11632-ec0b-4bde-8197-fbd65a2973e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:03.607948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-45f11632-ec0b-4bde-8197-fbd65a2973e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:03.610183 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2059/4096] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:34:03 2022] DELETE /identity/v3/projects/cbf786de23ac4f98bfb40359dc4fbaa9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:03.615913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31fb1-adf0-4a1c-beb9-075d768a35be None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:03.616806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31fb1-adf0-4a1c-beb9-075d768a35be None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:03.617087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31fb1-adf0-4a1c-beb9-075d768a35be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:03.642783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4ac31fb1-adf0-4a1c-beb9-075d768a35be None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:03.644052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4ac31fb1-adf0-4a1c-beb9-075d768a35be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:03.735170 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2038/4097] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:03.743475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38409e95-e76d-4615-9d82-637b213697a6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:03.743764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38409e95-e76d-4615-9d82-637b213697a6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:03.744109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38409e95-e76d-4615-9d82-637b213697a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:03.783001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-38409e95-e76d-4615-9d82-637b213697a6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:03.784096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-38409e95-e76d-4615-9d82-637b213697a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:03.801224 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2060/4098] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:03.807113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac31fb1-adf0-4a1c-beb9-075d768a35be None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:03.822228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac31fb1-adf0-4a1c-beb9-075d768a35be None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:03.831608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037b6d5-3445-4d80-a1a5-02f1b108ffef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:03.833030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037b6d5-3445-4d80-a1a5-02f1b108ffef admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:03.833413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037b6d5-3445-4d80-a1a5-02f1b108ffef admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:03.833791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037b6d5-3445-4d80-a1a5-02f1b108ffef admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:03.835308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037b6d5-3445-4d80-a1a5-02f1b108ffef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:34:03.835688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037b6d5-3445-4d80-a1a5-02f1b108ffef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:03.837395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037b6d5-3445-4d80-a1a5-02f1b108ffef admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:03.850693 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2039/4099] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:34:03.855231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38409e95-e76d-4615-9d82-637b213697a6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:03.864719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38409e95-e76d-4615-9d82-637b213697a6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:03.869798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0935d-4083-4bc0-a2c8-9953596c506b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:03.870489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0935d-4083-4bc0-a2c8-9953596c506b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:03.872177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0935d-4083-4bc0-a2c8-9953596c506b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:03.872530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0935d-4083-4bc0-a2c8-9953596c506b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:03.873271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0935d-4083-4bc0-a2c8-9953596c506b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:03.875326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0935d-4083-4bc0-a2c8-9953596c506b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:03.908822 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2061/4100] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:34:03 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:34:03.913042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037b6d5-3445-4d80-a1a5-02f1b108ffef admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:03.926660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037b6d5-3445-4d80-a1a5-02f1b108ffef admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:04.037885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfd68d-d052-4141-9e8d-efe1216c77f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:04.038568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfd68d-d052-4141-9e8d-efe1216c77f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:04.038886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfd68d-d052-4141-9e8d-efe1216c77f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:04.039225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfd68d-d052-4141-9e8d-efe1216c77f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:04.040256 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfd68d-d052-4141-9e8d-efe1216c77f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:04.049324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfd68d-d052-4141-9e8d-efe1216c77f5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:04.073963 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2040/4101] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:34:03 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:34:04.078834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0935d-4083-4bc0-a2c8-9953596c506b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:04.093564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0935d-4083-4bc0-a2c8-9953596c506b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:04.099390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c052f-d645-47a7-b188-b5d69d30b99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:04.100016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c052f-d645-47a7-b188-b5d69d30b99e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:04.100295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c052f-d645-47a7-b188-b5d69d30b99e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:04.100570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c052f-d645-47a7-b188-b5d69d30b99e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:04.101222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c052f-d645-47a7-b188-b5d69d30b99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:04.102850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c052f-d645-47a7-b188-b5d69d30b99e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:04.113632 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2062/4102] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:34:04.117884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfd68d-d052-4141-9e8d-efe1216c77f5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:04.128503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfd68d-d052-4141-9e8d-efe1216c77f5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:04.133477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9d41d-fa87-4d7c-a5bf-8e63927afdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:04.134101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9d41d-fa87-4d7c-a5bf-8e63927afdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:04.134382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9d41d-fa87-4d7c-a5bf-8e63927afdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:04.134716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9d41d-fa87-4d7c-a5bf-8e63927afdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:04.135428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9d41d-fa87-4d7c-a5bf-8e63927afdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:04.137031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9d41d-fa87-4d7c-a5bf-8e63927afdd4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:04.149102 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2041/4103] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:34:04.153399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c052f-d645-47a7-b188-b5d69d30b99e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:04.164014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c052f-d645-47a7-b188-b5d69d30b99e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:04.168844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ea2a6-3ffa-4740-87a8-1c423c7162ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:04.169643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ea2a6-3ffa-4740-87a8-1c423c7162ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:04.169931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ea2a6-3ffa-4740-87a8-1c423c7162ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:04.170210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ea2a6-3ffa-4740-87a8-1c423c7162ca admin admin] PATH_INFO: `/v3/projects/49214e0a3263432298c5a4a50f485b3d/users/ab1041bfe6024e60859be061b013a0f1/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:04.185230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ea2a6-3ffa-4740-87a8-1c423c7162ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=49214e0a3263432298c5a4a50f485b3d, user_id=ab1041bfe6024e60859be061b013a0f1, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:04.187963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ea2a6-3ffa-4740-87a8-1c423c7162ca admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:04.203190 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2063/4104] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:34:04 2022] PUT /identity/v3/projects/49214e0a3263432298c5a4a50f485b3d/users/ab1041bfe6024e60859be061b013a0f1/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:04.295287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040663f-faf1-4290-b5e2-309bf1ef7ef6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:04.295600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040663f-faf1-4290-b5e2-309bf1ef7ef6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:04.295874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040663f-faf1-4290-b5e2-309bf1ef7ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:04.324454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e040663f-faf1-4290-b5e2-309bf1ef7ef6 None None] MFA Rules not processed for user `ab1041bfe6024e60859be061b013a0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:04.325714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e040663f-faf1-4290-b5e2-309bf1ef7ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:04.383570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:04.396543 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2042/4105] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:04.401130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ea2a6-3ffa-4740-87a8-1c423c7162ca admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:04.463702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ea2a6-3ffa-4740-87a8-1c423c7162ca admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:04.468802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e4069-fbb4-48ad-bdc2-56de8cc05b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:04.469441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e4069-fbb4-48ad-bdc2-56de8cc05b75 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:04.469723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e4069-fbb4-48ad-bdc2-56de8cc05b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:04.469996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e4069-fbb4-48ad-bdc2-56de8cc05b75 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:04.470630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e4069-fbb4-48ad-bdc2-56de8cc05b75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:04.472591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e4069-fbb4-48ad-bdc2-56de8cc05b75 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:04.482463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:04.504025 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2064/4106] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:34:04 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:34:04.508147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040663f-faf1-4290-b5e2-309bf1ef7ef6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:04.519186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040663f-faf1-4290-b5e2-309bf1ef7ef6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:04.589094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ca069-bec2-4e56-b179-c75a3728780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:04.589744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ca069-bec2-4e56-b179-c75a3728780c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:04.590154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ca069-bec2-4e56-b179-c75a3728780c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:04.590541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ca069-bec2-4e56-b179-c75a3728780c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:04.591330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ca069-bec2-4e56-b179-c75a3728780c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:04.593467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ca069-bec2-4e56-b179-c75a3728780c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:04.617202 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2043/4107] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:34:04 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:34:04.621676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e4069-fbb4-48ad-bdc2-56de8cc05b75 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:04.632737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e4069-fbb4-48ad-bdc2-56de8cc05b75 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:04.638269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53035f48-670a-4dd4-9629-58989bc93d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:04.638875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53035f48-670a-4dd4-9629-58989bc93d00 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:04.639152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53035f48-670a-4dd4-9629-58989bc93d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:04.639448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53035f48-670a-4dd4-9629-58989bc93d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:04.640090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53035f48-670a-4dd4-9629-58989bc93d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:04.641889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53035f48-670a-4dd4-9629-58989bc93d00 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:04.652892 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2065/4108] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:34:04.657013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ca069-bec2-4e56-b179-c75a3728780c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:04.667596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ca069-bec2-4e56-b179-c75a3728780c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:04.673127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2b378-5ce1-4306-bab8-ebefe2eaad8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:04.673737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2b378-5ce1-4306-bab8-ebefe2eaad8e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:04.674015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2b378-5ce1-4306-bab8-ebefe2eaad8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:04.674285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2b378-5ce1-4306-bab8-ebefe2eaad8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:04.674931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2b378-5ce1-4306-bab8-ebefe2eaad8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:04.676588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2b378-5ce1-4306-bab8-ebefe2eaad8e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:04.687417 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2044/4109] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:34:04.691693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53035f48-670a-4dd4-9629-58989bc93d00 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:04.702327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53035f48-670a-4dd4-9629-58989bc93d00 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:04.708230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9541e5-4bb8-4547-9a0c-48d0eefdbcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:04.708920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9541e5-4bb8-4547-9a0c-48d0eefdbcac admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:04.709190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9541e5-4bb8-4547-9a0c-48d0eefdbcac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:04.709462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9541e5-4bb8-4547-9a0c-48d0eefdbcac admin admin] PATH_INFO: `/v3/projects/0aa7e0d359804719b798d960ee281de1/users/8308ca781bab48b59dcb71a53fb0bccf/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:04.731150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9541e5-4bb8-4547-9a0c-48d0eefdbcac admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa7e0d359804719b798d960ee281de1, user_id=8308ca781bab48b59dcb71a53fb0bccf, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:04.734558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9541e5-4bb8-4547-9a0c-48d0eefdbcac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:04.760754 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2066/4110] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:34:04 2022] PUT /identity/v3/projects/0aa7e0d359804719b798d960ee281de1/users/8308ca781bab48b59dcb71a53fb0bccf/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:04.770984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45aa3b-64a3-44c4-8436-c2e5717a7eb4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:04.771289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45aa3b-64a3-44c4-8436-c2e5717a7eb4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:04.771718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45aa3b-64a3-44c4-8436-c2e5717a7eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:04.808064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2f45aa3b-64a3-44c4-8436-c2e5717a7eb4 None None] MFA Rules not processed for user `8308ca781bab48b59dcb71a53fb0bccf`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:04.809337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2f45aa3b-64a3-44c4-8436-c2e5717a7eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:04.887990 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2045/4111] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:04.892510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9541e5-4bb8-4547-9a0c-48d0eefdbcac admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:04.988094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9541e5-4bb8-4547-9a0c-48d0eefdbcac admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:04.992813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4d267-1cd8-42e5-9b6e-bf1cc0d0d0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:04.993466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4d267-1cd8-42e5-9b6e-bf1cc0d0d0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:04.993694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4d267-1cd8-42e5-9b6e-bf1cc0d0d0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:04.994019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4d267-1cd8-42e5-9b6e-bf1cc0d0d0e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:04.994666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4d267-1cd8-42e5-9b6e-bf1cc0d0d0e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:04.996632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4d267-1cd8-42e5-9b6e-bf1cc0d0d0e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:05.031326 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2067/4112] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:34:04 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:34:05.033013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45aa3b-64a3-44c4-8436-c2e5717a7eb4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:05.044285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45aa3b-64a3-44c4-8436-c2e5717a7eb4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:05.117125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ee9a0-046a-4c74-8523-6ec82f31b434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:05.118062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ee9a0-046a-4c74-8523-6ec82f31b434 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:05.118581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ee9a0-046a-4c74-8523-6ec82f31b434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:05.119122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ee9a0-046a-4c74-8523-6ec82f31b434 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:05.120236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ee9a0-046a-4c74-8523-6ec82f31b434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:05.124180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ee9a0-046a-4c74-8523-6ec82f31b434 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:05.138617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:05.156107 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2046/4113] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:34:05 2022] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:34:05.159732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4d267-1cd8-42e5-9b6e-bf1cc0d0d0e7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:05.173531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4d267-1cd8-42e5-9b6e-bf1cc0d0d0e7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:05.178879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2130c-3598-4e97-8534-6b0986d96c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:05.180651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2130c-3598-4e97-8534-6b0986d96c91 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:05.181318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2130c-3598-4e97-8534-6b0986d96c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:05.181845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2130c-3598-4e97-8534-6b0986d96c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:05.182806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2130c-3598-4e97-8534-6b0986d96c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:05.184759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2130c-3598-4e97-8534-6b0986d96c91 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:05.200363 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2068/4114] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:34:05.204399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ee9a0-046a-4c74-8523-6ec82f31b434 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:05.223388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ee9a0-046a-4c74-8523-6ec82f31b434 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:05.231130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef54b4-5775-4ff2-86b6-fac671dae5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:05.232084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef54b4-5775-4ff2-86b6-fac671dae5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:05.232483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef54b4-5775-4ff2-86b6-fac671dae5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:05.232854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef54b4-5775-4ff2-86b6-fac671dae5e2 admin admin] PATH_INFO: `/v3/projects/51bc411c959740eabd7f96bb99527d08/users/6f5b7c5603d741408519ee1342b75cae/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:05.255564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef54b4-5775-4ff2-86b6-fac671dae5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51bc411c959740eabd7f96bb99527d08, user_id=6f5b7c5603d741408519ee1342b75cae, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:05.258854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef54b4-5775-4ff2-86b6-fac671dae5e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:05.274024 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2047/4115] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:34:05 2022] PUT /identity/v3/projects/51bc411c959740eabd7f96bb99527d08/users/6f5b7c5603d741408519ee1342b75cae/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:05.278258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2130c-3598-4e97-8534-6b0986d96c91 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:05.290088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2130c-3598-4e97-8534-6b0986d96c91 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:05.360766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e7bae-03f7-483a-b5d0-1bdcd493bfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:05.361772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e7bae-03f7-483a-b5d0-1bdcd493bfdc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:05.362284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e7bae-03f7-483a-b5d0-1bdcd493bfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:05.362757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e7bae-03f7-483a-b5d0-1bdcd493bfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:05.363455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e7bae-03f7-483a-b5d0-1bdcd493bfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:05.365030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e7bae-03f7-483a-b5d0-1bdcd493bfdc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:05.375372 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2069/4116] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:34:05.379491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef54b4-5775-4ff2-86b6-fac671dae5e2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:05.390246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef54b4-5775-4ff2-86b6-fac671dae5e2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:05.395002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2775f-f1f0-4e09-92b6-5fdd3e9bcd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:05.395931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2775f-f1f0-4e09-92b6-5fdd3e9bcd8f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:05.396206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2775f-f1f0-4e09-92b6-5fdd3e9bcd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:05.396844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2775f-f1f0-4e09-92b6-5fdd3e9bcd8f admin admin] PATH_INFO: `/v3/projects/51bc411c959740eabd7f96bb99527d08/users/6f5b7c5603d741408519ee1342b75cae/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:05.399024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2775f-f1f0-4e09-92b6-5fdd3e9bcd8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=51bc411c959740eabd7f96bb99527d08, user_id=6f5b7c5603d741408519ee1342b75cae, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:05.401715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2775f-f1f0-4e09-92b6-5fdd3e9bcd8f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:05.412683 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2048/4117] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:34:05 2022] PUT /identity/v3/projects/51bc411c959740eabd7f96bb99527d08/users/6f5b7c5603d741408519ee1342b75cae/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:05.424134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0ee6e-5741-4713-988c-a47e0eb138c4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:05.424457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0ee6e-5741-4713-988c-a47e0eb138c4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:05.424741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0ee6e-5741-4713-988c-a47e0eb138c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:05.453531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9dd0ee6e-5741-4713-988c-a47e0eb138c4 None None] MFA Rules not processed for user `6f5b7c5603d741408519ee1342b75cae`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:05.454753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9dd0ee6e-5741-4713-988c-a47e0eb138c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:05.467500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:05.529175 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2070/4118] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:05.539460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2775f-f1f0-4e09-92b6-5fdd3e9bcd8f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:05.541534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b3f2775f-f1f0-4e09-92b6-5fdd3e9bcd8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:05.602262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2775f-f1f0-4e09-92b6-5fdd3e9bcd8f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:05.606468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd2702-e0e6-47f4-b1a2-4b547ce6bd4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:05.607072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd2702-e0e6-47f4-b1a2-4b547ce6bd4a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:05.607383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd2702-e0e6-47f4-b1a2-4b547ce6bd4a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:05.607654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd2702-e0e6-47f4-b1a2-4b547ce6bd4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:05.668122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd2702-e0e6-47f4-b1a2-4b547ce6bd4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:05.669536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd2702-e0e6-47f4-b1a2-4b547ce6bd4a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:05.678697 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2049/4119] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:34:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:34:07.254826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0ee6e-5741-4713-988c-a47e0eb138c4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:07.258523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9dd0ee6e-5741-4713-988c-a47e0eb138c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:07.273385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0ee6e-5741-4713-988c-a47e0eb138c4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:07.277657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74d34c-565a-4058-97ac-a9bcc642ca73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:07.278363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74d34c-565a-4058-97ac-a9bcc642ca73 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:07.278708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74d34c-565a-4058-97ac-a9bcc642ca73 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:07.279084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74d34c-565a-4058-97ac-a9bcc642ca73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:07.281183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb74d34c-565a-4058-97ac-a9bcc642ca73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:07.293534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74d34c-565a-4058-97ac-a9bcc642ca73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:07.295415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74d34c-565a-4058-97ac-a9bcc642ca73 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:07.305455 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2071/4120] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:34:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:34:07.567935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab453fed-333d-4fbd-bc30-a92658cda9cc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:07.568416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab453fed-333d-4fbd-bc30-a92658cda9cc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:07.568657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab453fed-333d-4fbd-bc30-a92658cda9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:07.632725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ab453fed-333d-4fbd-bc30-a92658cda9cc None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:07.634060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ab453fed-333d-4fbd-bc30-a92658cda9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:07.741662 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2050/4121] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:34:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:07.758268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74d34c-565a-4058-97ac-a9bcc642ca73 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:07.759979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb74d34c-565a-4058-97ac-a9bcc642ca73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:07.840073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74d34c-565a-4058-97ac-a9bcc642ca73 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:07.846697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a85bab-72d6-4aed-8c6c-c9c110750cb9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:07.846697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a85bab-72d6-4aed-8c6c-c9c110750cb9 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:07.846992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a85bab-72d6-4aed-8c6c-c9c110750cb9 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:07.847110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a85bab-72d6-4aed-8c6c-c9c110750cb9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:07.863521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a85bab-72d6-4aed-8c6c-c9c110750cb9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:07.865583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a85bab-72d6-4aed-8c6c-c9c110750cb9 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:07.888020 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2072/4122] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:34:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:34:13.241757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82d6a-381f-4e99-857c-e72f309fc83f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:13.242733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82d6a-381f-4e99-857c-e72f309fc83f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:13.243490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82d6a-381f-4e99-857c-e72f309fc83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:13.294490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e3b82d6a-381f-4e99-857c-e72f309fc83f None None] MFA Rules not processed for user `88d03e1bf0b046018b4664606af4497a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:13.295761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e3b82d6a-381f-4e99-857c-e72f309fc83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:13.310613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:13.446077 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2051/4123] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:13.543476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b71ba9-e118-4d24-a8fa-1ce711785895 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:13.544069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b71ba9-e118-4d24-a8fa-1ce711785895 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:13.544321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b71ba9-e118-4d24-a8fa-1ce711785895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:13.582034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f6b71ba9-e118-4d24-a8fa-1ce711785895 None None] MFA Rules not processed for user `88d03e1bf0b046018b4664606af4497a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:13.584657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f6b71ba9-e118-4d24-a8fa-1ce711785895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:13.618254 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2073/4124] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:13.664357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee1ce0-cd86-4a25-80dd-a3bd5b8500f0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:13.664690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee1ce0-cd86-4a25-80dd-a3bd5b8500f0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:13.664970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee1ce0-cd86-4a25-80dd-a3bd5b8500f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:13.694859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-76ee1ce0-cd86-4a25-80dd-a3bd5b8500f0 None None] MFA Rules not processed for user `88d03e1bf0b046018b4664606af4497a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:13.696695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-76ee1ce0-cd86-4a25-80dd-a3bd5b8500f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:13.733678 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2052/4125] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:13.747024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961dffb-30e3-44bb-bdea-555946d1d8a6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:13.747619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961dffb-30e3-44bb-bdea-555946d1d8a6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:13.748127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961dffb-30e3-44bb-bdea-555946d1d8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:13.784144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7961dffb-30e3-44bb-bdea-555946d1d8a6 None None] MFA Rules not processed for user `88d03e1bf0b046018b4664606af4497a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:13.785656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7961dffb-30e3-44bb-bdea-555946d1d8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:13.799371 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2074/4126] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:13.834741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e82f58-81a5-47be-9586-fca4eebc6f4c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:13.835149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e82f58-81a5-47be-9586-fca4eebc6f4c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:13.835589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e82f58-81a5-47be-9586-fca4eebc6f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:13.889371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-17e82f58-81a5-47be-9586-fca4eebc6f4c None None] MFA Rules not processed for user `88d03e1bf0b046018b4664606af4497a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:13.892516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-17e82f58-81a5-47be-9586-fca4eebc6f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:13.911766 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2053/4127] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:16.817274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b0855-eb28-4eac-af0f-0ea2e6936954 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:16.817788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b0855-eb28-4eac-af0f-0ea2e6936954 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:16.817888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b0855-eb28-4eac-af0f-0ea2e6936954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:16.871309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1f2b0855-eb28-4eac-af0f-0ea2e6936954 None None] MFA Rules not processed for user `dbf15e3294dc4450835847a05ad0ee7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:16.873044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1f2b0855-eb28-4eac-af0f-0ea2e6936954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:17.029146 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2075/4128] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:18.794934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e82f58-81a5-47be-9586-fca4eebc6f4c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:18.811162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e82f58-81a5-47be-9586-fca4eebc6f4c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:18.838796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a865a6a-56f4-4846-8e86-5f2842212a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:18.840930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a865a6a-56f4-4846-8e86-5f2842212a09 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:18.841160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a865a6a-56f4-4846-8e86-5f2842212a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:18.841435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a865a6a-56f4-4846-8e86-5f2842212a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:18.870210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a865a6a-56f4-4846-8e86-5f2842212a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:18.871718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a865a6a-56f4-4846-8e86-5f2842212a09 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:18.892183 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2054/4129] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:34:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:34:18.969238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8857f19-c264-442a-8c37-bbd27263e8b7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:18.970138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8857f19-c264-442a-8c37-bbd27263e8b7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:18.970532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8857f19-c264-442a-8c37-bbd27263e8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:19.014679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e8857f19-c264-442a-8c37-bbd27263e8b7 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:19.016988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e8857f19-c264-442a-8c37-bbd27263e8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:19.038544 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2076/4130] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:34:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:19.060897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a865a6a-56f4-4846-8e86-5f2842212a09 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:19.081709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a865a6a-56f4-4846-8e86-5f2842212a09 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:19.093483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11ee67-8a95-4043-886b-ed2b9ee7fccc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:19.094109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11ee67-8a95-4043-886b-ed2b9ee7fccc service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:19.094430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11ee67-8a95-4043-886b-ed2b9ee7fccc service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:19.094711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11ee67-8a95-4043-886b-ed2b9ee7fccc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:19.114678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11ee67-8a95-4043-886b-ed2b9ee7fccc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:19.121913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11ee67-8a95-4043-886b-ed2b9ee7fccc service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:19.171314 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2055/4131] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:34:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:34:26.338827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8857f19-c264-442a-8c37-bbd27263e8b7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:26.340307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e8857f19-c264-442a-8c37-bbd27263e8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:26.364464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:26.537890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8857f19-c264-442a-8c37-bbd27263e8b7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:26.545918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c766e-d7b1-4954-a936-d4d5934042e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:26.548764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c766e-d7b1-4954-a936-d4d5934042e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:26.549314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c766e-d7b1-4954-a936-d4d5934042e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:26.550000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c766e-d7b1-4954-a936-d4d5934042e0 admin admin] PATH_INFO: `/v3/users/88d03e1bf0b046018b4664606af4497a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:26.561003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c766e-d7b1-4954-a936-d4d5934042e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88d03e1bf0b046018b4664606af4497a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:26.563489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c766e-d7b1-4954-a936-d4d5934042e0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:26.667203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e39c766e-d7b1-4954-a936-d4d5934042e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88d03e1bf0b046018b4664606af4497a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:26.668231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e39c766e-d7b1-4954-a936-d4d5934042e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88d03e1bf0b046018b4664606af4497a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:26.677954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e39c766e-d7b1-4954-a936-d4d5934042e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88d03e1bf0b046018b4664606af4497a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:26.691287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e39c766e-d7b1-4954-a936-d4d5934042e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88d03e1bf0b046018b4664606af4497a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:26.710908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e39c766e-d7b1-4954-a936-d4d5934042e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88d03e1bf0b046018b4664606af4497a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:26.720393 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2077/4132] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:34:26 2022] DELETE /identity/v3/users/88d03e1bf0b046018b4664606af4497a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:27.141860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11ee67-8a95-4043-886b-ed2b9ee7fccc service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:27.157561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11ee67-8a95-4043-886b-ed2b9ee7fccc service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:27.318574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ef257-033e-4a45-bf73-e59b7658cd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:27.320103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ef257-033e-4a45-bf73-e59b7658cd35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:27.320600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ef257-033e-4a45-bf73-e59b7658cd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:27.321151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ef257-033e-4a45-bf73-e59b7658cd35 admin admin] PATH_INFO: `/v3/projects/e47b021d8b6a41d58e072bec7137ae20` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:27.328357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ef257-033e-4a45-bf73-e59b7658cd35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e47b021d8b6a41d58e072bec7137ae20)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:27.330583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ef257-033e-4a45-bf73-e59b7658cd35 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:27.437837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8e6ef257-033e-4a45-bf73-e59b7658cd35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e47b021d8b6a41d58e072bec7137ae20', 'request_id': 'req-8e6ef257-033e-4a45-bf73-e59b7658cd35'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:27.454937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8e6ef257-033e-4a45-bf73-e59b7658cd35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e47b021d8b6a41d58e072bec7137ae20', 'request_id': 'req-8e6ef257-033e-4a45-bf73-e59b7658cd35'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:27.469793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8e6ef257-033e-4a45-bf73-e59b7658cd35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e47b021d8b6a41d58e072bec7137ae20', 'request_id': 'req-8e6ef257-033e-4a45-bf73-e59b7658cd35'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:27.500338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8e6ef257-033e-4a45-bf73-e59b7658cd35 admin admin] The token cache is being invalidate because project e47b021d8b6a41d58e072bec7137ae20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:34:27.500717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8e6ef257-033e-4a45-bf73-e59b7658cd35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:27.503882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8e6ef257-033e-4a45-bf73-e59b7658cd35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:27.510989 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2056/4133] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:34:27 2022] DELETE /identity/v3/projects/e47b021d8b6a41d58e072bec7137ae20 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:27.512872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5402a-448a-4079-b552-cf49bd150229 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:27.513363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5402a-448a-4079-b552-cf49bd150229 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:27.513479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5402a-448a-4079-b552-cf49bd150229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:27.580800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c6f5402a-448a-4079-b552-cf49bd150229 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:27.592803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c6f5402a-448a-4079-b552-cf49bd150229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:27.728360 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2078/4134] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:27.738241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7ba07-496f-4557-8ece-f66625f64285 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:27.738526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7ba07-496f-4557-8ece-f66625f64285 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:27.738803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7ba07-496f-4557-8ece-f66625f64285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:27.796762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-60d7ba07-496f-4557-8ece-f66625f64285 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:27.798369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-60d7ba07-496f-4557-8ece-f66625f64285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:27.807481 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2057/4135] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:27.813621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5402a-448a-4079-b552-cf49bd150229 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:27.841830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5402a-448a-4079-b552-cf49bd150229 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:27.850867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27b2d2-5beb-4d3c-bfe8-f23cd8198f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:27.853130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27b2d2-5beb-4d3c-bfe8-f23cd8198f3b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:27.854033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27b2d2-5beb-4d3c-bfe8-f23cd8198f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:27.854033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27b2d2-5beb-4d3c-bfe8-f23cd8198f3b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:27.854642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27b2d2-5beb-4d3c-bfe8-f23cd8198f3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:34:27.855089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27b2d2-5beb-4d3c-bfe8-f23cd8198f3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:27.857686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27b2d2-5beb-4d3c-bfe8-f23cd8198f3b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:27.885994 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2079/4136] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:34:27.888306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7ba07-496f-4557-8ece-f66625f64285 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:27.906088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:27.920675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7ba07-496f-4557-8ece-f66625f64285 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:27.950755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae097e-6ddc-49be-9c72-b654520debd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:27.951664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae097e-6ddc-49be-9c72-b654520debd7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:27.952043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae097e-6ddc-49be-9c72-b654520debd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:27.952413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae097e-6ddc-49be-9c72-b654520debd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:27.953192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae097e-6ddc-49be-9c72-b654520debd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:27.955246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae097e-6ddc-49be-9c72-b654520debd7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:28.014112 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2058/4137] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:34:27 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:34:28.014889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27b2d2-5beb-4d3c-bfe8-f23cd8198f3b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:28.034276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27b2d2-5beb-4d3c-bfe8-f23cd8198f3b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:28.072001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:28.171359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f398a85-858e-484e-b5b6-b39397f601cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:28.172124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f398a85-858e-484e-b5b6-b39397f601cb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:28.172483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f398a85-858e-484e-b5b6-b39397f601cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:28.173133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f398a85-858e-484e-b5b6-b39397f601cb admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:28.174201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f398a85-858e-484e-b5b6-b39397f601cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:28.177709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f398a85-858e-484e-b5b6-b39397f601cb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:28.235296 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2080/4138] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:34:28 2022] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:34:28.244467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae097e-6ddc-49be-9c72-b654520debd7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:28.256678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae097e-6ddc-49be-9c72-b654520debd7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:28.266914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfd093-cea2-4d97-bad9-f45aae832e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:28.269411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfd093-cea2-4d97-bad9-f45aae832e49 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:28.269819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfd093-cea2-4d97-bad9-f45aae832e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:28.270677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfd093-cea2-4d97-bad9-f45aae832e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:28.270880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfd093-cea2-4d97-bad9-f45aae832e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:28.274074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfd093-cea2-4d97-bad9-f45aae832e49 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:28.296073 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2059/4139] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:34:28.298207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f398a85-858e-484e-b5b6-b39397f601cb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:28.322539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f398a85-858e-484e-b5b6-b39397f601cb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:28.332116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b4924-be3e-4762-b893-b8c517c63905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:28.334303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b4924-be3e-4762-b893-b8c517c63905 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:28.335087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b4924-be3e-4762-b893-b8c517c63905 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:28.335570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b4924-be3e-4762-b893-b8c517c63905 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:28.336780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b4924-be3e-4762-b893-b8c517c63905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:28.338368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b4924-be3e-4762-b893-b8c517c63905 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:28.361541 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2081/4140] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:34:28.365984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfd093-cea2-4d97-bad9-f45aae832e49 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:28.392820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfd093-cea2-4d97-bad9-f45aae832e49 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:28.399674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68378ace-03a1-4164-a5cc-73ecce4a9e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:28.401341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378ace-03a1-4164-a5cc-73ecce4a9e0c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:28.401632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378ace-03a1-4164-a5cc-73ecce4a9e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:28.402091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378ace-03a1-4164-a5cc-73ecce4a9e0c admin admin] PATH_INFO: `/v3/projects/5f6f7bdca1204a21b25be5648a6371c1/users/26ec1e64e01348a19f4007326d5f6536/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:28.421647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68378ace-03a1-4164-a5cc-73ecce4a9e0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6f7bdca1204a21b25be5648a6371c1, user_id=26ec1e64e01348a19f4007326d5f6536, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:28.425275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68378ace-03a1-4164-a5cc-73ecce4a9e0c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:28.451013 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2060/4141] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:34:28 2022] PUT /identity/v3/projects/5f6f7bdca1204a21b25be5648a6371c1/users/26ec1e64e01348a19f4007326d5f6536/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:28.452462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86713782-7e32-49b5-83c7-6c6a2dee6aec None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:28.452752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86713782-7e32-49b5-83c7-6c6a2dee6aec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:28.452846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86713782-7e32-49b5-83c7-6c6a2dee6aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:28.487244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-86713782-7e32-49b5-83c7-6c6a2dee6aec None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:28.488547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-86713782-7e32-49b5-83c7-6c6a2dee6aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:28.595286 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2082/4142] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:34:28.606475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68378ace-03a1-4164-a5cc-73ecce4a9e0c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:28.608960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-68378ace-03a1-4164-a5cc-73ecce4a9e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:28.725689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68378ace-03a1-4164-a5cc-73ecce4a9e0c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:28.730269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7668a-856d-4021-a60b-c44d82075c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:28.732026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7668a-856d-4021-a60b-c44d82075c9c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:28.732277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7668a-856d-4021-a60b-c44d82075c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:28.732617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7668a-856d-4021-a60b-c44d82075c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:28.759365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7668a-856d-4021-a60b-c44d82075c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:28.762774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7668a-856d-4021-a60b-c44d82075c9c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:28.792104 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2061/4143] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:34:29.144986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86713782-7e32-49b5-83c7-6c6a2dee6aec None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:29.147339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-86713782-7e32-49b5-83c7-6c6a2dee6aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:29.187181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86713782-7e32-49b5-83c7-6c6a2dee6aec None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:29.195347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86a556-ed37-4943-bd67-73ff1f3bff31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:29.196288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86a556-ed37-4943-bd67-73ff1f3bff31 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:29.196669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86a556-ed37-4943-bd67-73ff1f3bff31 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:29.197086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86a556-ed37-4943-bd67-73ff1f3bff31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:29.200013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0e86a556-ed37-4943-bd67-73ff1f3bff31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:29.341239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86a556-ed37-4943-bd67-73ff1f3bff31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:29.343044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86a556-ed37-4943-bd67-73ff1f3bff31 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:29.367003 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2083/4144] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:34:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:34:30.909664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7668a-856d-4021-a60b-c44d82075c9c service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:30.911140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f8a7668a-856d-4021-a60b-c44d82075c9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:31.155137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7668a-856d-4021-a60b-c44d82075c9c service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:31.168478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a2469-e1e1-42da-9376-ff63b8eedc87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:31.169540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a2469-e1e1-42da-9376-ff63b8eedc87 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:31.170511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a2469-e1e1-42da-9376-ff63b8eedc87 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:31.171237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a2469-e1e1-42da-9376-ff63b8eedc87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:31.173931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5a4a2469-e1e1-42da-9376-ff63b8eedc87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:31.294811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:31.316816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a2469-e1e1-42da-9376-ff63b8eedc87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:31.329223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a2469-e1e1-42da-9376-ff63b8eedc87 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:31.357774 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2062/4145] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:34:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:34:32.176507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86a556-ed37-4943-bd67-73ff1f3bff31 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:32.196545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86a556-ed37-4943-bd67-73ff1f3bff31 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:32.218829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69709d91-53c4-42ed-a1e3-f08f75fca71b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:32.236981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69709d91-53c4-42ed-a1e3-f08f75fca71b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:32.237914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69709d91-53c4-42ed-a1e3-f08f75fca71b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:32.239334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69709d91-53c4-42ed-a1e3-f08f75fca71b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:32.243023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-69709d91-53c4-42ed-a1e3-f08f75fca71b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:32.282215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69709d91-53c4-42ed-a1e3-f08f75fca71b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:32.284004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69709d91-53c4-42ed-a1e3-f08f75fca71b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:32.316892 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2084/4146] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:34:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:34:34.703076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a2469-e1e1-42da-9376-ff63b8eedc87 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:34.718913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a2469-e1e1-42da-9376-ff63b8eedc87 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:34.729881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161c40d-cc67-4334-9276-b23783e90678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:34.730516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161c40d-cc67-4334-9276-b23783e90678 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:34.730789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161c40d-cc67-4334-9276-b23783e90678 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:34.731056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161c40d-cc67-4334-9276-b23783e90678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:34.738771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2161c40d-cc67-4334-9276-b23783e90678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:34.752948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161c40d-cc67-4334-9276-b23783e90678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:34.754564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161c40d-cc67-4334-9276-b23783e90678 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:34.766240 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2063/4147] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:34:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:34:37.634649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69709d91-53c4-42ed-a1e3-f08f75fca71b service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:37.636937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-69709d91-53c4-42ed-a1e3-f08f75fca71b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:37.660755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69709d91-53c4-42ed-a1e3-f08f75fca71b service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:37.676123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81771dd3-58db-4f0c-82ac-2b387c64bb31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:37.677080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81771dd3-58db-4f0c-82ac-2b387c64bb31 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:37.677531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81771dd3-58db-4f0c-82ac-2b387c64bb31 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:37.677964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81771dd3-58db-4f0c-82ac-2b387c64bb31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:37.683855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-81771dd3-58db-4f0c-82ac-2b387c64bb31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:37.709522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81771dd3-58db-4f0c-82ac-2b387c64bb31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:37.715821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81771dd3-58db-4f0c-82ac-2b387c64bb31 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:37.757216 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2085/4148] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:34:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:34:38.030170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5680516-4fb4-4a14-8185-8cbd5b5e8ec4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:38.031439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5680516-4fb4-4a14-8185-8cbd5b5e8ec4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:38.031936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5680516-4fb4-4a14-8185-8cbd5b5e8ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:38.053219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e5680516-4fb4-4a14-8185-8cbd5b5e8ec4 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:38.054770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e5680516-4fb4-4a14-8185-8cbd5b5e8ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:38.127854 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2064/4149] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:34:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:38.164515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81771dd3-58db-4f0c-82ac-2b387c64bb31 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:38.166530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-81771dd3-58db-4f0c-82ac-2b387c64bb31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:38.182005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:38.291632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81771dd3-58db-4f0c-82ac-2b387c64bb31 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:38.297425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e82ab-534b-4464-a8b7-ad067a85c2f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:38.298543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e82ab-534b-4464-a8b7-ad067a85c2f0 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:38.298830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e82ab-534b-4464-a8b7-ad067a85c2f0 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:38.299414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e82ab-534b-4464-a8b7-ad067a85c2f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:38.311031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e82ab-534b-4464-a8b7-ad067a85c2f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:38.312725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e82ab-534b-4464-a8b7-ad067a85c2f0 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:38.323290 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2086/4150] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:34:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:34:38.950910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4a005-6e66-40d9-af23-42ebd715cbaf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:38.951492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4a005-6e66-40d9-af23-42ebd715cbaf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:38.951952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4a005-6e66-40d9-af23-42ebd715cbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:39.094103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bcd4a005-6e66-40d9-af23-42ebd715cbaf None None] MFA Rules not processed for user `26ec1e64e01348a19f4007326d5f6536`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:39.102954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bcd4a005-6e66-40d9-af23-42ebd715cbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:39.310882 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2065/4151] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:39.312982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0602444-dc0d-4f57-8306-7ba098e6451d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:39.313469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0602444-dc0d-4f57-8306-7ba098e6451d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:39.313576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0602444-dc0d-4f57-8306-7ba098e6451d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:39.339086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b0602444-dc0d-4f57-8306-7ba098e6451d None None] MFA Rules not processed for user `26ec1e64e01348a19f4007326d5f6536`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:39.341304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0602444-dc0d-4f57-8306-7ba098e6451d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:39.372829 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2087/4152] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:39.384950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4a005-6e66-40d9-af23-42ebd715cbaf None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:39.402890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4a005-6e66-40d9-af23-42ebd715cbaf None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:39.410269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dff34-50a2-4f63-b0c0-67ed49d9dc4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:39.410694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dff34-50a2-4f63-b0c0-67ed49d9dc4d service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:39.411097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dff34-50a2-4f63-b0c0-67ed49d9dc4d service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:39.411335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dff34-50a2-4f63-b0c0-67ed49d9dc4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:39.421529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dff34-50a2-4f63-b0c0-67ed49d9dc4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:39.423577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dff34-50a2-4f63-b0c0-67ed49d9dc4d service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:39.452991 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2066/4153] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:34:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:34:40.417649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0602444-dc0d-4f57-8306-7ba098e6451d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:40.419969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0602444-dc0d-4f57-8306-7ba098e6451d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:40.628134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0602444-dc0d-4f57-8306-7ba098e6451d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:40.657242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56571b-dc8f-4734-9337-52cfefc90148 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:40.661914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56571b-dc8f-4734-9337-52cfefc90148 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:40.662245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56571b-dc8f-4734-9337-52cfefc90148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:40.674024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cae26-40f3-4270-8070-77673996a179 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:40.674682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cae26-40f3-4270-8070-77673996a179 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:40.674965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cae26-40f3-4270-8070-77673996a179 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:40.675270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cae26-40f3-4270-8070-77673996a179 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:40.679033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c0cae26-40f3-4270-8070-77673996a179 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:40.711939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cc56571b-dc8f-4734-9337-52cfefc90148 None None] MFA Rules not processed for user `26ec1e64e01348a19f4007326d5f6536`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:40.716140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cc56571b-dc8f-4734-9337-52cfefc90148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:40.734466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0cae26-40f3-4270-8070-77673996a179 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:40.738896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0cae26-40f3-4270-8070-77673996a179 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:40.753232 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2067/4154] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:40.776885 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2088/4155] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:34:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:34:47.228161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56571b-dc8f-4734-9337-52cfefc90148 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:47.230378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cc56571b-dc8f-4734-9337-52cfefc90148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:47.262701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56571b-dc8f-4734-9337-52cfefc90148 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:47.274325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32596f-60f5-4bb1-adfe-1dcf95e8cafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:47.275935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32596f-60f5-4bb1-adfe-1dcf95e8cafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:47.276691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32596f-60f5-4bb1-adfe-1dcf95e8cafc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:47.277623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32596f-60f5-4bb1-adfe-1dcf95e8cafc admin admin] PATH_INFO: `/v3/users/ab1041bfe6024e60859be061b013a0f1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:47.280111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32596f-60f5-4bb1-adfe-1dcf95e8cafc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1041bfe6024e60859be061b013a0f1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:47.285123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32596f-60f5-4bb1-adfe-1dcf95e8cafc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:47.465267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:47.480052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0e32596f-60f5-4bb1-adfe-1dcf95e8cafc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1041bfe6024e60859be061b013a0f1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:47.511789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0e32596f-60f5-4bb1-adfe-1dcf95e8cafc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1041bfe6024e60859be061b013a0f1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:47.513053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0e32596f-60f5-4bb1-adfe-1dcf95e8cafc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1041bfe6024e60859be061b013a0f1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:47.513822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0e32596f-60f5-4bb1-adfe-1dcf95e8cafc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1041bfe6024e60859be061b013a0f1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:47.529079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0e32596f-60f5-4bb1-adfe-1dcf95e8cafc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1041bfe6024e60859be061b013a0f1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:47.565621 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2068/4156] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:34:47 2022] DELETE /identity/v3/users/ab1041bfe6024e60859be061b013a0f1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:47.570579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e6268-1785-4614-809b-0c91c4018a7f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:47.570579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e6268-1785-4614-809b-0c91c4018a7f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:47.571189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e6268-1785-4614-809b-0c91c4018a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:47.596166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4a1e6268-1785-4614-809b-0c91c4018a7f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:47.597950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a1e6268-1785-4614-809b-0c91c4018a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:47.726485 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2089/4157] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:47.735305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32596f-60f5-4bb1-adfe-1dcf95e8cafc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:47.737094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0e32596f-60f5-4bb1-adfe-1dcf95e8cafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:47.897357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32596f-60f5-4bb1-adfe-1dcf95e8cafc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:47.929703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edafedb-2806-4125-b30e-a76fe866ab70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:47.930725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edafedb-2806-4125-b30e-a76fe866ab70 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:47.934589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edafedb-2806-4125-b30e-a76fe866ab70 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:47.937807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edafedb-2806-4125-b30e-a76fe866ab70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:47.972854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edafedb-2806-4125-b30e-a76fe866ab70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:47.975306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edafedb-2806-4125-b30e-a76fe866ab70 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:48.013334 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2069/4158] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:34:48.804658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e6268-1785-4614-809b-0c91c4018a7f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:48.806771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a1e6268-1785-4614-809b-0c91c4018a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:48.839117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e6268-1785-4614-809b-0c91c4018a7f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:48.855845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad53386-a6b1-4471-8f20-052d5aeebd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:48.856506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad53386-a6b1-4471-8f20-052d5aeebd4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:48.857535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad53386-a6b1-4471-8f20-052d5aeebd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:48.857817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad53386-a6b1-4471-8f20-052d5aeebd4b admin admin] PATH_INFO: `/v3/projects/49214e0a3263432298c5a4a50f485b3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:48.859030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad53386-a6b1-4471-8f20-052d5aeebd4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=49214e0a3263432298c5a4a50f485b3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:48.861958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad53386-a6b1-4471-8f20-052d5aeebd4b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:48.879402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:49.005893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad53386-a6b1-4471-8f20-052d5aeebd4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49214e0a3263432298c5a4a50f485b3d', 'request_id': 'req-cad53386-a6b1-4471-8f20-052d5aeebd4b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:49.016642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad53386-a6b1-4471-8f20-052d5aeebd4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49214e0a3263432298c5a4a50f485b3d', 'request_id': 'req-cad53386-a6b1-4471-8f20-052d5aeebd4b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:49.027452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad53386-a6b1-4471-8f20-052d5aeebd4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49214e0a3263432298c5a4a50f485b3d', 'request_id': 'req-cad53386-a6b1-4471-8f20-052d5aeebd4b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:49.042869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad53386-a6b1-4471-8f20-052d5aeebd4b admin admin] The token cache is being invalidate because project 49214e0a3263432298c5a4a50f485b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:34:49.043568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad53386-a6b1-4471-8f20-052d5aeebd4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:49.044582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad53386-a6b1-4471-8f20-052d5aeebd4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:49.046728 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2090/4159] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:34:48 2022] DELETE /identity/v3/projects/49214e0a3263432298c5a4a50f485b3d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:49.050721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edafedb-2806-4125-b30e-a76fe866ab70 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:49.086396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edafedb-2806-4125-b30e-a76fe866ab70 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:49.237868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55096f3-60cd-4ec6-9d7a-9fb407baba32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:49.239352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55096f3-60cd-4ec6-9d7a-9fb407baba32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:49.239869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55096f3-60cd-4ec6-9d7a-9fb407baba32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:49.240344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55096f3-60cd-4ec6-9d7a-9fb407baba32 admin admin] PATH_INFO: `/v3/users/8308ca781bab48b59dcb71a53fb0bccf` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:49.241952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55096f3-60cd-4ec6-9d7a-9fb407baba32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8308ca781bab48b59dcb71a53fb0bccf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:49.244665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55096f3-60cd-4ec6-9d7a-9fb407baba32 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:49.339046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e55096f3-60cd-4ec6-9d7a-9fb407baba32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8308ca781bab48b59dcb71a53fb0bccf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:49.381482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e55096f3-60cd-4ec6-9d7a-9fb407baba32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8308ca781bab48b59dcb71a53fb0bccf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:49.383776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e55096f3-60cd-4ec6-9d7a-9fb407baba32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8308ca781bab48b59dcb71a53fb0bccf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:49.384894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e55096f3-60cd-4ec6-9d7a-9fb407baba32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8308ca781bab48b59dcb71a53fb0bccf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:49.389129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:49.401404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e55096f3-60cd-4ec6-9d7a-9fb407baba32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8308ca781bab48b59dcb71a53fb0bccf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:49.422155 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2070/4160] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:34:49 2022] DELETE /identity/v3/users/8308ca781bab48b59dcb71a53fb0bccf => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:50.026637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad53386-a6b1-4471-8f20-052d5aeebd4b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:50.029011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cad53386-a6b1-4471-8f20-052d5aeebd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:50.063472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad53386-a6b1-4471-8f20-052d5aeebd4b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:50.222927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17da8e9-cf53-471a-b1e4-4f09d65d8251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:50.223620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17da8e9-cf53-471a-b1e4-4f09d65d8251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:50.224121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17da8e9-cf53-471a-b1e4-4f09d65d8251 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:50.224573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17da8e9-cf53-471a-b1e4-4f09d65d8251 admin admin] PATH_INFO: `/v3/projects/0aa7e0d359804719b798d960ee281de1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:50.226704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17da8e9-cf53-471a-b1e4-4f09d65d8251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aa7e0d359804719b798d960ee281de1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:50.229226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17da8e9-cf53-471a-b1e4-4f09d65d8251 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:50.335309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17da8e9-cf53-471a-b1e4-4f09d65d8251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aa7e0d359804719b798d960ee281de1', 'request_id': 'req-f17da8e9-cf53-471a-b1e4-4f09d65d8251'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:50.347897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17da8e9-cf53-471a-b1e4-4f09d65d8251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aa7e0d359804719b798d960ee281de1', 'request_id': 'req-f17da8e9-cf53-471a-b1e4-4f09d65d8251'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:50.357106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17da8e9-cf53-471a-b1e4-4f09d65d8251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aa7e0d359804719b798d960ee281de1', 'request_id': 'req-f17da8e9-cf53-471a-b1e4-4f09d65d8251'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:50.385117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17da8e9-cf53-471a-b1e4-4f09d65d8251 admin admin] The token cache is being invalidate because project 0aa7e0d359804719b798d960ee281de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:34:50.385480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17da8e9-cf53-471a-b1e4-4f09d65d8251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:50.386145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17da8e9-cf53-471a-b1e4-4f09d65d8251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:50.391478 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2091/4161] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:34:50 2022] DELETE /identity/v3/projects/0aa7e0d359804719b798d960ee281de1 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:50.392796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55096f3-60cd-4ec6-9d7a-9fb407baba32 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:50.395399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e55096f3-60cd-4ec6-9d7a-9fb407baba32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:50.418147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55096f3-60cd-4ec6-9d7a-9fb407baba32 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:50.584291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d4451-c12a-4e31-97bc-5f6b8987be7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:50.587981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d4451-c12a-4e31-97bc-5f6b8987be7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:50.588280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d4451-c12a-4e31-97bc-5f6b8987be7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:50.588565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d4451-c12a-4e31-97bc-5f6b8987be7a admin admin] PATH_INFO: `/v3/users/6f5b7c5603d741408519ee1342b75cae` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:50.590793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d4451-c12a-4e31-97bc-5f6b8987be7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5b7c5603d741408519ee1342b75cae)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:50.608391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d4451-c12a-4e31-97bc-5f6b8987be7a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:50.741572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed7d4451-c12a-4e31-97bc-5f6b8987be7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5b7c5603d741408519ee1342b75cae'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:50.775741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed7d4451-c12a-4e31-97bc-5f6b8987be7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5b7c5603d741408519ee1342b75cae'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:50.776828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed7d4451-c12a-4e31-97bc-5f6b8987be7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5b7c5603d741408519ee1342b75cae'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:50.778410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed7d4451-c12a-4e31-97bc-5f6b8987be7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5b7c5603d741408519ee1342b75cae'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:50.794882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed7d4451-c12a-4e31-97bc-5f6b8987be7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5b7c5603d741408519ee1342b75cae'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:50.818229 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2071/4162] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:34:50 2022] DELETE /identity/v3/users/6f5b7c5603d741408519ee1342b75cae => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:52.910404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17da8e9-cf53-471a-b1e4-4f09d65d8251 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:52.912758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f17da8e9-cf53-471a-b1e4-4f09d65d8251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:52.937986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17da8e9-cf53-471a-b1e4-4f09d65d8251 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:52.974123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:53.047061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54b80d-081c-4175-9b41-2deb77c5c2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:53.048185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54b80d-081c-4175-9b41-2deb77c5c2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:53.048634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54b80d-081c-4175-9b41-2deb77c5c2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:53.049296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54b80d-081c-4175-9b41-2deb77c5c2dc admin admin] PATH_INFO: `/v3/projects/51bc411c959740eabd7f96bb99527d08` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:53.050993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54b80d-081c-4175-9b41-2deb77c5c2dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=51bc411c959740eabd7f96bb99527d08)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:53.053560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54b80d-081c-4175-9b41-2deb77c5c2dc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:53.171819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7d54b80d-081c-4175-9b41-2deb77c5c2dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51bc411c959740eabd7f96bb99527d08', 'request_id': 'req-7d54b80d-081c-4175-9b41-2deb77c5c2dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:53.213893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7d54b80d-081c-4175-9b41-2deb77c5c2dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51bc411c959740eabd7f96bb99527d08', 'request_id': 'req-7d54b80d-081c-4175-9b41-2deb77c5c2dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:53.235403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7d54b80d-081c-4175-9b41-2deb77c5c2dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51bc411c959740eabd7f96bb99527d08', 'request_id': 'req-7d54b80d-081c-4175-9b41-2deb77c5c2dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:53.281564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7d54b80d-081c-4175-9b41-2deb77c5c2dc admin admin] The token cache is being invalidate because project 51bc411c959740eabd7f96bb99527d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:34:53.287903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7d54b80d-081c-4175-9b41-2deb77c5c2dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:53.294043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7d54b80d-081c-4175-9b41-2deb77c5c2dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:34:53.303532 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2092/4163] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:34:52 2022] DELETE /identity/v3/projects/51bc411c959740eabd7f96bb99527d08 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:53.303926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198099e-41f8-4005-8f40-edb59b52f7bc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:53.303926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198099e-41f8-4005-8f40-edb59b52f7bc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:53.303926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198099e-41f8-4005-8f40-edb59b52f7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:53.380808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5198099e-41f8-4005-8f40-edb59b52f7bc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:53.382130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5198099e-41f8-4005-8f40-edb59b52f7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:53.638704 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2072/4164] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:53.641010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc6a6a-f726-4fc5-bbb4-62674707b9ba None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:53.641528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc6a6a-f726-4fc5-bbb4-62674707b9ba None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:53.641991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc6a6a-f726-4fc5-bbb4-62674707b9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:53.672512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1fcc6a6a-f726-4fc5-bbb4-62674707b9ba None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:53.674059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1fcc6a6a-f726-4fc5-bbb4-62674707b9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:53.683855 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2093/4165] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:53.688164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198099e-41f8-4005-8f40-edb59b52f7bc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:53.699084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:53.712381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198099e-41f8-4005-8f40-edb59b52f7bc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:53.718175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21597626-c79f-4e11-8a5f-90605db37616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:53.720018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21597626-c79f-4e11-8a5f-90605db37616 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:53.720832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21597626-c79f-4e11-8a5f-90605db37616 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:53.721354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21597626-c79f-4e11-8a5f-90605db37616 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:53.722911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21597626-c79f-4e11-8a5f-90605db37616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:34:53.723789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21597626-c79f-4e11-8a5f-90605db37616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:53.726752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21597626-c79f-4e11-8a5f-90605db37616 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:53.744702 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2073/4166] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:34:53.749150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc6a6a-f726-4fc5-bbb4-62674707b9ba None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:53.765068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc6a6a-f726-4fc5-bbb4-62674707b9ba None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:53.792611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612ed23-f95f-4033-a9b7-ccd5a3f3c47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:53.792891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612ed23-f95f-4033-a9b7-ccd5a3f3c47e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:53.793191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612ed23-f95f-4033-a9b7-ccd5a3f3c47e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:53.793432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612ed23-f95f-4033-a9b7-ccd5a3f3c47e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:53.804388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612ed23-f95f-4033-a9b7-ccd5a3f3c47e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:53.806452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612ed23-f95f-4033-a9b7-ccd5a3f3c47e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:53.875917 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2094/4167] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:34:53 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:34:53.878846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21597626-c79f-4e11-8a5f-90605db37616 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:53.899058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21597626-c79f-4e11-8a5f-90605db37616 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:54.031735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01930fc3-6e84-42ac-b42f-0794707fa0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:54.032386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01930fc3-6e84-42ac-b42f-0794707fa0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:54.032815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01930fc3-6e84-42ac-b42f-0794707fa0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:54.033099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01930fc3-6e84-42ac-b42f-0794707fa0a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:54.033858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01930fc3-6e84-42ac-b42f-0794707fa0a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:54.041080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01930fc3-6e84-42ac-b42f-0794707fa0a5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:54.093055 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2074/4168] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:34:53 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:34:54.097413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612ed23-f95f-4033-a9b7-ccd5a3f3c47e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:54.114775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612ed23-f95f-4033-a9b7-ccd5a3f3c47e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:54.124010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037070b8-abbb-4c21-8175-77b9e5899634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:54.124656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037070b8-abbb-4c21-8175-77b9e5899634 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:54.125290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037070b8-abbb-4c21-8175-77b9e5899634 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:54.125999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037070b8-abbb-4c21-8175-77b9e5899634 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:54.126930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037070b8-abbb-4c21-8175-77b9e5899634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:54.130843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037070b8-abbb-4c21-8175-77b9e5899634 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:54.164144 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2095/4169] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:34:54.168450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01930fc3-6e84-42ac-b42f-0794707fa0a5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:54.181793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01930fc3-6e84-42ac-b42f-0794707fa0a5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:54.187901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec22a7-7577-426d-9c3b-9621bca5affb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:54.197250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec22a7-7577-426d-9c3b-9621bca5affb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:54.197801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec22a7-7577-426d-9c3b-9621bca5affb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:54.198262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec22a7-7577-426d-9c3b-9621bca5affb admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:54.199123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec22a7-7577-426d-9c3b-9621bca5affb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:54.200946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec22a7-7577-426d-9c3b-9621bca5affb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:54.230092 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2075/4170] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:34:54.233928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037070b8-abbb-4c21-8175-77b9e5899634 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:54.260569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037070b8-abbb-4c21-8175-77b9e5899634 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:54.279642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8afa20-f2bd-4a29-89f6-8aa26228bd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:54.280341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8afa20-f2bd-4a29-89f6-8aa26228bd66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:54.280621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8afa20-f2bd-4a29-89f6-8aa26228bd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:54.280898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8afa20-f2bd-4a29-89f6-8aa26228bd66 admin admin] PATH_INFO: `/v3/projects/22cca8b0b9da470d92e998f2cc294e2f/users/5a56096bd6a147af9ef4db7969c26344/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:54.321539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8afa20-f2bd-4a29-89f6-8aa26228bd66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22cca8b0b9da470d92e998f2cc294e2f, user_id=5a56096bd6a147af9ef4db7969c26344, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:54.326590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8afa20-f2bd-4a29-89f6-8aa26228bd66 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:54.353621 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2096/4171] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:34:54 2022] PUT /identity/v3/projects/22cca8b0b9da470d92e998f2cc294e2f/users/5a56096bd6a147af9ef4db7969c26344/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:54.364172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b044f0-95bb-4347-9cb2-3140a4183685 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:54.364977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b044f0-95bb-4347-9cb2-3140a4183685 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:54.365415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b044f0-95bb-4347-9cb2-3140a4183685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:54.423600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d4b044f0-95bb-4347-9cb2-3140a4183685 None None] MFA Rules not processed for user `5a56096bd6a147af9ef4db7969c26344`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:54.425734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d4b044f0-95bb-4347-9cb2-3140a4183685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:54.573883 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2076/4172] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:54.578317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8afa20-f2bd-4a29-89f6-8aa26228bd66 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:54.732026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:54.752677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8afa20-f2bd-4a29-89f6-8aa26228bd66 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:54.758498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a9a20-378d-4939-8036-4d339f051ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:54.759883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a9a20-378d-4939-8036-4d339f051ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:54.760557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a9a20-378d-4939-8036-4d339f051ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:54.761060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a9a20-378d-4939-8036-4d339f051ff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:54.762191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a9a20-378d-4939-8036-4d339f051ff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:54.764732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a9a20-378d-4939-8036-4d339f051ff2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:54.825474 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2097/4173] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:34:54 2022] POST /identity/v3/projects => generated 365 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:34:54.829473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b044f0-95bb-4347-9cb2-3140a4183685 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:54.850557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b044f0-95bb-4347-9cb2-3140a4183685 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:54.981899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:54.990021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c3317-675e-4261-b3bd-2fed24d4ce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:54.991998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c3317-675e-4261-b3bd-2fed24d4ce75 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:54.994735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c3317-675e-4261-b3bd-2fed24d4ce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:54.995550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c3317-675e-4261-b3bd-2fed24d4ce75 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:54.996228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c3317-675e-4261-b3bd-2fed24d4ce75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:54.998331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c3317-675e-4261-b3bd-2fed24d4ce75 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:55.050279 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2077/4174] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:34:54 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:34:55.054230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a9a20-378d-4939-8036-4d339f051ff2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:55.071798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a9a20-378d-4939-8036-4d339f051ff2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:55.092068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcaea1-b18f-485e-aade-7ad039047fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:55.093048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcaea1-b18f-485e-aade-7ad039047fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:55.093509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcaea1-b18f-485e-aade-7ad039047fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:55.093947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcaea1-b18f-485e-aade-7ad039047fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:55.094787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcaea1-b18f-485e-aade-7ad039047fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:55.096700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcaea1-b18f-485e-aade-7ad039047fe1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:55.126995 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2098/4175] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:34:55.132247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c3317-675e-4261-b3bd-2fed24d4ce75 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:55.153766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c3317-675e-4261-b3bd-2fed24d4ce75 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:55.169947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21d01d-aeb2-4921-bf81-1f5445188d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:55.171043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21d01d-aeb2-4921-bf81-1f5445188d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:55.171579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21d01d-aeb2-4921-bf81-1f5445188d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:55.171868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21d01d-aeb2-4921-bf81-1f5445188d15 admin admin] PATH_INFO: `/v3/projects/f5f3123c4a0b484ab86faa8bed282c15/users/cbee9499989e470f9f5ae24bb6a194bd/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:55.200692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21d01d-aeb2-4921-bf81-1f5445188d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f3123c4a0b484ab86faa8bed282c15, user_id=cbee9499989e470f9f5ae24bb6a194bd, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:55.206063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21d01d-aeb2-4921-bf81-1f5445188d15 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:55.252318 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2078/4176] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:34:55 2022] PUT /identity/v3/projects/f5f3123c4a0b484ab86faa8bed282c15/users/cbee9499989e470f9f5ae24bb6a194bd/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:34:55.256829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcaea1-b18f-485e-aade-7ad039047fe1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:55.279731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcaea1-b18f-485e-aade-7ad039047fe1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:55.441622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59834f-ff01-4a14-a601-a28e3061dfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:55.444126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59834f-ff01-4a14-a601-a28e3061dfdb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:55.444494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59834f-ff01-4a14-a601-a28e3061dfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:55.445852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59834f-ff01-4a14-a601-a28e3061dfdb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:55.447077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59834f-ff01-4a14-a601-a28e3061dfdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:55.449459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59834f-ff01-4a14-a601-a28e3061dfdb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:55.477127 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2099/4177] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:34:55.478423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21d01d-aeb2-4921-bf81-1f5445188d15 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:55.492987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21d01d-aeb2-4921-bf81-1f5445188d15 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:55.507184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c38193-6713-4dd5-9461-bc9d6c07fbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:55.507987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c38193-6713-4dd5-9461-bc9d6c07fbfe admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:55.508547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c38193-6713-4dd5-9461-bc9d6c07fbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:55.508899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c38193-6713-4dd5-9461-bc9d6c07fbfe admin admin] PATH_INFO: `/v3/projects/f5f3123c4a0b484ab86faa8bed282c15/users/cbee9499989e470f9f5ae24bb6a194bd/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:55.511130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c38193-6713-4dd5-9461-bc9d6c07fbfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f3123c4a0b484ab86faa8bed282c15, user_id=cbee9499989e470f9f5ae24bb6a194bd, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:55.514722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c38193-6713-4dd5-9461-bc9d6c07fbfe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:55.540633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb86e09-06fc-4fd5-bfe2-256047503629 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:55.540891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb86e09-06fc-4fd5-bfe2-256047503629 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:55.542338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb86e09-06fc-4fd5-bfe2-256047503629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:55.553118 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2079/4178] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:34:55 2022] PUT /identity/v3/projects/f5f3123c4a0b484ab86faa8bed282c15/users/cbee9499989e470f9f5ae24bb6a194bd/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:34:55.598505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8bb86e09-06fc-4fd5-bfe2-256047503629 None None] MFA Rules not processed for user `cbee9499989e470f9f5ae24bb6a194bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:34:55.602562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8bb86e09-06fc-4fd5-bfe2-256047503629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:55.746118 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2100/4179] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:34:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:34:55.760666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c38193-6713-4dd5-9461-bc9d6c07fbfe admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:55.762802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f9c38193-6713-4dd5-9461-bc9d6c07fbfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:34:55.922699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c38193-6713-4dd5-9461-bc9d6c07fbfe admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:55.931134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9f788-b787-4b97-b060-39f167f7f014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:55.932452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9f788-b787-4b97-b060-39f167f7f014 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:55.932991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9f788-b787-4b97-b060-39f167f7f014 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:55.933490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9f788-b787-4b97-b060-39f167f7f014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:55.960952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9f788-b787-4b97-b060-39f167f7f014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:55.964141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9f788-b787-4b97-b060-39f167f7f014 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:55.994949 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2080/4180] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:34:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:34:59.707686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb86e09-06fc-4fd5-bfe2-256047503629 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:34:59.721408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb86e09-06fc-4fd5-bfe2-256047503629 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:34:59.739972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31f88e-7173-4c7c-bde6-5278dc06629f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:34:59.739972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31f88e-7173-4c7c-bde6-5278dc06629f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:34:59.740295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31f88e-7173-4c7c-bde6-5278dc06629f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:34:59.740554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31f88e-7173-4c7c-bde6-5278dc06629f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:34:59.925793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:34:59.947602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31f88e-7173-4c7c-bde6-5278dc06629f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:34:59.949346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31f88e-7173-4c7c-bde6-5278dc06629f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:34:59.962569 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2101/4181] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:34:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:35:01.110742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9f788-b787-4b97-b060-39f167f7f014 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:01.113278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c7a9f788-b787-4b97-b060-39f167f7f014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:01.205357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9f788-b787-4b97-b060-39f167f7f014 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:01.211968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8297035-ee9f-4a5d-8d71-4bc44a066981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:01.212919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8297035-ee9f-4a5d-8d71-4bc44a066981 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:01.213407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8297035-ee9f-4a5d-8d71-4bc44a066981 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:01.213889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8297035-ee9f-4a5d-8d71-4bc44a066981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:01.216219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b8297035-ee9f-4a5d-8d71-4bc44a066981 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:01.284296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:01.304154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8297035-ee9f-4a5d-8d71-4bc44a066981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:01.306214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8297035-ee9f-4a5d-8d71-4bc44a066981 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:01.363093 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2081/4182] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:35:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:35:01.492082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31f88e-7173-4c7c-bde6-5278dc06629f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:01.561706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31f88e-7173-4c7c-bde6-5278dc06629f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:01.566645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716d127-39ec-4401-9582-72c6df624ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:01.567535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716d127-39ec-4401-9582-72c6df624ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:01.567795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716d127-39ec-4401-9582-72c6df624ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:01.568134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716d127-39ec-4401-9582-72c6df624ad9 admin admin] PATH_INFO: `/v3/users/5a56096bd6a147af9ef4db7969c26344` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:01.572064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716d127-39ec-4401-9582-72c6df624ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a56096bd6a147af9ef4db7969c26344)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:01.574056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716d127-39ec-4401-9582-72c6df624ad9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:01.627794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5716d127-39ec-4401-9582-72c6df624ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a56096bd6a147af9ef4db7969c26344'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:01.628431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5716d127-39ec-4401-9582-72c6df624ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a56096bd6a147af9ef4db7969c26344'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:01.636111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5716d127-39ec-4401-9582-72c6df624ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a56096bd6a147af9ef4db7969c26344'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:01.644177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5716d127-39ec-4401-9582-72c6df624ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a56096bd6a147af9ef4db7969c26344'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:01.658711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5716d127-39ec-4401-9582-72c6df624ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a56096bd6a147af9ef4db7969c26344'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:01.665343 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2102/4183] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:35:01 2022] DELETE /identity/v3/users/5a56096bd6a147af9ef4db7969c26344 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:35:01.670112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943428e-d105-48a3-9750-746786656884 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:01.670395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943428e-d105-48a3-9750-746786656884 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:01.670668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943428e-d105-48a3-9750-746786656884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:01.692609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8943428e-d105-48a3-9750-746786656884 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:01.693895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8943428e-d105-48a3-9750-746786656884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:01.758490 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2082/4184] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:35:01.768800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716d127-39ec-4401-9582-72c6df624ad9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:01.770477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5716d127-39ec-4401-9582-72c6df624ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:01.864561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716d127-39ec-4401-9582-72c6df624ad9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:01.872101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aadae3-9c02-4158-895c-aac8fffbc630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:01.873006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aadae3-9c02-4158-895c-aac8fffbc630 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:01.873477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aadae3-9c02-4158-895c-aac8fffbc630 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:01.873841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aadae3-9c02-4158-895c-aac8fffbc630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:01.889172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aadae3-9c02-4158-895c-aac8fffbc630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:01.890830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aadae3-9c02-4158-895c-aac8fffbc630 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:01.903954 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2103/4185] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:35:02.925425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943428e-d105-48a3-9750-746786656884 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:02.927211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8943428e-d105-48a3-9750-746786656884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:02.940288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943428e-d105-48a3-9750-746786656884 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:02.945239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdfa9a-ce14-4894-9228-9927240b64c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:02.945879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdfa9a-ce14-4894-9228-9927240b64c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:02.946158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdfa9a-ce14-4894-9228-9927240b64c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:02.946434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdfa9a-ce14-4894-9228-9927240b64c6 admin admin] PATH_INFO: `/v3/projects/22cca8b0b9da470d92e998f2cc294e2f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:02.947616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdfa9a-ce14-4894-9228-9927240b64c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22cca8b0b9da470d92e998f2cc294e2f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:02.949557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdfa9a-ce14-4894-9228-9927240b64c6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:03.025178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7ccdfa9a-ce14-4894-9228-9927240b64c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22cca8b0b9da470d92e998f2cc294e2f', 'request_id': 'req-7ccdfa9a-ce14-4894-9228-9927240b64c6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:03.031800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7ccdfa9a-ce14-4894-9228-9927240b64c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22cca8b0b9da470d92e998f2cc294e2f', 'request_id': 'req-7ccdfa9a-ce14-4894-9228-9927240b64c6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:03.037276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7ccdfa9a-ce14-4894-9228-9927240b64c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22cca8b0b9da470d92e998f2cc294e2f', 'request_id': 'req-7ccdfa9a-ce14-4894-9228-9927240b64c6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:03.053373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7ccdfa9a-ce14-4894-9228-9927240b64c6 admin admin] The token cache is being invalidate because project 22cca8b0b9da470d92e998f2cc294e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:35:03.054318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7ccdfa9a-ce14-4894-9228-9927240b64c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:03.055370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7ccdfa9a-ce14-4894-9228-9927240b64c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:03.057736 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2083/4186] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:35:02 2022] DELETE /identity/v3/projects/22cca8b0b9da470d92e998f2cc294e2f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:35:03.061683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aadae3-9c02-4158-895c-aac8fffbc630 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:03.072359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aadae3-9c02-4158-895c-aac8fffbc630 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:03.078076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:03.144881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f56d7f-9e93-4df3-b25b-c67fb70b89a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:03.145526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f56d7f-9e93-4df3-b25b-c67fb70b89a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:03.145800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f56d7f-9e93-4df3-b25b-c67fb70b89a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:03.146081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f56d7f-9e93-4df3-b25b-c67fb70b89a5 admin admin] PATH_INFO: `/v3/users/cbee9499989e470f9f5ae24bb6a194bd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:03.147283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f56d7f-9e93-4df3-b25b-c67fb70b89a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbee9499989e470f9f5ae24bb6a194bd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:03.149235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f56d7f-9e93-4df3-b25b-c67fb70b89a5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:03.196525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-99f56d7f-9e93-4df3-b25b-c67fb70b89a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbee9499989e470f9f5ae24bb6a194bd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:03.197240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-99f56d7f-9e93-4df3-b25b-c67fb70b89a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbee9499989e470f9f5ae24bb6a194bd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:03.204603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-99f56d7f-9e93-4df3-b25b-c67fb70b89a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbee9499989e470f9f5ae24bb6a194bd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:03.215178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-99f56d7f-9e93-4df3-b25b-c67fb70b89a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbee9499989e470f9f5ae24bb6a194bd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:03.228913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-99f56d7f-9e93-4df3-b25b-c67fb70b89a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbee9499989e470f9f5ae24bb6a194bd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:03.237161 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2104/4187] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:35:03 2022] DELETE /identity/v3/users/cbee9499989e470f9f5ae24bb6a194bd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:35:03.542921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdfa9a-ce14-4894-9228-9927240b64c6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:03.544519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7ccdfa9a-ce14-4894-9228-9927240b64c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:03.566044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdfa9a-ce14-4894-9228-9927240b64c6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:03.631624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56458c34-ee6c-49b1-8360-3ab1c6ce9a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:03.632282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56458c34-ee6c-49b1-8360-3ab1c6ce9a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:03.632568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56458c34-ee6c-49b1-8360-3ab1c6ce9a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:03.632845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56458c34-ee6c-49b1-8360-3ab1c6ce9a4b admin admin] PATH_INFO: `/v3/projects/f5f3123c4a0b484ab86faa8bed282c15` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:03.634032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56458c34-ee6c-49b1-8360-3ab1c6ce9a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5f3123c4a0b484ab86faa8bed282c15)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:03.636085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56458c34-ee6c-49b1-8360-3ab1c6ce9a4b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:03.637771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:03.688464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-56458c34-ee6c-49b1-8360-3ab1c6ce9a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5f3123c4a0b484ab86faa8bed282c15', 'request_id': 'req-56458c34-ee6c-49b1-8360-3ab1c6ce9a4b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:03.696344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-56458c34-ee6c-49b1-8360-3ab1c6ce9a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5f3123c4a0b484ab86faa8bed282c15', 'request_id': 'req-56458c34-ee6c-49b1-8360-3ab1c6ce9a4b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:03.702373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-56458c34-ee6c-49b1-8360-3ab1c6ce9a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5f3123c4a0b484ab86faa8bed282c15', 'request_id': 'req-56458c34-ee6c-49b1-8360-3ab1c6ce9a4b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:03.714980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-56458c34-ee6c-49b1-8360-3ab1c6ce9a4b admin admin] The token cache is being invalidate because project f5f3123c4a0b484ab86faa8bed282c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:35:03.715465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-56458c34-ee6c-49b1-8360-3ab1c6ce9a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:03.716137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-56458c34-ee6c-49b1-8360-3ab1c6ce9a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:03.717656 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2084/4188] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:35:03 2022] DELETE /identity/v3/projects/f5f3123c4a0b484ab86faa8bed282c15 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:35:03.723170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2e2f-620c-4c99-b7e7-1346e66f56a5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:03.723543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2e2f-620c-4c99-b7e7-1346e66f56a5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:03.723891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2e2f-620c-4c99-b7e7-1346e66f56a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:03.745857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bb5a2e2f-620c-4c99-b7e7-1346e66f56a5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:03.747189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb5a2e2f-620c-4c99-b7e7-1346e66f56a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:03.813000 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2105/4189] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:03.821123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b410de6-02e9-4c19-880d-3da34c19398e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:03.821459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b410de6-02e9-4c19-880d-3da34c19398e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:03.821683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b410de6-02e9-4c19-880d-3da34c19398e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:03.842043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0b410de6-02e9-4c19-880d-3da34c19398e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:03.843176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0b410de6-02e9-4c19-880d-3da34c19398e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:03.852656 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2085/4190] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:03.856932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a2e2f-620c-4c99-b7e7-1346e66f56a5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:03.868776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a2e2f-620c-4c99-b7e7-1346e66f56a5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:03.875659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222659a4-d403-4440-8eb1-25457ff77bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:03.876584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222659a4-d403-4440-8eb1-25457ff77bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:03.876872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222659a4-d403-4440-8eb1-25457ff77bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:03.877147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222659a4-d403-4440-8eb1-25457ff77bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:03.877819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222659a4-d403-4440-8eb1-25457ff77bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:03.878123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222659a4-d403-4440-8eb1-25457ff77bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:03.879802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222659a4-d403-4440-8eb1-25457ff77bf2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:03.895758 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2106/4191] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:03.900433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b410de6-02e9-4c19-880d-3da34c19398e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:03.910544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b410de6-02e9-4c19-880d-3da34c19398e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:03.916207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382a0df-f3e8-4156-99dd-fa62fd2a15f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:03.918142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382a0df-f3e8-4156-99dd-fa62fd2a15f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:03.918920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382a0df-f3e8-4156-99dd-fa62fd2a15f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:03.919022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382a0df-f3e8-4156-99dd-fa62fd2a15f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:03.919929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382a0df-f3e8-4156-99dd-fa62fd2a15f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:03.921785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382a0df-f3e8-4156-99dd-fa62fd2a15f0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:03.954069 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2086/4192] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:35:03 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:35:03.955275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222659a4-d403-4440-8eb1-25457ff77bf2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:03.965463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222659a4-d403-4440-8eb1-25457ff77bf2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:03.977110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:04.029974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77575a73-b872-493f-97cc-9f07fce95d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:04.030709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77575a73-b872-493f-97cc-9f07fce95d52 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:04.031048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77575a73-b872-493f-97cc-9f07fce95d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:04.031387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77575a73-b872-493f-97cc-9f07fce95d52 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:04.032273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77575a73-b872-493f-97cc-9f07fce95d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:04.034293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77575a73-b872-493f-97cc-9f07fce95d52 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:04.066551 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2107/4193] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:35:03 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:35:04.068374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382a0df-f3e8-4156-99dd-fa62fd2a15f0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:04.081054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382a0df-f3e8-4156-99dd-fa62fd2a15f0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:04.085819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83988673-f0e7-4d19-8e51-1285046d1687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:04.086439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83988673-f0e7-4d19-8e51-1285046d1687 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:04.086722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83988673-f0e7-4d19-8e51-1285046d1687 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:04.086995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83988673-f0e7-4d19-8e51-1285046d1687 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:04.087680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83988673-f0e7-4d19-8e51-1285046d1687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:04.089293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83988673-f0e7-4d19-8e51-1285046d1687 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:04.100649 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2087/4194] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:35:04.104766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77575a73-b872-493f-97cc-9f07fce95d52 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:04.115787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77575a73-b872-493f-97cc-9f07fce95d52 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:04.121005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7fec1-d52e-4d57-992b-b94f9b4f068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:04.121731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7fec1-d52e-4d57-992b-b94f9b4f068f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:04.122080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7fec1-d52e-4d57-992b-b94f9b4f068f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:04.122476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7fec1-d52e-4d57-992b-b94f9b4f068f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:04.123124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7fec1-d52e-4d57-992b-b94f9b4f068f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:04.124768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7fec1-d52e-4d57-992b-b94f9b4f068f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:04.136977 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2108/4195] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:35:04.141579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83988673-f0e7-4d19-8e51-1285046d1687 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:04.151976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83988673-f0e7-4d19-8e51-1285046d1687 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:04.157413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d2fc2-70a6-4424-886f-e8d5db017653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:04.158090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d2fc2-70a6-4424-886f-e8d5db017653 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:04.158363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d2fc2-70a6-4424-886f-e8d5db017653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:04.158634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d2fc2-70a6-4424-886f-e8d5db017653 admin admin] PATH_INFO: `/v3/projects/ab608a66573d42d4b9e77791efd1a4ae/users/4792f97fc9fb486e8817cf8fe47be598/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:04.175557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d2fc2-70a6-4424-886f-e8d5db017653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab608a66573d42d4b9e77791efd1a4ae, user_id=4792f97fc9fb486e8817cf8fe47be598, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:04.178242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d2fc2-70a6-4424-886f-e8d5db017653 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:04.192471 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2088/4196] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:35:04 2022] PUT /identity/v3/projects/ab608a66573d42d4b9e77791efd1a4ae/users/4792f97fc9fb486e8817cf8fe47be598/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:35:04.203015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822281-7957-4b72-8f29-b4ad98f2e2d0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:04.203333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822281-7957-4b72-8f29-b4ad98f2e2d0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:04.203638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822281-7957-4b72-8f29-b4ad98f2e2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:04.240023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e9822281-7957-4b72-8f29-b4ad98f2e2d0 None None] MFA Rules not processed for user `4792f97fc9fb486e8817cf8fe47be598`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:04.241697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e9822281-7957-4b72-8f29-b4ad98f2e2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:04.324339 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2109/4197] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:35:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:04.334993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d2fc2-70a6-4424-886f-e8d5db017653 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:04.336792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b96d2fc2-70a6-4424-886f-e8d5db017653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:04.451503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d2fc2-70a6-4424-886f-e8d5db017653 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:04.467708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f3d0d-bdba-4b80-abb0-e1dd45352426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:04.467708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f3d0d-bdba-4b80-abb0-e1dd45352426 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:04.467708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f3d0d-bdba-4b80-abb0-e1dd45352426 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:04.467708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f3d0d-bdba-4b80-abb0-e1dd45352426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:04.476391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f3d0d-bdba-4b80-abb0-e1dd45352426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:04.478925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f3d0d-bdba-4b80-abb0-e1dd45352426 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:04.492886 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2089/4198] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:35:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:35:06.541469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bff9d8-00ed-4d63-a786-e5e9706aefde None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:06.542020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bff9d8-00ed-4d63-a786-e5e9706aefde None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:06.542020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bff9d8-00ed-4d63-a786-e5e9706aefde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:06.587940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a3bff9d8-00ed-4d63-a786-e5e9706aefde None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:06.593492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a3bff9d8-00ed-4d63-a786-e5e9706aefde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:06.774644 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2110/4199] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:35:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:06.796289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f3d0d-bdba-4b80-abb0-e1dd45352426 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:06.798671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-067f3d0d-bdba-4b80-abb0-e1dd45352426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:06.845918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:06.938455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f3d0d-bdba-4b80-abb0-e1dd45352426 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:06.949008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd5057-908a-4fbe-8d2b-155360c37593 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:06.963753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd5057-908a-4fbe-8d2b-155360c37593 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:06.963753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd5057-908a-4fbe-8d2b-155360c37593 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:06.963753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd5057-908a-4fbe-8d2b-155360c37593 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:06.984485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd5057-908a-4fbe-8d2b-155360c37593 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:06.986135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd5057-908a-4fbe-8d2b-155360c37593 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:07.006207 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2090/4200] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:35:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:35:10.269025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bff9d8-00ed-4d63-a786-e5e9706aefde None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:10.272376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a3bff9d8-00ed-4d63-a786-e5e9706aefde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:10.342817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:10.444983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bff9d8-00ed-4d63-a786-e5e9706aefde None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:10.469815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c0388-3363-4789-9160-5b97ea5f3371 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:10.474048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0388-3363-4789-9160-5b97ea5f3371 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:10.475019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0388-3363-4789-9160-5b97ea5f3371 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:10.482165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0388-3363-4789-9160-5b97ea5f3371 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:10.486734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-835c0388-3363-4789-9160-5b97ea5f3371 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:10.498176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd5057-908a-4fbe-8d2b-155360c37593 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:10.499634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-86fd5057-908a-4fbe-8d2b-155360c37593 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:10.525644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c0388-3363-4789-9160-5b97ea5f3371 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:10.527493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c0388-3363-4789-9160-5b97ea5f3371 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:10.549861 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2111/4201] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:35:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:35:10.664288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd5057-908a-4fbe-8d2b-155360c37593 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:10.676546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d9e43-8fa8-401f-821e-f4d27a8f4ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:10.681817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d9e43-8fa8-401f-821e-f4d27a8f4ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:10.682529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d9e43-8fa8-401f-821e-f4d27a8f4ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:10.683049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d9e43-8fa8-401f-821e-f4d27a8f4ec0 admin admin] PATH_INFO: `/v3/users/4d84581730a84c3baa33385bb14200ea` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:10.685589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d9e43-8fa8-401f-821e-f4d27a8f4ec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d84581730a84c3baa33385bb14200ea)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:10.690840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d9e43-8fa8-401f-821e-f4d27a8f4ec0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:10.870074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-171d9e43-8fa8-401f-821e-f4d27a8f4ec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d84581730a84c3baa33385bb14200ea'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:10.909481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-171d9e43-8fa8-401f-821e-f4d27a8f4ec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d84581730a84c3baa33385bb14200ea'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:10.925264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-171d9e43-8fa8-401f-821e-f4d27a8f4ec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d84581730a84c3baa33385bb14200ea'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:10.926766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-171d9e43-8fa8-401f-821e-f4d27a8f4ec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d84581730a84c3baa33385bb14200ea'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:10.940159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-171d9e43-8fa8-401f-821e-f4d27a8f4ec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d84581730a84c3baa33385bb14200ea'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:10.967821 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2091/4202] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:35:10 2022] DELETE /identity/v3/users/4d84581730a84c3baa33385bb14200ea => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:35:11.517955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c0388-3363-4789-9160-5b97ea5f3371 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:11.542226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c0388-3363-4789-9160-5b97ea5f3371 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:11.715318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e85b79-5fe1-41a1-bcec-f5abc4f27fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:11.716358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85b79-5fe1-41a1-bcec-f5abc4f27fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:11.716879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85b79-5fe1-41a1-bcec-f5abc4f27fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:11.717328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85b79-5fe1-41a1-bcec-f5abc4f27fc0 admin admin] PATH_INFO: `/v3/projects/5a551b5591c4409e9c19b95ca99eecec` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:11.718868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e85b79-5fe1-41a1-bcec-f5abc4f27fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a551b5591c4409e9c19b95ca99eecec)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:11.721215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e85b79-5fe1-41a1-bcec-f5abc4f27fc0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:11.799856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15e85b79-5fe1-41a1-bcec-f5abc4f27fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a551b5591c4409e9c19b95ca99eecec', 'request_id': 'req-15e85b79-5fe1-41a1-bcec-f5abc4f27fc0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:11.815187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15e85b79-5fe1-41a1-bcec-f5abc4f27fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a551b5591c4409e9c19b95ca99eecec', 'request_id': 'req-15e85b79-5fe1-41a1-bcec-f5abc4f27fc0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:11.821817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15e85b79-5fe1-41a1-bcec-f5abc4f27fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a551b5591c4409e9c19b95ca99eecec', 'request_id': 'req-15e85b79-5fe1-41a1-bcec-f5abc4f27fc0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:11.838602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15e85b79-5fe1-41a1-bcec-f5abc4f27fc0 admin admin] The token cache is being invalidate because project 5a551b5591c4409e9c19b95ca99eecec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:35:11.839387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15e85b79-5fe1-41a1-bcec-f5abc4f27fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:11.840202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15e85b79-5fe1-41a1-bcec-f5abc4f27fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:11.842233 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2112/4203] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:35:11 2022] DELETE /identity/v3/projects/5a551b5591c4409e9c19b95ca99eecec => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:35:11.848195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5fbfe-392f-43dd-8367-704f7b64e681 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:11.848768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5fbfe-392f-43dd-8367-704f7b64e681 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:11.849075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5fbfe-392f-43dd-8367-704f7b64e681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:11.938485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ada5fbfe-392f-43dd-8367-704f7b64e681 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:11.939976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ada5fbfe-392f-43dd-8367-704f7b64e681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:12.056260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:12.135123 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2092/4204] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:12.143487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3ef09-72ab-4b67-a2ac-b07b6eee1f02 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:12.144198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3ef09-72ab-4b67-a2ac-b07b6eee1f02 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:12.144655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3ef09-72ab-4b67-a2ac-b07b6eee1f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:12.219818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5df3ef09-72ab-4b67-a2ac-b07b6eee1f02 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:12.223342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5df3ef09-72ab-4b67-a2ac-b07b6eee1f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:12.280221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5fbfe-392f-43dd-8367-704f7b64e681 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:12.282564 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2113/4205] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:12.300573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5fbfe-392f-43dd-8367-704f7b64e681 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:12.312881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b8902-c9b9-43cb-9794-bfeb91e6f286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:12.313725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b8902-c9b9-43cb-9794-bfeb91e6f286 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:12.314169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b8902-c9b9-43cb-9794-bfeb91e6f286 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:12.315364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b8902-c9b9-43cb-9794-bfeb91e6f286 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:12.317368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b8902-c9b9-43cb-9794-bfeb91e6f286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:12.320610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b8902-c9b9-43cb-9794-bfeb91e6f286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:12.322889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b8902-c9b9-43cb-9794-bfeb91e6f286 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:12.361813 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2093/4206] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:35:12.362804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3ef09-72ab-4b67-a2ac-b07b6eee1f02 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:12.377047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3ef09-72ab-4b67-a2ac-b07b6eee1f02 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:12.400197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed251d8e-e2c6-4ed7-b593-7a737829f1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:12.401014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed251d8e-e2c6-4ed7-b593-7a737829f1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:12.401342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed251d8e-e2c6-4ed7-b593-7a737829f1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:12.401485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed251d8e-e2c6-4ed7-b593-7a737829f1a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:12.402160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed251d8e-e2c6-4ed7-b593-7a737829f1a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:12.404412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed251d8e-e2c6-4ed7-b593-7a737829f1a5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:12.464334 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2114/4207] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:35:12 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:35:12.465267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b8902-c9b9-43cb-9794-bfeb91e6f286 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:12.480345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b8902-c9b9-43cb-9794-bfeb91e6f286 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:12.630377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f121e-b9b6-4305-810a-4c86470175d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:12.631424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f121e-b9b6-4305-810a-4c86470175d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:12.634480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f121e-b9b6-4305-810a-4c86470175d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:12.635516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f121e-b9b6-4305-810a-4c86470175d0 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:12.636402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f121e-b9b6-4305-810a-4c86470175d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:12.639285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f121e-b9b6-4305-810a-4c86470175d0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:12.687052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed251d8e-e2c6-4ed7-b593-7a737829f1a5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:12.687856 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2094/4208] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:35:12 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:35:12.703265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed251d8e-e2c6-4ed7-b593-7a737829f1a5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:12.710805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3964630-d74e-471f-9928-7cf6024300d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:12.711769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3964630-d74e-471f-9928-7cf6024300d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:12.712059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3964630-d74e-471f-9928-7cf6024300d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:12.712731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3964630-d74e-471f-9928-7cf6024300d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:12.721454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3964630-d74e-471f-9928-7cf6024300d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:12.724790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3964630-d74e-471f-9928-7cf6024300d7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:12.750571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f121e-b9b6-4305-810a-4c86470175d0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:12.752248 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2115/4209] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:35:12.766065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f121e-b9b6-4305-810a-4c86470175d0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:12.775759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf7fab-2556-4772-b0a5-1846c0216961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:12.777198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7fab-2556-4772-b0a5-1846c0216961 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:12.779605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7fab-2556-4772-b0a5-1846c0216961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:12.779902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7fab-2556-4772-b0a5-1846c0216961 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:12.780587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf7fab-2556-4772-b0a5-1846c0216961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:12.783008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf7fab-2556-4772-b0a5-1846c0216961 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:12.809118 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2095/4210] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:35:12.813565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3964630-d74e-471f-9928-7cf6024300d7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:12.828563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3964630-d74e-471f-9928-7cf6024300d7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:12.837967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7aed4-330a-4d84-a497-6d842df629dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:12.838972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7aed4-330a-4d84-a497-6d842df629dc admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:12.839459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7aed4-330a-4d84-a497-6d842df629dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:12.839911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7aed4-330a-4d84-a497-6d842df629dc admin admin] PATH_INFO: `/v3/projects/6cf22e385b8f4e4bb0e802416446fe1d/users/a4a0713f4bfc4b1fb99f4afe849b042d/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:12.845122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:12.865497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7aed4-330a-4d84-a497-6d842df629dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf22e385b8f4e4bb0e802416446fe1d, user_id=a4a0713f4bfc4b1fb99f4afe849b042d, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:12.868581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7aed4-330a-4d84-a497-6d842df629dc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:12.899003 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2116/4211] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:35:12 2022] PUT /identity/v3/projects/6cf22e385b8f4e4bb0e802416446fe1d/users/a4a0713f4bfc4b1fb99f4afe849b042d/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:35:12.902629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dd8b1-89e0-449e-93b1-d4378818649b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:12.902629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dd8b1-89e0-449e-93b1-d4378818649b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:12.903460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dd8b1-89e0-449e-93b1-d4378818649b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:12.961940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d65dd8b1-89e0-449e-93b1-d4378818649b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:12.964959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d65dd8b1-89e0-449e-93b1-d4378818649b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:13.090010 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2096/4212] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:13.108766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7aed4-330a-4d84-a497-6d842df629dc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:13.111085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-53c7aed4-330a-4d84-a497-6d842df629dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:13.275546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7aed4-330a-4d84-a497-6d842df629dc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:13.284008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ce175-3925-4aca-8e2a-91951606d90b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:13.285590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ce175-3925-4aca-8e2a-91951606d90b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:13.285969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ce175-3925-4aca-8e2a-91951606d90b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:13.286280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ce175-3925-4aca-8e2a-91951606d90b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:13.317599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ce175-3925-4aca-8e2a-91951606d90b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:13.326309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ce175-3925-4aca-8e2a-91951606d90b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:13.377709 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2117/4213] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:35:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:35:19.216404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65dd8b1-89e0-449e-93b1-d4378818649b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:19.217751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d65dd8b1-89e0-449e-93b1-d4378818649b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:19.290814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:19.326260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65dd8b1-89e0-449e-93b1-d4378818649b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:19.335363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419e054-96d4-48a9-96a2-aacf5560705f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:19.335900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419e054-96d4-48a9-96a2-aacf5560705f service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:19.336304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419e054-96d4-48a9-96a2-aacf5560705f service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:19.336824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419e054-96d4-48a9-96a2-aacf5560705f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:19.339247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4419e054-96d4-48a9-96a2-aacf5560705f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:19.421840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419e054-96d4-48a9-96a2-aacf5560705f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:19.423504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419e054-96d4-48a9-96a2-aacf5560705f service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:19.452787 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2097/4214] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:35:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:35:21.180255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451b978-5981-4038-8ba4-bcb3a46f9af0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:21.180869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451b978-5981-4038-8ba4-bcb3a46f9af0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:21.181065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451b978-5981-4038-8ba4-bcb3a46f9af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:21.226587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f451b978-5981-4038-8ba4-bcb3a46f9af0 None None] MFA Rules not processed for user `a4a0713f4bfc4b1fb99f4afe849b042d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:21.227757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f451b978-5981-4038-8ba4-bcb3a46f9af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:21.319393 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2118/4215] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:35:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:35:21.331532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419e054-96d4-48a9-96a2-aacf5560705f service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:21.344300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419e054-96d4-48a9-96a2-aacf5560705f service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:21.365224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4e9b6-7e09-4d0e-97f9-14f35222b103 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:21.366378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4e9b6-7e09-4d0e-97f9-14f35222b103 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:21.366868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4e9b6-7e09-4d0e-97f9-14f35222b103 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:21.367803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4e9b6-7e09-4d0e-97f9-14f35222b103 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:21.421129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4e9b6-7e09-4d0e-97f9-14f35222b103 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:21.423606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4e9b6-7e09-4d0e-97f9-14f35222b103 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:21.457853 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2098/4216] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:35:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:35:24.454905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439971a-6342-4d83-ba18-112b99f42c14 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:24.455433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439971a-6342-4d83-ba18-112b99f42c14 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:24.455562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439971a-6342-4d83-ba18-112b99f42c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:24.475748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b439971a-6342-4d83-ba18-112b99f42c14 None None] MFA Rules not processed for user `a4a0713f4bfc4b1fb99f4afe849b042d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:24.477056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b439971a-6342-4d83-ba18-112b99f42c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:24.484107 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2119/4217] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:35:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:31.449160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=46 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:33.609958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4e9b6-7e09-4d0e-97f9-14f35222b103 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:33.611602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a9d4e9b6-7e09-4d0e-97f9-14f35222b103 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:33.627394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4e9b6-7e09-4d0e-97f9-14f35222b103 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:33.635430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be728ce-7c2c-45f8-bcc9-a874f9de68f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:33.636187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be728ce-7c2c-45f8-bcc9-a874f9de68f9 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:33.637197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be728ce-7c2c-45f8-bcc9-a874f9de68f9 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:33.637576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be728ce-7c2c-45f8-bcc9-a874f9de68f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:33.640293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5be728ce-7c2c-45f8-bcc9-a874f9de68f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:33.662569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be728ce-7c2c-45f8-bcc9-a874f9de68f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:33.664380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be728ce-7c2c-45f8-bcc9-a874f9de68f9 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:33.675961 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2099/4218] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:35:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:35:34.470285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=67,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:35.352111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facec2cf-940c-4767-bdc0-ce867ad22f82 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:35.352395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facec2cf-940c-4767-bdc0-ce867ad22f82 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:35.352890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facec2cf-940c-4767-bdc0-ce867ad22f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:35.374891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-facec2cf-940c-4767-bdc0-ce867ad22f82 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:35.376199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-facec2cf-940c-4767-bdc0-ce867ad22f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:35.444783 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2120/4219] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:35:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:35.475369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be728ce-7c2c-45f8-bcc9-a874f9de68f9 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:35.476847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5be728ce-7c2c-45f8-bcc9-a874f9de68f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:35.581268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be728ce-7c2c-45f8-bcc9-a874f9de68f9 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:35.610211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941fd77-7cdf-4dc6-a88e-f1df7f4b3664 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:35.611148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941fd77-7cdf-4dc6-a88e-f1df7f4b3664 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:35.611762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941fd77-7cdf-4dc6-a88e-f1df7f4b3664 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:35.612689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941fd77-7cdf-4dc6-a88e-f1df7f4b3664 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:35.644559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941fd77-7cdf-4dc6-a88e-f1df7f4b3664 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:35.648227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941fd77-7cdf-4dc6-a88e-f1df7f4b3664 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:35.677399 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2100/4220] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:35:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:35:39.700761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facec2cf-940c-4767-bdc0-ce867ad22f82 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:39.703629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-facec2cf-940c-4767-bdc0-ce867ad22f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:39.724432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facec2cf-940c-4767-bdc0-ce867ad22f82 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:39.730073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1511d1-8846-43b2-b5af-829457fb6f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:39.731383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1511d1-8846-43b2-b5af-829457fb6f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:39.731887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1511d1-8846-43b2-b5af-829457fb6f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:39.732393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1511d1-8846-43b2-b5af-829457fb6f3b admin admin] PATH_INFO: `/v3/users/ed083a289526439ea93593880be3ef86` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:39.733893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1511d1-8846-43b2-b5af-829457fb6f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed083a289526439ea93593880be3ef86)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:39.736196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1511d1-8846-43b2-b5af-829457fb6f3b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:39.872263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb1511d1-8846-43b2-b5af-829457fb6f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed083a289526439ea93593880be3ef86'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:39.874003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb1511d1-8846-43b2-b5af-829457fb6f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed083a289526439ea93593880be3ef86'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:39.888565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb1511d1-8846-43b2-b5af-829457fb6f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed083a289526439ea93593880be3ef86'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:39.927215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb1511d1-8846-43b2-b5af-829457fb6f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed083a289526439ea93593880be3ef86'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:40.000535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb1511d1-8846-43b2-b5af-829457fb6f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed083a289526439ea93593880be3ef86'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:40.023300 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2121/4221] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:35:39 2022] DELETE /identity/v3/users/ed083a289526439ea93593880be3ef86 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:35:40.027192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0765b-894b-4669-955f-052339211da1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:40.027772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0765b-894b-4669-955f-052339211da1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:40.027772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0765b-894b-4669-955f-052339211da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:40.075361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c3e0765b-894b-4669-955f-052339211da1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:40.077070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c3e0765b-894b-4669-955f-052339211da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:40.240520 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2101/4222] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:40.250203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1511d1-8846-43b2-b5af-829457fb6f3b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:40.252388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb1511d1-8846-43b2-b5af-829457fb6f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:40.362747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1511d1-8846-43b2-b5af-829457fb6f3b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:40.368854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccd660-0be3-4ae7-b2d9-380c6fa03c01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:40.369716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccd660-0be3-4ae7-b2d9-380c6fa03c01 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:40.370102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccd660-0be3-4ae7-b2d9-380c6fa03c01 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:40.370493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccd660-0be3-4ae7-b2d9-380c6fa03c01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:40.394529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccd660-0be3-4ae7-b2d9-380c6fa03c01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:40.396096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccd660-0be3-4ae7-b2d9-380c6fa03c01 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:40.410171 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2122/4223] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:35:40.847318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0765b-894b-4669-955f-052339211da1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:40.848992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c3e0765b-894b-4669-955f-052339211da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:40.865313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0765b-894b-4669-955f-052339211da1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:40.899995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761b73e-72ff-4868-8b8d-fbb76019b640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:40.901156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761b73e-72ff-4868-8b8d-fbb76019b640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:40.902617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761b73e-72ff-4868-8b8d-fbb76019b640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:40.903146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761b73e-72ff-4868-8b8d-fbb76019b640 admin admin] PATH_INFO: `/v3/projects/38b6047ebd7e49a2a0afebf88cbc3183` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:40.905213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761b73e-72ff-4868-8b8d-fbb76019b640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b6047ebd7e49a2a0afebf88cbc3183)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:40.923310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761b73e-72ff-4868-8b8d-fbb76019b640 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:41.043134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f761b73e-72ff-4868-8b8d-fbb76019b640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b6047ebd7e49a2a0afebf88cbc3183', 'request_id': 'req-f761b73e-72ff-4868-8b8d-fbb76019b640'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:41.059836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f761b73e-72ff-4868-8b8d-fbb76019b640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b6047ebd7e49a2a0afebf88cbc3183', 'request_id': 'req-f761b73e-72ff-4868-8b8d-fbb76019b640'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:41.070525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f761b73e-72ff-4868-8b8d-fbb76019b640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b6047ebd7e49a2a0afebf88cbc3183', 'request_id': 'req-f761b73e-72ff-4868-8b8d-fbb76019b640'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:41.096026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:41.104538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f761b73e-72ff-4868-8b8d-fbb76019b640 admin admin] The token cache is being invalidate because project 38b6047ebd7e49a2a0afebf88cbc3183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:35:41.105305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f761b73e-72ff-4868-8b8d-fbb76019b640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:41.106933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f761b73e-72ff-4868-8b8d-fbb76019b640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:41.110515 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2102/4224] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:35:40 2022] DELETE /identity/v3/projects/38b6047ebd7e49a2a0afebf88cbc3183 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:35:41.115928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccd660-0be3-4ae7-b2d9-380c6fa03c01 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:41.139560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccd660-0be3-4ae7-b2d9-380c6fa03c01 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:41.190427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:41.276400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df48126-6067-4dde-9149-91c1c94a6d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:41.277069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df48126-6067-4dde-9149-91c1c94a6d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:41.277352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df48126-6067-4dde-9149-91c1c94a6d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:41.277628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df48126-6067-4dde-9149-91c1c94a6d30 admin admin] PATH_INFO: `/v3/users/14284c0aaa6048edbf6c2b95d67085e4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:41.280469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df48126-6067-4dde-9149-91c1c94a6d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14284c0aaa6048edbf6c2b95d67085e4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:41.282758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df48126-6067-4dde-9149-91c1c94a6d30 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:41.403415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9df48126-6067-4dde-9149-91c1c94a6d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14284c0aaa6048edbf6c2b95d67085e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:41.404117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9df48126-6067-4dde-9149-91c1c94a6d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14284c0aaa6048edbf6c2b95d67085e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:41.415892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9df48126-6067-4dde-9149-91c1c94a6d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14284c0aaa6048edbf6c2b95d67085e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:41.445900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9df48126-6067-4dde-9149-91c1c94a6d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14284c0aaa6048edbf6c2b95d67085e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:41.463985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9df48126-6067-4dde-9149-91c1c94a6d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14284c0aaa6048edbf6c2b95d67085e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:41.475070 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2123/4225] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:35:41 2022] DELETE /identity/v3/users/14284c0aaa6048edbf6c2b95d67085e4 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:35:41.790286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761b73e-72ff-4868-8b8d-fbb76019b640 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:41.791911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f761b73e-72ff-4868-8b8d-fbb76019b640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:41.808498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761b73e-72ff-4868-8b8d-fbb76019b640 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:41.890207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85965da-31c1-4458-b085-dd390560ddb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:41.891282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85965da-31c1-4458-b085-dd390560ddb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:41.891772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85965da-31c1-4458-b085-dd390560ddb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:41.892257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85965da-31c1-4458-b085-dd390560ddb0 admin admin] PATH_INFO: `/v3/projects/af0ce1ad10aa42b789e2cffdb55dc348` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:41.896430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85965da-31c1-4458-b085-dd390560ddb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af0ce1ad10aa42b789e2cffdb55dc348)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:41.899009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85965da-31c1-4458-b085-dd390560ddb0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:41.980202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d85965da-31c1-4458-b085-dd390560ddb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af0ce1ad10aa42b789e2cffdb55dc348', 'request_id': 'req-d85965da-31c1-4458-b085-dd390560ddb0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:42.005790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d85965da-31c1-4458-b085-dd390560ddb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af0ce1ad10aa42b789e2cffdb55dc348', 'request_id': 'req-d85965da-31c1-4458-b085-dd390560ddb0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:42.013973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d85965da-31c1-4458-b085-dd390560ddb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af0ce1ad10aa42b789e2cffdb55dc348', 'request_id': 'req-d85965da-31c1-4458-b085-dd390560ddb0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:42.035322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d85965da-31c1-4458-b085-dd390560ddb0 admin admin] The token cache is being invalidate because project af0ce1ad10aa42b789e2cffdb55dc348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:35:42.035656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d85965da-31c1-4458-b085-dd390560ddb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:42.036335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d85965da-31c1-4458-b085-dd390560ddb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:35:42.042838 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2103/4226] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:35:41 2022] DELETE /identity/v3/projects/af0ce1ad10aa42b789e2cffdb55dc348 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:35:42.044208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c193d-46c1-4643-ab13-9e0217f548fb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:42.044498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c193d-46c1-4643-ab13-9e0217f548fb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:42.044797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c193d-46c1-4643-ab13-9e0217f548fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:42.085416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-286c193d-46c1-4643-ab13-9e0217f548fb None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:42.088770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-286c193d-46c1-4643-ab13-9e0217f548fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:42.187598 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2124/4227] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:42.198067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09109c3-873f-412e-872b-d3e6dabeeef1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:42.199062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09109c3-873f-412e-872b-d3e6dabeeef1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:42.199614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09109c3-873f-412e-872b-d3e6dabeeef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:42.242407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f09109c3-873f-412e-872b-d3e6dabeeef1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:42.244093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f09109c3-873f-412e-872b-d3e6dabeeef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:42.255853 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2104/4228] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:42.260199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c193d-46c1-4643-ab13-9e0217f548fb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:42.271909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c193d-46c1-4643-ab13-9e0217f548fb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:42.279579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e65e65-c0c0-484d-b020-469297a61458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:42.281644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e65e65-c0c0-484d-b020-469297a61458 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:42.282194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e65e65-c0c0-484d-b020-469297a61458 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:42.282391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e65e65-c0c0-484d-b020-469297a61458 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:42.283557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e65e65-c0c0-484d-b020-469297a61458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:42.283872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e65e65-c0c0-484d-b020-469297a61458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:42.288545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e65e65-c0c0-484d-b020-469297a61458 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:42.305529 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2125/4229] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:35:42.309699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09109c3-873f-412e-872b-d3e6dabeeef1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:42.319672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09109c3-873f-412e-872b-d3e6dabeeef1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:42.326585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc457d-e662-441a-aa98-81cb729b2896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:42.327212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc457d-e662-441a-aa98-81cb729b2896 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:42.327523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc457d-e662-441a-aa98-81cb729b2896 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:42.327790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc457d-e662-441a-aa98-81cb729b2896 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:42.328423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc457d-e662-441a-aa98-81cb729b2896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:42.330329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc457d-e662-441a-aa98-81cb729b2896 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:42.367880 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2105/4230] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:35:42 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:35:42.369152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e65e65-c0c0-484d-b020-469297a61458 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:42.381194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e65e65-c0c0-484d-b020-469297a61458 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:42.418027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:42.473366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413f774-a5bb-450f-b09e-2d700d479528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:42.475495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413f774-a5bb-450f-b09e-2d700d479528 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:42.476106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413f774-a5bb-450f-b09e-2d700d479528 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:42.476578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413f774-a5bb-450f-b09e-2d700d479528 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:42.477297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413f774-a5bb-450f-b09e-2d700d479528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:42.479385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413f774-a5bb-450f-b09e-2d700d479528 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:42.539763 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2126/4231] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:35:42 2022] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:35:42.540944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc457d-e662-441a-aa98-81cb729b2896 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:42.565576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc457d-e662-441a-aa98-81cb729b2896 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:42.578122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a4ced-1920-4388-9849-cf20cdf9dbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:42.579131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a4ced-1920-4388-9849-cf20cdf9dbca admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:42.579663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a4ced-1920-4388-9849-cf20cdf9dbca admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:42.580222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a4ced-1920-4388-9849-cf20cdf9dbca admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:42.581092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a4ced-1920-4388-9849-cf20cdf9dbca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:42.583603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a4ced-1920-4388-9849-cf20cdf9dbca admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:42.610944 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2106/4232] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:35:42.612193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413f774-a5bb-450f-b09e-2d700d479528 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:42.627206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413f774-a5bb-450f-b09e-2d700d479528 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:42.632556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a914354-8d47-49b9-8859-87fb7d0d3610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:42.633481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a914354-8d47-49b9-8859-87fb7d0d3610 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:42.633988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a914354-8d47-49b9-8859-87fb7d0d3610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:42.634480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a914354-8d47-49b9-8859-87fb7d0d3610 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:42.635406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a914354-8d47-49b9-8859-87fb7d0d3610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:42.637241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a914354-8d47-49b9-8859-87fb7d0d3610 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:42.652170 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2127/4233] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:35:42.657594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a4ced-1920-4388-9849-cf20cdf9dbca admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:42.693002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a4ced-1920-4388-9849-cf20cdf9dbca admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:42.698304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594db550-c62b-4d66-ba4e-ca05b4ad51f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:42.699203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594db550-c62b-4d66-ba4e-ca05b4ad51f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:42.699735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594db550-c62b-4d66-ba4e-ca05b4ad51f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:42.700240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594db550-c62b-4d66-ba4e-ca05b4ad51f1 admin admin] PATH_INFO: `/v3/projects/48439d21167a42748f5813c95b7a8437/users/e57aca8c1b5847f999daeb74a982f4ec/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:42.720224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594db550-c62b-4d66-ba4e-ca05b4ad51f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48439d21167a42748f5813c95b7a8437, user_id=e57aca8c1b5847f999daeb74a982f4ec, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:42.724006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594db550-c62b-4d66-ba4e-ca05b4ad51f1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:42.743072 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2107/4234] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:35:42 2022] PUT /identity/v3/projects/48439d21167a42748f5813c95b7a8437/users/e57aca8c1b5847f999daeb74a982f4ec/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:35:42.756579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70092a-1bd3-47d7-8f79-925b09e7e96d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:42.756943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70092a-1bd3-47d7-8f79-925b09e7e96d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:42.757725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70092a-1bd3-47d7-8f79-925b09e7e96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:42.788355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-db70092a-1bd3-47d7-8f79-925b09e7e96d None None] MFA Rules not processed for user `e57aca8c1b5847f999daeb74a982f4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:42.789604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db70092a-1bd3-47d7-8f79-925b09e7e96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:42.920970 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2128/4235] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:35:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:42.925569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594db550-c62b-4d66-ba4e-ca05b4ad51f1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:42.973422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:43.035996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594db550-c62b-4d66-ba4e-ca05b4ad51f1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:43.044179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76566784-9eb7-4542-b710-f3e2d0206d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:43.045067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76566784-9eb7-4542-b710-f3e2d0206d38 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:43.045440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76566784-9eb7-4542-b710-f3e2d0206d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:43.045816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76566784-9eb7-4542-b710-f3e2d0206d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:43.046569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76566784-9eb7-4542-b710-f3e2d0206d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:43.049551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76566784-9eb7-4542-b710-f3e2d0206d38 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:43.092048 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2108/4236] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:35:42 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:35:43.097506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70092a-1bd3-47d7-8f79-925b09e7e96d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:43.112111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70092a-1bd3-47d7-8f79-925b09e7e96d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:43.185461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb37fe-82df-4ab3-babe-1fe1624c4cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:43.186471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb37fe-82df-4ab3-babe-1fe1624c4cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:43.186826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb37fe-82df-4ab3-babe-1fe1624c4cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:43.188476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb37fe-82df-4ab3-babe-1fe1624c4cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:43.189068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb37fe-82df-4ab3-babe-1fe1624c4cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:43.191064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb37fe-82df-4ab3-babe-1fe1624c4cb6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:43.238543 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2129/4237] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:35:43 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:35:43.243966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76566784-9eb7-4542-b710-f3e2d0206d38 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:43.259756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76566784-9eb7-4542-b710-f3e2d0206d38 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:43.266810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3565e2-126a-4686-9512-e1090ba399cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:43.267642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3565e2-126a-4686-9512-e1090ba399cc admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:43.267925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3565e2-126a-4686-9512-e1090ba399cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:43.268201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3565e2-126a-4686-9512-e1090ba399cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:43.268857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3565e2-126a-4686-9512-e1090ba399cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:43.270615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3565e2-126a-4686-9512-e1090ba399cc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:43.287089 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2109/4238] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:35:43.290812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb37fe-82df-4ab3-babe-1fe1624c4cb6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:43.307937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb37fe-82df-4ab3-babe-1fe1624c4cb6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:43.316353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad30798-5b61-4782-9b58-17f509d4bbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:43.317609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad30798-5b61-4782-9b58-17f509d4bbf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:43.318629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad30798-5b61-4782-9b58-17f509d4bbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:43.319148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad30798-5b61-4782-9b58-17f509d4bbf6 admin admin] PATH_INFO: `/v3/projects/a7fd7975dba04cecb3c4328bf23e0a92/users/facbba4046d7401db296b74664a31481/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:43.379016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad30798-5b61-4782-9b58-17f509d4bbf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7fd7975dba04cecb3c4328bf23e0a92, user_id=facbba4046d7401db296b74664a31481, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:43.385948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad30798-5b61-4782-9b58-17f509d4bbf6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:43.406536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:43.412811 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2130/4239] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:35:43 2022] PUT /identity/v3/projects/a7fd7975dba04cecb3c4328bf23e0a92/users/facbba4046d7401db296b74664a31481/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:35:43.416959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3565e2-126a-4686-9512-e1090ba399cc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:43.429968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3565e2-126a-4686-9512-e1090ba399cc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:43.613767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa96171-0aee-4226-959d-fa0a4cba2ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:43.614449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa96171-0aee-4226-959d-fa0a4cba2ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:43.614733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa96171-0aee-4226-959d-fa0a4cba2ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:43.615012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa96171-0aee-4226-959d-fa0a4cba2ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:43.615746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa96171-0aee-4226-959d-fa0a4cba2ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:43.617388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa96171-0aee-4226-959d-fa0a4cba2ca5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:43.653390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad30798-5b61-4782-9b58-17f509d4bbf6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:43.663506 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2110/4240] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:35:43.669226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad30798-5b61-4782-9b58-17f509d4bbf6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:43.679461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f0a4b-e5a3-4637-90e0-98768dc4c9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:43.681230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f0a4b-e5a3-4637-90e0-98768dc4c9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:43.681615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f0a4b-e5a3-4637-90e0-98768dc4c9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:43.682882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f0a4b-e5a3-4637-90e0-98768dc4c9f6 admin admin] PATH_INFO: `/v3/projects/a7fd7975dba04cecb3c4328bf23e0a92/users/facbba4046d7401db296b74664a31481/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:43.687349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f0a4b-e5a3-4637-90e0-98768dc4c9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7fd7975dba04cecb3c4328bf23e0a92, user_id=facbba4046d7401db296b74664a31481, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:43.690086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f0a4b-e5a3-4637-90e0-98768dc4c9f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:43.707297 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2131/4241] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:35:43 2022] PUT /identity/v3/projects/a7fd7975dba04cecb3c4328bf23e0a92/users/facbba4046d7401db296b74664a31481/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:35:43.718872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24a4b8-2755-418b-b08e-973a373641ca None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:43.719433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24a4b8-2755-418b-b08e-973a373641ca None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:43.719973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24a4b8-2755-418b-b08e-973a373641ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:43.788294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-db24a4b8-2755-418b-b08e-973a373641ca None None] MFA Rules not processed for user `facbba4046d7401db296b74664a31481`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:43.790259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db24a4b8-2755-418b-b08e-973a373641ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:43.955993 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2111/4242] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:35:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:43.970011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ef111-ef26-4f3f-bc0a-3b1698e32825 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:43.970440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ef111-ef26-4f3f-bc0a-3b1698e32825 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:43.971132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ef111-ef26-4f3f-bc0a-3b1698e32825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:44.009082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5b9ef111-ef26-4f3f-bc0a-3b1698e32825 None None] MFA Rules not processed for user `e57aca8c1b5847f999daeb74a982f4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:44.011038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5b9ef111-ef26-4f3f-bc0a-3b1698e32825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:44.141957 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2132/4243] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:35:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:44.149792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24a4b8-2755-418b-b08e-973a373641ca None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:44.152154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db24a4b8-2755-418b-b08e-973a373641ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:44.192463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:44.299900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24a4b8-2755-418b-b08e-973a373641ca None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:44.315729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7a041-b4bc-458c-8f78-a49b4d32dacb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:44.316375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7a041-b4bc-458c-8f78-a49b4d32dacb service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:44.322226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7a041-b4bc-458c-8f78-a49b4d32dacb service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:44.322616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7a041-b4bc-458c-8f78-a49b4d32dacb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:44.328917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078b6ca-2e0b-4bb0-91e3-8e806fa13b7e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:44.330059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078b6ca-2e0b-4bb0-91e3-8e806fa13b7e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:44.330555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078b6ca-2e0b-4bb0-91e3-8e806fa13b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:44.343064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7a041-b4bc-458c-8f78-a49b4d32dacb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:44.344732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7a041-b4bc-458c-8f78-a49b4d32dacb service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:44.355945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4078b6ca-2e0b-4bb0-91e3-8e806fa13b7e None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:44.357636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4078b6ca-2e0b-4bb0-91e3-8e806fa13b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:44.367814 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2112/4244] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:35:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:35:44.436788 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2133/4245] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:35:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:35:44.580940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7a041-b4bc-458c-8f78-a49b4d32dacb service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:44.582613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f2d7a041-b4bc-458c-8f78-a49b4d32dacb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:44.708984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7a041-b4bc-458c-8f78-a49b4d32dacb service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:44.715715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab965a1c-117c-4dc1-ba10-c9260db9e82d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:44.716637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab965a1c-117c-4dc1-ba10-c9260db9e82d service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:44.717135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab965a1c-117c-4dc1-ba10-c9260db9e82d service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:44.717636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab965a1c-117c-4dc1-ba10-c9260db9e82d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:44.728107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab965a1c-117c-4dc1-ba10-c9260db9e82d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:44.730020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab965a1c-117c-4dc1-ba10-c9260db9e82d service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:44.740997 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2113/4246] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:35:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:35:54.426948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=55,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:54.741841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=56 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:58.403169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9263c-c16d-422d-ab88-fb408bb71e9a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:58.403714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9263c-c16d-422d-ab88-fb408bb71e9a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:58.404091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9263c-c16d-422d-ab88-fb408bb71e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:58.430272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-eff9263c-c16d-422d-ab88-fb408bb71e9a None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:58.432957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eff9263c-c16d-422d-ab88-fb408bb71e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:58.454945 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2134/4247] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:35:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:58.469150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab965a1c-117c-4dc1-ba10-c9260db9e82d service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:58.481716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab965a1c-117c-4dc1-ba10-c9260db9e82d service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:58.488315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fbda2-6e83-4460-8bb5-7a2a6716a1da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:58.489103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fbda2-6e83-4460-8bb5-7a2a6716a1da service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:58.489475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fbda2-6e83-4460-8bb5-7a2a6716a1da service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:58.491393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fbda2-6e83-4460-8bb5-7a2a6716a1da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:58.508401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fbda2-6e83-4460-8bb5-7a2a6716a1da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:58.511783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fbda2-6e83-4460-8bb5-7a2a6716a1da service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:58.538049 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2114/4248] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:35:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:35:58.953890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911489a-f2cc-4d8c-9c8f-4becf50bbe65 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:58.954179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911489a-f2cc-4d8c-9c8f-4becf50bbe65 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:58.954460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911489a-f2cc-4d8c-9c8f-4becf50bbe65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:58.977472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d911489a-f2cc-4d8c-9c8f-4becf50bbe65 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:58.978793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d911489a-f2cc-4d8c-9c8f-4becf50bbe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:58.987434 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2135/4249] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:35:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:59.001018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fbda2-6e83-4460-8bb5-7a2a6716a1da service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:59.012874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fbda2-6e83-4460-8bb5-7a2a6716a1da service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:59.018167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc5705-f0bd-448c-88c4-16bea6f027d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:59.018865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc5705-f0bd-448c-88c4-16bea6f027d3 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:59.019146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc5705-f0bd-448c-88c4-16bea6f027d3 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:59.019462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc5705-f0bd-448c-88c4-16bea6f027d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:59.028767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc5705-f0bd-448c-88c4-16bea6f027d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:59.030358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc5705-f0bd-448c-88c4-16bea6f027d3 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:59.039223 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2115/4250] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:35:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 18:35:59.430711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98968e5e-dbba-4291-91b3-3a9145d7660f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:59.431717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98968e5e-dbba-4291-91b3-3a9145d7660f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:59.432269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98968e5e-dbba-4291-91b3-3a9145d7660f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:59.457549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-98968e5e-dbba-4291-91b3-3a9145d7660f None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:59.458805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98968e5e-dbba-4291-91b3-3a9145d7660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:59.481465 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2136/4251] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:35:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:35:59.496889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc5705-f0bd-448c-88c4-16bea6f027d3 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:59.509619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc5705-f0bd-448c-88c4-16bea6f027d3 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:59.518917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01aad7-a94e-40c5-ae3f-06c83ef56519 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:59.520094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01aad7-a94e-40c5-ae3f-06c83ef56519 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:59.520555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01aad7-a94e-40c5-ae3f-06c83ef56519 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:59.521717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01aad7-a94e-40c5-ae3f-06c83ef56519 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:59.539943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01aad7-a94e-40c5-ae3f-06c83ef56519 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:59.542049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01aad7-a94e-40c5-ae3f-06c83ef56519 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:59.561256 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2116/4252] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:35:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:36:05.685215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98968e5e-dbba-4291-91b3-3a9145d7660f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:05.686914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98968e5e-dbba-4291-91b3-3a9145d7660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:05.733084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98968e5e-dbba-4291-91b3-3a9145d7660f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:05.765373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68a123-53a3-4a01-bdb9-9474bb5811bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:05.768828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68a123-53a3-4a01-bdb9-9474bb5811bc service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:05.770171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68a123-53a3-4a01-bdb9-9474bb5811bc service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:05.770613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68a123-53a3-4a01-bdb9-9474bb5811bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:05.808774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68a123-53a3-4a01-bdb9-9474bb5811bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:05.814564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68a123-53a3-4a01-bdb9-9474bb5811bc service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:05.842986 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2137/4253] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:36:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:36:07.043674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c08aff-6d91-4025-af59-749c9f3d1d27 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:07.044697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c08aff-6d91-4025-af59-749c9f3d1d27 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:07.045825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c08aff-6d91-4025-af59-749c9f3d1d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:07.069503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-84c08aff-6d91-4025-af59-749c9f3d1d27 None None] MFA Rules not processed for user `e57aca8c1b5847f999daeb74a982f4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:07.071198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-84c08aff-6d91-4025-af59-749c9f3d1d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:07.084268 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2117/4254] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:11.649143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68a123-53a3-4a01-bdb9-9474bb5811bc service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:11.651340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e68a123-53a3-4a01-bdb9-9474bb5811bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:11.828778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68a123-53a3-4a01-bdb9-9474bb5811bc service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:11.834460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ba1fa-deca-49c3-8e4e-d122884c21bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:11.835089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ba1fa-deca-49c3-8e4e-d122884c21bb service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:11.835419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ba1fa-deca-49c3-8e4e-d122884c21bb service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:11.835698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ba1fa-deca-49c3-8e4e-d122884c21bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:11.838422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a2ba1fa-deca-49c3-8e4e-d122884c21bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:11.856266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ba1fa-deca-49c3-8e4e-d122884c21bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:11.858199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ba1fa-deca-49c3-8e4e-d122884c21bb service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:11.871739 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2138/4255] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:36:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:36:15.413359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc2b21-2622-44f1-9850-305b4819dd5d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:15.414001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc2b21-2622-44f1-9850-305b4819dd5d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:15.414135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc2b21-2622-44f1-9850-305b4819dd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:15.444562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0efc2b21-2622-44f1-9850-305b4819dd5d None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:15.448144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0efc2b21-2622-44f1-9850-305b4819dd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:15.472386 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2118/4256] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:36:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:15.490696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ba1fa-deca-49c3-8e4e-d122884c21bb service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:15.563289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ba1fa-deca-49c3-8e4e-d122884c21bb service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:15.585566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97d23d-c96d-4cd4-a746-63e5e073ab30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:15.586267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97d23d-c96d-4cd4-a746-63e5e073ab30 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:15.586551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97d23d-c96d-4cd4-a746-63e5e073ab30 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:15.586825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97d23d-c96d-4cd4-a746-63e5e073ab30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:15.610039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97d23d-c96d-4cd4-a746-63e5e073ab30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:15.613945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97d23d-c96d-4cd4-a746-63e5e073ab30 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:15.671840 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2139/4257] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:36:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:36:15.910710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1664a4-ba50-40ac-8a8e-0e959e3f1d2b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:15.910987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1664a4-ba50-40ac-8a8e-0e959e3f1d2b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:15.911647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1664a4-ba50-40ac-8a8e-0e959e3f1d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:15.960365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-da1664a4-ba50-40ac-8a8e-0e959e3f1d2b None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:15.962519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-da1664a4-ba50-40ac-8a8e-0e959e3f1d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:15.977246 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2119/4258] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:36:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:15.991232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97d23d-c96d-4cd4-a746-63e5e073ab30 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:16.010265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97d23d-c96d-4cd4-a746-63e5e073ab30 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:16.024314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8374c-962d-4068-b1d7-5a74324ace9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:16.026040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8374c-962d-4068-b1d7-5a74324ace9e service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:16.026352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8374c-962d-4068-b1d7-5a74324ace9e service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:16.026630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8374c-962d-4068-b1d7-5a74324ace9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:16.058036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8374c-962d-4068-b1d7-5a74324ace9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:16.060280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8374c-962d-4068-b1d7-5a74324ace9e service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:16.089580 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2140/4259] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:36:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:36:16.381059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618cf7c-2595-441c-9a9b-db1e62fde062 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:16.381592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618cf7c-2595-441c-9a9b-db1e62fde062 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:16.382032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618cf7c-2595-441c-9a9b-db1e62fde062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:16.414944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a618cf7c-2595-441c-9a9b-db1e62fde062 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:16.417395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a618cf7c-2595-441c-9a9b-db1e62fde062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:16.444154 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2120/4260] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:36:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:16.444610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8374c-962d-4068-b1d7-5a74324ace9e service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:16.460786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8374c-962d-4068-b1d7-5a74324ace9e service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:16.488025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c8404-f6f5-4d51-9d0a-4267c2326041 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:16.489216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c8404-f6f5-4d51-9d0a-4267c2326041 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:16.489660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c8404-f6f5-4d51-9d0a-4267c2326041 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:16.490121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c8404-f6f5-4d51-9d0a-4267c2326041 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:16.506195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c8404-f6f5-4d51-9d0a-4267c2326041 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:16.509587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c8404-f6f5-4d51-9d0a-4267c2326041 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:16.524622 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2141/4261] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:36:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:36:16.667069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618cf7c-2595-441c-9a9b-db1e62fde062 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:16.668996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a618cf7c-2595-441c-9a9b-db1e62fde062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:16.777429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618cf7c-2595-441c-9a9b-db1e62fde062 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:16.783605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e573b-5ba4-4413-a527-a7474145dbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:16.784609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e573b-5ba4-4413-a527-a7474145dbd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:16.785209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e573b-5ba4-4413-a527-a7474145dbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:16.785654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e573b-5ba4-4413-a527-a7474145dbd5 admin admin] PATH_INFO: `/v3/users/3c27c792ec89484ea1f8c7147195561a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:16.787221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e573b-5ba4-4413-a527-a7474145dbd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c27c792ec89484ea1f8c7147195561a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:16.790693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e573b-5ba4-4413-a527-a7474145dbd5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:16.896033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9b6e573b-5ba4-4413-a527-a7474145dbd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c27c792ec89484ea1f8c7147195561a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:16.946708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9b6e573b-5ba4-4413-a527-a7474145dbd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c27c792ec89484ea1f8c7147195561a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:16.947997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9b6e573b-5ba4-4413-a527-a7474145dbd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c27c792ec89484ea1f8c7147195561a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:16.948778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9b6e573b-5ba4-4413-a527-a7474145dbd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c27c792ec89484ea1f8c7147195561a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:16.968877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9b6e573b-5ba4-4413-a527-a7474145dbd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c27c792ec89484ea1f8c7147195561a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:16.999599 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2121/4262] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:36:16 2022] DELETE /identity/v3/users/3c27c792ec89484ea1f8c7147195561a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:17.004002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6276f5-8d29-4860-9d63-10e0fdf98e17 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:17.004557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6276f5-8d29-4860-9d63-10e0fdf98e17 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:17.005164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6276f5-8d29-4860-9d63-10e0fdf98e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:17.034429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4a6276f5-8d29-4860-9d63-10e0fdf98e17 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:17.036193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a6276f5-8d29-4860-9d63-10e0fdf98e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:17.141487 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2142/4263] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:17.154626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e573b-5ba4-4413-a527-a7474145dbd5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:17.156362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9b6e573b-5ba4-4413-a527-a7474145dbd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:17.183727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:17.257454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e573b-5ba4-4413-a527-a7474145dbd5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:17.261916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20c93b-1be9-4ff3-9cd2-3003aa320c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:17.262766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20c93b-1be9-4ff3-9cd2-3003aa320c4c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:17.262928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20c93b-1be9-4ff3-9cd2-3003aa320c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:17.263073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20c93b-1be9-4ff3-9cd2-3003aa320c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:17.273032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20c93b-1be9-4ff3-9cd2-3003aa320c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:17.274534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20c93b-1be9-4ff3-9cd2-3003aa320c4c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:17.296166 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2122/4264] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:36:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:36:17.702902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6276f5-8d29-4860-9d63-10e0fdf98e17 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:17.704802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a6276f5-8d29-4860-9d63-10e0fdf98e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:17.727442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6276f5-8d29-4860-9d63-10e0fdf98e17 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:17.753263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720776a-540d-4c4d-9f3a-6c08a7a76926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:17.754483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720776a-540d-4c4d-9f3a-6c08a7a76926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:17.755042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720776a-540d-4c4d-9f3a-6c08a7a76926 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:17.755582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720776a-540d-4c4d-9f3a-6c08a7a76926 admin admin] PATH_INFO: `/v3/projects/2a9635dc601347759aa5cbdb9df1905b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:17.757097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720776a-540d-4c4d-9f3a-6c08a7a76926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9635dc601347759aa5cbdb9df1905b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:17.785990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720776a-540d-4c4d-9f3a-6c08a7a76926 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:17.834222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:17.891046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2720776a-540d-4c4d-9f3a-6c08a7a76926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9635dc601347759aa5cbdb9df1905b', 'request_id': 'req-2720776a-540d-4c4d-9f3a-6c08a7a76926'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:17.909936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2720776a-540d-4c4d-9f3a-6c08a7a76926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9635dc601347759aa5cbdb9df1905b', 'request_id': 'req-2720776a-540d-4c4d-9f3a-6c08a7a76926'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:17.919803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2720776a-540d-4c4d-9f3a-6c08a7a76926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9635dc601347759aa5cbdb9df1905b', 'request_id': 'req-2720776a-540d-4c4d-9f3a-6c08a7a76926'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:17.937307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2720776a-540d-4c4d-9f3a-6c08a7a76926 admin admin] The token cache is being invalidate because project 2a9635dc601347759aa5cbdb9df1905b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:36:17.937639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2720776a-540d-4c4d-9f3a-6c08a7a76926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:17.938507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2720776a-540d-4c4d-9f3a-6c08a7a76926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:17.940450 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2143/4265] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:36:17 2022] DELETE /identity/v3/projects/2a9635dc601347759aa5cbdb9df1905b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:17.946000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2d13c-e657-473a-ba5d-bea1e2558844 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:17.946847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2d13c-e657-473a-ba5d-bea1e2558844 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:17.947554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2d13c-e657-473a-ba5d-bea1e2558844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.005618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-34c2d13c-e657-473a-ba5d-bea1e2558844 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:18.007481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-34c2d13c-e657-473a-ba5d-bea1e2558844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:18.108945 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2123/4266] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:18.117046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620eed9-664c-4673-91b6-9d8c7e6c2939 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:18.117339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620eed9-664c-4673-91b6-9d8c7e6c2939 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:18.117624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620eed9-664c-4673-91b6-9d8c7e6c2939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.138781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8620eed9-664c-4673-91b6-9d8c7e6c2939 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:18.140133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8620eed9-664c-4673-91b6-9d8c7e6c2939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:18.150834 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2144/4267] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:18.155185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2d13c-e657-473a-ba5d-bea1e2558844 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:18.168952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2d13c-e657-473a-ba5d-bea1e2558844 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:18.184708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849aa1d0-c3c9-48ab-82c7-14865ac772b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:18.185502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849aa1d0-c3c9-48ab-82c7-14865ac772b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:18.185884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849aa1d0-c3c9-48ab-82c7-14865ac772b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:18.186265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849aa1d0-c3c9-48ab-82c7-14865ac772b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.187040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849aa1d0-c3c9-48ab-82c7-14865ac772b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:18.187479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849aa1d0-c3c9-48ab-82c7-14865ac772b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:18.189150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849aa1d0-c3c9-48ab-82c7-14865ac772b6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:18.209032 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2124/4268] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:18.216154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620eed9-664c-4673-91b6-9d8c7e6c2939 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:18.243240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620eed9-664c-4673-91b6-9d8c7e6c2939 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:18.258336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ec238-aeee-4d60-b0cc-d9d44e2e07d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:18.259442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ec238-aeee-4d60-b0cc-d9d44e2e07d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:18.259970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ec238-aeee-4d60-b0cc-d9d44e2e07d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:18.260471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ec238-aeee-4d60-b0cc-d9d44e2e07d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.265186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ec238-aeee-4d60-b0cc-d9d44e2e07d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:18.267918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ec238-aeee-4d60-b0cc-d9d44e2e07d0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:18.342986 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2145/4269] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:36:18 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:18.344900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849aa1d0-c3c9-48ab-82c7-14865ac772b6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:18.360087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849aa1d0-c3c9-48ab-82c7-14865ac772b6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:18.481552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e7758-455b-43d7-9789-e20991bb2d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:18.482184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e7758-455b-43d7-9789-e20991bb2d59 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:18.482642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e7758-455b-43d7-9789-e20991bb2d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:18.482924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e7758-455b-43d7-9789-e20991bb2d59 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.483606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e7758-455b-43d7-9789-e20991bb2d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:18.486048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e7758-455b-43d7-9789-e20991bb2d59 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:18.522751 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2125/4270] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:36:18 2022] POST /identity/v3/users => generated 295 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:18.524202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ec238-aeee-4d60-b0cc-d9d44e2e07d0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:18.538790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ec238-aeee-4d60-b0cc-d9d44e2e07d0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:18.552167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d88e4f-72f9-4bed-996e-2a78f3ca6318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:18.553588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d88e4f-72f9-4bed-996e-2a78f3ca6318 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:18.553874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d88e4f-72f9-4bed-996e-2a78f3ca6318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:18.554148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d88e4f-72f9-4bed-996e-2a78f3ca6318 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.556870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d88e4f-72f9-4bed-996e-2a78f3ca6318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:18.558957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d88e4f-72f9-4bed-996e-2a78f3ca6318 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:18.583315 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2146/4271] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:36:18.585435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e7758-455b-43d7-9789-e20991bb2d59 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:18.599724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e7758-455b-43d7-9789-e20991bb2d59 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:18.616667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad22ce2-6954-446a-90ff-22ac3ac327d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:18.617224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad22ce2-6954-446a-90ff-22ac3ac327d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:18.617503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad22ce2-6954-446a-90ff-22ac3ac327d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:18.617784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad22ce2-6954-446a-90ff-22ac3ac327d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.618440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad22ce2-6954-446a-90ff-22ac3ac327d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:18.620128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad22ce2-6954-446a-90ff-22ac3ac327d6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:18.663204 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2126/4272] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:36:18.667986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d88e4f-72f9-4bed-996e-2a78f3ca6318 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:18.685316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d88e4f-72f9-4bed-996e-2a78f3ca6318 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:18.708977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435067e5-9756-49a7-be85-802f725c6552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:18.720322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435067e5-9756-49a7-be85-802f725c6552 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:18.720614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435067e5-9756-49a7-be85-802f725c6552 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:18.720927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435067e5-9756-49a7-be85-802f725c6552 admin admin] PATH_INFO: `/v3/projects/accbc3dc601e48b3a3c534a94b6cb3f4/users/8a69e2abd84b4fe2a38af048510f83af/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.760711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435067e5-9756-49a7-be85-802f725c6552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=accbc3dc601e48b3a3c534a94b6cb3f4, user_id=8a69e2abd84b4fe2a38af048510f83af, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:18.763627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435067e5-9756-49a7-be85-802f725c6552 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:18.784961 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2147/4273] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:36:18 2022] PUT /identity/v3/projects/accbc3dc601e48b3a3c534a94b6cb3f4/users/8a69e2abd84b4fe2a38af048510f83af/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:18.791425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2278-2e27-4ae0-95a8-e8d2be64a271 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:18.792015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2278-2e27-4ae0-95a8-e8d2be64a271 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:18.792479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2278-2e27-4ae0-95a8-e8d2be64a271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.833312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d9ba2278-2e27-4ae0-95a8-e8d2be64a271 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:18.835827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d9ba2278-2e27-4ae0-95a8-e8d2be64a271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:18.878776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:19.052910 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2127/4274] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:19.065090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435067e5-9756-49a7-be85-802f725c6552 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:19.066881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-435067e5-9756-49a7-be85-802f725c6552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:19.221305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435067e5-9756-49a7-be85-802f725c6552 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:19.235525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277ba4f-5551-4a64-9571-6256038e6712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:19.236254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277ba4f-5551-4a64-9571-6256038e6712 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:19.236667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277ba4f-5551-4a64-9571-6256038e6712 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:19.237017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277ba4f-5551-4a64-9571-6256038e6712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:19.261151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277ba4f-5551-4a64-9571-6256038e6712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:19.263711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277ba4f-5551-4a64-9571-6256038e6712 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:19.288610 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2148/4275] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:36:22.267936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba2278-2e27-4ae0-95a8-e8d2be64a271 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:22.270598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d9ba2278-2e27-4ae0-95a8-e8d2be64a271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:22.303908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba2278-2e27-4ae0-95a8-e8d2be64a271 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:22.322139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1375db4-edbe-4bcb-bedb-43d5a1deb5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:22.323119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1375db4-edbe-4bcb-bedb-43d5a1deb5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:22.323582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1375db4-edbe-4bcb-bedb-43d5a1deb5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:22.324022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1375db4-edbe-4bcb-bedb-43d5a1deb5ed admin admin] PATH_INFO: `/v3/users/4792f97fc9fb486e8817cf8fe47be598` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:22.328278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1375db4-edbe-4bcb-bedb-43d5a1deb5ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=4792f97fc9fb486e8817cf8fe47be598)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:22.330883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1375db4-edbe-4bcb-bedb-43d5a1deb5ed admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:22.428975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e1375db4-edbe-4bcb-bedb-43d5a1deb5ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4792f97fc9fb486e8817cf8fe47be598'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:22.487360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e1375db4-edbe-4bcb-bedb-43d5a1deb5ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4792f97fc9fb486e8817cf8fe47be598'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:22.491946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e1375db4-edbe-4bcb-bedb-43d5a1deb5ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4792f97fc9fb486e8817cf8fe47be598'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:22.498010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e1375db4-edbe-4bcb-bedb-43d5a1deb5ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4792f97fc9fb486e8817cf8fe47be598'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:22.531209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e1375db4-edbe-4bcb-bedb-43d5a1deb5ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4792f97fc9fb486e8817cf8fe47be598'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:22.570272 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2128/4276] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:36:22 2022] DELETE /identity/v3/users/4792f97fc9fb486e8817cf8fe47be598 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:22.577679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a1884-02dc-40e9-826c-c3feae8ab430 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:22.578149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a1884-02dc-40e9-826c-c3feae8ab430 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:22.578965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a1884-02dc-40e9-826c-c3feae8ab430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:22.632791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7a2a1884-02dc-40e9-826c-c3feae8ab430 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:22.637100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a2a1884-02dc-40e9-826c-c3feae8ab430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:22.706469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:22.784706 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2149/4277] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:22.800170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1375db4-edbe-4bcb-bedb-43d5a1deb5ed admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:22.801707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e1375db4-edbe-4bcb-bedb-43d5a1deb5ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:23.004655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1375db4-edbe-4bcb-bedb-43d5a1deb5ed admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:23.028115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96358665-766e-4bc3-b87a-9c82e4410bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:23.028676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96358665-766e-4bc3-b87a-9c82e4410bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:23.028955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96358665-766e-4bc3-b87a-9c82e4410bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:23.029231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96358665-766e-4bc3-b87a-9c82e4410bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:23.082380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96358665-766e-4bc3-b87a-9c82e4410bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:23.084183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96358665-766e-4bc3-b87a-9c82e4410bc5 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:23.144356 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2129/4278] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:36:23.687992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6433c8-760b-4b46-ad01-e458677db6ea None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:23.689107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6433c8-760b-4b46-ad01-e458677db6ea None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:23.689688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6433c8-760b-4b46-ad01-e458677db6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:23.743313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fe6433c8-760b-4b46-ad01-e458677db6ea None None] MFA Rules not processed for user `26ec1e64e01348a19f4007326d5f6536`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:23.744697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe6433c8-760b-4b46-ad01-e458677db6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:23.901078 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2150/4279] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:23.901205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96358665-766e-4bc3-b87a-9c82e4410bc5 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:23.901205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-96358665-766e-4bc3-b87a-9c82e4410bc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:23.967181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96358665-766e-4bc3-b87a-9c82e4410bc5 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:23.979723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6702571-f440-4ba1-8d94-6a70d2b45fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:23.980749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6702571-f440-4ba1-8d94-6a70d2b45fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:23.981396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6702571-f440-4ba1-8d94-6a70d2b45fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:23.981991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6702571-f440-4ba1-8d94-6a70d2b45fc6 admin admin] PATH_INFO: `/v3/projects/ab608a66573d42d4b9e77791efd1a4ae` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:23.983731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6702571-f440-4ba1-8d94-6a70d2b45fc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab608a66573d42d4b9e77791efd1a4ae)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:23.985988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6702571-f440-4ba1-8d94-6a70d2b45fc6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:24.050227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:24.108346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6702571-f440-4ba1-8d94-6a70d2b45fc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab608a66573d42d4b9e77791efd1a4ae', 'request_id': 'req-d6702571-f440-4ba1-8d94-6a70d2b45fc6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:24.126203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6702571-f440-4ba1-8d94-6a70d2b45fc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab608a66573d42d4b9e77791efd1a4ae', 'request_id': 'req-d6702571-f440-4ba1-8d94-6a70d2b45fc6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:24.146386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6702571-f440-4ba1-8d94-6a70d2b45fc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab608a66573d42d4b9e77791efd1a4ae', 'request_id': 'req-d6702571-f440-4ba1-8d94-6a70d2b45fc6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:24.179805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6702571-f440-4ba1-8d94-6a70d2b45fc6 admin admin] The token cache is being invalidate because project ab608a66573d42d4b9e77791efd1a4ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:36:24.180556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6702571-f440-4ba1-8d94-6a70d2b45fc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:24.181656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6702571-f440-4ba1-8d94-6a70d2b45fc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:24.189530 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2130/4280] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:36:23 2022] DELETE /identity/v3/projects/ab608a66573d42d4b9e77791efd1a4ae => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:24.196015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40655689-1fd2-4e8d-845c-b56a8e9541f4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:24.199146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40655689-1fd2-4e8d-845c-b56a8e9541f4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:24.199610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40655689-1fd2-4e8d-845c-b56a8e9541f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:24.236396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-40655689-1fd2-4e8d-845c-b56a8e9541f4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:24.239642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-40655689-1fd2-4e8d-845c-b56a8e9541f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:24.377920 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2151/4281] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:24.381276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4dd2a-998b-4251-9903-6f649a25a9e6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:24.381918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4dd2a-998b-4251-9903-6f649a25a9e6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:24.382416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4dd2a-998b-4251-9903-6f649a25a9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:24.409771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c7d4dd2a-998b-4251-9903-6f649a25a9e6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:24.412822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c7d4dd2a-998b-4251-9903-6f649a25a9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:24.439381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40655689-1fd2-4e8d-845c-b56a8e9541f4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:24.441147 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2131/4282] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:24.454314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40655689-1fd2-4e8d-845c-b56a8e9541f4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:24.472362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c9fca-7fb9-4af1-b740-13fbeabaa65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:24.473309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c9fca-7fb9-4af1-b740-13fbeabaa65b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:24.473987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c9fca-7fb9-4af1-b740-13fbeabaa65b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:24.475073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c9fca-7fb9-4af1-b740-13fbeabaa65b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:24.485051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c9fca-7fb9-4af1-b740-13fbeabaa65b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:24.485411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c9fca-7fb9-4af1-b740-13fbeabaa65b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:24.500575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c9fca-7fb9-4af1-b740-13fbeabaa65b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:24.530765 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2152/4283] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:24.535880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4dd2a-998b-4251-9903-6f649a25a9e6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:24.550358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4dd2a-998b-4251-9903-6f649a25a9e6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:24.565611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c2206-bd9b-4f63-ba7d-54a81b9e442e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:24.566633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c2206-bd9b-4f63-ba7d-54a81b9e442e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:24.567092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c2206-bd9b-4f63-ba7d-54a81b9e442e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:24.567603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c2206-bd9b-4f63-ba7d-54a81b9e442e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:24.568468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c2206-bd9b-4f63-ba7d-54a81b9e442e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:24.571705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c2206-bd9b-4f63-ba7d-54a81b9e442e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:24.612240 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2132/4284] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:36:24 2022] POST /identity/v3/projects => generated 359 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:24.616386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c9fca-7fb9-4af1-b740-13fbeabaa65b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:24.627923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c9fca-7fb9-4af1-b740-13fbeabaa65b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:24.748599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe939eb4-63dc-4d97-ae70-918002635de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:24.750165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe939eb4-63dc-4d97-ae70-918002635de9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:24.751652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe939eb4-63dc-4d97-ae70-918002635de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:24.752227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe939eb4-63dc-4d97-ae70-918002635de9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:24.753140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe939eb4-63dc-4d97-ae70-918002635de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:24.758049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe939eb4-63dc-4d97-ae70-918002635de9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:24.807231 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2153/4285] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:36:24 2022] POST /identity/v3/users => generated 280 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:24.809221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c2206-bd9b-4f63-ba7d-54a81b9e442e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:24.827490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c2206-bd9b-4f63-ba7d-54a81b9e442e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:24.832780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265fd76-3406-42d1-83fb-4d88887058ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:24.833398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265fd76-3406-42d1-83fb-4d88887058ad admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:24.833680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265fd76-3406-42d1-83fb-4d88887058ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:24.834004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265fd76-3406-42d1-83fb-4d88887058ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:24.834711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265fd76-3406-42d1-83fb-4d88887058ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:24.836571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265fd76-3406-42d1-83fb-4d88887058ad admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:24.873271 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2133/4286] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:36:24.877529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe939eb4-63dc-4d97-ae70-918002635de9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:24.885063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:24.896047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe939eb4-63dc-4d97-ae70-918002635de9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:24.921543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30839a59-f0db-455e-9a6f-86e3ac26510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:24.922321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839a59-f0db-455e-9a6f-86e3ac26510d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:24.922718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839a59-f0db-455e-9a6f-86e3ac26510d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:24.923729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839a59-f0db-455e-9a6f-86e3ac26510d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:24.925422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30839a59-f0db-455e-9a6f-86e3ac26510d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:24.938096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30839a59-f0db-455e-9a6f-86e3ac26510d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:24.980449 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2154/4287] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:36:24.992145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265fd76-3406-42d1-83fb-4d88887058ad admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:25.008081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265fd76-3406-42d1-83fb-4d88887058ad admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:25.013981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ba0dd-9ed6-44df-9998-1faa906a63d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:25.015107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ba0dd-9ed6-44df-9998-1faa906a63d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:25.015606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ba0dd-9ed6-44df-9998-1faa906a63d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:25.016046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ba0dd-9ed6-44df-9998-1faa906a63d3 admin admin] PATH_INFO: `/v3/projects/b55bde7a378e446189e15490d29b2a62/users/0a6dd250a739490f861937fab753b718/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:25.038726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ba0dd-9ed6-44df-9998-1faa906a63d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55bde7a378e446189e15490d29b2a62, user_id=0a6dd250a739490f861937fab753b718, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:25.042158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ba0dd-9ed6-44df-9998-1faa906a63d3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:25.076243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cef76-094c-4c12-85c0-81836da57867 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:25.077426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cef76-094c-4c12-85c0-81836da57867 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:25.078105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cef76-094c-4c12-85c0-81836da57867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:25.078493 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2134/4288] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:36:24 2022] PUT /identity/v3/projects/b55bde7a378e446189e15490d29b2a62/users/0a6dd250a739490f861937fab753b718/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:25.130354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-292cef76-094c-4c12-85c0-81836da57867 None None] MFA Rules not processed for user `0a6dd250a739490f861937fab753b718`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:25.131643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-292cef76-094c-4c12-85c0-81836da57867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:25.247314 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2155/4289] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:36:25.257714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ba0dd-9ed6-44df-9998-1faa906a63d3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:25.261877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6a4ba0dd-9ed6-44df-9998-1faa906a63d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:25.393238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ba0dd-9ed6-44df-9998-1faa906a63d3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:25.397211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d35642-83b9-4911-b4c9-6861f56d547e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:25.398103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d35642-83b9-4911-b4c9-6861f56d547e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:25.398520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d35642-83b9-4911-b4c9-6861f56d547e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:25.398878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d35642-83b9-4911-b4c9-6861f56d547e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:25.409306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d35642-83b9-4911-b4c9-6861f56d547e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:25.411299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d35642-83b9-4911-b4c9-6861f56d547e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:25.433081 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2135/4290] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:36:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:36:28.101145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cef76-094c-4c12-85c0-81836da57867 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:28.113862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cef76-094c-4c12-85c0-81836da57867 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:28.128442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a15aa-4a7e-4107-a432-cc2a4b836e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:28.129342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a15aa-4a7e-4107-a432-cc2a4b836e07 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:28.129794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a15aa-4a7e-4107-a432-cc2a4b836e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:28.130377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a15aa-4a7e-4107-a432-cc2a4b836e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:28.133594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ed9a15aa-4a7e-4107-a432-cc2a4b836e07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:28.383396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a15aa-4a7e-4107-a432-cc2a4b836e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:28.385185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a15aa-4a7e-4107-a432-cc2a4b836e07 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:28.428066 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2156/4291] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:36:33.080728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906c49d-7eac-4523-a958-de53be1cdc90 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:33.081705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906c49d-7eac-4523-a958-de53be1cdc90 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:33.083984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906c49d-7eac-4523-a958-de53be1cdc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:33.126864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b906c49d-7eac-4523-a958-de53be1cdc90 None None] MFA Rules not processed for user `8a69e2abd84b4fe2a38af048510f83af`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:33.128832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b906c49d-7eac-4523-a958-de53be1cdc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:33.207430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130017-1f18-4e65-b7ff-b4af3923ba5c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:33.208112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130017-1f18-4e65-b7ff-b4af3923ba5c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:33.208711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130017-1f18-4e65-b7ff-b4af3923ba5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:33.263462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e5130017-1f18-4e65-b7ff-b4af3923ba5c None None] MFA Rules not processed for user `e57aca8c1b5847f999daeb74a982f4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:33.265206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e5130017-1f18-4e65-b7ff-b4af3923ba5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:33.277542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:33.335944 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2136/4292] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:33.345166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906c49d-7eac-4523-a958-de53be1cdc90 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:33.348640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b906c49d-7eac-4523-a958-de53be1cdc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:33.413538 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2157/4293] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:33.534734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906c49d-7eac-4523-a958-de53be1cdc90 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:33.543186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ddc71-a6ba-4874-a79d-c693139a5bb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:33.543854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ddc71-a6ba-4874-a79d-c693139a5bb4 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:33.544141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ddc71-a6ba-4874-a79d-c693139a5bb4 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:33.544418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ddc71-a6ba-4874-a79d-c693139a5bb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:33.564109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ddc71-a6ba-4874-a79d-c693139a5bb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:33.565769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ddc71-a6ba-4874-a79d-c693139a5bb4 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:33.586578 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2137/4294] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:36:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:36:40.795092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5130017-1f18-4e65-b7ff-b4af3923ba5c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:40.812813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5130017-1f18-4e65-b7ff-b4af3923ba5c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:40.822242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d1667-05f1-4291-a8cb-aa0029f875ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:40.823280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d1667-05f1-4291-a8cb-aa0029f875ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:40.823799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d1667-05f1-4291-a8cb-aa0029f875ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:40.824292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d1667-05f1-4291-a8cb-aa0029f875ea admin admin] PATH_INFO: `/v3/users/0a6dd250a739490f861937fab753b718` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:40.825713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d1667-05f1-4291-a8cb-aa0029f875ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6dd250a739490f861937fab753b718)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:40.827916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d1667-05f1-4291-a8cb-aa0029f875ea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:40.864404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:40.931242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a77d1667-05f1-4291-a8cb-aa0029f875ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6dd250a739490f861937fab753b718'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:40.932049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a77d1667-05f1-4291-a8cb-aa0029f875ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6dd250a739490f861937fab753b718'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:40.950708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a77d1667-05f1-4291-a8cb-aa0029f875ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6dd250a739490f861937fab753b718'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:40.967714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a77d1667-05f1-4291-a8cb-aa0029f875ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6dd250a739490f861937fab753b718'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:41.003023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a77d1667-05f1-4291-a8cb-aa0029f875ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6dd250a739490f861937fab753b718'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:41.024735 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2158/4295] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:36:40 2022] DELETE /identity/v3/users/0a6dd250a739490f861937fab753b718 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:36:41.029310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ab909-d46e-479b-8008-8808792baca5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:41.030146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ab909-d46e-479b-8008-8808792baca5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:41.030598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ab909-d46e-479b-8008-8808792baca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:41.070333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-027ab909-d46e-479b-8008-8808792baca5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:41.071824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-027ab909-d46e-479b-8008-8808792baca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:41.332781 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2138/4296] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:41.355006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d1667-05f1-4291-a8cb-aa0029f875ea admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:41.356541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a77d1667-05f1-4291-a8cb-aa0029f875ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:41.458734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d1667-05f1-4291-a8cb-aa0029f875ea admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:41.463300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a54cf4-9df7-42c3-a6dd-cb8092976c18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:41.464135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a54cf4-9df7-42c3-a6dd-cb8092976c18 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:41.464606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a54cf4-9df7-42c3-a6dd-cb8092976c18 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:41.465193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a54cf4-9df7-42c3-a6dd-cb8092976c18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:41.476641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a54cf4-9df7-42c3-a6dd-cb8092976c18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:41.478473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a54cf4-9df7-42c3-a6dd-cb8092976c18 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:41.491310 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2159/4297] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:36:42.405572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ab909-d46e-479b-8008-8808792baca5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:42.407668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-027ab909-d46e-479b-8008-8808792baca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:42.426508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ab909-d46e-479b-8008-8808792baca5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:42.442041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261e5c6-2b13-4dff-a6f4-8883e6511df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:42.443309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261e5c6-2b13-4dff-a6f4-8883e6511df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.443782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261e5c6-2b13-4dff-a6f4-8883e6511df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.444228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261e5c6-2b13-4dff-a6f4-8883e6511df0 admin admin] PATH_INFO: `/v3/projects/b55bde7a378e446189e15490d29b2a62` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.445845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261e5c6-2b13-4dff-a6f4-8883e6511df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55bde7a378e446189e15490d29b2a62)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:42.448284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261e5c6-2b13-4dff-a6f4-8883e6511df0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:42.548513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d261e5c6-2b13-4dff-a6f4-8883e6511df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55bde7a378e446189e15490d29b2a62', 'request_id': 'req-d261e5c6-2b13-4dff-a6f4-8883e6511df0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:42.560785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d261e5c6-2b13-4dff-a6f4-8883e6511df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55bde7a378e446189e15490d29b2a62', 'request_id': 'req-d261e5c6-2b13-4dff-a6f4-8883e6511df0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:42.574623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d261e5c6-2b13-4dff-a6f4-8883e6511df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55bde7a378e446189e15490d29b2a62', 'request_id': 'req-d261e5c6-2b13-4dff-a6f4-8883e6511df0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:42.591752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:42.597858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d261e5c6-2b13-4dff-a6f4-8883e6511df0 admin admin] The token cache is being invalidate because project b55bde7a378e446189e15490d29b2a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:36:42.598442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d261e5c6-2b13-4dff-a6f4-8883e6511df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:42.601586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d261e5c6-2b13-4dff-a6f4-8883e6511df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:42.603461 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2139/4298] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:36:42 2022] DELETE /identity/v3/projects/b55bde7a378e446189e15490d29b2a62 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:42.608472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5550d-d584-46cb-a300-6f0e52cdb815 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.609488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5550d-d584-46cb-a300-6f0e52cdb815 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.609743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5550d-d584-46cb-a300-6f0e52cdb815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.646286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4af5550d-d584-46cb-a300-6f0e52cdb815 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:42.647565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4af5550d-d584-46cb-a300-6f0e52cdb815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:42.747917 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2160/4299] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:42.749278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a12b7-dd49-435c-b194-b9f2c86e9e0f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.749828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a12b7-dd49-435c-b194-b9f2c86e9e0f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.750478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a12b7-dd49-435c-b194-b9f2c86e9e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.776925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a99a12b7-dd49-435c-b194-b9f2c86e9e0f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:42.778818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a99a12b7-dd49-435c-b194-b9f2c86e9e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:42.795309 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2140/4300] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:36:42.797098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5550d-d584-46cb-a300-6f0e52cdb815 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:42.808943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5550d-d584-46cb-a300-6f0e52cdb815 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:42.814083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b24ad6-84bc-4b71-b01c-783530556c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:42.814711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b24ad6-84bc-4b71-b01c-783530556c70 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.814990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b24ad6-84bc-4b71-b01c-783530556c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.817529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b24ad6-84bc-4b71-b01c-783530556c70 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.817529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b24ad6-84bc-4b71-b01c-783530556c70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:42.817529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b24ad6-84bc-4b71-b01c-783530556c70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:42.818110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b24ad6-84bc-4b71-b01c-783530556c70 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:42.834786 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2161/4301] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:42.839503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a12b7-dd49-435c-b194-b9f2c86e9e0f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:42.850954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a12b7-dd49-435c-b194-b9f2c86e9e0f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:42.856052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd6f31-9836-4034-b5de-b17d730addd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:42.856801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd6f31-9836-4034-b5de-b17d730addd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.857184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd6f31-9836-4034-b5de-b17d730addd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.857559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd6f31-9836-4034-b5de-b17d730addd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.858995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd6f31-9836-4034-b5de-b17d730addd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:42.862203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd6f31-9836-4034-b5de-b17d730addd1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:42.904972 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2141/4302] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:36:42 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:42.906637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b24ad6-84bc-4b71-b01c-783530556c70 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:42.922230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b24ad6-84bc-4b71-b01c-783530556c70 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:42.948987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:43.034216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f15e5-3782-4bb1-8f09-bd2ff20a285b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:43.034740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f15e5-3782-4bb1-8f09-bd2ff20a285b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.035029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f15e5-3782-4bb1-8f09-bd2ff20a285b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.035331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f15e5-3782-4bb1-8f09-bd2ff20a285b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.037227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f15e5-3782-4bb1-8f09-bd2ff20a285b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:43.038943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f15e5-3782-4bb1-8f09-bd2ff20a285b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:43.072213 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2162/4303] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:36:42 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:43.073173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd6f31-9836-4034-b5de-b17d730addd1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:43.085997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd6f31-9836-4034-b5de-b17d730addd1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:43.092900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f7313-a02c-46cf-b660-23dd9e3ff612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:43.094988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f7313-a02c-46cf-b660-23dd9e3ff612 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.095537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f7313-a02c-46cf-b660-23dd9e3ff612 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.096016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f7313-a02c-46cf-b660-23dd9e3ff612 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.096702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f7313-a02c-46cf-b660-23dd9e3ff612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:43.098345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f7313-a02c-46cf-b660-23dd9e3ff612 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:43.118584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f15e5-3782-4bb1-8f09-bd2ff20a285b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:43.126290 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2142/4304] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:36:43.130696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f15e5-3782-4bb1-8f09-bd2ff20a285b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:43.138073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ae29-7929-4aac-97e0-ea0280c05f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:43.139122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ae29-7929-4aac-97e0-ea0280c05f4b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.139524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ae29-7929-4aac-97e0-ea0280c05f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.140078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ae29-7929-4aac-97e0-ea0280c05f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.141099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7ae29-7929-4aac-97e0-ea0280c05f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:43.143300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7ae29-7929-4aac-97e0-ea0280c05f4b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:43.165403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f7313-a02c-46cf-b660-23dd9e3ff612 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:43.173118 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2163/4305] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:36:43.177369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f7313-a02c-46cf-b660-23dd9e3ff612 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:43.184897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24d73e-520a-4a87-85da-0c1c179ba0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:43.187032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24d73e-520a-4a87-85da-0c1c179ba0a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.187032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24d73e-520a-4a87-85da-0c1c179ba0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.187304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24d73e-520a-4a87-85da-0c1c179ba0a9 admin admin] PATH_INFO: `/v3/projects/652883e5e4a142daa575c36fdeb869f1/users/542f384009814c209c10f2ee5f3631d0/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.208317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24d73e-520a-4a87-85da-0c1c179ba0a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652883e5e4a142daa575c36fdeb869f1, user_id=542f384009814c209c10f2ee5f3631d0, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:43.211479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24d73e-520a-4a87-85da-0c1c179ba0a9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:43.235904 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2143/4306] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:36:43 2022] PUT /identity/v3/projects/652883e5e4a142daa575c36fdeb869f1/users/542f384009814c209c10f2ee5f3631d0/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:43.245437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98d59e-7e94-4109-89fc-369a1c21a656 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.245721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98d59e-7e94-4109-89fc-369a1c21a656 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.246069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98d59e-7e94-4109-89fc-369a1c21a656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.282910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1c98d59e-7e94-4109-89fc-369a1c21a656 None None] MFA Rules not processed for user `542f384009814c209c10f2ee5f3631d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:43.285941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c98d59e-7e94-4109-89fc-369a1c21a656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:43.400433 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2164/4307] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:43.420025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24d73e-520a-4a87-85da-0c1c179ba0a9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:43.421995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0d24d73e-520a-4a87-85da-0c1c179ba0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:43.494940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24d73e-520a-4a87-85da-0c1c179ba0a9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:43.499051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134295f3-332f-4930-8926-b02ce09cb573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:43.499699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134295f3-332f-4930-8926-b02ce09cb573 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.499976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134295f3-332f-4930-8926-b02ce09cb573 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.500248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134295f3-332f-4930-8926-b02ce09cb573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.510092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134295f3-332f-4930-8926-b02ce09cb573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:43.511733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134295f3-332f-4930-8926-b02ce09cb573 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:43.522993 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2144/4308] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:36:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:36:43.535929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98d59e-7e94-4109-89fc-369a1c21a656 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:43.619158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98d59e-7e94-4109-89fc-369a1c21a656 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:43.626731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355fbc2-fc1f-48ad-af2a-c2977e43db88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:43.627557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355fbc2-fc1f-48ad-af2a-c2977e43db88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.627829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355fbc2-fc1f-48ad-af2a-c2977e43db88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.628248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355fbc2-fc1f-48ad-af2a-c2977e43db88 admin admin] PATH_INFO: `/v3/users/542f384009814c209c10f2ee5f3631d0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.629450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355fbc2-fc1f-48ad-af2a-c2977e43db88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=542f384009814c209c10f2ee5f3631d0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:43.631450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355fbc2-fc1f-48ad-af2a-c2977e43db88 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:43.700339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:43.725560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8355fbc2-fc1f-48ad-af2a-c2977e43db88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542f384009814c209c10f2ee5f3631d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:43.725560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8355fbc2-fc1f-48ad-af2a-c2977e43db88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542f384009814c209c10f2ee5f3631d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:43.734617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8355fbc2-fc1f-48ad-af2a-c2977e43db88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542f384009814c209c10f2ee5f3631d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:43.746500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8355fbc2-fc1f-48ad-af2a-c2977e43db88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542f384009814c209c10f2ee5f3631d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:43.762975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8355fbc2-fc1f-48ad-af2a-c2977e43db88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542f384009814c209c10f2ee5f3631d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:43.772730 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2165/4309] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:36:43 2022] DELETE /identity/v3/users/542f384009814c209c10f2ee5f3631d0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:43.774416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26240af6-39d0-494a-86d7-1ef5063d2ea9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.774697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26240af6-39d0-494a-86d7-1ef5063d2ea9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.774972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26240af6-39d0-494a-86d7-1ef5063d2ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.801654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-26240af6-39d0-494a-86d7-1ef5063d2ea9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:43.803388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-26240af6-39d0-494a-86d7-1ef5063d2ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:43.879073 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2145/4310] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:36:43.889328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355fbc2-fc1f-48ad-af2a-c2977e43db88 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:43.891490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8355fbc2-fc1f-48ad-af2a-c2977e43db88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:43.999029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355fbc2-fc1f-48ad-af2a-c2977e43db88 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:44.003617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca7f3c-ccf9-46e3-a772-b91b79a30a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:44.004911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca7f3c-ccf9-46e3-a772-b91b79a30a4c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:44.004911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca7f3c-ccf9-46e3-a772-b91b79a30a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:44.005243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca7f3c-ccf9-46e3-a772-b91b79a30a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:44.018190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca7f3c-ccf9-46e3-a772-b91b79a30a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:44.019933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca7f3c-ccf9-46e3-a772-b91b79a30a4c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:44.031115 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2166/4311] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:36:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:36:44.337313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26240af6-39d0-494a-86d7-1ef5063d2ea9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:44.339499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-26240af6-39d0-494a-86d7-1ef5063d2ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:44.357189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26240af6-39d0-494a-86d7-1ef5063d2ea9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:44.363823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff2ea0-bd5f-4750-9882-e63fcc73edfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:44.364568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff2ea0-bd5f-4750-9882-e63fcc73edfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:44.364920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff2ea0-bd5f-4750-9882-e63fcc73edfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:44.365298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff2ea0-bd5f-4750-9882-e63fcc73edfc admin admin] PATH_INFO: `/v3/projects/652883e5e4a142daa575c36fdeb869f1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:44.366589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff2ea0-bd5f-4750-9882-e63fcc73edfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=652883e5e4a142daa575c36fdeb869f1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:44.368609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff2ea0-bd5f-4750-9882-e63fcc73edfc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:44.444963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:44.464209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d0ff2ea0-bd5f-4750-9882-e63fcc73edfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652883e5e4a142daa575c36fdeb869f1', 'request_id': 'req-d0ff2ea0-bd5f-4750-9882-e63fcc73edfc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:44.473616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d0ff2ea0-bd5f-4750-9882-e63fcc73edfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652883e5e4a142daa575c36fdeb869f1', 'request_id': 'req-d0ff2ea0-bd5f-4750-9882-e63fcc73edfc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:44.480553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d0ff2ea0-bd5f-4750-9882-e63fcc73edfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652883e5e4a142daa575c36fdeb869f1', 'request_id': 'req-d0ff2ea0-bd5f-4750-9882-e63fcc73edfc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:44.505046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d0ff2ea0-bd5f-4750-9882-e63fcc73edfc admin admin] The token cache is being invalidate because project 652883e5e4a142daa575c36fdeb869f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:36:44.506222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d0ff2ea0-bd5f-4750-9882-e63fcc73edfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:44.507298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d0ff2ea0-bd5f-4750-9882-e63fcc73edfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:44.509431 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2146/4312] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:36:44 2022] DELETE /identity/v3/projects/652883e5e4a142daa575c36fdeb869f1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:44.514420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419035d-2fef-4433-b6ce-97fe2c780f65 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:44.514717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419035d-2fef-4433-b6ce-97fe2c780f65 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:44.514992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419035d-2fef-4433-b6ce-97fe2c780f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:44.575690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f419035d-2fef-4433-b6ce-97fe2c780f65 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:44.576935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f419035d-2fef-4433-b6ce-97fe2c780f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:44.676165 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2167/4313] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:44.685226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3edd72-fe7e-43b5-8c16-2a1818145ff6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:44.685796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3edd72-fe7e-43b5-8c16-2a1818145ff6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:44.686417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3edd72-fe7e-43b5-8c16-2a1818145ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:44.714652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6d3edd72-fe7e-43b5-8c16-2a1818145ff6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:44.716366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6d3edd72-fe7e-43b5-8c16-2a1818145ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:44.734355 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2147/4314] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:36:44.738965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419035d-2fef-4433-b6ce-97fe2c780f65 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:44.754321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419035d-2fef-4433-b6ce-97fe2c780f65 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:44.767027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512061c0-4be6-45ea-92df-ce8a91f2541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:44.767573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512061c0-4be6-45ea-92df-ce8a91f2541b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:44.767844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512061c0-4be6-45ea-92df-ce8a91f2541b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:44.768110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512061c0-4be6-45ea-92df-ce8a91f2541b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:44.770276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512061c0-4be6-45ea-92df-ce8a91f2541b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:44.770586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512061c0-4be6-45ea-92df-ce8a91f2541b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:44.777758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512061c0-4be6-45ea-92df-ce8a91f2541b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:44.812513 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2168/4315] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:44.814879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3edd72-fe7e-43b5-8c16-2a1818145ff6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:44.826870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3edd72-fe7e-43b5-8c16-2a1818145ff6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:44.841137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc59b7-f7ed-4406-b16e-ba76084bd995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:44.841843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc59b7-f7ed-4406-b16e-ba76084bd995 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:44.842125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc59b7-f7ed-4406-b16e-ba76084bd995 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:44.842394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc59b7-f7ed-4406-b16e-ba76084bd995 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:44.843057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc59b7-f7ed-4406-b16e-ba76084bd995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:44.849964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc59b7-f7ed-4406-b16e-ba76084bd995 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:44.935949 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2148/4316] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:36:44 2022] POST /identity/v3/projects => generated 391 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:44.938507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512061c0-4be6-45ea-92df-ce8a91f2541b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:44.958350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512061c0-4be6-45ea-92df-ce8a91f2541b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:45.106367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:45.161028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1e30e-8d32-47cb-8bf7-16caef44b7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:45.161674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e30e-8d32-47cb-8bf7-16caef44b7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:45.161953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e30e-8d32-47cb-8bf7-16caef44b7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:45.162231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e30e-8d32-47cb-8bf7-16caef44b7e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:45.162892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1e30e-8d32-47cb-8bf7-16caef44b7e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:45.164901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1e30e-8d32-47cb-8bf7-16caef44b7e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:45.220703 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2169/4317] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:36:44 2022] POST /identity/v3/users => generated 296 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:45.222091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc59b7-f7ed-4406-b16e-ba76084bd995 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:45.238826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc59b7-f7ed-4406-b16e-ba76084bd995 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:45.254500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334d775-94a2-4da6-9166-8e4cefac1981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:45.255152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d775-94a2-4da6-9166-8e4cefac1981 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:45.255476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d775-94a2-4da6-9166-8e4cefac1981 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:45.255752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d775-94a2-4da6-9166-8e4cefac1981 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:45.256414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334d775-94a2-4da6-9166-8e4cefac1981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:45.258346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334d775-94a2-4da6-9166-8e4cefac1981 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:45.276919 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2149/4318] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:36:45.281034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1e30e-8d32-47cb-8bf7-16caef44b7e7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:45.291969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1e30e-8d32-47cb-8bf7-16caef44b7e7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:45.297172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32477ec9-3ae0-4257-896f-93cf2fc708c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:45.297832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32477ec9-3ae0-4257-896f-93cf2fc708c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:45.298113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32477ec9-3ae0-4257-896f-93cf2fc708c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:45.298386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32477ec9-3ae0-4257-896f-93cf2fc708c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:45.299037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32477ec9-3ae0-4257-896f-93cf2fc708c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:45.300746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32477ec9-3ae0-4257-896f-93cf2fc708c8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:45.317106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334d775-94a2-4da6-9166-8e4cefac1981 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:45.317817 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2170/4319] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:36:45.334164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334d775-94a2-4da6-9166-8e4cefac1981 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:45.341496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc54a4-7875-44cd-9cd9-3f44067c1791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:45.342226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc54a4-7875-44cd-9cd9-3f44067c1791 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:45.342496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc54a4-7875-44cd-9cd9-3f44067c1791 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:45.342821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc54a4-7875-44cd-9cd9-3f44067c1791 admin admin] PATH_INFO: `/v3/projects/e2310212af5942689d3889be2fa7daec/users/3d32649b5e034ec196c5551582228f48/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:45.364012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc54a4-7875-44cd-9cd9-3f44067c1791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2310212af5942689d3889be2fa7daec, user_id=3d32649b5e034ec196c5551582228f48, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:45.368494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc54a4-7875-44cd-9cd9-3f44067c1791 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:45.396701 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2150/4320] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:36:45 2022] PUT /identity/v3/projects/e2310212af5942689d3889be2fa7daec/users/3d32649b5e034ec196c5551582228f48/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:36:45.408670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e85f7-a285-42e7-853e-0e5aae13701e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:45.408957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e85f7-a285-42e7-853e-0e5aae13701e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:45.409229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e85f7-a285-42e7-853e-0e5aae13701e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:45.442310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-784e85f7-a285-42e7-853e-0e5aae13701e None None] MFA Rules not processed for user `3d32649b5e034ec196c5551582228f48`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:45.443588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-784e85f7-a285-42e7-853e-0e5aae13701e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:45.546312 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2171/4321] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:45.550496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc54a4-7875-44cd-9cd9-3f44067c1791 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:45.701346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc54a4-7875-44cd-9cd9-3f44067c1791 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:45.712323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3652f84-19d2-4418-b925-4653565cb95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:45.713382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3652f84-19d2-4418-b925-4653565cb95c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:45.713914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3652f84-19d2-4418-b925-4653565cb95c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:45.714412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3652f84-19d2-4418-b925-4653565cb95c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:45.715510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3652f84-19d2-4418-b925-4653565cb95c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:45.720267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3652f84-19d2-4418-b925-4653565cb95c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:45.798528 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2151/4322] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:36:45 2022] POST /identity/v3/projects => generated 391 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:45.799390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e85f7-a285-42e7-853e-0e5aae13701e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:45.826861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e85f7-a285-42e7-853e-0e5aae13701e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:46.007490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50ca14-2771-41e6-a6ab-2d71bb98253c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:46.008118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50ca14-2771-41e6-a6ab-2d71bb98253c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:46.008466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50ca14-2771-41e6-a6ab-2d71bb98253c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:46.008805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50ca14-2771-41e6-a6ab-2d71bb98253c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:46.009592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50ca14-2771-41e6-a6ab-2d71bb98253c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:46.012233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50ca14-2771-41e6-a6ab-2d71bb98253c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:46.088565 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2172/4323] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:36:45 2022] POST /identity/v3/users => generated 302 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:36:46.093244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3652f84-19d2-4418-b925-4653565cb95c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:46.112092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3652f84-19d2-4418-b925-4653565cb95c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:46.118528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0b31c-cf41-4f30-974c-e97d4fbf854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:46.119505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0b31c-cf41-4f30-974c-e97d4fbf854c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:46.120024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0b31c-cf41-4f30-974c-e97d4fbf854c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:46.120585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0b31c-cf41-4f30-974c-e97d4fbf854c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:46.121516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0b31c-cf41-4f30-974c-e97d4fbf854c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:46.124030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0b31c-cf41-4f30-974c-e97d4fbf854c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:46.143749 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2152/4324] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:36:46.145620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50ca14-2771-41e6-a6ab-2d71bb98253c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:46.162274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50ca14-2771-41e6-a6ab-2d71bb98253c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:46.173877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c345572-78de-4555-b526-212840b9d91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:46.176273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c345572-78de-4555-b526-212840b9d91e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:46.176937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c345572-78de-4555-b526-212840b9d91e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:46.177441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c345572-78de-4555-b526-212840b9d91e admin admin] PATH_INFO: `/v3/projects/55314dbbdd0b46469cf799340f8a3113/users/94c0cd1bf6a64e658c597f8561bd5c9c/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:46.212058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c345572-78de-4555-b526-212840b9d91e admin admin] RBAC: Authorizing `identity:create_grant(project_id=55314dbbdd0b46469cf799340f8a3113, user_id=94c0cd1bf6a64e658c597f8561bd5c9c, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:46.220391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c345572-78de-4555-b526-212840b9d91e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:46.257870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0b31c-cf41-4f30-974c-e97d4fbf854c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:46.259493 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2173/4325] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:36:46 2022] PUT /identity/v3/projects/55314dbbdd0b46469cf799340f8a3113/users/94c0cd1bf6a64e658c597f8561bd5c9c/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:46.279405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0b31c-cf41-4f30-974c-e97d4fbf854c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:46.346502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:46.418972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bc9a2-8c56-4b62-b365-84df84ae10a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:46.420046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bc9a2-8c56-4b62-b365-84df84ae10a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:46.420332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bc9a2-8c56-4b62-b365-84df84ae10a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:46.421364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bc9a2-8c56-4b62-b365-84df84ae10a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:46.422150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bc9a2-8c56-4b62-b365-84df84ae10a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:46.432903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bc9a2-8c56-4b62-b365-84df84ae10a9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:46.449638 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2153/4326] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:36:46.450763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c345572-78de-4555-b526-212840b9d91e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:46.470036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c345572-78de-4555-b526-212840b9d91e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:46.496690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053ab6e-84be-48ab-8e2d-05ddbbbcaf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:46.499335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053ab6e-84be-48ab-8e2d-05ddbbbcaf05 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:46.499621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053ab6e-84be-48ab-8e2d-05ddbbbcaf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:46.499943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053ab6e-84be-48ab-8e2d-05ddbbbcaf05 admin admin] PATH_INFO: `/v3/projects/55314dbbdd0b46469cf799340f8a3113/users/94c0cd1bf6a64e658c597f8561bd5c9c/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:46.502810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053ab6e-84be-48ab-8e2d-05ddbbbcaf05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55314dbbdd0b46469cf799340f8a3113, user_id=94c0cd1bf6a64e658c597f8561bd5c9c, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:46.505514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053ab6e-84be-48ab-8e2d-05ddbbbcaf05 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:46.515354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:46.539024 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2174/4327] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:36:46 2022] PUT /identity/v3/projects/55314dbbdd0b46469cf799340f8a3113/users/94c0cd1bf6a64e658c597f8561bd5c9c/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:36:46.540921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac757c9-1e2e-4e0c-bdb4-45da70b0e41f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:46.543496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac757c9-1e2e-4e0c-bdb4-45da70b0e41f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:46.544207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac757c9-1e2e-4e0c-bdb4-45da70b0e41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:46.597774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3ac757c9-1e2e-4e0c-bdb4-45da70b0e41f None None] MFA Rules not processed for user `94c0cd1bf6a64e658c597f8561bd5c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:46.599735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3ac757c9-1e2e-4e0c-bdb4-45da70b0e41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:46.753049 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2154/4328] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:46.753328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053ab6e-84be-48ab-8e2d-05ddbbbcaf05 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:46.755731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5053ab6e-84be-48ab-8e2d-05ddbbbcaf05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:46.918628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053ab6e-84be-48ab-8e2d-05ddbbbcaf05 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:46.934078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d491d6-77db-4575-a3ae-f827aa0f573a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:46.934976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d491d6-77db-4575-a3ae-f827aa0f573a service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:46.935124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d491d6-77db-4575-a3ae-f827aa0f573a service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:46.935350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d491d6-77db-4575-a3ae-f827aa0f573a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:46.951808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d491d6-77db-4575-a3ae-f827aa0f573a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:46.955375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d491d6-77db-4575-a3ae-f827aa0f573a service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:46.970408 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2175/4329] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:36:46 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:36:47.046351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac757c9-1e2e-4e0c-bdb4-45da70b0e41f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:47.059393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac757c9-1e2e-4e0c-bdb4-45da70b0e41f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:47.063813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05118dc9-375b-4b30-aeee-d40f6d8158eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:47.064697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05118dc9-375b-4b30-aeee-d40f6d8158eb service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:47.065133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05118dc9-375b-4b30-aeee-d40f6d8158eb service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:47.065762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05118dc9-375b-4b30-aeee-d40f6d8158eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:47.141866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05118dc9-375b-4b30-aeee-d40f6d8158eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:47.143476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05118dc9-375b-4b30-aeee-d40f6d8158eb service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:47.153368 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2155/4330] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:36:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:36:47.400193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d491d6-77db-4575-a3ae-f827aa0f573a service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:47.401992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5d491d6-77db-4575-a3ae-f827aa0f573a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:47.482477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d491d6-77db-4575-a3ae-f827aa0f573a service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:47.489139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685a0f9-c2ef-48f2-82ec-dca5dd51f8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:47.490388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685a0f9-c2ef-48f2-82ec-dca5dd51f8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:47.490686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685a0f9-c2ef-48f2-82ec-dca5dd51f8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:47.491111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685a0f9-c2ef-48f2-82ec-dca5dd51f8a7 admin admin] PATH_INFO: `/v3/users/20b3956bf2d14c1ea1940fd29cc0f7cd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:47.492983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685a0f9-c2ef-48f2-82ec-dca5dd51f8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b3956bf2d14c1ea1940fd29cc0f7cd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:47.495968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685a0f9-c2ef-48f2-82ec-dca5dd51f8a7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:47.574991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1685a0f9-c2ef-48f2-82ec-dca5dd51f8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b3956bf2d14c1ea1940fd29cc0f7cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:47.575933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1685a0f9-c2ef-48f2-82ec-dca5dd51f8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b3956bf2d14c1ea1940fd29cc0f7cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:47.593234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1685a0f9-c2ef-48f2-82ec-dca5dd51f8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b3956bf2d14c1ea1940fd29cc0f7cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:47.612661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1685a0f9-c2ef-48f2-82ec-dca5dd51f8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b3956bf2d14c1ea1940fd29cc0f7cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:47.665702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1685a0f9-c2ef-48f2-82ec-dca5dd51f8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b3956bf2d14c1ea1940fd29cc0f7cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:47.687971 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2176/4331] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:36:47 2022] DELETE /identity/v3/users/20b3956bf2d14c1ea1940fd29cc0f7cd => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:36:48.041971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05118dc9-375b-4b30-aeee-d40f6d8158eb service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:48.072181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05118dc9-375b-4b30-aeee-d40f6d8158eb service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:48.141469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:48.153516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847122a8-0980-4832-8747-8dbbb99ead3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:48.154192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847122a8-0980-4832-8747-8dbbb99ead3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:48.154715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847122a8-0980-4832-8747-8dbbb99ead3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:48.155240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847122a8-0980-4832-8747-8dbbb99ead3b admin admin] PATH_INFO: `/v3/projects/49fc5b0f8f3b4514a98886d41d38b890` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:48.156478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847122a8-0980-4832-8747-8dbbb99ead3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=49fc5b0f8f3b4514a98886d41d38b890)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:48.158561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847122a8-0980-4832-8747-8dbbb99ead3b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:48.269778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-847122a8-0980-4832-8747-8dbbb99ead3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49fc5b0f8f3b4514a98886d41d38b890', 'request_id': 'req-847122a8-0980-4832-8747-8dbbb99ead3b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:48.277158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-847122a8-0980-4832-8747-8dbbb99ead3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49fc5b0f8f3b4514a98886d41d38b890', 'request_id': 'req-847122a8-0980-4832-8747-8dbbb99ead3b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:48.301410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-847122a8-0980-4832-8747-8dbbb99ead3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49fc5b0f8f3b4514a98886d41d38b890', 'request_id': 'req-847122a8-0980-4832-8747-8dbbb99ead3b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:48.348401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-847122a8-0980-4832-8747-8dbbb99ead3b admin admin] The token cache is being invalidate because project 49fc5b0f8f3b4514a98886d41d38b890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:36:48.348794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-847122a8-0980-4832-8747-8dbbb99ead3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:48.350679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-847122a8-0980-4832-8747-8dbbb99ead3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:48.357354 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2156/4332] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:36:48 2022] DELETE /identity/v3/projects/49fc5b0f8f3b4514a98886d41d38b890 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:48.359040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685a0f9-c2ef-48f2-82ec-dca5dd51f8a7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:48.361092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1685a0f9-c2ef-48f2-82ec-dca5dd51f8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:48.382647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685a0f9-c2ef-48f2-82ec-dca5dd51f8a7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:48.445898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:48.563521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c6a28-6881-4917-b662-da8e842733a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:48.565265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c6a28-6881-4917-b662-da8e842733a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:48.565790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c6a28-6881-4917-b662-da8e842733a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:48.566279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c6a28-6881-4917-b662-da8e842733a9 admin admin] PATH_INFO: `/v3/users/2f88b207579d4a23ba97a02e1d78af49` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:48.575287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c6a28-6881-4917-b662-da8e842733a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f88b207579d4a23ba97a02e1d78af49)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:48.577686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c6a28-6881-4917-b662-da8e842733a9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:48.685669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-951c6a28-6881-4917-b662-da8e842733a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f88b207579d4a23ba97a02e1d78af49'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:48.686641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-951c6a28-6881-4917-b662-da8e842733a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f88b207579d4a23ba97a02e1d78af49'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:48.702615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-951c6a28-6881-4917-b662-da8e842733a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f88b207579d4a23ba97a02e1d78af49'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:48.715651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-951c6a28-6881-4917-b662-da8e842733a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f88b207579d4a23ba97a02e1d78af49'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:48.734530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-951c6a28-6881-4917-b662-da8e842733a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f88b207579d4a23ba97a02e1d78af49'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:48.742665 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2177/4333] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:36:48 2022] DELETE /identity/v3/users/2f88b207579d4a23ba97a02e1d78af49 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:49.004909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847122a8-0980-4832-8747-8dbbb99ead3b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:49.006419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-847122a8-0980-4832-8747-8dbbb99ead3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:49.022574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847122a8-0980-4832-8747-8dbbb99ead3b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:49.108701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839305e-e932-47c2-b0d3-caef4a9ecbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:49.109374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839305e-e932-47c2-b0d3-caef4a9ecbcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.109761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839305e-e932-47c2-b0d3-caef4a9ecbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.110126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839305e-e932-47c2-b0d3-caef4a9ecbcf admin admin] PATH_INFO: `/v3/projects/535c52e2036b48979a309a565d08559e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.111404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839305e-e932-47c2-b0d3-caef4a9ecbcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=535c52e2036b48979a309a565d08559e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:49.113726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839305e-e932-47c2-b0d3-caef4a9ecbcf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:49.179385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7839305e-e932-47c2-b0d3-caef4a9ecbcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535c52e2036b48979a309a565d08559e', 'request_id': 'req-7839305e-e932-47c2-b0d3-caef4a9ecbcf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:49.196325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7839305e-e932-47c2-b0d3-caef4a9ecbcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535c52e2036b48979a309a565d08559e', 'request_id': 'req-7839305e-e932-47c2-b0d3-caef4a9ecbcf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:49.205213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7839305e-e932-47c2-b0d3-caef4a9ecbcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535c52e2036b48979a309a565d08559e', 'request_id': 'req-7839305e-e932-47c2-b0d3-caef4a9ecbcf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:49.221442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7839305e-e932-47c2-b0d3-caef4a9ecbcf admin admin] The token cache is being invalidate because project 535c52e2036b48979a309a565d08559e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:36:49.221803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7839305e-e932-47c2-b0d3-caef4a9ecbcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:49.222383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7839305e-e932-47c2-b0d3-caef4a9ecbcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:49.227907 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2157/4334] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:36:49 2022] DELETE /identity/v3/projects/535c52e2036b48979a309a565d08559e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:49.232548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae5b08-a85c-4c8a-9894-25d8dbea8798 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.232836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae5b08-a85c-4c8a-9894-25d8dbea8798 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.233115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae5b08-a85c-4c8a-9894-25d8dbea8798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.264665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f4ae5b08-a85c-4c8a-9894-25d8dbea8798 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:49.265865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4ae5b08-a85c-4c8a-9894-25d8dbea8798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:49.364263 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2178/4335] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:49.372567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43a5c1-75e4-4086-95f3-7addec79e55a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.372958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43a5c1-75e4-4086-95f3-7addec79e55a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.373304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43a5c1-75e4-4086-95f3-7addec79e55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.395864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4e43a5c1-75e4-4086-95f3-7addec79e55a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:49.397699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4e43a5c1-75e4-4086-95f3-7addec79e55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:49.412649 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2158/4336] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:49.413518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae5b08-a85c-4c8a-9894-25d8dbea8798 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:49.424168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae5b08-a85c-4c8a-9894-25d8dbea8798 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:49.429229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfea156-8fc6-4142-aa7a-0bded171696f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:49.429982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfea156-8fc6-4142-aa7a-0bded171696f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.430268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfea156-8fc6-4142-aa7a-0bded171696f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.430527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfea156-8fc6-4142-aa7a-0bded171696f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.431556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfea156-8fc6-4142-aa7a-0bded171696f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:49.431945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfea156-8fc6-4142-aa7a-0bded171696f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:49.433658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfea156-8fc6-4142-aa7a-0bded171696f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:49.449395 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2179/4337] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:49.452554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43a5c1-75e4-4086-95f3-7addec79e55a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:49.458741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:49.471881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43a5c1-75e4-4086-95f3-7addec79e55a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:49.479551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66b0b3-a423-4bfa-833c-41fce14f4e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:49.480293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66b0b3-a423-4bfa-833c-41fce14f4e06 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.481360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66b0b3-a423-4bfa-833c-41fce14f4e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.482303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66b0b3-a423-4bfa-833c-41fce14f4e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.483999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66b0b3-a423-4bfa-833c-41fce14f4e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:49.487770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66b0b3-a423-4bfa-833c-41fce14f4e06 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:49.526654 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2159/4338] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:36:49 2022] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:49.530697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfea156-8fc6-4142-aa7a-0bded171696f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:49.543109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfea156-8fc6-4142-aa7a-0bded171696f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:49.582233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:49.619568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f8c35-36bd-4f36-9041-50c8fc1ce28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:49.620784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f8c35-36bd-4f36-9041-50c8fc1ce28d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.621140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f8c35-36bd-4f36-9041-50c8fc1ce28d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.621489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f8c35-36bd-4f36-9041-50c8fc1ce28d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.622204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f8c35-36bd-4f36-9041-50c8fc1ce28d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:49.624800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f8c35-36bd-4f36-9041-50c8fc1ce28d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:49.653415 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2180/4339] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:36:49 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:49.658004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66b0b3-a423-4bfa-833c-41fce14f4e06 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:49.672553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66b0b3-a423-4bfa-833c-41fce14f4e06 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:49.678302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59ea44-df9a-49d4-9159-7214213c9be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:49.679042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59ea44-df9a-49d4-9159-7214213c9be7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.679466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59ea44-df9a-49d4-9159-7214213c9be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.679843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59ea44-df9a-49d4-9159-7214213c9be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.680685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59ea44-df9a-49d4-9159-7214213c9be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:49.682367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59ea44-df9a-49d4-9159-7214213c9be7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:49.699333 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2160/4340] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:36:49.701134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f8c35-36bd-4f36-9041-50c8fc1ce28d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:49.713823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f8c35-36bd-4f36-9041-50c8fc1ce28d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:49.719203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330311c3-ee4b-48cb-96e5-ab19254dcc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:49.719869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330311c3-ee4b-48cb-96e5-ab19254dcc52 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.720143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330311c3-ee4b-48cb-96e5-ab19254dcc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.720413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330311c3-ee4b-48cb-96e5-ab19254dcc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.721062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330311c3-ee4b-48cb-96e5-ab19254dcc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:49.722670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330311c3-ee4b-48cb-96e5-ab19254dcc52 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:49.734965 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2181/4341] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:36:49.739653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59ea44-df9a-49d4-9159-7214213c9be7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:49.749795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59ea44-df9a-49d4-9159-7214213c9be7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:49.755341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7611e66-622a-48ff-b10f-9225a8b4f112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:49.756029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7611e66-622a-48ff-b10f-9225a8b4f112 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.756309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7611e66-622a-48ff-b10f-9225a8b4f112 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.756584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7611e66-622a-48ff-b10f-9225a8b4f112 admin admin] PATH_INFO: `/v3/projects/a10aa37d09f64c5d9e3fa6be401ff8fe/users/cddcb537be124c17a52951eed7a61305/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.775991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7611e66-622a-48ff-b10f-9225a8b4f112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a10aa37d09f64c5d9e3fa6be401ff8fe, user_id=cddcb537be124c17a52951eed7a61305, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:49.778676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7611e66-622a-48ff-b10f-9225a8b4f112 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:49.800716 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2161/4342] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:36:49 2022] PUT /identity/v3/projects/a10aa37d09f64c5d9e3fa6be401ff8fe/users/cddcb537be124c17a52951eed7a61305/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:36:49.802666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1167ab-451d-4967-abfd-3d6a2f7244cd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.802947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1167ab-451d-4967-abfd-3d6a2f7244cd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.803950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1167ab-451d-4967-abfd-3d6a2f7244cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.826957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2d1167ab-451d-4967-abfd-3d6a2f7244cd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:49.828585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d1167ab-451d-4967-abfd-3d6a2f7244cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:49.929681 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2182/4343] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:49.938949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7611e66-622a-48ff-b10f-9225a8b4f112 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:49.940909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d7611e66-622a-48ff-b10f-9225a8b4f112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:50.050827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7611e66-622a-48ff-b10f-9225a8b4f112 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:50.062023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34689fc1-ddce-4050-80e8-8b1f8b198ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:50.062973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34689fc1-ddce-4050-80e8-8b1f8b198ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:50.063553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34689fc1-ddce-4050-80e8-8b1f8b198ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:50.064075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34689fc1-ddce-4050-80e8-8b1f8b198ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:50.086571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34689fc1-ddce-4050-80e8-8b1f8b198ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:50.098075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34689fc1-ddce-4050-80e8-8b1f8b198ea8 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:50.120829 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2162/4344] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:36:56.308784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1167ab-451d-4967-abfd-3d6a2f7244cd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:56.310338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d1167ab-451d-4967-abfd-3d6a2f7244cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:56.335819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1167ab-451d-4967-abfd-3d6a2f7244cd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:56.350142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022bc2d-dad3-4df4-9fd6-43b01ec7dd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:56.354505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022bc2d-dad3-4df4-9fd6-43b01ec7dd68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:56.360678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022bc2d-dad3-4df4-9fd6-43b01ec7dd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:56.361332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022bc2d-dad3-4df4-9fd6-43b01ec7dd68 admin admin] PATH_INFO: `/v3/users/3d32649b5e034ec196c5551582228f48` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:56.364805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022bc2d-dad3-4df4-9fd6-43b01ec7dd68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d32649b5e034ec196c5551582228f48)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:56.366961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022bc2d-dad3-4df4-9fd6-43b01ec7dd68 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:56.471944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7022bc2d-dad3-4df4-9fd6-43b01ec7dd68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d32649b5e034ec196c5551582228f48'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:56.472814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7022bc2d-dad3-4df4-9fd6-43b01ec7dd68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d32649b5e034ec196c5551582228f48'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:56.484687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7022bc2d-dad3-4df4-9fd6-43b01ec7dd68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d32649b5e034ec196c5551582228f48'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:56.522559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7022bc2d-dad3-4df4-9fd6-43b01ec7dd68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d32649b5e034ec196c5551582228f48'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:56.581768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7022bc2d-dad3-4df4-9fd6-43b01ec7dd68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d32649b5e034ec196c5551582228f48'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:56.599664 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2183/4345] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:36:56 2022] DELETE /identity/v3/users/3d32649b5e034ec196c5551582228f48 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:56.604197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f32764-996a-499e-ade8-fd4680e00b2f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:56.605624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f32764-996a-499e-ade8-fd4680e00b2f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:56.606091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f32764-996a-499e-ade8-fd4680e00b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:56.648229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-93f32764-996a-499e-ade8-fd4680e00b2f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:56.651802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-93f32764-996a-499e-ade8-fd4680e00b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:56.822920 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2163/4346] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:56.946219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022bc2d-dad3-4df4-9fd6-43b01ec7dd68 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:56.947706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7022bc2d-dad3-4df4-9fd6-43b01ec7dd68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:57.005212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:57.109073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022bc2d-dad3-4df4-9fd6-43b01ec7dd68 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:57.120006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6991df6-1828-4e45-9733-c3d7da162f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:57.120702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6991df6-1828-4e45-9733-c3d7da162f31 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:57.120980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6991df6-1828-4e45-9733-c3d7da162f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:57.121552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6991df6-1828-4e45-9733-c3d7da162f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:57.148313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6991df6-1828-4e45-9733-c3d7da162f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:57.150502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6991df6-1828-4e45-9733-c3d7da162f31 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:57.179009 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2184/4347] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:36:57.827931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f32764-996a-499e-ade8-fd4680e00b2f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:57.829575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-93f32764-996a-499e-ade8-fd4680e00b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:57.876369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f32764-996a-499e-ade8-fd4680e00b2f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:57.894278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1106bd3-42fa-4c8b-b0c4-3e3b4f861abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:57.894939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1106bd3-42fa-4c8b-b0c4-3e3b4f861abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:57.895367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1106bd3-42fa-4c8b-b0c4-3e3b4f861abf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:57.895840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1106bd3-42fa-4c8b-b0c4-3e3b4f861abf admin admin] PATH_INFO: `/v3/users/8a69e2abd84b4fe2a38af048510f83af` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:57.897231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1106bd3-42fa-4c8b-b0c4-3e3b4f861abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a69e2abd84b4fe2a38af048510f83af)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:57.899330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1106bd3-42fa-4c8b-b0c4-3e3b4f861abf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:57.967888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:57.975237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c1106bd3-42fa-4c8b-b0c4-3e3b4f861abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a69e2abd84b4fe2a38af048510f83af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:57.993356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c1106bd3-42fa-4c8b-b0c4-3e3b4f861abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a69e2abd84b4fe2a38af048510f83af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:57.994080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c1106bd3-42fa-4c8b-b0c4-3e3b4f861abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a69e2abd84b4fe2a38af048510f83af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:57.994848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c1106bd3-42fa-4c8b-b0c4-3e3b4f861abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a69e2abd84b4fe2a38af048510f83af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:58.006087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c1106bd3-42fa-4c8b-b0c4-3e3b4f861abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a69e2abd84b4fe2a38af048510f83af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:58.026427 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2164/4348] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:36:57 2022] DELETE /identity/v3/users/8a69e2abd84b4fe2a38af048510f83af => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:58.026594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6991df6-1828-4e45-9733-c3d7da162f31 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:58.027841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6991df6-1828-4e45-9733-c3d7da162f31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:58.041795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6991df6-1828-4e45-9733-c3d7da162f31 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:58.141083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:58.142560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.142933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.143308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07 admin admin] PATH_INFO: `/v3/projects/e2310212af5942689d3889be2fa7daec` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.144815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2310212af5942689d3889be2fa7daec)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:58.147111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:58.216497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2310212af5942689d3889be2fa7daec', 'request_id': 'req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:58.234465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2310212af5942689d3889be2fa7daec', 'request_id': 'req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:58.241671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2310212af5942689d3889be2fa7daec', 'request_id': 'req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:58.269464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07 admin admin] The token cache is being invalidate because project e2310212af5942689d3889be2fa7daec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:36:58.269779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:58.270506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:58.274890 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2185/4349] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:36:58 2022] DELETE /identity/v3/projects/e2310212af5942689d3889be2fa7daec => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:58.276782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1106bd3-42fa-4c8b-b0c4-3e3b4f861abf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:58.278325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c1106bd3-42fa-4c8b-b0c4-3e3b4f861abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:58.301454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1106bd3-42fa-4c8b-b0c4-3e3b4f861abf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:58.362368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:58.364276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:58.481525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:58.482456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50239b2-77a3-4063-b9f2-487e860915af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:58.483273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50239b2-77a3-4063-b9f2-487e860915af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.483670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50239b2-77a3-4063-b9f2-487e860915af admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.484048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50239b2-77a3-4063-b9f2-487e860915af admin admin] PATH_INFO: `/v3/users/94c0cd1bf6a64e658c597f8561bd5c9c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.485663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50239b2-77a3-4063-b9f2-487e860915af admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c0cd1bf6a64e658c597f8561bd5c9c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:58.494925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50239b2-77a3-4063-b9f2-487e860915af admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:58.498683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0ba2f-3c8a-4bbb-87ad-b7e76ed33f07 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:58.505497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfe613-6223-4f46-af5a-d18988ea2e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:58.506758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfe613-6223-4f46-af5a-d18988ea2e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.507046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfe613-6223-4f46-af5a-d18988ea2e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.507658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfe613-6223-4f46-af5a-d18988ea2e01 admin admin] PATH_INFO: `/v3/projects/accbc3dc601e48b3a3c534a94b6cb3f4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.508595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfe613-6223-4f46-af5a-d18988ea2e01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=accbc3dc601e48b3a3c534a94b6cb3f4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:58.511047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfe613-6223-4f46-af5a-d18988ea2e01 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:58.599854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10dfe613-6223-4f46-af5a-d18988ea2e01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'accbc3dc601e48b3a3c534a94b6cb3f4', 'request_id': 'req-10dfe613-6223-4f46-af5a-d18988ea2e01'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:58.615058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b50239b2-77a3-4063-b9f2-487e860915af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c0cd1bf6a64e658c597f8561bd5c9c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:58.615673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10dfe613-6223-4f46-af5a-d18988ea2e01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'accbc3dc601e48b3a3c534a94b6cb3f4', 'request_id': 'req-10dfe613-6223-4f46-af5a-d18988ea2e01'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:58.625065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10dfe613-6223-4f46-af5a-d18988ea2e01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'accbc3dc601e48b3a3c534a94b6cb3f4', 'request_id': 'req-10dfe613-6223-4f46-af5a-d18988ea2e01'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:58.646643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10dfe613-6223-4f46-af5a-d18988ea2e01 admin admin] The token cache is being invalidate because project accbc3dc601e48b3a3c534a94b6cb3f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:36:58.646923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10dfe613-6223-4f46-af5a-d18988ea2e01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:58.647627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10dfe613-6223-4f46-af5a-d18988ea2e01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:58.649517 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2186/4350] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:36:58 2022] DELETE /identity/v3/projects/accbc3dc601e48b3a3c534a94b6cb3f4 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:58.658339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befca594-0710-40fe-bd66-25603211abe4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.661205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befca594-0710-40fe-bd66-25603211abe4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.661959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befca594-0710-40fe-bd66-25603211abe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.671146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b50239b2-77a3-4063-b9f2-487e860915af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c0cd1bf6a64e658c597f8561bd5c9c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:58.673050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b50239b2-77a3-4063-b9f2-487e860915af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c0cd1bf6a64e658c597f8561bd5c9c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:58.673741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b50239b2-77a3-4063-b9f2-487e860915af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c0cd1bf6a64e658c597f8561bd5c9c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:58.682629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b50239b2-77a3-4063-b9f2-487e860915af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c0cd1bf6a64e658c597f8561bd5c9c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:58.694509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-befca594-0710-40fe-bd66-25603211abe4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:58.707475 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2165/4351] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:36:58 2022] DELETE /identity/v3/users/94c0cd1bf6a64e658c597f8561bd5c9c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:58.721914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-befca594-0710-40fe-bd66-25603211abe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:58.815914 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2187/4352] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:58.824440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20343610-73d9-406e-ba81-f4898308c133 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.825002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20343610-73d9-406e-ba81-f4898308c133 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.825522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20343610-73d9-406e-ba81-f4898308c133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.849409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-20343610-73d9-406e-ba81-f4898308c133 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:58.851664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-20343610-73d9-406e-ba81-f4898308c133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:58.871610 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2166/4353] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:58.876712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befca594-0710-40fe-bd66-25603211abe4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:58.894996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befca594-0710-40fe-bd66-25603211abe4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:58.903034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989141f-e37e-4892-8168-8680cd77a982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:58.903833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989141f-e37e-4892-8168-8680cd77a982 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.904948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989141f-e37e-4892-8168-8680cd77a982 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.905423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989141f-e37e-4892-8168-8680cd77a982 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.906481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989141f-e37e-4892-8168-8680cd77a982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:58.906944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989141f-e37e-4892-8168-8680cd77a982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:58.909777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989141f-e37e-4892-8168-8680cd77a982 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:58.940854 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2188/4354] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:58.944259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20343610-73d9-406e-ba81-f4898308c133 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:58.958444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20343610-73d9-406e-ba81-f4898308c133 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:58.972069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c06a1-786b-4055-a01f-d9e4fb08576a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:58.972695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c06a1-786b-4055-a01f-d9e4fb08576a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.972975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c06a1-786b-4055-a01f-d9e4fb08576a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.973248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c06a1-786b-4055-a01f-d9e4fb08576a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.974298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c06a1-786b-4055-a01f-d9e4fb08576a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:58.981276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c06a1-786b-4055-a01f-d9e4fb08576a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.026412 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2167/4355] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:36:58 2022] POST /identity/v3/projects => generated 405 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:59.030234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989141f-e37e-4892-8168-8680cd77a982 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.043455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989141f-e37e-4892-8168-8680cd77a982 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.126433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402a1e3-9d0e-4972-8a80-75a34684e414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.127065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402a1e3-9d0e-4972-8a80-75a34684e414 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.127382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402a1e3-9d0e-4972-8a80-75a34684e414 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.127657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402a1e3-9d0e-4972-8a80-75a34684e414 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.129613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402a1e3-9d0e-4972-8a80-75a34684e414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.137540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402a1e3-9d0e-4972-8a80-75a34684e414 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.167957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:59.177438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c06a1-786b-4055-a01f-d9e4fb08576a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.179427 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2189/4356] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:36:59 2022] POST /identity/v3/users => generated 303 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:36:59.180451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402a1e3-9d0e-4972-8a80-75a34684e414 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.183218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1402a1e3-9d0e-4972-8a80-75a34684e414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:59.194474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c06a1-786b-4055-a01f-d9e4fb08576a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.197319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402a1e3-9d0e-4972-8a80-75a34684e414 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.203354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf692d7-9e69-4d65-be77-da7e64a449be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.204381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf692d7-9e69-4d65-be77-da7e64a449be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.204745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf692d7-9e69-4d65-be77-da7e64a449be admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.205212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf692d7-9e69-4d65-be77-da7e64a449be admin admin] PATH_INFO: `/v3/projects/55314dbbdd0b46469cf799340f8a3113` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.205815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f593fd-0c44-4812-9b08-57da6c719459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.206734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f593fd-0c44-4812-9b08-57da6c719459 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.206941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf692d7-9e69-4d65-be77-da7e64a449be admin admin] RBAC: Authorizing `identity:delete_project(project_id=55314dbbdd0b46469cf799340f8a3113)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.207441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f593fd-0c44-4812-9b08-57da6c719459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.207877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f593fd-0c44-4812-9b08-57da6c719459 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.209395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f593fd-0c44-4812-9b08-57da6c719459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.209935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf692d7-9e69-4d65-be77-da7e64a449be admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.211703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f593fd-0c44-4812-9b08-57da6c719459 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.228928 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2168/4357] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:36:59.233985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f593fd-0c44-4812-9b08-57da6c719459 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.239735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:59.250328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f593fd-0c44-4812-9b08-57da6c719459 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.257685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950d8f3-632c-4458-abba-08fbbf77e33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.258360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950d8f3-632c-4458-abba-08fbbf77e33a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.258632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950d8f3-632c-4458-abba-08fbbf77e33a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.258917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950d8f3-632c-4458-abba-08fbbf77e33a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.259642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950d8f3-632c-4458-abba-08fbbf77e33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.261285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950d8f3-632c-4458-abba-08fbbf77e33a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.281360 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2169/4358] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:36:59.283718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950d8f3-632c-4458-abba-08fbbf77e33a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.298246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adf692d7-9e69-4d65-be77-da7e64a449be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55314dbbdd0b46469cf799340f8a3113', 'request_id': 'req-adf692d7-9e69-4d65-be77-da7e64a449be'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:59.298517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950d8f3-632c-4458-abba-08fbbf77e33a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.309555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adf692d7-9e69-4d65-be77-da7e64a449be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55314dbbdd0b46469cf799340f8a3113', 'request_id': 'req-adf692d7-9e69-4d65-be77-da7e64a449be'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:59.320660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adf692d7-9e69-4d65-be77-da7e64a449be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55314dbbdd0b46469cf799340f8a3113', 'request_id': 'req-adf692d7-9e69-4d65-be77-da7e64a449be'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:59.342535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adf692d7-9e69-4d65-be77-da7e64a449be admin admin] The token cache is being invalidate because project 55314dbbdd0b46469cf799340f8a3113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:36:59.342972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adf692d7-9e69-4d65-be77-da7e64a449be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:59.344215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adf692d7-9e69-4d65-be77-da7e64a449be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:36:59.348647 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2190/4359] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:36:59 2022] DELETE /identity/v3/projects/55314dbbdd0b46469cf799340f8a3113 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:59.354345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28f12f-cecf-4d62-8157-a93771d8ffc3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.354913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28f12f-cecf-4d62-8157-a93771d8ffc3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.355413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28f12f-cecf-4d62-8157-a93771d8ffc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.376166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ab28f12f-cecf-4d62-8157-a93771d8ffc3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:59.377726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab28f12f-cecf-4d62-8157-a93771d8ffc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:59.381309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f278629-fdee-4fdc-80b9-bc85eac91184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.382064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f278629-fdee-4fdc-80b9-bc85eac91184 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.382414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f278629-fdee-4fdc-80b9-bc85eac91184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.382756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f278629-fdee-4fdc-80b9-bc85eac91184 admin admin] PATH_INFO: `/v3/projects/a164854fbbbe435882eb5ef6fd89b887/users/aa196ab32caf4d6dbe169aa43484c2ec/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.387991 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2191/4360] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:36:59.397539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47621e-3da1-419f-b4c2-3434666bbaac None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.397804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47621e-3da1-419f-b4c2-3434666bbaac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.398160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47621e-3da1-419f-b4c2-3434666bbaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.403151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f278629-fdee-4fdc-80b9-bc85eac91184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a164854fbbbe435882eb5ef6fd89b887, user_id=aa196ab32caf4d6dbe169aa43484c2ec, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.406606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f278629-fdee-4fdc-80b9-bc85eac91184 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.424302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fc47621e-3da1-419f-b4c2-3434666bbaac None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:59.425722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc47621e-3da1-419f-b4c2-3434666bbaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:59.432565 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2170/4361] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:36:59 2022] PUT /identity/v3/projects/a164854fbbbe435882eb5ef6fd89b887/users/aa196ab32caf4d6dbe169aa43484c2ec/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:59.438046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102aeb9-90ad-4fe7-8710-eb67522a5aa5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.438705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102aeb9-90ad-4fe7-8710-eb67522a5aa5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.438986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102aeb9-90ad-4fe7-8710-eb67522a5aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.465663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5102aeb9-90ad-4fe7-8710-eb67522a5aa5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:59.478304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5102aeb9-90ad-4fe7-8710-eb67522a5aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:59.523359 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2192/4362] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:59.524534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47621e-3da1-419f-b4c2-3434666bbaac None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.538546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47621e-3da1-419f-b4c2-3434666bbaac None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.548766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730daad-ca9f-436f-be6c-61774bf73ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.549874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730daad-ca9f-436f-be6c-61774bf73ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.550410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730daad-ca9f-436f-be6c-61774bf73ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.550896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730daad-ca9f-436f-be6c-61774bf73ba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.551928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730daad-ca9f-436f-be6c-61774bf73ba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:59.552486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730daad-ca9f-436f-be6c-61774bf73ba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.554462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730daad-ca9f-436f-be6c-61774bf73ba0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.581803 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2171/4363] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:36:59.586881 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2193/4364] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:59.588077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102aeb9-90ad-4fe7-8710-eb67522a5aa5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.589269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730daad-ca9f-436f-be6c-61774bf73ba0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.591266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9730daad-ca9f-436f-be6c-61774bf73ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:59.598645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102aeb9-90ad-4fe7-8710-eb67522a5aa5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.605666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fc172-973f-4e64-9e6a-ced5a9d6e115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.606614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fc172-973f-4e64-9e6a-ced5a9d6e115 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.607087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fc172-973f-4e64-9e6a-ced5a9d6e115 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.607598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fc172-973f-4e64-9e6a-ced5a9d6e115 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.608462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fc172-973f-4e64-9e6a-ced5a9d6e115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.610708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fc172-973f-4e64-9e6a-ced5a9d6e115 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.650915 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2172/4365] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:36:59 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:59.654567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fc172-973f-4e64-9e6a-ced5a9d6e115 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.678817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730daad-ca9f-436f-be6c-61774bf73ba0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.699287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:59.740522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a3f4a-2861-49e6-a033-6c5a7dabd1dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.741238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a3f4a-2861-49e6-a033-6c5a7dabd1dd service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.741710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a3f4a-2861-49e6-a033-6c5a7dabd1dd service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.741865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a3f4a-2861-49e6-a033-6c5a7dabd1dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.779139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:59.797211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fc172-973f-4e64-9e6a-ced5a9d6e115 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.802920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d49ef2-ffff-43f4-bd77-46973b16ba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.803640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d49ef2-ffff-43f4-bd77-46973b16ba51 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.804021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d49ef2-ffff-43f4-bd77-46973b16ba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.804318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d49ef2-ffff-43f4-bd77-46973b16ba51 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.804963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d49ef2-ffff-43f4-bd77-46973b16ba51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.808012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d49ef2-ffff-43f4-bd77-46973b16ba51 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.826345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a3f4a-2861-49e6-a033-6c5a7dabd1dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.828747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a3f4a-2861-49e6-a033-6c5a7dabd1dd service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.838003 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2173/4366] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:36:59 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:59.841849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d49ef2-ffff-43f4-bd77-46973b16ba51 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.842250 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2194/4367] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:36:59.874201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d49ef2-ffff-43f4-bd77-46973b16ba51 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.885566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21204120-6016-4693-bbd9-5f602e8e39bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.886221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21204120-6016-4693-bbd9-5f602e8e39bc admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.886503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21204120-6016-4693-bbd9-5f602e8e39bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.887198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21204120-6016-4693-bbd9-5f602e8e39bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.887571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21204120-6016-4693-bbd9-5f602e8e39bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.889069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21204120-6016-4693-bbd9-5f602e8e39bc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.921047 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2174/4368] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:36:59.922280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a3f4a-2861-49e6-a033-6c5a7dabd1dd service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.934239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a3f4a-2861-49e6-a033-6c5a7dabd1dd service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.960562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a2ed5-912e-4b62-b27a-f8b89a4e442f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.961294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a2ed5-912e-4b62-b27a-f8b89a4e442f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.962390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a2ed5-912e-4b62-b27a-f8b89a4e442f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.972568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23784a1f-24f9-42e0-9750-6731cadcecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.974008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23784a1f-24f9-42e0-9750-6731cadcecc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.975434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23784a1f-24f9-42e0-9750-6731cadcecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.975914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23784a1f-24f9-42e0-9750-6731cadcecc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.976594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23784a1f-24f9-42e0-9750-6731cadcecc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.980934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23784a1f-24f9-42e0-9750-6731cadcecc6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:00.002623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d40a2ed5-912e-4b62-b27a-f8b89a4e442f None None] MFA Rules not processed for user `e57aca8c1b5847f999daeb74a982f4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:00.004313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d40a2ed5-912e-4b62-b27a-f8b89a4e442f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:00.008813 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2195/4369] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:37:00.013427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23784a1f-24f9-42e0-9750-6731cadcecc6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:00.039173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23784a1f-24f9-42e0-9750-6731cadcecc6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:00.051125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243b40d-e083-4362-b675-f748590d8203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:00.051984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b40d-e083-4362-b675-f748590d8203 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:00.052737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b40d-e083-4362-b675-f748590d8203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:00.053090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b40d-e083-4362-b675-f748590d8203 admin admin] PATH_INFO: `/v3/projects/a7c939b5ae50475aa0aff7973af83c30/users/0e770edfa0b748bf94d9dacaffc9ea23/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:00.079354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243b40d-e083-4362-b675-f748590d8203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c939b5ae50475aa0aff7973af83c30, user_id=0e770edfa0b748bf94d9dacaffc9ea23, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:00.085130 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2175/4370] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:36:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:37:00.085362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243b40d-e083-4362-b675-f748590d8203 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:00.106959 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2196/4371] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:37:00 2022] PUT /identity/v3/projects/a7c939b5ae50475aa0aff7973af83c30/users/0e770edfa0b748bf94d9dacaffc9ea23/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:37:00.118495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b949959-a0e3-450b-a2fb-856e7b0c16ad None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:00.118782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b949959-a0e3-450b-a2fb-856e7b0c16ad None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:00.120693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b949959-a0e3-450b-a2fb-856e7b0c16ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:00.190729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9b949959-a0e3-450b-a2fb-856e7b0c16ad None None] MFA Rules not processed for user `0e770edfa0b748bf94d9dacaffc9ea23`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:00.192110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9b949959-a0e3-450b-a2fb-856e7b0c16ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:00.280564 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2176/4372] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:37:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:37:00.285173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243b40d-e083-4362-b675-f748590d8203 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:00.369422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243b40d-e083-4362-b675-f748590d8203 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:00.399048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f735743-ab42-4dee-93fc-ba2f6f774ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:00.400006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f735743-ab42-4dee-93fc-ba2f6f774ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:00.400493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f735743-ab42-4dee-93fc-ba2f6f774ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:00.400945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f735743-ab42-4dee-93fc-ba2f6f774ed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:00.402404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f735743-ab42-4dee-93fc-ba2f6f774ed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:00.406650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f735743-ab42-4dee-93fc-ba2f6f774ed6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:00.472893 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2197/4373] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:37:00 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:37:00.476690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b949959-a0e3-450b-a2fb-856e7b0c16ad None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:00.500378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b949959-a0e3-450b-a2fb-856e7b0c16ad None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:00.646420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015194da-33b6-4a68-923e-595b27fca5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:00.646982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015194da-33b6-4a68-923e-595b27fca5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:00.647279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015194da-33b6-4a68-923e-595b27fca5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:00.647569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015194da-33b6-4a68-923e-595b27fca5a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:00.648228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015194da-33b6-4a68-923e-595b27fca5a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:00.654827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015194da-33b6-4a68-923e-595b27fca5a5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:00.670620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:00.692006 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2177/4374] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:37:00 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:37:00.696036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f735743-ab42-4dee-93fc-ba2f6f774ed6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:00.708427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f735743-ab42-4dee-93fc-ba2f6f774ed6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:00.714789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd00aa-98b1-4b85-83ce-8b5004c10f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:00.715525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd00aa-98b1-4b85-83ce-8b5004c10f27 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:00.716599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd00aa-98b1-4b85-83ce-8b5004c10f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:00.717323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd00aa-98b1-4b85-83ce-8b5004c10f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:00.717982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd00aa-98b1-4b85-83ce-8b5004c10f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:00.720084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd00aa-98b1-4b85-83ce-8b5004c10f27 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:00.735180 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2198/4375] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:37:00.738853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015194da-33b6-4a68-923e-595b27fca5a5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:00.755846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015194da-33b6-4a68-923e-595b27fca5a5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:00.766689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a6ede-9a12-4c25-9017-772190093621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:00.767510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a6ede-9a12-4c25-9017-772190093621 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:00.767735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a6ede-9a12-4c25-9017-772190093621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:00.768060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a6ede-9a12-4c25-9017-772190093621 admin admin] PATH_INFO: `/v3/projects/c0bf1fdd2d704b0a95b0dcd583ea5908/users/bc5647735dd74bfd90864910f7bcd71e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:00.790032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a6ede-9a12-4c25-9017-772190093621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0bf1fdd2d704b0a95b0dcd583ea5908, user_id=bc5647735dd74bfd90864910f7bcd71e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:00.792749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a6ede-9a12-4c25-9017-772190093621 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:00.809745 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2178/4376] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:37:00 2022] PUT /identity/v3/projects/c0bf1fdd2d704b0a95b0dcd583ea5908/users/bc5647735dd74bfd90864910f7bcd71e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:37:00.813776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd00aa-98b1-4b85-83ce-8b5004c10f27 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:00.826201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd00aa-98b1-4b85-83ce-8b5004c10f27 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:00.832318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:00.913498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7029b3e-333e-48aa-ba30-a0b27096ef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:00.914128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7029b3e-333e-48aa-ba30-a0b27096ef2a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:00.914404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7029b3e-333e-48aa-ba30-a0b27096ef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:00.914677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7029b3e-333e-48aa-ba30-a0b27096ef2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:00.915441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7029b3e-333e-48aa-ba30-a0b27096ef2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:00.917101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7029b3e-333e-48aa-ba30-a0b27096ef2a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:00.930793 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2199/4377] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:37:00.936977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a6ede-9a12-4c25-9017-772190093621 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:00.950686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a6ede-9a12-4c25-9017-772190093621 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:00.967663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9ed3c-42b4-41e6-98e6-0b39247ff966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:00.969202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9ed3c-42b4-41e6-98e6-0b39247ff966 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:00.971713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9ed3c-42b4-41e6-98e6-0b39247ff966 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:00.972470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9ed3c-42b4-41e6-98e6-0b39247ff966 admin admin] PATH_INFO: `/v3/projects/c0bf1fdd2d704b0a95b0dcd583ea5908/users/bc5647735dd74bfd90864910f7bcd71e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:00.978602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9ed3c-42b4-41e6-98e6-0b39247ff966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0bf1fdd2d704b0a95b0dcd583ea5908, user_id=bc5647735dd74bfd90864910f7bcd71e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:00.986665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9ed3c-42b4-41e6-98e6-0b39247ff966 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:01.016905 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2179/4378] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:37:00 2022] PUT /identity/v3/projects/c0bf1fdd2d704b0a95b0dcd583ea5908/users/bc5647735dd74bfd90864910f7bcd71e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:37:01.028149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26845822-d31c-4f64-9b78-de7764e2d669 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:01.028697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26845822-d31c-4f64-9b78-de7764e2d669 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:01.029097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26845822-d31c-4f64-9b78-de7764e2d669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:01.147705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-26845822-d31c-4f64-9b78-de7764e2d669 None None] MFA Rules not processed for user `bc5647735dd74bfd90864910f7bcd71e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:01.149017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-26845822-d31c-4f64-9b78-de7764e2d669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:01.270081 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2200/4379] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:37:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:37:01.282311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9ed3c-42b4-41e6-98e6-0b39247ff966 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:01.284121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cde9ed3c-42b4-41e6-98e6-0b39247ff966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:01.415859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9ed3c-42b4-41e6-98e6-0b39247ff966 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:01.430282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571594c6-e03d-4c47-9df8-a643ec0e376d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:01.431206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571594c6-e03d-4c47-9df8-a643ec0e376d service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:01.431886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571594c6-e03d-4c47-9df8-a643ec0e376d service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:01.432322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571594c6-e03d-4c47-9df8-a643ec0e376d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:01.445863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571594c6-e03d-4c47-9df8-a643ec0e376d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:01.447598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571594c6-e03d-4c47-9df8-a643ec0e376d service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:01.461423 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2180/4380] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:37:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:37:01.589996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26845822-d31c-4f64-9b78-de7764e2d669 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:01.619892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26845822-d31c-4f64-9b78-de7764e2d669 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:01.625729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13483f83-9a73-40d9-86b8-d8cc8ad04ed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:01.626451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13483f83-9a73-40d9-86b8-d8cc8ad04ed1 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:01.627178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13483f83-9a73-40d9-86b8-d8cc8ad04ed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:01.627976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13483f83-9a73-40d9-86b8-d8cc8ad04ed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:01.681976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e4920-23cb-426e-9b85-cab3d40eb915 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:01.682328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e4920-23cb-426e-9b85-cab3d40eb915 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:01.682526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e4920-23cb-426e-9b85-cab3d40eb915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:01.726694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4b3e4920-23cb-426e-9b85-cab3d40eb915 None None] MFA Rules not processed for user `cddcb537be124c17a52951eed7a61305`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:01.728302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4b3e4920-23cb-426e-9b85-cab3d40eb915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:01.766910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13483f83-9a73-40d9-86b8-d8cc8ad04ed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:01.769105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13483f83-9a73-40d9-86b8-d8cc8ad04ed1 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:01.800103 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2201/4381] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:37:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:37:01.871365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13483f83-9a73-40d9-86b8-d8cc8ad04ed1 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:01.871662 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2181/4382] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:37:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:37:01.874465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13483f83-9a73-40d9-86b8-d8cc8ad04ed1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:01.926949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:02.096707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13483f83-9a73-40d9-86b8-d8cc8ad04ed1 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:02.114406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721466ca-dde2-4100-8f92-f5ddd0107b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:02.115059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721466ca-dde2-4100-8f92-f5ddd0107b67 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:02.115368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721466ca-dde2-4100-8f92-f5ddd0107b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:02.115649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721466ca-dde2-4100-8f92-f5ddd0107b67 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:02.116305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721466ca-dde2-4100-8f92-f5ddd0107b67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:02.122818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721466ca-dde2-4100-8f92-f5ddd0107b67 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:02.202460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e4920-23cb-426e-9b85-cab3d40eb915 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:02.212618 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2202/4383] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:37:01 2022] POST /identity/v3/projects => generated 389 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:37:02.219301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e4920-23cb-426e-9b85-cab3d40eb915 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:02.316978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:02.322932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721466ca-dde2-4100-8f92-f5ddd0107b67 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:02.346768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53854fe8-67b8-47a1-a735-e660a1aaccb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:02.347660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53854fe8-67b8-47a1-a735-e660a1aaccb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:02.348084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53854fe8-67b8-47a1-a735-e660a1aaccb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:02.348483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53854fe8-67b8-47a1-a735-e660a1aaccb8 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:02.350631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53854fe8-67b8-47a1-a735-e660a1aaccb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:02.354838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53854fe8-67b8-47a1-a735-e660a1aaccb8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:02.394519 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2182/4384] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:37:02 2022] POST /identity/v3/users => generated 301 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:37:02.396169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53854fe8-67b8-47a1-a735-e660a1aaccb8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:02.420229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53854fe8-67b8-47a1-a735-e660a1aaccb8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:02.433161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d22dd6-929b-407c-a816-01c85ed144a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:02.434025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d22dd6-929b-407c-a816-01c85ed144a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:02.434785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d22dd6-929b-407c-a816-01c85ed144a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:02.435667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d22dd6-929b-407c-a816-01c85ed144a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:02.438149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d22dd6-929b-407c-a816-01c85ed144a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:02.441674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d22dd6-929b-407c-a816-01c85ed144a3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:02.483755 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2183/4385] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:37:02.488241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d22dd6-929b-407c-a816-01c85ed144a3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:02.510624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d22dd6-929b-407c-a816-01c85ed144a3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:02.515920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721466ca-dde2-4100-8f92-f5ddd0107b67 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:02.525083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb752a62-3b6b-412f-95c9-b4aedf349009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:02.525897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb752a62-3b6b-412f-95c9-b4aedf349009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:02.526273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb752a62-3b6b-412f-95c9-b4aedf349009 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:02.526648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb752a62-3b6b-412f-95c9-b4aedf349009 admin admin] PATH_INFO: `/v3/users/0e770edfa0b748bf94d9dacaffc9ea23` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:02.528535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b1620-5819-4048-983c-dd80ef5e3e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:02.529230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1620-5819-4048-983c-dd80ef5e3e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:02.529506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1620-5819-4048-983c-dd80ef5e3e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:02.529777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb752a62-3b6b-412f-95c9-b4aedf349009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e770edfa0b748bf94d9dacaffc9ea23)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:02.529921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1620-5819-4048-983c-dd80ef5e3e63 admin admin] PATH_INFO: `/v3/projects/d2564041053244a08e83372d8d791113/users/3071859e8d09432cb329669826287496/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:02.532277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb752a62-3b6b-412f-95c9-b4aedf349009 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:02.582093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b1620-5819-4048-983c-dd80ef5e3e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2564041053244a08e83372d8d791113, user_id=3071859e8d09432cb329669826287496, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:02.592403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b1620-5819-4048-983c-dd80ef5e3e63 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:02.632304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb752a62-3b6b-412f-95c9-b4aedf349009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e770edfa0b748bf94d9dacaffc9ea23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:02.637568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb752a62-3b6b-412f-95c9-b4aedf349009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e770edfa0b748bf94d9dacaffc9ea23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:02.638989 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2184/4386] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:37:02 2022] PUT /identity/v3/projects/d2564041053244a08e83372d8d791113/users/3071859e8d09432cb329669826287496/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:37:02.642464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b1620-5819-4048-983c-dd80ef5e3e63 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:02.649670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f00b1620-5819-4048-983c-dd80ef5e3e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:02.650675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb752a62-3b6b-412f-95c9-b4aedf349009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e770edfa0b748bf94d9dacaffc9ea23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:02.669822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb752a62-3b6b-412f-95c9-b4aedf349009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e770edfa0b748bf94d9dacaffc9ea23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:02.696671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb752a62-3b6b-412f-95c9-b4aedf349009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e770edfa0b748bf94d9dacaffc9ea23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:02.715693 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2203/4387] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:37:02 2022] DELETE /identity/v3/users/0e770edfa0b748bf94d9dacaffc9ea23 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:37:02.720893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5f528-f28f-4bea-aae0-94cfebb84b48 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:02.721794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5f528-f28f-4bea-aae0-94cfebb84b48 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:02.722286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5f528-f28f-4bea-aae0-94cfebb84b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:02.771580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2fe5f528-f28f-4bea-aae0-94cfebb84b48 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:02.773716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2fe5f528-f28f-4bea-aae0-94cfebb84b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:02.867050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b1620-5819-4048-983c-dd80ef5e3e63 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:02.875023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:02.946602 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2204/4388] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:37:02.958038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5f528-f28f-4bea-aae0-94cfebb84b48 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:02.963972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2fe5f528-f28f-4bea-aae0-94cfebb84b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:02.997635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d50f6-f150-4bd4-a50b-6bf7228f6521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:02.998583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d50f6-f150-4bd4-a50b-6bf7228f6521 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:03.000251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d50f6-f150-4bd4-a50b-6bf7228f6521 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:03.000719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d50f6-f150-4bd4-a50b-6bf7228f6521 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:03.002783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d50f6-f150-4bd4-a50b-6bf7228f6521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:03.006047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d50f6-f150-4bd4-a50b-6bf7228f6521 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:03.035016 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2185/4389] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:37:03.041599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d50f6-f150-4bd4-a50b-6bf7228f6521 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:03.059527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d50f6-f150-4bd4-a50b-6bf7228f6521 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:03.078297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bc38e-5f3e-46c5-8543-01fc317f0565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:03.078994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bc38e-5f3e-46c5-8543-01fc317f0565 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:03.079295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bc38e-5f3e-46c5-8543-01fc317f0565 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:03.079591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bc38e-5f3e-46c5-8543-01fc317f0565 admin admin] PATH_INFO: `/v3/projects/d2564041053244a08e83372d8d791113/users/3071859e8d09432cb329669826287496/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:03.083403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bc38e-5f3e-46c5-8543-01fc317f0565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2564041053244a08e83372d8d791113, user_id=3071859e8d09432cb329669826287496, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:03.088794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bc38e-5f3e-46c5-8543-01fc317f0565 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:03.118432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5f528-f28f-4bea-aae0-94cfebb84b48 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:03.127530 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2186/4390] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:37:03 2022] PUT /identity/v3/projects/d2564041053244a08e83372d8d791113/users/3071859e8d09432cb329669826287496/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:37:03.305716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e2d41-f8df-41f5-adc4-66020dfc2bf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:03.307185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e2d41-f8df-41f5-adc4-66020dfc2bf7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:03.307767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e2d41-f8df-41f5-adc4-66020dfc2bf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:03.308390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e2d41-f8df-41f5-adc4-66020dfc2bf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:03.459777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e2d41-f8df-41f5-adc4-66020dfc2bf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:03.461662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e2d41-f8df-41f5-adc4-66020dfc2bf7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:03.475650 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2205/4391] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:37:04.717001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bc38e-5f3e-46c5-8543-01fc317f0565 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:04.719735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-122bc38e-5f3e-46c5-8543-01fc317f0565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:04.818873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:04.827197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bc38e-5f3e-46c5-8543-01fc317f0565 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:04.861448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99149de-3631-4acc-9deb-e91b538487f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:04.862722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99149de-3631-4acc-9deb-e91b538487f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:04.863226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99149de-3631-4acc-9deb-e91b538487f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:04.864254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99149de-3631-4acc-9deb-e91b538487f1 admin admin] PATH_INFO: `/v3/projects/a7c939b5ae50475aa0aff7973af83c30` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:04.865932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99149de-3631-4acc-9deb-e91b538487f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7c939b5ae50475aa0aff7973af83c30)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:04.869497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99149de-3631-4acc-9deb-e91b538487f1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:04.944796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f99149de-3631-4acc-9deb-e91b538487f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c939b5ae50475aa0aff7973af83c30', 'request_id': 'req-f99149de-3631-4acc-9deb-e91b538487f1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:04.955842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f99149de-3631-4acc-9deb-e91b538487f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c939b5ae50475aa0aff7973af83c30', 'request_id': 'req-f99149de-3631-4acc-9deb-e91b538487f1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:04.963409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f99149de-3631-4acc-9deb-e91b538487f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c939b5ae50475aa0aff7973af83c30', 'request_id': 'req-f99149de-3631-4acc-9deb-e91b538487f1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:04.983375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f99149de-3631-4acc-9deb-e91b538487f1 admin admin] The token cache is being invalidate because project a7c939b5ae50475aa0aff7973af83c30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:37:04.983662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f99149de-3631-4acc-9deb-e91b538487f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:04.984414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f99149de-3631-4acc-9deb-e91b538487f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:04.989196 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2187/4392] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:37:04 2022] DELETE /identity/v3/projects/a7c939b5ae50475aa0aff7973af83c30 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:37:04.991492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e2d41-f8df-41f5-adc4-66020dfc2bf7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:05.035481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99149de-3631-4acc-9deb-e91b538487f1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:05.038099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f99149de-3631-4acc-9deb-e91b538487f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:05.141173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e2d41-f8df-41f5-adc4-66020dfc2bf7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:05.173330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:05.225511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99149de-3631-4acc-9deb-e91b538487f1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:05.233720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f96bc6-ef9d-4c9c-94ab-45a4931643f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:05.234451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f96bc6-ef9d-4c9c-94ab-45a4931643f9 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:05.234734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f96bc6-ef9d-4c9c-94ab-45a4931643f9 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:05.235014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f96bc6-ef9d-4c9c-94ab-45a4931643f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:05.237198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c2f96bc6-ef9d-4c9c-94ab-45a4931643f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:05.284278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84715e4-d3b1-40db-828e-532dd806f72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:05.285450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84715e4-d3b1-40db-828e-532dd806f72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:05.285734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84715e4-d3b1-40db-828e-532dd806f72f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:05.286379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84715e4-d3b1-40db-828e-532dd806f72f admin admin] PATH_INFO: `/v3/users/bc5647735dd74bfd90864910f7bcd71e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:05.287310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84715e4-d3b1-40db-828e-532dd806f72f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc5647735dd74bfd90864910f7bcd71e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:05.289248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84715e4-d3b1-40db-828e-532dd806f72f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:05.344808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f96bc6-ef9d-4c9c-94ab-45a4931643f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:05.346641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f96bc6-ef9d-4c9c-94ab-45a4931643f9 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:05.418251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:05.430932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d84715e4-d3b1-40db-828e-532dd806f72f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc5647735dd74bfd90864910f7bcd71e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:05.433855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d84715e4-d3b1-40db-828e-532dd806f72f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc5647735dd74bfd90864910f7bcd71e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:05.437424 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2188/4393] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:37:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:37:05.477819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d84715e4-d3b1-40db-828e-532dd806f72f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc5647735dd74bfd90864910f7bcd71e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:05.503798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d84715e4-d3b1-40db-828e-532dd806f72f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc5647735dd74bfd90864910f7bcd71e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:05.543728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d84715e4-d3b1-40db-828e-532dd806f72f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc5647735dd74bfd90864910f7bcd71e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:05.569248 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2206/4394] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:37:04 2022] DELETE /identity/v3/users/bc5647735dd74bfd90864910f7bcd71e => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:37:06.959141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f96bc6-ef9d-4c9c-94ab-45a4931643f9 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:06.960745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c2f96bc6-ef9d-4c9c-94ab-45a4931643f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:06.987453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f96bc6-ef9d-4c9c-94ab-45a4931643f9 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:07.166996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:07.167731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:07.168016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:07.168301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e admin admin] PATH_INFO: `/v3/projects/c0bf1fdd2d704b0a95b0dcd583ea5908` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:07.170507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0bf1fdd2d704b0a95b0dcd583ea5908)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:07.172515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:07.274310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0bf1fdd2d704b0a95b0dcd583ea5908', 'request_id': 'req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:07.290355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0bf1fdd2d704b0a95b0dcd583ea5908', 'request_id': 'req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:07.305762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0bf1fdd2d704b0a95b0dcd583ea5908', 'request_id': 'req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:07.331025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e admin admin] The token cache is being invalidate because project c0bf1fdd2d704b0a95b0dcd583ea5908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:37:07.331357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:07.335875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:07.337448 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2189/4395] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:37:06 2022] DELETE /identity/v3/projects/c0bf1fdd2d704b0a95b0dcd583ea5908 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:37:07.929942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf18dd2-5673-4dd2-a467-2c4f3b7be0e3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:07.931134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf18dd2-5673-4dd2-a467-2c4f3b7be0e3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:07.931834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf18dd2-5673-4dd2-a467-2c4f3b7be0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:07.976800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1bf18dd2-5673-4dd2-a467-2c4f3b7be0e3 None None] MFA Rules not processed for user `aa196ab32caf4d6dbe169aa43484c2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:07.978617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1bf18dd2-5673-4dd2-a467-2c4f3b7be0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:08.159879 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2207/4396] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:37:07 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:37:08.172238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:08.173858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:08.405780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbb8ca-a266-4d9f-ae30-6ea7da49f42e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:08.433253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757e78c-29da-4fb8-92f5-ebfa627b86e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:08.433905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757e78c-29da-4fb8-92f5-ebfa627b86e3 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:08.434190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757e78c-29da-4fb8-92f5-ebfa627b86e3 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:08.434457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757e78c-29da-4fb8-92f5-ebfa627b86e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:08.470029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757e78c-29da-4fb8-92f5-ebfa627b86e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:08.472277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757e78c-29da-4fb8-92f5-ebfa627b86e3 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:08.494233 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2190/4397] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:37:08 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:37:08.962082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf18dd2-5673-4dd2-a467-2c4f3b7be0e3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:08.964575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1bf18dd2-5673-4dd2-a467-2c4f3b7be0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:09.058645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:09.181994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf18dd2-5673-4dd2-a467-2c4f3b7be0e3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:09.196941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d369bd5-401a-4eca-813d-cc0d081a19bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:09.197585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369bd5-401a-4eca-813d-cc0d081a19bd service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:09.197862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369bd5-401a-4eca-813d-cc0d081a19bd service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:09.198348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369bd5-401a-4eca-813d-cc0d081a19bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:09.200490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6d369bd5-401a-4eca-813d-cc0d081a19bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:09.225924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d369bd5-401a-4eca-813d-cc0d081a19bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:09.227745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d369bd5-401a-4eca-813d-cc0d081a19bd service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:09.265086 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2208/4398] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:37:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:37:11.481136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757e78c-29da-4fb8-92f5-ebfa627b86e3 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:11.496019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757e78c-29da-4fb8-92f5-ebfa627b86e3 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:11.516026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9c6f2-66ce-4726-96aa-7fabc0bf378c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:11.516653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9c6f2-66ce-4726-96aa-7fabc0bf378c service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:11.517022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9c6f2-66ce-4726-96aa-7fabc0bf378c service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:11.517220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9c6f2-66ce-4726-96aa-7fabc0bf378c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:11.519071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0fb9c6f2-66ce-4726-96aa-7fabc0bf378c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:11.556310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9c6f2-66ce-4726-96aa-7fabc0bf378c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:11.558866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9c6f2-66ce-4726-96aa-7fabc0bf378c service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:11.577828 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2191/4399] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:37:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:37:11.578118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:15.899193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c2ea0-fbb0-4296-9cea-726b5d986eec None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:15.900053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c2ea0-fbb0-4296-9cea-726b5d986eec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:15.900331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c2ea0-fbb0-4296-9cea-726b5d986eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:15.939665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c96c2ea0-fbb0-4296-9cea-726b5d986eec None None] MFA Rules not processed for user `3071859e8d09432cb329669826287496`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:15.941930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c96c2ea0-fbb0-4296-9cea-726b5d986eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:16.092195 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2209/4400] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:37:15 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:37:16.106753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9c6f2-66ce-4726-96aa-7fabc0bf378c service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:16.108849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0fb9c6f2-66ce-4726-96aa-7fabc0bf378c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:16.228064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9c6f2-66ce-4726-96aa-7fabc0bf378c service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:16.234235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0268a3-2c0b-4299-b182-929bbef88de4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:16.235059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0268a3-2c0b-4299-b182-929bbef88de4 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:16.235500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0268a3-2c0b-4299-b182-929bbef88de4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:16.235904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0268a3-2c0b-4299-b182-929bbef88de4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:16.240660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d0268a3-2c0b-4299-b182-929bbef88de4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:16.369851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0268a3-2c0b-4299-b182-929bbef88de4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:16.374442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0268a3-2c0b-4299-b182-929bbef88de4 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:16.438294 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2192/4401] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:37:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:37:24.354959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b186c79-589e-4fbe-ad46-f92edd0f6bcb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:24.355530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b186c79-589e-4fbe-ad46-f92edd0f6bcb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:24.355624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b186c79-589e-4fbe-ad46-f92edd0f6bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:24.406274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8b186c79-589e-4fbe-ad46-f92edd0f6bcb None None] MFA Rules not processed for user `e57aca8c1b5847f999daeb74a982f4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:24.428055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8b186c79-589e-4fbe-ad46-f92edd0f6bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:24.618613 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2210/4402] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:37:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:37:26.057973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0268a3-2c0b-4299-b182-929bbef88de4 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:26.059474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d0268a3-2c0b-4299-b182-929bbef88de4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:26.263855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0268a3-2c0b-4299-b182-929bbef88de4 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:26.270900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcd2b7-ba3e-4853-a6d0-50c097c46370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:26.271911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcd2b7-ba3e-4853-a6d0-50c097c46370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:26.272321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcd2b7-ba3e-4853-a6d0-50c097c46370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:26.272809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcd2b7-ba3e-4853-a6d0-50c097c46370 admin admin] PATH_INFO: `/v3/users/aa196ab32caf4d6dbe169aa43484c2ec` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:26.274865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcd2b7-ba3e-4853-a6d0-50c097c46370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa196ab32caf4d6dbe169aa43484c2ec)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:26.277289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcd2b7-ba3e-4853-a6d0-50c097c46370 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:26.356978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:26.374939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-affcd2b7-ba3e-4853-a6d0-50c097c46370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa196ab32caf4d6dbe169aa43484c2ec'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:26.393280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-affcd2b7-ba3e-4853-a6d0-50c097c46370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa196ab32caf4d6dbe169aa43484c2ec'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:26.394811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-affcd2b7-ba3e-4853-a6d0-50c097c46370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa196ab32caf4d6dbe169aa43484c2ec'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:26.395555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-affcd2b7-ba3e-4853-a6d0-50c097c46370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa196ab32caf4d6dbe169aa43484c2ec'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:26.413551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-affcd2b7-ba3e-4853-a6d0-50c097c46370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa196ab32caf4d6dbe169aa43484c2ec'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:26.455086 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2193/4403] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:37:26 2022] DELETE /identity/v3/users/aa196ab32caf4d6dbe169aa43484c2ec => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:37:26.928134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b186c79-589e-4fbe-ad46-f92edd0f6bcb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:26.952657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b186c79-589e-4fbe-ad46-f92edd0f6bcb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:27.076508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:27.138101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d1c78-d81c-4ddf-b36d-3ea4808bd97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:27.138915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d1c78-d81c-4ddf-b36d-3ea4808bd97c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:27.140457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d1c78-d81c-4ddf-b36d-3ea4808bd97c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:27.140840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d1c78-d81c-4ddf-b36d-3ea4808bd97c admin admin] PATH_INFO: `/v3/projects/a164854fbbbe435882eb5ef6fd89b887` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:27.144069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d1c78-d81c-4ddf-b36d-3ea4808bd97c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a164854fbbbe435882eb5ef6fd89b887)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:27.151193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d1c78-d81c-4ddf-b36d-3ea4808bd97c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:27.283987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b8d1c78-d81c-4ddf-b36d-3ea4808bd97c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a164854fbbbe435882eb5ef6fd89b887', 'request_id': 'req-6b8d1c78-d81c-4ddf-b36d-3ea4808bd97c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:27.305202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b8d1c78-d81c-4ddf-b36d-3ea4808bd97c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a164854fbbbe435882eb5ef6fd89b887', 'request_id': 'req-6b8d1c78-d81c-4ddf-b36d-3ea4808bd97c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:27.333680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b8d1c78-d81c-4ddf-b36d-3ea4808bd97c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a164854fbbbe435882eb5ef6fd89b887', 'request_id': 'req-6b8d1c78-d81c-4ddf-b36d-3ea4808bd97c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:27.361901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b8d1c78-d81c-4ddf-b36d-3ea4808bd97c admin admin] The token cache is being invalidate because project a164854fbbbe435882eb5ef6fd89b887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:37:27.363132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b8d1c78-d81c-4ddf-b36d-3ea4808bd97c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:27.364246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b8d1c78-d81c-4ddf-b36d-3ea4808bd97c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:27.368899 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2211/4404] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:37:26 2022] DELETE /identity/v3/projects/a164854fbbbe435882eb5ef6fd89b887 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:37:27.376327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4e2a6-5da9-45bf-85ec-0c96ece652e8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:27.376785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4e2a6-5da9-45bf-85ec-0c96ece652e8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:27.376901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4e2a6-5da9-45bf-85ec-0c96ece652e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:27.516452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e3c4e2a6-5da9-45bf-85ec-0c96ece652e8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:27.521441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e3c4e2a6-5da9-45bf-85ec-0c96ece652e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:27.688830 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2194/4405] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:37:27.784720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc13c3-c38a-4558-b3cc-5217c4bda041 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:27.785247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc13c3-c38a-4558-b3cc-5217c4bda041 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:27.785534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc13c3-c38a-4558-b3cc-5217c4bda041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:27.829128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-02bc13c3-c38a-4558-b3cc-5217c4bda041 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:27.833390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-02bc13c3-c38a-4558-b3cc-5217c4bda041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:27.864913 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2212/4406] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:37:27.866161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4e2a6-5da9-45bf-85ec-0c96ece652e8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:27.882080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4e2a6-5da9-45bf-85ec-0c96ece652e8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:27.910540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ea186-915b-4c09-aa48-de0270bda312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:27.911221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea186-915b-4c09-aa48-de0270bda312 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:27.911567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea186-915b-4c09-aa48-de0270bda312 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:27.911841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea186-915b-4c09-aa48-de0270bda312 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:27.912568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ea186-915b-4c09-aa48-de0270bda312 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:27.912877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ea186-915b-4c09-aa48-de0270bda312 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:27.914575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ea186-915b-4c09-aa48-de0270bda312 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:27.937215 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2195/4407] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:27.941203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc13c3-c38a-4558-b3cc-5217c4bda041 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:27.954306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc13c3-c38a-4558-b3cc-5217c4bda041 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:27.967642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccce17-82e5-4325-8f23-b3d40138843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:27.968230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccce17-82e5-4325-8f23-b3d40138843a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:27.969828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccce17-82e5-4325-8f23-b3d40138843a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:27.970194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccce17-82e5-4325-8f23-b3d40138843a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:27.972485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccce17-82e5-4325-8f23-b3d40138843a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:27.974775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccce17-82e5-4325-8f23-b3d40138843a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:28.020293 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2213/4408] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:37:27 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:37:28.023375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ea186-915b-4c09-aa48-de0270bda312 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:28.039088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ea186-915b-4c09-aa48-de0270bda312 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:28.197685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f4297-169f-49ac-b5e6-9e8575cee2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:28.198347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f4297-169f-49ac-b5e6-9e8575cee2ed admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:28.198616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f4297-169f-49ac-b5e6-9e8575cee2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:28.198986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f4297-169f-49ac-b5e6-9e8575cee2ed admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:28.199605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f4297-169f-49ac-b5e6-9e8575cee2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:28.202100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f4297-169f-49ac-b5e6-9e8575cee2ed admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:28.298808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:28.327312 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2196/4409] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:37:28 2022] POST /identity/v3/users => generated 291 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:37:28.331326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccce17-82e5-4325-8f23-b3d40138843a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:28.352766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccce17-82e5-4325-8f23-b3d40138843a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:28.369634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88148d93-2437-4509-90fc-1e161c0e9f3a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:28.369759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88148d93-2437-4509-90fc-1e161c0e9f3a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:28.370123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88148d93-2437-4509-90fc-1e161c0e9f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:28.385307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5e2dc-5a4e-4769-90b5-ee72a843a301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:28.386125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5e2dc-5a4e-4769-90b5-ee72a843a301 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:28.398669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5e2dc-5a4e-4769-90b5-ee72a843a301 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:28.399616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5e2dc-5a4e-4769-90b5-ee72a843a301 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:28.400488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5e2dc-5a4e-4769-90b5-ee72a843a301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:28.402763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5e2dc-5a4e-4769-90b5-ee72a843a301 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:28.419953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-88148d93-2437-4509-90fc-1e161c0e9f3a None None] MFA Rules not processed for user `f2d62e73e5024dde96d48cdd0e375d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:28.422151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-88148d93-2437-4509-90fc-1e161c0e9f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:28.436071 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2214/4410] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:37:28.437039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5e2dc-5a4e-4769-90b5-ee72a843a301 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:28.467109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5e2dc-5a4e-4769-90b5-ee72a843a301 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:28.481136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78250d83-10e8-4f67-b069-a923913c2ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:28.482045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78250d83-10e8-4f67-b069-a923913c2ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:28.482045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78250d83-10e8-4f67-b069-a923913c2ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:28.482408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78250d83-10e8-4f67-b069-a923913c2ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:28.483119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78250d83-10e8-4f67-b069-a923913c2ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:28.487188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78250d83-10e8-4f67-b069-a923913c2ba8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:28.523649 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2215/4411] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:37:28.525523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78250d83-10e8-4f67-b069-a923913c2ba8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:28.544375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78250d83-10e8-4f67-b069-a923913c2ba8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:28.555496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3a8b0-3ab5-47c0-be6a-c3235b4e1b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:28.556133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3a8b0-3ab5-47c0-be6a-c3235b4e1b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:28.556624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3a8b0-3ab5-47c0-be6a-c3235b4e1b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:28.556902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3a8b0-3ab5-47c0-be6a-c3235b4e1b51 admin admin] PATH_INFO: `/v3/projects/8a649339fa5c47a1979fc39073e0e6bc/users/ab9fb317498947bca059461d8211b6b8/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:28.570207 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2197/4412] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:37:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:37:28.597538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3a8b0-3ab5-47c0-be6a-c3235b4e1b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a649339fa5c47a1979fc39073e0e6bc, user_id=ab9fb317498947bca059461d8211b6b8, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:28.600996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3a8b0-3ab5-47c0-be6a-c3235b4e1b51 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:28.602844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88148d93-2437-4509-90fc-1e161c0e9f3a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:28.611992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-88148d93-2437-4509-90fc-1e161c0e9f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:28.649418 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2216/4413] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:37:28 2022] PUT /identity/v3/projects/8a649339fa5c47a1979fc39073e0e6bc/users/ab9fb317498947bca059461d8211b6b8/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:37:28.650985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a340-3869-45e7-8cb0-57973275a63c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:28.651293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a340-3869-45e7-8cb0-57973275a63c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:28.651591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a340-3869-45e7-8cb0-57973275a63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:28.685646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0145a340-3869-45e7-8cb0-57973275a63c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:28.687621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0145a340-3869-45e7-8cb0-57973275a63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:28.750236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:28.760798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88148d93-2437-4509-90fc-1e161c0e9f3a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:28.785945 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2217/4414] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:37:28.800939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145a340-3869-45e7-8cb0-57973275a63c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:28.852895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bb811-23e7-4158-81ad-bb1acd0792d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:28.861360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bb811-23e7-4158-81ad-bb1acd0792d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:28.863839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bb811-23e7-4158-81ad-bb1acd0792d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:28.864413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bb811-23e7-4158-81ad-bb1acd0792d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:28.869361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-249bb811-23e7-4158-81ad-bb1acd0792d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:28.908928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bb811-23e7-4158-81ad-bb1acd0792d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:28.913856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bb811-23e7-4158-81ad-bb1acd0792d3 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:28.926358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145a340-3869-45e7-8cb0-57973275a63c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:28.942049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ab927-aeeb-43c9-92b8-9d6cd980663c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:28.942871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ab927-aeeb-43c9-92b8-9d6cd980663c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:28.945940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ab927-aeeb-43c9-92b8-9d6cd980663c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:28.946216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ab927-aeeb-43c9-92b8-9d6cd980663c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:28.954598 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2198/4415] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:37:28.983859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ab927-aeeb-43c9-92b8-9d6cd980663c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:28.988209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ab927-aeeb-43c9-92b8-9d6cd980663c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:29.013479 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2218/4416] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:37:29.362554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bb811-23e7-4158-81ad-bb1acd0792d3 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:29.364550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-249bb811-23e7-4158-81ad-bb1acd0792d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:29.389632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bb811-23e7-4158-81ad-bb1acd0792d3 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:29.403041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318ceff-3700-4d42-bec4-9c22047c8b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:29.403742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318ceff-3700-4d42-bec4-9c22047c8b9c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:29.406108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318ceff-3700-4d42-bec4-9c22047c8b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:29.407101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318ceff-3700-4d42-bec4-9c22047c8b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:29.415560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b318ceff-3700-4d42-bec4-9c22047c8b9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:29.445205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318ceff-3700-4d42-bec4-9c22047c8b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:29.451074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318ceff-3700-4d42-bec4-9c22047c8b9c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:29.476415 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2199/4417] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:37:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:37:35.476790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ab927-aeeb-43c9-92b8-9d6cd980663c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:35.482158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ae9ab927-aeeb-43c9-92b8-9d6cd980663c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:35.530787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ab927-aeeb-43c9-92b8-9d6cd980663c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:35.539059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a741671-4e38-4053-99e5-fb14da108a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:35.540767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741671-4e38-4053-99e5-fb14da108a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:35.541686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741671-4e38-4053-99e5-fb14da108a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:35.542378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741671-4e38-4053-99e5-fb14da108a8e admin admin] PATH_INFO: `/v3/users/dbf15e3294dc4450835847a05ad0ee7b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:35.544870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a741671-4e38-4053-99e5-fb14da108a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf15e3294dc4450835847a05ad0ee7b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:35.549351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a741671-4e38-4053-99e5-fb14da108a8e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:35.663828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8a741671-4e38-4053-99e5-fb14da108a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf15e3294dc4450835847a05ad0ee7b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:35.664606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8a741671-4e38-4053-99e5-fb14da108a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf15e3294dc4450835847a05ad0ee7b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:35.674757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8a741671-4e38-4053-99e5-fb14da108a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf15e3294dc4450835847a05ad0ee7b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:35.713115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8a741671-4e38-4053-99e5-fb14da108a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf15e3294dc4450835847a05ad0ee7b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:35.737548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8a741671-4e38-4053-99e5-fb14da108a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf15e3294dc4450835847a05ad0ee7b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:35.752068 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2219/4418] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:37:35 2022] DELETE /identity/v3/users/dbf15e3294dc4450835847a05ad0ee7b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:37:36.195880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318ceff-3700-4d42-bec4-9c22047c8b9c service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:36.218443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318ceff-3700-4d42-bec4-9c22047c8b9c service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:36.299853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:36.319564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec88fc2-cd35-4546-8fd8-355f03357747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:36.320630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec88fc2-cd35-4546-8fd8-355f03357747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:36.322530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec88fc2-cd35-4546-8fd8-355f03357747 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:36.323107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec88fc2-cd35-4546-8fd8-355f03357747 admin admin] PATH_INFO: `/v3/projects/8f01489a0dad4f68b3ac28585ded94e7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:36.324402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec88fc2-cd35-4546-8fd8-355f03357747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f01489a0dad4f68b3ac28585ded94e7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:36.326414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec88fc2-cd35-4546-8fd8-355f03357747 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:36.405395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dec88fc2-cd35-4546-8fd8-355f03357747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f01489a0dad4f68b3ac28585ded94e7', 'request_id': 'req-dec88fc2-cd35-4546-8fd8-355f03357747'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:36.414925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dec88fc2-cd35-4546-8fd8-355f03357747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f01489a0dad4f68b3ac28585ded94e7', 'request_id': 'req-dec88fc2-cd35-4546-8fd8-355f03357747'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:36.422366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dec88fc2-cd35-4546-8fd8-355f03357747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f01489a0dad4f68b3ac28585ded94e7', 'request_id': 'req-dec88fc2-cd35-4546-8fd8-355f03357747'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:36.441036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dec88fc2-cd35-4546-8fd8-355f03357747 admin admin] The token cache is being invalidate because project 8f01489a0dad4f68b3ac28585ded94e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:37:36.441624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dec88fc2-cd35-4546-8fd8-355f03357747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:36.442521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dec88fc2-cd35-4546-8fd8-355f03357747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:37:36.445165 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2200/4419] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:37:36 2022] DELETE /identity/v3/projects/8f01489a0dad4f68b3ac28585ded94e7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:37:36.451111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338fb76-6ef6-41d5-8a80-f4855645a05f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:36.451472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338fb76-6ef6-41d5-8a80-f4855645a05f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:36.451999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338fb76-6ef6-41d5-8a80-f4855645a05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:36.484620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e338fb76-6ef6-41d5-8a80-f4855645a05f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:36.487952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e338fb76-6ef6-41d5-8a80-f4855645a05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:36.599005 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2220/4420] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:37:36.607899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e7000-ac76-4720-a67c-5fbe2e810556 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:36.608186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e7000-ac76-4720-a67c-5fbe2e810556 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:36.608459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e7000-ac76-4720-a67c-5fbe2e810556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:36.639805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-520e7000-ac76-4720-a67c-5fbe2e810556 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:36.642275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-520e7000-ac76-4720-a67c-5fbe2e810556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:36.651697 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2201/4421] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:37:36.656056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338fb76-6ef6-41d5-8a80-f4855645a05f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:36.668595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:36.673118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338fb76-6ef6-41d5-8a80-f4855645a05f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:36.681957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19c7a7-27a8-4588-9f90-8a6091cc4fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:36.682360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19c7a7-27a8-4588-9f90-8a6091cc4fcb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:36.682739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19c7a7-27a8-4588-9f90-8a6091cc4fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:36.683025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19c7a7-27a8-4588-9f90-8a6091cc4fcb admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:36.683761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19c7a7-27a8-4588-9f90-8a6091cc4fcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:36.684715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19c7a7-27a8-4588-9f90-8a6091cc4fcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:36.689460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19c7a7-27a8-4588-9f90-8a6091cc4fcb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:36.703472 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2221/4422] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:36.707968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e7000-ac76-4720-a67c-5fbe2e810556 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:36.719794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e7000-ac76-4720-a67c-5fbe2e810556 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:36.729509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd5002-c99b-4689-8a06-851ca422eeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:36.730110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd5002-c99b-4689-8a06-851ca422eeca admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:36.730390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd5002-c99b-4689-8a06-851ca422eeca admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:36.730661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd5002-c99b-4689-8a06-851ca422eeca admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:36.731361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd5002-c99b-4689-8a06-851ca422eeca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:36.734902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd5002-c99b-4689-8a06-851ca422eeca admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:36.777845 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2202/4423] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:37:36 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:37:36.779451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19c7a7-27a8-4588-9f90-8a6091cc4fcb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:36.800452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19c7a7-27a8-4588-9f90-8a6091cc4fcb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:36.941522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43a9f8-7f4d-481b-9f49-865c40cae4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:36.942756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43a9f8-7f4d-481b-9f49-865c40cae4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:36.943171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43a9f8-7f4d-481b-9f49-865c40cae4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:36.943669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43a9f8-7f4d-481b-9f49-865c40cae4e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:36.944476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43a9f8-7f4d-481b-9f49-865c40cae4e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:36.946748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43a9f8-7f4d-481b-9f49-865c40cae4e4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:37.000785 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2222/4424] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:37:36 2022] POST /identity/v3/users => generated 283 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:37:37.004628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd5002-c99b-4689-8a06-851ca422eeca admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:37.019559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd5002-c99b-4689-8a06-851ca422eeca admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:37.038274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2cc2d-37dd-4182-a84f-aa20243441ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:37.040220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2cc2d-37dd-4182-a84f-aa20243441ec admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:37.040867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2cc2d-37dd-4182-a84f-aa20243441ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:37.040981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2cc2d-37dd-4182-a84f-aa20243441ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:37.041828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2cc2d-37dd-4182-a84f-aa20243441ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:37.043741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2cc2d-37dd-4182-a84f-aa20243441ec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:37.066391 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2203/4425] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:37:37.068403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43a9f8-7f4d-481b-9f49-865c40cae4e4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:37.084010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43a9f8-7f4d-481b-9f49-865c40cae4e4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:37.096607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e2560-84ac-4b1f-9f90-d4379c9b39d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:37.098116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e2560-84ac-4b1f-9f90-d4379c9b39d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:37.099678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e2560-84ac-4b1f-9f90-d4379c9b39d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:37.100053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e2560-84ac-4b1f-9f90-d4379c9b39d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:37.100793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e2560-84ac-4b1f-9f90-d4379c9b39d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:37.107390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e2560-84ac-4b1f-9f90-d4379c9b39d9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:37.133989 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2223/4426] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:37:37.136481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2cc2d-37dd-4182-a84f-aa20243441ec admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:37.149176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2cc2d-37dd-4182-a84f-aa20243441ec admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:37.164147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e1ebe-3243-48fa-9b80-8ae9ea2e2d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:37.166222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e1ebe-3243-48fa-9b80-8ae9ea2e2d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:37.166611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e1ebe-3243-48fa-9b80-8ae9ea2e2d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:37.168367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e1ebe-3243-48fa-9b80-8ae9ea2e2d88 admin admin] PATH_INFO: `/v3/projects/9ed24d914d5f4de6a0dcc6bf8879ec9b/users/f4d6cc3c7df440e3af0de7afd42df29c/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:37.209451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e1ebe-3243-48fa-9b80-8ae9ea2e2d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed24d914d5f4de6a0dcc6bf8879ec9b, user_id=f4d6cc3c7df440e3af0de7afd42df29c, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:37.217234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e1ebe-3243-48fa-9b80-8ae9ea2e2d88 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:37.247992 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2204/4427] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:37:37 2022] PUT /identity/v3/projects/9ed24d914d5f4de6a0dcc6bf8879ec9b/users/f4d6cc3c7df440e3af0de7afd42df29c/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:37:37.260043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbebfb9-4613-48d1-a2ca-38edaa75ffeb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:37.264800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbebfb9-4613-48d1-a2ca-38edaa75ffeb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:37.265422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbebfb9-4613-48d1-a2ca-38edaa75ffeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:37.318803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bbbebfb9-4613-48d1-a2ca-38edaa75ffeb None None] MFA Rules not processed for user `f4d6cc3c7df440e3af0de7afd42df29c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:37.320236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bbbebfb9-4613-48d1-a2ca-38edaa75ffeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:37.458764 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2224/4428] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:37:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:37:37.470636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e1ebe-3243-48fa-9b80-8ae9ea2e2d88 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:37.472960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fb8e1ebe-3243-48fa-9b80-8ae9ea2e2d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:37.640638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e1ebe-3243-48fa-9b80-8ae9ea2e2d88 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:37.656087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26751362-8812-4e0e-a3a2-34de41544658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:37.656998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26751362-8812-4e0e-a3a2-34de41544658 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:37.657414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26751362-8812-4e0e-a3a2-34de41544658 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:37.657822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26751362-8812-4e0e-a3a2-34de41544658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:37.679516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26751362-8812-4e0e-a3a2-34de41544658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:37.681663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26751362-8812-4e0e-a3a2-34de41544658 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:37.704082 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2205/4429] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:37:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:37:39.784697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f49fc-a822-41fc-b593-3c632c00b934 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:39.785165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f49fc-a822-41fc-b593-3c632c00b934 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:39.785588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f49fc-a822-41fc-b593-3c632c00b934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:39.840876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-de6f49fc-a822-41fc-b593-3c632c00b934 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:39.843486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-de6f49fc-a822-41fc-b593-3c632c00b934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:39.955044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:40.008408 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2225/4430] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:37:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:37:40.094026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26751362-8812-4e0e-a3a2-34de41544658 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:40.095848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-26751362-8812-4e0e-a3a2-34de41544658 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:40.139999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:40.186321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee9c80-8c5c-4b45-b03f-ac389dd4187c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:40.186623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee9c80-8c5c-4b45-b03f-ac389dd4187c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:40.186906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee9c80-8c5c-4b45-b03f-ac389dd4187c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:40.259842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2fee9c80-8c5c-4b45-b03f-ac389dd4187c None None] MFA Rules not processed for user `ab9fb317498947bca059461d8211b6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:40.262524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2fee9c80-8c5c-4b45-b03f-ac389dd4187c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:40.299790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26751362-8812-4e0e-a3a2-34de41544658 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:40.315923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d224b3-5056-4dc3-818f-30801d097d27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:40.317107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d224b3-5056-4dc3-818f-30801d097d27 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:40.317401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d224b3-5056-4dc3-818f-30801d097d27 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:40.317759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d224b3-5056-4dc3-818f-30801d097d27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:40.331468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d224b3-5056-4dc3-818f-30801d097d27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:40.333471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d224b3-5056-4dc3-818f-30801d097d27 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:40.348476 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2206/4431] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:37:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:37:40.447155 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2226/4432] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:37:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:37:40.466647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b7afc-f1e2-4fc5-aefc-c8239b9c17aa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:40.471433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b7afc-f1e2-4fc5-aefc-c8239b9c17aa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:40.471696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b7afc-f1e2-4fc5-aefc-c8239b9c17aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:40.526711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c61b7afc-f1e2-4fc5-aefc-c8239b9c17aa None None] MFA Rules not processed for user `ab9fb317498947bca059461d8211b6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:40.528164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c61b7afc-f1e2-4fc5-aefc-c8239b9c17aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:40.544277 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2207/4433] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:37:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:37:40.556639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee9c80-8c5c-4b45-b03f-ac389dd4187c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:40.558933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2fee9c80-8c5c-4b45-b03f-ac389dd4187c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:40.814548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee9c80-8c5c-4b45-b03f-ac389dd4187c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:40.825304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06201aa6-704b-425d-ae46-db56625072db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:40.826000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06201aa6-704b-425d-ae46-db56625072db service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:40.826309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06201aa6-704b-425d-ae46-db56625072db service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:40.826630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06201aa6-704b-425d-ae46-db56625072db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:40.852568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06201aa6-704b-425d-ae46-db56625072db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:40.854230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06201aa6-704b-425d-ae46-db56625072db service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:40.868258 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2227/4434] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:37:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:37:47.753601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e5815-6ed7-4176-b1d0-5e23f8de438c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:47.754822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e5815-6ed7-4176-b1d0-5e23f8de438c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:47.755345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e5815-6ed7-4176-b1d0-5e23f8de438c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:47.779368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-884e5815-6ed7-4176-b1d0-5e23f8de438c None None] MFA Rules not processed for user `e57aca8c1b5847f999daeb74a982f4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:47.780955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-884e5815-6ed7-4176-b1d0-5e23f8de438c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:47.904209 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2208/4435] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:37:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:37:50.859963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=76 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:57.869063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=51 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:03.969773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06201aa6-704b-425d-ae46-db56625072db service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:04.099711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06201aa6-704b-425d-ae46-db56625072db service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:04.110937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a5fe4-a9c5-48b2-beee-4cf69ba4501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:04.111876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a5fe4-a9c5-48b2-beee-4cf69ba4501a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:04.112257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a5fe4-a9c5-48b2-beee-4cf69ba4501a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:04.112675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a5fe4-a9c5-48b2-beee-4cf69ba4501a admin admin] PATH_INFO: `/v3/users/f4d6cc3c7df440e3af0de7afd42df29c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:04.114162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a5fe4-a9c5-48b2-beee-4cf69ba4501a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d6cc3c7df440e3af0de7afd42df29c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:04.117062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a5fe4-a9c5-48b2-beee-4cf69ba4501a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:04.213725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a5a5fe4-a9c5-48b2-beee-4cf69ba4501a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d6cc3c7df440e3af0de7afd42df29c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:04.214315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a5a5fe4-a9c5-48b2-beee-4cf69ba4501a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d6cc3c7df440e3af0de7afd42df29c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:04.222629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a5a5fe4-a9c5-48b2-beee-4cf69ba4501a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d6cc3c7df440e3af0de7afd42df29c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:04.233581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a5a5fe4-a9c5-48b2-beee-4cf69ba4501a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d6cc3c7df440e3af0de7afd42df29c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:04.249568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a5a5fe4-a9c5-48b2-beee-4cf69ba4501a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d6cc3c7df440e3af0de7afd42df29c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:04.260839 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2228/4436] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:03 2022] DELETE /identity/v3/users/f4d6cc3c7df440e3af0de7afd42df29c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:04.262603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82c3da-fd0c-44d5-bf20-e305670b3e12 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:04.263085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82c3da-fd0c-44d5-bf20-e305670b3e12 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:04.263160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82c3da-fd0c-44d5-bf20-e305670b3e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:04.294925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ec82c3da-fd0c-44d5-bf20-e305670b3e12 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:04.297372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ec82c3da-fd0c-44d5-bf20-e305670b3e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:04.412169 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2209/4437] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:04.417938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a5fe4-a9c5-48b2-beee-4cf69ba4501a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:04.419822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9a5a5fe4-a9c5-48b2-beee-4cf69ba4501a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:04.548670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a5fe4-a9c5-48b2-beee-4cf69ba4501a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:04.561977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48825bd-f447-4f91-8e47-ed5e676f0b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:04.562775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48825bd-f447-4f91-8e47-ed5e676f0b99 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:04.563520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48825bd-f447-4f91-8e47-ed5e676f0b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:04.563520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48825bd-f447-4f91-8e47-ed5e676f0b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:04.582421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48825bd-f447-4f91-8e47-ed5e676f0b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:04.583954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48825bd-f447-4f91-8e47-ed5e676f0b99 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:04.597256 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2229/4438] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:04.776473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecc182-818f-4e4d-98ca-344aeb1c83e4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:04.776823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecc182-818f-4e4d-98ca-344aeb1c83e4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:04.777194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecc182-818f-4e4d-98ca-344aeb1c83e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:04.801585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2cecc182-818f-4e4d-98ca-344aeb1c83e4 None None] MFA Rules not processed for user `cddcb537be124c17a52951eed7a61305`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:04.803284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2cecc182-818f-4e4d-98ca-344aeb1c83e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:04.880069 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2210/4439] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:04.969388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744c0a-edb1-4518-8e85-fe2b5209545a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:04.969675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744c0a-edb1-4518-8e85-fe2b5209545a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:04.969951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744c0a-edb1-4518-8e85-fe2b5209545a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:04.990303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-65744c0a-edb1-4518-8e85-fe2b5209545a None None] MFA Rules not processed for user `cddcb537be124c17a52951eed7a61305`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:04.991641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-65744c0a-edb1-4518-8e85-fe2b5209545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:05.014307 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2230/4440] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:05.319175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecc182-818f-4e4d-98ca-344aeb1c83e4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:05.322595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2cecc182-818f-4e4d-98ca-344aeb1c83e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:05.347645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecc182-818f-4e4d-98ca-344aeb1c83e4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:05.355462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a20c2-90e1-4d22-915b-1c89ed22868b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:05.356442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a20c2-90e1-4d22-915b-1c89ed22868b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:05.356775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a20c2-90e1-4d22-915b-1c89ed22868b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:05.357108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a20c2-90e1-4d22-915b-1c89ed22868b admin admin] PATH_INFO: `/v3/projects/9ed24d914d5f4de6a0dcc6bf8879ec9b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:05.359054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a20c2-90e1-4d22-915b-1c89ed22868b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ed24d914d5f4de6a0dcc6bf8879ec9b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:05.362164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a20c2-90e1-4d22-915b-1c89ed22868b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:05.433306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cb0a20c2-90e1-4d22-915b-1c89ed22868b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ed24d914d5f4de6a0dcc6bf8879ec9b', 'request_id': 'req-cb0a20c2-90e1-4d22-915b-1c89ed22868b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:05.445244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cb0a20c2-90e1-4d22-915b-1c89ed22868b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ed24d914d5f4de6a0dcc6bf8879ec9b', 'request_id': 'req-cb0a20c2-90e1-4d22-915b-1c89ed22868b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:05.455863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cb0a20c2-90e1-4d22-915b-1c89ed22868b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ed24d914d5f4de6a0dcc6bf8879ec9b', 'request_id': 'req-cb0a20c2-90e1-4d22-915b-1c89ed22868b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:05.479329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cb0a20c2-90e1-4d22-915b-1c89ed22868b admin admin] The token cache is being invalidate because project 9ed24d914d5f4de6a0dcc6bf8879ec9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:05.479699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cb0a20c2-90e1-4d22-915b-1c89ed22868b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:05.480392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cb0a20c2-90e1-4d22-915b-1c89ed22868b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:05.485671 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2211/4441] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:05 2022] DELETE /identity/v3/projects/9ed24d914d5f4de6a0dcc6bf8879ec9b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:05.489309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ad6fb-4cef-4adf-811b-c9e0bc7d3066 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:05.490119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ad6fb-4cef-4adf-811b-c9e0bc7d3066 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:05.490874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ad6fb-4cef-4adf-811b-c9e0bc7d3066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:05.515502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0c3ad6fb-4cef-4adf-811b-c9e0bc7d3066 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:05.517020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0c3ad6fb-4cef-4adf-811b-c9e0bc7d3066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:05.530364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:05.607476 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2231/4442] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:05.615407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821ff98-ebf2-479d-b5a9-3e078ebcb9b1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:05.615686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821ff98-ebf2-479d-b5a9-3e078ebcb9b1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:05.615893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821ff98-ebf2-479d-b5a9-3e078ebcb9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:05.635891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b821ff98-ebf2-479d-b5a9-3e078ebcb9b1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:05.637142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b821ff98-ebf2-479d-b5a9-3e078ebcb9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:05.645152 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2212/4443] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:05.649424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ad6fb-4cef-4adf-811b-c9e0bc7d3066 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:05.659418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ad6fb-4cef-4adf-811b-c9e0bc7d3066 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:05.665284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af07aab-29d7-4616-a059-4aedc8e5dcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:05.665899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af07aab-29d7-4616-a059-4aedc8e5dcea admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:05.666173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af07aab-29d7-4616-a059-4aedc8e5dcea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:05.666443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af07aab-29d7-4616-a059-4aedc8e5dcea admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:05.667156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af07aab-29d7-4616-a059-4aedc8e5dcea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:05.667447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af07aab-29d7-4616-a059-4aedc8e5dcea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:05.669106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af07aab-29d7-4616-a059-4aedc8e5dcea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:05.681844 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2232/4444] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:05.686333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821ff98-ebf2-479d-b5a9-3e078ebcb9b1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:05.695735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821ff98-ebf2-479d-b5a9-3e078ebcb9b1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:05.700611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea19aa-9273-4c02-b750-a8f6dc21cfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:05.701223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea19aa-9273-4c02-b750-a8f6dc21cfb9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:05.701501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea19aa-9273-4c02-b750-a8f6dc21cfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:05.701773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea19aa-9273-4c02-b750-a8f6dc21cfb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:05.702414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea19aa-9273-4c02-b750-a8f6dc21cfb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:05.704410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea19aa-9273-4c02-b750-a8f6dc21cfb9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:05.732034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:05.746025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af07aab-29d7-4616-a059-4aedc8e5dcea admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:05.757301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af07aab-29d7-4616-a059-4aedc8e5dcea admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:05.758250 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2213/4445] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:05 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:05.833867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed937e-ee11-43c9-9b1a-030dfee57bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:05.834514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed937e-ee11-43c9-9b1a-030dfee57bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:05.834769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed937e-ee11-43c9-9b1a-030dfee57bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:05.835044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed937e-ee11-43c9-9b1a-030dfee57bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:05.836130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed937e-ee11-43c9-9b1a-030dfee57bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:05.838362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed937e-ee11-43c9-9b1a-030dfee57bb6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:05.863167 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2233/4446] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:05 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:05.867620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea19aa-9273-4c02-b750-a8f6dc21cfb9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:05.891299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea19aa-9273-4c02-b750-a8f6dc21cfb9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:05.896452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f9dad-d359-409c-9d09-9336eadeea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:05.897217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f9dad-d359-409c-9d09-9336eadeea34 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:05.897582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f9dad-d359-409c-9d09-9336eadeea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:05.898128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f9dad-d359-409c-9d09-9336eadeea34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:05.898834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f9dad-d359-409c-9d09-9336eadeea34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:05.900951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f9dad-d359-409c-9d09-9336eadeea34 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:05.913158 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2214/4447] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:05.917360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed937e-ee11-43c9-9b1a-030dfee57bb6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:05.932408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed937e-ee11-43c9-9b1a-030dfee57bb6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:05.938019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad570b62-2959-4497-997f-0e8b028c07b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:05.938755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad570b62-2959-4497-997f-0e8b028c07b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:05.939101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad570b62-2959-4497-997f-0e8b028c07b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:05.939605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad570b62-2959-4497-997f-0e8b028c07b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:05.940487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad570b62-2959-4497-997f-0e8b028c07b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:05.942171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad570b62-2959-4497-997f-0e8b028c07b9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:05.959066 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2234/4448] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:05.959919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f9dad-d359-409c-9d09-9336eadeea34 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:05.970511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f9dad-d359-409c-9d09-9336eadeea34 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:05.987380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19b260-5192-478f-9220-8545468f1940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:05.988072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19b260-5192-478f-9220-8545468f1940 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:05.988356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19b260-5192-478f-9220-8545468f1940 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:05.988631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19b260-5192-478f-9220-8545468f1940 admin admin] PATH_INFO: `/v3/projects/278d8bf1a40b484fb0c4a21f0638928f/users/552f70af1bb5472691ca0d884866e37f/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:06.005077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19b260-5192-478f-9220-8545468f1940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=278d8bf1a40b484fb0c4a21f0638928f, user_id=552f70af1bb5472691ca0d884866e37f, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:06.007812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19b260-5192-478f-9220-8545468f1940 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:06.022053 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2215/4449] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:05 2022] PUT /identity/v3/projects/278d8bf1a40b484fb0c4a21f0638928f/users/552f70af1bb5472691ca0d884866e37f/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:06.032843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa44a64-eec4-4eb4-93bb-56a9e5a33e68 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:06.033335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa44a64-eec4-4eb4-93bb-56a9e5a33e68 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:06.033576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa44a64-eec4-4eb4-93bb-56a9e5a33e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:06.063885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6fa44a64-eec4-4eb4-93bb-56a9e5a33e68 None None] MFA Rules not processed for user `552f70af1bb5472691ca0d884866e37f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:06.065221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6fa44a64-eec4-4eb4-93bb-56a9e5a33e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:06.150280 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2235/4450] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:06.154718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19b260-5192-478f-9220-8545468f1940 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:06.224516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19b260-5192-478f-9220-8545468f1940 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:06.229682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a52547-759d-4484-8ae2-d72c9198c968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:06.230300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a52547-759d-4484-8ae2-d72c9198c968 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:06.230663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a52547-759d-4484-8ae2-d72c9198c968 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:06.231023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a52547-759d-4484-8ae2-d72c9198c968 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:06.231705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a52547-759d-4484-8ae2-d72c9198c968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:06.233630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a52547-759d-4484-8ae2-d72c9198c968 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:06.269519 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2216/4451] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:06 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:38:06.270699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa44a64-eec4-4eb4-93bb-56a9e5a33e68 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:06.284142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa44a64-eec4-4eb4-93bb-56a9e5a33e68 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:06.296800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:06.362936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67cbd6-370e-4d8c-85e9-dd2edf8b4c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:06.363706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67cbd6-370e-4d8c-85e9-dd2edf8b4c4b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:06.364059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67cbd6-370e-4d8c-85e9-dd2edf8b4c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:06.364783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67cbd6-370e-4d8c-85e9-dd2edf8b4c4b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:06.369350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67cbd6-370e-4d8c-85e9-dd2edf8b4c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:06.369350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67cbd6-370e-4d8c-85e9-dd2edf8b4c4b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:06.394594 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2236/4452] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:06 2022] POST /identity/v3/users => generated 298 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:38:06.399164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a52547-759d-4484-8ae2-d72c9198c968 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:06.412078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a52547-759d-4484-8ae2-d72c9198c968 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:06.422848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d08afc-9bb8-4319-93a6-82bedc31baf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:06.423612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d08afc-9bb8-4319-93a6-82bedc31baf0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:06.423997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d08afc-9bb8-4319-93a6-82bedc31baf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:06.424329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d08afc-9bb8-4319-93a6-82bedc31baf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:06.425182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d08afc-9bb8-4319-93a6-82bedc31baf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:06.426930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d08afc-9bb8-4319-93a6-82bedc31baf0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:06.439353 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2217/4453] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:06.444142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67cbd6-370e-4d8c-85e9-dd2edf8b4c4b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:06.458608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67cbd6-370e-4d8c-85e9-dd2edf8b4c4b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:06.467540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3552ba-7396-4686-9a64-6dbd6deade0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:06.468739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3552ba-7396-4686-9a64-6dbd6deade0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:06.469160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3552ba-7396-4686-9a64-6dbd6deade0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:06.469573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3552ba-7396-4686-9a64-6dbd6deade0b admin admin] PATH_INFO: `/v3/projects/ccfc70e88a3e4c3cb2663455c149b0b9/users/e23174bda30d4d2aba2e00b579e69068/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:06.495895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3552ba-7396-4686-9a64-6dbd6deade0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccfc70e88a3e4c3cb2663455c149b0b9, user_id=e23174bda30d4d2aba2e00b579e69068, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:06.498971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3552ba-7396-4686-9a64-6dbd6deade0b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:06.518984 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2237/4454] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:06 2022] PUT /identity/v3/projects/ccfc70e88a3e4c3cb2663455c149b0b9/users/e23174bda30d4d2aba2e00b579e69068/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:06.520321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d08afc-9bb8-4319-93a6-82bedc31baf0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:06.533112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d08afc-9bb8-4319-93a6-82bedc31baf0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:06.645358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c8a78-17cf-4952-8387-264ee68f7238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:06.645998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c8a78-17cf-4952-8387-264ee68f7238 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:06.646286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c8a78-17cf-4952-8387-264ee68f7238 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:06.646764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c8a78-17cf-4952-8387-264ee68f7238 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:06.647483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c8a78-17cf-4952-8387-264ee68f7238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:06.649203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c8a78-17cf-4952-8387-264ee68f7238 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:06.662111 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2218/4455] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:06.666130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3552ba-7396-4686-9a64-6dbd6deade0b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:06.680684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3552ba-7396-4686-9a64-6dbd6deade0b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:06.696394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aab66f-9b46-4c46-ac99-ee24e7a4e57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:06.697091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aab66f-9b46-4c46-ac99-ee24e7a4e57c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:06.697371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aab66f-9b46-4c46-ac99-ee24e7a4e57c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:06.697646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aab66f-9b46-4c46-ac99-ee24e7a4e57c admin admin] PATH_INFO: `/v3/projects/ccfc70e88a3e4c3cb2663455c149b0b9/users/e23174bda30d4d2aba2e00b579e69068/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:06.700841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aab66f-9b46-4c46-ac99-ee24e7a4e57c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccfc70e88a3e4c3cb2663455c149b0b9, user_id=e23174bda30d4d2aba2e00b579e69068, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:06.704257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aab66f-9b46-4c46-ac99-ee24e7a4e57c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:06.729305 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2238/4456] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:06 2022] PUT /identity/v3/projects/ccfc70e88a3e4c3cb2663455c149b0b9/users/e23174bda30d4d2aba2e00b579e69068/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:06.741040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918889aa-5188-473f-9a47-c951f359069a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:06.741332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918889aa-5188-473f-9a47-c951f359069a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:06.741610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918889aa-5188-473f-9a47-c951f359069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:06.871439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-918889aa-5188-473f-9a47-c951f359069a None None] MFA Rules not processed for user `e23174bda30d4d2aba2e00b579e69068`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:06.872702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-918889aa-5188-473f-9a47-c951f359069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:06.931159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:07.019948 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2219/4457] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:07.026577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aab66f-9b46-4c46-ac99-ee24e7a4e57c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:07.047490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aab66f-9b46-4c46-ac99-ee24e7a4e57c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:07.057525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9629b-6562-4024-bdf8-00bec0630fe2 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e23174bda30d4d2aba2e00b579e69068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfc70e88a3e4c3cb2663455c149b0b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:07.058537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9629b-6562-4024-bdf8-00bec0630fe2 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:07.059089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9629b-6562-4024-bdf8-00bec0630fe2 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:07.059495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9629b-6562-4024-bdf8-00bec0630fe2 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:07.060329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9629b-6562-4024-bdf8-00bec0630fe2 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:07.062057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9629b-6562-4024-bdf8-00bec0630fe2 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-62d9629b-6562-4024-bdf8-00bec0630fe2 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invalid input for field 'name': '' is too short Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: Failed validating 'minLength' in schema['properties']['name']: Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: On instance['name']: Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: Failed validating 'minLength' in schema['properties']['name']: Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: On instance['name']: Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: '' Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise error Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['name']: Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application '' Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:07.078360 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:38:07.079668 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:07.079668 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:07.079668 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:38:07.079668 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:38:07.079668 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:38:07.079668 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:38:07.079668 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:38:07.079668 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:38:07.079668 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:38:07.079668 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:38:07.079668 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:38:07.079668 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:38:07.079668 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 28 18:38:07.079668 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 28 18:38:07.079668 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 18:38:07.079668 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 18:38:07.079668 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 18:38:07.080542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 18:38:07.080542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 28 18:38:07.080542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:07.080542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 28 18:38:07.080542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 18:38:07.080542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:07.080542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['name']: Aug 28 18:38:07.080542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application '' Aug 28 18:38:07.080542 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:07.085353 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2239/4458] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:38:07 2022] POST /identity/v3/domains => generated 283 bytes in 59 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 18:38:07.092054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918889aa-5188-473f-9a47-c951f359069a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:07.119821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918889aa-5188-473f-9a47-c951f359069a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:07.128494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87575108-2a87-4f93-9e71-981af7eee70d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e23174bda30d4d2aba2e00b579e69068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfc70e88a3e4c3cb2663455c149b0b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:07.129159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87575108-2a87-4f93-9e71-981af7eee70d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:07.129444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87575108-2a87-4f93-9e71-981af7eee70d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:07.129727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87575108-2a87-4f93-9e71-981af7eee70d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:07.130465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87575108-2a87-4f93-9e71-981af7eee70d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:07.132430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87575108-2a87-4f93-9e71-981af7eee70d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-87575108-2a87-4f93-9e71-981af7eee70d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: Failed validating 'maxLength' in schema['properties']['name']: Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: On instance['name']: Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: Failed validating 'maxLength' in schema['properties']['name']: Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: On instance['name']: Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise error Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 18:38:07.156826 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application On instance['name']: Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 28 18:38:07.157919 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 28 18:38:07.160545 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 18:38:07.160545 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 18:38:07.160545 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 18:38:07.160545 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 18:38:07.160545 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 18:38:07.160545 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:38:07.160545 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 28 18:38:07.160545 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 18:38:07.160545 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:38:07.160545 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application On instance['name']: Aug 28 18:38:07.160545 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 18:38:07.160545 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:38:07.160545 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2220/4459] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:38:07 2022] POST /identity/v3/domains => generated 412 bytes in 68 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 18:38:07.163340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9629b-6562-4024-bdf8-00bec0630fe2 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:07.174855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9629b-6562-4024-bdf8-00bec0630fe2 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:07.182115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e760cc1-9171-461c-8c5f-7250f2b7e52a tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e23174bda30d4d2aba2e00b579e69068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfc70e88a3e4c3cb2663455c149b0b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:07.182739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e760cc1-9171-461c-8c5f-7250f2b7e52a tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:07.183171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e760cc1-9171-461c-8c5f-7250f2b7e52a tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:07.183531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e760cc1-9171-461c-8c5f-7250f2b7e52a tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:07.184289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e760cc1-9171-461c-8c5f-7250f2b7e52a tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:07.185993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e760cc1-9171-461c-8c5f-7250f2b7e52a tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:07.212844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87575108-2a87-4f93-9e71-981af7eee70d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:07.213326 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2240/4460] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:38:07 2022] POST /identity/v3/domains => generated 274 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:07.225787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87575108-2a87-4f93-9e71-981af7eee70d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:07.290782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63891f18-c175-4de0-a082-8d242f645fd4 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e23174bda30d4d2aba2e00b579e69068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfc70e88a3e4c3cb2663455c149b0b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:07.291681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63891f18-c175-4de0-a082-8d242f645fd4 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:07.292039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63891f18-c175-4de0-a082-8d242f645fd4 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:07.292390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63891f18-c175-4de0-a082-8d242f645fd4 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] PATH_INFO: `/v3/domains/f1236f638cf443ddb7d924756f7623a1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:07.304696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63891f18-c175-4de0-a082-8d242f645fd4 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f1236f638cf443ddb7d924756f7623a1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:07.306588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63891f18-c175-4de0-a082-8d242f645fd4 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:07.324382 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-63891f18-c175-4de0-a082-8d242f645fd4 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 28 18:38:07.324382 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:07.324382 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:38:07.324382 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:38:07.324382 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:38:07.324382 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:38:07.324382 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:38:07.324382 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:38:07.324382 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:38:07.324382 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:38:07.324382 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:38:07.324382 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:38:07.324382 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Aug 28 18:38:07.324382 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Aug 28 18:38:07.325303 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:38:07.325303 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:38:07.325303 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Aug 28 18:38:07.325303 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Aug 28 18:38:07.325303 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Aug 28 18:38:07.325303 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 28 18:38:07.325303 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 28 18:38:07.325303 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:38:07.329490 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2221/4461] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:38:07 2022] DELETE /identity/v3/domains/f1236f638cf443ddb7d924756f7623a1 => generated 120 bytes in 115 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:38:07.331179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e760cc1-9171-461c-8c5f-7250f2b7e52a tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:07.348432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e760cc1-9171-461c-8c5f-7250f2b7e52a tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:07.355065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31e69e-dfb6-48e3-a8f0-236763d28d06 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e23174bda30d4d2aba2e00b579e69068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfc70e88a3e4c3cb2663455c149b0b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:07.356193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31e69e-dfb6-48e3-a8f0-236763d28d06 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:07.356670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31e69e-dfb6-48e3-a8f0-236763d28d06 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:07.357155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31e69e-dfb6-48e3-a8f0-236763d28d06 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] PATH_INFO: `/v3/domains/f1236f638cf443ddb7d924756f7623a1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:07.358576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31e69e-dfb6-48e3-a8f0-236763d28d06 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f1236f638cf443ddb7d924756f7623a1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:07.361120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31e69e-dfb6-48e3-a8f0-236763d28d06 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:07.391229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ab31e69e-dfb6-48e3-a8f0-236763d28d06 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f1236f638cf443ddb7d924756f7623a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:07.392464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ab31e69e-dfb6-48e3-a8f0-236763d28d06 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f1236f638cf443ddb7d924756f7623a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:07.432070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ab31e69e-dfb6-48e3-a8f0-236763d28d06 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f1236f638cf443ddb7d924756f7623a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:07.433088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ab31e69e-dfb6-48e3-a8f0-236763d28d06 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f1236f638cf443ddb7d924756f7623a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:07.440464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63891f18-c175-4de0-a082-8d242f645fd4 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:07.443690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-63891f18-c175-4de0-a082-8d242f645fd4 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:07.447661 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2241/4462] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:38:07 2022] PATCH /identity/v3/domains/f1236f638cf443ddb7d924756f7623a1 => generated 275 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:07.467576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63891f18-c175-4de0-a082-8d242f645fd4 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:07.559540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e23174bda30d4d2aba2e00b579e69068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfc70e88a3e4c3cb2663455c149b0b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:07.560125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:07.560405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:07.560677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] PATH_INFO: `/v3/domains/f1236f638cf443ddb7d924756f7623a1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:07.578101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f1236f638cf443ddb7d924756f7623a1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:07.580402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:07.605640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f1236f638cf443ddb7d924756f7623a1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:07.616066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f1236f638cf443ddb7d924756f7623a1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:07.620601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:07.657225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1236f638cf443ddb7d924756f7623a1', 'request_id': 'req-7805b561-de13-416d-b0f9-77b2e7a6804d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:07.663781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1236f638cf443ddb7d924756f7623a1', 'request_id': 'req-7805b561-de13-416d-b0f9-77b2e7a6804d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:07.670094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1236f638cf443ddb7d924756f7623a1', 'request_id': 'req-7805b561-de13-416d-b0f9-77b2e7a6804d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:07.686687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] The token cache is being invalidate because project f1236f638cf443ddb7d924756f7623a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:07.687238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:07.688395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:07.696902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f1236f638cf443ddb7d924756f7623a1', 'request_id': 'req-7805b561-de13-416d-b0f9-77b2e7a6804d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:07.700533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f1236f638cf443ddb7d924756f7623a1', 'request_id': 'req-7805b561-de13-416d-b0f9-77b2e7a6804d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:07.701243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f1236f638cf443ddb7d924756f7623a1', 'request_id': 'req-7805b561-de13-416d-b0f9-77b2e7a6804d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:07.707239 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2222/4463] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:38:07 2022] DELETE /identity/v3/domains/f1236f638cf443ddb7d924756f7623a1 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:07.713965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31e69e-dfb6-48e3-a8f0-236763d28d06 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:07.725052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31e69e-dfb6-48e3-a8f0-236763d28d06 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:07.789571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ed648-b022-4a8c-bee9-31661f11377e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e23174bda30d4d2aba2e00b579e69068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfc70e88a3e4c3cb2663455c149b0b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:07.790221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ed648-b022-4a8c-bee9-31661f11377e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:07.790499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ed648-b022-4a8c-bee9-31661f11377e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:07.791029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ed648-b022-4a8c-bee9-31661f11377e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] PATH_INFO: `/v3/domains/86e2bd6d43e14fc58c77a13efe6be163` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:07.798866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ed648-b022-4a8c-bee9-31661f11377e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:38:07.804731 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-fc7ed648-b022-4a8c-bee9-31661f11377e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Could not find domain: 86e2bd6d43e14fc58c77a13efe6be163.: keystone.exception.DomainNotFound: Could not find domain: 86e2bd6d43e14fc58c77a13efe6be163. Aug 28 18:38:07.804731 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:07.804731 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:38:07.804731 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:38:07.804731 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:38:07.804731 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:38:07.804731 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:38:07.804731 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:38:07.804731 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 86e2bd6d43e14fc58c77a13efe6be163. Aug 28 18:38:07.804731 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:07.804731 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:38:07.804731 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:07.804731 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:07.804731 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:38:07.804731 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:38:07.805908 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:38:07.805908 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:38:07.805908 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:38:07.805908 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:38:07.805908 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:38:07.805908 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:38:07.805908 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:38:07.805908 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:38:07.805908 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Aug 28 18:38:07.805908 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Aug 28 18:38:07.805908 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:38:07.805908 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:38:07.805908 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:38:07.805908 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:38:07.805908 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:38:07.805908 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:38:07.807046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:38:07.807046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:38:07.807046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:38:07.807046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:38:07.807046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:38:07.807046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:38:07.807046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:38:07.807046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:38:07.807046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:38:07.807046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:38:07.807046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:38:07.807046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:38:07.807046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:38:07.807046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:38:07.807046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:38:07.807046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:38:07.807046 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 86e2bd6d43e14fc58c77a13efe6be163. Aug 28 18:38:07.808235 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:07.817409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:07.817630 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2242/4464] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:38:07 2022] DELETE /identity/v3/domains/86e2bd6d43e14fc58c77a13efe6be163 => generated 112 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:38:07.819464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:07.850546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805b561-de13-416d-b0f9-77b2e7a6804d tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:07.863706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3627b-9eec-4e93-b8e9-19b78cbc6075 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e23174bda30d4d2aba2e00b579e69068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfc70e88a3e4c3cb2663455c149b0b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:07.864538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3627b-9eec-4e93-b8e9-19b78cbc6075 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:07.864853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3627b-9eec-4e93-b8e9-19b78cbc6075 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:07.865659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3627b-9eec-4e93-b8e9-19b78cbc6075 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:07.866473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3627b-9eec-4e93-b8e9-19b78cbc6075 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:07.868360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3627b-9eec-4e93-b8e9-19b78cbc6075 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:07.914357 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2223/4465] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:38:07 2022] POST /identity/v3/domains => generated 252 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:38:07.920332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ed648-b022-4a8c-bee9-31661f11377e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:07.929422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:07.939289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ed648-b022-4a8c-bee9-31661f11377e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:08.027907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf745942-abda-4bf1-86aa-95a3f9ff63bc tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e23174bda30d4d2aba2e00b579e69068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfc70e88a3e4c3cb2663455c149b0b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:08.028526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf745942-abda-4bf1-86aa-95a3f9ff63bc tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:08.028827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf745942-abda-4bf1-86aa-95a3f9ff63bc tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:08.029077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf745942-abda-4bf1-86aa-95a3f9ff63bc tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:08.029784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf745942-abda-4bf1-86aa-95a3f9ff63bc tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:08.031445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf745942-abda-4bf1-86aa-95a3f9ff63bc tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:08.044588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.sql.core [None req-cf745942-abda-4bf1-86aa-95a3f9ff63bc tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-114530260' for key 'project.ixu_project_name_domain_id'") Aug 28 18:38:08.044588 n-d-850468-20 devstack@keystone.service[82161]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 18:38:08.044588 n-d-850468-20 devstack@keystone.service[82161]: [parameters: {'id': '5fa726eda5044e8189757a7b89b448c0', 'name': 'tempest-domain-dup-114530260', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 28 18:38:08.044588 n-d-850468-20 devstack@keystone.service[82161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82161) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 18:38:08.079580 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-cf745942-abda-4bf1-86aa-95a3f9ff63bc tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-114530260.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-114530260. Aug 28 18:38:08.079580 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:08.079580 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 18:38:08.079580 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 18:38:08.079580 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 18:38:08.079580 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 18:38:08.079580 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 18:38:08.079580 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 18:38:08.079580 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 18:38:08.079580 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Aug 28 18:38:08.079580 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 18:38:08.079580 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 18:38:08.079580 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-114530260' for key 'project.ixu_project_name_domain_id'") Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 28 18:38:08.080871 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 28 18:38:08.085346 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:38:08.085346 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:38:08.085346 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 18:38:08.085346 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application yield resource Aug 28 18:38:08.085346 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:38:08.085346 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:38:08.085346 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 18:38:08.085346 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 18:38:08.085346 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 18:38:08.085346 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 18:38:08.085346 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 18:38:08.085346 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise self.value Aug 28 18:38:08.085346 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 18:38:08.085346 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 18:38:08.085346 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 18:38:08.085346 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application session.commit() Aug 28 18:38:08.085346 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 18:38:08.086237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 18:38:08.086237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 18:38:08.086237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 18:38:08.086237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 18:38:08.086237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.flush() Aug 28 18:38:08.086237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 18:38:08.086237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 18:38:08.086237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 18:38:08.086237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 18:38:08.086237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 18:38:08.086237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application compat.raise_( Aug 28 18:38:08.086237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 18:38:08.086237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Aug 28 18:38:08.086237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 18:38:08.086237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 18:38:08.086237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 18:38:08.086237 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 18:38:08.087115 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 18:38:08.087115 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 18:38:08.087115 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 18:38:08.087115 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 18:38:08.087115 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 18:38:08.087115 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 18:38:08.087115 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 18:38:08.087115 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 18:38:08.087115 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 18:38:08.087115 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 18:38:08.087115 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 18:38:08.087115 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 18:38:08.087115 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 18:38:08.087115 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 18:38:08.087115 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 18:38:08.090726 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 18:38:08.090726 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 18:38:08.090726 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Aug 28 18:38:08.090726 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 18:38:08.090726 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 18:38:08.090726 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 18:38:08.090726 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 18:38:08.090726 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 18:38:08.090726 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 18:38:08.090726 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 18:38:08.090726 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Aug 28 18:38:08.090726 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 18:38:08.090726 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 18:38:08.090726 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 18:38:08.090726 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Aug 28 18:38:08.090726 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 18:38:08.090726 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 18:38:08.093843 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 18:38:08.093843 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 18:38:08.093843 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 18:38:08.093843 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 18:38:08.093843 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 18:38:08.093843 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 18:38:08.093843 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-114530260' for key 'project.ixu_project_name_domain_id'") Aug 28 18:38:08.093843 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 18:38:08.093843 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [parameters: {'id': '5fa726eda5044e8189757a7b89b448c0', 'name': 'tempest-domain-dup-114530260', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 28 18:38:08.093843 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 18:38:08.093843 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:08.093843 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:38:08.093843 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:08.093843 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:08.095683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 28 18:38:08.095683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 28 18:38:08.095683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 18:38:08.095683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 18:38:08.095683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-114530260. Aug 28 18:38:08.095683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:08.095683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:38:08.095683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:08.095683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:08.095683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:38:08.095683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:38:08.095683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:38:08.095683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:38:08.095683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:38:08.095683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:38:08.095683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:38:08.095683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:38:08.097429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:38:08.097429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:38:08.097429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Aug 28 18:38:08.097429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Aug 28 18:38:08.097429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:38:08.097429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:38:08.097429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Aug 28 18:38:08.097429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Aug 28 18:38:08.097429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:38:08.097429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:38:08.097429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 28 18:38:08.097429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 28 18:38:08.097429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-114530260. Aug 28 18:38:08.097429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:08.097429 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2243/4466] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:38:07 2022] POST /identity/v3/domains => generated 211 bytes in 161 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:38:08.099225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3627b-9eec-4e93-b8e9-19b78cbc6075 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:08.115236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3627b-9eec-4e93-b8e9-19b78cbc6075 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:08.124656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cca86-5e98-4d6b-a96a-c780877f4f40 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e23174bda30d4d2aba2e00b579e69068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfc70e88a3e4c3cb2663455c149b0b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:08.125383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cca86-5e98-4d6b-a96a-c780877f4f40 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:08.125739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cca86-5e98-4d6b-a96a-c780877f4f40 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:08.126074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cca86-5e98-4d6b-a96a-c780877f4f40 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] PATH_INFO: `/v3/domains/20c1430e899947efa5eca1fae2fac0b0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:08.139169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cca86-5e98-4d6b-a96a-c780877f4f40 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=20c1430e899947efa5eca1fae2fac0b0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:08.140856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cca86-5e98-4d6b-a96a-c780877f4f40 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:08.164431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-043cca86-5e98-4d6b-a96a-c780877f4f40 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '20c1430e899947efa5eca1fae2fac0b0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.165353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-043cca86-5e98-4d6b-a96a-c780877f4f40 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '20c1430e899947efa5eca1fae2fac0b0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.193953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-043cca86-5e98-4d6b-a96a-c780877f4f40 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '20c1430e899947efa5eca1fae2fac0b0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.194497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-043cca86-5e98-4d6b-a96a-c780877f4f40 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '20c1430e899947efa5eca1fae2fac0b0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.196989 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2224/4467] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:38:08 2022] PATCH /identity/v3/domains/20c1430e899947efa5eca1fae2fac0b0 => generated 253 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:08.201191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf745942-abda-4bf1-86aa-95a3f9ff63bc tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:08.203582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf745942-abda-4bf1-86aa-95a3f9ff63bc tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:08.222907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf745942-abda-4bf1-86aa-95a3f9ff63bc tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:08.283049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e23174bda30d4d2aba2e00b579e69068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfc70e88a3e4c3cb2663455c149b0b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:08.284327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:08.284327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:08.284327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] PATH_INFO: `/v3/domains/20c1430e899947efa5eca1fae2fac0b0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:08.296364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=20c1430e899947efa5eca1fae2fac0b0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:08.297999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:08.334785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '20c1430e899947efa5eca1fae2fac0b0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.352046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '20c1430e899947efa5eca1fae2fac0b0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.411376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c1430e899947efa5eca1fae2fac0b0', 'request_id': 'req-9abc0a77-6496-47da-9592-ba7936e12e5e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.421976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c1430e899947efa5eca1fae2fac0b0', 'request_id': 'req-9abc0a77-6496-47da-9592-ba7936e12e5e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.429372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c1430e899947efa5eca1fae2fac0b0', 'request_id': 'req-9abc0a77-6496-47da-9592-ba7936e12e5e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.437603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:08.443141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] The token cache is being invalidate because project 20c1430e899947efa5eca1fae2fac0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:08.443877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.449592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.460996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '20c1430e899947efa5eca1fae2fac0b0', 'request_id': 'req-9abc0a77-6496-47da-9592-ba7936e12e5e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.461791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '20c1430e899947efa5eca1fae2fac0b0', 'request_id': 'req-9abc0a77-6496-47da-9592-ba7936e12e5e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.465605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '20c1430e899947efa5eca1fae2fac0b0', 'request_id': 'req-9abc0a77-6496-47da-9592-ba7936e12e5e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.476495 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2244/4468] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:38:08 2022] DELETE /identity/v3/domains/20c1430e899947efa5eca1fae2fac0b0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:08.478567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cca86-5e98-4d6b-a96a-c780877f4f40 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:08.506046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cca86-5e98-4d6b-a96a-c780877f4f40 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:08.576427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339fe9f-157b-4527-94eb-5edc69fcbe26 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e23174bda30d4d2aba2e00b579e69068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfc70e88a3e4c3cb2663455c149b0b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:08.577246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339fe9f-157b-4527-94eb-5edc69fcbe26 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:08.577539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339fe9f-157b-4527-94eb-5edc69fcbe26 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:08.577937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339fe9f-157b-4527-94eb-5edc69fcbe26 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] PATH_INFO: `/v3/domains/f1236f638cf443ddb7d924756f7623a1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:08.586227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339fe9f-157b-4527-94eb-5edc69fcbe26 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:38:08.592095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-7339fe9f-157b-4527-94eb-5edc69fcbe26 tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Could not find domain: f1236f638cf443ddb7d924756f7623a1.: keystone.exception.DomainNotFound: Could not find domain: f1236f638cf443ddb7d924756f7623a1. Aug 28 18:38:08.592095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:08.592095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:38:08.592095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:38:08.592095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:38:08.592095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:38:08.592095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:38:08.592095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:38:08.592095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f1236f638cf443ddb7d924756f7623a1. Aug 28 18:38:08.592095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:38:08.592095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:38:08.592095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:38:08.592095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:08.592095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:38:08.592095 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:38:08.593074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:38:08.593074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:38:08.593074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:38:08.593074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:38:08.593074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:38:08.593074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:38:08.593074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:38:08.593074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:38:08.593074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 18:38:08.593074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 18:38:08.593074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:38:08.593074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:38:08.593074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:38:08.593074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:38:08.593074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:38:08.593074 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:38:08.593991 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:38:08.593991 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:38:08.593991 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:38:08.593991 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:38:08.593991 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:38:08.593991 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:38:08.593991 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:38:08.593991 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:38:08.593991 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:38:08.593991 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:38:08.593991 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:38:08.593991 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:38:08.593991 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:38:08.593991 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:38:08.593991 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:38:08.593991 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:38:08.593991 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f1236f638cf443ddb7d924756f7623a1. Aug 28 18:38:08.594922 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:38:08.596838 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2225/4469] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:38:08 2022] PATCH /identity/v3/domains/f1236f638cf443ddb7d924756f7623a1 => generated 112 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:38:08.598414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:08.600056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:08.679061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc0a77-6496-47da-9592-ba7936e12e5e tempest-DomainsNegativeTestJSON-2120125751 tempest-DomainsNegativeTestJSON-2120125751-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:08.684749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a301f6-cb48-4a6f-99e4-0419464c92a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:08.685438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a301f6-cb48-4a6f-99e4-0419464c92a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:08.685701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a301f6-cb48-4a6f-99e4-0419464c92a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:08.685979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a301f6-cb48-4a6f-99e4-0419464c92a9 admin admin] PATH_INFO: `/v3/users/552f70af1bb5472691ca0d884866e37f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:08.687819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a301f6-cb48-4a6f-99e4-0419464c92a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=552f70af1bb5472691ca0d884866e37f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:08.689857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a301f6-cb48-4a6f-99e4-0419464c92a9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:08.752733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-68a301f6-cb48-4a6f-99e4-0419464c92a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '552f70af1bb5472691ca0d884866e37f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.753705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-68a301f6-cb48-4a6f-99e4-0419464c92a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '552f70af1bb5472691ca0d884866e37f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.762269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-68a301f6-cb48-4a6f-99e4-0419464c92a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '552f70af1bb5472691ca0d884866e37f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.772036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-68a301f6-cb48-4a6f-99e4-0419464c92a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '552f70af1bb5472691ca0d884866e37f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.786252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-68a301f6-cb48-4a6f-99e4-0419464c92a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '552f70af1bb5472691ca0d884866e37f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:08.793922 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2245/4470] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:08 2022] DELETE /identity/v3/users/552f70af1bb5472691ca0d884866e37f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:08.798245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53546547-f849-4136-8f6e-ec51b17ff938 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:08.798589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53546547-f849-4136-8f6e-ec51b17ff938 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:08.798931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53546547-f849-4136-8f6e-ec51b17ff938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:08.838571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-53546547-f849-4136-8f6e-ec51b17ff938 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:08.840044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-53546547-f849-4136-8f6e-ec51b17ff938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:08.850180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:08.918953 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2226/4471] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:08.928649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a301f6-cb48-4a6f-99e4-0419464c92a9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:08.930446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68a301f6-cb48-4a6f-99e4-0419464c92a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:09.021208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:09.027661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a301f6-cb48-4a6f-99e4-0419464c92a9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:09.037064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c06a4a-fb02-4b5e-8fcb-d9dfcb3b434e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:09.037545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c06a4a-fb02-4b5e-8fcb-d9dfcb3b434e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:09.037830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c06a4a-fb02-4b5e-8fcb-d9dfcb3b434e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:09.038219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c06a4a-fb02-4b5e-8fcb-d9dfcb3b434e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:09.049154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c06a4a-fb02-4b5e-8fcb-d9dfcb3b434e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:09.050614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c06a4a-fb02-4b5e-8fcb-d9dfcb3b434e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:09.061479 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2246/4472] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:09.589584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53546547-f849-4136-8f6e-ec51b17ff938 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:09.592336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-53546547-f849-4136-8f6e-ec51b17ff938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:09.633658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53546547-f849-4136-8f6e-ec51b17ff938 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:09.670575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a678f08-c7e5-44d9-b6d3-15ea7dece366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:09.671233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a678f08-c7e5-44d9-b6d3-15ea7dece366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:09.671733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a678f08-c7e5-44d9-b6d3-15ea7dece366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:09.672019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a678f08-c7e5-44d9-b6d3-15ea7dece366 admin admin] PATH_INFO: `/v3/projects/278d8bf1a40b484fb0c4a21f0638928f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:09.677481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a678f08-c7e5-44d9-b6d3-15ea7dece366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=278d8bf1a40b484fb0c4a21f0638928f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:09.680163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a678f08-c7e5-44d9-b6d3-15ea7dece366 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:09.836982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a678f08-c7e5-44d9-b6d3-15ea7dece366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278d8bf1a40b484fb0c4a21f0638928f', 'request_id': 'req-0a678f08-c7e5-44d9-b6d3-15ea7dece366'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:09.848499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a678f08-c7e5-44d9-b6d3-15ea7dece366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278d8bf1a40b484fb0c4a21f0638928f', 'request_id': 'req-0a678f08-c7e5-44d9-b6d3-15ea7dece366'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:09.860799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a678f08-c7e5-44d9-b6d3-15ea7dece366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278d8bf1a40b484fb0c4a21f0638928f', 'request_id': 'req-0a678f08-c7e5-44d9-b6d3-15ea7dece366'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:09.889560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a678f08-c7e5-44d9-b6d3-15ea7dece366 admin admin] The token cache is being invalidate because project 278d8bf1a40b484fb0c4a21f0638928f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:09.889560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a678f08-c7e5-44d9-b6d3-15ea7dece366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:09.890219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a678f08-c7e5-44d9-b6d3-15ea7dece366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:09.896779 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2227/4473] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:09 2022] DELETE /identity/v3/projects/278d8bf1a40b484fb0c4a21f0638928f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:09.896925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c06a4a-fb02-4b5e-8fcb-d9dfcb3b434e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:09.934038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c06a4a-fb02-4b5e-8fcb-d9dfcb3b434e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:10.051948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a678f08-c7e5-44d9-b6d3-15ea7dece366 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:10.053510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0a678f08-c7e5-44d9-b6d3-15ea7dece366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:10.079714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b28d8e-177c-43a2-9260-b4853a94e61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:10.080477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b28d8e-177c-43a2-9260-b4853a94e61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:10.080764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b28d8e-177c-43a2-9260-b4853a94e61b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:10.081042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b28d8e-177c-43a2-9260-b4853a94e61b admin admin] PATH_INFO: `/v3/users/e23174bda30d4d2aba2e00b579e69068` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:10.088558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b28d8e-177c-43a2-9260-b4853a94e61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e23174bda30d4d2aba2e00b579e69068)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:10.096022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b28d8e-177c-43a2-9260-b4853a94e61b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:10.199495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a678f08-c7e5-44d9-b6d3-15ea7dece366 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:10.203563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a76d4-b383-4f2f-96e6-712bcd958fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:10.204185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a76d4-b383-4f2f-96e6-712bcd958fea service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:10.204503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a76d4-b383-4f2f-96e6-712bcd958fea service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:10.204840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a76d4-b383-4f2f-96e6-712bcd958fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:10.207285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8a9a76d4-b383-4f2f-96e6-712bcd958fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:10.217622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a0b28d8e-177c-43a2-9260-b4853a94e61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e23174bda30d4d2aba2e00b579e69068'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:10.218634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a0b28d8e-177c-43a2-9260-b4853a94e61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e23174bda30d4d2aba2e00b579e69068'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:10.235819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a0b28d8e-177c-43a2-9260-b4853a94e61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e23174bda30d4d2aba2e00b579e69068'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:10.249815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a0b28d8e-177c-43a2-9260-b4853a94e61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e23174bda30d4d2aba2e00b579e69068'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:10.283852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a0b28d8e-177c-43a2-9260-b4853a94e61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e23174bda30d4d2aba2e00b579e69068'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:10.306575 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2247/4474] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:09 2022] DELETE /identity/v3/users/e23174bda30d4d2aba2e00b579e69068 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:10.348520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:10.384943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a76d4-b383-4f2f-96e6-712bcd958fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:10.386838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a76d4-b383-4f2f-96e6-712bcd958fea service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:10.407685 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2228/4475] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:38:11.355910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b28d8e-177c-43a2-9260-b4853a94e61b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:11.357358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a0b28d8e-177c-43a2-9260-b4853a94e61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:11.561601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b28d8e-177c-43a2-9260-b4853a94e61b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:11.578260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdcd16-5c8d-4512-86f9-bc139b7e7294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:11.578748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdcd16-5c8d-4512-86f9-bc139b7e7294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:11.579029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdcd16-5c8d-4512-86f9-bc139b7e7294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:11.579331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdcd16-5c8d-4512-86f9-bc139b7e7294 admin admin] PATH_INFO: `/v3/projects/ccfc70e88a3e4c3cb2663455c149b0b9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:11.581239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdcd16-5c8d-4512-86f9-bc139b7e7294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccfc70e88a3e4c3cb2663455c149b0b9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:11.583028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdcd16-5c8d-4512-86f9-bc139b7e7294 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:11.597858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:11.669364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ddbdcd16-5c8d-4512-86f9-bc139b7e7294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccfc70e88a3e4c3cb2663455c149b0b9', 'request_id': 'req-ddbdcd16-5c8d-4512-86f9-bc139b7e7294'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:11.683904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ddbdcd16-5c8d-4512-86f9-bc139b7e7294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccfc70e88a3e4c3cb2663455c149b0b9', 'request_id': 'req-ddbdcd16-5c8d-4512-86f9-bc139b7e7294'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:11.701787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ddbdcd16-5c8d-4512-86f9-bc139b7e7294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccfc70e88a3e4c3cb2663455c149b0b9', 'request_id': 'req-ddbdcd16-5c8d-4512-86f9-bc139b7e7294'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:11.733170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ddbdcd16-5c8d-4512-86f9-bc139b7e7294 admin admin] The token cache is being invalidate because project ccfc70e88a3e4c3cb2663455c149b0b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:11.735311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ddbdcd16-5c8d-4512-86f9-bc139b7e7294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:11.738590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ddbdcd16-5c8d-4512-86f9-bc139b7e7294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:11.740723 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2248/4476] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:11 2022] DELETE /identity/v3/projects/ccfc70e88a3e4c3cb2663455c149b0b9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:11.745901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47825b12-5b5e-40bb-a49e-4b9efb752c02 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:11.746465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47825b12-5b5e-40bb-a49e-4b9efb752c02 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:11.746465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47825b12-5b5e-40bb-a49e-4b9efb752c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:11.797407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-47825b12-5b5e-40bb-a49e-4b9efb752c02 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:11.802665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-47825b12-5b5e-40bb-a49e-4b9efb752c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:11.988385 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2229/4477] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:11.997146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fea412-dfde-4301-b1ea-e8ace286e222 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:11.997453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fea412-dfde-4301-b1ea-e8ace286e222 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:11.997723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fea412-dfde-4301-b1ea-e8ace286e222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:12.027577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a5fea412-dfde-4301-b1ea-e8ace286e222 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:12.028927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a5fea412-dfde-4301-b1ea-e8ace286e222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:12.041985 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2249/4478] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:12.046257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47825b12-5b5e-40bb-a49e-4b9efb752c02 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:12.059008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47825b12-5b5e-40bb-a49e-4b9efb752c02 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:12.065203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05829ffd-6e23-4689-9b39-a825de4dae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:12.066082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05829ffd-6e23-4689-9b39-a825de4dae3e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:12.066368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05829ffd-6e23-4689-9b39-a825de4dae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:12.066751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05829ffd-6e23-4689-9b39-a825de4dae3e admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:12.067466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05829ffd-6e23-4689-9b39-a825de4dae3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:12.067688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05829ffd-6e23-4689-9b39-a825de4dae3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:12.069443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05829ffd-6e23-4689-9b39-a825de4dae3e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:12.096526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fea412-dfde-4301-b1ea-e8ace286e222 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:12.099659 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2230/4479] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:12.112468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fea412-dfde-4301-b1ea-e8ace286e222 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:12.117432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1492aaf-9b8f-4ff8-8b15-5605e89d4ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:12.118970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1492aaf-9b8f-4ff8-8b15-5605e89d4ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:12.118970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1492aaf-9b8f-4ff8-8b15-5605e89d4ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:12.118970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1492aaf-9b8f-4ff8-8b15-5605e89d4ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:12.121349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1492aaf-9b8f-4ff8-8b15-5605e89d4ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:12.123361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1492aaf-9b8f-4ff8-8b15-5605e89d4ed2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:12.185217 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2250/4480] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:12 2022] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:12.187031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05829ffd-6e23-4689-9b39-a825de4dae3e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:12.217903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05829ffd-6e23-4689-9b39-a825de4dae3e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:12.443771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067f362-b5a5-43b6-a96b-39e1cf91de04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:12.447773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067f362-b5a5-43b6-a96b-39e1cf91de04 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:12.448175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067f362-b5a5-43b6-a96b-39e1cf91de04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:12.448551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067f362-b5a5-43b6-a96b-39e1cf91de04 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:12.449688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067f362-b5a5-43b6-a96b-39e1cf91de04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:12.453577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067f362-b5a5-43b6-a96b-39e1cf91de04 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:12.513879 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2231/4481] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:12 2022] POST /identity/v3/users => generated 284 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:12.515338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1492aaf-9b8f-4ff8-8b15-5605e89d4ed2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:12.529557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1492aaf-9b8f-4ff8-8b15-5605e89d4ed2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:12.542142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc5118-4180-4274-be90-e0d1611e60e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:12.543778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc5118-4180-4274-be90-e0d1611e60e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:12.544198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc5118-4180-4274-be90-e0d1611e60e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:12.545394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc5118-4180-4274-be90-e0d1611e60e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:12.547386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc5118-4180-4274-be90-e0d1611e60e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:12.551481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc5118-4180-4274-be90-e0d1611e60e0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:12.583621 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2251/4482] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:12.587678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067f362-b5a5-43b6-a96b-39e1cf91de04 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:12.612892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067f362-b5a5-43b6-a96b-39e1cf91de04 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:12.626194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed24b1d-a119-4d28-9f59-f8543ad69902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:12.626943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed24b1d-a119-4d28-9f59-f8543ad69902 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:12.628698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed24b1d-a119-4d28-9f59-f8543ad69902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:12.628698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed24b1d-a119-4d28-9f59-f8543ad69902 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:12.630312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed24b1d-a119-4d28-9f59-f8543ad69902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:12.634187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed24b1d-a119-4d28-9f59-f8543ad69902 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:12.665106 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2232/4483] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:38:12.669529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc5118-4180-4274-be90-e0d1611e60e0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:12.683607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc5118-4180-4274-be90-e0d1611e60e0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:12.698466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ad485-f6d2-42d9-898b-ad3c61071d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:12.699617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ad485-f6d2-42d9-898b-ad3c61071d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:12.700261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ad485-f6d2-42d9-898b-ad3c61071d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:12.700541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ad485-f6d2-42d9-898b-ad3c61071d62 admin admin] PATH_INFO: `/v3/projects/68250fe7015d44d2a8509fed1211730b/users/02aacfb926de4d189baba01e6fbb7deb/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:12.729732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ad485-f6d2-42d9-898b-ad3c61071d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68250fe7015d44d2a8509fed1211730b, user_id=02aacfb926de4d189baba01e6fbb7deb, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:12.733049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ad485-f6d2-42d9-898b-ad3c61071d62 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:12.768385 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2252/4484] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:12 2022] PUT /identity/v3/projects/68250fe7015d44d2a8509fed1211730b/users/02aacfb926de4d189baba01e6fbb7deb/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:12.772325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34f72b-263c-4a8d-b388-1b99084fca7b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:12.772829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34f72b-263c-4a8d-b388-1b99084fca7b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:12.772930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34f72b-263c-4a8d-b388-1b99084fca7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:12.830740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0b34f72b-263c-4a8d-b388-1b99084fca7b None None] MFA Rules not processed for user `02aacfb926de4d189baba01e6fbb7deb`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:12.832235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0b34f72b-263c-4a8d-b388-1b99084fca7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:12.888810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:12.942527 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2233/4485] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:12.943755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ad485-f6d2-42d9-898b-ad3c61071d62 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:13.096059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ad485-f6d2-42d9-898b-ad3c61071d62 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:13.103557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0204bf-4639-46d9-a471-7885082ead99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:13.104425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0204bf-4639-46d9-a471-7885082ead99 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:13.104891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0204bf-4639-46d9-a471-7885082ead99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:13.105416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0204bf-4639-46d9-a471-7885082ead99 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:13.106354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0204bf-4639-46d9-a471-7885082ead99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:13.108933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0204bf-4639-46d9-a471-7885082ead99 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:13.156037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34f72b-263c-4a8d-b388-1b99084fca7b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:13.167026 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2253/4486] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:12 2022] POST /identity/v3/projects => generated 367 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:13.169453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34f72b-263c-4a8d-b388-1b99084fca7b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:13.240782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0204bf-4639-46d9-a471-7885082ead99 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:13.242697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a0204bf-4639-46d9-a471-7885082ead99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:13.278192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:13.282671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d72c7-796d-4a72-8db2-cdfe87070610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:13.283537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d72c7-796d-4a72-8db2-cdfe87070610 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:13.283951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d72c7-796d-4a72-8db2-cdfe87070610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:13.284332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d72c7-796d-4a72-8db2-cdfe87070610 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:13.285112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d72c7-796d-4a72-8db2-cdfe87070610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:13.287720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d72c7-796d-4a72-8db2-cdfe87070610 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:13.315119 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2234/4487] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:13 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:13.319607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d72c7-796d-4a72-8db2-cdfe87070610 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:13.333298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d72c7-796d-4a72-8db2-cdfe87070610 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:13.340474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12bc16-0869-475c-82d6-7d8cfbe0d71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:13.341649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12bc16-0869-475c-82d6-7d8cfbe0d71b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:13.342033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12bc16-0869-475c-82d6-7d8cfbe0d71b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:13.342481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12bc16-0869-475c-82d6-7d8cfbe0d71b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:13.344673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12bc16-0869-475c-82d6-7d8cfbe0d71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:13.346612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12bc16-0869-475c-82d6-7d8cfbe0d71b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:13.361133 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2235/4488] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:13.365687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12bc16-0869-475c-82d6-7d8cfbe0d71b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:13.388742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12bc16-0869-475c-82d6-7d8cfbe0d71b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:13.390118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0204bf-4639-46d9-a471-7885082ead99 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:13.404011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9bf4f-1ede-4f5a-b0e5-c6f7afac6b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:13.404764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9bf4f-1ede-4f5a-b0e5-c6f7afac6b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:13.404938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9bf4f-1ede-4f5a-b0e5-c6f7afac6b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:13.405215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9bf4f-1ede-4f5a-b0e5-c6f7afac6b35 admin admin] PATH_INFO: `/v3/users/ab9fb317498947bca059461d8211b6b8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:13.406575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae70711-fdd9-4ed7-835f-52050de09dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:13.407387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae70711-fdd9-4ed7-835f-52050de09dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:13.408240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae70711-fdd9-4ed7-835f-52050de09dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:13.408240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae70711-fdd9-4ed7-835f-52050de09dc0 admin admin] PATH_INFO: `/v3/projects/70ce42a4d0524450a9b2867ad886aca8/users/cbfcf6d5974847b184c43daaa0155369/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:13.408501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9bf4f-1ede-4f5a-b0e5-c6f7afac6b35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab9fb317498947bca059461d8211b6b8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:13.410449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9bf4f-1ede-4f5a-b0e5-c6f7afac6b35 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:13.466494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae70711-fdd9-4ed7-835f-52050de09dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ce42a4d0524450a9b2867ad886aca8, user_id=cbfcf6d5974847b184c43daaa0155369, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:13.473852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae70711-fdd9-4ed7-835f-52050de09dc0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:13.507501 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2236/4489] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:13 2022] PUT /identity/v3/projects/70ce42a4d0524450a9b2867ad886aca8/users/cbfcf6d5974847b184c43daaa0155369/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:13.512949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae70711-fdd9-4ed7-835f-52050de09dc0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:13.531794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-28c9bf4f-1ede-4f5a-b0e5-c6f7afac6b35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab9fb317498947bca059461d8211b6b8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:13.533600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-28c9bf4f-1ede-4f5a-b0e5-c6f7afac6b35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab9fb317498947bca059461d8211b6b8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:13.559450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-28c9bf4f-1ede-4f5a-b0e5-c6f7afac6b35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab9fb317498947bca059461d8211b6b8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:13.593782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-28c9bf4f-1ede-4f5a-b0e5-c6f7afac6b35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab9fb317498947bca059461d8211b6b8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:13.625851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-28c9bf4f-1ede-4f5a-b0e5-c6f7afac6b35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab9fb317498947bca059461d8211b6b8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:13.644752 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2254/4490] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:13 2022] DELETE /identity/v3/users/ab9fb317498947bca059461d8211b6b8 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:13.703106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae70711-fdd9-4ed7-835f-52050de09dc0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:13.788632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:13.864006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1516b3-be28-4754-a418-0dfa14ec8b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:13.867785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1516b3-be28-4754-a418-0dfa14ec8b23 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:13.868511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1516b3-be28-4754-a418-0dfa14ec8b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:13.876095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1516b3-be28-4754-a418-0dfa14ec8b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:13.876095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1516b3-be28-4754-a418-0dfa14ec8b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:13.878782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1516b3-be28-4754-a418-0dfa14ec8b23 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:13.912565 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2237/4491] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:13.916801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9bf4f-1ede-4f5a-b0e5-c6f7afac6b35 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:13.918606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-28c9bf4f-1ede-4f5a-b0e5-c6f7afac6b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:13.950585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9bf4f-1ede-4f5a-b0e5-c6f7afac6b35 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:13.965187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275c476-c59a-45d3-bc2e-50f1ce73d00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:13.967322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275c476-c59a-45d3-bc2e-50f1ce73d00a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:13.967694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275c476-c59a-45d3-bc2e-50f1ce73d00a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:13.968151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275c476-c59a-45d3-bc2e-50f1ce73d00a admin admin] PATH_INFO: `/v3/projects/70ce42a4d0524450a9b2867ad886aca8/users/cbfcf6d5974847b184c43daaa0155369/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:13.974399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275c476-c59a-45d3-bc2e-50f1ce73d00a admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ce42a4d0524450a9b2867ad886aca8, user_id=cbfcf6d5974847b184c43daaa0155369, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:13.983344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275c476-c59a-45d3-bc2e-50f1ce73d00a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:14.044400 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2255/4492] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:13 2022] PUT /identity/v3/projects/70ce42a4d0524450a9b2867ad886aca8/users/cbfcf6d5974847b184c43daaa0155369/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:14.044503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1516b3-be28-4754-a418-0dfa14ec8b23 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:14.055303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0d1516b3-be28-4754-a418-0dfa14ec8b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:14.102882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1516b3-be28-4754-a418-0dfa14ec8b23 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:14.129379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68342508-6396-400e-b377-6b11c7749465 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:14.130023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68342508-6396-400e-b377-6b11c7749465 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:14.130540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68342508-6396-400e-b377-6b11c7749465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:14.208833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-68342508-6396-400e-b377-6b11c7749465 None None] MFA Rules not processed for user `cbfcf6d5974847b184c43daaa0155369`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:14.211556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68342508-6396-400e-b377-6b11c7749465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:14.235615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27946f46-426b-4343-8dca-0a14bbe0fe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:14.236506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27946f46-426b-4343-8dca-0a14bbe0fe64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:14.236661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27946f46-426b-4343-8dca-0a14bbe0fe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:14.236799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27946f46-426b-4343-8dca-0a14bbe0fe64 admin admin] PATH_INFO: `/v3/projects/8a649339fa5c47a1979fc39073e0e6bc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:14.239706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27946f46-426b-4343-8dca-0a14bbe0fe64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a649339fa5c47a1979fc39073e0e6bc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:14.241695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27946f46-426b-4343-8dca-0a14bbe0fe64 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:14.356424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-27946f46-426b-4343-8dca-0a14bbe0fe64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a649339fa5c47a1979fc39073e0e6bc', 'request_id': 'req-27946f46-426b-4343-8dca-0a14bbe0fe64'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:14.362194 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2256/4493] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:14.364370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68342508-6396-400e-b377-6b11c7749465 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:14.368647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-27946f46-426b-4343-8dca-0a14bbe0fe64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a649339fa5c47a1979fc39073e0e6bc', 'request_id': 'req-27946f46-426b-4343-8dca-0a14bbe0fe64'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:14.379301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-27946f46-426b-4343-8dca-0a14bbe0fe64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a649339fa5c47a1979fc39073e0e6bc', 'request_id': 'req-27946f46-426b-4343-8dca-0a14bbe0fe64'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:14.398798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-27946f46-426b-4343-8dca-0a14bbe0fe64 admin admin] The token cache is being invalidate because project 8a649339fa5c47a1979fc39073e0e6bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:14.399450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-27946f46-426b-4343-8dca-0a14bbe0fe64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:14.400655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-27946f46-426b-4343-8dca-0a14bbe0fe64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:14.403386 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2238/4494] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:14 2022] DELETE /identity/v3/projects/8a649339fa5c47a1979fc39073e0e6bc => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:14.408325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d6ed9-f39d-43d1-838f-25e1b34487c4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:14.408893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d6ed9-f39d-43d1-838f-25e1b34487c4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:14.409344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d6ed9-f39d-43d1-838f-25e1b34487c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:14.412143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68342508-6396-400e-b377-6b11c7749465 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:14.438452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:14.501668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-734d6ed9-f39d-43d1-838f-25e1b34487c4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:14.506402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-734d6ed9-f39d-43d1-838f-25e1b34487c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:14.655807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9b5a9-11f5-4629-96d0-5c75d19cda89 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:14.656685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9b5a9-11f5-4629-96d0-5c75d19cda89 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:14.662558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9b5a9-11f5-4629-96d0-5c75d19cda89 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:14.662893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9b5a9-11f5-4629-96d0-5c75d19cda89 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:14.663424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9b5a9-11f5-4629-96d0-5c75d19cda89 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:14.670821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9b5a9-11f5-4629-96d0-5c75d19cda89 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:14.682391 n-d-850468-20 devstack@keystone.service[82161]: WARNING keystone.server.flask.common [None req-92a9b5a9-11f5-4629-96d0-5c75d19cda89 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 28 18:38:14.757346 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2239/4495] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:38:14.764418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478aab4-8d7d-4565-be42-4c79c3cdb8ab None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:14.764973 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2257/4496] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:14 2022] POST /identity/v3/projects => generated 360 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:14.768346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478aab4-8d7d-4565-be42-4c79c3cdb8ab None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:14.768759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478aab4-8d7d-4565-be42-4c79c3cdb8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:14.770027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9b5a9-11f5-4629-96d0-5c75d19cda89 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:14.773598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-92a9b5a9-11f5-4629-96d0-5c75d19cda89 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:14.784201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:14.806672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d478aab4-8d7d-4565-be42-4c79c3cdb8ab None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:14.811231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d478aab4-8d7d-4565-be42-4c79c3cdb8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:14.954473 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2240/4497] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:14.955503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478aab4-8d7d-4565-be42-4c79c3cdb8ab None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:14.958611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9b5a9-11f5-4629-96d0-5c75d19cda89 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:14.970380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa135832-af9a-473c-935a-93cfbed7fdae tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:14.971211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa135832-af9a-473c-935a-93cfbed7fdae tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:14.971681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa135832-af9a-473c-935a-93cfbed7fdae tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:14.972245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa135832-af9a-473c-935a-93cfbed7fdae tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:14.973064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa135832-af9a-473c-935a-93cfbed7fdae tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:14.984332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478aab4-8d7d-4565-be42-4c79c3cdb8ab None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:14.989620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb67e4-84ea-4437-8ac0-5e4020f92078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:14.990024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa135832-af9a-473c-935a-93cfbed7fdae tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:14.990257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb67e4-84ea-4437-8ac0-5e4020f92078 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:14.990953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb67e4-84ea-4437-8ac0-5e4020f92078 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:14.991273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb67e4-84ea-4437-8ac0-5e4020f92078 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:14.992464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb67e4-84ea-4437-8ac0-5e4020f92078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:14.992464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb67e4-84ea-4437-8ac0-5e4020f92078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:14.993919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb67e4-84ea-4437-8ac0-5e4020f92078 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:15.027008 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2241/4498] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:15.027972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb67e4-84ea-4437-8ac0-5e4020f92078 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:15.041280 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2258/4499] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:14 2022] POST /identity/v3/users => generated 413 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:15.042742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa135832-af9a-473c-935a-93cfbed7fdae tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:15.049221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb67e4-84ea-4437-8ac0-5e4020f92078 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:15.057796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa135832-af9a-473c-935a-93cfbed7fdae tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:15.061184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366bfdb-0b3f-416c-8b19-8b2435294395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:15.061918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366bfdb-0b3f-416c-8b19-8b2435294395 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:15.063006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366bfdb-0b3f-416c-8b19-8b2435294395 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:15.063006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366bfdb-0b3f-416c-8b19-8b2435294395 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:15.063200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366bfdb-0b3f-416c-8b19-8b2435294395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:15.067218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293284a-05e5-4c89-81db-282847ecd747 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:15.067937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293284a-05e5-4c89-81db-282847ecd747 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:15.068315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293284a-05e5-4c89-81db-282847ecd747 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:15.068624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293284a-05e5-4c89-81db-282847ecd747 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/users/2dac35198d0541feb27d9ff3363add8f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:15.068973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366bfdb-0b3f-416c-8b19-8b2435294395 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:15.095457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293284a-05e5-4c89-81db-282847ecd747 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:get_user(user_id=2dac35198d0541feb27d9ff3363add8f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:15.100845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293284a-05e5-4c89-81db-282847ecd747 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:15.104303 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2259/4500] 10.222.0.27 () {58 vars in 1221 bytes} [Sun Aug 28 18:38:15 2022] GET /identity/v3/users/2dac35198d0541feb27d9ff3363add8f => generated 413 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:15.112036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293284a-05e5-4c89-81db-282847ecd747 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:15.131084 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2242/4501] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:15 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:15.132110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366bfdb-0b3f-416c-8b19-8b2435294395 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:15.139063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293284a-05e5-4c89-81db-282847ecd747 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:15.288867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367bf0d-9be4-44b9-a38d-9e8d2ff67947 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:15.289537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367bf0d-9be4-44b9-a38d-9e8d2ff67947 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:15.289824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367bf0d-9be4-44b9-a38d-9e8d2ff67947 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:15.290106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367bf0d-9be4-44b9-a38d-9e8d2ff67947 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/users/2dac35198d0541feb27d9ff3363add8f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:15.292380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367bf0d-9be4-44b9-a38d-9e8d2ff67947 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2dac35198d0541feb27d9ff3363add8f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:15.294686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367bf0d-9be4-44b9-a38d-9e8d2ff67947 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:15.313788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366bfdb-0b3f-416c-8b19-8b2435294395 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:15.326049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9193d3-b70f-4e96-a0d1-67c3d07187b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:15.326690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9193d3-b70f-4e96-a0d1-67c3d07187b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:15.327193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:15.327428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9193d3-b70f-4e96-a0d1-67c3d07187b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:15.327717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9193d3-b70f-4e96-a0d1-67c3d07187b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:15.328554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9193d3-b70f-4e96-a0d1-67c3d07187b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:15.330821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9193d3-b70f-4e96-a0d1-67c3d07187b2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:15.374656 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2243/4502] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:15 2022] POST /identity/v3/users => generated 291 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:15.376991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9193d3-b70f-4e96-a0d1-67c3d07187b2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:15.397195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4367bf0d-9be4-44b9-a38d-9e8d2ff67947 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dac35198d0541feb27d9ff3363add8f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:15.398895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4367bf0d-9be4-44b9-a38d-9e8d2ff67947 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dac35198d0541feb27d9ff3363add8f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:15.405352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9193d3-b70f-4e96-a0d1-67c3d07187b2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:15.411814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a177d-c880-42ee-bec0-93ab697d494f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:15.412845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a177d-c880-42ee-bec0-93ab697d494f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:15.413328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a177d-c880-42ee-bec0-93ab697d494f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:15.413754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a177d-c880-42ee-bec0-93ab697d494f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:15.414598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a177d-c880-42ee-bec0-93ab697d494f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:15.416992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a177d-c880-42ee-bec0-93ab697d494f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:15.430648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4367bf0d-9be4-44b9-a38d-9e8d2ff67947 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dac35198d0541feb27d9ff3363add8f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:15.435348 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2244/4503] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:15.435348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a177d-c880-42ee-bec0-93ab697d494f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:15.436353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b68a177d-c880-42ee-bec0-93ab697d494f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:15.441552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4367bf0d-9be4-44b9-a38d-9e8d2ff67947 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dac35198d0541feb27d9ff3363add8f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:15.451171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a177d-c880-42ee-bec0-93ab697d494f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:15.456364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b203f-21fd-46be-9822-8b786725f3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:15.457098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b203f-21fd-46be-9822-8b786725f3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:15.457357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b203f-21fd-46be-9822-8b786725f3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:15.457629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b203f-21fd-46be-9822-8b786725f3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:15.458279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b203f-21fd-46be-9822-8b786725f3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:15.460104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b203f-21fd-46be-9822-8b786725f3a0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:15.460639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4367bf0d-9be4-44b9-a38d-9e8d2ff67947 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dac35198d0541feb27d9ff3363add8f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:15.469959 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2260/4504] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:15 2022] DELETE /identity/v3/users/2dac35198d0541feb27d9ff3363add8f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:15.474117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367bf0d-9be4-44b9-a38d-9e8d2ff67947 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:15.480065 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2245/4505] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:15.481873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b203f-21fd-46be-9822-8b786725f3a0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:15.492814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4367bf0d-9be4-44b9-a38d-9e8d2ff67947 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:15.494813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b203f-21fd-46be-9822-8b786725f3a0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:15.564499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:15.622137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382fafb-54ee-4bdc-83de-d472fc2929d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:15.623631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382fafb-54ee-4bdc-83de-d472fc2929d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:15.624300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382fafb-54ee-4bdc-83de-d472fc2929d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:15.624797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382fafb-54ee-4bdc-83de-d472fc2929d1 admin admin] PATH_INFO: `/v3/projects/024fabea2d6b4689aa2a05a01dbf9a02/users/86904c91778040c496be7e7ac440f564/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:15.662540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382fafb-54ee-4bdc-83de-d472fc2929d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=024fabea2d6b4689aa2a05a01dbf9a02, user_id=86904c91778040c496be7e7ac440f564, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:15.669809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382fafb-54ee-4bdc-83de-d472fc2929d1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:15.683506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367bf0d-9be4-44b9-a38d-9e8d2ff67947 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:15.691757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:15.692978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:15.693358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:15.693779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/63e9533740e94c43a4a03dd1af48d9e7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:15.695399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:delete_project(project_id=63e9533740e94c43a4a03dd1af48d9e7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:15.697616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:15.702091 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2246/4506] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:15 2022] PUT /identity/v3/projects/024fabea2d6b4689aa2a05a01dbf9a02/users/86904c91778040c496be7e7ac440f564/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:15.708164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec92566-1119-42eb-830b-7e5be63799cc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:15.708467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec92566-1119-42eb-830b-7e5be63799cc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:15.708748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec92566-1119-42eb-830b-7e5be63799cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:15.741825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9ec92566-1119-42eb-830b-7e5be63799cc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:15.743164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9ec92566-1119-42eb-830b-7e5be63799cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:15.800611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e9533740e94c43a4a03dd1af48d9e7', 'request_id': 'req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:15.811897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e9533740e94c43a4a03dd1af48d9e7', 'request_id': 'req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:15.823275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e9533740e94c43a4a03dd1af48d9e7', 'request_id': 'req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:15.832757 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2247/4507] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:38:15.837449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] The token cache is being invalidate because project 63e9533740e94c43a4a03dd1af48d9e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:15.837747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:15.838496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:15.839215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec92566-1119-42eb-830b-7e5be63799cc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:15.841415 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2261/4508] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:15 2022] DELETE /identity/v3/projects/63e9533740e94c43a4a03dd1af48d9e7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:15.846007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9ec92566-1119-42eb-830b-7e5be63799cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:15.846261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:15.848303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:15.878682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:15.946389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283b7fa-a7d0-4288-97ad-7338b5de9cfe tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:15.961426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec92566-1119-42eb-830b-7e5be63799cc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:15.964224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eb783-9690-4506-8a83-4ced2c2dcadb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:15.964931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eb783-9690-4506-8a83-4ced2c2dcadb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:15.965213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eb783-9690-4506-8a83-4ced2c2dcadb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:15.965524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eb783-9690-4506-8a83-4ced2c2dcadb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:15.966497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8eb783-9690-4506-8a83-4ced2c2dcadb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:15.971738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8eb783-9690-4506-8a83-4ced2c2dcadb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:16.006556 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2262/4509] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:15 2022] POST /identity/v3/projects => generated 349 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:16.011223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eb783-9690-4506-8a83-4ced2c2dcadb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:16.067824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bbc37-7657-43d6-9c72-01ea274c9f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:16.068454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bbc37-7657-43d6-9c72-01ea274c9f9b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:16.068743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bbc37-7657-43d6-9c72-01ea274c9f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:16.069019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bbc37-7657-43d6-9c72-01ea274c9f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:16.071082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-772bbc37-7657-43d6-9c72-01ea274c9f9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:16.134869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:16.161483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eb783-9690-4506-8a83-4ced2c2dcadb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:16.167999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e509fc7-187e-4b65-b0c5-5c231cba758e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:16.169145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e509fc7-187e-4b65-b0c5-5c231cba758e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:16.169482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e509fc7-187e-4b65-b0c5-5c231cba758e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:16.169897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e509fc7-187e-4b65-b0c5-5c231cba758e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:16.170837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e509fc7-187e-4b65-b0c5-5c231cba758e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:16.171527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e509fc7-187e-4b65-b0c5-5c231cba758e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:16.173690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e509fc7-187e-4b65-b0c5-5c231cba758e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:16.197627 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2263/4510] 10.222.0.27 () {58 vars in 1160 bytes} [Sun Aug 28 18:38:16 2022] GET /identity/v3/projects?is_domain=True => generated 1021 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:16.199184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e509fc7-187e-4b65-b0c5-5c231cba758e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:16.211477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e509fc7-187e-4b65-b0c5-5c231cba758e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:16.217850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f02fa-1edc-4e80-9855-76f22def61ec tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:16.219060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f02fa-1edc-4e80-9855-76f22def61ec tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:16.219478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f02fa-1edc-4e80-9855-76f22def61ec tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:16.219942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f02fa-1edc-4e80-9855-76f22def61ec tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:16.220746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f02fa-1edc-4e80-9855-76f22def61ec tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:16.222956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f02fa-1edc-4e80-9855-76f22def61ec tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:16.225956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bbc37-7657-43d6-9c72-01ea274c9f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:16.232875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bbc37-7657-43d6-9c72-01ea274c9f9b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:16.240023 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2264/4511] 10.222.0.27 () {58 vars in 1128 bytes} [Sun Aug 28 18:38:16 2022] GET /identity/v3/domains => generated 830 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:16.244026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f02fa-1edc-4e80-9855-76f22def61ec tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:16.258411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f02fa-1edc-4e80-9855-76f22def61ec tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:16.260004 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2248/4512] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:16.264579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09c0c8-1c7d-4546-8db3-a40c9fe5b9d1 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:16.265376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09c0c8-1c7d-4546-8db3-a40c9fe5b9d1 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:16.265773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09c0c8-1c7d-4546-8db3-a40c9fe5b9d1 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:16.266136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09c0c8-1c7d-4546-8db3-a40c9fe5b9d1 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/5fe2e54dcbfd4685ab3c95d3006b4345` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:16.267672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09c0c8-1c7d-4546-8db3-a40c9fe5b9d1 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:update_project(project_id=5fe2e54dcbfd4685ab3c95d3006b4345)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:16.269308 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-6c09c0c8-1c7d-4546-8db3-a40c9fe5b9d1 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:38:16.269308 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:38:16.269308 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:38:16.270553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09c0c8-1c7d-4546-8db3-a40c9fe5b9d1 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:16.285002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c09c0c8-1c7d-4546-8db3-a40c9fe5b9d1 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5fe2e54dcbfd4685ab3c95d3006b4345'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:16.285944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c09c0c8-1c7d-4546-8db3-a40c9fe5b9d1 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5fe2e54dcbfd4685ab3c95d3006b4345'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:16.320522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c09c0c8-1c7d-4546-8db3-a40c9fe5b9d1 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5fe2e54dcbfd4685ab3c95d3006b4345'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:16.321311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c09c0c8-1c7d-4546-8db3-a40c9fe5b9d1 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5fe2e54dcbfd4685ab3c95d3006b4345'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:16.324969 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2265/4513] 10.222.0.27 () {60 vars in 1252 bytes} [Sun Aug 28 18:38:16 2022] PATCH /identity/v3/projects/5fe2e54dcbfd4685ab3c95d3006b4345 => generated 363 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:16.329033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bbc37-7657-43d6-9c72-01ea274c9f9b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:16.343820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bbc37-7657-43d6-9c72-01ea274c9f9b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:16.443585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:16.445171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:16.445474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:16.445761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/5fe2e54dcbfd4685ab3c95d3006b4345` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:16.459604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5fe2e54dcbfd4685ab3c95d3006b4345)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:16.461412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:16.487679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5fe2e54dcbfd4685ab3c95d3006b4345'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:16.500258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5fe2e54dcbfd4685ab3c95d3006b4345'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:16.556114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe2e54dcbfd4685ab3c95d3006b4345', 'request_id': 'req-66591e1c-ce89-4049-97eb-c44c5d60619d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:16.566285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe2e54dcbfd4685ab3c95d3006b4345', 'request_id': 'req-66591e1c-ce89-4049-97eb-c44c5d60619d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:16.573641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe2e54dcbfd4685ab3c95d3006b4345', 'request_id': 'req-66591e1c-ce89-4049-97eb-c44c5d60619d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:16.595915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] The token cache is being invalidate because project 5fe2e54dcbfd4685ab3c95d3006b4345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:16.596280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:16.597059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:16.610440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5fe2e54dcbfd4685ab3c95d3006b4345', 'request_id': 'req-66591e1c-ce89-4049-97eb-c44c5d60619d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:16.615107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5fe2e54dcbfd4685ab3c95d3006b4345', 'request_id': 'req-66591e1c-ce89-4049-97eb-c44c5d60619d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:16.615899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5fe2e54dcbfd4685ab3c95d3006b4345', 'request_id': 'req-66591e1c-ce89-4049-97eb-c44c5d60619d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:16.625316 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2249/4514] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:16 2022] DELETE /identity/v3/projects/5fe2e54dcbfd4685ab3c95d3006b4345 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:16.631509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09c0c8-1c7d-4546-8db3-a40c9fe5b9d1 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:16.633529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6c09c0c8-1c7d-4546-8db3-a40c9fe5b9d1 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:16.650473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09c0c8-1c7d-4546-8db3-a40c9fe5b9d1 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:16.738771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e420c52-13f6-4116-bd9e-9686048b3a09 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:16.740284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e420c52-13f6-4116-bd9e-9686048b3a09 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:16.740702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e420c52-13f6-4116-bd9e-9686048b3a09 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:16.741163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e420c52-13f6-4116-bd9e-9686048b3a09 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:16.742109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e420c52-13f6-4116-bd9e-9686048b3a09 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:16.758511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e420c52-13f6-4116-bd9e-9686048b3a09 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:16.789771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:16.847199 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2266/4515] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:16 2022] POST /identity/v3/projects => generated 360 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:16.848628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:16.850873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:16.866811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:16.879608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66591e1c-ce89-4049-97eb-c44c5d60619d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:17.124581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a14d4-4169-48cb-a711-925e27552b96 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:17.125393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a14d4-4169-48cb-a711-925e27552b96 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:17.125740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a14d4-4169-48cb-a711-925e27552b96 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:17.126123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a14d4-4169-48cb-a711-925e27552b96 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/15c89e6a15924487b78f542c62060576` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:17.128276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a14d4-4169-48cb-a711-925e27552b96 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:get_project(project_id=15c89e6a15924487b78f542c62060576)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:17.131671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a14d4-4169-48cb-a711-925e27552b96 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:17.134088 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2250/4516] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:38:16 2022] GET /identity/v3/projects/15c89e6a15924487b78f542c62060576 => generated 360 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:17.139201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e420c52-13f6-4116-bd9e-9686048b3a09 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:17.161674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e420c52-13f6-4116-bd9e-9686048b3a09 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:17.168203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d375dfc-95c0-4b37-a8c9-cedf7e593ebd tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:17.168990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d375dfc-95c0-4b37-a8c9-cedf7e593ebd tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:17.171009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d375dfc-95c0-4b37-a8c9-cedf7e593ebd tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:17.171428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d375dfc-95c0-4b37-a8c9-cedf7e593ebd tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/15c89e6a15924487b78f542c62060576` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:17.174963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d375dfc-95c0-4b37-a8c9-cedf7e593ebd tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:delete_project(project_id=15c89e6a15924487b78f542c62060576)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:17.177421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d375dfc-95c0-4b37-a8c9-cedf7e593ebd tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:17.267512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d375dfc-95c0-4b37-a8c9-cedf7e593ebd tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c89e6a15924487b78f542c62060576', 'request_id': 'req-8d375dfc-95c0-4b37-a8c9-cedf7e593ebd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:17.289314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d375dfc-95c0-4b37-a8c9-cedf7e593ebd tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c89e6a15924487b78f542c62060576', 'request_id': 'req-8d375dfc-95c0-4b37-a8c9-cedf7e593ebd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:17.300220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d375dfc-95c0-4b37-a8c9-cedf7e593ebd tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c89e6a15924487b78f542c62060576', 'request_id': 'req-8d375dfc-95c0-4b37-a8c9-cedf7e593ebd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:17.315212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d375dfc-95c0-4b37-a8c9-cedf7e593ebd tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] The token cache is being invalidate because project 15c89e6a15924487b78f542c62060576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:17.315941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d375dfc-95c0-4b37-a8c9-cedf7e593ebd tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:17.316758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d375dfc-95c0-4b37-a8c9-cedf7e593ebd tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:17.319298 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2267/4517] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:17 2022] DELETE /identity/v3/projects/15c89e6a15924487b78f542c62060576 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:17.323800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a14d4-4169-48cb-a711-925e27552b96 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:17.326100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-623a14d4-4169-48cb-a711-925e27552b96 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:17.361195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a14d4-4169-48cb-a711-925e27552b96 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:17.488059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72278174-24d3-4c1b-89db-1d4f899607ef tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:17.489701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72278174-24d3-4c1b-89db-1d4f899607ef tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:17.489988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72278174-24d3-4c1b-89db-1d4f899607ef tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:17.490271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72278174-24d3-4c1b-89db-1d4f899607ef tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:17.493700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72278174-24d3-4c1b-89db-1d4f899607ef tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:17.497924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72278174-24d3-4c1b-89db-1d4f899607ef tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:17.581680 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2251/4518] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:17 2022] POST /identity/v3/projects => generated 359 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:17.584615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d375dfc-95c0-4b37-a8c9-cedf7e593ebd tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:17.600197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d375dfc-95c0-4b37-a8c9-cedf7e593ebd tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:17.752395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bf9ae-b32a-40b8-a10e-4424b6c05456 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:17.753776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bf9ae-b32a-40b8-a10e-4424b6c05456 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:17.754173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bf9ae-b32a-40b8-a10e-4424b6c05456 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:17.754559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bf9ae-b32a-40b8-a10e-4424b6c05456 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/27391b0f734d446095ee0e7d975f53c0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:17.756025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bf9ae-b32a-40b8-a10e-4424b6c05456 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:get_project(project_id=27391b0f734d446095ee0e7d975f53c0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:17.760422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bf9ae-b32a-40b8-a10e-4424b6c05456 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:17.771475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72278174-24d3-4c1b-89db-1d4f899607ef tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:17.771763 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2268/4519] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:38:17 2022] GET /identity/v3/projects/27391b0f734d446095ee0e7d975f53c0 => generated 359 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:17.793680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72278174-24d3-4c1b-89db-1d4f899607ef tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:17.799525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41278bf2-e855-4b69-a89d-164a29ad190a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:17.800371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41278bf2-e855-4b69-a89d-164a29ad190a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:17.800710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41278bf2-e855-4b69-a89d-164a29ad190a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:17.800983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41278bf2-e855-4b69-a89d-164a29ad190a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/27391b0f734d446095ee0e7d975f53c0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:17.804155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41278bf2-e855-4b69-a89d-164a29ad190a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:delete_project(project_id=27391b0f734d446095ee0e7d975f53c0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:17.806798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41278bf2-e855-4b69-a89d-164a29ad190a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:17.933314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-41278bf2-e855-4b69-a89d-164a29ad190a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27391b0f734d446095ee0e7d975f53c0', 'request_id': 'req-41278bf2-e855-4b69-a89d-164a29ad190a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:17.958106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-41278bf2-e855-4b69-a89d-164a29ad190a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27391b0f734d446095ee0e7d975f53c0', 'request_id': 'req-41278bf2-e855-4b69-a89d-164a29ad190a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:17.969523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-41278bf2-e855-4b69-a89d-164a29ad190a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27391b0f734d446095ee0e7d975f53c0', 'request_id': 'req-41278bf2-e855-4b69-a89d-164a29ad190a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:17.992770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-41278bf2-e855-4b69-a89d-164a29ad190a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] The token cache is being invalidate because project 27391b0f734d446095ee0e7d975f53c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:17.993145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-41278bf2-e855-4b69-a89d-164a29ad190a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:17.995194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-41278bf2-e855-4b69-a89d-164a29ad190a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:18.000326 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2252/4520] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:17 2022] DELETE /identity/v3/projects/27391b0f734d446095ee0e7d975f53c0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:18.005849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bf9ae-b32a-40b8-a10e-4424b6c05456 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:18.008083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f47bf9ae-b32a-40b8-a10e-4424b6c05456 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:18.041052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bf9ae-b32a-40b8-a10e-4424b6c05456 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:18.122979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc75ad-6a76-4620-9e58-724830ae9c64 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:18.124626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc75ad-6a76-4620-9e58-724830ae9c64 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:18.124932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc75ad-6a76-4620-9e58-724830ae9c64 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:18.125218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc75ad-6a76-4620-9e58-724830ae9c64 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:18.125876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc75ad-6a76-4620-9e58-724830ae9c64 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:18.128319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc75ad-6a76-4620-9e58-724830ae9c64 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:18.162912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:18.183679 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2269/4521] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:38:18 2022] POST /identity/v3/projects => generated 347 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:18.185836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41278bf2-e855-4b69-a89d-164a29ad190a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:18.198864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41278bf2-e855-4b69-a89d-164a29ad190a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:18.214759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:18.309484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d41b9-a62a-427c-bf40-861762cf9672 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:18.310729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d41b9-a62a-427c-bf40-861762cf9672 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:18.312360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d41b9-a62a-427c-bf40-861762cf9672 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:18.312839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d41b9-a62a-427c-bf40-861762cf9672 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/b97bacd0242246e6af7d5b56e182c540` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:18.314657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d41b9-a62a-427c-bf40-861762cf9672 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:get_project(project_id=b97bacd0242246e6af7d5b56e182c540)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:18.318021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d41b9-a62a-427c-bf40-861762cf9672 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:18.322238 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2253/4522] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:38:18 2022] GET /identity/v3/projects/b97bacd0242246e6af7d5b56e182c540 => generated 347 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:38:18.327304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc75ad-6a76-4620-9e58-724830ae9c64 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:18.358504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc75ad-6a76-4620-9e58-724830ae9c64 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:18.374127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fbbad-da47-487f-84d8-5724ada80e17 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:18.375099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fbbad-da47-487f-84d8-5724ada80e17 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:18.375539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fbbad-da47-487f-84d8-5724ada80e17 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:18.379689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fbbad-da47-487f-84d8-5724ada80e17 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/b97bacd0242246e6af7d5b56e182c540` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:18.382271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fbbad-da47-487f-84d8-5724ada80e17 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b97bacd0242246e6af7d5b56e182c540)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:18.385504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fbbad-da47-487f-84d8-5724ada80e17 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:18.512175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a7fbbad-da47-487f-84d8-5724ada80e17 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97bacd0242246e6af7d5b56e182c540', 'request_id': 'req-6a7fbbad-da47-487f-84d8-5724ada80e17'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:18.529091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a7fbbad-da47-487f-84d8-5724ada80e17 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97bacd0242246e6af7d5b56e182c540', 'request_id': 'req-6a7fbbad-da47-487f-84d8-5724ada80e17'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:18.536041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a7fbbad-da47-487f-84d8-5724ada80e17 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97bacd0242246e6af7d5b56e182c540', 'request_id': 'req-6a7fbbad-da47-487f-84d8-5724ada80e17'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:18.559314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a7fbbad-da47-487f-84d8-5724ada80e17 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] The token cache is being invalidate because project b97bacd0242246e6af7d5b56e182c540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:18.560347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a7fbbad-da47-487f-84d8-5724ada80e17 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:18.571857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a7fbbad-da47-487f-84d8-5724ada80e17 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:18.573987 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2270/4523] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:18 2022] DELETE /identity/v3/projects/b97bacd0242246e6af7d5b56e182c540 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:18.579670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d41b9-a62a-427c-bf40-861762cf9672 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:18.581579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3f9d41b9-a62a-427c-bf40-861762cf9672 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:18.597403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d41b9-a62a-427c-bf40-861762cf9672 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:18.709266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc55c65-3310-4ad6-999c-cbcd2a3c7df6 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:18.709899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc55c65-3310-4ad6-999c-cbcd2a3c7df6 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:18.710187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc55c65-3310-4ad6-999c-cbcd2a3c7df6 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:18.710473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc55c65-3310-4ad6-999c-cbcd2a3c7df6 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:18.711125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc55c65-3310-4ad6-999c-cbcd2a3c7df6 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:18.733849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc55c65-3310-4ad6-999c-cbcd2a3c7df6 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:18.772924 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2254/4524] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:38:18 2022] POST /identity/v3/domains => generated 274 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:18.777718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fbbad-da47-487f-84d8-5724ada80e17 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:18.789464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fbbad-da47-487f-84d8-5724ada80e17 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:18.891544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9a5d1-b473-4229-8282-0029e117a36e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:18.893391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9a5d1-b473-4229-8282-0029e117a36e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:18.893731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9a5d1-b473-4229-8282-0029e117a36e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:18.894018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9a5d1-b473-4229-8282-0029e117a36e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:18.894695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9a5d1-b473-4229-8282-0029e117a36e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:18.896673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9a5d1-b473-4229-8282-0029e117a36e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:19.010383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc55c65-3310-4ad6-999c-cbcd2a3c7df6 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:19.011447 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2271/4525] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:18 2022] POST /identity/v3/projects => generated 404 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:19.044322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc55c65-3310-4ad6-999c-cbcd2a3c7df6 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:19.186269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509583a-0b75-4967-b23f-360e911d2a94 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:19.187016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509583a-0b75-4967-b23f-360e911d2a94 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:19.187343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509583a-0b75-4967-b23f-360e911d2a94 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:19.187623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509583a-0b75-4967-b23f-360e911d2a94 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/2b6ca147c9954b08b2b71f6e359742cf` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:19.189236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509583a-0b75-4967-b23f-360e911d2a94 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:get_project(project_id=2b6ca147c9954b08b2b71f6e359742cf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:19.191162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509583a-0b75-4967-b23f-360e911d2a94 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:19.193471 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2255/4526] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:38:19 2022] GET /identity/v3/projects/2b6ca147c9954b08b2b71f6e359742cf => generated 404 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:19.197426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9a5d1-b473-4229-8282-0029e117a36e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:19.214124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9a5d1-b473-4229-8282-0029e117a36e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:19.225958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2cbb9-1c8b-47ec-9df3-887ec52c829b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:19.226638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2cbb9-1c8b-47ec-9df3-887ec52c829b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:19.226920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2cbb9-1c8b-47ec-9df3-887ec52c829b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:19.227196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2cbb9-1c8b-47ec-9df3-887ec52c829b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/2b6ca147c9954b08b2b71f6e359742cf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:19.232812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2cbb9-1c8b-47ec-9df3-887ec52c829b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2b6ca147c9954b08b2b71f6e359742cf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:19.239025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2cbb9-1c8b-47ec-9df3-887ec52c829b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:19.347976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8af2cbb9-1c8b-47ec-9df3-887ec52c829b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b6ca147c9954b08b2b71f6e359742cf', 'request_id': 'req-8af2cbb9-1c8b-47ec-9df3-887ec52c829b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:19.351850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:19.362868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8af2cbb9-1c8b-47ec-9df3-887ec52c829b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b6ca147c9954b08b2b71f6e359742cf', 'request_id': 'req-8af2cbb9-1c8b-47ec-9df3-887ec52c829b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:19.374215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8af2cbb9-1c8b-47ec-9df3-887ec52c829b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b6ca147c9954b08b2b71f6e359742cf', 'request_id': 'req-8af2cbb9-1c8b-47ec-9df3-887ec52c829b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:19.390679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8af2cbb9-1c8b-47ec-9df3-887ec52c829b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] The token cache is being invalidate because project 2b6ca147c9954b08b2b71f6e359742cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:19.390970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8af2cbb9-1c8b-47ec-9df3-887ec52c829b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:19.391672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8af2cbb9-1c8b-47ec-9df3-887ec52c829b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:19.396518 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2272/4527] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:19 2022] DELETE /identity/v3/projects/2b6ca147c9954b08b2b71f6e359742cf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:19.397987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509583a-0b75-4967-b23f-360e911d2a94 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:19.400058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a509583a-0b75-4967-b23f-360e911d2a94 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:19.455500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509583a-0b75-4967-b23f-360e911d2a94 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:19.606367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:19.632322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97cefa-3909-47f3-abe8-4835b4d1929e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:19.633325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97cefa-3909-47f3-abe8-4835b4d1929e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:19.633851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97cefa-3909-47f3-abe8-4835b4d1929e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:19.634663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97cefa-3909-47f3-abe8-4835b4d1929e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/domains/4e26917d6ce3449aae2f6e440151ad05` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:19.637187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97cefa-3909-47f3-abe8-4835b4d1929e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4e26917d6ce3449aae2f6e440151ad05)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:19.639158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97cefa-3909-47f3-abe8-4835b4d1929e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:19.724540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db97cefa-3909-47f3-abe8-4835b4d1929e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4e26917d6ce3449aae2f6e440151ad05'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:19.729798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db97cefa-3909-47f3-abe8-4835b4d1929e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4e26917d6ce3449aae2f6e440151ad05'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:19.789176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db97cefa-3909-47f3-abe8-4835b4d1929e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4e26917d6ce3449aae2f6e440151ad05'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:19.790937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db97cefa-3909-47f3-abe8-4835b4d1929e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4e26917d6ce3449aae2f6e440151ad05'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:19.798145 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2256/4528] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:38:19 2022] PATCH /identity/v3/domains/4e26917d6ce3449aae2f6e440151ad05 => generated 275 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:19.802266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2cbb9-1c8b-47ec-9df3-887ec52c829b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:19.823176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2cbb9-1c8b-47ec-9df3-887ec52c829b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:19.835704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ac304-ea04-4b9e-b5f6-83356f3d8e86 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:19.836150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ac304-ea04-4b9e-b5f6-83356f3d8e86 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:19.836278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ac304-ea04-4b9e-b5f6-83356f3d8e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:19.876358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f95ac304-ea04-4b9e-b5f6-83356f3d8e86 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:19.877613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f95ac304-ea04-4b9e-b5f6-83356f3d8e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:19.942280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:19.943678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:19.943678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:19.943678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/domains/4e26917d6ce3449aae2f6e440151ad05` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:19.972652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4e26917d6ce3449aae2f6e440151ad05)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:19.974555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:20.004300 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2257/4529] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:38:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:20.017705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ac304-ea04-4b9e-b5f6-83356f3d8e86 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:20.019450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f95ac304-ea04-4b9e-b5f6-83356f3d8e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:20.043860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4e26917d6ce3449aae2f6e440151ad05'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:20.092881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4e26917d6ce3449aae2f6e440151ad05'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:20.184246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e26917d6ce3449aae2f6e440151ad05', 'request_id': 'req-51270da2-69a7-44b7-a329-9493358fde82'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:20.196655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ac304-ea04-4b9e-b5f6-83356f3d8e86 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:20.206084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e26917d6ce3449aae2f6e440151ad05', 'request_id': 'req-51270da2-69a7-44b7-a329-9493358fde82'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:20.215395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e26917d6ce3449aae2f6e440151ad05', 'request_id': 'req-51270da2-69a7-44b7-a329-9493358fde82'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:20.246631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] The token cache is being invalidate because project 4e26917d6ce3449aae2f6e440151ad05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:20.247041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:20.249089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:20.275050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4e26917d6ce3449aae2f6e440151ad05', 'request_id': 'req-51270da2-69a7-44b7-a329-9493358fde82'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:20.277777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4e26917d6ce3449aae2f6e440151ad05', 'request_id': 'req-51270da2-69a7-44b7-a329-9493358fde82'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:20.285178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4e26917d6ce3449aae2f6e440151ad05', 'request_id': 'req-51270da2-69a7-44b7-a329-9493358fde82'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:20.296903 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2273/4530] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:38:19 2022] DELETE /identity/v3/domains/4e26917d6ce3449aae2f6e440151ad05 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:20.306174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:20.306548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:20.344853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f98181-aa68-41af-b956-bf2cf7351a0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:20.345672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f98181-aa68-41af-b956-bf2cf7351a0d service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:20.346188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f98181-aa68-41af-b956-bf2cf7351a0d service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:20.367357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f98181-aa68-41af-b956-bf2cf7351a0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:20.381189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d4f98181-aa68-41af-b956-bf2cf7351a0d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:20.402379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:20.404532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:20.591291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f98181-aa68-41af-b956-bf2cf7351a0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:20.592788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f98181-aa68-41af-b956-bf2cf7351a0d service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:20.595299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51270da2-69a7-44b7-a329-9493358fde82 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:20.612662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6261aeb-c8d7-4a8f-b619-19acd93d462f tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:20.613709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6261aeb-c8d7-4a8f-b619-19acd93d462f tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:20.614086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6261aeb-c8d7-4a8f-b619-19acd93d462f tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:20.614528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6261aeb-c8d7-4a8f-b619-19acd93d462f tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:20.618613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6261aeb-c8d7-4a8f-b619-19acd93d462f tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:20.622372 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2258/4531] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:38:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:38:20.642245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6261aeb-c8d7-4a8f-b619-19acd93d462f tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:20.706308 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2274/4532] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:38:20 2022] POST /identity/v3/domains => generated 275 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:20.710583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f98181-aa68-41af-b956-bf2cf7351a0d service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:20.740699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f98181-aa68-41af-b956-bf2cf7351a0d service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:20.973558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691f33c-21f0-43b1-ab9d-761e8a833629 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:20.974211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691f33c-21f0-43b1-ab9d-761e8a833629 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:20.974528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691f33c-21f0-43b1-ab9d-761e8a833629 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:20.976161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691f33c-21f0-43b1-ab9d-761e8a833629 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:20.982999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691f33c-21f0-43b1-ab9d-761e8a833629 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:20.988613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691f33c-21f0-43b1-ab9d-761e8a833629 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:21.080649 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2259/4533] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:20 2022] POST /identity/v3/projects => generated 410 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:21.081642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6261aeb-c8d7-4a8f-b619-19acd93d462f tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:21.104299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6261aeb-c8d7-4a8f-b619-19acd93d462f tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:21.251080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7fa7e-5b56-48dc-8532-72a6a310af92 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:21.252050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7fa7e-5b56-48dc-8532-72a6a310af92 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:21.252453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7fa7e-5b56-48dc-8532-72a6a310af92 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:21.252834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7fa7e-5b56-48dc-8532-72a6a310af92 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:21.253633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7fa7e-5b56-48dc-8532-72a6a310af92 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:21.257864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7fa7e-5b56-48dc-8532-72a6a310af92 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:21.345728 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2275/4534] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:21 2022] POST /identity/v3/projects => generated 405 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:21.348960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691f33c-21f0-43b1-ab9d-761e8a833629 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:21.366121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691f33c-21f0-43b1-ab9d-761e8a833629 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:21.533831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494fe37-c439-42a7-8274-1f96b6928593 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:21.534462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494fe37-c439-42a7-8274-1f96b6928593 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:21.534747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494fe37-c439-42a7-8274-1f96b6928593 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:21.535027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494fe37-c439-42a7-8274-1f96b6928593 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/d2854c81bc744d03a4e88d8daf918654` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:21.541363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494fe37-c439-42a7-8274-1f96b6928593 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d2854c81bc744d03a4e88d8daf918654)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:21.543537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494fe37-c439-42a7-8274-1f96b6928593 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:21.645642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:21.681448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5494fe37-c439-42a7-8274-1f96b6928593 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2854c81bc744d03a4e88d8daf918654', 'request_id': 'req-5494fe37-c439-42a7-8274-1f96b6928593'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:21.692694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5494fe37-c439-42a7-8274-1f96b6928593 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2854c81bc744d03a4e88d8daf918654', 'request_id': 'req-5494fe37-c439-42a7-8274-1f96b6928593'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:21.711760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5494fe37-c439-42a7-8274-1f96b6928593 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2854c81bc744d03a4e88d8daf918654', 'request_id': 'req-5494fe37-c439-42a7-8274-1f96b6928593'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:21.741004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5494fe37-c439-42a7-8274-1f96b6928593 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] The token cache is being invalidate because project d2854c81bc744d03a4e88d8daf918654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:21.741590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5494fe37-c439-42a7-8274-1f96b6928593 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:21.742801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5494fe37-c439-42a7-8274-1f96b6928593 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:21.748691 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2260/4535] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:21 2022] DELETE /identity/v3/projects/d2854c81bc744d03a4e88d8daf918654 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:21.750152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7fa7e-5b56-48dc-8532-72a6a310af92 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:21.752263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9f7fa7e-5b56-48dc-8532-72a6a310af92 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:21.793082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7fa7e-5b56-48dc-8532-72a6a310af92 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:22.018395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cd325-f91b-47a0-957a-66191b20c092 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:22.019318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cd325-f91b-47a0-957a-66191b20c092 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:22.019569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cd325-f91b-47a0-957a-66191b20c092 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:22.019953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cd325-f91b-47a0-957a-66191b20c092 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/17f0e1f872fb4ce0b1406e178425fe90` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:22.022022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cd325-f91b-47a0-957a-66191b20c092 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:delete_project(project_id=17f0e1f872fb4ce0b1406e178425fe90)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:22.029423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cd325-f91b-47a0-957a-66191b20c092 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:22.108703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:22.153084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f5cd325-f91b-47a0-957a-66191b20c092 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f0e1f872fb4ce0b1406e178425fe90', 'request_id': 'req-7f5cd325-f91b-47a0-957a-66191b20c092'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:22.176188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f5cd325-f91b-47a0-957a-66191b20c092 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f0e1f872fb4ce0b1406e178425fe90', 'request_id': 'req-7f5cd325-f91b-47a0-957a-66191b20c092'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:22.195133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f5cd325-f91b-47a0-957a-66191b20c092 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f0e1f872fb4ce0b1406e178425fe90', 'request_id': 'req-7f5cd325-f91b-47a0-957a-66191b20c092'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:22.228926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f5cd325-f91b-47a0-957a-66191b20c092 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] The token cache is being invalidate because project 17f0e1f872fb4ce0b1406e178425fe90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:22.229230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f5cd325-f91b-47a0-957a-66191b20c092 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:22.233999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f5cd325-f91b-47a0-957a-66191b20c092 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:22.244930 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2276/4536] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:21 2022] DELETE /identity/v3/projects/17f0e1f872fb4ce0b1406e178425fe90 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:22.247695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494fe37-c439-42a7-8274-1f96b6928593 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:22.278286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494fe37-c439-42a7-8274-1f96b6928593 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:22.447662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c018d0-5b3e-4b9b-a3ea-eb07564226bc tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:22.448564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c018d0-5b3e-4b9b-a3ea-eb07564226bc tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:22.448942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c018d0-5b3e-4b9b-a3ea-eb07564226bc tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:22.449710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c018d0-5b3e-4b9b-a3ea-eb07564226bc tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/domains/3a7895e7e77b44c8be44375cc29f5db4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:22.451279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c018d0-5b3e-4b9b-a3ea-eb07564226bc tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3a7895e7e77b44c8be44375cc29f5db4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:22.453003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c018d0-5b3e-4b9b-a3ea-eb07564226bc tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:22.525531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-37c018d0-5b3e-4b9b-a3ea-eb07564226bc tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3a7895e7e77b44c8be44375cc29f5db4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:22.532996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-37c018d0-5b3e-4b9b-a3ea-eb07564226bc tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3a7895e7e77b44c8be44375cc29f5db4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:22.648034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-37c018d0-5b3e-4b9b-a3ea-eb07564226bc tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3a7895e7e77b44c8be44375cc29f5db4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:22.649799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-37c018d0-5b3e-4b9b-a3ea-eb07564226bc tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3a7895e7e77b44c8be44375cc29f5db4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:22.657660 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2261/4537] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:38:22 2022] PATCH /identity/v3/domains/3a7895e7e77b44c8be44375cc29f5db4 => generated 276 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:22.661784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cd325-f91b-47a0-957a-66191b20c092 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:22.671054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7f5cd325-f91b-47a0-957a-66191b20c092 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:22.689180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cd325-f91b-47a0-957a-66191b20c092 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:22.790572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:22.791245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:22.791617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:22.791905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/domains/3a7895e7e77b44c8be44375cc29f5db4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:22.810744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3a7895e7e77b44c8be44375cc29f5db4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:22.812478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:22.852773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3a7895e7e77b44c8be44375cc29f5db4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:22.865324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3a7895e7e77b44c8be44375cc29f5db4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:22.925126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a7895e7e77b44c8be44375cc29f5db4', 'request_id': 'req-0615f3ee-e299-46ac-9889-2ae132637d5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:22.938184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a7895e7e77b44c8be44375cc29f5db4', 'request_id': 'req-0615f3ee-e299-46ac-9889-2ae132637d5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:22.949609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a7895e7e77b44c8be44375cc29f5db4', 'request_id': 'req-0615f3ee-e299-46ac-9889-2ae132637d5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:22.966376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] The token cache is being invalidate because project 3a7895e7e77b44c8be44375cc29f5db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:22.966674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:22.968890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:22.990644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3a7895e7e77b44c8be44375cc29f5db4', 'request_id': 'req-0615f3ee-e299-46ac-9889-2ae132637d5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:22.994354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3a7895e7e77b44c8be44375cc29f5db4', 'request_id': 'req-0615f3ee-e299-46ac-9889-2ae132637d5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:23.005446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3a7895e7e77b44c8be44375cc29f5db4', 'request_id': 'req-0615f3ee-e299-46ac-9889-2ae132637d5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:23.008550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:23.023615 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2277/4538] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:38:22 2022] DELETE /identity/v3/domains/3a7895e7e77b44c8be44375cc29f5db4 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:23.030516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c018d0-5b3e-4b9b-a3ea-eb07564226bc tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:23.035370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-37c018d0-5b3e-4b9b-a3ea-eb07564226bc tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:23.064652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c018d0-5b3e-4b9b-a3ea-eb07564226bc tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:23.238463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfc295-a80f-4da2-a8eb-8a50359abb5b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:23.240290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfc295-a80f-4da2-a8eb-8a50359abb5b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:23.244226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfc295-a80f-4da2-a8eb-8a50359abb5b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:23.244503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfc295-a80f-4da2-a8eb-8a50359abb5b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:23.245227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfc295-a80f-4da2-a8eb-8a50359abb5b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:23.247714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfc295-a80f-4da2-a8eb-8a50359abb5b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:23.378679 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2262/4539] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:23 2022] POST /identity/v3/projects => generated 378 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:23.382521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:23.385142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:23.406765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615f3ee-e299-46ac-9889-2ae132637d5d tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:23.668604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6122ab-bc84-4ee5-8a74-6f2f017997b3 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:23.669392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6122ab-bc84-4ee5-8a74-6f2f017997b3 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:23.669779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6122ab-bc84-4ee5-8a74-6f2f017997b3 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:23.670166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6122ab-bc84-4ee5-8a74-6f2f017997b3 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/cee03d031bc640278ae6df315902e045` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:23.671810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6122ab-bc84-4ee5-8a74-6f2f017997b3 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:get_project(project_id=cee03d031bc640278ae6df315902e045)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:23.674046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6122ab-bc84-4ee5-8a74-6f2f017997b3 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:23.686346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfc295-a80f-4da2-a8eb-8a50359abb5b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:23.686830 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2278/4540] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:38:23 2022] GET /identity/v3/projects/cee03d031bc640278ae6df315902e045 => generated 378 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:23.693350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:23.703323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfc295-a80f-4da2-a8eb-8a50359abb5b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:23.720333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efe174-135b-4117-b581-52e92b238dee tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:23.721684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efe174-135b-4117-b581-52e92b238dee tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:23.722147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efe174-135b-4117-b581-52e92b238dee tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:23.722677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efe174-135b-4117-b581-52e92b238dee tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:23.723421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efe174-135b-4117-b581-52e92b238dee tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:23.725819 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-87efe174-135b-4117-b581-52e92b238dee tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:38:23.725819 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:38:23.725819 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:38:23.730326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efe174-135b-4117-b581-52e92b238dee tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:23.801893 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2263/4541] 10.222.0.27 () {58 vars in 1131 bytes} [Sun Aug 28 18:38:23 2022] GET /identity/v3/projects => generated 6615 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:23.803701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6122ab-bc84-4ee5-8a74-6f2f017997b3 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:23.821242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6122ab-bc84-4ee5-8a74-6f2f017997b3 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:23.852154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc60db-1363-493f-ace7-58216b64bb41 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:23.852994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc60db-1363-493f-ace7-58216b64bb41 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:23.854691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc60db-1363-493f-ace7-58216b64bb41 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:23.855075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc60db-1363-493f-ace7-58216b64bb41 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/cee03d031bc640278ae6df315902e045` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:23.860837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc60db-1363-493f-ace7-58216b64bb41 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cee03d031bc640278ae6df315902e045)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:23.862916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc60db-1363-493f-ace7-58216b64bb41 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:24.002355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eafc60db-1363-493f-ace7-58216b64bb41 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee03d031bc640278ae6df315902e045', 'request_id': 'req-eafc60db-1363-493f-ace7-58216b64bb41'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:24.022097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eafc60db-1363-493f-ace7-58216b64bb41 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee03d031bc640278ae6df315902e045', 'request_id': 'req-eafc60db-1363-493f-ace7-58216b64bb41'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:24.039334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eafc60db-1363-493f-ace7-58216b64bb41 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee03d031bc640278ae6df315902e045', 'request_id': 'req-eafc60db-1363-493f-ace7-58216b64bb41'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:24.064383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eafc60db-1363-493f-ace7-58216b64bb41 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] The token cache is being invalidate because project cee03d031bc640278ae6df315902e045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:24.068845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eafc60db-1363-493f-ace7-58216b64bb41 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:24.069773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eafc60db-1363-493f-ace7-58216b64bb41 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:24.080871 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2279/4542] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:23 2022] DELETE /identity/v3/projects/cee03d031bc640278ae6df315902e045 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:24.081567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efe174-135b-4117-b581-52e92b238dee tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:24.083861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-87efe174-135b-4117-b581-52e92b238dee tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:24.109917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efe174-135b-4117-b581-52e92b238dee tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:24.293404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7f806-b63d-47e8-87ca-533bcf36fa2b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:24.294216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7f806-b63d-47e8-87ca-533bcf36fa2b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:24.294509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7f806-b63d-47e8-87ca-533bcf36fa2b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:24.294794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7f806-b63d-47e8-87ca-533bcf36fa2b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:24.295480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7f806-b63d-47e8-87ca-533bcf36fa2b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:24.297481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7f806-b63d-47e8-87ca-533bcf36fa2b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:24.361694 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2264/4543] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:38:24 2022] POST /identity/v3/projects => generated 347 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:24.363603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc60db-1363-493f-ace7-58216b64bb41 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:24.380312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc60db-1363-493f-ace7-58216b64bb41 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:24.547816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057fea3-f37d-4e2f-b06b-357a9cea3d28 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:24.548473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057fea3-f37d-4e2f-b06b-357a9cea3d28 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:24.548720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057fea3-f37d-4e2f-b06b-357a9cea3d28 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:24.548990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057fea3-f37d-4e2f-b06b-357a9cea3d28 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/86fdf2a5f0f34c00a8f6acd2c94f509c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:24.551527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057fea3-f37d-4e2f-b06b-357a9cea3d28 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:update_project(project_id=86fdf2a5f0f34c00a8f6acd2c94f509c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:24.556400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057fea3-f37d-4e2f-b06b-357a9cea3d28 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:24.619980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:24.636498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7f806-b63d-47e8-87ca-533bcf36fa2b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:24.638510 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2280/4544] 10.222.0.27 () {60 vars in 1252 bytes} [Sun Aug 28 18:38:24 2022] PATCH /identity/v3/projects/86fdf2a5f0f34c00a8f6acd2c94f509c => generated 362 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:24.657586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7f806-b63d-47e8-87ca-533bcf36fa2b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:24.678943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e5181-295a-403a-b02f-fbc841f72c8a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:24.680182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e5181-295a-403a-b02f-fbc841f72c8a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:24.680182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e5181-295a-403a-b02f-fbc841f72c8a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:24.680419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e5181-295a-403a-b02f-fbc841f72c8a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/86fdf2a5f0f34c00a8f6acd2c94f509c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:24.710086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e5181-295a-403a-b02f-fbc841f72c8a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:get_project(project_id=86fdf2a5f0f34c00a8f6acd2c94f509c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:24.716622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e5181-295a-403a-b02f-fbc841f72c8a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:24.727806 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2265/4545] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:38:24 2022] GET /identity/v3/projects/86fdf2a5f0f34c00a8f6acd2c94f509c => generated 349 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:24.730871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057fea3-f37d-4e2f-b06b-357a9cea3d28 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:24.763358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057fea3-f37d-4e2f-b06b-357a9cea3d28 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:24.796727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73184cc4-7306-4181-8564-65cbd9234a1e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:24.797416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73184cc4-7306-4181-8564-65cbd9234a1e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:24.797849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73184cc4-7306-4181-8564-65cbd9234a1e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:24.798261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73184cc4-7306-4181-8564-65cbd9234a1e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/86fdf2a5f0f34c00a8f6acd2c94f509c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:24.805269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73184cc4-7306-4181-8564-65cbd9234a1e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:delete_project(project_id=86fdf2a5f0f34c00a8f6acd2c94f509c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:24.815564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73184cc4-7306-4181-8564-65cbd9234a1e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:24.984718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-73184cc4-7306-4181-8564-65cbd9234a1e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86fdf2a5f0f34c00a8f6acd2c94f509c', 'request_id': 'req-73184cc4-7306-4181-8564-65cbd9234a1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:25.008641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-73184cc4-7306-4181-8564-65cbd9234a1e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86fdf2a5f0f34c00a8f6acd2c94f509c', 'request_id': 'req-73184cc4-7306-4181-8564-65cbd9234a1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:25.028002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-73184cc4-7306-4181-8564-65cbd9234a1e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86fdf2a5f0f34c00a8f6acd2c94f509c', 'request_id': 'req-73184cc4-7306-4181-8564-65cbd9234a1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:25.088401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-73184cc4-7306-4181-8564-65cbd9234a1e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] The token cache is being invalidate because project 86fdf2a5f0f34c00a8f6acd2c94f509c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:25.098476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-73184cc4-7306-4181-8564-65cbd9234a1e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:25.106171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-73184cc4-7306-4181-8564-65cbd9234a1e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:25.113713 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2281/4546] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:24 2022] DELETE /identity/v3/projects/86fdf2a5f0f34c00a8f6acd2c94f509c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:25.115552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e5181-295a-403a-b02f-fbc841f72c8a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:25.117749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-099e5181-295a-403a-b02f-fbc841f72c8a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:25.140847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e5181-295a-403a-b02f-fbc841f72c8a tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:25.307402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ae857-244a-4d72-bef3-f2ca1fc425f6 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:25.308917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ae857-244a-4d72-bef3-f2ca1fc425f6 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:25.309349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ae857-244a-4d72-bef3-f2ca1fc425f6 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:25.309800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ae857-244a-4d72-bef3-f2ca1fc425f6 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:25.310684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ae857-244a-4d72-bef3-f2ca1fc425f6 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:25.313223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ae857-244a-4d72-bef3-f2ca1fc425f6 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:25.368947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e44037-5fcc-432f-a4dc-2314c6a226ad None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:25.369571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e44037-5fcc-432f-a4dc-2314c6a226ad None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:25.370018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e44037-5fcc-432f-a4dc-2314c6a226ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:25.401296 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2266/4547] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:25 2022] POST /identity/v3/projects => generated 360 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:38:25.409665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ae857-244a-4d72-bef3-f2ca1fc425f6 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:25.452405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-97e44037-5fcc-432f-a4dc-2314c6a226ad None None] MFA Rules not processed for user `86904c91778040c496be7e7ac440f564`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:25.453976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97e44037-5fcc-432f-a4dc-2314c6a226ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:25.560265 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2282/4548] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:25.562059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:25.563798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99668df8-925e-4494-8ff2-ea4d7be1d9a8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:25.564126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99668df8-925e-4494-8ff2-ea4d7be1d9a8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:25.564430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99668df8-925e-4494-8ff2-ea4d7be1d9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:25.586196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ae857-244a-4d72-bef3-f2ca1fc425f6 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:25.596001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611dacb-be15-426d-98cf-ca4667961d57 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:25.596649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611dacb-be15-426d-98cf-ca4667961d57 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:25.596939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611dacb-be15-426d-98cf-ca4667961d57 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:25.597218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611dacb-be15-426d-98cf-ca4667961d57 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/c35811b19efc42aa89ad546fb23e87c4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:25.599691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-99668df8-925e-4494-8ff2-ea4d7be1d9a8 None None] MFA Rules not processed for user `86904c91778040c496be7e7ac440f564`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:25.601406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-99668df8-925e-4494-8ff2-ea4d7be1d9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:25.604536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611dacb-be15-426d-98cf-ca4667961d57 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:update_project(project_id=c35811b19efc42aa89ad546fb23e87c4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:25.615428 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-2611dacb-be15-426d-98cf-ca4667961d57 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:38:25.615428 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:38:25.615428 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:38:25.617051 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2283/4549] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:38:25.618817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611dacb-be15-426d-98cf-ca4667961d57 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:25.624160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99668df8-925e-4494-8ff2-ea4d7be1d9a8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:25.627845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-99668df8-925e-4494-8ff2-ea4d7be1d9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:25.797577 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2267/4550] 10.222.0.27 () {60 vars in 1252 bytes} [Sun Aug 28 18:38:25 2022] PATCH /identity/v3/projects/c35811b19efc42aa89ad546fb23e87c4 => generated 372 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:25.799009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611dacb-be15-426d-98cf-ca4667961d57 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:25.828262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611dacb-be15-426d-98cf-ca4667961d57 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:25.841656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbe2ce-c359-41c6-b7bd-fcc4a93dad7e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:25.842322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbe2ce-c359-41c6-b7bd-fcc4a93dad7e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:25.842605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbe2ce-c359-41c6-b7bd-fcc4a93dad7e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:25.842881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbe2ce-c359-41c6-b7bd-fcc4a93dad7e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/c35811b19efc42aa89ad546fb23e87c4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:25.866974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:25.880732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99668df8-925e-4494-8ff2-ea4d7be1d9a8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:25.885204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fbe2ce-c359-41c6-b7bd-fcc4a93dad7e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:get_project(project_id=c35811b19efc42aa89ad546fb23e87c4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:25.892760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fbe2ce-c359-41c6-b7bd-fcc4a93dad7e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:25.904315 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2268/4551] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:38:25 2022] GET /identity/v3/projects/c35811b19efc42aa89ad546fb23e87c4 => generated 359 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:25.914861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbe2ce-c359-41c6-b7bd-fcc4a93dad7e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:25.920368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbfffd-3ba6-414f-aff8-fab6765b73da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:25.921205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbfffd-3ba6-414f-aff8-fab6765b73da service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:25.923967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbfffd-3ba6-414f-aff8-fab6765b73da service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:25.924454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbfffd-3ba6-414f-aff8-fab6765b73da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:25.942462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbe2ce-c359-41c6-b7bd-fcc4a93dad7e tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:25.948526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbfffd-3ba6-414f-aff8-fab6765b73da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:25.951046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbfffd-3ba6-414f-aff8-fab6765b73da service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:25.970619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54175679-0bb1-4db6-9391-3e0a92d6faeb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:25.971593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54175679-0bb1-4db6-9391-3e0a92d6faeb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:25.973993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54175679-0bb1-4db6-9391-3e0a92d6faeb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:25.974985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54175679-0bb1-4db6-9391-3e0a92d6faeb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/c35811b19efc42aa89ad546fb23e87c4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:25.977202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54175679-0bb1-4db6-9391-3e0a92d6faeb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c35811b19efc42aa89ad546fb23e87c4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:25.980560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54175679-0bb1-4db6-9391-3e0a92d6faeb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:25.988840 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2284/4552] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:26.106482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-54175679-0bb1-4db6-9391-3e0a92d6faeb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c35811b19efc42aa89ad546fb23e87c4', 'request_id': 'req-54175679-0bb1-4db6-9391-3e0a92d6faeb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:26.122811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-54175679-0bb1-4db6-9391-3e0a92d6faeb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c35811b19efc42aa89ad546fb23e87c4', 'request_id': 'req-54175679-0bb1-4db6-9391-3e0a92d6faeb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:26.140418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-54175679-0bb1-4db6-9391-3e0a92d6faeb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c35811b19efc42aa89ad546fb23e87c4', 'request_id': 'req-54175679-0bb1-4db6-9391-3e0a92d6faeb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:26.164081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-54175679-0bb1-4db6-9391-3e0a92d6faeb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] The token cache is being invalidate because project c35811b19efc42aa89ad546fb23e87c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:26.164501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-54175679-0bb1-4db6-9391-3e0a92d6faeb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:26.167384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-54175679-0bb1-4db6-9391-3e0a92d6faeb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:26.169761 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2269/4553] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:25 2022] DELETE /identity/v3/projects/c35811b19efc42aa89ad546fb23e87c4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:26.174742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbfffd-3ba6-414f-aff8-fab6765b73da service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:26.195515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbfffd-3ba6-414f-aff8-fab6765b73da service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:26.374039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a0e4b-c177-4578-905b-498fe87e162c tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:26.375577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a0e4b-c177-4578-905b-498fe87e162c tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:26.375974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a0e4b-c177-4578-905b-498fe87e162c tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:26.376361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a0e4b-c177-4578-905b-498fe87e162c tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:26.377605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a0e4b-c177-4578-905b-498fe87e162c tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:26.380670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a0e4b-c177-4578-905b-498fe87e162c tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:26.439002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54175679-0bb1-4db6-9391-3e0a92d6faeb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:26.440145 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2285/4554] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:26 2022] POST /identity/v3/projects => generated 354 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:26.441645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-54175679-0bb1-4db6-9391-3e0a92d6faeb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:26.474270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54175679-0bb1-4db6-9391-3e0a92d6faeb tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:26.673304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf52e0-0388-42d5-9c8b-4f7957589629 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:26.674079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf52e0-0388-42d5-9c8b-4f7957589629 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:26.674431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf52e0-0388-42d5-9c8b-4f7957589629 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:26.674772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf52e0-0388-42d5-9c8b-4f7957589629 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/1044064f5cc54e1c8b77cb9f6faebc9e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:26.676556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf52e0-0388-42d5-9c8b-4f7957589629 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:update_project(project_id=1044064f5cc54e1c8b77cb9f6faebc9e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:26.682758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf52e0-0388-42d5-9c8b-4f7957589629 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:26.771440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:26.804926 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2270/4555] 10.222.0.27 () {60 vars in 1252 bytes} [Sun Aug 28 18:38:26 2022] PATCH /identity/v3/projects/1044064f5cc54e1c8b77cb9f6faebc9e => generated 368 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:26.805173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a0e4b-c177-4578-905b-498fe87e162c tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:26.827758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a0e4b-c177-4578-905b-498fe87e162c tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:26.839501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d6811-7ba9-4612-b34d-05dd1107424b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:26.840167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d6811-7ba9-4612-b34d-05dd1107424b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:26.840820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d6811-7ba9-4612-b34d-05dd1107424b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:26.841036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d6811-7ba9-4612-b34d-05dd1107424b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/1044064f5cc54e1c8b77cb9f6faebc9e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:26.871925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d6811-7ba9-4612-b34d-05dd1107424b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:get_project(project_id=1044064f5cc54e1c8b77cb9f6faebc9e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:26.874126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d6811-7ba9-4612-b34d-05dd1107424b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:26.876162 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2286/4556] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:38:26 2022] GET /identity/v3/projects/1044064f5cc54e1c8b77cb9f6faebc9e => generated 355 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:38:26.880266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf52e0-0388-42d5-9c8b-4f7957589629 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:26.896071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf52e0-0388-42d5-9c8b-4f7957589629 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:26.907967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62e9e8-aad9-44eb-8a73-a956019ba517 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:26.916045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62e9e8-aad9-44eb-8a73-a956019ba517 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:26.916672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62e9e8-aad9-44eb-8a73-a956019ba517 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:26.917188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62e9e8-aad9-44eb-8a73-a956019ba517 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/projects/1044064f5cc54e1c8b77cb9f6faebc9e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:26.930451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62e9e8-aad9-44eb-8a73-a956019ba517 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1044064f5cc54e1c8b77cb9f6faebc9e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:26.933199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62e9e8-aad9-44eb-8a73-a956019ba517 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:27.084099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d62e9e8-aad9-44eb-8a73-a956019ba517 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1044064f5cc54e1c8b77cb9f6faebc9e', 'request_id': 'req-9d62e9e8-aad9-44eb-8a73-a956019ba517'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:27.112973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d62e9e8-aad9-44eb-8a73-a956019ba517 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1044064f5cc54e1c8b77cb9f6faebc9e', 'request_id': 'req-9d62e9e8-aad9-44eb-8a73-a956019ba517'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:27.147902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d62e9e8-aad9-44eb-8a73-a956019ba517 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1044064f5cc54e1c8b77cb9f6faebc9e', 'request_id': 'req-9d62e9e8-aad9-44eb-8a73-a956019ba517'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:27.222104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d62e9e8-aad9-44eb-8a73-a956019ba517 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] The token cache is being invalidate because project 1044064f5cc54e1c8b77cb9f6faebc9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:27.222473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d62e9e8-aad9-44eb-8a73-a956019ba517 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:27.223139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d62e9e8-aad9-44eb-8a73-a956019ba517 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:27.235335 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2271/4557] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:26 2022] DELETE /identity/v3/projects/1044064f5cc54e1c8b77cb9f6faebc9e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:27.239837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d6811-7ba9-4612-b34d-05dd1107424b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:27.243992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-129d6811-7ba9-4612-b34d-05dd1107424b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:27.279949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d6811-7ba9-4612-b34d-05dd1107424b tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:27.397176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667ed6a-426e-417f-9615-97e5e085becf tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:27.398455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667ed6a-426e-417f-9615-97e5e085becf tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:27.399063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667ed6a-426e-417f-9615-97e5e085becf tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:27.399574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667ed6a-426e-417f-9615-97e5e085becf tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/domains/3a7895e7e77b44c8be44375cc29f5db4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:27.412696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667ed6a-426e-417f-9615-97e5e085becf tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:38:27.419831 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a667ed6a-426e-417f-9615-97e5e085becf tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Could not find domain: 3a7895e7e77b44c8be44375cc29f5db4.: keystone.exception.DomainNotFound: Could not find domain: 3a7895e7e77b44c8be44375cc29f5db4. Aug 28 18:38:27.419831 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:27.419831 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:38:27.419831 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:38:27.419831 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:38:27.419831 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:38:27.419831 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:38:27.419831 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:38:27.419831 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3a7895e7e77b44c8be44375cc29f5db4. Aug 28 18:38:27.419831 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:27.419831 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:38:27.419831 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:27.419831 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:27.419831 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:38:27.419831 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:38:27.419831 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:38:27.420852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:38:27.420852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:38:27.420852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:38:27.420852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:38:27.420852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:38:27.420852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:38:27.420852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:38:27.420852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 18:38:27.420852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 18:38:27.420852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:38:27.420852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:38:27.420852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:38:27.420852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:38:27.420852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:38:27.420852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:38:27.420852 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:38:27.421733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:38:27.421733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:38:27.421733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:38:27.421733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:38:27.421733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:38:27.421733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:38:27.421733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:38:27.421733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:38:27.421733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:38:27.421733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:38:27.421733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:38:27.421733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:38:27.421733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:38:27.421733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:38:27.421733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:38:27.421733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3a7895e7e77b44c8be44375cc29f5db4. Aug 28 18:38:27.421733 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:27.425436 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2287/4558] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:38:27 2022] PATCH /identity/v3/domains/3a7895e7e77b44c8be44375cc29f5db4 => generated 112 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 18:38:27.429044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62e9e8-aad9-44eb-8a73-a956019ba517 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:27.447292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62e9e8-aad9-44eb-8a73-a956019ba517 tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:27.476770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a741915-64d2-403e-a9d1-79524cb7bb5f tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbfcf6d5974847b184c43daaa0155369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70ce42a4d0524450a9b2867ad886aca8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:27.479781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a741915-64d2-403e-a9d1-79524cb7bb5f tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:27.482879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a741915-64d2-403e-a9d1-79524cb7bb5f tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:27.483216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a741915-64d2-403e-a9d1-79524cb7bb5f tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] PATH_INFO: `/v3/domains/4e26917d6ce3449aae2f6e440151ad05` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:27.513062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a741915-64d2-403e-a9d1-79524cb7bb5f tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:38:27.526753 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-2a741915-64d2-403e-a9d1-79524cb7bb5f tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Could not find domain: 4e26917d6ce3449aae2f6e440151ad05.: keystone.exception.DomainNotFound: Could not find domain: 4e26917d6ce3449aae2f6e440151ad05. Aug 28 18:38:27.526753 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:27.526753 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:38:27.526753 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:38:27.526753 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:38:27.526753 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:38:27.526753 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:38:27.526753 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:38:27.526753 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4e26917d6ce3449aae2f6e440151ad05. Aug 28 18:38:27.526753 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:38:27.526753 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:38:27.526753 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:38:27.526753 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:27.526753 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:38:27.526753 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:38:27.526753 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:38:27.528210 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:38:27.528210 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:38:27.528210 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:38:27.528210 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:38:27.528210 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:38:27.528210 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:38:27.528210 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:38:27.528210 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 18:38:27.528210 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 18:38:27.528210 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:38:27.528210 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:38:27.528210 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:38:27.528210 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:38:27.528210 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:38:27.528210 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:38:27.528210 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:38:27.529121 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:38:27.529121 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:38:27.529121 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:38:27.529121 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:38:27.529121 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:38:27.529121 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:38:27.529121 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:38:27.529121 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:38:27.529121 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:38:27.529121 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:38:27.529121 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:38:27.529121 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:38:27.529121 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:38:27.529121 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:38:27.529121 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:38:27.529121 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4e26917d6ce3449aae2f6e440151ad05. Aug 28 18:38:27.529121 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:38:27.533146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667ed6a-426e-417f-9615-97e5e085becf tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:27.535726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a667ed6a-426e-417f-9615-97e5e085becf tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:27.536501 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2272/4559] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:38:27 2022] PATCH /identity/v3/domains/4e26917d6ce3449aae2f6e440151ad05 => generated 112 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:38:27.671447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667ed6a-426e-417f-9615-97e5e085becf tempest-ProjectsTestJSON-448019440 tempest-ProjectsTestJSON-448019440-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:27.687818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8544c-2248-4f69-8619-2076df105293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:27.689842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8544c-2248-4f69-8619-2076df105293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:27.690759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8544c-2248-4f69-8619-2076df105293 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:27.691543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8544c-2248-4f69-8619-2076df105293 admin admin] PATH_INFO: `/v3/users/02aacfb926de4d189baba01e6fbb7deb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:27.694653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8544c-2248-4f69-8619-2076df105293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02aacfb926de4d189baba01e6fbb7deb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:27.704892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8544c-2248-4f69-8619-2076df105293 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:27.716093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:27.798571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bc8544c-2248-4f69-8619-2076df105293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02aacfb926de4d189baba01e6fbb7deb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:27.800064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bc8544c-2248-4f69-8619-2076df105293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02aacfb926de4d189baba01e6fbb7deb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:27.814351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bc8544c-2248-4f69-8619-2076df105293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02aacfb926de4d189baba01e6fbb7deb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:27.833347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bc8544c-2248-4f69-8619-2076df105293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02aacfb926de4d189baba01e6fbb7deb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:27.870380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bc8544c-2248-4f69-8619-2076df105293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02aacfb926de4d189baba01e6fbb7deb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:27.895829 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2288/4560] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:27 2022] DELETE /identity/v3/users/02aacfb926de4d189baba01e6fbb7deb => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:27.900963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad499-1f57-4fec-85ce-2332fda7c696 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:27.901395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad499-1f57-4fec-85ce-2332fda7c696 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:27.901603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad499-1f57-4fec-85ce-2332fda7c696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:27.932836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6cdad499-1f57-4fec-85ce-2332fda7c696 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:27.934144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6cdad499-1f57-4fec-85ce-2332fda7c696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:28.063109 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2273/4561] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:28.073119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8544c-2248-4f69-8619-2076df105293 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:28.074969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9bc8544c-2248-4f69-8619-2076df105293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:28.176611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdad499-1f57-4fec-85ce-2332fda7c696 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:28.181885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6cdad499-1f57-4fec-85ce-2332fda7c696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:28.366761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8544c-2248-4f69-8619-2076df105293 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:28.383322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f279797-7604-4331-a475-11734292e0c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:28.390530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f279797-7604-4331-a475-11734292e0c9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:28.391123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f279797-7604-4331-a475-11734292e0c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:28.395727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f279797-7604-4331-a475-11734292e0c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:28.433569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f279797-7604-4331-a475-11734292e0c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:28.451595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f279797-7604-4331-a475-11734292e0c9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:28.469336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdad499-1f57-4fec-85ce-2332fda7c696 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:28.472713 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2289/4562] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:28.494803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beea0d6-74da-4a3a-9861-a5276e638cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:28.495520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beea0d6-74da-4a3a-9861-a5276e638cfa service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:28.495804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beea0d6-74da-4a3a-9861-a5276e638cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:28.501008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beea0d6-74da-4a3a-9861-a5276e638cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:28.509265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1beea0d6-74da-4a3a-9861-a5276e638cfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:28.563002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beea0d6-74da-4a3a-9861-a5276e638cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:28.568441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beea0d6-74da-4a3a-9861-a5276e638cfa service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:28.597476 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2274/4563] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:29.158445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f279797-7604-4331-a475-11734292e0c9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:29.160758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1f279797-7604-4331-a475-11734292e0c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:29.204720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f279797-7604-4331-a475-11734292e0c9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:29.225950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:29.226619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:29.227791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:29.231720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62 admin admin] PATH_INFO: `/v3/projects/68250fe7015d44d2a8509fed1211730b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:29.234150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68250fe7015d44d2a8509fed1211730b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:29.236346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:29.411986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68250fe7015d44d2a8509fed1211730b', 'request_id': 'req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:29.431341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68250fe7015d44d2a8509fed1211730b', 'request_id': 'req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:29.441226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68250fe7015d44d2a8509fed1211730b', 'request_id': 'req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:29.457065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62 admin admin] The token cache is being invalidate because project 68250fe7015d44d2a8509fed1211730b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:29.457258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:29.467708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:29.470437 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2290/4564] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:29 2022] DELETE /identity/v3/projects/68250fe7015d44d2a8509fed1211730b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:29.474382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beea0d6-74da-4a3a-9861-a5276e638cfa service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:29.492222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beea0d6-74da-4a3a-9861-a5276e638cfa service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:29.510673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:29.601763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c973d-6f47-457a-8b9c-3e3c9d89dbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:29.602915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c973d-6f47-457a-8b9c-3e3c9d89dbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:29.603198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c973d-6f47-457a-8b9c-3e3c9d89dbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:29.603512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c973d-6f47-457a-8b9c-3e3c9d89dbbf admin admin] PATH_INFO: `/v3/users/cbfcf6d5974847b184c43daaa0155369` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:29.620339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c973d-6f47-457a-8b9c-3e3c9d89dbbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbfcf6d5974847b184c43daaa0155369)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:29.620339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c973d-6f47-457a-8b9c-3e3c9d89dbbf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:29.863829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f91c973d-6f47-457a-8b9c-3e3c9d89dbbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbfcf6d5974847b184c43daaa0155369'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:29.893356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f91c973d-6f47-457a-8b9c-3e3c9d89dbbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbfcf6d5974847b184c43daaa0155369'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:29.895202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f91c973d-6f47-457a-8b9c-3e3c9d89dbbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbfcf6d5974847b184c43daaa0155369'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:29.896824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f91c973d-6f47-457a-8b9c-3e3c9d89dbbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbfcf6d5974847b184c43daaa0155369'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:29.909517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f91c973d-6f47-457a-8b9c-3e3c9d89dbbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbfcf6d5974847b184c43daaa0155369'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:29.956280 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2275/4565] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:29 2022] DELETE /identity/v3/users/cbfcf6d5974847b184c43daaa0155369 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:31.337767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:31.343379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:31.368918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7cc68-4b74-4f71-956b-4b58bd0c8f62 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:31.379744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:31.530647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aee01e-21f6-45cd-b936-bbd06efa6a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:31.531564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aee01e-21f6-45cd-b936-bbd06efa6a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:31.532052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aee01e-21f6-45cd-b936-bbd06efa6a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:31.532463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aee01e-21f6-45cd-b936-bbd06efa6a41 admin admin] PATH_INFO: `/v3/projects/70ce42a4d0524450a9b2867ad886aca8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:31.534201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aee01e-21f6-45cd-b936-bbd06efa6a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ce42a4d0524450a9b2867ad886aca8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:31.536901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aee01e-21f6-45cd-b936-bbd06efa6a41 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:31.636210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-56aee01e-21f6-45cd-b936-bbd06efa6a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ce42a4d0524450a9b2867ad886aca8', 'request_id': 'req-56aee01e-21f6-45cd-b936-bbd06efa6a41'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:31.654932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-56aee01e-21f6-45cd-b936-bbd06efa6a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ce42a4d0524450a9b2867ad886aca8', 'request_id': 'req-56aee01e-21f6-45cd-b936-bbd06efa6a41'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:31.662772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-56aee01e-21f6-45cd-b936-bbd06efa6a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ce42a4d0524450a9b2867ad886aca8', 'request_id': 'req-56aee01e-21f6-45cd-b936-bbd06efa6a41'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:31.685185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-56aee01e-21f6-45cd-b936-bbd06efa6a41 admin admin] The token cache is being invalidate because project 70ce42a4d0524450a9b2867ad886aca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:31.685582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-56aee01e-21f6-45cd-b936-bbd06efa6a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:31.686849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-56aee01e-21f6-45cd-b936-bbd06efa6a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:31.688963 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2291/4566] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:31 2022] DELETE /identity/v3/projects/70ce42a4d0524450a9b2867ad886aca8 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:31.693730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fc3f7-fd7f-4015-82ea-180f6f9e813e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:31.694239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fc3f7-fd7f-4015-82ea-180f6f9e813e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:31.694316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fc3f7-fd7f-4015-82ea-180f6f9e813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:31.741812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-932fc3f7-fd7f-4015-82ea-180f6f9e813e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:31.743141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-932fc3f7-fd7f-4015-82ea-180f6f9e813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:31.936260 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2276/4567] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:31.936744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581bc0a-bc93-4a44-b292-37202c45175b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:31.937096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581bc0a-bc93-4a44-b292-37202c45175b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:31.937460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581bc0a-bc93-4a44-b292-37202c45175b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:31.989933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6581bc0a-bc93-4a44-b292-37202c45175b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:31.989933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6581bc0a-bc93-4a44-b292-37202c45175b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:32.024162 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2292/4568] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:32.025858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fc3f7-fd7f-4015-82ea-180f6f9e813e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:32.057800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fc3f7-fd7f-4015-82ea-180f6f9e813e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:32.068860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c98cf3-df88-4ba2-bb7a-a6cdc1fd1c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:32.072271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c98cf3-df88-4ba2-bb7a-a6cdc1fd1c08 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:32.072769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c98cf3-df88-4ba2-bb7a-a6cdc1fd1c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:32.073301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c98cf3-df88-4ba2-bb7a-a6cdc1fd1c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:32.074258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c98cf3-df88-4ba2-bb7a-a6cdc1fd1c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:32.074750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c98cf3-df88-4ba2-bb7a-a6cdc1fd1c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:32.076880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c98cf3-df88-4ba2-bb7a-a6cdc1fd1c08 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:32.098280 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2277/4569] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:32.098932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581bc0a-bc93-4a44-b292-37202c45175b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:32.111775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581bc0a-bc93-4a44-b292-37202c45175b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:32.127777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf1ad6-b24f-4a38-af14-56cf3ae8be78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:32.128492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf1ad6-b24f-4a38-af14-56cf3ae8be78 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:32.128846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf1ad6-b24f-4a38-af14-56cf3ae8be78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:32.129274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf1ad6-b24f-4a38-af14-56cf3ae8be78 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:32.129977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf1ad6-b24f-4a38-af14-56cf3ae8be78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:32.138145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf1ad6-b24f-4a38-af14-56cf3ae8be78 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:32.205926 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2293/4570] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:32 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:32.207485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c98cf3-df88-4ba2-bb7a-a6cdc1fd1c08 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:32.227690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c98cf3-df88-4ba2-bb7a-a6cdc1fd1c08 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:32.312612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:32.464520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b441a-02f2-4e95-8013-7b6092c76255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:32.465608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b441a-02f2-4e95-8013-7b6092c76255 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:32.466013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b441a-02f2-4e95-8013-7b6092c76255 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:32.466937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b441a-02f2-4e95-8013-7b6092c76255 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:32.469018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b441a-02f2-4e95-8013-7b6092c76255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:32.481439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b441a-02f2-4e95-8013-7b6092c76255 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:32.565770 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2278/4571] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:32 2022] POST /identity/v3/users => generated 286 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:32.566614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf1ad6-b24f-4a38-af14-56cf3ae8be78 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:32.586202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf1ad6-b24f-4a38-af14-56cf3ae8be78 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:32.607550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b5a19-5b5e-4e5c-8e99-13aa3e08a5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:32.608573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b5a19-5b5e-4e5c-8e99-13aa3e08a5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:32.610426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b5a19-5b5e-4e5c-8e99-13aa3e08a5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:32.610790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b5a19-5b5e-4e5c-8e99-13aa3e08a5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:32.611823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b5a19-5b5e-4e5c-8e99-13aa3e08a5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:32.613490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b5a19-5b5e-4e5c-8e99-13aa3e08a5d6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:32.651011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b441a-02f2-4e95-8013-7b6092c76255 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:32.651850 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2294/4572] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:32.662621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b441a-02f2-4e95-8013-7b6092c76255 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:32.681933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e70957-3e85-49ac-a8fd-5794ecf53dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:32.682645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e70957-3e85-49ac-a8fd-5794ecf53dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:32.683138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e70957-3e85-49ac-a8fd-5794ecf53dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:32.683539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e70957-3e85-49ac-a8fd-5794ecf53dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:32.685213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e70957-3e85-49ac-a8fd-5794ecf53dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:32.685846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e70957-3e85-49ac-a8fd-5794ecf53dd5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:32.701037 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2279/4573] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:32.702325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b5a19-5b5e-4e5c-8e99-13aa3e08a5d6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:32.719451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b5a19-5b5e-4e5c-8e99-13aa3e08a5d6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:32.740925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a77694-69e6-481f-acf0-d06d4027dff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:32.743536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a77694-69e6-481f-acf0-d06d4027dff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:32.744255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a77694-69e6-481f-acf0-d06d4027dff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:32.745355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a77694-69e6-481f-acf0-d06d4027dff6 admin admin] PATH_INFO: `/v3/projects/12392a457c304d759883507b122f6a03/users/a78b1bef0e314075925d15fd735a947c/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:32.774521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a77694-69e6-481f-acf0-d06d4027dff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12392a457c304d759883507b122f6a03, user_id=a78b1bef0e314075925d15fd735a947c, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:32.789670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a77694-69e6-481f-acf0-d06d4027dff6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:32.829291 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2295/4574] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:32 2022] PUT /identity/v3/projects/12392a457c304d759883507b122f6a03/users/a78b1bef0e314075925d15fd735a947c/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:32.842413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb71cd-8958-414f-8f4d-c4b7c01421c8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:32.842748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb71cd-8958-414f-8f4d-c4b7c01421c8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:32.843245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb71cd-8958-414f-8f4d-c4b7c01421c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:32.905330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-70bb71cd-8958-414f-8f4d-c4b7c01421c8 None None] MFA Rules not processed for user `a78b1bef0e314075925d15fd735a947c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:32.906634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-70bb71cd-8958-414f-8f4d-c4b7c01421c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:33.062964 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2280/4575] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:33.067569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a77694-69e6-481f-acf0-d06d4027dff6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:33.174056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:33.346089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a77694-69e6-481f-acf0-d06d4027dff6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:33.381853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c65ce-224d-4eeb-ae47-89cc6044efa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:33.382814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c65ce-224d-4eeb-ae47-89cc6044efa1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:33.387338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c65ce-224d-4eeb-ae47-89cc6044efa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:33.387338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c65ce-224d-4eeb-ae47-89cc6044efa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:33.387338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c65ce-224d-4eeb-ae47-89cc6044efa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:33.390279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c65ce-224d-4eeb-ae47-89cc6044efa1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:33.525482 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2296/4576] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:33 2022] POST /identity/v3/projects => generated 369 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:33.529548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb71cd-8958-414f-8f4d-c4b7c01421c8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:33.564833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb71cd-8958-414f-8f4d-c4b7c01421c8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:33.786533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcb87a-bc80-4d60-a922-c35fdd6cd818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:33.791360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcb87a-bc80-4d60-a922-c35fdd6cd818 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:33.792225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcb87a-bc80-4d60-a922-c35fdd6cd818 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:33.792648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcb87a-bc80-4d60-a922-c35fdd6cd818 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:33.793485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcb87a-bc80-4d60-a922-c35fdd6cd818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:33.810054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcb87a-bc80-4d60-a922-c35fdd6cd818 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:33.870665 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2281/4577] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:33 2022] POST /identity/v3/users => generated 291 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:33.874740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c65ce-224d-4eeb-ae47-89cc6044efa1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:33.904584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c65ce-224d-4eeb-ae47-89cc6044efa1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:33.934292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adcc82-685c-4415-ac1f-f1add53af38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:33.939105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adcc82-685c-4415-ac1f-f1add53af38f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:33.941015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adcc82-685c-4415-ac1f-f1add53af38f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:33.942676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adcc82-685c-4415-ac1f-f1add53af38f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:33.949791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adcc82-685c-4415-ac1f-f1add53af38f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:33.971671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adcc82-685c-4415-ac1f-f1add53af38f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:34.024324 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2297/4578] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:34.028748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcb87a-bc80-4d60-a922-c35fdd6cd818 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:34.070392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcb87a-bc80-4d60-a922-c35fdd6cd818 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:34.096812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb1ac8-9abe-415c-aae0-7be15245064d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:34.100457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb1ac8-9abe-415c-aae0-7be15245064d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:34.100701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb1ac8-9abe-415c-aae0-7be15245064d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:34.101084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb1ac8-9abe-415c-aae0-7be15245064d admin admin] PATH_INFO: `/v3/projects/ef1c3b4b3c0043d3bd91f264b2ab2231/users/752f2945ba01412187c04130e78dab1e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:34.179601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb1ac8-9abe-415c-aae0-7be15245064d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1c3b4b3c0043d3bd91f264b2ab2231, user_id=752f2945ba01412187c04130e78dab1e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:34.198249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb1ac8-9abe-415c-aae0-7be15245064d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:34.209341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:34.236751 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2282/4579] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:34 2022] PUT /identity/v3/projects/ef1c3b4b3c0043d3bd91f264b2ab2231/users/752f2945ba01412187c04130e78dab1e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:34.240509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adcc82-685c-4415-ac1f-f1add53af38f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:34.257678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adcc82-685c-4415-ac1f-f1add53af38f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:34.558250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7700c1-3c28-44c5-a379-e84570a02e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:34.558904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7700c1-3c28-44c5-a379-e84570a02e82 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:34.559195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7700c1-3c28-44c5-a379-e84570a02e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:34.559502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7700c1-3c28-44c5-a379-e84570a02e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:34.560171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7700c1-3c28-44c5-a379-e84570a02e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:34.561840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7700c1-3c28-44c5-a379-e84570a02e82 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:34.652234 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2298/4580] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:34.657940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb1ac8-9abe-415c-aae0-7be15245064d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:34.691239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb1ac8-9abe-415c-aae0-7be15245064d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:34.714725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e19ea9-7855-4fca-84fb-f900472bc6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:34.740277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19ea9-7855-4fca-84fb-f900472bc6c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:34.740639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19ea9-7855-4fca-84fb-f900472bc6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:34.742079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19ea9-7855-4fca-84fb-f900472bc6c8 admin admin] PATH_INFO: `/v3/projects/ef1c3b4b3c0043d3bd91f264b2ab2231/users/752f2945ba01412187c04130e78dab1e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:34.758262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e19ea9-7855-4fca-84fb-f900472bc6c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1c3b4b3c0043d3bd91f264b2ab2231, user_id=752f2945ba01412187c04130e78dab1e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:34.769889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e19ea9-7855-4fca-84fb-f900472bc6c8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:34.807100 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2283/4581] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:34 2022] PUT /identity/v3/projects/ef1c3b4b3c0043d3bd91f264b2ab2231/users/752f2945ba01412187c04130e78dab1e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:34.826717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ae1f8-7e62-4a1f-9e1b-8aa479aae3ed None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:34.827740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ae1f8-7e62-4a1f-9e1b-8aa479aae3ed None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:34.828195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ae1f8-7e62-4a1f-9e1b-8aa479aae3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:34.881486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6d8ae1f8-7e62-4a1f-9e1b-8aa479aae3ed None None] MFA Rules not processed for user `752f2945ba01412187c04130e78dab1e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:34.886174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6d8ae1f8-7e62-4a1f-9e1b-8aa479aae3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:35.098430 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2299/4582] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:35.101755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e19ea9-7855-4fca-84fb-f900472bc6c8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:35.128669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e19ea9-7855-4fca-84fb-f900472bc6c8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:35.139952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c540c60-be60-417c-9962-3210037c15a3 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752f2945ba01412187c04130e78dab1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef1c3b4b3c0043d3bd91f264b2ab2231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:35.148690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c540c60-be60-417c-9962-3210037c15a3 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:35.149468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c540c60-be60-417c-9962-3210037c15a3 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:35.149951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c540c60-be60-417c-9962-3210037c15a3 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:35.150844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c540c60-be60-417c-9962-3210037c15a3 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:35.155738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c540c60-be60-417c-9962-3210037c15a3 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:35.235679 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2284/4583] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:35 2022] POST /identity/v3/projects => generated 359 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:35.239074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ae1f8-7e62-4a1f-9e1b-8aa479aae3ed None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:35.256169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ae1f8-7e62-4a1f-9e1b-8aa479aae3ed None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:35.328378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:35.392848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a189754-cf02-405b-b5fd-d984f1dc6fa1 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752f2945ba01412187c04130e78dab1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef1c3b4b3c0043d3bd91f264b2ab2231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:35.393744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a189754-cf02-405b-b5fd-d984f1dc6fa1 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:35.394041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a189754-cf02-405b-b5fd-d984f1dc6fa1 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:35.394501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a189754-cf02-405b-b5fd-d984f1dc6fa1 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:35.395183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a189754-cf02-405b-b5fd-d984f1dc6fa1 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:35.397681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a189754-cf02-405b-b5fd-d984f1dc6fa1 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:35.465326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c540c60-be60-417c-9962-3210037c15a3 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:35.481250 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2300/4584] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:35 2022] POST /identity/v3/users => generated 373 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:38:35.482369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c540c60-be60-417c-9962-3210037c15a3 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:35.489157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3878068-5622-4c0e-8a66-f7381b166554 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752f2945ba01412187c04130e78dab1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef1c3b4b3c0043d3bd91f264b2ab2231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:35.489961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3878068-5622-4c0e-8a66-f7381b166554 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:35.490254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3878068-5622-4c0e-8a66-f7381b166554 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:35.490532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3878068-5622-4c0e-8a66-f7381b166554 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:35.491350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3878068-5622-4c0e-8a66-f7381b166554 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:35.491637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3878068-5622-4c0e-8a66-f7381b166554 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:35.493127 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-b3878068-5622-4c0e-8a66-f7381b166554 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:38:35.493127 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:38:35.493127 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:38:35.494648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3878068-5622-4c0e-8a66-f7381b166554 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:35.632350 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2285/4585] 10.222.0.27 () {58 vars in 1157 bytes} [Sun Aug 28 18:38:35 2022] GET /identity/v3/users?domain_id=default => generated 8041 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:38:35.637842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a189754-cf02-405b-b5fd-d984f1dc6fa1 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:35.671961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a189754-cf02-405b-b5fd-d984f1dc6fa1 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:35.678635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60ed06-be92-493a-8d6a-713f1abf21e6 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752f2945ba01412187c04130e78dab1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef1c3b4b3c0043d3bd91f264b2ab2231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:35.679384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60ed06-be92-493a-8d6a-713f1abf21e6 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:35.679666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60ed06-be92-493a-8d6a-713f1abf21e6 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:35.680596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60ed06-be92-493a-8d6a-713f1abf21e6 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] PATH_INFO: `/v3/users/79f61f1864c542df8da29865fbafc0c3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:35.749928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60ed06-be92-493a-8d6a-713f1abf21e6 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: Authorizing `identity:update_user(user_id=79f61f1864c542df8da29865fbafc0c3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:35.761629 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-eb60ed06-be92-493a-8d6a-713f1abf21e6 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:38:35.761629 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:38:35.761629 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:38:35.769354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60ed06-be92-493a-8d6a-713f1abf21e6 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:35.865359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eb60ed06-be92-493a-8d6a-713f1abf21e6 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '79f61f1864c542df8da29865fbafc0c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:35.884923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eb60ed06-be92-493a-8d6a-713f1abf21e6 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Invalidating the token cache because user 79f61f1864c542df8da29865fbafc0c3 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:35.885595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eb60ed06-be92-493a-8d6a-713f1abf21e6 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:35.886778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eb60ed06-be92-493a-8d6a-713f1abf21e6 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:35.894609 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2301/4586] 10.222.0.27 () {60 vars in 1244 bytes} [Sun Aug 28 18:38:35 2022] PATCH /identity/v3/users/79f61f1864c542df8da29865fbafc0c3 => generated 488 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:35.897835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf99fbd-e0bf-4e61-b2b5-824e8e765f84 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:35.898339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf99fbd-e0bf-4e61-b2b5-824e8e765f84 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:35.898415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf99fbd-e0bf-4e61-b2b5-824e8e765f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:35.930010 n-d-850468-20 devstack@keystone.service[82160]: WARNING keystone.auth.plugins.core [None req-adf99fbd-e0bf-4e61-b2b5-824e8e765f84 None None] User is disabled: 79f61f1864c542df8da29865fbafc0c3: AssertionError: User is disabled: 79f61f1864c542df8da29865fbafc0c3 Aug 28 18:38:35.944947 n-d-850468-20 devstack@keystone.service[82160]: WARNING keystone.server.flask.application [None req-adf99fbd-e0bf-4e61-b2b5-824e8e765f84 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 18:38:35.953240 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2286/4587] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:35 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 55 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 18:38:35.954730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60ed06-be92-493a-8d6a-713f1abf21e6 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:35.956946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eb60ed06-be92-493a-8d6a-713f1abf21e6 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:35.983711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60ed06-be92-493a-8d6a-713f1abf21e6 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:35.994225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d0fe3-1146-4e7d-878b-8484a929141d tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752f2945ba01412187c04130e78dab1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef1c3b4b3c0043d3bd91f264b2ab2231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:35.995051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d0fe3-1146-4e7d-878b-8484a929141d tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:35.995850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d0fe3-1146-4e7d-878b-8484a929141d tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:35.996325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d0fe3-1146-4e7d-878b-8484a929141d tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] PATH_INFO: `/v3/users/79f61f1864c542df8da29865fbafc0c3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:36.020214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d0fe3-1146-4e7d-878b-8484a929141d tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: Authorizing `identity:delete_user(user_id=79f61f1864c542df8da29865fbafc0c3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:36.022895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d0fe3-1146-4e7d-878b-8484a929141d tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:36.129601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a36d0fe3-1146-4e7d-878b-8484a929141d tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f61f1864c542df8da29865fbafc0c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:36.131427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a36d0fe3-1146-4e7d-878b-8484a929141d tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f61f1864c542df8da29865fbafc0c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:36.168812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a36d0fe3-1146-4e7d-878b-8484a929141d tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f61f1864c542df8da29865fbafc0c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:36.190241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a36d0fe3-1146-4e7d-878b-8484a929141d tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f61f1864c542df8da29865fbafc0c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:36.214102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a36d0fe3-1146-4e7d-878b-8484a929141d tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f61f1864c542df8da29865fbafc0c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:36.227304 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2302/4588] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:35 2022] DELETE /identity/v3/users/79f61f1864c542df8da29865fbafc0c3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:36.232498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf99fbd-e0bf-4e61-b2b5-824e8e765f84 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:36.236103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-adf99fbd-e0bf-4e61-b2b5-824e8e765f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:36.437089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf99fbd-e0bf-4e61-b2b5-824e8e765f84 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:36.451893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8899df3-f82d-4a6b-9544-2139f29799e9 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752f2945ba01412187c04130e78dab1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef1c3b4b3c0043d3bd91f264b2ab2231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:36.452595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8899df3-f82d-4a6b-9544-2139f29799e9 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:36.452877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8899df3-f82d-4a6b-9544-2139f29799e9 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:36.453153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8899df3-f82d-4a6b-9544-2139f29799e9 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] PATH_INFO: `/v3/projects/a91d99f61ba949da8ae7e83154f328e8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:36.457334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8899df3-f82d-4a6b-9544-2139f29799e9 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a91d99f61ba949da8ae7e83154f328e8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:36.463476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8899df3-f82d-4a6b-9544-2139f29799e9 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:36.640177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e8899df3-f82d-4a6b-9544-2139f29799e9 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91d99f61ba949da8ae7e83154f328e8', 'request_id': 'req-e8899df3-f82d-4a6b-9544-2139f29799e9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:36.658752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e8899df3-f82d-4a6b-9544-2139f29799e9 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91d99f61ba949da8ae7e83154f328e8', 'request_id': 'req-e8899df3-f82d-4a6b-9544-2139f29799e9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:36.666054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e8899df3-f82d-4a6b-9544-2139f29799e9 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91d99f61ba949da8ae7e83154f328e8', 'request_id': 'req-e8899df3-f82d-4a6b-9544-2139f29799e9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:36.706378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e8899df3-f82d-4a6b-9544-2139f29799e9 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] The token cache is being invalidate because project a91d99f61ba949da8ae7e83154f328e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:36.706852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e8899df3-f82d-4a6b-9544-2139f29799e9 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:36.712563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e8899df3-f82d-4a6b-9544-2139f29799e9 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:36.719432 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2287/4589] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:36 2022] DELETE /identity/v3/projects/a91d99f61ba949da8ae7e83154f328e8 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:36.724646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d0fe3-1146-4e7d-878b-8484a929141d tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:36.737498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d0fe3-1146-4e7d-878b-8484a929141d tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:36.802522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:36.857193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f7325-72a3-43dc-a13e-8b648d7b44b2 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752f2945ba01412187c04130e78dab1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef1c3b4b3c0043d3bd91f264b2ab2231', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:36.857829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f7325-72a3-43dc-a13e-8b648d7b44b2 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:36.858107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f7325-72a3-43dc-a13e-8b648d7b44b2 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:36.858378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f7325-72a3-43dc-a13e-8b648d7b44b2 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:36.859023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f7325-72a3-43dc-a13e-8b648d7b44b2 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:36.861097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f7325-72a3-43dc-a13e-8b648d7b44b2 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:36.892764 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-fa3f7325-72a3-43dc-a13e-8b648d7b44b2 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Could not find domain: 50d83689af344772b676263996de66aa.: keystone.exception.DomainNotFound: Could not find domain: 50d83689af344772b676263996de66aa. Aug 28 18:38:36.892764 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:36.892764 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:38:36.892764 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:38:36.892764 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:38:36.892764 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:38:36.892764 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:38:36.892764 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:38:36.892764 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 50d83689af344772b676263996de66aa. Aug 28 18:38:36.892764 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:36.892764 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:38:36.892764 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:36.892764 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:36.892764 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:38:36.892764 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:38:36.892764 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:38:36.894487 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:38:36.894487 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:38:36.894487 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:38:36.894487 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:38:36.894487 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:38:36.894487 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:38:36.894487 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:38:36.894487 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 28 18:38:36.894487 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 28 18:38:36.894487 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:38:36.894487 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:38:36.894487 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:38:36.894487 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:38:36.894487 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:38:36.894487 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:38:36.894487 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Aug 28 18:38:36.894487 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:38:36.895722 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:38:36.895722 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:38:36.895722 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:38:36.895722 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:38:36.895722 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:38:36.895722 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:38:36.895722 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:38:36.895722 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:38:36.895722 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:38:36.895722 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:38:36.895722 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:38:36.895722 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:38:36.895722 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:38:36.895722 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:38:36.895722 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:38:36.895722 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:38:36.895722 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:38:36.896823 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:38:36.896823 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 50d83689af344772b676263996de66aa. Aug 28 18:38:36.896823 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:38:36.903629 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2303/4590] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:36 2022] POST /identity/v3/users => generated 112 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:38:36.904436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8899df3-f82d-4a6b-9544-2139f29799e9 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:36.905999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e8899df3-f82d-4a6b-9544-2139f29799e9 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:36.989586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:37.047958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8899df3-f82d-4a6b-9544-2139f29799e9 tempest-UsersNegativeTest-262014955 tempest-UsersNegativeTest-262014955-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:37.055312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253417b-eb2e-494e-b2e6-097ceb2d5f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:37.056100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253417b-eb2e-494e-b2e6-097ceb2d5f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:37.056389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253417b-eb2e-494e-b2e6-097ceb2d5f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:37.056670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253417b-eb2e-494e-b2e6-097ceb2d5f7c admin admin] PATH_INFO: `/v3/users/a78b1bef0e314075925d15fd735a947c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:37.058025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253417b-eb2e-494e-b2e6-097ceb2d5f7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a78b1bef0e314075925d15fd735a947c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:37.060192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253417b-eb2e-494e-b2e6-097ceb2d5f7c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:37.171437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d253417b-eb2e-494e-b2e6-097ceb2d5f7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a78b1bef0e314075925d15fd735a947c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:37.189486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d253417b-eb2e-494e-b2e6-097ceb2d5f7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a78b1bef0e314075925d15fd735a947c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:37.190231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d253417b-eb2e-494e-b2e6-097ceb2d5f7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a78b1bef0e314075925d15fd735a947c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:37.190837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d253417b-eb2e-494e-b2e6-097ceb2d5f7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a78b1bef0e314075925d15fd735a947c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:37.208740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d253417b-eb2e-494e-b2e6-097ceb2d5f7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a78b1bef0e314075925d15fd735a947c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:37.236221 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2288/4591] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:36 2022] DELETE /identity/v3/users/a78b1bef0e314075925d15fd735a947c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:37.238288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfe70f-cc5c-4597-bdf6-76d6925f7031 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:37.239626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfe70f-cc5c-4597-bdf6-76d6925f7031 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:37.240136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfe70f-cc5c-4597-bdf6-76d6925f7031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:37.291180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-15bfe70f-cc5c-4597-bdf6-76d6925f7031 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:37.292545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-15bfe70f-cc5c-4597-bdf6-76d6925f7031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:37.382431 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2304/4592] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:37.396006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253417b-eb2e-494e-b2e6-097ceb2d5f7c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:37.398253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d253417b-eb2e-494e-b2e6-097ceb2d5f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:37.476765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253417b-eb2e-494e-b2e6-097ceb2d5f7c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:37.481781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4405d9d-4cab-482b-9183-b9f885115d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:37.482836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4405d9d-4cab-482b-9183-b9f885115d84 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:37.483326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4405d9d-4cab-482b-9183-b9f885115d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:37.483908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4405d9d-4cab-482b-9183-b9f885115d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:37.496619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4405d9d-4cab-482b-9183-b9f885115d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:37.498457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4405d9d-4cab-482b-9183-b9f885115d84 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:37.515027 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2289/4593] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:38.114739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfe70f-cc5c-4597-bdf6-76d6925f7031 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:38.116971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-15bfe70f-cc5c-4597-bdf6-76d6925f7031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:38.149191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfe70f-cc5c-4597-bdf6-76d6925f7031 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:38.155582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3691afa-6e4a-4e03-9289-4cbfb653c89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:38.156501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3691afa-6e4a-4e03-9289-4cbfb653c89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:38.156954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3691afa-6e4a-4e03-9289-4cbfb653c89e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:38.157369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3691afa-6e4a-4e03-9289-4cbfb653c89e admin admin] PATH_INFO: `/v3/projects/12392a457c304d759883507b122f6a03` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:38.159029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3691afa-6e4a-4e03-9289-4cbfb653c89e admin admin] RBAC: Authorizing `identity:delete_project(project_id=12392a457c304d759883507b122f6a03)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:38.162432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3691afa-6e4a-4e03-9289-4cbfb653c89e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:38.276612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d3691afa-6e4a-4e03-9289-4cbfb653c89e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12392a457c304d759883507b122f6a03', 'request_id': 'req-d3691afa-6e4a-4e03-9289-4cbfb653c89e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:38.308063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d3691afa-6e4a-4e03-9289-4cbfb653c89e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12392a457c304d759883507b122f6a03', 'request_id': 'req-d3691afa-6e4a-4e03-9289-4cbfb653c89e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:38.319143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d3691afa-6e4a-4e03-9289-4cbfb653c89e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12392a457c304d759883507b122f6a03', 'request_id': 'req-d3691afa-6e4a-4e03-9289-4cbfb653c89e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:38.362000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d3691afa-6e4a-4e03-9289-4cbfb653c89e admin admin] The token cache is being invalidate because project 12392a457c304d759883507b122f6a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:38.362304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d3691afa-6e4a-4e03-9289-4cbfb653c89e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:38.367018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d3691afa-6e4a-4e03-9289-4cbfb653c89e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:38.372883 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2305/4594] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:38 2022] DELETE /identity/v3/projects/12392a457c304d759883507b122f6a03 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:38.374140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4405d9d-4cab-482b-9183-b9f885115d84 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:38.439313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4405d9d-4cab-482b-9183-b9f885115d84 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:38.619681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:38.630886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934594b2-faf4-4cb3-b1d7-e7e22a69a7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:38.631996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934594b2-faf4-4cb3-b1d7-e7e22a69a7e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:38.632883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934594b2-faf4-4cb3-b1d7-e7e22a69a7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:38.632883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934594b2-faf4-4cb3-b1d7-e7e22a69a7e6 admin admin] PATH_INFO: `/v3/users/752f2945ba01412187c04130e78dab1e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:38.639550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934594b2-faf4-4cb3-b1d7-e7e22a69a7e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=752f2945ba01412187c04130e78dab1e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:38.641817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934594b2-faf4-4cb3-b1d7-e7e22a69a7e6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:38.817945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-934594b2-faf4-4cb3-b1d7-e7e22a69a7e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '752f2945ba01412187c04130e78dab1e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:38.835916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-934594b2-faf4-4cb3-b1d7-e7e22a69a7e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '752f2945ba01412187c04130e78dab1e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:38.837264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-934594b2-faf4-4cb3-b1d7-e7e22a69a7e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '752f2945ba01412187c04130e78dab1e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:38.838083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-934594b2-faf4-4cb3-b1d7-e7e22a69a7e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '752f2945ba01412187c04130e78dab1e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:38.850182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-934594b2-faf4-4cb3-b1d7-e7e22a69a7e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '752f2945ba01412187c04130e78dab1e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:38.868809 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2290/4595] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:38 2022] DELETE /identity/v3/users/752f2945ba01412187c04130e78dab1e => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:39.369761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3691afa-6e4a-4e03-9289-4cbfb653c89e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:39.372353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3691afa-6e4a-4e03-9289-4cbfb653c89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:39.396285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3691afa-6e4a-4e03-9289-4cbfb653c89e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:39.519884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e72587-62e0-4e6c-bea4-3131bbb8b684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:39.520860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e72587-62e0-4e6c-bea4-3131bbb8b684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:39.521237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e72587-62e0-4e6c-bea4-3131bbb8b684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:39.521612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e72587-62e0-4e6c-bea4-3131bbb8b684 admin admin] PATH_INFO: `/v3/projects/ef1c3b4b3c0043d3bd91f264b2ab2231` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:39.523604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e72587-62e0-4e6c-bea4-3131bbb8b684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1c3b4b3c0043d3bd91f264b2ab2231)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:39.525969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e72587-62e0-4e6c-bea4-3131bbb8b684 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:39.530199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:39.636095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f0e72587-62e0-4e6c-bea4-3131bbb8b684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1c3b4b3c0043d3bd91f264b2ab2231', 'request_id': 'req-f0e72587-62e0-4e6c-bea4-3131bbb8b684'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:39.657708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f0e72587-62e0-4e6c-bea4-3131bbb8b684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1c3b4b3c0043d3bd91f264b2ab2231', 'request_id': 'req-f0e72587-62e0-4e6c-bea4-3131bbb8b684'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:39.665977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f0e72587-62e0-4e6c-bea4-3131bbb8b684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1c3b4b3c0043d3bd91f264b2ab2231', 'request_id': 'req-f0e72587-62e0-4e6c-bea4-3131bbb8b684'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:39.697214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f0e72587-62e0-4e6c-bea4-3131bbb8b684 admin admin] The token cache is being invalidate because project ef1c3b4b3c0043d3bd91f264b2ab2231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:39.697597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f0e72587-62e0-4e6c-bea4-3131bbb8b684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:39.698300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f0e72587-62e0-4e6c-bea4-3131bbb8b684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:39.712047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8efaab-4810-4c29-9d81-36815e6bab97 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:39.712603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8efaab-4810-4c29-9d81-36815e6bab97 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:39.712848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8efaab-4810-4c29-9d81-36815e6bab97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:39.716732 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2306/4596] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:39 2022] DELETE /identity/v3/projects/ef1c3b4b3c0043d3bd91f264b2ab2231 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:39.750675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ac8efaab-4810-4c29-9d81-36815e6bab97 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:39.752242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ac8efaab-4810-4c29-9d81-36815e6bab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:39.900959 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2291/4597] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:39.902808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2398c1-f6f7-44b1-85a1-b0ab28b4cbc5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:39.903106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2398c1-f6f7-44b1-85a1-b0ab28b4cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:39.903418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2398c1-f6f7-44b1-85a1-b0ab28b4cbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:39.933119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7d2398c1-f6f7-44b1-85a1-b0ab28b4cbc5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:39.934888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7d2398c1-f6f7-44b1-85a1-b0ab28b4cbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:39.968935 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2307/4598] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:39.969877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8efaab-4810-4c29-9d81-36815e6bab97 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:39.990082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8efaab-4810-4c29-9d81-36815e6bab97 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:40.002280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a772f-a83a-4abd-90f7-655eb5da64c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:40.002919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a772f-a83a-4abd-90f7-655eb5da64c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:40.003196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a772f-a83a-4abd-90f7-655eb5da64c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:40.008891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a772f-a83a-4abd-90f7-655eb5da64c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:40.014416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a772f-a83a-4abd-90f7-655eb5da64c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:40.016538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a772f-a83a-4abd-90f7-655eb5da64c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:40.037209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a772f-a83a-4abd-90f7-655eb5da64c1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:40.082560 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2292/4599] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:38:40.085311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2398c1-f6f7-44b1-85a1-b0ab28b4cbc5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:40.100874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2398c1-f6f7-44b1-85a1-b0ab28b4cbc5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:40.119073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bcb65-c088-45f9-8af2-727ce46a3658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:40.120068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bcb65-c088-45f9-8af2-727ce46a3658 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:40.120564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bcb65-c088-45f9-8af2-727ce46a3658 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:40.120985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bcb65-c088-45f9-8af2-727ce46a3658 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:40.121783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bcb65-c088-45f9-8af2-727ce46a3658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:40.123887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bcb65-c088-45f9-8af2-727ce46a3658 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:40.184249 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2308/4600] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:40 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:40.188483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a772f-a83a-4abd-90f7-655eb5da64c1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:40.206166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a772f-a83a-4abd-90f7-655eb5da64c1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:40.366460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709ec4b-0f86-4d09-9226-7588b7734549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:40.367004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709ec4b-0f86-4d09-9226-7588b7734549 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:40.367299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709ec4b-0f86-4d09-9226-7588b7734549 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:40.367681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709ec4b-0f86-4d09-9226-7588b7734549 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:40.368838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709ec4b-0f86-4d09-9226-7588b7734549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:40.371211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709ec4b-0f86-4d09-9226-7588b7734549 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:40.395164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:40.436427 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2293/4601] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:40 2022] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:40.440310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bcb65-c088-45f9-8af2-727ce46a3658 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:40.454463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bcb65-c088-45f9-8af2-727ce46a3658 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:40.474358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dffaf3-bc5d-442f-988c-af99be191c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:40.475001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dffaf3-bc5d-442f-988c-af99be191c96 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:40.475303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dffaf3-bc5d-442f-988c-af99be191c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:40.475585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dffaf3-bc5d-442f-988c-af99be191c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:40.476259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dffaf3-bc5d-442f-988c-af99be191c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:40.477872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dffaf3-bc5d-442f-988c-af99be191c96 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:40.497551 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2309/4602] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:38:40.501692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709ec4b-0f86-4d09-9226-7588b7734549 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:40.523918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709ec4b-0f86-4d09-9226-7588b7734549 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:40.536051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baca8e-87a7-4573-93c4-1cafe6697430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:40.536702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baca8e-87a7-4573-93c4-1cafe6697430 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:40.536991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baca8e-87a7-4573-93c4-1cafe6697430 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:40.537273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baca8e-87a7-4573-93c4-1cafe6697430 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:40.537941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baca8e-87a7-4573-93c4-1cafe6697430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:40.539602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baca8e-87a7-4573-93c4-1cafe6697430 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:40.565340 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2294/4603] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:40.566530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dffaf3-bc5d-442f-988c-af99be191c96 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:40.587212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dffaf3-bc5d-442f-988c-af99be191c96 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:40.604149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f706b3-da36-4e69-9d64-eb963c6fb13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:40.605026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f706b3-da36-4e69-9d64-eb963c6fb13d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:40.605419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f706b3-da36-4e69-9d64-eb963c6fb13d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:40.605828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f706b3-da36-4e69-9d64-eb963c6fb13d admin admin] PATH_INFO: `/v3/projects/65e8ef7ad3cb4bcbbe920b1c8b8ce713/users/f21724f1d1944b68b0ba65381241f885/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:40.667309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f706b3-da36-4e69-9d64-eb963c6fb13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e8ef7ad3cb4bcbbe920b1c8b8ce713, user_id=f21724f1d1944b68b0ba65381241f885, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:40.675480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f706b3-da36-4e69-9d64-eb963c6fb13d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:40.716800 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2310/4604] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:40 2022] PUT /identity/v3/projects/65e8ef7ad3cb4bcbbe920b1c8b8ce713/users/f21724f1d1944b68b0ba65381241f885/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:40.728975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae2879-f5ab-4c51-ab3a-0018a6c11ea7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:40.729580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae2879-f5ab-4c51-ab3a-0018a6c11ea7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:40.729876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae2879-f5ab-4c51-ab3a-0018a6c11ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:40.837323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8fae2879-f5ab-4c51-ab3a-0018a6c11ea7 None None] MFA Rules not processed for user `f21724f1d1944b68b0ba65381241f885`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:40.838646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8fae2879-f5ab-4c51-ab3a-0018a6c11ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:41.014395 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2295/4605] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:38:41.017839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f706b3-da36-4e69-9d64-eb963c6fb13d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:41.044066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f706b3-da36-4e69-9d64-eb963c6fb13d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:41.065470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e74606-49d6-4949-825e-7ac548efef06 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21724f1d1944b68b0ba65381241f885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:41.086423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e74606-49d6-4949-825e-7ac548efef06 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:41.087030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e74606-49d6-4949-825e-7ac548efef06 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:41.088536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e74606-49d6-4949-825e-7ac548efef06 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:41.090758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e74606-49d6-4949-825e-7ac548efef06 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorizing `identity:create_application_credential(user_id=f21724f1d1944b68b0ba65381241f885)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:41.095145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e74606-49d6-4949-825e-7ac548efef06 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:41.343541 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2311/4606] 10.222.0.27 () {60 vars in 1314 bytes} [Sun Aug 28 18:38:41 2022] POST /identity/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials => generated 789 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:41.345487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae2879-f5ab-4c51-ab3a-0018a6c11ea7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:41.371185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae2879-f5ab-4c51-ab3a-0018a6c11ea7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:41.391367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44cb7a-455f-44a2-8d19-afe19c6a20b7 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21724f1d1944b68b0ba65381241f885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:41.393229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44cb7a-455f-44a2-8d19-afe19c6a20b7 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:41.393802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44cb7a-455f-44a2-8d19-afe19c6a20b7 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:41.394799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44cb7a-455f-44a2-8d19-afe19c6a20b7 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials/48a7b75da250443ba3704e5eadfb827b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:41.425672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44cb7a-455f-44a2-8d19-afe19c6a20b7 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorizing `identity:get_application_credential(user_id=f21724f1d1944b68b0ba65381241f885, application_credential_id=48a7b75da250443ba3704e5eadfb827b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:41.428828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44cb7a-455f-44a2-8d19-afe19c6a20b7 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:41.431092 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2296/4607] 10.222.0.27 () {58 vars in 1392 bytes} [Sun Aug 28 18:38:41 2022] GET /identity/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials/48a7b75da250443ba3704e5eadfb827b => generated 689 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:41.436728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52fc18-ccbe-4750-8eaf-b9a8814ea46e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:41.437471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52fc18-ccbe-4750-8eaf-b9a8814ea46e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:41.437958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52fc18-ccbe-4750-8eaf-b9a8814ea46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:41.493718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2a52fc18-ccbe-4750-8eaf-b9a8814ea46e None None] MFA Rules not processed for user `f21724f1d1944b68b0ba65381241f885`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:41.497162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2a52fc18-ccbe-4750-8eaf-b9a8814ea46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:41.524616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:41.691574 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2312/4608] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:41 2022] POST /identity/v3/auth/tokens => generated 3427 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 28 18:38:41.695921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44cb7a-455f-44a2-8d19-afe19c6a20b7 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:41.713631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44cb7a-455f-44a2-8d19-afe19c6a20b7 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:41.723296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306504d7-273f-410f-a41d-d0c5f2d25fe1 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21724f1d1944b68b0ba65381241f885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:41.723802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306504d7-273f-410f-a41d-d0c5f2d25fe1 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:41.724284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306504d7-273f-410f-a41d-d0c5f2d25fe1 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:41.724671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306504d7-273f-410f-a41d-d0c5f2d25fe1 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials/48a7b75da250443ba3704e5eadfb827b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:41.727468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306504d7-273f-410f-a41d-d0c5f2d25fe1 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f21724f1d1944b68b0ba65381241f885, application_credential_id=48a7b75da250443ba3704e5eadfb827b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:41.729949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306504d7-273f-410f-a41d-d0c5f2d25fe1 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:41.786281 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2297/4609] 10.222.0.27 () {58 vars in 1395 bytes} [Sun Aug 28 18:38:41 2022] DELETE /identity/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials/48a7b75da250443ba3704e5eadfb827b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:41.794090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52fc18-ccbe-4750-8eaf-b9a8814ea46e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:41.808881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52fc18-ccbe-4750-8eaf-b9a8814ea46e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:41.820413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf90ba6-1585-47b7-8719-ea1adad6d0a0 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21724f1d1944b68b0ba65381241f885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:41.821139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf90ba6-1585-47b7-8719-ea1adad6d0a0 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:41.821428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf90ba6-1585-47b7-8719-ea1adad6d0a0 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:41.821714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf90ba6-1585-47b7-8719-ea1adad6d0a0 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:41.822473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf90ba6-1585-47b7-8719-ea1adad6d0a0 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorizing `identity:create_application_credential(user_id=f21724f1d1944b68b0ba65381241f885)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:41.826434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf90ba6-1585-47b7-8719-ea1adad6d0a0 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:42.039601 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2313/4610] 10.222.0.27 () {60 vars in 1315 bytes} [Sun Aug 28 18:38:41 2022] POST /identity/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials => generated 921 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:38:42.043882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306504d7-273f-410f-a41d-d0c5f2d25fe1 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:42.054387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306504d7-273f-410f-a41d-d0c5f2d25fe1 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:42.059926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5032b73-f898-4ec3-ad1a-161fb19578f5 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21724f1d1944b68b0ba65381241f885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:42.060787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5032b73-f898-4ec3-ad1a-161fb19578f5 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:42.061172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5032b73-f898-4ec3-ad1a-161fb19578f5 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:42.061552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5032b73-f898-4ec3-ad1a-161fb19578f5 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials/db8fd0b3f8924992a20ddf673474fe43` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:42.078519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5032b73-f898-4ec3-ad1a-161fb19578f5 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f21724f1d1944b68b0ba65381241f885, application_credential_id=db8fd0b3f8924992a20ddf673474fe43)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:42.081478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5032b73-f898-4ec3-ad1a-161fb19578f5 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:42.128788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf90ba6-1585-47b7-8719-ea1adad6d0a0 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:42.129724 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2298/4611] 10.222.0.27 () {58 vars in 1395 bytes} [Sun Aug 28 18:38:42 2022] DELETE /identity/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials/db8fd0b3f8924992a20ddf673474fe43 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:42.143071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf90ba6-1585-47b7-8719-ea1adad6d0a0 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:42.155065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507ff8d-6dfa-4a6d-a4e8-7ee94ef9d013 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21724f1d1944b68b0ba65381241f885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:42.156187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507ff8d-6dfa-4a6d-a4e8-7ee94ef9d013 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:42.156678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507ff8d-6dfa-4a6d-a4e8-7ee94ef9d013 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:42.157157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507ff8d-6dfa-4a6d-a4e8-7ee94ef9d013 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:42.158059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507ff8d-6dfa-4a6d-a4e8-7ee94ef9d013 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorizing `identity:create_application_credential(user_id=f21724f1d1944b68b0ba65381241f885)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:42.160853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507ff8d-6dfa-4a6d-a4e8-7ee94ef9d013 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:42.323119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:42.339650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5032b73-f898-4ec3-ad1a-161fb19578f5 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:42.345134 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2314/4612] 10.222.0.27 () {60 vars in 1315 bytes} [Sun Aug 28 18:38:42 2022] POST /identity/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials => generated 813 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:42.354618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5032b73-f898-4ec3-ad1a-161fb19578f5 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:42.369206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88e835-27e8-44ad-acf6-342ca9669eae tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21724f1d1944b68b0ba65381241f885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:42.370547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e835-27e8-44ad-acf6-342ca9669eae tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:42.371504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e835-27e8-44ad-acf6-342ca9669eae tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:42.372005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e835-27e8-44ad-acf6-342ca9669eae tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials/d64733f037f44d93a89619ed349a5817` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:42.383928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88e835-27e8-44ad-acf6-342ca9669eae tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f21724f1d1944b68b0ba65381241f885, application_credential_id=d64733f037f44d93a89619ed349a5817)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:42.387988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88e835-27e8-44ad-acf6-342ca9669eae tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:42.441164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507ff8d-6dfa-4a6d-a4e8-7ee94ef9d013 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:42.442496 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2299/4613] 10.222.0.27 () {58 vars in 1395 bytes} [Sun Aug 28 18:38:42 2022] DELETE /identity/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials/d64733f037f44d93a89619ed349a5817 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:42.457391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507ff8d-6dfa-4a6d-a4e8-7ee94ef9d013 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:42.469277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a952e-25ca-4a9c-8355-8bd5ba821f6a tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21724f1d1944b68b0ba65381241f885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:42.470637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a952e-25ca-4a9c-8355-8bd5ba821f6a tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:42.471337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a952e-25ca-4a9c-8355-8bd5ba821f6a tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:42.471825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a952e-25ca-4a9c-8355-8bd5ba821f6a tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:42.472839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a952e-25ca-4a9c-8355-8bd5ba821f6a tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorizing `identity:create_application_credential(user_id=f21724f1d1944b68b0ba65381241f885)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:42.474719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a952e-25ca-4a9c-8355-8bd5ba821f6a tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:42.685219 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2315/4614] 10.222.0.27 () {60 vars in 1314 bytes} [Sun Aug 28 18:38:42 2022] POST /identity/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials => generated 788 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:42.687420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88e835-27e8-44ad-acf6-342ca9669eae tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:42.701296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88e835-27e8-44ad-acf6-342ca9669eae tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:42.706189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37843f-e444-4f46-85dc-7cec0ce66e0b tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21724f1d1944b68b0ba65381241f885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:42.707467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37843f-e444-4f46-85dc-7cec0ce66e0b tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:42.708014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37843f-e444-4f46-85dc-7cec0ce66e0b tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:42.708515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37843f-e444-4f46-85dc-7cec0ce66e0b tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:42.710239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37843f-e444-4f46-85dc-7cec0ce66e0b tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorizing `identity:create_application_credential(user_id=f21724f1d1944b68b0ba65381241f885)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:42.721751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37843f-e444-4f46-85dc-7cec0ce66e0b tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:42.811897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:42.887313 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2300/4615] 10.222.0.27 () {60 vars in 1314 bytes} [Sun Aug 28 18:38:42 2022] POST /identity/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials => generated 787 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:42.887541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a952e-25ca-4a9c-8355-8bd5ba821f6a tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:42.895286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a952e-25ca-4a9c-8355-8bd5ba821f6a tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:42.901976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe13d6-26f0-4fe9-8358-bcf28cb8be96 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21724f1d1944b68b0ba65381241f885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:42.902638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe13d6-26f0-4fe9-8358-bcf28cb8be96 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:42.902924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe13d6-26f0-4fe9-8358-bcf28cb8be96 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:42.903245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe13d6-26f0-4fe9-8358-bcf28cb8be96 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:42.903860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe13d6-26f0-4fe9-8358-bcf28cb8be96 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorizing `identity:list_application_credentials(user_id=f21724f1d1944b68b0ba65381241f885)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:42.906243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe13d6-26f0-4fe9-8358-bcf28cb8be96 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:42.935964 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2316/4616] 10.222.0.27 () {58 vars in 1293 bytes} [Sun Aug 28 18:38:42 2022] GET /identity/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials => generated 1499 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:38:42.940121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37843f-e444-4f46-85dc-7cec0ce66e0b tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:42.952635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37843f-e444-4f46-85dc-7cec0ce66e0b tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:42.958752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fe355-3feb-49a9-91e9-b3f4d7d888bb tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21724f1d1944b68b0ba65381241f885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:42.959482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fe355-3feb-49a9-91e9-b3f4d7d888bb tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:42.959757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fe355-3feb-49a9-91e9-b3f4d7d888bb tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:42.960042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fe355-3feb-49a9-91e9-b3f4d7d888bb tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials/183c32e14025443581ddd4b20fb48bf3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:42.983050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fe355-3feb-49a9-91e9-b3f4d7d888bb tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f21724f1d1944b68b0ba65381241f885, application_credential_id=183c32e14025443581ddd4b20fb48bf3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:42.984686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fe355-3feb-49a9-91e9-b3f4d7d888bb tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:43.025685 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2301/4617] 10.222.0.27 () {58 vars in 1395 bytes} [Sun Aug 28 18:38:42 2022] DELETE /identity/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials/183c32e14025443581ddd4b20fb48bf3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:43.029962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe13d6-26f0-4fe9-8358-bcf28cb8be96 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:43.052042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe13d6-26f0-4fe9-8358-bcf28cb8be96 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:43.063674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9eb82-b1c1-44be-9ae6-d3c0cb684e26 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21724f1d1944b68b0ba65381241f885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:43.065921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9eb82-b1c1-44be-9ae6-d3c0cb684e26 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:43.066434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9eb82-b1c1-44be-9ae6-d3c0cb684e26 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:43.067151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9eb82-b1c1-44be-9ae6-d3c0cb684e26 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials/dba9ee7908994a2fb5a31d7f8a114301` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:43.083909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9eb82-b1c1-44be-9ae6-d3c0cb684e26 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f21724f1d1944b68b0ba65381241f885, application_credential_id=dba9ee7908994a2fb5a31d7f8a114301)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:43.087658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9eb82-b1c1-44be-9ae6-d3c0cb684e26 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:43.124506 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2317/4618] 10.222.0.27 () {58 vars in 1395 bytes} [Sun Aug 28 18:38:43 2022] DELETE /identity/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials/dba9ee7908994a2fb5a31d7f8a114301 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:43.132748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fe355-3feb-49a9-91e9-b3f4d7d888bb tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:43.143957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fe355-3feb-49a9-91e9-b3f4d7d888bb tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:43.171472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf907c-1638-4996-aa59-74a2214999ec tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21724f1d1944b68b0ba65381241f885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:43.172612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf907c-1638-4996-aa59-74a2214999ec tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:43.173059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf907c-1638-4996-aa59-74a2214999ec tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:43.174163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf907c-1638-4996-aa59-74a2214999ec tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:43.175061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf907c-1638-4996-aa59-74a2214999ec tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorizing `identity:create_application_credential(user_id=f21724f1d1944b68b0ba65381241f885)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:43.177277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf907c-1638-4996-aa59-74a2214999ec tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:43.320693 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2302/4619] 10.222.0.27 () {60 vars in 1314 bytes} [Sun Aug 28 18:38:43 2022] POST /identity/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials => generated 789 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:43.325942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9eb82-b1c1-44be-9ae6-d3c0cb684e26 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:43.342701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9eb82-b1c1-44be-9ae6-d3c0cb684e26 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:43.354651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45481a8-14b4-499a-9fe1-401a836f468b tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21724f1d1944b68b0ba65381241f885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:43.355565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45481a8-14b4-499a-9fe1-401a836f468b tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:43.355963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45481a8-14b4-499a-9fe1-401a836f468b tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:43.356347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45481a8-14b4-499a-9fe1-401a836f468b tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:43.357548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45481a8-14b4-499a-9fe1-401a836f468b tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorizing `identity:create_application_credential(user_id=f21724f1d1944b68b0ba65381241f885)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:43.358842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45481a8-14b4-499a-9fe1-401a836f468b tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:43.529964 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2318/4620] 10.222.0.27 () {60 vars in 1314 bytes} [Sun Aug 28 18:38:43 2022] POST /identity/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials => generated 788 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:43.534020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf907c-1638-4996-aa59-74a2214999ec tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:43.550896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf907c-1638-4996-aa59-74a2214999ec tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:43.564797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa66442-3da1-426a-b39e-61ce1d408b35 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21724f1d1944b68b0ba65381241f885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:43.565660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa66442-3da1-426a-b39e-61ce1d408b35 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:43.566095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa66442-3da1-426a-b39e-61ce1d408b35 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:43.577376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa66442-3da1-426a-b39e-61ce1d408b35 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:43.578198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa66442-3da1-426a-b39e-61ce1d408b35 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Adding query filter params (name=tempest-application_credential-380739396) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:43.578854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa66442-3da1-426a-b39e-61ce1d408b35 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorizing `identity:list_application_credentials(user_id=f21724f1d1944b68b0ba65381241f885)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:43.580586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa66442-3da1-426a-b39e-61ce1d408b35 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:43.597325 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2303/4621] 10.222.0.27 () {58 vars in 1384 bytes} [Sun Aug 28 18:38:43 2022] GET /identity/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials?name=tempest-application_credential-380739396 => generated 885 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:43.598422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45481a8-14b4-499a-9fe1-401a836f468b tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:43.608185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45481a8-14b4-499a-9fe1-401a836f468b tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:43.623833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c11366-d828-4aac-8a19-60aeeb383e4e tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21724f1d1944b68b0ba65381241f885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:43.624520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c11366-d828-4aac-8a19-60aeeb383e4e tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:43.624811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c11366-d828-4aac-8a19-60aeeb383e4e tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:43.625095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c11366-d828-4aac-8a19-60aeeb383e4e tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials/16c30dbdfe4a479db7f1a796eaace3e6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:43.659915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c11366-d828-4aac-8a19-60aeeb383e4e tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f21724f1d1944b68b0ba65381241f885, application_credential_id=16c30dbdfe4a479db7f1a796eaace3e6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:43.662013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c11366-d828-4aac-8a19-60aeeb383e4e tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:43.717884 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2319/4622] 10.222.0.27 () {58 vars in 1395 bytes} [Sun Aug 28 18:38:43 2022] DELETE /identity/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials/16c30dbdfe4a479db7f1a796eaace3e6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:43.721967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa66442-3da1-426a-b39e-61ce1d408b35 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:43.735131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa66442-3da1-426a-b39e-61ce1d408b35 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:43.743582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cdfcc-904c-4c38-bbf7-1cc95ab18eb7 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21724f1d1944b68b0ba65381241f885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:43.746115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cdfcc-904c-4c38-bbf7-1cc95ab18eb7 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:43.746896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cdfcc-904c-4c38-bbf7-1cc95ab18eb7 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:43.747652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cdfcc-904c-4c38-bbf7-1cc95ab18eb7 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials/99ea2603b0d5479297761b6aa7f07d47` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:43.785276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cdfcc-904c-4c38-bbf7-1cc95ab18eb7 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f21724f1d1944b68b0ba65381241f885, application_credential_id=99ea2603b0d5479297761b6aa7f07d47)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:43.788151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cdfcc-904c-4c38-bbf7-1cc95ab18eb7 tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:43.880506 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2304/4623] 10.222.0.27 () {58 vars in 1395 bytes} [Sun Aug 28 18:38:43 2022] DELETE /identity/v3/users/f21724f1d1944b68b0ba65381241f885/application_credentials/99ea2603b0d5479297761b6aa7f07d47 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:43.887094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c11366-d828-4aac-8a19-60aeeb383e4e tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:43.929656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:44.038006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c11366-d828-4aac-8a19-60aeeb383e4e tempest-ApplicationCredentialsV3Test-1456614933 tempest-ApplicationCredentialsV3Test-1456614933-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:44.044887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad1865-a963-4d0e-bbca-76ccdccf2229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:44.046338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad1865-a963-4d0e-bbca-76ccdccf2229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:44.046714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad1865-a963-4d0e-bbca-76ccdccf2229 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:44.047060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad1865-a963-4d0e-bbca-76ccdccf2229 admin admin] PATH_INFO: `/v3/users/f21724f1d1944b68b0ba65381241f885` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:44.048541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad1865-a963-4d0e-bbca-76ccdccf2229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21724f1d1944b68b0ba65381241f885)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:44.050838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad1865-a963-4d0e-bbca-76ccdccf2229 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:44.131625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d9ad1865-a963-4d0e-bbca-76ccdccf2229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21724f1d1944b68b0ba65381241f885'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:44.133336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d9ad1865-a963-4d0e-bbca-76ccdccf2229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21724f1d1944b68b0ba65381241f885'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:44.156229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d9ad1865-a963-4d0e-bbca-76ccdccf2229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21724f1d1944b68b0ba65381241f885'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:44.178562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d9ad1865-a963-4d0e-bbca-76ccdccf2229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21724f1d1944b68b0ba65381241f885'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:44.241249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d9ad1865-a963-4d0e-bbca-76ccdccf2229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21724f1d1944b68b0ba65381241f885'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:44.252160 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2320/4624] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:43 2022] DELETE /identity/v3/users/f21724f1d1944b68b0ba65381241f885 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:44.257000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a75bb5-9144-4ed5-a280-4b0f82dcb5a5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:44.257568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a75bb5-9144-4ed5-a280-4b0f82dcb5a5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:44.258058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a75bb5-9144-4ed5-a280-4b0f82dcb5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:44.293443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-89a75bb5-9144-4ed5-a280-4b0f82dcb5a5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:44.294604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-89a75bb5-9144-4ed5-a280-4b0f82dcb5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:44.388112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:44.429118 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2305/4625] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:44.439651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad1865-a963-4d0e-bbca-76ccdccf2229 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:44.441510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9ad1865-a963-4d0e-bbca-76ccdccf2229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:44.533306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad1865-a963-4d0e-bbca-76ccdccf2229 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:44.545986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5e1ea-defe-4bd2-8de8-fa3c16c2426e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:44.547554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5e1ea-defe-4bd2-8de8-fa3c16c2426e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:44.548653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5e1ea-defe-4bd2-8de8-fa3c16c2426e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:44.550324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5e1ea-defe-4bd2-8de8-fa3c16c2426e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:44.579508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5e1ea-defe-4bd2-8de8-fa3c16c2426e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:44.585228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5e1ea-defe-4bd2-8de8-fa3c16c2426e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:44.623542 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2321/4626] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:45.212555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a75bb5-9144-4ed5-a280-4b0f82dcb5a5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:45.215029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-89a75bb5-9144-4ed5-a280-4b0f82dcb5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:45.229331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a75bb5-9144-4ed5-a280-4b0f82dcb5a5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:45.236243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f78831-fd35-4418-b867-0989bbac8e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:45.237115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f78831-fd35-4418-b867-0989bbac8e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:45.237609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f78831-fd35-4418-b867-0989bbac8e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:45.238090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f78831-fd35-4418-b867-0989bbac8e93 admin admin] PATH_INFO: `/v3/projects/65e8ef7ad3cb4bcbbe920b1c8b8ce713` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:45.239549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f78831-fd35-4418-b867-0989bbac8e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e8ef7ad3cb4bcbbe920b1c8b8ce713)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:45.242014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f78831-fd35-4418-b867-0989bbac8e93 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:45.312000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c8f78831-fd35-4418-b867-0989bbac8e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'request_id': 'req-c8f78831-fd35-4418-b867-0989bbac8e93'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:45.319636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c8f78831-fd35-4418-b867-0989bbac8e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'request_id': 'req-c8f78831-fd35-4418-b867-0989bbac8e93'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:45.349075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c8f78831-fd35-4418-b867-0989bbac8e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e8ef7ad3cb4bcbbe920b1c8b8ce713', 'request_id': 'req-c8f78831-fd35-4418-b867-0989bbac8e93'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:45.393120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c8f78831-fd35-4418-b867-0989bbac8e93 admin admin] The token cache is being invalidate because project 65e8ef7ad3cb4bcbbe920b1c8b8ce713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:45.393807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c8f78831-fd35-4418-b867-0989bbac8e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:45.394949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c8f78831-fd35-4418-b867-0989bbac8e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:45.401750 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2306/4627] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:45 2022] DELETE /identity/v3/projects/65e8ef7ad3cb4bcbbe920b1c8b8ce713 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:45.402045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0e830-beb9-4dd1-8611-da8f41471c7e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:45.402502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0e830-beb9-4dd1-8611-da8f41471c7e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:45.402591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0e830-beb9-4dd1-8611-da8f41471c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:45.438009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-afc0e830-beb9-4dd1-8611-da8f41471c7e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:45.439188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-afc0e830-beb9-4dd1-8611-da8f41471c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:45.489944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:45.533790 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2322/4628] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:45.542529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc787b-4475-428b-aa80-3fda19115abe None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:45.542834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc787b-4475-428b-aa80-3fda19115abe None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:45.543092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc787b-4475-428b-aa80-3fda19115abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:45.574151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b4fc787b-4475-428b-aa80-3fda19115abe None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:45.576105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b4fc787b-4475-428b-aa80-3fda19115abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:45.593313 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2307/4629] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:45.595614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0e830-beb9-4dd1-8611-da8f41471c7e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:45.608774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0e830-beb9-4dd1-8611-da8f41471c7e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:45.623875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d21c5f-78c8-4b4d-a95f-a5df04b1e162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:45.624527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d21c5f-78c8-4b4d-a95f-a5df04b1e162 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:45.624795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d21c5f-78c8-4b4d-a95f-a5df04b1e162 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:45.625074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d21c5f-78c8-4b4d-a95f-a5df04b1e162 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:45.625747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d21c5f-78c8-4b4d-a95f-a5df04b1e162 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:45.626045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d21c5f-78c8-4b4d-a95f-a5df04b1e162 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:45.627738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d21c5f-78c8-4b4d-a95f-a5df04b1e162 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:45.663990 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2323/4630] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:45.665177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc787b-4475-428b-aa80-3fda19115abe None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:45.679714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc787b-4475-428b-aa80-3fda19115abe None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:45.690670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd7704-96b6-4936-8a0b-d45f1c297ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:45.691217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd7704-96b6-4936-8a0b-d45f1c297ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:45.692075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd7704-96b6-4936-8a0b-d45f1c297ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:45.692359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd7704-96b6-4936-8a0b-d45f1c297ac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:45.693011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd7704-96b6-4936-8a0b-d45f1c297ac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:45.694932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd7704-96b6-4936-8a0b-d45f1c297ac6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:45.762503 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2308/4631] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:45 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:45.770158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d21c5f-78c8-4b4d-a95f-a5df04b1e162 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:45.790150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d21c5f-78c8-4b4d-a95f-a5df04b1e162 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:45.955420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c8b7c-8110-47bc-908e-ad251b5c30df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:45.956066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c8b7c-8110-47bc-908e-ad251b5c30df admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:45.956351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c8b7c-8110-47bc-908e-ad251b5c30df admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:45.956632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c8b7c-8110-47bc-908e-ad251b5c30df admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:45.957289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c8b7c-8110-47bc-908e-ad251b5c30df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:45.959303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c8b7c-8110-47bc-908e-ad251b5c30df admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:46.004907 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2324/4632] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:45 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:46.008890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd7704-96b6-4936-8a0b-d45f1c297ac6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:46.022819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd7704-96b6-4936-8a0b-d45f1c297ac6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:46.029121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64fdb4-d077-4b22-bfec-d16c63fbf12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:46.030470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64fdb4-d077-4b22-bfec-d16c63fbf12b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:46.031065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64fdb4-d077-4b22-bfec-d16c63fbf12b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:46.031754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64fdb4-d077-4b22-bfec-d16c63fbf12b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:46.032661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64fdb4-d077-4b22-bfec-d16c63fbf12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:46.034778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64fdb4-d077-4b22-bfec-d16c63fbf12b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:46.058712 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2309/4633] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:46.062593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c8b7c-8110-47bc-908e-ad251b5c30df admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:46.082693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c8b7c-8110-47bc-908e-ad251b5c30df admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:46.090815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafb0f7-e229-4ea6-9729-77e6ee926c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:46.091643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafb0f7-e229-4ea6-9729-77e6ee926c22 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:46.097171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafb0f7-e229-4ea6-9729-77e6ee926c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:46.097484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafb0f7-e229-4ea6-9729-77e6ee926c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:46.098131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafb0f7-e229-4ea6-9729-77e6ee926c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:46.100320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafb0f7-e229-4ea6-9729-77e6ee926c22 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:46.119672 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2325/4634] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:46.123590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64fdb4-d077-4b22-bfec-d16c63fbf12b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:46.150967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64fdb4-d077-4b22-bfec-d16c63fbf12b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:46.163960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd304e-df62-4bfc-9a88-0563c9dacd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:46.164784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd304e-df62-4bfc-9a88-0563c9dacd79 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:46.165563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd304e-df62-4bfc-9a88-0563c9dacd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:46.166187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd304e-df62-4bfc-9a88-0563c9dacd79 admin admin] PATH_INFO: `/v3/projects/120c6e8a711644f7aaa7b813dcac1e82/users/fceee530c9a045cf845c02fd50672713/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:46.190908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd304e-df62-4bfc-9a88-0563c9dacd79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120c6e8a711644f7aaa7b813dcac1e82, user_id=fceee530c9a045cf845c02fd50672713, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:46.194784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd304e-df62-4bfc-9a88-0563c9dacd79 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:46.222987 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2310/4635] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:46 2022] PUT /identity/v3/projects/120c6e8a711644f7aaa7b813dcac1e82/users/fceee530c9a045cf845c02fd50672713/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:46.225086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f3540-ce95-402d-8f56-ba76daff218c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:46.225602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f3540-ce95-402d-8f56-ba76daff218c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:46.225971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f3540-ce95-402d-8f56-ba76daff218c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:46.285105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9f5f3540-ce95-402d-8f56-ba76daff218c None None] MFA Rules not processed for user `fceee530c9a045cf845c02fd50672713`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:46.287625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f5f3540-ce95-402d-8f56-ba76daff218c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:46.420658 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2326/4636] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:46.425265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd304e-df62-4bfc-9a88-0563c9dacd79 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:46.552279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd304e-df62-4bfc-9a88-0563c9dacd79 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:46.558461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250167c5-5d93-4d0d-97d0-2b869d3fc074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:46.559063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250167c5-5d93-4d0d-97d0-2b869d3fc074 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:46.559370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250167c5-5d93-4d0d-97d0-2b869d3fc074 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:46.559679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250167c5-5d93-4d0d-97d0-2b869d3fc074 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:46.561278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250167c5-5d93-4d0d-97d0-2b869d3fc074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:46.563409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250167c5-5d93-4d0d-97d0-2b869d3fc074 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:46.582834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:46.607971 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2311/4637] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:46 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:46.609220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f3540-ce95-402d-8f56-ba76daff218c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:46.624214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f3540-ce95-402d-8f56-ba76daff218c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:46.653061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:46.692918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18db43f-de69-4075-90d3-31c5f5135ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:46.693643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18db43f-de69-4075-90d3-31c5f5135ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:46.693990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18db43f-de69-4075-90d3-31c5f5135ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:46.694351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18db43f-de69-4075-90d3-31c5f5135ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:46.695057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18db43f-de69-4075-90d3-31c5f5135ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:46.697142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18db43f-de69-4075-90d3-31c5f5135ff1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:46.732992 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2327/4638] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:46 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:46.736941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250167c5-5d93-4d0d-97d0-2b869d3fc074 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:46.748861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250167c5-5d93-4d0d-97d0-2b869d3fc074 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:46.755481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f66db-3986-4e64-9cbd-16c1e6938b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:46.755481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f66db-3986-4e64-9cbd-16c1e6938b9c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:46.755744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f66db-3986-4e64-9cbd-16c1e6938b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:46.755992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f66db-3986-4e64-9cbd-16c1e6938b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:46.756650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f66db-3986-4e64-9cbd-16c1e6938b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:46.758664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f66db-3986-4e64-9cbd-16c1e6938b9c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:46.771100 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2312/4639] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:46.775131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18db43f-de69-4075-90d3-31c5f5135ff1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:46.788731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18db43f-de69-4075-90d3-31c5f5135ff1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:46.797764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f16724-87af-4d36-b13c-35942316e067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:46.799239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f16724-87af-4d36-b13c-35942316e067 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:46.799903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f16724-87af-4d36-b13c-35942316e067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:46.800566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f16724-87af-4d36-b13c-35942316e067 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:46.801629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f16724-87af-4d36-b13c-35942316e067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:46.803761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f16724-87af-4d36-b13c-35942316e067 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:46.816560 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2328/4640] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:38:46.820193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f66db-3986-4e64-9cbd-16c1e6938b9c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:46.834986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f66db-3986-4e64-9cbd-16c1e6938b9c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:46.848404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b00693-d755-40d3-9682-1c4be476fb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:46.849097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b00693-d755-40d3-9682-1c4be476fb7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:46.849370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b00693-d755-40d3-9682-1c4be476fb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:46.849777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b00693-d755-40d3-9682-1c4be476fb7a admin admin] PATH_INFO: `/v3/projects/f640a536092443f7bb5bb5db08115156/users/f5a2de4958cc4b9ea584d56385b4ada8/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:46.887924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b00693-d755-40d3-9682-1c4be476fb7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f640a536092443f7bb5bb5db08115156, user_id=f5a2de4958cc4b9ea584d56385b4ada8, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:46.890617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b00693-d755-40d3-9682-1c4be476fb7a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:46.911270 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2313/4641] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:46 2022] PUT /identity/v3/projects/f640a536092443f7bb5bb5db08115156/users/f5a2de4958cc4b9ea584d56385b4ada8/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:46.923757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f2371-6dd3-451e-9497-f2a94d5c4aa6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:46.924247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f2371-6dd3-451e-9497-f2a94d5c4aa6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:46.924716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f2371-6dd3-451e-9497-f2a94d5c4aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:46.985048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ab0f2371-6dd3-451e-9497-f2a94d5c4aa6 None None] MFA Rules not processed for user `f5a2de4958cc4b9ea584d56385b4ada8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:46.986776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab0f2371-6dd3-451e-9497-f2a94d5c4aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:47.163521 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2329/4642] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:47.168260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b00693-d755-40d3-9682-1c4be476fb7a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:47.271286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b00693-d755-40d3-9682-1c4be476fb7a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:47.280752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27420d7c-accf-42e2-8f2c-cbc68fc1cc50 tempest-IdentityV3ProjectsTest-1322626518 tempest-IdentityV3ProjectsTest-1322626518-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fceee530c9a045cf845c02fd50672713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '120c6e8a711644f7aaa7b813dcac1e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:47.281411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27420d7c-accf-42e2-8f2c-cbc68fc1cc50 tempest-IdentityV3ProjectsTest-1322626518 tempest-IdentityV3ProjectsTest-1322626518-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:47.281696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27420d7c-accf-42e2-8f2c-cbc68fc1cc50 tempest-IdentityV3ProjectsTest-1322626518 tempest-IdentityV3ProjectsTest-1322626518-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:47.281973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27420d7c-accf-42e2-8f2c-cbc68fc1cc50 tempest-IdentityV3ProjectsTest-1322626518 tempest-IdentityV3ProjectsTest-1322626518-project] PATH_INFO: `/v3/users/fceee530c9a045cf845c02fd50672713/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:47.284740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27420d7c-accf-42e2-8f2c-cbc68fc1cc50 tempest-IdentityV3ProjectsTest-1322626518 tempest-IdentityV3ProjectsTest-1322626518-project] RBAC: Authorizing `identity:list_user_projects(user_id=fceee530c9a045cf845c02fd50672713)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:47.286806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27420d7c-accf-42e2-8f2c-cbc68fc1cc50 tempest-IdentityV3ProjectsTest-1322626518 tempest-IdentityV3ProjectsTest-1322626518-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:47.390935 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2314/4643] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Aug 28 18:38:47 2022] GET /identity/v3/users/fceee530c9a045cf845c02fd50672713/projects => generated 517 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:38:47.393906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dfc90-dc0e-45aa-9e91-3c3addbd5499 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:47.394469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dfc90-dc0e-45aa-9e91-3c3addbd5499 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:47.395820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dfc90-dc0e-45aa-9e91-3c3addbd5499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:47.452200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-671dfc90-dc0e-45aa-9e91-3c3addbd5499 None None] MFA Rules not processed for user `fceee530c9a045cf845c02fd50672713`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:47.454253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-671dfc90-dc0e-45aa-9e91-3c3addbd5499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:47.470051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914055d8-6c0d-459e-9c48-68bda4585e2a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:47.470348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914055d8-6c0d-459e-9c48-68bda4585e2a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:47.470630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914055d8-6c0d-459e-9c48-68bda4585e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:47.472880 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2330/4644] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:47.497233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-914055d8-6c0d-459e-9c48-68bda4585e2a None None] MFA Rules not processed for user `fceee530c9a045cf845c02fd50672713`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:47.498573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-914055d8-6c0d-459e-9c48-68bda4585e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:47.546777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.models.token_model [None req-914055d8-6c0d-459e-9c48-68bda4585e2a None None] User fceee530c9a045cf845c02fd50672713 has no access to project f640a536092443f7bb5bb5db08115156 {{(pid=82160) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Aug 28 18:38:47.551199 n-d-850468-20 devstack@keystone.service[82160]: WARNING keystone.server.flask.application [None req-914055d8-6c0d-459e-9c48-68bda4585e2a None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 18:38:47.552871 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2315/4645] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:47 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 86 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 18:38:47.559956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dfc90-dc0e-45aa-9e91-3c3addbd5499 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:47.645729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dfc90-dc0e-45aa-9e91-3c3addbd5499 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:47.655353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e382ad-1cec-4267-8337-48319b16d675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:47.659046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e382ad-1cec-4267-8337-48319b16d675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:47.659046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e382ad-1cec-4267-8337-48319b16d675 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:47.659046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e382ad-1cec-4267-8337-48319b16d675 admin admin] PATH_INFO: `/v3/users/fceee530c9a045cf845c02fd50672713` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:47.659046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e382ad-1cec-4267-8337-48319b16d675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fceee530c9a045cf845c02fd50672713)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:47.662567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e382ad-1cec-4267-8337-48319b16d675 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:47.692562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:47.734390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13e382ad-1cec-4267-8337-48319b16d675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fceee530c9a045cf845c02fd50672713'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:47.735206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13e382ad-1cec-4267-8337-48319b16d675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fceee530c9a045cf845c02fd50672713'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:47.745782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13e382ad-1cec-4267-8337-48319b16d675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fceee530c9a045cf845c02fd50672713'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:47.759926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13e382ad-1cec-4267-8337-48319b16d675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fceee530c9a045cf845c02fd50672713'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:47.781454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13e382ad-1cec-4267-8337-48319b16d675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fceee530c9a045cf845c02fd50672713'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:47.792035 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2331/4646] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:47 2022] DELETE /identity/v3/users/fceee530c9a045cf845c02fd50672713 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:47.795303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439def72-af38-4a59-b8b9-66f26cbe0ce5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:47.796078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439def72-af38-4a59-b8b9-66f26cbe0ce5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:47.796547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439def72-af38-4a59-b8b9-66f26cbe0ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:47.828485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-439def72-af38-4a59-b8b9-66f26cbe0ce5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:47.830397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-439def72-af38-4a59-b8b9-66f26cbe0ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:47.872864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:47.914108 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2316/4647] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:47.924274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e382ad-1cec-4267-8337-48319b16d675 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:47.925848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13e382ad-1cec-4267-8337-48319b16d675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:48.020970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b62f1b-fbfa-459d-9a63-c4273b087126 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:48.021308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b62f1b-fbfa-459d-9a63-c4273b087126 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:48.021538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b62f1b-fbfa-459d-9a63-c4273b087126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:48.027163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e382ad-1cec-4267-8337-48319b16d675 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:48.030864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950a617-41a4-4b9b-bb2e-06d4e94d539b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:48.031793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950a617-41a4-4b9b-bb2e-06d4e94d539b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:48.032280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950a617-41a4-4b9b-bb2e-06d4e94d539b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:48.032626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950a617-41a4-4b9b-bb2e-06d4e94d539b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:48.060029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-32b62f1b-fbfa-459d-9a63-c4273b087126 None None] MFA Rules not processed for user `26ec1e64e01348a19f4007326d5f6536`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:48.061148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950a617-41a4-4b9b-bb2e-06d4e94d539b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:48.061263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-32b62f1b-fbfa-459d-9a63-c4273b087126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:48.062909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950a617-41a4-4b9b-bb2e-06d4e94d539b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:48.077427 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2332/4648] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:48.176388 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2317/4649] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:38:48.480706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950a617-41a4-4b9b-bb2e-06d4e94d539b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:48.492809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3950a617-41a4-4b9b-bb2e-06d4e94d539b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:48.517660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950a617-41a4-4b9b-bb2e-06d4e94d539b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:48.538619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:48.539557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:48.540530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:48.540530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763 admin admin] PATH_INFO: `/v3/projects/120c6e8a711644f7aaa7b813dcac1e82` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:48.541476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=120c6e8a711644f7aaa7b813dcac1e82)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:48.543506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:48.607436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120c6e8a711644f7aaa7b813dcac1e82', 'request_id': 'req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:48.616536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120c6e8a711644f7aaa7b813dcac1e82', 'request_id': 'req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:48.628774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120c6e8a711644f7aaa7b813dcac1e82', 'request_id': 'req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:48.649222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763 admin admin] The token cache is being invalidate because project 120c6e8a711644f7aaa7b813dcac1e82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:48.651684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:48.654125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:48.656271 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2333/4650] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:48 2022] DELETE /identity/v3/projects/120c6e8a711644f7aaa7b813dcac1e82 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:48.660504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b62f1b-fbfa-459d-9a63-c4273b087126 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:48.675080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b62f1b-fbfa-459d-9a63-c4273b087126 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:48.749940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfdf37-c990-4ce3-8253-62ca7cb80f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:48.751302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfdf37-c990-4ce3-8253-62ca7cb80f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:48.751302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfdf37-c990-4ce3-8253-62ca7cb80f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:48.751640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfdf37-c990-4ce3-8253-62ca7cb80f31 admin admin] PATH_INFO: `/v3/users/f5a2de4958cc4b9ea584d56385b4ada8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:48.753127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdfdf37-c990-4ce3-8253-62ca7cb80f31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a2de4958cc4b9ea584d56385b4ada8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:48.755231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdfdf37-c990-4ce3-8253-62ca7cb80f31 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:48.811672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6cdfdf37-c990-4ce3-8253-62ca7cb80f31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a2de4958cc4b9ea584d56385b4ada8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:48.825177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6cdfdf37-c990-4ce3-8253-62ca7cb80f31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a2de4958cc4b9ea584d56385b4ada8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:48.825919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6cdfdf37-c990-4ce3-8253-62ca7cb80f31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a2de4958cc4b9ea584d56385b4ada8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:48.826526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6cdfdf37-c990-4ce3-8253-62ca7cb80f31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a2de4958cc4b9ea584d56385b4ada8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:48.835813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6cdfdf37-c990-4ce3-8253-62ca7cb80f31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a2de4958cc4b9ea584d56385b4ada8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:48.850492 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2318/4651] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:48 2022] DELETE /identity/v3/users/f5a2de4958cc4b9ea584d56385b4ada8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:49.142265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:49.143914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:49.159182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee58e6b-7bce-4825-b446-4d9d7b4a2763 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:49.202058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:49.283547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548d2b6-4e13-4a3b-8816-9ab65a65f33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:49.284342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548d2b6-4e13-4a3b-8816-9ab65a65f33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:49.284549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548d2b6-4e13-4a3b-8816-9ab65a65f33b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:49.284822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548d2b6-4e13-4a3b-8816-9ab65a65f33b admin admin] PATH_INFO: `/v3/projects/f640a536092443f7bb5bb5db08115156` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:49.286202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548d2b6-4e13-4a3b-8816-9ab65a65f33b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f640a536092443f7bb5bb5db08115156)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:49.292746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548d2b6-4e13-4a3b-8816-9ab65a65f33b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:49.377662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2548d2b6-4e13-4a3b-8816-9ab65a65f33b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f640a536092443f7bb5bb5db08115156', 'request_id': 'req-2548d2b6-4e13-4a3b-8816-9ab65a65f33b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:49.387870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2548d2b6-4e13-4a3b-8816-9ab65a65f33b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f640a536092443f7bb5bb5db08115156', 'request_id': 'req-2548d2b6-4e13-4a3b-8816-9ab65a65f33b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:49.395635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2548d2b6-4e13-4a3b-8816-9ab65a65f33b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f640a536092443f7bb5bb5db08115156', 'request_id': 'req-2548d2b6-4e13-4a3b-8816-9ab65a65f33b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:49.407855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2548d2b6-4e13-4a3b-8816-9ab65a65f33b admin admin] The token cache is being invalidate because project f640a536092443f7bb5bb5db08115156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:49.408155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2548d2b6-4e13-4a3b-8816-9ab65a65f33b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:49.408838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2548d2b6-4e13-4a3b-8816-9ab65a65f33b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:49.410632 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2334/4652] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:49 2022] DELETE /identity/v3/projects/f640a536092443f7bb5bb5db08115156 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:49.416793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67061bd6-a619-4f75-95a7-e0fa36ae7dc4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:49.417173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67061bd6-a619-4f75-95a7-e0fa36ae7dc4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:49.417546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67061bd6-a619-4f75-95a7-e0fa36ae7dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:49.426306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:49.439728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-67061bd6-a619-4f75-95a7-e0fa36ae7dc4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:49.442033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-67061bd6-a619-4f75-95a7-e0fa36ae7dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:49.535344 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2319/4653] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:49.539437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddbee0-c60a-414b-8e95-2aa6c3683a5c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:49.540090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddbee0-c60a-414b-8e95-2aa6c3683a5c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:49.540090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddbee0-c60a-414b-8e95-2aa6c3683a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:49.576394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-95ddbee0-c60a-414b-8e95-2aa6c3683a5c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:49.577655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-95ddbee0-c60a-414b-8e95-2aa6c3683a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:49.613152 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2335/4654] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:49.615087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67061bd6-a619-4f75-95a7-e0fa36ae7dc4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:49.626992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67061bd6-a619-4f75-95a7-e0fa36ae7dc4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:49.632916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6326c-1fd6-4871-9004-c02f171823b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:49.633807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6326c-1fd6-4871-9004-c02f171823b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:49.634227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6326c-1fd6-4871-9004-c02f171823b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:49.634743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6326c-1fd6-4871-9004-c02f171823b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:49.635910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6326c-1fd6-4871-9004-c02f171823b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:49.636433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6326c-1fd6-4871-9004-c02f171823b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:49.638178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6326c-1fd6-4871-9004-c02f171823b2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:49.661862 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2320/4655] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:49.663841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddbee0-c60a-414b-8e95-2aa6c3683a5c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:49.686897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddbee0-c60a-414b-8e95-2aa6c3683a5c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:49.701089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88acf84-72d7-4fe2-af2e-a0bb31e2c707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:49.701937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88acf84-72d7-4fe2-af2e-a0bb31e2c707 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:49.702217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88acf84-72d7-4fe2-af2e-a0bb31e2c707 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:49.702489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88acf84-72d7-4fe2-af2e-a0bb31e2c707 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:49.703138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88acf84-72d7-4fe2-af2e-a0bb31e2c707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:49.712248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88acf84-72d7-4fe2-af2e-a0bb31e2c707 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:49.776283 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2336/4656] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:49 2022] POST /identity/v3/projects => generated 393 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:49.780618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6326c-1fd6-4871-9004-c02f171823b2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:49.793254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6326c-1fd6-4871-9004-c02f171823b2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:49.888102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10162221-5c3c-42fa-a35d-4bdafd631aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:49.888392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10162221-5c3c-42fa-a35d-4bdafd631aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:49.888898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10162221-5c3c-42fa-a35d-4bdafd631aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:49.889323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10162221-5c3c-42fa-a35d-4bdafd631aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:49.889912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10162221-5c3c-42fa-a35d-4bdafd631aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:49.893175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10162221-5c3c-42fa-a35d-4bdafd631aa2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:49.924703 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2321/4657] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:49 2022] POST /identity/v3/users => generated 303 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:49.928468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88acf84-72d7-4fe2-af2e-a0bb31e2c707 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:49.945544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88acf84-72d7-4fe2-af2e-a0bb31e2c707 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:49.951021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9157aea-41f4-4a7b-8ef2-90b584cce748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:49.952438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9157aea-41f4-4a7b-8ef2-90b584cce748 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:49.952901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9157aea-41f4-4a7b-8ef2-90b584cce748 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:49.953391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9157aea-41f4-4a7b-8ef2-90b584cce748 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:49.954229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9157aea-41f4-4a7b-8ef2-90b584cce748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:49.956051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9157aea-41f4-4a7b-8ef2-90b584cce748 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:49.969590 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2337/4658] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:49.973637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10162221-5c3c-42fa-a35d-4bdafd631aa2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:49.990985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10162221-5c3c-42fa-a35d-4bdafd631aa2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:49.997070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a43665-b6cf-4d94-b622-8a975308dc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:49.997772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a43665-b6cf-4d94-b622-8a975308dc91 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:49.998184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a43665-b6cf-4d94-b622-8a975308dc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:49.998466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a43665-b6cf-4d94-b622-8a975308dc91 admin admin] PATH_INFO: `/v3/projects/a0dec376873a4c008bb3cc657ed6efcd/users/2983480444c248a9b247e47a39e4757f/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:50.017776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a43665-b6cf-4d94-b622-8a975308dc91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0dec376873a4c008bb3cc657ed6efcd, user_id=2983480444c248a9b247e47a39e4757f, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:50.020666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a43665-b6cf-4d94-b622-8a975308dc91 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:50.036440 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2322/4659] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:49 2022] PUT /identity/v3/projects/a0dec376873a4c008bb3cc657ed6efcd/users/2983480444c248a9b247e47a39e4757f/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:50.040424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9157aea-41f4-4a7b-8ef2-90b584cce748 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:50.055998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9157aea-41f4-4a7b-8ef2-90b584cce748 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:50.119787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b16c65-92cd-41b0-bdcc-731387c7df49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:50.120907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b16c65-92cd-41b0-bdcc-731387c7df49 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:50.120907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b16c65-92cd-41b0-bdcc-731387c7df49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:50.121226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b16c65-92cd-41b0-bdcc-731387c7df49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:50.121579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b16c65-92cd-41b0-bdcc-731387c7df49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:50.123212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b16c65-92cd-41b0-bdcc-731387c7df49 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:50.135158 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2338/4660] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:50.139627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a43665-b6cf-4d94-b622-8a975308dc91 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:50.150858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a43665-b6cf-4d94-b622-8a975308dc91 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:50.155641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9508ae-ebab-404c-93bd-2f2d4bb5350e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:50.156334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9508ae-ebab-404c-93bd-2f2d4bb5350e admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:50.156610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9508ae-ebab-404c-93bd-2f2d4bb5350e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:50.157099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9508ae-ebab-404c-93bd-2f2d4bb5350e admin admin] PATH_INFO: `/v3/projects/a0dec376873a4c008bb3cc657ed6efcd/users/2983480444c248a9b247e47a39e4757f/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:50.159281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9508ae-ebab-404c-93bd-2f2d4bb5350e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0dec376873a4c008bb3cc657ed6efcd, user_id=2983480444c248a9b247e47a39e4757f, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:50.162231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9508ae-ebab-404c-93bd-2f2d4bb5350e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:50.176047 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2323/4661] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:50 2022] PUT /identity/v3/projects/a0dec376873a4c008bb3cc657ed6efcd/users/2983480444c248a9b247e47a39e4757f/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:50.186984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5a90-8752-438e-8b33-9b070cef7277 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:50.187406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5a90-8752-438e-8b33-9b070cef7277 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:50.187603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5a90-8752-438e-8b33-9b070cef7277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:50.223236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:50.225158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-497d5a90-8752-438e-8b33-9b070cef7277 None None] MFA Rules not processed for user `2983480444c248a9b247e47a39e4757f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:50.226454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-497d5a90-8752-438e-8b33-9b070cef7277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:50.332918 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2339/4662] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:50.338077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9508ae-ebab-404c-93bd-2f2d4bb5350e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:50.436419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:50.467453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9508ae-ebab-404c-93bd-2f2d4bb5350e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:50.473296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92581d32-a35d-444a-a589-eb4b3b8c001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:50.473916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92581d32-a35d-444a-a589-eb4b3b8c001c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:50.474222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92581d32-a35d-444a-a589-eb4b3b8c001c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:50.474456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92581d32-a35d-444a-a589-eb4b3b8c001c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:50.475098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92581d32-a35d-444a-a589-eb4b3b8c001c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:50.477561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92581d32-a35d-444a-a589-eb4b3b8c001c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:50.525835 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2324/4663] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:50 2022] POST /identity/v3/projects => generated 393 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:50.527519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d5a90-8752-438e-8b33-9b070cef7277 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:50.541569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d5a90-8752-438e-8b33-9b070cef7277 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:50.621529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba99ac-78e1-4c1c-89f2-d82f7c9138bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:50.622245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba99ac-78e1-4c1c-89f2-d82f7c9138bb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:50.622560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba99ac-78e1-4c1c-89f2-d82f7c9138bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:50.622796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba99ac-78e1-4c1c-89f2-d82f7c9138bb admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:50.623507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba99ac-78e1-4c1c-89f2-d82f7c9138bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:50.625470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba99ac-78e1-4c1c-89f2-d82f7c9138bb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:50.652863 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2340/4664] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:50 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:50.656783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92581d32-a35d-444a-a589-eb4b3b8c001c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:50.668110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92581d32-a35d-444a-a589-eb4b3b8c001c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:50.672726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0810031-e072-44bf-acbc-424c3316ecda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:50.686802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0810031-e072-44bf-acbc-424c3316ecda admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:50.686802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0810031-e072-44bf-acbc-424c3316ecda admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:50.686802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0810031-e072-44bf-acbc-424c3316ecda admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:50.686802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0810031-e072-44bf-acbc-424c3316ecda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:50.686802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0810031-e072-44bf-acbc-424c3316ecda admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:50.697160 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2325/4665] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:50.701245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba99ac-78e1-4c1c-89f2-d82f7c9138bb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:50.712516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba99ac-78e1-4c1c-89f2-d82f7c9138bb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:50.718955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bfc32-2a11-458e-835d-feacec8fd364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:50.719802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bfc32-2a11-458e-835d-feacec8fd364 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:50.720266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bfc32-2a11-458e-835d-feacec8fd364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:50.720538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bfc32-2a11-458e-835d-feacec8fd364 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:50.721189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bfc32-2a11-458e-835d-feacec8fd364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:50.722918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bfc32-2a11-458e-835d-feacec8fd364 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:50.738102 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2341/4666] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:50.744535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0810031-e072-44bf-acbc-424c3316ecda admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:50.754974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0810031-e072-44bf-acbc-424c3316ecda admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:50.760197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bbf95-e2df-45cc-8224-8271dff5fad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:50.760875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bbf95-e2df-45cc-8224-8271dff5fad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:50.761777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bbf95-e2df-45cc-8224-8271dff5fad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:50.762205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bbf95-e2df-45cc-8224-8271dff5fad0 admin admin] PATH_INFO: `/v3/projects/21cf94200b5345c988e94ea7c2e604c2/users/a174ef824267414ebf0a0adf348b99df/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:50.778560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bbf95-e2df-45cc-8224-8271dff5fad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cf94200b5345c988e94ea7c2e604c2, user_id=a174ef824267414ebf0a0adf348b99df, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:50.781245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bbf95-e2df-45cc-8224-8271dff5fad0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:50.795466 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2326/4667] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:50 2022] PUT /identity/v3/projects/21cf94200b5345c988e94ea7c2e604c2/users/a174ef824267414ebf0a0adf348b99df/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:50.805869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ef7dc-b6c2-4677-9d27-33557f79dbdd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:50.806264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ef7dc-b6c2-4677-9d27-33557f79dbdd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:50.806607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ef7dc-b6c2-4677-9d27-33557f79dbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:50.835704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-022ef7dc-b6c2-4677-9d27-33557f79dbdd None None] MFA Rules not processed for user `a174ef824267414ebf0a0adf348b99df`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:50.837041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-022ef7dc-b6c2-4677-9d27-33557f79dbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:50.908333 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2342/4668] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:50.919911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bbf95-e2df-45cc-8224-8271dff5fad0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:50.921656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-146bbf95-e2df-45cc-8224-8271dff5fad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:51.000515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bbf95-e2df-45cc-8224-8271dff5fad0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:51.006964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abbb74-c83d-4b4b-a64c-fcc9fca6eae0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:51.007731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abbb74-c83d-4b4b-a64c-fcc9fca6eae0 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:51.008083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abbb74-c83d-4b4b-a64c-fcc9fca6eae0 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:51.008428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abbb74-c83d-4b4b-a64c-fcc9fca6eae0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:51.083170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abbb74-c83d-4b4b-a64c-fcc9fca6eae0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:51.084581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abbb74-c83d-4b4b-a64c-fcc9fca6eae0 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:51.097621 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2327/4669] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:51.734972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ef7dc-b6c2-4677-9d27-33557f79dbdd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:51.736306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-022ef7dc-b6c2-4677-9d27-33557f79dbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:51.756496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:51.847625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ef7dc-b6c2-4677-9d27-33557f79dbdd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:51.856008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc2965-fff4-4bee-ad31-80cd62dfc0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:51.856888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2965-fff4-4bee-ad31-80cd62dfc0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:51.857271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2965-fff4-4bee-ad31-80cd62dfc0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:51.857857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2965-fff4-4bee-ad31-80cd62dfc0ed admin admin] PATH_INFO: `/v3/users/e57aca8c1b5847f999daeb74a982f4ec` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:51.858838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc2965-fff4-4bee-ad31-80cd62dfc0ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=e57aca8c1b5847f999daeb74a982f4ec)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:51.861009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc2965-fff4-4bee-ad31-80cd62dfc0ed admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:51.926929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bfc2965-fff4-4bee-ad31-80cd62dfc0ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e57aca8c1b5847f999daeb74a982f4ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:51.928574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bfc2965-fff4-4bee-ad31-80cd62dfc0ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e57aca8c1b5847f999daeb74a982f4ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:51.938356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bfc2965-fff4-4bee-ad31-80cd62dfc0ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e57aca8c1b5847f999daeb74a982f4ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:51.960548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bfc2965-fff4-4bee-ad31-80cd62dfc0ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e57aca8c1b5847f999daeb74a982f4ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:51.998523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bfc2965-fff4-4bee-ad31-80cd62dfc0ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e57aca8c1b5847f999daeb74a982f4ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:52.010717 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2343/4670] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:51 2022] DELETE /identity/v3/users/e57aca8c1b5847f999daeb74a982f4ec => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:52.015375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f3503-5678-44e2-a77a-b86953bee211 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:52.016206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f3503-5678-44e2-a77a-b86953bee211 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:52.016717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f3503-5678-44e2-a77a-b86953bee211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:52.040917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-683f3503-5678-44e2-a77a-b86953bee211 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:52.042393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-683f3503-5678-44e2-a77a-b86953bee211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:52.046014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc2965-fff4-4bee-ad31-80cd62dfc0ed admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:52.047606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9bfc2965-fff4-4bee-ad31-80cd62dfc0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:52.091899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:52.115071 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2328/4671] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:52.123744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc2965-fff4-4bee-ad31-80cd62dfc0ed admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:52.125119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f3503-5678-44e2-a77a-b86953bee211 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:52.126635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-683f3503-5678-44e2-a77a-b86953bee211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:52.129060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a751cc-ff9f-4134-873f-2f4e647a675f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:52.129770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a751cc-ff9f-4134-873f-2f4e647a675f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:52.130050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a751cc-ff9f-4134-873f-2f4e647a675f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:52.130326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a751cc-ff9f-4134-873f-2f4e647a675f admin admin] PATH_INFO: `/v3/users/2983480444c248a9b247e47a39e4757f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:52.131508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a751cc-ff9f-4134-873f-2f4e647a675f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2983480444c248a9b247e47a39e4757f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:52.133769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a751cc-ff9f-4134-873f-2f4e647a675f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:52.168770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:52.192696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2a751cc-ff9f-4134-873f-2f4e647a675f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2983480444c248a9b247e47a39e4757f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:52.193424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2a751cc-ff9f-4134-873f-2f4e647a675f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2983480444c248a9b247e47a39e4757f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:52.202046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2a751cc-ff9f-4134-873f-2f4e647a675f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2983480444c248a9b247e47a39e4757f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:52.208374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f3503-5678-44e2-a77a-b86953bee211 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:52.212085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2a751cc-ff9f-4134-873f-2f4e647a675f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2983480444c248a9b247e47a39e4757f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:52.212611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f3893-0457-41a0-be67-19307ff48e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:52.213253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3893-0457-41a0-be67-19307ff48e74 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:52.213528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3893-0457-41a0-be67-19307ff48e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:52.213798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3893-0457-41a0-be67-19307ff48e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:52.215933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6a3f3893-0457-41a0-be67-19307ff48e74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:52.226742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2a751cc-ff9f-4134-873f-2f4e647a675f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2983480444c248a9b247e47a39e4757f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:52.229084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f3893-0457-41a0-be67-19307ff48e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:52.230535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f3893-0457-41a0-be67-19307ff48e74 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:52.235285 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2344/4672] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:52 2022] DELETE /identity/v3/users/2983480444c248a9b247e47a39e4757f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:52.238762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3497fea-84a8-4dcf-bd98-056f2caad140 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:52.239035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3497fea-84a8-4dcf-bd98-056f2caad140 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:52.239418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3497fea-84a8-4dcf-bd98-056f2caad140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:52.242394 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2329/4673] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:52.260477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d3497fea-84a8-4dcf-bd98-056f2caad140 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:52.261784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3497fea-84a8-4dcf-bd98-056f2caad140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:52.334785 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2345/4674] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:52.347928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f3893-0457-41a0-be67-19307ff48e74 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:52.349400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6a3f3893-0457-41a0-be67-19307ff48e74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:52.364301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f3893-0457-41a0-be67-19307ff48e74 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:52.432694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3497fea-84a8-4dcf-bd98-056f2caad140 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:52.434429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3497fea-84a8-4dcf-bd98-056f2caad140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:52.436594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c11f9-7a94-426d-b177-2669f17e0170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:52.437546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c11f9-7a94-426d-b177-2669f17e0170 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:52.438140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c11f9-7a94-426d-b177-2669f17e0170 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:52.438541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c11f9-7a94-426d-b177-2669f17e0170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:52.449938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c11f9-7a94-426d-b177-2669f17e0170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:52.451501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c11f9-7a94-426d-b177-2669f17e0170 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:52.463460 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2330/4675] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:52.474642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3497fea-84a8-4dcf-bd98-056f2caad140 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:52.481757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a1b32-251b-441b-bbb3-eb046c38dec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:52.482585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a1b32-251b-441b-bbb3-eb046c38dec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:52.483040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a1b32-251b-441b-bbb3-eb046c38dec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:52.483357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a1b32-251b-441b-bbb3-eb046c38dec5 admin admin] PATH_INFO: `/v3/projects/48439d21167a42748f5813c95b7a8437` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:52.485012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a1b32-251b-441b-bbb3-eb046c38dec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48439d21167a42748f5813c95b7a8437)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:52.487022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a1b32-251b-441b-bbb3-eb046c38dec5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:52.544738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-813a1b32-251b-441b-bbb3-eb046c38dec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48439d21167a42748f5813c95b7a8437', 'request_id': 'req-813a1b32-251b-441b-bbb3-eb046c38dec5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:52.559311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-813a1b32-251b-441b-bbb3-eb046c38dec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48439d21167a42748f5813c95b7a8437', 'request_id': 'req-813a1b32-251b-441b-bbb3-eb046c38dec5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:52.574401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-813a1b32-251b-441b-bbb3-eb046c38dec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48439d21167a42748f5813c95b7a8437', 'request_id': 'req-813a1b32-251b-441b-bbb3-eb046c38dec5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:52.590589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-813a1b32-251b-441b-bbb3-eb046c38dec5 admin admin] The token cache is being invalidate because project 48439d21167a42748f5813c95b7a8437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:52.590890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-813a1b32-251b-441b-bbb3-eb046c38dec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:52.592073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-813a1b32-251b-441b-bbb3-eb046c38dec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:52.593576 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2346/4676] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:52 2022] DELETE /identity/v3/projects/48439d21167a42748f5813c95b7a8437 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:52.597819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c11f9-7a94-426d-b177-2669f17e0170 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:52.607827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c11f9-7a94-426d-b177-2669f17e0170 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:52.682434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fafee-10b5-4cbf-8666-ae5e531119c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:52.682974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fafee-10b5-4cbf-8666-ae5e531119c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:52.683300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fafee-10b5-4cbf-8666-ae5e531119c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:52.683561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fafee-10b5-4cbf-8666-ae5e531119c5 admin admin] PATH_INFO: `/v3/users/facbba4046d7401db296b74664a31481` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:52.684773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58fafee-10b5-4cbf-8666-ae5e531119c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=facbba4046d7401db296b74664a31481)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:52.686888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58fafee-10b5-4cbf-8666-ae5e531119c5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:52.741603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:52.760083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e58fafee-10b5-4cbf-8666-ae5e531119c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'facbba4046d7401db296b74664a31481'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:52.775293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e58fafee-10b5-4cbf-8666-ae5e531119c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'facbba4046d7401db296b74664a31481'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:52.776231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e58fafee-10b5-4cbf-8666-ae5e531119c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'facbba4046d7401db296b74664a31481'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:52.777005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e58fafee-10b5-4cbf-8666-ae5e531119c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'facbba4046d7401db296b74664a31481'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:52.788989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e58fafee-10b5-4cbf-8666-ae5e531119c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'facbba4046d7401db296b74664a31481'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:52.806549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a1b32-251b-441b-bbb3-eb046c38dec5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:52.808117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-813a1b32-251b-441b-bbb3-eb046c38dec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:52.830822 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2331/4677] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:52 2022] DELETE /identity/v3/users/facbba4046d7401db296b74664a31481 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:52.831051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a1b32-251b-441b-bbb3-eb046c38dec5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:52.865523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:52.909668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0a023-196a-450c-9440-3f9eefacee16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:52.910440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0a023-196a-450c-9440-3f9eefacee16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:52.910729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0a023-196a-450c-9440-3f9eefacee16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:52.911006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0a023-196a-450c-9440-3f9eefacee16 admin admin] PATH_INFO: `/v3/projects/a0dec376873a4c008bb3cc657ed6efcd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:52.912264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0a023-196a-450c-9440-3f9eefacee16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0dec376873a4c008bb3cc657ed6efcd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:52.914212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0a023-196a-450c-9440-3f9eefacee16 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:52.971804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ef0a023-196a-450c-9440-3f9eefacee16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0dec376873a4c008bb3cc657ed6efcd', 'request_id': 'req-0ef0a023-196a-450c-9440-3f9eefacee16'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:52.988316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ef0a023-196a-450c-9440-3f9eefacee16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0dec376873a4c008bb3cc657ed6efcd', 'request_id': 'req-0ef0a023-196a-450c-9440-3f9eefacee16'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.011073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ef0a023-196a-450c-9440-3f9eefacee16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0dec376873a4c008bb3cc657ed6efcd', 'request_id': 'req-0ef0a023-196a-450c-9440-3f9eefacee16'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.027160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ef0a023-196a-450c-9440-3f9eefacee16 admin admin] The token cache is being invalidate because project a0dec376873a4c008bb3cc657ed6efcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:53.028707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ef0a023-196a-450c-9440-3f9eefacee16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.029487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ef0a023-196a-450c-9440-3f9eefacee16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.034613 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2347/4678] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:52 2022] DELETE /identity/v3/projects/a0dec376873a4c008bb3cc657ed6efcd => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:53.036800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fafee-10b5-4cbf-8666-ae5e531119c5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:53.038671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e58fafee-10b5-4cbf-8666-ae5e531119c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:53.085341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fafee-10b5-4cbf-8666-ae5e531119c5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:53.091603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0a023-196a-450c-9440-3f9eefacee16 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:53.093709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0ef0a023-196a-450c-9440-3f9eefacee16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:53.199344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588ed74-3b8c-413c-976c-412320976a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:53.201019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588ed74-3b8c-413c-976c-412320976a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:53.201402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588ed74-3b8c-413c-976c-412320976a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:53.201807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588ed74-3b8c-413c-976c-412320976a2c admin admin] PATH_INFO: `/v3/users/a174ef824267414ebf0a0adf348b99df` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:53.202898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0a023-196a-450c-9440-3f9eefacee16 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:53.203432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588ed74-3b8c-413c-976c-412320976a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a174ef824267414ebf0a0adf348b99df)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:53.205661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588ed74-3b8c-413c-976c-412320976a2c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:53.208703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c856042-ae6b-4567-a9a2-13d9cb70efbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:53.209513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c856042-ae6b-4567-a9a2-13d9cb70efbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:53.209795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c856042-ae6b-4567-a9a2-13d9cb70efbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:53.210069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c856042-ae6b-4567-a9a2-13d9cb70efbd admin admin] PATH_INFO: `/v3/projects/a7fd7975dba04cecb3c4328bf23e0a92` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:53.211229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c856042-ae6b-4567-a9a2-13d9cb70efbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7fd7975dba04cecb3c4328bf23e0a92)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:53.213219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c856042-ae6b-4567-a9a2-13d9cb70efbd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:53.280398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1588ed74-3b8c-413c-976c-412320976a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a174ef824267414ebf0a0adf348b99df'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.290527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c856042-ae6b-4567-a9a2-13d9cb70efbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7fd7975dba04cecb3c4328bf23e0a92', 'request_id': 'req-5c856042-ae6b-4567-a9a2-13d9cb70efbd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.294691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1588ed74-3b8c-413c-976c-412320976a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a174ef824267414ebf0a0adf348b99df'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.295777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1588ed74-3b8c-413c-976c-412320976a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a174ef824267414ebf0a0adf348b99df'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.296507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1588ed74-3b8c-413c-976c-412320976a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a174ef824267414ebf0a0adf348b99df'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.302477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c856042-ae6b-4567-a9a2-13d9cb70efbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7fd7975dba04cecb3c4328bf23e0a92', 'request_id': 'req-5c856042-ae6b-4567-a9a2-13d9cb70efbd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.307932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1588ed74-3b8c-413c-976c-412320976a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a174ef824267414ebf0a0adf348b99df'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.313055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:53.322290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c856042-ae6b-4567-a9a2-13d9cb70efbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7fd7975dba04cecb3c4328bf23e0a92', 'request_id': 'req-5c856042-ae6b-4567-a9a2-13d9cb70efbd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.326008 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2332/4679] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:53 2022] DELETE /identity/v3/users/a174ef824267414ebf0a0adf348b99df => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:53.340874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c856042-ae6b-4567-a9a2-13d9cb70efbd admin admin] The token cache is being invalidate because project a7fd7975dba04cecb3c4328bf23e0a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:53.341512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c856042-ae6b-4567-a9a2-13d9cb70efbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.342302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c856042-ae6b-4567-a9a2-13d9cb70efbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.344208 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2348/4680] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:53 2022] DELETE /identity/v3/projects/a7fd7975dba04cecb3c4328bf23e0a92 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:53.349786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29362d9b-4222-4d05-9e16-cd866c44d647 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:53.350140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29362d9b-4222-4d05-9e16-cd866c44d647 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:53.350484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29362d9b-4222-4d05-9e16-cd866c44d647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:53.376498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-29362d9b-4222-4d05-9e16-cd866c44d647 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:53.377934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-29362d9b-4222-4d05-9e16-cd866c44d647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:53.412863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:53.457840 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2333/4681] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:53.466636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8a2fa-e80c-43ad-84ec-d110573995e2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:53.466966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8a2fa-e80c-43ad-84ec-d110573995e2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:53.467246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8a2fa-e80c-43ad-84ec-d110573995e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:53.488276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-86c8a2fa-e80c-43ad-84ec-d110573995e2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:53.489515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-86c8a2fa-e80c-43ad-84ec-d110573995e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:53.498843 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2349/4682] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:53.503291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29362d9b-4222-4d05-9e16-cd866c44d647 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:53.532312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29362d9b-4222-4d05-9e16-cd866c44d647 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:53.551604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a18e0-39ab-4326-89bf-c60e843c75d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:53.552247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a18e0-39ab-4326-89bf-c60e843c75d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:53.552530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a18e0-39ab-4326-89bf-c60e843c75d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:53.552809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a18e0-39ab-4326-89bf-c60e843c75d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:53.575792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a18e0-39ab-4326-89bf-c60e843c75d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:53.576117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a18e0-39ab-4326-89bf-c60e843c75d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:53.581573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a18e0-39ab-4326-89bf-c60e843c75d8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:53.609556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8a2fa-e80c-43ad-84ec-d110573995e2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:53.615827 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2334/4683] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:53.622626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8a2fa-e80c-43ad-84ec-d110573995e2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:53.627968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af0fe5-0976-4df2-bc60-2ccf946ca349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:53.628699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af0fe5-0976-4df2-bc60-2ccf946ca349 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:53.629031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af0fe5-0976-4df2-bc60-2ccf946ca349 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:53.629373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af0fe5-0976-4df2-bc60-2ccf946ca349 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:53.630136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af0fe5-0976-4df2-bc60-2ccf946ca349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:53.632500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af0fe5-0976-4df2-bc60-2ccf946ca349 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:53.666263 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2350/4684] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:53 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:38:53.670584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a18e0-39ab-4326-89bf-c60e843c75d8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:53.684472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a18e0-39ab-4326-89bf-c60e843c75d8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:53.728501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af0fe5-0976-4df2-bc60-2ccf946ca349 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:53.731633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80af0fe5-0976-4df2-bc60-2ccf946ca349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:53.776345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5e155-de30-48d4-9191-426b8d6ab64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:53.777212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5e155-de30-48d4-9191-426b8d6ab64b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:53.777498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5e155-de30-48d4-9191-426b8d6ab64b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:53.777774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5e155-de30-48d4-9191-426b8d6ab64b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:53.778435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5e155-de30-48d4-9191-426b8d6ab64b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:53.780438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5e155-de30-48d4-9191-426b8d6ab64b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:53.812030 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2335/4685] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:53 2022] POST /identity/v3/users => generated 296 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:38:53.813185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5e155-de30-48d4-9191-426b8d6ab64b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:53.821512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af0fe5-0976-4df2-bc60-2ccf946ca349 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:53.824481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5e155-de30-48d4-9191-426b8d6ab64b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:53.826403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d635c1d-4658-4351-a708-65bfec7f8bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:53.827102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d635c1d-4658-4351-a708-65bfec7f8bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:53.827467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d635c1d-4658-4351-a708-65bfec7f8bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:53.827760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d635c1d-4658-4351-a708-65bfec7f8bcc admin admin] PATH_INFO: `/v3/projects/21cf94200b5345c988e94ea7c2e604c2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:53.828876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d635c1d-4658-4351-a708-65bfec7f8bcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=21cf94200b5345c988e94ea7c2e604c2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:53.829292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5905a5b-61f8-4d8c-b622-5c859648b1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:53.829900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5905a5b-61f8-4d8c-b622-5c859648b1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:53.830188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5905a5b-61f8-4d8c-b622-5c859648b1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:53.830466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5905a5b-61f8-4d8c-b622-5c859648b1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:53.830959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d635c1d-4658-4351-a708-65bfec7f8bcc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:53.831133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5905a5b-61f8-4d8c-b622-5c859648b1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:53.833528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5905a5b-61f8-4d8c-b622-5c859648b1b6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:53.845566 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2336/4686] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:53.849342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5905a5b-61f8-4d8c-b622-5c859648b1b6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:53.859858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5905a5b-61f8-4d8c-b622-5c859648b1b6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:53.865050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d8b0a-ed05-4cbf-a869-e82ce9bba3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:53.865742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d8b0a-ed05-4cbf-a869-e82ce9bba3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:53.866022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d8b0a-ed05-4cbf-a869-e82ce9bba3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:53.866299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d8b0a-ed05-4cbf-a869-e82ce9bba3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:53.866955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d8b0a-ed05-4cbf-a869-e82ce9bba3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:53.868889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d8b0a-ed05-4cbf-a869-e82ce9bba3e0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:53.889742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d635c1d-4658-4351-a708-65bfec7f8bcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21cf94200b5345c988e94ea7c2e604c2', 'request_id': 'req-9d635c1d-4658-4351-a708-65bfec7f8bcc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.894725 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2337/4687] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:38:53.899357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d8b0a-ed05-4cbf-a869-e82ce9bba3e0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:53.900794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d635c1d-4658-4351-a708-65bfec7f8bcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21cf94200b5345c988e94ea7c2e604c2', 'request_id': 'req-9d635c1d-4658-4351-a708-65bfec7f8bcc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.909343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d635c1d-4658-4351-a708-65bfec7f8bcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21cf94200b5345c988e94ea7c2e604c2', 'request_id': 'req-9d635c1d-4658-4351-a708-65bfec7f8bcc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.912841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d8b0a-ed05-4cbf-a869-e82ce9bba3e0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:53.925726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d635c1d-4658-4351-a708-65bfec7f8bcc admin admin] The token cache is being invalidate because project 21cf94200b5345c988e94ea7c2e604c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:53.926114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d635c1d-4658-4351-a708-65bfec7f8bcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.927558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d635c1d-4658-4351-a708-65bfec7f8bcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:53.933509 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2351/4688] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:53 2022] DELETE /identity/v3/projects/21cf94200b5345c988e94ea7c2e604c2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:53.938498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650549fb-5f18-4f7f-b1a5-3e8af579d769 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:53.938775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650549fb-5f18-4f7f-b1a5-3e8af579d769 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:53.939054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650549fb-5f18-4f7f-b1a5-3e8af579d769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:53.963776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-650549fb-5f18-4f7f-b1a5-3e8af579d769 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:53.965351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-650549fb-5f18-4f7f-b1a5-3e8af579d769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:54.000081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df36ee0-1122-4008-94e7-1a61e581022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:54.000790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df36ee0-1122-4008-94e7-1a61e581022d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.001121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df36ee0-1122-4008-94e7-1a61e581022d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.001715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df36ee0-1122-4008-94e7-1a61e581022d admin admin] PATH_INFO: `/v3/projects/6f35b42876284afaaf1f1a6e1ae85c48/users/bec0d6ff93dd4c47a71167549968455b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.023751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df36ee0-1122-4008-94e7-1a61e581022d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f35b42876284afaaf1f1a6e1ae85c48, user_id=bec0d6ff93dd4c47a71167549968455b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:54.026741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df36ee0-1122-4008-94e7-1a61e581022d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:54.032337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:54.055157 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2338/4689] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:53 2022] PUT /identity/v3/projects/6f35b42876284afaaf1f1a6e1ae85c48/users/bec0d6ff93dd4c47a71167549968455b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:54.055713 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2352/4690] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:38:54.057753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dbebc-ab34-4482-a51d-38008920efe6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.057906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c00348-0db8-4b4c-a582-dbfb16135616 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.058277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c00348-0db8-4b4c-a582-dbfb16135616 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.058622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c00348-0db8-4b4c-a582-dbfb16135616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.058925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dbebc-ab34-4482-a51d-38008920efe6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.059438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dbebc-ab34-4482-a51d-38008920efe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.077064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:54.089947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b7c00348-0db8-4b4c-a582-dbfb16135616 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:54.092985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b7c00348-0db8-4b4c-a582-dbfb16135616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:54.098920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-791dbebc-ab34-4482-a51d-38008920efe6 None None] MFA Rules not processed for user `bec0d6ff93dd4c47a71167549968455b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:54.100455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-791dbebc-ab34-4482-a51d-38008920efe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:54.196620 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2339/4691] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:54.197351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c00348-0db8-4b4c-a582-dbfb16135616 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:54.202482 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2353/4692] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:54.206844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dbebc-ab34-4482-a51d-38008920efe6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:54.208657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-791dbebc-ab34-4482-a51d-38008920efe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:54.213320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c00348-0db8-4b4c-a582-dbfb16135616 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:54.219307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484ad7c-ae32-4e1d-bd91-2c9f3e4733ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:54.221023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484ad7c-ae32-4e1d-bd91-2c9f3e4733ba admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.221447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484ad7c-ae32-4e1d-bd91-2c9f3e4733ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.221722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484ad7c-ae32-4e1d-bd91-2c9f3e4733ba admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.222505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484ad7c-ae32-4e1d-bd91-2c9f3e4733ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:54.222812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484ad7c-ae32-4e1d-bd91-2c9f3e4733ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:54.224442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484ad7c-ae32-4e1d-bd91-2c9f3e4733ba admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:54.224770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dbebc-ab34-4482-a51d-38008920efe6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:54.230408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dd539-9070-44f4-8d0c-0f723d8f823f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:54.231029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dd539-9070-44f4-8d0c-0f723d8f823f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.231345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dd539-9070-44f4-8d0c-0f723d8f823f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.231614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dd539-9070-44f4-8d0c-0f723d8f823f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.232253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9dd539-9070-44f4-8d0c-0f723d8f823f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:54.234651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9dd539-9070-44f4-8d0c-0f723d8f823f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:54.241746 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2340/4693] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:54.242773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484ad7c-ae32-4e1d-bd91-2c9f3e4733ba admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:54.256320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484ad7c-ae32-4e1d-bd91-2c9f3e4733ba admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:54.261890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8346e-4cb0-4cd0-9e1e-870660922714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:54.262757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8346e-4cb0-4cd0-9e1e-870660922714 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.263113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8346e-4cb0-4cd0-9e1e-870660922714 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.263422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8346e-4cb0-4cd0-9e1e-870660922714 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.264086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8346e-4cb0-4cd0-9e1e-870660922714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:54.265990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8346e-4cb0-4cd0-9e1e-870660922714 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:54.271385 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2354/4694] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:54 2022] POST /identity/v3/projects => generated 391 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:38:54.275616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dd539-9070-44f4-8d0c-0f723d8f823f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:54.300821 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2341/4695] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:54 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:54.304955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8346e-4cb0-4cd0-9e1e-870660922714 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:54.357303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dd539-9070-44f4-8d0c-0f723d8f823f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:54.377875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8346e-4cb0-4cd0-9e1e-870660922714 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:54.383019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab3ef9-c4fe-431f-9e36-b9f0babee9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:54.383869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab3ef9-c4fe-431f-9e36-b9f0babee9bb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.384216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab3ef9-c4fe-431f-9e36-b9f0babee9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.384567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab3ef9-c4fe-431f-9e36-b9f0babee9bb admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.385205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab3ef9-c4fe-431f-9e36-b9f0babee9bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:54.387288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab3ef9-c4fe-431f-9e36-b9f0babee9bb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:54.414815 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2342/4696] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:54 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:38:54.416332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab3ef9-c4fe-431f-9e36-b9f0babee9bb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:54.425384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f56e26-1db7-4c5b-8573-852a28e5c24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:54.426270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f56e26-1db7-4c5b-8573-852a28e5c24e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.426708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f56e26-1db7-4c5b-8573-852a28e5c24e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.427128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f56e26-1db7-4c5b-8573-852a28e5c24e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.427244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab3ef9-c4fe-431f-9e36-b9f0babee9bb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:54.428036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f56e26-1db7-4c5b-8573-852a28e5c24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:54.430459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f56e26-1db7-4c5b-8573-852a28e5c24e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:54.432637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040b0e0-b328-4f27-b738-41b572526105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:54.433411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040b0e0-b328-4f27-b738-41b572526105 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.433695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040b0e0-b328-4f27-b738-41b572526105 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.433969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040b0e0-b328-4f27-b738-41b572526105 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.434615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040b0e0-b328-4f27-b738-41b572526105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:54.436231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040b0e0-b328-4f27-b738-41b572526105 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:54.443942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:54.449073 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2343/4697] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:38:54.454559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040b0e0-b328-4f27-b738-41b572526105 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:54.466547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040b0e0-b328-4f27-b738-41b572526105 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:54.466810 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2355/4698] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:54 2022] POST /identity/v3/users => generated 302 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:38:54.467778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f56e26-1db7-4c5b-8573-852a28e5c24e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:54.474579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d65c0-386d-43a2-a95d-313ad2a475bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:54.475533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d65c0-386d-43a2-a95d-313ad2a475bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.476011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d65c0-386d-43a2-a95d-313ad2a475bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.476720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d65c0-386d-43a2-a95d-313ad2a475bc admin admin] PATH_INFO: `/v3/projects/623ca10a44ff4b7a8f8c0f311100c4c7/users/5d858c7235334936a0f91ae277b3e355/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.479395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f56e26-1db7-4c5b-8573-852a28e5c24e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:54.484660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281343d-c06e-4c92-930e-efd37de3396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:54.485287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281343d-c06e-4c92-930e-efd37de3396b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.485565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281343d-c06e-4c92-930e-efd37de3396b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.485836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281343d-c06e-4c92-930e-efd37de3396b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.487239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281343d-c06e-4c92-930e-efd37de3396b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:54.488893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281343d-c06e-4c92-930e-efd37de3396b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:54.508711 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2356/4699] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:54.513029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281343d-c06e-4c92-930e-efd37de3396b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:54.513279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d65c0-386d-43a2-a95d-313ad2a475bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=623ca10a44ff4b7a8f8c0f311100c4c7, user_id=5d858c7235334936a0f91ae277b3e355, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:54.516633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d65c0-386d-43a2-a95d-313ad2a475bc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:54.524601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281343d-c06e-4c92-930e-efd37de3396b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:54.529934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71334def-bbeb-4932-8531-7eb3834a9335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:54.530623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71334def-bbeb-4932-8531-7eb3834a9335 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.530877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71334def-bbeb-4932-8531-7eb3834a9335 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.531170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71334def-bbeb-4932-8531-7eb3834a9335 admin admin] PATH_INFO: `/v3/projects/b58161fc9b4f4047879726586c9cf3f8/users/f3c179dbcd2f49fa95943042571cd879/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.533145 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2344/4700] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:54 2022] PUT /identity/v3/projects/623ca10a44ff4b7a8f8c0f311100c4c7/users/5d858c7235334936a0f91ae277b3e355/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:54.537917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d65c0-386d-43a2-a95d-313ad2a475bc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:54.550610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71334def-bbeb-4932-8531-7eb3834a9335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58161fc9b4f4047879726586c9cf3f8, user_id=f3c179dbcd2f49fa95943042571cd879, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:54.557246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71334def-bbeb-4932-8531-7eb3834a9335 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:54.573275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:54.584282 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2357/4701] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:54 2022] PUT /identity/v3/projects/b58161fc9b4f4047879726586c9cf3f8/users/f3c179dbcd2f49fa95943042571cd879/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:54.588439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71334def-bbeb-4932-8531-7eb3834a9335 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:54.613778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d65c0-386d-43a2-a95d-313ad2a475bc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:54.659939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71334def-bbeb-4932-8531-7eb3834a9335 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:54.666934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924a109-c43b-4a61-bbcb-9b10c014d432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:54.667880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924a109-c43b-4a61-bbcb-9b10c014d432 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.668155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924a109-c43b-4a61-bbcb-9b10c014d432 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.668420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924a109-c43b-4a61-bbcb-9b10c014d432 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.669083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924a109-c43b-4a61-bbcb-9b10c014d432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:54.670731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924a109-c43b-4a61-bbcb-9b10c014d432 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:54.673764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9aac7-f010-44cc-873c-8e715bfb6b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:54.674383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9aac7-f010-44cc-873c-8e715bfb6b28 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.674663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9aac7-f010-44cc-873c-8e715bfb6b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.674941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9aac7-f010-44cc-873c-8e715bfb6b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.675620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9aac7-f010-44cc-873c-8e715bfb6b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:54.677210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9aac7-f010-44cc-873c-8e715bfb6b28 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:54.682065 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2358/4702] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:54.686251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924a109-c43b-4a61-bbcb-9b10c014d432 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:54.693297 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2345/4703] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:38:54.697363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9aac7-f010-44cc-873c-8e715bfb6b28 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:54.699901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924a109-c43b-4a61-bbcb-9b10c014d432 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:54.706653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a72862-056b-49f2-a9e9-7b1f262168e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:54.707371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a72862-056b-49f2-a9e9-7b1f262168e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.707653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a72862-056b-49f2-a9e9-7b1f262168e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.707752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9aac7-f010-44cc-873c-8e715bfb6b28 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:54.707907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a72862-056b-49f2-a9e9-7b1f262168e2 admin admin] PATH_INFO: `/v3/projects/b58161fc9b4f4047879726586c9cf3f8/users/f3c179dbcd2f49fa95943042571cd879/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.710369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a72862-056b-49f2-a9e9-7b1f262168e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58161fc9b4f4047879726586c9cf3f8, user_id=f3c179dbcd2f49fa95943042571cd879, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:54.712862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542d34d-b8f3-44ef-80e9-7fd45509fd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:54.713157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a72862-056b-49f2-a9e9-7b1f262168e2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:54.713536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542d34d-b8f3-44ef-80e9-7fd45509fd21 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.713792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542d34d-b8f3-44ef-80e9-7fd45509fd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.714069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542d34d-b8f3-44ef-80e9-7fd45509fd21 admin admin] PATH_INFO: `/v3/projects/623ca10a44ff4b7a8f8c0f311100c4c7/users/5d858c7235334936a0f91ae277b3e355/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.716465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542d34d-b8f3-44ef-80e9-7fd45509fd21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=623ca10a44ff4b7a8f8c0f311100c4c7, user_id=5d858c7235334936a0f91ae277b3e355, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:54.719096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542d34d-b8f3-44ef-80e9-7fd45509fd21 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:54.724650 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2359/4704] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:54 2022] PUT /identity/v3/projects/b58161fc9b4f4047879726586c9cf3f8/users/f3c179dbcd2f49fa95943042571cd879/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:54.735357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5073a-8946-46f3-b6f4-2fb4f1b5ed6f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.735645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5073a-8946-46f3-b6f4-2fb4f1b5ed6f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.735924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5073a-8946-46f3-b6f4-2fb4f1b5ed6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.737162 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2346/4705] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:54 2022] PUT /identity/v3/projects/623ca10a44ff4b7a8f8c0f311100c4c7/users/5d858c7235334936a0f91ae277b3e355/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:54.748311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9491d-3a66-4ee1-a470-d4a36a2b4ba2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.748596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9491d-3a66-4ee1-a470-d4a36a2b4ba2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.748871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9491d-3a66-4ee1-a470-d4a36a2b4ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.767895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1da5073a-8946-46f3-b6f4-2fb4f1b5ed6f None None] MFA Rules not processed for user `f3c179dbcd2f49fa95943042571cd879`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:54.769138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1da5073a-8946-46f3-b6f4-2fb4f1b5ed6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:54.779155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c8b9491d-3a66-4ee1-a470-d4a36a2b4ba2 None None] MFA Rules not processed for user `5d858c7235334936a0f91ae277b3e355`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:54.780459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c8b9491d-3a66-4ee1-a470-d4a36a2b4ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:54.845275 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2360/4706] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:54 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:38:54.855287 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2347/4707] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:38:54.860377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5073a-8946-46f3-b6f4-2fb4f1b5ed6f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:54.862236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9491d-3a66-4ee1-a470-d4a36a2b4ba2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:54.863687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c8b9491d-3a66-4ee1-a470-d4a36a2b4ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:54.895654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:54.914400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:54.932660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5073a-8946-46f3-b6f4-2fb4f1b5ed6f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:54.938510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffda5b8-1a8b-4aba-9edd-184a5bf43abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:54.939328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffda5b8-1a8b-4aba-9edd-184a5bf43abb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.939614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffda5b8-1a8b-4aba-9edd-184a5bf43abb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.939891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffda5b8-1a8b-4aba-9edd-184a5bf43abb admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.940543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffda5b8-1a8b-4aba-9edd-184a5bf43abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:54.942468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffda5b8-1a8b-4aba-9edd-184a5bf43abb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:54.947655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9491d-3a66-4ee1-a470-d4a36a2b4ba2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:54.954040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f66d83-a89d-4c06-bcf9-cec8012ceaa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:54.954650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f66d83-a89d-4c06-bcf9-cec8012ceaa2 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:54.954926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f66d83-a89d-4c06-bcf9-cec8012ceaa2 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:54.955198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f66d83-a89d-4c06-bcf9-cec8012ceaa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:54.965028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f66d83-a89d-4c06-bcf9-cec8012ceaa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:54.967110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f66d83-a89d-4c06-bcf9-cec8012ceaa2 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:54.973399 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2361/4708] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:54 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:54.977155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffda5b8-1a8b-4aba-9edd-184a5bf43abb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:54.979532 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2348/4709] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:54 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:38:55.063398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffda5b8-1a8b-4aba-9edd-184a5bf43abb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:55.063917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f66d83-a89d-4c06-bcf9-cec8012ceaa2 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:55.069504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c1476-fe93-4d4d-895f-1053ac41069a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:55.070436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c1476-fe93-4d4d-895f-1053ac41069a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:55.070943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c1476-fe93-4d4d-895f-1053ac41069a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:55.071310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c1476-fe93-4d4d-895f-1053ac41069a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:55.072061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c1476-fe93-4d4d-895f-1053ac41069a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:55.074377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c1476-fe93-4d4d-895f-1053ac41069a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:55.078303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f66d83-a89d-4c06-bcf9-cec8012ceaa2 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:55.103201 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2362/4710] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:54 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:38:55.107098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c1476-fe93-4d4d-895f-1053ac41069a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:55.118721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c1476-fe93-4d4d-895f-1053ac41069a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:55.124205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc497fc-b759-4ddf-9bb2-94dcc2b85068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:55.124903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc497fc-b759-4ddf-9bb2-94dcc2b85068 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:55.125675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc497fc-b759-4ddf-9bb2-94dcc2b85068 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:55.125962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc497fc-b759-4ddf-9bb2-94dcc2b85068 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:55.126613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc497fc-b759-4ddf-9bb2-94dcc2b85068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:55.128250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc497fc-b759-4ddf-9bb2-94dcc2b85068 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:55.140750 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2363/4711] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:55.144613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc497fc-b759-4ddf-9bb2-94dcc2b85068 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:55.154975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc497fc-b759-4ddf-9bb2-94dcc2b85068 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:55.159845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5a335-5638-42f3-a81d-11a7080caadc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:55.160496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5a335-5638-42f3-a81d-11a7080caadc service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:55.160776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5a335-5638-42f3-a81d-11a7080caadc service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:55.161050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5a335-5638-42f3-a81d-11a7080caadc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:55.163748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da44a8b-18c5-447d-b098-43a99e783e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:55.164357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da44a8b-18c5-447d-b098-43a99e783e4a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:55.164631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da44a8b-18c5-447d-b098-43a99e783e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:55.165589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da44a8b-18c5-447d-b098-43a99e783e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:55.166264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da44a8b-18c5-447d-b098-43a99e783e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:55.167902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da44a8b-18c5-447d-b098-43a99e783e4a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:55.186498 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2364/4712] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:38:55.187717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da44a8b-18c5-447d-b098-43a99e783e4a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:55.208974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da44a8b-18c5-447d-b098-43a99e783e4a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:55.216496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a604f52-7e14-417a-ad04-2f08548971d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:55.217470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a604f52-7e14-417a-ad04-2f08548971d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:55.218464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a604f52-7e14-417a-ad04-2f08548971d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:55.218824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a604f52-7e14-417a-ad04-2f08548971d3 admin admin] PATH_INFO: `/v3/projects/696e7b94ae7440479553b3b5620bc8eb/users/5be6e22f7702494c9c72bd2979f20446/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:55.249651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a604f52-7e14-417a-ad04-2f08548971d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=696e7b94ae7440479553b3b5620bc8eb, user_id=5be6e22f7702494c9c72bd2979f20446, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:55.253704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a604f52-7e14-417a-ad04-2f08548971d3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:55.254500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5a335-5638-42f3-a81d-11a7080caadc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:55.257510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5a335-5638-42f3-a81d-11a7080caadc service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:55.270827 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2349/4713] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:55.284054 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2365/4714] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:55 2022] PUT /identity/v3/projects/696e7b94ae7440479553b3b5620bc8eb/users/5be6e22f7702494c9c72bd2979f20446/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:55.296258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5a335-5638-42f3-a81d-11a7080caadc service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:55.303117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56b22b-acc0-4464-90dc-b0839a6feb1c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:55.303613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56b22b-acc0-4464-90dc-b0839a6feb1c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:55.305533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56b22b-acc0-4464-90dc-b0839a6feb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:55.310057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5a335-5638-42f3-a81d-11a7080caadc service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:55.357635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2b56b22b-acc0-4464-90dc-b0839a6feb1c None None] MFA Rules not processed for user `5be6e22f7702494c9c72bd2979f20446`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:55.358850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b56b22b-acc0-4464-90dc-b0839a6feb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:55.395964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97da7f-7b0e-46a6-8f18-c1672a2dbf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:55.396611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97da7f-7b0e-46a6-8f18-c1672a2dbf73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:55.396893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97da7f-7b0e-46a6-8f18-c1672a2dbf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:55.397407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97da7f-7b0e-46a6-8f18-c1672a2dbf73 admin admin] PATH_INFO: `/v3/users/bec0d6ff93dd4c47a71167549968455b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:55.399078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97da7f-7b0e-46a6-8f18-c1672a2dbf73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bec0d6ff93dd4c47a71167549968455b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:55.401573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97da7f-7b0e-46a6-8f18-c1672a2dbf73 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:55.408559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:55.429017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:55.464280 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2366/4715] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:55.476507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56b22b-acc0-4464-90dc-b0839a6feb1c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:55.478394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b56b22b-acc0-4464-90dc-b0839a6feb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:55.482017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9b97da7f-7b0e-46a6-8f18-c1672a2dbf73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bec0d6ff93dd4c47a71167549968455b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:55.498886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9b97da7f-7b0e-46a6-8f18-c1672a2dbf73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bec0d6ff93dd4c47a71167549968455b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:55.501679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9b97da7f-7b0e-46a6-8f18-c1672a2dbf73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bec0d6ff93dd4c47a71167549968455b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:55.502345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9b97da7f-7b0e-46a6-8f18-c1672a2dbf73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bec0d6ff93dd4c47a71167549968455b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:55.514685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9b97da7f-7b0e-46a6-8f18-c1672a2dbf73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bec0d6ff93dd4c47a71167549968455b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:55.540403 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2350/4716] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:55 2022] DELETE /identity/v3/users/bec0d6ff93dd4c47a71167549968455b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:55.551509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df2eec-cfa7-4e2e-aa1c-1a2f63010d43 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:55.552479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df2eec-cfa7-4e2e-aa1c-1a2f63010d43 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:55.553111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df2eec-cfa7-4e2e-aa1c-1a2f63010d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:55.600902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56b22b-acc0-4464-90dc-b0839a6feb1c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:55.621051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-64df2eec-cfa7-4e2e-aa1c-1a2f63010d43 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:55.622508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-64df2eec-cfa7-4e2e-aa1c-1a2f63010d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:55.704027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc0df5-3204-4f9e-be7f-774707dc9ec6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:55.704708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc0df5-3204-4f9e-be7f-774707dc9ec6 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:55.704976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc0df5-3204-4f9e-be7f-774707dc9ec6 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:55.705275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc0df5-3204-4f9e-be7f-774707dc9ec6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:55.708365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-46cc0df5-3204-4f9e-be7f-774707dc9ec6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:55.781252 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2351/4717] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:55.795101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc0df5-3204-4f9e-be7f-774707dc9ec6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:55.798406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc0df5-3204-4f9e-be7f-774707dc9ec6 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:55.805072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df2eec-cfa7-4e2e-aa1c-1a2f63010d43 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:55.807204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-64df2eec-cfa7-4e2e-aa1c-1a2f63010d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:55.823897 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2367/4718] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:55.884439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df2eec-cfa7-4e2e-aa1c-1a2f63010d43 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:55.888616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031286e-4e81-4601-be64-fa5309b73b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:55.889608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031286e-4e81-4601-be64-fa5309b73b16 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:55.889608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031286e-4e81-4601-be64-fa5309b73b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:55.889840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031286e-4e81-4601-be64-fa5309b73b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:55.900549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031286e-4e81-4601-be64-fa5309b73b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:55.902153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031286e-4e81-4601-be64-fa5309b73b16 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:55.913657 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2352/4719] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:56.380144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc0df5-3204-4f9e-be7f-774707dc9ec6 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:56.381953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-46cc0df5-3204-4f9e-be7f-774707dc9ec6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:56.400630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc0df5-3204-4f9e-be7f-774707dc9ec6 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:56.406530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054e48d-9200-4628-85b3-7cb4f36f9b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:56.407176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054e48d-9200-4628-85b3-7cb4f36f9b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:56.407501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054e48d-9200-4628-85b3-7cb4f36f9b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:56.407776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054e48d-9200-4628-85b3-7cb4f36f9b38 admin admin] PATH_INFO: `/v3/projects/6f35b42876284afaaf1f1a6e1ae85c48` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:56.409486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054e48d-9200-4628-85b3-7cb4f36f9b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f35b42876284afaaf1f1a6e1ae85c48)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:56.412718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054e48d-9200-4628-85b3-7cb4f36f9b38 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:56.459359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031286e-4e81-4601-be64-fa5309b73b16 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:56.460804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b031286e-4e81-4601-be64-fa5309b73b16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:56.470749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:56.472217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c054e48d-9200-4628-85b3-7cb4f36f9b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f35b42876284afaaf1f1a6e1ae85c48', 'request_id': 'req-c054e48d-9200-4628-85b3-7cb4f36f9b38'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:56.477348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031286e-4e81-4601-be64-fa5309b73b16 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:56.483952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c054e48d-9200-4628-85b3-7cb4f36f9b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f35b42876284afaaf1f1a6e1ae85c48', 'request_id': 'req-c054e48d-9200-4628-85b3-7cb4f36f9b38'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:56.490191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c054e48d-9200-4628-85b3-7cb4f36f9b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f35b42876284afaaf1f1a6e1ae85c48', 'request_id': 'req-c054e48d-9200-4628-85b3-7cb4f36f9b38'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:56.503199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c054e48d-9200-4628-85b3-7cb4f36f9b38 admin admin] The token cache is being invalidate because project 6f35b42876284afaaf1f1a6e1ae85c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:56.503199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c054e48d-9200-4628-85b3-7cb4f36f9b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:56.503922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c054e48d-9200-4628-85b3-7cb4f36f9b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:56.505449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:56.506663 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2368/4720] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:56 2022] DELETE /identity/v3/projects/6f35b42876284afaaf1f1a6e1ae85c48 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:56.510866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054e48d-9200-4628-85b3-7cb4f36f9b38 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:56.512796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c054e48d-9200-4628-85b3-7cb4f36f9b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:56.545156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60321625-c9e5-4f6f-99dd-91eed75539b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:56.546810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60321625-c9e5-4f6f-99dd-91eed75539b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:56.547151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60321625-c9e5-4f6f-99dd-91eed75539b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:56.547514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60321625-c9e5-4f6f-99dd-91eed75539b6 admin admin] PATH_INFO: `/v3/users/5d858c7235334936a0f91ae277b3e355` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:56.548818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60321625-c9e5-4f6f-99dd-91eed75539b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d858c7235334936a0f91ae277b3e355)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:56.550827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60321625-c9e5-4f6f-99dd-91eed75539b6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:56.604004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054e48d-9200-4628-85b3-7cb4f36f9b38 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:56.610771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762026b-1a33-4a92-9cf7-22cbf72057f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:56.611754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762026b-1a33-4a92-9cf7-22cbf72057f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:56.612216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762026b-1a33-4a92-9cf7-22cbf72057f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:56.612830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762026b-1a33-4a92-9cf7-22cbf72057f8 admin admin] PATH_INFO: `/v3/users/f3c179dbcd2f49fa95943042571cd879` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:56.614246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762026b-1a33-4a92-9cf7-22cbf72057f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c179dbcd2f49fa95943042571cd879)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:56.615081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60321625-c9e5-4f6f-99dd-91eed75539b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d858c7235334936a0f91ae277b3e355'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:56.617115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762026b-1a33-4a92-9cf7-22cbf72057f8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:56.627681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60321625-c9e5-4f6f-99dd-91eed75539b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d858c7235334936a0f91ae277b3e355'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:56.628341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60321625-c9e5-4f6f-99dd-91eed75539b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d858c7235334936a0f91ae277b3e355'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:56.628956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60321625-c9e5-4f6f-99dd-91eed75539b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d858c7235334936a0f91ae277b3e355'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:56.638071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60321625-c9e5-4f6f-99dd-91eed75539b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d858c7235334936a0f91ae277b3e355'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:56.676624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8762026b-1a33-4a92-9cf7-22cbf72057f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c179dbcd2f49fa95943042571cd879'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:56.679337 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2353/4721] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:56 2022] DELETE /identity/v3/users/5d858c7235334936a0f91ae277b3e355 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:56.680283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8762026b-1a33-4a92-9cf7-22cbf72057f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c179dbcd2f49fa95943042571cd879'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:56.682096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e2de2-5ac1-44e2-aee1-24b189a2a4b1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:56.682378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e2de2-5ac1-44e2-aee1-24b189a2a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:56.683547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e2de2-5ac1-44e2-aee1-24b189a2a4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:56.692745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8762026b-1a33-4a92-9cf7-22cbf72057f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c179dbcd2f49fa95943042571cd879'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:56.705938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8762026b-1a33-4a92-9cf7-22cbf72057f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c179dbcd2f49fa95943042571cd879'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:56.709661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ca7e2de2-5ac1-44e2-aee1-24b189a2a4b1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:56.710936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ca7e2de2-5ac1-44e2-aee1-24b189a2a4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:56.742837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8762026b-1a33-4a92-9cf7-22cbf72057f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c179dbcd2f49fa95943042571cd879'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:56.754699 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2369/4722] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:56 2022] DELETE /identity/v3/users/f3c179dbcd2f49fa95943042571cd879 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:56.807426 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2354/4723] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:56.823068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762026b-1a33-4a92-9cf7-22cbf72057f8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:56.826111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8762026b-1a33-4a92-9cf7-22cbf72057f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:56.939727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762026b-1a33-4a92-9cf7-22cbf72057f8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:56.944629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f22fc-e9cc-48ae-a72a-ae128d829d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:56.945507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f22fc-e9cc-48ae-a72a-ae128d829d67 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:56.945996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f22fc-e9cc-48ae-a72a-ae128d829d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:56.946619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f22fc-e9cc-48ae-a72a-ae128d829d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:56.958705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:57.021499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f22fc-e9cc-48ae-a72a-ae128d829d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:57.023373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f22fc-e9cc-48ae-a72a-ae128d829d67 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:57.036545 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2370/4724] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:57.684896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e2de2-5ac1-44e2-aee1-24b189a2a4b1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:57.686614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ca7e2de2-5ac1-44e2-aee1-24b189a2a4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:57.705764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e2de2-5ac1-44e2-aee1-24b189a2a4b1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:57.718483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a2210-de65-489f-960d-2420a4abd5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:57.719141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a2210-de65-489f-960d-2420a4abd5fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:57.719446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a2210-de65-489f-960d-2420a4abd5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:57.719718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a2210-de65-489f-960d-2420a4abd5fa admin admin] PATH_INFO: `/v3/projects/b58161fc9b4f4047879726586c9cf3f8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:57.725817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a2210-de65-489f-960d-2420a4abd5fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b58161fc9b4f4047879726586c9cf3f8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:57.728208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a2210-de65-489f-960d-2420a4abd5fa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:57.827500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:57.851547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c3a2210-de65-489f-960d-2420a4abd5fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58161fc9b4f4047879726586c9cf3f8', 'request_id': 'req-0c3a2210-de65-489f-960d-2420a4abd5fa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:57.860898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c3a2210-de65-489f-960d-2420a4abd5fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58161fc9b4f4047879726586c9cf3f8', 'request_id': 'req-0c3a2210-de65-489f-960d-2420a4abd5fa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:57.868684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c3a2210-de65-489f-960d-2420a4abd5fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58161fc9b4f4047879726586c9cf3f8', 'request_id': 'req-0c3a2210-de65-489f-960d-2420a4abd5fa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:57.895126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c3a2210-de65-489f-960d-2420a4abd5fa admin admin] The token cache is being invalidate because project b58161fc9b4f4047879726586c9cf3f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:57.895461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c3a2210-de65-489f-960d-2420a4abd5fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:57.896180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c3a2210-de65-489f-960d-2420a4abd5fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:57.904682 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2355/4725] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:57 2022] DELETE /identity/v3/projects/b58161fc9b4f4047879726586c9cf3f8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:57.906618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba662c-7aee-4eb8-9865-7d851ebd649b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:57.907068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba662c-7aee-4eb8-9865-7d851ebd649b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:57.907152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba662c-7aee-4eb8-9865-7d851ebd649b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:57.914600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a2210-de65-489f-960d-2420a4abd5fa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:57.916645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0c3a2210-de65-489f-960d-2420a4abd5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:57.944011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-29ba662c-7aee-4eb8-9865-7d851ebd649b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:57.945836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-29ba662c-7aee-4eb8-9865-7d851ebd649b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:58.032937 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2371/4726] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:38:58.041660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a2210-de65-489f-960d-2420a4abd5fa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:58.045563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5e71f-61fd-41e9-8ba0-aedad8796730 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:58.045860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5e71f-61fd-41e9-8ba0-aedad8796730 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:58.046169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5e71f-61fd-41e9-8ba0-aedad8796730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:58.053853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99709506-be77-4156-abda-a06f7a855096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:58.057098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99709506-be77-4156-abda-a06f7a855096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:58.057542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99709506-be77-4156-abda-a06f7a855096 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:58.058456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99709506-be77-4156-abda-a06f7a855096 admin admin] PATH_INFO: `/v3/projects/623ca10a44ff4b7a8f8c0f311100c4c7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:58.062800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99709506-be77-4156-abda-a06f7a855096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=623ca10a44ff4b7a8f8c0f311100c4c7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:58.068724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99709506-be77-4156-abda-a06f7a855096 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:58.090335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-16f5e71f-61fd-41e9-8ba0-aedad8796730 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:58.093486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-16f5e71f-61fd-41e9-8ba0-aedad8796730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:58.103851 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2372/4727] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:58.108608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5e71f-61fd-41e9-8ba0-aedad8796730 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:58.124362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5e71f-61fd-41e9-8ba0-aedad8796730 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:58.137840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99709506-be77-4156-abda-a06f7a855096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '623ca10a44ff4b7a8f8c0f311100c4c7', 'request_id': 'req-99709506-be77-4156-abda-a06f7a855096'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:58.144752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99709506-be77-4156-abda-a06f7a855096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '623ca10a44ff4b7a8f8c0f311100c4c7', 'request_id': 'req-99709506-be77-4156-abda-a06f7a855096'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:58.151168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99709506-be77-4156-abda-a06f7a855096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '623ca10a44ff4b7a8f8c0f311100c4c7', 'request_id': 'req-99709506-be77-4156-abda-a06f7a855096'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:58.168192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99709506-be77-4156-abda-a06f7a855096 admin admin] The token cache is being invalidate because project 623ca10a44ff4b7a8f8c0f311100c4c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:58.168492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99709506-be77-4156-abda-a06f7a855096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:58.169378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99709506-be77-4156-abda-a06f7a855096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:58.172004 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2356/4728] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:57 2022] DELETE /identity/v3/projects/623ca10a44ff4b7a8f8c0f311100c4c7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:58.175836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99709506-be77-4156-abda-a06f7a855096 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:58.178048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-99709506-be77-4156-abda-a06f7a855096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:58.210747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e2c68-0234-4fe3-bd14-769a56bb5253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:58.211510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e2c68-0234-4fe3-bd14-769a56bb5253 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:58.211864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e2c68-0234-4fe3-bd14-769a56bb5253 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:58.212230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e2c68-0234-4fe3-bd14-769a56bb5253 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:58.213456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e2c68-0234-4fe3-bd14-769a56bb5253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:58.213456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e2c68-0234-4fe3-bd14-769a56bb5253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:58.216152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e2c68-0234-4fe3-bd14-769a56bb5253 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:58.229474 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2373/4729] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:38:58.234044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e2c68-0234-4fe3-bd14-769a56bb5253 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:58.236713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-094e2c68-0234-4fe3-bd14-769a56bb5253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:58.251546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e2c68-0234-4fe3-bd14-769a56bb5253 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:58.258410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0638b-e092-49c6-8e84-22e4bd9a826d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:58.259199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0638b-e092-49c6-8e84-22e4bd9a826d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:58.259716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0638b-e092-49c6-8e84-22e4bd9a826d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:58.260176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0638b-e092-49c6-8e84-22e4bd9a826d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:58.260958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0638b-e092-49c6-8e84-22e4bd9a826d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:58.262442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99709506-be77-4156-abda-a06f7a855096 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:58.263100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0638b-e092-49c6-8e84-22e4bd9a826d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:58.267738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f483be-0ee4-41e7-aa16-9f683d477489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:58.268563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f483be-0ee4-41e7-aa16-9f683d477489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:58.269016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f483be-0ee4-41e7-aa16-9f683d477489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:58.269165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f483be-0ee4-41e7-aa16-9f683d477489 admin admin] PATH_INFO: `/v3/users/5be6e22f7702494c9c72bd2979f20446` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:58.270261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f483be-0ee4-41e7-aa16-9f683d477489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5be6e22f7702494c9c72bd2979f20446)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:58.272287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f483be-0ee4-41e7-aa16-9f683d477489 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:58.274831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:58.312524 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2374/4730] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:58 2022] POST /identity/v3/projects => generated 397 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:58.316243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0638b-e092-49c6-8e84-22e4bd9a826d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:58.321487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:58.336546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13f483be-0ee4-41e7-aa16-9f683d477489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5be6e22f7702494c9c72bd2979f20446'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:58.350395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13f483be-0ee4-41e7-aa16-9f683d477489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5be6e22f7702494c9c72bd2979f20446'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:58.351115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13f483be-0ee4-41e7-aa16-9f683d477489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5be6e22f7702494c9c72bd2979f20446'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:58.351925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13f483be-0ee4-41e7-aa16-9f683d477489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5be6e22f7702494c9c72bd2979f20446'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:58.361170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13f483be-0ee4-41e7-aa16-9f683d477489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5be6e22f7702494c9c72bd2979f20446'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:58.374358 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2357/4731] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:38:58 2022] DELETE /identity/v3/users/5be6e22f7702494c9c72bd2979f20446 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:58.392567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0638b-e092-49c6-8e84-22e4bd9a826d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:58.454557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8b400-09da-4e86-afd7-0c5196774e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:58.455183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8b400-09da-4e86-afd7-0c5196774e01 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:58.455497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8b400-09da-4e86-afd7-0c5196774e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:58.455771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8b400-09da-4e86-afd7-0c5196774e01 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:58.456417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8b400-09da-4e86-afd7-0c5196774e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:58.458843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8b400-09da-4e86-afd7-0c5196774e01 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:58.484224 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2375/4732] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:58 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:38:58.488313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f483be-0ee4-41e7-aa16-9f683d477489 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:58.489871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-13f483be-0ee4-41e7-aa16-9f683d477489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:58.504864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f483be-0ee4-41e7-aa16-9f683d477489 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:58.511170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced4b65-2082-4c75-95fe-57ee1553518b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:58.511907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced4b65-2082-4c75-95fe-57ee1553518b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:58.512194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced4b65-2082-4c75-95fe-57ee1553518b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:58.512466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced4b65-2082-4c75-95fe-57ee1553518b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:58.513253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced4b65-2082-4c75-95fe-57ee1553518b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:58.514940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced4b65-2082-4c75-95fe-57ee1553518b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:58.525969 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2358/4733] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:58.538328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8b400-09da-4e86-afd7-0c5196774e01 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:58.548799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8b400-09da-4e86-afd7-0c5196774e01 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:58.561248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27008849-2576-4a4d-8500-c3ffa95e12d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:58.562017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27008849-2576-4a4d-8500-c3ffa95e12d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:58.562387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27008849-2576-4a4d-8500-c3ffa95e12d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:58.563059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27008849-2576-4a4d-8500-c3ffa95e12d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:58.563490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27008849-2576-4a4d-8500-c3ffa95e12d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:58.565168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27008849-2576-4a4d-8500-c3ffa95e12d6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:58.587962 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2376/4734] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:58.589800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced4b65-2082-4c75-95fe-57ee1553518b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:58.608990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced4b65-2082-4c75-95fe-57ee1553518b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:58.614385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0421065-159c-4b41-ac21-0deb0c9fe952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:58.615334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0421065-159c-4b41-ac21-0deb0c9fe952 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:58.615791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0421065-159c-4b41-ac21-0deb0c9fe952 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:58.616247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0421065-159c-4b41-ac21-0deb0c9fe952 admin admin] PATH_INFO: `/v3/projects/412e246f78c545028e42fedc2584387b/users/deeaf393aa314b13819887730641a8af/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:58.634918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0421065-159c-4b41-ac21-0deb0c9fe952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=412e246f78c545028e42fedc2584387b, user_id=deeaf393aa314b13819887730641a8af, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:58.637630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0421065-159c-4b41-ac21-0deb0c9fe952 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:58.652779 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2359/4735] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:58 2022] PUT /identity/v3/projects/412e246f78c545028e42fedc2584387b/users/deeaf393aa314b13819887730641a8af/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:58.657942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca2f25-d734-4962-b512-99fabd070dc2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:58.658235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca2f25-d734-4962-b512-99fabd070dc2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:58.658548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca2f25-d734-4962-b512-99fabd070dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:58.678408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-47ca2f25-d734-4962-b512-99fabd070dc2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:58.679691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-47ca2f25-d734-4962-b512-99fabd070dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:58.734536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0421065-159c-4b41-ac21-0deb0c9fe952 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:58.736473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d0421065-159c-4b41-ac21-0deb0c9fe952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:58.743781 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2377/4736] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:38:58.751208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0421065-159c-4b41-ac21-0deb0c9fe952 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:58.753799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca2f25-d734-4962-b512-99fabd070dc2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:58.755681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-47ca2f25-d734-4962-b512-99fabd070dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:58.759525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901cf0b-1e6f-4fab-9d28-b3a84ea16edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:58.760264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901cf0b-1e6f-4fab-9d28-b3a84ea16edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:58.760440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901cf0b-1e6f-4fab-9d28-b3a84ea16edb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:58.760710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901cf0b-1e6f-4fab-9d28-b3a84ea16edb admin admin] PATH_INFO: `/v3/projects/696e7b94ae7440479553b3b5620bc8eb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:58.761949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901cf0b-1e6f-4fab-9d28-b3a84ea16edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=696e7b94ae7440479553b3b5620bc8eb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:58.763923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901cf0b-1e6f-4fab-9d28-b3a84ea16edb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:58.791382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:58.813165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0901cf0b-1e6f-4fab-9d28-b3a84ea16edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '696e7b94ae7440479553b3b5620bc8eb', 'request_id': 'req-0901cf0b-1e6f-4fab-9d28-b3a84ea16edb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:58.819524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0901cf0b-1e6f-4fab-9d28-b3a84ea16edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '696e7b94ae7440479553b3b5620bc8eb', 'request_id': 'req-0901cf0b-1e6f-4fab-9d28-b3a84ea16edb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:58.822272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca2f25-d734-4962-b512-99fabd070dc2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:58.825489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0901cf0b-1e6f-4fab-9d28-b3a84ea16edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '696e7b94ae7440479553b3b5620bc8eb', 'request_id': 'req-0901cf0b-1e6f-4fab-9d28-b3a84ea16edb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:58.839064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0901cf0b-1e6f-4fab-9d28-b3a84ea16edb admin admin] The token cache is being invalidate because project 696e7b94ae7440479553b3b5620bc8eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:38:58.839701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0901cf0b-1e6f-4fab-9d28-b3a84ea16edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:58.840339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0901cf0b-1e6f-4fab-9d28-b3a84ea16edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:38:58.842096 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2360/4737] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:38:58 2022] DELETE /identity/v3/projects/696e7b94ae7440479553b3b5620bc8eb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:58.847814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45cee4-2865-4b4b-bf90-0976238d56a0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:58.848099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45cee4-2865-4b4b-bf90-0976238d56a0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:58.848372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45cee4-2865-4b4b-bf90-0976238d56a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:58.867820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1b45cee4-2865-4b4b-bf90-0976238d56a0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:58.869078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1b45cee4-2865-4b4b-bf90-0976238d56a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:58.873943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5d7f1-c069-46bc-92e4-26dd8c12baab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:58.874562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5d7f1-c069-46bc-92e4-26dd8c12baab service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:58.874984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5d7f1-c069-46bc-92e4-26dd8c12baab service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:58.875276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5d7f1-c069-46bc-92e4-26dd8c12baab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:58.877117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aae5d7f1-c069-46bc-92e4-26dd8c12baab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:58.890509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:58.937581 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2361/4738] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:38:58.946465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7fe67-30b1-4e78-88bf-274a1ad7d7a5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:58.947127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7fe67-30b1-4e78-88bf-274a1ad7d7a5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:58.947684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7fe67-30b1-4e78-88bf-274a1ad7d7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:58.950544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5d7f1-c069-46bc-92e4-26dd8c12baab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:58.952082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5d7f1-c069-46bc-92e4-26dd8c12baab service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:58.963130 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2378/4739] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:58.971497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2ed7fe67-30b1-4e78-88bf-274a1ad7d7a5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:58.972721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2ed7fe67-30b1-4e78-88bf-274a1ad7d7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:58.981087 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2362/4740] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:58.985553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5d7f1-c069-46bc-92e4-26dd8c12baab service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:58.999349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5d7f1-c069-46bc-92e4-26dd8c12baab service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:59.005837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf7c80-6d40-4f12-89f5-0dfb4ddbff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:59.006474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf7c80-6d40-4f12-89f5-0dfb4ddbff40 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:59.006780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf7c80-6d40-4f12-89f5-0dfb4ddbff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:59.007057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf7c80-6d40-4f12-89f5-0dfb4ddbff40 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:59.007819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf7c80-6d40-4f12-89f5-0dfb4ddbff40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:59.008127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf7c80-6d40-4f12-89f5-0dfb4ddbff40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:59.010272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf7c80-6d40-4f12-89f5-0dfb4ddbff40 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:59.023089 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2379/4741] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:38:59.027487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7fe67-30b1-4e78-88bf-274a1ad7d7a5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:59.037091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7fe67-30b1-4e78-88bf-274a1ad7d7a5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:59.041945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ab6ea-f415-4bea-9098-53f486c61d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:59.042558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ab6ea-f415-4bea-9098-53f486c61d12 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:59.042841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ab6ea-f415-4bea-9098-53f486c61d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:59.043121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ab6ea-f415-4bea-9098-53f486c61d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:59.043830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ab6ea-f415-4bea-9098-53f486c61d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:59.045792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ab6ea-f415-4bea-9098-53f486c61d12 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:59.078054 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2363/4742] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:59 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:59.082295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf7c80-6d40-4f12-89f5-0dfb4ddbff40 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:59.097103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf7c80-6d40-4f12-89f5-0dfb4ddbff40 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:59.167177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e4762-0d1c-4066-ac41-90aa00859841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:59.168031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4762-0d1c-4066-ac41-90aa00859841 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:59.168186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4762-0d1c-4066-ac41-90aa00859841 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:59.168382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4762-0d1c-4066-ac41-90aa00859841 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:59.169034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e4762-0d1c-4066-ac41-90aa00859841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:59.170998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e4762-0d1c-4066-ac41-90aa00859841 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:59.194520 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2380/4743] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:59 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:59.199223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ab6ea-f415-4bea-9098-53f486c61d12 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:59.210704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ab6ea-f415-4bea-9098-53f486c61d12 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:59.216387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67904bcf-c5b6-4f46-948b-75fe2794ac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:59.217009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67904bcf-c5b6-4f46-948b-75fe2794ac82 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:59.217291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67904bcf-c5b6-4f46-948b-75fe2794ac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:59.217564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67904bcf-c5b6-4f46-948b-75fe2794ac82 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:59.218251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67904bcf-c5b6-4f46-948b-75fe2794ac82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:59.219930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67904bcf-c5b6-4f46-948b-75fe2794ac82 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:59.231151 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2364/4744] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:38:59.235168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e4762-0d1c-4066-ac41-90aa00859841 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:59.245742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e4762-0d1c-4066-ac41-90aa00859841 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:59.250772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32f8fa-c5e4-4a5f-a5cb-b2764224529a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:59.251441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32f8fa-c5e4-4a5f-a5cb-b2764224529a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:59.251760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32f8fa-c5e4-4a5f-a5cb-b2764224529a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:59.252070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32f8fa-c5e4-4a5f-a5cb-b2764224529a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:59.252753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32f8fa-c5e4-4a5f-a5cb-b2764224529a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:59.254384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32f8fa-c5e4-4a5f-a5cb-b2764224529a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:59.260139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:59.267541 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2381/4745] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:59.271765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67904bcf-c5b6-4f46-948b-75fe2794ac82 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:59.282341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67904bcf-c5b6-4f46-948b-75fe2794ac82 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:59.287359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3fdae-758e-46e4-b174-7c6d9b002525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:59.288031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3fdae-758e-46e4-b174-7c6d9b002525 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:59.288313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3fdae-758e-46e4-b174-7c6d9b002525 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:59.288586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3fdae-758e-46e4-b174-7c6d9b002525 admin admin] PATH_INFO: `/v3/projects/226561649218423abe247bff077b27b8/users/69fae5b46e7349a1b6e370b4e6e1d4e8/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:59.306494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3fdae-758e-46e4-b174-7c6d9b002525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=226561649218423abe247bff077b27b8, user_id=69fae5b46e7349a1b6e370b4e6e1d4e8, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:59.309519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3fdae-758e-46e4-b174-7c6d9b002525 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:59.326253 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2365/4746] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:59 2022] PUT /identity/v3/projects/226561649218423abe247bff077b27b8/users/69fae5b46e7349a1b6e370b4e6e1d4e8/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:59.337632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14316c-8c79-4630-a4b5-b2c6a7b49b3c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:59.337938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14316c-8c79-4630-a4b5-b2c6a7b49b3c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:59.338457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14316c-8c79-4630-a4b5-b2c6a7b49b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:59.371600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0e14316c-8c79-4630-a4b5-b2c6a7b49b3c None None] MFA Rules not processed for user `69fae5b46e7349a1b6e370b4e6e1d4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:59.373106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0e14316c-8c79-4630-a4b5-b2c6a7b49b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:59.433087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3fdae-758e-46e4-b174-7c6d9b002525 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:59.435650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-32a3fdae-758e-46e4-b174-7c6d9b002525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:59.463627 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2382/4747] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:38:59 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:38:59.469312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14316c-8c79-4630-a4b5-b2c6a7b49b3c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:59.524873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3fdae-758e-46e4-b174-7c6d9b002525 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:59.528955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a6108-d516-4793-b627-95862926bd4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:59.529695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a6108-d516-4793-b627-95862926bd4d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:59.530079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a6108-d516-4793-b627-95862926bd4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:59.530464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a6108-d516-4793-b627-95862926bd4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:59.532706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-149a6108-d516-4793-b627-95862926bd4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:59.576838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14316c-8c79-4630-a4b5-b2c6a7b49b3c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:59.583757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f11723-de04-4d83-87c5-b02bd0b44145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:59.584381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f11723-de04-4d83-87c5-b02bd0b44145 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:59.584654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f11723-de04-4d83-87c5-b02bd0b44145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:59.584922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f11723-de04-4d83-87c5-b02bd0b44145 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:59.585710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f11723-de04-4d83-87c5-b02bd0b44145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:59.587557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f11723-de04-4d83-87c5-b02bd0b44145 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:59.620833 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2383/4748] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:38:59 2022] POST /identity/v3/projects => generated 397 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:59.624611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f11723-de04-4d83-87c5-b02bd0b44145 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:59.655058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a6108-d516-4793-b627-95862926bd4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:59.665939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a6108-d516-4793-b627-95862926bd4d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:59.700253 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2366/4749] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:38:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:38:59.739000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f11723-de04-4d83-87c5-b02bd0b44145 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:59.745056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0098904-ee7b-4801-9877-23293a4e4ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:59.745780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0098904-ee7b-4801-9877-23293a4e4ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:59.746155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0098904-ee7b-4801-9877-23293a4e4ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:59.746404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0098904-ee7b-4801-9877-23293a4e4ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:59.747054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0098904-ee7b-4801-9877-23293a4e4ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:59.749087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0098904-ee7b-4801-9877-23293a4e4ce8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:59.775913 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2384/4750] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:38:59 2022] POST /identity/v3/users => generated 305 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:59.779733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a6108-d516-4793-b627-95862926bd4d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:59.788493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:59.798139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a6108-d516-4793-b627-95862926bd4d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:59.805530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a2596-4b92-42fb-be48-5573d58c31c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:59.806878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a2596-4b92-42fb-be48-5573d58c31c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:59.807411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a2596-4b92-42fb-be48-5573d58c31c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:59.807967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a2596-4b92-42fb-be48-5573d58c31c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:59.809114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a2596-4b92-42fb-be48-5573d58c31c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:59.810850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a2596-4b92-42fb-be48-5573d58c31c5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:59.827314 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2367/4751] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:38:59.831941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0098904-ee7b-4801-9877-23293a4e4ce8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:59.847667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:59.853379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0098904-ee7b-4801-9877-23293a4e4ce8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:59.861387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c8cce-9c8e-4a91-88b9-ab9076e1947d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:59.862312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c8cce-9c8e-4a91-88b9-ab9076e1947d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:59.862664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c8cce-9c8e-4a91-88b9-ab9076e1947d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:59.863044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c8cce-9c8e-4a91-88b9-ab9076e1947d admin admin] PATH_INFO: `/v3/projects/fca5d788aa1e47718ecbb0faa9561340/users/0c6ecc158c37424aa132ea5fa563d789/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:59.885071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c8cce-9c8e-4a91-88b9-ab9076e1947d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fca5d788aa1e47718ecbb0faa9561340, user_id=0c6ecc158c37424aa132ea5fa563d789, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:59.887868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c8cce-9c8e-4a91-88b9-ab9076e1947d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:59.904633 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2385/4752] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:38:59 2022] PUT /identity/v3/projects/fca5d788aa1e47718ecbb0faa9561340/users/0c6ecc158c37424aa132ea5fa563d789/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:59.908780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a2596-4b92-42fb-be48-5573d58c31c5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:59.924927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a2596-4b92-42fb-be48-5573d58c31c5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:00.008415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e4091-7565-4010-8008-94ee7345ca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:00.010121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e4091-7565-4010-8008-94ee7345ca42 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:00.010121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e4091-7565-4010-8008-94ee7345ca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:00.026434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e4091-7565-4010-8008-94ee7345ca42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:00.029428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e4091-7565-4010-8008-94ee7345ca42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:00.034617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e4091-7565-4010-8008-94ee7345ca42 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:00.049486 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2368/4753] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:39:00.053551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c8cce-9c8e-4a91-88b9-ab9076e1947d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:00.066217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c8cce-9c8e-4a91-88b9-ab9076e1947d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:00.082586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc4cc8-46ad-4088-8554-faa3553cc9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:00.083348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc4cc8-46ad-4088-8554-faa3553cc9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:00.083638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc4cc8-46ad-4088-8554-faa3553cc9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:00.083921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc4cc8-46ad-4088-8554-faa3553cc9ff admin admin] PATH_INFO: `/v3/projects/fca5d788aa1e47718ecbb0faa9561340/users/0c6ecc158c37424aa132ea5fa563d789/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:00.087100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc4cc8-46ad-4088-8554-faa3553cc9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=fca5d788aa1e47718ecbb0faa9561340, user_id=0c6ecc158c37424aa132ea5fa563d789, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:00.093049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc4cc8-46ad-4088-8554-faa3553cc9ff admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:00.107645 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2386/4754] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:39:00 2022] PUT /identity/v3/projects/fca5d788aa1e47718ecbb0faa9561340/users/0c6ecc158c37424aa132ea5fa563d789/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:39:00.119007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf68503-00de-4e35-acda-ea761df6e8be None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:00.119314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf68503-00de-4e35-acda-ea761df6e8be None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:00.119614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf68503-00de-4e35-acda-ea761df6e8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:00.155344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-daf68503-00de-4e35-acda-ea761df6e8be None None] MFA Rules not processed for user `0c6ecc158c37424aa132ea5fa563d789`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:00.156582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-daf68503-00de-4e35-acda-ea761df6e8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:00.266480 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2369/4755] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:39:00 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:39:00.312798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc4cc8-46ad-4088-8554-faa3553cc9ff admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:00.416493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc4cc8-46ad-4088-8554-faa3553cc9ff admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:00.420414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83509e3-a09b-4594-8373-1f918bf2ab8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:00.421114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83509e3-a09b-4594-8373-1f918bf2ab8d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:00.421467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83509e3-a09b-4594-8373-1f918bf2ab8d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:00.421806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83509e3-a09b-4594-8373-1f918bf2ab8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:00.503586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83509e3-a09b-4594-8373-1f918bf2ab8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:00.505201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83509e3-a09b-4594-8373-1f918bf2ab8d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:00.517826 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2387/4756] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:39:00 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:39:00.679955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb9853-4753-4ba0-b4fb-ff31e3054445 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:00.680250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb9853-4753-4ba0-b4fb-ff31e3054445 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:00.680967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb9853-4753-4ba0-b4fb-ff31e3054445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:00.719919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2eeb9853-4753-4ba0-b4fb-ff31e3054445 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:00.724132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2eeb9853-4753-4ba0-b4fb-ff31e3054445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:00.857628 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2370/4757] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:39:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:39:00.875906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83509e3-a09b-4594-8373-1f918bf2ab8d service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:00.878332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f83509e3-a09b-4594-8373-1f918bf2ab8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:01.052013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83509e3-a09b-4594-8373-1f918bf2ab8d service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:01.066306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a0edb-4fd1-41aa-a1de-b9d5262b3e95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:01.067716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a0edb-4fd1-41aa-a1de-b9d5262b3e95 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:01.068929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a0edb-4fd1-41aa-a1de-b9d5262b3e95 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:01.089909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb9853-4753-4ba0-b4fb-ff31e3054445 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:01.091544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2eeb9853-4753-4ba0-b4fb-ff31e3054445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:01.092342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a0edb-4fd1-41aa-a1de-b9d5262b3e95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:01.116397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a0edb-4fd1-41aa-a1de-b9d5262b3e95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:01.121693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a0edb-4fd1-41aa-a1de-b9d5262b3e95 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:01.141379 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2388/4758] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:39:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:39:01.164962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:01.328730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a0edb-4fd1-41aa-a1de-b9d5262b3e95 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:01.341771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a0edb-4fd1-41aa-a1de-b9d5262b3e95 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:01.350109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aa079-65f5-4403-b469-fe22fa53c73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:01.351409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aa079-65f5-4403-b469-fe22fa53c73c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:01.352202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aa079-65f5-4403-b469-fe22fa53c73c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:01.352720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aa079-65f5-4403-b469-fe22fa53c73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:01.357293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c5aa079-65f5-4403-b469-fe22fa53c73c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:01.388944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5aa079-65f5-4403-b469-fe22fa53c73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:01.391478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5aa079-65f5-4403-b469-fe22fa53c73c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:01.406210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb9853-4753-4ba0-b4fb-ff31e3054445 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:01.409056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:01.439443 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2389/4759] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:39:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:39:01.440704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad9766-d482-4418-905d-8ae8968e5074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:01.441479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad9766-d482-4418-905d-8ae8968e5074 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:01.442221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad9766-d482-4418-905d-8ae8968e5074 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:01.442458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad9766-d482-4418-905d-8ae8968e5074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:01.467492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad9766-d482-4418-905d-8ae8968e5074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:01.469139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad9766-d482-4418-905d-8ae8968e5074 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:01.501128 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2371/4760] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:39:01 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:39:05.712056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c8bdd-2363-45d5-9210-a8f17062aa00 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:05.712798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c8bdd-2363-45d5-9210-a8f17062aa00 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:05.712798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c8bdd-2363-45d5-9210-a8f17062aa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:05.784690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-677c8bdd-2363-45d5-9210-a8f17062aa00 None None] MFA Rules not processed for user `deeaf393aa314b13819887730641a8af`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:05.786112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-677c8bdd-2363-45d5-9210-a8f17062aa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:06.017574 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2390/4761] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:39:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:39:06.019526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4289c56-a374-4161-9353-14a675150b44 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:06.020472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4289c56-a374-4161-9353-14a675150b44 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:06.020898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4289c56-a374-4161-9353-14a675150b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:06.073092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c4289c56-a374-4161-9353-14a675150b44 None None] MFA Rules not processed for user `deeaf393aa314b13819887730641a8af`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:06.077137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c4289c56-a374-4161-9353-14a675150b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:06.110536 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2372/4762] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:39:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:39:06.123685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c8bdd-2363-45d5-9210-a8f17062aa00 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:06.131139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-677c8bdd-2363-45d5-9210-a8f17062aa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:06.202364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c8bdd-2363-45d5-9210-a8f17062aa00 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:06.217879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba36820-2069-40e0-b3df-cea3a462cf8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:06.219148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba36820-2069-40e0-b3df-cea3a462cf8a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:06.219980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba36820-2069-40e0-b3df-cea3a462cf8a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:06.220451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba36820-2069-40e0-b3df-cea3a462cf8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:06.235191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba36820-2069-40e0-b3df-cea3a462cf8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:06.238222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba36820-2069-40e0-b3df-cea3a462cf8a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:06.253471 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2391/4763] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:39:06 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:39:12.207342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4289c56-a374-4161-9353-14a675150b44 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:12.210055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c4289c56-a374-4161-9353-14a675150b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:12.402383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4289c56-a374-4161-9353-14a675150b44 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:12.408548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256d8a3-b214-400e-a788-f95f204485d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:12.409226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256d8a3-b214-400e-a788-f95f204485d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:12.409556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256d8a3-b214-400e-a788-f95f204485d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:12.409847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256d8a3-b214-400e-a788-f95f204485d0 admin admin] PATH_INFO: `/v3/users/86904c91778040c496be7e7ac440f564` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:12.411035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256d8a3-b214-400e-a788-f95f204485d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86904c91778040c496be7e7ac440f564)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:12.420894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256d8a3-b214-400e-a788-f95f204485d0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:12.529324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7256d8a3-b214-400e-a788-f95f204485d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86904c91778040c496be7e7ac440f564'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:12.566800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7256d8a3-b214-400e-a788-f95f204485d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86904c91778040c496be7e7ac440f564'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:12.567849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7256d8a3-b214-400e-a788-f95f204485d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86904c91778040c496be7e7ac440f564'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:12.568709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7256d8a3-b214-400e-a788-f95f204485d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86904c91778040c496be7e7ac440f564'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:12.592952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7256d8a3-b214-400e-a788-f95f204485d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86904c91778040c496be7e7ac440f564'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:12.619452 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2373/4764] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:39:12 2022] DELETE /identity/v3/users/86904c91778040c496be7e7ac440f564 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:39:12.970701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba36820-2069-40e0-b3df-cea3a462cf8a service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:13.022772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba36820-2069-40e0-b3df-cea3a462cf8a service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:13.205706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347a914-96b0-4b98-9072-8ab71258f1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:13.205706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347a914-96b0-4b98-9072-8ab71258f1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:13.205706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347a914-96b0-4b98-9072-8ab71258f1af admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:13.206073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347a914-96b0-4b98-9072-8ab71258f1af admin admin] PATH_INFO: `/v3/projects/024fabea2d6b4689aa2a05a01dbf9a02` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:13.207074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347a914-96b0-4b98-9072-8ab71258f1af admin admin] RBAC: Authorizing `identity:delete_project(project_id=024fabea2d6b4689aa2a05a01dbf9a02)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:13.209302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347a914-96b0-4b98-9072-8ab71258f1af admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:13.353224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9347a914-96b0-4b98-9072-8ab71258f1af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024fabea2d6b4689aa2a05a01dbf9a02', 'request_id': 'req-9347a914-96b0-4b98-9072-8ab71258f1af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:13.377417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256d8a3-b214-400e-a788-f95f204485d0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:13.379813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7256d8a3-b214-400e-a788-f95f204485d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:13.389526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9347a914-96b0-4b98-9072-8ab71258f1af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024fabea2d6b4689aa2a05a01dbf9a02', 'request_id': 'req-9347a914-96b0-4b98-9072-8ab71258f1af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:13.408682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9347a914-96b0-4b98-9072-8ab71258f1af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024fabea2d6b4689aa2a05a01dbf9a02', 'request_id': 'req-9347a914-96b0-4b98-9072-8ab71258f1af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:13.426310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:13.448629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9347a914-96b0-4b98-9072-8ab71258f1af admin admin] The token cache is being invalidate because project 024fabea2d6b4689aa2a05a01dbf9a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:39:13.448912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9347a914-96b0-4b98-9072-8ab71258f1af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:13.455844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9347a914-96b0-4b98-9072-8ab71258f1af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:13.463036 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2392/4765] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:39:12 2022] DELETE /identity/v3/projects/024fabea2d6b4689aa2a05a01dbf9a02 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:39:13.473394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39712675-d341-432c-8e67-b6854bc2e257 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:13.477470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39712675-d341-432c-8e67-b6854bc2e257 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:13.477998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39712675-d341-432c-8e67-b6854bc2e257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:13.504431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256d8a3-b214-400e-a788-f95f204485d0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:13.506838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:13.533824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-39712675-d341-432c-8e67-b6854bc2e257 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:13.539060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-39712675-d341-432c-8e67-b6854bc2e257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:13.602844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c847a-faf7-4e7c-9aff-8a48aa37ae52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:13.603826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c847a-faf7-4e7c-9aff-8a48aa37ae52 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:13.604344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c847a-faf7-4e7c-9aff-8a48aa37ae52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:13.604813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c847a-faf7-4e7c-9aff-8a48aa37ae52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:13.607721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a19c847a-faf7-4e7c-9aff-8a48aa37ae52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:13.626472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c847a-faf7-4e7c-9aff-8a48aa37ae52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:13.630087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c847a-faf7-4e7c-9aff-8a48aa37ae52 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:13.645146 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2374/4766] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:39:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:39:13.733651 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2393/4767] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:39:13.743702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891c09b-5d6b-4104-be1e-50b0a5a7a8e6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:13.744309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891c09b-5d6b-4104-be1e-50b0a5a7a8e6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:13.744747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891c09b-5d6b-4104-be1e-50b0a5a7a8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:13.797207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7891c09b-5d6b-4104-be1e-50b0a5a7a8e6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:13.798466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7891c09b-5d6b-4104-be1e-50b0a5a7a8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:13.808169 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2375/4768] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:39:13.814293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39712675-d341-432c-8e67-b6854bc2e257 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:13.828496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39712675-d341-432c-8e67-b6854bc2e257 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:13.843409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769d2e9-3a3c-495d-910a-9190d78e2e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:13.844334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769d2e9-3a3c-495d-910a-9190d78e2e01 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:13.844772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769d2e9-3a3c-495d-910a-9190d78e2e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:13.846708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769d2e9-3a3c-495d-910a-9190d78e2e01 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:13.847614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769d2e9-3a3c-495d-910a-9190d78e2e01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:13.848087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769d2e9-3a3c-495d-910a-9190d78e2e01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:13.855906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769d2e9-3a3c-495d-910a-9190d78e2e01 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:13.891922 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2394/4769] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:13.892951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891c09b-5d6b-4104-be1e-50b0a5a7a8e6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:13.911916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891c09b-5d6b-4104-be1e-50b0a5a7a8e6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:13.938560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492bf4b-8102-41a4-ab6e-058fa93c1395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:13.944395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492bf4b-8102-41a4-ab6e-058fa93c1395 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:13.945883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492bf4b-8102-41a4-ab6e-058fa93c1395 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:13.947802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492bf4b-8102-41a4-ab6e-058fa93c1395 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:13.948636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492bf4b-8102-41a4-ab6e-058fa93c1395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:13.955272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492bf4b-8102-41a4-ab6e-058fa93c1395 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:14.021786 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2376/4770] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:39:13 2022] POST /identity/v3/projects => generated 395 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:39:14.025766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769d2e9-3a3c-495d-910a-9190d78e2e01 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:14.046310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769d2e9-3a3c-495d-910a-9190d78e2e01 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:14.153576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8071e0-2f3e-409d-9f1c-b0c0ee132252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:14.154282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8071e0-2f3e-409d-9f1c-b0c0ee132252 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:14.154618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8071e0-2f3e-409d-9f1c-b0c0ee132252 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:14.155044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8071e0-2f3e-409d-9f1c-b0c0ee132252 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:14.155847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8071e0-2f3e-409d-9f1c-b0c0ee132252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:14.158243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8071e0-2f3e-409d-9f1c-b0c0ee132252 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:14.222663 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2395/4771] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:39:14 2022] POST /identity/v3/users => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:39:14.222992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492bf4b-8102-41a4-ab6e-058fa93c1395 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:14.236986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492bf4b-8102-41a4-ab6e-058fa93c1395 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:14.254186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322325d-59cb-4c77-90ec-04feeb1b72fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:14.256127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322325d-59cb-4c77-90ec-04feeb1b72fd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:14.257021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322325d-59cb-4c77-90ec-04feeb1b72fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:14.258253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322325d-59cb-4c77-90ec-04feeb1b72fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:14.261944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322325d-59cb-4c77-90ec-04feeb1b72fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:14.274385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322325d-59cb-4c77-90ec-04feeb1b72fd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:14.315230 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2377/4772] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:39:14.316485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8071e0-2f3e-409d-9f1c-b0c0ee132252 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:14.330652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8071e0-2f3e-409d-9f1c-b0c0ee132252 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:14.340055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da371439-c47f-44ca-9241-8e09f2437925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:14.343358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da371439-c47f-44ca-9241-8e09f2437925 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:14.344294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da371439-c47f-44ca-9241-8e09f2437925 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:14.344842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da371439-c47f-44ca-9241-8e09f2437925 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:14.348214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da371439-c47f-44ca-9241-8e09f2437925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:14.351503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da371439-c47f-44ca-9241-8e09f2437925 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:14.367694 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2396/4773] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:39:14.372277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322325d-59cb-4c77-90ec-04feeb1b72fd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:14.384267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322325d-59cb-4c77-90ec-04feeb1b72fd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:14.393974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4327c7-fe5f-47dc-9c0e-e0b4e06bf344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:14.395757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4327c7-fe5f-47dc-9c0e-e0b4e06bf344 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:14.396266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4327c7-fe5f-47dc-9c0e-e0b4e06bf344 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:14.396772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4327c7-fe5f-47dc-9c0e-e0b4e06bf344 admin admin] PATH_INFO: `/v3/projects/bc870b2dd9604a76a5fc4566e4eca523/users/12eff0cadba644f9bb6db497eb721b0b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:14.417920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4327c7-fe5f-47dc-9c0e-e0b4e06bf344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc870b2dd9604a76a5fc4566e4eca523, user_id=12eff0cadba644f9bb6db497eb721b0b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:14.421350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4327c7-fe5f-47dc-9c0e-e0b4e06bf344 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:14.443812 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2378/4774] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:39:14 2022] PUT /identity/v3/projects/bc870b2dd9604a76a5fc4566e4eca523/users/12eff0cadba644f9bb6db497eb721b0b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:39:14.449193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5e576-50a4-4ffe-8c28-3a1d52bbd7d8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:14.450155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5e576-50a4-4ffe-8c28-3a1d52bbd7d8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:14.450433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5e576-50a4-4ffe-8c28-3a1d52bbd7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:14.477324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a2d5e576-50a4-4ffe-8c28-3a1d52bbd7d8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:14.478539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a2d5e576-50a4-4ffe-8c28-3a1d52bbd7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:14.568601 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2397/4775] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:39:14.592366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4327c7-fe5f-47dc-9c0e-e0b4e06bf344 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:14.594834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6b4327c7-fe5f-47dc-9c0e-e0b4e06bf344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:14.688764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4327c7-fe5f-47dc-9c0e-e0b4e06bf344 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:14.692825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7a1f7-ed50-4afe-ad13-f04fda03b2d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:14.693473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a1f7-ed50-4afe-ad13-f04fda03b2d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:14.693755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a1f7-ed50-4afe-ad13-f04fda03b2d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:14.694031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a1f7-ed50-4afe-ad13-f04fda03b2d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:14.705655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7a1f7-ed50-4afe-ad13-f04fda03b2d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:14.707345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7a1f7-ed50-4afe-ad13-f04fda03b2d0 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:14.725776 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2379/4776] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:39:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:39:17.439610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5e576-50a4-4ffe-8c28-3a1d52bbd7d8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:17.441897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a2d5e576-50a4-4ffe-8c28-3a1d52bbd7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:17.496973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5e576-50a4-4ffe-8c28-3a1d52bbd7d8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:17.517565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec15c75-bbfd-4db0-a3f3-de41199e2e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:17.518363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec15c75-bbfd-4db0-a3f3-de41199e2e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:17.518646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec15c75-bbfd-4db0-a3f3-de41199e2e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:17.518941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec15c75-bbfd-4db0-a3f3-de41199e2e4b admin admin] PATH_INFO: `/v3/users/69fae5b46e7349a1b6e370b4e6e1d4e8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:17.520696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec15c75-bbfd-4db0-a3f3-de41199e2e4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=69fae5b46e7349a1b6e370b4e6e1d4e8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:17.527618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec15c75-bbfd-4db0-a3f3-de41199e2e4b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:17.545107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:17.657689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eec15c75-bbfd-4db0-a3f3-de41199e2e4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69fae5b46e7349a1b6e370b4e6e1d4e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:17.659312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eec15c75-bbfd-4db0-a3f3-de41199e2e4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69fae5b46e7349a1b6e370b4e6e1d4e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:17.686923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eec15c75-bbfd-4db0-a3f3-de41199e2e4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69fae5b46e7349a1b6e370b4e6e1d4e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:17.704794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eec15c75-bbfd-4db0-a3f3-de41199e2e4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69fae5b46e7349a1b6e370b4e6e1d4e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:17.768425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eec15c75-bbfd-4db0-a3f3-de41199e2e4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69fae5b46e7349a1b6e370b4e6e1d4e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:17.778714 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2398/4777] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:39:17 2022] DELETE /identity/v3/users/69fae5b46e7349a1b6e370b4e6e1d4e8 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:39:17.783116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f2275-dee4-4a02-8e31-cc5598e174df None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:17.783634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f2275-dee4-4a02-8e31-cc5598e174df None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:17.783743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f2275-dee4-4a02-8e31-cc5598e174df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:17.810776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-845f2275-dee4-4a02-8e31-cc5598e174df None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:17.812295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-845f2275-dee4-4a02-8e31-cc5598e174df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:17.825897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:17.918237 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2380/4778] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:39:17.980368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec15c75-bbfd-4db0-a3f3-de41199e2e4b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:17.981923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eec15c75-bbfd-4db0-a3f3-de41199e2e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:18.068522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec15c75-bbfd-4db0-a3f3-de41199e2e4b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:18.073652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8bf9a-8fa1-4530-9226-0b547a053b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:18.074685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8bf9a-8fa1-4530-9226-0b547a053b4d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:18.075513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8bf9a-8fa1-4530-9226-0b547a053b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:18.076258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8bf9a-8fa1-4530-9226-0b547a053b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:18.091766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8bf9a-8fa1-4530-9226-0b547a053b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:18.094095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8bf9a-8fa1-4530-9226-0b547a053b4d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:18.114709 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2399/4779] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:39:18.665917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f2275-dee4-4a02-8e31-cc5598e174df None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:18.667488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-845f2275-dee4-4a02-8e31-cc5598e174df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:18.688371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f2275-dee4-4a02-8e31-cc5598e174df None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:18.705952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:18.706639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:18.706924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:18.707203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8 admin admin] PATH_INFO: `/v3/projects/226561649218423abe247bff077b27b8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:18.711615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=226561649218423abe247bff077b27b8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:18.713589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:18.840333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226561649218423abe247bff077b27b8', 'request_id': 'req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:18.852773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226561649218423abe247bff077b27b8', 'request_id': 'req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:18.868311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226561649218423abe247bff077b27b8', 'request_id': 'req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:18.904420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8 admin admin] The token cache is being invalidate because project 226561649218423abe247bff077b27b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:39:18.905236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:18.906180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:18.923211 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2381/4780] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:39:18 2022] DELETE /identity/v3/projects/226561649218423abe247bff077b27b8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:39:18.927522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8bf9a-8fa1-4530-9226-0b547a053b4d service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:18.942035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8bf9a-8fa1-4530-9226-0b547a053b4d service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:19.049636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10899c7f-ea24-45a6-a3fb-04ec5fba326a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:19.050308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899c7f-ea24-45a6-a3fb-04ec5fba326a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:19.050592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899c7f-ea24-45a6-a3fb-04ec5fba326a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:19.050866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899c7f-ea24-45a6-a3fb-04ec5fba326a admin admin] PATH_INFO: `/v3/users/0c6ecc158c37424aa132ea5fa563d789` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:19.052615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10899c7f-ea24-45a6-a3fb-04ec5fba326a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c6ecc158c37424aa132ea5fa563d789)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:19.055171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10899c7f-ea24-45a6-a3fb-04ec5fba326a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:19.100287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:19.142969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10899c7f-ea24-45a6-a3fb-04ec5fba326a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c6ecc158c37424aa132ea5fa563d789'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:19.144211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10899c7f-ea24-45a6-a3fb-04ec5fba326a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c6ecc158c37424aa132ea5fa563d789'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:19.153898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10899c7f-ea24-45a6-a3fb-04ec5fba326a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c6ecc158c37424aa132ea5fa563d789'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:19.165777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10899c7f-ea24-45a6-a3fb-04ec5fba326a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c6ecc158c37424aa132ea5fa563d789'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:19.188234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10899c7f-ea24-45a6-a3fb-04ec5fba326a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c6ecc158c37424aa132ea5fa563d789'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:19.203291 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2400/4781] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:39:18 2022] DELETE /identity/v3/users/0c6ecc158c37424aa132ea5fa563d789 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:39:19.553047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:19.555077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:19.629085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2872d3d-bed9-4c7d-ae75-a35f0c1025c8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:19.756049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d46e3-7ec8-4d39-b68b-4503cdf35afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:19.756965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d46e3-7ec8-4d39-b68b-4503cdf35afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:19.757571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d46e3-7ec8-4d39-b68b-4503cdf35afd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:19.758120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d46e3-7ec8-4d39-b68b-4503cdf35afd admin admin] PATH_INFO: `/v3/projects/fca5d788aa1e47718ecbb0faa9561340` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:19.760606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d46e3-7ec8-4d39-b68b-4503cdf35afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fca5d788aa1e47718ecbb0faa9561340)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:19.763239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d46e3-7ec8-4d39-b68b-4503cdf35afd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:19.873678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:19.873678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f1d46e3-7ec8-4d39-b68b-4503cdf35afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fca5d788aa1e47718ecbb0faa9561340', 'request_id': 'req-6f1d46e3-7ec8-4d39-b68b-4503cdf35afd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:19.884274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f1d46e3-7ec8-4d39-b68b-4503cdf35afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fca5d788aa1e47718ecbb0faa9561340', 'request_id': 'req-6f1d46e3-7ec8-4d39-b68b-4503cdf35afd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:19.899002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f1d46e3-7ec8-4d39-b68b-4503cdf35afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fca5d788aa1e47718ecbb0faa9561340', 'request_id': 'req-6f1d46e3-7ec8-4d39-b68b-4503cdf35afd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:19.932825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f1d46e3-7ec8-4d39-b68b-4503cdf35afd admin admin] The token cache is being invalidate because project fca5d788aa1e47718ecbb0faa9561340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:39:19.936826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f1d46e3-7ec8-4d39-b68b-4503cdf35afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:19.937638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f1d46e3-7ec8-4d39-b68b-4503cdf35afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:39:19.939246 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2382/4782] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:39:19 2022] DELETE /identity/v3/projects/fca5d788aa1e47718ecbb0faa9561340 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:39:19.944778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c3f8f-2f06-4634-a4fb-2c139ffcf9c5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:19.945304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c3f8f-2f06-4634-a4fb-2c139ffcf9c5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:19.945396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c3f8f-2f06-4634-a4fb-2c139ffcf9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:20.002440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fb8c3f8f-2f06-4634-a4fb-2c139ffcf9c5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:20.003610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb8c3f8f-2f06-4634-a4fb-2c139ffcf9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:20.148624 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2401/4783] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:39:20.155386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c049b06-58c2-450b-8bee-eed7a3b00640 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:20.155759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c049b06-58c2-450b-8bee-eed7a3b00640 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:20.156109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c049b06-58c2-450b-8bee-eed7a3b00640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:20.182181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1c049b06-58c2-450b-8bee-eed7a3b00640 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:20.184183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1c049b06-58c2-450b-8bee-eed7a3b00640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:20.198441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c3f8f-2f06-4634-a4fb-2c139ffcf9c5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:20.206108 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2383/4784] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:39:20.212215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c3f8f-2f06-4634-a4fb-2c139ffcf9c5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:20.217610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ba78b-2192-410d-8c86-09b9e8977e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:20.218522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ba78b-2192-410d-8c86-09b9e8977e28 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:20.218867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ba78b-2192-410d-8c86-09b9e8977e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:20.219205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ba78b-2192-410d-8c86-09b9e8977e28 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:20.220111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ba78b-2192-410d-8c86-09b9e8977e28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:20.220500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ba78b-2192-410d-8c86-09b9e8977e28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:20.222430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ba78b-2192-410d-8c86-09b9e8977e28 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:20.243202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c049b06-58c2-450b-8bee-eed7a3b00640 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:20.249675 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2402/4785] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:20.259088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c049b06-58c2-450b-8bee-eed7a3b00640 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:20.265602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8396751-63f5-4928-89cc-e465f586cc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:20.266360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8396751-63f5-4928-89cc-e465f586cc69 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:20.266976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8396751-63f5-4928-89cc-e465f586cc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:20.267388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8396751-63f5-4928-89cc-e465f586cc69 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:20.268135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8396751-63f5-4928-89cc-e465f586cc69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:20.272119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8396751-63f5-4928-89cc-e465f586cc69 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:20.312507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ba78b-2192-410d-8c86-09b9e8977e28 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:20.314159 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2384/4786] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:39:20 2022] POST /identity/v3/projects => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:39:20.327501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ba78b-2192-410d-8c86-09b9e8977e28 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:20.406420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc523790-4b4a-4111-8ada-386a074e93fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:20.407196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc523790-4b4a-4111-8ada-386a074e93fb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:20.407524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc523790-4b4a-4111-8ada-386a074e93fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:20.407799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc523790-4b4a-4111-8ada-386a074e93fb admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:20.408441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc523790-4b4a-4111-8ada-386a074e93fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:20.410390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc523790-4b4a-4111-8ada-386a074e93fb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:20.440588 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2403/4787] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:39:20 2022] POST /identity/v3/users => generated 284 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:39:20.445418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8396751-63f5-4928-89cc-e465f586cc69 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:20.458619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8396751-63f5-4928-89cc-e465f586cc69 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:20.465362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b77caf-a24d-45e1-aa05-0766132b713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:20.466113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b77caf-a24d-45e1-aa05-0766132b713b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:20.466497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b77caf-a24d-45e1-aa05-0766132b713b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:20.466905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b77caf-a24d-45e1-aa05-0766132b713b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:20.467718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b77caf-a24d-45e1-aa05-0766132b713b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:20.470014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b77caf-a24d-45e1-aa05-0766132b713b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:20.485743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc523790-4b4a-4111-8ada-386a074e93fb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:20.486759 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2385/4788] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:39:20.502775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc523790-4b4a-4111-8ada-386a074e93fb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:20.508012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510f9db-9071-457c-97ce-006209e0df1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:20.508762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510f9db-9071-457c-97ce-006209e0df1f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:20.509201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510f9db-9071-457c-97ce-006209e0df1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:20.509476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510f9db-9071-457c-97ce-006209e0df1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:20.510218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510f9db-9071-457c-97ce-006209e0df1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:20.511970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510f9db-9071-457c-97ce-006209e0df1f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:20.532581 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2404/4789] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:39:20.537197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b77caf-a24d-45e1-aa05-0766132b713b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:20.548077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b77caf-a24d-45e1-aa05-0766132b713b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:20.562507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a6d4e-d3e3-4008-9c44-1c85a46e6520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:20.563518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a6d4e-d3e3-4008-9c44-1c85a46e6520 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:20.564014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a6d4e-d3e3-4008-9c44-1c85a46e6520 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:20.564391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a6d4e-d3e3-4008-9c44-1c85a46e6520 admin admin] PATH_INFO: `/v3/projects/fd7348849b3b4231b11c26b6d44848fe/users/c08f9727d3d04d728531225379a3c4c1/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:20.594794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a6d4e-d3e3-4008-9c44-1c85a46e6520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7348849b3b4231b11c26b6d44848fe, user_id=c08f9727d3d04d728531225379a3c4c1, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:20.598723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a6d4e-d3e3-4008-9c44-1c85a46e6520 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:20.630943 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2386/4790] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:39:20 2022] PUT /identity/v3/projects/fd7348849b3b4231b11c26b6d44848fe/users/c08f9727d3d04d728531225379a3c4c1/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:39:20.633680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980fd36-bd87-4645-b9e4-2b82c2e80d8d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:20.634102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980fd36-bd87-4645-b9e4-2b82c2e80d8d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:20.634351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980fd36-bd87-4645-b9e4-2b82c2e80d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:20.700124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1980fd36-bd87-4645-b9e4-2b82c2e80d8d None None] MFA Rules not processed for user `c08f9727d3d04d728531225379a3c4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:20.704258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1980fd36-bd87-4645-b9e4-2b82c2e80d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:20.707808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:20.858496 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2405/4791] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:39:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:39:20.869236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a6d4e-d3e3-4008-9c44-1c85a46e6520 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:20.870940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cb9a6d4e-d3e3-4008-9c44-1c85a46e6520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:21.066344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a6d4e-d3e3-4008-9c44-1c85a46e6520 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:21.072589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1f1c2-833e-44c1-9fbf-ba6b490950f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:21.073443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1f1c2-833e-44c1-9fbf-ba6b490950f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:21.073871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1f1c2-833e-44c1-9fbf-ba6b490950f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:21.074312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1f1c2-833e-44c1-9fbf-ba6b490950f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:21.084681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1f1c2-833e-44c1-9fbf-ba6b490950f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:21.086612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1f1c2-833e-44c1-9fbf-ba6b490950f1 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:21.112217 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2387/4792] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:39:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:39:23.506556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25836499-a6f2-49fb-b91f-6b73a9726daf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:23.508405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25836499-a6f2-49fb-b91f-6b73a9726daf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:23.509103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25836499-a6f2-49fb-b91f-6b73a9726daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:23.555207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-25836499-a6f2-49fb-b91f-6b73a9726daf None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:23.556782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-25836499-a6f2-49fb-b91f-6b73a9726daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:23.681666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1f1c2-833e-44c1-9fbf-ba6b490950f1 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:23.684355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c5c1f1c2-833e-44c1-9fbf-ba6b490950f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:23.688595 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2406/4793] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:39:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:39:23.887205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1f1c2-833e-44c1-9fbf-ba6b490950f1 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:23.903596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae0d04-077c-47b8-9934-bc80be658579 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:23.904606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae0d04-077c-47b8-9934-bc80be658579 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:23.905996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae0d04-077c-47b8-9934-bc80be658579 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:23.907059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae0d04-077c-47b8-9934-bc80be658579 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:23.930445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae0d04-077c-47b8-9934-bc80be658579 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:23.934494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae0d04-077c-47b8-9934-bc80be658579 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:23.945385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:23.981235 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2388/4794] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:39:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 18:39:24.413297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb138e6c-3ab0-4bf4-9d82-c8228c880e01 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:24.414406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb138e6c-3ab0-4bf4-9d82-c8228c880e01 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:24.416967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb138e6c-3ab0-4bf4-9d82-c8228c880e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:24.514873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-eb138e6c-3ab0-4bf4-9d82-c8228c880e01 None None] MFA Rules not processed for user `12eff0cadba644f9bb6db497eb721b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:24.517276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eb138e6c-3ab0-4bf4-9d82-c8228c880e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:24.635370 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2407/4795] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:39:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:39:24.648911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc9396-6b6b-42ff-b321-93b84d5d389d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:24.649291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc9396-6b6b-42ff-b321-93b84d5d389d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:24.649640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc9396-6b6b-42ff-b321-93b84d5d389d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:24.716365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b4dc9396-6b6b-42ff-b321-93b84d5d389d None None] MFA Rules not processed for user `12eff0cadba644f9bb6db497eb721b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:24.718958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b4dc9396-6b6b-42ff-b321-93b84d5d389d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:24.727753 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2389/4796] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:39:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:39:24.739186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb138e6c-3ab0-4bf4-9d82-c8228c880e01 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:24.746205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eb138e6c-3ab0-4bf4-9d82-c8228c880e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:24.796379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:24.833550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb138e6c-3ab0-4bf4-9d82-c8228c880e01 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:24.841257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c0032-db86-496a-a05f-463e14b603e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:24.841903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c0032-db86-496a-a05f-463e14b603e6 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:24.842168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c0032-db86-496a-a05f-463e14b603e6 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:24.842442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c0032-db86-496a-a05f-463e14b603e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:24.856347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c0032-db86-496a-a05f-463e14b603e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:24.857981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c0032-db86-496a-a05f-463e14b603e6 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:24.869287 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2408/4797] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:39:24 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:39:25.710221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca39bd8-bfce-4cc7-ab2b-1485f1598760 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:25.711015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca39bd8-bfce-4cc7-ab2b-1485f1598760 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:25.713139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca39bd8-bfce-4cc7-ab2b-1485f1598760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:25.767626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7ca39bd8-bfce-4cc7-ab2b-1485f1598760 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:25.770934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7ca39bd8-bfce-4cc7-ab2b-1485f1598760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:25.797649 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2390/4798] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:39:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:39:25.814038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c0032-db86-496a-a05f-463e14b603e6 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:25.836680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c0032-db86-496a-a05f-463e14b603e6 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:25.844991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5570632-45df-40c4-92bd-a066f62d1c01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:25.845620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5570632-45df-40c4-92bd-a066f62d1c01 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:25.845898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5570632-45df-40c4-92bd-a066f62d1c01 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:25.846173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5570632-45df-40c4-92bd-a066f62d1c01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:25.883875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5570632-45df-40c4-92bd-a066f62d1c01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:25.885505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5570632-45df-40c4-92bd-a066f62d1c01 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:25.912587 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2409/4799] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:39:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:39:26.505489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd00a6-8adf-44e7-85cb-524c291161e2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:26.505775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd00a6-8adf-44e7-85cb-524c291161e2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:26.506244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd00a6-8adf-44e7-85cb-524c291161e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:26.530320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-34bd00a6-8adf-44e7-85cb-524c291161e2 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:26.532970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-34bd00a6-8adf-44e7-85cb-524c291161e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:26.545627 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2391/4800] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:39:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:39:26.590116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5570632-45df-40c4-92bd-a066f62d1c01 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:26.617936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5570632-45df-40c4-92bd-a066f62d1c01 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:26.629513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25bd3b-931f-4216-87c6-a9a758049a13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:26.630228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25bd3b-931f-4216-87c6-a9a758049a13 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:26.630569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25bd3b-931f-4216-87c6-a9a758049a13 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:26.631080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25bd3b-931f-4216-87c6-a9a758049a13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:26.643110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25bd3b-931f-4216-87c6-a9a758049a13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:26.645367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25bd3b-931f-4216-87c6-a9a758049a13 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:26.657321 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2410/4801] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:39:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:39:32.158440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a73dd-e71d-4cc1-81ac-54be6be09b26 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:32.158993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a73dd-e71d-4cc1-81ac-54be6be09b26 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:32.159221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a73dd-e71d-4cc1-81ac-54be6be09b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:32.196252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-230a73dd-e71d-4cc1-81ac-54be6be09b26 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:32.203952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-230a73dd-e71d-4cc1-81ac-54be6be09b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:32.224901 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2392/4802] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:39:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:39:32.239178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25bd3b-931f-4216-87c6-a9a758049a13 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:32.255708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25bd3b-931f-4216-87c6-a9a758049a13 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:32.275234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d404ea6-7448-4fab-91e1-eff41e09d960 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:32.275903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d404ea6-7448-4fab-91e1-eff41e09d960 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:32.276181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d404ea6-7448-4fab-91e1-eff41e09d960 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:32.276453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d404ea6-7448-4fab-91e1-eff41e09d960 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:32.294317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d404ea6-7448-4fab-91e1-eff41e09d960 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:32.295973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d404ea6-7448-4fab-91e1-eff41e09d960 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:32.329539 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2411/4803] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:39:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:39:33.105787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff9a4-f9d4-4c11-bf5f-4cc43d31099a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:33.106574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff9a4-f9d4-4c11-bf5f-4cc43d31099a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:33.106999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff9a4-f9d4-4c11-bf5f-4cc43d31099a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:33.172053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-880ff9a4-f9d4-4c11-bf5f-4cc43d31099a None None] MFA Rules not processed for user `deeaf393aa314b13819887730641a8af`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:33.178069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-880ff9a4-f9d4-4c11-bf5f-4cc43d31099a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:33.333780 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2393/4804] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:39:33 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:39:33.496993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d404ea6-7448-4fab-91e1-eff41e09d960 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:33.498441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4d404ea6-7448-4fab-91e1-eff41e09d960 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:33.540473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d404ea6-7448-4fab-91e1-eff41e09d960 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:33.581848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05eb32e-7ce5-4ce1-bfd4-5e3c9fd693fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:33.582644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eb32e-7ce5-4ce1-bfd4-5e3c9fd693fd service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:33.582932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eb32e-7ce5-4ce1-bfd4-5e3c9fd693fd service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:33.584066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eb32e-7ce5-4ce1-bfd4-5e3c9fd693fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:33.587957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e05eb32e-7ce5-4ce1-bfd4-5e3c9fd693fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:33.622758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05eb32e-7ce5-4ce1-bfd4-5e3c9fd693fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:33.626619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05eb32e-7ce5-4ce1-bfd4-5e3c9fd693fd service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:33.651444 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2412/4805] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:39:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:39:36.854075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ff9a4-f9d4-4c11-bf5f-4cc43d31099a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:36.881872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ff9a4-f9d4-4c11-bf5f-4cc43d31099a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:36.897741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85389a8a-eb03-46b9-8f00-f9a494a7a5a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:36.898815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85389a8a-eb03-46b9-8f00-f9a494a7a5a1 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:36.899365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85389a8a-eb03-46b9-8f00-f9a494a7a5a1 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:36.899837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85389a8a-eb03-46b9-8f00-f9a494a7a5a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:36.902784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-85389a8a-eb03-46b9-8f00-f9a494a7a5a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:36.940155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85389a8a-eb03-46b9-8f00-f9a494a7a5a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:36.942100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85389a8a-eb03-46b9-8f00-f9a494a7a5a1 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:36.975977 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2394/4806] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:39:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:39:43.160851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05eb32e-7ce5-4ce1-bfd4-5e3c9fd693fd service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:43.175340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d360b-6d1f-4a57-bdd1-9c96a626ade0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:43.176445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d360b-6d1f-4a57-bdd1-9c96a626ade0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:43.179214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e05eb32e-7ce5-4ce1-bfd4-5e3c9fd693fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:43.179511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d360b-6d1f-4a57-bdd1-9c96a626ade0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:43.229825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05eb32e-7ce5-4ce1-bfd4-5e3c9fd693fd service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:43.238351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-450d360b-6d1f-4a57-bdd1-9c96a626ade0 None None] MFA Rules not processed for user `a4a0713f4bfc4b1fb99f4afe849b042d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:43.239872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-450d360b-6d1f-4a57-bdd1-9c96a626ade0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:43.274087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b854e5-7523-4472-a5b2-542b3a3a7c68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:43.275709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b854e5-7523-4472-a5b2-542b3a3a7c68 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:43.275997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b854e5-7523-4472-a5b2-542b3a3a7c68 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:43.276274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b854e5-7523-4472-a5b2-542b3a3a7c68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:43.282838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a0b854e5-7523-4472-a5b2-542b3a3a7c68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:43.352846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b854e5-7523-4472-a5b2-542b3a3a7c68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:43.359366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b854e5-7523-4472-a5b2-542b3a3a7c68 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:43.375425 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2395/4807] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:39:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:39:43.403764 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2413/4808] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:39:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:39:44.810641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d360b-6d1f-4a57-bdd1-9c96a626ade0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:44.812932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-450d360b-6d1f-4a57-bdd1-9c96a626ade0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:44.989132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d360b-6d1f-4a57-bdd1-9c96a626ade0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:45.002568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317b25c-e98b-4a29-a706-e3bab84ea76e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:45.003632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317b25c-e98b-4a29-a706-e3bab84ea76e service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:45.004123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317b25c-e98b-4a29-a706-e3bab84ea76e service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:45.004613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317b25c-e98b-4a29-a706-e3bab84ea76e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:45.008187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e317b25c-e98b-4a29-a706-e3bab84ea76e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:45.039845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317b25c-e98b-4a29-a706-e3bab84ea76e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:45.041712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317b25c-e98b-4a29-a706-e3bab84ea76e service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:45.050131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:45.068787 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2396/4809] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:39:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:39:52.761672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b854e5-7523-4472-a5b2-542b3a3a7c68 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:52.765110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a0b854e5-7523-4472-a5b2-542b3a3a7c68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:52.861146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b854e5-7523-4472-a5b2-542b3a3a7c68 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:52.865453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696ac44-2e61-48f6-8e83-427b27747218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:52.866308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696ac44-2e61-48f6-8e83-427b27747218 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:52.866761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696ac44-2e61-48f6-8e83-427b27747218 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:52.867283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696ac44-2e61-48f6-8e83-427b27747218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:52.870277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6696ac44-2e61-48f6-8e83-427b27747218 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:52.952857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696ac44-2e61-48f6-8e83-427b27747218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:52.954732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696ac44-2e61-48f6-8e83-427b27747218 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:52.961421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:52.989127 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2414/4810] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:39:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:39:55.055568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:01.139526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317b25c-e98b-4a29-a706-e3bab84ea76e service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:01.247193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317b25c-e98b-4a29-a706-e3bab84ea76e service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:01.252407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea313b-a785-4c5b-bf86-cf93a0bb5f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:01.253070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea313b-a785-4c5b-bf86-cf93a0bb5f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:01.253371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea313b-a785-4c5b-bf86-cf93a0bb5f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:01.253774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea313b-a785-4c5b-bf86-cf93a0bb5f74 admin admin] PATH_INFO: `/v3/users/c08f9727d3d04d728531225379a3c4c1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:01.255724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea313b-a785-4c5b-bf86-cf93a0bb5f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08f9727d3d04d728531225379a3c4c1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:01.258435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea313b-a785-4c5b-bf86-cf93a0bb5f74 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:01.320931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78ea313b-a785-4c5b-bf86-cf93a0bb5f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08f9727d3d04d728531225379a3c4c1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:01.336631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78ea313b-a785-4c5b-bf86-cf93a0bb5f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08f9727d3d04d728531225379a3c4c1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:01.337753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78ea313b-a785-4c5b-bf86-cf93a0bb5f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08f9727d3d04d728531225379a3c4c1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:01.338623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78ea313b-a785-4c5b-bf86-cf93a0bb5f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08f9727d3d04d728531225379a3c4c1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:01.348201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78ea313b-a785-4c5b-bf86-cf93a0bb5f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08f9727d3d04d728531225379a3c4c1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:01.371957 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2397/4811] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:40:01 2022] DELETE /identity/v3/users/c08f9727d3d04d728531225379a3c4c1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:01.373785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82970fb-bbaa-4ff1-9fff-a5ad1ca83648 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:01.374267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82970fb-bbaa-4ff1-9fff-a5ad1ca83648 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:01.374678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82970fb-bbaa-4ff1-9fff-a5ad1ca83648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:01.396498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f82970fb-bbaa-4ff1-9fff-a5ad1ca83648 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:01.397919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f82970fb-bbaa-4ff1-9fff-a5ad1ca83648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:01.465604 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2415/4812] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:01.476537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea313b-a785-4c5b-bf86-cf93a0bb5f74 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:01.479953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-78ea313b-a785-4c5b-bf86-cf93a0bb5f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:01.583521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea313b-a785-4c5b-bf86-cf93a0bb5f74 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:01.597190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80416555-8737-4542-a5c8-27d26bd0a3be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:01.598243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416555-8737-4542-a5c8-27d26bd0a3be service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:01.600469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416555-8737-4542-a5c8-27d26bd0a3be service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:01.601055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416555-8737-4542-a5c8-27d26bd0a3be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:01.621632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80416555-8737-4542-a5c8-27d26bd0a3be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:01.623807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80416555-8737-4542-a5c8-27d26bd0a3be service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:01.642313 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2398/4813] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:40:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:40:01.894870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82970fb-bbaa-4ff1-9fff-a5ad1ca83648 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:01.896854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f82970fb-bbaa-4ff1-9fff-a5ad1ca83648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:01.969747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80416555-8737-4542-a5c8-27d26bd0a3be service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:01.971279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-80416555-8737-4542-a5c8-27d26bd0a3be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:01.991188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80416555-8737-4542-a5c8-27d26bd0a3be service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:02.002633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82970fb-bbaa-4ff1-9fff-a5ad1ca83648 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:02.011958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e256a-e401-47ef-b308-8e30b16eda51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:02.012972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e256a-e401-47ef-b308-8e30b16eda51 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:02.013459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e256a-e401-47ef-b308-8e30b16eda51 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:02.014170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e256a-e401-47ef-b308-8e30b16eda51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:02.016786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380235f-b264-4bab-8e3e-15d3be4b137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:02.017628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380235f-b264-4bab-8e3e-15d3be4b137c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:02.017755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-710e256a-e401-47ef-b308-8e30b16eda51 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:02.018312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380235f-b264-4bab-8e3e-15d3be4b137c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:02.018753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380235f-b264-4bab-8e3e-15d3be4b137c admin admin] PATH_INFO: `/v3/projects/fd7348849b3b4231b11c26b6d44848fe` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:02.022188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380235f-b264-4bab-8e3e-15d3be4b137c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7348849b3b4231b11c26b6d44848fe)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:02.029871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380235f-b264-4bab-8e3e-15d3be4b137c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:02.093274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:02.141532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4380235f-b264-4bab-8e3e-15d3be4b137c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7348849b3b4231b11c26b6d44848fe', 'request_id': 'req-4380235f-b264-4bab-8e3e-15d3be4b137c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:02.154356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4380235f-b264-4bab-8e3e-15d3be4b137c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7348849b3b4231b11c26b6d44848fe', 'request_id': 'req-4380235f-b264-4bab-8e3e-15d3be4b137c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:02.169364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4380235f-b264-4bab-8e3e-15d3be4b137c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7348849b3b4231b11c26b6d44848fe', 'request_id': 'req-4380235f-b264-4bab-8e3e-15d3be4b137c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:02.187701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e256a-e401-47ef-b308-8e30b16eda51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:02.189239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e256a-e401-47ef-b308-8e30b16eda51 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:02.189714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4380235f-b264-4bab-8e3e-15d3be4b137c admin admin] The token cache is being invalidate because project fd7348849b3b4231b11c26b6d44848fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:40:02.190117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4380235f-b264-4bab-8e3e-15d3be4b137c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:02.190990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4380235f-b264-4bab-8e3e-15d3be4b137c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:02.195333 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2399/4814] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:40:01 2022] DELETE /identity/v3/projects/fd7348849b3b4231b11c26b6d44848fe => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:02.200673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913c9d6-b457-42dc-85ff-f6853223f347 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:02.201211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913c9d6-b457-42dc-85ff-f6853223f347 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:02.201642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913c9d6-b457-42dc-85ff-f6853223f347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:02.208677 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2416/4815] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:40:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:40:02.225150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3913c9d6-b457-42dc-85ff-f6853223f347 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:02.226963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3913c9d6-b457-42dc-85ff-f6853223f347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:02.323294 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2400/4816] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:02.329713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e256a-e401-47ef-b308-8e30b16eda51 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:02.331460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-710e256a-e401-47ef-b308-8e30b16eda51 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:02.333319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c811954-31ef-486b-b377-c67e2a755c10 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:02.333737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c811954-31ef-486b-b377-c67e2a755c10 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:02.335870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c811954-31ef-486b-b377-c67e2a755c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:02.346319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e256a-e401-47ef-b308-8e30b16eda51 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:02.384039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4c811954-31ef-486b-b377-c67e2a755c10 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:02.386821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4c811954-31ef-486b-b377-c67e2a755c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:02.396563 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2401/4817] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:02.401054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c811954-31ef-486b-b377-c67e2a755c10 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:02.414192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c811954-31ef-486b-b377-c67e2a755c10 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:02.420259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fcb62-7692-45ee-aa54-48a27f532563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:02.420968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fcb62-7692-45ee-aa54-48a27f532563 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:02.421321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fcb62-7692-45ee-aa54-48a27f532563 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:02.422048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fcb62-7692-45ee-aa54-48a27f532563 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:02.422913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:02.423391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fcb62-7692-45ee-aa54-48a27f532563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:02.423391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fcb62-7692-45ee-aa54-48a27f532563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:02.425088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fcb62-7692-45ee-aa54-48a27f532563 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:02.436733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee5ef4-0ca6-4e4e-8729-5eb14e0fdeef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:02.437367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee5ef4-0ca6-4e4e-8729-5eb14e0fdeef service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:02.437649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee5ef4-0ca6-4e4e-8729-5eb14e0fdeef service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:02.437922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee5ef4-0ca6-4e4e-8729-5eb14e0fdeef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:02.440320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3eee5ef4-0ca6-4e4e-8729-5eb14e0fdeef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:02.445790 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2402/4818] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:02.446811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fcb62-7692-45ee-aa54-48a27f532563 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:02.459224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fcb62-7692-45ee-aa54-48a27f532563 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:02.465098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb043833-faf6-4647-90a9-8bf778de6dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:02.465741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb043833-faf6-4647-90a9-8bf778de6dba admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:02.466363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee5ef4-0ca6-4e4e-8729-5eb14e0fdeef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:02.467240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb043833-faf6-4647-90a9-8bf778de6dba admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:02.467587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb043833-faf6-4647-90a9-8bf778de6dba admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:02.468711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb043833-faf6-4647-90a9-8bf778de6dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:02.469256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee5ef4-0ca6-4e4e-8729-5eb14e0fdeef service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:02.470764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb043833-faf6-4647-90a9-8bf778de6dba admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:02.481764 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2417/4819] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:40:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:40:02.505347 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2403/4820] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:40:02 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:40:02.510388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee5ef4-0ca6-4e4e-8729-5eb14e0fdeef service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:02.523821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee5ef4-0ca6-4e4e-8729-5eb14e0fdeef service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:02.587103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1f33a-56bd-4da6-bbd7-ee17e349e218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:02.588313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1f33a-56bd-4da6-bbd7-ee17e349e218 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:02.588661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1f33a-56bd-4da6-bbd7-ee17e349e218 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:02.589110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1f33a-56bd-4da6-bbd7-ee17e349e218 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:02.589901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1f33a-56bd-4da6-bbd7-ee17e349e218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:02.592545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1f33a-56bd-4da6-bbd7-ee17e349e218 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:02.654412 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2418/4821] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:40:02 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:40:02.659086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb043833-faf6-4647-90a9-8bf778de6dba admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:02.677567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb043833-faf6-4647-90a9-8bf778de6dba admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:02.685704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000231f-a9c4-4301-bac5-b9c5d8f72b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:02.685704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000231f-a9c4-4301-bac5-b9c5d8f72b18 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:02.685704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000231f-a9c4-4301-bac5-b9c5d8f72b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:02.685704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000231f-a9c4-4301-bac5-b9c5d8f72b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:02.686384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000231f-a9c4-4301-bac5-b9c5d8f72b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:02.687599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000231f-a9c4-4301-bac5-b9c5d8f72b18 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:02.701583 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2404/4822] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:40:02.705332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1f33a-56bd-4da6-bbd7-ee17e349e218 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:02.717387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1f33a-56bd-4da6-bbd7-ee17e349e218 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:02.722977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6a3c8-f821-49a8-a35d-61c9114d9101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:02.723956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6a3c8-f821-49a8-a35d-61c9114d9101 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:02.724542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6a3c8-f821-49a8-a35d-61c9114d9101 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:02.724924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6a3c8-f821-49a8-a35d-61c9114d9101 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:02.725700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6a3c8-f821-49a8-a35d-61c9114d9101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:02.727606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6a3c8-f821-49a8-a35d-61c9114d9101 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:02.741085 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2419/4823] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:40:02.745474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000231f-a9c4-4301-bac5-b9c5d8f72b18 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:02.765287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000231f-a9c4-4301-bac5-b9c5d8f72b18 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:02.782267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81999d-3e6c-4713-bfec-09de85b0af13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:02.782968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81999d-3e6c-4713-bfec-09de85b0af13 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:02.783286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81999d-3e6c-4713-bfec-09de85b0af13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:02.783600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81999d-3e6c-4713-bfec-09de85b0af13 admin admin] PATH_INFO: `/v3/projects/cde9afaca5c34b4b9aaa774bbc9068e0/users/b979403314cb4e32b5b310c4a0e78dfa/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:02.810029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81999d-3e6c-4713-bfec-09de85b0af13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde9afaca5c34b4b9aaa774bbc9068e0, user_id=b979403314cb4e32b5b310c4a0e78dfa, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:02.813079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81999d-3e6c-4713-bfec-09de85b0af13 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:02.842668 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2405/4824] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:40:02 2022] PUT /identity/v3/projects/cde9afaca5c34b4b9aaa774bbc9068e0/users/b979403314cb4e32b5b310c4a0e78dfa/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:02.854702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c481855-e96d-4a91-8d2b-2d574de68497 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:02.855082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c481855-e96d-4a91-8d2b-2d574de68497 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:02.855439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c481855-e96d-4a91-8d2b-2d574de68497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:02.887824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1c481855-e96d-4a91-8d2b-2d574de68497 None None] MFA Rules not processed for user `b979403314cb4e32b5b310c4a0e78dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:02.889186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c481855-e96d-4a91-8d2b-2d574de68497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:02.985616 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2420/4825] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:02.987016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81999d-3e6c-4713-bfec-09de85b0af13 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:03.031997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:03.089884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81999d-3e6c-4713-bfec-09de85b0af13 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:03.096476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2332760-f8ed-442a-b62e-672f5cdfcde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:03.097229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2332760-f8ed-442a-b62e-672f5cdfcde2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:03.097603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2332760-f8ed-442a-b62e-672f5cdfcde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:03.097969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2332760-f8ed-442a-b62e-672f5cdfcde2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:03.098722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2332760-f8ed-442a-b62e-672f5cdfcde2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:03.101843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2332760-f8ed-442a-b62e-672f5cdfcde2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:03.152419 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2406/4826] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:40:02 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:03.156398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c481855-e96d-4a91-8d2b-2d574de68497 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:03.170615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c481855-e96d-4a91-8d2b-2d574de68497 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:03.234497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:03.269802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfe5f3-d798-4344-9a5d-6695b3549bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:03.281692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfe5f3-d798-4344-9a5d-6695b3549bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:03.284311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfe5f3-d798-4344-9a5d-6695b3549bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:03.284627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfe5f3-d798-4344-9a5d-6695b3549bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:03.285312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfe5f3-d798-4344-9a5d-6695b3549bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:03.302873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfe5f3-d798-4344-9a5d-6695b3549bc1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:03.366176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2332760-f8ed-442a-b62e-672f5cdfcde2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:03.366468 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2421/4827] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:40:03 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:03.382021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2332760-f8ed-442a-b62e-672f5cdfcde2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:03.399775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7072e-4e68-4a51-9fc9-743f938720ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:03.404084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7072e-4e68-4a51-9fc9-743f938720ed admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:03.404613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7072e-4e68-4a51-9fc9-743f938720ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:03.405083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7072e-4e68-4a51-9fc9-743f938720ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:03.406768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7072e-4e68-4a51-9fc9-743f938720ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:03.413537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7072e-4e68-4a51-9fc9-743f938720ed admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:03.429824 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2407/4828] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:40:03.434497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfe5f3-d798-4344-9a5d-6695b3549bc1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:03.448530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfe5f3-d798-4344-9a5d-6695b3549bc1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:03.456685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edcec0-a123-4fe6-886c-4218fe37351e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:03.458858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edcec0-a123-4fe6-886c-4218fe37351e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:03.459833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edcec0-a123-4fe6-886c-4218fe37351e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:03.460880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edcec0-a123-4fe6-886c-4218fe37351e admin admin] PATH_INFO: `/v3/projects/b4ccb894da134fc29412c3349edc6602/users/0de9e1156d984369a00453fc871874bc/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:03.501351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edcec0-a123-4fe6-886c-4218fe37351e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ccb894da134fc29412c3349edc6602, user_id=0de9e1156d984369a00453fc871874bc, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:03.514267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edcec0-a123-4fe6-886c-4218fe37351e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:03.536216 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2422/4829] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:40:03 2022] PUT /identity/v3/projects/b4ccb894da134fc29412c3349edc6602/users/0de9e1156d984369a00453fc871874bc/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:03.540456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7072e-4e68-4a51-9fc9-743f938720ed admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:03.552693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7072e-4e68-4a51-9fc9-743f938720ed admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:03.632593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05951cfa-0c3d-4bfb-94c5-dcdc71a0991f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:03.633218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951cfa-0c3d-4bfb-94c5-dcdc71a0991f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:03.633597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951cfa-0c3d-4bfb-94c5-dcdc71a0991f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:03.633874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951cfa-0c3d-4bfb-94c5-dcdc71a0991f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:03.634525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05951cfa-0c3d-4bfb-94c5-dcdc71a0991f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:03.636588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05951cfa-0c3d-4bfb-94c5-dcdc71a0991f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:03.649575 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2408/4830] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:40:03.654448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edcec0-a123-4fe6-886c-4218fe37351e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:03.666803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edcec0-a123-4fe6-886c-4218fe37351e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:03.675155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ef040-49b7-48cf-9542-c4b28ebabeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:03.676491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ef040-49b7-48cf-9542-c4b28ebabeaa admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:03.676833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ef040-49b7-48cf-9542-c4b28ebabeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:03.677205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ef040-49b7-48cf-9542-c4b28ebabeaa admin admin] PATH_INFO: `/v3/projects/b4ccb894da134fc29412c3349edc6602/users/0de9e1156d984369a00453fc871874bc/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:03.679521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ef040-49b7-48cf-9542-c4b28ebabeaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ccb894da134fc29412c3349edc6602, user_id=0de9e1156d984369a00453fc871874bc, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:03.682463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ef040-49b7-48cf-9542-c4b28ebabeaa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:03.699303 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2423/4831] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:40:03 2022] PUT /identity/v3/projects/b4ccb894da134fc29412c3349edc6602/users/0de9e1156d984369a00453fc871874bc/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:03.706947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73258e49-c979-45d8-81b6-806f6c2fda0b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:03.707291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73258e49-c979-45d8-81b6-806f6c2fda0b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:03.707551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73258e49-c979-45d8-81b6-806f6c2fda0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:03.763060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-73258e49-c979-45d8-81b6-806f6c2fda0b None None] MFA Rules not processed for user `0de9e1156d984369a00453fc871874bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:03.764693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-73258e49-c979-45d8-81b6-806f6c2fda0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:03.869332 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2409/4832] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:03.877091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ef040-49b7-48cf-9542-c4b28ebabeaa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:03.879057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8c7ef040-49b7-48cf-9542-c4b28ebabeaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:03.949024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ef040-49b7-48cf-9542-c4b28ebabeaa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:03.953621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93a0cd-6a7c-486b-b936-5051d66cf70d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:03.954351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93a0cd-6a7c-486b-b936-5051d66cf70d service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:03.954630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93a0cd-6a7c-486b-b936-5051d66cf70d service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:03.954929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93a0cd-6a7c-486b-b936-5051d66cf70d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:03.965877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93a0cd-6a7c-486b-b936-5051d66cf70d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:03.967378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93a0cd-6a7c-486b-b936-5051d66cf70d service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:03.977686 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2424/4833] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:40:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:40:04.081802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73258e49-c979-45d8-81b6-806f6c2fda0b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:04.094603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73258e49-c979-45d8-81b6-806f6c2fda0b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:04.100951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff4e05-1610-454c-928e-998522fe8e69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:04.101672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff4e05-1610-454c-928e-998522fe8e69 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:04.102046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff4e05-1610-454c-928e-998522fe8e69 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:04.102390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff4e05-1610-454c-928e-998522fe8e69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:04.127848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:04.167575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff4e05-1610-454c-928e-998522fe8e69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:04.169024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff4e05-1610-454c-928e-998522fe8e69 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:04.178208 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2410/4834] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:40:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:40:11.817079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdecfc-7d16-4958-8a3a-f7375e81f3e6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:11.817633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdecfc-7d16-4958-8a3a-f7375e81f3e6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:11.817734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdecfc-7d16-4958-8a3a-f7375e81f3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:11.977257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-55fdecfc-7d16-4958-8a3a-f7375e81f3e6 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:11.984259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-55fdecfc-7d16-4958-8a3a-f7375e81f3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:12.117010 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2425/4835] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:40:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:12.130651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff4e05-1610-454c-928e-998522fe8e69 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:12.133675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3eff4e05-1610-454c-928e-998522fe8e69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:12.365694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff4e05-1610-454c-928e-998522fe8e69 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:12.375101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb605861-8b8f-4908-b3d4-6caa132494a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:12.376275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb605861-8b8f-4908-b3d4-6caa132494a0 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:12.376832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb605861-8b8f-4908-b3d4-6caa132494a0 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:12.377400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb605861-8b8f-4908-b3d4-6caa132494a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:12.392283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb605861-8b8f-4908-b3d4-6caa132494a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:12.394434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb605861-8b8f-4908-b3d4-6caa132494a0 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:12.405425 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2411/4836] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:40:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:40:21.670300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdecfc-7d16-4958-8a3a-f7375e81f3e6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:21.672577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-55fdecfc-7d16-4958-8a3a-f7375e81f3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:21.802882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:21.896180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdecfc-7d16-4958-8a3a-f7375e81f3e6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:21.900407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f569b-ee01-400d-9080-7e7a6d8bd6a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:21.901316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f569b-ee01-400d-9080-7e7a6d8bd6a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:21.901781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f569b-ee01-400d-9080-7e7a6d8bd6a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:21.902235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f569b-ee01-400d-9080-7e7a6d8bd6a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:21.906085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-529f569b-ee01-400d-9080-7e7a6d8bd6a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:22.035314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f569b-ee01-400d-9080-7e7a6d8bd6a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:22.037262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f569b-ee01-400d-9080-7e7a6d8bd6a0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:22.073729 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2426/4837] 10.222.0.27 () {60 vars in 1396 bytes} [Sun Aug 28 18:40:21 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:40:22.400463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=54 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:32.052433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=36 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:36.971378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb605861-8b8f-4908-b3d4-6caa132494a0 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:36.973207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eb605861-8b8f-4908-b3d4-6caa132494a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:37.152173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb605861-8b8f-4908-b3d4-6caa132494a0 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:37.157926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ace0e-d0cd-4541-854c-7fc75922f149 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:37.158560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ace0e-d0cd-4541-854c-7fc75922f149 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:37.158889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ace0e-d0cd-4541-854c-7fc75922f149 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:37.159297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ace0e-d0cd-4541-854c-7fc75922f149 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:37.161220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cf2ace0e-d0cd-4541-854c-7fc75922f149 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:37.175998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ace0e-d0cd-4541-854c-7fc75922f149 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:37.177832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ace0e-d0cd-4541-854c-7fc75922f149 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:37.192146 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2412/4838] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:40:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:40:37.964406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fab65c-1e0c-415f-b05b-f55474d07e39 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:37.964925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fab65c-1e0c-415f-b05b-f55474d07e39 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:37.964925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fab65c-1e0c-415f-b05b-f55474d07e39 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:37.966314 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2427/4839] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:40:37.972717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d841c4d-603d-4b3c-9a67-f7a7ad451994 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:37.973680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d841c4d-603d-4b3c-9a67-f7a7ad451994 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:37.974145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d841c4d-603d-4b3c-9a67-f7a7ad451994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:37.999650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1d841c4d-603d-4b3c-9a67-f7a7ad451994 None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:38.001620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d841c4d-603d-4b3c-9a67-f7a7ad451994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:38.013942 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2413/4840] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:40:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:38.026056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fab65c-1e0c-415f-b05b-f55474d07e39 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:38.027928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68fab65c-1e0c-415f-b05b-f55474d07e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:38.043111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fab65c-1e0c-415f-b05b-f55474d07e39 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:38.047968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6e88b-1faa-4c87-b119-24461c244a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:38.049073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6e88b-1faa-4c87-b119-24461c244a58 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:38.049512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6e88b-1faa-4c87-b119-24461c244a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:38.050154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6e88b-1faa-4c87-b119-24461c244a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:38.069031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6e88b-1faa-4c87-b119-24461c244a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:38.070895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6e88b-1faa-4c87-b119-24461c244a58 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:38.100675 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2428/4841] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:40:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:40:39.519723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbe8f3-8b51-4f4c-b767-b6ed8dcfb609 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:39.520271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbe8f3-8b51-4f4c-b767-b6ed8dcfb609 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:39.520546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbe8f3-8b51-4f4c-b767-b6ed8dcfb609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:39.576115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-99bbe8f3-8b51-4f4c-b767-b6ed8dcfb609 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:39.577598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-99bbe8f3-8b51-4f4c-b767-b6ed8dcfb609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:39.602116 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2414/4842] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:40:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:39.624393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6e88b-1faa-4c87-b119-24461c244a58 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:39.654175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6e88b-1faa-4c87-b119-24461c244a58 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:39.659795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a08b72-8341-4663-872e-5810451c7bcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:39.660552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a08b72-8341-4663-872e-5810451c7bcc service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:39.661071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a08b72-8341-4663-872e-5810451c7bcc service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:39.661637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a08b72-8341-4663-872e-5810451c7bcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:39.672356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a08b72-8341-4663-872e-5810451c7bcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:39.674248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a08b72-8341-4663-872e-5810451c7bcc service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:39.705679 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2429/4843] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:40:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 18:40:40.840640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbe8f3-8b51-4f4c-b767-b6ed8dcfb609 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:40.842852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-99bbe8f3-8b51-4f4c-b767-b6ed8dcfb609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:40.847797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a08b72-8341-4663-872e-5810451c7bcc service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:40.849171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9a08b72-8341-4663-872e-5810451c7bcc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:40.976911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a08b72-8341-4663-872e-5810451c7bcc service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:40.983555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1214e69-6fb3-428b-b042-d274e13f87e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:40.984561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1214e69-6fb3-428b-b042-d274e13f87e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:40.985000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1214e69-6fb3-428b-b042-d274e13f87e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:40.985409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1214e69-6fb3-428b-b042-d274e13f87e4 admin admin] PATH_INFO: `/v3/users/deeaf393aa314b13819887730641a8af` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:40.986867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1214e69-6fb3-428b-b042-d274e13f87e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deeaf393aa314b13819887730641a8af)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:40.988638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbe8f3-8b51-4f4c-b767-b6ed8dcfb609 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:40.989583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1214e69-6fb3-428b-b042-d274e13f87e4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:40.998508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d322-fded-48b0-b02d-962e3d317e72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:41.001710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d322-fded-48b0-b02d-962e3d317e72 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:41.002584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d322-fded-48b0-b02d-962e3d317e72 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:41.003019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d322-fded-48b0-b02d-962e3d317e72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:41.005259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3b38d322-fded-48b0-b02d-962e3d317e72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:41.036143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d322-fded-48b0-b02d-962e3d317e72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:41.037892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d322-fded-48b0-b02d-962e3d317e72 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:41.050018 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2415/4844] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:40:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:40:41.051178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d322-fded-48b0-b02d-962e3d317e72 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:41.065732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d322-fded-48b0-b02d-962e3d317e72 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:41.066401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d1214e69-6fb3-428b-b042-d274e13f87e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deeaf393aa314b13819887730641a8af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:41.067763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d1214e69-6fb3-428b-b042-d274e13f87e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deeaf393aa314b13819887730641a8af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:41.070667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565e8c3-27e0-4b22-a56c-e8d28c73ef42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:41.071316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565e8c3-27e0-4b22-a56c-e8d28c73ef42 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:41.071934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565e8c3-27e0-4b22-a56c-e8d28c73ef42 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:41.072218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565e8c3-27e0-4b22-a56c-e8d28c73ef42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:41.074550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d565e8c3-27e0-4b22-a56c-e8d28c73ef42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:41.079332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d1214e69-6fb3-428b-b042-d274e13f87e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deeaf393aa314b13819887730641a8af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:41.096814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d1214e69-6fb3-428b-b042-d274e13f87e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deeaf393aa314b13819887730641a8af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:41.097020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565e8c3-27e0-4b22-a56c-e8d28c73ef42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:41.100187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565e8c3-27e0-4b22-a56c-e8d28c73ef42 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:41.114363 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2416/4845] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:40:41.124049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d1214e69-6fb3-428b-b042-d274e13f87e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deeaf393aa314b13819887730641a8af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:41.135936 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2430/4846] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:40:40 2022] DELETE /identity/v3/users/deeaf393aa314b13819887730641a8af => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:40:41.142340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadad330-cde0-423c-b655-f57e83667373 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:41.142632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadad330-cde0-423c-b655-f57e83667373 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:41.142906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadad330-cde0-423c-b655-f57e83667373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:41.165975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-aadad330-cde0-423c-b655-f57e83667373 None None] MFA Rules not processed for user `a4a0713f4bfc4b1fb99f4afe849b042d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:41.167432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aadad330-cde0-423c-b655-f57e83667373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:41.243281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:41.260315 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2417/4847] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:41.609236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1214e69-6fb3-428b-b042-d274e13f87e4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:41.610675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d1214e69-6fb3-428b-b042-d274e13f87e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:41.677040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:41.692202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1214e69-6fb3-428b-b042-d274e13f87e4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:41.705808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd709caa-526d-40e5-b73a-c47564dda685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:41.706496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd709caa-526d-40e5-b73a-c47564dda685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:41.706771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd709caa-526d-40e5-b73a-c47564dda685 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:41.707040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd709caa-526d-40e5-b73a-c47564dda685 admin admin] PATH_INFO: `/v3/projects/412e246f78c545028e42fedc2584387b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:41.708285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd709caa-526d-40e5-b73a-c47564dda685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=412e246f78c545028e42fedc2584387b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:41.710315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd709caa-526d-40e5-b73a-c47564dda685 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:41.785052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd709caa-526d-40e5-b73a-c47564dda685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '412e246f78c545028e42fedc2584387b', 'request_id': 'req-cd709caa-526d-40e5-b73a-c47564dda685'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:41.795221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd709caa-526d-40e5-b73a-c47564dda685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '412e246f78c545028e42fedc2584387b', 'request_id': 'req-cd709caa-526d-40e5-b73a-c47564dda685'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:41.803772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd709caa-526d-40e5-b73a-c47564dda685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '412e246f78c545028e42fedc2584387b', 'request_id': 'req-cd709caa-526d-40e5-b73a-c47564dda685'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:41.818748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd709caa-526d-40e5-b73a-c47564dda685 admin admin] The token cache is being invalidate because project 412e246f78c545028e42fedc2584387b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:40:41.819128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd709caa-526d-40e5-b73a-c47564dda685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:41.820105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd709caa-526d-40e5-b73a-c47564dda685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:41.822499 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2431/4848] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:40:41 2022] DELETE /identity/v3/projects/412e246f78c545028e42fedc2584387b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:41.827822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba663e-1a8e-43aa-a8e6-a70e72d5c16f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:41.828091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba663e-1a8e-43aa-a8e6-a70e72d5c16f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:41.828373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba663e-1a8e-43aa-a8e6-a70e72d5c16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:41.868512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e0ba663e-1a8e-43aa-a8e6-a70e72d5c16f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:41.869895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e0ba663e-1a8e-43aa-a8e6-a70e72d5c16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:41.952083 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2418/4849] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:41.960001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8fb69-67e4-4298-b2cd-14f3b88bbdbd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:41.960498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8fb69-67e4-4298-b2cd-14f3b88bbdbd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:41.960579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8fb69-67e4-4298-b2cd-14f3b88bbdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:41.981872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-69a8fb69-67e4-4298-b2cd-14f3b88bbdbd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:41.982981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-69a8fb69-67e4-4298-b2cd-14f3b88bbdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:41.998419 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2432/4850] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:42.000122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba663e-1a8e-43aa-a8e6-a70e72d5c16f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:42.011797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba663e-1a8e-43aa-a8e6-a70e72d5c16f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:42.017105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ac52f-df75-476c-89f9-fd53915a1655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:42.017969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ac52f-df75-476c-89f9-fd53915a1655 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:42.018525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ac52f-df75-476c-89f9-fd53915a1655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:42.018990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ac52f-df75-476c-89f9-fd53915a1655 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:42.019904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ac52f-df75-476c-89f9-fd53915a1655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:42.020377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ac52f-df75-476c-89f9-fd53915a1655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:42.022135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ac52f-df75-476c-89f9-fd53915a1655 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:42.037018 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2419/4851] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:40:42.042332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8fb69-67e4-4298-b2cd-14f3b88bbdbd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:42.055341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8fb69-67e4-4298-b2cd-14f3b88bbdbd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:42.063992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bb84b-fb15-4f2b-bcfa-491ba53c6f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:42.064633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bb84b-fb15-4f2b-bcfa-491ba53c6f21 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:42.064911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bb84b-fb15-4f2b-bcfa-491ba53c6f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:42.066214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bb84b-fb15-4f2b-bcfa-491ba53c6f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:42.066869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bb84b-fb15-4f2b-bcfa-491ba53c6f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:42.068828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bb84b-fb15-4f2b-bcfa-491ba53c6f21 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:42.128333 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2433/4852] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:40:42 2022] POST /identity/v3/projects => generated 397 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:42.131058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ac52f-df75-476c-89f9-fd53915a1655 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:42.143149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ac52f-df75-476c-89f9-fd53915a1655 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:42.223934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864c013-1c60-4e7b-b7c4-e4298c45b557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:42.225266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864c013-1c60-4e7b-b7c4-e4298c45b557 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:42.225587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864c013-1c60-4e7b-b7c4-e4298c45b557 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:42.225864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864c013-1c60-4e7b-b7c4-e4298c45b557 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:42.237858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864c013-1c60-4e7b-b7c4-e4298c45b557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:42.242384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864c013-1c60-4e7b-b7c4-e4298c45b557 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:42.307521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bb84b-fb15-4f2b-bcfa-491ba53c6f21 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:42.308379 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2420/4853] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:40:42 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:42.324583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bb84b-fb15-4f2b-bcfa-491ba53c6f21 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:42.332610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901be57d-b8be-4f80-a383-3f3cb504bb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:42.333515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901be57d-b8be-4f80-a383-3f3cb504bb6f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:42.333958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901be57d-b8be-4f80-a383-3f3cb504bb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:42.334377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901be57d-b8be-4f80-a383-3f3cb504bb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:42.335350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901be57d-b8be-4f80-a383-3f3cb504bb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:42.337766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901be57d-b8be-4f80-a383-3f3cb504bb6f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:42.353107 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2434/4854] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:40:42.354220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864c013-1c60-4e7b-b7c4-e4298c45b557 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:42.376796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864c013-1c60-4e7b-b7c4-e4298c45b557 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:42.382792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaf70c-f8d2-4588-aeae-3bcb22bf69c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:42.386311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaf70c-f8d2-4588-aeae-3bcb22bf69c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:42.386720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaf70c-f8d2-4588-aeae-3bcb22bf69c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:42.387470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaf70c-f8d2-4588-aeae-3bcb22bf69c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:42.388254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffaf70c-f8d2-4588-aeae-3bcb22bf69c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:42.390133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffaf70c-f8d2-4588-aeae-3bcb22bf69c2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:42.410590 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2421/4855] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:40:42.411049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901be57d-b8be-4f80-a383-3f3cb504bb6f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:42.421720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901be57d-b8be-4f80-a383-3f3cb504bb6f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:42.426696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094292f9-baa7-460f-ba26-69082fd37a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:42.427516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094292f9-baa7-460f-ba26-69082fd37a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:42.427668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094292f9-baa7-460f-ba26-69082fd37a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:42.428090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094292f9-baa7-460f-ba26-69082fd37a62 admin admin] PATH_INFO: `/v3/projects/c1ede0159a014724813256923c66934b/users/a0dc654f9722414ba8b83d73e874409d/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:42.450506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094292f9-baa7-460f-ba26-69082fd37a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ede0159a014724813256923c66934b, user_id=a0dc654f9722414ba8b83d73e874409d, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:42.454366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094292f9-baa7-460f-ba26-69082fd37a62 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:42.478078 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2435/4856] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:40:42 2022] PUT /identity/v3/projects/c1ede0159a014724813256923c66934b/users/a0dc654f9722414ba8b83d73e874409d/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:42.489029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726f67e-bebb-4a37-9b28-ba6d3abd5a38 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:42.490880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726f67e-bebb-4a37-9b28-ba6d3abd5a38 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:42.491159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726f67e-bebb-4a37-9b28-ba6d3abd5a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:42.557716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a726f67e-bebb-4a37-9b28-ba6d3abd5a38 None None] MFA Rules not processed for user `a0dc654f9722414ba8b83d73e874409d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:42.565379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a726f67e-bebb-4a37-9b28-ba6d3abd5a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:42.658195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:42.694539 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2422/4857] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:42.706524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094292f9-baa7-460f-ba26-69082fd37a62 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:42.708570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-094292f9-baa7-460f-ba26-69082fd37a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:42.796132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094292f9-baa7-460f-ba26-69082fd37a62 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:42.803669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80ebb1-1dbb-41d4-bd67-e1f11b2d5c22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:42.804301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80ebb1-1dbb-41d4-bd67-e1f11b2d5c22 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:42.804576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80ebb1-1dbb-41d4-bd67-e1f11b2d5c22 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:42.804936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80ebb1-1dbb-41d4-bd67-e1f11b2d5c22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:42.819275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80ebb1-1dbb-41d4-bd67-e1f11b2d5c22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:42.823970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80ebb1-1dbb-41d4-bd67-e1f11b2d5c22 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:42.836211 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2436/4858] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:40:42 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:40:43.148395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726f67e-bebb-4a37-9b28-ba6d3abd5a38 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:43.235107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726f67e-bebb-4a37-9b28-ba6d3abd5a38 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:43.240243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b8c4d-a469-4d38-b6b4-a25fc6f969a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:43.241195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b8c4d-a469-4d38-b6b4-a25fc6f969a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:43.241704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b8c4d-a469-4d38-b6b4-a25fc6f969a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:43.242391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b8c4d-a469-4d38-b6b4-a25fc6f969a9 admin admin] PATH_INFO: `/v3/users/a0dc654f9722414ba8b83d73e874409d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:43.244283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b8c4d-a469-4d38-b6b4-a25fc6f969a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0dc654f9722414ba8b83d73e874409d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:43.246538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b8c4d-a469-4d38-b6b4-a25fc6f969a9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:43.321085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-111b8c4d-a469-4d38-b6b4-a25fc6f969a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0dc654f9722414ba8b83d73e874409d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:43.336591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-111b8c4d-a469-4d38-b6b4-a25fc6f969a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0dc654f9722414ba8b83d73e874409d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:43.337511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-111b8c4d-a469-4d38-b6b4-a25fc6f969a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0dc654f9722414ba8b83d73e874409d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:43.338255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-111b8c4d-a469-4d38-b6b4-a25fc6f969a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0dc654f9722414ba8b83d73e874409d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:43.350037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-111b8c4d-a469-4d38-b6b4-a25fc6f969a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0dc654f9722414ba8b83d73e874409d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:43.368141 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2423/4859] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:40:43 2022] DELETE /identity/v3/users/a0dc654f9722414ba8b83d73e874409d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:43.372763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a076ce9-18db-4388-9221-a1a3ee59c642 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:43.373277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a076ce9-18db-4388-9221-a1a3ee59c642 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:43.373375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a076ce9-18db-4388-9221-a1a3ee59c642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:43.384979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:43.400454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6a076ce9-18db-4388-9221-a1a3ee59c642 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:43.403402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a076ce9-18db-4388-9221-a1a3ee59c642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:43.507603 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2437/4860] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:43.517727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b8c4d-a469-4d38-b6b4-a25fc6f969a9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:43.519552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-111b8c4d-a469-4d38-b6b4-a25fc6f969a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:43.584903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b8c4d-a469-4d38-b6b4-a25fc6f969a9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:43.590196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6b499-c8e6-4801-a496-adfead8064b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:43.594312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6b499-c8e6-4801-a496-adfead8064b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:43.594629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6b499-c8e6-4801-a496-adfead8064b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:43.594905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6b499-c8e6-4801-a496-adfead8064b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:43.614569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6b499-c8e6-4801-a496-adfead8064b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:43.619758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6b499-c8e6-4801-a496-adfead8064b4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:43.634540 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2424/4861] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:40:44.476330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a076ce9-18db-4388-9221-a1a3ee59c642 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:44.477916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a076ce9-18db-4388-9221-a1a3ee59c642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:44.490326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a076ce9-18db-4388-9221-a1a3ee59c642 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:44.495139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba60258-b5c4-4a7f-b6b8-3445c4db85d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:44.497089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba60258-b5c4-4a7f-b6b8-3445c4db85d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:44.497089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba60258-b5c4-4a7f-b6b8-3445c4db85d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:44.497089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba60258-b5c4-4a7f-b6b8-3445c4db85d6 admin admin] PATH_INFO: `/v3/projects/c1ede0159a014724813256923c66934b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:44.497459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba60258-b5c4-4a7f-b6b8-3445c4db85d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ede0159a014724813256923c66934b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:44.499781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba60258-b5c4-4a7f-b6b8-3445c4db85d6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:44.588462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3ba60258-b5c4-4a7f-b6b8-3445c4db85d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ede0159a014724813256923c66934b', 'request_id': 'req-3ba60258-b5c4-4a7f-b6b8-3445c4db85d6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:44.601949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3ba60258-b5c4-4a7f-b6b8-3445c4db85d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ede0159a014724813256923c66934b', 'request_id': 'req-3ba60258-b5c4-4a7f-b6b8-3445c4db85d6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:44.635479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3ba60258-b5c4-4a7f-b6b8-3445c4db85d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ede0159a014724813256923c66934b', 'request_id': 'req-3ba60258-b5c4-4a7f-b6b8-3445c4db85d6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:44.649045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3ba60258-b5c4-4a7f-b6b8-3445c4db85d6 admin admin] The token cache is being invalidate because project c1ede0159a014724813256923c66934b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:40:44.649387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3ba60258-b5c4-4a7f-b6b8-3445c4db85d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:44.650232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3ba60258-b5c4-4a7f-b6b8-3445c4db85d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:44.652266 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2438/4862] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:40:44 2022] DELETE /identity/v3/projects/c1ede0159a014724813256923c66934b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:44.656991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0511f-e9e7-4e44-b95e-468326553c0d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:44.657735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0511f-e9e7-4e44-b95e-468326553c0d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:44.658030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0511f-e9e7-4e44-b95e-468326553c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:44.682521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bab0511f-e9e7-4e44-b95e-468326553c0d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:44.684490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bab0511f-e9e7-4e44-b95e-468326553c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:44.691389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:44.769033 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2425/4863] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:40:44.777190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503090e-9611-40b1-9b2f-e4405325ad90 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:44.777809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503090e-9611-40b1-9b2f-e4405325ad90 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:44.778270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503090e-9611-40b1-9b2f-e4405325ad90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:44.816387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d503090e-9611-40b1-9b2f-e4405325ad90 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:44.817730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d503090e-9611-40b1-9b2f-e4405325ad90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:44.827248 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2439/4864] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:44.831195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0511f-e9e7-4e44-b95e-468326553c0d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:44.845586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0511f-e9e7-4e44-b95e-468326553c0d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:44.858441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba2b35-3089-4c61-a9b1-ec64333610be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:44.859134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2b35-3089-4c61-a9b1-ec64333610be admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:44.859505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2b35-3089-4c61-a9b1-ec64333610be admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:44.859684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2b35-3089-4c61-a9b1-ec64333610be admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:44.860373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba2b35-3089-4c61-a9b1-ec64333610be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:44.860680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba2b35-3089-4c61-a9b1-ec64333610be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:44.872824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba2b35-3089-4c61-a9b1-ec64333610be admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:44.897509 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2426/4865] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:44.902126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503090e-9611-40b1-9b2f-e4405325ad90 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:44.916391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503090e-9611-40b1-9b2f-e4405325ad90 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:44.922828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0ba29-52f4-4d50-89fb-a601f5d66b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:44.924081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0ba29-52f4-4d50-89fb-a601f5d66b34 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:44.924370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0ba29-52f4-4d50-89fb-a601f5d66b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:44.924650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0ba29-52f4-4d50-89fb-a601f5d66b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:44.925502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0ba29-52f4-4d50-89fb-a601f5d66b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:44.927785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0ba29-52f4-4d50-89fb-a601f5d66b34 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:44.995502 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2440/4866] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:40:44 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:40:44.996931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba2b35-3089-4c61-a9b1-ec64333610be admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:45.017582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba2b35-3089-4c61-a9b1-ec64333610be admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:45.181064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be67d34-e396-4817-9cf4-3be08dc274d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:45.181833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be67d34-e396-4817-9cf4-3be08dc274d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:45.182129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be67d34-e396-4817-9cf4-3be08dc274d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:45.182413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be67d34-e396-4817-9cf4-3be08dc274d9 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:45.183372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be67d34-e396-4817-9cf4-3be08dc274d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:45.185529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be67d34-e396-4817-9cf4-3be08dc274d9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:45.231924 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2427/4867] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:40:44 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:45.235686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0ba29-52f4-4d50-89fb-a601f5d66b34 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:45.249018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0ba29-52f4-4d50-89fb-a601f5d66b34 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:45.254665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581cddd-5a6e-4d18-8f7e-2990f768a385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:45.256244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581cddd-5a6e-4d18-8f7e-2990f768a385 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:45.256748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581cddd-5a6e-4d18-8f7e-2990f768a385 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:45.257283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581cddd-5a6e-4d18-8f7e-2990f768a385 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:45.258434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581cddd-5a6e-4d18-8f7e-2990f768a385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:45.260390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581cddd-5a6e-4d18-8f7e-2990f768a385 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:45.275934 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2441/4868] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:40:45.279681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be67d34-e396-4817-9cf4-3be08dc274d9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:45.292041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be67d34-e396-4817-9cf4-3be08dc274d9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:45.307384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45ae7f-6b0a-4332-a431-190ad4a23056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:45.310686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45ae7f-6b0a-4332-a431-190ad4a23056 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:45.310977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45ae7f-6b0a-4332-a431-190ad4a23056 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:45.312029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45ae7f-6b0a-4332-a431-190ad4a23056 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:45.312940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45ae7f-6b0a-4332-a431-190ad4a23056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:45.314567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45ae7f-6b0a-4332-a431-190ad4a23056 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:45.326633 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2428/4869] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:40:45.330632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581cddd-5a6e-4d18-8f7e-2990f768a385 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:45.355057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581cddd-5a6e-4d18-8f7e-2990f768a385 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:45.373271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b993947-0efd-42fd-9792-4ca077210885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:45.374146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b993947-0efd-42fd-9792-4ca077210885 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:45.374496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b993947-0efd-42fd-9792-4ca077210885 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:45.374838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b993947-0efd-42fd-9792-4ca077210885 admin admin] PATH_INFO: `/v3/projects/a76325eafd6747cca6d57896a1b53a19/users/3781c1799c3f419aad5a8c1f21e40d88/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:45.396766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b993947-0efd-42fd-9792-4ca077210885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76325eafd6747cca6d57896a1b53a19, user_id=3781c1799c3f419aad5a8c1f21e40d88, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:45.421715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b993947-0efd-42fd-9792-4ca077210885 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:45.459076 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2442/4870] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:40:45 2022] PUT /identity/v3/projects/a76325eafd6747cca6d57896a1b53a19/users/3781c1799c3f419aad5a8c1f21e40d88/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:40:45.464184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d10a92-38f4-47c5-852b-a6c7c81f15fa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:45.464547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d10a92-38f4-47c5-852b-a6c7c81f15fa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:45.464895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d10a92-38f4-47c5-852b-a6c7c81f15fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:45.505322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a4d10a92-38f4-47c5-852b-a6c7c81f15fa None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:45.506539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a4d10a92-38f4-47c5-852b-a6c7c81f15fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:45.637297 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2429/4871] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:40:45.663230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b993947-0efd-42fd-9792-4ca077210885 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:45.665096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b993947-0efd-42fd-9792-4ca077210885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:45.726404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:45.819154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b993947-0efd-42fd-9792-4ca077210885 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:45.822952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3570a-cff1-4523-8f12-02c12d0d1850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:45.823922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3570a-cff1-4523-8f12-02c12d0d1850 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:45.824047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3570a-cff1-4523-8f12-02c12d0d1850 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:45.824366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3570a-cff1-4523-8f12-02c12d0d1850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:45.837900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3570a-cff1-4523-8f12-02c12d0d1850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:45.840471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3570a-cff1-4523-8f12-02c12d0d1850 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:45.865515 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2443/4872] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:40:46.401363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d10a92-38f4-47c5-852b-a6c7c81f15fa None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:46.403130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a4d10a92-38f4-47c5-852b-a6c7c81f15fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:46.418329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d10a92-38f4-47c5-852b-a6c7c81f15fa None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:46.423177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e49f89-be40-4ef9-aacd-ba441a7fc1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:46.423922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49f89-be40-4ef9-aacd-ba441a7fc1c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:46.424204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49f89-be40-4ef9-aacd-ba441a7fc1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:46.424476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49f89-be40-4ef9-aacd-ba441a7fc1c2 admin admin] PATH_INFO: `/v3/users/26ec1e64e01348a19f4007326d5f6536` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:46.426314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e49f89-be40-4ef9-aacd-ba441a7fc1c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ec1e64e01348a19f4007326d5f6536)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:46.428516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e49f89-be40-4ef9-aacd-ba441a7fc1c2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:46.444263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:46.489373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23e49f89-be40-4ef9-aacd-ba441a7fc1c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ec1e64e01348a19f4007326d5f6536'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:46.504054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23e49f89-be40-4ef9-aacd-ba441a7fc1c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ec1e64e01348a19f4007326d5f6536'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:46.505310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23e49f89-be40-4ef9-aacd-ba441a7fc1c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ec1e64e01348a19f4007326d5f6536'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:46.506023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23e49f89-be40-4ef9-aacd-ba441a7fc1c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ec1e64e01348a19f4007326d5f6536'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:46.521447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23e49f89-be40-4ef9-aacd-ba441a7fc1c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ec1e64e01348a19f4007326d5f6536'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:46.563203 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2430/4873] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:40:46 2022] DELETE /identity/v3/users/26ec1e64e01348a19f4007326d5f6536 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:46.985604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3570a-cff1-4523-8f12-02c12d0d1850 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:47.014817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3570a-cff1-4523-8f12-02c12d0d1850 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:47.096227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7abaf-3bc7-46dc-828c-ce8ea43b2a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:47.096985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7abaf-3bc7-46dc-828c-ce8ea43b2a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:47.097274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7abaf-3bc7-46dc-828c-ce8ea43b2a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:47.097552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7abaf-3bc7-46dc-828c-ce8ea43b2a09 admin admin] PATH_INFO: `/v3/projects/5f6f7bdca1204a21b25be5648a6371c1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:47.098746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7abaf-3bc7-46dc-828c-ce8ea43b2a09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f6f7bdca1204a21b25be5648a6371c1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:47.100989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7abaf-3bc7-46dc-828c-ce8ea43b2a09 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:47.171384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1e7abaf-3bc7-46dc-828c-ce8ea43b2a09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f6f7bdca1204a21b25be5648a6371c1', 'request_id': 'req-f1e7abaf-3bc7-46dc-828c-ce8ea43b2a09'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:47.187814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1e7abaf-3bc7-46dc-828c-ce8ea43b2a09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f6f7bdca1204a21b25be5648a6371c1', 'request_id': 'req-f1e7abaf-3bc7-46dc-828c-ce8ea43b2a09'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:47.218152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1e7abaf-3bc7-46dc-828c-ce8ea43b2a09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f6f7bdca1204a21b25be5648a6371c1', 'request_id': 'req-f1e7abaf-3bc7-46dc-828c-ce8ea43b2a09'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:47.242104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1e7abaf-3bc7-46dc-828c-ce8ea43b2a09 admin admin] The token cache is being invalidate because project 5f6f7bdca1204a21b25be5648a6371c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:40:47.244714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1e7abaf-3bc7-46dc-828c-ce8ea43b2a09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:47.247298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1e7abaf-3bc7-46dc-828c-ce8ea43b2a09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:47.250040 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2444/4874] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:40:46 2022] DELETE /identity/v3/projects/5f6f7bdca1204a21b25be5648a6371c1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:47.257250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf3191-acaa-4385-9c4b-cea1518fc714 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:47.257549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf3191-acaa-4385-9c4b-cea1518fc714 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:47.257826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf3191-acaa-4385-9c4b-cea1518fc714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:47.295024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-abdf3191-acaa-4385-9c4b-cea1518fc714 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:47.296215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-abdf3191-acaa-4385-9c4b-cea1518fc714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:47.428263 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2431/4875] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:47.433821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857940b-8591-4dd4-ac32-87d01629cab6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:47.434230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857940b-8591-4dd4-ac32-87d01629cab6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:47.434620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857940b-8591-4dd4-ac32-87d01629cab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:47.457557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1857940b-8591-4dd4-ac32-87d01629cab6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:47.459503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1857940b-8591-4dd4-ac32-87d01629cab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:47.470415 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2445/4876] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:47.476998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf3191-acaa-4385-9c4b-cea1518fc714 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:47.502595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf3191-acaa-4385-9c4b-cea1518fc714 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:47.512706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e4109-b107-4a39-8cb5-ae5dcf2f2573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:47.513756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e4109-b107-4a39-8cb5-ae5dcf2f2573 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:47.514189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e4109-b107-4a39-8cb5-ae5dcf2f2573 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:47.515298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e4109-b107-4a39-8cb5-ae5dcf2f2573 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:47.517625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e4109-b107-4a39-8cb5-ae5dcf2f2573 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:47.518117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e4109-b107-4a39-8cb5-ae5dcf2f2573 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:47.520474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e4109-b107-4a39-8cb5-ae5dcf2f2573 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:47.541712 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2432/4877] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:47.546574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857940b-8591-4dd4-ac32-87d01629cab6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:47.578170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857940b-8591-4dd4-ac32-87d01629cab6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:47.596869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f78930-91ef-4a5c-8cfb-6aba11abfad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:47.597135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f78930-91ef-4a5c-8cfb-6aba11abfad6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:47.597473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f78930-91ef-4a5c-8cfb-6aba11abfad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:47.597815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f78930-91ef-4a5c-8cfb-6aba11abfad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:47.598542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f78930-91ef-4a5c-8cfb-6aba11abfad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:47.600663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f78930-91ef-4a5c-8cfb-6aba11abfad6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:47.654910 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2446/4878] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:40:47 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:47.659639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e4109-b107-4a39-8cb5-ae5dcf2f2573 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:47.673570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e4109-b107-4a39-8cb5-ae5dcf2f2573 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:47.809127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff13d2d-ac1a-475b-86b5-cfd07a3f752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:47.809835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff13d2d-ac1a-475b-86b5-cfd07a3f752b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:47.810118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff13d2d-ac1a-475b-86b5-cfd07a3f752b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:47.810532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff13d2d-ac1a-475b-86b5-cfd07a3f752b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:47.811180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff13d2d-ac1a-475b-86b5-cfd07a3f752b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:47.813135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff13d2d-ac1a-475b-86b5-cfd07a3f752b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:47.883227 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2433/4879] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:40:47 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:47.887331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f78930-91ef-4a5c-8cfb-6aba11abfad6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:47.900071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f78930-91ef-4a5c-8cfb-6aba11abfad6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:47.905196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0ad1d-7e93-4197-9dd1-e63817699ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:47.906472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0ad1d-7e93-4197-9dd1-e63817699ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:47.906948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0ad1d-7e93-4197-9dd1-e63817699ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:47.907500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0ad1d-7e93-4197-9dd1-e63817699ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:47.909671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0ad1d-7e93-4197-9dd1-e63817699ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:47.912078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0ad1d-7e93-4197-9dd1-e63817699ee1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:47.928013 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2447/4880] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:40:47.931987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff13d2d-ac1a-475b-86b5-cfd07a3f752b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:47.950138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff13d2d-ac1a-475b-86b5-cfd07a3f752b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:47.961803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46999539-9a80-4a0b-bf39-6b863a449dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:47.964218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46999539-9a80-4a0b-bf39-6b863a449dae admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:47.964680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46999539-9a80-4a0b-bf39-6b863a449dae admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:47.965179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46999539-9a80-4a0b-bf39-6b863a449dae admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:47.966452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46999539-9a80-4a0b-bf39-6b863a449dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:47.968427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46999539-9a80-4a0b-bf39-6b863a449dae admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:47.970205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:48.001448 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2434/4881] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:40:48.005862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0ad1d-7e93-4197-9dd1-e63817699ee1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:48.017946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0ad1d-7e93-4197-9dd1-e63817699ee1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:48.023502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06b70e-3eb2-42ac-a763-93e4baf2a3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:48.024830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06b70e-3eb2-42ac-a763-93e4baf2a3f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:48.025262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06b70e-3eb2-42ac-a763-93e4baf2a3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:48.025672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06b70e-3eb2-42ac-a763-93e4baf2a3f9 admin admin] PATH_INFO: `/v3/projects/8d4ea8f1ea5e4a1db848ca9917646ccb/users/e59c9849816240eda7bc90f3d2e97cf8/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:48.057932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06b70e-3eb2-42ac-a763-93e4baf2a3f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4ea8f1ea5e4a1db848ca9917646ccb, user_id=e59c9849816240eda7bc90f3d2e97cf8, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:48.063065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06b70e-3eb2-42ac-a763-93e4baf2a3f9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:48.066336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:48.096541 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2448/4882] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:40:48 2022] PUT /identity/v3/projects/8d4ea8f1ea5e4a1db848ca9917646ccb/users/e59c9849816240eda7bc90f3d2e97cf8/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:48.107746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b7c49-9526-46d8-a690-64a98c4efdd9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:48.109228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b7c49-9526-46d8-a690-64a98c4efdd9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:48.109621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b7c49-9526-46d8-a690-64a98c4efdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:48.157325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e76b7c49-9526-46d8-a690-64a98c4efdd9 None None] MFA Rules not processed for user `e59c9849816240eda7bc90f3d2e97cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:48.158720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e76b7c49-9526-46d8-a690-64a98c4efdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:48.281358 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2435/4883] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:48.286115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06b70e-3eb2-42ac-a763-93e4baf2a3f9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:48.400644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06b70e-3eb2-42ac-a763-93e4baf2a3f9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:48.412660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb7ec3-b9ad-4f87-a4d6-0040a2ad5f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:48.413482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb7ec3-b9ad-4f87-a4d6-0040a2ad5f7e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:48.413760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb7ec3-b9ad-4f87-a4d6-0040a2ad5f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:48.414034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb7ec3-b9ad-4f87-a4d6-0040a2ad5f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:48.414685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb7ec3-b9ad-4f87-a4d6-0040a2ad5f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:48.416669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb7ec3-b9ad-4f87-a4d6-0040a2ad5f7e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:48.531317 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2449/4884] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:40:48 2022] POST /identity/v3/projects => generated 377 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:48.534415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b7c49-9526-46d8-a690-64a98c4efdd9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:48.583546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b7c49-9526-46d8-a690-64a98c4efdd9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:48.728194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725e91c-bcfd-43ac-b100-db67638a507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:48.729201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725e91c-bcfd-43ac-b100-db67638a507b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:48.729603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725e91c-bcfd-43ac-b100-db67638a507b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:48.730081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725e91c-bcfd-43ac-b100-db67638a507b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:48.731680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725e91c-bcfd-43ac-b100-db67638a507b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:48.740686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725e91c-bcfd-43ac-b100-db67638a507b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:48.795657 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2436/4885] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:40:48 2022] POST /identity/v3/users => generated 295 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:48.800023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb7ec3-b9ad-4f87-a4d6-0040a2ad5f7e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:48.816182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb7ec3-b9ad-4f87-a4d6-0040a2ad5f7e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:48.826306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8555b9-bbd2-4b57-b624-ba9d854f2953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:48.826306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8555b9-bbd2-4b57-b624-ba9d854f2953 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:48.826306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8555b9-bbd2-4b57-b624-ba9d854f2953 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:48.826306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8555b9-bbd2-4b57-b624-ba9d854f2953 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:48.826714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8555b9-bbd2-4b57-b624-ba9d854f2953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:48.827994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8555b9-bbd2-4b57-b624-ba9d854f2953 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:48.853789 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2450/4886] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:40:48.858290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725e91c-bcfd-43ac-b100-db67638a507b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:48.875862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725e91c-bcfd-43ac-b100-db67638a507b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:48.890113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dadffd-2023-4ee2-9937-77bda5656fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:48.890795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dadffd-2023-4ee2-9937-77bda5656fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:48.891079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dadffd-2023-4ee2-9937-77bda5656fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:48.892108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dadffd-2023-4ee2-9937-77bda5656fdb admin admin] PATH_INFO: `/v3/projects/27b483f3b70c4837908fb151f66bf505/users/13d5293abb1a47fcb6bad46a69916129/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:48.912229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dadffd-2023-4ee2-9937-77bda5656fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b483f3b70c4837908fb151f66bf505, user_id=13d5293abb1a47fcb6bad46a69916129, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:48.916472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dadffd-2023-4ee2-9937-77bda5656fdb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:48.937630 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2437/4887] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:40:48 2022] PUT /identity/v3/projects/27b483f3b70c4837908fb151f66bf505/users/13d5293abb1a47fcb6bad46a69916129/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:48.941487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8555b9-bbd2-4b57-b624-ba9d854f2953 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:48.959467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8555b9-bbd2-4b57-b624-ba9d854f2953 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:49.081011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ce906-7d0e-4832-8dd0-02196eaf684b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:49.082623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ce906-7d0e-4832-8dd0-02196eaf684b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:49.083097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ce906-7d0e-4832-8dd0-02196eaf684b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:49.083568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ce906-7d0e-4832-8dd0-02196eaf684b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:49.085312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ce906-7d0e-4832-8dd0-02196eaf684b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:49.088899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ce906-7d0e-4832-8dd0-02196eaf684b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:49.105484 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2451/4888] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:40:49.109403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dadffd-2023-4ee2-9937-77bda5656fdb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:49.123630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dadffd-2023-4ee2-9937-77bda5656fdb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:49.134013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f2090-50d3-4322-9fac-4b2945da0500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:49.135033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f2090-50d3-4322-9fac-4b2945da0500 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:49.135556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f2090-50d3-4322-9fac-4b2945da0500 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:49.135980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f2090-50d3-4322-9fac-4b2945da0500 admin admin] PATH_INFO: `/v3/projects/27b483f3b70c4837908fb151f66bf505/users/13d5293abb1a47fcb6bad46a69916129/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:49.140208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f2090-50d3-4322-9fac-4b2945da0500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b483f3b70c4837908fb151f66bf505, user_id=13d5293abb1a47fcb6bad46a69916129, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:49.144207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f2090-50d3-4322-9fac-4b2945da0500 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:49.161367 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2438/4889] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:40:49 2022] PUT /identity/v3/projects/27b483f3b70c4837908fb151f66bf505/users/13d5293abb1a47fcb6bad46a69916129/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:40:49.173816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f235a-7d5c-4380-9a89-09269273033e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:49.174609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f235a-7d5c-4380-9a89-09269273033e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:49.175084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f235a-7d5c-4380-9a89-09269273033e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:49.238038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d92f235a-7d5c-4380-9a89-09269273033e None None] MFA Rules not processed for user `13d5293abb1a47fcb6bad46a69916129`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:49.239578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d92f235a-7d5c-4380-9a89-09269273033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:49.363615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:49.400366 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2452/4890] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:49.405339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f2090-50d3-4322-9fac-4b2945da0500 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:49.422128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f2090-50d3-4322-9fac-4b2945da0500 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:49.437846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5851b4-3678-4c9c-a57b-363cef23519d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13d5293abb1a47fcb6bad46a69916129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27b483f3b70c4837908fb151f66bf505', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:49.438746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5851b4-3678-4c9c-a57b-363cef23519d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:49.439187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5851b4-3678-4c9c-a57b-363cef23519d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:49.439654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5851b4-3678-4c9c-a57b-363cef23519d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:49.440564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5851b4-3678-4c9c-a57b-363cef23519d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:49.442740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5851b4-3678-4c9c-a57b-363cef23519d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:49.473577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f235a-7d5c-4380-9a89-09269273033e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:49.478011 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2439/4891] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:40:49 2022] POST /identity/v3/domains => generated 245 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:40:49.483515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f235a-7d5c-4380-9a89-09269273033e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:49.591563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896bb27-1a8e-42fd-b0ee-bae92107cc10 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13d5293abb1a47fcb6bad46a69916129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27b483f3b70c4837908fb151f66bf505', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:49.592443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896bb27-1a8e-42fd-b0ee-bae92107cc10 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:49.592886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896bb27-1a8e-42fd-b0ee-bae92107cc10 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:49.593318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896bb27-1a8e-42fd-b0ee-bae92107cc10 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:49.594577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896bb27-1a8e-42fd-b0ee-bae92107cc10 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:49.597055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896bb27-1a8e-42fd-b0ee-bae92107cc10 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:49.684900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5851b4-3678-4c9c-a57b-363cef23519d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:49.695001 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2453/4892] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:40:49 2022] POST /identity/v3/projects => generated 410 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:49.700271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5851b4-3678-4c9c-a57b-363cef23519d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:49.730264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:49.825313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba46f12-39cf-4912-9e5b-7fd42c469f0d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13d5293abb1a47fcb6bad46a69916129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27b483f3b70c4837908fb151f66bf505', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:49.826519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba46f12-39cf-4912-9e5b-7fd42c469f0d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:49.827057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba46f12-39cf-4912-9e5b-7fd42c469f0d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:49.827444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba46f12-39cf-4912-9e5b-7fd42c469f0d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:49.828115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba46f12-39cf-4912-9e5b-7fd42c469f0d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:49.838035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba46f12-39cf-4912-9e5b-7fd42c469f0d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:49.903847 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2440/4893] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:40:49 2022] POST /identity/v3/users => generated 348 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:49.905569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896bb27-1a8e-42fd-b0ee-bae92107cc10 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:49.921606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896bb27-1a8e-42fd-b0ee-bae92107cc10 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:49.939704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dcfdf-92b2-4567-98f5-38f0349f3a2c tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13d5293abb1a47fcb6bad46a69916129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27b483f3b70c4837908fb151f66bf505', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:49.940453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dcfdf-92b2-4567-98f5-38f0349f3a2c tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:49.940748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dcfdf-92b2-4567-98f5-38f0349f3a2c tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:49.941032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dcfdf-92b2-4567-98f5-38f0349f3a2c tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:49.941703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dcfdf-92b2-4567-98f5-38f0349f3a2c tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:49.943784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dcfdf-92b2-4567-98f5-38f0349f3a2c tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:49.979536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba46f12-39cf-4912-9e5b-7fd42c469f0d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:49.980017 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2454/4894] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:40:49.996311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba46f12-39cf-4912-9e5b-7fd42c469f0d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:50.012204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab961c-5b35-486c-8490-b83831ef463d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13d5293abb1a47fcb6bad46a69916129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27b483f3b70c4837908fb151f66bf505', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:50.012917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab961c-5b35-486c-8490-b83831ef463d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:50.013202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab961c-5b35-486c-8490-b83831ef463d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:50.013487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab961c-5b35-486c-8490-b83831ef463d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] PATH_INFO: `/v3/projects/f8ebb2b6e6ea4c30800d8a056fa360c5/users/d631307af74441ba8e6b9f4a174f5c81/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:50.040539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab961c-5b35-486c-8490-b83831ef463d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f8ebb2b6e6ea4c30800d8a056fa360c5, user_id=d631307af74441ba8e6b9f4a174f5c81, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:50.043539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab961c-5b35-486c-8490-b83831ef463d tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:50.074942 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2441/4895] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:40:49 2022] PUT /identity/v3/projects/f8ebb2b6e6ea4c30800d8a056fa360c5/users/d631307af74441ba8e6b9f4a174f5c81/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:50.080261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837474d-124f-4b82-9b3e-24d9945d691c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:50.080554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837474d-124f-4b82-9b3e-24d9945d691c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:50.080915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837474d-124f-4b82-9b3e-24d9945d691c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:50.356120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0837474d-124f-4b82-9b3e-24d9945d691c None None] MFA Rules not processed for user `d631307af74441ba8e6b9f4a174f5c81`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:50.358263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0837474d-124f-4b82-9b3e-24d9945d691c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:50.395918 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2455/4896] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:50 2022] POST /identity/v3/auth/tokens => generated 3361 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:50.406105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0d6e1-0f9c-4c6a-ae18-10d63de95bed None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:50.407285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0d6e1-0f9c-4c6a-ae18-10d63de95bed None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:50.407285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0d6e1-0f9c-4c6a-ae18-10d63de95bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:50.433425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d3d0d6e1-0f9c-4c6a-ae18-10d63de95bed None None] MFA Rules not processed for user `d631307af74441ba8e6b9f4a174f5c81`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:50.434764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d3d0d6e1-0f9c-4c6a-ae18-10d63de95bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:50.447893 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2442/4897] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:50 2022] POST /identity/v3/auth/tokens => generated 3361 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:50.450209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837474d-124f-4b82-9b3e-24d9945d691c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:50.465569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837474d-124f-4b82-9b3e-24d9945d691c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:50.472227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f69fab-3985-4082-bcb2-b9b202d75f9f tempest-test_project-1686995138 tempest-user-1565271616] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd631307af74441ba8e6b9f4a174f5c81', 'user_domain_id': '9c5ab960ac3c4906b193a59fcb94d6cb', 'system_scope': None, 'project_id': 'f8ebb2b6e6ea4c30800d8a056fa360c5', 'project_domain_id': '9c5ab960ac3c4906b193a59fcb94d6cb', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:50.473277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f69fab-3985-4082-bcb2-b9b202d75f9f tempest-test_project-1686995138 tempest-user-1565271616] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:50.473877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f69fab-3985-4082-bcb2-b9b202d75f9f tempest-test_project-1686995138 tempest-user-1565271616] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:50.474438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f69fab-3985-4082-bcb2-b9b202d75f9f tempest-test_project-1686995138 tempest-user-1565271616] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:50.484800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f69fab-3985-4082-bcb2-b9b202d75f9f tempest-test_project-1686995138 tempest-user-1565271616] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:50.486821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f69fab-3985-4082-bcb2-b9b202d75f9f tempest-test_project-1686995138 tempest-user-1565271616] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:50.504732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0d6e1-0f9c-4c6a-ae18-10d63de95bed None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:50.504999 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2456/4898] 10.222.0.27 () {56 vars in 1284 bytes} [Sun Aug 28 18:40:50 2022] GET /identity/v3/auth/tokens => generated 3361 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:40:50.583698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0d6e1-0f9c-4c6a-ae18-10d63de95bed None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:50.595335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c2212-8781-4e0f-a0cb-f21de9eee29e tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13d5293abb1a47fcb6bad46a69916129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27b483f3b70c4837908fb151f66bf505', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:50.596176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c2212-8781-4e0f-a0cb-f21de9eee29e tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:50.597198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c2212-8781-4e0f-a0cb-f21de9eee29e tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:50.597198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c2212-8781-4e0f-a0cb-f21de9eee29e tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] PATH_INFO: `/v3/users/d631307af74441ba8e6b9f4a174f5c81` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:50.599143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c2212-8781-4e0f-a0cb-f21de9eee29e tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d631307af74441ba8e6b9f4a174f5c81)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:50.602327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c2212-8781-4e0f-a0cb-f21de9eee29e tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:50.717295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a09c2212-8781-4e0f-a0cb-f21de9eee29e tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd631307af74441ba8e6b9f4a174f5c81'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:50.747529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a09c2212-8781-4e0f-a0cb-f21de9eee29e tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd631307af74441ba8e6b9f4a174f5c81'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:50.749482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a09c2212-8781-4e0f-a0cb-f21de9eee29e tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd631307af74441ba8e6b9f4a174f5c81'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:50.749482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a09c2212-8781-4e0f-a0cb-f21de9eee29e tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd631307af74441ba8e6b9f4a174f5c81'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:50.763121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a09c2212-8781-4e0f-a0cb-f21de9eee29e tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd631307af74441ba8e6b9f4a174f5c81'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:50.783799 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2443/4899] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:40:50 2022] DELETE /identity/v3/users/d631307af74441ba8e6b9f4a174f5c81 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:50.788253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f69fab-3985-4082-bcb2-b9b202d75f9f tempest-test_project-1686995138 tempest-user-1565271616] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:50.809657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f69fab-3985-4082-bcb2-b9b202d75f9f tempest-test_project-1686995138 tempest-user-1565271616] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:50.826803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:50.991191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c5721-6737-4d26-8c44-867ef9d35a7f tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13d5293abb1a47fcb6bad46a69916129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27b483f3b70c4837908fb151f66bf505', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:50.991908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c5721-6737-4d26-8c44-867ef9d35a7f tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:51.001003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c5721-6737-4d26-8c44-867ef9d35a7f tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:51.002029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c5721-6737-4d26-8c44-867ef9d35a7f tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] PATH_INFO: `/v3/projects/f8ebb2b6e6ea4c30800d8a056fa360c5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:51.011144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c5721-6737-4d26-8c44-867ef9d35a7f tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f8ebb2b6e6ea4c30800d8a056fa360c5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:51.034910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c5721-6737-4d26-8c44-867ef9d35a7f tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:51.216906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-286c5721-6737-4d26-8c44-867ef9d35a7f tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ebb2b6e6ea4c30800d8a056fa360c5', 'request_id': 'req-286c5721-6737-4d26-8c44-867ef9d35a7f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.237936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-286c5721-6737-4d26-8c44-867ef9d35a7f tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ebb2b6e6ea4c30800d8a056fa360c5', 'request_id': 'req-286c5721-6737-4d26-8c44-867ef9d35a7f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.251517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-286c5721-6737-4d26-8c44-867ef9d35a7f tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ebb2b6e6ea4c30800d8a056fa360c5', 'request_id': 'req-286c5721-6737-4d26-8c44-867ef9d35a7f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.285491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-286c5721-6737-4d26-8c44-867ef9d35a7f tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] The token cache is being invalidate because project f8ebb2b6e6ea4c30800d8a056fa360c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:40:51.286489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-286c5721-6737-4d26-8c44-867ef9d35a7f tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.298787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-286c5721-6737-4d26-8c44-867ef9d35a7f tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.301857 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2457/4900] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:40:50 2022] DELETE /identity/v3/projects/f8ebb2b6e6ea4c30800d8a056fa360c5 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:51.306391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c2212-8781-4e0f-a0cb-f21de9eee29e tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:51.312520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a09c2212-8781-4e0f-a0cb-f21de9eee29e tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:51.329930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:51.340028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c2212-8781-4e0f-a0cb-f21de9eee29e tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:51.425081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9031c7e-b479-4247-b100-cd067db60abb tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13d5293abb1a47fcb6bad46a69916129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27b483f3b70c4837908fb151f66bf505', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:51.425960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9031c7e-b479-4247-b100-cd067db60abb tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:51.426340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9031c7e-b479-4247-b100-cd067db60abb tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:51.427722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9031c7e-b479-4247-b100-cd067db60abb tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] PATH_INFO: `/v3/domains/9c5ab960ac3c4906b193a59fcb94d6cb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:51.429809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9031c7e-b479-4247-b100-cd067db60abb tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9c5ab960ac3c4906b193a59fcb94d6cb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:51.431859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9031c7e-b479-4247-b100-cd067db60abb tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:51.459288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9031c7e-b479-4247-b100-cd067db60abb tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9c5ab960ac3c4906b193a59fcb94d6cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.460207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9031c7e-b479-4247-b100-cd067db60abb tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9c5ab960ac3c4906b193a59fcb94d6cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.516272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9031c7e-b479-4247-b100-cd067db60abb tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9c5ab960ac3c4906b193a59fcb94d6cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.517801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9031c7e-b479-4247-b100-cd067db60abb tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9c5ab960ac3c4906b193a59fcb94d6cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.528955 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2444/4901] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:40:51 2022] PATCH /identity/v3/domains/9c5ab960ac3c4906b193a59fcb94d6cb => generated 246 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:40:51.530190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c5721-6737-4d26-8c44-867ef9d35a7f tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:51.531669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-286c5721-6737-4d26-8c44-867ef9d35a7f tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:51.545261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c5721-6737-4d26-8c44-867ef9d35a7f tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:51.635038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b758ad-c401-4bb3-ac12-c9f7057cebe5 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13d5293abb1a47fcb6bad46a69916129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27b483f3b70c4837908fb151f66bf505', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:51.635879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b758ad-c401-4bb3-ac12-c9f7057cebe5 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:51.636155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b758ad-c401-4bb3-ac12-c9f7057cebe5 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:51.636432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b758ad-c401-4bb3-ac12-c9f7057cebe5 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] PATH_INFO: `/v3/domains/9c5ab960ac3c4906b193a59fcb94d6cb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:51.648229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b758ad-c401-4bb3-ac12-c9f7057cebe5 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9c5ab960ac3c4906b193a59fcb94d6cb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:51.649571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b758ad-c401-4bb3-ac12-c9f7057cebe5 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:51.674155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48b758ad-c401-4bb3-ac12-c9f7057cebe5 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9c5ab960ac3c4906b193a59fcb94d6cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.684133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48b758ad-c401-4bb3-ac12-c9f7057cebe5 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9c5ab960ac3c4906b193a59fcb94d6cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.688579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:51.738498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48b758ad-c401-4bb3-ac12-c9f7057cebe5 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c5ab960ac3c4906b193a59fcb94d6cb', 'request_id': 'req-48b758ad-c401-4bb3-ac12-c9f7057cebe5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.746982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48b758ad-c401-4bb3-ac12-c9f7057cebe5 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c5ab960ac3c4906b193a59fcb94d6cb', 'request_id': 'req-48b758ad-c401-4bb3-ac12-c9f7057cebe5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.756325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48b758ad-c401-4bb3-ac12-c9f7057cebe5 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c5ab960ac3c4906b193a59fcb94d6cb', 'request_id': 'req-48b758ad-c401-4bb3-ac12-c9f7057cebe5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.769818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48b758ad-c401-4bb3-ac12-c9f7057cebe5 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] The token cache is being invalidate because project 9c5ab960ac3c4906b193a59fcb94d6cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:40:51.770217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48b758ad-c401-4bb3-ac12-c9f7057cebe5 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.771207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48b758ad-c401-4bb3-ac12-c9f7057cebe5 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.786743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48b758ad-c401-4bb3-ac12-c9f7057cebe5 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9c5ab960ac3c4906b193a59fcb94d6cb', 'request_id': 'req-48b758ad-c401-4bb3-ac12-c9f7057cebe5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.787955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48b758ad-c401-4bb3-ac12-c9f7057cebe5 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9c5ab960ac3c4906b193a59fcb94d6cb', 'request_id': 'req-48b758ad-c401-4bb3-ac12-c9f7057cebe5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.799881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48b758ad-c401-4bb3-ac12-c9f7057cebe5 tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9c5ab960ac3c4906b193a59fcb94d6cb', 'request_id': 'req-48b758ad-c401-4bb3-ac12-c9f7057cebe5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:51.819810 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2458/4902] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:40:51 2022] DELETE /identity/v3/domains/9c5ab960ac3c4906b193a59fcb94d6cb => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:51.824863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9031c7e-b479-4247-b100-cd067db60abb tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:51.826750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b9031c7e-b479-4247-b100-cd067db60abb tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:51.926832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9031c7e-b479-4247-b100-cd067db60abb tempest-TestDefaultProjectId-1494849273 tempest-TestDefaultProjectId-1494849273-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:52.025159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cdb9b-4a8b-4d6c-a1e7-8d4c6ca53e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:52.026737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cdb9b-4a8b-4d6c-a1e7-8d4c6ca53e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:52.027138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cdb9b-4a8b-4d6c-a1e7-8d4c6ca53e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:52.027717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cdb9b-4a8b-4d6c-a1e7-8d4c6ca53e79 admin admin] PATH_INFO: `/v3/users/e59c9849816240eda7bc90f3d2e97cf8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:52.029483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cdb9b-4a8b-4d6c-a1e7-8d4c6ca53e79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e59c9849816240eda7bc90f3d2e97cf8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:52.032512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cdb9b-4a8b-4d6c-a1e7-8d4c6ca53e79 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:52.065207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:52.124058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-244cdb9b-4a8b-4d6c-a1e7-8d4c6ca53e79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e59c9849816240eda7bc90f3d2e97cf8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:52.137614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-244cdb9b-4a8b-4d6c-a1e7-8d4c6ca53e79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e59c9849816240eda7bc90f3d2e97cf8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:52.138260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-244cdb9b-4a8b-4d6c-a1e7-8d4c6ca53e79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e59c9849816240eda7bc90f3d2e97cf8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:52.139077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-244cdb9b-4a8b-4d6c-a1e7-8d4c6ca53e79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e59c9849816240eda7bc90f3d2e97cf8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:52.149996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-244cdb9b-4a8b-4d6c-a1e7-8d4c6ca53e79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e59c9849816240eda7bc90f3d2e97cf8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:52.174084 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2445/4903] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:40:51 2022] DELETE /identity/v3/users/e59c9849816240eda7bc90f3d2e97cf8 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:52.176482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86577afc-af53-4628-b5e6-17244baf1146 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:52.176775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86577afc-af53-4628-b5e6-17244baf1146 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:52.177056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86577afc-af53-4628-b5e6-17244baf1146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:52.211736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-86577afc-af53-4628-b5e6-17244baf1146 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:52.212956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-86577afc-af53-4628-b5e6-17244baf1146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:52.421301 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2459/4904] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:52.463623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cdb9b-4a8b-4d6c-a1e7-8d4c6ca53e79 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:52.465216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-244cdb9b-4a8b-4d6c-a1e7-8d4c6ca53e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:52.658936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cdb9b-4a8b-4d6c-a1e7-8d4c6ca53e79 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:52.667965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575df524-bbe4-4002-be79-f98f14ef683f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:52.668723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575df524-bbe4-4002-be79-f98f14ef683f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:52.669010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575df524-bbe4-4002-be79-f98f14ef683f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:52.669287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575df524-bbe4-4002-be79-f98f14ef683f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:52.710284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575df524-bbe4-4002-be79-f98f14ef683f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:52.717908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575df524-bbe4-4002-be79-f98f14ef683f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:52.751990 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2446/4905] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:40:53.342561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86577afc-af53-4628-b5e6-17244baf1146 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:53.344107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-86577afc-af53-4628-b5e6-17244baf1146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:53.369863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86577afc-af53-4628-b5e6-17244baf1146 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:53.384334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5e0a3-7d9a-46a5-9e3c-47609ffdc318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:53.385098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e0a3-7d9a-46a5-9e3c-47609ffdc318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:53.385589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e0a3-7d9a-46a5-9e3c-47609ffdc318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:53.385863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e0a3-7d9a-46a5-9e3c-47609ffdc318 admin admin] PATH_INFO: `/v3/users/12eff0cadba644f9bb6db497eb721b0b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:53.388059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5e0a3-7d9a-46a5-9e3c-47609ffdc318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12eff0cadba644f9bb6db497eb721b0b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:53.394804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5e0a3-7d9a-46a5-9e3c-47609ffdc318 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:53.496390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cbb5e0a3-7d9a-46a5-9e3c-47609ffdc318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12eff0cadba644f9bb6db497eb721b0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:53.505661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cbb5e0a3-7d9a-46a5-9e3c-47609ffdc318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12eff0cadba644f9bb6db497eb721b0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:53.514261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cbb5e0a3-7d9a-46a5-9e3c-47609ffdc318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12eff0cadba644f9bb6db497eb721b0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:53.566908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575df524-bbe4-4002-be79-f98f14ef683f service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:53.566908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-575df524-bbe4-4002-be79-f98f14ef683f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:53.569439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cbb5e0a3-7d9a-46a5-9e3c-47609ffdc318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12eff0cadba644f9bb6db497eb721b0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:53.576984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:53.582535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575df524-bbe4-4002-be79-f98f14ef683f service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:53.601263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cbb5e0a3-7d9a-46a5-9e3c-47609ffdc318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12eff0cadba644f9bb6db497eb721b0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:53.612618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffe692-bbe3-433d-85f8-8aae33e9caed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:53.613895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffe692-bbe3-433d-85f8-8aae33e9caed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:53.614327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffe692-bbe3-433d-85f8-8aae33e9caed admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:53.614748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffe692-bbe3-433d-85f8-8aae33e9caed admin admin] PATH_INFO: `/v3/projects/8d4ea8f1ea5e4a1db848ca9917646ccb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:53.620530 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2460/4906] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:40:53 2022] DELETE /identity/v3/users/12eff0cadba644f9bb6db497eb721b0b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:53.620978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffe692-bbe3-433d-85f8-8aae33e9caed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d4ea8f1ea5e4a1db848ca9917646ccb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:53.624661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffe692-bbe3-433d-85f8-8aae33e9caed admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:53.732009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e8ffe692-bbe3-433d-85f8-8aae33e9caed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d4ea8f1ea5e4a1db848ca9917646ccb', 'request_id': 'req-e8ffe692-bbe3-433d-85f8-8aae33e9caed'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:53.755156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e8ffe692-bbe3-433d-85f8-8aae33e9caed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d4ea8f1ea5e4a1db848ca9917646ccb', 'request_id': 'req-e8ffe692-bbe3-433d-85f8-8aae33e9caed'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:53.767172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e8ffe692-bbe3-433d-85f8-8aae33e9caed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d4ea8f1ea5e4a1db848ca9917646ccb', 'request_id': 'req-e8ffe692-bbe3-433d-85f8-8aae33e9caed'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:53.805982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e8ffe692-bbe3-433d-85f8-8aae33e9caed admin admin] The token cache is being invalidate because project 8d4ea8f1ea5e4a1db848ca9917646ccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:40:53.806282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e8ffe692-bbe3-433d-85f8-8aae33e9caed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:53.807681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e8ffe692-bbe3-433d-85f8-8aae33e9caed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:53.811926 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2447/4907] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:40:53 2022] DELETE /identity/v3/projects/8d4ea8f1ea5e4a1db848ca9917646ccb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:53.815883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5e0a3-7d9a-46a5-9e3c-47609ffdc318 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:53.817453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cbb5e0a3-7d9a-46a5-9e3c-47609ffdc318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:54.013469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5e0a3-7d9a-46a5-9e3c-47609ffdc318 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:54.072042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffe692-bbe3-433d-85f8-8aae33e9caed admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:54.074538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e8ffe692-bbe3-433d-85f8-8aae33e9caed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:54.127515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:54.172314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7272084-07a9-4981-b036-7af5e22f9655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:54.173189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7272084-07a9-4981-b036-7af5e22f9655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:54.173656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7272084-07a9-4981-b036-7af5e22f9655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:54.173974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7272084-07a9-4981-b036-7af5e22f9655 admin admin] PATH_INFO: `/v3/users/13d5293abb1a47fcb6bad46a69916129` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:54.175468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7272084-07a9-4981-b036-7af5e22f9655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d5293abb1a47fcb6bad46a69916129)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:54.177523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7272084-07a9-4981-b036-7af5e22f9655 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:54.203246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffe692-bbe3-433d-85f8-8aae33e9caed admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:54.209443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad63eb-d70d-4b1a-b8a8-c83e9ee36cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:54.210092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad63eb-d70d-4b1a-b8a8-c83e9ee36cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:54.210371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad63eb-d70d-4b1a-b8a8-c83e9ee36cac admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:54.210995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad63eb-d70d-4b1a-b8a8-c83e9ee36cac admin admin] PATH_INFO: `/v3/projects/bc870b2dd9604a76a5fc4566e4eca523` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:54.213151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad63eb-d70d-4b1a-b8a8-c83e9ee36cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc870b2dd9604a76a5fc4566e4eca523)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:54.215229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad63eb-d70d-4b1a-b8a8-c83e9ee36cac admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:54.283790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7272084-07a9-4981-b036-7af5e22f9655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d5293abb1a47fcb6bad46a69916129'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:54.284573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7272084-07a9-4981-b036-7af5e22f9655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d5293abb1a47fcb6bad46a69916129'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:54.296319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7272084-07a9-4981-b036-7af5e22f9655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d5293abb1a47fcb6bad46a69916129'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:54.305758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-31ad63eb-d70d-4b1a-b8a8-c83e9ee36cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc870b2dd9604a76a5fc4566e4eca523', 'request_id': 'req-31ad63eb-d70d-4b1a-b8a8-c83e9ee36cac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:54.309867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7272084-07a9-4981-b036-7af5e22f9655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d5293abb1a47fcb6bad46a69916129'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:54.326130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-31ad63eb-d70d-4b1a-b8a8-c83e9ee36cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc870b2dd9604a76a5fc4566e4eca523', 'request_id': 'req-31ad63eb-d70d-4b1a-b8a8-c83e9ee36cac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:54.329251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7272084-07a9-4981-b036-7af5e22f9655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d5293abb1a47fcb6bad46a69916129'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:54.339472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-31ad63eb-d70d-4b1a-b8a8-c83e9ee36cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc870b2dd9604a76a5fc4566e4eca523', 'request_id': 'req-31ad63eb-d70d-4b1a-b8a8-c83e9ee36cac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:54.340982 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2461/4908] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:40:53 2022] DELETE /identity/v3/users/13d5293abb1a47fcb6bad46a69916129 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:54.362748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-31ad63eb-d70d-4b1a-b8a8-c83e9ee36cac admin admin] The token cache is being invalidate because project bc870b2dd9604a76a5fc4566e4eca523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:40:54.363045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-31ad63eb-d70d-4b1a-b8a8-c83e9ee36cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:54.363768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-31ad63eb-d70d-4b1a-b8a8-c83e9ee36cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:54.365298 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2448/4909] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:40:54 2022] DELETE /identity/v3/projects/bc870b2dd9604a76a5fc4566e4eca523 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:54.371339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949385f-acb3-4a09-b446-e792d04bb62f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:54.371852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949385f-acb3-4a09-b446-e792d04bb62f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:54.371961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949385f-acb3-4a09-b446-e792d04bb62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:54.431398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d949385f-acb3-4a09-b446-e792d04bb62f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:54.431398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d949385f-acb3-4a09-b446-e792d04bb62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:54.469767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:54.621685 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2462/4910] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:54.625293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf81661-c650-4396-84f3-60cf665e3216 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:54.625780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf81661-c650-4396-84f3-60cf665e3216 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:54.625860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf81661-c650-4396-84f3-60cf665e3216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:54.659331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fcf81661-c650-4396-84f3-60cf665e3216 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:54.660578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fcf81661-c650-4396-84f3-60cf665e3216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:54.684167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949385f-acb3-4a09-b446-e792d04bb62f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:54.689566 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2449/4911] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:54.706323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949385f-acb3-4a09-b446-e792d04bb62f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:54.714026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c5a0d-daa0-43d3-8b44-d418477a7c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:54.715566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c5a0d-daa0-43d3-8b44-d418477a7c9f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:54.717043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c5a0d-daa0-43d3-8b44-d418477a7c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:54.717528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c5a0d-daa0-43d3-8b44-d418477a7c9f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:54.718419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c5a0d-daa0-43d3-8b44-d418477a7c9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:54.718947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c5a0d-daa0-43d3-8b44-d418477a7c9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:54.721129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c5a0d-daa0-43d3-8b44-d418477a7c9f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:54.736045 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2463/4912] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:54.740437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf81661-c650-4396-84f3-60cf665e3216 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:54.753045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf81661-c650-4396-84f3-60cf665e3216 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:54.775675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a8491-9b6f-406f-b569-dd357e07e8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:54.776528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a8491-9b6f-406f-b569-dd357e07e8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:54.776889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a8491-9b6f-406f-b569-dd357e07e8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:54.777238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a8491-9b6f-406f-b569-dd357e07e8e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:54.778016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a8491-9b6f-406f-b569-dd357e07e8e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:54.782918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a8491-9b6f-406f-b569-dd357e07e8e9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:54.845612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c5a0d-daa0-43d3-8b44-d418477a7c9f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:54.847987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9b0c5a0d-daa0-43d3-8b44-d418477a7c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:54.878542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c5a0d-daa0-43d3-8b44-d418477a7c9f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:54.883974 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2450/4913] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:40:54 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:54.883974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e6796-096f-4f97-a180-79a5ea0f5eb9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:54.883974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e6796-096f-4f97-a180-79a5ea0f5eb9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:54.883974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e6796-096f-4f97-a180-79a5ea0f5eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:54.927806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f74e6796-096f-4f97-a180-79a5ea0f5eb9 None None] MFA Rules not processed for user `3781c1799c3f419aad5a8c1f21e40d88`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:54.929302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f74e6796-096f-4f97-a180-79a5ea0f5eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:55.012415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edde11-715b-4f10-91fa-99fd85737a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:55.013728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edde11-715b-4f10-91fa-99fd85737a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:55.014224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edde11-715b-4f10-91fa-99fd85737a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:55.014835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edde11-715b-4f10-91fa-99fd85737a0a admin admin] PATH_INFO: `/v3/projects/27b483f3b70c4837908fb151f66bf505` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:55.016989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edde11-715b-4f10-91fa-99fd85737a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b483f3b70c4837908fb151f66bf505)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:55.020232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edde11-715b-4f10-91fa-99fd85737a0a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:55.039431 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2451/4914] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:55.039431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e6796-096f-4f97-a180-79a5ea0f5eb9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:55.091703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e6796-096f-4f97-a180-79a5ea0f5eb9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:55.111068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa714ae8-f329-4011-81b7-8b0e8b1a100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:55.112198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714ae8-f329-4011-81b7-8b0e8b1a100e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:55.115908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714ae8-f329-4011-81b7-8b0e8b1a100e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:55.116208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714ae8-f329-4011-81b7-8b0e8b1a100e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:55.116998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa714ae8-f329-4011-81b7-8b0e8b1a100e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:55.125462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa714ae8-f329-4011-81b7-8b0e8b1a100e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:55.140447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:55.158540 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2452/4915] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:40:55 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:55.160122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215905ea-a8b3-4018-904e-86fa7bd4c2a7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:55.160507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215905ea-a8b3-4018-904e-86fa7bd4c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:55.160899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215905ea-a8b3-4018-904e-86fa7bd4c2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:55.163275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81edde11-715b-4f10-91fa-99fd85737a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b483f3b70c4837908fb151f66bf505', 'request_id': 'req-81edde11-715b-4f10-91fa-99fd85737a0a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:55.181106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81edde11-715b-4f10-91fa-99fd85737a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b483f3b70c4837908fb151f66bf505', 'request_id': 'req-81edde11-715b-4f10-91fa-99fd85737a0a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:55.185608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-215905ea-a8b3-4018-904e-86fa7bd4c2a7 None None] MFA Rules not processed for user `3781c1799c3f419aad5a8c1f21e40d88`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:55.187219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-215905ea-a8b3-4018-904e-86fa7bd4c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:55.190199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81edde11-715b-4f10-91fa-99fd85737a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b483f3b70c4837908fb151f66bf505', 'request_id': 'req-81edde11-715b-4f10-91fa-99fd85737a0a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:55.204818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81edde11-715b-4f10-91fa-99fd85737a0a admin admin] The token cache is being invalidate because project 27b483f3b70c4837908fb151f66bf505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:40:55.205362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81edde11-715b-4f10-91fa-99fd85737a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:55.206301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81edde11-715b-4f10-91fa-99fd85737a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:55.208733 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2464/4916] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:40:54 2022] DELETE /identity/v3/projects/27b483f3b70c4837908fb151f66bf505 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:55.209753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edde11-715b-4f10-91fa-99fd85737a0a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:55.211722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-81edde11-715b-4f10-91fa-99fd85737a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:55.262028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:55.275636 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2453/4917] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:55.280794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712efba-017d-43c1-83ce-67f9bca805a4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:55.281295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712efba-017d-43c1-83ce-67f9bca805a4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:55.281662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712efba-017d-43c1-83ce-67f9bca805a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:55.296101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edde11-715b-4f10-91fa-99fd85737a0a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:55.303714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0712efba-017d-43c1-83ce-67f9bca805a4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:55.304569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836bd6a-a2aa-4530-b3f4-03b5c5a5594d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:55.305057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0712efba-017d-43c1-83ce-67f9bca805a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:55.305551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836bd6a-a2aa-4530-b3f4-03b5c5a5594d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:55.305987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836bd6a-a2aa-4530-b3f4-03b5c5a5594d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:55.306395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836bd6a-a2aa-4530-b3f4-03b5c5a5594d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:55.307200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836bd6a-a2aa-4530-b3f4-03b5c5a5594d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:55.309085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836bd6a-a2aa-4530-b3f4-03b5c5a5594d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:55.313611 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2454/4918] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:55.320574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712efba-017d-43c1-83ce-67f9bca805a4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:55.321874 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2465/4919] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:40:55.321991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0712efba-017d-43c1-83ce-67f9bca805a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:55.323406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81c98-ce91-408a-9584-4bd158325a3b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:55.323690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81c98-ce91-408a-9584-4bd158325a3b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:55.323966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81c98-ce91-408a-9584-4bd158325a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:55.349508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dbd81c98-ce91-408a-9584-4bd158325a3b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:55.350781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dbd81c98-ce91-408a-9584-4bd158325a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:55.362954 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2466/4920] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:55.363629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81c98-ce91-408a-9584-4bd158325a3b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:55.373833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81c98-ce91-408a-9584-4bd158325a3b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:55.379111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4042b-2dd5-4fae-b009-f338ebaa3376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:55.379850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4042b-2dd5-4fae-b009-f338ebaa3376 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:55.380234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4042b-2dd5-4fae-b009-f338ebaa3376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:55.380667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4042b-2dd5-4fae-b009-f338ebaa3376 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:55.381448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4042b-2dd5-4fae-b009-f338ebaa3376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:55.384045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4042b-2dd5-4fae-b009-f338ebaa3376 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:55.395684 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2467/4921] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:40:55.401019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4042b-2dd5-4fae-b009-f338ebaa3376 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:55.409691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712efba-017d-43c1-83ce-67f9bca805a4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:55.411847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4042b-2dd5-4fae-b009-f338ebaa3376 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:55.415857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3577cc-197f-4f6d-b956-dac53fa2e660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:55.416565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3577cc-197f-4f6d-b956-dac53fa2e660 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:55.416847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3577cc-197f-4f6d-b956-dac53fa2e660 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:55.417128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3577cc-197f-4f6d-b956-dac53fa2e660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:55.417314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7c140-0e95-4659-ad23-2332859feeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:55.418018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7c140-0e95-4659-ad23-2332859feeb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:55.418506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7c140-0e95-4659-ad23-2332859feeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:55.418865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6f3577cc-197f-4f6d-b956-dac53fa2e660 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:55.418963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7c140-0e95-4659-ad23-2332859feeb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:55.419722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7c140-0e95-4659-ad23-2332859feeb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:55.420142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7c140-0e95-4659-ad23-2332859feeb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:55.421825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7c140-0e95-4659-ad23-2332859feeb4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:55.430626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3577cc-197f-4f6d-b956-dac53fa2e660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:55.432311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3577cc-197f-4f6d-b956-dac53fa2e660 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:55.440290 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2468/4922] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:55.447212 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2455/4923] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:40:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:40:55.447961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3577cc-197f-4f6d-b956-dac53fa2e660 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:55.460406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7c140-0e95-4659-ad23-2332859feeb4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:55.460917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3577cc-197f-4f6d-b956-dac53fa2e660 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:55.465926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27190a9e-19bd-459b-a578-2d9a711796b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:55.466533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27190a9e-19bd-459b-a578-2d9a711796b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:55.466811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27190a9e-19bd-459b-a578-2d9a711796b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:55.467084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27190a9e-19bd-459b-a578-2d9a711796b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:55.468099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27190a9e-19bd-459b-a578-2d9a711796b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:55.470839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27190a9e-19bd-459b-a578-2d9a711796b3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:55.474730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7c140-0e95-4659-ad23-2332859feeb4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:55.480047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdd2ec-5277-4766-9edc-47ea48719056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:55.480910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdd2ec-5277-4766-9edc-47ea48719056 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:55.481266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdd2ec-5277-4766-9edc-47ea48719056 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:55.481749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdd2ec-5277-4766-9edc-47ea48719056 admin admin] PATH_INFO: `/v3/projects/abd3d2eb8d3a461a923ef424b4b651d9/users/8ed50d414dc14715bfdade9ce2e7ee52/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:55.502132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdd2ec-5277-4766-9edc-47ea48719056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd3d2eb8d3a461a923ef424b4b651d9, user_id=8ed50d414dc14715bfdade9ce2e7ee52, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:55.505165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdd2ec-5277-4766-9edc-47ea48719056 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:55.518068 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2456/4924] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:40:55 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:55.524506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27190a9e-19bd-459b-a578-2d9a711796b3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:55.525189 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2469/4925] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:40:55 2022] PUT /identity/v3/projects/abd3d2eb8d3a461a923ef424b4b651d9/users/8ed50d414dc14715bfdade9ce2e7ee52/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:55.531878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038fecd-786c-4849-b72b-586aabed39bf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:55.531878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038fecd-786c-4849-b72b-586aabed39bf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:55.531878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038fecd-786c-4849-b72b-586aabed39bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:55.558136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c038fecd-786c-4849-b72b-586aabed39bf None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:55.559822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c038fecd-786c-4849-b72b-586aabed39bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:55.642787 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2470/4926] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:40:55.645113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:55.652025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038fecd-786c-4849-b72b-586aabed39bf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:55.653895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c038fecd-786c-4849-b72b-586aabed39bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:55.654972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27190a9e-19bd-459b-a578-2d9a711796b3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:55.661026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dbc5d-9c50-4867-8346-eaf2bc264be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:55.661668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dbc5d-9c50-4867-8346-eaf2bc264be5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:55.661952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dbc5d-9c50-4867-8346-eaf2bc264be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:55.662348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dbc5d-9c50-4867-8346-eaf2bc264be5 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:55.663380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dbc5d-9c50-4867-8346-eaf2bc264be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:55.666036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dbc5d-9c50-4867-8346-eaf2bc264be5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:55.703665 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2457/4927] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:40:55 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:40:55.704689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dbc5d-9c50-4867-8346-eaf2bc264be5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:55.721347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dbc5d-9c50-4867-8346-eaf2bc264be5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:55.734969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f4935-11e6-4d94-b995-1ba664891dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:55.735842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f4935-11e6-4d94-b995-1ba664891dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:55.736240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f4935-11e6-4d94-b995-1ba664891dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:55.736617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f4935-11e6-4d94-b995-1ba664891dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:55.737449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f4935-11e6-4d94-b995-1ba664891dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:55.740792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f4935-11e6-4d94-b995-1ba664891dd2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:55.765119 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2458/4928] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:40:55.767921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f4935-11e6-4d94-b995-1ba664891dd2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:55.771915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038fecd-786c-4849-b72b-586aabed39bf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:55.782076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8a05e-3e74-45ad-9658-36d9de1c5426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:55.784165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8a05e-3e74-45ad-9658-36d9de1c5426 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:55.784407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8a05e-3e74-45ad-9658-36d9de1c5426 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:55.785946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8a05e-3e74-45ad-9658-36d9de1c5426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:55.792241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f4935-11e6-4d94-b995-1ba664891dd2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:55.807730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80973563-10ae-48d2-9d66-019965cf27ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:55.812096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80973563-10ae-48d2-9d66-019965cf27ee admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:55.813003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80973563-10ae-48d2-9d66-019965cf27ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:55.813563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80973563-10ae-48d2-9d66-019965cf27ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:55.815247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80973563-10ae-48d2-9d66-019965cf27ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:55.815732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8a05e-3e74-45ad-9658-36d9de1c5426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:55.818308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8a05e-3e74-45ad-9658-36d9de1c5426 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:55.819691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80973563-10ae-48d2-9d66-019965cf27ee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:55.838914 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2471/4929] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:40:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:40:55.879374 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2459/4930] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:40:55.893266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8a05e-3e74-45ad-9658-36d9de1c5426 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:55.913643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8a05e-3e74-45ad-9658-36d9de1c5426 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:55.926605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7410c97-4378-44cc-99ee-f54fe7e06812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:55.927487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7410c97-4378-44cc-99ee-f54fe7e06812 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:55.927881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7410c97-4378-44cc-99ee-f54fe7e06812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:55.928315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7410c97-4378-44cc-99ee-f54fe7e06812 admin admin] PATH_INFO: `/v3/projects/6c2c29c39d2d43e7bdf82d7f29b796e9/users/571115ae9fe64cfb8fba7cd0b09c4bb6/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:55.974435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7410c97-4378-44cc-99ee-f54fe7e06812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2c29c39d2d43e7bdf82d7f29b796e9, user_id=571115ae9fe64cfb8fba7cd0b09c4bb6, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:55.982118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7410c97-4378-44cc-99ee-f54fe7e06812 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:55.993757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:56.032734 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2472/4931] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:40:55 2022] PUT /identity/v3/projects/6c2c29c39d2d43e7bdf82d7f29b796e9/users/571115ae9fe64cfb8fba7cd0b09c4bb6/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:56.033547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32aabd-ce67-4576-8dcb-028b8045c30c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:56.033931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32aabd-ce67-4576-8dcb-028b8045c30c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:56.034291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32aabd-ce67-4576-8dcb-028b8045c30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:56.102086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5e32aabd-ce67-4576-8dcb-028b8045c30c None None] MFA Rules not processed for user `571115ae9fe64cfb8fba7cd0b09c4bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:56.106831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5e32aabd-ce67-4576-8dcb-028b8045c30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:56.243766 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2460/4932] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:56.248143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7410c97-4378-44cc-99ee-f54fe7e06812 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:56.359999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7410c97-4378-44cc-99ee-f54fe7e06812 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:56.371317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbfdda-f4a2-4fd5-b546-09428adbf121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:56.372016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbfdda-f4a2-4fd5-b546-09428adbf121 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:56.372341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbfdda-f4a2-4fd5-b546-09428adbf121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:56.372657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbfdda-f4a2-4fd5-b546-09428adbf121 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:56.373324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbfdda-f4a2-4fd5-b546-09428adbf121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:56.376950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbfdda-f4a2-4fd5-b546-09428adbf121 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:56.432489 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2473/4933] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:40:56 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:56.436592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32aabd-ce67-4576-8dcb-028b8045c30c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:56.448423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32aabd-ce67-4576-8dcb-028b8045c30c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:56.538311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ec532-293c-41ae-9d3c-f650c03d10cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:56.538959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ec532-293c-41ae-9d3c-f650c03d10cc admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:56.539244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ec532-293c-41ae-9d3c-f650c03d10cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:56.539640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ec532-293c-41ae-9d3c-f650c03d10cc admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:56.540476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ec532-293c-41ae-9d3c-f650c03d10cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:56.542680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ec532-293c-41ae-9d3c-f650c03d10cc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:56.575662 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2461/4934] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:40:56 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:40:56.579675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbfdda-f4a2-4fd5-b546-09428adbf121 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:56.591355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbfdda-f4a2-4fd5-b546-09428adbf121 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:56.597155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4169ae-47a2-4bd1-bf4d-f3d10f8a91d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:56.598357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4169ae-47a2-4bd1-bf4d-f3d10f8a91d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:56.598665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4169ae-47a2-4bd1-bf4d-f3d10f8a91d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:56.598945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4169ae-47a2-4bd1-bf4d-f3d10f8a91d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:56.600029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4169ae-47a2-4bd1-bf4d-f3d10f8a91d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:56.601678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4169ae-47a2-4bd1-bf4d-f3d10f8a91d7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:56.616219 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2474/4935] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:40:56.620979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ec532-293c-41ae-9d3c-f650c03d10cc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:56.634560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ec532-293c-41ae-9d3c-f650c03d10cc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:56.642267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb056cd-2d79-4897-bc2e-be3cc871d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:56.643114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb056cd-2d79-4897-bc2e-be3cc871d454 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:56.643672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb056cd-2d79-4897-bc2e-be3cc871d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:56.644222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb056cd-2d79-4897-bc2e-be3cc871d454 admin admin] PATH_INFO: `/v3/projects/bd1d406e42dc4b8c8f323a188c0bbc84/users/3ba9f3c490f347fdace5b96de0991d55/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:56.662578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb056cd-2d79-4897-bc2e-be3cc871d454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1d406e42dc4b8c8f323a188c0bbc84, user_id=3ba9f3c490f347fdace5b96de0991d55, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:56.667634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb056cd-2d79-4897-bc2e-be3cc871d454 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:56.705671 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2462/4936] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:40:56 2022] PUT /identity/v3/projects/bd1d406e42dc4b8c8f323a188c0bbc84/users/3ba9f3c490f347fdace5b96de0991d55/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:56.709559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4169ae-47a2-4bd1-bf4d-f3d10f8a91d7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:56.726020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4169ae-47a2-4bd1-bf4d-f3d10f8a91d7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:56.894152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee94a1e-5bd5-4ffd-b0d7-8c09d2375094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:56.895136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee94a1e-5bd5-4ffd-b0d7-8c09d2375094 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:56.895525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee94a1e-5bd5-4ffd-b0d7-8c09d2375094 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:56.895812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee94a1e-5bd5-4ffd-b0d7-8c09d2375094 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:56.896508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee94a1e-5bd5-4ffd-b0d7-8c09d2375094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:56.898180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee94a1e-5bd5-4ffd-b0d7-8c09d2375094 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:56.911936 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2475/4937] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:40:56.916497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb056cd-2d79-4897-bc2e-be3cc871d454 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:56.933190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb056cd-2d79-4897-bc2e-be3cc871d454 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:56.946548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3816e6-cefe-4144-ba3c-83f6ad69cb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:56.948163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3816e6-cefe-4144-ba3c-83f6ad69cb24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:56.948451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3816e6-cefe-4144-ba3c-83f6ad69cb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:56.948739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3816e6-cefe-4144-ba3c-83f6ad69cb24 admin admin] PATH_INFO: `/v3/projects/bd1d406e42dc4b8c8f323a188c0bbc84/users/3ba9f3c490f347fdace5b96de0991d55/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:56.956375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3816e6-cefe-4144-ba3c-83f6ad69cb24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1d406e42dc4b8c8f323a188c0bbc84, user_id=3ba9f3c490f347fdace5b96de0991d55, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:56.961182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3816e6-cefe-4144-ba3c-83f6ad69cb24 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:56.992409 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2463/4938] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:40:56 2022] PUT /identity/v3/projects/bd1d406e42dc4b8c8f323a188c0bbc84/users/3ba9f3c490f347fdace5b96de0991d55/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:40:57.004029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc169f9-5f4c-474f-b197-465fc3f658b2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:57.004327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc169f9-5f4c-474f-b197-465fc3f658b2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:57.006671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc169f9-5f4c-474f-b197-465fc3f658b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:57.048274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8cc169f9-5f4c-474f-b197-465fc3f658b2 None None] MFA Rules not processed for user `3ba9f3c490f347fdace5b96de0991d55`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:57.049879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8cc169f9-5f4c-474f-b197-465fc3f658b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:57.182283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:57.216393 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2476/4939] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:57.221358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3816e6-cefe-4144-ba3c-83f6ad69cb24 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:57.232505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:57.243381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3816e6-cefe-4144-ba3c-83f6ad69cb24 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:57.261076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d19c6-1908-4206-9497-020504cda981 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:57.262590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d19c6-1908-4206-9497-020504cda981 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:57.263049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d19c6-1908-4206-9497-020504cda981 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:57.263781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d19c6-1908-4206-9497-020504cda981 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:57.264817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d19c6-1908-4206-9497-020504cda981 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:57.270072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d19c6-1908-4206-9497-020504cda981 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:57.298982 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2464/4940] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:40:57 2022] POST /identity/v3/services => generated 287 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:57.303508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc169f9-5f4c-474f-b197-465fc3f658b2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:57.315607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc169f9-5f4c-474f-b197-465fc3f658b2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:57.355091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade5b2f-fb38-4c03-965a-16c2e4f9d1fe tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:57.355352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade5b2f-fb38-4c03-965a-16c2e4f9d1fe tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:57.355773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade5b2f-fb38-4c03-965a-16c2e4f9d1fe tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:57.356062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade5b2f-fb38-4c03-965a-16c2e4f9d1fe tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:57.356864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade5b2f-fb38-4c03-965a-16c2e4f9d1fe tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:57.358024 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-aade5b2f-fb38-4c03-965a-16c2e4f9d1fe tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:40:57.358024 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:40:57.358024 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:40:57.359032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade5b2f-fb38-4c03-965a-16c2e4f9d1fe tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:57.376291 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2477/4941] 10.222.0.27 () {60 vars in 1213 bytes} [Sun Aug 28 18:40:57 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:57.379861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d19c6-1908-4206-9497-020504cda981 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:57.397862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d19c6-1908-4206-9497-020504cda981 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:57.404074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd19998-cd7e-4059-beef-89d6568e108b tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:57.404967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd19998-cd7e-4059-beef-89d6568e108b tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:57.405511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd19998-cd7e-4059-beef-89d6568e108b tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:57.407007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd19998-cd7e-4059-beef-89d6568e108b tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:57.408025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd19998-cd7e-4059-beef-89d6568e108b tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:57.410018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd19998-cd7e-4059-beef-89d6568e108b tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:57.441095 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2465/4942] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:40:57 2022] POST /identity/v3/services => generated 289 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:57.444051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade5b2f-fb38-4c03-965a-16c2e4f9d1fe tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:57.456686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade5b2f-fb38-4c03-965a-16c2e4f9d1fe tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:57.480246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89e9c7-d4bb-4050-87bd-b758f9443341 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:57.481308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89e9c7-d4bb-4050-87bd-b758f9443341 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:57.482450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89e9c7-d4bb-4050-87bd-b758f9443341 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:57.483368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89e9c7-d4bb-4050-87bd-b758f9443341 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:57.484412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89e9c7-d4bb-4050-87bd-b758f9443341 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:57.486533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89e9c7-d4bb-4050-87bd-b758f9443341 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:57.503174 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2478/4943] 10.222.0.27 () {60 vars in 1213 bytes} [Sun Aug 28 18:40:57 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 331 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:57.507973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd19998-cd7e-4059-beef-89d6568e108b tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:57.526961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd19998-cd7e-4059-beef-89d6568e108b tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:57.535517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7544f7-e094-4dd5-ae16-cd4e3269160e tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:57.537085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7544f7-e094-4dd5-ae16-cd4e3269160e tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:57.537541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7544f7-e094-4dd5-ae16-cd4e3269160e tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:57.537985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7544f7-e094-4dd5-ae16-cd4e3269160e tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:57.538870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7544f7-e094-4dd5-ae16-cd4e3269160e tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:57.540462 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-dd7544f7-e094-4dd5-ae16-cd4e3269160e tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:40:57.540462 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:40:57.540462 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:40:57.541799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7544f7-e094-4dd5-ae16-cd4e3269160e tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:57.554373 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2466/4944] 10.222.0.27 () {58 vars in 1191 bytes} [Sun Aug 28 18:40:57 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 761 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:57.555806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89e9c7-d4bb-4050-87bd-b758f9443341 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:57.580978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89e9c7-d4bb-4050-87bd-b758f9443341 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:57.600869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81f8b3-f256-49e7-b5e4-6f6826b32f58 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:57.603126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81f8b3-f256-49e7-b5e4-6f6826b32f58 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:57.603759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81f8b3-f256-49e7-b5e4-6f6826b32f58 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:57.604329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81f8b3-f256-49e7-b5e4-6f6826b32f58 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/4decee3a472440b4ab29ca0d33781399` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:57.605204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81f8b3-f256-49e7-b5e4-6f6826b32f58 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=4decee3a472440b4ab29ca0d33781399)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:57.607156 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-ef81f8b3-f256-49e7-b5e4-6f6826b32f58 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:40:57.607156 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:40:57.607156 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:40:57.608667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81f8b3-f256-49e7-b5e4-6f6826b32f58 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:57.621123 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2479/4945] 10.222.0.27 () {58 vars in 1290 bytes} [Sun Aug 28 18:40:57 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/4decee3a472440b4ab29ca0d33781399 => generated 331 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:40:57.625223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7544f7-e094-4dd5-ae16-cd4e3269160e tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:57.653695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7544f7-e094-4dd5-ae16-cd4e3269160e tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:57.667924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f7d20-c181-4332-ba93-343ce016d055 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:57.672295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f7d20-c181-4332-ba93-343ce016d055 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:57.672796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f7d20-c181-4332-ba93-343ce016d055 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:57.673713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f7d20-c181-4332-ba93-343ce016d055 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/4decee3a472440b4ab29ca0d33781399` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:57.677252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f7d20-c181-4332-ba93-343ce016d055 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=4decee3a472440b4ab29ca0d33781399)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:57.678310 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-d08f7d20-c181-4332-ba93-343ce016d055 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:40:57.678310 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:40:57.678310 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:40:57.679248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f7d20-c181-4332-ba93-343ce016d055 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:57.701554 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2467/4946] 10.222.0.27 () {58 vars in 1291 bytes} [Sun Aug 28 18:40:57 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/4decee3a472440b4ab29ca0d33781399 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 28 18:40:57.702517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81f8b3-f256-49e7-b5e4-6f6826b32f58 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:57.715118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81f8b3-f256-49e7-b5e4-6f6826b32f58 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:57.733927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754a081-c017-47ca-accb-4d8d28cee9b6 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:57.735072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754a081-c017-47ca-accb-4d8d28cee9b6 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:57.735616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754a081-c017-47ca-accb-4d8d28cee9b6 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:57.736144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754a081-c017-47ca-accb-4d8d28cee9b6 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/4decee3a472440b4ab29ca0d33781399` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:57.737004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754a081-c017-47ca-accb-4d8d28cee9b6 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=4decee3a472440b4ab29ca0d33781399)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:57.738249 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-b754a081-c017-47ca-accb-4d8d28cee9b6 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:40:57.738249 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:40:57.738249 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:40:57.740768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754a081-c017-47ca-accb-4d8d28cee9b6 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:57.755499 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2480/4947] 10.222.0.27 () {58 vars in 1293 bytes} [Sun Aug 28 18:40:57 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/4decee3a472440b4ab29ca0d33781399 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:40:57.760457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f7d20-c181-4332-ba93-343ce016d055 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:57.787349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f7d20-c181-4332-ba93-343ce016d055 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:57.800297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a8e9e-904b-49b1-aa3a-df625e03735e tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:57.801942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a8e9e-904b-49b1-aa3a-df625e03735e tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:57.802299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a8e9e-904b-49b1-aa3a-df625e03735e tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:57.802690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a8e9e-904b-49b1-aa3a-df625e03735e tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:57.804122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a8e9e-904b-49b1-aa3a-df625e03735e tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:57.805881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a8e9e-904b-49b1-aa3a-df625e03735e tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:57.812105 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2468/4948] 10.222.0.27 () {58 vars in 1191 bytes} [Sun Aug 28 18:40:57 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 449 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:57.816219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754a081-c017-47ca-accb-4d8d28cee9b6 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:57.832909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754a081-c017-47ca-accb-4d8d28cee9b6 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:57.843753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df473c24-eb30-44e6-b29f-f7a874e374d8 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:57.847168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df473c24-eb30-44e6-b29f-f7a874e374d8 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:57.847649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df473c24-eb30-44e6-b29f-f7a874e374d8 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:57.848652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df473c24-eb30-44e6-b29f-f7a874e374d8 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/4decee3a472440b4ab29ca0d33781399` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:57.849441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df473c24-eb30-44e6-b29f-f7a874e374d8 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=4decee3a472440b4ab29ca0d33781399)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:57.854156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df473c24-eb30-44e6-b29f-f7a874e374d8 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:57.885478 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-df473c24-eb30-44e6-b29f-f7a874e374d8 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Could not find Endpoint Group: 4decee3a472440b4ab29ca0d33781399.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 4decee3a472440b4ab29ca0d33781399. Aug 28 18:40:57.885478 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:40:57.885478 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:40:57.885478 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:40:57.885478 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:40:57.885478 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:40:57.885478 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:40:57.885478 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:40:57.885478 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:40:57.885478 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:40:57.885478 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:40:57.885478 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:40:57.885478 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Aug 28 18:40:57.885478 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Aug 28 18:40:57.886735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Aug 28 18:40:57.886735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Aug 28 18:40:57.886735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Aug 28 18:40:57.886735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Aug 28 18:40:57.886735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 4decee3a472440b4ab29ca0d33781399. Aug 28 18:40:57.886735 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:40:57.891161 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2481/4949] 10.222.0.27 () {58 vars in 1293 bytes} [Sun Aug 28 18:40:57 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/4decee3a472440b4ab29ca0d33781399 => generated 120 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:40:57.895406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a8e9e-904b-49b1-aa3a-df625e03735e tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:57.915062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a8e9e-904b-49b1-aa3a-df625e03735e tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:57.935485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fb142-06c9-43e0-ae22-5a94f3cd5f88 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:57.937463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fb142-06c9-43e0-ae22-5a94f3cd5f88 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:57.937759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fb142-06c9-43e0-ae22-5a94f3cd5f88 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:57.938040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fb142-06c9-43e0-ae22-5a94f3cd5f88 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/services/3d15591c56e04b00bcd388dcac95a9d4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:57.939013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fb142-06c9-43e0-ae22-5a94f3cd5f88 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3d15591c56e04b00bcd388dcac95a9d4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:57.947036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fb142-06c9-43e0-ae22-5a94f3cd5f88 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:58.029355 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2469/4950] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:40:57 2022] DELETE /identity/v3/services/3d15591c56e04b00bcd388dcac95a9d4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:58.034692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df473c24-eb30-44e6-b29f-f7a874e374d8 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:58.063490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df473c24-eb30-44e6-b29f-f7a874e374d8 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:58.140106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcc028-d258-4f3e-bbfc-eb69ad2aae9f tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:58.142233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcc028-d258-4f3e-bbfc-eb69ad2aae9f tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:58.142357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcc028-d258-4f3e-bbfc-eb69ad2aae9f tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:58.142621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcc028-d258-4f3e-bbfc-eb69ad2aae9f tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:58.148413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcc028-d258-4f3e-bbfc-eb69ad2aae9f tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:58.150147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcc028-d258-4f3e-bbfc-eb69ad2aae9f tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:58.194370 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2482/4951] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:40:58 2022] POST /identity/v3/services => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:58.199511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fb142-06c9-43e0-ae22-5a94f3cd5f88 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:58.225605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fb142-06c9-43e0-ae22-5a94f3cd5f88 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:58.271452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b06c6-4039-42f8-9fde-ebd44604fe2f tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:58.272107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b06c6-4039-42f8-9fde-ebd44604fe2f tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:58.272409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b06c6-4039-42f8-9fde-ebd44604fe2f tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:58.277427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b06c6-4039-42f8-9fde-ebd44604fe2f tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:58.279507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b06c6-4039-42f8-9fde-ebd44604fe2f tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:58.286820 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-758b06c6-4039-42f8-9fde-ebd44604fe2f tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:40:58.286820 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:40:58.286820 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:40:58.291100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b06c6-4039-42f8-9fde-ebd44604fe2f tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:58.325841 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2470/4952] 10.222.0.27 () {60 vars in 1213 bytes} [Sun Aug 28 18:40:58 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:58.329973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcc028-d258-4f3e-bbfc-eb69ad2aae9f tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:58.348253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcc028-d258-4f3e-bbfc-eb69ad2aae9f tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:58.357693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7cc15-4c1e-4aa9-803a-4289403022f6 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:58.358344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7cc15-4c1e-4aa9-803a-4289403022f6 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:58.359181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7cc15-4c1e-4aa9-803a-4289403022f6 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:58.362260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7cc15-4c1e-4aa9-803a-4289403022f6 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:58.362985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7cc15-4c1e-4aa9-803a-4289403022f6 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:58.369291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7cc15-4c1e-4aa9-803a-4289403022f6 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:58.434362 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2483/4953] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:40:58 2022] POST /identity/v3/services => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:58.437904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b06c6-4039-42f8-9fde-ebd44604fe2f tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:58.463643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b06c6-4039-42f8-9fde-ebd44604fe2f tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:58.524147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a6783-1024-420c-a115-3f65a74d5e89 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:58.524828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a6783-1024-420c-a115-3f65a74d5e89 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:58.525116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a6783-1024-420c-a115-3f65a74d5e89 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:58.525399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a6783-1024-420c-a115-3f65a74d5e89 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f185c4c4a8e34e99a78d7d1219feea7e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:58.526105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a6783-1024-420c-a115-3f65a74d5e89 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=f185c4c4a8e34e99a78d7d1219feea7e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:58.527141 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-527a6783-1024-420c-a115-3f65a74d5e89 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:40:58.527141 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:40:58.527141 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:40:58.528096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a6783-1024-420c-a115-3f65a74d5e89 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:58.578792 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2471/4954] 10.222.0.27 () {60 vars in 1313 bytes} [Sun Aug 28 18:40:58 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/f185c4c4a8e34e99a78d7d1219feea7e => generated 336 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:58.582795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7cc15-4c1e-4aa9-803a-4289403022f6 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:58.604619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7cc15-4c1e-4aa9-803a-4289403022f6 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:58.635188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f73ffc-e0f6-4374-9f87-3f274bb48bf9 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:58.635929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f73ffc-e0f6-4374-9f87-3f274bb48bf9 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:58.636218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f73ffc-e0f6-4374-9f87-3f274bb48bf9 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:58.647776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f73ffc-e0f6-4374-9f87-3f274bb48bf9 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/services/3490ca38302a48a6bf782ba6f183ab56` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:58.648971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f73ffc-e0f6-4374-9f87-3f274bb48bf9 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3490ca38302a48a6bf782ba6f183ab56)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:58.657884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f73ffc-e0f6-4374-9f87-3f274bb48bf9 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:58.697751 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2484/4955] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:40:58 2022] DELETE /identity/v3/services/3490ca38302a48a6bf782ba6f183ab56 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:58.701729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a6783-1024-420c-a115-3f65a74d5e89 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:58.717723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a6783-1024-420c-a115-3f65a74d5e89 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:58.767290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7a413-23a2-488f-a709-1360b7c018a4 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:58.768015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7a413-23a2-488f-a709-1360b7c018a4 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:58.768314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7a413-23a2-488f-a709-1360b7c018a4 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:58.768596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7a413-23a2-488f-a709-1360b7c018a4 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f185c4c4a8e34e99a78d7d1219feea7e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:58.769193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7a413-23a2-488f-a709-1360b7c018a4 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=f185c4c4a8e34e99a78d7d1219feea7e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:58.770268 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-6fe7a413-23a2-488f-a709-1360b7c018a4 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:40:58.770268 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:40:58.770268 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:40:58.771131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7a413-23a2-488f-a709-1360b7c018a4 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:58.798732 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2472/4956] 10.222.0.27 () {58 vars in 1293 bytes} [Sun Aug 28 18:40:58 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/f185c4c4a8e34e99a78d7d1219feea7e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:58.802914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f73ffc-e0f6-4374-9f87-3f274bb48bf9 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:58.818946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f73ffc-e0f6-4374-9f87-3f274bb48bf9 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:58.835330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991a944-9f24-4946-901c-39f997f366dd tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:58.836386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991a944-9f24-4946-901c-39f997f366dd tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:58.836745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991a944-9f24-4946-901c-39f997f366dd tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:58.837111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991a944-9f24-4946-901c-39f997f366dd tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/services/d45f3dca840a4aa2b80952eda4e851d9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:58.837773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991a944-9f24-4946-901c-39f997f366dd tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d45f3dca840a4aa2b80952eda4e851d9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:58.840326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991a944-9f24-4946-901c-39f997f366dd tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:58.892896 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2485/4957] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:40:58 2022] DELETE /identity/v3/services/d45f3dca840a4aa2b80952eda4e851d9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:58.897538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7a413-23a2-488f-a709-1360b7c018a4 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:58.916087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7a413-23a2-488f-a709-1360b7c018a4 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:58.960120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd9701-0046-4d02-8273-762dfc458b74 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:58.961083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd9701-0046-4d02-8273-762dfc458b74 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:58.961362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd9701-0046-4d02-8273-762dfc458b74 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:58.961650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd9701-0046-4d02-8273-762dfc458b74 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/41dda267a8ee449685d212b77d0da0c6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:58.962234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd9701-0046-4d02-8273-762dfc458b74 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=41dda267a8ee449685d212b77d0da0c6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:58.967021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd9701-0046-4d02-8273-762dfc458b74 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:58.987571 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2473/4958] 10.222.0.27 () {58 vars in 1293 bytes} [Sun Aug 28 18:40:58 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/41dda267a8ee449685d212b77d0da0c6 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:58.992242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991a944-9f24-4946-901c-39f997f366dd tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:59.009045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991a944-9f24-4946-901c-39f997f366dd tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:59.023909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07717fe2-52df-45fa-88b0-5844d5c8a9d3 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ba9f3c490f347fdace5b96de0991d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:59.024729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07717fe2-52df-45fa-88b0-5844d5c8a9d3 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:59.025136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07717fe2-52df-45fa-88b0-5844d5c8a9d3 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:59.025515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07717fe2-52df-45fa-88b0-5844d5c8a9d3 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] PATH_INFO: `/v3/services/1aa47c46c79c420fbf7c458455fde7ab` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:59.026214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07717fe2-52df-45fa-88b0-5844d5c8a9d3 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1aa47c46c79c420fbf7c458455fde7ab)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:59.027970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07717fe2-52df-45fa-88b0-5844d5c8a9d3 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:59.102009 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2486/4959] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:40:58 2022] DELETE /identity/v3/services/1aa47c46c79c420fbf7c458455fde7ab => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:59.105941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd9701-0046-4d02-8273-762dfc458b74 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:59.274651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:59.280236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd9701-0046-4d02-8273-762dfc458b74 tempest-EndPointGroupsTest-1917915278 tempest-EndPointGroupsTest-1917915278-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:59.311876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe592a5-fd61-4438-90e4-4bb288a6ac54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:59.312726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe592a5-fd61-4438-90e4-4bb288a6ac54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:59.313165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe592a5-fd61-4438-90e4-4bb288a6ac54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:59.313448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe592a5-fd61-4438-90e4-4bb288a6ac54 admin admin] PATH_INFO: `/v3/users/571115ae9fe64cfb8fba7cd0b09c4bb6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:59.315082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe592a5-fd61-4438-90e4-4bb288a6ac54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571115ae9fe64cfb8fba7cd0b09c4bb6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:59.318974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe592a5-fd61-4438-90e4-4bb288a6ac54 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:59.430132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7fe592a5-fd61-4438-90e4-4bb288a6ac54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571115ae9fe64cfb8fba7cd0b09c4bb6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:59.452001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7fe592a5-fd61-4438-90e4-4bb288a6ac54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571115ae9fe64cfb8fba7cd0b09c4bb6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:59.452829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7fe592a5-fd61-4438-90e4-4bb288a6ac54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571115ae9fe64cfb8fba7cd0b09c4bb6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:59.453557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7fe592a5-fd61-4438-90e4-4bb288a6ac54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571115ae9fe64cfb8fba7cd0b09c4bb6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:59.466663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7fe592a5-fd61-4438-90e4-4bb288a6ac54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571115ae9fe64cfb8fba7cd0b09c4bb6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:40:59.535864 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2474/4960] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:40:59 2022] DELETE /identity/v3/users/571115ae9fe64cfb8fba7cd0b09c4bb6 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:59.538231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68839d79-b31b-4b54-a978-84a1127d853e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:59.538767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68839d79-b31b-4b54-a978-84a1127d853e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:59.539141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68839d79-b31b-4b54-a978-84a1127d853e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:59.578183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-68839d79-b31b-4b54-a978-84a1127d853e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:59.579997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68839d79-b31b-4b54-a978-84a1127d853e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:59.688889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:59.766930 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2487/4961] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:40:59.799157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe592a5-fd61-4438-90e4-4bb288a6ac54 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:59.803237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7fe592a5-fd61-4438-90e4-4bb288a6ac54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:00.020298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe592a5-fd61-4438-90e4-4bb288a6ac54 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:00.034053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168dfeb-6abe-4dff-8863-292d6e767998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:00.034696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168dfeb-6abe-4dff-8863-292d6e767998 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:00.034977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168dfeb-6abe-4dff-8863-292d6e767998 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:00.035278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168dfeb-6abe-4dff-8863-292d6e767998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:00.064272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168dfeb-6abe-4dff-8863-292d6e767998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:00.065869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168dfeb-6abe-4dff-8863-292d6e767998 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:00.087967 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2475/4962] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:00.920446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68839d79-b31b-4b54-a978-84a1127d853e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:00.921927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68839d79-b31b-4b54-a978-84a1127d853e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:00.945054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68839d79-b31b-4b54-a978-84a1127d853e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:00.954549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5992db-9e76-461c-bb32-f8a169050db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:00.955328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5992db-9e76-461c-bb32-f8a169050db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:00.955669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5992db-9e76-461c-bb32-f8a169050db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:00.955960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5992db-9e76-461c-bb32-f8a169050db3 admin admin] PATH_INFO: `/v3/projects/6c2c29c39d2d43e7bdf82d7f29b796e9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:00.961271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5992db-9e76-461c-bb32-f8a169050db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2c29c39d2d43e7bdf82d7f29b796e9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:00.963339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5992db-9e76-461c-bb32-f8a169050db3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:01.069906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc5992db-9e76-461c-bb32-f8a169050db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2c29c39d2d43e7bdf82d7f29b796e9', 'request_id': 'req-cc5992db-9e76-461c-bb32-f8a169050db3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:01.083664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc5992db-9e76-461c-bb32-f8a169050db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2c29c39d2d43e7bdf82d7f29b796e9', 'request_id': 'req-cc5992db-9e76-461c-bb32-f8a169050db3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:01.092738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc5992db-9e76-461c-bb32-f8a169050db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2c29c39d2d43e7bdf82d7f29b796e9', 'request_id': 'req-cc5992db-9e76-461c-bb32-f8a169050db3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:01.112628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc5992db-9e76-461c-bb32-f8a169050db3 admin admin] The token cache is being invalidate because project 6c2c29c39d2d43e7bdf82d7f29b796e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:01.113212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc5992db-9e76-461c-bb32-f8a169050db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:01.114207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc5992db-9e76-461c-bb32-f8a169050db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:01.116754 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2488/4963] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:00 2022] DELETE /identity/v3/projects/6c2c29c39d2d43e7bdf82d7f29b796e9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:01.120457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168dfeb-6abe-4dff-8863-292d6e767998 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:01.137988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168dfeb-6abe-4dff-8863-292d6e767998 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:01.258723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069314ea-f31f-4406-a120-e1d28d5606f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:01.260133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069314ea-f31f-4406-a120-e1d28d5606f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:01.260654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069314ea-f31f-4406-a120-e1d28d5606f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:01.261154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069314ea-f31f-4406-a120-e1d28d5606f5 admin admin] PATH_INFO: `/v3/users/3ba9f3c490f347fdace5b96de0991d55` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:01.263460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069314ea-f31f-4406-a120-e1d28d5606f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba9f3c490f347fdace5b96de0991d55)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:01.269718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069314ea-f31f-4406-a120-e1d28d5606f5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:01.275282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:01.370517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-069314ea-f31f-4406-a120-e1d28d5606f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba9f3c490f347fdace5b96de0991d55'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:01.396426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-069314ea-f31f-4406-a120-e1d28d5606f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba9f3c490f347fdace5b96de0991d55'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:01.397196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-069314ea-f31f-4406-a120-e1d28d5606f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba9f3c490f347fdace5b96de0991d55'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:01.398331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-069314ea-f31f-4406-a120-e1d28d5606f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba9f3c490f347fdace5b96de0991d55'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:01.415860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-069314ea-f31f-4406-a120-e1d28d5606f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba9f3c490f347fdace5b96de0991d55'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:01.440537 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2476/4964] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:01 2022] DELETE /identity/v3/users/3ba9f3c490f347fdace5b96de0991d55 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:02.424588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5992db-9e76-461c-bb32-f8a169050db3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:02.426189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cc5992db-9e76-461c-bb32-f8a169050db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:02.446336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5992db-9e76-461c-bb32-f8a169050db3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:02.583243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d836ddd-4472-47fd-a2bf-960138dd1fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:02.584224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d836ddd-4472-47fd-a2bf-960138dd1fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:02.584612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d836ddd-4472-47fd-a2bf-960138dd1fec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:02.584990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d836ddd-4472-47fd-a2bf-960138dd1fec admin admin] PATH_INFO: `/v3/projects/bd1d406e42dc4b8c8f323a188c0bbc84` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:02.587626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d836ddd-4472-47fd-a2bf-960138dd1fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1d406e42dc4b8c8f323a188c0bbc84)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:02.590570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d836ddd-4472-47fd-a2bf-960138dd1fec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:02.667425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d836ddd-4472-47fd-a2bf-960138dd1fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'request_id': 'req-3d836ddd-4472-47fd-a2bf-960138dd1fec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:02.684000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d836ddd-4472-47fd-a2bf-960138dd1fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'request_id': 'req-3d836ddd-4472-47fd-a2bf-960138dd1fec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:02.696591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:02.700039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d836ddd-4472-47fd-a2bf-960138dd1fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1d406e42dc4b8c8f323a188c0bbc84', 'request_id': 'req-3d836ddd-4472-47fd-a2bf-960138dd1fec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:02.718704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d836ddd-4472-47fd-a2bf-960138dd1fec admin admin] The token cache is being invalidate because project bd1d406e42dc4b8c8f323a188c0bbc84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:02.719509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d836ddd-4472-47fd-a2bf-960138dd1fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:02.720539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d836ddd-4472-47fd-a2bf-960138dd1fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:02.723912 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2489/4965] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:02 2022] DELETE /identity/v3/projects/bd1d406e42dc4b8c8f323a188c0bbc84 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:02.728654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc140e2-d4ca-49d7-a5d4-9a7e7fe1c0f5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:02.729231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc140e2-d4ca-49d7-a5d4-9a7e7fe1c0f5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:02.729231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc140e2-d4ca-49d7-a5d4-9a7e7fe1c0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:02.764051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6fc140e2-d4ca-49d7-a5d4-9a7e7fe1c0f5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:02.765506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6fc140e2-d4ca-49d7-a5d4-9a7e7fe1c0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:02.890742 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2477/4966] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:02.900994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc43130-95c7-45f0-b375-74476c46b393 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:02.901759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc43130-95c7-45f0-b375-74476c46b393 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:02.902142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc43130-95c7-45f0-b375-74476c46b393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:02.939597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5bc43130-95c7-45f0-b375-74476c46b393 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:02.941284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5bc43130-95c7-45f0-b375-74476c46b393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:02.959773 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2490/4967] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:02.964184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc140e2-d4ca-49d7-a5d4-9a7e7fe1c0f5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:02.975316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc140e2-d4ca-49d7-a5d4-9a7e7fe1c0f5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:02.981169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34acf7e-a287-4a76-aa67-5928c0e0ffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:02.982024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34acf7e-a287-4a76-aa67-5928c0e0ffdd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:02.982380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34acf7e-a287-4a76-aa67-5928c0e0ffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:02.982729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34acf7e-a287-4a76-aa67-5928c0e0ffdd admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:02.983734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34acf7e-a287-4a76-aa67-5928c0e0ffdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:02.985094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34acf7e-a287-4a76-aa67-5928c0e0ffdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:02.987028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34acf7e-a287-4a76-aa67-5928c0e0ffdd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:03.001773 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2478/4968] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:41:03.006081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc43130-95c7-45f0-b375-74476c46b393 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:03.016830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc43130-95c7-45f0-b375-74476c46b393 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:03.024540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76626930-ab36-43fe-80f3-23945534ed65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:03.025259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76626930-ab36-43fe-80f3-23945534ed65 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:03.025641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76626930-ab36-43fe-80f3-23945534ed65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:03.026035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76626930-ab36-43fe-80f3-23945534ed65 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:03.027023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76626930-ab36-43fe-80f3-23945534ed65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:03.029126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76626930-ab36-43fe-80f3-23945534ed65 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:03.082804 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2491/4969] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:03 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:03.087663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34acf7e-a287-4a76-aa67-5928c0e0ffdd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:03.101947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34acf7e-a287-4a76-aa67-5928c0e0ffdd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:03.252761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0caf7e3-035a-4f36-b875-b39681a172ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:03.253675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caf7e3-035a-4f36-b875-b39681a172ed admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:03.253962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caf7e3-035a-4f36-b875-b39681a172ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:03.257921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caf7e3-035a-4f36-b875-b39681a172ed admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:03.258644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0caf7e3-035a-4f36-b875-b39681a172ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:03.265449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0caf7e3-035a-4f36-b875-b39681a172ed admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:03.296902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:03.314482 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2479/4970] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:03 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:03.320759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76626930-ab36-43fe-80f3-23945534ed65 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:03.335683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf42c13-f96c-40f0-9eab-5654b2892fa2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:03.335683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf42c13-f96c-40f0-9eab-5654b2892fa2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:03.335683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf42c13-f96c-40f0-9eab-5654b2892fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:03.336754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76626930-ab36-43fe-80f3-23945534ed65 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:03.352289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8c58e-34ef-4f7d-ba7a-d296234cb90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:03.353242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8c58e-34ef-4f7d-ba7a-d296234cb90e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:03.353634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8c58e-34ef-4f7d-ba7a-d296234cb90e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:03.353980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8c58e-34ef-4f7d-ba7a-d296234cb90e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:03.354697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8c58e-34ef-4f7d-ba7a-d296234cb90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:03.356575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8c58e-34ef-4f7d-ba7a-d296234cb90e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:03.374584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-adf42c13-f96c-40f0-9eab-5654b2892fa2 None None] MFA Rules not processed for user `8ed50d414dc14715bfdade9ce2e7ee52`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:03.375672 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2492/4971] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:03.376111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-adf42c13-f96c-40f0-9eab-5654b2892fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:03.379385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8c58e-34ef-4f7d-ba7a-d296234cb90e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:03.400591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8c58e-34ef-4f7d-ba7a-d296234cb90e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:03.407765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a99b4-9e64-4cd8-9e41-a8caeaa0d6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:03.409052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a99b4-9e64-4cd8-9e41-a8caeaa0d6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:03.409520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a99b4-9e64-4cd8-9e41-a8caeaa0d6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:03.409989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a99b4-9e64-4cd8-9e41-a8caeaa0d6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:03.411531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a99b4-9e64-4cd8-9e41-a8caeaa0d6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:03.414003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a99b4-9e64-4cd8-9e41-a8caeaa0d6f5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:03.432961 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2493/4972] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:03.437110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a99b4-9e64-4cd8-9e41-a8caeaa0d6f5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:03.454129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a99b4-9e64-4cd8-9e41-a8caeaa0d6f5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:03.461697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25adc2f-7eae-48b7-b6c4-3d1b966d4aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:03.463023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25adc2f-7eae-48b7-b6c4-3d1b966d4aed admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:03.463566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25adc2f-7eae-48b7-b6c4-3d1b966d4aed admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:03.464035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25adc2f-7eae-48b7-b6c4-3d1b966d4aed admin admin] PATH_INFO: `/v3/projects/14decf146895451289c8863549d80425/users/6f7804f389ec4ff48ee3638d666b4c67/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:03.467712 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2480/4973] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:03.482599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25adc2f-7eae-48b7-b6c4-3d1b966d4aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=14decf146895451289c8863549d80425, user_id=6f7804f389ec4ff48ee3638d666b4c67, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:03.483525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf42c13-f96c-40f0-9eab-5654b2892fa2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:03.485218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-adf42c13-f96c-40f0-9eab-5654b2892fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:03.486912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25adc2f-7eae-48b7-b6c4-3d1b966d4aed admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:03.508376 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2494/4974] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:03 2022] PUT /identity/v3/projects/14decf146895451289c8863549d80425/users/6f7804f389ec4ff48ee3638d666b4c67/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:03.520960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7022-a732-4810-bc01-c123e1f1396f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:03.521360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7022-a732-4810-bc01-c123e1f1396f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:03.521709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7022-a732-4810-bc01-c123e1f1396f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:03.552364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d0ee7022-a732-4810-bc01-c123e1f1396f None None] MFA Rules not processed for user `6f7804f389ec4ff48ee3638d666b4c67`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:03.554038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d0ee7022-a732-4810-bc01-c123e1f1396f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:03.614350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf42c13-f96c-40f0-9eab-5654b2892fa2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:03.647207 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2495/4975] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:03.648288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee7022-a732-4810-bc01-c123e1f1396f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:03.698101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57226d89-9165-4a95-87e4-789251059857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:03.698730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57226d89-9165-4a95-87e4-789251059857 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:03.699564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57226d89-9165-4a95-87e4-789251059857 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:03.699854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57226d89-9165-4a95-87e4-789251059857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:03.717475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:03.726980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee7022-a732-4810-bc01-c123e1f1396f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:03.732206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9ea50-0e0a-413a-89bc-3fa340341355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:03.733083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9ea50-0e0a-413a-89bc-3fa340341355 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:03.733083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9ea50-0e0a-413a-89bc-3fa340341355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:03.733372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9ea50-0e0a-413a-89bc-3fa340341355 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:03.734021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9ea50-0e0a-413a-89bc-3fa340341355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:03.736036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9ea50-0e0a-413a-89bc-3fa340341355 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:03.749560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:03.770045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57226d89-9165-4a95-87e4-789251059857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:03.771704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57226d89-9165-4a95-87e4-789251059857 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:03.774547 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2496/4976] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:03 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:03.777690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9ea50-0e0a-413a-89bc-3fa340341355 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:03.782425 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2481/4977] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:41:03.863300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9ea50-0e0a-413a-89bc-3fa340341355 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:03.889683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319ee2e-dd92-48a3-818f-6a86ed714881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:03.890330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319ee2e-dd92-48a3-818f-6a86ed714881 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:03.890615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319ee2e-dd92-48a3-818f-6a86ed714881 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:03.890896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319ee2e-dd92-48a3-818f-6a86ed714881 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:03.891583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319ee2e-dd92-48a3-818f-6a86ed714881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:03.893995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319ee2e-dd92-48a3-818f-6a86ed714881 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:03.928703 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2497/4978] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:03 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:41:03.932451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57226d89-9165-4a95-87e4-789251059857 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:03.950562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57226d89-9165-4a95-87e4-789251059857 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:03.956391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375035a1-ddf7-4822-b12c-ec1bef2c0bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:03.957472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375035a1-ddf7-4822-b12c-ec1bef2c0bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:03.957472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375035a1-ddf7-4822-b12c-ec1bef2c0bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:03.957678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375035a1-ddf7-4822-b12c-ec1bef2c0bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:03.958311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375035a1-ddf7-4822-b12c-ec1bef2c0bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:03.960646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375035a1-ddf7-4822-b12c-ec1bef2c0bd8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:03.978093 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2482/4979] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:03.982178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319ee2e-dd92-48a3-818f-6a86ed714881 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:03.994936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319ee2e-dd92-48a3-818f-6a86ed714881 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:04.001661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968cbe8-743c-44d0-a1aa-2a93ac598a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:04.002739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968cbe8-743c-44d0-a1aa-2a93ac598a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:04.003098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968cbe8-743c-44d0-a1aa-2a93ac598a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:04.003528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968cbe8-743c-44d0-a1aa-2a93ac598a51 admin admin] PATH_INFO: `/v3/projects/927d7160ceab439e94e6f11167b699cb/users/5c3131e6557447a182013aa6d6887ef4/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:04.041448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968cbe8-743c-44d0-a1aa-2a93ac598a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=927d7160ceab439e94e6f11167b699cb, user_id=5c3131e6557447a182013aa6d6887ef4, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:04.045838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968cbe8-743c-44d0-a1aa-2a93ac598a51 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:04.082593 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2498/4980] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:03 2022] PUT /identity/v3/projects/927d7160ceab439e94e6f11167b699cb/users/5c3131e6557447a182013aa6d6887ef4/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:04.087009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375035a1-ddf7-4822-b12c-ec1bef2c0bd8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:04.099230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375035a1-ddf7-4822-b12c-ec1bef2c0bd8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:04.242951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306074d7-ab6b-4832-904a-e22310c9f65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:04.243796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306074d7-ab6b-4832-904a-e22310c9f65a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:04.244084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306074d7-ab6b-4832-904a-e22310c9f65a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:04.244384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306074d7-ab6b-4832-904a-e22310c9f65a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:04.245039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306074d7-ab6b-4832-904a-e22310c9f65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:04.246636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306074d7-ab6b-4832-904a-e22310c9f65a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:04.279049 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2483/4981] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:04.284630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968cbe8-743c-44d0-a1aa-2a93ac598a51 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:04.315701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968cbe8-743c-44d0-a1aa-2a93ac598a51 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:04.322340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0034f4-612a-4d4d-8b70-8ac4c69956da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:04.323194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0034f4-612a-4d4d-8b70-8ac4c69956da admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:04.323717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0034f4-612a-4d4d-8b70-8ac4c69956da admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:04.324096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0034f4-612a-4d4d-8b70-8ac4c69956da admin admin] PATH_INFO: `/v3/projects/927d7160ceab439e94e6f11167b699cb/users/5c3131e6557447a182013aa6d6887ef4/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:04.326719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0034f4-612a-4d4d-8b70-8ac4c69956da admin admin] RBAC: Authorizing `identity:create_grant(project_id=927d7160ceab439e94e6f11167b699cb, user_id=5c3131e6557447a182013aa6d6887ef4, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:04.330804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0034f4-612a-4d4d-8b70-8ac4c69956da admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:04.379738 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2499/4982] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:04 2022] PUT /identity/v3/projects/927d7160ceab439e94e6f11167b699cb/users/5c3131e6557447a182013aa6d6887ef4/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:04.382734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47ac94-c591-4ce0-9b54-fb8e78aa7545 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:04.383014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47ac94-c591-4ce0-9b54-fb8e78aa7545 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:04.384191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47ac94-c591-4ce0-9b54-fb8e78aa7545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:04.475520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-eb47ac94-c591-4ce0-9b54-fb8e78aa7545 None None] MFA Rules not processed for user `5c3131e6557447a182013aa6d6887ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:04.477205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eb47ac94-c591-4ce0-9b54-fb8e78aa7545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:04.611422 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2484/4983] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:04.612550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0034f4-612a-4d4d-8b70-8ac4c69956da admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:04.625597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0034f4-612a-4d4d-8b70-8ac4c69956da admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:04.645246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca2dee-b2ab-4b3d-98bf-23701f34fea4 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3131e6557447a182013aa6d6887ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927d7160ceab439e94e6f11167b699cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:04.646145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca2dee-b2ab-4b3d-98bf-23701f34fea4 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:04.646398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca2dee-b2ab-4b3d-98bf-23701f34fea4 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:04.646707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca2dee-b2ab-4b3d-98bf-23701f34fea4 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:04.647539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca2dee-b2ab-4b3d-98bf-23701f34fea4 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:04.651114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca2dee-b2ab-4b3d-98bf-23701f34fea4 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:04.685431 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2500/4984] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:04 2022] POST /identity/v3/projects => generated 334 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:04.689972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47ac94-c591-4ce0-9b54-fb8e78aa7545 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:04.700268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47ac94-c591-4ce0-9b54-fb8e78aa7545 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:04.726762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:04.770614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08455f75-219b-485b-b2f1-20b0ef1a76dd tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3131e6557447a182013aa6d6887ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927d7160ceab439e94e6f11167b699cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:04.772179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08455f75-219b-485b-b2f1-20b0ef1a76dd tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:04.772425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08455f75-219b-485b-b2f1-20b0ef1a76dd tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:04.772690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08455f75-219b-485b-b2f1-20b0ef1a76dd tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:04.774629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08455f75-219b-485b-b2f1-20b0ef1a76dd tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:04.779132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08455f75-219b-485b-b2f1-20b0ef1a76dd tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:04.830043 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2485/4985] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:41:04 2022] POST /identity/v3/projects => generated 333 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:41:04.834292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca2dee-b2ab-4b3d-98bf-23701f34fea4 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:04.854806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca2dee-b2ab-4b3d-98bf-23701f34fea4 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:04.942358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9642f74-4873-48e3-83cf-ff1830e0a768 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3131e6557447a182013aa6d6887ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927d7160ceab439e94e6f11167b699cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:04.943061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9642f74-4873-48e3-83cf-ff1830e0a768 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:04.943503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9642f74-4873-48e3-83cf-ff1830e0a768 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:04.943790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9642f74-4873-48e3-83cf-ff1830e0a768 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:04.944586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9642f74-4873-48e3-83cf-ff1830e0a768 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:04.946989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9642f74-4873-48e3-83cf-ff1830e0a768 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:04.986098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:05.001220 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2501/4986] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:04 2022] POST /identity/v3/projects => generated 357 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:41:05.005572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08455f75-219b-485b-b2f1-20b0ef1a76dd tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:05.018993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08455f75-219b-485b-b2f1-20b0ef1a76dd tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:05.087872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23c27c-029b-4476-8357-bec99816c317 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3131e6557447a182013aa6d6887ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927d7160ceab439e94e6f11167b699cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:05.088803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c27c-029b-4476-8357-bec99816c317 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:05.089936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c27c-029b-4476-8357-bec99816c317 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:05.089936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c27c-029b-4476-8357-bec99816c317 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:05.090140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23c27c-029b-4476-8357-bec99816c317 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:05.092249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23c27c-029b-4476-8357-bec99816c317 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:05.112458 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2486/4987] 10.222.0.27 () {58 vars in 1131 bytes} [Sun Aug 28 18:41:05 2022] GET /identity/v3/projects => generated 7227 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:05.117263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9642f74-4873-48e3-83cf-ff1830e0a768 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:05.133799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9642f74-4873-48e3-83cf-ff1830e0a768 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:05.141932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b81ea6-3ffb-42d3-9e8f-01082d5092eb tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3131e6557447a182013aa6d6887ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927d7160ceab439e94e6f11167b699cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:05.143583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b81ea6-3ffb-42d3-9e8f-01082d5092eb tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:05.144051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b81ea6-3ffb-42d3-9e8f-01082d5092eb tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:05.144482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b81ea6-3ffb-42d3-9e8f-01082d5092eb tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:05.145611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b81ea6-3ffb-42d3-9e8f-01082d5092eb tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:05.146660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b81ea6-3ffb-42d3-9e8f-01082d5092eb tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:05.151222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b81ea6-3ffb-42d3-9e8f-01082d5092eb tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:05.174308 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2502/4988] 10.222.0.27 () {58 vars in 1158 bytes} [Sun Aug 28 18:41:05 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:41:05.182547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23c27c-029b-4476-8357-bec99816c317 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:05.194477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23c27c-029b-4476-8357-bec99816c317 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:05.200519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a4458-8b6b-4666-821d-c448735607e9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3131e6557447a182013aa6d6887ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927d7160ceab439e94e6f11167b699cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:05.201175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4458-8b6b-4666-821d-c448735607e9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:05.201733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4458-8b6b-4666-821d-c448735607e9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:05.201911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4458-8b6b-4666-821d-c448735607e9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:05.202561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a4458-8b6b-4666-821d-c448735607e9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Adding query filter params (parent_id=2c2a9a237ac24be389d0c21ed0d34538) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:05.202875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a4458-8b6b-4666-821d-c448735607e9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:05.204800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a4458-8b6b-4666-821d-c448735607e9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:05.230228 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2487/4989] 10.222.0.27 () {58 vars in 1216 bytes} [Sun Aug 28 18:41:05 2022] GET /identity/v3/projects?parent_id=2c2a9a237ac24be389d0c21ed0d34538 => generated 497 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:41:05.230856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b81ea6-3ffb-42d3-9e8f-01082d5092eb tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:05.243942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b81ea6-3ffb-42d3-9e8f-01082d5092eb tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:05.248849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9331ba0-14ea-4544-80b9-aea8a778cae9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3131e6557447a182013aa6d6887ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927d7160ceab439e94e6f11167b699cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:05.249583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9331ba0-14ea-4544-80b9-aea8a778cae9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:05.249933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9331ba0-14ea-4544-80b9-aea8a778cae9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:05.250275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9331ba0-14ea-4544-80b9-aea8a778cae9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] PATH_INFO: `/v3/projects/653bc3a08147497f9922e0f678effa94` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:05.251502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9331ba0-14ea-4544-80b9-aea8a778cae9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorizing `identity:delete_project(project_id=653bc3a08147497f9922e0f678effa94)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:05.253664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9331ba0-14ea-4544-80b9-aea8a778cae9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:05.310554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9331ba0-14ea-4544-80b9-aea8a778cae9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '653bc3a08147497f9922e0f678effa94', 'request_id': 'req-e9331ba0-14ea-4544-80b9-aea8a778cae9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:05.321378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9331ba0-14ea-4544-80b9-aea8a778cae9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '653bc3a08147497f9922e0f678effa94', 'request_id': 'req-e9331ba0-14ea-4544-80b9-aea8a778cae9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:05.329551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9331ba0-14ea-4544-80b9-aea8a778cae9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '653bc3a08147497f9922e0f678effa94', 'request_id': 'req-e9331ba0-14ea-4544-80b9-aea8a778cae9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:05.343788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9331ba0-14ea-4544-80b9-aea8a778cae9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] The token cache is being invalidate because project 653bc3a08147497f9922e0f678effa94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:05.344128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9331ba0-14ea-4544-80b9-aea8a778cae9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:05.344911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9331ba0-14ea-4544-80b9-aea8a778cae9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:05.349667 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2503/4990] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:05 2022] DELETE /identity/v3/projects/653bc3a08147497f9922e0f678effa94 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:05.351232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a4458-8b6b-4666-821d-c448735607e9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:05.352955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ab8a4458-8b6b-4666-821d-c448735607e9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:05.370926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a4458-8b6b-4666-821d-c448735607e9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:05.463331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba949af0-8642-46d0-b012-b4cc02879c27 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3131e6557447a182013aa6d6887ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927d7160ceab439e94e6f11167b699cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:05.464028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba949af0-8642-46d0-b012-b4cc02879c27 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:05.464315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba949af0-8642-46d0-b012-b4cc02879c27 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:05.464593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba949af0-8642-46d0-b012-b4cc02879c27 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] PATH_INFO: `/v3/projects/2c2a9a237ac24be389d0c21ed0d34538` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:05.465976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba949af0-8642-46d0-b012-b4cc02879c27 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2c2a9a237ac24be389d0c21ed0d34538)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:05.468234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba949af0-8642-46d0-b012-b4cc02879c27 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:05.521612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:05.548978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ba949af0-8642-46d0-b012-b4cc02879c27 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c2a9a237ac24be389d0c21ed0d34538', 'request_id': 'req-ba949af0-8642-46d0-b012-b4cc02879c27'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:05.565924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ba949af0-8642-46d0-b012-b4cc02879c27 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c2a9a237ac24be389d0c21ed0d34538', 'request_id': 'req-ba949af0-8642-46d0-b012-b4cc02879c27'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:05.598912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ba949af0-8642-46d0-b012-b4cc02879c27 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c2a9a237ac24be389d0c21ed0d34538', 'request_id': 'req-ba949af0-8642-46d0-b012-b4cc02879c27'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:05.638212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ba949af0-8642-46d0-b012-b4cc02879c27 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] The token cache is being invalidate because project 2c2a9a237ac24be389d0c21ed0d34538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:05.663968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ba949af0-8642-46d0-b012-b4cc02879c27 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:05.666539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ba949af0-8642-46d0-b012-b4cc02879c27 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:05.674614 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2488/4991] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:05 2022] DELETE /identity/v3/projects/2c2a9a237ac24be389d0c21ed0d34538 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:05.678529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9331ba0-14ea-4544-80b9-aea8a778cae9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:05.698141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9331ba0-14ea-4544-80b9-aea8a778cae9 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:05.892035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26d1db-4850-41a4-abc7-1001d5cab565 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3131e6557447a182013aa6d6887ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927d7160ceab439e94e6f11167b699cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:05.896279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26d1db-4850-41a4-abc7-1001d5cab565 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:05.896649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26d1db-4850-41a4-abc7-1001d5cab565 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:05.896910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26d1db-4850-41a4-abc7-1001d5cab565 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] PATH_INFO: `/v3/projects/7fa006f9d74e4583a463743069d3713c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:05.903502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26d1db-4850-41a4-abc7-1001d5cab565 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7fa006f9d74e4583a463743069d3713c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:05.907068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26d1db-4850-41a4-abc7-1001d5cab565 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:06.036131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f26d1db-4850-41a4-abc7-1001d5cab565 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa006f9d74e4583a463743069d3713c', 'request_id': 'req-7f26d1db-4850-41a4-abc7-1001d5cab565'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:06.054307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f26d1db-4850-41a4-abc7-1001d5cab565 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa006f9d74e4583a463743069d3713c', 'request_id': 'req-7f26d1db-4850-41a4-abc7-1001d5cab565'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:06.070053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f26d1db-4850-41a4-abc7-1001d5cab565 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa006f9d74e4583a463743069d3713c', 'request_id': 'req-7f26d1db-4850-41a4-abc7-1001d5cab565'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:06.106441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:06.121253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f26d1db-4850-41a4-abc7-1001d5cab565 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] The token cache is being invalidate because project 7fa006f9d74e4583a463743069d3713c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:06.121561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f26d1db-4850-41a4-abc7-1001d5cab565 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:06.122486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f26d1db-4850-41a4-abc7-1001d5cab565 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:06.128868 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2504/4992] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:05 2022] DELETE /identity/v3/projects/7fa006f9d74e4583a463743069d3713c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:06.133000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba949af0-8642-46d0-b012-b4cc02879c27 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:06.134600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ba949af0-8642-46d0-b012-b4cc02879c27 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:06.318315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba949af0-8642-46d0-b012-b4cc02879c27 tempest-ListProjectsTestJSON-705593104 tempest-ListProjectsTestJSON-705593104-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:06.435456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe41f64-f9b8-48d3-bc5f-32f775f62d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:06.436276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe41f64-f9b8-48d3-bc5f-32f775f62d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:06.436562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe41f64-f9b8-48d3-bc5f-32f775f62d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:06.436843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe41f64-f9b8-48d3-bc5f-32f775f62d10 admin admin] PATH_INFO: `/v3/users/6f7804f389ec4ff48ee3638d666b4c67` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:06.439368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe41f64-f9b8-48d3-bc5f-32f775f62d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7804f389ec4ff48ee3638d666b4c67)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:06.441359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe41f64-f9b8-48d3-bc5f-32f775f62d10 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:06.552499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7fe41f64-f9b8-48d3-bc5f-32f775f62d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7804f389ec4ff48ee3638d666b4c67'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:06.591870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7fe41f64-f9b8-48d3-bc5f-32f775f62d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7804f389ec4ff48ee3638d666b4c67'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:06.599665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7fe41f64-f9b8-48d3-bc5f-32f775f62d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7804f389ec4ff48ee3638d666b4c67'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:06.600708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7fe41f64-f9b8-48d3-bc5f-32f775f62d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7804f389ec4ff48ee3638d666b4c67'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:06.606046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:06.617519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7fe41f64-f9b8-48d3-bc5f-32f775f62d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7804f389ec4ff48ee3638d666b4c67'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:06.644697 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2489/4993] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:06 2022] DELETE /identity/v3/users/6f7804f389ec4ff48ee3638d666b4c67 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:06.649301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fe2db-a9ec-46a6-9c69-df72f5fbcefe None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:06.649698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fe2db-a9ec-46a6-9c69-df72f5fbcefe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:06.650866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fe2db-a9ec-46a6-9c69-df72f5fbcefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:06.673884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5a5fe2db-a9ec-46a6-9c69-df72f5fbcefe None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:06.676058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a5fe2db-a9ec-46a6-9c69-df72f5fbcefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:06.714976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91f9d-5c0d-4267-99b6-8316d840b84b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:06.715451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91f9d-5c0d-4267-99b6-8316d840b84b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:06.715748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91f9d-5c0d-4267-99b6-8316d840b84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:06.745417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-06c91f9d-5c0d-4267-99b6-8316d840b84b None None] MFA Rules not processed for user `8ed50d414dc14715bfdade9ce2e7ee52`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:06.746677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-06c91f9d-5c0d-4267-99b6-8316d840b84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:06.803996 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2505/4994] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:06.815684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fe2db-a9ec-46a6-9c69-df72f5fbcefe None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:06.817199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a5fe2db-a9ec-46a6-9c69-df72f5fbcefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:06.833783 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2490/4995] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:06.961903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fe2db-a9ec-46a6-9c69-df72f5fbcefe None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:06.968434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7974d-de98-4968-ae07-589f90ac19ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:06.969176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7974d-de98-4968-ae07-589f90ac19ab service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:06.969612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7974d-de98-4968-ae07-589f90ac19ab service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:06.969737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7974d-de98-4968-ae07-589f90ac19ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:06.982274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7974d-de98-4968-ae07-589f90ac19ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:06.983850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7974d-de98-4968-ae07-589f90ac19ab service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:07.001836 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2506/4996] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:41:08.142030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c91f9d-5c0d-4267-99b6-8316d840b84b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:08.143676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-06c91f9d-5c0d-4267-99b6-8316d840b84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:08.166359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c91f9d-5c0d-4267-99b6-8316d840b84b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:08.173218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69442ea-016e-465d-8704-e63b8d916f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:08.174008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69442ea-016e-465d-8704-e63b8d916f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:08.174296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69442ea-016e-465d-8704-e63b8d916f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:08.175035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69442ea-016e-465d-8704-e63b8d916f5a admin admin] PATH_INFO: `/v3/projects/14decf146895451289c8863549d80425` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:08.183667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69442ea-016e-465d-8704-e63b8d916f5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=14decf146895451289c8863549d80425)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:08.187058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69442ea-016e-465d-8704-e63b8d916f5a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:08.272510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e69442ea-016e-465d-8704-e63b8d916f5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14decf146895451289c8863549d80425', 'request_id': 'req-e69442ea-016e-465d-8704-e63b8d916f5a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:08.287093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e69442ea-016e-465d-8704-e63b8d916f5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14decf146895451289c8863549d80425', 'request_id': 'req-e69442ea-016e-465d-8704-e63b8d916f5a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:08.304392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e69442ea-016e-465d-8704-e63b8d916f5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14decf146895451289c8863549d80425', 'request_id': 'req-e69442ea-016e-465d-8704-e63b8d916f5a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:08.334323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e69442ea-016e-465d-8704-e63b8d916f5a admin admin] The token cache is being invalidate because project 14decf146895451289c8863549d80425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:08.334644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e69442ea-016e-465d-8704-e63b8d916f5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:08.335675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e69442ea-016e-465d-8704-e63b8d916f5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:08.341674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7974d-de98-4968-ae07-589f90ac19ab service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:08.342211 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2491/4997] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:08 2022] DELETE /identity/v3/projects/14decf146895451289c8863549d80425 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:08.352053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7974d-de98-4968-ae07-589f90ac19ab service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:08.448610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecc5e6-fa75-4d50-a76a-a459e681dfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:08.449383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecc5e6-fa75-4d50-a76a-a459e681dfdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:08.449668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecc5e6-fa75-4d50-a76a-a459e681dfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:08.449942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecc5e6-fa75-4d50-a76a-a459e681dfdd admin admin] PATH_INFO: `/v3/users/5c3131e6557447a182013aa6d6887ef4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:08.451247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecc5e6-fa75-4d50-a76a-a459e681dfdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3131e6557447a182013aa6d6887ef4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:08.453373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecc5e6-fa75-4d50-a76a-a459e681dfdd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:08.520002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:08.523526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4aecc5e6-fa75-4d50-a76a-a459e681dfdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3131e6557447a182013aa6d6887ef4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:08.524480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4aecc5e6-fa75-4d50-a76a-a459e681dfdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3131e6557447a182013aa6d6887ef4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:08.536328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4aecc5e6-fa75-4d50-a76a-a459e681dfdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3131e6557447a182013aa6d6887ef4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:08.544412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4aecc5e6-fa75-4d50-a76a-a459e681dfdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3131e6557447a182013aa6d6887ef4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:08.571094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4aecc5e6-fa75-4d50-a76a-a459e681dfdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3131e6557447a182013aa6d6887ef4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:08.579602 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2507/4998] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:08 2022] DELETE /identity/v3/users/5c3131e6557447a182013aa6d6887ef4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:09.143003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69442ea-016e-465d-8704-e63b8d916f5a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:09.144714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e69442ea-016e-465d-8704-e63b8d916f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:09.168618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69442ea-016e-465d-8704-e63b8d916f5a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:09.347062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff973c4-d4ee-41f5-9664-3dd0a5080134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:09.347763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff973c4-d4ee-41f5-9664-3dd0a5080134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:09.348041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff973c4-d4ee-41f5-9664-3dd0a5080134 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:09.348325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff973c4-d4ee-41f5-9664-3dd0a5080134 admin admin] PATH_INFO: `/v3/projects/927d7160ceab439e94e6f11167b699cb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:09.351917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff973c4-d4ee-41f5-9664-3dd0a5080134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=927d7160ceab439e94e6f11167b699cb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:09.354431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff973c4-d4ee-41f5-9664-3dd0a5080134 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:09.388109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:09.477202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ff973c4-d4ee-41f5-9664-3dd0a5080134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '927d7160ceab439e94e6f11167b699cb', 'request_id': 'req-8ff973c4-d4ee-41f5-9664-3dd0a5080134'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:09.493051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ff973c4-d4ee-41f5-9664-3dd0a5080134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '927d7160ceab439e94e6f11167b699cb', 'request_id': 'req-8ff973c4-d4ee-41f5-9664-3dd0a5080134'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:09.501066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ff973c4-d4ee-41f5-9664-3dd0a5080134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '927d7160ceab439e94e6f11167b699cb', 'request_id': 'req-8ff973c4-d4ee-41f5-9664-3dd0a5080134'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:09.522426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ff973c4-d4ee-41f5-9664-3dd0a5080134 admin admin] The token cache is being invalidate because project 927d7160ceab439e94e6f11167b699cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:09.522962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ff973c4-d4ee-41f5-9664-3dd0a5080134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:09.523866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ff973c4-d4ee-41f5-9664-3dd0a5080134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:09.526739 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2492/4999] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:09 2022] DELETE /identity/v3/projects/927d7160ceab439e94e6f11167b699cb => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:09.531888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1c213-92dd-49ea-bf2d-1434bb6a50ed None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:09.532749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1c213-92dd-49ea-bf2d-1434bb6a50ed None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:09.533089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1c213-92dd-49ea-bf2d-1434bb6a50ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:09.595688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-40d1c213-92dd-49ea-bf2d-1434bb6a50ed None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:09.597118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-40d1c213-92dd-49ea-bf2d-1434bb6a50ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:09.754856 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2508/5000] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:09.762297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c25bb-7e92-4144-8b93-639f2ac1721d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:09.762593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c25bb-7e92-4144-8b93-639f2ac1721d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:09.763055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c25bb-7e92-4144-8b93-639f2ac1721d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:09.803445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-206c25bb-7e92-4144-8b93-639f2ac1721d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:09.804729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-206c25bb-7e92-4144-8b93-639f2ac1721d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:09.827169 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2493/5001] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:09.828990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1c213-92dd-49ea-bf2d-1434bb6a50ed None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:09.847027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1c213-92dd-49ea-bf2d-1434bb6a50ed None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:09.864490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5c089-9b7d-4421-b40d-b03925b8e39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:09.865840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5c089-9b7d-4421-b40d-b03925b8e39e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:09.866549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5c089-9b7d-4421-b40d-b03925b8e39e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:09.867829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5c089-9b7d-4421-b40d-b03925b8e39e admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:09.870855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5c089-9b7d-4421-b40d-b03925b8e39e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:09.871365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5c089-9b7d-4421-b40d-b03925b8e39e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:09.893448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5c089-9b7d-4421-b40d-b03925b8e39e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:09.937044 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2509/5002] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:41:09.938958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c25bb-7e92-4144-8b93-639f2ac1721d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:09.954134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c25bb-7e92-4144-8b93-639f2ac1721d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:09.972941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e231f-22e7-4954-867e-f0312e9f0fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:09.973682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e231f-22e7-4954-867e-f0312e9f0fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:09.973857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e231f-22e7-4954-867e-f0312e9f0fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:09.974133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e231f-22e7-4954-867e-f0312e9f0fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:09.974772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e231f-22e7-4954-867e-f0312e9f0fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:09.977458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e231f-22e7-4954-867e-f0312e9f0fd4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:10.041253 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2494/5003] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:09 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:10.045275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5c089-9b7d-4421-b40d-b03925b8e39e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:10.065441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5c089-9b7d-4421-b40d-b03925b8e39e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:10.170334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d25ecb-e1c5-43d7-a513-c8c924ecdffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:10.171068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d25ecb-e1c5-43d7-a513-c8c924ecdffc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:10.171500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d25ecb-e1c5-43d7-a513-c8c924ecdffc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:10.171870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d25ecb-e1c5-43d7-a513-c8c924ecdffc admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:10.172613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d25ecb-e1c5-43d7-a513-c8c924ecdffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:10.177563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d25ecb-e1c5-43d7-a513-c8c924ecdffc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:10.219339 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2510/5004] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:10 2022] POST /identity/v3/users => generated 284 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:10.223005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e231f-22e7-4954-867e-f0312e9f0fd4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:10.235455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e231f-22e7-4954-867e-f0312e9f0fd4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:10.251224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07858139-2cd0-4807-ae93-6f1bc76368dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:10.252186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07858139-2cd0-4807-ae93-6f1bc76368dd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:10.252622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07858139-2cd0-4807-ae93-6f1bc76368dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:10.253065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07858139-2cd0-4807-ae93-6f1bc76368dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:10.254244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07858139-2cd0-4807-ae93-6f1bc76368dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:10.258211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07858139-2cd0-4807-ae93-6f1bc76368dd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:10.301554 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2495/5005] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:10.306051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d25ecb-e1c5-43d7-a513-c8c924ecdffc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:10.332894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d25ecb-e1c5-43d7-a513-c8c924ecdffc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:10.362682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c3de9-88e0-4664-87bd-42c11a37f605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:10.363350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c3de9-88e0-4664-87bd-42c11a37f605 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:10.363898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c3de9-88e0-4664-87bd-42c11a37f605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:10.364191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c3de9-88e0-4664-87bd-42c11a37f605 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:10.365028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c3de9-88e0-4664-87bd-42c11a37f605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:10.366790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c3de9-88e0-4664-87bd-42c11a37f605 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:10.416388 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2511/5006] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:10.420373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07858139-2cd0-4807-ae93-6f1bc76368dd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:10.437944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07858139-2cd0-4807-ae93-6f1bc76368dd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:10.456052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd72b3-ac34-4a61-b84f-44ca9346ae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:10.457236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd72b3-ac34-4a61-b84f-44ca9346ae5c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:10.457757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd72b3-ac34-4a61-b84f-44ca9346ae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:10.458474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd72b3-ac34-4a61-b84f-44ca9346ae5c admin admin] PATH_INFO: `/v3/projects/4f93621a81034bd48813418da3ab9f59/users/41e10a02741b4222be372fb138961924/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:10.503210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd72b3-ac34-4a61-b84f-44ca9346ae5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f93621a81034bd48813418da3ab9f59, user_id=41e10a02741b4222be372fb138961924, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:10.506184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd72b3-ac34-4a61-b84f-44ca9346ae5c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:10.533339 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2496/5007] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:10 2022] PUT /identity/v3/projects/4f93621a81034bd48813418da3ab9f59/users/41e10a02741b4222be372fb138961924/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:10.545888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141a727-7491-4719-a2e4-cb2ac76e7841 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:10.546771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141a727-7491-4719-a2e4-cb2ac76e7841 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:10.547231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141a727-7491-4719-a2e4-cb2ac76e7841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:10.605713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7141a727-7491-4719-a2e4-cb2ac76e7841 None None] MFA Rules not processed for user `41e10a02741b4222be372fb138961924`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:10.607166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7141a727-7491-4719-a2e4-cb2ac76e7841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:10.647243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:10.764990 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2512/5008] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:10.769896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd72b3-ac34-4a61-b84f-44ca9346ae5c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:10.910331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd72b3-ac34-4a61-b84f-44ca9346ae5c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:10.918512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ad0f9-f301-448f-92ea-8066860ee1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:10.919598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ad0f9-f301-448f-92ea-8066860ee1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:10.920035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ad0f9-f301-448f-92ea-8066860ee1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:10.920491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ad0f9-f301-448f-92ea-8066860ee1a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:10.935487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ad0f9-f301-448f-92ea-8066860ee1a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:10.935487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ad0f9-f301-448f-92ea-8066860ee1a4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:11.008321 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2497/5009] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:10 2022] POST /identity/v3/projects => generated 367 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:11.013261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141a727-7491-4719-a2e4-cb2ac76e7841 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:11.034849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141a727-7491-4719-a2e4-cb2ac76e7841 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:11.166757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380c191-a938-442c-a8df-b2c3195aa56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:11.166954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380c191-a938-442c-a8df-b2c3195aa56b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:11.167176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380c191-a938-442c-a8df-b2c3195aa56b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:11.167547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380c191-a938-442c-a8df-b2c3195aa56b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:11.168197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380c191-a938-442c-a8df-b2c3195aa56b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:11.172268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380c191-a938-442c-a8df-b2c3195aa56b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:11.232283 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2513/5010] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:11 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:11.236084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ad0f9-f301-448f-92ea-8066860ee1a4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:11.252754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ad0f9-f301-448f-92ea-8066860ee1a4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:11.264978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed19406-f28e-4576-b3b1-ef43f9c8ff8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:11.265586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed19406-f28e-4576-b3b1-ef43f9c8ff8e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:11.266011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed19406-f28e-4576-b3b1-ef43f9c8ff8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:11.266376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed19406-f28e-4576-b3b1-ef43f9c8ff8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:11.267806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed19406-f28e-4576-b3b1-ef43f9c8ff8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:11.274799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed19406-f28e-4576-b3b1-ef43f9c8ff8e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:11.291527 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2498/5011] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:11.293413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380c191-a938-442c-a8df-b2c3195aa56b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:11.317153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380c191-a938-442c-a8df-b2c3195aa56b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:11.328700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4e78d-737e-4bc5-ba61-8c056e4cb952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:11.329404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4e78d-737e-4bc5-ba61-8c056e4cb952 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:11.329748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4e78d-737e-4bc5-ba61-8c056e4cb952 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:11.330036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4e78d-737e-4bc5-ba61-8c056e4cb952 admin admin] PATH_INFO: `/v3/projects/dde055acd4ca4ae48b9067e0954790c9/users/b2d08755f8ac443aaf7cffab86af9d8a/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:11.373067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4e78d-737e-4bc5-ba61-8c056e4cb952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde055acd4ca4ae48b9067e0954790c9, user_id=b2d08755f8ac443aaf7cffab86af9d8a, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:11.374516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4e78d-737e-4bc5-ba61-8c056e4cb952 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:11.408531 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2514/5012] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:11 2022] PUT /identity/v3/projects/dde055acd4ca4ae48b9067e0954790c9/users/b2d08755f8ac443aaf7cffab86af9d8a/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:11.412687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed19406-f28e-4576-b3b1-ef43f9c8ff8e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:11.427642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed19406-f28e-4576-b3b1-ef43f9c8ff8e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:11.443291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:11.602558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208df4f-e3f4-4153-97e9-0ea8525208b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:11.603407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208df4f-e3f4-4153-97e9-0ea8525208b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:11.603767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208df4f-e3f4-4153-97e9-0ea8525208b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:11.604122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208df4f-e3f4-4153-97e9-0ea8525208b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:11.604857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208df4f-e3f4-4153-97e9-0ea8525208b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:11.607952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208df4f-e3f4-4153-97e9-0ea8525208b4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:11.628413 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2499/5013] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:41:11.632184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4e78d-737e-4bc5-ba61-8c056e4cb952 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:11.644215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4e78d-737e-4bc5-ba61-8c056e4cb952 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:11.649109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadf72c-f579-4dde-b05d-349e447c99a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:11.650057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadf72c-f579-4dde-b05d-349e447c99a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:11.650404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadf72c-f579-4dde-b05d-349e447c99a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:11.650901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadf72c-f579-4dde-b05d-349e447c99a7 admin admin] PATH_INFO: `/v3/projects/dde055acd4ca4ae48b9067e0954790c9/users/b2d08755f8ac443aaf7cffab86af9d8a/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:11.652962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadf72c-f579-4dde-b05d-349e447c99a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde055acd4ca4ae48b9067e0954790c9, user_id=b2d08755f8ac443aaf7cffab86af9d8a, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:11.655797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadf72c-f579-4dde-b05d-349e447c99a7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:11.678423 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2515/5014] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:11 2022] PUT /identity/v3/projects/dde055acd4ca4ae48b9067e0954790c9/users/b2d08755f8ac443aaf7cffab86af9d8a/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:11.688855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc713c-5b06-49d7-a043-adf060d2bc88 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:11.689292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc713c-5b06-49d7-a043-adf060d2bc88 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:11.689584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc713c-5b06-49d7-a043-adf060d2bc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:11.723248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a7fc713c-5b06-49d7-a043-adf060d2bc88 None None] MFA Rules not processed for user `b2d08755f8ac443aaf7cffab86af9d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:11.724739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a7fc713c-5b06-49d7-a043-adf060d2bc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:11.824185 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2500/5015] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:11.826861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadf72c-f579-4dde-b05d-349e447c99a7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:11.838934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadf72c-f579-4dde-b05d-349e447c99a7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:11.845854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c6095-56ba-4716-98ae-8c10e7d064c3 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d08755f8ac443aaf7cffab86af9d8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde055acd4ca4ae48b9067e0954790c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:11.846729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c6095-56ba-4716-98ae-8c10e7d064c3 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:11.847104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c6095-56ba-4716-98ae-8c10e7d064c3 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:11.847654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c6095-56ba-4716-98ae-8c10e7d064c3 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:11.848473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c6095-56ba-4716-98ae-8c10e7d064c3 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:11.850388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c6095-56ba-4716-98ae-8c10e7d064c3 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:11.870043 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2516/5016] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:41:11 2022] POST /identity/v3/services => generated 240 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:11.879949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc713c-5b06-49d7-a043-adf060d2bc88 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:11.889461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc713c-5b06-49d7-a043-adf060d2bc88 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:11.906321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f6a13-7d21-4724-885b-b1a97a431d1e tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d08755f8ac443aaf7cffab86af9d8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde055acd4ca4ae48b9067e0954790c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:11.907177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f6a13-7d21-4724-885b-b1a97a431d1e tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:11.907568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f6a13-7d21-4724-885b-b1a97a431d1e tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:11.907982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f6a13-7d21-4724-885b-b1a97a431d1e tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] PATH_INFO: `/v3/services/d2841afffae54ad59b912950044e0dfd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:11.908586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f6a13-7d21-4724-885b-b1a97a431d1e tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d2841afffae54ad59b912950044e0dfd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:11.910238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f6a13-7d21-4724-885b-b1a97a431d1e tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:11.939341 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2501/5017] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:11 2022] DELETE /identity/v3/services/d2841afffae54ad59b912950044e0dfd => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:11.942402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c6095-56ba-4716-98ae-8c10e7d064c3 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:11.953426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c6095-56ba-4716-98ae-8c10e7d064c3 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:11.972067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1dc34-537a-4aef-895c-01073ab26c6c tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d08755f8ac443aaf7cffab86af9d8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde055acd4ca4ae48b9067e0954790c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:11.973036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1dc34-537a-4aef-895c-01073ab26c6c tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:11.973319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1dc34-537a-4aef-895c-01073ab26c6c tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:11.973694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1dc34-537a-4aef-895c-01073ab26c6c tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:11.974319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1dc34-537a-4aef-895c-01073ab26c6c tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:11.976387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1dc34-537a-4aef-895c-01073ab26c6c tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:11.993303 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2517/5018] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:11 2022] POST /identity/v3/services => generated 287 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:11.997159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f6a13-7d21-4724-885b-b1a97a431d1e tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:12.009441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f6a13-7d21-4724-885b-b1a97a431d1e tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:12.032238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e090e13-1254-4731-af0a-4be564f3405a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d08755f8ac443aaf7cffab86af9d8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde055acd4ca4ae48b9067e0954790c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:12.033248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e090e13-1254-4731-af0a-4be564f3405a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:12.033674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e090e13-1254-4731-af0a-4be564f3405a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:12.034085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e090e13-1254-4731-af0a-4be564f3405a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] PATH_INFO: `/v3/services/5be8d6768f244e6d97e303cd9b4a9062` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:12.036443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e090e13-1254-4731-af0a-4be564f3405a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorizing `identity:update_service(service_id=5be8d6768f244e6d97e303cd9b4a9062)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:12.037797 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-6e090e13-1254-4731-af0a-4be564f3405a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:41:12.037797 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:41:12.037797 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:41:12.039172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e090e13-1254-4731-af0a-4be564f3405a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:12.069580 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2502/5019] 10.222.0.27 () {60 vars in 1252 bytes} [Sun Aug 28 18:41:11 2022] PATCH /identity/v3/services/5be8d6768f244e6d97e303cd9b4a9062 => generated 282 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:41:12.071216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1dc34-537a-4aef-895c-01073ab26c6c tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:12.086165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1dc34-537a-4aef-895c-01073ab26c6c tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:12.121085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa23b8-b19e-4b16-98ad-a6f60f1aac08 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d08755f8ac443aaf7cffab86af9d8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde055acd4ca4ae48b9067e0954790c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:12.122058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa23b8-b19e-4b16-98ad-a6f60f1aac08 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:12.123311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa23b8-b19e-4b16-98ad-a6f60f1aac08 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:12.123830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa23b8-b19e-4b16-98ad-a6f60f1aac08 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] PATH_INFO: `/v3/services/5be8d6768f244e6d97e303cd9b4a9062` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:12.124732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa23b8-b19e-4b16-98ad-a6f60f1aac08 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorizing `identity:get_service(service_id=5be8d6768f244e6d97e303cd9b4a9062)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:12.126222 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-89fa23b8-b19e-4b16-98ad-a6f60f1aac08 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:41:12.126222 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:41:12.126222 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:41:12.127807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa23b8-b19e-4b16-98ad-a6f60f1aac08 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:12.147266 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2518/5020] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:41:12 2022] GET /identity/v3/services/5be8d6768f244e6d97e303cd9b4a9062 => generated 282 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:41:12.148493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e090e13-1254-4731-af0a-4be564f3405a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:12.167699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e090e13-1254-4731-af0a-4be564f3405a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:12.172898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62852c5f-e229-4f55-bca2-4e83b108f7df tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d08755f8ac443aaf7cffab86af9d8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde055acd4ca4ae48b9067e0954790c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:12.173690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62852c5f-e229-4f55-bca2-4e83b108f7df tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:12.174031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62852c5f-e229-4f55-bca2-4e83b108f7df tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:12.174364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62852c5f-e229-4f55-bca2-4e83b108f7df tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] PATH_INFO: `/v3/services/5be8d6768f244e6d97e303cd9b4a9062` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:12.175024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62852c5f-e229-4f55-bca2-4e83b108f7df tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5be8d6768f244e6d97e303cd9b4a9062)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:12.176780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62852c5f-e229-4f55-bca2-4e83b108f7df tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:12.230869 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2503/5021] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:12 2022] DELETE /identity/v3/services/5be8d6768f244e6d97e303cd9b4a9062 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:12.235944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa23b8-b19e-4b16-98ad-a6f60f1aac08 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:12.251209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa23b8-b19e-4b16-98ad-a6f60f1aac08 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:12.276018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea152f7-dedb-4591-bc82-4954edcd2bde tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d08755f8ac443aaf7cffab86af9d8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde055acd4ca4ae48b9067e0954790c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:12.277196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea152f7-dedb-4591-bc82-4954edcd2bde tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:12.277716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea152f7-dedb-4591-bc82-4954edcd2bde tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:12.278362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea152f7-dedb-4591-bc82-4954edcd2bde tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] PATH_INFO: `/v3/services/5be8d6768f244e6d97e303cd9b4a9062` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:12.279156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea152f7-dedb-4591-bc82-4954edcd2bde tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorizing `identity:get_service(service_id=5be8d6768f244e6d97e303cd9b4a9062)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:12.281227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea152f7-dedb-4591-bc82-4954edcd2bde tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:12.285961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:12.314460 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-4ea152f7-dedb-4591-bc82-4954edcd2bde tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Could not find service: 5be8d6768f244e6d97e303cd9b4a9062.: keystone.exception.ServiceNotFound: Could not find service: 5be8d6768f244e6d97e303cd9b4a9062. Aug 28 18:41:12.314460 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:41:12.314460 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:41:12.314460 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:41:12.314460 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:41:12.314460 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:41:12.314460 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:41:12.314460 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:41:12.314460 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 5be8d6768f244e6d97e303cd9b4a9062. Aug 28 18:41:12.314460 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:41:12.314460 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:41:12.314460 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:41:12.314460 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:41:12.314460 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:41:12.314460 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:41:12.314460 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:41:12.315628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:41:12.315628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:41:12.315628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:41:12.315628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:41:12.315628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:41:12.315628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:41:12.315628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:41:12.315628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:41:12.315628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:41:12.315628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:41:12.315628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:41:12.315628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:41:12.315628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:41:12.315628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:41:12.315628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:41:12.315628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:41:12.315628 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:41:12.321101 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:41:12.321101 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:41:12.321101 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:41:12.321101 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:41:12.321101 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:41:12.321101 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:41:12.321101 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:41:12.321101 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:41:12.321101 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:41:12.321101 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:41:12.321101 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:41:12.321101 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:41:12.321101 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 5be8d6768f244e6d97e303cd9b4a9062. Aug 28 18:41:12.321101 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:41:12.321101 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2519/5022] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:41:12 2022] GET /identity/v3/services/5be8d6768f244e6d97e303cd9b4a9062 => generated 113 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 18:41:12.325338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62852c5f-e229-4f55-bca2-4e83b108f7df tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:12.340292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62852c5f-e229-4f55-bca2-4e83b108f7df tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:12.345064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1cf55-2e5d-4657-9d3d-bd7012a8652d tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d08755f8ac443aaf7cffab86af9d8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde055acd4ca4ae48b9067e0954790c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:12.345720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1cf55-2e5d-4657-9d3d-bd7012a8652d tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:12.345999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1cf55-2e5d-4657-9d3d-bd7012a8652d tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:12.346272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1cf55-2e5d-4657-9d3d-bd7012a8652d tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:12.346921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1cf55-2e5d-4657-9d3d-bd7012a8652d tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:12.348588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1cf55-2e5d-4657-9d3d-bd7012a8652d tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:12.368318 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2504/5023] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:12 2022] POST /identity/v3/services => generated 271 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:12.372027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea152f7-dedb-4591-bc82-4954edcd2bde tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:12.386792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea152f7-dedb-4591-bc82-4954edcd2bde tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:12.411896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72ba6b-9f14-4ea3-97b9-ee8eab3890dc tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d08755f8ac443aaf7cffab86af9d8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde055acd4ca4ae48b9067e0954790c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:12.412404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72ba6b-9f14-4ea3-97b9-ee8eab3890dc tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:12.412781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72ba6b-9f14-4ea3-97b9-ee8eab3890dc tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:12.413065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72ba6b-9f14-4ea3-97b9-ee8eab3890dc tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:12.414373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72ba6b-9f14-4ea3-97b9-ee8eab3890dc tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:12.416074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72ba6b-9f14-4ea3-97b9-ee8eab3890dc tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:12.438203 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2520/5024] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:12 2022] POST /identity/v3/services => generated 274 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:12.439539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1cf55-2e5d-4657-9d3d-bd7012a8652d tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:12.446612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:12.455214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1cf55-2e5d-4657-9d3d-bd7012a8652d tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:12.481281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacfd2a-e551-4c0f-a18f-7718efc0cb2b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d08755f8ac443aaf7cffab86af9d8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde055acd4ca4ae48b9067e0954790c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:12.482134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacfd2a-e551-4c0f-a18f-7718efc0cb2b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:12.482510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacfd2a-e551-4c0f-a18f-7718efc0cb2b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:12.482845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacfd2a-e551-4c0f-a18f-7718efc0cb2b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:12.483604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacfd2a-e551-4c0f-a18f-7718efc0cb2b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:12.486721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacfd2a-e551-4c0f-a18f-7718efc0cb2b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:12.513775 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2505/5025] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:12 2022] POST /identity/v3/services => generated 275 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:12.517490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72ba6b-9f14-4ea3-97b9-ee8eab3890dc tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:12.530536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72ba6b-9f14-4ea3-97b9-ee8eab3890dc tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:12.575795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2f041-a514-4960-a4d5-5c272ed0e84f tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d08755f8ac443aaf7cffab86af9d8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde055acd4ca4ae48b9067e0954790c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:12.576617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2f041-a514-4960-a4d5-5c272ed0e84f tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:12.576907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2f041-a514-4960-a4d5-5c272ed0e84f tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:12.577187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2f041-a514-4960-a4d5-5c272ed0e84f tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:12.577854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2f041-a514-4960-a4d5-5c272ed0e84f tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:12.578889 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-37b2f041-a514-4960-a4d5-5c272ed0e84f tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:41:12.578889 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:41:12.578889 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:41:12.586711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2f041-a514-4960-a4d5-5c272ed0e84f tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:12.604169 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2521/5026] 10.222.0.27 () {58 vars in 1131 bytes} [Sun Aug 28 18:41:12 2022] GET /identity/v3/services => generated 2975 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:12.604370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacfd2a-e551-4c0f-a18f-7718efc0cb2b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:12.621184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacfd2a-e551-4c0f-a18f-7718efc0cb2b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:12.634333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba524a0-3611-437d-82cd-23c66a80348b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d08755f8ac443aaf7cffab86af9d8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde055acd4ca4ae48b9067e0954790c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:12.634986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba524a0-3611-437d-82cd-23c66a80348b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:12.636148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba524a0-3611-437d-82cd-23c66a80348b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:12.636530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba524a0-3611-437d-82cd-23c66a80348b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:12.637195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba524a0-3611-437d-82cd-23c66a80348b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-988213870) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:12.637508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba524a0-3611-437d-82cd-23c66a80348b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:12.638533 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-aba524a0-3611-437d-82cd-23c66a80348b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:41:12.638533 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:41:12.638533 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:41:12.639462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba524a0-3611-437d-82cd-23c66a80348b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:12.655676 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2506/5027] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Aug 28 18:41:12 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-988213870 => generated 413 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:41:12.656753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2f041-a514-4960-a4d5-5c272ed0e84f tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:12.675097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2f041-a514-4960-a4d5-5c272ed0e84f tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:12.694862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a15a12-82f7-46c8-95e3-85b31fdbc76a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d08755f8ac443aaf7cffab86af9d8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde055acd4ca4ae48b9067e0954790c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:12.697548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a15a12-82f7-46c8-95e3-85b31fdbc76a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:12.698029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a15a12-82f7-46c8-95e3-85b31fdbc76a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:12.698522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a15a12-82f7-46c8-95e3-85b31fdbc76a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:12.699411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a15a12-82f7-46c8-95e3-85b31fdbc76a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1739469481) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:12.701231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a15a12-82f7-46c8-95e3-85b31fdbc76a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:12.704724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a15a12-82f7-46c8-95e3-85b31fdbc76a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:12.715761 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2522/5028] 10.222.0.27 () {58 vars in 1222 bytes} [Sun Aug 28 18:41:12 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1739469481 => generated 417 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:41:12.721068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba524a0-3611-437d-82cd-23c66a80348b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:12.735554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba524a0-3611-437d-82cd-23c66a80348b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:12.747964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25790357-b32a-4cbd-8202-c9bedd9cf8cd tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d08755f8ac443aaf7cffab86af9d8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde055acd4ca4ae48b9067e0954790c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:12.748685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25790357-b32a-4cbd-8202-c9bedd9cf8cd tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:12.749033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25790357-b32a-4cbd-8202-c9bedd9cf8cd tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:12.749374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25790357-b32a-4cbd-8202-c9bedd9cf8cd tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:12.750097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25790357-b32a-4cbd-8202-c9bedd9cf8cd tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1088455821) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:12.750462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25790357-b32a-4cbd-8202-c9bedd9cf8cd tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:12.752940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25790357-b32a-4cbd-8202-c9bedd9cf8cd tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:12.766808 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2507/5029] 10.222.0.27 () {58 vars in 1222 bytes} [Sun Aug 28 18:41:12 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1088455821 => generated 418 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:41:12.770461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a15a12-82f7-46c8-95e3-85b31fdbc76a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:12.783381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a15a12-82f7-46c8-95e3-85b31fdbc76a tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:12.810419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce5c9b-8215-4af1-ad62-99af81593406 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d08755f8ac443aaf7cffab86af9d8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde055acd4ca4ae48b9067e0954790c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:12.811209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce5c9b-8215-4af1-ad62-99af81593406 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:12.813124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce5c9b-8215-4af1-ad62-99af81593406 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:12.813632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce5c9b-8215-4af1-ad62-99af81593406 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] PATH_INFO: `/v3/services/549785c4f3c6455080eefb4e43a7cdbf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:12.815595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce5c9b-8215-4af1-ad62-99af81593406 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorizing `identity:delete_service(service_id=549785c4f3c6455080eefb4e43a7cdbf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:12.819116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce5c9b-8215-4af1-ad62-99af81593406 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:12.873802 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2523/5030] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:12 2022] DELETE /identity/v3/services/549785c4f3c6455080eefb4e43a7cdbf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:12.879573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25790357-b32a-4cbd-8202-c9bedd9cf8cd tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:12.892175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25790357-b32a-4cbd-8202-c9bedd9cf8cd tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:12.942831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ee2a7-39c2-4a4a-919e-5a65a3bde945 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d08755f8ac443aaf7cffab86af9d8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde055acd4ca4ae48b9067e0954790c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:12.945573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ee2a7-39c2-4a4a-919e-5a65a3bde945 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:12.946030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ee2a7-39c2-4a4a-919e-5a65a3bde945 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:12.946466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ee2a7-39c2-4a4a-919e-5a65a3bde945 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] PATH_INFO: `/v3/services/77327b492ab54957a53618b5977d8f9c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:12.948431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ee2a7-39c2-4a4a-919e-5a65a3bde945 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorizing `identity:delete_service(service_id=77327b492ab54957a53618b5977d8f9c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:12.952864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ee2a7-39c2-4a4a-919e-5a65a3bde945 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:13.009086 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2508/5031] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:12 2022] DELETE /identity/v3/services/77327b492ab54957a53618b5977d8f9c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:13.013584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce5c9b-8215-4af1-ad62-99af81593406 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:13.036827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce5c9b-8215-4af1-ad62-99af81593406 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:13.056982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b6843-2cc3-49a9-8161-734c6302388b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d08755f8ac443aaf7cffab86af9d8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde055acd4ca4ae48b9067e0954790c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:13.057552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b6843-2cc3-49a9-8161-734c6302388b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:13.057835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b6843-2cc3-49a9-8161-734c6302388b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:13.058149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b6843-2cc3-49a9-8161-734c6302388b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] PATH_INFO: `/v3/services/190ffc92bde446f695f42294b5246739` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:13.058694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b6843-2cc3-49a9-8161-734c6302388b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorizing `identity:delete_service(service_id=190ffc92bde446f695f42294b5246739)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:13.060382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b6843-2cc3-49a9-8161-734c6302388b tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:13.091827 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2524/5032] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:13 2022] DELETE /identity/v3/services/190ffc92bde446f695f42294b5246739 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:13.093356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ee2a7-39c2-4a4a-919e-5a65a3bde945 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:13.186399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ee2a7-39c2-4a4a-919e-5a65a3bde945 tempest-ServicesTestJSON-605176799 tempest-ServicesTestJSON-605176799-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:13.204414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60a3e2-d92b-4631-9960-0eaae8b30a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:13.205092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60a3e2-d92b-4631-9960-0eaae8b30a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:13.205381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60a3e2-d92b-4631-9960-0eaae8b30a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:13.205660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60a3e2-d92b-4631-9960-0eaae8b30a2e admin admin] PATH_INFO: `/v3/users/41e10a02741b4222be372fb138961924` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:13.206913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60a3e2-d92b-4631-9960-0eaae8b30a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e10a02741b4222be372fb138961924)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:13.208946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60a3e2-d92b-4631-9960-0eaae8b30a2e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:13.266671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f60a3e2-d92b-4631-9960-0eaae8b30a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e10a02741b4222be372fb138961924'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:13.280041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f60a3e2-d92b-4631-9960-0eaae8b30a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e10a02741b4222be372fb138961924'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:13.280791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f60a3e2-d92b-4631-9960-0eaae8b30a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e10a02741b4222be372fb138961924'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:13.281430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f60a3e2-d92b-4631-9960-0eaae8b30a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e10a02741b4222be372fb138961924'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:13.289803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f60a3e2-d92b-4631-9960-0eaae8b30a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e10a02741b4222be372fb138961924'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:13.292057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:13.313131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e44e3-e2a3-4afa-b1a2-854fc1f39471 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:13.313131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e44e3-e2a3-4afa-b1a2-854fc1f39471 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:13.313131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e44e3-e2a3-4afa-b1a2-854fc1f39471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:13.315332 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2509/5033] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:13 2022] DELETE /identity/v3/users/41e10a02741b4222be372fb138961924 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:13.333158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1d2e44e3-e2a3-4afa-b1a2-854fc1f39471 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:13.334386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d2e44e3-e2a3-4afa-b1a2-854fc1f39471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:13.414195 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2525/5034] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:13.424971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60a3e2-d92b-4631-9960-0eaae8b30a2e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:13.426542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6f60a3e2-d92b-4631-9960-0eaae8b30a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:13.512994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60a3e2-d92b-4631-9960-0eaae8b30a2e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:13.517837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db746cb9-0bd3-49ce-bd11-d642874d02ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:13.518668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db746cb9-0bd3-49ce-bd11-d642874d02ca service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:13.519044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db746cb9-0bd3-49ce-bd11-d642874d02ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:13.519461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db746cb9-0bd3-49ce-bd11-d642874d02ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:13.530516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db746cb9-0bd3-49ce-bd11-d642874d02ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:13.532401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db746cb9-0bd3-49ce-bd11-d642874d02ca service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:13.546712 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2510/5035] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:13.962368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e44e3-e2a3-4afa-b1a2-854fc1f39471 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:13.964194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d2e44e3-e2a3-4afa-b1a2-854fc1f39471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:13.980375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e44e3-e2a3-4afa-b1a2-854fc1f39471 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:13.988290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c5f44-cc8f-40c1-86f4-5b757a228131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:13.989077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c5f44-cc8f-40c1-86f4-5b757a228131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:13.989356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c5f44-cc8f-40c1-86f4-5b757a228131 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:13.989688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c5f44-cc8f-40c1-86f4-5b757a228131 admin admin] PATH_INFO: `/v3/projects/4f93621a81034bd48813418da3ab9f59` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:13.991182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c5f44-cc8f-40c1-86f4-5b757a228131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f93621a81034bd48813418da3ab9f59)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:13.993851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c5f44-cc8f-40c1-86f4-5b757a228131 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:14.096640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db5c5f44-cc8f-40c1-86f4-5b757a228131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f93621a81034bd48813418da3ab9f59', 'request_id': 'req-db5c5f44-cc8f-40c1-86f4-5b757a228131'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:14.098954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:14.113754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db5c5f44-cc8f-40c1-86f4-5b757a228131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f93621a81034bd48813418da3ab9f59', 'request_id': 'req-db5c5f44-cc8f-40c1-86f4-5b757a228131'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:14.122793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db5c5f44-cc8f-40c1-86f4-5b757a228131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f93621a81034bd48813418da3ab9f59', 'request_id': 'req-db5c5f44-cc8f-40c1-86f4-5b757a228131'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:14.148582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db5c5f44-cc8f-40c1-86f4-5b757a228131 admin admin] The token cache is being invalidate because project 4f93621a81034bd48813418da3ab9f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:14.149027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db5c5f44-cc8f-40c1-86f4-5b757a228131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:14.149721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db5c5f44-cc8f-40c1-86f4-5b757a228131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:14.154146 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2526/5036] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:13 2022] DELETE /identity/v3/projects/4f93621a81034bd48813418da3ab9f59 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:14.155435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db746cb9-0bd3-49ce-bd11-d642874d02ca service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:14.167085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db746cb9-0bd3-49ce-bd11-d642874d02ca service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:14.266642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf6ca3-84b0-45ec-bad1-8548dbf14ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:14.267629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf6ca3-84b0-45ec-bad1-8548dbf14ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:14.268180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf6ca3-84b0-45ec-bad1-8548dbf14ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:14.268645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf6ca3-84b0-45ec-bad1-8548dbf14ac1 admin admin] PATH_INFO: `/v3/users/b2d08755f8ac443aaf7cffab86af9d8a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:14.270230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf6ca3-84b0-45ec-bad1-8548dbf14ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d08755f8ac443aaf7cffab86af9d8a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:14.272842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf6ca3-84b0-45ec-bad1-8548dbf14ac1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:14.368691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-accf6ca3-84b0-45ec-bad1-8548dbf14ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d08755f8ac443aaf7cffab86af9d8a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:14.414643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-accf6ca3-84b0-45ec-bad1-8548dbf14ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d08755f8ac443aaf7cffab86af9d8a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:14.415884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-accf6ca3-84b0-45ec-bad1-8548dbf14ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d08755f8ac443aaf7cffab86af9d8a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:14.417574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-accf6ca3-84b0-45ec-bad1-8548dbf14ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d08755f8ac443aaf7cffab86af9d8a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:14.436200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-accf6ca3-84b0-45ec-bad1-8548dbf14ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d08755f8ac443aaf7cffab86af9d8a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:14.460271 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2511/5037] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:14 2022] DELETE /identity/v3/users/b2d08755f8ac443aaf7cffab86af9d8a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:14.868033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c5f44-cc8f-40c1-86f4-5b757a228131 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:14.870049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db5c5f44-cc8f-40c1-86f4-5b757a228131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:14.888169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c5f44-cc8f-40c1-86f4-5b757a228131 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:14.946984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40e971-3808-47ad-a49a-1a01a7369b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:14.947659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40e971-3808-47ad-a49a-1a01a7369b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:14.947962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40e971-3808-47ad-a49a-1a01a7369b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:14.948201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40e971-3808-47ad-a49a-1a01a7369b19 admin admin] PATH_INFO: `/v3/projects/dde055acd4ca4ae48b9067e0954790c9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:14.949755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40e971-3808-47ad-a49a-1a01a7369b19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde055acd4ca4ae48b9067e0954790c9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:14.951920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40e971-3808-47ad-a49a-1a01a7369b19 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:15.000607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef40e971-3808-47ad-a49a-1a01a7369b19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde055acd4ca4ae48b9067e0954790c9', 'request_id': 'req-ef40e971-3808-47ad-a49a-1a01a7369b19'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:15.008868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef40e971-3808-47ad-a49a-1a01a7369b19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde055acd4ca4ae48b9067e0954790c9', 'request_id': 'req-ef40e971-3808-47ad-a49a-1a01a7369b19'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:15.014733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef40e971-3808-47ad-a49a-1a01a7369b19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde055acd4ca4ae48b9067e0954790c9', 'request_id': 'req-ef40e971-3808-47ad-a49a-1a01a7369b19'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:15.026734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef40e971-3808-47ad-a49a-1a01a7369b19 admin admin] The token cache is being invalidate because project dde055acd4ca4ae48b9067e0954790c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:15.027026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef40e971-3808-47ad-a49a-1a01a7369b19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:15.027795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef40e971-3808-47ad-a49a-1a01a7369b19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:15.029396 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2527/5038] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:14 2022] DELETE /identity/v3/projects/dde055acd4ca4ae48b9067e0954790c9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:15.035360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d4403-a4a2-4dfb-9cdb-c5ad51f17df6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:15.035652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d4403-a4a2-4dfb-9cdb-c5ad51f17df6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:15.035925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d4403-a4a2-4dfb-9cdb-c5ad51f17df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:15.050800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:15.066154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-058d4403-a4a2-4dfb-9cdb-c5ad51f17df6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:15.068744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-058d4403-a4a2-4dfb-9cdb-c5ad51f17df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:15.148605 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2512/5039] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:15.157630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241262b-704f-4aa1-9934-b92070c18f84 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:15.157913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241262b-704f-4aa1-9934-b92070c18f84 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:15.158185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241262b-704f-4aa1-9934-b92070c18f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:15.183719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d241262b-704f-4aa1-9934-b92070c18f84 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:15.184992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d241262b-704f-4aa1-9934-b92070c18f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:15.193900 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2528/5040] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:15.198415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d4403-a4a2-4dfb-9cdb-c5ad51f17df6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:15.213850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d4403-a4a2-4dfb-9cdb-c5ad51f17df6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:15.220170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd632aa2-b26e-4399-b6f9-088be431969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:15.221151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632aa2-b26e-4399-b6f9-088be431969a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:15.221266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632aa2-b26e-4399-b6f9-088be431969a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:15.221455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632aa2-b26e-4399-b6f9-088be431969a admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:15.222125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd632aa2-b26e-4399-b6f9-088be431969a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:15.222706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd632aa2-b26e-4399-b6f9-088be431969a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:15.224462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd632aa2-b26e-4399-b6f9-088be431969a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:15.239112 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2513/5041] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:41:15.243520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241262b-704f-4aa1-9934-b92070c18f84 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:15.264409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241262b-704f-4aa1-9934-b92070c18f84 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:15.273057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c15c11-7069-4c10-acdb-279e76a40569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:15.273798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c15c11-7069-4c10-acdb-279e76a40569 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:15.274073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c15c11-7069-4c10-acdb-279e76a40569 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:15.274345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c15c11-7069-4c10-acdb-279e76a40569 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:15.275036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c15c11-7069-4c10-acdb-279e76a40569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:15.277975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c15c11-7069-4c10-acdb-279e76a40569 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:15.312249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd632aa2-b26e-4399-b6f9-088be431969a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:15.313288 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2529/5042] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:15 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:15.322785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd632aa2-b26e-4399-b6f9-088be431969a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:15.405974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8358e-0901-49aa-b5c2-e56ef1c6c2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:15.406719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8358e-0901-49aa-b5c2-e56ef1c6c2df admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:15.406997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8358e-0901-49aa-b5c2-e56ef1c6c2df admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:15.407292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8358e-0901-49aa-b5c2-e56ef1c6c2df admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:15.407962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8358e-0901-49aa-b5c2-e56ef1c6c2df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:15.409881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8358e-0901-49aa-b5c2-e56ef1c6c2df admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:15.440229 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2514/5043] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:15 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:41:15.445346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c15c11-7069-4c10-acdb-279e76a40569 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:15.457240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c15c11-7069-4c10-acdb-279e76a40569 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:15.463643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bea6d5-c334-48b7-ba28-938cf96d0503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:15.464285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bea6d5-c334-48b7-ba28-938cf96d0503 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:15.464562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bea6d5-c334-48b7-ba28-938cf96d0503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:15.464834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bea6d5-c334-48b7-ba28-938cf96d0503 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:15.465481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bea6d5-c334-48b7-ba28-938cf96d0503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:15.467071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bea6d5-c334-48b7-ba28-938cf96d0503 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:15.491796 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2530/5044] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:15.495834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8358e-0901-49aa-b5c2-e56ef1c6c2df admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:15.507538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8358e-0901-49aa-b5c2-e56ef1c6c2df admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:15.512297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af94806-a41d-4607-af18-c7778f398f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:15.512913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af94806-a41d-4607-af18-c7778f398f7a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:15.513192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af94806-a41d-4607-af18-c7778f398f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:15.513464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af94806-a41d-4607-af18-c7778f398f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:15.514102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af94806-a41d-4607-af18-c7778f398f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:15.515890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af94806-a41d-4607-af18-c7778f398f7a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:15.527961 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2515/5045] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:41:15.533472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bea6d5-c334-48b7-ba28-938cf96d0503 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:15.549660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bea6d5-c334-48b7-ba28-938cf96d0503 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:15.573087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a802152-5ad0-4b42-9909-d12197d8299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:15.573882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a802152-5ad0-4b42-9909-d12197d8299b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:15.574232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a802152-5ad0-4b42-9909-d12197d8299b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:15.574583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a802152-5ad0-4b42-9909-d12197d8299b admin admin] PATH_INFO: `/v3/projects/7f703b402ec842aabf1ab0174c8b1264/users/88d2538e6d2643d8b68e77f4ca25860d/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:15.596879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a802152-5ad0-4b42-9909-d12197d8299b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f703b402ec842aabf1ab0174c8b1264, user_id=88d2538e6d2643d8b68e77f4ca25860d, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:15.599794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a802152-5ad0-4b42-9909-d12197d8299b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:15.618707 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2531/5046] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:15 2022] PUT /identity/v3/projects/7f703b402ec842aabf1ab0174c8b1264/users/88d2538e6d2643d8b68e77f4ca25860d/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:15.630431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f88e4b-9ead-4e51-b7fe-61e19450962d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:15.631587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f88e4b-9ead-4e51-b7fe-61e19450962d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:15.632050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f88e4b-9ead-4e51-b7fe-61e19450962d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:15.666023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-40f88e4b-9ead-4e51-b7fe-61e19450962d None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:15.667642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-40f88e4b-9ead-4e51-b7fe-61e19450962d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:15.762517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:15.779562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a802152-5ad0-4b42-9909-d12197d8299b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:15.785884 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2516/5047] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:15.788463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:15.813697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a802152-5ad0-4b42-9909-d12197d8299b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:15.824547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779e163-699b-4c06-b750-00c4b8448d13 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d2538e6d2643d8b68e77f4ca25860d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f703b402ec842aabf1ab0174c8b1264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:15.826174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779e163-699b-4c06-b750-00c4b8448d13 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:15.827348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779e163-699b-4c06-b750-00c4b8448d13 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:15.828758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779e163-699b-4c06-b750-00c4b8448d13 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] PATH_INFO: `/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:15.895037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7779e163-699b-4c06-b750-00c4b8448d13 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '88d2538e6d2643d8b68e77f4ca25860d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:15.909961 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2532/5048] 10.222.0.27 () {60 vars in 1269 bytes} [Sun Aug 28 18:41:15 2022] POST /identity/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:16.916085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4090eb4-3cda-4ef7-b981-80cd4396c423 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:16.916631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4090eb4-3cda-4ef7-b981-80cd4396c423 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:16.916631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4090eb4-3cda-4ef7-b981-80cd4396c423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:16.948369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e4090eb4-3cda-4ef7-b981-80cd4396c423 None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:16.950272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e4090eb4-3cda-4ef7-b981-80cd4396c423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:16.955107 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2517/5049] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:16 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:41:16.959323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf047e3-7c4c-4314-bb56-fb8697410950 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:16.960579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf047e3-7c4c-4314-bb56-fb8697410950 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:16.961035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf047e3-7c4c-4314-bb56-fb8697410950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:16.983774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6bf047e3-7c4c-4314-bb56-fb8697410950 None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:16.985420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6bf047e3-7c4c-4314-bb56-fb8697410950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:16.996554 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2533/5050] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:16.997498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4090eb4-3cda-4ef7-b981-80cd4396c423 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:17.010737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4090eb4-3cda-4ef7-b981-80cd4396c423 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:17.018823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020810a-8c2c-48a8-97c5-e740e61ae44a tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d2538e6d2643d8b68e77f4ca25860d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f703b402ec842aabf1ab0174c8b1264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:17.019946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020810a-8c2c-48a8-97c5-e740e61ae44a tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:17.021508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020810a-8c2c-48a8-97c5-e740e61ae44a tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:17.022059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020810a-8c2c-48a8-97c5-e740e61ae44a tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] PATH_INFO: `/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:17.076162 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-9020810a-8c2c-48a8-97c5-e740e61ae44a tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 28 18:41:17.076162 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:41:17.076162 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:41:17.076162 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:41:17.076162 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:41:17.076162 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:41:17.076162 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:41:17.076162 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:41:17.076162 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:41:17.076162 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:41:17.076162 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:41:17.076162 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:41:17.076162 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 28 18:41:17.077196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 28 18:41:17.077196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 28 18:41:17.077196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 28 18:41:17.077196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:41:17.077196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:41:17.077196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:41:17.077196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:41:17.077196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 28 18:41:17.077196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 28 18:41:17.077196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 28 18:41:17.077196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 28 18:41:17.077196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 28 18:41:17.077196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 28 18:41:17.077196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 28 18:41:17.077196 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:41:17.078138 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2518/5051] 10.222.0.27 () {60 vars in 1269 bytes} [Sun Aug 28 18:41:16 2022] POST /identity/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password => generated 188 bytes in 81 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 28 18:41:17.081929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf047e3-7c4c-4314-bb56-fb8697410950 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:17.091537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf047e3-7c4c-4314-bb56-fb8697410950 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:17.096662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd2503-dbf6-4129-855a-ad6328c9439a tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d2538e6d2643d8b68e77f4ca25860d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f703b402ec842aabf1ab0174c8b1264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:17.097320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd2503-dbf6-4129-855a-ad6328c9439a tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:17.097604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd2503-dbf6-4129-855a-ad6328c9439a tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:17.097881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd2503-dbf6-4129-855a-ad6328c9439a tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] PATH_INFO: `/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:17.139426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-02dd2503-dbf6-4129-855a-ad6328c9439a tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 28 18:41:17.139426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:41:17.139426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:41:17.139426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:41:17.139426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:41:17.139426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:41:17.139426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:41:17.139426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:41:17.139426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:41:17.139426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:41:17.139426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:41:17.139426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:41:17.139426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 28 18:41:17.140530 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 28 18:41:17.140530 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 28 18:41:17.140530 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 28 18:41:17.140530 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:41:17.140530 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:41:17.140530 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:41:17.140530 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:41:17.140530 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 28 18:41:17.140530 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 28 18:41:17.140530 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 28 18:41:17.140530 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 28 18:41:17.140530 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 28 18:41:17.140530 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 28 18:41:17.140530 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 28 18:41:17.140530 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:41:17.142965 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2534/5052] 10.222.0.27 () {60 vars in 1269 bytes} [Sun Aug 28 18:41:17 2022] POST /identity/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password => generated 188 bytes in 62 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 18:41:17.147050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020810a-8c2c-48a8-97c5-e740e61ae44a tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:17.157676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020810a-8c2c-48a8-97c5-e740e61ae44a tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:17.162116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5e90d-f548-497d-b7e4-7700aa514df8 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d2538e6d2643d8b68e77f4ca25860d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f703b402ec842aabf1ab0174c8b1264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:17.162748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5e90d-f548-497d-b7e4-7700aa514df8 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:17.163037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5e90d-f548-497d-b7e4-7700aa514df8 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:17.163460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5e90d-f548-497d-b7e4-7700aa514df8 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] PATH_INFO: `/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:17.213871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6ce5e90d-f548-497d-b7e4-7700aa514df8 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '88d2538e6d2643d8b68e77f4ca25860d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:17.225706 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2519/5053] 10.222.0.27 () {60 vars in 1269 bytes} [Sun Aug 28 18:41:17 2022] POST /identity/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:18.134497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd2503-dbf6-4129-855a-ad6328c9439a tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:18.136487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-02dd2503-dbf6-4129-855a-ad6328c9439a tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:18.230998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d22225-6188-4de2-878a-82811a67b376 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:18.231499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d22225-6188-4de2-878a-82811a67b376 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:18.232088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d22225-6188-4de2-878a-82811a67b376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:18.280351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-00d22225-6188-4de2-878a-82811a67b376 None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:18.281603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00d22225-6188-4de2-878a-82811a67b376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:18.286717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd2503-dbf6-4129-855a-ad6328c9439a tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:18.293331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173eec5e-1ace-43b4-b0fc-459dce7eb93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:18.294404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eec5e-1ace-43b4-b0fc-459dce7eb93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:18.294840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eec5e-1ace-43b4-b0fc-459dce7eb93b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:18.295346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eec5e-1ace-43b4-b0fc-459dce7eb93b admin admin] PATH_INFO: `/v3/users/b979403314cb4e32b5b310c4a0e78dfa` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:18.296825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173eec5e-1ace-43b4-b0fc-459dce7eb93b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b979403314cb4e32b5b310c4a0e78dfa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:18.298885 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2520/5054] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:18 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:41:18.299900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173eec5e-1ace-43b4-b0fc-459dce7eb93b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:18.307818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb5b72-33ff-4bcd-aa79-79617f1de538 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:18.308442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb5b72-33ff-4bcd-aa79-79617f1de538 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:18.308873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb5b72-33ff-4bcd-aa79-79617f1de538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:18.341121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1bbb5b72-33ff-4bcd-aa79-79617f1de538 None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:18.342733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1bbb5b72-33ff-4bcd-aa79-79617f1de538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:18.350718 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2521/5055] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:18.355953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb5b72-33ff-4bcd-aa79-79617f1de538 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:18.368695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb5b72-33ff-4bcd-aa79-79617f1de538 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:18.373704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6c87c-b76b-422a-ab21-1365f6b1b14d tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d2538e6d2643d8b68e77f4ca25860d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f703b402ec842aabf1ab0174c8b1264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:18.374601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6c87c-b76b-422a-ab21-1365f6b1b14d tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:18.375034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6c87c-b76b-422a-ab21-1365f6b1b14d tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:18.375526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6c87c-b76b-422a-ab21-1365f6b1b14d tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] PATH_INFO: `/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:18.412750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-173eec5e-1ace-43b4-b0fc-459dce7eb93b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b979403314cb4e32b5b310c4a0e78dfa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:18.413870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-173eec5e-1ace-43b4-b0fc-459dce7eb93b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b979403314cb4e32b5b310c4a0e78dfa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:18.435446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-173eec5e-1ace-43b4-b0fc-459dce7eb93b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b979403314cb4e32b5b310c4a0e78dfa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:18.445962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-aad6c87c-b76b-422a-ab21-1365f6b1b14d tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '88d2538e6d2643d8b68e77f4ca25860d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:18.452632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-173eec5e-1ace-43b4-b0fc-459dce7eb93b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b979403314cb4e32b5b310c4a0e78dfa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:18.463550 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2522/5056] 10.222.0.27 () {60 vars in 1269 bytes} [Sun Aug 28 18:41:18 2022] POST /identity/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:18.476509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-173eec5e-1ace-43b4-b0fc-459dce7eb93b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b979403314cb4e32b5b310c4a0e78dfa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:18.485075 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2535/5057] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:18 2022] DELETE /identity/v3/users/b979403314cb4e32b5b310c4a0e78dfa => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:18.489830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2f63c-dd9e-474b-9035-682aaf3616b9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:18.490123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2f63c-dd9e-474b-9035-682aaf3616b9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:18.490406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2f63c-dd9e-474b-9035-682aaf3616b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:18.527488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f3a2f63c-dd9e-474b-9035-682aaf3616b9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:18.529237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f3a2f63c-dd9e-474b-9035-682aaf3616b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:18.652503 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2523/5058] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:18.669037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173eec5e-1ace-43b4-b0fc-459dce7eb93b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:18.670743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-173eec5e-1ace-43b4-b0fc-459dce7eb93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:18.724818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=11 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:18.811212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173eec5e-1ace-43b4-b0fc-459dce7eb93b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:18.817536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f34f4c-29fb-4995-bceb-334dd184ee41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:18.818374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f34f4c-29fb-4995-bceb-334dd184ee41 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:18.819444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f34f4c-29fb-4995-bceb-334dd184ee41 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:18.819879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f34f4c-29fb-4995-bceb-334dd184ee41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:18.830884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f34f4c-29fb-4995-bceb-334dd184ee41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:18.832809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f34f4c-29fb-4995-bceb-334dd184ee41 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:18.846139 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2536/5059] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:19.323582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2f63c-dd9e-474b-9035-682aaf3616b9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:19.325233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f3a2f63c-dd9e-474b-9035-682aaf3616b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:19.346158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2f63c-dd9e-474b-9035-682aaf3616b9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:19.354342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5237665-b96c-41d3-9b36-7beafc38bc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:19.355767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5237665-b96c-41d3-9b36-7beafc38bc3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:19.356075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5237665-b96c-41d3-9b36-7beafc38bc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:19.357077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5237665-b96c-41d3-9b36-7beafc38bc3a admin admin] PATH_INFO: `/v3/projects/cde9afaca5c34b4b9aaa774bbc9068e0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:19.358975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5237665-b96c-41d3-9b36-7beafc38bc3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde9afaca5c34b4b9aaa774bbc9068e0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:19.361104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5237665-b96c-41d3-9b36-7beafc38bc3a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:19.416381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:19.420063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5237665-b96c-41d3-9b36-7beafc38bc3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde9afaca5c34b4b9aaa774bbc9068e0', 'request_id': 'req-b5237665-b96c-41d3-9b36-7beafc38bc3a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:19.432843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5237665-b96c-41d3-9b36-7beafc38bc3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde9afaca5c34b4b9aaa774bbc9068e0', 'request_id': 'req-b5237665-b96c-41d3-9b36-7beafc38bc3a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:19.440763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5237665-b96c-41d3-9b36-7beafc38bc3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde9afaca5c34b4b9aaa774bbc9068e0', 'request_id': 'req-b5237665-b96c-41d3-9b36-7beafc38bc3a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:19.457199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5237665-b96c-41d3-9b36-7beafc38bc3a admin admin] The token cache is being invalidate because project cde9afaca5c34b4b9aaa774bbc9068e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:19.457575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5237665-b96c-41d3-9b36-7beafc38bc3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:19.458265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5237665-b96c-41d3-9b36-7beafc38bc3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:19.463660 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2524/5060] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:19 2022] DELETE /identity/v3/projects/cde9afaca5c34b4b9aaa774bbc9068e0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:19.464612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f34f4c-29fb-4995-bceb-334dd184ee41 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:19.469800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd01e4-2e35-41e2-89d6-c4649440db0b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:19.470325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd01e4-2e35-41e2-89d6-c4649440db0b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:19.470784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd01e4-2e35-41e2-89d6-c4649440db0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:19.477607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f34f4c-29fb-4995-bceb-334dd184ee41 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:19.498665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-40bd01e4-2e35-41e2-89d6-c4649440db0b None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:19.500432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-40bd01e4-2e35-41e2-89d6-c4649440db0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:19.504284 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2525/5061] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:19 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:41:19.508715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea316a00-6cb2-4491-82d7-5c9da190030a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:19.509196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea316a00-6cb2-4491-82d7-5c9da190030a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:19.509637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea316a00-6cb2-4491-82d7-5c9da190030a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:19.531175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ea316a00-6cb2-4491-82d7-5c9da190030a None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:19.532926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ea316a00-6cb2-4491-82d7-5c9da190030a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:19.582968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df40df-fa9b-484f-aaf4-956296db9f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:19.583824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df40df-fa9b-484f-aaf4-956296db9f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:19.584182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df40df-fa9b-484f-aaf4-956296db9f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:19.584532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df40df-fa9b-484f-aaf4-956296db9f9b admin admin] PATH_INFO: `/v3/users/0de9e1156d984369a00453fc871874bc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:19.586231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df40df-fa9b-484f-aaf4-956296db9f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de9e1156d984369a00453fc871874bc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:19.588458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df40df-fa9b-484f-aaf4-956296db9f9b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:19.681252 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2526/5062] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:19.686394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea316a00-6cb2-4491-82d7-5c9da190030a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:19.698152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77df40df-fa9b-484f-aaf4-956296db9f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de9e1156d984369a00453fc871874bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:19.699673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77df40df-fa9b-484f-aaf4-956296db9f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de9e1156d984369a00453fc871874bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:19.704046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea316a00-6cb2-4491-82d7-5c9da190030a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:19.713299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77df40df-fa9b-484f-aaf4-956296db9f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de9e1156d984369a00453fc871874bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:19.717644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d7e4b-4bb0-4cb5-982a-25ed743d75d2 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d2538e6d2643d8b68e77f4ca25860d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f703b402ec842aabf1ab0174c8b1264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:19.718656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d7e4b-4bb0-4cb5-982a-25ed743d75d2 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:19.718993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d7e4b-4bb0-4cb5-982a-25ed743d75d2 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:19.719313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d7e4b-4bb0-4cb5-982a-25ed743d75d2 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] PATH_INFO: `/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:19.722445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77df40df-fa9b-484f-aaf4-956296db9f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de9e1156d984369a00453fc871874bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:19.740823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77df40df-fa9b-484f-aaf4-956296db9f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de9e1156d984369a00453fc871874bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:19.751732 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2537/5063] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:19 2022] DELETE /identity/v3/users/0de9e1156d984369a00453fc871874bc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:19.802417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-298d7e4b-4bb0-4cb5-982a-25ed743d75d2 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '88d2538e6d2643d8b68e77f4ca25860d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:19.819302 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2527/5064] 10.222.0.27 () {60 vars in 1269 bytes} [Sun Aug 28 18:41:19 2022] POST /identity/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:20.265979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df40df-fa9b-484f-aaf4-956296db9f9b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:20.265979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77df40df-fa9b-484f-aaf4-956296db9f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:20.301876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d7e4b-4bb0-4cb5-982a-25ed743d75d2 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:20.304338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-298d7e4b-4bb0-4cb5-982a-25ed743d75d2 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:20.325343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:20.349972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df40df-fa9b-484f-aaf4-956296db9f9b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:20.357188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:20.357947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:20.358369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:20.358650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410 admin admin] PATH_INFO: `/v3/projects/b4ccb894da134fc29412c3349edc6602` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:20.359829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ccb894da134fc29412c3349edc6602)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:20.362472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:20.399915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d7e4b-4bb0-4cb5-982a-25ed743d75d2 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:20.413825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ccb894da134fc29412c3349edc6602', 'request_id': 'req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:20.422214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ccb894da134fc29412c3349edc6602', 'request_id': 'req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:20.427814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ccb894da134fc29412c3349edc6602', 'request_id': 'req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:20.430677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:20.439542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410 admin admin] The token cache is being invalidate because project b4ccb894da134fc29412c3349edc6602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:20.439846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:20.440700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:20.442295 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2538/5065] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:20 2022] DELETE /identity/v3/projects/b4ccb894da134fc29412c3349edc6602 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:20.443089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:20.444390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:20.467045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1fb3a-ed7f-4210-99ee-3dc30d6a4e1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:20.467693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1fb3a-ed7f-4210-99ee-3dc30d6a4e1e service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:20.467978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1fb3a-ed7f-4210-99ee-3dc30d6a4e1e service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:20.468263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1fb3a-ed7f-4210-99ee-3dc30d6a4e1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:20.470174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e7e1fb3a-ed7f-4210-99ee-3dc30d6a4e1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:20.482954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1fb3a-ed7f-4210-99ee-3dc30d6a4e1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:20.484607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1fb3a-ed7f-4210-99ee-3dc30d6a4e1e service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:20.495487 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2528/5066] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:41:20.496739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aa091-e397-46fa-a67e-b939a86931bc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:20.497021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aa091-e397-46fa-a67e-b939a86931bc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:20.497431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aa091-e397-46fa-a67e-b939a86931bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:20.513182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d5e73-5cfb-4aef-9585-4d2726b6b410 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:20.517086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0f4aa091-e397-46fa-a67e-b939a86931bc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:20.518274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0f4aa091-e397-46fa-a67e-b939a86931bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:20.520410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc3395-db09-47ec-acd1-ee2f04faec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:20.521055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc3395-db09-47ec-acd1-ee2f04faec22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:20.521334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc3395-db09-47ec-acd1-ee2f04faec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:20.521782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc3395-db09-47ec-acd1-ee2f04faec22 admin admin] PATH_INFO: `/v3/users/3781c1799c3f419aad5a8c1f21e40d88` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:20.523385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc3395-db09-47ec-acd1-ee2f04faec22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3781c1799c3f419aad5a8c1f21e40d88)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:20.525579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc3395-db09-47ec-acd1-ee2f04faec22 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:20.526605 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2529/5067] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:20.537436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6899a-974b-4ba7-9ce5-65bae2c47995 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:20.537720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6899a-974b-4ba7-9ce5-65bae2c47995 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:20.537996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6899a-974b-4ba7-9ce5-65bae2c47995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:20.557681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-91a6899a-974b-4ba7-9ce5-65bae2c47995 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:20.558920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-91a6899a-974b-4ba7-9ce5-65bae2c47995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:20.567588 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2530/5068] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:20.572303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6899a-974b-4ba7-9ce5-65bae2c47995 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:20.582826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6899a-974b-4ba7-9ce5-65bae2c47995 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:20.587964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ddc3395-db09-47ec-acd1-ee2f04faec22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3781c1799c3f419aad5a8c1f21e40d88'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:20.588127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dfe38-ece0-4de8-b0f6-8694387daba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:20.588749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dfe38-ece0-4de8-b0f6-8694387daba3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:20.588869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ddc3395-db09-47ec-acd1-ee2f04faec22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3781c1799c3f419aad5a8c1f21e40d88'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:20.589067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dfe38-ece0-4de8-b0f6-8694387daba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:20.589323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dfe38-ece0-4de8-b0f6-8694387daba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:20.589974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667dfe38-ece0-4de8-b0f6-8694387daba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:20.590271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667dfe38-ece0-4de8-b0f6-8694387daba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:20.591895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667dfe38-ece0-4de8-b0f6-8694387daba3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:20.595988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ddc3395-db09-47ec-acd1-ee2f04faec22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3781c1799c3f419aad5a8c1f21e40d88'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:20.604246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ddc3395-db09-47ec-acd1-ee2f04faec22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3781c1799c3f419aad5a8c1f21e40d88'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:20.605497 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2531/5069] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:41:20.609916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dfe38-ece0-4de8-b0f6-8694387daba3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:20.611728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-667dfe38-ece0-4de8-b0f6-8694387daba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:20.617329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:20.619780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ddc3395-db09-47ec-acd1-ee2f04faec22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3781c1799c3f419aad5a8c1f21e40d88'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:20.625876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dfe38-ece0-4de8-b0f6-8694387daba3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:20.628373 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2539/5070] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:20 2022] DELETE /identity/v3/users/3781c1799c3f419aad5a8c1f21e40d88 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:20.633896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be04350-ce28-4160-99af-01eaf94aa6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:20.634517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be04350-ce28-4160-99af-01eaf94aa6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:20.634870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be04350-ce28-4160-99af-01eaf94aa6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:20.635148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be04350-ce28-4160-99af-01eaf94aa6e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:20.635880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be04350-ce28-4160-99af-01eaf94aa6e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:20.637821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be04350-ce28-4160-99af-01eaf94aa6e7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:20.673561 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2532/5071] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:20 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:41:20.674715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc3395-db09-47ec-acd1-ee2f04faec22 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:20.749898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc3395-db09-47ec-acd1-ee2f04faec22 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:20.824790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc5dbb-f4df-4d5c-b552-d9aa41e4e499 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:20.825212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc5dbb-f4df-4d5c-b552-d9aa41e4e499 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:20.825511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc5dbb-f4df-4d5c-b552-d9aa41e4e499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:20.826402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4cd0c-0a0a-4232-bd4f-53c7210bcfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:20.827433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4cd0c-0a0a-4232-bd4f-53c7210bcfce admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:20.828398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4cd0c-0a0a-4232-bd4f-53c7210bcfce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:20.828865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4cd0c-0a0a-4232-bd4f-53c7210bcfce admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:20.829736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4cd0c-0a0a-4232-bd4f-53c7210bcfce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:20.832106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4cd0c-0a0a-4232-bd4f-53c7210bcfce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:20.846577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-00fc5dbb-f4df-4d5c-b552-d9aa41e4e499 None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:20.848541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00fc5dbb-f4df-4d5c-b552-d9aa41e4e499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:20.852211 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2533/5072] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:20 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:41:20.856730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7e533-c186-42bd-b29c-586311a655e0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:20.857129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7e533-c186-42bd-b29c-586311a655e0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:20.857647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7e533-c186-42bd-b29c-586311a655e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:20.872563 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2540/5073] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:20 2022] POST /identity/v3/users => generated 284 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:20.882873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1ba7e533-c186-42bd-b29c-586311a655e0 None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:20.885215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1ba7e533-c186-42bd-b29c-586311a655e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:20.886161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4cd0c-0a0a-4232-bd4f-53c7210bcfce admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:20.901959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4cd0c-0a0a-4232-bd4f-53c7210bcfce admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:20.908369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24db236-0c18-42fc-a177-6109b1b28f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:20.909373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db236-0c18-42fc-a177-6109b1b28f64 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:20.910263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db236-0c18-42fc-a177-6109b1b28f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:20.910870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db236-0c18-42fc-a177-6109b1b28f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:20.912631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24db236-0c18-42fc-a177-6109b1b28f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:20.914843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24db236-0c18-42fc-a177-6109b1b28f64 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:20.932542 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2541/5074] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:20.932860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24db236-0c18-42fc-a177-6109b1b28f64 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:20.934601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d24db236-0c18-42fc-a177-6109b1b28f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:20.949579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24db236-0c18-42fc-a177-6109b1b28f64 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:20.955137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486b7ca-eeaa-43d1-accf-7acd653279e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:20.955956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486b7ca-eeaa-43d1-accf-7acd653279e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:20.956323 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2534/5075] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:20.957378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7e533-c186-42bd-b29c-586311a655e0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:20.959573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486b7ca-eeaa-43d1-accf-7acd653279e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:20.960180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486b7ca-eeaa-43d1-accf-7acd653279e9 admin admin] PATH_INFO: `/v3/projects/a76325eafd6747cca6d57896a1b53a19` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:20.961412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486b7ca-eeaa-43d1-accf-7acd653279e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a76325eafd6747cca6d57896a1b53a19)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:20.963610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486b7ca-eeaa-43d1-accf-7acd653279e9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:20.970371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7e533-c186-42bd-b29c-586311a655e0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:20.975842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcce7a-fefa-4660-8523-831af0fecfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:20.976541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcce7a-fefa-4660-8523-831af0fecfbf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:20.976898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcce7a-fefa-4660-8523-831af0fecfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:20.977746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcce7a-fefa-4660-8523-831af0fecfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:20.978493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dcce7a-fefa-4660-8523-831af0fecfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:20.980420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dcce7a-fefa-4660-8523-831af0fecfbf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:20.995741 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2535/5076] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:21.000074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcce7a-fefa-4660-8523-831af0fecfbf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:21.010988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcce7a-fefa-4660-8523-831af0fecfbf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:21.030385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5486b7ca-eeaa-43d1-accf-7acd653279e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a76325eafd6747cca6d57896a1b53a19', 'request_id': 'req-5486b7ca-eeaa-43d1-accf-7acd653279e9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:21.043460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5486b7ca-eeaa-43d1-accf-7acd653279e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a76325eafd6747cca6d57896a1b53a19', 'request_id': 'req-5486b7ca-eeaa-43d1-accf-7acd653279e9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:21.052293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5486b7ca-eeaa-43d1-accf-7acd653279e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a76325eafd6747cca6d57896a1b53a19', 'request_id': 'req-5486b7ca-eeaa-43d1-accf-7acd653279e9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:21.070308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5486b7ca-eeaa-43d1-accf-7acd653279e9 admin admin] The token cache is being invalidate because project a76325eafd6747cca6d57896a1b53a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:21.070704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5486b7ca-eeaa-43d1-accf-7acd653279e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:21.072957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5486b7ca-eeaa-43d1-accf-7acd653279e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:21.074616 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2542/5077] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:20 2022] DELETE /identity/v3/projects/a76325eafd6747cca6d57896a1b53a19 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:21.075305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486b7ca-eeaa-43d1-accf-7acd653279e9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:21.078931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5486b7ca-eeaa-43d1-accf-7acd653279e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:21.086425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:21.086638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5bb84-e2e9-4a82-bc0f-4d3664f454b8 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d2538e6d2643d8b68e77f4ca25860d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f703b402ec842aabf1ab0174c8b1264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:21.087584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5bb84-e2e9-4a82-bc0f-4d3664f454b8 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.087584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5bb84-e2e9-4a82-bc0f-4d3664f454b8 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.088051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5bb84-e2e9-4a82-bc0f-4d3664f454b8 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] PATH_INFO: `/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.100715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:21.138623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23f5bb84-e2e9-4a82-bc0f-4d3664f454b8 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '88d2538e6d2643d8b68e77f4ca25860d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:21.148569 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2536/5078] 10.222.0.27 () {60 vars in 1269 bytes} [Sun Aug 28 18:41:20 2022] POST /identity/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:21.149789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf20abc-7ab5-42e4-8a1c-797292b781f7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.150078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf20abc-7ab5-42e4-8a1c-797292b781f7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.150390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf20abc-7ab5-42e4-8a1c-797292b781f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.170490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2cf20abc-7ab5-42e4-8a1c-797292b781f7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:21.171717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2cf20abc-7ab5-42e4-8a1c-797292b781f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:21.179880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486b7ca-eeaa-43d1-accf-7acd653279e9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:21.182019 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2537/5079] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:21.184620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953dc6e-6ba2-430a-9436-518c21527fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:21.185289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953dc6e-6ba2-430a-9436-518c21527fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.185574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953dc6e-6ba2-430a-9436-518c21527fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.185836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953dc6e-6ba2-430a-9436-518c21527fa4 admin admin] PATH_INFO: `/v3/projects/bcd1a807d62e4eb991a609e472cdb473/users/458b96ae3f244f95b48748fa36e66d80/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.189465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6da8d-d995-4d46-b12a-260502cbb7dd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.189743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6da8d-d995-4d46-b12a-260502cbb7dd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.190016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6da8d-d995-4d46-b12a-260502cbb7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.206943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953dc6e-6ba2-430a-9436-518c21527fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd1a807d62e4eb991a609e472cdb473, user_id=458b96ae3f244f95b48748fa36e66d80, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:21.210518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953dc6e-6ba2-430a-9436-518c21527fa4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:21.212937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f5b6da8d-d995-4d46-b12a-260502cbb7dd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:21.215410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f5b6da8d-d995-4d46-b12a-260502cbb7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:21.225858 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2538/5080] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:21.226780 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2543/5081] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:21 2022] PUT /identity/v3/projects/bcd1a807d62e4eb991a609e472cdb473/users/458b96ae3f244f95b48748fa36e66d80/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:21.229780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6da8d-d995-4d46-b12a-260502cbb7dd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:21.238720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd815f11-b906-4690-aed5-7c8368f52e1a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.239017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd815f11-b906-4690-aed5-7c8368f52e1a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.239350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd815f11-b906-4690-aed5-7c8368f52e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.239669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6da8d-d995-4d46-b12a-260502cbb7dd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:21.268985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fd815f11-b906-4690-aed5-7c8368f52e1a None None] MFA Rules not processed for user `458b96ae3f244f95b48748fa36e66d80`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:21.270221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd815f11-b906-4690-aed5-7c8368f52e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:21.298447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdab7e-5d09-4adf-b328-f86494449a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:21.298902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdab7e-5d09-4adf-b328-f86494449a51 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.299165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdab7e-5d09-4adf-b328-f86494449a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.299474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdab7e-5d09-4adf-b328-f86494449a51 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.300140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdab7e-5d09-4adf-b328-f86494449a51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:21.300448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdab7e-5d09-4adf-b328-f86494449a51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:21.302115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdab7e-5d09-4adf-b328-f86494449a51 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:21.318610 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2539/5082] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:41:21.320148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdab7e-5d09-4adf-b328-f86494449a51 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:21.331038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdab7e-5d09-4adf-b328-f86494449a51 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:21.336509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb221a38-15a4-4fca-8d7f-998dbb3954a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:21.337143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb221a38-15a4-4fca-8d7f-998dbb3954a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.337423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb221a38-15a4-4fca-8d7f-998dbb3954a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.337717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb221a38-15a4-4fca-8d7f-998dbb3954a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.338350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb221a38-15a4-4fca-8d7f-998dbb3954a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:21.340403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb221a38-15a4-4fca-8d7f-998dbb3954a3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:21.376451 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2540/5083] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:21 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:41:21.377684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb221a38-15a4-4fca-8d7f-998dbb3954a3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:21.445091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb221a38-15a4-4fca-8d7f-998dbb3954a3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:21.451691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33eac07-ba8f-444a-9109-a0ada3a04885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:21.452313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eac07-ba8f-444a-9109-a0ada3a04885 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.452595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eac07-ba8f-444a-9109-a0ada3a04885 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.452860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eac07-ba8f-444a-9109-a0ada3a04885 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.453521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33eac07-ba8f-444a-9109-a0ada3a04885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:21.455596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33eac07-ba8f-444a-9109-a0ada3a04885 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:21.481180 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2541/5084] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:21 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:21.484982 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2544/5085] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:21.486448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33eac07-ba8f-444a-9109-a0ada3a04885 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:21.489488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd815f11-b906-4690-aed5-7c8368f52e1a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:21.499927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33eac07-ba8f-444a-9109-a0ada3a04885 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:21.501146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd815f11-b906-4690-aed5-7c8368f52e1a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:21.505392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1a66a-6f4a-4f35-bbfa-5826594d1173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:21.505906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f600c4-f38f-41f3-8350-88d48cd47b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:21.506070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1a66a-6f4a-4f35-bbfa-5826594d1173 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.506291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1a66a-6f4a-4f35-bbfa-5826594d1173 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.506524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f600c4-f38f-41f3-8350-88d48cd47b44 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.506642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1a66a-6f4a-4f35-bbfa-5826594d1173 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.506819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f600c4-f38f-41f3-8350-88d48cd47b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.507060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f600c4-f38f-41f3-8350-88d48cd47b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.507428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1a66a-6f4a-4f35-bbfa-5826594d1173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:21.507739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f600c4-f38f-41f3-8350-88d48cd47b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:21.509058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1a66a-6f4a-4f35-bbfa-5826594d1173 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:21.509851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f600c4-f38f-41f3-8350-88d48cd47b44 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:21.522485 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2542/5086] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:21.526436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1a66a-6f4a-4f35-bbfa-5826594d1173 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:21.538722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1a66a-6f4a-4f35-bbfa-5826594d1173 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:21.543960 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2545/5087] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:21 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:21.547313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4fa8b-7fc0-4664-9567-f3779b7a7369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:21.548005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4fa8b-7fc0-4664-9567-f3779b7a7369 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.548158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f600c4-f38f-41f3-8350-88d48cd47b44 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:21.548332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4fa8b-7fc0-4664-9567-f3779b7a7369 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.548714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4fa8b-7fc0-4664-9567-f3779b7a7369 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.549383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4fa8b-7fc0-4664-9567-f3779b7a7369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:21.551185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4fa8b-7fc0-4664-9567-f3779b7a7369 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:21.570948 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2543/5088] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:41:21.575127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4fa8b-7fc0-4664-9567-f3779b7a7369 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:21.586413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:INSERT=6,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:21.592087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4fa8b-7fc0-4664-9567-f3779b7a7369 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:21.629787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:21.641559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f600c4-f38f-41f3-8350-88d48cd47b44 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:21.648731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae5a87-87bb-4bcb-9f45-270928dd5014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:21.650543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae5a87-87bb-4bcb-9f45-270928dd5014 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.650923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae5a87-87bb-4bcb-9f45-270928dd5014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.651288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae5a87-87bb-4bcb-9f45-270928dd5014 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.652009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae5a87-87bb-4bcb-9f45-270928dd5014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:21.654030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae5a87-87bb-4bcb-9f45-270928dd5014 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:21.663051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a84ceb-72d0-42cc-8451-44f5efa7b216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:21.663999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a84ceb-72d0-42cc-8451-44f5efa7b216 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.664431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a84ceb-72d0-42cc-8451-44f5efa7b216 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.664885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a84ceb-72d0-42cc-8451-44f5efa7b216 admin admin] PATH_INFO: `/v3/projects/9712e95d26d04160aab0e0297668946c/users/b053880ec7894a95a25420177f6e2793/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.678813 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2546/5089] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:21 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:41:21.682315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae5a87-87bb-4bcb-9f45-270928dd5014 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:21.683791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a84ceb-72d0-42cc-8451-44f5efa7b216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9712e95d26d04160aab0e0297668946c, user_id=b053880ec7894a95a25420177f6e2793, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:21.686658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a84ceb-72d0-42cc-8451-44f5efa7b216 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:21.692559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae5a87-87bb-4bcb-9f45-270928dd5014 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:21.698214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abea433-14a6-461a-b1b1-9e54425efca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:21.698825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abea433-14a6-461a-b1b1-9e54425efca6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.699104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abea433-14a6-461a-b1b1-9e54425efca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.699471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abea433-14a6-461a-b1b1-9e54425efca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.700247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abea433-14a6-461a-b1b1-9e54425efca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:21.701894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abea433-14a6-461a-b1b1-9e54425efca6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:21.703565 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2544/5090] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:21 2022] PUT /identity/v3/projects/9712e95d26d04160aab0e0297668946c/users/b053880ec7894a95a25420177f6e2793/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:21.715557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419b98c-3bc8-4321-bf10-26b00aeba487 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.715843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419b98c-3bc8-4321-bf10-26b00aeba487 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.716168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419b98c-3bc8-4321-bf10-26b00aeba487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.720198 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2547/5091] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:41:21.721659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abea433-14a6-461a-b1b1-9e54425efca6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:21.733296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abea433-14a6-461a-b1b1-9e54425efca6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:21.746714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7419b98c-3bc8-4321-bf10-26b00aeba487 None None] MFA Rules not processed for user `b053880ec7894a95a25420177f6e2793`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:21.748071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7419b98c-3bc8-4321-bf10-26b00aeba487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:21.792216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d429c-cf02-4109-b0c2-e5b8328b995c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:21.792781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d429c-cf02-4109-b0c2-e5b8328b995c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.793072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d429c-cf02-4109-b0c2-e5b8328b995c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.793328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d429c-cf02-4109-b0c2-e5b8328b995c admin admin] PATH_INFO: `/v3/projects/7f98936445b543f9a6bf136d003cb309/users/d787ba9d75ed44f6b8df8b698196d3e0/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.807786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d429c-cf02-4109-b0c2-e5b8328b995c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f98936445b543f9a6bf136d003cb309, user_id=d787ba9d75ed44f6b8df8b698196d3e0, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:21.810609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d429c-cf02-4109-b0c2-e5b8328b995c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:21.811541 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2545/5092] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:21.826459 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2548/5093] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:21 2022] PUT /identity/v3/projects/7f98936445b543f9a6bf136d003cb309/users/d787ba9d75ed44f6b8df8b698196d3e0/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:21.827796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419b98c-3bc8-4321-bf10-26b00aeba487 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:21.829269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7419b98c-3bc8-4321-bf10-26b00aeba487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:21.830407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d429c-cf02-4109-b0c2-e5b8328b995c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:21.893428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d429c-cf02-4109-b0c2-e5b8328b995c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:21.898658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d67558-5552-483a-8ac0-8930fb189592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:21.899332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d67558-5552-483a-8ac0-8930fb189592 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.899608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d67558-5552-483a-8ac0-8930fb189592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.899920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d67558-5552-483a-8ac0-8930fb189592 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.900566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d67558-5552-483a-8ac0-8930fb189592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:21.902183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d67558-5552-483a-8ac0-8930fb189592 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:21.912767 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2549/5094] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:41:21.915990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:21.916967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d67558-5552-483a-8ac0-8930fb189592 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:21.919036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419b98c-3bc8-4321-bf10-26b00aeba487 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:21.927354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d67558-5552-483a-8ac0-8930fb189592 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:21.935305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74c3c3-27a2-4e97-9c24-008bb16321b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:21.935305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74c3c3-27a2-4e97-9c24-008bb16321b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.935596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74c3c3-27a2-4e97-9c24-008bb16321b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.935818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74c3c3-27a2-4e97-9c24-008bb16321b5 admin admin] PATH_INFO: `/v3/projects/7f98936445b543f9a6bf136d003cb309/users/d787ba9d75ed44f6b8df8b698196d3e0/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.937734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74c3c3-27a2-4e97-9c24-008bb16321b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f98936445b543f9a6bf136d003cb309, user_id=d787ba9d75ed44f6b8df8b698196d3e0, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:21.940787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74c3c3-27a2-4e97-9c24-008bb16321b5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:21.963178 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2550/5095] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:21 2022] PUT /identity/v3/projects/7f98936445b543f9a6bf136d003cb309/users/d787ba9d75ed44f6b8df8b698196d3e0/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:21.964872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97918de1-5b32-4fa1-aab8-40e172ba509c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.965710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97918de1-5b32-4fa1-aab8-40e172ba509c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.965710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97918de1-5b32-4fa1-aab8-40e172ba509c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.998006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-97918de1-5b32-4fa1-aab8-40e172ba509c None None] MFA Rules not processed for user `d787ba9d75ed44f6b8df8b698196d3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:21.999240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97918de1-5b32-4fa1-aab8-40e172ba509c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:22.008210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8682f-db5b-4534-8903-4cc1aec9575a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:22.009431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8682f-db5b-4534-8903-4cc1aec9575a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:22.009776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8682f-db5b-4534-8903-4cc1aec9575a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:22.010220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8682f-db5b-4534-8903-4cc1aec9575a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:22.032792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:22.088834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8682f-db5b-4534-8903-4cc1aec9575a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:22.090603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8682f-db5b-4534-8903-4cc1aec9575a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:22.098744 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2551/5096] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:22.104651 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2546/5097] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:41:22.110723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97918de1-5b32-4fa1-aab8-40e172ba509c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:22.112280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97918de1-5b32-4fa1-aab8-40e172ba509c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:22.155289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656146f-7f0d-41d9-bfdb-0c34a07f888d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:22.155676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656146f-7f0d-41d9-bfdb-0c34a07f888d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:22.155960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656146f-7f0d-41d9-bfdb-0c34a07f888d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:22.175796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a656146f-7f0d-41d9-bfdb-0c34a07f888d None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:22.176988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a656146f-7f0d-41d9-bfdb-0c34a07f888d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:22.180419 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2547/5098] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:22 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:41:22.189464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97918de1-5b32-4fa1-aab8-40e172ba509c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:22.193352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdad3a-ebc3-4205-b47c-9c747fc3dae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:22.193972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdad3a-ebc3-4205-b47c-9c747fc3dae3 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:22.194251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdad3a-ebc3-4205-b47c-9c747fc3dae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:22.194553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdad3a-ebc3-4205-b47c-9c747fc3dae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:22.204186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdad3a-ebc3-4205-b47c-9c747fc3dae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:22.205841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdad3a-ebc3-4205-b47c-9c747fc3dae3 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:22.216470 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2552/5099] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:22.564688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656146f-7f0d-41d9-bfdb-0c34a07f888d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:22.638688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656146f-7f0d-41d9-bfdb-0c34a07f888d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:22.644250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b7c43-99ed-410d-a50d-c8c418ee4318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:22.644902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b7c43-99ed-410d-a50d-c8c418ee4318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:22.645179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b7c43-99ed-410d-a50d-c8c418ee4318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:22.645450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b7c43-99ed-410d-a50d-c8c418ee4318 admin admin] PATH_INFO: `/v3/users/b053880ec7894a95a25420177f6e2793` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:22.646611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b7c43-99ed-410d-a50d-c8c418ee4318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b053880ec7894a95a25420177f6e2793)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:22.648557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b7c43-99ed-410d-a50d-c8c418ee4318 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:22.690038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:22.701487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-902b7c43-99ed-410d-a50d-c8c418ee4318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b053880ec7894a95a25420177f6e2793'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:22.718736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-902b7c43-99ed-410d-a50d-c8c418ee4318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b053880ec7894a95a25420177f6e2793'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:22.719589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-902b7c43-99ed-410d-a50d-c8c418ee4318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b053880ec7894a95a25420177f6e2793'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:22.720110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-902b7c43-99ed-410d-a50d-c8c418ee4318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b053880ec7894a95a25420177f6e2793'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:22.728425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-902b7c43-99ed-410d-a50d-c8c418ee4318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b053880ec7894a95a25420177f6e2793'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:22.746354 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2548/5100] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:22 2022] DELETE /identity/v3/users/b053880ec7894a95a25420177f6e2793 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:22.748074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09706628-f874-489c-bb77-16c023b4ca57 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:22.748540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09706628-f874-489c-bb77-16c023b4ca57 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:22.748807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09706628-f874-489c-bb77-16c023b4ca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:22.768785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-09706628-f874-489c-bb77-16c023b4ca57 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:22.770264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09706628-f874-489c-bb77-16c023b4ca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:22.855150 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2553/5101] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:22.862666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b7c43-99ed-410d-a50d-c8c418ee4318 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:22.864159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-902b7c43-99ed-410d-a50d-c8c418ee4318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:22.938254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b7c43-99ed-410d-a50d-c8c418ee4318 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:22.942067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156ffcb-dc19-4a55-b5a2-1275e9aff5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:22.942683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156ffcb-dc19-4a55-b5a2-1275e9aff5af service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:22.942962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156ffcb-dc19-4a55-b5a2-1275e9aff5af service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:22.943231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156ffcb-dc19-4a55-b5a2-1275e9aff5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:22.953259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156ffcb-dc19-4a55-b5a2-1275e9aff5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:22.954728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156ffcb-dc19-4a55-b5a2-1275e9aff5af service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:22.968694 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2549/5102] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:23.186300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494518a-978a-4e5f-b5bd-29fa965b2d83 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:23.186584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494518a-978a-4e5f-b5bd-29fa965b2d83 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:23.186859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494518a-978a-4e5f-b5bd-29fa965b2d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:23.223439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8494518a-978a-4e5f-b5bd-29fa965b2d83 None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:23.224726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8494518a-978a-4e5f-b5bd-29fa965b2d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:23.294135 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2554/5103] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:23.300549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e18d2-a794-4a44-8d56-6fcdc2a5c8d5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:23.300896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e18d2-a794-4a44-8d56-6fcdc2a5c8d5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:23.301208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e18d2-a794-4a44-8d56-6fcdc2a5c8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:23.321727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1e1e18d2-a794-4a44-8d56-6fcdc2a5c8d5 None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:23.323186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1e1e18d2-a794-4a44-8d56-6fcdc2a5c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:23.326627 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2550/5104] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:23 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:41:23.331199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0802b-9c33-42d2-9b30-cda4aed39310 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:23.331581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0802b-9c33-42d2-9b30-cda4aed39310 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:23.332056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0802b-9c33-42d2-9b30-cda4aed39310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:23.339779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:23.393917 n-d-850468-20 devstack@keystone.service[82161]: WARNING keystone.server.flask.application [None req-edb0802b-9c33-42d2-9b30-cda4aed39310 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 18:41:23.395597 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2555/5105] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:23 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 65 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Aug 28 18:41:23.400612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e705f7-4f14-4a27-8229-b3c2e5f04b3e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:23.400813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e705f7-4f14-4a27-8229-b3c2e5f04b3e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:23.401711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e705f7-4f14-4a27-8229-b3c2e5f04b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:23.436513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0802b-9c33-42d2-9b30-cda4aed39310 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:23.445583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-edb0802b-9c33-42d2-9b30-cda4aed39310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:23.454384 n-d-850468-20 devstack@keystone.service[82160]: WARNING keystone.server.flask.application [None req-58e705f7-4f14-4a27-8229-b3c2e5f04b3e None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 18:41:23.456524 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2551/5106] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:23 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 57 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 18:41:23.461019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892aa6-9215-4cda-8919-0b12c42a4458 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:23.461409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892aa6-9215-4cda-8919-0b12c42a4458 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:23.461784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892aa6-9215-4cda-8919-0b12c42a4458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:23.470941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0802b-9c33-42d2-9b30-cda4aed39310 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:23.476372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e742330-2c91-417b-9ce7-726b122d6706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:23.477460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e742330-2c91-417b-9ce7-726b122d6706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:23.480866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e742330-2c91-417b-9ce7-726b122d6706 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:23.481243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e742330-2c91-417b-9ce7-726b122d6706 admin admin] PATH_INFO: `/v3/projects/9712e95d26d04160aab0e0297668946c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:23.485115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e742330-2c91-417b-9ce7-726b122d6706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9712e95d26d04160aab0e0297668946c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:23.491604 n-d-850468-20 devstack@keystone.service[82160]: WARNING keystone.server.flask.application [None req-a4892aa6-9215-4cda-8919-0b12c42a4458 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 18:41:23.494605 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2552/5107] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:23 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 35 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 18:41:23.496583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e742330-2c91-417b-9ce7-726b122d6706 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:23.582757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e742330-2c91-417b-9ce7-726b122d6706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9712e95d26d04160aab0e0297668946c', 'request_id': 'req-3e742330-2c91-417b-9ce7-726b122d6706'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:23.593775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e742330-2c91-417b-9ce7-726b122d6706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9712e95d26d04160aab0e0297668946c', 'request_id': 'req-3e742330-2c91-417b-9ce7-726b122d6706'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:23.619807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e742330-2c91-417b-9ce7-726b122d6706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9712e95d26d04160aab0e0297668946c', 'request_id': 'req-3e742330-2c91-417b-9ce7-726b122d6706'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:23.656814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e742330-2c91-417b-9ce7-726b122d6706 admin admin] The token cache is being invalidate because project 9712e95d26d04160aab0e0297668946c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:23.657145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e742330-2c91-417b-9ce7-726b122d6706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:23.657872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e742330-2c91-417b-9ce7-726b122d6706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:23.660223 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2556/5108] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:23 2022] DELETE /identity/v3/projects/9712e95d26d04160aab0e0297668946c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:23.665159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff07362-40e8-44b4-ba83-1c522db7bedb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:23.665982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff07362-40e8-44b4-ba83-1c522db7bedb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:23.666264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff07362-40e8-44b4-ba83-1c522db7bedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:23.687147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8ff07362-40e8-44b4-ba83-1c522db7bedb None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:23.688722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8ff07362-40e8-44b4-ba83-1c522db7bedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:23.777392 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2553/5109] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:23.785138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47aca9-8fa1-4b62-acaa-95a81409d3ac None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:23.785687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47aca9-8fa1-4b62-acaa-95a81409d3ac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:23.785687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47aca9-8fa1-4b62-acaa-95a81409d3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:23.812476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-af47aca9-8fa1-4b62-acaa-95a81409d3ac None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:23.814566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af47aca9-8fa1-4b62-acaa-95a81409d3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:23.825540 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2557/5110] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:23.829874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff07362-40e8-44b4-ba83-1c522db7bedb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:23.842488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff07362-40e8-44b4-ba83-1c522db7bedb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:23.848475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6c13e-a295-4587-acc1-3e11d91ddc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:23.849435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6c13e-a295-4587-acc1-3e11d91ddc33 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:23.849815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6c13e-a295-4587-acc1-3e11d91ddc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:23.850224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6c13e-a295-4587-acc1-3e11d91ddc33 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:23.851046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6c13e-a295-4587-acc1-3e11d91ddc33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:23.851483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6c13e-a295-4587-acc1-3e11d91ddc33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:23.853264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6c13e-a295-4587-acc1-3e11d91ddc33 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:23.872708 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2554/5111] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:41:23.873527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47aca9-8fa1-4b62-acaa-95a81409d3ac None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:23.893104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6c13e-a295-4587-acc1-3e11d91ddc33 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:23.893774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47aca9-8fa1-4b62-acaa-95a81409d3ac None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:23.895743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bef6c13e-a295-4587-acc1-3e11d91ddc33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:23.900690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa1051-4a64-4603-ad53-810094229b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:23.901418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa1051-4a64-4603-ad53-810094229b49 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:23.901830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa1051-4a64-4603-ad53-810094229b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:23.902113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa1051-4a64-4603-ad53-810094229b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:23.903196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa1051-4a64-4603-ad53-810094229b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:23.906952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa1051-4a64-4603-ad53-810094229b49 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:23.915759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6c13e-a295-4587-acc1-3e11d91ddc33 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:23.922925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dfe06-9dc2-466d-975a-2b4d620e0886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:23.923890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dfe06-9dc2-466d-975a-2b4d620e0886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:23.924409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dfe06-9dc2-466d-975a-2b4d620e0886 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:23.925083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dfe06-9dc2-466d-975a-2b4d620e0886 admin admin] PATH_INFO: `/v3/users/458b96ae3f244f95b48748fa36e66d80` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:23.926651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dfe06-9dc2-466d-975a-2b4d620e0886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=458b96ae3f244f95b48748fa36e66d80)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:23.929935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dfe06-9dc2-466d-975a-2b4d620e0886 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:23.933538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:23.955185 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2558/5112] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:23 2022] POST /identity/v3/projects => generated 397 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:23.959550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa1051-4a64-4603-ad53-810094229b49 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:23.998093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c33dfe06-9dc2-466d-975a-2b4d620e0886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '458b96ae3f244f95b48748fa36e66d80'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:24.011797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c33dfe06-9dc2-466d-975a-2b4d620e0886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '458b96ae3f244f95b48748fa36e66d80'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:24.012733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c33dfe06-9dc2-466d-975a-2b4d620e0886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '458b96ae3f244f95b48748fa36e66d80'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:24.013379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c33dfe06-9dc2-466d-975a-2b4d620e0886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '458b96ae3f244f95b48748fa36e66d80'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:24.025273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c33dfe06-9dc2-466d-975a-2b4d620e0886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '458b96ae3f244f95b48748fa36e66d80'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:24.032319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa1051-4a64-4603-ad53-810094229b49 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:24.037028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47d1d1-825a-4836-a9b5-9e0d30a3a121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:24.037639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47d1d1-825a-4836-a9b5-9e0d30a3a121 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:24.038070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47d1d1-825a-4836-a9b5-9e0d30a3a121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:24.038489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47d1d1-825a-4836-a9b5-9e0d30a3a121 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:24.039285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47d1d1-825a-4836-a9b5-9e0d30a3a121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:24.041347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47d1d1-825a-4836-a9b5-9e0d30a3a121 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:24.041489 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2555/5113] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:23 2022] DELETE /identity/v3/users/458b96ae3f244f95b48748fa36e66d80 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:24.045874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1003e59-0b30-4b45-96af-2b3e31ab034b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:24.046163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1003e59-0b30-4b45-96af-2b3e31ab034b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:24.046448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1003e59-0b30-4b45-96af-2b3e31ab034b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:24.067674 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2559/5114] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:23 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:41:24.071955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47d1d1-825a-4836-a9b5-9e0d30a3a121 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:24.073421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f1003e59-0b30-4b45-96af-2b3e31ab034b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:24.073722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2f47d1d1-825a-4836-a9b5-9e0d30a3a121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:24.074879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f1003e59-0b30-4b45-96af-2b3e31ab034b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:24.088160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47d1d1-825a-4836-a9b5-9e0d30a3a121 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:24.116543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:24.158569 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2556/5115] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:24.165604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50227d32-b668-4a27-93ef-bfcb2a60e585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:24.166271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50227d32-b668-4a27-93ef-bfcb2a60e585 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:24.166572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50227d32-b668-4a27-93ef-bfcb2a60e585 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:24.166978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50227d32-b668-4a27-93ef-bfcb2a60e585 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:24.168015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50227d32-b668-4a27-93ef-bfcb2a60e585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:24.168420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1003e59-0b30-4b45-96af-2b3e31ab034b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:24.169638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50227d32-b668-4a27-93ef-bfcb2a60e585 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:24.169839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f1003e59-0b30-4b45-96af-2b3e31ab034b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:24.183049 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2560/5116] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:41:24.184156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50227d32-b668-4a27-93ef-bfcb2a60e585 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:24.194627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50227d32-b668-4a27-93ef-bfcb2a60e585 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:24.199636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cbf1f-04b3-48f2-8ab6-21b39f198aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:24.200393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cbf1f-04b3-48f2-8ab6-21b39f198aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:24.200773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cbf1f-04b3-48f2-8ab6-21b39f198aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:24.201164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cbf1f-04b3-48f2-8ab6-21b39f198aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:24.201915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cbf1f-04b3-48f2-8ab6-21b39f198aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:24.203777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cbf1f-04b3-48f2-8ab6-21b39f198aa2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:24.215474 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2561/5117] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:24.219575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cbf1f-04b3-48f2-8ab6-21b39f198aa2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:24.232026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cbf1f-04b3-48f2-8ab6-21b39f198aa2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:24.237480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884232e0-7869-4726-91b2-7f11d75d7e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:24.238178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884232e0-7869-4726-91b2-7f11d75d7e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:24.238464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884232e0-7869-4726-91b2-7f11d75d7e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:24.238741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884232e0-7869-4726-91b2-7f11d75d7e79 admin admin] PATH_INFO: `/v3/projects/4e0cbc1cf736456da4742f7c7a9039d0/users/17b66bf006ea446186842d9a73fd2eab/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:24.250892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1003e59-0b30-4b45-96af-2b3e31ab034b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:24.254820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c651c-fe6c-4112-acc5-5e6da8087750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:24.255540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c651c-fe6c-4112-acc5-5e6da8087750 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:24.255845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884232e0-7869-4726-91b2-7f11d75d7e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0cbc1cf736456da4742f7c7a9039d0, user_id=17b66bf006ea446186842d9a73fd2eab, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:24.255951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c651c-fe6c-4112-acc5-5e6da8087750 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:24.256432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c651c-fe6c-4112-acc5-5e6da8087750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:24.258665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884232e0-7869-4726-91b2-7f11d75d7e79 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:24.267724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c651c-fe6c-4112-acc5-5e6da8087750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:24.269753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c651c-fe6c-4112-acc5-5e6da8087750 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:24.273810 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2562/5118] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:24 2022] PUT /identity/v3/projects/4e0cbc1cf736456da4742f7c7a9039d0/users/17b66bf006ea446186842d9a73fd2eab/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:24.280680 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2557/5119] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:24.284097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2156dc-56ab-49ad-adfa-e988f2242283 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:24.284577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2156dc-56ab-49ad-adfa-e988f2242283 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:24.285118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2156dc-56ab-49ad-adfa-e988f2242283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:24.320559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9b2156dc-56ab-49ad-adfa-e988f2242283 None None] MFA Rules not processed for user `17b66bf006ea446186842d9a73fd2eab`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:24.321897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9b2156dc-56ab-49ad-adfa-e988f2242283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:24.413710 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2563/5120] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:24.428232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c651c-fe6c-4112-acc5-5e6da8087750 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:24.429774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-215c651c-fe6c-4112-acc5-5e6da8087750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:24.457873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:24.511766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c651c-fe6c-4112-acc5-5e6da8087750 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:24.563834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2156dc-56ab-49ad-adfa-e988f2242283 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:24.566099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9b2156dc-56ab-49ad-adfa-e988f2242283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:24.591515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29480f2b-bdc6-430f-8c22-72d2a5227adb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:24.592136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29480f2b-bdc6-430f-8c22-72d2a5227adb service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:24.592415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29480f2b-bdc6-430f-8c22-72d2a5227adb service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:24.592688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29480f2b-bdc6-430f-8c22-72d2a5227adb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:24.607180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29480f2b-bdc6-430f-8c22-72d2a5227adb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:24.609301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29480f2b-bdc6-430f-8c22-72d2a5227adb service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:24.619765 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2558/5121] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:24 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:24.647794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2156dc-56ab-49ad-adfa-e988f2242283 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:24.652343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045dd2e6-328b-435e-aaed-e6b71bedf0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:24.652983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dd2e6-328b-435e-aaed-e6b71bedf0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:24.653259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dd2e6-328b-435e-aaed-e6b71bedf0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:24.653529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dd2e6-328b-435e-aaed-e6b71bedf0ce admin admin] PATH_INFO: `/v3/projects/bcd1a807d62e4eb991a609e472cdb473` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:24.654788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045dd2e6-328b-435e-aaed-e6b71bedf0ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd1a807d62e4eb991a609e472cdb473)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:24.656821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045dd2e6-328b-435e-aaed-e6b71bedf0ce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:24.676828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d71d99-aca1-4800-b6f2-08538a6f1ad9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:24.677376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d71d99-aca1-4800-b6f2-08538a6f1ad9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:24.677376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d71d99-aca1-4800-b6f2-08538a6f1ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:24.682604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:24.699791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-51d71d99-aca1-4800-b6f2-08538a6f1ad9 None None] MFA Rules not processed for user `17b66bf006ea446186842d9a73fd2eab`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:24.701348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-51d71d99-aca1-4800-b6f2-08538a6f1ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:24.714486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-045dd2e6-328b-435e-aaed-e6b71bedf0ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd1a807d62e4eb991a609e472cdb473', 'request_id': 'req-045dd2e6-328b-435e-aaed-e6b71bedf0ce'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:24.727803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-045dd2e6-328b-435e-aaed-e6b71bedf0ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd1a807d62e4eb991a609e472cdb473', 'request_id': 'req-045dd2e6-328b-435e-aaed-e6b71bedf0ce'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:24.735436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-045dd2e6-328b-435e-aaed-e6b71bedf0ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd1a807d62e4eb991a609e472cdb473', 'request_id': 'req-045dd2e6-328b-435e-aaed-e6b71bedf0ce'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:24.748945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-045dd2e6-328b-435e-aaed-e6b71bedf0ce admin admin] The token cache is being invalidate because project bcd1a807d62e4eb991a609e472cdb473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:24.749238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-045dd2e6-328b-435e-aaed-e6b71bedf0ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:24.749952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-045dd2e6-328b-435e-aaed-e6b71bedf0ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:24.751595 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2564/5122] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:24 2022] DELETE /identity/v3/projects/bcd1a807d62e4eb991a609e472cdb473 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:24.755698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045dd2e6-328b-435e-aaed-e6b71bedf0ce admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:24.758306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-045dd2e6-328b-435e-aaed-e6b71bedf0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:24.768444 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2559/5123] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:24.838793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045dd2e6-328b-435e-aaed-e6b71bedf0ce admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:24.844093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75187ee-b0f0-4127-a07a-782872c50ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:24.844922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75187ee-b0f0-4127-a07a-782872c50ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:24.845324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75187ee-b0f0-4127-a07a-782872c50ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:24.845690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75187ee-b0f0-4127-a07a-782872c50ee1 admin admin] PATH_INFO: `/v3/users/d787ba9d75ed44f6b8df8b698196d3e0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:24.847037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75187ee-b0f0-4127-a07a-782872c50ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d787ba9d75ed44f6b8df8b698196d3e0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:24.849098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75187ee-b0f0-4127-a07a-782872c50ee1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:24.911497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a75187ee-b0f0-4127-a07a-782872c50ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd787ba9d75ed44f6b8df8b698196d3e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:24.912231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a75187ee-b0f0-4127-a07a-782872c50ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd787ba9d75ed44f6b8df8b698196d3e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:24.921369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a75187ee-b0f0-4127-a07a-782872c50ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd787ba9d75ed44f6b8df8b698196d3e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:24.930025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a75187ee-b0f0-4127-a07a-782872c50ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd787ba9d75ed44f6b8df8b698196d3e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:24.951672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a75187ee-b0f0-4127-a07a-782872c50ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd787ba9d75ed44f6b8df8b698196d3e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:24.960372 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2565/5124] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:24 2022] DELETE /identity/v3/users/d787ba9d75ed44f6b8df8b698196d3e0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:25.251183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d71d99-aca1-4800-b6f2-08538a6f1ad9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:25.268939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d71d99-aca1-4800-b6f2-08538a6f1ad9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:25.337060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:25.350335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b196dc-f918-49be-88bb-f502556ab37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:25.351103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b196dc-f918-49be-88bb-f502556ab37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:25.351417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b196dc-f918-49be-88bb-f502556ab37e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:25.351691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b196dc-f918-49be-88bb-f502556ab37e admin admin] PATH_INFO: `/v3/projects/7f98936445b543f9a6bf136d003cb309` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:25.352830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b196dc-f918-49be-88bb-f502556ab37e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f98936445b543f9a6bf136d003cb309)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:25.355019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b196dc-f918-49be-88bb-f502556ab37e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:25.413422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78b196dc-f918-49be-88bb-f502556ab37e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f98936445b543f9a6bf136d003cb309', 'request_id': 'req-78b196dc-f918-49be-88bb-f502556ab37e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:25.421463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78b196dc-f918-49be-88bb-f502556ab37e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f98936445b543f9a6bf136d003cb309', 'request_id': 'req-78b196dc-f918-49be-88bb-f502556ab37e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:25.429061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78b196dc-f918-49be-88bb-f502556ab37e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f98936445b543f9a6bf136d003cb309', 'request_id': 'req-78b196dc-f918-49be-88bb-f502556ab37e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:25.448839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78b196dc-f918-49be-88bb-f502556ab37e admin admin] The token cache is being invalidate because project 7f98936445b543f9a6bf136d003cb309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:25.449138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78b196dc-f918-49be-88bb-f502556ab37e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:25.449825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78b196dc-f918-49be-88bb-f502556ab37e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:25.451384 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2560/5125] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:25 2022] DELETE /identity/v3/projects/7f98936445b543f9a6bf136d003cb309 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:25.456415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22b4ee-6d3c-41d7-91f1-63a6aee648db None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:25.456779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22b4ee-6d3c-41d7-91f1-63a6aee648db None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:25.457055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22b4ee-6d3c-41d7-91f1-63a6aee648db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:25.490743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ad22b4ee-6d3c-41d7-91f1-63a6aee648db None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:25.492007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad22b4ee-6d3c-41d7-91f1-63a6aee648db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:25.512410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b196dc-f918-49be-88bb-f502556ab37e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:25.514913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-78b196dc-f918-49be-88bb-f502556ab37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:25.520738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:25.572879 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2566/5126] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:25.577256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112d2d6-33f0-4860-a1b7-8f456ac27edd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:25.577609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112d2d6-33f0-4860-a1b7-8f456ac27edd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:25.578337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112d2d6-33f0-4860-a1b7-8f456ac27edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:25.602249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f112d2d6-33f0-4860-a1b7-8f456ac27edd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:25.604036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f112d2d6-33f0-4860-a1b7-8f456ac27edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:25.610530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b196dc-f918-49be-88bb-f502556ab37e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:25.613984 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2567/5127] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:25.616740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b835fc2-a15d-4e64-ad38-b23d053409bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:25.617826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b835fc2-a15d-4e64-ad38-b23d053409bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:25.618187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b835fc2-a15d-4e64-ad38-b23d053409bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:25.618288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112d2d6-33f0-4860-a1b7-8f456ac27edd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:25.618590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b835fc2-a15d-4e64-ad38-b23d053409bc admin admin] PATH_INFO: `/v3/users/17b66bf006ea446186842d9a73fd2eab` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:25.620211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b835fc2-a15d-4e64-ad38-b23d053409bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b66bf006ea446186842d9a73fd2eab)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:25.622211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b835fc2-a15d-4e64-ad38-b23d053409bc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:25.630763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112d2d6-33f0-4860-a1b7-8f456ac27edd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:25.637143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38859557-767f-4470-a40e-6185445b255c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:25.638239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38859557-767f-4470-a40e-6185445b255c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:25.638522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38859557-767f-4470-a40e-6185445b255c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:25.639133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38859557-767f-4470-a40e-6185445b255c admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:25.639885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38859557-767f-4470-a40e-6185445b255c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:25.640123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38859557-767f-4470-a40e-6185445b255c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:25.644894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38859557-767f-4470-a40e-6185445b255c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:25.676024 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2568/5128] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:41:25.680699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38859557-767f-4470-a40e-6185445b255c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:25.686530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7b835fc2-a15d-4e64-ad38-b23d053409bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b66bf006ea446186842d9a73fd2eab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:25.692418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38859557-767f-4470-a40e-6185445b255c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:25.697620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2309c-a3af-4d1a-a0b6-c479f0a1a82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:25.698316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2309c-a3af-4d1a-a0b6-c479f0a1a82a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:25.698669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2309c-a3af-4d1a-a0b6-c479f0a1a82a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:25.699015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2309c-a3af-4d1a-a0b6-c479f0a1a82a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:25.699789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2309c-a3af-4d1a-a0b6-c479f0a1a82a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:25.702372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2309c-a3af-4d1a-a0b6-c479f0a1a82a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:25.708796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7b835fc2-a15d-4e64-ad38-b23d053409bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b66bf006ea446186842d9a73fd2eab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:25.711022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7b835fc2-a15d-4e64-ad38-b23d053409bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b66bf006ea446186842d9a73fd2eab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:25.711690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7b835fc2-a15d-4e64-ad38-b23d053409bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b66bf006ea446186842d9a73fd2eab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:25.722887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7b835fc2-a15d-4e64-ad38-b23d053409bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b66bf006ea446186842d9a73fd2eab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:25.733621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:25.738998 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2569/5129] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:25 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:25.740111 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2561/5130] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:25 2022] DELETE /identity/v3/users/17b66bf006ea446186842d9a73fd2eab => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:25.744655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b835fc2-a15d-4e64-ad38-b23d053409bc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:25.745554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83423cda-483c-4797-a7e9-603fd776e562 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:25.745882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83423cda-483c-4797-a7e9-603fd776e562 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:25.746204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83423cda-483c-4797-a7e9-603fd776e562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:25.746988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7b835fc2-a15d-4e64-ad38-b23d053409bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:25.768661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-83423cda-483c-4797-a7e9-603fd776e562 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:25.770030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-83423cda-483c-4797-a7e9-603fd776e562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:25.822815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b835fc2-a15d-4e64-ad38-b23d053409bc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:25.827937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16229f1f-1490-426c-9f37-29b689e6fd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:25.828549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16229f1f-1490-426c-9f37-29b689e6fd17 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:25.828890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16229f1f-1490-426c-9f37-29b689e6fd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:25.829168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16229f1f-1490-426c-9f37-29b689e6fd17 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:25.829812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16229f1f-1490-426c-9f37-29b689e6fd17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:25.831879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16229f1f-1490-426c-9f37-29b689e6fd17 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:25.842914 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2570/5131] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:25.854830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83423cda-483c-4797-a7e9-603fd776e562 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:25.856458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-83423cda-483c-4797-a7e9-603fd776e562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:25.862638 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2562/5132] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:25 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:25.866524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16229f1f-1490-426c-9f37-29b689e6fd17 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:25.876529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16229f1f-1490-426c-9f37-29b689e6fd17 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:25.881166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d9333-e32a-4405-8b8a-c11a0661d43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:25.881773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d9333-e32a-4405-8b8a-c11a0661d43e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:25.882055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d9333-e32a-4405-8b8a-c11a0661d43e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:25.882325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d9333-e32a-4405-8b8a-c11a0661d43e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:25.883089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d9333-e32a-4405-8b8a-c11a0661d43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:25.884597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d9333-e32a-4405-8b8a-c11a0661d43e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:25.895962 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2563/5133] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:41:25.900012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d9333-e32a-4405-8b8a-c11a0661d43e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:25.912580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d9333-e32a-4405-8b8a-c11a0661d43e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:25.917615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf486e-0d71-4ba1-a255-3864ae8a96de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:25.918379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf486e-0d71-4ba1-a255-3864ae8a96de admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:25.918774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf486e-0d71-4ba1-a255-3864ae8a96de admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:25.919148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf486e-0d71-4ba1-a255-3864ae8a96de admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:25.919978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf486e-0d71-4ba1-a255-3864ae8a96de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:25.922336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf486e-0d71-4ba1-a255-3864ae8a96de admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:25.925675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83423cda-483c-4797-a7e9-603fd776e562 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:25.930006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c283e25-9228-43c2-8ac9-b47a8d4d1d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:25.930626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c283e25-9228-43c2-8ac9-b47a8d4d1d0a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:25.930959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c283e25-9228-43c2-8ac9-b47a8d4d1d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:25.931291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c283e25-9228-43c2-8ac9-b47a8d4d1d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:25.934839 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2564/5134] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:41:25.939354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf486e-0d71-4ba1-a255-3864ae8a96de admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:25.944002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c283e25-9228-43c2-8ac9-b47a8d4d1d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:25.946168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c283e25-9228-43c2-8ac9-b47a8d4d1d0a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:25.949453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf486e-0d71-4ba1-a255-3864ae8a96de admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:25.954885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d990dd5-2a79-4d4c-a470-4e8294e36efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:25.955730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d990dd5-2a79-4d4c-a470-4e8294e36efb admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:25.956110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d990dd5-2a79-4d4c-a470-4e8294e36efb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:25.956486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d990dd5-2a79-4d4c-a470-4e8294e36efb admin admin] PATH_INFO: `/v3/projects/6c6c67ffa24d42dd9ad70528476b00c1/users/3d2ac900413a41a482436c89ab991902/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:25.958760 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2571/5135] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:41:25.978067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d990dd5-2a79-4d4c-a470-4e8294e36efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6c67ffa24d42dd9ad70528476b00c1, user_id=3d2ac900413a41a482436c89ab991902, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:25.981079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d990dd5-2a79-4d4c-a470-4e8294e36efb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:25.998723 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2565/5136] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:25 2022] PUT /identity/v3/projects/6c6c67ffa24d42dd9ad70528476b00c1/users/3d2ac900413a41a482436c89ab991902/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:26.009010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfa14c-fb26-4cb9-b561-d17cf57d5596 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:26.009342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfa14c-fb26-4cb9-b561-d17cf57d5596 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:26.010002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfa14c-fb26-4cb9-b561-d17cf57d5596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:26.047805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-61bfa14c-fb26-4cb9-b561-d17cf57d5596 None None] MFA Rules not processed for user `3d2ac900413a41a482436c89ab991902`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:26.049312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-61bfa14c-fb26-4cb9-b561-d17cf57d5596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:26.070681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:26.151228 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2572/5137] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:26.152441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d990dd5-2a79-4d4c-a470-4e8294e36efb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:26.231031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d990dd5-2a79-4d4c-a470-4e8294e36efb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:26.240080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742b66d-4ef3-433c-a172-8211cd671c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:26.240715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742b66d-4ef3-433c-a172-8211cd671c23 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:26.241455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742b66d-4ef3-433c-a172-8211cd671c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:26.241455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742b66d-4ef3-433c-a172-8211cd671c23 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:26.242023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742b66d-4ef3-433c-a172-8211cd671c23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:26.244122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742b66d-4ef3-433c-a172-8211cd671c23 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:26.275320 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2566/5138] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:26 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:26.278898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfa14c-fb26-4cb9-b561-d17cf57d5596 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:26.290100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfa14c-fb26-4cb9-b561-d17cf57d5596 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:26.329296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742b66d-4ef3-433c-a172-8211cd671c23 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:26.330912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3742b66d-4ef3-433c-a172-8211cd671c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:26.370189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d0455-2faf-4a7c-bfa0-a53df6f6e842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:26.371544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d0455-2faf-4a7c-bfa0-a53df6f6e842 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:26.371933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d0455-2faf-4a7c-bfa0-a53df6f6e842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:26.372389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d0455-2faf-4a7c-bfa0-a53df6f6e842 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:26.373337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d0455-2faf-4a7c-bfa0-a53df6f6e842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:26.374278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:26.376317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d0455-2faf-4a7c-bfa0-a53df6f6e842 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:26.418409 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2573/5139] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:26 2022] POST /identity/v3/users => generated 297 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:26.419361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d0455-2faf-4a7c-bfa0-a53df6f6e842 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:26.430997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d0455-2faf-4a7c-bfa0-a53df6f6e842 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:26.436323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b285e-b693-46dd-930a-ffbf51405a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:26.437095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b285e-b693-46dd-930a-ffbf51405a0a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:26.437427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b285e-b693-46dd-930a-ffbf51405a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:26.437579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742b66d-4ef3-433c-a172-8211cd671c23 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:26.437693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b285e-b693-46dd-930a-ffbf51405a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:26.438375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b285e-b693-46dd-930a-ffbf51405a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:26.440049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b285e-b693-46dd-930a-ffbf51405a0a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:26.445384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941ff43-152a-41da-ab95-ec2e1c8a88ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:26.446474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941ff43-152a-41da-ab95-ec2e1c8a88ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:26.447029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941ff43-152a-41da-ab95-ec2e1c8a88ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:26.447578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941ff43-152a-41da-ab95-ec2e1c8a88ab admin admin] PATH_INFO: `/v3/projects/4e0cbc1cf736456da4742f7c7a9039d0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:26.449493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941ff43-152a-41da-ab95-ec2e1c8a88ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e0cbc1cf736456da4742f7c7a9039d0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:26.452271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941ff43-152a-41da-ab95-ec2e1c8a88ab admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:26.455440 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2574/5140] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:26.460490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b285e-b693-46dd-930a-ffbf51405a0a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:26.473918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b285e-b693-46dd-930a-ffbf51405a0a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:26.478717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62340283-36ed-448b-aad9-08f87085e123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:26.479452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62340283-36ed-448b-aad9-08f87085e123 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:26.479738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62340283-36ed-448b-aad9-08f87085e123 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:26.480017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62340283-36ed-448b-aad9-08f87085e123 admin admin] PATH_INFO: `/v3/projects/d1a1c6cb89484075a8b5f401c31e12c4/users/5c133674ee23484d8764ebb3f6deff71/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:26.496937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62340283-36ed-448b-aad9-08f87085e123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1a1c6cb89484075a8b5f401c31e12c4, user_id=5c133674ee23484d8764ebb3f6deff71, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:26.499780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62340283-36ed-448b-aad9-08f87085e123 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:26.516734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b941ff43-152a-41da-ab95-ec2e1c8a88ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e0cbc1cf736456da4742f7c7a9039d0', 'request_id': 'req-b941ff43-152a-41da-ab95-ec2e1c8a88ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:26.517265 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2575/5141] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:26 2022] PUT /identity/v3/projects/d1a1c6cb89484075a8b5f401c31e12c4/users/5c133674ee23484d8764ebb3f6deff71/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:26.521086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62340283-36ed-448b-aad9-08f87085e123 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:26.523577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b941ff43-152a-41da-ab95-ec2e1c8a88ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e0cbc1cf736456da4742f7c7a9039d0', 'request_id': 'req-b941ff43-152a-41da-ab95-ec2e1c8a88ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:26.533180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b941ff43-152a-41da-ab95-ec2e1c8a88ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e0cbc1cf736456da4742f7c7a9039d0', 'request_id': 'req-b941ff43-152a-41da-ab95-ec2e1c8a88ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:26.550450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b941ff43-152a-41da-ab95-ec2e1c8a88ab admin admin] The token cache is being invalidate because project 4e0cbc1cf736456da4742f7c7a9039d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:26.551167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b941ff43-152a-41da-ab95-ec2e1c8a88ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:26.552173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b941ff43-152a-41da-ab95-ec2e1c8a88ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:26.555975 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2567/5142] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:26 2022] DELETE /identity/v3/projects/4e0cbc1cf736456da4742f7c7a9039d0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:26.564742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219e9b9-dedc-4421-9c81-70c601ba6e13 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:26.565058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219e9b9-dedc-4421-9c81-70c601ba6e13 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:26.565307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219e9b9-dedc-4421-9c81-70c601ba6e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:26.603497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4219e9b9-dedc-4421-9c81-70c601ba6e13 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:26.604845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4219e9b9-dedc-4421-9c81-70c601ba6e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:26.628053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62340283-36ed-448b-aad9-08f87085e123 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:26.633393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c27f3b-5359-43bb-834f-7a0569ea1c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:26.634473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c27f3b-5359-43bb-834f-7a0569ea1c3e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:26.634757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c27f3b-5359-43bb-834f-7a0569ea1c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:26.635034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c27f3b-5359-43bb-834f-7a0569ea1c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:26.635723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c27f3b-5359-43bb-834f-7a0569ea1c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:26.638617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c27f3b-5359-43bb-834f-7a0569ea1c3e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:26.659327 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2576/5143] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:41:26.662016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c27f3b-5359-43bb-834f-7a0569ea1c3e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:26.663877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-38c27f3b-5359-43bb-834f-7a0569ea1c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:26.677722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c27f3b-5359-43bb-834f-7a0569ea1c3e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:26.678677 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2568/5144] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:26.682793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8b6b3-ada4-4660-ba14-7dd49e7d1782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:26.683490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8b6b3-ada4-4660-ba14-7dd49e7d1782 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:26.683773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8b6b3-ada4-4660-ba14-7dd49e7d1782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:26.684051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8b6b3-ada4-4660-ba14-7dd49e7d1782 admin admin] PATH_INFO: `/v3/projects/d1a1c6cb89484075a8b5f401c31e12c4/users/5c133674ee23484d8764ebb3f6deff71/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:26.686400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbacec5-3d7d-4bca-93b8-8107a29d625d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:26.686542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8b6b3-ada4-4660-ba14-7dd49e7d1782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1a1c6cb89484075a8b5f401c31e12c4, user_id=5c133674ee23484d8764ebb3f6deff71, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:26.686660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbacec5-3d7d-4bca-93b8-8107a29d625d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:26.686660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbacec5-3d7d-4bca-93b8-8107a29d625d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:26.688971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8b6b3-ada4-4660-ba14-7dd49e7d1782 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:26.692404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:26.703918 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2577/5145] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:26 2022] PUT /identity/v3/projects/d1a1c6cb89484075a8b5f401c31e12c4/users/5c133674ee23484d8764ebb3f6deff71/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:26.707663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6bbacec5-3d7d-4bca-93b8-8107a29d625d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:26.708873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6bbacec5-3d7d-4bca-93b8-8107a29d625d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:26.714807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1579d0-369a-421c-80ed-40272b3fa3d8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:26.715145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1579d0-369a-421c-80ed-40272b3fa3d8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:26.715431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1579d0-369a-421c-80ed-40272b3fa3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:26.768876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:26.784945 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2569/5146] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:26.789599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbacec5-3d7d-4bca-93b8-8107a29d625d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:26.791164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fc1579d0-369a-421c-80ed-40272b3fa3d8 None None] MFA Rules not processed for user `5c133674ee23484d8764ebb3f6deff71`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:26.792722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc1579d0-369a-421c-80ed-40272b3fa3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:26.800544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbacec5-3d7d-4bca-93b8-8107a29d625d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:26.807503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6986c4e-d65d-4d55-b8e2-8556339cfc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:26.808129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6986c4e-d65d-4d55-b8e2-8556339cfc24 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:26.808411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6986c4e-d65d-4d55-b8e2-8556339cfc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:26.808686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6986c4e-d65d-4d55-b8e2-8556339cfc24 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:26.809349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6986c4e-d65d-4d55-b8e2-8556339cfc24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:26.809715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6986c4e-d65d-4d55-b8e2-8556339cfc24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:26.811359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6986c4e-d65d-4d55-b8e2-8556339cfc24 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:26.824789 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2570/5147] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:41:26.829132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6986c4e-d65d-4d55-b8e2-8556339cfc24 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:26.839863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6986c4e-d65d-4d55-b8e2-8556339cfc24 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:26.844712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbca9e-d075-4b68-b062-69abeedcc8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:26.845319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbca9e-d075-4b68-b062-69abeedcc8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:26.845865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbca9e-d075-4b68-b062-69abeedcc8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:26.845865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbca9e-d075-4b68-b062-69abeedcc8e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:26.846501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbca9e-d075-4b68-b062-69abeedcc8e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:26.848460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbca9e-d075-4b68-b062-69abeedcc8e6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:26.873605 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2578/5148] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:26.886953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1579d0-369a-421c-80ed-40272b3fa3d8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:26.888206 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2571/5149] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:26 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:41:26.892405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbca9e-d075-4b68-b062-69abeedcc8e6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:26.892674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc1579d0-369a-421c-80ed-40272b3fa3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:26.962107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1579d0-369a-421c-80ed-40272b3fa3d8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:26.964564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbca9e-d075-4b68-b062-69abeedcc8e6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:26.969814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810699e-2dc0-4984-a5d5-34932600dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:26.970265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810699e-2dc0-4984-a5d5-34932600dc8f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:26.970677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810699e-2dc0-4984-a5d5-34932600dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:26.985678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810699e-2dc0-4984-a5d5-34932600dc8f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:26.985678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810699e-2dc0-4984-a5d5-34932600dc8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:26.985678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810699e-2dc0-4984-a5d5-34932600dc8f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:27.015074 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2572/5150] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:26 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:27.019619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810699e-2dc0-4984-a5d5-34932600dc8f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:27.030574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810699e-2dc0-4984-a5d5-34932600dc8f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:27.030804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29c870-cb24-4c1a-88cd-bb8eef4d92fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:27.031490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29c870-cb24-4c1a-88cd-bb8eef4d92fc service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:27.031939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29c870-cb24-4c1a-88cd-bb8eef4d92fc service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:27.032360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29c870-cb24-4c1a-88cd-bb8eef4d92fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:27.036203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a833c-a531-4f31-834e-ebd135d993c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:27.036907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a833c-a531-4f31-834e-ebd135d993c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:27.037252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a833c-a531-4f31-834e-ebd135d993c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:27.037616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a833c-a531-4f31-834e-ebd135d993c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:27.038372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a833c-a531-4f31-834e-ebd135d993c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:27.040089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a833c-a531-4f31-834e-ebd135d993c8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:27.051338 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2573/5151] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:27.055816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a833c-a531-4f31-834e-ebd135d993c8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:27.067978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a833c-a531-4f31-834e-ebd135d993c8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:27.073346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5a77d-67d5-4bcb-b468-f790a518f71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:27.074096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5a77d-67d5-4bcb-b468-f790a518f71a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:27.074495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5a77d-67d5-4bcb-b468-f790a518f71a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:27.074870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5a77d-67d5-4bcb-b468-f790a518f71a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:27.075747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5a77d-67d5-4bcb-b468-f790a518f71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:27.077590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5a77d-67d5-4bcb-b468-f790a518f71a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:27.107544 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2574/5152] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:41:27.124695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5a77d-67d5-4bcb-b468-f790a518f71a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:27.140222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:27.146660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5a77d-67d5-4bcb-b468-f790a518f71a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:27.161404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c1eb2-3939-405d-b30a-724125c840d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:27.162296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c1eb2-3939-405d-b30a-724125c840d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:27.163235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c1eb2-3939-405d-b30a-724125c840d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:27.163960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c1eb2-3939-405d-b30a-724125c840d0 admin admin] PATH_INFO: `/v3/projects/219bcef679bc4c61a2b23ab9c29e3a93/users/2a1cab39f20c4a758e9a190f85eeafa7/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:27.170159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29c870-cb24-4c1a-88cd-bb8eef4d92fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:27.172979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29c870-cb24-4c1a-88cd-bb8eef4d92fc service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:27.191490 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2579/5153] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:41:27.195876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c1eb2-3939-405d-b30a-724125c840d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219bcef679bc4c61a2b23ab9c29e3a93, user_id=2a1cab39f20c4a758e9a190f85eeafa7, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:27.199685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c1eb2-3939-405d-b30a-724125c840d0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:27.234106 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2575/5154] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:27 2022] PUT /identity/v3/projects/219bcef679bc4c61a2b23ab9c29e3a93/users/2a1cab39f20c4a758e9a190f85eeafa7/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:27.239500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8406d-5314-43f3-b412-48ec8101edfc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:27.239868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8406d-5314-43f3-b412-48ec8101edfc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:27.241063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8406d-5314-43f3-b412-48ec8101edfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:27.265713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-19d8406d-5314-43f3-b412-48ec8101edfc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:27.267732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-19d8406d-5314-43f3-b412-48ec8101edfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:27.358553 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2580/5155] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:27.362761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c1eb2-3939-405d-b30a-724125c840d0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:27.364625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d34c1eb2-3939-405d-b30a-724125c840d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:27.450120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c1eb2-3939-405d-b30a-724125c840d0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:27.455573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27236ad8-4f8c-400c-a6eb-51f7dd673953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:27.456210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27236ad8-4f8c-400c-a6eb-51f7dd673953 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:27.456494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27236ad8-4f8c-400c-a6eb-51f7dd673953 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:27.456773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27236ad8-4f8c-400c-a6eb-51f7dd673953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:27.472799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27236ad8-4f8c-400c-a6eb-51f7dd673953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:27.474283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27236ad8-4f8c-400c-a6eb-51f7dd673953 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:27.487131 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2576/5156] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:27.673441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8406d-5314-43f3-b412-48ec8101edfc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:27.772423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8406d-5314-43f3-b412-48ec8101edfc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:27.782011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627a20d-9182-4b66-86b7-41797f337539 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c133674ee23484d8764ebb3f6deff71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1a1c6cb89484075a8b5f401c31e12c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:27.782652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627a20d-9182-4b66-86b7-41797f337539 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:27.782935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627a20d-9182-4b66-86b7-41797f337539 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:27.783215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627a20d-9182-4b66-86b7-41797f337539 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:27.783934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627a20d-9182-4b66-86b7-41797f337539 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:27.784360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627a20d-9182-4b66-86b7-41797f337539 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:27.786001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627a20d-9182-4b66-86b7-41797f337539 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:27.804143 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2581/5157] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:41:27.804688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27236ad8-4f8c-400c-a6eb-51f7dd673953 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:27.816215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27236ad8-4f8c-400c-a6eb-51f7dd673953 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:27.821111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793df05d-5e61-438f-af87-9a1f14f85b3c tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c133674ee23484d8764ebb3f6deff71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1a1c6cb89484075a8b5f401c31e12c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:27.821784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793df05d-5e61-438f-af87-9a1f14f85b3c tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:27.822076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793df05d-5e61-438f-af87-9a1f14f85b3c tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:27.822501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793df05d-5e61-438f-af87-9a1f14f85b3c tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:27.823155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793df05d-5e61-438f-af87-9a1f14f85b3c tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:27.825206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793df05d-5e61-438f-af87-9a1f14f85b3c tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:27.837451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:27.864021 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2577/5158] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:27 2022] POST /identity/v3/projects => generated 354 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:41:27.871009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627a20d-9182-4b66-86b7-41797f337539 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:27.883572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627a20d-9182-4b66-86b7-41797f337539 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:27.998775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e7c3b-d524-4d0e-8247-add74383ddb8 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c133674ee23484d8764ebb3f6deff71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1a1c6cb89484075a8b5f401c31e12c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:27.999897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e7c3b-d524-4d0e-8247-add74383ddb8 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:28.000829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e7c3b-d524-4d0e-8247-add74383ddb8 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:28.001461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e7c3b-d524-4d0e-8247-add74383ddb8 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:28.002695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e7c3b-d524-4d0e-8247-add74383ddb8 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:28.003807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e7c3b-d524-4d0e-8247-add74383ddb8 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:28.005945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e7c3b-d524-4d0e-8247-add74383ddb8 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:28.023715 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2582/5159] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:41:28.067593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793df05d-5e61-438f-af87-9a1f14f85b3c tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:28.078970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793df05d-5e61-438f-af87-9a1f14f85b3c tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:28.083839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d377d2d-a730-406e-84da-d73a79fcecfa tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c133674ee23484d8764ebb3f6deff71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1a1c6cb89484075a8b5f401c31e12c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:28.085255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d377d2d-a730-406e-84da-d73a79fcecfa tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:28.086043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d377d2d-a730-406e-84da-d73a79fcecfa tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:28.086336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d377d2d-a730-406e-84da-d73a79fcecfa tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] PATH_INFO: `/v3/projects/4aea6ef7e9e44e0eaba9f0c803f862ad` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:28.087929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d377d2d-a730-406e-84da-d73a79fcecfa tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4aea6ef7e9e44e0eaba9f0c803f862ad)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:28.089861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d377d2d-a730-406e-84da-d73a79fcecfa tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:28.145501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d377d2d-a730-406e-84da-d73a79fcecfa tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aea6ef7e9e44e0eaba9f0c803f862ad', 'request_id': 'req-4d377d2d-a730-406e-84da-d73a79fcecfa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:28.153275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d377d2d-a730-406e-84da-d73a79fcecfa tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aea6ef7e9e44e0eaba9f0c803f862ad', 'request_id': 'req-4d377d2d-a730-406e-84da-d73a79fcecfa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:28.159666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d377d2d-a730-406e-84da-d73a79fcecfa tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aea6ef7e9e44e0eaba9f0c803f862ad', 'request_id': 'req-4d377d2d-a730-406e-84da-d73a79fcecfa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:28.173781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d377d2d-a730-406e-84da-d73a79fcecfa tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] The token cache is being invalidate because project 4aea6ef7e9e44e0eaba9f0c803f862ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:28.173998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d377d2d-a730-406e-84da-d73a79fcecfa tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:28.174620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d377d2d-a730-406e-84da-d73a79fcecfa tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:28.176408 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2578/5160] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:28 2022] DELETE /identity/v3/projects/4aea6ef7e9e44e0eaba9f0c803f862ad => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:28.425862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e7c3b-d524-4d0e-8247-add74383ddb8 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:28.428541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e6e7c3b-d524-4d0e-8247-add74383ddb8 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:28.449357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:28.514598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e7c3b-d524-4d0e-8247-add74383ddb8 tempest-VolumeQuotaClassesTest-1933732833 tempest-VolumeQuotaClassesTest-1933732833-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:28.601394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce334637-d593-4215-af35-b39303a9946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:28.602983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce334637-d593-4215-af35-b39303a9946b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:28.603303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce334637-d593-4215-af35-b39303a9946b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:28.603592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce334637-d593-4215-af35-b39303a9946b admin admin] PATH_INFO: `/v3/users/3d2ac900413a41a482436c89ab991902` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:28.605804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce334637-d593-4215-af35-b39303a9946b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d2ac900413a41a482436c89ab991902)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:28.608207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce334637-d593-4215-af35-b39303a9946b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:28.679922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce334637-d593-4215-af35-b39303a9946b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d2ac900413a41a482436c89ab991902'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:28.681342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce334637-d593-4215-af35-b39303a9946b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d2ac900413a41a482436c89ab991902'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:28.692058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce334637-d593-4215-af35-b39303a9946b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d2ac900413a41a482436c89ab991902'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:28.703508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce334637-d593-4215-af35-b39303a9946b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d2ac900413a41a482436c89ab991902'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:28.721602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce334637-d593-4215-af35-b39303a9946b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d2ac900413a41a482436c89ab991902'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:28.729518 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2583/5161] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:28 2022] DELETE /identity/v3/users/3d2ac900413a41a482436c89ab991902 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:28.735498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231a06d-897a-4f76-83be-b4e4e5a5a49c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:28.735842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231a06d-897a-4f76-83be-b4e4e5a5a49c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:28.736358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231a06d-897a-4f76-83be-b4e4e5a5a49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:28.771529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a231a06d-897a-4f76-83be-b4e4e5a5a49c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:28.774548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a231a06d-897a-4f76-83be-b4e4e5a5a49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:28.868213 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2579/5162] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:28.878424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce334637-d593-4215-af35-b39303a9946b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:28.880695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce334637-d593-4215-af35-b39303a9946b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:28.956620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:28.975950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce334637-d593-4215-af35-b39303a9946b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:28.982009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149badd-38c9-42d2-8b6d-4cd4b70e3347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:28.982843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149badd-38c9-42d2-8b6d-4cd4b70e3347 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:28.983367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149badd-38c9-42d2-8b6d-4cd4b70e3347 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:28.983695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149badd-38c9-42d2-8b6d-4cd4b70e3347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:29.005538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149badd-38c9-42d2-8b6d-4cd4b70e3347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:29.007807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149badd-38c9-42d2-8b6d-4cd4b70e3347 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:29.024396 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2584/5163] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:29.439827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231a06d-897a-4f76-83be-b4e4e5a5a49c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:29.441343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a231a06d-897a-4f76-83be-b4e4e5a5a49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:29.454940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231a06d-897a-4f76-83be-b4e4e5a5a49c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:29.468208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa8e86-8247-4473-b6fa-a8db9b4857e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:29.469173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa8e86-8247-4473-b6fa-a8db9b4857e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:29.469346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa8e86-8247-4473-b6fa-a8db9b4857e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:29.469671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa8e86-8247-4473-b6fa-a8db9b4857e0 admin admin] PATH_INFO: `/v3/projects/6c6c67ffa24d42dd9ad70528476b00c1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:29.470982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa8e86-8247-4473-b6fa-a8db9b4857e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c6c67ffa24d42dd9ad70528476b00c1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:29.474247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa8e86-8247-4473-b6fa-a8db9b4857e0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:29.569424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-88aa8e86-8247-4473-b6fa-a8db9b4857e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c6c67ffa24d42dd9ad70528476b00c1', 'request_id': 'req-88aa8e86-8247-4473-b6fa-a8db9b4857e0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:29.581078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-88aa8e86-8247-4473-b6fa-a8db9b4857e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c6c67ffa24d42dd9ad70528476b00c1', 'request_id': 'req-88aa8e86-8247-4473-b6fa-a8db9b4857e0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:29.588621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-88aa8e86-8247-4473-b6fa-a8db9b4857e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c6c67ffa24d42dd9ad70528476b00c1', 'request_id': 'req-88aa8e86-8247-4473-b6fa-a8db9b4857e0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:29.592649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:29.609268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-88aa8e86-8247-4473-b6fa-a8db9b4857e0 admin admin] The token cache is being invalidate because project 6c6c67ffa24d42dd9ad70528476b00c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:29.609831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-88aa8e86-8247-4473-b6fa-a8db9b4857e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:29.610752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-88aa8e86-8247-4473-b6fa-a8db9b4857e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:29.613069 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2580/5164] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:29 2022] DELETE /identity/v3/projects/6c6c67ffa24d42dd9ad70528476b00c1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:29.617038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149badd-38c9-42d2-8b6d-4cd4b70e3347 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:29.628068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149badd-38c9-42d2-8b6d-4cd4b70e3347 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:29.691835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2126369-4730-40f4-b76d-e21868695ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:29.692841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126369-4730-40f4-b76d-e21868695ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:29.693119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126369-4730-40f4-b76d-e21868695ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:29.693388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126369-4730-40f4-b76d-e21868695ecd admin admin] PATH_INFO: `/v3/users/5c133674ee23484d8764ebb3f6deff71` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:29.694755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2126369-4730-40f4-b76d-e21868695ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c133674ee23484d8764ebb3f6deff71)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:29.697070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2126369-4730-40f4-b76d-e21868695ecd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:29.746787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e2126369-4730-40f4-b76d-e21868695ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c133674ee23484d8764ebb3f6deff71'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:29.747445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e2126369-4730-40f4-b76d-e21868695ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c133674ee23484d8764ebb3f6deff71'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:29.755090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e2126369-4730-40f4-b76d-e21868695ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c133674ee23484d8764ebb3f6deff71'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:29.765194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e2126369-4730-40f4-b76d-e21868695ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c133674ee23484d8764ebb3f6deff71'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:29.777224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e2126369-4730-40f4-b76d-e21868695ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c133674ee23484d8764ebb3f6deff71'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:29.783929 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2585/5165] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:29 2022] DELETE /identity/v3/users/5c133674ee23484d8764ebb3f6deff71 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:30.158798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa8e86-8247-4473-b6fa-a8db9b4857e0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:30.160612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-88aa8e86-8247-4473-b6fa-a8db9b4857e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:30.176795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa8e86-8247-4473-b6fa-a8db9b4857e0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:30.283782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf530a22-95ce-4339-82a7-70a910257f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:30.284492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf530a22-95ce-4339-82a7-70a910257f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:30.284779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf530a22-95ce-4339-82a7-70a910257f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:30.285057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf530a22-95ce-4339-82a7-70a910257f8f admin admin] PATH_INFO: `/v3/projects/d1a1c6cb89484075a8b5f401c31e12c4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:30.286238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf530a22-95ce-4339-82a7-70a910257f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1a1c6cb89484075a8b5f401c31e12c4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:30.288409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf530a22-95ce-4339-82a7-70a910257f8f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:30.385298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf530a22-95ce-4339-82a7-70a910257f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1a1c6cb89484075a8b5f401c31e12c4', 'request_id': 'req-bf530a22-95ce-4339-82a7-70a910257f8f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:30.393896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf530a22-95ce-4339-82a7-70a910257f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1a1c6cb89484075a8b5f401c31e12c4', 'request_id': 'req-bf530a22-95ce-4339-82a7-70a910257f8f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:30.405329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf530a22-95ce-4339-82a7-70a910257f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1a1c6cb89484075a8b5f401c31e12c4', 'request_id': 'req-bf530a22-95ce-4339-82a7-70a910257f8f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:30.423793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf530a22-95ce-4339-82a7-70a910257f8f admin admin] The token cache is being invalidate because project d1a1c6cb89484075a8b5f401c31e12c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:30.424543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf530a22-95ce-4339-82a7-70a910257f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:30.425803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf530a22-95ce-4339-82a7-70a910257f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:30.428450 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2581/5166] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:30 2022] DELETE /identity/v3/projects/d1a1c6cb89484075a8b5f401c31e12c4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:30.433432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bc14f-cd6d-44aa-9aee-8fa768009d2a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:30.433976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bc14f-cd6d-44aa-9aee-8fa768009d2a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:30.434201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bc14f-cd6d-44aa-9aee-8fa768009d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:30.458905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-717bc14f-cd6d-44aa-9aee-8fa768009d2a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:30.465014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-717bc14f-cd6d-44aa-9aee-8fa768009d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:30.547138 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2586/5167] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:30.565289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890eac92-b10c-4057-97df-c8a7b72f858c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:30.566287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890eac92-b10c-4057-97df-c8a7b72f858c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:30.566588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890eac92-b10c-4057-97df-c8a7b72f858c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:30.602855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-890eac92-b10c-4057-97df-c8a7b72f858c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:30.604492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-890eac92-b10c-4057-97df-c8a7b72f858c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:30.615129 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2582/5168] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:30.619418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717bc14f-cd6d-44aa-9aee-8fa768009d2a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:30.626182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:30.630797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717bc14f-cd6d-44aa-9aee-8fa768009d2a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:30.639550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e379c-43e9-4546-beee-19e9b5d52972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:30.640986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e379c-43e9-4546-beee-19e9b5d52972 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:30.648861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e379c-43e9-4546-beee-19e9b5d52972 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:30.649321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e379c-43e9-4546-beee-19e9b5d52972 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:30.650332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e379c-43e9-4546-beee-19e9b5d52972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:30.650822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e379c-43e9-4546-beee-19e9b5d52972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:30.652757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e379c-43e9-4546-beee-19e9b5d52972 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:30.668810 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2587/5169] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:41:30.673313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890eac92-b10c-4057-97df-c8a7b72f858c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:30.683992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890eac92-b10c-4057-97df-c8a7b72f858c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:30.689517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf8bbf-aaa5-4e27-9383-28017839670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:30.690264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf8bbf-aaa5-4e27-9383-28017839670c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:30.690646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf8bbf-aaa5-4e27-9383-28017839670c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:30.691018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf8bbf-aaa5-4e27-9383-28017839670c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:30.691827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf8bbf-aaa5-4e27-9383-28017839670c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:30.693874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf8bbf-aaa5-4e27-9383-28017839670c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:30.736607 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2583/5170] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:30 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:41:30.736899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e379c-43e9-4546-beee-19e9b5d52972 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:30.755239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e379c-43e9-4546-beee-19e9b5d52972 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:30.875310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff94bd-81a4-4a73-a929-ff0580b28c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:30.875984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff94bd-81a4-4a73-a929-ff0580b28c9c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:30.877031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff94bd-81a4-4a73-a929-ff0580b28c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:30.877234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff94bd-81a4-4a73-a929-ff0580b28c9c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:30.877892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff94bd-81a4-4a73-a929-ff0580b28c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:30.880018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff94bd-81a4-4a73-a929-ff0580b28c9c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:30.926296 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2588/5171] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:30 2022] POST /identity/v3/users => generated 295 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:30.930459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf8bbf-aaa5-4e27-9383-28017839670c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:30.945846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf8bbf-aaa5-4e27-9383-28017839670c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:30.952625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4218e7-e37f-4cec-a70e-11989954e2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:30.953556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4218e7-e37f-4cec-a70e-11989954e2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:30.954100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4218e7-e37f-4cec-a70e-11989954e2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:30.954473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4218e7-e37f-4cec-a70e-11989954e2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:30.956132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4218e7-e37f-4cec-a70e-11989954e2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:30.957893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4218e7-e37f-4cec-a70e-11989954e2c8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:30.973894 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2584/5172] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:30.975127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff94bd-81a4-4a73-a929-ff0580b28c9c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:30.988829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff94bd-81a4-4a73-a929-ff0580b28c9c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:31.004310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3aae6-4a1f-4106-ba02-7378d146bed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:31.005354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3aae6-4a1f-4106-ba02-7378d146bed3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:31.005354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3aae6-4a1f-4106-ba02-7378d146bed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:31.005896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3aae6-4a1f-4106-ba02-7378d146bed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:31.006565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3aae6-4a1f-4106-ba02-7378d146bed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:31.008274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3aae6-4a1f-4106-ba02-7378d146bed3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:31.027627 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2589/5173] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:41:31.029057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4218e7-e37f-4cec-a70e-11989954e2c8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:31.040440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4218e7-e37f-4cec-a70e-11989954e2c8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:31.045858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e26dde-db86-4865-bd83-33a2955041d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:31.046644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e26dde-db86-4865-bd83-33a2955041d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:31.046992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e26dde-db86-4865-bd83-33a2955041d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:31.047416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e26dde-db86-4865-bd83-33a2955041d1 admin admin] PATH_INFO: `/v3/projects/a33e9d8721a2416dadbcccd6871204a4/users/7327723784064d94a3df13b6f111918b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:31.070366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e26dde-db86-4865-bd83-33a2955041d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a33e9d8721a2416dadbcccd6871204a4, user_id=7327723784064d94a3df13b6f111918b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:31.074826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e26dde-db86-4865-bd83-33a2955041d1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:31.102733 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2585/5174] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:31 2022] PUT /identity/v3/projects/a33e9d8721a2416dadbcccd6871204a4/users/7327723784064d94a3df13b6f111918b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:31.103592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ea6ae-5b31-4493-933b-03b0356b3f57 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:31.104061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ea6ae-5b31-4493-933b-03b0356b3f57 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:31.104495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ea6ae-5b31-4493-933b-03b0356b3f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:31.175426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-421ea6ae-5b31-4493-933b-03b0356b3f57 None None] MFA Rules not processed for user `7327723784064d94a3df13b6f111918b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:31.175426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-421ea6ae-5b31-4493-933b-03b0356b3f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:31.291302 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2590/5175] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:31.294461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e26dde-db86-4865-bd83-33a2955041d1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:31.323930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:31.376171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e26dde-db86-4865-bd83-33a2955041d1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:31.381853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b0e52-d1cb-464a-9f97-de29db5da3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:31.383119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b0e52-d1cb-464a-9f97-de29db5da3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:31.383119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b0e52-d1cb-464a-9f97-de29db5da3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:31.383119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b0e52-d1cb-464a-9f97-de29db5da3e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:31.384047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b0e52-d1cb-464a-9f97-de29db5da3e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:31.386040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b0e52-d1cb-464a-9f97-de29db5da3e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:31.418988 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2586/5176] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:31 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:31.422960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ea6ae-5b31-4493-933b-03b0356b3f57 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:31.435557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ea6ae-5b31-4493-933b-03b0356b3f57 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:31.517152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb123388-9087-424b-b24e-692a310ae5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:31.517787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb123388-9087-424b-b24e-692a310ae5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:31.518067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb123388-9087-424b-b24e-692a310ae5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:31.518350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb123388-9087-424b-b24e-692a310ae5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:31.518981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb123388-9087-424b-b24e-692a310ae5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:31.523671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb123388-9087-424b-b24e-692a310ae5a4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:31.536514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:31.558179 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2591/5177] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:31 2022] POST /identity/v3/users => generated 300 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:41:31.562252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b0e52-d1cb-464a-9f97-de29db5da3e2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:31.574233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b0e52-d1cb-464a-9f97-de29db5da3e2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:31.579156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b9180-ae66-416b-810b-32cd2fa11461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:31.579838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b9180-ae66-416b-810b-32cd2fa11461 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:31.580108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b9180-ae66-416b-810b-32cd2fa11461 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:31.580391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b9180-ae66-416b-810b-32cd2fa11461 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:31.581034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b9180-ae66-416b-810b-32cd2fa11461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:31.582640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b9180-ae66-416b-810b-32cd2fa11461 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:31.594235 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2587/5178] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:31.601031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb123388-9087-424b-b24e-692a310ae5a4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:31.611547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb123388-9087-424b-b24e-692a310ae5a4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:31.616362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a0b82-ec07-4e40-bf57-a1ff3aa1014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:31.617135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a0b82-ec07-4e40-bf57-a1ff3aa1014a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:31.617512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a0b82-ec07-4e40-bf57-a1ff3aa1014a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:31.617883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a0b82-ec07-4e40-bf57-a1ff3aa1014a admin admin] PATH_INFO: `/v3/projects/ce4ff3c51e964a9c88c338d203ad1870/users/f26a252d99844703a3f190835bde3504/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:31.638156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a0b82-ec07-4e40-bf57-a1ff3aa1014a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4ff3c51e964a9c88c338d203ad1870, user_id=f26a252d99844703a3f190835bde3504, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:31.641210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a0b82-ec07-4e40-bf57-a1ff3aa1014a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:31.665980 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2592/5179] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:31 2022] PUT /identity/v3/projects/ce4ff3c51e964a9c88c338d203ad1870/users/f26a252d99844703a3f190835bde3504/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:31.670115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b9180-ae66-416b-810b-32cd2fa11461 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:31.682471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b9180-ae66-416b-810b-32cd2fa11461 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:31.769978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2ade3-6f74-45a7-80e4-d8c4e579e25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:31.770609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2ade3-6f74-45a7-80e4-d8c4e579e25f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:31.770894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2ade3-6f74-45a7-80e4-d8c4e579e25f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:31.771171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2ade3-6f74-45a7-80e4-d8c4e579e25f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:31.772269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2ade3-6f74-45a7-80e4-d8c4e579e25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:31.774857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2ade3-6f74-45a7-80e4-d8c4e579e25f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:31.787064 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2588/5180] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:31.790988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a0b82-ec07-4e40-bf57-a1ff3aa1014a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:31.803364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a0b82-ec07-4e40-bf57-a1ff3aa1014a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:31.809371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb558bd4-8d2e-4bb3-81d1-6e1e1d7b6b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:31.810707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558bd4-8d2e-4bb3-81d1-6e1e1d7b6b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:31.811870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558bd4-8d2e-4bb3-81d1-6e1e1d7b6b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:31.813037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558bd4-8d2e-4bb3-81d1-6e1e1d7b6b53 admin admin] PATH_INFO: `/v3/projects/ce4ff3c51e964a9c88c338d203ad1870/users/f26a252d99844703a3f190835bde3504/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:31.816117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb558bd4-8d2e-4bb3-81d1-6e1e1d7b6b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4ff3c51e964a9c88c338d203ad1870, user_id=f26a252d99844703a3f190835bde3504, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:31.818778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb558bd4-8d2e-4bb3-81d1-6e1e1d7b6b53 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:31.841234 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2593/5181] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:31 2022] PUT /identity/v3/projects/ce4ff3c51e964a9c88c338d203ad1870/users/f26a252d99844703a3f190835bde3504/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:31.843384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f094f-a877-411d-a57a-f2c1219b1d8c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:31.843744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f094f-a877-411d-a57a-f2c1219b1d8c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:31.844123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f094f-a877-411d-a57a-f2c1219b1d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:31.880909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-514f094f-a877-411d-a57a-f2c1219b1d8c None None] MFA Rules not processed for user `f26a252d99844703a3f190835bde3504`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:31.882144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-514f094f-a877-411d-a57a-f2c1219b1d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:32.009371 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2589/5182] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:32.024780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb558bd4-8d2e-4bb3-81d1-6e1e1d7b6b53 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:32.027492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cb558bd4-8d2e-4bb3-81d1-6e1e1d7b6b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:32.170456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb558bd4-8d2e-4bb3-81d1-6e1e1d7b6b53 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:32.177315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf1097-60df-4081-86df-93c14e278bbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:32.179975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf1097-60df-4081-86df-93c14e278bbc service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:32.180269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf1097-60df-4081-86df-93c14e278bbc service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:32.180553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf1097-60df-4081-86df-93c14e278bbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:32.199679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf1097-60df-4081-86df-93c14e278bbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:32.204120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf1097-60df-4081-86df-93c14e278bbc service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:32.226040 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2594/5183] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:32.409554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f094f-a877-411d-a57a-f2c1219b1d8c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:32.444187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:32.512339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f094f-a877-411d-a57a-f2c1219b1d8c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:32.520138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce4813-5e72-4833-bd12-d04d9068f88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:32.520820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce4813-5e72-4833-bd12-d04d9068f88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:32.521262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce4813-5e72-4833-bd12-d04d9068f88b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:32.521702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce4813-5e72-4833-bd12-d04d9068f88b admin admin] PATH_INFO: `/v3/users/7327723784064d94a3df13b6f111918b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:32.522954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce4813-5e72-4833-bd12-d04d9068f88b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7327723784064d94a3df13b6f111918b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:32.525876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce4813-5e72-4833-bd12-d04d9068f88b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:32.597158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80ce4813-5e72-4833-bd12-d04d9068f88b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7327723784064d94a3df13b6f111918b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:32.614778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80ce4813-5e72-4833-bd12-d04d9068f88b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7327723784064d94a3df13b6f111918b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:32.615695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80ce4813-5e72-4833-bd12-d04d9068f88b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7327723784064d94a3df13b6f111918b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:32.616442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80ce4813-5e72-4833-bd12-d04d9068f88b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7327723784064d94a3df13b6f111918b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:32.627695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80ce4813-5e72-4833-bd12-d04d9068f88b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7327723784064d94a3df13b6f111918b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:32.647829 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2590/5184] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:32 2022] DELETE /identity/v3/users/7327723784064d94a3df13b6f111918b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:32.652790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2383742-cfed-4b11-9d60-04e6e6453ef2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:32.652790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2383742-cfed-4b11-9d60-04e6e6453ef2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:32.653247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2383742-cfed-4b11-9d60-04e6e6453ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:32.680582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f2383742-cfed-4b11-9d60-04e6e6453ef2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:32.681968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f2383742-cfed-4b11-9d60-04e6e6453ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:32.758055 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2595/5185] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:32.768542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce4813-5e72-4833-bd12-d04d9068f88b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:32.769849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-80ce4813-5e72-4833-bd12-d04d9068f88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:32.854132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce4813-5e72-4833-bd12-d04d9068f88b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:32.857940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ba560-b74c-4cf7-882f-27f9473df170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:32.858559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ba560-b74c-4cf7-882f-27f9473df170 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:32.858837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ba560-b74c-4cf7-882f-27f9473df170 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:32.859122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ba560-b74c-4cf7-882f-27f9473df170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:32.876286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ba560-b74c-4cf7-882f-27f9473df170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:32.878031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ba560-b74c-4cf7-882f-27f9473df170 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:32.888780 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2591/5186] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:33.039560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bd395-4e6e-4331-ad79-d465fed076d3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:33.039855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bd395-4e6e-4331-ad79-d465fed076d3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:33.040131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bd395-4e6e-4331-ad79-d465fed076d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:33.075023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-245bd395-4e6e-4331-ad79-d465fed076d3 None None] MFA Rules not processed for user `2a1cab39f20c4a758e9a190f85eeafa7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:33.076620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-245bd395-4e6e-4331-ad79-d465fed076d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:33.132370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:33.153479 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2596/5187] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:33.165305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ba560-b74c-4cf7-882f-27f9473df170 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:33.166729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b67ba560-b74c-4cf7-882f-27f9473df170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:33.183041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bd395-4e6e-4331-ad79-d465fed076d3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:33.184580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-245bd395-4e6e-4331-ad79-d465fed076d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:33.198258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bd395-4e6e-4331-ad79-d465fed076d3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:33.204465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e98a43-3091-4786-82db-617a7aecd6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:33.205125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e98a43-3091-4786-82db-617a7aecd6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:33.205404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e98a43-3091-4786-82db-617a7aecd6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:33.205674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e98a43-3091-4786-82db-617a7aecd6ed admin admin] PATH_INFO: `/v3/projects/a33e9d8721a2416dadbcccd6871204a4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:33.206829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e98a43-3091-4786-82db-617a7aecd6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=a33e9d8721a2416dadbcccd6871204a4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:33.208834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e98a43-3091-4786-82db-617a7aecd6ed admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:33.223659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:33.257310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ba560-b74c-4cf7-882f-27f9473df170 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:33.262964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69e98a43-3091-4786-82db-617a7aecd6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a33e9d8721a2416dadbcccd6871204a4', 'request_id': 'req-69e98a43-3091-4786-82db-617a7aecd6ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:33.272048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69e98a43-3091-4786-82db-617a7aecd6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a33e9d8721a2416dadbcccd6871204a4', 'request_id': 'req-69e98a43-3091-4786-82db-617a7aecd6ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:33.279005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69e98a43-3091-4786-82db-617a7aecd6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a33e9d8721a2416dadbcccd6871204a4', 'request_id': 'req-69e98a43-3091-4786-82db-617a7aecd6ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:33.290622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69e98a43-3091-4786-82db-617a7aecd6ed admin admin] The token cache is being invalidate because project a33e9d8721a2416dadbcccd6871204a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:33.290967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69e98a43-3091-4786-82db-617a7aecd6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:33.291607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69e98a43-3091-4786-82db-617a7aecd6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:33.293333 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2597/5188] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:33 2022] DELETE /identity/v3/projects/a33e9d8721a2416dadbcccd6871204a4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:33.296847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e98a43-3091-4786-82db-617a7aecd6ed admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:33.298197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-69e98a43-3091-4786-82db-617a7aecd6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:33.325567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe99342-2fae-4b07-b915-e9a21ca61ae9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:33.326309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe99342-2fae-4b07-b915-e9a21ca61ae9 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:33.326590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe99342-2fae-4b07-b915-e9a21ca61ae9 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:33.326865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe99342-2fae-4b07-b915-e9a21ca61ae9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:33.328870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cfe99342-2fae-4b07-b915-e9a21ca61ae9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:33.368688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e98a43-3091-4786-82db-617a7aecd6ed admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:33.374267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d31d90-74cb-4271-9ca6-9d8672c9ced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:33.374942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d31d90-74cb-4271-9ca6-9d8672c9ced2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:33.375220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d31d90-74cb-4271-9ca6-9d8672c9ced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:33.375557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d31d90-74cb-4271-9ca6-9d8672c9ced2 admin admin] PATH_INFO: `/v3/users/f26a252d99844703a3f190835bde3504` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:33.376711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d31d90-74cb-4271-9ca6-9d8672c9ced2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f26a252d99844703a3f190835bde3504)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:33.378655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d31d90-74cb-4271-9ca6-9d8672c9ced2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:33.395469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe99342-2fae-4b07-b915-e9a21ca61ae9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:33.397710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe99342-2fae-4b07-b915-e9a21ca61ae9 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:33.408348 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2592/5189] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:33.434884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a7d31d90-74cb-4271-9ca6-9d8672c9ced2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f26a252d99844703a3f190835bde3504'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:33.435633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a7d31d90-74cb-4271-9ca6-9d8672c9ced2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f26a252d99844703a3f190835bde3504'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:33.445720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a7d31d90-74cb-4271-9ca6-9d8672c9ced2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f26a252d99844703a3f190835bde3504'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:33.454021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a7d31d90-74cb-4271-9ca6-9d8672c9ced2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f26a252d99844703a3f190835bde3504'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:33.461428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:33.471542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a7d31d90-74cb-4271-9ca6-9d8672c9ced2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f26a252d99844703a3f190835bde3504'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:33.484216 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2598/5190] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:33 2022] DELETE /identity/v3/users/f26a252d99844703a3f190835bde3504 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:33.769664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bfb66-6f0b-4e44-91f9-f7fb2275ec5e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:33.770207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bfb66-6f0b-4e44-91f9-f7fb2275ec5e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:33.770207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bfb66-6f0b-4e44-91f9-f7fb2275ec5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:33.790675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-009bfb66-6f0b-4e44-91f9-f7fb2275ec5e None None] MFA Rules not processed for user `2a1cab39f20c4a758e9a190f85eeafa7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:33.791854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-009bfb66-6f0b-4e44-91f9-f7fb2275ec5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:33.863321 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2593/5191] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:34.116188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d31d90-74cb-4271-9ca6-9d8672c9ced2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:34.117783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a7d31d90-74cb-4271-9ca6-9d8672c9ced2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:34.218053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d31d90-74cb-4271-9ca6-9d8672c9ced2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:34.223533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a557c-dee9-49f6-8f30-7aa9f7690492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:34.224389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a557c-dee9-49f6-8f30-7aa9f7690492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:34.225145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a557c-dee9-49f6-8f30-7aa9f7690492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:34.225606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a557c-dee9-49f6-8f30-7aa9f7690492 admin admin] PATH_INFO: `/v3/projects/ce4ff3c51e964a9c88c338d203ad1870` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:34.227037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a557c-dee9-49f6-8f30-7aa9f7690492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4ff3c51e964a9c88c338d203ad1870)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:34.229722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a557c-dee9-49f6-8f30-7aa9f7690492 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:34.296481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed0a557c-dee9-49f6-8f30-7aa9f7690492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4ff3c51e964a9c88c338d203ad1870', 'request_id': 'req-ed0a557c-dee9-49f6-8f30-7aa9f7690492'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:34.304623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed0a557c-dee9-49f6-8f30-7aa9f7690492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4ff3c51e964a9c88c338d203ad1870', 'request_id': 'req-ed0a557c-dee9-49f6-8f30-7aa9f7690492'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:34.310826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed0a557c-dee9-49f6-8f30-7aa9f7690492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4ff3c51e964a9c88c338d203ad1870', 'request_id': 'req-ed0a557c-dee9-49f6-8f30-7aa9f7690492'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:34.325779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed0a557c-dee9-49f6-8f30-7aa9f7690492 admin admin] The token cache is being invalidate because project ce4ff3c51e964a9c88c338d203ad1870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:34.326448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed0a557c-dee9-49f6-8f30-7aa9f7690492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:34.327500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed0a557c-dee9-49f6-8f30-7aa9f7690492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:34.334803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4d0a7-0840-4fc2-bb4a-44fad7490db4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:34.335351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4d0a7-0840-4fc2-bb4a-44fad7490db4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:34.335467 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2599/5192] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:34 2022] DELETE /identity/v3/projects/ce4ff3c51e964a9c88c338d203ad1870 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:34.335967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4d0a7-0840-4fc2-bb4a-44fad7490db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:34.359348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-aff4d0a7-0840-4fc2-bb4a-44fad7490db4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:34.360854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aff4d0a7-0840-4fc2-bb4a-44fad7490db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:34.376168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:34.430611 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2594/5193] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:34.438355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c602b-a06c-41cd-9e20-7d2d8e3ada42 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:34.439074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c602b-a06c-41cd-9e20-7d2d8e3ada42 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:34.439074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c602b-a06c-41cd-9e20-7d2d8e3ada42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:34.463404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-844c602b-a06c-41cd-9e20-7d2d8e3ada42 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:34.464639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-844c602b-a06c-41cd-9e20-7d2d8e3ada42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:34.475754 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2600/5194] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:34.476945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4d0a7-0840-4fc2-bb4a-44fad7490db4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:34.487368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4d0a7-0840-4fc2-bb4a-44fad7490db4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:34.492192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a91012-3d72-439a-ab45-5ca4f250d4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:34.492798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a91012-3d72-439a-ab45-5ca4f250d4ee admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:34.493076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a91012-3d72-439a-ab45-5ca4f250d4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:34.493345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a91012-3d72-439a-ab45-5ca4f250d4ee admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:34.494026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a91012-3d72-439a-ab45-5ca4f250d4ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:34.494325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a91012-3d72-439a-ab45-5ca4f250d4ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:34.495951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a91012-3d72-439a-ab45-5ca4f250d4ee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:34.507711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dd617-fd94-457d-8f17-a09b418adff1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:34.507711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dd617-fd94-457d-8f17-a09b418adff1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:34.507966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dd617-fd94-457d-8f17-a09b418adff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:34.523333 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2595/5195] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:41:34.524500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a91012-3d72-439a-ab45-5ca4f250d4ee admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:34.545539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a91012-3d72-439a-ab45-5ca4f250d4ee admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:34.577515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946645bd-d179-498e-8736-4d13a8217cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:34.580136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946645bd-d179-498e-8736-4d13a8217cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:34.580526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946645bd-d179-498e-8736-4d13a8217cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:34.581174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946645bd-d179-498e-8736-4d13a8217cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:34.582646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946645bd-d179-498e-8736-4d13a8217cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:34.587143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946645bd-d179-498e-8736-4d13a8217cf5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:34.611216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2e5dd617-fd94-457d-8f17-a09b418adff1 None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:34.611845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2e5dd617-fd94-457d-8f17-a09b418adff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:34.618078 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2601/5196] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:34 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:41:34.624036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dd617-fd94-457d-8f17-a09b418adff1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:34.625990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2e5dd617-fd94-457d-8f17-a09b418adff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:34.644920 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2596/5197] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:34 2022] POST /identity/v3/projects => generated 359 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:34.646399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946645bd-d179-498e-8736-4d13a8217cf5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:34.719521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:34.751101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dd617-fd94-457d-8f17-a09b418adff1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:34.753407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946645bd-d179-498e-8736-4d13a8217cf5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:34.758727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a5578-e91e-450f-a127-805ed6a536e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:34.759600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a5578-e91e-450f-a127-805ed6a536e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:34.759873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a5578-e91e-450f-a127-805ed6a536e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:34.760311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a5578-e91e-450f-a127-805ed6a536e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:34.761057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a5578-e91e-450f-a127-805ed6a536e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:34.763479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a5578-e91e-450f-a127-805ed6a536e4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:34.793172 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2597/5198] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:34 2022] POST /identity/v3/users => generated 280 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:34.798920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a5578-e91e-450f-a127-805ed6a536e4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:34.813961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a5578-e91e-450f-a127-805ed6a536e4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:34.822234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f9881-9b23-4dce-8e13-d1563d347212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:34.822921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f9881-9b23-4dce-8e13-d1563d347212 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:34.823275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f9881-9b23-4dce-8e13-d1563d347212 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:34.823628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f9881-9b23-4dce-8e13-d1563d347212 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:34.824528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f9881-9b23-4dce-8e13-d1563d347212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:34.826471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f9881-9b23-4dce-8e13-d1563d347212 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:34.837505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737c5d9-8e45-47d3-a66e-286dd1a22edf tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d2538e6d2643d8b68e77f4ca25860d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f703b402ec842aabf1ab0174c8b1264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:34.838258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737c5d9-8e45-47d3-a66e-286dd1a22edf tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:34.839318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737c5d9-8e45-47d3-a66e-286dd1a22edf tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:34.839679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737c5d9-8e45-47d3-a66e-286dd1a22edf tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] PATH_INFO: `/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:34.843069 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2598/5199] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:34.846476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f9881-9b23-4dce-8e13-d1563d347212 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:34.862274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f9881-9b23-4dce-8e13-d1563d347212 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:34.868297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f635ad-a071-4dbd-8d70-d1a7e3dc6104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:34.869202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f635ad-a071-4dbd-8d70-d1a7e3dc6104 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:34.870011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f635ad-a071-4dbd-8d70-d1a7e3dc6104 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:34.870681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f635ad-a071-4dbd-8d70-d1a7e3dc6104 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:34.871809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f635ad-a071-4dbd-8d70-d1a7e3dc6104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:34.873693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f635ad-a071-4dbd-8d70-d1a7e3dc6104 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:34.887427 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2599/5200] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:34.889804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f635ad-a071-4dbd-8d70-d1a7e3dc6104 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:34.905171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4737c5d9-8e45-47d3-a66e-286dd1a22edf tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '88d2538e6d2643d8b68e77f4ca25860d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:34.908976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f635ad-a071-4dbd-8d70-d1a7e3dc6104 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:34.919217 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2602/5201] 10.222.0.27 () {60 vars in 1269 bytes} [Sun Aug 28 18:41:34 2022] POST /identity/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:34.919439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed0cac-638f-4e62-8f81-90b2c4709cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:34.919439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed0cac-638f-4e62-8f81-90b2c4709cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:34.919439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed0cac-638f-4e62-8f81-90b2c4709cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:34.919439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed0cac-638f-4e62-8f81-90b2c4709cf0 admin admin] PATH_INFO: `/v3/projects/e03907d85cf047e3b0c5f082164443d7/users/bb40eb2d1f78477c92c44d2166eb70ed/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:34.937455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed0cac-638f-4e62-8f81-90b2c4709cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e03907d85cf047e3b0c5f082164443d7, user_id=bb40eb2d1f78477c92c44d2166eb70ed, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:34.940570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed0cac-638f-4e62-8f81-90b2c4709cf0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:34.963348 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2600/5202] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:34 2022] PUT /identity/v3/projects/e03907d85cf047e3b0c5f082164443d7/users/bb40eb2d1f78477c92c44d2166eb70ed/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:34.965428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848bfab-b1c2-44d7-be3b-58368d3257cd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:34.965714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848bfab-b1c2-44d7-be3b-58368d3257cd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:34.965981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848bfab-b1c2-44d7-be3b-58368d3257cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:34.997183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6848bfab-b1c2-44d7-be3b-58368d3257cd None None] MFA Rules not processed for user `bb40eb2d1f78477c92c44d2166eb70ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:34.998552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6848bfab-b1c2-44d7-be3b-58368d3257cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:35.082682 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2603/5203] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:35.119429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed0cac-638f-4e62-8f81-90b2c4709cf0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:35.121935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-73ed0cac-638f-4e62-8f81-90b2c4709cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:35.174053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:35.204400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed0cac-638f-4e62-8f81-90b2c4709cf0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:35.208356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0089b-2c1c-45de-8a75-de6e66b02b18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:35.208956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0089b-2c1c-45de-8a75-de6e66b02b18 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:35.209536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0089b-2c1c-45de-8a75-de6e66b02b18 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:35.209826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0089b-2c1c-45de-8a75-de6e66b02b18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:35.218496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0089b-2c1c-45de-8a75-de6e66b02b18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:35.220123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0089b-2c1c-45de-8a75-de6e66b02b18 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:35.233574 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2601/5204] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:35.246581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848bfab-b1c2-44d7-be3b-58368d3257cd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:35.316104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848bfab-b1c2-44d7-be3b-58368d3257cd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:35.321512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d368ab-1b66-4704-a54d-9e4fa712c39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:35.322225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d368ab-1b66-4704-a54d-9e4fa712c39d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:35.322503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d368ab-1b66-4704-a54d-9e4fa712c39d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:35.322790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d368ab-1b66-4704-a54d-9e4fa712c39d admin admin] PATH_INFO: `/v3/users/bb40eb2d1f78477c92c44d2166eb70ed` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:35.324097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d368ab-1b66-4704-a54d-9e4fa712c39d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb40eb2d1f78477c92c44d2166eb70ed)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:35.326251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d368ab-1b66-4704-a54d-9e4fa712c39d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:35.340712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:35.395084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7d368ab-1b66-4704-a54d-9e4fa712c39d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb40eb2d1f78477c92c44d2166eb70ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:35.395717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7d368ab-1b66-4704-a54d-9e4fa712c39d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb40eb2d1f78477c92c44d2166eb70ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:35.404694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7d368ab-1b66-4704-a54d-9e4fa712c39d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb40eb2d1f78477c92c44d2166eb70ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:35.414417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7d368ab-1b66-4704-a54d-9e4fa712c39d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb40eb2d1f78477c92c44d2166eb70ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:35.457916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7d368ab-1b66-4704-a54d-9e4fa712c39d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb40eb2d1f78477c92c44d2166eb70ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:35.468710 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2604/5205] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:35 2022] DELETE /identity/v3/users/bb40eb2d1f78477c92c44d2166eb70ed => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:35.473233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0a1ae-d796-49fe-96f5-bf991126a3c4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:35.473516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0a1ae-d796-49fe-96f5-bf991126a3c4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:35.474729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0a1ae-d796-49fe-96f5-bf991126a3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:35.497091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-22a0a1ae-d796-49fe-96f5-bf991126a3c4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:35.498395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-22a0a1ae-d796-49fe-96f5-bf991126a3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:35.576265 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2602/5206] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:35.588356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d368ab-1b66-4704-a54d-9e4fa712c39d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:35.590205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f7d368ab-1b66-4704-a54d-9e4fa712c39d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:35.656292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d368ab-1b66-4704-a54d-9e4fa712c39d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:35.662241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9454a-8a78-49da-92a1-cdd8e42a579d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:35.662987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9454a-8a78-49da-92a1-cdd8e42a579d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:35.663290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9454a-8a78-49da-92a1-cdd8e42a579d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:35.663581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9454a-8a78-49da-92a1-cdd8e42a579d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:35.674379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9454a-8a78-49da-92a1-cdd8e42a579d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:35.675905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9454a-8a78-49da-92a1-cdd8e42a579d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:35.689741 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2605/5207] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:35.924586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094a977-17d0-4af2-927b-0bda2b8e92e4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:35.925681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094a977-17d0-4af2-927b-0bda2b8e92e4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:35.926159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094a977-17d0-4af2-927b-0bda2b8e92e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:35.948220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8094a977-17d0-4af2-927b-0bda2b8e92e4 None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:35.949567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8094a977-17d0-4af2-927b-0bda2b8e92e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:35.957004 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2603/5208] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:35 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:41:35.957947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779be05-5121-4421-a8a5-fba3e8d14cc6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:35.958241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779be05-5121-4421-a8a5-fba3e8d14cc6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:35.958569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779be05-5121-4421-a8a5-fba3e8d14cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:35.963210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7779be05-5121-4421-a8a5-fba3e8d14cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:36.058239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094a977-17d0-4af2-927b-0bda2b8e92e4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:36.060597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8094a977-17d0-4af2-927b-0bda2b8e92e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:36.088511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094a977-17d0-4af2-927b-0bda2b8e92e4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:36.106816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab39b31-43e0-42a4-b0e3-c041b210cc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:36.107638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab39b31-43e0-42a4-b0e3-c041b210cc89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:36.108016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab39b31-43e0-42a4-b0e3-c041b210cc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:36.108387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab39b31-43e0-42a4-b0e3-c041b210cc89 admin admin] PATH_INFO: `/v3/projects/e03907d85cf047e3b0c5f082164443d7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:36.114059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab39b31-43e0-42a4-b0e3-c041b210cc89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e03907d85cf047e3b0c5f082164443d7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:36.117357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab39b31-43e0-42a4-b0e3-c041b210cc89 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:36.182853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-7779be05-5121-4421-a8a5-fba3e8d14cc6 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 28 18:41:36.182853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:41:36.182853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:41:36.182853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:41:36.182853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:41:36.182853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:41:36.182853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:41:36.182853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:41:36.182853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:41:36.182853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:41:36.182853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:41:36.182853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:41:36.182853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 28 18:41:36.182853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 28 18:41:36.182853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 28 18:41:36.182853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 28 18:41:36.184345 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Aug 28 18:41:36.184345 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Aug 28 18:41:36.184345 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Aug 28 18:41:36.184345 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Aug 28 18:41:36.184345 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Aug 28 18:41:36.184345 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Aug 28 18:41:36.184345 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Aug 28 18:41:36.184345 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Aug 28 18:41:36.184345 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:41:36.184345 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:41:36.184345 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 28 18:41:36.184345 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 28 18:41:36.184345 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 28 18:41:36.184345 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 28 18:41:36.184345 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:41:36.184345 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:41:36.185552 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 28 18:41:36.185552 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 28 18:41:36.185552 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:41:36.185552 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:41:36.185552 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 28 18:41:36.185552 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 28 18:41:36.185552 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:41:36.185552 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:41:36.185552 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 28 18:41:36.185552 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 28 18:41:36.185552 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 28 18:41:36.185552 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:41:36.187395 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2606/5209] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:35 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:41:36.192077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea4ba5-fa1f-44a1-8e12-3274976bc95c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:36.192650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea4ba5-fa1f-44a1-8e12-3274976bc95c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:36.193059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea4ba5-fa1f-44a1-8e12-3274976bc95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:36.229125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ab39b31-43e0-42a4-b0e3-c041b210cc89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e03907d85cf047e3b0c5f082164443d7', 'request_id': 'req-8ab39b31-43e0-42a4-b0e3-c041b210cc89'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:36.239981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ab39b31-43e0-42a4-b0e3-c041b210cc89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e03907d85cf047e3b0c5f082164443d7', 'request_id': 'req-8ab39b31-43e0-42a4-b0e3-c041b210cc89'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:36.250240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ab39b31-43e0-42a4-b0e3-c041b210cc89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e03907d85cf047e3b0c5f082164443d7', 'request_id': 'req-8ab39b31-43e0-42a4-b0e3-c041b210cc89'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:36.270758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ab39b31-43e0-42a4-b0e3-c041b210cc89 admin admin] The token cache is being invalidate because project e03907d85cf047e3b0c5f082164443d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:36.271153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ab39b31-43e0-42a4-b0e3-c041b210cc89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:36.272195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ab39b31-43e0-42a4-b0e3-c041b210cc89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:36.272918 n-d-850468-20 devstack@keystone.service[82161]: WARNING keystone.server.flask.application [None req-8eea4ba5-fa1f-44a1-8e12-3274976bc95c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 18:41:36.275292 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2604/5210] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:36 2022] DELETE /identity/v3/projects/e03907d85cf047e3b0c5f082164443d7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:36.276742 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2607/5211] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:36 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 87 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 18:41:36.283308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393af756-07fd-426e-b6d1-b5f603df998a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:36.283835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393af756-07fd-426e-b6d1-b5f603df998a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:36.284311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393af756-07fd-426e-b6d1-b5f603df998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:36.285234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4647e1-6f43-4404-8dec-fc9e428a8916 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:36.285621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4647e1-6f43-4404-8dec-fc9e428a8916 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:36.285999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4647e1-6f43-4404-8dec-fc9e428a8916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:36.327957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2a4647e1-6f43-4404-8dec-fc9e428a8916 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:36.329300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2a4647e1-6f43-4404-8dec-fc9e428a8916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:36.339296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-393af756-07fd-426e-b6d1-b5f603df998a None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:36.341121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-393af756-07fd-426e-b6d1-b5f603df998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:36.342120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:36.395119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:36.433761 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2608/5212] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:36.443196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e37e0b-41c9-4a01-8513-35763a21b524 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:36.443510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e37e0b-41c9-4a01-8513-35763a21b524 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:36.443838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e37e0b-41c9-4a01-8513-35763a21b524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:36.451946 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2605/5213] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:36.453322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393af756-07fd-426e-b6d1-b5f603df998a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:36.468140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393af756-07fd-426e-b6d1-b5f603df998a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:36.474013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf73f2b-44c9-404e-a722-fe0a2d67dcd2 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d2538e6d2643d8b68e77f4ca25860d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f703b402ec842aabf1ab0174c8b1264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:36.476078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf73f2b-44c9-404e-a722-fe0a2d67dcd2 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:36.476372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf73f2b-44c9-404e-a722-fe0a2d67dcd2 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:36.476645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf73f2b-44c9-404e-a722-fe0a2d67dcd2 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] PATH_INFO: `/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:36.491201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-42e37e0b-41c9-4a01-8513-35763a21b524 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:36.492474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-42e37e0b-41c9-4a01-8513-35763a21b524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:36.507823 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2609/5214] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:36.513735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e37e0b-41c9-4a01-8513-35763a21b524 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:36.530658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e37e0b-41c9-4a01-8513-35763a21b524 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:36.543513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ae8e7-b15d-42eb-82c0-02fe0b48d9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:36.544295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ae8e7-b15d-42eb-82c0-02fe0b48d9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:36.544412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ae8e7-b15d-42eb-82c0-02fe0b48d9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:36.544669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ae8e7-b15d-42eb-82c0-02fe0b48d9b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:36.545352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ae8e7-b15d-42eb-82c0-02fe0b48d9b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:36.545638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ae8e7-b15d-42eb-82c0-02fe0b48d9b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:36.548627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ae8e7-b15d-42eb-82c0-02fe0b48d9b1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:36.557101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fcf73f2b-44c9-404e-a722-fe0a2d67dcd2 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '88d2538e6d2643d8b68e77f4ca25860d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:36.562153 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2610/5215] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:41:36.567061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ae8e7-b15d-42eb-82c0-02fe0b48d9b1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:36.575327 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2606/5216] 10.222.0.27 () {60 vars in 1269 bytes} [Sun Aug 28 18:41:36 2022] POST /identity/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:36.581237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ae8e7-b15d-42eb-82c0-02fe0b48d9b1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:36.587244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b40b4-9404-42d4-9fac-9545b3e333af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:36.587890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b40b4-9404-42d4-9fac-9545b3e333af admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:36.588172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b40b4-9404-42d4-9fac-9545b3e333af admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:36.588446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b40b4-9404-42d4-9fac-9545b3e333af admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:36.589083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b40b4-9404-42d4-9fac-9545b3e333af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:36.591006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b40b4-9404-42d4-9fac-9545b3e333af admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:36.623288 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2611/5217] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:36 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:36.626724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf73f2b-44c9-404e-a722-fe0a2d67dcd2 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:36.638223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf73f2b-44c9-404e-a722-fe0a2d67dcd2 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:36.710680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c8ff0-2f63-435f-9f4c-89aec63ac9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:36.711344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c8ff0-2f63-435f-9f4c-89aec63ac9d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:36.711632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c8ff0-2f63-435f-9f4c-89aec63ac9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:36.711910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c8ff0-2f63-435f-9f4c-89aec63ac9d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:36.712706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c8ff0-2f63-435f-9f4c-89aec63ac9d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:36.714642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c8ff0-2f63-435f-9f4c-89aec63ac9d1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:36.753260 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2607/5218] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:36 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:36.757800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b40b4-9404-42d4-9fac-9545b3e333af admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:36.772081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b40b4-9404-42d4-9fac-9545b3e333af admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:36.777661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad0837-0ee5-411f-bed0-25f65b8653ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:36.778448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad0837-0ee5-411f-bed0-25f65b8653ef admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:36.778803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad0837-0ee5-411f-bed0-25f65b8653ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:36.779152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad0837-0ee5-411f-bed0-25f65b8653ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:36.780561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad0837-0ee5-411f-bed0-25f65b8653ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:36.782747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad0837-0ee5-411f-bed0-25f65b8653ef admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:36.795911 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2612/5219] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:41:36.800002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c8ff0-2f63-435f-9f4c-89aec63ac9d1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:36.813503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c8ff0-2f63-435f-9f4c-89aec63ac9d1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:36.818988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14725eb4-d6ad-400d-aa6d-b87db8d7ac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:36.819656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14725eb4-d6ad-400d-aa6d-b87db8d7ac08 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:36.819940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14725eb4-d6ad-400d-aa6d-b87db8d7ac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:36.820217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14725eb4-d6ad-400d-aa6d-b87db8d7ac08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:36.821027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14725eb4-d6ad-400d-aa6d-b87db8d7ac08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:36.823309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14725eb4-d6ad-400d-aa6d-b87db8d7ac08 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:36.836288 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2608/5220] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:41:36.840643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad0837-0ee5-411f-bed0-25f65b8653ef admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:36.851800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad0837-0ee5-411f-bed0-25f65b8653ef admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:36.856621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70817907-6f62-4abe-b968-8a1d18ac765d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:36.857291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70817907-6f62-4abe-b968-8a1d18ac765d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:36.857573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70817907-6f62-4abe-b968-8a1d18ac765d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:36.857844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70817907-6f62-4abe-b968-8a1d18ac765d admin admin] PATH_INFO: `/v3/projects/5050a9a7ac4647cfb5645026cbea14c8/users/e9f170414bbb40fe9de7301f58db026b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:36.876003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70817907-6f62-4abe-b968-8a1d18ac765d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5050a9a7ac4647cfb5645026cbea14c8, user_id=e9f170414bbb40fe9de7301f58db026b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:36.878774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70817907-6f62-4abe-b968-8a1d18ac765d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:36.905850 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2613/5221] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:36 2022] PUT /identity/v3/projects/5050a9a7ac4647cfb5645026cbea14c8/users/e9f170414bbb40fe9de7301f58db026b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:36.913309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8bda9-1c2b-4723-9815-83bbebe8c237 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:36.913604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8bda9-1c2b-4723-9815-83bbebe8c237 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:36.913885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8bda9-1c2b-4723-9815-83bbebe8c237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:36.956001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6ef8bda9-1c2b-4723-9815-83bbebe8c237 None None] MFA Rules not processed for user `e9f170414bbb40fe9de7301f58db026b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:36.957269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6ef8bda9-1c2b-4723-9815-83bbebe8c237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:37.040360 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2609/5222] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:37.052124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70817907-6f62-4abe-b968-8a1d18ac765d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:37.053992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-70817907-6f62-4abe-b968-8a1d18ac765d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:37.123941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70817907-6f62-4abe-b968-8a1d18ac765d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:37.128747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0c0dc-4368-48df-a8c9-11a6e134eb79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:37.130212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0c0dc-4368-48df-a8c9-11a6e134eb79 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:37.130537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0c0dc-4368-48df-a8c9-11a6e134eb79 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:37.130780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0c0dc-4368-48df-a8c9-11a6e134eb79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:37.141780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0c0dc-4368-48df-a8c9-11a6e134eb79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:37.143349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0c0dc-4368-48df-a8c9-11a6e134eb79 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:37.152545 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2614/5223] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:37.581565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce627596-789b-4178-b41f-83409af2d255 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:37.581849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce627596-789b-4178-b41f-83409af2d255 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:37.582213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce627596-789b-4178-b41f-83409af2d255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:37.604789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ce627596-789b-4178-b41f-83409af2d255 None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:37.606319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ce627596-789b-4178-b41f-83409af2d255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:37.609782 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2610/5224] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:37 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:41:37.614263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541e738-592d-455f-bfa9-ca965148be40 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:37.614742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541e738-592d-455f-bfa9-ca965148be40 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:37.614840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541e738-592d-455f-bfa9-ca965148be40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:37.638891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c541e738-592d-455f-bfa9-ca965148be40 None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:37.640359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c541e738-592d-455f-bfa9-ca965148be40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:37.701630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:37.722541 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2615/5225] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:37.726437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce627596-789b-4178-b41f-83409af2d255 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:37.740948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce627596-789b-4178-b41f-83409af2d255 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:37.745179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508b584-a7e0-4f74-8322-6e1335fad609 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d2538e6d2643d8b68e77f4ca25860d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f703b402ec842aabf1ab0174c8b1264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:37.745834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508b584-a7e0-4f74-8322-6e1335fad609 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:37.746112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508b584-a7e0-4f74-8322-6e1335fad609 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:37.746380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508b584-a7e0-4f74-8322-6e1335fad609 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] PATH_INFO: `/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:37.759237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:37.798426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d508b584-a7e0-4f74-8322-6e1335fad609 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '88d2538e6d2643d8b68e77f4ca25860d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:37.809406 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2611/5226] 10.222.0.27 () {60 vars in 1269 bytes} [Sun Aug 28 18:41:37 2022] POST /identity/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:38.814657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd699b47-dafb-400b-803b-5028af96e6f0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:38.815227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd699b47-dafb-400b-803b-5028af96e6f0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:38.815227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd699b47-dafb-400b-803b-5028af96e6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:38.837301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dd699b47-dafb-400b-803b-5028af96e6f0 None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:38.838506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dd699b47-dafb-400b-803b-5028af96e6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:38.841711 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2616/5227] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:38 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:41:38.846756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f7f98-7e7d-4bb9-85bf-73138c0f500c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:38.847307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f7f98-7e7d-4bb9-85bf-73138c0f500c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:38.847307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f7f98-7e7d-4bb9-85bf-73138c0f500c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:38.870002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-df9f7f98-7e7d-4bb9-85bf-73138c0f500c None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:38.871124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-df9f7f98-7e7d-4bb9-85bf-73138c0f500c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:38.879446 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2612/5228] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:38.884205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd699b47-dafb-400b-803b-5028af96e6f0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:38.895695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd699b47-dafb-400b-803b-5028af96e6f0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:38.899959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7c5a8-5db3-45ac-9d28-46eb7147cf25 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d2538e6d2643d8b68e77f4ca25860d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f703b402ec842aabf1ab0174c8b1264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:38.900629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7c5a8-5db3-45ac-9d28-46eb7147cf25 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:38.900911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7c5a8-5db3-45ac-9d28-46eb7147cf25 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:38.901185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7c5a8-5db3-45ac-9d28-46eb7147cf25 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] PATH_INFO: `/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:38.946093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15b7c5a8-5db3-45ac-9d28-46eb7147cf25 tempest-IdentityV3UsersTest-1221054848 tempest-IdentityV3UsersTest-1221054848-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '88d2538e6d2643d8b68e77f4ca25860d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:38.955192 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2617/5229] 10.222.0.27 () {60 vars in 1269 bytes} [Sun Aug 28 18:41:38 2022] POST /identity/v3/users/88d2538e6d2643d8b68e77f4ca25860d/password => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:39.973245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dcb39-ce54-436f-a147-6ac579c3ba78 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:39.973835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dcb39-ce54-436f-a147-6ac579c3ba78 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:39.973835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dcb39-ce54-436f-a147-6ac579c3ba78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:40.036721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-823dcb39-ce54-436f-a147-6ac579c3ba78 None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:40.038263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-823dcb39-ce54-436f-a147-6ac579c3ba78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:40.041768 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2613/5230] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:39 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:41:41.048554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db2aa4-ed2c-4b8e-b132-526e7414ddbb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:41.049073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db2aa4-ed2c-4b8e-b132-526e7414ddbb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:41.049555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db2aa4-ed2c-4b8e-b132-526e7414ddbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:41.073318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-17db2aa4-ed2c-4b8e-b132-526e7414ddbb None None] MFA Rules not processed for user `88d2538e6d2643d8b68e77f4ca25860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:41.074635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17db2aa4-ed2c-4b8e-b132-526e7414ddbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:41.085639 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2618/5231] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:41.091293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dcb39-ce54-436f-a147-6ac579c3ba78 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:41.093560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-823dcb39-ce54-436f-a147-6ac579c3ba78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:41.169012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dcb39-ce54-436f-a147-6ac579c3ba78 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:41.174027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9c44e-9984-4ed7-b592-e75cb7ab7145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:41.174775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9c44e-9984-4ed7-b592-e75cb7ab7145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:41.175288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9c44e-9984-4ed7-b592-e75cb7ab7145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:41.175716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9c44e-9984-4ed7-b592-e75cb7ab7145 admin admin] PATH_INFO: `/v3/users/88d2538e6d2643d8b68e77f4ca25860d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:41.177066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9c44e-9984-4ed7-b592-e75cb7ab7145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88d2538e6d2643d8b68e77f4ca25860d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:41.178995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9c44e-9984-4ed7-b592-e75cb7ab7145 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:41.235800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b1c9c44e-9984-4ed7-b592-e75cb7ab7145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88d2538e6d2643d8b68e77f4ca25860d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:41.248684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b1c9c44e-9984-4ed7-b592-e75cb7ab7145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88d2538e6d2643d8b68e77f4ca25860d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:41.249840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b1c9c44e-9984-4ed7-b592-e75cb7ab7145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88d2538e6d2643d8b68e77f4ca25860d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:41.250557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b1c9c44e-9984-4ed7-b592-e75cb7ab7145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88d2538e6d2643d8b68e77f4ca25860d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:41.260569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b1c9c44e-9984-4ed7-b592-e75cb7ab7145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88d2538e6d2643d8b68e77f4ca25860d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:41.275858 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2614/5232] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:41 2022] DELETE /identity/v3/users/88d2538e6d2643d8b68e77f4ca25860d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:41.280686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515277f-50a3-44fd-9f1a-43883e097699 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:41.281249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515277f-50a3-44fd-9f1a-43883e097699 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:41.281707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515277f-50a3-44fd-9f1a-43883e097699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:41.304304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7515277f-50a3-44fd-9f1a-43883e097699 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:41.306188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7515277f-50a3-44fd-9f1a-43883e097699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:41.374521 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2619/5233] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:41.384555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9c44e-9984-4ed7-b592-e75cb7ab7145 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:41.386497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b1c9c44e-9984-4ed7-b592-e75cb7ab7145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:41.437448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=12 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:41.451706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9c44e-9984-4ed7-b592-e75cb7ab7145 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:41.456729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d837676-c2a0-4e2d-a8e0-6483752f4f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:41.457359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d837676-c2a0-4e2d-a8e0-6483752f4f76 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:41.457867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d837676-c2a0-4e2d-a8e0-6483752f4f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:41.458220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d837676-c2a0-4e2d-a8e0-6483752f4f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:41.468111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d837676-c2a0-4e2d-a8e0-6483752f4f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:41.469569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d837676-c2a0-4e2d-a8e0-6483752f4f76 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:41.480587 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2615/5234] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:41.794738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515277f-50a3-44fd-9f1a-43883e097699 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:41.796930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7515277f-50a3-44fd-9f1a-43883e097699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:41.809859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515277f-50a3-44fd-9f1a-43883e097699 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:41.814891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbd9bd-8ffd-4046-89c8-f7a667643663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:41.815691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbd9bd-8ffd-4046-89c8-f7a667643663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:41.815987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbd9bd-8ffd-4046-89c8-f7a667643663 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:41.816260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbd9bd-8ffd-4046-89c8-f7a667643663 admin admin] PATH_INFO: `/v3/projects/7f703b402ec842aabf1ab0174c8b1264` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:41.817376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbd9bd-8ffd-4046-89c8-f7a667643663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f703b402ec842aabf1ab0174c8b1264)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:41.819316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbd9bd-8ffd-4046-89c8-f7a667643663 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:41.881158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bdcbd9bd-8ffd-4046-89c8-f7a667643663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f703b402ec842aabf1ab0174c8b1264', 'request_id': 'req-bdcbd9bd-8ffd-4046-89c8-f7a667643663'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:41.890772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bdcbd9bd-8ffd-4046-89c8-f7a667643663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f703b402ec842aabf1ab0174c8b1264', 'request_id': 'req-bdcbd9bd-8ffd-4046-89c8-f7a667643663'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:41.897862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bdcbd9bd-8ffd-4046-89c8-f7a667643663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f703b402ec842aabf1ab0174c8b1264', 'request_id': 'req-bdcbd9bd-8ffd-4046-89c8-f7a667643663'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:41.912148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bdcbd9bd-8ffd-4046-89c8-f7a667643663 admin admin] The token cache is being invalidate because project 7f703b402ec842aabf1ab0174c8b1264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:41.912440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bdcbd9bd-8ffd-4046-89c8-f7a667643663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:41.913209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bdcbd9bd-8ffd-4046-89c8-f7a667643663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:41.918784 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2620/5235] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:41 2022] DELETE /identity/v3/projects/7f703b402ec842aabf1ab0174c8b1264 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:41.920470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd08f97-6c02-48ed-ad73-45fdd1eb0daa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:41.920760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd08f97-6c02-48ed-ad73-45fdd1eb0daa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:41.921040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd08f97-6c02-48ed-ad73-45fdd1eb0daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:41.941166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4bd08f97-6c02-48ed-ad73-45fdd1eb0daa None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:41.942373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4bd08f97-6c02-48ed-ad73-45fdd1eb0daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:42.011408 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2616/5236] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:42.019601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11dd8-6980-4053-8b0d-efaa24e60714 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:42.019886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11dd8-6980-4053-8b0d-efaa24e60714 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:42.020173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11dd8-6980-4053-8b0d-efaa24e60714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:42.040890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c9d11dd8-6980-4053-8b0d-efaa24e60714 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:42.042414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c9d11dd8-6980-4053-8b0d-efaa24e60714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:42.052574 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2621/5237] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:42.056547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd08f97-6c02-48ed-ad73-45fdd1eb0daa None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:42.067989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd08f97-6c02-48ed-ad73-45fdd1eb0daa None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:42.072851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcf050-f0dc-4aa8-8547-03e4ff254e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:42.073556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcf050-f0dc-4aa8-8547-03e4ff254e20 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:42.073906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcf050-f0dc-4aa8-8547-03e4ff254e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:42.074249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcf050-f0dc-4aa8-8547-03e4ff254e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:42.074985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcf050-f0dc-4aa8-8547-03e4ff254e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:42.075405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcf050-f0dc-4aa8-8547-03e4ff254e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:42.077086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcf050-f0dc-4aa8-8547-03e4ff254e20 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:42.089976 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2617/5238] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:41:42.094484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d11dd8-6980-4053-8b0d-efaa24e60714 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:42.104073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d11dd8-6980-4053-8b0d-efaa24e60714 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:42.109127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08855b8e-0853-47fe-88bf-196d514bde50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:42.109921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08855b8e-0853-47fe-88bf-196d514bde50 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:42.110200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08855b8e-0853-47fe-88bf-196d514bde50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:42.110473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08855b8e-0853-47fe-88bf-196d514bde50 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:42.111107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08855b8e-0853-47fe-88bf-196d514bde50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:42.113053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08855b8e-0853-47fe-88bf-196d514bde50 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:42.129484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:42.148297 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2622/5239] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:42 2022] POST /identity/v3/projects => generated 395 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:42.152496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcf050-f0dc-4aa8-8547-03e4ff254e20 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:42.163230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcf050-f0dc-4aa8-8547-03e4ff254e20 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:42.222542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dc220-762e-4a8c-a56a-594b049d2d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:42.223150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dc220-762e-4a8c-a56a-594b049d2d6c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:42.223490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dc220-762e-4a8c-a56a-594b049d2d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:42.223726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dc220-762e-4a8c-a56a-594b049d2d6c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:42.224354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dc220-762e-4a8c-a56a-594b049d2d6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:42.226254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dc220-762e-4a8c-a56a-594b049d2d6c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:42.254014 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2618/5240] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:42 2022] POST /identity/v3/users => generated 304 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:42.259741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08855b8e-0853-47fe-88bf-196d514bde50 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:42.285564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08855b8e-0853-47fe-88bf-196d514bde50 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:42.291645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6319b48-f4ee-46d1-9e7a-8309832102ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:42.292583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6319b48-f4ee-46d1-9e7a-8309832102ef admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:42.292866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6319b48-f4ee-46d1-9e7a-8309832102ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:42.296669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6319b48-f4ee-46d1-9e7a-8309832102ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:42.304074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6319b48-f4ee-46d1-9e7a-8309832102ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:42.305746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6319b48-f4ee-46d1-9e7a-8309832102ef admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:42.335316 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2623/5241] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:42.341234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dc220-762e-4a8c-a56a-594b049d2d6c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:42.354932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dc220-762e-4a8c-a56a-594b049d2d6c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:42.360500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620480f-ba27-4868-80eb-1642395ceac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:42.361171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620480f-ba27-4868-80eb-1642395ceac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:42.361453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620480f-ba27-4868-80eb-1642395ceac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:42.361725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620480f-ba27-4868-80eb-1642395ceac3 admin admin] PATH_INFO: `/v3/projects/d9a12460f8e64901b287c99a6cad5aee/users/f03ba923f1dd40ea908c310915c9d12e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:42.382364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620480f-ba27-4868-80eb-1642395ceac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a12460f8e64901b287c99a6cad5aee, user_id=f03ba923f1dd40ea908c310915c9d12e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:42.383366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620480f-ba27-4868-80eb-1642395ceac3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:42.401212 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2619/5242] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:42 2022] PUT /identity/v3/projects/d9a12460f8e64901b287c99a6cad5aee/users/f03ba923f1dd40ea908c310915c9d12e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:42.405426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6319b48-f4ee-46d1-9e7a-8309832102ef admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:42.416263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6319b48-f4ee-46d1-9e7a-8309832102ef admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:42.478505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bccd7-a8aa-4916-9eed-c4ba7425f67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:42.479130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bccd7-a8aa-4916-9eed-c4ba7425f67e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:42.479508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bccd7-a8aa-4916-9eed-c4ba7425f67e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:42.479811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bccd7-a8aa-4916-9eed-c4ba7425f67e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:42.480470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bccd7-a8aa-4916-9eed-c4ba7425f67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:42.482102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bccd7-a8aa-4916-9eed-c4ba7425f67e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:42.492795 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2624/5243] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:42.497118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620480f-ba27-4868-80eb-1642395ceac3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:42.510086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620480f-ba27-4868-80eb-1642395ceac3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:42.515417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143353c1-69e4-4087-8913-2098b5c4d01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:42.516120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143353c1-69e4-4087-8913-2098b5c4d01d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:42.516403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143353c1-69e4-4087-8913-2098b5c4d01d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:42.516685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143353c1-69e4-4087-8913-2098b5c4d01d admin admin] PATH_INFO: `/v3/projects/d9a12460f8e64901b287c99a6cad5aee/users/f03ba923f1dd40ea908c310915c9d12e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:42.518799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143353c1-69e4-4087-8913-2098b5c4d01d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a12460f8e64901b287c99a6cad5aee, user_id=f03ba923f1dd40ea908c310915c9d12e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:42.521538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143353c1-69e4-4087-8913-2098b5c4d01d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:42.532233 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2620/5244] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:42 2022] PUT /identity/v3/projects/d9a12460f8e64901b287c99a6cad5aee/users/f03ba923f1dd40ea908c310915c9d12e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:42.543498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf593e31-3eef-4a53-b99e-54a8381e7f59 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:42.543735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf593e31-3eef-4a53-b99e-54a8381e7f59 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:42.544009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf593e31-3eef-4a53-b99e-54a8381e7f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:42.573367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cf593e31-3eef-4a53-b99e-54a8381e7f59 None None] MFA Rules not processed for user `f03ba923f1dd40ea908c310915c9d12e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:42.574575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf593e31-3eef-4a53-b99e-54a8381e7f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:42.645817 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2625/5245] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:42 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:42.650633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143353c1-69e4-4087-8913-2098b5c4d01d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:42.678784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:42.715593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143353c1-69e4-4087-8913-2098b5c4d01d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:42.721355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e27f6-ed97-4b03-bd51-e9b8ccb1c1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:42.721937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e27f6-ed97-4b03-bd51-e9b8ccb1c1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:42.722219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e27f6-ed97-4b03-bd51-e9b8ccb1c1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:42.722486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e27f6-ed97-4b03-bd51-e9b8ccb1c1e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:42.723128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e27f6-ed97-4b03-bd51-e9b8ccb1c1e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:42.725074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e27f6-ed97-4b03-bd51-e9b8ccb1c1e8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:42.754302 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2621/5246] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:42 2022] POST /identity/v3/projects => generated 397 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:42.757485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf593e31-3eef-4a53-b99e-54a8381e7f59 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:42.768291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf593e31-3eef-4a53-b99e-54a8381e7f59 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:42.836559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a16a44-6f2a-4446-9dbf-d86b26005926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:42.837166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a16a44-6f2a-4446-9dbf-d86b26005926 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:42.837440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a16a44-6f2a-4446-9dbf-d86b26005926 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:42.837707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a16a44-6f2a-4446-9dbf-d86b26005926 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:42.838332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a16a44-6f2a-4446-9dbf-d86b26005926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:42.840652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a16a44-6f2a-4446-9dbf-d86b26005926 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:42.851010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:42.863509 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2626/5247] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:42 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:42.868962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e27f6-ed97-4b03-bd51-e9b8ccb1c1e8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:42.880305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e27f6-ed97-4b03-bd51-e9b8ccb1c1e8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:42.886420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e0c8-d904-4aba-a241-f47e2d2cb446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:42.887032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e0c8-d904-4aba-a241-f47e2d2cb446 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:42.887371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e0c8-d904-4aba-a241-f47e2d2cb446 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:42.887641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e0c8-d904-4aba-a241-f47e2d2cb446 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:42.888303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e0c8-d904-4aba-a241-f47e2d2cb446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:42.889962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e0c8-d904-4aba-a241-f47e2d2cb446 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:42.901230 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2622/5248] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:42.905285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a16a44-6f2a-4446-9dbf-d86b26005926 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:42.916297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a16a44-6f2a-4446-9dbf-d86b26005926 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:42.926185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9396b7-545b-47eb-a129-05d839731f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:42.927045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9396b7-545b-47eb-a129-05d839731f77 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:42.927045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9396b7-545b-47eb-a129-05d839731f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:42.927382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9396b7-545b-47eb-a129-05d839731f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:42.928025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9396b7-545b-47eb-a129-05d839731f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:42.929642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9396b7-545b-47eb-a129-05d839731f77 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:42.941503 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2627/5249] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:42.945616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e0c8-d904-4aba-a241-f47e2d2cb446 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:42.956632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e0c8-d904-4aba-a241-f47e2d2cb446 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:42.962991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83230781-8b6a-41a2-8911-366ae512d2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:42.963710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83230781-8b6a-41a2-8911-366ae512d2ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:42.963988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83230781-8b6a-41a2-8911-366ae512d2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:42.964258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83230781-8b6a-41a2-8911-366ae512d2ec admin admin] PATH_INFO: `/v3/projects/3691b64f042742f58283758857a828d2/users/100e3e93177f4bf8ac249751962d62cd/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:42.982247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83230781-8b6a-41a2-8911-366ae512d2ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3691b64f042742f58283758857a828d2, user_id=100e3e93177f4bf8ac249751962d62cd, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:42.985041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83230781-8b6a-41a2-8911-366ae512d2ec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:43.001715 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2623/5250] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:42 2022] PUT /identity/v3/projects/3691b64f042742f58283758857a828d2/users/100e3e93177f4bf8ac249751962d62cd/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:43.011824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b12cc-507c-4061-b048-45b30eeb82ae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:43.012167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b12cc-507c-4061-b048-45b30eeb82ae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:43.012450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b12cc-507c-4061-b048-45b30eeb82ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:43.057899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-730b12cc-507c-4061-b048-45b30eeb82ae None None] MFA Rules not processed for user `100e3e93177f4bf8ac249751962d62cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:43.059124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-730b12cc-507c-4061-b048-45b30eeb82ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:43.141513 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2628/5251] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:43 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:43.153403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83230781-8b6a-41a2-8911-366ae512d2ec admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:43.156040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-83230781-8b6a-41a2-8911-366ae512d2ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:43.260752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83230781-8b6a-41a2-8911-366ae512d2ec admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:43.265789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85693cbd-4488-495b-ae5c-9df444f0b3be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:43.266398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85693cbd-4488-495b-ae5c-9df444f0b3be service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:43.266676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85693cbd-4488-495b-ae5c-9df444f0b3be service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:43.266946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85693cbd-4488-495b-ae5c-9df444f0b3be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:43.341027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85693cbd-4488-495b-ae5c-9df444f0b3be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:43.342480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85693cbd-4488-495b-ae5c-9df444f0b3be service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:43.352405 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2624/5252] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:43 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:43.735996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b12cc-507c-4061-b048-45b30eeb82ae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:43.811532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b12cc-507c-4061-b048-45b30eeb82ae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:43.816881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3751e76-d066-451e-b4aa-9f5972b3239a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:43.817643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3751e76-d066-451e-b4aa-9f5972b3239a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:43.817994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3751e76-d066-451e-b4aa-9f5972b3239a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:43.818343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3751e76-d066-451e-b4aa-9f5972b3239a admin admin] PATH_INFO: `/v3/users/f03ba923f1dd40ea908c310915c9d12e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:43.820048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3751e76-d066-451e-b4aa-9f5972b3239a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f03ba923f1dd40ea908c310915c9d12e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:43.822755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3751e76-d066-451e-b4aa-9f5972b3239a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:43.880688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3751e76-d066-451e-b4aa-9f5972b3239a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f03ba923f1dd40ea908c310915c9d12e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:43.881493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3751e76-d066-451e-b4aa-9f5972b3239a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f03ba923f1dd40ea908c310915c9d12e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:43.890928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3751e76-d066-451e-b4aa-9f5972b3239a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f03ba923f1dd40ea908c310915c9d12e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:43.900356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3751e76-d066-451e-b4aa-9f5972b3239a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f03ba923f1dd40ea908c310915c9d12e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:43.908687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:43.913753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3751e76-d066-451e-b4aa-9f5972b3239a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f03ba923f1dd40ea908c310915c9d12e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:43.920870 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2629/5253] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:43 2022] DELETE /identity/v3/users/f03ba923f1dd40ea908c310915c9d12e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:43.926278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81335295-8bf7-4fe7-b144-0134b531ceea None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:43.926798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81335295-8bf7-4fe7-b144-0134b531ceea None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:43.927344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81335295-8bf7-4fe7-b144-0134b531ceea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:43.936129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:43.948998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-81335295-8bf7-4fe7-b144-0134b531ceea None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:43.950202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-81335295-8bf7-4fe7-b144-0134b531ceea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:44.010949 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2625/5254] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:44.020669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3751e76-d066-451e-b4aa-9f5972b3239a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:44.022124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c3751e76-d066-451e-b4aa-9f5972b3239a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:44.084600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3751e76-d066-451e-b4aa-9f5972b3239a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:44.088461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9404c-4957-4cb3-8fc2-1cc63d5e35b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:44.089073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9404c-4957-4cb3-8fc2-1cc63d5e35b9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:44.089350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9404c-4957-4cb3-8fc2-1cc63d5e35b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:44.089618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9404c-4957-4cb3-8fc2-1cc63d5e35b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:44.099518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9404c-4957-4cb3-8fc2-1cc63d5e35b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:44.101011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9404c-4957-4cb3-8fc2-1cc63d5e35b9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:44.111739 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2630/5255] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:44.562833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81335295-8bf7-4fe7-b144-0134b531ceea None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:44.564527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-81335295-8bf7-4fe7-b144-0134b531ceea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:44.578520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81335295-8bf7-4fe7-b144-0134b531ceea None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:44.584960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde14217-11e8-45f8-8e21-61c2253827dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:44.585607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde14217-11e8-45f8-8e21-61c2253827dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:44.585874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde14217-11e8-45f8-8e21-61c2253827dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:44.586155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde14217-11e8-45f8-8e21-61c2253827dc admin admin] PATH_INFO: `/v3/projects/d9a12460f8e64901b287c99a6cad5aee` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:44.587495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde14217-11e8-45f8-8e21-61c2253827dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a12460f8e64901b287c99a6cad5aee)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:44.589425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde14217-11e8-45f8-8e21-61c2253827dc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:44.647908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dde14217-11e8-45f8-8e21-61c2253827dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a12460f8e64901b287c99a6cad5aee', 'request_id': 'req-dde14217-11e8-45f8-8e21-61c2253827dc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:44.654435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dde14217-11e8-45f8-8e21-61c2253827dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a12460f8e64901b287c99a6cad5aee', 'request_id': 'req-dde14217-11e8-45f8-8e21-61c2253827dc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:44.660345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dde14217-11e8-45f8-8e21-61c2253827dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a12460f8e64901b287c99a6cad5aee', 'request_id': 'req-dde14217-11e8-45f8-8e21-61c2253827dc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:44.674754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dde14217-11e8-45f8-8e21-61c2253827dc admin admin] The token cache is being invalidate because project d9a12460f8e64901b287c99a6cad5aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:44.675046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dde14217-11e8-45f8-8e21-61c2253827dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:44.675730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dde14217-11e8-45f8-8e21-61c2253827dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:44.677512 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2626/5256] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:44 2022] DELETE /identity/v3/projects/d9a12460f8e64901b287c99a6cad5aee => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:44.681940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9404c-4957-4cb3-8fc2-1cc63d5e35b9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:44.692218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9404c-4957-4cb3-8fc2-1cc63d5e35b9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:44.754770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28185c5-84c3-4f30-bf52-e09a917f62a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:44.755559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28185c5-84c3-4f30-bf52-e09a917f62a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:44.755709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28185c5-84c3-4f30-bf52-e09a917f62a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:44.756261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28185c5-84c3-4f30-bf52-e09a917f62a2 admin admin] PATH_INFO: `/v3/users/100e3e93177f4bf8ac249751962d62cd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:44.757082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28185c5-84c3-4f30-bf52-e09a917f62a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=100e3e93177f4bf8ac249751962d62cd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:44.759039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28185c5-84c3-4f30-bf52-e09a917f62a2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:44.805104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b28185c5-84c3-4f30-bf52-e09a917f62a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100e3e93177f4bf8ac249751962d62cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:44.805754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b28185c5-84c3-4f30-bf52-e09a917f62a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100e3e93177f4bf8ac249751962d62cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:44.812670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b28185c5-84c3-4f30-bf52-e09a917f62a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100e3e93177f4bf8ac249751962d62cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:44.820640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b28185c5-84c3-4f30-bf52-e09a917f62a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100e3e93177f4bf8ac249751962d62cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:44.836565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b28185c5-84c3-4f30-bf52-e09a917f62a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100e3e93177f4bf8ac249751962d62cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:44.844267 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2631/5257] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:44 2022] DELETE /identity/v3/users/100e3e93177f4bf8ac249751962d62cd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:41:45.147414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde14217-11e8-45f8-8e21-61c2253827dc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:45.149602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dde14217-11e8-45f8-8e21-61c2253827dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:45.165409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde14217-11e8-45f8-8e21-61c2253827dc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:45.234137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3761ce5-a847-44ae-8c9f-5ac2b35e7d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:45.234899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3761ce5-a847-44ae-8c9f-5ac2b35e7d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:45.235188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3761ce5-a847-44ae-8c9f-5ac2b35e7d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:45.235574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3761ce5-a847-44ae-8c9f-5ac2b35e7d89 admin admin] PATH_INFO: `/v3/projects/3691b64f042742f58283758857a828d2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:45.239921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3761ce5-a847-44ae-8c9f-5ac2b35e7d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3691b64f042742f58283758857a828d2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:45.242082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3761ce5-a847-44ae-8c9f-5ac2b35e7d89 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:45.295293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:45.305934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d3761ce5-a847-44ae-8c9f-5ac2b35e7d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3691b64f042742f58283758857a828d2', 'request_id': 'req-d3761ce5-a847-44ae-8c9f-5ac2b35e7d89'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:45.315465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d3761ce5-a847-44ae-8c9f-5ac2b35e7d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3691b64f042742f58283758857a828d2', 'request_id': 'req-d3761ce5-a847-44ae-8c9f-5ac2b35e7d89'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:45.323359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d3761ce5-a847-44ae-8c9f-5ac2b35e7d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3691b64f042742f58283758857a828d2', 'request_id': 'req-d3761ce5-a847-44ae-8c9f-5ac2b35e7d89'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:45.349696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d3761ce5-a847-44ae-8c9f-5ac2b35e7d89 admin admin] The token cache is being invalidate because project 3691b64f042742f58283758857a828d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:45.350083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d3761ce5-a847-44ae-8c9f-5ac2b35e7d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:45.350838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d3761ce5-a847-44ae-8c9f-5ac2b35e7d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:45.352806 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2627/5258] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:45 2022] DELETE /identity/v3/projects/3691b64f042742f58283758857a828d2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:45.357959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e70f25-cbd0-42ca-827b-236238c99aec None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:45.358552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e70f25-cbd0-42ca-827b-236238c99aec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:45.358552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e70f25-cbd0-42ca-827b-236238c99aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:45.385726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c6e70f25-cbd0-42ca-827b-236238c99aec None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:45.387043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c6e70f25-cbd0-42ca-827b-236238c99aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:45.397649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:45.457396 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2632/5259] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:45.464937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c4ba1-324d-48e4-ba84-210afcbc6484 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:45.465237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c4ba1-324d-48e4-ba84-210afcbc6484 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:45.465502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c4ba1-324d-48e4-ba84-210afcbc6484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:45.487382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3c4c4ba1-324d-48e4-ba84-210afcbc6484 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:45.488738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3c4c4ba1-324d-48e4-ba84-210afcbc6484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:45.497359 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2628/5260] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:45.501790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e70f25-cbd0-42ca-827b-236238c99aec None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:45.512482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e70f25-cbd0-42ca-827b-236238c99aec None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:45.517329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dab07f-aa27-444e-ac6f-ac53b9636f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:45.517946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dab07f-aa27-444e-ac6f-ac53b9636f4d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:45.518228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dab07f-aa27-444e-ac6f-ac53b9636f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:45.518500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dab07f-aa27-444e-ac6f-ac53b9636f4d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:45.519186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dab07f-aa27-444e-ac6f-ac53b9636f4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:45.519519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dab07f-aa27-444e-ac6f-ac53b9636f4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:45.521222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dab07f-aa27-444e-ac6f-ac53b9636f4d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:45.535657 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2633/5261] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:41:45.540779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c4ba1-324d-48e4-ba84-210afcbc6484 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:45.551419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c4ba1-324d-48e4-ba84-210afcbc6484 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:45.557615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9238f4-34f2-4b9f-98fb-d1f2fbe26722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:45.557975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9238f4-34f2-4b9f-98fb-d1f2fbe26722 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:45.558313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9238f4-34f2-4b9f-98fb-d1f2fbe26722 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:45.558650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9238f4-34f2-4b9f-98fb-d1f2fbe26722 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:45.559445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9238f4-34f2-4b9f-98fb-d1f2fbe26722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:45.563936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9238f4-34f2-4b9f-98fb-d1f2fbe26722 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:45.607289 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2629/5262] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:45 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:45.611635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dab07f-aa27-444e-ac6f-ac53b9636f4d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:45.621837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dab07f-aa27-444e-ac6f-ac53b9636f4d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:45.679445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2fe74-5e79-4560-b8c8-b506339075ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:45.680158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2fe74-5e79-4560-b8c8-b506339075ad admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:45.680444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2fe74-5e79-4560-b8c8-b506339075ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:45.680718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2fe74-5e79-4560-b8c8-b506339075ad admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:45.681363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2fe74-5e79-4560-b8c8-b506339075ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:45.683429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2fe74-5e79-4560-b8c8-b506339075ad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:45.706149 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2634/5263] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:45 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:45.711209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9238f4-34f2-4b9f-98fb-d1f2fbe26722 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:45.722430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9238f4-34f2-4b9f-98fb-d1f2fbe26722 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:45.728158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b80f29-7f6e-441c-bf43-4c919df9c0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:45.728775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b80f29-7f6e-441c-bf43-4c919df9c0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:45.729049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b80f29-7f6e-441c-bf43-4c919df9c0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:45.729316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b80f29-7f6e-441c-bf43-4c919df9c0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:45.729963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b80f29-7f6e-441c-bf43-4c919df9c0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:45.731620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b80f29-7f6e-441c-bf43-4c919df9c0d3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:45.742778 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2630/5264] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:45.747019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2fe74-5e79-4560-b8c8-b506339075ad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:45.757600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2fe74-5e79-4560-b8c8-b506339075ad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:45.762607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad296af-046b-4bf7-87df-793d332dd107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:45.763197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad296af-046b-4bf7-87df-793d332dd107 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:45.763508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad296af-046b-4bf7-87df-793d332dd107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:45.763784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad296af-046b-4bf7-87df-793d332dd107 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:45.764427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad296af-046b-4bf7-87df-793d332dd107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:45.766031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad296af-046b-4bf7-87df-793d332dd107 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:45.777122 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2635/5265] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:45.781526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b80f29-7f6e-441c-bf43-4c919df9c0d3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:45.791792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b80f29-7f6e-441c-bf43-4c919df9c0d3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:45.796878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b5de3-1297-436b-a3ce-9cd388865d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:45.797532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b5de3-1297-436b-a3ce-9cd388865d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:45.797813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b5de3-1297-436b-a3ce-9cd388865d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:45.798090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b5de3-1297-436b-a3ce-9cd388865d0b admin admin] PATH_INFO: `/v3/projects/95c8c0af7d7d4fe7a86af7db162bace5/users/67eab4a1ba8741a99b347ea22f51e3dd/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:45.814675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b5de3-1297-436b-a3ce-9cd388865d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c8c0af7d7d4fe7a86af7db162bace5, user_id=67eab4a1ba8741a99b347ea22f51e3dd, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:45.817375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b5de3-1297-436b-a3ce-9cd388865d0b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:45.831033 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2631/5266] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:45 2022] PUT /identity/v3/projects/95c8c0af7d7d4fe7a86af7db162bace5/users/67eab4a1ba8741a99b347ea22f51e3dd/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:45.843324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de2527-e530-44ad-964e-e61bdd9a4b5c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:45.843704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de2527-e530-44ad-964e-e61bdd9a4b5c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:45.844122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de2527-e530-44ad-964e-e61bdd9a4b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:45.874698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-95de2527-e530-44ad-964e-e61bdd9a4b5c None None] MFA Rules not processed for user `67eab4a1ba8741a99b347ea22f51e3dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:45.875976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-95de2527-e530-44ad-964e-e61bdd9a4b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:45.946267 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2636/5267] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:45.958724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b5de3-1297-436b-a3ce-9cd388865d0b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:45.961124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-263b5de3-1297-436b-a3ce-9cd388865d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:46.026923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b5de3-1297-436b-a3ce-9cd388865d0b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:46.033411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da045d-f91b-47d0-8482-8de4670e4956 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:46.034027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da045d-f91b-47d0-8482-8de4670e4956 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:46.034305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da045d-f91b-47d0-8482-8de4670e4956 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:46.034573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da045d-f91b-47d0-8482-8de4670e4956 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:46.043226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da045d-f91b-47d0-8482-8de4670e4956 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:46.044693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da045d-f91b-47d0-8482-8de4670e4956 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:46.054483 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2632/5268] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:46.188719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12e46e-b522-4002-ba3f-e21724e74a73 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:46.189005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12e46e-b522-4002-ba3f-e21724e74a73 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:46.189276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12e46e-b522-4002-ba3f-e21724e74a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:46.209532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7b12e46e-b522-4002-ba3f-e21724e74a73 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:46.210754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7b12e46e-b522-4002-ba3f-e21724e74a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:46.215161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:46.285143 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2637/5269] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:41:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:46.337700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da045d-f91b-47d0-8482-8de4670e4956 service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:46.339234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d2da045d-f91b-47d0-8482-8de4670e4956 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:46.407701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:46.435152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da045d-f91b-47d0-8482-8de4670e4956 service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:46.440482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6f55b-bee7-44cf-b608-7ad80bfca2af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:46.441090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6f55b-bee7-44cf-b608-7ad80bfca2af service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:46.441366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6f55b-bee7-44cf-b608-7ad80bfca2af service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:46.441610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6f55b-bee7-44cf-b608-7ad80bfca2af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:46.450307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6f55b-bee7-44cf-b608-7ad80bfca2af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:46.451947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6f55b-bee7-44cf-b608-7ad80bfca2af service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:46.460672 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2633/5270] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:41:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:41:46.804078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85853652-a7ad-4df9-be3b-e31543e30245 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:46.804569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85853652-a7ad-4df9-be3b-e31543e30245 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:46.804856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85853652-a7ad-4df9-be3b-e31543e30245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:46.823929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-85853652-a7ad-4df9-be3b-e31543e30245 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:46.825410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-85853652-a7ad-4df9-be3b-e31543e30245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:46.833042 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2638/5271] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:41:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:46.846311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6f55b-bee7-44cf-b608-7ad80bfca2af service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:46.859457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6f55b-bee7-44cf-b608-7ad80bfca2af service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:46.865105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd07adc-a81b-4310-a747-f51435fc9790 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:46.865723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd07adc-a81b-4310-a747-f51435fc9790 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:46.866013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd07adc-a81b-4310-a747-f51435fc9790 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:46.866258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd07adc-a81b-4310-a747-f51435fc9790 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:46.875549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd07adc-a81b-4310-a747-f51435fc9790 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:46.877144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd07adc-a81b-4310-a747-f51435fc9790 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:46.886351 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2634/5272] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:41:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:41:47.331339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f07c0-a1ef-4f98-8933-95047ec82fcd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:47.332058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f07c0-a1ef-4f98-8933-95047ec82fcd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:47.332533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f07c0-a1ef-4f98-8933-95047ec82fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:47.353806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-471f07c0-a1ef-4f98-8933-95047ec82fcd None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:47.355110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-471f07c0-a1ef-4f98-8933-95047ec82fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:47.362993 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2639/5273] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:41:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:47.377774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd07adc-a81b-4310-a747-f51435fc9790 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:47.390053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd07adc-a81b-4310-a747-f51435fc9790 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:47.395634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42eb528-d9fa-454e-9c5f-0e5f2016e0b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:47.396243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eb528-d9fa-454e-9c5f-0e5f2016e0b6 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:47.396618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eb528-d9fa-454e-9c5f-0e5f2016e0b6 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:47.396966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eb528-d9fa-454e-9c5f-0e5f2016e0b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:47.407777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42eb528-d9fa-454e-9c5f-0e5f2016e0b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:47.409519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42eb528-d9fa-454e-9c5f-0e5f2016e0b6 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:47.418596 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2635/5274] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:41:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:41:47.582310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70402b-5fa1-4294-9827-75b8e02b58be None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:47.582598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70402b-5fa1-4294-9827-75b8e02b58be None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:47.582876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70402b-5fa1-4294-9827-75b8e02b58be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:47.603852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0b70402b-5fa1-4294-9827-75b8e02b58be None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:47.605116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0b70402b-5fa1-4294-9827-75b8e02b58be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:47.613006 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2640/5275] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:41:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:47.625879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42eb528-d9fa-454e-9c5f-0e5f2016e0b6 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:47.637238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42eb528-d9fa-454e-9c5f-0e5f2016e0b6 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:47.642419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a60964-23a7-4b10-b2b3-176e477d9b5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:47.643151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a60964-23a7-4b10-b2b3-176e477d9b5d service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:47.643459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a60964-23a7-4b10-b2b3-176e477d9b5d service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:47.643717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a60964-23a7-4b10-b2b3-176e477d9b5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:47.652176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a60964-23a7-4b10-b2b3-176e477d9b5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:47.653782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a60964-23a7-4b10-b2b3-176e477d9b5d service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:47.662068 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2636/5276] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:41:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:41:47.976989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1a882-579d-4d8a-8e71-cb597f0c3bc0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:47.977510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1a882-579d-4d8a-8e71-cb597f0c3bc0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:47.977613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1a882-579d-4d8a-8e71-cb597f0c3bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:47.997007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f4b1a882-579d-4d8a-8e71-cb597f0c3bc0 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:47.998249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4b1a882-579d-4d8a-8e71-cb597f0c3bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:48.010677 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2641/5277] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:41:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:48.026259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a60964-23a7-4b10-b2b3-176e477d9b5d service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:48.038667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a60964-23a7-4b10-b2b3-176e477d9b5d service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:48.043959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf39277-dce7-45ac-a13d-dd89a68ee3d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:48.044578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf39277-dce7-45ac-a13d-dd89a68ee3d6 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:48.044855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf39277-dce7-45ac-a13d-dd89a68ee3d6 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:48.045125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf39277-dce7-45ac-a13d-dd89a68ee3d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:48.058094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf39277-dce7-45ac-a13d-dd89a68ee3d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:48.060122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf39277-dce7-45ac-a13d-dd89a68ee3d6 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:48.074448 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2637/5278] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:41:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:41:48.288655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edc81b-2d55-4fb3-a9c7-810cf234d149 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:48.289110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edc81b-2d55-4fb3-a9c7-810cf234d149 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:48.289650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edc81b-2d55-4fb3-a9c7-810cf234d149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:48.313504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-77edc81b-2d55-4fb3-a9c7-810cf234d149 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:48.314716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77edc81b-2d55-4fb3-a9c7-810cf234d149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:48.322154 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2642/5279] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:41:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:48.337997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf39277-dce7-45ac-a13d-dd89a68ee3d6 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:48.354401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf39277-dce7-45ac-a13d-dd89a68ee3d6 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:48.359823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3a300-8305-4210-a5e6-fff41d1981f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:48.360431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3a300-8305-4210-a5e6-fff41d1981f9 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:48.360706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3a300-8305-4210-a5e6-fff41d1981f9 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:48.361473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3a300-8305-4210-a5e6-fff41d1981f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:48.369993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3a300-8305-4210-a5e6-fff41d1981f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:48.371687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3a300-8305-4210-a5e6-fff41d1981f9 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:48.380975 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2638/5280] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:41:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:41:48.538541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edc81b-2d55-4fb3-a9c7-810cf234d149 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:48.652387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edc81b-2d55-4fb3-a9c7-810cf234d149 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:48.658638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abace2b7-10b8-4e63-ab8c-07d9a4a17ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:48.659539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abace2b7-10b8-4e63-ab8c-07d9a4a17ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:48.660066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abace2b7-10b8-4e63-ab8c-07d9a4a17ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:48.660410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abace2b7-10b8-4e63-ab8c-07d9a4a17ea8 admin admin] PATH_INFO: `/v3/users/67eab4a1ba8741a99b347ea22f51e3dd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:48.662098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abace2b7-10b8-4e63-ab8c-07d9a4a17ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67eab4a1ba8741a99b347ea22f51e3dd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:48.663940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abace2b7-10b8-4e63-ab8c-07d9a4a17ea8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:48.780997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-abace2b7-10b8-4e63-ab8c-07d9a4a17ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67eab4a1ba8741a99b347ea22f51e3dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:48.782379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-abace2b7-10b8-4e63-ab8c-07d9a4a17ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67eab4a1ba8741a99b347ea22f51e3dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:48.801468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-abace2b7-10b8-4e63-ab8c-07d9a4a17ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67eab4a1ba8741a99b347ea22f51e3dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:48.826892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-abace2b7-10b8-4e63-ab8c-07d9a4a17ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67eab4a1ba8741a99b347ea22f51e3dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:48.853348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:48.862115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-abace2b7-10b8-4e63-ab8c-07d9a4a17ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67eab4a1ba8741a99b347ea22f51e3dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:48.879409 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2643/5281] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:48 2022] DELETE /identity/v3/users/67eab4a1ba8741a99b347ea22f51e3dd => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:48.881511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d36bb1-8a3e-491f-92da-5e8224839ddc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:48.881796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d36bb1-8a3e-491f-92da-5e8224839ddc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:48.882070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d36bb1-8a3e-491f-92da-5e8224839ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:48.911370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-61d36bb1-8a3e-491f-92da-5e8224839ddc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:48.913061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-61d36bb1-8a3e-491f-92da-5e8224839ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:49.075280 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2639/5282] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:49.091725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abace2b7-10b8-4e63-ab8c-07d9a4a17ea8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:49.093711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-abace2b7-10b8-4e63-ab8c-07d9a4a17ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:49.197355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abace2b7-10b8-4e63-ab8c-07d9a4a17ea8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:49.202774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5198632-0ca0-48b9-9911-4d5ce13ed69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:49.203681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5198632-0ca0-48b9-9911-4d5ce13ed69d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:49.204216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5198632-0ca0-48b9-9911-4d5ce13ed69d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:49.204822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5198632-0ca0-48b9-9911-4d5ce13ed69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:49.218213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5198632-0ca0-48b9-9911-4d5ce13ed69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:49.220138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5198632-0ca0-48b9-9911-4d5ce13ed69d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:49.233725 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2644/5283] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:49.609984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d36bb1-8a3e-491f-92da-5e8224839ddc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:49.611990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-61d36bb1-8a3e-491f-92da-5e8224839ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:49.639514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d36bb1-8a3e-491f-92da-5e8224839ddc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:49.654925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e52eb-6cd2-4bcf-879f-aa1e156b1d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:49.655686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e52eb-6cd2-4bcf-879f-aa1e156b1d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:49.656215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e52eb-6cd2-4bcf-879f-aa1e156b1d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:49.656645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e52eb-6cd2-4bcf-879f-aa1e156b1d15 admin admin] PATH_INFO: `/v3/projects/95c8c0af7d7d4fe7a86af7db162bace5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:49.658028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e52eb-6cd2-4bcf-879f-aa1e156b1d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c8c0af7d7d4fe7a86af7db162bace5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:49.660084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e52eb-6cd2-4bcf-879f-aa1e156b1d15 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:49.737940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-894e52eb-6cd2-4bcf-879f-aa1e156b1d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c8c0af7d7d4fe7a86af7db162bace5', 'request_id': 'req-894e52eb-6cd2-4bcf-879f-aa1e156b1d15'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:49.764355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-894e52eb-6cd2-4bcf-879f-aa1e156b1d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c8c0af7d7d4fe7a86af7db162bace5', 'request_id': 'req-894e52eb-6cd2-4bcf-879f-aa1e156b1d15'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:49.772406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-894e52eb-6cd2-4bcf-879f-aa1e156b1d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c8c0af7d7d4fe7a86af7db162bace5', 'request_id': 'req-894e52eb-6cd2-4bcf-879f-aa1e156b1d15'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:49.778264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:49.806518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-894e52eb-6cd2-4bcf-879f-aa1e156b1d15 admin admin] The token cache is being invalidate because project 95c8c0af7d7d4fe7a86af7db162bace5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:41:49.806898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-894e52eb-6cd2-4bcf-879f-aa1e156b1d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:49.808297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-894e52eb-6cd2-4bcf-879f-aa1e156b1d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:49.818407 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2640/5284] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:41:49 2022] DELETE /identity/v3/projects/95c8c0af7d7d4fe7a86af7db162bace5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:49.820942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26fed4-d034-43c5-b350-d0dd81d80f89 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:49.821404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26fed4-d034-43c5-b350-d0dd81d80f89 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:49.821794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26fed4-d034-43c5-b350-d0dd81d80f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:49.852967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9e26fed4-d034-43c5-b350-d0dd81d80f89 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:49.854101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e26fed4-d034-43c5-b350-d0dd81d80f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:49.921302 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2645/5285] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:49.929167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab868a0a-81ef-4692-8a78-c01d76f3ba5b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:49.929503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab868a0a-81ef-4692-8a78-c01d76f3ba5b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:49.929788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab868a0a-81ef-4692-8a78-c01d76f3ba5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:49.949786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ab868a0a-81ef-4692-8a78-c01d76f3ba5b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:49.950990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ab868a0a-81ef-4692-8a78-c01d76f3ba5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:49.960069 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2641/5286] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:49.964288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26fed4-d034-43c5-b350-d0dd81d80f89 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:49.977497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26fed4-d034-43c5-b350-d0dd81d80f89 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:49.983117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015681ea-8fce-4ca7-b459-b132a98073d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:49.983945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015681ea-8fce-4ca7-b459-b132a98073d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:49.984310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015681ea-8fce-4ca7-b459-b132a98073d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:49.984686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015681ea-8fce-4ca7-b459-b132a98073d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:49.985413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015681ea-8fce-4ca7-b459-b132a98073d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:41:49.985787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015681ea-8fce-4ca7-b459-b132a98073d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:49.987501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015681ea-8fce-4ca7-b459-b132a98073d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:50.003741 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2646/5287] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:41:50.007831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab868a0a-81ef-4692-8a78-c01d76f3ba5b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:50.020181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab868a0a-81ef-4692-8a78-c01d76f3ba5b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:50.026039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f293763-e295-4687-abe4-918c93d53daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:50.026747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f293763-e295-4687-abe4-918c93d53daa admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:50.027025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f293763-e295-4687-abe4-918c93d53daa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:50.027375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f293763-e295-4687-abe4-918c93d53daa admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:50.027987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f293763-e295-4687-abe4-918c93d53daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:50.029891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f293763-e295-4687-abe4-918c93d53daa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:50.068311 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2642/5288] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:50 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:50.074611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015681ea-8fce-4ca7-b459-b132a98073d1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:50.092715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015681ea-8fce-4ca7-b459-b132a98073d1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:50.190300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4cc83-e653-4b8a-a32a-f8bc41d8437a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:50.191227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4cc83-e653-4b8a-a32a-f8bc41d8437a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:50.191729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4cc83-e653-4b8a-a32a-f8bc41d8437a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:50.192309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4cc83-e653-4b8a-a32a-f8bc41d8437a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:50.192972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4cc83-e653-4b8a-a32a-f8bc41d8437a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:50.194967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4cc83-e653-4b8a-a32a-f8bc41d8437a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:50.220662 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2647/5289] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:50 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:50.224983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f293763-e295-4687-abe4-918c93d53daa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:50.236434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f293763-e295-4687-abe4-918c93d53daa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:50.242461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bf5f8-8ed6-401d-8208-e34e8c934d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:50.243154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bf5f8-8ed6-401d-8208-e34e8c934d6a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:50.243944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bf5f8-8ed6-401d-8208-e34e8c934d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:50.244219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bf5f8-8ed6-401d-8208-e34e8c934d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:50.244904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8bf5f8-8ed6-401d-8208-e34e8c934d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:50.246705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8bf5f8-8ed6-401d-8208-e34e8c934d6a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:50.258650 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2643/5290] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:50.264068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4cc83-e653-4b8a-a32a-f8bc41d8437a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:50.275752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4cc83-e653-4b8a-a32a-f8bc41d8437a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:50.280465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb777bf-9b9b-44bf-8e24-9aa8069ab027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:50.281147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb777bf-9b9b-44bf-8e24-9aa8069ab027 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:50.281421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb777bf-9b9b-44bf-8e24-9aa8069ab027 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:50.281699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb777bf-9b9b-44bf-8e24-9aa8069ab027 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:50.282349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb777bf-9b9b-44bf-8e24-9aa8069ab027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:50.284085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb777bf-9b9b-44bf-8e24-9aa8069ab027 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:50.290149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:50.300295 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2648/5291] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:50.301707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bf5f8-8ed6-401d-8208-e34e8c934d6a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:50.312293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bf5f8-8ed6-401d-8208-e34e8c934d6a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:50.316936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c4a90-8058-4bbe-8cab-d37742fafcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:50.317600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c4a90-8058-4bbe-8cab-d37742fafcfc admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:50.317877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c4a90-8058-4bbe-8cab-d37742fafcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:50.318180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c4a90-8058-4bbe-8cab-d37742fafcfc admin admin] PATH_INFO: `/v3/projects/408b96429d1a4658b12ef00e0bddab69/users/46bee87ab3cf4353bb28bd9d76330896/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:50.335230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c4a90-8058-4bbe-8cab-d37742fafcfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=408b96429d1a4658b12ef00e0bddab69, user_id=46bee87ab3cf4353bb28bd9d76330896, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:50.337901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c4a90-8058-4bbe-8cab-d37742fafcfc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:50.353141 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2644/5292] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:50 2022] PUT /identity/v3/projects/408b96429d1a4658b12ef00e0bddab69/users/46bee87ab3cf4353bb28bd9d76330896/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:50.365043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde227f9-c2e8-4143-8baf-c7945f3743fd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:50.365302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde227f9-c2e8-4143-8baf-c7945f3743fd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:50.365587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde227f9-c2e8-4143-8baf-c7945f3743fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:50.396616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bde227f9-c2e8-4143-8baf-c7945f3743fd None None] MFA Rules not processed for user `46bee87ab3cf4353bb28bd9d76330896`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:50.397848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bde227f9-c2e8-4143-8baf-c7945f3743fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:50.465832 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2649/5293] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:50.470750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c4a90-8058-4bbe-8cab-d37742fafcfc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:50.536311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c4a90-8058-4bbe-8cab-d37742fafcfc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:50.543607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20db137-a396-47fd-8836-4384198ca5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:50.543607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20db137-a396-47fd-8836-4384198ca5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:50.543898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20db137-a396-47fd-8836-4384198ca5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:50.544060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20db137-a396-47fd-8836-4384198ca5a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:50.544851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20db137-a396-47fd-8836-4384198ca5a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:50.547289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20db137-a396-47fd-8836-4384198ca5a1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:50.583319 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2645/5294] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:41:50 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:50.587797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde227f9-c2e8-4143-8baf-c7945f3743fd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:50.598673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde227f9-c2e8-4143-8baf-c7945f3743fd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:50.661341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b45647-982c-4053-943c-6b93d7863e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:50.662556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b45647-982c-4053-943c-6b93d7863e3d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:50.662835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b45647-982c-4053-943c-6b93d7863e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:50.663149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b45647-982c-4053-943c-6b93d7863e3d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:50.663953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b45647-982c-4053-943c-6b93d7863e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:50.665889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b45647-982c-4053-943c-6b93d7863e3d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:50.690564 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2650/5295] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:41:50 2022] POST /identity/v3/users => generated 301 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:41:50.694687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20db137-a396-47fd-8836-4384198ca5a1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:50.705823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20db137-a396-47fd-8836-4384198ca5a1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:50.734556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85227f-570e-4d08-ba44-bef34d0321bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:50.734556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85227f-570e-4d08-ba44-bef34d0321bb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:50.734556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85227f-570e-4d08-ba44-bef34d0321bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:50.734556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85227f-570e-4d08-ba44-bef34d0321bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:50.735086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85227f-570e-4d08-ba44-bef34d0321bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:50.735086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85227f-570e-4d08-ba44-bef34d0321bb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:50.757730 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2646/5296] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:50.762625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b45647-982c-4053-943c-6b93d7863e3d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:50.787288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b45647-982c-4053-943c-6b93d7863e3d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:50.796985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9aa58c-a5c0-4bac-8ecd-0ce5c82cfada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:50.797678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9aa58c-a5c0-4bac-8ecd-0ce5c82cfada admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:50.797958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9aa58c-a5c0-4bac-8ecd-0ce5c82cfada admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:50.798238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9aa58c-a5c0-4bac-8ecd-0ce5c82cfada admin admin] PATH_INFO: `/v3/projects/1029deb1223a4115b96d6752c3b13210/users/fba0f8dc56804748be7a0be7d072aa2a/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:50.834987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9aa58c-a5c0-4bac-8ecd-0ce5c82cfada admin admin] RBAC: Authorizing `identity:create_grant(project_id=1029deb1223a4115b96d6752c3b13210, user_id=fba0f8dc56804748be7a0be7d072aa2a, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:50.839208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9aa58c-a5c0-4bac-8ecd-0ce5c82cfada admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:50.863382 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2651/5297] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:50 2022] PUT /identity/v3/projects/1029deb1223a4115b96d6752c3b13210/users/fba0f8dc56804748be7a0be7d072aa2a/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:50.864673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85227f-570e-4d08-ba44-bef34d0321bb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:50.877086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85227f-570e-4d08-ba44-bef34d0321bb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:50.960718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4ad8e-5ce0-4ceb-a0f4-9d7c19c8a192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:50.961653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4ad8e-5ce0-4ceb-a0f4-9d7c19c8a192 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:50.962222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4ad8e-5ce0-4ceb-a0f4-9d7c19c8a192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:50.962712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4ad8e-5ce0-4ceb-a0f4-9d7c19c8a192 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:50.963612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4ad8e-5ce0-4ceb-a0f4-9d7c19c8a192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:50.965641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4ad8e-5ce0-4ceb-a0f4-9d7c19c8a192 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:50.982370 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2647/5298] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:41:50.987435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9aa58c-a5c0-4bac-8ecd-0ce5c82cfada admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:51.008429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9aa58c-a5c0-4bac-8ecd-0ce5c82cfada admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:51.014861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe972e7c-16f9-441f-b866-59522901302d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:51.016150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe972e7c-16f9-441f-b866-59522901302d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:51.016150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe972e7c-16f9-441f-b866-59522901302d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:51.016369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe972e7c-16f9-441f-b866-59522901302d admin admin] PATH_INFO: `/v3/projects/1029deb1223a4115b96d6752c3b13210/users/fba0f8dc56804748be7a0be7d072aa2a/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:51.019364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe972e7c-16f9-441f-b866-59522901302d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1029deb1223a4115b96d6752c3b13210, user_id=fba0f8dc56804748be7a0be7d072aa2a, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:51.022607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe972e7c-16f9-441f-b866-59522901302d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:51.043648 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2652/5299] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:41:50 2022] PUT /identity/v3/projects/1029deb1223a4115b96d6752c3b13210/users/fba0f8dc56804748be7a0be7d072aa2a/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:51.048897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dd71d-e9e8-444d-9265-b429e59dcf98 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:51.049471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dd71d-e9e8-444d-9265-b429e59dcf98 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:51.049798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dd71d-e9e8-444d-9265-b429e59dcf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:51.059179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:51.099212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fd8dd71d-e9e8-444d-9265-b429e59dcf98 None None] MFA Rules not processed for user `fba0f8dc56804748be7a0be7d072aa2a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:51.100735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fd8dd71d-e9e8-444d-9265-b429e59dcf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:51.193598 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2648/5300] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:51.203387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe972e7c-16f9-441f-b866-59522901302d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:51.205305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe972e7c-16f9-441f-b866-59522901302d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:51.302667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:51.320325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe972e7c-16f9-441f-b866-59522901302d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:51.325816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d009b-6e15-434f-a28b-6b39632d5e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:51.326839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d009b-6e15-434f-a28b-6b39632d5e30 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:51.328228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d009b-6e15-434f-a28b-6b39632d5e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:51.329120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d009b-6e15-434f-a28b-6b39632d5e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:51.402676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d009b-6e15-434f-a28b-6b39632d5e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:51.404628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d009b-6e15-434f-a28b-6b39632d5e30 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:51.416640 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2653/5301] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:41:55.275304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dd71d-e9e8-444d-9265-b429e59dcf98 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:55.291008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dd71d-e9e8-444d-9265-b429e59dcf98 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:55.302094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507d95e-4496-4eb3-b755-8ce04096725e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:55.303769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507d95e-4496-4eb3-b755-8ce04096725e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:55.304080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507d95e-4496-4eb3-b755-8ce04096725e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:55.304560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507d95e-4496-4eb3-b755-8ce04096725e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:55.325507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507d95e-4496-4eb3-b755-8ce04096725e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:55.328689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507d95e-4496-4eb3-b755-8ce04096725e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:55.354257 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2649/5302] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:55 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:56.806145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99811e09-25c4-46b0-9706-7737743c82fa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:56.806682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99811e09-25c4-46b0-9706-7737743c82fa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:56.806682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99811e09-25c4-46b0-9706-7737743c82fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:56.855600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-99811e09-25c4-46b0-9706-7737743c82fa None None] MFA Rules not processed for user `2a1cab39f20c4a758e9a190f85eeafa7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:56.857769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-99811e09-25c4-46b0-9706-7737743c82fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:56.941872 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2654/5303] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:58.779906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507d95e-4496-4eb3-b755-8ce04096725e service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:58.890171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507d95e-4496-4eb3-b755-8ce04096725e service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:58.903406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e03ca2-085c-40a4-9078-a00653ff9686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:58.904067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e03ca2-085c-40a4-9078-a00653ff9686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:58.904495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e03ca2-085c-40a4-9078-a00653ff9686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:58.904775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e03ca2-085c-40a4-9078-a00653ff9686 admin admin] PATH_INFO: `/v3/users/46bee87ab3cf4353bb28bd9d76330896` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:58.914112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e03ca2-085c-40a4-9078-a00653ff9686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46bee87ab3cf4353bb28bd9d76330896)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:58.917202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e03ca2-085c-40a4-9078-a00653ff9686 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:59.003796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-84e03ca2-085c-40a4-9078-a00653ff9686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46bee87ab3cf4353bb28bd9d76330896'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:59.019855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-84e03ca2-085c-40a4-9078-a00653ff9686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46bee87ab3cf4353bb28bd9d76330896'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:59.020804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-84e03ca2-085c-40a4-9078-a00653ff9686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46bee87ab3cf4353bb28bd9d76330896'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:59.021518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-84e03ca2-085c-40a4-9078-a00653ff9686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46bee87ab3cf4353bb28bd9d76330896'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:59.054511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-84e03ca2-085c-40a4-9078-a00653ff9686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46bee87ab3cf4353bb28bd9d76330896'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:41:59.100368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:59.151146 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2650/5304] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:41:58 2022] DELETE /identity/v3/users/46bee87ab3cf4353bb28bd9d76330896 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:41:59.153195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116bb2f-b5ec-41d1-a205-1d38a377a083 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:59.154235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116bb2f-b5ec-41d1-a205-1d38a377a083 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:59.154728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116bb2f-b5ec-41d1-a205-1d38a377a083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:59.203287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f116bb2f-b5ec-41d1-a205-1d38a377a083 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:59.204497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f116bb2f-b5ec-41d1-a205-1d38a377a083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:59.281973 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2655/5305] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:59.293159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e03ca2-085c-40a4-9078-a00653ff9686 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:59.298865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-84e03ca2-085c-40a4-9078-a00653ff9686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:59.644185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e03ca2-085c-40a4-9078-a00653ff9686 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:59.650519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851d9c3-46ea-4d56-ab19-5cc04ce82a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:59.651332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851d9c3-46ea-4d56-ab19-5cc04ce82a65 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:59.651615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851d9c3-46ea-4d56-ab19-5cc04ce82a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:59.651981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851d9c3-46ea-4d56-ab19-5cc04ce82a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:59.663241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851d9c3-46ea-4d56-ab19-5cc04ce82a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:59.665231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851d9c3-46ea-4d56-ab19-5cc04ce82a65 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:59.676478 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2651/5306] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:42:00.007493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116bb2f-b5ec-41d1-a205-1d38a377a083 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:00.009207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f116bb2f-b5ec-41d1-a205-1d38a377a083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:00.036094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116bb2f-b5ec-41d1-a205-1d38a377a083 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:00.042937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a8edb-50f1-4641-a334-1388529428fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:00.043871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a8edb-50f1-4641-a334-1388529428fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:00.044359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a8edb-50f1-4641-a334-1388529428fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:00.044851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a8edb-50f1-4641-a334-1388529428fe admin admin] PATH_INFO: `/v3/projects/408b96429d1a4658b12ef00e0bddab69` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:00.046291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a8edb-50f1-4641-a334-1388529428fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=408b96429d1a4658b12ef00e0bddab69)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:00.048486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a8edb-50f1-4641-a334-1388529428fe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:00.158754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:00.188673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-df2a8edb-50f1-4641-a334-1388529428fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408b96429d1a4658b12ef00e0bddab69', 'request_id': 'req-df2a8edb-50f1-4641-a334-1388529428fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:00.223509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-df2a8edb-50f1-4641-a334-1388529428fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408b96429d1a4658b12ef00e0bddab69', 'request_id': 'req-df2a8edb-50f1-4641-a334-1388529428fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:00.234092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-df2a8edb-50f1-4641-a334-1388529428fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408b96429d1a4658b12ef00e0bddab69', 'request_id': 'req-df2a8edb-50f1-4641-a334-1388529428fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:00.275910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-df2a8edb-50f1-4641-a334-1388529428fe admin admin] The token cache is being invalidate because project 408b96429d1a4658b12ef00e0bddab69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:00.276332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-df2a8edb-50f1-4641-a334-1388529428fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:00.276960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-df2a8edb-50f1-4641-a334-1388529428fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:00.278921 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2656/5307] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:00 2022] DELETE /identity/v3/projects/408b96429d1a4658b12ef00e0bddab69 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:00.284108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851d9c3-46ea-4d56-ab19-5cc04ce82a65 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:00.298988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851d9c3-46ea-4d56-ab19-5cc04ce82a65 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:00.404298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4449a0-ac9c-4e90-9c1f-b5a2c3964137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:00.404580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4449a0-ac9c-4e90-9c1f-b5a2c3964137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:00.404933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4449a0-ac9c-4e90-9c1f-b5a2c3964137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:00.405253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4449a0-ac9c-4e90-9c1f-b5a2c3964137 admin admin] PATH_INFO: `/v3/users/fba0f8dc56804748be7a0be7d072aa2a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:00.406817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4449a0-ac9c-4e90-9c1f-b5a2c3964137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba0f8dc56804748be7a0be7d072aa2a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:00.408826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4449a0-ac9c-4e90-9c1f-b5a2c3964137 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:00.548606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6c4449a0-ac9c-4e90-9c1f-b5a2c3964137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba0f8dc56804748be7a0be7d072aa2a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:00.575702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6c4449a0-ac9c-4e90-9c1f-b5a2c3964137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba0f8dc56804748be7a0be7d072aa2a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:00.576654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6c4449a0-ac9c-4e90-9c1f-b5a2c3964137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba0f8dc56804748be7a0be7d072aa2a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:00.577309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6c4449a0-ac9c-4e90-9c1f-b5a2c3964137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba0f8dc56804748be7a0be7d072aa2a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:00.591594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6c4449a0-ac9c-4e90-9c1f-b5a2c3964137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba0f8dc56804748be7a0be7d072aa2a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:00.615941 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2652/5308] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:00 2022] DELETE /identity/v3/users/fba0f8dc56804748be7a0be7d072aa2a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:01.228387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a8edb-50f1-4641-a334-1388529428fe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:01.231221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-df2a8edb-50f1-4641-a334-1388529428fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:01.302658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a8edb-50f1-4641-a334-1388529428fe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:01.495991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9551d3f-fb81-4c06-bd3e-6e9bb10a71fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:01.496940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9551d3f-fb81-4c06-bd3e-6e9bb10a71fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:01.497509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9551d3f-fb81-4c06-bd3e-6e9bb10a71fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:01.497954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9551d3f-fb81-4c06-bd3e-6e9bb10a71fc admin admin] PATH_INFO: `/v3/projects/1029deb1223a4115b96d6752c3b13210` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:01.502974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9551d3f-fb81-4c06-bd3e-6e9bb10a71fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1029deb1223a4115b96d6752c3b13210)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:01.505326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9551d3f-fb81-4c06-bd3e-6e9bb10a71fc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:01.627702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a9551d3f-fb81-4c06-bd3e-6e9bb10a71fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1029deb1223a4115b96d6752c3b13210', 'request_id': 'req-a9551d3f-fb81-4c06-bd3e-6e9bb10a71fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:01.642552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a9551d3f-fb81-4c06-bd3e-6e9bb10a71fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1029deb1223a4115b96d6752c3b13210', 'request_id': 'req-a9551d3f-fb81-4c06-bd3e-6e9bb10a71fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:01.650798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a9551d3f-fb81-4c06-bd3e-6e9bb10a71fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1029deb1223a4115b96d6752c3b13210', 'request_id': 'req-a9551d3f-fb81-4c06-bd3e-6e9bb10a71fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:01.666066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a9551d3f-fb81-4c06-bd3e-6e9bb10a71fc admin admin] The token cache is being invalidate because project 1029deb1223a4115b96d6752c3b13210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:01.666823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a9551d3f-fb81-4c06-bd3e-6e9bb10a71fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:01.668040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a9551d3f-fb81-4c06-bd3e-6e9bb10a71fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:01.670895 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2657/5309] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:01 2022] DELETE /identity/v3/projects/1029deb1223a4115b96d6752c3b13210 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:01.675891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4856d4d-1f42-4bfa-9bc1-ef529de27dc4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:01.676395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4856d4d-1f42-4bfa-9bc1-ef529de27dc4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:01.676523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4856d4d-1f42-4bfa-9bc1-ef529de27dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:01.702765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d4856d4d-1f42-4bfa-9bc1-ef529de27dc4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:01.704254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d4856d4d-1f42-4bfa-9bc1-ef529de27dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:01.724474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:01.856540 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2653/5310] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:01.864266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b216d0-11bc-4df7-bdba-738cc9af85d3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:01.864555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b216d0-11bc-4df7-bdba-738cc9af85d3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:01.864848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b216d0-11bc-4df7-bdba-738cc9af85d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:01.890322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-83b216d0-11bc-4df7-bdba-738cc9af85d3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:01.891419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-83b216d0-11bc-4df7-bdba-738cc9af85d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:01.908871 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2658/5311] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:01.913297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4856d4d-1f42-4bfa-9bc1-ef529de27dc4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:01.925383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4856d4d-1f42-4bfa-9bc1-ef529de27dc4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:01.936296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0436e-3bfe-4340-96a7-832c03baa7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:01.940855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0436e-3bfe-4340-96a7-832c03baa7cd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:01.941780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0436e-3bfe-4340-96a7-832c03baa7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:01.942434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0436e-3bfe-4340-96a7-832c03baa7cd admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:01.946453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0436e-3bfe-4340-96a7-832c03baa7cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:42:01.948615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0436e-3bfe-4340-96a7-832c03baa7cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:01.952919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0436e-3bfe-4340-96a7-832c03baa7cd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:01.971909 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2654/5312] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:01.973702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b216d0-11bc-4df7-bdba-738cc9af85d3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:01.984049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b216d0-11bc-4df7-bdba-738cc9af85d3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:02.016054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8610f-a129-40fe-bb6c-328d2e2a3900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:02.016856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8610f-a129-40fe-bb6c-328d2e2a3900 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:02.017125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8610f-a129-40fe-bb6c-328d2e2a3900 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:02.017392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8610f-a129-40fe-bb6c-328d2e2a3900 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:02.018040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8610f-a129-40fe-bb6c-328d2e2a3900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:02.038803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8610f-a129-40fe-bb6c-328d2e2a3900 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:02.116360 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2659/5313] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:01 2022] POST /identity/v3/projects => generated 367 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:02.118315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0436e-3bfe-4340-96a7-832c03baa7cd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:02.130176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0436e-3bfe-4340-96a7-832c03baa7cd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:02.234041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de411428-2a17-4d61-be97-b4650b49f005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:02.234736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de411428-2a17-4d61-be97-b4650b49f005 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:02.235072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de411428-2a17-4d61-be97-b4650b49f005 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:02.235440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de411428-2a17-4d61-be97-b4650b49f005 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:02.235981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de411428-2a17-4d61-be97-b4650b49f005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:02.237907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de411428-2a17-4d61-be97-b4650b49f005 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:02.270227 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2655/5314] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:02 2022] POST /identity/v3/users => generated 284 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:02.274397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8610f-a129-40fe-bb6c-328d2e2a3900 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:02.287291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8610f-a129-40fe-bb6c-328d2e2a3900 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:02.303962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1175eae-d91d-432c-8527-e1ef2f9c7fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:02.305621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175eae-d91d-432c-8527-e1ef2f9c7fea admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:02.305902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175eae-d91d-432c-8527-e1ef2f9c7fea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:02.306383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175eae-d91d-432c-8527-e1ef2f9c7fea admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:02.310442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1175eae-d91d-432c-8527-e1ef2f9c7fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:02.313406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1175eae-d91d-432c-8527-e1ef2f9c7fea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:02.337177 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2660/5315] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:02.341347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de411428-2a17-4d61-be97-b4650b49f005 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:02.363374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de411428-2a17-4d61-be97-b4650b49f005 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:02.382422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d585f-dbc0-4dd0-be03-4aeeffe1bb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:02.383121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d585f-dbc0-4dd0-be03-4aeeffe1bb84 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:02.383432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d585f-dbc0-4dd0-be03-4aeeffe1bb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:02.383796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d585f-dbc0-4dd0-be03-4aeeffe1bb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:02.385513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d585f-dbc0-4dd0-be03-4aeeffe1bb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:02.387158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d585f-dbc0-4dd0-be03-4aeeffe1bb84 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:02.400946 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2656/5316] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:02.415127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1175eae-d91d-432c-8527-e1ef2f9c7fea admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:02.447334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1175eae-d91d-432c-8527-e1ef2f9c7fea admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:02.458095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b1430-f94a-488a-9aa6-68a6dec3c593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:02.459333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b1430-f94a-488a-9aa6-68a6dec3c593 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:02.459791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b1430-f94a-488a-9aa6-68a6dec3c593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:02.460233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b1430-f94a-488a-9aa6-68a6dec3c593 admin admin] PATH_INFO: `/v3/projects/ad80b11631944f44b59927c19759e60a/users/a902cea2ce36403da2e5283e168556ee/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:02.474792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:02.477515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b1430-f94a-488a-9aa6-68a6dec3c593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad80b11631944f44b59927c19759e60a, user_id=a902cea2ce36403da2e5283e168556ee, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:02.480668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b1430-f94a-488a-9aa6-68a6dec3c593 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:02.507454 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2661/5317] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:02 2022] PUT /identity/v3/projects/ad80b11631944f44b59927c19759e60a/users/a902cea2ce36403da2e5283e168556ee/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:02.526038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985dd79-f73b-4e24-bed7-5912da5e5606 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:02.527580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985dd79-f73b-4e24-bed7-5912da5e5606 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:02.528060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985dd79-f73b-4e24-bed7-5912da5e5606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:02.563904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2985dd79-f73b-4e24-bed7-5912da5e5606 None None] MFA Rules not processed for user `a902cea2ce36403da2e5283e168556ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:02.565212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2985dd79-f73b-4e24-bed7-5912da5e5606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:02.682187 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2657/5318] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:42:02.684102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b1430-f94a-488a-9aa6-68a6dec3c593 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:02.766292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b1430-f94a-488a-9aa6-68a6dec3c593 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:02.777619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568603b-9017-45a0-b606-d7875e48deeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:02.778387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568603b-9017-45a0-b606-d7875e48deeb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:02.778614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568603b-9017-45a0-b606-d7875e48deeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:02.778909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568603b-9017-45a0-b606-d7875e48deeb admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:02.779576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568603b-9017-45a0-b606-d7875e48deeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:02.781979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568603b-9017-45a0-b606-d7875e48deeb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:02.838189 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2662/5319] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:02 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:02.842259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985dd79-f73b-4e24-bed7-5912da5e5606 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:02.859620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985dd79-f73b-4e24-bed7-5912da5e5606 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:02.900066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:03.004370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94221b5d-a152-47ee-970a-295992fa12c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:03.005335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94221b5d-a152-47ee-970a-295992fa12c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:03.005901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94221b5d-a152-47ee-970a-295992fa12c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:03.006395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94221b5d-a152-47ee-970a-295992fa12c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:03.007338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94221b5d-a152-47ee-970a-295992fa12c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:03.010476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94221b5d-a152-47ee-970a-295992fa12c9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:03.035966 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2658/5320] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:02 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:03.040498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568603b-9017-45a0-b606-d7875e48deeb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:03.053075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568603b-9017-45a0-b606-d7875e48deeb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:03.059232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a42ae-05af-4751-b432-6c4925690c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:03.060831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a42ae-05af-4751-b432-6c4925690c99 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:03.060831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a42ae-05af-4751-b432-6c4925690c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:03.060831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a42ae-05af-4751-b432-6c4925690c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:03.062111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a42ae-05af-4751-b432-6c4925690c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:03.063093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a42ae-05af-4751-b432-6c4925690c99 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:03.076490 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2663/5321] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:03.081365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94221b5d-a152-47ee-970a-295992fa12c9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:03.096358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94221b5d-a152-47ee-970a-295992fa12c9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:03.101432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a0eac-78ae-4728-bcb1-0094dbfbfeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:03.102112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a0eac-78ae-4728-bcb1-0094dbfbfeba admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:03.102439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a0eac-78ae-4728-bcb1-0094dbfbfeba admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:03.102681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a0eac-78ae-4728-bcb1-0094dbfbfeba admin admin] PATH_INFO: `/v3/projects/4f3be7eac85449c7bf9b0e1f8b997931/users/fb4ef7f6e94449499dfabf01527d6f69/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:03.121150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a0eac-78ae-4728-bcb1-0094dbfbfeba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3be7eac85449c7bf9b0e1f8b997931, user_id=fb4ef7f6e94449499dfabf01527d6f69, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:03.124551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a0eac-78ae-4728-bcb1-0094dbfbfeba admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:03.144647 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2659/5322] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:03 2022] PUT /identity/v3/projects/4f3be7eac85449c7bf9b0e1f8b997931/users/fb4ef7f6e94449499dfabf01527d6f69/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:03.148864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a42ae-05af-4751-b432-6c4925690c99 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:03.164469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a42ae-05af-4751-b432-6c4925690c99 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:03.224562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a03d46-9c3c-4292-b8d1-be28e8e4e5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:03.225293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a03d46-9c3c-4292-b8d1-be28e8e4e5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:03.225667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a03d46-9c3c-4292-b8d1-be28e8e4e5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:03.226020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a03d46-9c3c-4292-b8d1-be28e8e4e5d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:03.226660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a03d46-9c3c-4292-b8d1-be28e8e4e5d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:03.228538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a03d46-9c3c-4292-b8d1-be28e8e4e5d7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:03.239292 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2664/5323] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:03.244742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a0eac-78ae-4728-bcb1-0094dbfbfeba admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:03.257113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a0eac-78ae-4728-bcb1-0094dbfbfeba admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:03.264436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62018af2-f6e1-4efd-9348-525b78ab44a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:03.265421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62018af2-f6e1-4efd-9348-525b78ab44a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:03.265868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62018af2-f6e1-4efd-9348-525b78ab44a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:03.266334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62018af2-f6e1-4efd-9348-525b78ab44a3 admin admin] PATH_INFO: `/v3/projects/4f3be7eac85449c7bf9b0e1f8b997931/users/fb4ef7f6e94449499dfabf01527d6f69/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:03.269285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62018af2-f6e1-4efd-9348-525b78ab44a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3be7eac85449c7bf9b0e1f8b997931, user_id=fb4ef7f6e94449499dfabf01527d6f69, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:03.272747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62018af2-f6e1-4efd-9348-525b78ab44a3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:03.285611 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2660/5324] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:03 2022] PUT /identity/v3/projects/4f3be7eac85449c7bf9b0e1f8b997931/users/fb4ef7f6e94449499dfabf01527d6f69/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:03.296833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bcf3c-d226-43a1-8f17-ba4aadc9b043 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:03.297315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bcf3c-d226-43a1-8f17-ba4aadc9b043 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:03.297315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bcf3c-d226-43a1-8f17-ba4aadc9b043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:03.329375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cc2bcf3c-d226-43a1-8f17-ba4aadc9b043 None None] MFA Rules not processed for user `fb4ef7f6e94449499dfabf01527d6f69`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:03.330698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cc2bcf3c-d226-43a1-8f17-ba4aadc9b043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:03.426774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:03.472979 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2665/5325] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:03.480642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62018af2-f6e1-4efd-9348-525b78ab44a3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:03.486463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-62018af2-f6e1-4efd-9348-525b78ab44a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:03.567747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bcf3c-d226-43a1-8f17-ba4aadc9b043 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:03.569545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cc2bcf3c-d226-43a1-8f17-ba4aadc9b043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:03.655208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62018af2-f6e1-4efd-9348-525b78ab44a3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:03.659606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1841955-82b4-49a2-af46-b5f1b991b093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:03.660225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1841955-82b4-49a2-af46-b5f1b991b093 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:03.660505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1841955-82b4-49a2-af46-b5f1b991b093 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:03.660778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1841955-82b4-49a2-af46-b5f1b991b093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:03.667059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bcf3c-d226-43a1-8f17-ba4aadc9b043 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:03.671626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1841955-82b4-49a2-af46-b5f1b991b093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:03.673160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1841955-82b4-49a2-af46-b5f1b991b093 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:03.683871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82513ba6-43f2-42dd-84f9-d36cca9a05e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:03.684076 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2661/5326] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:03.686502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82513ba6-43f2-42dd-84f9-d36cca9a05e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:03.688003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82513ba6-43f2-42dd-84f9-d36cca9a05e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:03.688294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82513ba6-43f2-42dd-84f9-d36cca9a05e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:03.696704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-82513ba6-43f2-42dd-84f9-d36cca9a05e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:03.802897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82513ba6-43f2-42dd-84f9-d36cca9a05e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:03.804982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82513ba6-43f2-42dd-84f9-d36cca9a05e3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:03.822993 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2666/5327] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:42:08.932158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1841955-82b4-49a2-af46-b5f1b991b093 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:08.938575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e1841955-82b4-49a2-af46-b5f1b991b093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:08.956000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1841955-82b4-49a2-af46-b5f1b991b093 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:08.962330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120509d3-712a-40be-8ff1-51389792e7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:08.962976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120509d3-712a-40be-8ff1-51389792e7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:08.963281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120509d3-712a-40be-8ff1-51389792e7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:08.963610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120509d3-712a-40be-8ff1-51389792e7f7 admin admin] PATH_INFO: `/v3/users/f2d62e73e5024dde96d48cdd0e375d1d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:09.006332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120509d3-712a-40be-8ff1-51389792e7f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d62e73e5024dde96d48cdd0e375d1d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:09.008629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120509d3-712a-40be-8ff1-51389792e7f7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:09.082681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-120509d3-712a-40be-8ff1-51389792e7f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d62e73e5024dde96d48cdd0e375d1d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:09.085304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:09.108674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-120509d3-712a-40be-8ff1-51389792e7f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d62e73e5024dde96d48cdd0e375d1d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:09.115338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-120509d3-712a-40be-8ff1-51389792e7f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d62e73e5024dde96d48cdd0e375d1d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:09.116154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-120509d3-712a-40be-8ff1-51389792e7f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d62e73e5024dde96d48cdd0e375d1d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:09.132689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-120509d3-712a-40be-8ff1-51389792e7f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d62e73e5024dde96d48cdd0e375d1d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:09.161226 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2662/5328] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:08 2022] DELETE /identity/v3/users/f2d62e73e5024dde96d48cdd0e375d1d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:09.418604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82513ba6-43f2-42dd-84f9-d36cca9a05e3 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:09.432170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82513ba6-43f2-42dd-84f9-d36cca9a05e3 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:09.545767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3c616-093f-41a9-a054-65fa32a5959f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:09.546903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3c616-093f-41a9-a054-65fa32a5959f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:09.547433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3c616-093f-41a9-a054-65fa32a5959f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:09.547997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3c616-093f-41a9-a054-65fa32a5959f admin admin] PATH_INFO: `/v3/projects/b8921b78abc9419a991b4d0a6027e43c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:09.606921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3c616-093f-41a9-a054-65fa32a5959f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8921b78abc9419a991b4d0a6027e43c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:09.609298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3c616-093f-41a9-a054-65fa32a5959f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:09.696939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:09.748862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c8c3c616-093f-41a9-a054-65fa32a5959f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8921b78abc9419a991b4d0a6027e43c', 'request_id': 'req-c8c3c616-093f-41a9-a054-65fa32a5959f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:09.767218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c8c3c616-093f-41a9-a054-65fa32a5959f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8921b78abc9419a991b4d0a6027e43c', 'request_id': 'req-c8c3c616-093f-41a9-a054-65fa32a5959f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:09.777255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c8c3c616-093f-41a9-a054-65fa32a5959f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8921b78abc9419a991b4d0a6027e43c', 'request_id': 'req-c8c3c616-093f-41a9-a054-65fa32a5959f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:09.791325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120509d3-712a-40be-8ff1-51389792e7f7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:09.792752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-120509d3-712a-40be-8ff1-51389792e7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:09.813072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c8c3c616-093f-41a9-a054-65fa32a5959f admin admin] The token cache is being invalidate because project b8921b78abc9419a991b4d0a6027e43c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:09.813361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c8c3c616-093f-41a9-a054-65fa32a5959f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:09.814981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c8c3c616-093f-41a9-a054-65fa32a5959f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:09.816562 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2667/5329] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:09 2022] DELETE /identity/v3/projects/b8921b78abc9419a991b4d0a6027e43c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:09.821840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5d8b7-ce2f-4fd0-bcb4-fab41b815da6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:09.822125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5d8b7-ce2f-4fd0-bcb4-fab41b815da6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:09.822386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5d8b7-ce2f-4fd0-bcb4-fab41b815da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:09.868370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2fc5d8b7-ce2f-4fd0-bcb4-fab41b815da6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:09.869621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2fc5d8b7-ce2f-4fd0-bcb4-fab41b815da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:10.003633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120509d3-712a-40be-8ff1-51389792e7f7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:10.045222 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2668/5330] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:10.053179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c26d61-c569-4b94-b260-a022e0a8548f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:10.053477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c26d61-c569-4b94-b260-a022e0a8548f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:10.053723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c26d61-c569-4b94-b260-a022e0a8548f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:10.074098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c355a0e-6b92-49ff-af0b-535aae56314a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:10.074910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c355a0e-6b92-49ff-af0b-535aae56314a service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:10.075279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c355a0e-6b92-49ff-af0b-535aae56314a service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:10.075718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c355a0e-6b92-49ff-af0b-535aae56314a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:10.078057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4c355a0e-6b92-49ff-af0b-535aae56314a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:10.096055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c355a0e-6b92-49ff-af0b-535aae56314a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:10.098142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c355a0e-6b92-49ff-af0b-535aae56314a service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:10.116076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-24c26d61-c569-4b94-b260-a022e0a8548f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:10.117324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24c26d61-c569-4b94-b260-a022e0a8548f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:10.135011 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2663/5331] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:42:10.152094 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2669/5332] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:42:10.157146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c355a0e-6b92-49ff-af0b-535aae56314a service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:10.179337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c355a0e-6b92-49ff-af0b-535aae56314a service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:10.191089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaa394-ecf1-4d66-9c05-0396e0901c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:10.193985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaa394-ecf1-4d66-9c05-0396e0901c96 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:10.196570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaa394-ecf1-4d66-9c05-0396e0901c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:10.197008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaa394-ecf1-4d66-9c05-0396e0901c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:10.198035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaa394-ecf1-4d66-9c05-0396e0901c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:42:10.200956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaa394-ecf1-4d66-9c05-0396e0901c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:10.210424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaa394-ecf1-4d66-9c05-0396e0901c96 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:10.238008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c26d61-c569-4b94-b260-a022e0a8548f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:10.243755 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2664/5333] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:10.251807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c26d61-c569-4b94-b260-a022e0a8548f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:10.262339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71e789-007b-4b96-be53-8bd4efbb0c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:10.263049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71e789-007b-4b96-be53-8bd4efbb0c9f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:10.263444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71e789-007b-4b96-be53-8bd4efbb0c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:10.263785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71e789-007b-4b96-be53-8bd4efbb0c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:10.264573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71e789-007b-4b96-be53-8bd4efbb0c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:10.266571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71e789-007b-4b96-be53-8bd4efbb0c9f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:10.316421 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2670/5334] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:10 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:10.325794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaa394-ecf1-4d66-9c05-0396e0901c96 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:10.338976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaa394-ecf1-4d66-9c05-0396e0901c96 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:10.393973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:10.413551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124d532-dbb8-4d65-b98b-5cd64f0540dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:10.414199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124d532-dbb8-4d65-b98b-5cd64f0540dc admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:10.414475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124d532-dbb8-4d65-b98b-5cd64f0540dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:10.414743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124d532-dbb8-4d65-b98b-5cd64f0540dc admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:10.415440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124d532-dbb8-4d65-b98b-5cd64f0540dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:10.417432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124d532-dbb8-4d65-b98b-5cd64f0540dc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:10.451947 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2665/5335] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:10 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:10.453650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71e789-007b-4b96-be53-8bd4efbb0c9f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:10.468700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71e789-007b-4b96-be53-8bd4efbb0c9f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:10.479893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2d2e0-496b-48f4-9497-6e388752c324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:10.482859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2d2e0-496b-48f4-9497-6e388752c324 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:10.483292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2d2e0-496b-48f4-9497-6e388752c324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:10.483839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2d2e0-496b-48f4-9497-6e388752c324 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:10.485622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2d2e0-496b-48f4-9497-6e388752c324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:10.490027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2d2e0-496b-48f4-9497-6e388752c324 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:10.516625 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2671/5336] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:10.518489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124d532-dbb8-4d65-b98b-5cd64f0540dc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:10.531720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124d532-dbb8-4d65-b98b-5cd64f0540dc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:10.544960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b0ecd-0465-46f0-9ce7-46aa17840dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:10.545529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b0ecd-0465-46f0-9ce7-46aa17840dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:10.545812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b0ecd-0465-46f0-9ce7-46aa17840dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:10.546091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b0ecd-0465-46f0-9ce7-46aa17840dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:10.546747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b0ecd-0465-46f0-9ce7-46aa17840dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:10.548404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b0ecd-0465-46f0-9ce7-46aa17840dc3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:10.572818 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2666/5337] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:10.574422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2d2e0-496b-48f4-9497-6e388752c324 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:10.588781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2d2e0-496b-48f4-9497-6e388752c324 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:10.595690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971878e-ff22-4fd7-b991-306e0abf305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:10.596588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971878e-ff22-4fd7-b991-306e0abf305c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:10.596912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971878e-ff22-4fd7-b991-306e0abf305c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:10.597191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971878e-ff22-4fd7-b991-306e0abf305c admin admin] PATH_INFO: `/v3/projects/1b3d01a726a945078cfdea17ec4d5561/users/62da9bfcbec14a71b73a8cd48e737e11/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:10.620003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971878e-ff22-4fd7-b991-306e0abf305c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b3d01a726a945078cfdea17ec4d5561, user_id=62da9bfcbec14a71b73a8cd48e737e11, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:10.623684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971878e-ff22-4fd7-b991-306e0abf305c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:10.640865 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2672/5338] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:10 2022] PUT /identity/v3/projects/1b3d01a726a945078cfdea17ec4d5561/users/62da9bfcbec14a71b73a8cd48e737e11/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:10.651908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224301c-c837-4ee5-9640-86008aa0c39c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:10.651908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224301c-c837-4ee5-9640-86008aa0c39c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:10.652121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224301c-c837-4ee5-9640-86008aa0c39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:10.694695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e224301c-c837-4ee5-9640-86008aa0c39c None None] MFA Rules not processed for user `62da9bfcbec14a71b73a8cd48e737e11`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:10.696832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e224301c-c837-4ee5-9640-86008aa0c39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:10.819692 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2667/5339] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:10.827906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971878e-ff22-4fd7-b991-306e0abf305c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:10.830179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a971878e-ff22-4fd7-b991-306e0abf305c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:10.930690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:10.970733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971878e-ff22-4fd7-b991-306e0abf305c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:10.977914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870ba1c-4d93-4609-8b12-7da0a153a727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:10.978594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870ba1c-4d93-4609-8b12-7da0a153a727 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:10.978894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870ba1c-4d93-4609-8b12-7da0a153a727 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:10.979113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870ba1c-4d93-4609-8b12-7da0a153a727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:11.002895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870ba1c-4d93-4609-8b12-7da0a153a727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:11.005937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870ba1c-4d93-4609-8b12-7da0a153a727 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:11.024464 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2673/5340] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:11.061234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224301c-c837-4ee5-9640-86008aa0c39c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:11.064050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e224301c-c837-4ee5-9640-86008aa0c39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:11.214080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224301c-c837-4ee5-9640-86008aa0c39c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:11.231075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408e48d-5ecd-4310-9179-9da93e1b0421 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4ef7f6e94449499dfabf01527d6f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f3be7eac85449c7bf9b0e1f8b997931', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:11.232083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e48d-5ecd-4310-9179-9da93e1b0421 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:11.232617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e48d-5ecd-4310-9179-9da93e1b0421 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:11.233146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e48d-5ecd-4310-9179-9da93e1b0421 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:11.234036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408e48d-5ecd-4310-9179-9da93e1b0421 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:42:11.235384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408e48d-5ecd-4310-9179-9da93e1b0421 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:11.238099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408e48d-5ecd-4310-9179-9da93e1b0421 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:11.265264 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2668/5341] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:11.269939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870ba1c-4d93-4609-8b12-7da0a153a727 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:11.286161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870ba1c-4d93-4609-8b12-7da0a153a727 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:11.294828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5cdea-9093-4256-9e22-32a2f1a7a06c tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4ef7f6e94449499dfabf01527d6f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f3be7eac85449c7bf9b0e1f8b997931', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:11.295923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5cdea-9093-4256-9e22-32a2f1a7a06c tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:11.296435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5cdea-9093-4256-9e22-32a2f1a7a06c tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:11.299439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5cdea-9093-4256-9e22-32a2f1a7a06c tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:11.300491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5cdea-9093-4256-9e22-32a2f1a7a06c tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:11.302682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5cdea-9093-4256-9e22-32a2f1a7a06c tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:11.393848 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2674/5342] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:11 2022] POST /identity/v3/projects => generated 346 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:11.396342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408e48d-5ecd-4310-9179-9da93e1b0421 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:11.408949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408e48d-5ecd-4310-9179-9da93e1b0421 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:11.519628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:11.549897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388df842-34a6-4120-ade0-2a5b1e0e5a24 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4ef7f6e94449499dfabf01527d6f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f3be7eac85449c7bf9b0e1f8b997931', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:11.549897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388df842-34a6-4120-ade0-2a5b1e0e5a24 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:11.550598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388df842-34a6-4120-ade0-2a5b1e0e5a24 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:11.550598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388df842-34a6-4120-ade0-2a5b1e0e5a24 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:11.551282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388df842-34a6-4120-ade0-2a5b1e0e5a24 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:42:11.551720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388df842-34a6-4120-ade0-2a5b1e0e5a24 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:11.558233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388df842-34a6-4120-ade0-2a5b1e0e5a24 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:11.578538 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2669/5343] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:42:12.070273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5cdea-9093-4256-9e22-32a2f1a7a06c tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:12.093463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5cdea-9093-4256-9e22-32a2f1a7a06c tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:12.098887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4ef7f6e94449499dfabf01527d6f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f3be7eac85449c7bf9b0e1f8b997931', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:12.099696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:12.100047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:12.100415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] PATH_INFO: `/v3/projects/431feb370e9140f8b6b1a19406e0c55a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:12.101725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] RBAC: Authorizing `identity:delete_project(project_id=431feb370e9140f8b6b1a19406e0c55a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:12.103794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:12.163748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431feb370e9140f8b6b1a19406e0c55a', 'request_id': 'req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:12.173591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431feb370e9140f8b6b1a19406e0c55a', 'request_id': 'req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:12.181163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431feb370e9140f8b6b1a19406e0c55a', 'request_id': 'req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:12.195066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] The token cache is being invalidate because project 431feb370e9140f8b6b1a19406e0c55a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:12.195427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:12.196051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:12.197810 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2675/5344] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:12 2022] DELETE /identity/v3/projects/431feb370e9140f8b6b1a19406e0c55a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:12.209945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388df842-34a6-4120-ade0-2a5b1e0e5a24 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:12.212643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-388df842-34a6-4120-ade0-2a5b1e0e5a24 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:12.290376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388df842-34a6-4120-ade0-2a5b1e0e5a24 tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:12.345590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada93e2b-6588-4d6c-8756-5f3c43e7f435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:12.346420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada93e2b-6588-4d6c-8756-5f3c43e7f435 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:12.346627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada93e2b-6588-4d6c-8756-5f3c43e7f435 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:12.346886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada93e2b-6588-4d6c-8756-5f3c43e7f435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:12.348700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ada93e2b-6588-4d6c-8756-5f3c43e7f435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:12.426750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada93e2b-6588-4d6c-8756-5f3c43e7f435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:12.428263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada93e2b-6588-4d6c-8756-5f3c43e7f435 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:12.443320 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2670/5345] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:13.609392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:13.611124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:13.753715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16aa7c-888d-4ea6-ab66-8b95c481eb4d tempest-RoutersAdminTest-1202737848 tempest-RoutersAdminTest-1202737848-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:13.766374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb33d7-ea24-4f0d-a10c-bd616e4b4209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:13.767167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb33d7-ea24-4f0d-a10c-bd616e4b4209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:13.767475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb33d7-ea24-4f0d-a10c-bd616e4b4209 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:13.767754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb33d7-ea24-4f0d-a10c-bd616e4b4209 admin admin] PATH_INFO: `/v3/users/e9f170414bbb40fe9de7301f58db026b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:13.770815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb33d7-ea24-4f0d-a10c-bd616e4b4209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f170414bbb40fe9de7301f58db026b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:13.772811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb33d7-ea24-4f0d-a10c-bd616e4b4209 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:13.861488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:13.868373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adbb33d7-ea24-4f0d-a10c-bd616e4b4209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f170414bbb40fe9de7301f58db026b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:13.869069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adbb33d7-ea24-4f0d-a10c-bd616e4b4209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f170414bbb40fe9de7301f58db026b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:13.886300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adbb33d7-ea24-4f0d-a10c-bd616e4b4209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f170414bbb40fe9de7301f58db026b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:13.901552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adbb33d7-ea24-4f0d-a10c-bd616e4b4209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f170414bbb40fe9de7301f58db026b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:13.925907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adbb33d7-ea24-4f0d-a10c-bd616e4b4209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f170414bbb40fe9de7301f58db026b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:13.937588 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2676/5346] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:13 2022] DELETE /identity/v3/users/e9f170414bbb40fe9de7301f58db026b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:13.940415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dba84-7eed-4604-8836-a819790fec42 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:13.941200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dba84-7eed-4604-8836-a819790fec42 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:13.941902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dba84-7eed-4604-8836-a819790fec42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:13.966338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2f3dba84-7eed-4604-8836-a819790fec42 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:13.968151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2f3dba84-7eed-4604-8836-a819790fec42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:14.033396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:14.050567 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2671/5347] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:42:14.064712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb33d7-ea24-4f0d-a10c-bd616e4b4209 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:14.067901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-adbb33d7-ea24-4f0d-a10c-bd616e4b4209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:14.152065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb33d7-ea24-4f0d-a10c-bd616e4b4209 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:14.160151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914a03f-9acd-40db-9ea4-0c521cfed40f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:14.161283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914a03f-9acd-40db-9ea4-0c521cfed40f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:14.162499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914a03f-9acd-40db-9ea4-0c521cfed40f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:14.163049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914a03f-9acd-40db-9ea4-0c521cfed40f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:14.188055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914a03f-9acd-40db-9ea4-0c521cfed40f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:14.189714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914a03f-9acd-40db-9ea4-0c521cfed40f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:14.218976 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2677/5348] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:14.591605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3dba84-7eed-4604-8836-a819790fec42 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:14.593746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2f3dba84-7eed-4604-8836-a819790fec42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:14.614292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3dba84-7eed-4604-8836-a819790fec42 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:14.621114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878ffd7-693a-45e8-8234-df7b95a13cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:14.621695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878ffd7-693a-45e8-8234-df7b95a13cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:14.622135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878ffd7-693a-45e8-8234-df7b95a13cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:14.622419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878ffd7-693a-45e8-8234-df7b95a13cb9 admin admin] PATH_INFO: `/v3/projects/5050a9a7ac4647cfb5645026cbea14c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:14.623854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878ffd7-693a-45e8-8234-df7b95a13cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5050a9a7ac4647cfb5645026cbea14c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:14.626438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878ffd7-693a-45e8-8234-df7b95a13cb9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:14.704805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d878ffd7-693a-45e8-8234-df7b95a13cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5050a9a7ac4647cfb5645026cbea14c8', 'request_id': 'req-d878ffd7-693a-45e8-8234-df7b95a13cb9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:14.716611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d878ffd7-693a-45e8-8234-df7b95a13cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5050a9a7ac4647cfb5645026cbea14c8', 'request_id': 'req-d878ffd7-693a-45e8-8234-df7b95a13cb9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:14.724375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d878ffd7-693a-45e8-8234-df7b95a13cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5050a9a7ac4647cfb5645026cbea14c8', 'request_id': 'req-d878ffd7-693a-45e8-8234-df7b95a13cb9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:14.748780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d878ffd7-693a-45e8-8234-df7b95a13cb9 admin admin] The token cache is being invalidate because project 5050a9a7ac4647cfb5645026cbea14c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:14.749140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d878ffd7-693a-45e8-8234-df7b95a13cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:14.750784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d878ffd7-693a-45e8-8234-df7b95a13cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:14.756932 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2672/5349] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:14 2022] DELETE /identity/v3/projects/5050a9a7ac4647cfb5645026cbea14c8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:14.757813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c22dd-6773-4401-bce6-f016ed4330ee None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:14.758266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c22dd-6773-4401-bce6-f016ed4330ee None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:14.758426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c22dd-6773-4401-bce6-f016ed4330ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:14.794848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-104c22dd-6773-4401-bce6-f016ed4330ee None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:14.797450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-104c22dd-6773-4401-bce6-f016ed4330ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:14.982061 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2678/5350] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:14.992834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd8226-53f4-4f5f-bcbb-9920121c5b6a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:14.993351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd8226-53f4-4f5f-bcbb-9920121c5b6a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:14.994331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd8226-53f4-4f5f-bcbb-9920121c5b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:15.021675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-93fd8226-53f4-4f5f-bcbb-9920121c5b6a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:15.023147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-93fd8226-53f4-4f5f-bcbb-9920121c5b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:15.036992 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2673/5351] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:15.042261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c22dd-6773-4401-bce6-f016ed4330ee None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:15.054476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c22dd-6773-4401-bce6-f016ed4330ee None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:15.059630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f852e-7a3d-48fc-b579-3db732dcbe95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:15.060251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f852e-7a3d-48fc-b579-3db732dcbe95 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:15.060573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f852e-7a3d-48fc-b579-3db732dcbe95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:15.061035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f852e-7a3d-48fc-b579-3db732dcbe95 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:15.061701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f852e-7a3d-48fc-b579-3db732dcbe95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:42:15.062006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f852e-7a3d-48fc-b579-3db732dcbe95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:15.065580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f852e-7a3d-48fc-b579-3db732dcbe95 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:15.091519 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2679/5352] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:15.095889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd8226-53f4-4f5f-bcbb-9920121c5b6a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:15.106539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd8226-53f4-4f5f-bcbb-9920121c5b6a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:15.112234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b233a-46a6-4852-9287-15018107a211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:15.113234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b233a-46a6-4852-9287-15018107a211 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:15.113234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b233a-46a6-4852-9287-15018107a211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:15.113548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b233a-46a6-4852-9287-15018107a211 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:15.114035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b233a-46a6-4852-9287-15018107a211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:15.116618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b233a-46a6-4852-9287-15018107a211 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:15.166076 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2674/5353] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:15 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:15.166708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f852e-7a3d-48fc-b579-3db732dcbe95 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:15.182029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f852e-7a3d-48fc-b579-3db732dcbe95 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:15.257226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:15.274464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9255840-59b3-4262-bcf8-48d8888d384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:15.275068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9255840-59b3-4262-bcf8-48d8888d384a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:15.276904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9255840-59b3-4262-bcf8-48d8888d384a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:15.276904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9255840-59b3-4262-bcf8-48d8888d384a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:15.277523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9255840-59b3-4262-bcf8-48d8888d384a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:15.279871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9255840-59b3-4262-bcf8-48d8888d384a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:15.310942 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2680/5354] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:15 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:15.312238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b233a-46a6-4852-9287-15018107a211 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:15.324497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b233a-46a6-4852-9287-15018107a211 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:15.330959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e93e7-5842-4921-b64b-079b64193524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:15.331835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e93e7-5842-4921-b64b-079b64193524 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:15.332483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e93e7-5842-4921-b64b-079b64193524 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:15.332798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e93e7-5842-4921-b64b-079b64193524 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:15.333812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e93e7-5842-4921-b64b-079b64193524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:15.335617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e93e7-5842-4921-b64b-079b64193524 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:15.358405 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2675/5355] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:15.362494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9255840-59b3-4262-bcf8-48d8888d384a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:15.373125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9255840-59b3-4262-bcf8-48d8888d384a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:15.378082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b31aaf-0db5-48a8-a4cd-b6fb5d222cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:15.378756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b31aaf-0db5-48a8-a4cd-b6fb5d222cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:15.379436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b31aaf-0db5-48a8-a4cd-b6fb5d222cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:15.379673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b31aaf-0db5-48a8-a4cd-b6fb5d222cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:15.380342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b31aaf-0db5-48a8-a4cd-b6fb5d222cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:15.381965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b31aaf-0db5-48a8-a4cd-b6fb5d222cf8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:15.402942 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2681/5356] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:15.407350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e93e7-5842-4921-b64b-079b64193524 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:15.420953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e93e7-5842-4921-b64b-079b64193524 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:15.428347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88bdee-3f7c-4160-8e5c-8d89d07f0f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:15.429273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88bdee-3f7c-4160-8e5c-8d89d07f0f66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:15.429557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88bdee-3f7c-4160-8e5c-8d89d07f0f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:15.429832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88bdee-3f7c-4160-8e5c-8d89d07f0f66 admin admin] PATH_INFO: `/v3/projects/a258fc7f8cc849f7acd173ca4e49abaa/users/17d15356bf2941b2927f238f00ec836f/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:15.448551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88bdee-3f7c-4160-8e5c-8d89d07f0f66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a258fc7f8cc849f7acd173ca4e49abaa, user_id=17d15356bf2941b2927f238f00ec836f, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:15.451627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88bdee-3f7c-4160-8e5c-8d89d07f0f66 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:15.484418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2c671-6297-4b85-a4d1-08d678178183 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:15.484714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2c671-6297-4b85-a4d1-08d678178183 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:15.484995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2c671-6297-4b85-a4d1-08d678178183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:15.489025 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2676/5357] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:15 2022] PUT /identity/v3/projects/a258fc7f8cc849f7acd173ca4e49abaa/users/17d15356bf2941b2927f238f00ec836f/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:15.508700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d2a2c671-6297-4b85-a4d1-08d678178183 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:15.509877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d2a2c671-6297-4b85-a4d1-08d678178183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:15.584057 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2682/5358] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:15.594227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88bdee-3f7c-4160-8e5c-8d89d07f0f66 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:15.596148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c88bdee-3f7c-4160-8e5c-8d89d07f0f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:15.666710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88bdee-3f7c-4160-8e5c-8d89d07f0f66 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:15.672377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871208a4-82c2-4cf3-862f-a9a2e6fac72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:15.673308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871208a4-82c2-4cf3-862f-a9a2e6fac72e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:15.673743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871208a4-82c2-4cf3-862f-a9a2e6fac72e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:15.674276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871208a4-82c2-4cf3-862f-a9a2e6fac72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:15.686157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871208a4-82c2-4cf3-862f-a9a2e6fac72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:15.688802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871208a4-82c2-4cf3-862f-a9a2e6fac72e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:15.704038 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2677/5359] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:16.354375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2c671-6297-4b85-a4d1-08d678178183 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:16.356187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d2a2c671-6297-4b85-a4d1-08d678178183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:16.531952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2c671-6297-4b85-a4d1-08d678178183 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:16.543336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129996e0-0110-47a7-97e3-2a740565bbfc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:16.543994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129996e0-0110-47a7-97e3-2a740565bbfc service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:16.544268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129996e0-0110-47a7-97e3-2a740565bbfc service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:16.544549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129996e0-0110-47a7-97e3-2a740565bbfc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:16.548966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-129996e0-0110-47a7-97e3-2a740565bbfc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:16.594650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129996e0-0110-47a7-97e3-2a740565bbfc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:16.596270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129996e0-0110-47a7-97e3-2a740565bbfc service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:16.615245 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2683/5360] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:17.357527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4900020-e053-4a7d-b1d1-f71bfbb938f5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:17.358005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4900020-e053-4a7d-b1d1-f71bfbb938f5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:17.358324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4900020-e053-4a7d-b1d1-f71bfbb938f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:17.401035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d4900020-e053-4a7d-b1d1-f71bfbb938f5 None None] MFA Rules not processed for user `17d15356bf2941b2927f238f00ec836f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:17.402375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d4900020-e053-4a7d-b1d1-f71bfbb938f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:17.407234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:17.570050 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2678/5361] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:17.586181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129996e0-0110-47a7-97e3-2a740565bbfc service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:17.587539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-129996e0-0110-47a7-97e3-2a740565bbfc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:17.694404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129996e0-0110-47a7-97e3-2a740565bbfc service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:17.699327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8f908-642a-40cf-a600-a75ae233ba8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:17.700040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8f908-642a-40cf-a600-a75ae233ba8a service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:17.700798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8f908-642a-40cf-a600-a75ae233ba8a service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:17.701169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8f908-642a-40cf-a600-a75ae233ba8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:17.714618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8f908-642a-40cf-a600-a75ae233ba8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:17.716236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8f908-642a-40cf-a600-a75ae233ba8a service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:17.726864 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2684/5362] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:19.247785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b690e4-1744-4c31-8698-9cc2ef29e225 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:19.248698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b690e4-1744-4c31-8698-9cc2ef29e225 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:19.248698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b690e4-1744-4c31-8698-9cc2ef29e225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:19.271304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-95b690e4-1744-4c31-8698-9cc2ef29e225 None None] MFA Rules not processed for user `17d15356bf2941b2927f238f00ec836f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:19.272556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-95b690e4-1744-4c31-8698-9cc2ef29e225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:19.283341 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2679/5363] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:20.985664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8f908-642a-40cf-a600-a75ae233ba8a service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:20.986215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-53d8f908-642a-40cf-a600-a75ae233ba8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:21.003471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:21.014796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8f908-642a-40cf-a600-a75ae233ba8a service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:21.026358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06204c83-7bfa-47fb-87e7-b2d4020e3ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:21.027343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06204c83-7bfa-47fb-87e7-b2d4020e3ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:21.027736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06204c83-7bfa-47fb-87e7-b2d4020e3ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:21.028784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06204c83-7bfa-47fb-87e7-b2d4020e3ae4 admin admin] PATH_INFO: `/v3/users/62da9bfcbec14a71b73a8cd48e737e11` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:21.030956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06204c83-7bfa-47fb-87e7-b2d4020e3ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62da9bfcbec14a71b73a8cd48e737e11)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:21.062114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06204c83-7bfa-47fb-87e7-b2d4020e3ae4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:21.179927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06204c83-7bfa-47fb-87e7-b2d4020e3ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62da9bfcbec14a71b73a8cd48e737e11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:21.182657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06204c83-7bfa-47fb-87e7-b2d4020e3ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62da9bfcbec14a71b73a8cd48e737e11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:21.199581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06204c83-7bfa-47fb-87e7-b2d4020e3ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62da9bfcbec14a71b73a8cd48e737e11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:21.221783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06204c83-7bfa-47fb-87e7-b2d4020e3ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62da9bfcbec14a71b73a8cd48e737e11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:21.244536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06204c83-7bfa-47fb-87e7-b2d4020e3ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62da9bfcbec14a71b73a8cd48e737e11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:21.263395 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2685/5364] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:20 2022] DELETE /identity/v3/users/62da9bfcbec14a71b73a8cd48e737e11 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:21.267956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2739e-ec15-4509-9263-fde2bddb2952 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:21.269217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2739e-ec15-4509-9263-fde2bddb2952 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:21.271282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2739e-ec15-4509-9263-fde2bddb2952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:21.305892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-59c2739e-ec15-4509-9263-fde2bddb2952 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:21.309239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-59c2739e-ec15-4509-9263-fde2bddb2952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:21.421475 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2680/5365] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:21.422500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06204c83-7bfa-47fb-87e7-b2d4020e3ae4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:21.424287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-06204c83-7bfa-47fb-87e7-b2d4020e3ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:21.509405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06204c83-7bfa-47fb-87e7-b2d4020e3ae4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:21.513846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a23f0-f344-4a2b-937e-fea1b82209c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:21.514474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a23f0-f344-4a2b-937e-fea1b82209c7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:21.515825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a23f0-f344-4a2b-937e-fea1b82209c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:21.516119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a23f0-f344-4a2b-937e-fea1b82209c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:21.528012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a23f0-f344-4a2b-937e-fea1b82209c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:21.529590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a23f0-f344-4a2b-937e-fea1b82209c7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:21.543505 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2686/5366] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:21.968281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2739e-ec15-4509-9263-fde2bddb2952 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:21.970353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-59c2739e-ec15-4509-9263-fde2bddb2952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:21.990646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2739e-ec15-4509-9263-fde2bddb2952 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:22.012086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19349cc1-3389-4615-b4ee-42b03c192736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:22.013361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19349cc1-3389-4615-b4ee-42b03c192736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:22.015350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19349cc1-3389-4615-b4ee-42b03c192736 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:22.016012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19349cc1-3389-4615-b4ee-42b03c192736 admin admin] PATH_INFO: `/v3/projects/1b3d01a726a945078cfdea17ec4d5561` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:22.017631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19349cc1-3389-4615-b4ee-42b03c192736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b3d01a726a945078cfdea17ec4d5561)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:22.020042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19349cc1-3389-4615-b4ee-42b03c192736 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:22.134277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-19349cc1-3389-4615-b4ee-42b03c192736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b3d01a726a945078cfdea17ec4d5561', 'request_id': 'req-19349cc1-3389-4615-b4ee-42b03c192736'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:22.146232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-19349cc1-3389-4615-b4ee-42b03c192736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b3d01a726a945078cfdea17ec4d5561', 'request_id': 'req-19349cc1-3389-4615-b4ee-42b03c192736'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:22.171127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-19349cc1-3389-4615-b4ee-42b03c192736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b3d01a726a945078cfdea17ec4d5561', 'request_id': 'req-19349cc1-3389-4615-b4ee-42b03c192736'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:22.194992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-19349cc1-3389-4615-b4ee-42b03c192736 admin admin] The token cache is being invalidate because project 1b3d01a726a945078cfdea17ec4d5561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:22.195267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-19349cc1-3389-4615-b4ee-42b03c192736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:22.196213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-19349cc1-3389-4615-b4ee-42b03c192736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:22.198733 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2681/5367] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:21 2022] DELETE /identity/v3/projects/1b3d01a726a945078cfdea17ec4d5561 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:22.203944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bb4e4-bd0c-42b1-9930-512c7ca74da3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:22.204689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bb4e4-bd0c-42b1-9930-512c7ca74da3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:22.204689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bb4e4-bd0c-42b1-9930-512c7ca74da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:22.235481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f73bb4e4-bd0c-42b1-9930-512c7ca74da3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:22.237022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f73bb4e4-bd0c-42b1-9930-512c7ca74da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:22.319059 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2687/5368] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:22.329477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55251dad-9436-4e39-8aab-14ad7aeb4bca None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:22.330081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55251dad-9436-4e39-8aab-14ad7aeb4bca None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:22.330359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55251dad-9436-4e39-8aab-14ad7aeb4bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:22.366930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-55251dad-9436-4e39-8aab-14ad7aeb4bca None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:22.368268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-55251dad-9436-4e39-8aab-14ad7aeb4bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:22.392707 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2682/5369] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:22.396979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bb4e4-bd0c-42b1-9930-512c7ca74da3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:22.409720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bb4e4-bd0c-42b1-9930-512c7ca74da3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:22.416698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e891528-92ef-489c-b0fb-e5451053d9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:22.417416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891528-92ef-489c-b0fb-e5451053d9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:22.417800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891528-92ef-489c-b0fb-e5451053d9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:22.418233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891528-92ef-489c-b0fb-e5451053d9f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:22.428420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e891528-92ef-489c-b0fb-e5451053d9f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:42:22.428982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e891528-92ef-489c-b0fb-e5451053d9f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:22.431054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e891528-92ef-489c-b0fb-e5451053d9f7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:22.461346 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2688/5370] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:22.465758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55251dad-9436-4e39-8aab-14ad7aeb4bca None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:22.477697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55251dad-9436-4e39-8aab-14ad7aeb4bca None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:22.484902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22f65b-569d-455b-89ea-e66fcafc9dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:22.486367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22f65b-569d-455b-89ea-e66fcafc9dcb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:22.486906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22f65b-569d-455b-89ea-e66fcafc9dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:22.487392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22f65b-569d-455b-89ea-e66fcafc9dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:22.489841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22f65b-569d-455b-89ea-e66fcafc9dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:22.501721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22f65b-569d-455b-89ea-e66fcafc9dcb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:22.546784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:22.578154 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2683/5371] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:22 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:22.579487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e891528-92ef-489c-b0fb-e5451053d9f7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:22.592826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:22.601653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e891528-92ef-489c-b0fb-e5451053d9f7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:22.733485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d44350-b500-4317-918b-14b99966d975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:22.734479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d44350-b500-4317-918b-14b99966d975 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:22.734963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d44350-b500-4317-918b-14b99966d975 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:22.735675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d44350-b500-4317-918b-14b99966d975 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:22.737340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d44350-b500-4317-918b-14b99966d975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:22.756944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d44350-b500-4317-918b-14b99966d975 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:22.803389 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2689/5372] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:22 2022] POST /identity/v3/users => generated 288 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:22.807447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22f65b-569d-455b-89ea-e66fcafc9dcb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:22.824557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22f65b-569d-455b-89ea-e66fcafc9dcb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:22.833608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f405a0-59c0-40e1-843f-73b215480c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:22.834553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f405a0-59c0-40e1-843f-73b215480c60 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:22.834996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f405a0-59c0-40e1-843f-73b215480c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:22.836033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f405a0-59c0-40e1-843f-73b215480c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:22.836899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f405a0-59c0-40e1-843f-73b215480c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:22.840865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f405a0-59c0-40e1-843f-73b215480c60 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:22.856514 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2684/5373] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:22.861238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d44350-b500-4317-918b-14b99966d975 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:22.874797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d44350-b500-4317-918b-14b99966d975 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:22.880028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b080b-9bed-4138-a21e-57b4fca51ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:22.880327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b080b-9bed-4138-a21e-57b4fca51ddf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:22.880585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b080b-9bed-4138-a21e-57b4fca51ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:22.880865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b080b-9bed-4138-a21e-57b4fca51ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:22.881916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b080b-9bed-4138-a21e-57b4fca51ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:22.883587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b080b-9bed-4138-a21e-57b4fca51ddf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:22.899301 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2690/5374] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:22.901795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f405a0-59c0-40e1-843f-73b215480c60 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:22.912689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f405a0-59c0-40e1-843f-73b215480c60 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:22.918441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0933ea1-7a82-4a3f-9b76-7b48356a617d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:22.919107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0933ea1-7a82-4a3f-9b76-7b48356a617d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:22.919454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0933ea1-7a82-4a3f-9b76-7b48356a617d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:22.919786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0933ea1-7a82-4a3f-9b76-7b48356a617d admin admin] PATH_INFO: `/v3/projects/8b512c3e32e44310bc545d4b97af214d/users/3589c110acff4f628fda3bffe80b6ed2/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:22.939677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0933ea1-7a82-4a3f-9b76-7b48356a617d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b512c3e32e44310bc545d4b97af214d, user_id=3589c110acff4f628fda3bffe80b6ed2, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:22.942644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0933ea1-7a82-4a3f-9b76-7b48356a617d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:22.964447 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2685/5375] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:22 2022] PUT /identity/v3/projects/8b512c3e32e44310bc545d4b97af214d/users/3589c110acff4f628fda3bffe80b6ed2/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:22.975619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e66012-f02b-4f82-8b0e-e63896327473 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:22.975619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e66012-f02b-4f82-8b0e-e63896327473 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:22.975619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e66012-f02b-4f82-8b0e-e63896327473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:23.014204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-12e66012-f02b-4f82-8b0e-e63896327473 None None] MFA Rules not processed for user `3589c110acff4f628fda3bffe80b6ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:23.016148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-12e66012-f02b-4f82-8b0e-e63896327473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:23.124308 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2691/5376] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:23.141480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0933ea1-7a82-4a3f-9b76-7b48356a617d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:23.144340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d0933ea1-7a82-4a3f-9b76-7b48356a617d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:23.285150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0933ea1-7a82-4a3f-9b76-7b48356a617d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:23.292264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5c68f-eff7-4bd2-b262-faff25399692 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:23.293001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5c68f-eff7-4bd2-b262-faff25399692 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:23.293363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5c68f-eff7-4bd2-b262-faff25399692 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:23.293755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5c68f-eff7-4bd2-b262-faff25399692 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:23.303379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5c68f-eff7-4bd2-b262-faff25399692 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:23.307478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5c68f-eff7-4bd2-b262-faff25399692 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:23.343755 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2686/5377] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:23.704528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e66012-f02b-4f82-8b0e-e63896327473 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:23.903042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e66012-f02b-4f82-8b0e-e63896327473 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:23.925543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed93e4-5e9c-4f1c-b1ae-250a5aa651c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:23.926422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed93e4-5e9c-4f1c-b1ae-250a5aa651c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:23.926701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed93e4-5e9c-4f1c-b1ae-250a5aa651c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:23.927025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed93e4-5e9c-4f1c-b1ae-250a5aa651c5 admin admin] PATH_INFO: `/v3/users/3589c110acff4f628fda3bffe80b6ed2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:23.928762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed93e4-5e9c-4f1c-b1ae-250a5aa651c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3589c110acff4f628fda3bffe80b6ed2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:23.935070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed93e4-5e9c-4f1c-b1ae-250a5aa651c5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:23.986003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:24.112460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97ed93e4-5e9c-4f1c-b1ae-250a5aa651c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3589c110acff4f628fda3bffe80b6ed2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:24.113314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97ed93e4-5e9c-4f1c-b1ae-250a5aa651c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3589c110acff4f628fda3bffe80b6ed2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:24.126983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97ed93e4-5e9c-4f1c-b1ae-250a5aa651c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3589c110acff4f628fda3bffe80b6ed2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:24.154834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97ed93e4-5e9c-4f1c-b1ae-250a5aa651c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3589c110acff4f628fda3bffe80b6ed2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:24.207219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97ed93e4-5e9c-4f1c-b1ae-250a5aa651c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3589c110acff4f628fda3bffe80b6ed2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:24.228031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f31ce-0ab3-49ba-94d9-f3ac12997af2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:24.228476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f31ce-0ab3-49ba-94d9-f3ac12997af2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:24.228913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f31ce-0ab3-49ba-94d9-f3ac12997af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:24.237934 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2692/5378] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:23 2022] DELETE /identity/v3/users/3589c110acff4f628fda3bffe80b6ed2 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:24.274014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5e4f31ce-0ab3-49ba-94d9-f3ac12997af2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:24.275774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5e4f31ce-0ab3-49ba-94d9-f3ac12997af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:24.422903 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2687/5379] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:24.438373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed93e4-5e9c-4f1c-b1ae-250a5aa651c5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:24.440246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97ed93e4-5e9c-4f1c-b1ae-250a5aa651c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:24.535169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed93e4-5e9c-4f1c-b1ae-250a5aa651c5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:24.541846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4363d-d744-4be8-ac50-481a4f82f82f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:24.543413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4363d-d744-4be8-ac50-481a4f82f82f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:24.543788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4363d-d744-4be8-ac50-481a4f82f82f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:24.544159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4363d-d744-4be8-ac50-481a4f82f82f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:24.585453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4363d-d744-4be8-ac50-481a4f82f82f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:24.590846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4363d-d744-4be8-ac50-481a4f82f82f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:24.603313 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2693/5380] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:25.022290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f31ce-0ab3-49ba-94d9-f3ac12997af2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:25.024783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5e4f31ce-0ab3-49ba-94d9-f3ac12997af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:25.051644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f31ce-0ab3-49ba-94d9-f3ac12997af2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:25.060051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7de9a5-e1bc-4b13-8f22-5bce1c62a09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:25.061213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7de9a5-e1bc-4b13-8f22-5bce1c62a09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:25.061761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7de9a5-e1bc-4b13-8f22-5bce1c62a09e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:25.062284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7de9a5-e1bc-4b13-8f22-5bce1c62a09e admin admin] PATH_INFO: `/v3/projects/8b512c3e32e44310bc545d4b97af214d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:25.064396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7de9a5-e1bc-4b13-8f22-5bce1c62a09e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b512c3e32e44310bc545d4b97af214d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:25.068624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7de9a5-e1bc-4b13-8f22-5bce1c62a09e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:25.172927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:25.182730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fb7de9a5-e1bc-4b13-8f22-5bce1c62a09e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b512c3e32e44310bc545d4b97af214d', 'request_id': 'req-fb7de9a5-e1bc-4b13-8f22-5bce1c62a09e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:25.192059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fb7de9a5-e1bc-4b13-8f22-5bce1c62a09e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b512c3e32e44310bc545d4b97af214d', 'request_id': 'req-fb7de9a5-e1bc-4b13-8f22-5bce1c62a09e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:25.204104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fb7de9a5-e1bc-4b13-8f22-5bce1c62a09e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b512c3e32e44310bc545d4b97af214d', 'request_id': 'req-fb7de9a5-e1bc-4b13-8f22-5bce1c62a09e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:25.233957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fb7de9a5-e1bc-4b13-8f22-5bce1c62a09e admin admin] The token cache is being invalidate because project 8b512c3e32e44310bc545d4b97af214d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:25.234840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fb7de9a5-e1bc-4b13-8f22-5bce1c62a09e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:25.236546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fb7de9a5-e1bc-4b13-8f22-5bce1c62a09e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:25.239484 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2688/5381] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:25 2022] DELETE /identity/v3/projects/8b512c3e32e44310bc545d4b97af214d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:25.249750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d23c5-27d0-4f02-a1fc-c5f65d76f837 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:25.250560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d23c5-27d0-4f02-a1fc-c5f65d76f837 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:25.250906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d23c5-27d0-4f02-a1fc-c5f65d76f837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:25.274965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2c0d23c5-27d0-4f02-a1fc-c5f65d76f837 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:25.276495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2c0d23c5-27d0-4f02-a1fc-c5f65d76f837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:25.362822 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2694/5382] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:25.370791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa450c-8ad3-4d32-af8b-0c96d027541c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:25.371101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa450c-8ad3-4d32-af8b-0c96d027541c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:25.371572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa450c-8ad3-4d32-af8b-0c96d027541c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:25.406771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-91fa450c-8ad3-4d32-af8b-0c96d027541c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:25.408054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-91fa450c-8ad3-4d32-af8b-0c96d027541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:25.424381 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2689/5383] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:25.429995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d23c5-27d0-4f02-a1fc-c5f65d76f837 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:25.447091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d23c5-27d0-4f02-a1fc-c5f65d76f837 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:25.452509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fde1c-f1eb-4c98-95fe-0781e6c205a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:25.453139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fde1c-f1eb-4c98-95fe-0781e6c205a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:25.453419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fde1c-f1eb-4c98-95fe-0781e6c205a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:25.453695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fde1c-f1eb-4c98-95fe-0781e6c205a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:25.454393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fde1c-f1eb-4c98-95fe-0781e6c205a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:42:25.454698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fde1c-f1eb-4c98-95fe-0781e6c205a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:25.456916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fde1c-f1eb-4c98-95fe-0781e6c205a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:25.471976 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2695/5384] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:25.477225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa450c-8ad3-4d32-af8b-0c96d027541c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:25.487682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa450c-8ad3-4d32-af8b-0c96d027541c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:25.493961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8f166-c64b-4553-ad4e-bae81564545a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:25.494652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8f166-c64b-4553-ad4e-bae81564545a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:25.495317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8f166-c64b-4553-ad4e-bae81564545a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:25.495828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8f166-c64b-4553-ad4e-bae81564545a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:25.496695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8f166-c64b-4553-ad4e-bae81564545a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:25.502972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8f166-c64b-4553-ad4e-bae81564545a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:25.548893 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2690/5385] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:25 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:25.549585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fde1c-f1eb-4c98-95fe-0781e6c205a6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:25.565368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fde1c-f1eb-4c98-95fe-0781e6c205a6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:25.595375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:25.651745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e81a3-2857-4700-9f8d-30172b7942e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:25.652557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e81a3-2857-4700-9f8d-30172b7942e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:25.652891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e81a3-2857-4700-9f8d-30172b7942e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:25.653295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e81a3-2857-4700-9f8d-30172b7942e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:25.653978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e81a3-2857-4700-9f8d-30172b7942e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:25.657063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e81a3-2857-4700-9f8d-30172b7942e8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:25.688845 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2696/5386] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:25 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:25.690796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8f166-c64b-4553-ad4e-bae81564545a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:25.704844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8f166-c64b-4553-ad4e-bae81564545a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:25.710523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d2469-5c57-4d7a-a6d3-5839778c7811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:25.711180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d2469-5c57-4d7a-a6d3-5839778c7811 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:25.711560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d2469-5c57-4d7a-a6d3-5839778c7811 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:25.711829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d2469-5c57-4d7a-a6d3-5839778c7811 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:25.712485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d2469-5c57-4d7a-a6d3-5839778c7811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:25.714114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d2469-5c57-4d7a-a6d3-5839778c7811 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:25.728608 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2691/5387] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:25.732317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e81a3-2857-4700-9f8d-30172b7942e8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:25.751194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e81a3-2857-4700-9f8d-30172b7942e8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:25.772653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94119b-66c2-4588-8c73-5d19a766c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:25.773383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94119b-66c2-4588-8c73-5d19a766c47b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:25.773885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94119b-66c2-4588-8c73-5d19a766c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:25.774361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94119b-66c2-4588-8c73-5d19a766c47b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:25.775057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94119b-66c2-4588-8c73-5d19a766c47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:25.777051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94119b-66c2-4588-8c73-5d19a766c47b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:25.793698 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2697/5388] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:25.797742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d2469-5c57-4d7a-a6d3-5839778c7811 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:25.812125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d2469-5c57-4d7a-a6d3-5839778c7811 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:25.834194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c5595-b4e8-4526-b94c-c4977daa1928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:25.835113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c5595-b4e8-4526-b94c-c4977daa1928 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:25.836571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c5595-b4e8-4526-b94c-c4977daa1928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:25.836962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c5595-b4e8-4526-b94c-c4977daa1928 admin admin] PATH_INFO: `/v3/projects/f9c5a67f571a4b3b81ac643685962bf9/users/69e8b1f2602a42c2b53da3b6db48e6cb/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:25.862652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c5595-b4e8-4526-b94c-c4977daa1928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c5a67f571a4b3b81ac643685962bf9, user_id=69e8b1f2602a42c2b53da3b6db48e6cb, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:25.865907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c5595-b4e8-4526-b94c-c4977daa1928 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:25.886998 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2692/5389] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:25 2022] PUT /identity/v3/projects/f9c5a67f571a4b3b81ac643685962bf9/users/69e8b1f2602a42c2b53da3b6db48e6cb/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:25.900450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abd0de-c324-4b55-81c2-1a8d45fbb76c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:25.901195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abd0de-c324-4b55-81c2-1a8d45fbb76c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:25.901806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abd0de-c324-4b55-81c2-1a8d45fbb76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:25.936120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d4abd0de-c324-4b55-81c2-1a8d45fbb76c None None] MFA Rules not processed for user `69e8b1f2602a42c2b53da3b6db48e6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:25.937548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d4abd0de-c324-4b55-81c2-1a8d45fbb76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:26.022621 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2698/5390] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:26.024037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c5595-b4e8-4526-b94c-c4977daa1928 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:26.107773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c5595-b4e8-4526-b94c-c4977daa1928 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:26.113568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86757c7-b0cd-4a82-a669-93184bea726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:26.114969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86757c7-b0cd-4a82-a669-93184bea726b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:26.115355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86757c7-b0cd-4a82-a669-93184bea726b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:26.115690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86757c7-b0cd-4a82-a669-93184bea726b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:26.116400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86757c7-b0cd-4a82-a669-93184bea726b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:26.118820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86757c7-b0cd-4a82-a669-93184bea726b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:26.177266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abd0de-c324-4b55-81c2-1a8d45fbb76c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:26.182884 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2693/5391] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:26 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:26.190600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abd0de-c324-4b55-81c2-1a8d45fbb76c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:26.277124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aca460-6576-430f-a9da-ecf883607fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:26.277809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aca460-6576-430f-a9da-ecf883607fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:26.278001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aca460-6576-430f-a9da-ecf883607fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:26.278422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aca460-6576-430f-a9da-ecf883607fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:26.279329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aca460-6576-430f-a9da-ecf883607fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:26.281271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aca460-6576-430f-a9da-ecf883607fd3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:26.311779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86757c7-b0cd-4a82-a669-93184bea726b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:26.319797 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2699/5392] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:26 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:26.323617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86757c7-b0cd-4a82-a669-93184bea726b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:26.329462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29097370-5a21-4953-bdd2-e4e9493ea427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:26.330097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29097370-5a21-4953-bdd2-e4e9493ea427 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:26.330482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29097370-5a21-4953-bdd2-e4e9493ea427 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:26.330764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29097370-5a21-4953-bdd2-e4e9493ea427 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:26.332012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29097370-5a21-4953-bdd2-e4e9493ea427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:26.334383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29097370-5a21-4953-bdd2-e4e9493ea427 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:26.354162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aca460-6576-430f-a9da-ecf883607fd3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:26.367329 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2694/5393] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:42:26.370698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aca460-6576-430f-a9da-ecf883607fd3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:26.377022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4299b-f7f1-4d6e-a7f9-6b506be7c274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:26.377767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4299b-f7f1-4d6e-a7f9-6b506be7c274 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:26.379034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4299b-f7f1-4d6e-a7f9-6b506be7c274 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:26.379034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4299b-f7f1-4d6e-a7f9-6b506be7c274 admin admin] PATH_INFO: `/v3/projects/8203e29b74c64d54a3cc2239948d05b7/users/1a07c26f817b42f6886cb5625bc9ff10/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:26.396256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4299b-f7f1-4d6e-a7f9-6b506be7c274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8203e29b74c64d54a3cc2239948d05b7, user_id=1a07c26f817b42f6886cb5625bc9ff10, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:26.399141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4299b-f7f1-4d6e-a7f9-6b506be7c274 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:26.403657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:26.421800 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2700/5394] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:26 2022] PUT /identity/v3/projects/8203e29b74c64d54a3cc2239948d05b7/users/1a07c26f817b42f6886cb5625bc9ff10/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:26.422790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29097370-5a21-4953-bdd2-e4e9493ea427 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:26.434978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29097370-5a21-4953-bdd2-e4e9493ea427 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:26.473031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:26.502656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09b8a3-a6c0-4494-97f7-fbebf8afe570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:26.503330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09b8a3-a6c0-4494-97f7-fbebf8afe570 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:26.503619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09b8a3-a6c0-4494-97f7-fbebf8afe570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:26.503899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09b8a3-a6c0-4494-97f7-fbebf8afe570 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:26.504624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09b8a3-a6c0-4494-97f7-fbebf8afe570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:26.506286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09b8a3-a6c0-4494-97f7-fbebf8afe570 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:26.520095 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2695/5395] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:42:26.524310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4299b-f7f1-4d6e-a7f9-6b506be7c274 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:26.535434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4299b-f7f1-4d6e-a7f9-6b506be7c274 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:26.540063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a33916-f1ef-4b26-a917-da2b3e24131e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:26.540744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a33916-f1ef-4b26-a917-da2b3e24131e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:26.541020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a33916-f1ef-4b26-a917-da2b3e24131e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:26.541295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a33916-f1ef-4b26-a917-da2b3e24131e admin admin] PATH_INFO: `/v3/projects/8203e29b74c64d54a3cc2239948d05b7/users/1a07c26f817b42f6886cb5625bc9ff10/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:26.544278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a33916-f1ef-4b26-a917-da2b3e24131e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8203e29b74c64d54a3cc2239948d05b7, user_id=1a07c26f817b42f6886cb5625bc9ff10, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:26.550078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a33916-f1ef-4b26-a917-da2b3e24131e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:26.571559 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2701/5396] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:26 2022] PUT /identity/v3/projects/8203e29b74c64d54a3cc2239948d05b7/users/1a07c26f817b42f6886cb5625bc9ff10/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:26.577384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4646bcc-765a-4c7c-bb73-28bcd9730038 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:26.577668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4646bcc-765a-4c7c-bb73-28bcd9730038 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:26.578316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4646bcc-765a-4c7c-bb73-28bcd9730038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:26.619791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a4646bcc-765a-4c7c-bb73-28bcd9730038 None None] MFA Rules not processed for user `1a07c26f817b42f6886cb5625bc9ff10`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:26.621039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a4646bcc-765a-4c7c-bb73-28bcd9730038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:26.735467 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2696/5397] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:26.739409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a33916-f1ef-4b26-a917-da2b3e24131e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:26.751700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a33916-f1ef-4b26-a917-da2b3e24131e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:26.756923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34acc9-11b1-450e-9224-4ebee2b44909 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a07c26f817b42f6886cb5625bc9ff10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8203e29b74c64d54a3cc2239948d05b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:26.757780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34acc9-11b1-450e-9224-4ebee2b44909 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:26.758290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34acc9-11b1-450e-9224-4ebee2b44909 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:26.758758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34acc9-11b1-450e-9224-4ebee2b44909 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:26.759781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34acc9-11b1-450e-9224-4ebee2b44909 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:26.762646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34acc9-11b1-450e-9224-4ebee2b44909 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:26.810648 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2702/5398] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:42:26 2022] POST /identity/v3/projects => generated 349 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:26.814651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4646bcc-765a-4c7c-bb73-28bcd9730038 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:26.830257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4646bcc-765a-4c7c-bb73-28bcd9730038 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:26.921410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61270c22-d169-4282-b5d0-fb43017669c9 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a07c26f817b42f6886cb5625bc9ff10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8203e29b74c64d54a3cc2239948d05b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:26.922661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61270c22-d169-4282-b5d0-fb43017669c9 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:26.923022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61270c22-d169-4282-b5d0-fb43017669c9 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:26.924329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61270c22-d169-4282-b5d0-fb43017669c9 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:26.925170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61270c22-d169-4282-b5d0-fb43017669c9 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:26.927172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61270c22-d169-4282-b5d0-fb43017669c9 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:26.972351 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2697/5399] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:26 2022] POST /identity/v3/projects => generated 350 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:26.977346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34acc9-11b1-450e-9224-4ebee2b44909 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:27.011101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34acc9-11b1-450e-9224-4ebee2b44909 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:27.143005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f1ba6-a04d-4360-98b5-e851689fb4b3 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a07c26f817b42f6886cb5625bc9ff10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8203e29b74c64d54a3cc2239948d05b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:27.143846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f1ba6-a04d-4360-98b5-e851689fb4b3 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:27.144133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f1ba6-a04d-4360-98b5-e851689fb4b3 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:27.144406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f1ba6-a04d-4360-98b5-e851689fb4b3 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] PATH_INFO: `/v3/users/69e8b1f2602a42c2b53da3b6db48e6cb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:27.146091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f1ba6-a04d-4360-98b5-e851689fb4b3 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorizing `identity:get_user(user_id=69e8b1f2602a42c2b53da3b6db48e6cb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:27.149953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f1ba6-a04d-4360-98b5-e851689fb4b3 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:27.155836 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2703/5400] 10.222.0.27 () {58 vars in 1221 bytes} [Sun Aug 28 18:42:26 2022] GET /identity/v3/users/69e8b1f2602a42c2b53da3b6db48e6cb => generated 288 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:27.157040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61270c22-d169-4282-b5d0-fb43017669c9 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:27.172836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61270c22-d169-4282-b5d0-fb43017669c9 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:27.178943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bdc22-9f99-480a-8110-6a17e44b2aeb tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a07c26f817b42f6886cb5625bc9ff10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8203e29b74c64d54a3cc2239948d05b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:27.179653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bdc22-9f99-480a-8110-6a17e44b2aeb tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:27.179942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bdc22-9f99-480a-8110-6a17e44b2aeb tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:27.180372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bdc22-9f99-480a-8110-6a17e44b2aeb tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:27.181195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bdc22-9f99-480a-8110-6a17e44b2aeb tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:27.183136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bdc22-9f99-480a-8110-6a17e44b2aeb tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:27.239451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f1ba6-a04d-4360-98b5-e851689fb4b3 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:27.242340 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2698/5401] 10.222.0.27 () {60 vars in 1162 bytes} [Sun Aug 28 18:42:27 2022] POST /identity/v3/credentials => generated 431 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:27.268485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f1ba6-a04d-4360-98b5-e851689fb4b3 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:27.282666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a8e48-8eff-46ea-b05d-b903fb66a0dc tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a07c26f817b42f6886cb5625bc9ff10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8203e29b74c64d54a3cc2239948d05b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:27.283383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a8e48-8eff-46ea-b05d-b903fb66a0dc tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:27.284044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a8e48-8eff-46ea-b05d-b903fb66a0dc tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:27.284864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a8e48-8eff-46ea-b05d-b903fb66a0dc tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] PATH_INFO: `/v3/credentials/2f226b1c824bc6d3125518a1250848fc802ed94b79fe2ea46236ce6576b0cff2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:27.288360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a8e48-8eff-46ea-b05d-b903fb66a0dc tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=2f226b1c824bc6d3125518a1250848fc802ed94b79fe2ea46236ce6576b0cff2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:27.290348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a8e48-8eff-46ea-b05d-b903fb66a0dc tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:27.296081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a8e48-8eff-46ea-b05d-b903fb66a0dc tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=2f226b1c824bc6d3125518a1250848fc802ed94b79fe2ea46236ce6576b0cff2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:27.297805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a8e48-8eff-46ea-b05d-b903fb66a0dc tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:27.322016 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2704/5402] 10.222.0.27 () {60 vars in 1358 bytes} [Sun Aug 28 18:42:27 2022] PATCH /identity/v3/credentials/2f226b1c824bc6d3125518a1250848fc802ed94b79fe2ea46236ce6576b0cff2 => generated 437 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:27.324482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bdc22-9f99-480a-8110-6a17e44b2aeb tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:27.351469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bdc22-9f99-480a-8110-6a17e44b2aeb tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:27.374316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf57703-ee0e-4088-8d01-1a59835b78b6 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a07c26f817b42f6886cb5625bc9ff10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8203e29b74c64d54a3cc2239948d05b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:27.377122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf57703-ee0e-4088-8d01-1a59835b78b6 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:27.377383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf57703-ee0e-4088-8d01-1a59835b78b6 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:27.377687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf57703-ee0e-4088-8d01-1a59835b78b6 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] PATH_INFO: `/v3/credentials/2f226b1c824bc6d3125518a1250848fc802ed94b79fe2ea46236ce6576b0cff2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:27.382627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf57703-ee0e-4088-8d01-1a59835b78b6 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=2f226b1c824bc6d3125518a1250848fc802ed94b79fe2ea46236ce6576b0cff2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:27.388906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf57703-ee0e-4088-8d01-1a59835b78b6 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:27.396767 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2699/5403] 10.222.0.27 () {58 vars in 1335 bytes} [Sun Aug 28 18:42:27 2022] GET /identity/v3/credentials/2f226b1c824bc6d3125518a1250848fc802ed94b79fe2ea46236ce6576b0cff2 => generated 437 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:27.398068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a8e48-8eff-46ea-b05d-b903fb66a0dc tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:27.413216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a8e48-8eff-46ea-b05d-b903fb66a0dc tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:27.420155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514e6b2-93e9-4b2f-b464-ecb6d8a9978f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a07c26f817b42f6886cb5625bc9ff10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8203e29b74c64d54a3cc2239948d05b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:27.420790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514e6b2-93e9-4b2f-b464-ecb6d8a9978f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:27.421102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514e6b2-93e9-4b2f-b464-ecb6d8a9978f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:27.421458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514e6b2-93e9-4b2f-b464-ecb6d8a9978f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] PATH_INFO: `/v3/credentials/2f226b1c824bc6d3125518a1250848fc802ed94b79fe2ea46236ce6576b0cff2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:27.423921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514e6b2-93e9-4b2f-b464-ecb6d8a9978f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=2f226b1c824bc6d3125518a1250848fc802ed94b79fe2ea46236ce6576b0cff2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:27.425787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514e6b2-93e9-4b2f-b464-ecb6d8a9978f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:27.446960 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2705/5404] 10.222.0.27 () {58 vars in 1338 bytes} [Sun Aug 28 18:42:27 2022] DELETE /identity/v3/credentials/2f226b1c824bc6d3125518a1250848fc802ed94b79fe2ea46236ce6576b0cff2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:27.452240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf57703-ee0e-4088-8d01-1a59835b78b6 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:27.463366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf57703-ee0e-4088-8d01-1a59835b78b6 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:27.468530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b2283-98f2-47b3-974d-5bbbe537dcaa tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a07c26f817b42f6886cb5625bc9ff10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8203e29b74c64d54a3cc2239948d05b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:27.469538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b2283-98f2-47b3-974d-5bbbe537dcaa tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:27.470050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b2283-98f2-47b3-974d-5bbbe537dcaa tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:27.470540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b2283-98f2-47b3-974d-5bbbe537dcaa tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:27.471592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b2283-98f2-47b3-974d-5bbbe537dcaa tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:27.474649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b2283-98f2-47b3-974d-5bbbe537dcaa tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:27.501155 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2700/5405] 10.222.0.27 () {60 vars in 1162 bytes} [Sun Aug 28 18:42:27 2022] POST /identity/v3/credentials => generated 427 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:27.501994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514e6b2-93e9-4b2f-b464-ecb6d8a9978f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:27.523016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514e6b2-93e9-4b2f-b464-ecb6d8a9978f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:27.530246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b3ce5-3e0d-4883-bf4e-1ad3ebe748f9 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a07c26f817b42f6886cb5625bc9ff10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8203e29b74c64d54a3cc2239948d05b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:27.530871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b3ce5-3e0d-4883-bf4e-1ad3ebe748f9 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:27.531150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b3ce5-3e0d-4883-bf4e-1ad3ebe748f9 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:27.531497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b3ce5-3e0d-4883-bf4e-1ad3ebe748f9 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:27.532329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b3ce5-3e0d-4883-bf4e-1ad3ebe748f9 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:27.534088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b3ce5-3e0d-4883-bf4e-1ad3ebe748f9 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:27.558965 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2706/5406] 10.222.0.27 () {60 vars in 1162 bytes} [Sun Aug 28 18:42:27 2022] POST /identity/v3/credentials => generated 429 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:27.578098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b2283-98f2-47b3-974d-5bbbe537dcaa tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:27.592105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b2283-98f2-47b3-974d-5bbbe537dcaa tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:27.598501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386662cb-aa58-4aa1-9f26-4753daec07a0 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a07c26f817b42f6886cb5625bc9ff10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8203e29b74c64d54a3cc2239948d05b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:27.598996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386662cb-aa58-4aa1-9f26-4753daec07a0 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:27.599364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386662cb-aa58-4aa1-9f26-4753daec07a0 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:27.599591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386662cb-aa58-4aa1-9f26-4753daec07a0 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:27.600250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386662cb-aa58-4aa1-9f26-4753daec07a0 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:27.602037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386662cb-aa58-4aa1-9f26-4753daec07a0 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:27.612115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386662cb-aa58-4aa1-9f26-4753daec07a0 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:27.613881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386662cb-aa58-4aa1-9f26-4753daec07a0 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:27.615482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386662cb-aa58-4aa1-9f26-4753daec07a0 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:27.617824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386662cb-aa58-4aa1-9f26-4753daec07a0 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:27.623208 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2701/5407] 10.222.0.27 () {58 vars in 1140 bytes} [Sun Aug 28 18:42:27 2022] GET /identity/v3/credentials => generated 941 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:27.624076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b3ce5-3e0d-4883-bf4e-1ad3ebe748f9 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:27.647787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b3ce5-3e0d-4883-bf4e-1ad3ebe748f9 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:27.653540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8afcd3-b276-45f4-8688-8cfcf5551e6f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a07c26f817b42f6886cb5625bc9ff10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8203e29b74c64d54a3cc2239948d05b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:27.654371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8afcd3-b276-45f4-8688-8cfcf5551e6f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:27.654726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8afcd3-b276-45f4-8688-8cfcf5551e6f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:27.655079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8afcd3-b276-45f4-8688-8cfcf5551e6f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] PATH_INFO: `/v3/credentials/b29349e559ed111dcc5f7ebe0375e7602479d9e5b5bbe69486c7c2e5d83b0ffd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:27.659572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8afcd3-b276-45f4-8688-8cfcf5551e6f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=b29349e559ed111dcc5f7ebe0375e7602479d9e5b5bbe69486c7c2e5d83b0ffd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:27.661476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8afcd3-b276-45f4-8688-8cfcf5551e6f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:27.686967 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2707/5408] 10.222.0.27 () {58 vars in 1338 bytes} [Sun Aug 28 18:42:27 2022] DELETE /identity/v3/credentials/b29349e559ed111dcc5f7ebe0375e7602479d9e5b5bbe69486c7c2e5d83b0ffd => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:27.691758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386662cb-aa58-4aa1-9f26-4753daec07a0 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:27.711542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:27.715616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386662cb-aa58-4aa1-9f26-4753daec07a0 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:27.723864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1e417-73bd-46fc-b680-b246f361929f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a07c26f817b42f6886cb5625bc9ff10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8203e29b74c64d54a3cc2239948d05b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:27.724685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1e417-73bd-46fc-b680-b246f361929f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:27.725045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1e417-73bd-46fc-b680-b246f361929f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:27.725399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1e417-73bd-46fc-b680-b246f361929f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] PATH_INFO: `/v3/credentials/5076f06779f218f0b37db00a9e9ca798817d95da96c44ead22fc8734cad06d72` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:27.727784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1e417-73bd-46fc-b680-b246f361929f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=5076f06779f218f0b37db00a9e9ca798817d95da96c44ead22fc8734cad06d72)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:27.729825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1e417-73bd-46fc-b680-b246f361929f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:27.764040 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2702/5409] 10.222.0.27 () {58 vars in 1338 bytes} [Sun Aug 28 18:42:27 2022] DELETE /identity/v3/credentials/5076f06779f218f0b37db00a9e9ca798817d95da96c44ead22fc8734cad06d72 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:27.768841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8afcd3-b276-45f4-8688-8cfcf5551e6f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:27.785571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8afcd3-b276-45f4-8688-8cfcf5551e6f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:27.792250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c85cee-0105-49f4-8b01-a73e30521a24 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a07c26f817b42f6886cb5625bc9ff10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8203e29b74c64d54a3cc2239948d05b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:27.794334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c85cee-0105-49f4-8b01-a73e30521a24 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:27.794578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c85cee-0105-49f4-8b01-a73e30521a24 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:27.794866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c85cee-0105-49f4-8b01-a73e30521a24 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] PATH_INFO: `/v3/projects/2073660ee0774c1ea38826011ddc1e0b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:27.797269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c85cee-0105-49f4-8b01-a73e30521a24 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2073660ee0774c1ea38826011ddc1e0b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:27.800780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c85cee-0105-49f4-8b01-a73e30521a24 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:27.881065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05c85cee-0105-49f4-8b01-a73e30521a24 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2073660ee0774c1ea38826011ddc1e0b', 'request_id': 'req-05c85cee-0105-49f4-8b01-a73e30521a24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:27.897764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05c85cee-0105-49f4-8b01-a73e30521a24 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2073660ee0774c1ea38826011ddc1e0b', 'request_id': 'req-05c85cee-0105-49f4-8b01-a73e30521a24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:27.908176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:27.910761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05c85cee-0105-49f4-8b01-a73e30521a24 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2073660ee0774c1ea38826011ddc1e0b', 'request_id': 'req-05c85cee-0105-49f4-8b01-a73e30521a24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:27.939098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05c85cee-0105-49f4-8b01-a73e30521a24 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] The token cache is being invalidate because project 2073660ee0774c1ea38826011ddc1e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:27.939806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05c85cee-0105-49f4-8b01-a73e30521a24 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:27.941088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05c85cee-0105-49f4-8b01-a73e30521a24 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:27.946434 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2708/5410] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:27 2022] DELETE /identity/v3/projects/2073660ee0774c1ea38826011ddc1e0b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:27.949404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1e417-73bd-46fc-b680-b246f361929f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:27.952415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-79f1e417-73bd-46fc-b680-b246f361929f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:27.971555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1e417-73bd-46fc-b680-b246f361929f tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:28.080025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4be7a4-baeb-45ae-a2de-11bb75569968 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a07c26f817b42f6886cb5625bc9ff10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8203e29b74c64d54a3cc2239948d05b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:28.080817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4be7a4-baeb-45ae-a2de-11bb75569968 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:28.081205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4be7a4-baeb-45ae-a2de-11bb75569968 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:28.081710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4be7a4-baeb-45ae-a2de-11bb75569968 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] PATH_INFO: `/v3/projects/e636df578bbf48539caf8566b4e0a992` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:28.084131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4be7a4-baeb-45ae-a2de-11bb75569968 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e636df578bbf48539caf8566b4e0a992)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:28.086569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4be7a4-baeb-45ae-a2de-11bb75569968 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:28.164835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ad4be7a4-baeb-45ae-a2de-11bb75569968 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e636df578bbf48539caf8566b4e0a992', 'request_id': 'req-ad4be7a4-baeb-45ae-a2de-11bb75569968'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:28.174905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ad4be7a4-baeb-45ae-a2de-11bb75569968 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e636df578bbf48539caf8566b4e0a992', 'request_id': 'req-ad4be7a4-baeb-45ae-a2de-11bb75569968'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:28.182754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ad4be7a4-baeb-45ae-a2de-11bb75569968 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e636df578bbf48539caf8566b4e0a992', 'request_id': 'req-ad4be7a4-baeb-45ae-a2de-11bb75569968'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:28.208174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ad4be7a4-baeb-45ae-a2de-11bb75569968 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] The token cache is being invalidate because project e636df578bbf48539caf8566b4e0a992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:28.210271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ad4be7a4-baeb-45ae-a2de-11bb75569968 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:28.211546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ad4be7a4-baeb-45ae-a2de-11bb75569968 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:28.213632 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2703/5411] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:27 2022] DELETE /identity/v3/projects/e636df578bbf48539caf8566b4e0a992 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:28.234530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c85cee-0105-49f4-8b01-a73e30521a24 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:28.236489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-05c85cee-0105-49f4-8b01-a73e30521a24 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:28.342485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c85cee-0105-49f4-8b01-a73e30521a24 tempest-CredentialsTestJSON-180279799 tempest-CredentialsTestJSON-180279799-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:28.436910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc67d21-325a-4189-99a9-39ec364bfd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:28.437989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc67d21-325a-4189-99a9-39ec364bfd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:28.438272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc67d21-325a-4189-99a9-39ec364bfd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:28.438545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc67d21-325a-4189-99a9-39ec364bfd0c admin admin] PATH_INFO: `/v3/users/69e8b1f2602a42c2b53da3b6db48e6cb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:28.440234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc67d21-325a-4189-99a9-39ec364bfd0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=69e8b1f2602a42c2b53da3b6db48e6cb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:28.441858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc67d21-325a-4189-99a9-39ec364bfd0c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:28.517543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fc67d21-325a-4189-99a9-39ec364bfd0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69e8b1f2602a42c2b53da3b6db48e6cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:28.524228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fc67d21-325a-4189-99a9-39ec364bfd0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69e8b1f2602a42c2b53da3b6db48e6cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:28.560362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fc67d21-325a-4189-99a9-39ec364bfd0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69e8b1f2602a42c2b53da3b6db48e6cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:28.577925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fc67d21-325a-4189-99a9-39ec364bfd0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69e8b1f2602a42c2b53da3b6db48e6cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:28.596712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0fc67d21-325a-4189-99a9-39ec364bfd0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69e8b1f2602a42c2b53da3b6db48e6cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:28.607861 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2709/5412] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:28 2022] DELETE /identity/v3/users/69e8b1f2602a42c2b53da3b6db48e6cb => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:28.609200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099d239-1942-4d86-bcef-f714e0a58adc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:28.609662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099d239-1942-4d86-bcef-f714e0a58adc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:28.609755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099d239-1942-4d86-bcef-f714e0a58adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:28.633993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b099d239-1942-4d86-bcef-f714e0a58adc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:28.635436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b099d239-1942-4d86-bcef-f714e0a58adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:28.726608 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2704/5413] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:28.733755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc67d21-325a-4189-99a9-39ec364bfd0c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:28.735801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0fc67d21-325a-4189-99a9-39ec364bfd0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:28.759582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:28.804894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc67d21-325a-4189-99a9-39ec364bfd0c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:28.809392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce4043-c397-427d-bf34-ed965218507d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:28.810286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce4043-c397-427d-bf34-ed965218507d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:28.810481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce4043-c397-427d-bf34-ed965218507d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:28.811399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce4043-c397-427d-bf34-ed965218507d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:28.828190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce4043-c397-427d-bf34-ed965218507d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:28.830148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce4043-c397-427d-bf34-ed965218507d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:28.847169 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2710/5414] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:29.542953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099d239-1942-4d86-bcef-f714e0a58adc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:29.543979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b099d239-1942-4d86-bcef-f714e0a58adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:29.557405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099d239-1942-4d86-bcef-f714e0a58adc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:29.563155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd45e86-529a-44a7-abd8-b01806fb595c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:29.563934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd45e86-529a-44a7-abd8-b01806fb595c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:29.564555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd45e86-529a-44a7-abd8-b01806fb595c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:29.564930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd45e86-529a-44a7-abd8-b01806fb595c admin admin] PATH_INFO: `/v3/projects/f9c5a67f571a4b3b81ac643685962bf9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:29.566293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd45e86-529a-44a7-abd8-b01806fb595c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c5a67f571a4b3b81ac643685962bf9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:29.568569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd45e86-529a-44a7-abd8-b01806fb595c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:29.589451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:29.623332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4bd45e86-529a-44a7-abd8-b01806fb595c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c5a67f571a4b3b81ac643685962bf9', 'request_id': 'req-4bd45e86-529a-44a7-abd8-b01806fb595c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:29.629845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4bd45e86-529a-44a7-abd8-b01806fb595c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c5a67f571a4b3b81ac643685962bf9', 'request_id': 'req-4bd45e86-529a-44a7-abd8-b01806fb595c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:29.635727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4bd45e86-529a-44a7-abd8-b01806fb595c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c5a67f571a4b3b81ac643685962bf9', 'request_id': 'req-4bd45e86-529a-44a7-abd8-b01806fb595c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:29.650930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4bd45e86-529a-44a7-abd8-b01806fb595c admin admin] The token cache is being invalidate because project f9c5a67f571a4b3b81ac643685962bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:29.651349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4bd45e86-529a-44a7-abd8-b01806fb595c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:29.652033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4bd45e86-529a-44a7-abd8-b01806fb595c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:29.653668 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2705/5415] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:29 2022] DELETE /identity/v3/projects/f9c5a67f571a4b3b81ac643685962bf9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:29.657814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce4043-c397-427d-bf34-ed965218507d service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:29.667523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce4043-c397-427d-bf34-ed965218507d service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:29.729223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905032f7-a46c-4f36-a186-f09499c0320f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:29.729983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905032f7-a46c-4f36-a186-f09499c0320f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:29.730174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905032f7-a46c-4f36-a186-f09499c0320f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:29.730473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905032f7-a46c-4f36-a186-f09499c0320f admin admin] PATH_INFO: `/v3/users/1a07c26f817b42f6886cb5625bc9ff10` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:29.731760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905032f7-a46c-4f36-a186-f09499c0320f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a07c26f817b42f6886cb5625bc9ff10)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:29.733694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905032f7-a46c-4f36-a186-f09499c0320f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:29.784278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-905032f7-a46c-4f36-a186-f09499c0320f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a07c26f817b42f6886cb5625bc9ff10'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:29.784970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-905032f7-a46c-4f36-a186-f09499c0320f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a07c26f817b42f6886cb5625bc9ff10'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:29.792737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-905032f7-a46c-4f36-a186-f09499c0320f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a07c26f817b42f6886cb5625bc9ff10'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:29.802034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-905032f7-a46c-4f36-a186-f09499c0320f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a07c26f817b42f6886cb5625bc9ff10'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:29.815079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-905032f7-a46c-4f36-a186-f09499c0320f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a07c26f817b42f6886cb5625bc9ff10'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:29.821336 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2711/5416] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:29 2022] DELETE /identity/v3/users/1a07c26f817b42f6886cb5625bc9ff10 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:30.712779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd45e86-529a-44a7-abd8-b01806fb595c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:30.715214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4bd45e86-529a-44a7-abd8-b01806fb595c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:30.730066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd45e86-529a-44a7-abd8-b01806fb595c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:30.794761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49649aa6-1cec-490e-a8b4-5e23b516572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:30.795520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49649aa6-1cec-490e-a8b4-5e23b516572a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:30.795868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49649aa6-1cec-490e-a8b4-5e23b516572a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:30.796211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49649aa6-1cec-490e-a8b4-5e23b516572a admin admin] PATH_INFO: `/v3/projects/8203e29b74c64d54a3cc2239948d05b7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:30.797450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49649aa6-1cec-490e-a8b4-5e23b516572a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8203e29b74c64d54a3cc2239948d05b7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:30.799649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49649aa6-1cec-490e-a8b4-5e23b516572a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:30.853212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49649aa6-1cec-490e-a8b4-5e23b516572a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8203e29b74c64d54a3cc2239948d05b7', 'request_id': 'req-49649aa6-1cec-490e-a8b4-5e23b516572a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:30.859676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49649aa6-1cec-490e-a8b4-5e23b516572a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8203e29b74c64d54a3cc2239948d05b7', 'request_id': 'req-49649aa6-1cec-490e-a8b4-5e23b516572a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:30.866780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49649aa6-1cec-490e-a8b4-5e23b516572a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8203e29b74c64d54a3cc2239948d05b7', 'request_id': 'req-49649aa6-1cec-490e-a8b4-5e23b516572a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:30.885764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49649aa6-1cec-490e-a8b4-5e23b516572a admin admin] The token cache is being invalidate because project 8203e29b74c64d54a3cc2239948d05b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:30.886106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49649aa6-1cec-490e-a8b4-5e23b516572a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:30.886974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49649aa6-1cec-490e-a8b4-5e23b516572a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:30.888841 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2706/5417] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:30 2022] DELETE /identity/v3/projects/8203e29b74c64d54a3cc2239948d05b7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:30.893929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1941a-f083-406b-a236-0402c469a14f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:30.894420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1941a-f083-406b-a236-0402c469a14f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:30.894532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1941a-f083-406b-a236-0402c469a14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:30.917576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c9f1941a-f083-406b-a236-0402c469a14f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:30.918782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c9f1941a-f083-406b-a236-0402c469a14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:30.955944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:30.988272 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2712/5418] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:30.996259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58952768-d6a1-4842-b87a-06815cf587b2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:30.996628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58952768-d6a1-4842-b87a-06815cf587b2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:30.996960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58952768-d6a1-4842-b87a-06815cf587b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:31.018071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-58952768-d6a1-4842-b87a-06815cf587b2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:31.019347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-58952768-d6a1-4842-b87a-06815cf587b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:31.027455 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2707/5419] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:31.031736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1941a-f083-406b-a236-0402c469a14f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:31.041790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1941a-f083-406b-a236-0402c469a14f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:31.046831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef1d7f-3556-4c40-a81d-db4403458b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:31.047537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef1d7f-3556-4c40-a81d-db4403458b9f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:31.047868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef1d7f-3556-4c40-a81d-db4403458b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:31.048210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef1d7f-3556-4c40-a81d-db4403458b9f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:31.048918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef1d7f-3556-4c40-a81d-db4403458b9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:42:31.049300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef1d7f-3556-4c40-a81d-db4403458b9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:31.050964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef1d7f-3556-4c40-a81d-db4403458b9f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:31.064352 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2713/5420] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:31.068782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58952768-d6a1-4842-b87a-06815cf587b2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:31.079530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58952768-d6a1-4842-b87a-06815cf587b2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:31.085203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf59628-4407-4be0-beee-0ed4e359d6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:31.085808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf59628-4407-4be0-beee-0ed4e359d6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:31.086074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf59628-4407-4be0-beee-0ed4e359d6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:31.086542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf59628-4407-4be0-beee-0ed4e359d6b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:31.087174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf59628-4407-4be0-beee-0ed4e359d6b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:31.089115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf59628-4407-4be0-beee-0ed4e359d6b2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:31.133699 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2708/5421] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:31 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:31.134374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef1d7f-3556-4c40-a81d-db4403458b9f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:31.148603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef1d7f-3556-4c40-a81d-db4403458b9f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:31.217935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c77c4-0025-4bfb-bcaa-502cc39f61b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:31.218841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c77c4-0025-4bfb-bcaa-502cc39f61b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:31.219133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c77c4-0025-4bfb-bcaa-502cc39f61b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:31.219436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c77c4-0025-4bfb-bcaa-502cc39f61b1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:31.220085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c77c4-0025-4bfb-bcaa-502cc39f61b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:31.222243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c77c4-0025-4bfb-bcaa-502cc39f61b1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:31.254956 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2714/5422] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:31 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:31.256570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf59628-4407-4be0-beee-0ed4e359d6b2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:31.263712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:31.268203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf59628-4407-4be0-beee-0ed4e359d6b2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:31.275359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfbf31-7a30-4ca8-b10b-87b7d6b91fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:31.276171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfbf31-7a30-4ca8-b10b-87b7d6b91fff admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:31.276715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfbf31-7a30-4ca8-b10b-87b7d6b91fff admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:31.277239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfbf31-7a30-4ca8-b10b-87b7d6b91fff admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:31.278097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfbf31-7a30-4ca8-b10b-87b7d6b91fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:31.280020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfbf31-7a30-4ca8-b10b-87b7d6b91fff admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:31.292310 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2709/5423] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:31.296389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c77c4-0025-4bfb-bcaa-502cc39f61b1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:31.307112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c77c4-0025-4bfb-bcaa-502cc39f61b1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:31.312894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d231d-9987-4c74-879c-f782e83d8fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:31.313524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d231d-9987-4c74-879c-f782e83d8fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:31.313808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d231d-9987-4c74-879c-f782e83d8fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:31.314082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d231d-9987-4c74-879c-f782e83d8fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:31.314800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d231d-9987-4c74-879c-f782e83d8fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:31.316405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d231d-9987-4c74-879c-f782e83d8fb4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:31.327763 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2715/5424] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:31.332735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfbf31-7a30-4ca8-b10b-87b7d6b91fff admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:31.343960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfbf31-7a30-4ca8-b10b-87b7d6b91fff admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:31.348705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b11007-db27-40bb-a2dd-8bb17d360baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:31.349390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b11007-db27-40bb-a2dd-8bb17d360baa admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:31.349673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b11007-db27-40bb-a2dd-8bb17d360baa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:31.349948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b11007-db27-40bb-a2dd-8bb17d360baa admin admin] PATH_INFO: `/v3/projects/b3423f9d9fad4b668a15c52445f1f88f/users/c88a6906f62841ed95ed895996fa68ca/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:31.366301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b11007-db27-40bb-a2dd-8bb17d360baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3423f9d9fad4b668a15c52445f1f88f, user_id=c88a6906f62841ed95ed895996fa68ca, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:31.369107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b11007-db27-40bb-a2dd-8bb17d360baa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:31.384428 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2710/5425] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:31 2022] PUT /identity/v3/projects/b3423f9d9fad4b668a15c52445f1f88f/users/c88a6906f62841ed95ed895996fa68ca/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:31.396385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2108f-1139-4f77-af54-817d159cab63 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:31.396671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2108f-1139-4f77-af54-817d159cab63 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:31.396993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2108f-1139-4f77-af54-817d159cab63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:31.428116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-caf2108f-1139-4f77-af54-817d159cab63 None None] MFA Rules not processed for user `c88a6906f62841ed95ed895996fa68ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:31.429351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-caf2108f-1139-4f77-af54-817d159cab63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:31.500674 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2716/5426] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:31.505483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b11007-db27-40bb-a2dd-8bb17d360baa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:31.601199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b11007-db27-40bb-a2dd-8bb17d360baa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:31.606121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97f78a-ca22-43b5-8482-14be9ec5d404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:31.606813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f78a-ca22-43b5-8482-14be9ec5d404 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:31.607204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f78a-ca22-43b5-8482-14be9ec5d404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:31.607682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f78a-ca22-43b5-8482-14be9ec5d404 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:31.608379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97f78a-ca22-43b5-8482-14be9ec5d404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:31.610347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97f78a-ca22-43b5-8482-14be9ec5d404 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:31.643815 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2711/5427] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:31 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:31.645081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2108f-1139-4f77-af54-817d159cab63 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:31.666529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2108f-1139-4f77-af54-817d159cab63 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:31.703934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:31.736086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8be9d-3aad-4121-bdcb-a66b2bea3964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:31.737334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8be9d-3aad-4121-bdcb-a66b2bea3964 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:31.737895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8be9d-3aad-4121-bdcb-a66b2bea3964 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:31.738338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8be9d-3aad-4121-bdcb-a66b2bea3964 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:31.739336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8be9d-3aad-4121-bdcb-a66b2bea3964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:31.742125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8be9d-3aad-4121-bdcb-a66b2bea3964 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:31.777159 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2717/5428] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:31 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:31.778670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97f78a-ca22-43b5-8482-14be9ec5d404 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:31.791831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97f78a-ca22-43b5-8482-14be9ec5d404 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:31.797582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086c31e-3f80-4786-9466-da7c39846d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:31.798321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086c31e-3f80-4786-9466-da7c39846d77 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:31.798697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086c31e-3f80-4786-9466-da7c39846d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:31.799068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086c31e-3f80-4786-9466-da7c39846d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:31.799969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086c31e-3f80-4786-9466-da7c39846d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:31.802225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086c31e-3f80-4786-9466-da7c39846d77 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:31.814726 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2712/5429] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:42:31.819120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8be9d-3aad-4121-bdcb-a66b2bea3964 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:31.830100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8be9d-3aad-4121-bdcb-a66b2bea3964 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:31.837310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a01cf7-d897-44af-a35e-4973be8a28e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:31.838071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a01cf7-d897-44af-a35e-4973be8a28e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:31.838442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a01cf7-d897-44af-a35e-4973be8a28e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:31.838810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a01cf7-d897-44af-a35e-4973be8a28e9 admin admin] PATH_INFO: `/v3/projects/3ccf03ec9a664ea8af23b60f445556bf/users/33b2a47d925e40918e1ca46b1d739b9a/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:31.855541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a01cf7-d897-44af-a35e-4973be8a28e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ccf03ec9a664ea8af23b60f445556bf, user_id=33b2a47d925e40918e1ca46b1d739b9a, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:31.858511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a01cf7-d897-44af-a35e-4973be8a28e9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:31.873168 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2718/5430] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:31 2022] PUT /identity/v3/projects/3ccf03ec9a664ea8af23b60f445556bf/users/33b2a47d925e40918e1ca46b1d739b9a/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:31.877245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086c31e-3f80-4786-9466-da7c39846d77 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:31.887601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086c31e-3f80-4786-9466-da7c39846d77 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:31.949804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb812c-145e-4f57-91d2-4629725d6684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:31.950785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb812c-145e-4f57-91d2-4629725d6684 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:31.951101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb812c-145e-4f57-91d2-4629725d6684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:31.951362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb812c-145e-4f57-91d2-4629725d6684 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:31.952221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb812c-145e-4f57-91d2-4629725d6684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:31.953895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb812c-145e-4f57-91d2-4629725d6684 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:31.964789 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2713/5431] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:31.969307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a01cf7-d897-44af-a35e-4973be8a28e9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:31.980313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a01cf7-d897-44af-a35e-4973be8a28e9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:31.985202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6315e-a54b-4a54-88f7-4f94e2434133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:31.985874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6315e-a54b-4a54-88f7-4f94e2434133 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:31.986152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6315e-a54b-4a54-88f7-4f94e2434133 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:31.986426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6315e-a54b-4a54-88f7-4f94e2434133 admin admin] PATH_INFO: `/v3/projects/3ccf03ec9a664ea8af23b60f445556bf/users/33b2a47d925e40918e1ca46b1d739b9a/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:31.988524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6315e-a54b-4a54-88f7-4f94e2434133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ccf03ec9a664ea8af23b60f445556bf, user_id=33b2a47d925e40918e1ca46b1d739b9a, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:31.991160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6315e-a54b-4a54-88f7-4f94e2434133 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:32.003140 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2719/5432] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:31 2022] PUT /identity/v3/projects/3ccf03ec9a664ea8af23b60f445556bf/users/33b2a47d925e40918e1ca46b1d739b9a/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:32.015682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb097ca9-9093-4d1c-a669-703c62c974cb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:32.015682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb097ca9-9093-4d1c-a669-703c62c974cb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:32.015682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb097ca9-9093-4d1c-a669-703c62c974cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:32.047214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cb097ca9-9093-4d1c-a669-703c62c974cb None None] MFA Rules not processed for user `33b2a47d925e40918e1ca46b1d739b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:32.049055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cb097ca9-9093-4d1c-a669-703c62c974cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:32.080438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:32.133807 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2714/5433] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:32.138889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6315e-a54b-4a54-88f7-4f94e2434133 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:32.150841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6315e-a54b-4a54-88f7-4f94e2434133 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:32.156102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7aeff1-b3b8-46aa-aada-b4fd4e3180ac tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b2a47d925e40918e1ca46b1d739b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccf03ec9a664ea8af23b60f445556bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:32.157136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aeff1-b3b8-46aa-aada-b4fd4e3180ac tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:32.157513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aeff1-b3b8-46aa-aada-b4fd4e3180ac tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:32.157881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aeff1-b3b8-46aa-aada-b4fd4e3180ac tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:32.158755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7aeff1-b3b8-46aa-aada-b4fd4e3180ac tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:32.160784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7aeff1-b3b8-46aa-aada-b4fd4e3180ac tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:32.180190 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2720/5434] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:32 2022] POST /identity/v3/services => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:32.187034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb097ca9-9093-4d1c-a669-703c62c974cb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:32.203216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb097ca9-9093-4d1c-a669-703c62c974cb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:32.218667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a96b46-7c32-47be-891e-916278dc456c tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b2a47d925e40918e1ca46b1d739b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccf03ec9a664ea8af23b60f445556bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:32.219326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a96b46-7c32-47be-891e-916278dc456c tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:32.219720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a96b46-7c32-47be-891e-916278dc456c tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:32.219998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a96b46-7c32-47be-891e-916278dc456c tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:32.220668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a96b46-7c32-47be-891e-916278dc456c tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:32.222261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a96b46-7c32-47be-891e-916278dc456c tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-b4a96b46-7c32-47be-891e-916278dc456c tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: On instance['enabled']: Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: On instance['enabled']: Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: 'False' Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise error Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application 'False' Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:42:32.228938 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:42:32.235188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:42:32.235188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:42:32.235188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:42:32.235188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:42:32.235188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:42:32.235188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:42:32.235188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:42:32.235188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:42:32.235188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:42:32.235188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:42:32.235188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:42:32.235188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:42:32.235188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 28 18:42:32.235188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 28 18:42:32.235188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 18:42:32.235188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 18:42:32.235188 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 18:42:32.236756 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 18:42:32.236756 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 18:42:32.236756 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:42:32.236756 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 18:42:32.236756 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 18:42:32.236756 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:42:32.236756 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 18:42:32.236756 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application 'False' Aug 28 18:42:32.236756 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:42:32.236756 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2715/5435] 10.222.0.27 () {60 vars in 1156 bytes} [Sun Aug 28 18:42:32 2022] POST /identity/v3/endpoints => generated 283 bytes in 44 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 18:42:32.237699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7aeff1-b3b8-46aa-aada-b4fd4e3180ac tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:32.246284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7aeff1-b3b8-46aa-aada-b4fd4e3180ac tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:32.251129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f37ce-c294-4584-b43d-892ddb7df7eb tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b2a47d925e40918e1ca46b1d739b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccf03ec9a664ea8af23b60f445556bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:32.251776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f37ce-c294-4584-b43d-892ddb7df7eb tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:32.252166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f37ce-c294-4584-b43d-892ddb7df7eb tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:32.252320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f37ce-c294-4584-b43d-892ddb7df7eb tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:32.253000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f37ce-c294-4584-b43d-892ddb7df7eb tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:32.254607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f37ce-c294-4584-b43d-892ddb7df7eb tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-346f37ce-c294-4584-b43d-892ddb7df7eb tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: On instance['enabled']: Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: On instance['enabled']: Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: 'True' Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise error Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'True' Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:42:32.261771 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:42:32.267393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:42:32.267393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:42:32.267393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:42:32.267393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:42:32.267393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:42:32.267393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:42:32.267393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:42:32.267393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:42:32.267393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:42:32.267393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:42:32.267393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:42:32.267393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:42:32.267393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 28 18:42:32.267393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 28 18:42:32.267393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 18:42:32.267393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 18:42:32.267393 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 18:42:32.268423 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 18:42:32.268423 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 18:42:32.268423 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:42:32.268423 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 18:42:32.268423 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 18:42:32.268423 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:42:32.268423 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 18:42:32.268423 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'True' Aug 28 18:42:32.268423 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:42:32.268423 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2721/5436] 10.222.0.27 () {60 vars in 1156 bytes} [Sun Aug 28 18:42:32 2022] POST /identity/v3/endpoints => generated 281 bytes in 28 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 28 18:42:32.269189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a96b46-7c32-47be-891e-916278dc456c tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:32.278693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a96b46-7c32-47be-891e-916278dc456c tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:32.284423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00bc2f-d7b4-4381-9105-a4af18eb0e31 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b2a47d925e40918e1ca46b1d739b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccf03ec9a664ea8af23b60f445556bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:32.284423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00bc2f-d7b4-4381-9105-a4af18eb0e31 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:32.284423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00bc2f-d7b4-4381-9105-a4af18eb0e31 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:32.284754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00bc2f-d7b4-4381-9105-a4af18eb0e31 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:32.285146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00bc2f-d7b4-4381-9105-a4af18eb0e31 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:32.286728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00bc2f-d7b4-4381-9105-a4af18eb0e31 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:32.304655 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-2a00bc2f-d7b4-4381-9105-a4af18eb0e31 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-847731975. To ensure interoperability, identifiers should be a valid uuid. Aug 28 18:42:32.304655 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 18:42:32.304655 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:42:32.336326 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2716/5437] 10.222.0.27 () {60 vars in 1156 bytes} [Sun Aug 28 18:42:32 2022] POST /identity/v3/endpoints => generated 359 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:32.337762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f37ce-c294-4584-b43d-892ddb7df7eb tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:32.349501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f37ce-c294-4584-b43d-892ddb7df7eb tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:32.366473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681861ea-043b-47ab-91d9-aad8469042ed tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b2a47d925e40918e1ca46b1d739b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccf03ec9a664ea8af23b60f445556bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:32.367203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681861ea-043b-47ab-91d9-aad8469042ed tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:32.367616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681861ea-043b-47ab-91d9-aad8469042ed tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:32.367950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681861ea-043b-47ab-91d9-aad8469042ed tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] PATH_INFO: `/v3/regions/tempest-region-847731975` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:32.368628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681861ea-043b-47ab-91d9-aad8469042ed tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-847731975)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:32.369811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681861ea-043b-47ab-91d9-aad8469042ed tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:32.371918 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2722/5438] 10.222.0.27 () {58 vars in 1203 bytes} [Sun Aug 28 18:42:32 2022] GET /identity/v3/regions/tempest-region-847731975 => generated 178 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:32.376338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00bc2f-d7b4-4381-9105-a4af18eb0e31 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:32.387457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00bc2f-d7b4-4381-9105-a4af18eb0e31 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:32.392709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480cfba-75ac-4bee-9c5c-450c6609d2cd tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b2a47d925e40918e1ca46b1d739b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccf03ec9a664ea8af23b60f445556bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:32.393371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480cfba-75ac-4bee-9c5c-450c6609d2cd tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:32.393653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480cfba-75ac-4bee-9c5c-450c6609d2cd tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:32.393922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480cfba-75ac-4bee-9c5c-450c6609d2cd tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] PATH_INFO: `/v3/endpoints/0070bedc4c5246029a2c7d906f66114b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:32.411138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480cfba-75ac-4bee-9c5c-450c6609d2cd tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=0070bedc4c5246029a2c7d906f66114b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:32.411978 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-d480cfba-75ac-4bee-9c5c-450c6609d2cd tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:42:32.411978 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:42:32.411978 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:42:32.412902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480cfba-75ac-4bee-9c5c-450c6609d2cd tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-d480cfba-75ac-4bee-9c5c-450c6609d2cd tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: On instance['enabled']: Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: On instance['enabled']: Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: 'False' Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise error Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application 'False' Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:42:32.420758 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:42:32.422254 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:42:32.422254 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:42:32.422254 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:42:32.422254 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:42:32.422254 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:42:32.422254 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:42:32.422254 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:42:32.422254 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:42:32.422254 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:42:32.422254 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:42:32.422254 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:42:32.422254 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:42:32.422254 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 28 18:42:32.422254 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 28 18:42:32.422254 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 18:42:32.422254 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 18:42:32.422254 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 18:42:32.423396 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 18:42:32.423396 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 18:42:32.423396 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:42:32.423396 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 18:42:32.423396 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 18:42:32.423396 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:42:32.423396 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 18:42:32.423396 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application 'False' Aug 28 18:42:32.423396 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:42:32.423396 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2717/5439] 10.222.0.27 () {60 vars in 1255 bytes} [Sun Aug 28 18:42:32 2022] PATCH /identity/v3/endpoints/0070bedc4c5246029a2c7d906f66114b => generated 283 bytes in 46 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 18:42:32.426323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681861ea-043b-47ab-91d9-aad8469042ed tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:32.437535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681861ea-043b-47ab-91d9-aad8469042ed tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:32.443130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaac2c6-2807-4c82-9d57-f0e8c99773b0 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b2a47d925e40918e1ca46b1d739b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccf03ec9a664ea8af23b60f445556bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:32.443817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaac2c6-2807-4c82-9d57-f0e8c99773b0 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:32.444098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaac2c6-2807-4c82-9d57-f0e8c99773b0 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:32.444375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaac2c6-2807-4c82-9d57-f0e8c99773b0 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] PATH_INFO: `/v3/endpoints/0070bedc4c5246029a2c7d906f66114b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:32.445587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaac2c6-2807-4c82-9d57-f0e8c99773b0 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=0070bedc4c5246029a2c7d906f66114b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:32.447667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaac2c6-2807-4c82-9d57-f0e8c99773b0 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:32.458132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1eaac2c6-2807-4c82-9d57-f0e8c99773b0 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '0070bedc4c5246029a2c7d906f66114b', 'request_id': 'req-1eaac2c6-2807-4c82-9d57-f0e8c99773b0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:32.477203 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2723/5440] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Aug 28 18:42:32 2022] DELETE /identity/v3/endpoints/0070bedc4c5246029a2c7d906f66114b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:32.482476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480cfba-75ac-4bee-9c5c-450c6609d2cd tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:32.493217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480cfba-75ac-4bee-9c5c-450c6609d2cd tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:32.510855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43318de0-932c-4ace-8b59-3532aaabf31c tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b2a47d925e40918e1ca46b1d739b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccf03ec9a664ea8af23b60f445556bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:32.511570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43318de0-932c-4ace-8b59-3532aaabf31c tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:32.511856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43318de0-932c-4ace-8b59-3532aaabf31c tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:32.512149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43318de0-932c-4ace-8b59-3532aaabf31c tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] PATH_INFO: `/v3/regions/tempest-region-847731975` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:32.512765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43318de0-932c-4ace-8b59-3532aaabf31c tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-847731975)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:32.514370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43318de0-932c-4ace-8b59-3532aaabf31c tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:32.535132 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2718/5441] 10.222.0.27 () {58 vars in 1206 bytes} [Sun Aug 28 18:42:32 2022] DELETE /identity/v3/regions/tempest-region-847731975 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:32.540223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaac2c6-2807-4c82-9d57-f0e8c99773b0 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:32.564220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaac2c6-2807-4c82-9d57-f0e8c99773b0 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:32.595751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5931f96-6cbb-4773-8ecf-c4c20bbb665f tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b2a47d925e40918e1ca46b1d739b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccf03ec9a664ea8af23b60f445556bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:32.596725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5931f96-6cbb-4773-8ecf-c4c20bbb665f tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:32.597203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5931f96-6cbb-4773-8ecf-c4c20bbb665f tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:32.597638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5931f96-6cbb-4773-8ecf-c4c20bbb665f tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:32.598556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5931f96-6cbb-4773-8ecf-c4c20bbb665f tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:32.601743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5931f96-6cbb-4773-8ecf-c4c20bbb665f tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:32.670493 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-e5931f96-6cbb-4773-8ecf-c4c20bbb665f tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1657814318. To ensure interoperability, identifiers should be a valid uuid. Aug 28 18:42:32.670493 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 18:42:32.670493 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:42:32.710704 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2724/5442] 10.222.0.27 () {60 vars in 1156 bytes} [Sun Aug 28 18:42:32 2022] POST /identity/v3/endpoints => generated 361 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:32.712151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43318de0-932c-4ace-8b59-3532aaabf31c tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:32.734962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43318de0-932c-4ace-8b59-3532aaabf31c tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:32.757362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3749f-1763-4160-9e0a-7fedf09cee72 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b2a47d925e40918e1ca46b1d739b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccf03ec9a664ea8af23b60f445556bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:32.757999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3749f-1763-4160-9e0a-7fedf09cee72 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:32.758279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3749f-1763-4160-9e0a-7fedf09cee72 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:32.758581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3749f-1763-4160-9e0a-7fedf09cee72 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] PATH_INFO: `/v3/regions/tempest-region-1657814318` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:32.759165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3749f-1763-4160-9e0a-7fedf09cee72 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1657814318)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:32.760971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3749f-1763-4160-9e0a-7fedf09cee72 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:32.763480 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2719/5443] 10.222.0.27 () {58 vars in 1206 bytes} [Sun Aug 28 18:42:32 2022] GET /identity/v3/regions/tempest-region-1657814318 => generated 180 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:32.767640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5931f96-6cbb-4773-8ecf-c4c20bbb665f tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:32.782088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5931f96-6cbb-4773-8ecf-c4c20bbb665f tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:32.785248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed9797-7609-433b-a45d-de837eafb2ca tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b2a47d925e40918e1ca46b1d739b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccf03ec9a664ea8af23b60f445556bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:32.785890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed9797-7609-433b-a45d-de837eafb2ca tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:32.786168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed9797-7609-433b-a45d-de837eafb2ca tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:32.786439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed9797-7609-433b-a45d-de837eafb2ca tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] PATH_INFO: `/v3/endpoints/c9439a1aa01343ef8a6eec3579e4aef3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:32.792428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed9797-7609-433b-a45d-de837eafb2ca tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=c9439a1aa01343ef8a6eec3579e4aef3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:32.794105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed9797-7609-433b-a45d-de837eafb2ca tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-94ed9797-7609-433b-a45d-de837eafb2ca tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: On instance['enabled']: Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: On instance['enabled']: Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: 'True' Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise error Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'True' Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:42:32.802142 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:42:32.804040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:42:32.804040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:42:32.804040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:42:32.804040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:42:32.804040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:42:32.804040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:42:32.804040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:42:32.804040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:42:32.804040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:42:32.804040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:42:32.804040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:42:32.804040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:42:32.804040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 28 18:42:32.804040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 28 18:42:32.804040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 18:42:32.804040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 18:42:32.804040 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 18:42:32.805271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 18:42:32.805271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 18:42:32.805271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:42:32.805271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 18:42:32.805271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 18:42:32.805271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:42:32.805271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 18:42:32.805271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'True' Aug 28 18:42:32.805271 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:42:32.806617 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2725/5444] 10.222.0.27 () {60 vars in 1255 bytes} [Sun Aug 28 18:42:32 2022] PATCH /identity/v3/endpoints/c9439a1aa01343ef8a6eec3579e4aef3 => generated 281 bytes in 39 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 18:42:32.807828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3749f-1763-4160-9e0a-7fedf09cee72 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:32.819329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3749f-1763-4160-9e0a-7fedf09cee72 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:32.824531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b9de6-4e90-4903-997e-cc8c0f740628 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b2a47d925e40918e1ca46b1d739b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccf03ec9a664ea8af23b60f445556bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:32.825396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b9de6-4e90-4903-997e-cc8c0f740628 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:32.825869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b9de6-4e90-4903-997e-cc8c0f740628 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:32.826505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b9de6-4e90-4903-997e-cc8c0f740628 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] PATH_INFO: `/v3/endpoints/c9439a1aa01343ef8a6eec3579e4aef3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:32.827980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b9de6-4e90-4903-997e-cc8c0f740628 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=c9439a1aa01343ef8a6eec3579e4aef3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:32.829579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b9de6-4e90-4903-997e-cc8c0f740628 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:32.839133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df5b9de6-4e90-4903-997e-cc8c0f740628 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'c9439a1aa01343ef8a6eec3579e4aef3', 'request_id': 'req-df5b9de6-4e90-4903-997e-cc8c0f740628'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:32.850104 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2720/5445] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Aug 28 18:42:32 2022] DELETE /identity/v3/endpoints/c9439a1aa01343ef8a6eec3579e4aef3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:32.854405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed9797-7609-433b-a45d-de837eafb2ca tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:32.866538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed9797-7609-433b-a45d-de837eafb2ca tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:32.886285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4523b-89f1-499e-bdce-9fbce34af6aa tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b2a47d925e40918e1ca46b1d739b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccf03ec9a664ea8af23b60f445556bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:32.887157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4523b-89f1-499e-bdce-9fbce34af6aa tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:32.887495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4523b-89f1-499e-bdce-9fbce34af6aa tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:32.887869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4523b-89f1-499e-bdce-9fbce34af6aa tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] PATH_INFO: `/v3/regions/tempest-region-1657814318` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:32.888481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4523b-89f1-499e-bdce-9fbce34af6aa tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1657814318)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:32.890127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4523b-89f1-499e-bdce-9fbce34af6aa tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:32.912228 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2726/5446] 10.222.0.27 () {58 vars in 1209 bytes} [Sun Aug 28 18:42:32 2022] DELETE /identity/v3/regions/tempest-region-1657814318 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:32.916755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b9de6-4e90-4903-997e-cc8c0f740628 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:32.931710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b9de6-4e90-4903-997e-cc8c0f740628 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:32.947297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528ef60-e323-4554-919d-08fd250902a7 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b2a47d925e40918e1ca46b1d739b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccf03ec9a664ea8af23b60f445556bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:32.947935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528ef60-e323-4554-919d-08fd250902a7 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:32.948213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528ef60-e323-4554-919d-08fd250902a7 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:32.948480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528ef60-e323-4554-919d-08fd250902a7 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] PATH_INFO: `/v3/services/59ce49b79c8e452da10eafe2b63e5c68` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:32.949059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528ef60-e323-4554-919d-08fd250902a7 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorizing `identity:delete_service(service_id=59ce49b79c8e452da10eafe2b63e5c68)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:32.950711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528ef60-e323-4554-919d-08fd250902a7 tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:32.979155 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2721/5447] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:32 2022] DELETE /identity/v3/services/59ce49b79c8e452da10eafe2b63e5c68 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:32.983558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4523b-89f1-499e-bdce-9fbce34af6aa tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:33.002699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=8,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:33.098481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4523b-89f1-499e-bdce-9fbce34af6aa tempest-EndpointsNegativeTestJSON-742375255 tempest-EndpointsNegativeTestJSON-742375255-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:33.119732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca7683-8105-4078-9c6e-e97b62b1bba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:33.121015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca7683-8105-4078-9c6e-e97b62b1bba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:33.121521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca7683-8105-4078-9c6e-e97b62b1bba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:33.123097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca7683-8105-4078-9c6e-e97b62b1bba9 admin admin] PATH_INFO: `/v3/users/c88a6906f62841ed95ed895996fa68ca` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:33.124755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca7683-8105-4078-9c6e-e97b62b1bba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88a6906f62841ed95ed895996fa68ca)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:33.127431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca7683-8105-4078-9c6e-e97b62b1bba9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:33.214879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5ca7683-8105-4078-9c6e-e97b62b1bba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88a6906f62841ed95ed895996fa68ca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:33.215914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5ca7683-8105-4078-9c6e-e97b62b1bba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88a6906f62841ed95ed895996fa68ca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:33.225235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5ca7683-8105-4078-9c6e-e97b62b1bba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88a6906f62841ed95ed895996fa68ca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:33.237133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5ca7683-8105-4078-9c6e-e97b62b1bba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88a6906f62841ed95ed895996fa68ca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:33.254759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5ca7683-8105-4078-9c6e-e97b62b1bba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88a6906f62841ed95ed895996fa68ca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:33.266057 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2727/5448] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:32 2022] DELETE /identity/v3/users/c88a6906f62841ed95ed895996fa68ca => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:33.267798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86999d54-ca18-4cd7-a1b8-8d58b97c452f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:33.268090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86999d54-ca18-4cd7-a1b8-8d58b97c452f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:33.268388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86999d54-ca18-4cd7-a1b8-8d58b97c452f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:33.291936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-86999d54-ca18-4cd7-a1b8-8d58b97c452f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:33.293167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-86999d54-ca18-4cd7-a1b8-8d58b97c452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:33.321152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:33.373939 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2722/5449] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:33.385142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca7683-8105-4078-9c6e-e97b62b1bba9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:33.386973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b5ca7683-8105-4078-9c6e-e97b62b1bba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:33.506158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca7683-8105-4078-9c6e-e97b62b1bba9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:33.512595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388beea0-6c27-4c1d-8f89-ffc8042268e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:33.513344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388beea0-6c27-4c1d-8f89-ffc8042268e1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:33.513631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388beea0-6c27-4c1d-8f89-ffc8042268e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:33.513953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388beea0-6c27-4c1d-8f89-ffc8042268e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:33.526362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388beea0-6c27-4c1d-8f89-ffc8042268e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:33.528530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388beea0-6c27-4c1d-8f89-ffc8042268e1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:33.547698 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2728/5450] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:33.906570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86999d54-ca18-4cd7-a1b8-8d58b97c452f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:33.908718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-86999d54-ca18-4cd7-a1b8-8d58b97c452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:33.939962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86999d54-ca18-4cd7-a1b8-8d58b97c452f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:33.961454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6839d-d942-4e63-8562-83f25f400947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:33.962125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6839d-d942-4e63-8562-83f25f400947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:33.962607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6839d-d942-4e63-8562-83f25f400947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:33.963049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6839d-d942-4e63-8562-83f25f400947 admin admin] PATH_INFO: `/v3/projects/b3423f9d9fad4b668a15c52445f1f88f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:33.964411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6839d-d942-4e63-8562-83f25f400947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3423f9d9fad4b668a15c52445f1f88f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:33.966531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6839d-d942-4e63-8562-83f25f400947 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:34.045446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-93f6839d-d942-4e63-8562-83f25f400947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3423f9d9fad4b668a15c52445f1f88f', 'request_id': 'req-93f6839d-d942-4e63-8562-83f25f400947'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:34.053366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-93f6839d-d942-4e63-8562-83f25f400947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3423f9d9fad4b668a15c52445f1f88f', 'request_id': 'req-93f6839d-d942-4e63-8562-83f25f400947'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:34.061881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-93f6839d-d942-4e63-8562-83f25f400947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3423f9d9fad4b668a15c52445f1f88f', 'request_id': 'req-93f6839d-d942-4e63-8562-83f25f400947'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:34.084143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-93f6839d-d942-4e63-8562-83f25f400947 admin admin] The token cache is being invalidate because project b3423f9d9fad4b668a15c52445f1f88f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:34.084446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-93f6839d-d942-4e63-8562-83f25f400947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:34.085115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-93f6839d-d942-4e63-8562-83f25f400947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:34.086673 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2723/5451] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:33 2022] DELETE /identity/v3/projects/b3423f9d9fad4b668a15c52445f1f88f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:34.090982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388beea0-6c27-4c1d-8f89-ffc8042268e1 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:34.105912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388beea0-6c27-4c1d-8f89-ffc8042268e1 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:34.112638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:34.173360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246764f-238e-4ce6-a756-72d8d0205c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:34.174003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246764f-238e-4ce6-a756-72d8d0205c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:34.174500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246764f-238e-4ce6-a756-72d8d0205c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:34.174776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246764f-238e-4ce6-a756-72d8d0205c41 admin admin] PATH_INFO: `/v3/users/33b2a47d925e40918e1ca46b1d739b9a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:34.175919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246764f-238e-4ce6-a756-72d8d0205c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b2a47d925e40918e1ca46b1d739b9a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:34.177883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246764f-238e-4ce6-a756-72d8d0205c41 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:34.235820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9246764f-238e-4ce6-a756-72d8d0205c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b2a47d925e40918e1ca46b1d739b9a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:34.236483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9246764f-238e-4ce6-a756-72d8d0205c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b2a47d925e40918e1ca46b1d739b9a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:34.243539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9246764f-238e-4ce6-a756-72d8d0205c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b2a47d925e40918e1ca46b1d739b9a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:34.251553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9246764f-238e-4ce6-a756-72d8d0205c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b2a47d925e40918e1ca46b1d739b9a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:34.264559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9246764f-238e-4ce6-a756-72d8d0205c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b2a47d925e40918e1ca46b1d739b9a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:34.272437 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2729/5452] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:34 2022] DELETE /identity/v3/users/33b2a47d925e40918e1ca46b1d739b9a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:34.871724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6839d-d942-4e63-8562-83f25f400947 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:34.873590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-93f6839d-d942-4e63-8562-83f25f400947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:34.889431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6839d-d942-4e63-8562-83f25f400947 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:34.987854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2c377-d805-48ca-ba9e-ab881c059075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:34.988664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2c377-d805-48ca-ba9e-ab881c059075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:34.988882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2c377-d805-48ca-ba9e-ab881c059075 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:34.989354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2c377-d805-48ca-ba9e-ab881c059075 admin admin] PATH_INFO: `/v3/projects/3ccf03ec9a664ea8af23b60f445556bf` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:34.990720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2c377-d805-48ca-ba9e-ab881c059075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ccf03ec9a664ea8af23b60f445556bf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:34.992879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2c377-d805-48ca-ba9e-ab881c059075 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:35.052613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07e2c377-d805-48ca-ba9e-ab881c059075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ccf03ec9a664ea8af23b60f445556bf', 'request_id': 'req-07e2c377-d805-48ca-ba9e-ab881c059075'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:35.054841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:35.061681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07e2c377-d805-48ca-ba9e-ab881c059075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ccf03ec9a664ea8af23b60f445556bf', 'request_id': 'req-07e2c377-d805-48ca-ba9e-ab881c059075'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:35.068952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07e2c377-d805-48ca-ba9e-ab881c059075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ccf03ec9a664ea8af23b60f445556bf', 'request_id': 'req-07e2c377-d805-48ca-ba9e-ab881c059075'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:35.097693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07e2c377-d805-48ca-ba9e-ab881c059075 admin admin] The token cache is being invalidate because project 3ccf03ec9a664ea8af23b60f445556bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:35.097993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07e2c377-d805-48ca-ba9e-ab881c059075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:35.098837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07e2c377-d805-48ca-ba9e-ab881c059075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:35.103706 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2724/5453] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:34 2022] DELETE /identity/v3/projects/3ccf03ec9a664ea8af23b60f445556bf => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:35.105676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeba11-6cd3-4e1f-9c93-f6fe4a9047b6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:35.106142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeba11-6cd3-4e1f-9c93-f6fe4a9047b6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:35.106290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeba11-6cd3-4e1f-9c93-f6fe4a9047b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:35.128376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-eadeba11-6cd3-4e1f-9c93-f6fe4a9047b6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:35.129769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eadeba11-6cd3-4e1f-9c93-f6fe4a9047b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:35.207269 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2730/5454] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:35.218726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf4451-31d4-41bc-b1d9-e7e6ebe14e86 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:35.219040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf4451-31d4-41bc-b1d9-e7e6ebe14e86 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:35.219519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf4451-31d4-41bc-b1d9-e7e6ebe14e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:35.252801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-70cf4451-31d4-41bc-b1d9-e7e6ebe14e86 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:35.255676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-70cf4451-31d4-41bc-b1d9-e7e6ebe14e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:35.267219 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2725/5455] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:35.271936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeba11-6cd3-4e1f-9c93-f6fe4a9047b6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:35.287978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeba11-6cd3-4e1f-9c93-f6fe4a9047b6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:35.296461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0162355-6729-4a49-863d-eacee30fde7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:35.297105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0162355-6729-4a49-863d-eacee30fde7f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:35.297379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0162355-6729-4a49-863d-eacee30fde7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:35.298013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0162355-6729-4a49-863d-eacee30fde7f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:35.298834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0162355-6729-4a49-863d-eacee30fde7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:42:35.299331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0162355-6729-4a49-863d-eacee30fde7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:35.301587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0162355-6729-4a49-863d-eacee30fde7f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:35.321579 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2731/5456] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:42:35.327539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf4451-31d4-41bc-b1d9-e7e6ebe14e86 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:35.339529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf4451-31d4-41bc-b1d9-e7e6ebe14e86 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:35.347566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d50bc-d9fb-4840-9e2a-63e642bba2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:35.348905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d50bc-d9fb-4840-9e2a-63e642bba2d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:35.350545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d50bc-d9fb-4840-9e2a-63e642bba2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:35.350991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d50bc-d9fb-4840-9e2a-63e642bba2d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:35.352546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d50bc-d9fb-4840-9e2a-63e642bba2d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:35.356011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d50bc-d9fb-4840-9e2a-63e642bba2d5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:35.418879 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2726/5457] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:35 2022] POST /identity/v3/projects => generated 369 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:35.424226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0162355-6729-4a49-863d-eacee30fde7f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:35.443744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0162355-6729-4a49-863d-eacee30fde7f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:35.461510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:35.527674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327169a-eb40-4d2d-924a-3aaeab936eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:35.528514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327169a-eb40-4d2d-924a-3aaeab936eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:35.528800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327169a-eb40-4d2d-924a-3aaeab936eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:35.529385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327169a-eb40-4d2d-924a-3aaeab936eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:35.529890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327169a-eb40-4d2d-924a-3aaeab936eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:35.532798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327169a-eb40-4d2d-924a-3aaeab936eb5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:35.560944 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2732/5458] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:35 2022] POST /identity/v3/users => generated 285 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:35.562220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d50bc-d9fb-4840-9e2a-63e642bba2d5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:35.580685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d50bc-d9fb-4840-9e2a-63e642bba2d5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:35.595851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f09f36-fb82-4127-8228-23c768e77206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:35.596860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f09f36-fb82-4127-8228-23c768e77206 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:35.597409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f09f36-fb82-4127-8228-23c768e77206 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:35.597841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f09f36-fb82-4127-8228-23c768e77206 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:35.600279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f09f36-fb82-4127-8228-23c768e77206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:35.602084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f09f36-fb82-4127-8228-23c768e77206 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:35.615440 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2727/5459] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:35.619426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327169a-eb40-4d2d-924a-3aaeab936eb5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:35.632413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327169a-eb40-4d2d-924a-3aaeab936eb5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:35.639571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df045cac-b9ca-4498-9712-ddb241aa30fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:35.640773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df045cac-b9ca-4498-9712-ddb241aa30fd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:35.641167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df045cac-b9ca-4498-9712-ddb241aa30fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:35.641545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df045cac-b9ca-4498-9712-ddb241aa30fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:35.643344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df045cac-b9ca-4498-9712-ddb241aa30fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:35.646271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df045cac-b9ca-4498-9712-ddb241aa30fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:35.661149 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2733/5460] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:42:35.665210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f09f36-fb82-4127-8228-23c768e77206 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:35.677735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f09f36-fb82-4127-8228-23c768e77206 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:35.683163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ab001-2461-4cdd-9c06-ba2bb7a1192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:35.684295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ab001-2461-4cdd-9c06-ba2bb7a1192c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:35.684644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ab001-2461-4cdd-9c06-ba2bb7a1192c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:35.684919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ab001-2461-4cdd-9c06-ba2bb7a1192c admin admin] PATH_INFO: `/v3/projects/014977f02fec4e3994227d5e1f6a6c33/users/17d0512b2a3a4692bf7341353b0730d5/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:35.702676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ab001-2461-4cdd-9c06-ba2bb7a1192c admin admin] RBAC: Authorizing `identity:create_grant(project_id=014977f02fec4e3994227d5e1f6a6c33, user_id=17d0512b2a3a4692bf7341353b0730d5, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:35.705485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ab001-2461-4cdd-9c06-ba2bb7a1192c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:35.729537 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2728/5461] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:35 2022] PUT /identity/v3/projects/014977f02fec4e3994227d5e1f6a6c33/users/17d0512b2a3a4692bf7341353b0730d5/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:35.740008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0484c-8b77-4237-bdd9-2b395dbe42ad None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:35.740345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0484c-8b77-4237-bdd9-2b395dbe42ad None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:35.740559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0484c-8b77-4237-bdd9-2b395dbe42ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:35.791701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cfa0484c-8b77-4237-bdd9-2b395dbe42ad None None] MFA Rules not processed for user `17d0512b2a3a4692bf7341353b0730d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:35.793770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cfa0484c-8b77-4237-bdd9-2b395dbe42ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:35.889382 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2734/5462] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:42:35.894027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ab001-2461-4cdd-9c06-ba2bb7a1192c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:35.971657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ab001-2461-4cdd-9c06-ba2bb7a1192c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:35.976841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cc259-3359-41dc-8059-f3dc1b1533fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:35.978211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cc259-3359-41dc-8059-f3dc1b1533fc admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:35.978598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cc259-3359-41dc-8059-f3dc1b1533fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:35.978974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cc259-3359-41dc-8059-f3dc1b1533fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:35.980248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cc259-3359-41dc-8059-f3dc1b1533fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:35.983517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cc259-3359-41dc-8059-f3dc1b1533fc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:36.020283 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2729/5463] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:35 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:36.024169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0484c-8b77-4237-bdd9-2b395dbe42ad None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:36.035453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0484c-8b77-4237-bdd9-2b395dbe42ad None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:36.098750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d0bf7-f10a-4e3b-b4b6-2bca6d3dd40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:36.099734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d0bf7-f10a-4e3b-b4b6-2bca6d3dd40d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:36.100274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d0bf7-f10a-4e3b-b4b6-2bca6d3dd40d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:36.100698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d0bf7-f10a-4e3b-b4b6-2bca6d3dd40d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:36.101519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d0bf7-f10a-4e3b-b4b6-2bca6d3dd40d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:36.103991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d0bf7-f10a-4e3b-b4b6-2bca6d3dd40d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:36.135751 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2735/5464] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:36 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:36.139744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cc259-3359-41dc-8059-f3dc1b1533fc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:36.152522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cc259-3359-41dc-8059-f3dc1b1533fc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:36.158294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc665cf7-7156-45e1-8e7c-8a6b5c957eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:36.159165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc665cf7-7156-45e1-8e7c-8a6b5c957eee admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:36.159576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc665cf7-7156-45e1-8e7c-8a6b5c957eee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:36.159947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc665cf7-7156-45e1-8e7c-8a6b5c957eee admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:36.160730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc665cf7-7156-45e1-8e7c-8a6b5c957eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:36.162454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc665cf7-7156-45e1-8e7c-8a6b5c957eee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:36.317563 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2730/5465] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:36.322374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d0bf7-f10a-4e3b-b4b6-2bca6d3dd40d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:36.338639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d0bf7-f10a-4e3b-b4b6-2bca6d3dd40d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:36.344698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaffb68-1c6d-43f3-9d26-18af5bef906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:36.345325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaffb68-1c6d-43f3-9d26-18af5bef906e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:36.345607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaffb68-1c6d-43f3-9d26-18af5bef906e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:36.346534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaffb68-1c6d-43f3-9d26-18af5bef906e admin admin] PATH_INFO: `/v3/projects/4fdfb920fbe6496c8b68cdb6b5962771/users/74e192487cfb47b79d9b68466f41df8e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:36.362111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:36.368189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaffb68-1c6d-43f3-9d26-18af5bef906e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fdfb920fbe6496c8b68cdb6b5962771, user_id=74e192487cfb47b79d9b68466f41df8e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:36.371381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaffb68-1c6d-43f3-9d26-18af5bef906e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:36.390536 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2736/5466] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:36 2022] PUT /identity/v3/projects/4fdfb920fbe6496c8b68cdb6b5962771/users/74e192487cfb47b79d9b68466f41df8e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:36.394639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc665cf7-7156-45e1-8e7c-8a6b5c957eee admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:36.406056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc665cf7-7156-45e1-8e7c-8a6b5c957eee admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:36.467164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:36.485289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f681ec-e153-4344-b1b4-22308a665b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:36.485969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f681ec-e153-4344-b1b4-22308a665b72 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:36.486526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f681ec-e153-4344-b1b4-22308a665b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:36.487130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f681ec-e153-4344-b1b4-22308a665b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:36.487926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f681ec-e153-4344-b1b4-22308a665b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:36.490791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f681ec-e153-4344-b1b4-22308a665b72 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:36.502859 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2731/5467] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:36.508157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaffb68-1c6d-43f3-9d26-18af5bef906e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:36.522330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaffb68-1c6d-43f3-9d26-18af5bef906e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:36.528862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648d943-5ef6-42c0-a23a-53d5e392583a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:36.530401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648d943-5ef6-42c0-a23a-53d5e392583a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:36.531167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648d943-5ef6-42c0-a23a-53d5e392583a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:36.531978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648d943-5ef6-42c0-a23a-53d5e392583a admin admin] PATH_INFO: `/v3/projects/4fdfb920fbe6496c8b68cdb6b5962771/users/74e192487cfb47b79d9b68466f41df8e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:36.534259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648d943-5ef6-42c0-a23a-53d5e392583a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fdfb920fbe6496c8b68cdb6b5962771, user_id=74e192487cfb47b79d9b68466f41df8e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:36.537556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648d943-5ef6-42c0-a23a-53d5e392583a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:36.566012 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2737/5468] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:36 2022] PUT /identity/v3/projects/4fdfb920fbe6496c8b68cdb6b5962771/users/74e192487cfb47b79d9b68466f41df8e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:36.572519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd26fa-519c-49b9-9278-a5269b0ad907 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:36.572805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd26fa-519c-49b9-9278-a5269b0ad907 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:36.573082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd26fa-519c-49b9-9278-a5269b0ad907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:36.610725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5fbd26fa-519c-49b9-9278-a5269b0ad907 None None] MFA Rules not processed for user `74e192487cfb47b79d9b68466f41df8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:36.613014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5fbd26fa-519c-49b9-9278-a5269b0ad907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:36.712966 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2732/5469] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:36.717148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648d943-5ef6-42c0-a23a-53d5e392583a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:36.734208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648d943-5ef6-42c0-a23a-53d5e392583a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:36.739977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5c326-5e03-4189-809d-b8ee0a76736c tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:36.740696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5c326-5e03-4189-809d-b8ee0a76736c tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:36.741085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5c326-5e03-4189-809d-b8ee0a76736c tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:36.741436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5c326-5e03-4189-809d-b8ee0a76736c tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:36.742213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5c326-5e03-4189-809d-b8ee0a76736c tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:36.744388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5c326-5e03-4189-809d-b8ee0a76736c tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:36.772337 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2738/5470] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:42:36 2022] POST /identity/v3/domains => generated 275 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:36.776577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd26fa-519c-49b9-9278-a5269b0ad907 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:36.800765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd26fa-519c-49b9-9278-a5269b0ad907 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:36.905006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b62e12-f6bc-4fa1-a398-52ef585bc219 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:36.905649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b62e12-f6bc-4fa1-a398-52ef585bc219 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:36.905934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b62e12-f6bc-4fa1-a398-52ef585bc219 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:36.906211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b62e12-f6bc-4fa1-a398-52ef585bc219 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:36.910920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b62e12-f6bc-4fa1-a398-52ef585bc219 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:36.913083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b62e12-f6bc-4fa1-a398-52ef585bc219 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:36.974230 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2733/5471] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Aug 28 18:42:36 2022] POST /identity/v3/groups => generated 279 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:36.978065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5c326-5e03-4189-809d-b8ee0a76736c tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:36.990026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5c326-5e03-4189-809d-b8ee0a76736c tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:36.996528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2054b2-609d-4b22-a1a2-3e24bf547a8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:36.997751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2054b2-609d-4b22-a1a2-3e24bf547a8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:36.997751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2054b2-609d-4b22-a1a2-3e24bf547a8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:36.998135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2054b2-609d-4b22-a1a2-3e24bf547a8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/92bc5dad0d2249339fcfde0acddb99a4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:37.006544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2054b2-609d-4b22-a1a2-3e24bf547a8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:update_group(group_id=92bc5dad0d2249339fcfde0acddb99a4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:37.008151 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-bb2054b2-609d-4b22-a1a2-3e24bf547a8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:42:37.008151 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:42:37.008151 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:42:37.009322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2054b2-609d-4b22-a1a2-3e24bf547a8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:37.045138 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2739/5472] 10.222.0.27 () {60 vars in 1247 bytes} [Sun Aug 28 18:42:36 2022] PATCH /identity/v3/groups/92bc5dad0d2249339fcfde0acddb99a4 => generated 293 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:37.048871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b62e12-f6bc-4fa1-a398-52ef585bc219 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:37.061297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b62e12-f6bc-4fa1-a398-52ef585bc219 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:37.067489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eafc06-0ff2-4ef5-ba62-5a5300600804 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:37.068379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eafc06-0ff2-4ef5-ba62-5a5300600804 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:37.068841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eafc06-0ff2-4ef5-ba62-5a5300600804 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:37.069880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eafc06-0ff2-4ef5-ba62-5a5300600804 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/92bc5dad0d2249339fcfde0acddb99a4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:37.077974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eafc06-0ff2-4ef5-ba62-5a5300600804 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:get_group(group_id=92bc5dad0d2249339fcfde0acddb99a4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:37.080437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eafc06-0ff2-4ef5-ba62-5a5300600804 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:37.083329 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2734/5473] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:37 2022] GET /identity/v3/groups/92bc5dad0d2249339fcfde0acddb99a4 => generated 293 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:37.088641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2054b2-609d-4b22-a1a2-3e24bf547a8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:37.105059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2054b2-609d-4b22-a1a2-3e24bf547a8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:37.114914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efed41-fd9d-40a5-873b-f673e975cba5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:37.116000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efed41-fd9d-40a5-873b-f673e975cba5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:37.116290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efed41-fd9d-40a5-873b-f673e975cba5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:37.116572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efed41-fd9d-40a5-873b-f673e975cba5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/92bc5dad0d2249339fcfde0acddb99a4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:37.118094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efed41-fd9d-40a5-873b-f673e975cba5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:update_group(group_id=92bc5dad0d2249339fcfde0acddb99a4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:37.120689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efed41-fd9d-40a5-873b-f673e975cba5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:37.153340 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2740/5474] 10.222.0.27 () {60 vars in 1246 bytes} [Sun Aug 28 18:42:37 2022] PATCH /identity/v3/groups/92bc5dad0d2249339fcfde0acddb99a4 => generated 309 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:37.161492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eafc06-0ff2-4ef5-ba62-5a5300600804 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:37.181562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eafc06-0ff2-4ef5-ba62-5a5300600804 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:37.188250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bfe6b-4dbf-41e1-ae29-2726632fce97 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:37.189021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bfe6b-4dbf-41e1-ae29-2726632fce97 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:37.189454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bfe6b-4dbf-41e1-ae29-2726632fce97 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:37.189888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bfe6b-4dbf-41e1-ae29-2726632fce97 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/92bc5dad0d2249339fcfde0acddb99a4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:37.201256 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bfe6b-4dbf-41e1-ae29-2726632fce97 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:delete_group(group_id=92bc5dad0d2249339fcfde0acddb99a4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:37.203010 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-958bfe6b-4dbf-41e1-ae29-2726632fce97 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:42:37.203010 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:42:37.203010 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:42:37.205616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bfe6b-4dbf-41e1-ae29-2726632fce97 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:37.299571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:37.316048 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2735/5475] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:42:37 2022] DELETE /identity/v3/groups/92bc5dad0d2249339fcfde0acddb99a4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:37.318086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efed41-fd9d-40a5-873b-f673e975cba5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:37.334267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efed41-fd9d-40a5-873b-f673e975cba5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:37.420956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2b24d-4c0e-4c0d-87c3-c49b4ad749c8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:37.422249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2b24d-4c0e-4c0d-87c3-c49b4ad749c8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:37.422812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2b24d-4c0e-4c0d-87c3-c49b4ad749c8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:37.423501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2b24d-4c0e-4c0d-87c3-c49b4ad749c8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:37.424530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2b24d-4c0e-4c0d-87c3-c49b4ad749c8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:37.428714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2b24d-4c0e-4c0d-87c3-c49b4ad749c8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:37.450519 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2741/5476] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Aug 28 18:42:37 2022] POST /identity/v3/groups => generated 327 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:37.456970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bfe6b-4dbf-41e1-ae29-2726632fce97 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:37.482359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bfe6b-4dbf-41e1-ae29-2726632fce97 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:37.487977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1625730-07de-44db-b924-96da381715de tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:37.488588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1625730-07de-44db-b924-96da381715de tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:37.488870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1625730-07de-44db-b924-96da381715de tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:37.489140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1625730-07de-44db-b924-96da381715de tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:37.489782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1625730-07de-44db-b924-96da381715de tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:37.491706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1625730-07de-44db-b924-96da381715de tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:37.534547 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2736/5477] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:37 2022] POST /identity/v3/users => generated 321 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:37.535884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2b24d-4c0e-4c0d-87c3-c49b4ad749c8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:37.546922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2b24d-4c0e-4c0d-87c3-c49b4ad749c8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:37.566144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745130a8-a1d0-446f-94b8-d06da0e1f82d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:37.585823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745130a8-a1d0-446f-94b8-d06da0e1f82d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:37.585823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745130a8-a1d0-446f-94b8-d06da0e1f82d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:37.585823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745130a8-a1d0-446f-94b8-d06da0e1f82d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/6d42aa4061944826b8d442f7d5fe3164` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:37.609452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745130a8-a1d0-446f-94b8-d06da0e1f82d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=eb09f4040d6c4e539159b72754a280c1, user_id=6d42aa4061944826b8d442f7d5fe3164)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:37.611984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745130a8-a1d0-446f-94b8-d06da0e1f82d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:37.652154 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2742/5478] 10.222.0.27 () {60 vars in 1360 bytes} [Sun Aug 28 18:42:37 2022] PUT /identity/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/6d42aa4061944826b8d442f7d5fe3164 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:37.654124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1625730-07de-44db-b924-96da381715de tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:37.670561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1625730-07de-44db-b924-96da381715de tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:37.776603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea4176-b5c5-4f96-8e39-267eacabafb2 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:37.776603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea4176-b5c5-4f96-8e39-267eacabafb2 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:37.776603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea4176-b5c5-4f96-8e39-267eacabafb2 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:37.777258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea4176-b5c5-4f96-8e39-267eacabafb2 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:37.777885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea4176-b5c5-4f96-8e39-267eacabafb2 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:37.780157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea4176-b5c5-4f96-8e39-267eacabafb2 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:37.825169 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2737/5479] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:37 2022] POST /identity/v3/users => generated 321 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:37.826779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745130a8-a1d0-446f-94b8-d06da0e1f82d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:37.840216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745130a8-a1d0-446f-94b8-d06da0e1f82d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:37.874435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93b349-6deb-4302-928e-91b840bfc834 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:37.876085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93b349-6deb-4302-928e-91b840bfc834 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:37.876571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93b349-6deb-4302-928e-91b840bfc834 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:37.878469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93b349-6deb-4302-928e-91b840bfc834 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/a44784f21d8b4b549fe89fcd4462445e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:37.913000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93b349-6deb-4302-928e-91b840bfc834 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=eb09f4040d6c4e539159b72754a280c1, user_id=a44784f21d8b4b549fe89fcd4462445e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:37.917607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93b349-6deb-4302-928e-91b840bfc834 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:37.973384 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2743/5480] 10.222.0.27 () {60 vars in 1360 bytes} [Sun Aug 28 18:42:37 2022] PUT /identity/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/a44784f21d8b4b549fe89fcd4462445e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:37.977424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea4176-b5c5-4f96-8e39-267eacabafb2 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:37.990212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea4176-b5c5-4f96-8e39-267eacabafb2 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:38.070808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66dd83-d651-4719-b354-a35a92f9b3fd tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:38.071639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66dd83-d651-4719-b354-a35a92f9b3fd tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:38.071918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66dd83-d651-4719-b354-a35a92f9b3fd tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:38.072198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66dd83-d651-4719-b354-a35a92f9b3fd tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:38.072909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66dd83-d651-4719-b354-a35a92f9b3fd tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:38.075203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66dd83-d651-4719-b354-a35a92f9b3fd tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:38.146591 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2738/5481] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:37 2022] POST /identity/v3/users => generated 319 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:38.151770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93b349-6deb-4302-928e-91b840bfc834 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:38.192458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93b349-6deb-4302-928e-91b840bfc834 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:38.209215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd217b85-dad3-4e27-875e-9668ac2e6357 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:38.210138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd217b85-dad3-4e27-875e-9668ac2e6357 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:38.210635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd217b85-dad3-4e27-875e-9668ac2e6357 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:38.211074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd217b85-dad3-4e27-875e-9668ac2e6357 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/853bd5fe86c746baad569f62dbf33dbd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:38.231317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:UPDATE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:38.241294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd217b85-dad3-4e27-875e-9668ac2e6357 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=eb09f4040d6c4e539159b72754a280c1, user_id=853bd5fe86c746baad569f62dbf33dbd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:38.251110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd217b85-dad3-4e27-875e-9668ac2e6357 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:38.322934 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2744/5482] 10.222.0.27 () {60 vars in 1360 bytes} [Sun Aug 28 18:42:38 2022] PUT /identity/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/853bd5fe86c746baad569f62dbf33dbd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:38.328184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66dd83-d651-4719-b354-a35a92f9b3fd tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:38.344843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66dd83-d651-4719-b354-a35a92f9b3fd tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:38.462683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:38.480208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920731b6-3953-44ae-85a1-fde0ddcd8522 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:38.481856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920731b6-3953-44ae-85a1-fde0ddcd8522 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:38.482082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920731b6-3953-44ae-85a1-fde0ddcd8522 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:38.482367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920731b6-3953-44ae-85a1-fde0ddcd8522 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/eb09f4040d6c4e539159b72754a280c1/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:38.485318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920731b6-3953-44ae-85a1-fde0ddcd8522 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=eb09f4040d6c4e539159b72754a280c1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:38.488360 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-920731b6-3953-44ae-85a1-fde0ddcd8522 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:42:38.488360 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:42:38.488360 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:42:38.490630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920731b6-3953-44ae-85a1-fde0ddcd8522 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:38.544986 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2739/5483] 10.222.0.27 () {58 vars in 1242 bytes} [Sun Aug 28 18:42:38 2022] GET /identity/v3/groups/eb09f4040d6c4e539159b72754a280c1/users => generated 1077 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:38.548344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd217b85-dad3-4e27-875e-9668ac2e6357 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:38.587315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd217b85-dad3-4e27-875e-9668ac2e6357 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:38.619460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8c956-a195-4ca9-84f4-aa5658e81a17 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:38.624390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8c956-a195-4ca9-84f4-aa5658e81a17 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:38.626487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8c956-a195-4ca9-84f4-aa5658e81a17 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:38.628382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8c956-a195-4ca9-84f4-aa5658e81a17 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/6d42aa4061944826b8d442f7d5fe3164` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:38.633365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8c956-a195-4ca9-84f4-aa5658e81a17 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=eb09f4040d6c4e539159b72754a280c1, user_id=6d42aa4061944826b8d442f7d5fe3164)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:38.640453 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-6bd8c956-a195-4ca9-84f4-aa5658e81a17 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:42:38.640453 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:42:38.640453 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:42:38.644984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8c956-a195-4ca9-84f4-aa5658e81a17 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:38.671160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920731b6-3953-44ae-85a1-fde0ddcd8522 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:38.674672 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2745/5484] 10.222.0.27 () {58 vars in 1342 bytes} [Sun Aug 28 18:42:38 2022] HEAD /identity/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/6d42aa4061944826b8d442f7d5fe3164 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:38.682092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8c956-a195-4ca9-84f4-aa5658e81a17 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:38.684808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6bd8c956-a195-4ca9-84f4-aa5658e81a17 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:38.686747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920731b6-3953-44ae-85a1-fde0ddcd8522 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:38.695958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef51e0-ec90-4b83-bbfb-b1537644bdf0 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:38.696598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef51e0-ec90-4b83-bbfb-b1537644bdf0 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:38.696821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef51e0-ec90-4b83-bbfb-b1537644bdf0 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:38.697090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef51e0-ec90-4b83-bbfb-b1537644bdf0 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/6d42aa4061944826b8d442f7d5fe3164` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:38.702066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef51e0-ec90-4b83-bbfb-b1537644bdf0 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=eb09f4040d6c4e539159b72754a280c1, user_id=6d42aa4061944826b8d442f7d5fe3164)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:38.704226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef51e0-ec90-4b83-bbfb-b1537644bdf0 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:38.715630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-73ef51e0-ec90-4b83-bbfb-b1537644bdf0 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6d42aa4061944826b8d442f7d5fe3164'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:38.738981 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2740/5485] 10.222.0.27 () {58 vars in 1344 bytes} [Sun Aug 28 18:42:38 2022] DELETE /identity/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/6d42aa4061944826b8d442f7d5fe3164 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:38.740149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef51e0-ec90-4b83-bbfb-b1537644bdf0 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:38.787735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8c956-a195-4ca9-84f4-aa5658e81a17 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:38.825363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef51e0-ec90-4b83-bbfb-b1537644bdf0 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:38.832935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f45d3-d6c0-4742-a657-58f2d7707923 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:38.833818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f45d3-d6c0-4742-a657-58f2d7707923 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:38.834273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f45d3-d6c0-4742-a657-58f2d7707923 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:38.834555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f45d3-d6c0-4742-a657-58f2d7707923 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/a44784f21d8b4b549fe89fcd4462445e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:38.836789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f45d3-d6c0-4742-a657-58f2d7707923 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=eb09f4040d6c4e539159b72754a280c1, user_id=a44784f21d8b4b549fe89fcd4462445e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:38.837993 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-6d9f45d3-d6c0-4742-a657-58f2d7707923 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:42:38.837993 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:42:38.837993 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:42:38.839199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f45d3-d6c0-4742-a657-58f2d7707923 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:38.850662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f9496-3b97-4947-badf-d395cd204ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:38.852033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f9496-3b97-4947-badf-d395cd204ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:38.852324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f9496-3b97-4947-badf-d395cd204ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:38.852606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f9496-3b97-4947-badf-d395cd204ec7 admin admin] PATH_INFO: `/v3/users/2a1cab39f20c4a758e9a190f85eeafa7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:38.853943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f9496-3b97-4947-badf-d395cd204ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1cab39f20c4a758e9a190f85eeafa7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:38.855071 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2741/5486] 10.222.0.27 () {58 vars in 1342 bytes} [Sun Aug 28 18:42:38 2022] HEAD /identity/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/a44784f21d8b4b549fe89fcd4462445e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:38.855962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f9496-3b97-4947-badf-d395cd204ec7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:38.859457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f45d3-d6c0-4742-a657-58f2d7707923 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:38.871564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f45d3-d6c0-4742-a657-58f2d7707923 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:38.876782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b2478-f5da-4aaf-bfcb-b45990dc108f tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:38.877431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b2478-f5da-4aaf-bfcb-b45990dc108f tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:38.877916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b2478-f5da-4aaf-bfcb-b45990dc108f tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:38.878255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b2478-f5da-4aaf-bfcb-b45990dc108f tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/a44784f21d8b4b549fe89fcd4462445e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:38.879951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b2478-f5da-4aaf-bfcb-b45990dc108f tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=eb09f4040d6c4e539159b72754a280c1, user_id=a44784f21d8b4b549fe89fcd4462445e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:38.881945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b2478-f5da-4aaf-bfcb-b45990dc108f tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:38.889611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca2b2478-f5da-4aaf-bfcb-b45990dc108f tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a44784f21d8b4b549fe89fcd4462445e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:38.911149 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2742/5487] 10.222.0.27 () {58 vars in 1344 bytes} [Sun Aug 28 18:42:38 2022] DELETE /identity/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/a44784f21d8b4b549fe89fcd4462445e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:38.912386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b2478-f5da-4aaf-bfcb-b45990dc108f tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:38.923039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b3f9496-3b97-4947-badf-d395cd204ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1cab39f20c4a758e9a190f85eeafa7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:38.924221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b3f9496-3b97-4947-badf-d395cd204ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1cab39f20c4a758e9a190f85eeafa7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:38.934977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b3f9496-3b97-4947-badf-d395cd204ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1cab39f20c4a758e9a190f85eeafa7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:38.953382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b3f9496-3b97-4947-badf-d395cd204ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1cab39f20c4a758e9a190f85eeafa7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:38.967917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:38.975142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b3f9496-3b97-4947-badf-d395cd204ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1cab39f20c4a758e9a190f85eeafa7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:38.987358 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2746/5488] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:38 2022] DELETE /identity/v3/users/2a1cab39f20c4a758e9a190f85eeafa7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:39.004328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b2478-f5da-4aaf-bfcb-b45990dc108f tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:39.072940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:39.092680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24062e-309f-4ba6-98e0-262ba6d0c7d7 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:39.093347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24062e-309f-4ba6-98e0-262ba6d0c7d7 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:39.093630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24062e-309f-4ba6-98e0-262ba6d0c7d7 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:39.093908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24062e-309f-4ba6-98e0-262ba6d0c7d7 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/853bd5fe86c746baad569f62dbf33dbd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:39.095689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24062e-309f-4ba6-98e0-262ba6d0c7d7 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=eb09f4040d6c4e539159b72754a280c1, user_id=853bd5fe86c746baad569f62dbf33dbd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:39.097769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24062e-309f-4ba6-98e0-262ba6d0c7d7 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:39.111822 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2743/5489] 10.222.0.27 () {58 vars in 1342 bytes} [Sun Aug 28 18:42:38 2022] HEAD /identity/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/853bd5fe86c746baad569f62dbf33dbd => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:39.115984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f9496-3b97-4947-badf-d395cd204ec7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:39.117573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9b3f9496-3b97-4947-badf-d395cd204ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:39.132978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f9496-3b97-4947-badf-d395cd204ec7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:39.139289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5bb04-fc1a-4f22-9cb4-7d838be9ebd5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:39.140794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5bb04-fc1a-4f22-9cb4-7d838be9ebd5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:39.141242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5bb04-fc1a-4f22-9cb4-7d838be9ebd5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:39.141709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5bb04-fc1a-4f22-9cb4-7d838be9ebd5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/853bd5fe86c746baad569f62dbf33dbd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:39.144221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5bb04-fc1a-4f22-9cb4-7d838be9ebd5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=eb09f4040d6c4e539159b72754a280c1, user_id=853bd5fe86c746baad569f62dbf33dbd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:39.145600 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-6bc5bb04-fc1a-4f22-9cb4-7d838be9ebd5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:42:39.145600 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:42:39.145600 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:42:39.147149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5bb04-fc1a-4f22-9cb4-7d838be9ebd5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:39.157209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6bc5bb04-fc1a-4f22-9cb4-7d838be9ebd5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '853bd5fe86c746baad569f62dbf33dbd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.177338 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2747/5490] 10.222.0.27 () {58 vars in 1344 bytes} [Sun Aug 28 18:42:39 2022] DELETE /identity/v3/groups/eb09f4040d6c4e539159b72754a280c1/users/853bd5fe86c746baad569f62dbf33dbd => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:39.182031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24062e-309f-4ba6-98e0-262ba6d0c7d7 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:39.196026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24062e-309f-4ba6-98e0-262ba6d0c7d7 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:39.204575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5bb04-fc1a-4f22-9cb4-7d838be9ebd5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:39.209189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6bc5bb04-fc1a-4f22-9cb4-7d838be9ebd5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:39.270163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46b2c2-1032-445e-930c-5ae2de526e8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:39.270995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46b2c2-1032-445e-930c-5ae2de526e8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:39.271477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46b2c2-1032-445e-930c-5ae2de526e8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:39.271760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46b2c2-1032-445e-930c-5ae2de526e8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/eb09f4040d6c4e539159b72754a280c1/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:39.273035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46b2c2-1032-445e-930c-5ae2de526e8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=eb09f4040d6c4e539159b72754a280c1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:39.275025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46b2c2-1032-445e-930c-5ae2de526e8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:39.286797 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2744/5491] 10.222.0.27 () {58 vars in 1242 bytes} [Sun Aug 28 18:42:39 2022] GET /identity/v3/groups/eb09f4040d6c4e539159b72754a280c1/users => generated 145 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:39.292507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46b2c2-1032-445e-930c-5ae2de526e8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:39.304491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46b2c2-1032-445e-930c-5ae2de526e8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:39.311802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff0ff3-bbe9-4112-b094-c220f3407916 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:39.312547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff0ff3-bbe9-4112-b094-c220f3407916 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:39.312925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff0ff3-bbe9-4112-b094-c220f3407916 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:39.319508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff0ff3-bbe9-4112-b094-c220f3407916 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/users/853bd5fe86c746baad569f62dbf33dbd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:39.321478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5bb04-fc1a-4f22-9cb4-7d838be9ebd5 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:39.321846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff0ff3-bbe9-4112-b094-c220f3407916 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:delete_user(user_id=853bd5fe86c746baad569f62dbf33dbd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:39.324674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff0ff3-bbe9-4112-b094-c220f3407916 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:39.329023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837289e7-a651-4bb1-a05a-60bd96fe5d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:39.329675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837289e7-a651-4bb1-a05a-60bd96fe5d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:39.329980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837289e7-a651-4bb1-a05a-60bd96fe5d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:39.330251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837289e7-a651-4bb1-a05a-60bd96fe5d53 admin admin] PATH_INFO: `/v3/projects/219bcef679bc4c61a2b23ab9c29e3a93` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:39.331653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837289e7-a651-4bb1-a05a-60bd96fe5d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=219bcef679bc4c61a2b23ab9c29e3a93)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:39.333920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837289e7-a651-4bb1-a05a-60bd96fe5d53 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:39.381336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-beff0ff3-bbe9-4112-b094-c220f3407916 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '853bd5fe86c746baad569f62dbf33dbd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.392606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-837289e7-a651-4bb1-a05a-60bd96fe5d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219bcef679bc4c61a2b23ab9c29e3a93', 'request_id': 'req-837289e7-a651-4bb1-a05a-60bd96fe5d53'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.396516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-beff0ff3-bbe9-4112-b094-c220f3407916 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '853bd5fe86c746baad569f62dbf33dbd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.397652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-beff0ff3-bbe9-4112-b094-c220f3407916 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '853bd5fe86c746baad569f62dbf33dbd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.398740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-beff0ff3-bbe9-4112-b094-c220f3407916 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '853bd5fe86c746baad569f62dbf33dbd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.401488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-837289e7-a651-4bb1-a05a-60bd96fe5d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219bcef679bc4c61a2b23ab9c29e3a93', 'request_id': 'req-837289e7-a651-4bb1-a05a-60bd96fe5d53'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.408045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-beff0ff3-bbe9-4112-b094-c220f3407916 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '853bd5fe86c746baad569f62dbf33dbd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.408339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-837289e7-a651-4bb1-a05a-60bd96fe5d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219bcef679bc4c61a2b23ab9c29e3a93', 'request_id': 'req-837289e7-a651-4bb1-a05a-60bd96fe5d53'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.421461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-837289e7-a651-4bb1-a05a-60bd96fe5d53 admin admin] The token cache is being invalidate because project 219bcef679bc4c61a2b23ab9c29e3a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:39.421754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-837289e7-a651-4bb1-a05a-60bd96fe5d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.422442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-837289e7-a651-4bb1-a05a-60bd96fe5d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.424024 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2748/5492] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:39 2022] DELETE /identity/v3/projects/219bcef679bc4c61a2b23ab9c29e3a93 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:39.427844 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2745/5493] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:39 2022] DELETE /identity/v3/users/853bd5fe86c746baad569f62dbf33dbd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:39.429248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff0ff3-bbe9-4112-b094-c220f3407916 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:39.429594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c94948-a0f9-4473-8634-d4ca9542c1a2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:39.430092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c94948-a0f9-4473-8634-d4ca9542c1a2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:39.430444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c94948-a0f9-4473-8634-d4ca9542c1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:39.431084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-beff0ff3-bbe9-4112-b094-c220f3407916 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:39.450859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-41c94948-a0f9-4473-8634-d4ca9542c1a2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:39.452188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-41c94948-a0f9-4473-8634-d4ca9542c1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:39.489710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:39.512763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff0ff3-bbe9-4112-b094-c220f3407916 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:39.514477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:39.521441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519077f0-335d-4536-bac9-265d65505a12 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:39.522168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519077f0-335d-4536-bac9-265d65505a12 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:39.522648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519077f0-335d-4536-bac9-265d65505a12 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:39.523200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519077f0-335d-4536-bac9-265d65505a12 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/users/a44784f21d8b4b549fe89fcd4462445e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:39.524699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519077f0-335d-4536-bac9-265d65505a12 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a44784f21d8b4b549fe89fcd4462445e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:39.525815 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2749/5494] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:42:39.527467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519077f0-335d-4536-bac9-265d65505a12 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:39.534216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8a884-c84d-4c03-bf74-128ac15dd1d6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:39.534584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8a884-c84d-4c03-bf74-128ac15dd1d6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:39.534910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8a884-c84d-4c03-bf74-128ac15dd1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:39.557352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4ce8a884-c84d-4c03-bf74-128ac15dd1d6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:39.560452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4ce8a884-c84d-4c03-bf74-128ac15dd1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:39.569807 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2750/5495] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:42:39.574607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8a884-c84d-4c03-bf74-128ac15dd1d6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:39.586888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8a884-c84d-4c03-bf74-128ac15dd1d6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:39.587149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-519077f0-335d-4536-bac9-265d65505a12 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a44784f21d8b4b549fe89fcd4462445e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.591715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7b5b0-97b7-4158-b42b-121ea4c3d05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:39.592330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7b5b0-97b7-4158-b42b-121ea4c3d05b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:39.592606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7b5b0-97b7-4158-b42b-121ea4c3d05b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:39.592885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7b5b0-97b7-4158-b42b-121ea4c3d05b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:39.593587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7b5b0-97b7-4158-b42b-121ea4c3d05b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:42:39.593887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7b5b0-97b7-4158-b42b-121ea4c3d05b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:39.595520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7b5b0-97b7-4158-b42b-121ea4c3d05b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:39.600879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-519077f0-335d-4536-bac9-265d65505a12 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a44784f21d8b4b549fe89fcd4462445e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.601797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-519077f0-335d-4536-bac9-265d65505a12 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a44784f21d8b4b549fe89fcd4462445e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.602413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-519077f0-335d-4536-bac9-265d65505a12 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a44784f21d8b4b549fe89fcd4462445e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.611294 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2751/5496] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:39.611464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-519077f0-335d-4536-bac9-265d65505a12 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a44784f21d8b4b549fe89fcd4462445e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.613008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7b5b0-97b7-4158-b42b-121ea4c3d05b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:39.615873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-15f7b5b0-97b7-4158-b42b-121ea4c3d05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:39.626805 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2746/5497] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:39 2022] DELETE /identity/v3/users/a44784f21d8b4b549fe89fcd4462445e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:39.629863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7b5b0-97b7-4158-b42b-121ea4c3d05b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:39.630914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519077f0-335d-4536-bac9-265d65505a12 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:39.632766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-519077f0-335d-4536-bac9-265d65505a12 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:39.695549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff2529-b0a1-4571-be41-8f26c3fb257f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:39.696162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2529-b0a1-4571-be41-8f26c3fb257f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:39.696441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2529-b0a1-4571-be41-8f26c3fb257f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:39.696714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2529-b0a1-4571-be41-8f26c3fb257f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:39.697750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff2529-b0a1-4571-be41-8f26c3fb257f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:39.699451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff2529-b0a1-4571-be41-8f26c3fb257f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:39.705165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519077f0-335d-4536-bac9-265d65505a12 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:39.711953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64928bca-2c90-4497-8fda-7e29721ca0c6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:39.712815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64928bca-2c90-4497-8fda-7e29721ca0c6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:39.713285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64928bca-2c90-4497-8fda-7e29721ca0c6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:39.713570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64928bca-2c90-4497-8fda-7e29721ca0c6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/users/6d42aa4061944826b8d442f7d5fe3164` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:39.714742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64928bca-2c90-4497-8fda-7e29721ca0c6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6d42aa4061944826b8d442f7d5fe3164)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:39.716771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64928bca-2c90-4497-8fda-7e29721ca0c6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:39.735342 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2752/5498] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:39 2022] POST /identity/v3/projects => generated 389 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:39.740163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff2529-b0a1-4571-be41-8f26c3fb257f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:39.773235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64928bca-2c90-4497-8fda-7e29721ca0c6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d42aa4061944826b8d442f7d5fe3164'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.786764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64928bca-2c90-4497-8fda-7e29721ca0c6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d42aa4061944826b8d442f7d5fe3164'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.787523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64928bca-2c90-4497-8fda-7e29721ca0c6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d42aa4061944826b8d442f7d5fe3164'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.788287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64928bca-2c90-4497-8fda-7e29721ca0c6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d42aa4061944826b8d442f7d5fe3164'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.791116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:39.800751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64928bca-2c90-4497-8fda-7e29721ca0c6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d42aa4061944826b8d442f7d5fe3164'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:39.812950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff2529-b0a1-4571-be41-8f26c3fb257f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:39.816117 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2747/5499] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:39 2022] DELETE /identity/v3/users/6d42aa4061944826b8d442f7d5fe3164 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:39.820027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441ccca-19ba-4633-af66-2b0bdacfac38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:39.820765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64928bca-2c90-4497-8fda-7e29721ca0c6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:39.820916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441ccca-19ba-4633-af66-2b0bdacfac38 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:39.820916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441ccca-19ba-4633-af66-2b0bdacfac38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:39.821183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441ccca-19ba-4633-af66-2b0bdacfac38 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:39.821819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441ccca-19ba-4633-af66-2b0bdacfac38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:39.822336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-64928bca-2c90-4497-8fda-7e29721ca0c6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:39.823834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441ccca-19ba-4633-af66-2b0bdacfac38 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:39.857770 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2753/5500] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:39 2022] POST /identity/v3/users => generated 295 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:39.858921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441ccca-19ba-4633-af66-2b0bdacfac38 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:39.860882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3441ccca-19ba-4633-af66-2b0bdacfac38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:39.874124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441ccca-19ba-4633-af66-2b0bdacfac38 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:39.900184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64928bca-2c90-4497-8fda-7e29721ca0c6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:39.905290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1936c4-8ad0-45b6-95b0-1b34a8c6253b tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:39.906047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1936c4-8ad0-45b6-95b0-1b34a8c6253b tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:39.906479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1936c4-8ad0-45b6-95b0-1b34a8c6253b tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:39.906858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1936c4-8ad0-45b6-95b0-1b34a8c6253b tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/eb09f4040d6c4e539159b72754a280c1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:39.908195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1936c4-8ad0-45b6-95b0-1b34a8c6253b tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:delete_group(group_id=eb09f4040d6c4e539159b72754a280c1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:39.910318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1936c4-8ad0-45b6-95b0-1b34a8c6253b tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:39.934165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:39.947924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa4dee-7648-4bee-89a3-30e5d8a2cff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:39.948709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa4dee-7648-4bee-89a3-30e5d8a2cff5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:39.949151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa4dee-7648-4bee-89a3-30e5d8a2cff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:39.949550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa4dee-7648-4bee-89a3-30e5d8a2cff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:39.950451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa4dee-7648-4bee-89a3-30e5d8a2cff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:39.953634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa4dee-7648-4bee-89a3-30e5d8a2cff5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:39.966993 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2754/5501] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:39.970543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa4dee-7648-4bee-89a3-30e5d8a2cff5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:39.971061 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2748/5502] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:42:39 2022] DELETE /identity/v3/groups/eb09f4040d6c4e539159b72754a280c1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:39.976560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1936c4-8ad0-45b6-95b0-1b34a8c6253b tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:39.987947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa4dee-7648-4bee-89a3-30e5d8a2cff5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:40.055015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1936c4-8ad0-45b6-95b0-1b34a8c6253b tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:40.060603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1566cb-082f-4255-9ed8-9dbf29e07a43 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:40.061220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1566cb-082f-4255-9ed8-9dbf29e07a43 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:40.061504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1566cb-082f-4255-9ed8-9dbf29e07a43 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:40.061776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1566cb-082f-4255-9ed8-9dbf29e07a43 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:40.063061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1566cb-082f-4255-9ed8-9dbf29e07a43 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:40.064672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d6852-26f1-466f-a5da-96faa2fd0ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:40.064999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1566cb-082f-4255-9ed8-9dbf29e07a43 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:40.065451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d6852-26f1-466f-a5da-96faa2fd0ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:40.065840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d6852-26f1-466f-a5da-96faa2fd0ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:40.066180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d6852-26f1-466f-a5da-96faa2fd0ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:40.067029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d6852-26f1-466f-a5da-96faa2fd0ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:40.068747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d6852-26f1-466f-a5da-96faa2fd0ef5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:40.085437 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2755/5503] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:40.086447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d6852-26f1-466f-a5da-96faa2fd0ef5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:40.088640 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2749/5504] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Aug 28 18:42:39 2022] POST /identity/v3/groups => generated 327 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:40.090193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1566cb-082f-4255-9ed8-9dbf29e07a43 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:40.092342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-737d6852-26f1-466f-a5da-96faa2fd0ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:40.106094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1566cb-082f-4255-9ed8-9dbf29e07a43 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:40.113093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6e66c-c514-42a2-8b68-fc69bd9c7598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:40.113766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6e66c-c514-42a2-8b68-fc69bd9c7598 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:40.114049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6e66c-c514-42a2-8b68-fc69bd9c7598 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:40.114630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6e66c-c514-42a2-8b68-fc69bd9c7598 admin admin] PATH_INFO: `/v3/projects/1bc4395bb17f4145999f78703a016ea1/users/16fedc13d7fd4e82bffc0e34e476266b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:40.140875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6e66c-c514-42a2-8b68-fc69bd9c7598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc4395bb17f4145999f78703a016ea1, user_id=16fedc13d7fd4e82bffc0e34e476266b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:40.146711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6e66c-c514-42a2-8b68-fc69bd9c7598 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:40.171515 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2750/5505] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:40 2022] PUT /identity/v3/projects/1bc4395bb17f4145999f78703a016ea1/users/16fedc13d7fd4e82bffc0e34e476266b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:40.175211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6e66c-c514-42a2-8b68-fc69bd9c7598 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:40.200929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:40.238376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d6852-26f1-466f-a5da-96faa2fd0ef5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:40.277504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6e66c-c514-42a2-8b68-fc69bd9c7598 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:40.279859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e6268-7c3e-4706-8977-cf47fdf2fa8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:40.281357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e6268-7c3e-4706-8977-cf47fdf2fa8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:40.281832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e6268-7c3e-4706-8977-cf47fdf2fa8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:40.282282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e6268-7c3e-4706-8977-cf47fdf2fa8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:40.282929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e6268-7c3e-4706-8977-cf47fdf2fa8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:40.284898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e6268-7c3e-4706-8977-cf47fdf2fa8d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:40.302689 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2751/5506] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Aug 28 18:42:40 2022] POST /identity/v3/groups => generated 327 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:40.306701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa96f4e-ba4f-42a9-8223-c29663caed4f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:40.306993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa96f4e-ba4f-42a9-8223-c29663caed4f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:40.307269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa96f4e-ba4f-42a9-8223-c29663caed4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:40.326931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1aa96f4e-ba4f-42a9-8223-c29663caed4f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:40.328192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1aa96f4e-ba4f-42a9-8223-c29663caed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:40.336144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b93a1-0aa9-48e7-b8b2-98cf697c397f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:40.336896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b93a1-0aa9-48e7-b8b2-98cf697c397f service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:40.337668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b93a1-0aa9-48e7-b8b2-98cf697c397f service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:40.337927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b93a1-0aa9-48e7-b8b2-98cf697c397f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:40.340007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-323b93a1-0aa9-48e7-b8b2-98cf697c397f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:40.354680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:40.402092 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2752/5507] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:40.402943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa96f4e-ba4f-42a9-8223-c29663caed4f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:40.420268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa96f4e-ba4f-42a9-8223-c29663caed4f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:40.425292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47e159-0f32-42f1-8316-bddb3a997afc tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:40.426111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47e159-0f32-42f1-8316-bddb3a997afc tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:40.426398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47e159-0f32-42f1-8316-bddb3a997afc tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:40.426784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47e159-0f32-42f1-8316-bddb3a997afc tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:40.430272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47e159-0f32-42f1-8316-bddb3a997afc tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:40.430272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47e159-0f32-42f1-8316-bddb3a997afc tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:40.438138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b93a1-0aa9-48e7-b8b2-98cf697c397f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:40.439812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b93a1-0aa9-48e7-b8b2-98cf697c397f service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:40.452032 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2753/5508] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Aug 28 18:42:40 2022] POST /identity/v3/groups => generated 326 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:40.453150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47e159-0f32-42f1-8316-bddb3a997afc tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:40.456388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9c47e159-0f32-42f1-8316-bddb3a997afc tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:40.464914 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2756/5509] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:40.465973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b93a1-0aa9-48e7-b8b2-98cf697c397f service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:40.476995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b93a1-0aa9-48e7-b8b2-98cf697c397f service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:40.482773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b07fd8-2b07-457a-91cb-b04e5d4e2075 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:40.483682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b07fd8-2b07-457a-91cb-b04e5d4e2075 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:40.484063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b07fd8-2b07-457a-91cb-b04e5d4e2075 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:40.484578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b07fd8-2b07-457a-91cb-b04e5d4e2075 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:40.485320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b07fd8-2b07-457a-91cb-b04e5d4e2075 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:40.486438 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-31b07fd8-2b07-457a-91cb-b04e5d4e2075 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:42:40.486438 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:42:40.486438 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:42:40.487863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b07fd8-2b07-457a-91cb-b04e5d4e2075 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:40.501866 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2757/5510] 10.222.0.27 () {58 vars in 1125 bytes} [Sun Aug 28 18:42:40 2022] GET /identity/v3/groups => generated 1490 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:40.502962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b07fd8-2b07-457a-91cb-b04e5d4e2075 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:40.514400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b07fd8-2b07-457a-91cb-b04e5d4e2075 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:40.519642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ae3e4-1e3a-4d46-bda9-7a028a7a7670 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:40.520425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ae3e4-1e3a-4d46-bda9-7a028a7a7670 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:40.520807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ae3e4-1e3a-4d46-bda9-7a028a7a7670 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:40.521192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ae3e4-1e3a-4d46-bda9-7a028a7a7670 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/b1ddd70eb98144a78540f4fc3cac9feb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:40.527269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ae3e4-1e3a-4d46-bda9-7a028a7a7670 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b1ddd70eb98144a78540f4fc3cac9feb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:40.529629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ae3e4-1e3a-4d46-bda9-7a028a7a7670 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:40.546306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47e159-0f32-42f1-8316-bddb3a997afc tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:40.551264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d28591-3a90-4f70-96c2-fbb9e938f302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:40.552083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d28591-3a90-4f70-96c2-fbb9e938f302 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:40.552373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d28591-3a90-4f70-96c2-fbb9e938f302 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:40.552776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d28591-3a90-4f70-96c2-fbb9e938f302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:40.569660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d28591-3a90-4f70-96c2-fbb9e938f302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:40.571578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d28591-3a90-4f70-96c2-fbb9e938f302 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:40.584843 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2754/5511] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:40.607373 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2758/5512] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:42:40 2022] DELETE /identity/v3/groups/b1ddd70eb98144a78540f4fc3cac9feb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:40.611190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d28591-3a90-4f70-96c2-fbb9e938f302 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:40.624113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d28591-3a90-4f70-96c2-fbb9e938f302 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:40.729472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:40.791562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff43e0d-ddfd-4a56-aea0-a49ce2f7f225 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:40.793015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff43e0d-ddfd-4a56-aea0-a49ce2f7f225 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:40.793300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff43e0d-ddfd-4a56-aea0-a49ce2f7f225 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:40.793963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff43e0d-ddfd-4a56-aea0-a49ce2f7f225 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/f1560e0f171b457c92c635b96cbd4d13` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:40.803181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff43e0d-ddfd-4a56-aea0-a49ce2f7f225 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f1560e0f171b457c92c635b96cbd4d13)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:40.806170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff43e0d-ddfd-4a56-aea0-a49ce2f7f225 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:40.879386 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2755/5513] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:42:40 2022] DELETE /identity/v3/groups/f1560e0f171b457c92c635b96cbd4d13 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:40.880596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ae3e4-1e3a-4d46-bda9-7a028a7a7670 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:40.903764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ae3e4-1e3a-4d46-bda9-7a028a7a7670 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:40.979008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a771c-4b5f-46d7-afeb-0fe3838c7e9d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:40.979772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a771c-4b5f-46d7-afeb-0fe3838c7e9d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:40.980059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a771c-4b5f-46d7-afeb-0fe3838c7e9d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:40.980463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a771c-4b5f-46d7-afeb-0fe3838c7e9d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/9e2d3ba44c0c46dab756c061a445fdcd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:40.986218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a771c-4b5f-46d7-afeb-0fe3838c7e9d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9e2d3ba44c0c46dab756c061a445fdcd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:40.988390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a771c-4b5f-46d7-afeb-0fe3838c7e9d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:41.031874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:41.041692 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2759/5514] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:42:40 2022] DELETE /identity/v3/groups/9e2d3ba44c0c46dab756c061a445fdcd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:41.047900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff43e0d-ddfd-4a56-aea0-a49ce2f7f225 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:41.064140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff43e0d-ddfd-4a56-aea0-a49ce2f7f225 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:41.133289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ee2a5-3d71-416f-885c-f9586ab637c8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:41.135004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ee2a5-3d71-416f-885c-f9586ab637c8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:41.135549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ee2a5-3d71-416f-885c-f9586ab637c8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:41.136059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ee2a5-3d71-416f-885c-f9586ab637c8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:41.136943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ee2a5-3d71-416f-885c-f9586ab637c8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:41.139138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ee2a5-3d71-416f-885c-f9586ab637c8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:41.177390 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2756/5515] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:41 2022] POST /identity/v3/users => generated 323 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:41.181865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a771c-4b5f-46d7-afeb-0fe3838c7e9d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:41.194888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a771c-4b5f-46d7-afeb-0fe3838c7e9d tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:41.200466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe236a89-6fd6-421f-946a-da4939f64309 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:41.201182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe236a89-6fd6-421f-946a-da4939f64309 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:41.201467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe236a89-6fd6-421f-946a-da4939f64309 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:41.201746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe236a89-6fd6-421f-946a-da4939f64309 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:41.202390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe236a89-6fd6-421f-946a-da4939f64309 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:41.204478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe236a89-6fd6-421f-946a-da4939f64309 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:41.220805 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2760/5516] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Aug 28 18:42:41 2022] POST /identity/v3/groups => generated 326 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:41.225457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ee2a5-3d71-416f-885c-f9586ab637c8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:41.236964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ee2a5-3d71-416f-885c-f9586ab637c8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:41.242078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def83c25-89e7-4a22-b43e-59016b5a9791 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:41.242864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def83c25-89e7-4a22-b43e-59016b5a9791 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:41.243217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def83c25-89e7-4a22-b43e-59016b5a9791 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:41.243616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def83c25-89e7-4a22-b43e-59016b5a9791 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/cdbd3014461f462096592464046eb1ed/users/75ece4bda1eb4c85a809edeb5a41e7a9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:41.264280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def83c25-89e7-4a22-b43e-59016b5a9791 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=cdbd3014461f462096592464046eb1ed, user_id=75ece4bda1eb4c85a809edeb5a41e7a9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:41.266615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def83c25-89e7-4a22-b43e-59016b5a9791 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:41.291302 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2757/5517] 10.222.0.27 () {60 vars in 1360 bytes} [Sun Aug 28 18:42:41 2022] PUT /identity/v3/groups/cdbd3014461f462096592464046eb1ed/users/75ece4bda1eb4c85a809edeb5a41e7a9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:41.295508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe236a89-6fd6-421f-946a-da4939f64309 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:41.307479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe236a89-6fd6-421f-946a-da4939f64309 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:41.369761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1089aab-7fdb-46ea-a130-52a1d2d313a8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:41.370405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1089aab-7fdb-46ea-a130-52a1d2d313a8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:41.370767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1089aab-7fdb-46ea-a130-52a1d2d313a8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:41.371044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1089aab-7fdb-46ea-a130-52a1d2d313a8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:41.371891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1089aab-7fdb-46ea-a130-52a1d2d313a8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:41.375287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1089aab-7fdb-46ea-a130-52a1d2d313a8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:41.390924 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2761/5518] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Aug 28 18:42:41 2022] POST /identity/v3/groups => generated 326 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:41.395275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def83c25-89e7-4a22-b43e-59016b5a9791 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:41.407496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def83c25-89e7-4a22-b43e-59016b5a9791 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:41.412516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76fa15-4ced-4b7e-998d-c6d09b0ccc96 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:41.413164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76fa15-4ced-4b7e-998d-c6d09b0ccc96 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:41.413565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76fa15-4ced-4b7e-998d-c6d09b0ccc96 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:41.413845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76fa15-4ced-4b7e-998d-c6d09b0ccc96 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/d92a4551de8242f4b41dd5fb2420ab95/users/75ece4bda1eb4c85a809edeb5a41e7a9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:41.419660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76fa15-4ced-4b7e-998d-c6d09b0ccc96 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=d92a4551de8242f4b41dd5fb2420ab95, user_id=75ece4bda1eb4c85a809edeb5a41e7a9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:41.421709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76fa15-4ced-4b7e-998d-c6d09b0ccc96 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:41.458998 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2758/5519] 10.222.0.27 () {60 vars in 1360 bytes} [Sun Aug 28 18:42:41 2022] PUT /identity/v3/groups/d92a4551de8242f4b41dd5fb2420ab95/users/75ece4bda1eb4c85a809edeb5a41e7a9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:41.462697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1089aab-7fdb-46ea-a130-52a1d2d313a8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:41.478410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1089aab-7fdb-46ea-a130-52a1d2d313a8 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:41.616549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c6ed7-704f-4e28-bb17-538946de0eba tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:41.617178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c6ed7-704f-4e28-bb17-538946de0eba tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:41.617459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c6ed7-704f-4e28-bb17-538946de0eba tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:41.617734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c6ed7-704f-4e28-bb17-538946de0eba tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/users/75ece4bda1eb4c85a809edeb5a41e7a9/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:41.625173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c6ed7-704f-4e28-bb17-538946de0eba tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=75ece4bda1eb4c85a809edeb5a41e7a9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:41.627477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c6ed7-704f-4e28-bb17-538946de0eba tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:41.659307 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2762/5520] 10.222.0.27 () {58 vars in 1242 bytes} [Sun Aug 28 18:42:41 2022] GET /identity/v3/users/75ece4bda1eb4c85a809edeb5a41e7a9/groups => generated 838 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:41.662067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76fa15-4ced-4b7e-998d-c6d09b0ccc96 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:41.676536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76fa15-4ced-4b7e-998d-c6d09b0ccc96 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:41.681937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a15d06-a8de-40c8-b2a7-362fd35946e6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:41.682958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a15d06-a8de-40c8-b2a7-362fd35946e6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:41.682958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a15d06-a8de-40c8-b2a7-362fd35946e6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:41.682958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a15d06-a8de-40c8-b2a7-362fd35946e6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/d92a4551de8242f4b41dd5fb2420ab95` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:41.684311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a15d06-a8de-40c8-b2a7-362fd35946e6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d92a4551de8242f4b41dd5fb2420ab95)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:41.686235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a15d06-a8de-40c8-b2a7-362fd35946e6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:41.710134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:41.795688 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2759/5521] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:42:41 2022] DELETE /identity/v3/groups/d92a4551de8242f4b41dd5fb2420ab95 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:41.800656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c6ed7-704f-4e28-bb17-538946de0eba tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:41.811801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c6ed7-704f-4e28-bb17-538946de0eba tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:41.899366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6c019-7100-40e7-b417-154e5e93b4cb tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:41.900018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6c019-7100-40e7-b417-154e5e93b4cb tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:41.900300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6c019-7100-40e7-b417-154e5e93b4cb tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:41.900721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6c019-7100-40e7-b417-154e5e93b4cb tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/groups/cdbd3014461f462096592464046eb1ed` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:41.902581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6c019-7100-40e7-b417-154e5e93b4cb tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:delete_group(group_id=cdbd3014461f462096592464046eb1ed)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:41.905302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6c019-7100-40e7-b417-154e5e93b4cb tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:41.916785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:41.986521 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2763/5522] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:42:41 2022] DELETE /identity/v3/groups/cdbd3014461f462096592464046eb1ed => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:41.991460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a15d06-a8de-40c8-b2a7-362fd35946e6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:42.004785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a15d06-a8de-40c8-b2a7-362fd35946e6 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:42.080446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d699f-77a1-4582-8f27-58bffe9ceac4 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:42.081193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d699f-77a1-4582-8f27-58bffe9ceac4 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:42.081591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d699f-77a1-4582-8f27-58bffe9ceac4 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:42.082374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d699f-77a1-4582-8f27-58bffe9ceac4 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/users/75ece4bda1eb4c85a809edeb5a41e7a9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:42.084315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d699f-77a1-4582-8f27-58bffe9ceac4 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:delete_user(user_id=75ece4bda1eb4c85a809edeb5a41e7a9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:42.086426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d699f-77a1-4582-8f27-58bffe9ceac4 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:42.147039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4b7d699f-77a1-4582-8f27-58bffe9ceac4 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ece4bda1eb4c85a809edeb5a41e7a9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.162429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4b7d699f-77a1-4582-8f27-58bffe9ceac4 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ece4bda1eb4c85a809edeb5a41e7a9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.163772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4b7d699f-77a1-4582-8f27-58bffe9ceac4 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ece4bda1eb4c85a809edeb5a41e7a9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.164947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4b7d699f-77a1-4582-8f27-58bffe9ceac4 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ece4bda1eb4c85a809edeb5a41e7a9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.178867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4b7d699f-77a1-4582-8f27-58bffe9ceac4 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ece4bda1eb4c85a809edeb5a41e7a9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.203280 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2760/5523] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:41 2022] DELETE /identity/v3/users/75ece4bda1eb4c85a809edeb5a41e7a9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:42.209235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6c019-7100-40e7-b417-154e5e93b4cb tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:42.211183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94e6c019-7100-40e7-b417-154e5e93b4cb tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:42.225230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6c019-7100-40e7-b417-154e5e93b4cb tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:42.292107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a54fae-d198-489f-819e-885f5c630606 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:42.292988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a54fae-d198-489f-819e-885f5c630606 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:42.293425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a54fae-d198-489f-819e-885f5c630606 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:42.293796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a54fae-d198-489f-819e-885f5c630606 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/domains/1d9db0fef27444ee932d7480f1ec941f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:42.295421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a54fae-d198-489f-819e-885f5c630606 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1d9db0fef27444ee932d7480f1ec941f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:42.297173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a54fae-d198-489f-819e-885f5c630606 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:42.338010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e0a54fae-d198-489f-819e-885f5c630606 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1d9db0fef27444ee932d7480f1ec941f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.338897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e0a54fae-d198-489f-819e-885f5c630606 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1d9db0fef27444ee932d7480f1ec941f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.391995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e0a54fae-d198-489f-819e-885f5c630606 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1d9db0fef27444ee932d7480f1ec941f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.392749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e0a54fae-d198-489f-819e-885f5c630606 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1d9db0fef27444ee932d7480f1ec941f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.397774 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2764/5524] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:42:42 2022] PATCH /identity/v3/domains/1d9db0fef27444ee932d7480f1ec941f => generated 276 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:42.401979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d699f-77a1-4582-8f27-58bffe9ceac4 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:42.414019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d699f-77a1-4582-8f27-58bffe9ceac4 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:42.487799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:42.514662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011038ce-e98e-43e3-b8be-5a7e50d5e2da tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e192487cfb47b79d9b68466f41df8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fdfb920fbe6496c8b68cdb6b5962771', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:42.515621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011038ce-e98e-43e3-b8be-5a7e50d5e2da tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:42.516012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011038ce-e98e-43e3-b8be-5a7e50d5e2da tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:42.516517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011038ce-e98e-43e3-b8be-5a7e50d5e2da tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] PATH_INFO: `/v3/domains/1d9db0fef27444ee932d7480f1ec941f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:42.535007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011038ce-e98e-43e3-b8be-5a7e50d5e2da tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1d9db0fef27444ee932d7480f1ec941f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:42.537015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011038ce-e98e-43e3-b8be-5a7e50d5e2da tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:42.603147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-011038ce-e98e-43e3-b8be-5a7e50d5e2da tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1d9db0fef27444ee932d7480f1ec941f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.632732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-011038ce-e98e-43e3-b8be-5a7e50d5e2da tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1d9db0fef27444ee932d7480f1ec941f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.701566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-011038ce-e98e-43e3-b8be-5a7e50d5e2da tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9db0fef27444ee932d7480f1ec941f', 'request_id': 'req-011038ce-e98e-43e3-b8be-5a7e50d5e2da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.713321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-011038ce-e98e-43e3-b8be-5a7e50d5e2da tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9db0fef27444ee932d7480f1ec941f', 'request_id': 'req-011038ce-e98e-43e3-b8be-5a7e50d5e2da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.725356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-011038ce-e98e-43e3-b8be-5a7e50d5e2da tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9db0fef27444ee932d7480f1ec941f', 'request_id': 'req-011038ce-e98e-43e3-b8be-5a7e50d5e2da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.748041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-011038ce-e98e-43e3-b8be-5a7e50d5e2da tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] The token cache is being invalidate because project 1d9db0fef27444ee932d7480f1ec941f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:42.748353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-011038ce-e98e-43e3-b8be-5a7e50d5e2da tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.749262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-011038ce-e98e-43e3-b8be-5a7e50d5e2da tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.759161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-011038ce-e98e-43e3-b8be-5a7e50d5e2da tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1d9db0fef27444ee932d7480f1ec941f', 'request_id': 'req-011038ce-e98e-43e3-b8be-5a7e50d5e2da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.763115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-011038ce-e98e-43e3-b8be-5a7e50d5e2da tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1d9db0fef27444ee932d7480f1ec941f', 'request_id': 'req-011038ce-e98e-43e3-b8be-5a7e50d5e2da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.763790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-011038ce-e98e-43e3-b8be-5a7e50d5e2da tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1d9db0fef27444ee932d7480f1ec941f', 'request_id': 'req-011038ce-e98e-43e3-b8be-5a7e50d5e2da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:42.775139 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2761/5525] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:42:42 2022] DELETE /identity/v3/domains/1d9db0fef27444ee932d7480f1ec941f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:42.776934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a54fae-d198-489f-819e-885f5c630606 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:42.779542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e0a54fae-d198-489f-819e-885f5c630606 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:42.887996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a54fae-d198-489f-819e-885f5c630606 tempest-GroupsV3TestJSON-588628837 tempest-GroupsV3TestJSON-588628837-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:42.980847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:43.011816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4b7b4-dca4-42c7-9550-701170e301db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:43.012720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4b7b4-dca4-42c7-9550-701170e301db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:43.014235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4b7b4-dca4-42c7-9550-701170e301db admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:43.014584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4b7b4-dca4-42c7-9550-701170e301db admin admin] PATH_INFO: `/v3/users/17d0512b2a3a4692bf7341353b0730d5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:43.016589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4b7b4-dca4-42c7-9550-701170e301db admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d0512b2a3a4692bf7341353b0730d5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:43.019768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4b7b4-dca4-42c7-9550-701170e301db admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:43.157063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cea4b7b4-dca4-42c7-9550-701170e301db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d0512b2a3a4692bf7341353b0730d5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:43.157805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cea4b7b4-dca4-42c7-9550-701170e301db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d0512b2a3a4692bf7341353b0730d5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:43.166733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cea4b7b4-dca4-42c7-9550-701170e301db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d0512b2a3a4692bf7341353b0730d5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:43.181997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cea4b7b4-dca4-42c7-9550-701170e301db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d0512b2a3a4692bf7341353b0730d5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:43.218639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cea4b7b4-dca4-42c7-9550-701170e301db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d0512b2a3a4692bf7341353b0730d5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:43.226513 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2765/5526] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:42 2022] DELETE /identity/v3/users/17d0512b2a3a4692bf7341353b0730d5 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:43.231329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b808d-b744-4d54-baaa-7dce2cb17481 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:43.232216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b808d-b744-4d54-baaa-7dce2cb17481 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:43.232560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b808d-b744-4d54-baaa-7dce2cb17481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:43.265042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dd1b808d-b744-4d54-baaa-7dce2cb17481 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:43.266549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dd1b808d-b744-4d54-baaa-7dce2cb17481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:43.365514 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2762/5527] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:43.377627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4b7b4-dca4-42c7-9550-701170e301db admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:43.379140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cea4b7b4-dca4-42c7-9550-701170e301db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:43.443614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4b7b4-dca4-42c7-9550-701170e301db admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:43.448175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb1d4d-79ba-4d1d-a841-75c703ed4475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:43.448883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb1d4d-79ba-4d1d-a841-75c703ed4475 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:43.449356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb1d4d-79ba-4d1d-a841-75c703ed4475 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:43.449894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb1d4d-79ba-4d1d-a841-75c703ed4475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:43.460723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb1d4d-79ba-4d1d-a841-75c703ed4475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:43.462269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb1d4d-79ba-4d1d-a841-75c703ed4475 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:43.473024 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2766/5528] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:43.839085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c873e-f546-41d6-9fc6-092ca46abe51 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:43.839859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c873e-f546-41d6-9fc6-092ca46abe51 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:43.840763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c873e-f546-41d6-9fc6-092ca46abe51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:43.920999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9b0c873e-f546-41d6-9fc6-092ca46abe51 None None] MFA Rules not processed for user `17d15356bf2941b2927f238f00ec836f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:43.927911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9b0c873e-f546-41d6-9fc6-092ca46abe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:43.960707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb1d4d-79ba-4d1d-a841-75c703ed4475 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:43.962109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0feb1d4d-79ba-4d1d-a841-75c703ed4475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:44.016609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb1d4d-79ba-4d1d-a841-75c703ed4475 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:44.019421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:44.033915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ef200-951c-4684-83c8-ed681a2d9f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:44.034579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ef200-951c-4684-83c8-ed681a2d9f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:44.035576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ef200-951c-4684-83c8-ed681a2d9f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:44.035576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ef200-951c-4684-83c8-ed681a2d9f14 admin admin] PATH_INFO: `/v3/projects/014977f02fec4e3994227d5e1f6a6c33` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:44.044024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ef200-951c-4684-83c8-ed681a2d9f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=014977f02fec4e3994227d5e1f6a6c33)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:44.046269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ef200-951c-4684-83c8-ed681a2d9f14 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:44.168451 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2763/5529] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:44.178522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad9ef200-951c-4684-83c8-ed681a2d9f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '014977f02fec4e3994227d5e1f6a6c33', 'request_id': 'req-ad9ef200-951c-4684-83c8-ed681a2d9f14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:44.182996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:44.222762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad9ef200-951c-4684-83c8-ed681a2d9f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '014977f02fec4e3994227d5e1f6a6c33', 'request_id': 'req-ad9ef200-951c-4684-83c8-ed681a2d9f14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:44.236733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad9ef200-951c-4684-83c8-ed681a2d9f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '014977f02fec4e3994227d5e1f6a6c33', 'request_id': 'req-ad9ef200-951c-4684-83c8-ed681a2d9f14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:44.254564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad9ef200-951c-4684-83c8-ed681a2d9f14 admin admin] The token cache is being invalidate because project 014977f02fec4e3994227d5e1f6a6c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:44.254859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad9ef200-951c-4684-83c8-ed681a2d9f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:44.255762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad9ef200-951c-4684-83c8-ed681a2d9f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:44.257444 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2767/5530] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:43 2022] DELETE /identity/v3/projects/014977f02fec4e3994227d5e1f6a6c33 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:44.264381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c873e-f546-41d6-9fc6-092ca46abe51 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:44.299619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c873e-f546-41d6-9fc6-092ca46abe51 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:44.365035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1f4ab-6563-4fca-bbb0-ebf095cc7cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:44.366007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1f4ab-6563-4fca-bbb0-ebf095cc7cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:44.366007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1f4ab-6563-4fca-bbb0-ebf095cc7cad admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:44.366385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1f4ab-6563-4fca-bbb0-ebf095cc7cad admin admin] PATH_INFO: `/v3/users/74e192487cfb47b79d9b68466f41df8e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:44.367846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1f4ab-6563-4fca-bbb0-ebf095cc7cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e192487cfb47b79d9b68466f41df8e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:44.370052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1f4ab-6563-4fca-bbb0-ebf095cc7cad admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:44.452499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3af1f4ab-6563-4fca-bbb0-ebf095cc7cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e192487cfb47b79d9b68466f41df8e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:44.474470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3af1f4ab-6563-4fca-bbb0-ebf095cc7cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e192487cfb47b79d9b68466f41df8e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:44.476041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3af1f4ab-6563-4fca-bbb0-ebf095cc7cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e192487cfb47b79d9b68466f41df8e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:44.477062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3af1f4ab-6563-4fca-bbb0-ebf095cc7cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e192487cfb47b79d9b68466f41df8e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:44.488193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3af1f4ab-6563-4fca-bbb0-ebf095cc7cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e192487cfb47b79d9b68466f41df8e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:44.504686 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2764/5531] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:44 2022] DELETE /identity/v3/users/74e192487cfb47b79d9b68466f41df8e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:45.001515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ef200-951c-4684-83c8-ed681a2d9f14 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:45.004059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad9ef200-951c-4684-83c8-ed681a2d9f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:45.101587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ef200-951c-4684-83c8-ed681a2d9f14 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:45.172384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f4d1f-3424-4cc4-b829-bf7b67139fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:45.173308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f4d1f-3424-4cc4-b829-bf7b67139fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:45.173684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f4d1f-3424-4cc4-b829-bf7b67139fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:45.174056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f4d1f-3424-4cc4-b829-bf7b67139fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:45.176029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f6f4d1f-3424-4cc4-b829-bf7b67139fa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:45.187965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f4d1f-3424-4cc4-b829-bf7b67139fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:45.189539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f4d1f-3424-4cc4-b829-bf7b67139fa3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:45.204391 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2768/5532] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:45.334498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1f4ab-6563-4fca-bbb0-ebf095cc7cad admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:45.336194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3af1f4ab-6563-4fca-bbb0-ebf095cc7cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:45.472270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:45.538018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1f4ab-6563-4fca-bbb0-ebf095cc7cad admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:45.552835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62058580-d835-412f-8d5f-b3136a4a3f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:45.554602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62058580-d835-412f-8d5f-b3136a4a3f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:45.555596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62058580-d835-412f-8d5f-b3136a4a3f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:45.556032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62058580-d835-412f-8d5f-b3136a4a3f44 admin admin] PATH_INFO: `/v3/projects/4fdfb920fbe6496c8b68cdb6b5962771` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:45.559222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62058580-d835-412f-8d5f-b3136a4a3f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fdfb920fbe6496c8b68cdb6b5962771)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:45.563150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62058580-d835-412f-8d5f-b3136a4a3f44 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:45.665600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62058580-d835-412f-8d5f-b3136a4a3f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fdfb920fbe6496c8b68cdb6b5962771', 'request_id': 'req-62058580-d835-412f-8d5f-b3136a4a3f44'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:45.676676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62058580-d835-412f-8d5f-b3136a4a3f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fdfb920fbe6496c8b68cdb6b5962771', 'request_id': 'req-62058580-d835-412f-8d5f-b3136a4a3f44'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:45.684916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62058580-d835-412f-8d5f-b3136a4a3f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fdfb920fbe6496c8b68cdb6b5962771', 'request_id': 'req-62058580-d835-412f-8d5f-b3136a4a3f44'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:45.709754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62058580-d835-412f-8d5f-b3136a4a3f44 admin admin] The token cache is being invalidate because project 4fdfb920fbe6496c8b68cdb6b5962771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:45.710290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62058580-d835-412f-8d5f-b3136a4a3f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:45.711672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62058580-d835-412f-8d5f-b3136a4a3f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:45.714049 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2765/5533] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:45 2022] DELETE /identity/v3/projects/4fdfb920fbe6496c8b68cdb6b5962771 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:45.718808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ae599-d51d-4f66-a21e-c241c1bc7307 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:45.719315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ae599-d51d-4f66-a21e-c241c1bc7307 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:45.719749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ae599-d51d-4f66-a21e-c241c1bc7307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:45.743011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2f9ae599-d51d-4f66-a21e-c241c1bc7307 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:45.744485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2f9ae599-d51d-4f66-a21e-c241c1bc7307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:45.856195 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2769/5534] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:45.865267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579f2ca-19d8-4ab1-9748-15ddd7415d42 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:45.865703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579f2ca-19d8-4ab1-9748-15ddd7415d42 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:45.865987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579f2ca-19d8-4ab1-9748-15ddd7415d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:45.890661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d579f2ca-19d8-4ab1-9748-15ddd7415d42 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:45.892002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d579f2ca-19d8-4ab1-9748-15ddd7415d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:45.902752 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2766/5535] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:45.906668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ae599-d51d-4f66-a21e-c241c1bc7307 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:45.917683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ae599-d51d-4f66-a21e-c241c1bc7307 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:45.923864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd07d9-6eec-46ce-96f3-c7198dc2bcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:45.924750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd07d9-6eec-46ce-96f3-c7198dc2bcbe admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:45.925347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd07d9-6eec-46ce-96f3-c7198dc2bcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:45.925806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd07d9-6eec-46ce-96f3-c7198dc2bcbe admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:45.926621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd07d9-6eec-46ce-96f3-c7198dc2bcbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:42:45.927085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd07d9-6eec-46ce-96f3-c7198dc2bcbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:45.928909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd07d9-6eec-46ce-96f3-c7198dc2bcbe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:45.943861 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2770/5536] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:45.948312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579f2ca-19d8-4ab1-9748-15ddd7415d42 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:45.961201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579f2ca-19d8-4ab1-9748-15ddd7415d42 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:45.967915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55f58f-40d8-46ad-afd8-247413e60c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:45.968901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f58f-40d8-46ad-afd8-247413e60c01 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:45.969415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f58f-40d8-46ad-afd8-247413e60c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:45.970630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f58f-40d8-46ad-afd8-247413e60c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:45.971497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55f58f-40d8-46ad-afd8-247413e60c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:45.974750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55f58f-40d8-46ad-afd8-247413e60c01 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:46.011213 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2767/5537] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:45 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:46.014940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd07d9-6eec-46ce-96f3-c7198dc2bcbe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:46.027910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd07d9-6eec-46ce-96f3-c7198dc2bcbe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:46.075402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:46.133459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ab9df-d208-420a-9849-e72c2d7d5d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:46.134215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ab9df-d208-420a-9849-e72c2d7d5d01 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:46.134886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ab9df-d208-420a-9849-e72c2d7d5d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:46.135756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ab9df-d208-420a-9849-e72c2d7d5d01 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:46.137229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ab9df-d208-420a-9849-e72c2d7d5d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:46.145601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ab9df-d208-420a-9849-e72c2d7d5d01 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:46.209560 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2771/5538] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:46 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:46.210632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55f58f-40d8-46ad-afd8-247413e60c01 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:46.229832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55f58f-40d8-46ad-afd8-247413e60c01 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:46.248138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc183cd-9c32-4dfe-b728-d264e2aa9109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:46.249037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc183cd-9c32-4dfe-b728-d264e2aa9109 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:46.249683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc183cd-9c32-4dfe-b728-d264e2aa9109 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:46.250691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc183cd-9c32-4dfe-b728-d264e2aa9109 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:46.251768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc183cd-9c32-4dfe-b728-d264e2aa9109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:46.254119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc183cd-9c32-4dfe-b728-d264e2aa9109 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:46.267824 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2768/5539] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:42:46.272623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ab9df-d208-420a-9849-e72c2d7d5d01 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:46.289338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ab9df-d208-420a-9849-e72c2d7d5d01 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:46.297124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48981e8-8720-4e7e-a273-e5673492c3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:46.297810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48981e8-8720-4e7e-a273-e5673492c3bf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:46.298094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48981e8-8720-4e7e-a273-e5673492c3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:46.298370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48981e8-8720-4e7e-a273-e5673492c3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:46.299235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48981e8-8720-4e7e-a273-e5673492c3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:46.301760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48981e8-8720-4e7e-a273-e5673492c3bf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:46.317492 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2772/5540] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:46.321534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc183cd-9c32-4dfe-b728-d264e2aa9109 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:46.332333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc183cd-9c32-4dfe-b728-d264e2aa9109 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:46.337624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f818ec-e42d-4e0d-97e7-9d0af32ec502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:46.338427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f818ec-e42d-4e0d-97e7-9d0af32ec502 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:46.338837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f818ec-e42d-4e0d-97e7-9d0af32ec502 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:46.339284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f818ec-e42d-4e0d-97e7-9d0af32ec502 admin admin] PATH_INFO: `/v3/projects/86e5595c4c0f4388939ed8efa639eadb/users/b47e09f44aef4be09ce4acd4e2b27399/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:46.357178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f818ec-e42d-4e0d-97e7-9d0af32ec502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e5595c4c0f4388939ed8efa639eadb, user_id=b47e09f44aef4be09ce4acd4e2b27399, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:46.360232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f818ec-e42d-4e0d-97e7-9d0af32ec502 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:46.393853 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2769/5541] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:46 2022] PUT /identity/v3/projects/86e5595c4c0f4388939ed8efa639eadb/users/b47e09f44aef4be09ce4acd4e2b27399/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:46.395793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3eb2e-1424-499c-8f70-a811e0633b0b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:46.396180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3eb2e-1424-499c-8f70-a811e0633b0b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:46.396559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3eb2e-1424-499c-8f70-a811e0633b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:46.429584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c0a3eb2e-1424-499c-8f70-a811e0633b0b None None] MFA Rules not processed for user `b47e09f44aef4be09ce4acd4e2b27399`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:46.431040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c0a3eb2e-1424-499c-8f70-a811e0633b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:46.526045 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2773/5542] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:46.530668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f818ec-e42d-4e0d-97e7-9d0af32ec502 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:46.605249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f818ec-e42d-4e0d-97e7-9d0af32ec502 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:46.612005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0343c98-ccb6-4990-9a60-ca74b6797e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:46.612854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0343c98-ccb6-4990-9a60-ca74b6797e3a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:46.613770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0343c98-ccb6-4990-9a60-ca74b6797e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:46.614463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0343c98-ccb6-4990-9a60-ca74b6797e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:46.615248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0343c98-ccb6-4990-9a60-ca74b6797e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:46.617745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0343c98-ccb6-4990-9a60-ca74b6797e3a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:46.664473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:46.712560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3eb2e-1424-499c-8f70-a811e0633b0b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:46.721879 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2770/5543] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:46 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:46.737307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3eb2e-1424-499c-8f70-a811e0633b0b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:46.907664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db538b-5964-4fbb-9b5a-7c9797aa05ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:46.908259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db538b-5964-4fbb-9b5a-7c9797aa05ac admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:46.908541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db538b-5964-4fbb-9b5a-7c9797aa05ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:46.908999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db538b-5964-4fbb-9b5a-7c9797aa05ac admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:46.909656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db538b-5964-4fbb-9b5a-7c9797aa05ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:46.911685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db538b-5964-4fbb-9b5a-7c9797aa05ac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:46.946037 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2774/5544] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:46 2022] POST /identity/v3/users => generated 300 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:46.950336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0343c98-ccb6-4990-9a60-ca74b6797e3a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:46.975330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0343c98-ccb6-4990-9a60-ca74b6797e3a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:47.011583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7acdd-7e3f-492e-be23-8503b6d1e48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:47.012268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7acdd-7e3f-492e-be23-8503b6d1e48d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:47.012550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7acdd-7e3f-492e-be23-8503b6d1e48d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:47.013020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7acdd-7e3f-492e-be23-8503b6d1e48d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:47.013768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7acdd-7e3f-492e-be23-8503b6d1e48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:47.015344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7acdd-7e3f-492e-be23-8503b6d1e48d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:47.043587 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2771/5545] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:47.046459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db538b-5964-4fbb-9b5a-7c9797aa05ac admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:47.058362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db538b-5964-4fbb-9b5a-7c9797aa05ac admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:47.064844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25135197-39e8-4783-9058-8b5bb8e9a272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:47.065858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25135197-39e8-4783-9058-8b5bb8e9a272 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:47.066252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25135197-39e8-4783-9058-8b5bb8e9a272 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:47.066837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25135197-39e8-4783-9058-8b5bb8e9a272 admin admin] PATH_INFO: `/v3/projects/ef957e15e66247699007fa79e0c17ae7/users/587db3ee471f4c4a84323dba41c149b4/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:47.113800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25135197-39e8-4783-9058-8b5bb8e9a272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef957e15e66247699007fa79e0c17ae7, user_id=587db3ee471f4c4a84323dba41c149b4, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:47.120712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25135197-39e8-4783-9058-8b5bb8e9a272 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:47.156442 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2775/5546] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:47 2022] PUT /identity/v3/projects/ef957e15e66247699007fa79e0c17ae7/users/587db3ee471f4c4a84323dba41c149b4/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:47.160649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7acdd-7e3f-492e-be23-8503b6d1e48d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:47.177604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7acdd-7e3f-492e-be23-8503b6d1e48d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:47.336672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236382c4-bbbc-480b-93b3-2374373b4c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:47.337395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236382c4-bbbc-480b-93b3-2374373b4c0d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:47.337766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236382c4-bbbc-480b-93b3-2374373b4c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:47.338339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236382c4-bbbc-480b-93b3-2374373b4c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:47.338872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236382c4-bbbc-480b-93b3-2374373b4c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:47.341255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236382c4-bbbc-480b-93b3-2374373b4c0d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:47.395437 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2772/5547] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:47.397347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25135197-39e8-4783-9058-8b5bb8e9a272 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:47.404750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:47.417299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25135197-39e8-4783-9058-8b5bb8e9a272 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:47.435286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca850a-7f83-4f05-850b-99bffe6ca5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:47.436115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca850a-7f83-4f05-850b-99bffe6ca5f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:47.436403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca850a-7f83-4f05-850b-99bffe6ca5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:47.436684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca850a-7f83-4f05-850b-99bffe6ca5f4 admin admin] PATH_INFO: `/v3/projects/ef957e15e66247699007fa79e0c17ae7/users/587db3ee471f4c4a84323dba41c149b4/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:47.442938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca850a-7f83-4f05-850b-99bffe6ca5f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef957e15e66247699007fa79e0c17ae7, user_id=587db3ee471f4c4a84323dba41c149b4, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:47.449071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca850a-7f83-4f05-850b-99bffe6ca5f4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:47.485447 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2776/5548] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:47 2022] PUT /identity/v3/projects/ef957e15e66247699007fa79e0c17ae7/users/587db3ee471f4c4a84323dba41c149b4/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:47.496527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ba981-31ee-4053-b32d-2de2654357d3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:47.496964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ba981-31ee-4053-b32d-2de2654357d3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:47.497260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ba981-31ee-4053-b32d-2de2654357d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:47.621089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-333ba981-31ee-4053-b32d-2de2654357d3 None None] MFA Rules not processed for user `587db3ee471f4c4a84323dba41c149b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:47.626149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-333ba981-31ee-4053-b32d-2de2654357d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:47.843790 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2773/5549] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:47.849917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca850a-7f83-4f05-850b-99bffe6ca5f4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:47.871041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca850a-7f83-4f05-850b-99bffe6ca5f4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:47.885872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8d491-2de4-4599-b77e-681eb136055c tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587db3ee471f4c4a84323dba41c149b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef957e15e66247699007fa79e0c17ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:47.886701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8d491-2de4-4599-b77e-681eb136055c tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:47.887035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8d491-2de4-4599-b77e-681eb136055c tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:47.887529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8d491-2de4-4599-b77e-681eb136055c tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] PATH_INFO: `/v3/projects/86e5595c4c0f4388939ed8efa639eadb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:47.889389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8d491-2de4-4599-b77e-681eb136055c tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorizing `identity:get_project(project_id=86e5595c4c0f4388939ed8efa639eadb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:47.893090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8d491-2de4-4599-b77e-681eb136055c tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:47.894230 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2777/5550] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:42:47 2022] GET /identity/v3/projects/86e5595c4c0f4388939ed8efa639eadb => generated 389 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:47.899458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ba981-31ee-4053-b32d-2de2654357d3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:47.916763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ba981-31ee-4053-b32d-2de2654357d3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:47.923014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03b39f-522a-45af-8689-8f0f94f0eaba tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587db3ee471f4c4a84323dba41c149b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef957e15e66247699007fa79e0c17ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:47.924266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03b39f-522a-45af-8689-8f0f94f0eaba tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:47.925142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03b39f-522a-45af-8689-8f0f94f0eaba tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:47.925636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03b39f-522a-45af-8689-8f0f94f0eaba tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:47.926700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03b39f-522a-45af-8689-8f0f94f0eaba tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:47.930155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03b39f-522a-45af-8689-8f0f94f0eaba tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:48.019943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8d491-2de4-4599-b77e-681eb136055c tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:48.020449 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2774/5551] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:42:47 2022] POST /identity/v3/projects => generated 338 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:48.034598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8d491-2de4-4599-b77e-681eb136055c tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:48.198674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc2ce4-5be9-4c4f-989b-9557a4daffad tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587db3ee471f4c4a84323dba41c149b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef957e15e66247699007fa79e0c17ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:48.206167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc2ce4-5be9-4c4f-989b-9557a4daffad tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:48.207498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc2ce4-5be9-4c4f-989b-9557a4daffad tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:48.208037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc2ce4-5be9-4c4f-989b-9557a4daffad tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:48.209314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc2ce4-5be9-4c4f-989b-9557a4daffad tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:48.212335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc2ce4-5be9-4c4f-989b-9557a4daffad tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:48.261275 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2778/5552] 10.222.0.27 () {58 vars in 1131 bytes} [Sun Aug 28 18:42:48 2022] GET /identity/v3/projects => generated 6573 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:48.264599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03b39f-522a-45af-8689-8f0f94f0eaba tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:48.295686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03b39f-522a-45af-8689-8f0f94f0eaba tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:48.320597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2750051-3492-461d-a1a0-6150fc025638 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587db3ee471f4c4a84323dba41c149b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef957e15e66247699007fa79e0c17ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:48.321263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2750051-3492-461d-a1a0-6150fc025638 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:48.321549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2750051-3492-461d-a1a0-6150fc025638 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:48.321830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2750051-3492-461d-a1a0-6150fc025638 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] PATH_INFO: `/v3/projects/86e5595c4c0f4388939ed8efa639eadb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:48.328681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2750051-3492-461d-a1a0-6150fc025638 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorizing `identity:get_project(project_id=86e5595c4c0f4388939ed8efa639eadb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:48.340723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2750051-3492-461d-a1a0-6150fc025638 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:48.352102 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2775/5553] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:42:48 2022] GET /identity/v3/projects/86e5595c4c0f4388939ed8efa639eadb => generated 389 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:48.353757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc2ce4-5be9-4c4f-989b-9557a4daffad tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:48.378483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc2ce4-5be9-4c4f-989b-9557a4daffad tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:48.392953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24245e-0486-401c-acf0-6f3d2e0505f8 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587db3ee471f4c4a84323dba41c149b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef957e15e66247699007fa79e0c17ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:48.393393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24245e-0486-401c-acf0-6f3d2e0505f8 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:48.393859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24245e-0486-401c-acf0-6f3d2e0505f8 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:48.394149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24245e-0486-401c-acf0-6f3d2e0505f8 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] PATH_INFO: `/v3/projects/e3429af1316449b780b2de5e7a9783a8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:48.395881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24245e-0486-401c-acf0-6f3d2e0505f8 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorizing `identity:get_project(project_id=e3429af1316449b780b2de5e7a9783a8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:48.413456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24245e-0486-401c-acf0-6f3d2e0505f8 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:48.419804 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2779/5554] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:42:48 2022] GET /identity/v3/projects/e3429af1316449b780b2de5e7a9783a8 => generated 338 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:48.421251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2750051-3492-461d-a1a0-6150fc025638 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:48.436039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2750051-3492-461d-a1a0-6150fc025638 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:48.442294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014cae5-17d0-492f-872c-e36a01db582f tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587db3ee471f4c4a84323dba41c149b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef957e15e66247699007fa79e0c17ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:48.443225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014cae5-17d0-492f-872c-e36a01db582f tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:48.443886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014cae5-17d0-492f-872c-e36a01db582f tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:48.444466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014cae5-17d0-492f-872c-e36a01db582f tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:48.445429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014cae5-17d0-492f-872c-e36a01db582f tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:48.448855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014cae5-17d0-492f-872c-e36a01db582f tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:48.480240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24245e-0486-401c-acf0-6f3d2e0505f8 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:48.481008 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2776/5555] 10.222.0.27 () {58 vars in 1131 bytes} [Sun Aug 28 18:42:48 2022] GET /identity/v3/projects => generated 6573 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:42:48.491545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24245e-0486-401c-acf0-6f3d2e0505f8 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:48.499124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2139b8-9bb2-4dca-bf23-2db2c33f026a tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587db3ee471f4c4a84323dba41c149b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef957e15e66247699007fa79e0c17ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:48.500099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2139b8-9bb2-4dca-bf23-2db2c33f026a tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:48.500635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2139b8-9bb2-4dca-bf23-2db2c33f026a tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:48.501099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2139b8-9bb2-4dca-bf23-2db2c33f026a tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:48.502021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2139b8-9bb2-4dca-bf23-2db2c33f026a tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:42:48.502533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2139b8-9bb2-4dca-bf23-2db2c33f026a tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:48.505146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2139b8-9bb2-4dca-bf23-2db2c33f026a tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:48.540198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014cae5-17d0-492f-872c-e36a01db582f tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:48.562380 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2780/5556] 10.222.0.27 () {58 vars in 1166 bytes} [Sun Aug 28 18:42:48 2022] GET /identity/v3/projects?domain_id=default => generated 6242 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:42:48.570148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014cae5-17d0-492f-872c-e36a01db582f tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:48.587605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d58046-29be-4a30-9e81-21c9f8f1185b tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587db3ee471f4c4a84323dba41c149b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef957e15e66247699007fa79e0c17ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:48.588347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d58046-29be-4a30-9e81-21c9f8f1185b tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:48.588704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d58046-29be-4a30-9e81-21c9f8f1185b tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:48.589202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d58046-29be-4a30-9e81-21c9f8f1185b tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:48.589999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d58046-29be-4a30-9e81-21c9f8f1185b tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:48.594688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d58046-29be-4a30-9e81-21c9f8f1185b tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:48.626753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2139b8-9bb2-4dca-bf23-2db2c33f026a tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:48.633580 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2777/5557] 10.222.0.27 () {58 vars in 1131 bytes} [Sun Aug 28 18:42:48 2022] GET /identity/v3/projects => generated 6573 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:42:48.639282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2139b8-9bb2-4dca-bf23-2db2c33f026a tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:48.644475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111bd549-4389-4789-9a73-5588e2478cf3 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587db3ee471f4c4a84323dba41c149b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef957e15e66247699007fa79e0c17ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:48.645189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bd549-4389-4789-9a73-5588e2478cf3 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:48.645544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bd549-4389-4789-9a73-5588e2478cf3 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:48.645892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bd549-4389-4789-9a73-5588e2478cf3 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:48.646686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111bd549-4389-4789-9a73-5588e2478cf3 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:42:48.647060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111bd549-4389-4789-9a73-5588e2478cf3 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:48.649397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111bd549-4389-4789-9a73-5588e2478cf3 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:48.669480 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2781/5558] 10.222.0.27 () {58 vars in 1166 bytes} [Sun Aug 28 18:42:48 2022] GET /identity/v3/projects?domain_id=default => generated 6242 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:48.675084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d58046-29be-4a30-9e81-21c9f8f1185b tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:48.686061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d58046-29be-4a30-9e81-21c9f8f1185b tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:48.705480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cde6b1-1ae9-4122-b30e-fbec08005226 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587db3ee471f4c4a84323dba41c149b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef957e15e66247699007fa79e0c17ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:48.706183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde6b1-1ae9-4122-b30e-fbec08005226 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:48.706464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde6b1-1ae9-4122-b30e-fbec08005226 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:48.706782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde6b1-1ae9-4122-b30e-fbec08005226 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:48.707857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cde6b1-1ae9-4122-b30e-fbec08005226 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:48.710878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cde6b1-1ae9-4122-b30e-fbec08005226 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:48.715673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:48.768929 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2778/5559] 10.222.0.27 () {58 vars in 1131 bytes} [Sun Aug 28 18:42:48 2022] GET /identity/v3/projects => generated 6573 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:48.773633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111bd549-4389-4789-9a73-5588e2478cf3 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:48.788408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111bd549-4389-4789-9a73-5588e2478cf3 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:48.796282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba5aa3-933f-4c67-a15f-1fc58ede3033 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587db3ee471f4c4a84323dba41c149b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef957e15e66247699007fa79e0c17ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:48.797007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba5aa3-933f-4c67-a15f-1fc58ede3033 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:48.797348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba5aa3-933f-4c67-a15f-1fc58ede3033 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:48.797635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba5aa3-933f-4c67-a15f-1fc58ede3033 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:48.798579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba5aa3-933f-4c67-a15f-1fc58ede3033 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1965363547) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:42:48.798894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba5aa3-933f-4c67-a15f-1fc58ede3033 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:48.801346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba5aa3-933f-4c67-a15f-1fc58ede3033 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:48.827042 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2782/5560] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Aug 28 18:42:48 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1965363547 => generated 537 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:48.832220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cde6b1-1ae9-4122-b30e-fbec08005226 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:48.846869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cde6b1-1ae9-4122-b30e-fbec08005226 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:48.863908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40f76c-88b6-4ec2-b00a-7561352e4f98 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587db3ee471f4c4a84323dba41c149b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef957e15e66247699007fa79e0c17ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:48.864820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40f76c-88b6-4ec2-b00a-7561352e4f98 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:48.865165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40f76c-88b6-4ec2-b00a-7561352e4f98 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:48.865603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40f76c-88b6-4ec2-b00a-7561352e4f98 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] PATH_INFO: `/v3/projects/e3429af1316449b780b2de5e7a9783a8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:48.867286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40f76c-88b6-4ec2-b00a-7561352e4f98 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e3429af1316449b780b2de5e7a9783a8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:48.873290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40f76c-88b6-4ec2-b00a-7561352e4f98 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:48.962178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a40f76c-88b6-4ec2-b00a-7561352e4f98 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3429af1316449b780b2de5e7a9783a8', 'request_id': 'req-1a40f76c-88b6-4ec2-b00a-7561352e4f98'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:48.969543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a40f76c-88b6-4ec2-b00a-7561352e4f98 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3429af1316449b780b2de5e7a9783a8', 'request_id': 'req-1a40f76c-88b6-4ec2-b00a-7561352e4f98'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:48.980582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a40f76c-88b6-4ec2-b00a-7561352e4f98 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3429af1316449b780b2de5e7a9783a8', 'request_id': 'req-1a40f76c-88b6-4ec2-b00a-7561352e4f98'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:48.999634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a40f76c-88b6-4ec2-b00a-7561352e4f98 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] The token cache is being invalidate because project e3429af1316449b780b2de5e7a9783a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:48.999948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a40f76c-88b6-4ec2-b00a-7561352e4f98 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:49.000640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a40f76c-88b6-4ec2-b00a-7561352e4f98 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:49.006270 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2779/5561] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:48 2022] DELETE /identity/v3/projects/e3429af1316449b780b2de5e7a9783a8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:49.008182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba5aa3-933f-4c67-a15f-1fc58ede3033 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:49.010224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-71ba5aa3-933f-4c67-a15f-1fc58ede3033 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:49.135405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba5aa3-933f-4c67-a15f-1fc58ede3033 tempest-ListProjectsStaticTestJSON-390956605 tempest-ListProjectsStaticTestJSON-390956605-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:49.190292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:49.210280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cad7a1-4162-42dd-8797-aaecc38e2c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:49.210983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cad7a1-4162-42dd-8797-aaecc38e2c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:49.210983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cad7a1-4162-42dd-8797-aaecc38e2c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:49.211179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cad7a1-4162-42dd-8797-aaecc38e2c92 admin admin] PATH_INFO: `/v3/users/b47e09f44aef4be09ce4acd4e2b27399` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:49.222415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cad7a1-4162-42dd-8797-aaecc38e2c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b47e09f44aef4be09ce4acd4e2b27399)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:49.228329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cad7a1-4162-42dd-8797-aaecc38e2c92 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:49.341173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07cad7a1-4162-42dd-8797-aaecc38e2c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b47e09f44aef4be09ce4acd4e2b27399'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:49.341798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07cad7a1-4162-42dd-8797-aaecc38e2c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b47e09f44aef4be09ce4acd4e2b27399'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:49.356001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07cad7a1-4162-42dd-8797-aaecc38e2c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b47e09f44aef4be09ce4acd4e2b27399'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:49.374981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07cad7a1-4162-42dd-8797-aaecc38e2c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b47e09f44aef4be09ce4acd4e2b27399'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:49.402772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07cad7a1-4162-42dd-8797-aaecc38e2c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b47e09f44aef4be09ce4acd4e2b27399'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:49.410344 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2783/5562] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:49 2022] DELETE /identity/v3/users/b47e09f44aef4be09ce4acd4e2b27399 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:49.414925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ddce8-4c87-4687-96c1-fd01afedb457 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:49.415490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ddce8-4c87-4687-96c1-fd01afedb457 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:49.415844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ddce8-4c87-4687-96c1-fd01afedb457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:49.437782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-775ddce8-4c87-4687-96c1-fd01afedb457 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:49.439441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-775ddce8-4c87-4687-96c1-fd01afedb457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:49.517030 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2780/5563] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:49.527814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cad7a1-4162-42dd-8797-aaecc38e2c92 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:49.529768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-07cad7a1-4162-42dd-8797-aaecc38e2c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:49.668551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cad7a1-4162-42dd-8797-aaecc38e2c92 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:49.677189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea31ecd-15c2-40d9-8656-a0ae80177730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:49.678050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea31ecd-15c2-40d9-8656-a0ae80177730 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:49.680206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea31ecd-15c2-40d9-8656-a0ae80177730 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:49.680670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea31ecd-15c2-40d9-8656-a0ae80177730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:49.705651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea31ecd-15c2-40d9-8656-a0ae80177730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:49.708081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea31ecd-15c2-40d9-8656-a0ae80177730 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:49.740722 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2784/5564] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:51.423308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ddce8-4c87-4687-96c1-fd01afedb457 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:51.424860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-775ddce8-4c87-4687-96c1-fd01afedb457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:51.448342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ddce8-4c87-4687-96c1-fd01afedb457 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:51.459530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24129dd-38e1-49b6-916e-fcf1b978e0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:51.460316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24129dd-38e1-49b6-916e-fcf1b978e0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:51.460641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24129dd-38e1-49b6-916e-fcf1b978e0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:51.460967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24129dd-38e1-49b6-916e-fcf1b978e0dd admin admin] PATH_INFO: `/v3/projects/86e5595c4c0f4388939ed8efa639eadb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:51.468875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24129dd-38e1-49b6-916e-fcf1b978e0dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e5595c4c0f4388939ed8efa639eadb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:51.470847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24129dd-38e1-49b6-916e-fcf1b978e0dd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:51.569759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f24129dd-38e1-49b6-916e-fcf1b978e0dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e5595c4c0f4388939ed8efa639eadb', 'request_id': 'req-f24129dd-38e1-49b6-916e-fcf1b978e0dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:51.583727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f24129dd-38e1-49b6-916e-fcf1b978e0dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e5595c4c0f4388939ed8efa639eadb', 'request_id': 'req-f24129dd-38e1-49b6-916e-fcf1b978e0dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:51.599928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f24129dd-38e1-49b6-916e-fcf1b978e0dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e5595c4c0f4388939ed8efa639eadb', 'request_id': 'req-f24129dd-38e1-49b6-916e-fcf1b978e0dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:51.620143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f24129dd-38e1-49b6-916e-fcf1b978e0dd admin admin] The token cache is being invalidate because project 86e5595c4c0f4388939ed8efa639eadb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:51.620444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f24129dd-38e1-49b6-916e-fcf1b978e0dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:51.624845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f24129dd-38e1-49b6-916e-fcf1b978e0dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:51.626783 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2781/5565] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:51 2022] DELETE /identity/v3/projects/86e5595c4c0f4388939ed8efa639eadb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:51.630698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea31ecd-15c2-40d9-8656-a0ae80177730 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:51.646437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea31ecd-15c2-40d9-8656-a0ae80177730 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:51.733871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8919e-8b33-4ea7-ab57-c4753c14d740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:51.734903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8919e-8b33-4ea7-ab57-c4753c14d740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:51.735406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8919e-8b33-4ea7-ab57-c4753c14d740 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:51.737461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8919e-8b33-4ea7-ab57-c4753c14d740 admin admin] PATH_INFO: `/v3/users/587db3ee471f4c4a84323dba41c149b4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:51.738966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8919e-8b33-4ea7-ab57-c4753c14d740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=587db3ee471f4c4a84323dba41c149b4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:51.741320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8919e-8b33-4ea7-ab57-c4753c14d740 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:51.752183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:51.888852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fbb8919e-8b33-4ea7-ab57-c4753c14d740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587db3ee471f4c4a84323dba41c149b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:51.890526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fbb8919e-8b33-4ea7-ab57-c4753c14d740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587db3ee471f4c4a84323dba41c149b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:51.912973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fbb8919e-8b33-4ea7-ab57-c4753c14d740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587db3ee471f4c4a84323dba41c149b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:51.925718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fbb8919e-8b33-4ea7-ab57-c4753c14d740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587db3ee471f4c4a84323dba41c149b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:51.944096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fbb8919e-8b33-4ea7-ab57-c4753c14d740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587db3ee471f4c4a84323dba41c149b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:51.955459 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2785/5566] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:51 2022] DELETE /identity/v3/users/587db3ee471f4c4a84323dba41c149b4 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:53.997704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24129dd-38e1-49b6-916e-fcf1b978e0dd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:53.999939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f24129dd-38e1-49b6-916e-fcf1b978e0dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:54.020938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:54.032883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24129dd-38e1-49b6-916e-fcf1b978e0dd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:54.151762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b524-d447-4243-bb19-47ad50a4f1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:54.153486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b524-d447-4243-bb19-47ad50a4f1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:54.153976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b524-d447-4243-bb19-47ad50a4f1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:54.154747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b524-d447-4243-bb19-47ad50a4f1b3 admin admin] PATH_INFO: `/v3/projects/ef957e15e66247699007fa79e0c17ae7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:54.157431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09b524-d447-4243-bb19-47ad50a4f1b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef957e15e66247699007fa79e0c17ae7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:54.160737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09b524-d447-4243-bb19-47ad50a4f1b3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:54.255276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d09b524-d447-4243-bb19-47ad50a4f1b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef957e15e66247699007fa79e0c17ae7', 'request_id': 'req-0d09b524-d447-4243-bb19-47ad50a4f1b3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:54.266313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d09b524-d447-4243-bb19-47ad50a4f1b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef957e15e66247699007fa79e0c17ae7', 'request_id': 'req-0d09b524-d447-4243-bb19-47ad50a4f1b3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:54.280060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d09b524-d447-4243-bb19-47ad50a4f1b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef957e15e66247699007fa79e0c17ae7', 'request_id': 'req-0d09b524-d447-4243-bb19-47ad50a4f1b3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:54.304556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d09b524-d447-4243-bb19-47ad50a4f1b3 admin admin] The token cache is being invalidate because project ef957e15e66247699007fa79e0c17ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:54.305061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d09b524-d447-4243-bb19-47ad50a4f1b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:54.306165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d09b524-d447-4243-bb19-47ad50a4f1b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:54.308265 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2782/5567] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:53 2022] DELETE /identity/v3/projects/ef957e15e66247699007fa79e0c17ae7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:54.312993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ff401-a33e-4d7f-a558-e4110de061dd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:54.313490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ff401-a33e-4d7f-a558-e4110de061dd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:54.313693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ff401-a33e-4d7f-a558-e4110de061dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:54.343229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-671ff401-a33e-4d7f-a558-e4110de061dd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:54.344776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-671ff401-a33e-4d7f-a558-e4110de061dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:54.443293 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2786/5568] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:54.450809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c17770-c407-4bac-b591-e21379250148 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:54.451305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c17770-c407-4bac-b591-e21379250148 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:54.451423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c17770-c407-4bac-b591-e21379250148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:54.483409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-68c17770-c407-4bac-b591-e21379250148 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:54.484848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-68c17770-c407-4bac-b591-e21379250148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:54.501786 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2783/5569] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:54.505958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ff401-a33e-4d7f-a558-e4110de061dd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:54.521711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ff401-a33e-4d7f-a558-e4110de061dd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:54.534135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14df24-dd91-451f-95ca-ee8558768e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:54.535037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14df24-dd91-451f-95ca-ee8558768e10 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:54.535654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14df24-dd91-451f-95ca-ee8558768e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:54.536112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14df24-dd91-451f-95ca-ee8558768e10 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:54.536965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14df24-dd91-451f-95ca-ee8558768e10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:42:54.537456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14df24-dd91-451f-95ca-ee8558768e10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:54.540945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14df24-dd91-451f-95ca-ee8558768e10 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:54.574508 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2787/5570] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:54.578879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c17770-c407-4bac-b591-e21379250148 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:54.592001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c17770-c407-4bac-b591-e21379250148 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:54.608695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff709fa4-f1e8-483f-8714-448aae1166f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:54.609694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff709fa4-f1e8-483f-8714-448aae1166f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:54.610179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff709fa4-f1e8-483f-8714-448aae1166f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:54.610623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff709fa4-f1e8-483f-8714-448aae1166f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:54.612697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff709fa4-f1e8-483f-8714-448aae1166f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:54.616995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff709fa4-f1e8-483f-8714-448aae1166f8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:54.669938 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2784/5571] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:54 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:54.673963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14df24-dd91-451f-95ca-ee8558768e10 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:54.686567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14df24-dd91-451f-95ca-ee8558768e10 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:54.771938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272c194-0e5b-4f30-adb3-65f175efb9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:54.773676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272c194-0e5b-4f30-adb3-65f175efb9fe admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:54.773972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272c194-0e5b-4f30-adb3-65f175efb9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:54.774243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272c194-0e5b-4f30-adb3-65f175efb9fe admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:54.774894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272c194-0e5b-4f30-adb3-65f175efb9fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:54.777439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272c194-0e5b-4f30-adb3-65f175efb9fe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:54.798023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:54.810340 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2788/5572] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:54 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:54.811184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff709fa4-f1e8-483f-8714-448aae1166f8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:54.826144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff709fa4-f1e8-483f-8714-448aae1166f8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:54.840767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930d3ba-2738-48e7-b1be-c516250eae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:54.841673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930d3ba-2738-48e7-b1be-c516250eae7f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:54.842105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930d3ba-2738-48e7-b1be-c516250eae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:54.842627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930d3ba-2738-48e7-b1be-c516250eae7f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:54.843490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930d3ba-2738-48e7-b1be-c516250eae7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:54.845351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930d3ba-2738-48e7-b1be-c516250eae7f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:54.864997 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2785/5573] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:42:54.865784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272c194-0e5b-4f30-adb3-65f175efb9fe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:54.879181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272c194-0e5b-4f30-adb3-65f175efb9fe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:54.884332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b2271-8cdd-491a-9ff7-5972f04b3ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:54.885287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b2271-8cdd-491a-9ff7-5972f04b3ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:54.885571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b2271-8cdd-491a-9ff7-5972f04b3ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:54.885846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b2271-8cdd-491a-9ff7-5972f04b3ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:54.887455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b2271-8cdd-491a-9ff7-5972f04b3ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:54.890925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b2271-8cdd-491a-9ff7-5972f04b3ef5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:54.906136 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2789/5574] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:42:54.908403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930d3ba-2738-48e7-b1be-c516250eae7f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:54.926876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930d3ba-2738-48e7-b1be-c516250eae7f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:54.933898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b2271-8cdd-491a-9ff7-5972f04b3ef5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:54.936068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-227b2271-8cdd-491a-9ff7-5972f04b3ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:54.941676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce860432-533d-4490-8ee0-32b70015420a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:54.943396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce860432-533d-4490-8ee0-32b70015420a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:54.943838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce860432-533d-4490-8ee0-32b70015420a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:54.944483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce860432-533d-4490-8ee0-32b70015420a admin admin] PATH_INFO: `/v3/projects/16d02c64443f420a8cf36ba7819e2f42/users/989545bfc9b0444a8b74e818430c693b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:54.951775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b2271-8cdd-491a-9ff7-5972f04b3ef5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:54.962469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9faa7d-0200-41d0-86c2-34091da07795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:54.963595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9faa7d-0200-41d0-86c2-34091da07795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:54.964098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9faa7d-0200-41d0-86c2-34091da07795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:54.964493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9faa7d-0200-41d0-86c2-34091da07795 admin admin] PATH_INFO: `/v3/users/a902cea2ce36403da2e5283e168556ee` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:54.966439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9faa7d-0200-41d0-86c2-34091da07795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a902cea2ce36403da2e5283e168556ee)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:54.967348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce860432-533d-4490-8ee0-32b70015420a admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d02c64443f420a8cf36ba7819e2f42, user_id=989545bfc9b0444a8b74e818430c693b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:54.968710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9faa7d-0200-41d0-86c2-34091da07795 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:54.971334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce860432-533d-4490-8ee0-32b70015420a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:55.012240 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2786/5575] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:54 2022] PUT /identity/v3/projects/16d02c64443f420a8cf36ba7819e2f42/users/989545bfc9b0444a8b74e818430c693b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:55.014930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcab529-3ed4-41bb-be8d-f16e2d737611 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:55.015376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcab529-3ed4-41bb-be8d-f16e2d737611 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:55.015886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcab529-3ed4-41bb-be8d-f16e2d737611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:55.032076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f9faa7d-0200-41d0-86c2-34091da07795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a902cea2ce36403da2e5283e168556ee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:55.032792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f9faa7d-0200-41d0-86c2-34091da07795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a902cea2ce36403da2e5283e168556ee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:55.040480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f9faa7d-0200-41d0-86c2-34091da07795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a902cea2ce36403da2e5283e168556ee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:55.050770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-adcab529-3ed4-41bb-be8d-f16e2d737611 None None] MFA Rules not processed for user `989545bfc9b0444a8b74e818430c693b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:55.052465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-adcab529-3ed4-41bb-be8d-f16e2d737611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:55.053143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f9faa7d-0200-41d0-86c2-34091da07795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a902cea2ce36403da2e5283e168556ee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:55.071837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f9faa7d-0200-41d0-86c2-34091da07795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a902cea2ce36403da2e5283e168556ee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:55.076114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:55.079850 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2790/5576] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:54 2022] DELETE /identity/v3/users/a902cea2ce36403da2e5283e168556ee => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:55.084894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf038a6-c1d9-45c1-b159-b64a2f4f0a09 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:55.085257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf038a6-c1d9-45c1-b159-b64a2f4f0a09 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:55.085605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf038a6-c1d9-45c1-b159-b64a2f4f0a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:55.109745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fcf038a6-c1d9-45c1-b159-b64a2f4f0a09 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:55.111543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fcf038a6-c1d9-45c1-b159-b64a2f4f0a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:55.138094 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2787/5577] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:55.142673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcab529-3ed4-41bb-be8d-f16e2d737611 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:55.145122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-adcab529-3ed4-41bb-be8d-f16e2d737611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:55.196798 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2791/5578] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:42:55.206576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf038a6-c1d9-45c1-b159-b64a2f4f0a09 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:55.208668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fcf038a6-c1d9-45c1-b159-b64a2f4f0a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:55.233156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcab529-3ed4-41bb-be8d-f16e2d737611 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:55.243402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d57b52-961c-4c49-b423-8cc53493c9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:55.244458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d57b52-961c-4c49-b423-8cc53493c9ef admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:55.244899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d57b52-961c-4c49-b423-8cc53493c9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:55.245333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d57b52-961c-4c49-b423-8cc53493c9ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:55.246235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d57b52-961c-4c49-b423-8cc53493c9ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:55.248957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d57b52-961c-4c49-b423-8cc53493c9ef admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:55.296839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf038a6-c1d9-45c1-b159-b64a2f4f0a09 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:55.297699 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2788/5579] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:55 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:55.302053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d57b52-961c-4c49-b423-8cc53493c9ef admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:55.316429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:55.389425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d57b52-961c-4c49-b423-8cc53493c9ef admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:55.395979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bade4d-72d7-479a-bd4c-c536af76f157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:55.396399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654618a3-b477-46b4-8cff-295ba62171fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:55.397694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654618a3-b477-46b4-8cff-295ba62171fa admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:55.397694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654618a3-b477-46b4-8cff-295ba62171fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:55.397694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654618a3-b477-46b4-8cff-295ba62171fa admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:55.398405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bade4d-72d7-479a-bd4c-c536af76f157 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:55.398693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654618a3-b477-46b4-8cff-295ba62171fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:55.399018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bade4d-72d7-479a-bd4c-c536af76f157 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:55.399462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bade4d-72d7-479a-bd4c-c536af76f157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:55.401101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654618a3-b477-46b4-8cff-295ba62171fa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:55.416498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bade4d-72d7-479a-bd4c-c536af76f157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:55.419039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bade4d-72d7-479a-bd4c-c536af76f157 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:55.434714 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2789/5580] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:55 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:42:55.436610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654618a3-b477-46b4-8cff-295ba62171fa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:55.443527 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2792/5581] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:55.451729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654618a3-b477-46b4-8cff-295ba62171fa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:55.458865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86270d24-a1c5-41d8-b984-20f6d676b2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:55.459660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86270d24-a1c5-41d8-b984-20f6d676b2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:55.460000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86270d24-a1c5-41d8-b984-20f6d676b2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:55.460353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86270d24-a1c5-41d8-b984-20f6d676b2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:55.461062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86270d24-a1c5-41d8-b984-20f6d676b2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:55.462887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86270d24-a1c5-41d8-b984-20f6d676b2d7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:55.480715 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2790/5582] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:55.480978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bade4d-72d7-479a-bd4c-c536af76f157 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:55.493920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bade4d-72d7-479a-bd4c-c536af76f157 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:55.501343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57e8c9-0696-4cf7-8c28-0c01a00d209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:55.502342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57e8c9-0696-4cf7-8c28-0c01a00d209b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:55.502892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57e8c9-0696-4cf7-8c28-0c01a00d209b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:55.502892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57e8c9-0696-4cf7-8c28-0c01a00d209b admin admin] PATH_INFO: `/v3/projects/537e99603c3f4b6b9d91a78fb1e982f5/users/2d505e22147f4a6398d542aaa1d62c7a/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:55.527440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57e8c9-0696-4cf7-8c28-0c01a00d209b admin admin] RBAC: Authorizing `identity:create_grant(project_id=537e99603c3f4b6b9d91a78fb1e982f5, user_id=2d505e22147f4a6398d542aaa1d62c7a, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:55.531801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57e8c9-0696-4cf7-8c28-0c01a00d209b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:55.547873 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2793/5583] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:55 2022] PUT /identity/v3/projects/537e99603c3f4b6b9d91a78fb1e982f5/users/2d505e22147f4a6398d542aaa1d62c7a/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:55.551885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86270d24-a1c5-41d8-b984-20f6d676b2d7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:55.563575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86270d24-a1c5-41d8-b984-20f6d676b2d7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:55.585783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:55.669927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af3dde-356e-421d-b810-22206aa9ae6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:55.670668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af3dde-356e-421d-b810-22206aa9ae6f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:55.671737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af3dde-356e-421d-b810-22206aa9ae6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:55.672984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af3dde-356e-421d-b810-22206aa9ae6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:55.673667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af3dde-356e-421d-b810-22206aa9ae6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:55.677703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af3dde-356e-421d-b810-22206aa9ae6f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:55.695066 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2791/5584] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:42:55.696352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57e8c9-0696-4cf7-8c28-0c01a00d209b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:55.711071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57e8c9-0696-4cf7-8c28-0c01a00d209b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:55.716936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58a1ae-dc0a-4970-a85e-8eb9b67e9ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:55.718254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58a1ae-dc0a-4970-a85e-8eb9b67e9ede admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:55.718921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58a1ae-dc0a-4970-a85e-8eb9b67e9ede admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:55.719327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58a1ae-dc0a-4970-a85e-8eb9b67e9ede admin admin] PATH_INFO: `/v3/projects/537e99603c3f4b6b9d91a78fb1e982f5/users/2d505e22147f4a6398d542aaa1d62c7a/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:55.723311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58a1ae-dc0a-4970-a85e-8eb9b67e9ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=537e99603c3f4b6b9d91a78fb1e982f5, user_id=2d505e22147f4a6398d542aaa1d62c7a, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:55.726078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58a1ae-dc0a-4970-a85e-8eb9b67e9ede admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:55.740840 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2794/5585] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:55 2022] PUT /identity/v3/projects/537e99603c3f4b6b9d91a78fb1e982f5/users/2d505e22147f4a6398d542aaa1d62c7a/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:55.753021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee4787-bc74-463d-9321-fed73e218729 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:55.753531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee4787-bc74-463d-9321-fed73e218729 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:55.753813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee4787-bc74-463d-9321-fed73e218729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:55.792834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0eee4787-bc74-463d-9321-fed73e218729 None None] MFA Rules not processed for user `2d505e22147f4a6398d542aaa1d62c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:55.794373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0eee4787-bc74-463d-9321-fed73e218729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:55.826394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58a1ae-dc0a-4970-a85e-8eb9b67e9ede admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:55.828345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1f58a1ae-dc0a-4970-a85e-8eb9b67e9ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:55.899776 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2792/5586] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:42:55.908452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee4787-bc74-463d-9321-fed73e218729 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:55.919799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee4787-bc74-463d-9321-fed73e218729 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:55.927556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc490bc2-1e67-46e6-b6c1-5b1ca474525d tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d505e22147f4a6398d542aaa1d62c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537e99603c3f4b6b9d91a78fb1e982f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:55.928268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc490bc2-1e67-46e6-b6c1-5b1ca474525d tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:55.928625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc490bc2-1e67-46e6-b6c1-5b1ca474525d tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:55.928975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc490bc2-1e67-46e6-b6c1-5b1ca474525d tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:55.929709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc490bc2-1e67-46e6-b6c1-5b1ca474525d tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:55.930326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58a1ae-dc0a-4970-a85e-8eb9b67e9ede admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:55.930892 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-cc490bc2-1e67-46e6-b6c1-5b1ca474525d tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:42:55.930892 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:42:55.930892 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:42:55.932289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc490bc2-1e67-46e6-b6c1-5b1ca474525d tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:55.935793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae1050-6766-46a7-b8f5-e0219cfd5df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:55.936523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae1050-6766-46a7-b8f5-e0219cfd5df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:55.936884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae1050-6766-46a7-b8f5-e0219cfd5df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:55.937315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae1050-6766-46a7-b8f5-e0219cfd5df6 admin admin] PATH_INFO: `/v3/projects/ad80b11631944f44b59927c19759e60a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:55.938438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae1050-6766-46a7-b8f5-e0219cfd5df6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad80b11631944f44b59927c19759e60a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:55.941548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae1050-6766-46a7-b8f5-e0219cfd5df6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:55.959606 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2793/5587] 10.222.0.27 () {60 vars in 1185 bytes} [Sun Aug 28 18:42:55 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:55.964335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc490bc2-1e67-46e6-b6c1-5b1ca474525d tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:55.976558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc490bc2-1e67-46e6-b6c1-5b1ca474525d tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:55.981853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1598078-35f3-4e31-b89c-dbb92532a53c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d505e22147f4a6398d542aaa1d62c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537e99603c3f4b6b9d91a78fb1e982f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:55.982497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1598078-35f3-4e31-b89c-dbb92532a53c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:55.982784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1598078-35f3-4e31-b89c-dbb92532a53c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:55.983066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1598078-35f3-4e31-b89c-dbb92532a53c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/ff82880a951c4ea2a5162b38441ae341` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:55.983708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1598078-35f3-4e31-b89c-dbb92532a53c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=ff82880a951c4ea2a5162b38441ae341)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:55.984730 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-b1598078-35f3-4e31-b89c-dbb92532a53c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:42:55.984730 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:42:55.984730 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:42:55.985626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1598078-35f3-4e31-b89c-dbb92532a53c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:55.992794 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2794/5588] 10.222.0.27 () {58 vars in 1263 bytes} [Sun Aug 28 18:42:55 2022] GET /identity/v3/OS-OAUTH1/consumers/ff82880a951c4ea2a5162b38441ae341 => generated 220 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:55.996708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1598078-35f3-4e31-b89c-dbb92532a53c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:55.998447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75ae1050-6766-46a7-b8f5-e0219cfd5df6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad80b11631944f44b59927c19759e60a', 'request_id': 'req-75ae1050-6766-46a7-b8f5-e0219cfd5df6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.006938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1598078-35f3-4e31-b89c-dbb92532a53c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:56.010399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75ae1050-6766-46a7-b8f5-e0219cfd5df6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad80b11631944f44b59927c19759e60a', 'request_id': 'req-75ae1050-6766-46a7-b8f5-e0219cfd5df6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.018365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75ae1050-6766-46a7-b8f5-e0219cfd5df6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad80b11631944f44b59927c19759e60a', 'request_id': 'req-75ae1050-6766-46a7-b8f5-e0219cfd5df6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.030647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75ae1050-6766-46a7-b8f5-e0219cfd5df6 admin admin] The token cache is being invalidate because project ad80b11631944f44b59927c19759e60a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:56.030940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75ae1050-6766-46a7-b8f5-e0219cfd5df6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.032068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75ae1050-6766-46a7-b8f5-e0219cfd5df6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.033850 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2795/5589] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:55 2022] DELETE /identity/v3/projects/ad80b11631944f44b59927c19759e60a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:56.037434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae1050-6766-46a7-b8f5-e0219cfd5df6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:56.039288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-75ae1050-6766-46a7-b8f5-e0219cfd5df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:56.059193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:56.076914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25365b05-3ddf-426d-bc3f-53212c3a3e4b tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d505e22147f4a6398d542aaa1d62c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537e99603c3f4b6b9d91a78fb1e982f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:56.076914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25365b05-3ddf-426d-bc3f-53212c3a3e4b tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:56.077636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25365b05-3ddf-426d-bc3f-53212c3a3e4b tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:56.077636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25365b05-3ddf-426d-bc3f-53212c3a3e4b tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/ff82880a951c4ea2a5162b38441ae341` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:56.078527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25365b05-3ddf-426d-bc3f-53212c3a3e4b tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=ff82880a951c4ea2a5162b38441ae341)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:56.079094 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-25365b05-3ddf-426d-bc3f-53212c3a3e4b tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:42:56.079094 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:42:56.079094 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:42:56.080187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25365b05-3ddf-426d-bc3f-53212c3a3e4b tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:56.080343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25365b05-3ddf-426d-bc3f-53212c3a3e4b tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invalidating token cache because consumer ff82880a951c4ea2a5162b38441ae341 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:56.080566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25365b05-3ddf-426d-bc3f-53212c3a3e4b tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.081440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25365b05-3ddf-426d-bc3f-53212c3a3e4b tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.124623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25365b05-3ddf-426d-bc3f-53212c3a3e4b tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'ff82880a951c4ea2a5162b38441ae341', 'request_id': 'req-25365b05-3ddf-426d-bc3f-53212c3a3e4b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.150656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae1050-6766-46a7-b8f5-e0219cfd5df6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:56.158650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d0428-0f1c-430a-b65a-a7a1051407c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:56.159608 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2795/5590] 10.222.0.27 () {58 vars in 1266 bytes} [Sun Aug 28 18:42:55 2022] DELETE /identity/v3/OS-OAUTH1/consumers/ff82880a951c4ea2a5162b38441ae341 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:56.159941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d0428-0f1c-430a-b65a-a7a1051407c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:56.160505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d0428-0f1c-430a-b65a-a7a1051407c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:56.161317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d0428-0f1c-430a-b65a-a7a1051407c6 admin admin] PATH_INFO: `/v3/users/fb4ef7f6e94449499dfabf01527d6f69` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:56.162306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b0192-a3ef-4142-8791-ec48d63a1740 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:56.163718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b0192-a3ef-4142-8791-ec48d63a1740 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:56.164145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b0192-a3ef-4142-8791-ec48d63a1740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:56.164658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d0428-0f1c-430a-b65a-a7a1051407c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb4ef7f6e94449499dfabf01527d6f69)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:56.167768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d0428-0f1c-430a-b65a-a7a1051407c6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:56.173096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:56.213974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d63b0192-a3ef-4142-8791-ec48d63a1740 None None] MFA Rules not processed for user `16fedc13d7fd4e82bffc0e34e476266b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:56.216689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d63b0192-a3ef-4142-8791-ec48d63a1740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:56.280633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a93d0428-0f1c-430a-b65a-a7a1051407c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb4ef7f6e94449499dfabf01527d6f69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.281544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a93d0428-0f1c-430a-b65a-a7a1051407c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb4ef7f6e94449499dfabf01527d6f69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.298750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a93d0428-0f1c-430a-b65a-a7a1051407c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb4ef7f6e94449499dfabf01527d6f69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.319062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a93d0428-0f1c-430a-b65a-a7a1051407c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb4ef7f6e94449499dfabf01527d6f69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.334814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a93d0428-0f1c-430a-b65a-a7a1051407c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb4ef7f6e94449499dfabf01527d6f69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.345286 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2796/5591] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:56 2022] DELETE /identity/v3/users/fb4ef7f6e94449499dfabf01527d6f69 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:56.347195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d0428-0f1c-430a-b65a-a7a1051407c6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:56.349036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a93d0428-0f1c-430a-b65a-a7a1051407c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:56.357705 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2796/5592] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:56.369220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a33d68-f36e-4fe3-8da3-9f07318fc599 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:56.369530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a33d68-f36e-4fe3-8da3-9f07318fc599 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:56.369799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a33d68-f36e-4fe3-8da3-9f07318fc599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:56.408538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d6a33d68-f36e-4fe3-8da3-9f07318fc599 None None] MFA Rules not processed for user `16fedc13d7fd4e82bffc0e34e476266b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:56.410025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d6a33d68-f36e-4fe3-8da3-9f07318fc599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:56.438048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d0428-0f1c-430a-b65a-a7a1051407c6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:56.445138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1a6bc-1b68-4397-a94a-c5e10e2dc047 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d505e22147f4a6398d542aaa1d62c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537e99603c3f4b6b9d91a78fb1e982f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:56.446115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1a6bc-1b68-4397-a94a-c5e10e2dc047 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:56.446607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1a6bc-1b68-4397-a94a-c5e10e2dc047 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:56.447121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1a6bc-1b68-4397-a94a-c5e10e2dc047 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:56.448007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1a6bc-1b68-4397-a94a-c5e10e2dc047 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:56.451834 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-cfb1a6bc-1b68-4397-a94a-c5e10e2dc047 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:42:56.451834 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:42:56.451834 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:42:56.455277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1a6bc-1b68-4397-a94a-c5e10e2dc047 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:56.492227 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2797/5593] 10.222.0.27 () {60 vars in 1185 bytes} [Sun Aug 28 18:42:56 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 264 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:56.497174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1a6bc-1b68-4397-a94a-c5e10e2dc047 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:56.514412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1a6bc-1b68-4397-a94a-c5e10e2dc047 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:56.526616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7ce1f-f013-4fa6-920f-5246bf4aa004 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d505e22147f4a6398d542aaa1d62c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537e99603c3f4b6b9d91a78fb1e982f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:56.527341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7ce1f-f013-4fa6-920f-5246bf4aa004 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:56.527911 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2797/5594] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:42:56.528034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7ce1f-f013-4fa6-920f-5246bf4aa004 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:56.528275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7ce1f-f013-4fa6-920f-5246bf4aa004 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/be360cf0d5484adebb5ae44d373cc5b4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:56.528875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7ce1f-f013-4fa6-920f-5246bf4aa004 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=be360cf0d5484adebb5ae44d373cc5b4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:56.530527 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-dda7ce1f-f013-4fa6-920f-5246bf4aa004 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:42:56.530527 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:42:56.530527 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:42:56.531550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7ce1f-f013-4fa6-920f-5246bf4aa004 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:56.539996 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2798/5595] 10.222.0.27 () {58 vars in 1263 bytes} [Sun Aug 28 18:42:56 2022] GET /identity/v3/OS-OAUTH1/consumers/be360cf0d5484adebb5ae44d373cc5b4 => generated 218 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:56.544668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a33d68-f36e-4fe3-8da3-9f07318fc599 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:56.562588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7ce1f-f013-4fa6-920f-5246bf4aa004 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:56.566146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dda7ce1f-f013-4fa6-920f-5246bf4aa004 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:56.576688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a33d68-f36e-4fe3-8da3-9f07318fc599 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:56.585948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c43285-442d-4257-9bc0-538f03f9c64e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d505e22147f4a6398d542aaa1d62c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537e99603c3f4b6b9d91a78fb1e982f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:56.586415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c43285-442d-4257-9bc0-538f03f9c64e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:56.586703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c43285-442d-4257-9bc0-538f03f9c64e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:56.587633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c43285-442d-4257-9bc0-538f03f9c64e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/be360cf0d5484adebb5ae44d373cc5b4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:56.587842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c43285-442d-4257-9bc0-538f03f9c64e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=be360cf0d5484adebb5ae44d373cc5b4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:56.591475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c43285-442d-4257-9bc0-538f03f9c64e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:56.591747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-03c43285-442d-4257-9bc0-538f03f9c64e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invalidating token cache because consumer be360cf0d5484adebb5ae44d373cc5b4 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:56.592004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-03c43285-442d-4257-9bc0-538f03f9c64e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.594165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-03c43285-442d-4257-9bc0-538f03f9c64e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.617804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:56.622932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-03c43285-442d-4257-9bc0-538f03f9c64e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'be360cf0d5484adebb5ae44d373cc5b4', 'request_id': 'req-03c43285-442d-4257-9bc0-538f03f9c64e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.650088 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2798/5596] 10.222.0.27 () {58 vars in 1266 bytes} [Sun Aug 28 18:42:56 2022] DELETE /identity/v3/OS-OAUTH1/consumers/be360cf0d5484adebb5ae44d373cc5b4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:56.654912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c43285-442d-4257-9bc0-538f03f9c64e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:56.659053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-03c43285-442d-4257-9bc0-538f03f9c64e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:56.679799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c43285-442d-4257-9bc0-538f03f9c64e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:56.708929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc9ac3-14ce-46f8-a74d-14efc92a0f75 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d505e22147f4a6398d542aaa1d62c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537e99603c3f4b6b9d91a78fb1e982f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:56.709573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc9ac3-14ce-46f8-a74d-14efc92a0f75 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:56.709851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc9ac3-14ce-46f8-a74d-14efc92a0f75 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:56.710845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc9ac3-14ce-46f8-a74d-14efc92a0f75 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/be360cf0d5484adebb5ae44d373cc5b4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:56.711703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc9ac3-14ce-46f8-a74d-14efc92a0f75 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=be360cf0d5484adebb5ae44d373cc5b4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:56.713776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc9ac3-14ce-46f8-a74d-14efc92a0f75 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:56.739959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7ce1f-f013-4fa6-920f-5246bf4aa004 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:56.747374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1198d-3501-47c9-a11f-4e87997c9bf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:56.748732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1198d-3501-47c9-a11f-4e87997c9bf0 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:56.748732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1198d-3501-47c9-a11f-4e87997c9bf0 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:56.748732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1198d-3501-47c9-a11f-4e87997c9bf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:56.749567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-2ebc9ac3-14ce-46f8-a74d-14efc92a0f75 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 28 18:42:56.749567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:42:56.749567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:42:56.749567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:42:56.749567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:42:56.749567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:42:56.749567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:42:56.749567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:42:56.749567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:42:56.749567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:42:56.749567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:42:56.749567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:42:56.749567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Aug 28 18:42:56.749567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Aug 28 18:42:56.749567 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Aug 28 18:42:56.750718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Aug 28 18:42:56.750718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Aug 28 18:42:56.750718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Aug 28 18:42:56.750718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Aug 28 18:42:56.750718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 28 18:42:56.750718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 28 18:42:56.750718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 28 18:42:56.750718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 28 18:42:56.750718 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:42:56.751765 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2799/5597] 10.222.0.27 () {58 vars in 1263 bytes} [Sun Aug 28 18:42:56 2022] GET /identity/v3/OS-OAUTH1/consumers/be360cf0d5484adebb5ae44d373cc5b4 => generated 74 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:42:56.751979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc9ac3-14ce-46f8-a74d-14efc92a0f75 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:56.754413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-36d1198d-3501-47c9-a11f-4e87997c9bf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:56.757708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2ebc9ac3-14ce-46f8-a74d-14efc92a0f75 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:56.769539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1198d-3501-47c9-a11f-4e87997c9bf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:56.771284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1198d-3501-47c9-a11f-4e87997c9bf0 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:56.784016 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2799/5598] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:56.785594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1198d-3501-47c9-a11f-4e87997c9bf0 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:56.799743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1198d-3501-47c9-a11f-4e87997c9bf0 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:56.806448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae3c46-a830-4231-9c96-6873c7a49397 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d505e22147f4a6398d542aaa1d62c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537e99603c3f4b6b9d91a78fb1e982f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:56.807594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae3c46-a830-4231-9c96-6873c7a49397 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:56.807742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae3c46-a830-4231-9c96-6873c7a49397 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:56.808132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae3c46-a830-4231-9c96-6873c7a49397 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/be360cf0d5484adebb5ae44d373cc5b4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:56.808745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae3c46-a830-4231-9c96-6873c7a49397 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=be360cf0d5484adebb5ae44d373cc5b4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:56.809978 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-fdae3c46-a830-4231-9c96-6873c7a49397 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:42:56.809978 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:42:56.809978 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:42:56.812151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae3c46-a830-4231-9c96-6873c7a49397 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:56.812151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdae3c46-a830-4231-9c96-6873c7a49397 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invalidating token cache because consumer be360cf0d5484adebb5ae44d373cc5b4 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:56.812395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdae3c46-a830-4231-9c96-6873c7a49397 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.813188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdae3c46-a830-4231-9c96-6873c7a49397 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:56.882050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-fdae3c46-a830-4231-9c96-6873c7a49397 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 28 18:42:56.882050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:42:56.882050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:42:56.882050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:42:56.882050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:42:56.882050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:42:56.882050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:42:56.882050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:42:56.882050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:42:56.882050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:42:56.882050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:42:56.882050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:42:56.882050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Aug 28 18:42:56.882050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Aug 28 18:42:56.882050 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:42:56.883723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:42:56.883723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Aug 28 18:42:56.883723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Aug 28 18:42:56.883723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Aug 28 18:42:56.883723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Aug 28 18:42:56.883723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Aug 28 18:42:56.883723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 28 18:42:56.883723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 28 18:42:56.883723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 28 18:42:56.883723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 28 18:42:56.883723 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:42:56.887841 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2800/5599] 10.222.0.27 () {58 vars in 1266 bytes} [Sun Aug 28 18:42:56 2022] DELETE /identity/v3/OS-OAUTH1/consumers/be360cf0d5484adebb5ae44d373cc5b4 => generated 74 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:42:56.893375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae3c46-a830-4231-9c96-6873c7a49397 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:56.895780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fdae3c46-a830-4231-9c96-6873c7a49397 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:56.922354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae3c46-a830-4231-9c96-6873c7a49397 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:56.924495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc9ac3-14ce-46f8-a74d-14efc92a0f75 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:56.928420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11caa5f9-b863-4b35-9075-5f8771254cee tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d505e22147f4a6398d542aaa1d62c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537e99603c3f4b6b9d91a78fb1e982f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:56.929316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caa5f9-b863-4b35-9075-5f8771254cee tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:56.929774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caa5f9-b863-4b35-9075-5f8771254cee tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:56.929974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938c2fd-2377-4fcb-9b23-1cb0f974342f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:56.930524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caa5f9-b863-4b35-9075-5f8771254cee tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:56.930994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938c2fd-2377-4fcb-9b23-1cb0f974342f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:56.931401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938c2fd-2377-4fcb-9b23-1cb0f974342f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:56.931802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caa5f9-b863-4b35-9075-5f8771254cee tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:56.931923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938c2fd-2377-4fcb-9b23-1cb0f974342f admin admin] PATH_INFO: `/v3/projects/4f3be7eac85449c7bf9b0e1f8b997931` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:56.933893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caa5f9-b863-4b35-9075-5f8771254cee tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:56.934644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938c2fd-2377-4fcb-9b23-1cb0f974342f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f3be7eac85449c7bf9b0e1f8b997931)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:56.937499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938c2fd-2377-4fcb-9b23-1cb0f974342f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:56.940405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:56.958670 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2801/5600] 10.222.0.27 () {60 vars in 1185 bytes} [Sun Aug 28 18:42:56 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:56.963772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11caa5f9-b863-4b35-9075-5f8771254cee tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:56.989619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11caa5f9-b863-4b35-9075-5f8771254cee tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:57.009930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4938c2fd-2377-4fcb-9b23-1cb0f974342f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f3be7eac85449c7bf9b0e1f8b997931', 'request_id': 'req-4938c2fd-2377-4fcb-9b23-1cb0f974342f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.021971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4938c2fd-2377-4fcb-9b23-1cb0f974342f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f3be7eac85449c7bf9b0e1f8b997931', 'request_id': 'req-4938c2fd-2377-4fcb-9b23-1cb0f974342f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.030905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4938c2fd-2377-4fcb-9b23-1cb0f974342f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f3be7eac85449c7bf9b0e1f8b997931', 'request_id': 'req-4938c2fd-2377-4fcb-9b23-1cb0f974342f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.050018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4938c2fd-2377-4fcb-9b23-1cb0f974342f admin admin] The token cache is being invalidate because project 4f3be7eac85449c7bf9b0e1f8b997931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:57.050615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4938c2fd-2377-4fcb-9b23-1cb0f974342f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.051677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4938c2fd-2377-4fcb-9b23-1cb0f974342f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.053651 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2800/5601] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:56 2022] DELETE /identity/v3/projects/4f3be7eac85449c7bf9b0e1f8b997931 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:57.060217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ebf81-c196-4d86-a798-deb157865f95 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.060542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ebf81-c196-4d86-a798-deb157865f95 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.060916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ebf81-c196-4d86-a798-deb157865f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.061121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796df6c9-d0bb-45f5-92ac-409c1af2d684 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d505e22147f4a6398d542aaa1d62c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537e99603c3f4b6b9d91a78fb1e982f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:57.061760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796df6c9-d0bb-45f5-92ac-409c1af2d684 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.062220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796df6c9-d0bb-45f5-92ac-409c1af2d684 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.062500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796df6c9-d0bb-45f5-92ac-409c1af2d684 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.063593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796df6c9-d0bb-45f5-92ac-409c1af2d684 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:57.064848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796df6c9-d0bb-45f5-92ac-409c1af2d684 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:57.086354 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2802/5602] 10.222.0.27 () {60 vars in 1185 bytes} [Sun Aug 28 18:42:56 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:57.087471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796df6c9-d0bb-45f5-92ac-409c1af2d684 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:57.089679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-796df6c9-d0bb-45f5-92ac-409c1af2d684 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:57.090098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c71ebf81-c196-4d86-a798-deb157865f95 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:57.091650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c71ebf81-c196-4d86-a798-deb157865f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:57.104130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796df6c9-d0bb-45f5-92ac-409c1af2d684 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:57.110337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55ec51-7487-482d-acf7-5bf97515212c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d505e22147f4a6398d542aaa1d62c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537e99603c3f4b6b9d91a78fb1e982f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:57.111400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55ec51-7487-482d-acf7-5bf97515212c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.111400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55ec51-7487-482d-acf7-5bf97515212c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.111685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55ec51-7487-482d-acf7-5bf97515212c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.113112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55ec51-7487-482d-acf7-5bf97515212c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:57.114303 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-be55ec51-7487-482d-acf7-5bf97515212c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:42:57.114303 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:42:57.114303 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:42:57.115415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55ec51-7487-482d-acf7-5bf97515212c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:57.126353 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2803/5603] 10.222.0.27 () {58 vars in 1164 bytes} [Sun Aug 28 18:42:57 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:42:57.127828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55ec51-7487-482d-acf7-5bf97515212c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:57.141176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55ec51-7487-482d-acf7-5bf97515212c tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:57.147718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc95860-5927-4b4f-82a3-713035b3d753 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d505e22147f4a6398d542aaa1d62c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537e99603c3f4b6b9d91a78fb1e982f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:57.148468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc95860-5927-4b4f-82a3-713035b3d753 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.149046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc95860-5927-4b4f-82a3-713035b3d753 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.149651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc95860-5927-4b4f-82a3-713035b3d753 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9421db165ebd474283704914ced3b151` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.150335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc95860-5927-4b4f-82a3-713035b3d753 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=9421db165ebd474283704914ced3b151)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:57.152441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc95860-5927-4b4f-82a3-713035b3d753 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:57.152813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4bc95860-5927-4b4f-82a3-713035b3d753 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invalidating token cache because consumer 9421db165ebd474283704914ced3b151 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:57.153222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4bc95860-5927-4b4f-82a3-713035b3d753 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.154369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4bc95860-5927-4b4f-82a3-713035b3d753 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.168018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4bc95860-5927-4b4f-82a3-713035b3d753 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '9421db165ebd474283704914ced3b151', 'request_id': 'req-4bc95860-5927-4b4f-82a3-713035b3d753'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.176548 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2801/5604] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:57.186039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202af13-61ff-40b8-9e50-6709377d8c67 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.187686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202af13-61ff-40b8-9e50-6709377d8c67 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.188076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202af13-61ff-40b8-9e50-6709377d8c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.201834 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2804/5605] 10.222.0.27 () {58 vars in 1266 bytes} [Sun Aug 28 18:42:57 2022] DELETE /identity/v3/OS-OAUTH1/consumers/9421db165ebd474283704914ced3b151 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:57.206456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc95860-5927-4b4f-82a3-713035b3d753 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:57.208623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4bc95860-5927-4b4f-82a3-713035b3d753 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:57.231323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc95860-5927-4b4f-82a3-713035b3d753 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:57.237104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291c2d5-5567-4edb-8b43-e8981a167fbb tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d505e22147f4a6398d542aaa1d62c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537e99603c3f4b6b9d91a78fb1e982f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:57.237458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5202af13-61ff-40b8-9e50-6709377d8c67 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:57.237776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291c2d5-5567-4edb-8b43-e8981a167fbb tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.238061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291c2d5-5567-4edb-8b43-e8981a167fbb tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.238341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291c2d5-5567-4edb-8b43-e8981a167fbb tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2944960aa1a840e7933e3cbad0c8b66c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.239514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5202af13-61ff-40b8-9e50-6709377d8c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:57.239635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291c2d5-5567-4edb-8b43-e8981a167fbb tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=2944960aa1a840e7933e3cbad0c8b66c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:57.243597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291c2d5-5567-4edb-8b43-e8981a167fbb tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:57.244018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1291c2d5-5567-4edb-8b43-e8981a167fbb tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invalidating token cache because consumer 2944960aa1a840e7933e3cbad0c8b66c has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:57.244469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1291c2d5-5567-4edb-8b43-e8981a167fbb tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.245200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1291c2d5-5567-4edb-8b43-e8981a167fbb tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.254366 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2802/5606] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:57.256755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202af13-61ff-40b8-9e50-6709377d8c67 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:57.267195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1291c2d5-5567-4edb-8b43-e8981a167fbb tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '2944960aa1a840e7933e3cbad0c8b66c', 'request_id': 'req-1291c2d5-5567-4edb-8b43-e8981a167fbb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.269887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202af13-61ff-40b8-9e50-6709377d8c67 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:57.275611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a14e1-34ba-44f4-8b4c-dd1206eb7ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:57.277005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a14e1-34ba-44f4-8b4c-dd1206eb7ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.277590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a14e1-34ba-44f4-8b4c-dd1206eb7ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.278415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a14e1-34ba-44f4-8b4c-dd1206eb7ea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.279526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a14e1-34ba-44f4-8b4c-dd1206eb7ea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:42:57.280025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a14e1-34ba-44f4-8b4c-dd1206eb7ea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:57.291177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a14e1-34ba-44f4-8b4c-dd1206eb7ea8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:57.301412 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2805/5607] 10.222.0.27 () {58 vars in 1266 bytes} [Sun Aug 28 18:42:57 2022] DELETE /identity/v3/OS-OAUTH1/consumers/2944960aa1a840e7933e3cbad0c8b66c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:57.308290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291c2d5-5567-4edb-8b43-e8981a167fbb tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:57.312676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1291c2d5-5567-4edb-8b43-e8981a167fbb tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:57.313968 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2803/5608] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:57.315191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a14e1-34ba-44f4-8b4c-dd1206eb7ea8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:57.328423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a14e1-34ba-44f4-8b4c-dd1206eb7ea8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:57.334550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48baea34-db25-49d0-9563-d259850a3008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:57.335183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baea34-db25-49d0-9563-d259850a3008 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.335557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baea34-db25-49d0-9563-d259850a3008 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.335831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baea34-db25-49d0-9563-d259850a3008 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.336700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48baea34-db25-49d0-9563-d259850a3008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:57.339149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291c2d5-5567-4edb-8b43-e8981a167fbb tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:57.346413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48baea34-db25-49d0-9563-d259850a3008 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:57.348792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753a90a-9ac5-4c1c-b397-de8111af981e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d505e22147f4a6398d542aaa1d62c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537e99603c3f4b6b9d91a78fb1e982f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:57.349978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753a90a-9ac5-4c1c-b397-de8111af981e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.350483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753a90a-9ac5-4c1c-b397-de8111af981e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.350967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753a90a-9ac5-4c1c-b397-de8111af981e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.352304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753a90a-9ac5-4c1c-b397-de8111af981e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:57.355783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753a90a-9ac5-4c1c-b397-de8111af981e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:57.364444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:57.386532 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2806/5609] 10.222.0.27 () {60 vars in 1185 bytes} [Sun Aug 28 18:42:57 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:57.387955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753a90a-9ac5-4c1c-b397-de8111af981e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:57.396059 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2804/5610] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:57 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:57.397035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48baea34-db25-49d0-9563-d259850a3008 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:57.405352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753a90a-9ac5-4c1c-b397-de8111af981e tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:57.497411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:57.529690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48baea34-db25-49d0-9563-d259850a3008 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:57.537456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cbb2c-69ee-424b-ad86-248a0c0d6028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:57.538623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cbb2c-69ee-424b-ad86-248a0c0d6028 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.539594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cbb2c-69ee-424b-ad86-248a0c0d6028 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.540031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cbb2c-69ee-424b-ad86-248a0c0d6028 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.540779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2cbb2c-69ee-424b-ad86-248a0c0d6028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:57.543962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c8bd8-742a-4154-9fca-45ac7f505104 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d505e22147f4a6398d542aaa1d62c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537e99603c3f4b6b9d91a78fb1e982f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:57.544651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2cbb2c-69ee-424b-ad86-248a0c0d6028 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:57.544743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c8bd8-742a-4154-9fca-45ac7f505104 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.544891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c8bd8-742a-4154-9fca-45ac7f505104 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.545172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c8bd8-742a-4154-9fca-45ac7f505104 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/5c69f0de363a42df892c831e739beae2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.546041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c8bd8-742a-4154-9fca-45ac7f505104 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=5c69f0de363a42df892c831e739beae2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:57.547392 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-b89c8bd8-742a-4154-9fca-45ac7f505104 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:42:57.547392 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:42:57.547392 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:42:57.551464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c8bd8-742a-4154-9fca-45ac7f505104 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:57.596264 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2805/5611] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:57 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:57.600067 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2807/5612] 10.222.0.27 () {60 vars in 1285 bytes} [Sun Aug 28 18:42:57 2022] PATCH /identity/v3/OS-OAUTH1/consumers/5c69f0de363a42df892c831e739beae2 => generated 221 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:57.601377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cbb2c-69ee-424b-ad86-248a0c0d6028 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:57.602527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c8bd8-742a-4154-9fca-45ac7f505104 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:57.627121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cbb2c-69ee-424b-ad86-248a0c0d6028 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:57.632561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c8bd8-742a-4154-9fca-45ac7f505104 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:57.642123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa4119-7cb0-46ee-83e5-b8752873c052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:57.642969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa4119-7cb0-46ee-83e5-b8752873c052 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.643267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa4119-7cb0-46ee-83e5-b8752873c052 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.644095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa4119-7cb0-46ee-83e5-b8752873c052 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.644744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa4119-7cb0-46ee-83e5-b8752873c052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:57.647523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa4119-7cb0-46ee-83e5-b8752873c052 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:57.648259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bce8f2-51a7-489b-8b5e-de3ccabe64b3 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d505e22147f4a6398d542aaa1d62c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537e99603c3f4b6b9d91a78fb1e982f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:57.649369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bce8f2-51a7-489b-8b5e-de3ccabe64b3 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.650228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bce8f2-51a7-489b-8b5e-de3ccabe64b3 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.650667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bce8f2-51a7-489b-8b5e-de3ccabe64b3 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/5c69f0de363a42df892c831e739beae2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.652429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bce8f2-51a7-489b-8b5e-de3ccabe64b3 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=5c69f0de363a42df892c831e739beae2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:57.656013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bce8f2-51a7-489b-8b5e-de3ccabe64b3 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:57.659487 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2806/5613] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:42:57.664384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa4119-7cb0-46ee-83e5-b8752873c052 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:57.666214 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2808/5614] 10.222.0.27 () {58 vars in 1263 bytes} [Sun Aug 28 18:42:57 2022] GET /identity/v3/OS-OAUTH1/consumers/5c69f0de363a42df892c831e739beae2 => generated 221 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:42:57.679341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bce8f2-51a7-489b-8b5e-de3ccabe64b3 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:57.680044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa4119-7cb0-46ee-83e5-b8752873c052 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:57.686017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e7c94-b9d5-4491-80d0-c7c3a664b6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:57.686626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e7c94-b9d5-4491-80d0-c7c3a664b6fc admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.686743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bce8f2-51a7-489b-8b5e-de3ccabe64b3 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:57.686902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e7c94-b9d5-4491-80d0-c7c3a664b6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.687174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e7c94-b9d5-4491-80d0-c7c3a664b6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.687892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e7c94-b9d5-4491-80d0-c7c3a664b6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:57.690309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e7c94-b9d5-4491-80d0-c7c3a664b6fc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:57.694920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6eec6f-1738-4a71-81bd-8eecb95ff412 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d505e22147f4a6398d542aaa1d62c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537e99603c3f4b6b9d91a78fb1e982f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:57.695631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eec6f-1738-4a71-81bd-8eecb95ff412 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.695915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eec6f-1738-4a71-81bd-8eecb95ff412 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.696342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eec6f-1738-4a71-81bd-8eecb95ff412 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/5c69f0de363a42df892c831e739beae2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.696943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6eec6f-1738-4a71-81bd-8eecb95ff412 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=5c69f0de363a42df892c831e739beae2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:57.700359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6eec6f-1738-4a71-81bd-8eecb95ff412 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:57.700658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e6eec6f-1738-4a71-81bd-8eecb95ff412 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invalidating token cache because consumer 5c69f0de363a42df892c831e739beae2 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:57.700911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e6eec6f-1738-4a71-81bd-8eecb95ff412 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.702568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e6eec6f-1738-4a71-81bd-8eecb95ff412 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.713355 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2807/5615] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:42:57.718209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e7c94-b9d5-4491-80d0-c7c3a664b6fc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:57.718486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e6eec6f-1738-4a71-81bd-8eecb95ff412 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '5c69f0de363a42df892c831e739beae2', 'request_id': 'req-0e6eec6f-1738-4a71-81bd-8eecb95ff412'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.720921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f43e7c94-b9d5-4491-80d0-c7c3a664b6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:57.747433 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2809/5616] 10.222.0.27 () {58 vars in 1266 bytes} [Sun Aug 28 18:42:57 2022] DELETE /identity/v3/OS-OAUTH1/consumers/5c69f0de363a42df892c831e739beae2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:57.750227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e7c94-b9d5-4491-80d0-c7c3a664b6fc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:57.752861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6eec6f-1738-4a71-81bd-8eecb95ff412 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:57.755057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0e6eec6f-1738-4a71-81bd-8eecb95ff412 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:57.772401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e15183-e0bd-4701-93e3-5d1664b073b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:57.773065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e15183-e0bd-4701-93e3-5d1664b073b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.773340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e15183-e0bd-4701-93e3-5d1664b073b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.773612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e15183-e0bd-4701-93e3-5d1664b073b1 admin admin] PATH_INFO: `/v3/projects/3b08f62057b640dc8456db89045facc1/users/813412ada6924ff0b239636fac52d950/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.785016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6eec6f-1738-4a71-81bd-8eecb95ff412 tempest-OAUTHConsumersV3Test-1288227189 tempest-OAUTHConsumersV3Test-1288227189-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:57.790496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7d600-fd30-4a59-ac3c-6703e5af4e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:57.791383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7d600-fd30-4a59-ac3c-6703e5af4e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.791896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7d600-fd30-4a59-ac3c-6703e5af4e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.792309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7d600-fd30-4a59-ac3c-6703e5af4e83 admin admin] PATH_INFO: `/v3/users/989545bfc9b0444a8b74e818430c693b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.794220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e15183-e0bd-4701-93e3-5d1664b073b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b08f62057b640dc8456db89045facc1, user_id=813412ada6924ff0b239636fac52d950, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:57.794621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7d600-fd30-4a59-ac3c-6703e5af4e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=989545bfc9b0444a8b74e818430c693b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:57.796795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7d600-fd30-4a59-ac3c-6703e5af4e83 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:57.796927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e15183-e0bd-4701-93e3-5d1664b073b1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:57.815317 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2808/5617] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:57 2022] PUT /identity/v3/projects/3b08f62057b640dc8456db89045facc1/users/813412ada6924ff0b239636fac52d950/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:42:57.865408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-21d7d600-fd30-4a59-ac3c-6703e5af4e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989545bfc9b0444a8b74e818430c693b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.866171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-21d7d600-fd30-4a59-ac3c-6703e5af4e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989545bfc9b0444a8b74e818430c693b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.876126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-21d7d600-fd30-4a59-ac3c-6703e5af4e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989545bfc9b0444a8b74e818430c693b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.889157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-21d7d600-fd30-4a59-ac3c-6703e5af4e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989545bfc9b0444a8b74e818430c693b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.908276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-21d7d600-fd30-4a59-ac3c-6703e5af4e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989545bfc9b0444a8b74e818430c693b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:57.917964 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2810/5618] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:57 2022] DELETE /identity/v3/users/989545bfc9b0444a8b74e818430c693b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:57.922708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b57893-e291-4530-83dc-a90b9e20bd09 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.923151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b57893-e291-4530-83dc-a90b9e20bd09 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.923552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b57893-e291-4530-83dc-a90b9e20bd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.926642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dc21c-4b01-462b-a1c6-0526fce91298 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:57.927033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dc21c-4b01-462b-a1c6-0526fce91298 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:57.927439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dc21c-4b01-462b-a1c6-0526fce91298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:57.959287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b0b57893-e291-4530-83dc-a90b9e20bd09 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:57.961210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b0b57893-e291-4530-83dc-a90b9e20bd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:57.979991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a05dc21c-4b01-462b-a1c6-0526fce91298 None None] MFA Rules not processed for user `813412ada6924ff0b239636fac52d950`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:57.982739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a05dc21c-4b01-462b-a1c6-0526fce91298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:57.999199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:58.036284 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2809/5619] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:58.050018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b57893-e291-4530-83dc-a90b9e20bd09 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:58.052335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b0b57893-e291-4530-83dc-a90b9e20bd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:58.093483 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2811/5620] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:58.094808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dc21c-4b01-462b-a1c6-0526fce91298 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:58.096534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a05dc21c-4b01-462b-a1c6-0526fce91298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:58.114694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dc21c-4b01-462b-a1c6-0526fce91298 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:58.121954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ccd75-a5ba-45d7-9280-9bb77ea9ba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:58.124377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ccd75-a5ba-45d7-9280-9bb77ea9ba08 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:58.124728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ccd75-a5ba-45d7-9280-9bb77ea9ba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:58.124980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ccd75-a5ba-45d7-9280-9bb77ea9ba08 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:58.125621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ccd75-a5ba-45d7-9280-9bb77ea9ba08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:58.133302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ccd75-a5ba-45d7-9280-9bb77ea9ba08 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:58.169695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b57893-e291-4530-83dc-a90b9e20bd09 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:58.181530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dae3b-c11a-4c04-80d6-da623955c759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:58.182209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dae3b-c11a-4c04-80d6-da623955c759 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:58.182488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dae3b-c11a-4c04-80d6-da623955c759 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:58.182769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dae3b-c11a-4c04-80d6-da623955c759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:58.194185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dae3b-c11a-4c04-80d6-da623955c759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:58.195699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dae3b-c11a-4c04-80d6-da623955c759 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:58.204084 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2812/5621] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:42:58 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:58.208899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ccd75-a5ba-45d7-9280-9bb77ea9ba08 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:58.211477 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2810/5622] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:58.403551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ccd75-a5ba-45d7-9280-9bb77ea9ba08 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:58.411118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3049fee-e238-4b15-9af6-5b23450ee894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:58.412172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3049fee-e238-4b15-9af6-5b23450ee894 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:58.412662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3049fee-e238-4b15-9af6-5b23450ee894 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:58.413170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3049fee-e238-4b15-9af6-5b23450ee894 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:58.414112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3049fee-e238-4b15-9af6-5b23450ee894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:58.416670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3049fee-e238-4b15-9af6-5b23450ee894 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:58.451851 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2813/5623] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:42:58 2022] POST /identity/v3/users => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:42:58.456460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dae3b-c11a-4c04-80d6-da623955c759 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:58.472841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dae3b-c11a-4c04-80d6-da623955c759 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:58.478624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b48eb-fffa-4521-b7b0-471a03f8bc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:58.479287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b48eb-fffa-4521-b7b0-471a03f8bc77 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:58.480664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b48eb-fffa-4521-b7b0-471a03f8bc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:58.480664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b48eb-fffa-4521-b7b0-471a03f8bc77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:58.483538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b48eb-fffa-4521-b7b0-471a03f8bc77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:58.490448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b48eb-fffa-4521-b7b0-471a03f8bc77 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:58.509887 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2811/5624] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:58.514020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3049fee-e238-4b15-9af6-5b23450ee894 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:58.529007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3049fee-e238-4b15-9af6-5b23450ee894 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:58.542348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be045eb9-4948-483b-b91b-6359f324ae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:58.543126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be045eb9-4948-483b-b91b-6359f324ae2b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:58.543431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be045eb9-4948-483b-b91b-6359f324ae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:58.543696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be045eb9-4948-483b-b91b-6359f324ae2b admin admin] PATH_INFO: `/v3/projects/39cb232b4d4249e4b9345d39948c92cd/users/716470c3a8ba4c999003229f8e257b00/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:58.581507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be045eb9-4948-483b-b91b-6359f324ae2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=39cb232b4d4249e4b9345d39948c92cd, user_id=716470c3a8ba4c999003229f8e257b00, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:58.584642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be045eb9-4948-483b-b91b-6359f324ae2b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:58.617287 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2814/5625] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:58 2022] PUT /identity/v3/projects/39cb232b4d4249e4b9345d39948c92cd/users/716470c3a8ba4c999003229f8e257b00/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:58.620330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b48eb-fffa-4521-b7b0-471a03f8bc77 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:58.639328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b48eb-fffa-4521-b7b0-471a03f8bc77 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:58.684338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be045eb9-4948-483b-b91b-6359f324ae2b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:58.688370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-be045eb9-4948-483b-b91b-6359f324ae2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:58.718554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:58.850101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84616fb-7a68-42ce-88c0-817c445b0350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:58.850775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84616fb-7a68-42ce-88c0-817c445b0350 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:58.851052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84616fb-7a68-42ce-88c0-817c445b0350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:58.851349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84616fb-7a68-42ce-88c0-817c445b0350 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:58.852006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84616fb-7a68-42ce-88c0-817c445b0350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:58.853614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84616fb-7a68-42ce-88c0-817c445b0350 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:58.891179 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2812/5626] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:42:58.897299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84616fb-7a68-42ce-88c0-817c445b0350 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:58.908964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:58.919117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be045eb9-4948-483b-b91b-6359f324ae2b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:58.925434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84616fb-7a68-42ce-88c0-817c445b0350 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:58.933748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:58.934413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:58.934690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:58.934964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262 admin admin] PATH_INFO: `/v3/projects/16d02c64443f420a8cf36ba7819e2f42` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:58.936667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d02c64443f420a8cf36ba7819e2f42)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:58.939717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:58.942671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead25600-2bbf-459e-bfb4-efba5e3a4cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:58.943388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead25600-2bbf-459e-bfb4-efba5e3a4cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:58.943667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead25600-2bbf-459e-bfb4-efba5e3a4cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:58.943942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead25600-2bbf-459e-bfb4-efba5e3a4cfc admin admin] PATH_INFO: `/v3/projects/39cb232b4d4249e4b9345d39948c92cd/users/716470c3a8ba4c999003229f8e257b00/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:58.948145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead25600-2bbf-459e-bfb4-efba5e3a4cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=39cb232b4d4249e4b9345d39948c92cd, user_id=716470c3a8ba4c999003229f8e257b00, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:58.951663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead25600-2bbf-459e-bfb4-efba5e3a4cfc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:59.001275 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2813/5627] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:42:58 2022] PUT /identity/v3/projects/39cb232b4d4249e4b9345d39948c92cd/users/716470c3a8ba4c999003229f8e257b00/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:59.012711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ed8de-9657-4cd4-b488-1569ad9fff3d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:59.013011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ed8de-9657-4cd4-b488-1569ad9fff3d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:59.013252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ed8de-9657-4cd4-b488-1569ad9fff3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:59.096477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d02c64443f420a8cf36ba7819e2f42', 'request_id': 'req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:59.117784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1b2ed8de-9657-4cd4-b488-1569ad9fff3d None None] MFA Rules not processed for user `716470c3a8ba4c999003229f8e257b00`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:59.119313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1b2ed8de-9657-4cd4-b488-1569ad9fff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:59.127148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d02c64443f420a8cf36ba7819e2f42', 'request_id': 'req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:59.139975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d02c64443f420a8cf36ba7819e2f42', 'request_id': 'req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:59.177502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262 admin admin] The token cache is being invalidate because project 16d02c64443f420a8cf36ba7819e2f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:42:59.178478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:59.179707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:59.190567 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2815/5628] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:42:58 2022] DELETE /identity/v3/projects/16d02c64443f420a8cf36ba7819e2f42 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:42:59.192479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:59.196438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:59.356334 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2814/5629] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:42:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:59.367090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ed8de-9657-4cd4-b488-1569ad9fff3d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:59.368915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1b2ed8de-9657-4cd4-b488-1569ad9fff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:59.394867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb208a15-fbc2-4f60-8e8b-a3a14ba2e262 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:59.409823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0f247-681c-4e05-b7f4-075e76e9be5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:59.411057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0f247-681c-4e05-b7f4-075e76e9be5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:59.411551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0f247-681c-4e05-b7f4-075e76e9be5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:59.412239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0f247-681c-4e05-b7f4-075e76e9be5f admin admin] PATH_INFO: `/v3/users/2d505e22147f4a6398d542aaa1d62c7a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:59.417316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0f247-681c-4e05-b7f4-075e76e9be5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d505e22147f4a6398d542aaa1d62c7a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:59.419896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0f247-681c-4e05-b7f4-075e76e9be5f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:59.517809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ed8de-9657-4cd4-b488-1569ad9fff3d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:59.521059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52d0f247-681c-4e05-b7f4-075e76e9be5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d505e22147f4a6398d542aaa1d62c7a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:59.522069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52d0f247-681c-4e05-b7f4-075e76e9be5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d505e22147f4a6398d542aaa1d62c7a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:59.525454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192dd54-739e-4747-86f8-7db75716675f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:59.526577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192dd54-739e-4747-86f8-7db75716675f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:59.527106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192dd54-739e-4747-86f8-7db75716675f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:59.528017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192dd54-739e-4747-86f8-7db75716675f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:59.530210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a192dd54-739e-4747-86f8-7db75716675f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:59.536073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52d0f247-681c-4e05-b7f4-075e76e9be5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d505e22147f4a6398d542aaa1d62c7a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:59.561693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52d0f247-681c-4e05-b7f4-075e76e9be5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d505e22147f4a6398d542aaa1d62c7a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:59.571235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192dd54-739e-4747-86f8-7db75716675f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:59.577134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192dd54-739e-4747-86f8-7db75716675f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:59.590088 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2815/5630] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:42:59.594605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52d0f247-681c-4e05-b7f4-075e76e9be5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d505e22147f4a6398d542aaa1d62c7a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:42:59.602968 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2816/5631] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:42:59 2022] DELETE /identity/v3/users/2d505e22147f4a6398d542aaa1d62c7a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:00.616259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192dd54-739e-4747-86f8-7db75716675f service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:00.618528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a192dd54-739e-4747-86f8-7db75716675f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:00.655158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192dd54-739e-4747-86f8-7db75716675f service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:00.805241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:00.884148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d6e5c-cb0f-44b9-905b-f35427ff96b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:00.886041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d6e5c-cb0f-44b9-905b-f35427ff96b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:00.886360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d6e5c-cb0f-44b9-905b-f35427ff96b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:00.886639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d6e5c-cb0f-44b9-905b-f35427ff96b2 admin admin] PATH_INFO: `/v3/projects/537e99603c3f4b6b9d91a78fb1e982f5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:00.892358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d6e5c-cb0f-44b9-905b-f35427ff96b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=537e99603c3f4b6b9d91a78fb1e982f5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:00.894446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d6e5c-cb0f-44b9-905b-f35427ff96b2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:01.051028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e5d6e5c-cb0f-44b9-905b-f35427ff96b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537e99603c3f4b6b9d91a78fb1e982f5', 'request_id': 'req-4e5d6e5c-cb0f-44b9-905b-f35427ff96b2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:01.065533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e5d6e5c-cb0f-44b9-905b-f35427ff96b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537e99603c3f4b6b9d91a78fb1e982f5', 'request_id': 'req-4e5d6e5c-cb0f-44b9-905b-f35427ff96b2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:01.091624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e5d6e5c-cb0f-44b9-905b-f35427ff96b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537e99603c3f4b6b9d91a78fb1e982f5', 'request_id': 'req-4e5d6e5c-cb0f-44b9-905b-f35427ff96b2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:01.115150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e5d6e5c-cb0f-44b9-905b-f35427ff96b2 admin admin] The token cache is being invalidate because project 537e99603c3f4b6b9d91a78fb1e982f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:43:01.115813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e5d6e5c-cb0f-44b9-905b-f35427ff96b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:01.117217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e5d6e5c-cb0f-44b9-905b-f35427ff96b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:01.123704 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2816/5632] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:43:00 2022] DELETE /identity/v3/projects/537e99603c3f4b6b9d91a78fb1e982f5 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:01.125239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1b4d3-c113-48c4-9974-89f5ddd9c98e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:01.125694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1b4d3-c113-48c4-9974-89f5ddd9c98e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:01.125781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1b4d3-c113-48c4-9974-89f5ddd9c98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:01.178228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:01.197574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d6b1b4d3-c113-48c4-9974-89f5ddd9c98e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:01.203575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6b1b4d3-c113-48c4-9974-89f5ddd9c98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:01.343416 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2817/5633] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:01.351101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b28604-fba1-440e-b167-3534ed5337bc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:01.351419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b28604-fba1-440e-b167-3534ed5337bc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:01.351698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b28604-fba1-440e-b167-3534ed5337bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:01.375316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-27b28604-fba1-440e-b167-3534ed5337bc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:01.376565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-27b28604-fba1-440e-b167-3534ed5337bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:01.392807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1b4d3-c113-48c4-9974-89f5ddd9c98e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:01.395614 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2817/5634] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:01.405533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1b4d3-c113-48c4-9974-89f5ddd9c98e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:01.411729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6d709-d813-42f0-9799-a93f7c748ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:01.412745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6d709-d813-42f0-9799-a93f7c748ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:01.413193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6d709-d813-42f0-9799-a93f7c748ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:01.413834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6d709-d813-42f0-9799-a93f7c748ed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:01.414757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6d709-d813-42f0-9799-a93f7c748ed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:43:01.414987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6d709-d813-42f0-9799-a93f7c748ed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:01.417689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6d709-d813-42f0-9799-a93f7c748ed5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:01.444283 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2818/5635] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:43:01.444493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b28604-fba1-440e-b167-3534ed5337bc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:01.457110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b28604-fba1-440e-b167-3534ed5337bc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:01.463529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142e64b-55fa-48d5-a31f-a0b379f4033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:01.464575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142e64b-55fa-48d5-a31f-a0b379f4033c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:01.465266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142e64b-55fa-48d5-a31f-a0b379f4033c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:01.465639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142e64b-55fa-48d5-a31f-a0b379f4033c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:01.466656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142e64b-55fa-48d5-a31f-a0b379f4033c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:01.469311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142e64b-55fa-48d5-a31f-a0b379f4033c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:01.519194 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2818/5636] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:43:01 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:43:01.523424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6d709-d813-42f0-9799-a93f7c748ed5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:01.557172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6d709-d813-42f0-9799-a93f7c748ed5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:01.691055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0ab33-8554-45fd-aef5-f9e732f3d55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:01.691749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0ab33-8554-45fd-aef5-f9e732f3d55c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:01.692183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0ab33-8554-45fd-aef5-f9e732f3d55c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:01.692572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0ab33-8554-45fd-aef5-f9e732f3d55c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:01.693264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0ab33-8554-45fd-aef5-f9e732f3d55c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:01.695567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0ab33-8554-45fd-aef5-f9e732f3d55c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:01.740840 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2819/5637] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:43:01 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:01.745005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142e64b-55fa-48d5-a31f-a0b379f4033c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:01.770051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142e64b-55fa-48d5-a31f-a0b379f4033c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:01.780586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43646a5d-e71b-4550-833c-0e555b0164b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:01.782873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43646a5d-e71b-4550-833c-0e555b0164b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:01.783156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43646a5d-e71b-4550-833c-0e555b0164b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:01.783907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43646a5d-e71b-4550-833c-0e555b0164b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:01.785048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43646a5d-e71b-4550-833c-0e555b0164b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:01.787107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43646a5d-e71b-4550-833c-0e555b0164b4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:01.821574 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2819/5638] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:01.825761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0ab33-8554-45fd-aef5-f9e732f3d55c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:01.840649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0ab33-8554-45fd-aef5-f9e732f3d55c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:01.847596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03653d65-431f-4e63-8697-13970bc6a13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:01.848779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03653d65-431f-4e63-8697-13970bc6a13f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:01.849414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03653d65-431f-4e63-8697-13970bc6a13f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:01.849922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03653d65-431f-4e63-8697-13970bc6a13f admin admin] PATH_INFO: `/v3/projects/5df1ad964b2a4382a1753eb9416cdf94/users/b24f52d3489d4ffd8d57d5722f076c57/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:01.876446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03653d65-431f-4e63-8697-13970bc6a13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df1ad964b2a4382a1753eb9416cdf94, user_id=b24f52d3489d4ffd8d57d5722f076c57, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:01.879821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03653d65-431f-4e63-8697-13970bc6a13f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:01.923857 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2820/5639] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:43:01 2022] PUT /identity/v3/projects/5df1ad964b2a4382a1753eb9416cdf94/users/b24f52d3489d4ffd8d57d5722f076c57/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:43:01.924960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43646a5d-e71b-4550-833c-0e555b0164b4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:01.943406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43646a5d-e71b-4550-833c-0e555b0164b4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:02.075275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9de72-d535-4f79-b75f-a55cfb8322dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:02.076238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9de72-d535-4f79-b75f-a55cfb8322dd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:02.076699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9de72-d535-4f79-b75f-a55cfb8322dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:02.077126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9de72-d535-4f79-b75f-a55cfb8322dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:02.077927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9de72-d535-4f79-b75f-a55cfb8322dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:02.080608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9de72-d535-4f79-b75f-a55cfb8322dd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:02.105778 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2820/5640] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:43:02.111327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03653d65-431f-4e63-8697-13970bc6a13f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:02.140593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03653d65-431f-4e63-8697-13970bc6a13f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:02.158283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91580199-bf7a-48a4-a2e7-997d0a3a7e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:02.159566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91580199-bf7a-48a4-a2e7-997d0a3a7e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:02.160276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91580199-bf7a-48a4-a2e7-997d0a3a7e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:02.160770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91580199-bf7a-48a4-a2e7-997d0a3a7e98 admin admin] PATH_INFO: `/v3/projects/5df1ad964b2a4382a1753eb9416cdf94/users/b24f52d3489d4ffd8d57d5722f076c57/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:02.164487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91580199-bf7a-48a4-a2e7-997d0a3a7e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df1ad964b2a4382a1753eb9416cdf94, user_id=b24f52d3489d4ffd8d57d5722f076c57, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:02.168238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91580199-bf7a-48a4-a2e7-997d0a3a7e98 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:02.182525 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2821/5641] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:43:02 2022] PUT /identity/v3/projects/5df1ad964b2a4382a1753eb9416cdf94/users/b24f52d3489d4ffd8d57d5722f076c57/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:02.193054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393aa90-0167-4c58-bfab-f0a93992d3b5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:02.193351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393aa90-0167-4c58-bfab-f0a93992d3b5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:02.193688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393aa90-0167-4c58-bfab-f0a93992d3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:02.258725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0393aa90-0167-4c58-bfab-f0a93992d3b5 None None] MFA Rules not processed for user `b24f52d3489d4ffd8d57d5722f076c57`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:02.260060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0393aa90-0167-4c58-bfab-f0a93992d3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:02.288667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:02.384256 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2821/5642] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:02.388459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91580199-bf7a-48a4-a2e7-997d0a3a7e98 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:02.468996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:02.486457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91580199-bf7a-48a4-a2e7-997d0a3a7e98 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:02.492160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e57716-a5fa-43f3-9e10-16128d78f730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:02.492850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e57716-a5fa-43f3-9e10-16128d78f730 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:02.493194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e57716-a5fa-43f3-9e10-16128d78f730 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:02.493667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e57716-a5fa-43f3-9e10-16128d78f730 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:02.494376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e57716-a5fa-43f3-9e10-16128d78f730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:02.496431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e57716-a5fa-43f3-9e10-16128d78f730 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:02.531181 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2822/5643] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:43:02 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:02.536439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393aa90-0167-4c58-bfab-f0a93992d3b5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:02.549973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393aa90-0167-4c58-bfab-f0a93992d3b5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:02.630120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81c126-ecff-4fda-9712-0624ff546350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:02.631031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81c126-ecff-4fda-9712-0624ff546350 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:02.631438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81c126-ecff-4fda-9712-0624ff546350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:02.632070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81c126-ecff-4fda-9712-0624ff546350 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:02.632979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81c126-ecff-4fda-9712-0624ff546350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:02.635186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81c126-ecff-4fda-9712-0624ff546350 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:02.669687 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2822/5644] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:43:02 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:02.673702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e57716-a5fa-43f3-9e10-16128d78f730 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:02.687680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e57716-a5fa-43f3-9e10-16128d78f730 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:02.694092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73639d-7db7-4898-bee1-9c559a483af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:02.695144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73639d-7db7-4898-bee1-9c559a483af7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:02.695144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73639d-7db7-4898-bee1-9c559a483af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:02.695447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73639d-7db7-4898-bee1-9c559a483af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:02.696185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73639d-7db7-4898-bee1-9c559a483af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:02.697856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73639d-7db7-4898-bee1-9c559a483af7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:02.714335 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2823/5645] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:02.718070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81c126-ecff-4fda-9712-0624ff546350 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:02.734636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81c126-ecff-4fda-9712-0624ff546350 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:02.749868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e8777-c4dd-4de4-9e18-7450f08a6b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:02.750652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e8777-c4dd-4de4-9e18-7450f08a6b56 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:02.751166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e8777-c4dd-4de4-9e18-7450f08a6b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:02.751562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e8777-c4dd-4de4-9e18-7450f08a6b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:02.752641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e8777-c4dd-4de4-9e18-7450f08a6b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:02.756827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e8777-c4dd-4de4-9e18-7450f08a6b56 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:02.785981 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2823/5646] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:02.788110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73639d-7db7-4898-bee1-9c559a483af7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:02.800686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73639d-7db7-4898-bee1-9c559a483af7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:02.807850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60617c8-0ba7-41e3-b960-7f7bf82fd9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:02.808586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60617c8-0ba7-41e3-b960-7f7bf82fd9e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:02.809140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60617c8-0ba7-41e3-b960-7f7bf82fd9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:02.809444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60617c8-0ba7-41e3-b960-7f7bf82fd9e6 admin admin] PATH_INFO: `/v3/projects/8d71791a1b48491586f920bf0db9d8ae/users/8de634439b47446e9e64d97c42f93863/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:02.842896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60617c8-0ba7-41e3-b960-7f7bf82fd9e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d71791a1b48491586f920bf0db9d8ae, user_id=8de634439b47446e9e64d97c42f93863, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:02.846445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60617c8-0ba7-41e3-b960-7f7bf82fd9e6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:02.880232 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2824/5647] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:43:02 2022] PUT /identity/v3/projects/8d71791a1b48491586f920bf0db9d8ae/users/8de634439b47446e9e64d97c42f93863/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:02.965723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03c816-5271-4d48-a0f8-6eb0b41a0bbe None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:02.966374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03c816-5271-4d48-a0f8-6eb0b41a0bbe None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:02.966911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03c816-5271-4d48-a0f8-6eb0b41a0bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:03.036142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6e03c816-5271-4d48-a0f8-6eb0b41a0bbe None None] MFA Rules not processed for user `8de634439b47446e9e64d97c42f93863`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:03.037864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6e03c816-5271-4d48-a0f8-6eb0b41a0bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:03.114360 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2824/5648] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:03.129691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60617c8-0ba7-41e3-b960-7f7bf82fd9e6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:03.132624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c60617c8-0ba7-41e3-b960-7f7bf82fd9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:03.238884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60617c8-0ba7-41e3-b960-7f7bf82fd9e6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:03.253051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d6f62-a693-4605-929f-f385a2f8cfd3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:03.254365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d6f62-a693-4605-929f-f385a2f8cfd3 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:03.254597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d6f62-a693-4605-929f-f385a2f8cfd3 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:03.254886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d6f62-a693-4605-929f-f385a2f8cfd3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:03.417853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d6f62-a693-4605-929f-f385a2f8cfd3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:03.420171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d6f62-a693-4605-929f-f385a2f8cfd3 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:03.441841 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2825/5649] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:43:03.826765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03c816-5271-4d48-a0f8-6eb0b41a0bbe None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:03.873135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:03.945778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03c816-5271-4d48-a0f8-6eb0b41a0bbe None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:03.952208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fcd05-5fc6-4087-af81-b56ee68f5f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:03.953047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fcd05-5fc6-4087-af81-b56ee68f5f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:03.953319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fcd05-5fc6-4087-af81-b56ee68f5f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:03.953600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fcd05-5fc6-4087-af81-b56ee68f5f4c admin admin] PATH_INFO: `/v3/users/b24f52d3489d4ffd8d57d5722f076c57` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:03.955379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9fcd05-5fc6-4087-af81-b56ee68f5f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b24f52d3489d4ffd8d57d5722f076c57)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:03.958796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9fcd05-5fc6-4087-af81-b56ee68f5f4c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:04.028673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4a9fcd05-5fc6-4087-af81-b56ee68f5f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b24f52d3489d4ffd8d57d5722f076c57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:04.042382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4a9fcd05-5fc6-4087-af81-b56ee68f5f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b24f52d3489d4ffd8d57d5722f076c57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:04.043138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4a9fcd05-5fc6-4087-af81-b56ee68f5f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b24f52d3489d4ffd8d57d5722f076c57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:04.043840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4a9fcd05-5fc6-4087-af81-b56ee68f5f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b24f52d3489d4ffd8d57d5722f076c57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:04.053133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4a9fcd05-5fc6-4087-af81-b56ee68f5f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b24f52d3489d4ffd8d57d5722f076c57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:04.076667 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2825/5650] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:43:03 2022] DELETE /identity/v3/users/b24f52d3489d4ffd8d57d5722f076c57 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:04.078428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf742848-791b-4c3b-9a71-4e5f9687a922 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:04.078716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf742848-791b-4c3b-9a71-4e5f9687a922 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:04.079003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf742848-791b-4c3b-9a71-4e5f9687a922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:04.101774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bf742848-791b-4c3b-9a71-4e5f9687a922 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:04.103006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf742848-791b-4c3b-9a71-4e5f9687a922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:04.147734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:04.195517 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2826/5651] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:04.248678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fcd05-5fc6-4087-af81-b56ee68f5f4c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:04.250405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4a9fcd05-5fc6-4087-af81-b56ee68f5f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:04.326912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fcd05-5fc6-4087-af81-b56ee68f5f4c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:04.330867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719c402-4dd6-475d-b2dd-2b78d032e28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:04.331859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c402-4dd6-475d-b2dd-2b78d032e28d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:04.332141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c402-4dd6-475d-b2dd-2b78d032e28d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:04.332416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c402-4dd6-475d-b2dd-2b78d032e28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:04.343074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719c402-4dd6-475d-b2dd-2b78d032e28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:04.344629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719c402-4dd6-475d-b2dd-2b78d032e28d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:04.371273 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2826/5652] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:05.040224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf742848-791b-4c3b-9a71-4e5f9687a922 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:05.042279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf742848-791b-4c3b-9a71-4e5f9687a922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:05.066424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf742848-791b-4c3b-9a71-4e5f9687a922 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:05.073057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda641e-8b59-4bd8-8a99-863e9f97b75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:05.079204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda641e-8b59-4bd8-8a99-863e9f97b75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:05.079704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda641e-8b59-4bd8-8a99-863e9f97b75b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:05.080164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda641e-8b59-4bd8-8a99-863e9f97b75b admin admin] PATH_INFO: `/v3/projects/5df1ad964b2a4382a1753eb9416cdf94` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:05.082680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda641e-8b59-4bd8-8a99-863e9f97b75b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df1ad964b2a4382a1753eb9416cdf94)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:05.085963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda641e-8b59-4bd8-8a99-863e9f97b75b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:05.157171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcda641e-8b59-4bd8-8a99-863e9f97b75b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df1ad964b2a4382a1753eb9416cdf94', 'request_id': 'req-fcda641e-8b59-4bd8-8a99-863e9f97b75b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:05.167306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcda641e-8b59-4bd8-8a99-863e9f97b75b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df1ad964b2a4382a1753eb9416cdf94', 'request_id': 'req-fcda641e-8b59-4bd8-8a99-863e9f97b75b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:05.175031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcda641e-8b59-4bd8-8a99-863e9f97b75b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df1ad964b2a4382a1753eb9416cdf94', 'request_id': 'req-fcda641e-8b59-4bd8-8a99-863e9f97b75b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:05.192012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcda641e-8b59-4bd8-8a99-863e9f97b75b admin admin] The token cache is being invalidate because project 5df1ad964b2a4382a1753eb9416cdf94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:43:05.192583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcda641e-8b59-4bd8-8a99-863e9f97b75b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:05.193582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcda641e-8b59-4bd8-8a99-863e9f97b75b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:05.195985 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2827/5653] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:43:05 2022] DELETE /identity/v3/projects/5df1ad964b2a4382a1753eb9416cdf94 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:05.199802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719c402-4dd6-475d-b2dd-2b78d032e28d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:05.211062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719c402-4dd6-475d-b2dd-2b78d032e28d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:05.259291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:05.290041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f75da-7a90-4720-a89f-0bcd8d228155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:05.291734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f75da-7a90-4720-a89f-0bcd8d228155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:05.292559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f75da-7a90-4720-a89f-0bcd8d228155 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:05.293185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f75da-7a90-4720-a89f-0bcd8d228155 admin admin] PATH_INFO: `/v3/users/8de634439b47446e9e64d97c42f93863` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:05.296982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f75da-7a90-4720-a89f-0bcd8d228155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8de634439b47446e9e64d97c42f93863)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:05.300208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f75da-7a90-4720-a89f-0bcd8d228155 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:05.391503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-608f75da-7a90-4720-a89f-0bcd8d228155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8de634439b47446e9e64d97c42f93863'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:05.413012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-608f75da-7a90-4720-a89f-0bcd8d228155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8de634439b47446e9e64d97c42f93863'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:05.413983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-608f75da-7a90-4720-a89f-0bcd8d228155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8de634439b47446e9e64d97c42f93863'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:05.414772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-608f75da-7a90-4720-a89f-0bcd8d228155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8de634439b47446e9e64d97c42f93863'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:05.433365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-608f75da-7a90-4720-a89f-0bcd8d228155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8de634439b47446e9e64d97c42f93863'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:05.461376 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2827/5654] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:43:05 2022] DELETE /identity/v3/users/8de634439b47446e9e64d97c42f93863 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:05.540971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda641e-8b59-4bd8-8a99-863e9f97b75b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:05.542787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fcda641e-8b59-4bd8-8a99-863e9f97b75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:05.574513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda641e-8b59-4bd8-8a99-863e9f97b75b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:05.696166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566dea2-517a-4895-93a1-f79c646dcd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:05.696841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566dea2-517a-4895-93a1-f79c646dcd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:05.697123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566dea2-517a-4895-93a1-f79c646dcd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:05.697402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566dea2-517a-4895-93a1-f79c646dcd64 admin admin] PATH_INFO: `/v3/users/813412ada6924ff0b239636fac52d950` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:05.698806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566dea2-517a-4895-93a1-f79c646dcd64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=813412ada6924ff0b239636fac52d950)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:05.701518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566dea2-517a-4895-93a1-f79c646dcd64 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:05.767039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f566dea2-517a-4895-93a1-f79c646dcd64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813412ada6924ff0b239636fac52d950'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:05.768010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f566dea2-517a-4895-93a1-f79c646dcd64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813412ada6924ff0b239636fac52d950'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:05.776560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f566dea2-517a-4895-93a1-f79c646dcd64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813412ada6924ff0b239636fac52d950'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:05.789942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f566dea2-517a-4895-93a1-f79c646dcd64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813412ada6924ff0b239636fac52d950'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:05.792063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:05.838719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f566dea2-517a-4895-93a1-f79c646dcd64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813412ada6924ff0b239636fac52d950'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:05.850373 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2828/5655] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:43:05 2022] DELETE /identity/v3/users/813412ada6924ff0b239636fac52d950 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:05.858469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f75da-7a90-4720-a89f-0bcd8d228155 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:05.858650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6424e-2f66-41de-b060-b7643e966634 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:05.859127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6424e-2f66-41de-b060-b7643e966634 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:05.859533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6424e-2f66-41de-b060-b7643e966634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:05.859665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-608f75da-7a90-4720-a89f-0bcd8d228155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:05.877064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f75da-7a90-4720-a89f-0bcd8d228155 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:05.911219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dee6424e-2f66-41de-b060-b7643e966634 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:05.912931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dee6424e-2f66-41de-b060-b7643e966634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:05.990189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c0aa1-ca20-46e7-b10b-bec2adc95776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:05.991010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c0aa1-ca20-46e7-b10b-bec2adc95776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:05.991386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c0aa1-ca20-46e7-b10b-bec2adc95776 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:05.991859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c0aa1-ca20-46e7-b10b-bec2adc95776 admin admin] PATH_INFO: `/v3/projects/8d71791a1b48491586f920bf0db9d8ae` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:05.993076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c0aa1-ca20-46e7-b10b-bec2adc95776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d71791a1b48491586f920bf0db9d8ae)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:05.995781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c0aa1-ca20-46e7-b10b-bec2adc95776 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:06.000910 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2829/5656] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:06.012213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6424e-2f66-41de-b060-b7643e966634 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:06.013700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dee6424e-2f66-41de-b060-b7643e966634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:06.052289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d77c0aa1-ca20-46e7-b10b-bec2adc95776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d71791a1b48491586f920bf0db9d8ae', 'request_id': 'req-d77c0aa1-ca20-46e7-b10b-bec2adc95776'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:06.074109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d77c0aa1-ca20-46e7-b10b-bec2adc95776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d71791a1b48491586f920bf0db9d8ae', 'request_id': 'req-d77c0aa1-ca20-46e7-b10b-bec2adc95776'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:06.085225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:06.089366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d77c0aa1-ca20-46e7-b10b-bec2adc95776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d71791a1b48491586f920bf0db9d8ae', 'request_id': 'req-d77c0aa1-ca20-46e7-b10b-bec2adc95776'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:06.095439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6424e-2f66-41de-b060-b7643e966634 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:06.113501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d77c0aa1-ca20-46e7-b10b-bec2adc95776 admin admin] The token cache is being invalidate because project 8d71791a1b48491586f920bf0db9d8ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:43:06.113989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d77c0aa1-ca20-46e7-b10b-bec2adc95776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:06.115361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d77c0aa1-ca20-46e7-b10b-bec2adc95776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:06.117323 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2828/5657] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:43:05 2022] DELETE /identity/v3/projects/8d71791a1b48491586f920bf0db9d8ae => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:06.122569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f1278-dbc9-411a-b45e-7f16b1e4b300 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:06.122946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f1278-dbc9-411a-b45e-7f16b1e4b300 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:06.123368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f1278-dbc9-411a-b45e-7f16b1e4b300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:06.149985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-444f1278-dbc9-411a-b45e-7f16b1e4b300 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:06.151223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-444f1278-dbc9-411a-b45e-7f16b1e4b300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:06.172139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc972d8e-3ebd-48f7-af3d-661da0af064f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:06.172757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc972d8e-3ebd-48f7-af3d-661da0af064f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:06.173039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc972d8e-3ebd-48f7-af3d-661da0af064f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:06.173381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc972d8e-3ebd-48f7-af3d-661da0af064f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:06.175102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bc972d8e-3ebd-48f7-af3d-661da0af064f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:06.225423 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2829/5658] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:06.233047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4f35f-5f1f-4edd-a33c-651f2168c06f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:06.233415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4f35f-5f1f-4edd-a33c-651f2168c06f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:06.234036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4f35f-5f1f-4edd-a33c-651f2168c06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:06.239146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:06.258041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8fc4f35f-5f1f-4edd-a33c-651f2168c06f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:06.259061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc972d8e-3ebd-48f7-af3d-661da0af064f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:06.259317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8fc4f35f-5f1f-4edd-a33c-651f2168c06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:06.260611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc972d8e-3ebd-48f7-af3d-661da0af064f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:06.269865 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2830/5659] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:43:06.272364 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2830/5660] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:43:06.273876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4f35f-5f1f-4edd-a33c-651f2168c06f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:06.283987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4f35f-5f1f-4edd-a33c-651f2168c06f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:06.289398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56834322-d3bd-400f-8344-8c15687038b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:06.290011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56834322-d3bd-400f-8344-8c15687038b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:06.290450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56834322-d3bd-400f-8344-8c15687038b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:06.290773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56834322-d3bd-400f-8344-8c15687038b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:06.291409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56834322-d3bd-400f-8344-8c15687038b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:43:06.292258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56834322-d3bd-400f-8344-8c15687038b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:06.293519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56834322-d3bd-400f-8344-8c15687038b6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:06.311043 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2831/5661] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:43:06.312734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc972d8e-3ebd-48f7-af3d-661da0af064f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:06.326184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc972d8e-3ebd-48f7-af3d-661da0af064f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:06.334620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7789820-0c62-41ea-ac3f-946f6fcccf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:06.335337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7789820-0c62-41ea-ac3f-946f6fcccf18 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:06.335621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7789820-0c62-41ea-ac3f-946f6fcccf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:06.335895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7789820-0c62-41ea-ac3f-946f6fcccf18 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:06.336786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7789820-0c62-41ea-ac3f-946f6fcccf18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:06.339396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7789820-0c62-41ea-ac3f-946f6fcccf18 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:06.391113 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2831/5662] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:43:06 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:06.392334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56834322-d3bd-400f-8344-8c15687038b6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:06.405646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56834322-d3bd-400f-8344-8c15687038b6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:06.485787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e781e-6d52-4a15-9018-11ae6ac60369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:06.486913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e781e-6d52-4a15-9018-11ae6ac60369 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:06.487188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e781e-6d52-4a15-9018-11ae6ac60369 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:06.487496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e781e-6d52-4a15-9018-11ae6ac60369 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:06.488941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e781e-6d52-4a15-9018-11ae6ac60369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:06.491888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e781e-6d52-4a15-9018-11ae6ac60369 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:06.531056 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2832/5663] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:43:06 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:43:06.534990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7789820-0c62-41ea-ac3f-946f6fcccf18 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:06.546479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7789820-0c62-41ea-ac3f-946f6fcccf18 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:06.551600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741ac29-1d37-4e70-9492-8e86821c5226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:06.552331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741ac29-1d37-4e70-9492-8e86821c5226 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:06.552813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741ac29-1d37-4e70-9492-8e86821c5226 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:06.553614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741ac29-1d37-4e70-9492-8e86821c5226 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:06.554355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741ac29-1d37-4e70-9492-8e86821c5226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:06.556160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741ac29-1d37-4e70-9492-8e86821c5226 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:06.572263 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2832/5664] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:43:06.576338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e781e-6d52-4a15-9018-11ae6ac60369 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:06.587817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e781e-6d52-4a15-9018-11ae6ac60369 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:06.593221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a8526-4223-4a27-baa6-7db5dde05da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:06.594021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a8526-4223-4a27-baa6-7db5dde05da7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:06.594427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a8526-4223-4a27-baa6-7db5dde05da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:06.594758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a8526-4223-4a27-baa6-7db5dde05da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:06.595658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a8526-4223-4a27-baa6-7db5dde05da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:06.597976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a8526-4223-4a27-baa6-7db5dde05da7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:06.616679 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2833/5665] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:06.621656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741ac29-1d37-4e70-9492-8e86821c5226 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:06.633231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741ac29-1d37-4e70-9492-8e86821c5226 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:06.638356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f1f80-ba84-4c34-87f4-ed48e469d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:06.639194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f1f80-ba84-4c34-87f4-ed48e469d5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:06.639586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f1f80-ba84-4c34-87f4-ed48e469d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:06.639932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f1f80-ba84-4c34-87f4-ed48e469d5f9 admin admin] PATH_INFO: `/v3/projects/e5e6fe1d13ea407bbad62e3320151238/users/3ce9a228df534310bebc5d202ae1cf5d/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:06.662097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f1f80-ba84-4c34-87f4-ed48e469d5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e6fe1d13ea407bbad62e3320151238, user_id=3ce9a228df534310bebc5d202ae1cf5d, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:06.665073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f1f80-ba84-4c34-87f4-ed48e469d5f9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:06.687296 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2833/5666] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:43:06 2022] PUT /identity/v3/projects/e5e6fe1d13ea407bbad62e3320151238/users/3ce9a228df534310bebc5d202ae1cf5d/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:06.696752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f4aa-72eb-4c98-b540-be0eb6fa690b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:06.697108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f4aa-72eb-4c98-b540-be0eb6fa690b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:06.697301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f4aa-72eb-4c98-b540-be0eb6fa690b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:06.732104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-aa81f4aa-72eb-4c98-b540-be0eb6fa690b None None] MFA Rules not processed for user `3ce9a228df534310bebc5d202ae1cf5d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:06.733338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aa81f4aa-72eb-4c98-b540-be0eb6fa690b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:06.774703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:06.805636 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2834/5667] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:06.810784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f1f80-ba84-4c34-87f4-ed48e469d5f9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:06.892720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f1f80-ba84-4c34-87f4-ed48e469d5f9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:06.915863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b1344-091b-41d6-a939-26cc3935e5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:06.917763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b1344-091b-41d6-a939-26cc3935e5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:06.918829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b1344-091b-41d6-a939-26cc3935e5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:06.919271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b1344-091b-41d6-a939-26cc3935e5e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:06.921848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b1344-091b-41d6-a939-26cc3935e5e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:06.926336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b1344-091b-41d6-a939-26cc3935e5e3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:06.996753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81f4aa-72eb-4c98-b540-be0eb6fa690b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:06.998816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aa81f4aa-72eb-4c98-b540-be0eb6fa690b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:07.005206 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2834/5668] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:43:06 2022] POST /identity/v3/projects => generated 371 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:07.006669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b1344-091b-41d6-a939-26cc3935e5e3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:07.037216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81f4aa-72eb-4c98-b540-be0eb6fa690b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:07.105495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b1344-091b-41d6-a939-26cc3935e5e3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:07.121196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c74909-44d2-4d1f-a30e-75e7142f472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:07.122328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c74909-44d2-4d1f-a30e-75e7142f472b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:07.122328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c74909-44d2-4d1f-a30e-75e7142f472b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:07.122725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c74909-44d2-4d1f-a30e-75e7142f472b admin admin] PATH_INFO: `/v3/projects/3b08f62057b640dc8456db89045facc1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:07.124187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c74909-44d2-4d1f-a30e-75e7142f472b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b08f62057b640dc8456db89045facc1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:07.126217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c74909-44d2-4d1f-a30e-75e7142f472b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:07.128696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf588d9-235a-4fe0-b256-716ea9552119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:07.129325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf588d9-235a-4fe0-b256-716ea9552119 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:07.129601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf588d9-235a-4fe0-b256-716ea9552119 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:07.129870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf588d9-235a-4fe0-b256-716ea9552119 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:07.130512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf588d9-235a-4fe0-b256-716ea9552119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:07.132475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf588d9-235a-4fe0-b256-716ea9552119 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:07.184328 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2835/5669] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:43:07 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:07.185446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf588d9-235a-4fe0-b256-716ea9552119 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:07.192544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:07.198285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf588d9-235a-4fe0-b256-716ea9552119 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:07.216203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750ab7a-68e4-4c4b-b8d5-2055ef4c0e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:07.217941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750ab7a-68e4-4c4b-b8d5-2055ef4c0e4d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:07.218374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750ab7a-68e4-4c4b-b8d5-2055ef4c0e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:07.218905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750ab7a-68e4-4c4b-b8d5-2055ef4c0e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:07.219070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f5c74909-44d2-4d1f-a30e-75e7142f472b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b08f62057b640dc8456db89045facc1', 'request_id': 'req-f5c74909-44d2-4d1f-a30e-75e7142f472b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:07.220475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750ab7a-68e4-4c4b-b8d5-2055ef4c0e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:07.222377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750ab7a-68e4-4c4b-b8d5-2055ef4c0e4d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:07.227208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f5c74909-44d2-4d1f-a30e-75e7142f472b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b08f62057b640dc8456db89045facc1', 'request_id': 'req-f5c74909-44d2-4d1f-a30e-75e7142f472b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:07.238077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f5c74909-44d2-4d1f-a30e-75e7142f472b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b08f62057b640dc8456db89045facc1', 'request_id': 'req-f5c74909-44d2-4d1f-a30e-75e7142f472b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:07.245916 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2836/5670] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:07.247438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9701-4bca-4717-bf43-25b30b93f847 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:07.247835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9701-4bca-4717-bf43-25b30b93f847 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:07.248211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9701-4bca-4717-bf43-25b30b93f847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:07.264073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f5c74909-44d2-4d1f-a30e-75e7142f472b admin admin] The token cache is being invalidate because project 3b08f62057b640dc8456db89045facc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:43:07.264405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f5c74909-44d2-4d1f-a30e-75e7142f472b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:07.265210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f5c74909-44d2-4d1f-a30e-75e7142f472b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:07.271625 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2835/5671] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:43:06 2022] DELETE /identity/v3/projects/3b08f62057b640dc8456db89045facc1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:07.271625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c74909-44d2-4d1f-a30e-75e7142f472b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:07.271900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-680e9701-4bca-4717-bf43-25b30b93f847 None None] MFA Rules not processed for user `8ed50d414dc14715bfdade9ce2e7ee52`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:07.272761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-680e9701-4bca-4717-bf43-25b30b93f847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:07.273493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f5c74909-44d2-4d1f-a30e-75e7142f472b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:07.351424 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2837/5672] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:07.352726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e9701-4bca-4717-bf43-25b30b93f847 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:07.354936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-680e9701-4bca-4717-bf43-25b30b93f847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:07.378339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c74909-44d2-4d1f-a30e-75e7142f472b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:07.404677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfca9f-337d-4653-b1ca-4e16edbc1aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:07.405367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfca9f-337d-4653-b1ca-4e16edbc1aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:07.405642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfca9f-337d-4653-b1ca-4e16edbc1aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:07.405915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfca9f-337d-4653-b1ca-4e16edbc1aeb admin admin] PATH_INFO: `/v3/projects/d4d6e0f3b6c942509049750e9644c61b/users/10f96a7099064d2dbb0a336997584f89/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:07.430517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:07.434242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfca9f-337d-4653-b1ca-4e16edbc1aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d6e0f3b6c942509049750e9644c61b, user_id=10f96a7099064d2dbb0a336997584f89, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:07.437365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfca9f-337d-4653-b1ca-4e16edbc1aeb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:07.471384 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2836/5673] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:43:07 2022] PUT /identity/v3/projects/d4d6e0f3b6c942509049750e9644c61b/users/10f96a7099064d2dbb0a336997584f89/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:07.475428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfca9f-337d-4653-b1ca-4e16edbc1aeb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:07.507241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e9701-4bca-4717-bf43-25b30b93f847 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:07.617571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfca9f-337d-4653-b1ca-4e16edbc1aeb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:07.632818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a4cc7-ff8b-4d86-9479-b31e1dee1f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:07.633452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a4cc7-ff8b-4d86-9479-b31e1dee1f95 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:07.633897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a4cc7-ff8b-4d86-9479-b31e1dee1f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:07.634556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a4cc7-ff8b-4d86-9479-b31e1dee1f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:07.634841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a4cc7-ff8b-4d86-9479-b31e1dee1f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:07.636542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a4cc7-ff8b-4d86-9479-b31e1dee1f95 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:07.648207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15fb58-49c2-4034-80a2-e43f5f0b87c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:07.649281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15fb58-49c2-4034-80a2-e43f5f0b87c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:07.649685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15fb58-49c2-4034-80a2-e43f5f0b87c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:07.649964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15fb58-49c2-4034-80a2-e43f5f0b87c8 admin admin] PATH_INFO: `/v3/users/716470c3a8ba4c999003229f8e257b00` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:07.651967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15fb58-49c2-4034-80a2-e43f5f0b87c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=716470c3a8ba4c999003229f8e257b00)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:07.654302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15fb58-49c2-4034-80a2-e43f5f0b87c8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:07.659657 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2837/5674] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:07.663736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a4cc7-ff8b-4d86-9479-b31e1dee1f95 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:07.689252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a4cc7-ff8b-4d86-9479-b31e1dee1f95 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:07.706181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cbe3b-0d46-4a8c-80f4-b0e4742579e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:07.707516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cbe3b-0d46-4a8c-80f4-b0e4742579e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:07.707516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cbe3b-0d46-4a8c-80f4-b0e4742579e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:07.707746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cbe3b-0d46-4a8c-80f4-b0e4742579e1 admin admin] PATH_INFO: `/v3/projects/d4d6e0f3b6c942509049750e9644c61b/users/10f96a7099064d2dbb0a336997584f89/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:07.713714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cbe3b-0d46-4a8c-80f4-b0e4742579e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d6e0f3b6c942509049750e9644c61b, user_id=10f96a7099064d2dbb0a336997584f89, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:07.725987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cbe3b-0d46-4a8c-80f4-b0e4742579e1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:07.743616 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2838/5675] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:43:07 2022] PUT /identity/v3/projects/d4d6e0f3b6c942509049750e9644c61b/users/10f96a7099064d2dbb0a336997584f89/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:07.761662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809afdbd-66f2-473f-8789-0c18d9103487 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:07.762026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809afdbd-66f2-473f-8789-0c18d9103487 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:07.762412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809afdbd-66f2-473f-8789-0c18d9103487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:07.771352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:07.787349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b15fb58-49c2-4034-80a2-e43f5f0b87c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716470c3a8ba4c999003229f8e257b00'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:07.789219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b15fb58-49c2-4034-80a2-e43f5f0b87c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716470c3a8ba4c999003229f8e257b00'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:07.801596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b15fb58-49c2-4034-80a2-e43f5f0b87c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716470c3a8ba4c999003229f8e257b00'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:07.825131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b15fb58-49c2-4034-80a2-e43f5f0b87c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716470c3a8ba4c999003229f8e257b00'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:07.853043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-809afdbd-66f2-473f-8789-0c18d9103487 None None] MFA Rules not processed for user `10f96a7099064d2dbb0a336997584f89`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:07.855417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-809afdbd-66f2-473f-8789-0c18d9103487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:07.858794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b15fb58-49c2-4034-80a2-e43f5f0b87c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716470c3a8ba4c999003229f8e257b00'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:07.881394 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2838/5676] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:43:07 2022] DELETE /identity/v3/users/716470c3a8ba4c999003229f8e257b00 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:07.959570 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2839/5677] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:43:07.960459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15fb58-49c2-4034-80a2-e43f5f0b87c8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:08.049806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15fb58-49c2-4034-80a2-e43f5f0b87c8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:08.055240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588c5d1-2e4c-4c90-8f61-a0e43ff57cd2 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f96a7099064d2dbb0a336997584f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d6e0f3b6c942509049750e9644c61b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:08.056973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588c5d1-2e4c-4c90-8f61-a0e43ff57cd2 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:08.057378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588c5d1-2e4c-4c90-8f61-a0e43ff57cd2 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:08.057803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588c5d1-2e4c-4c90-8f61-a0e43ff57cd2 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:08.058600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588c5d1-2e4c-4c90-8f61-a0e43ff57cd2 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:43:08.059185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588c5d1-2e4c-4c90-8f61-a0e43ff57cd2 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:08.062675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588c5d1-2e4c-4c90-8f61-a0e43ff57cd2 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:08.086588 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2839/5678] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:43:08.090646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809afdbd-66f2-473f-8789-0c18d9103487 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:08.101695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809afdbd-66f2-473f-8789-0c18d9103487 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:08.109368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473cac9-0a1f-4798-a779-592709bb14fa tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f96a7099064d2dbb0a336997584f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d6e0f3b6c942509049750e9644c61b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:08.110008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473cac9-0a1f-4798-a779-592709bb14fa tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:08.110290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473cac9-0a1f-4798-a779-592709bb14fa tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:08.110795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473cac9-0a1f-4798-a779-592709bb14fa tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:08.111833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473cac9-0a1f-4798-a779-592709bb14fa tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:08.114263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473cac9-0a1f-4798-a779-592709bb14fa tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:08.160563 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2840/5679] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:43:08 2022] POST /identity/v3/projects => generated 349 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:08.164106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588c5d1-2e4c-4c90-8f61-a0e43ff57cd2 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:08.179665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588c5d1-2e4c-4c90-8f61-a0e43ff57cd2 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:08.265654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ce12c-eaf6-473e-a965-f57250579d78 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f96a7099064d2dbb0a336997584f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d6e0f3b6c942509049750e9644c61b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:08.266517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ce12c-eaf6-473e-a965-f57250579d78 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:08.266870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ce12c-eaf6-473e-a965-f57250579d78 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:08.267212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ce12c-eaf6-473e-a965-f57250579d78 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:08.268422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ce12c-eaf6-473e-a965-f57250579d78 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:43:08.268798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ce12c-eaf6-473e-a965-f57250579d78 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:08.270485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ce12c-eaf6-473e-a965-f57250579d78 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:08.289479 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2840/5680] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:43:08.302870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473cac9-0a1f-4798-a779-592709bb14fa tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:08.304719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d473cac9-0a1f-4798-a779-592709bb14fa tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:08.390813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:08.417694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473cac9-0a1f-4798-a779-592709bb14fa tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:08.423600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fbf2a-53c1-4295-9e8b-bf7386f82c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:08.424214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fbf2a-53c1-4295-9e8b-bf7386f82c63 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:08.424495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fbf2a-53c1-4295-9e8b-bf7386f82c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:08.424763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fbf2a-53c1-4295-9e8b-bf7386f82c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:08.449269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fbf2a-53c1-4295-9e8b-bf7386f82c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:08.451600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fbf2a-53c1-4295-9e8b-bf7386f82c63 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:08.467664 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2841/5681] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:08.879983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ce12c-eaf6-473e-a965-f57250579d78 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:08.882044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-160ce12c-eaf6-473e-a965-f57250579d78 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:08.999769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:09.034595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ce12c-eaf6-473e-a965-f57250579d78 tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:09.041232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f724a-4359-459f-bd5f-d5e1c320915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:09.041969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f724a-4359-459f-bd5f-d5e1c320915b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:09.042623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f724a-4359-459f-bd5f-d5e1c320915b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:09.042950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f724a-4359-459f-bd5f-d5e1c320915b admin admin] PATH_INFO: `/v3/projects/39cb232b4d4249e4b9345d39948c92cd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:09.043960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f724a-4359-459f-bd5f-d5e1c320915b admin admin] RBAC: Authorizing `identity:delete_project(project_id=39cb232b4d4249e4b9345d39948c92cd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:09.047420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f724a-4359-459f-bd5f-d5e1c320915b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:09.127950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-292f724a-4359-459f-bd5f-d5e1c320915b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39cb232b4d4249e4b9345d39948c92cd', 'request_id': 'req-292f724a-4359-459f-bd5f-d5e1c320915b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:09.145230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-292f724a-4359-459f-bd5f-d5e1c320915b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39cb232b4d4249e4b9345d39948c92cd', 'request_id': 'req-292f724a-4359-459f-bd5f-d5e1c320915b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:09.163434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-292f724a-4359-459f-bd5f-d5e1c320915b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39cb232b4d4249e4b9345d39948c92cd', 'request_id': 'req-292f724a-4359-459f-bd5f-d5e1c320915b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:09.193810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-292f724a-4359-459f-bd5f-d5e1c320915b admin admin] The token cache is being invalidate because project 39cb232b4d4249e4b9345d39948c92cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:43:09.194459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-292f724a-4359-459f-bd5f-d5e1c320915b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:09.194915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-292f724a-4359-459f-bd5f-d5e1c320915b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:09.202191 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2841/5682] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:43:08 2022] DELETE /identity/v3/projects/39cb232b4d4249e4b9345d39948c92cd => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:09.202388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbcdd7-db35-4019-b015-b0d9361067aa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:09.202667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbcdd7-db35-4019-b015-b0d9361067aa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:09.202854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbcdd7-db35-4019-b015-b0d9361067aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:09.245442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bacbcdd7-db35-4019-b015-b0d9361067aa None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:09.251167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bacbcdd7-db35-4019-b015-b0d9361067aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:09.493054 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2842/5683] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:43:09.500321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be812f7f-a958-41b1-83be-b4d63a70fdfe None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:09.500877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be812f7f-a958-41b1-83be-b4d63a70fdfe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:09.501340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be812f7f-a958-41b1-83be-b4d63a70fdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:09.540170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-be812f7f-a958-41b1-83be-b4d63a70fdfe None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:09.544022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-be812f7f-a958-41b1-83be-b4d63a70fdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:09.571810 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2842/5684] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:09.574228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbcdd7-db35-4019-b015-b0d9361067aa None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:09.592090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbcdd7-db35-4019-b015-b0d9361067aa None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:09.604260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7d757-6dfc-474f-9570-b0a7c4e63634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:09.604937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7d757-6dfc-474f-9570-b0a7c4e63634 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:09.605924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7d757-6dfc-474f-9570-b0a7c4e63634 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:09.605924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7d757-6dfc-474f-9570-b0a7c4e63634 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:09.606196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7d757-6dfc-474f-9570-b0a7c4e63634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:43:09.606447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7d757-6dfc-474f-9570-b0a7c4e63634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:09.608773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7d757-6dfc-474f-9570-b0a7c4e63634 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:09.641899 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2843/5685] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:43:09.642661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be812f7f-a958-41b1-83be-b4d63a70fdfe None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:09.655116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be812f7f-a958-41b1-83be-b4d63a70fdfe None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:09.671441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a0cbf-5712-4932-b8a3-a93b25c65d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:09.672153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a0cbf-5712-4932-b8a3-a93b25c65d58 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:09.672435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a0cbf-5712-4932-b8a3-a93b25c65d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:09.672707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a0cbf-5712-4932-b8a3-a93b25c65d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:09.673357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a0cbf-5712-4932-b8a3-a93b25c65d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:09.675351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a0cbf-5712-4932-b8a3-a93b25c65d58 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:09.743548 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2843/5686] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:43:09 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:09.746262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7d757-6dfc-474f-9570-b0a7c4e63634 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:09.762323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7d757-6dfc-474f-9570-b0a7c4e63634 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:09.955957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739a5c9-2e9e-4437-97aa-e3e71bef2cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:09.957994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739a5c9-2e9e-4437-97aa-e3e71bef2cea admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:09.958418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739a5c9-2e9e-4437-97aa-e3e71bef2cea admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:09.958703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739a5c9-2e9e-4437-97aa-e3e71bef2cea admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:09.961711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739a5c9-2e9e-4437-97aa-e3e71bef2cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:09.965236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739a5c9-2e9e-4437-97aa-e3e71bef2cea admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:10.050004 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2844/5687] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:43:09 2022] POST /identity/v3/users => generated 297 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:10.054570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a0cbf-5712-4932-b8a3-a93b25c65d58 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:10.071383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a0cbf-5712-4932-b8a3-a93b25c65d58 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:10.078309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a8981-7dce-457f-9131-039d63820a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:10.079060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a8981-7dce-457f-9131-039d63820a41 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:10.079420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a8981-7dce-457f-9131-039d63820a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:10.079748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a8981-7dce-457f-9131-039d63820a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:10.080692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a8981-7dce-457f-9131-039d63820a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:10.083083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a8981-7dce-457f-9131-039d63820a41 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:10.095884 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2844/5688] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:10.100382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739a5c9-2e9e-4437-97aa-e3e71bef2cea admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:10.113871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739a5c9-2e9e-4437-97aa-e3e71bef2cea admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:10.133258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2901e-8d53-4f20-b7fa-80037d7a8061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:10.133999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2901e-8d53-4f20-b7fa-80037d7a8061 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:10.135101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2901e-8d53-4f20-b7fa-80037d7a8061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:10.135469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2901e-8d53-4f20-b7fa-80037d7a8061 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:10.136698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2901e-8d53-4f20-b7fa-80037d7a8061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:10.140881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2901e-8d53-4f20-b7fa-80037d7a8061 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:10.173254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a8981-7dce-457f-9131-039d63820a41 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:10.173541 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2845/5689] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:10.196671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a8981-7dce-457f-9131-039d63820a41 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:10.219396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f7e9a-bdf7-42e8-846a-aa165cbd2693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:10.220793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f7e9a-bdf7-42e8-846a-aa165cbd2693 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:10.222804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f7e9a-bdf7-42e8-846a-aa165cbd2693 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:10.227233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f7e9a-bdf7-42e8-846a-aa165cbd2693 admin admin] PATH_INFO: `/v3/projects/503b0304128943c699c536d637c6eecb/users/9e57d4e6e06747dc96033a7b6688ba4e/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:10.263948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f7e9a-bdf7-42e8-846a-aa165cbd2693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=503b0304128943c699c536d637c6eecb, user_id=9e57d4e6e06747dc96033a7b6688ba4e, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:10.272109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f7e9a-bdf7-42e8-846a-aa165cbd2693 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:10.319453 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2845/5690] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:43:10 2022] PUT /identity/v3/projects/503b0304128943c699c536d637c6eecb/users/9e57d4e6e06747dc96033a7b6688ba4e/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:10.320725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598079f3-abfa-4190-af9d-2ab3d4d2516f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:10.321006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598079f3-abfa-4190-af9d-2ab3d4d2516f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:10.321276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598079f3-abfa-4190-af9d-2ab3d4d2516f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:10.444991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-598079f3-abfa-4190-af9d-2ab3d4d2516f None None] MFA Rules not processed for user `9e57d4e6e06747dc96033a7b6688ba4e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:10.450841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-598079f3-abfa-4190-af9d-2ab3d4d2516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:10.536996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:10.609855 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2846/5691] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:43:10.670790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f7e9a-bdf7-42e8-846a-aa165cbd2693 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:10.672861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-495f7e9a-bdf7-42e8-846a-aa165cbd2693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:10.861579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f7e9a-bdf7-42e8-846a-aa165cbd2693 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:10.880198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb1649-e1d2-49c5-a67e-266b7b86b5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:10.880828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb1649-e1d2-49c5-a67e-266b7b86b5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:10.881219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb1649-e1d2-49c5-a67e-266b7b86b5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:10.881498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb1649-e1d2-49c5-a67e-266b7b86b5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:10.910978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb1649-e1d2-49c5-a67e-266b7b86b5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:10.912489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb1649-e1d2-49c5-a67e-266b7b86b5f5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:10.930827 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2846/5692] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:10 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:12.353261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598079f3-abfa-4190-af9d-2ab3d4d2516f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:12.355008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-598079f3-abfa-4190-af9d-2ab3d4d2516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:12.446064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598079f3-abfa-4190-af9d-2ab3d4d2516f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:12.451851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47376-cc6b-44b7-9e7b-c21bb50fd5dc tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f96a7099064d2dbb0a336997584f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d6e0f3b6c942509049750e9644c61b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:12.452808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47376-cc6b-44b7-9e7b-c21bb50fd5dc tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:12.453430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47376-cc6b-44b7-9e7b-c21bb50fd5dc tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:12.454028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47376-cc6b-44b7-9e7b-c21bb50fd5dc tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] PATH_INFO: `/v3/projects/482991ecf9a948abbe818d3b694303ef` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:12.456722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd47376-cc6b-44b7-9e7b-c21bb50fd5dc tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] RBAC: Authorizing `identity:delete_project(project_id=482991ecf9a948abbe818d3b694303ef)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:12.459599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd47376-cc6b-44b7-9e7b-c21bb50fd5dc tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:12.537300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbd47376-cc6b-44b7-9e7b-c21bb50fd5dc tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482991ecf9a948abbe818d3b694303ef', 'request_id': 'req-dbd47376-cc6b-44b7-9e7b-c21bb50fd5dc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:12.544617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbd47376-cc6b-44b7-9e7b-c21bb50fd5dc tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482991ecf9a948abbe818d3b694303ef', 'request_id': 'req-dbd47376-cc6b-44b7-9e7b-c21bb50fd5dc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:12.550191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbd47376-cc6b-44b7-9e7b-c21bb50fd5dc tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482991ecf9a948abbe818d3b694303ef', 'request_id': 'req-dbd47376-cc6b-44b7-9e7b-c21bb50fd5dc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:12.581531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbd47376-cc6b-44b7-9e7b-c21bb50fd5dc tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] The token cache is being invalidate because project 482991ecf9a948abbe818d3b694303ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:43:12.582218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbd47376-cc6b-44b7-9e7b-c21bb50fd5dc tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:12.582872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbd47376-cc6b-44b7-9e7b-c21bb50fd5dc tempest-QuotasNegativeTest-431434179 tempest-QuotasNegativeTest-431434179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:12.584487 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2847/5693] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:43:12 2022] DELETE /identity/v3/projects/482991ecf9a948abbe818d3b694303ef => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:12.590066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb1649-e1d2-49c5-a67e-266b7b86b5f5 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:12.591538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7abb1649-e1d2-49c5-a67e-266b7b86b5f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:12.607547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:12.672932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb1649-e1d2-49c5-a67e-266b7b86b5f5 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:12.793277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557162c4-08d9-460e-a249-451f661f9e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:12.793953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557162c4-08d9-460e-a249-451f661f9e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:12.794302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557162c4-08d9-460e-a249-451f661f9e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:12.794952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557162c4-08d9-460e-a249-451f661f9e6a admin admin] PATH_INFO: `/v3/users/3ce9a228df534310bebc5d202ae1cf5d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:12.806145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557162c4-08d9-460e-a249-451f661f9e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce9a228df534310bebc5d202ae1cf5d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:12.808652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557162c4-08d9-460e-a249-451f661f9e6a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:12.917744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-557162c4-08d9-460e-a249-451f661f9e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce9a228df534310bebc5d202ae1cf5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:12.918919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-557162c4-08d9-460e-a249-451f661f9e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce9a228df534310bebc5d202ae1cf5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:12.940928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-557162c4-08d9-460e-a249-451f661f9e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce9a228df534310bebc5d202ae1cf5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:12.972643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-557162c4-08d9-460e-a249-451f661f9e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce9a228df534310bebc5d202ae1cf5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:13.014359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-557162c4-08d9-460e-a249-451f661f9e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce9a228df534310bebc5d202ae1cf5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:13.029776 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2847/5694] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:43:12 2022] DELETE /identity/v3/users/3ce9a228df534310bebc5d202ae1cf5d => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:13.031284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6d97e-bcf7-439a-a544-684b63349d4e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:13.031684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6d97e-bcf7-439a-a544-684b63349d4e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:13.032114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6d97e-bcf7-439a-a544-684b63349d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:13.071856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-28c6d97e-bcf7-439a-a544-684b63349d4e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:13.073684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-28c6d97e-bcf7-439a-a544-684b63349d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:13.244364 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2848/5695] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:13.256462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557162c4-08d9-460e-a249-451f661f9e6a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:13.261328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-557162c4-08d9-460e-a249-451f661f9e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:13.315741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:13.348193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557162c4-08d9-460e-a249-451f661f9e6a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:13.352245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafd32a-b5eb-4737-afce-ae09d031e461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:13.352921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafd32a-b5eb-4737-afce-ae09d031e461 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:13.353201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafd32a-b5eb-4737-afce-ae09d031e461 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:13.353478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafd32a-b5eb-4737-afce-ae09d031e461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:13.365209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafd32a-b5eb-4737-afce-ae09d031e461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:13.366995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafd32a-b5eb-4737-afce-ae09d031e461 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:13.388375 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2848/5696] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:14.270407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6d97e-bcf7-439a-a544-684b63349d4e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:14.273438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-28c6d97e-bcf7-439a-a544-684b63349d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:14.309306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6d97e-bcf7-439a-a544-684b63349d4e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:14.315592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb850837-7a6c-4e99-91f8-141478e3a4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:14.319169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb850837-7a6c-4e99-91f8-141478e3a4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:14.319671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb850837-7a6c-4e99-91f8-141478e3a4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:14.320053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb850837-7a6c-4e99-91f8-141478e3a4d6 admin admin] PATH_INFO: `/v3/projects/e5e6fe1d13ea407bbad62e3320151238` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:14.322609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb850837-7a6c-4e99-91f8-141478e3a4d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e6fe1d13ea407bbad62e3320151238)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:14.327556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb850837-7a6c-4e99-91f8-141478e3a4d6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:14.333641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:14.417126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cb850837-7a6c-4e99-91f8-141478e3a4d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e6fe1d13ea407bbad62e3320151238', 'request_id': 'req-cb850837-7a6c-4e99-91f8-141478e3a4d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:14.425950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cb850837-7a6c-4e99-91f8-141478e3a4d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e6fe1d13ea407bbad62e3320151238', 'request_id': 'req-cb850837-7a6c-4e99-91f8-141478e3a4d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:14.433431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cb850837-7a6c-4e99-91f8-141478e3a4d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e6fe1d13ea407bbad62e3320151238', 'request_id': 'req-cb850837-7a6c-4e99-91f8-141478e3a4d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:14.450999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cb850837-7a6c-4e99-91f8-141478e3a4d6 admin admin] The token cache is being invalidate because project e5e6fe1d13ea407bbad62e3320151238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:43:14.451569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cb850837-7a6c-4e99-91f8-141478e3a4d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:14.453347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cb850837-7a6c-4e99-91f8-141478e3a4d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:14.456526 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2849/5697] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:43:14 2022] DELETE /identity/v3/projects/e5e6fe1d13ea407bbad62e3320151238 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:14.460226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafd32a-b5eb-4737-afce-ae09d031e461 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:14.498517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafd32a-b5eb-4737-afce-ae09d031e461 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:14.650116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdff404-89c1-4e8e-a161-d46572a7515e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:14.650845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdff404-89c1-4e8e-a161-d46572a7515e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:14.651162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdff404-89c1-4e8e-a161-d46572a7515e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:14.651481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdff404-89c1-4e8e-a161-d46572a7515e admin admin] PATH_INFO: `/v3/users/10f96a7099064d2dbb0a336997584f89` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:14.652702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdff404-89c1-4e8e-a161-d46572a7515e admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f96a7099064d2dbb0a336997584f89)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:14.654858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdff404-89c1-4e8e-a161-d46572a7515e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:14.745341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5cdff404-89c1-4e8e-a161-d46572a7515e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f96a7099064d2dbb0a336997584f89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:14.748807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5cdff404-89c1-4e8e-a161-d46572a7515e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f96a7099064d2dbb0a336997584f89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:14.769233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5cdff404-89c1-4e8e-a161-d46572a7515e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f96a7099064d2dbb0a336997584f89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:14.790731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5cdff404-89c1-4e8e-a161-d46572a7515e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f96a7099064d2dbb0a336997584f89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:14.819018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5cdff404-89c1-4e8e-a161-d46572a7515e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f96a7099064d2dbb0a336997584f89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:14.837071 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2849/5698] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:43:14 2022] DELETE /identity/v3/users/10f96a7099064d2dbb0a336997584f89 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:15.479973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cde83f-d011-4928-97da-88d4582e0757 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:15.480473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cde83f-d011-4928-97da-88d4582e0757 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:15.480576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cde83f-d011-4928-97da-88d4582e0757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:15.530199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-15cde83f-d011-4928-97da-88d4582e0757 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:15.537079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-15cde83f-d011-4928-97da-88d4582e0757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:15.785929 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2850/5699] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:43:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:15.888276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdff404-89c1-4e8e-a161-d46572a7515e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:15.889894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5cdff404-89c1-4e8e-a161-d46572a7515e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:16.182352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:16.236371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdff404-89c1-4e8e-a161-d46572a7515e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:16.275380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598024a2-e00c-4b68-8a3c-b3e04267938e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:16.275957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598024a2-e00c-4b68-8a3c-b3e04267938e service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:16.276247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598024a2-e00c-4b68-8a3c-b3e04267938e service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:16.276536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598024a2-e00c-4b68-8a3c-b3e04267938e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:16.333791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598024a2-e00c-4b68-8a3c-b3e04267938e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:16.345564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598024a2-e00c-4b68-8a3c-b3e04267938e service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:16.399747 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2850/5700] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:43:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:43:17.006412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cde83f-d011-4928-97da-88d4582e0757 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:17.008422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-15cde83f-d011-4928-97da-88d4582e0757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:17.222421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cde83f-d011-4928-97da-88d4582e0757 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:17.240565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35446fc2-02c7-43b4-8076-41991ffe79d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:17.241829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35446fc2-02c7-43b4-8076-41991ffe79d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:17.242317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35446fc2-02c7-43b4-8076-41991ffe79d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:17.242765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35446fc2-02c7-43b4-8076-41991ffe79d6 admin admin] PATH_INFO: `/v3/projects/d4d6e0f3b6c942509049750e9644c61b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:17.245112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35446fc2-02c7-43b4-8076-41991ffe79d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d6e0f3b6c942509049750e9644c61b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:17.248214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35446fc2-02c7-43b4-8076-41991ffe79d6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:17.378282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:17.467145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-35446fc2-02c7-43b4-8076-41991ffe79d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d6e0f3b6c942509049750e9644c61b', 'request_id': 'req-35446fc2-02c7-43b4-8076-41991ffe79d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:17.487140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-35446fc2-02c7-43b4-8076-41991ffe79d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d6e0f3b6c942509049750e9644c61b', 'request_id': 'req-35446fc2-02c7-43b4-8076-41991ffe79d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:17.512013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-35446fc2-02c7-43b4-8076-41991ffe79d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d6e0f3b6c942509049750e9644c61b', 'request_id': 'req-35446fc2-02c7-43b4-8076-41991ffe79d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:17.550828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-35446fc2-02c7-43b4-8076-41991ffe79d6 admin admin] The token cache is being invalidate because project d4d6e0f3b6c942509049750e9644c61b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:43:17.551455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-35446fc2-02c7-43b4-8076-41991ffe79d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:17.554345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-35446fc2-02c7-43b4-8076-41991ffe79d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:17.558135 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2851/5701] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:43:17 2022] DELETE /identity/v3/projects/d4d6e0f3b6c942509049750e9644c61b => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:43:17.563156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b071a-00b0-4b3b-be32-17feaeee4429 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:17.563678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b071a-00b0-4b3b-be32-17feaeee4429 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:17.563822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b071a-00b0-4b3b-be32-17feaeee4429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:17.624895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-501b071a-00b0-4b3b-be32-17feaeee4429 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:17.626192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-501b071a-00b0-4b3b-be32-17feaeee4429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:17.871428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40294bff-87de-45e7-ac04-94b302fa2352 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:17.872382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40294bff-87de-45e7-ac04-94b302fa2352 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:17.873074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40294bff-87de-45e7-ac04-94b302fa2352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:17.882311 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2851/5702] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:17.929698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-40294bff-87de-45e7-ac04-94b302fa2352 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:17.933089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-40294bff-87de-45e7-ac04-94b302fa2352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:17.978358 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2852/5703] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:17.979679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b071a-00b0-4b3b-be32-17feaeee4429 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:17.991478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b071a-00b0-4b3b-be32-17feaeee4429 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:18.006940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e483f9-a1bc-40d4-8e1f-2aa31bb5cd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:18.007585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e483f9-a1bc-40d4-8e1f-2aa31bb5cd10 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:18.007894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e483f9-a1bc-40d4-8e1f-2aa31bb5cd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:18.008203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e483f9-a1bc-40d4-8e1f-2aa31bb5cd10 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:18.008999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e483f9-a1bc-40d4-8e1f-2aa31bb5cd10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:43:18.009247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e483f9-a1bc-40d4-8e1f-2aa31bb5cd10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:18.010935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e483f9-a1bc-40d4-8e1f-2aa31bb5cd10 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:18.047822 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2852/5704] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:43:18.049019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40294bff-87de-45e7-ac04-94b302fa2352 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:18.073017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40294bff-87de-45e7-ac04-94b302fa2352 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:18.091353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830c80e-694c-41a9-8956-a9d4f3f4bd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:18.092029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830c80e-694c-41a9-8956-a9d4f3f4bd7c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:18.092309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830c80e-694c-41a9-8956-a9d4f3f4bd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:18.092642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830c80e-694c-41a9-8956-a9d4f3f4bd7c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:18.093291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830c80e-694c-41a9-8956-a9d4f3f4bd7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:18.095526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830c80e-694c-41a9-8956-a9d4f3f4bd7c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:18.174138 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2853/5705] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:43:18 2022] POST /identity/v3/projects => generated 357 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:18.175512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e483f9-a1bc-40d4-8e1f-2aa31bb5cd10 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:18.186253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e483f9-a1bc-40d4-8e1f-2aa31bb5cd10 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:18.365716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5923652-7633-422b-9765-1301125eb80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:18.366674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5923652-7633-422b-9765-1301125eb80f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:18.367240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5923652-7633-422b-9765-1301125eb80f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:18.367657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5923652-7633-422b-9765-1301125eb80f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:18.377456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5923652-7633-422b-9765-1301125eb80f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:18.386306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5923652-7633-422b-9765-1301125eb80f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:18.437903 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2853/5706] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:43:18 2022] POST /identity/v3/users => generated 279 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:18.438552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830c80e-694c-41a9-8956-a9d4f3f4bd7c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:18.458376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830c80e-694c-41a9-8956-a9d4f3f4bd7c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:18.485234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c0a66-1a29-4cfb-a097-b6b2d3d5fd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:18.486106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c0a66-1a29-4cfb-a097-b6b2d3d5fd50 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:18.486388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c0a66-1a29-4cfb-a097-b6b2d3d5fd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:18.486668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c0a66-1a29-4cfb-a097-b6b2d3d5fd50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:18.487352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c0a66-1a29-4cfb-a097-b6b2d3d5fd50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:18.489050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c0a66-1a29-4cfb-a097-b6b2d3d5fd50 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:18.521499 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2854/5707] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:43:18.525616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5923652-7633-422b-9765-1301125eb80f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:18.541550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5923652-7633-422b-9765-1301125eb80f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:18.561089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794a6d7-d6d5-4fe1-b926-eb776be58a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:18.561884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794a6d7-d6d5-4fe1-b926-eb776be58a5d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:18.562889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794a6d7-d6d5-4fe1-b926-eb776be58a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:18.563286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794a6d7-d6d5-4fe1-b926-eb776be58a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:18.564056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794a6d7-d6d5-4fe1-b926-eb776be58a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:18.593083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794a6d7-d6d5-4fe1-b926-eb776be58a5d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:18.628189 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2854/5708] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:18.629428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c0a66-1a29-4cfb-a097-b6b2d3d5fd50 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:18.640970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c0a66-1a29-4cfb-a097-b6b2d3d5fd50 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:18.656126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cbace-8cf1-4184-b016-83a8b2cfef06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:18.656834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cbace-8cf1-4184-b016-83a8b2cfef06 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:18.657122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cbace-8cf1-4184-b016-83a8b2cfef06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:18.657399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cbace-8cf1-4184-b016-83a8b2cfef06 admin admin] PATH_INFO: `/v3/projects/793bd3f49da64c918601cb21c7b11b6b/users/a605063d19164a31815d906f142032fb/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:18.705544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cbace-8cf1-4184-b016-83a8b2cfef06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=793bd3f49da64c918601cb21c7b11b6b, user_id=a605063d19164a31815d906f142032fb, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:18.733877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cbace-8cf1-4184-b016-83a8b2cfef06 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:18.788377 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2855/5709] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:43:18 2022] PUT /identity/v3/projects/793bd3f49da64c918601cb21c7b11b6b/users/a605063d19164a31815d906f142032fb/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:43:18.789540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af846f3-a382-4e0b-b0fa-e5b4816e5123 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:18.790040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af846f3-a382-4e0b-b0fa-e5b4816e5123 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:18.790509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af846f3-a382-4e0b-b0fa-e5b4816e5123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:18.853681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6af846f3-a382-4e0b-b0fa-e5b4816e5123 None None] MFA Rules not processed for user `a605063d19164a31815d906f142032fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:18.855851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6af846f3-a382-4e0b-b0fa-e5b4816e5123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:19.011439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:19.144913 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2855/5710] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:19.146197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cbace-8cf1-4184-b016-83a8b2cfef06 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:19.436285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cbace-8cf1-4184-b016-83a8b2cfef06 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:19.469114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dec14-5ead-473d-b402-c33a2dfbeb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:19.469990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dec14-5ead-473d-b402-c33a2dfbeb9d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:19.472061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dec14-5ead-473d-b402-c33a2dfbeb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:19.472529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dec14-5ead-473d-b402-c33a2dfbeb9d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:19.473388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306dec14-5ead-473d-b402-c33a2dfbeb9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:19.475526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306dec14-5ead-473d-b402-c33a2dfbeb9d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:19.583179 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2856/5711] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:43:19 2022] POST /identity/v3/projects => generated 357 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:19.587176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af846f3-a382-4e0b-b0fa-e5b4816e5123 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:19.608861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af846f3-a382-4e0b-b0fa-e5b4816e5123 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:19.898795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1602663-cc9d-4285-964f-91185b0a0c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:19.901869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1602663-cc9d-4285-964f-91185b0a0c78 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:19.902156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1602663-cc9d-4285-964f-91185b0a0c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:19.902435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1602663-cc9d-4285-964f-91185b0a0c78 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:19.903105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1602663-cc9d-4285-964f-91185b0a0c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:19.905141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1602663-cc9d-4285-964f-91185b0a0c78 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:20.000207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dec14-5ead-473d-b402-c33a2dfbeb9d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:20.006341 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2856/5712] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:43:19 2022] POST /identity/v3/users => generated 285 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:20.020867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dec14-5ead-473d-b402-c33a2dfbeb9d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:20.039768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec3d97-1466-406c-998a-8f2088d54234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:20.040660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec3d97-1466-406c-998a-8f2088d54234 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:20.041153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec3d97-1466-406c-998a-8f2088d54234 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:20.041666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec3d97-1466-406c-998a-8f2088d54234 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:20.042787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec3d97-1466-406c-998a-8f2088d54234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:20.045011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec3d97-1466-406c-998a-8f2088d54234 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:20.086979 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2857/5713] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:20.088652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1602663-cc9d-4285-964f-91185b0a0c78 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:20.105095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1602663-cc9d-4285-964f-91185b0a0c78 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:20.136716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9b13a-96c0-4521-aa68-bcfa3fc710cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:20.137426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9b13a-96c0-4521-aa68-bcfa3fc710cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:20.137702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9b13a-96c0-4521-aa68-bcfa3fc710cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:20.137978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9b13a-96c0-4521-aa68-bcfa3fc710cf admin admin] PATH_INFO: `/v3/projects/bcc42da37b594f6cacdee7dec4cc437b/users/7df229309b2941a2a6c660bf7f2ef5f6/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:20.192892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9b13a-96c0-4521-aa68-bcfa3fc710cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc42da37b594f6cacdee7dec4cc437b, user_id=7df229309b2941a2a6c660bf7f2ef5f6, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:20.199104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9b13a-96c0-4521-aa68-bcfa3fc710cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:20.228755 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2857/5714] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:43:20 2022] PUT /identity/v3/projects/bcc42da37b594f6cacdee7dec4cc437b/users/7df229309b2941a2a6c660bf7f2ef5f6/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:20.233187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec3d97-1466-406c-998a-8f2088d54234 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:20.252969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec3d97-1466-406c-998a-8f2088d54234 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:20.346240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:20.484734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5ff07-5170-4dd0-bbd3-a7e96f1a485a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:20.485794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5ff07-5170-4dd0-bbd3-a7e96f1a485a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:20.486334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5ff07-5170-4dd0-bbd3-a7e96f1a485a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:20.486822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5ff07-5170-4dd0-bbd3-a7e96f1a485a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:20.488880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5ff07-5170-4dd0-bbd3-a7e96f1a485a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:20.491315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5ff07-5170-4dd0-bbd3-a7e96f1a485a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:20.507792 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2858/5715] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:20.512034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9b13a-96c0-4521-aa68-bcfa3fc710cf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:20.535129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9b13a-96c0-4521-aa68-bcfa3fc710cf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:20.548529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be1195-75fd-4f62-ba72-66f0377b241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:20.549481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be1195-75fd-4f62-ba72-66f0377b241f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:20.549768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be1195-75fd-4f62-ba72-66f0377b241f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:20.550033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be1195-75fd-4f62-ba72-66f0377b241f admin admin] PATH_INFO: `/v3/projects/bcc42da37b594f6cacdee7dec4cc437b/users/7df229309b2941a2a6c660bf7f2ef5f6/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:20.552185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be1195-75fd-4f62-ba72-66f0377b241f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc42da37b594f6cacdee7dec4cc437b, user_id=7df229309b2941a2a6c660bf7f2ef5f6, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:20.566579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be1195-75fd-4f62-ba72-66f0377b241f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:20.596677 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2858/5716] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:43:20 2022] PUT /identity/v3/projects/bcc42da37b594f6cacdee7dec4cc437b/users/7df229309b2941a2a6c660bf7f2ef5f6/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:20.608466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11d32d-71a9-4dfb-b536-f3be0974eb11 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:20.609464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11d32d-71a9-4dfb-b536-f3be0974eb11 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:20.610045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11d32d-71a9-4dfb-b536-f3be0974eb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:20.648344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8a11d32d-71a9-4dfb-b536-f3be0974eb11 None None] MFA Rules not processed for user `7df229309b2941a2a6c660bf7f2ef5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:20.649951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8a11d32d-71a9-4dfb-b536-f3be0974eb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:20.778074 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2859/5717] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:20.783121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be1195-75fd-4f62-ba72-66f0377b241f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:20.803225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be1195-75fd-4f62-ba72-66f0377b241f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:20.810881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debea53b-65d2-4ddc-b563-48cbed982f41 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df229309b2941a2a6c660bf7f2ef5f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc42da37b594f6cacdee7dec4cc437b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:20.811671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debea53b-65d2-4ddc-b563-48cbed982f41 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:20.812097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debea53b-65d2-4ddc-b563-48cbed982f41 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:20.812481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debea53b-65d2-4ddc-b563-48cbed982f41 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:20.814635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debea53b-65d2-4ddc-b563-48cbed982f41 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:43:20.815230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debea53b-65d2-4ddc-b563-48cbed982f41 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:20.817958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debea53b-65d2-4ddc-b563-48cbed982f41 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:20.839816 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2859/5718] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:43:20.843807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11d32d-71a9-4dfb-b536-f3be0974eb11 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:20.860265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11d32d-71a9-4dfb-b536-f3be0974eb11 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:20.865776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adca6b8-8fb4-4533-84ef-54139614adb5 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df229309b2941a2a6c660bf7f2ef5f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc42da37b594f6cacdee7dec4cc437b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:20.866560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adca6b8-8fb4-4533-84ef-54139614adb5 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:20.866942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adca6b8-8fb4-4533-84ef-54139614adb5 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:20.867509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adca6b8-8fb4-4533-84ef-54139614adb5 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:20.869205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adca6b8-8fb4-4533-84ef-54139614adb5 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:20.872336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adca6b8-8fb4-4533-84ef-54139614adb5 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:20.929224 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2860/5719] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:43:20 2022] POST /identity/v3/projects => generated 349 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:20.933279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debea53b-65d2-4ddc-b563-48cbed982f41 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:20.951500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debea53b-65d2-4ddc-b563-48cbed982f41 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:21.199898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee036ac2-d945-40d6-b20e-7ac4e1b2dbef tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df229309b2941a2a6c660bf7f2ef5f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc42da37b594f6cacdee7dec4cc437b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:21.201266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee036ac2-d945-40d6-b20e-7ac4e1b2dbef tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:21.202162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee036ac2-d945-40d6-b20e-7ac4e1b2dbef tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:21.202888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee036ac2-d945-40d6-b20e-7ac4e1b2dbef tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:21.204433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee036ac2-d945-40d6-b20e-7ac4e1b2dbef tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:43:21.205158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee036ac2-d945-40d6-b20e-7ac4e1b2dbef tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:21.207837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee036ac2-d945-40d6-b20e-7ac4e1b2dbef tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:21.265204 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2860/5720] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:43:21.307052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adca6b8-8fb4-4533-84ef-54139614adb5 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:21.309213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4adca6b8-8fb4-4533-84ef-54139614adb5 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:21.466152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adca6b8-8fb4-4533-84ef-54139614adb5 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:21.472218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ce430-e927-46bf-8484-5a925c612689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:21.473550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ce430-e927-46bf-8484-5a925c612689 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:21.474011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ce430-e927-46bf-8484-5a925c612689 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:21.474478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ce430-e927-46bf-8484-5a925c612689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:21.487139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ce430-e927-46bf-8484-5a925c612689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:21.489036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ce430-e927-46bf-8484-5a925c612689 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:21.510092 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2861/5721] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:22.050418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee036ac2-d945-40d6-b20e-7ac4e1b2dbef tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:22.092815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee036ac2-d945-40d6-b20e-7ac4e1b2dbef tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:22.121760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e3fe0-3e97-453c-8c9a-66cecc612f14 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7df229309b2941a2a6c660bf7f2ef5f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc42da37b594f6cacdee7dec4cc437b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:22.123711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e3fe0-3e97-453c-8c9a-66cecc612f14 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:22.125130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e3fe0-3e97-453c-8c9a-66cecc612f14 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:22.127802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e3fe0-3e97-453c-8c9a-66cecc612f14 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] PATH_INFO: `/v3/projects/e453ba7c4be941c5b75a1ec70d5accf6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:22.132339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e3fe0-3e97-453c-8c9a-66cecc612f14 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e453ba7c4be941c5b75a1ec70d5accf6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:22.140745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e3fe0-3e97-453c-8c9a-66cecc612f14 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:22.160992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:22.249987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd4e3fe0-3e97-453c-8c9a-66cecc612f14 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e453ba7c4be941c5b75a1ec70d5accf6', 'request_id': 'req-dd4e3fe0-3e97-453c-8c9a-66cecc612f14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:22.265980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd4e3fe0-3e97-453c-8c9a-66cecc612f14 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e453ba7c4be941c5b75a1ec70d5accf6', 'request_id': 'req-dd4e3fe0-3e97-453c-8c9a-66cecc612f14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:22.278059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd4e3fe0-3e97-453c-8c9a-66cecc612f14 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e453ba7c4be941c5b75a1ec70d5accf6', 'request_id': 'req-dd4e3fe0-3e97-453c-8c9a-66cecc612f14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:22.349400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd4e3fe0-3e97-453c-8c9a-66cecc612f14 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] The token cache is being invalidate because project e453ba7c4be941c5b75a1ec70d5accf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:43:22.349975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd4e3fe0-3e97-453c-8c9a-66cecc612f14 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:22.351708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd4e3fe0-3e97-453c-8c9a-66cecc612f14 tempest-QuotasTest-1220962485 tempest-QuotasTest-1220962485-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:22.354484 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2861/5722] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:43:22 2022] DELETE /identity/v3/projects/e453ba7c4be941c5b75a1ec70d5accf6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:22.890366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ce430-e927-46bf-8484-5a925c612689 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:23.010427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:23.136245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ce430-e927-46bf-8484-5a925c612689 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:23.287966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7881e0e-679c-48e7-a411-bc7e15660e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:23.288817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7881e0e-679c-48e7-a411-bc7e15660e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:23.289114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7881e0e-679c-48e7-a411-bc7e15660e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:23.289377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7881e0e-679c-48e7-a411-bc7e15660e06 admin admin] PATH_INFO: `/v3/users/a605063d19164a31815d906f142032fb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:23.292572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7881e0e-679c-48e7-a411-bc7e15660e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a605063d19164a31815d906f142032fb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:23.298178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7881e0e-679c-48e7-a411-bc7e15660e06 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:23.417797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e7881e0e-679c-48e7-a411-bc7e15660e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a605063d19164a31815d906f142032fb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:23.477479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e7881e0e-679c-48e7-a411-bc7e15660e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a605063d19164a31815d906f142032fb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:23.482347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e7881e0e-679c-48e7-a411-bc7e15660e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a605063d19164a31815d906f142032fb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:23.484055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e7881e0e-679c-48e7-a411-bc7e15660e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a605063d19164a31815d906f142032fb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:23.516120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e7881e0e-679c-48e7-a411-bc7e15660e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a605063d19164a31815d906f142032fb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:23.546114 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2862/5723] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:43:22 2022] DELETE /identity/v3/users/a605063d19164a31815d906f142032fb => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:23.550979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb7420-8be6-4706-a04e-1a9de3c40788 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:23.551512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb7420-8be6-4706-a04e-1a9de3c40788 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:23.551793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb7420-8be6-4706-a04e-1a9de3c40788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:23.625682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b3eb7420-8be6-4706-a04e-1a9de3c40788 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:23.633321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b3eb7420-8be6-4706-a04e-1a9de3c40788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:23.769218 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2862/5724] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:23.779335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7881e0e-679c-48e7-a411-bc7e15660e06 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:23.781545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e7881e0e-679c-48e7-a411-bc7e15660e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:23.868852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7881e0e-679c-48e7-a411-bc7e15660e06 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:23.873736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0d1e4-fce6-455c-b753-65b9202ccd0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:23.874445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d1e4-fce6-455c-b753-65b9202ccd0a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:23.874806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d1e4-fce6-455c-b753-65b9202ccd0a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:23.875221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d1e4-fce6-455c-b753-65b9202ccd0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:23.887728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0d1e4-fce6-455c-b753-65b9202ccd0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:23.889917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0d1e4-fce6-455c-b753-65b9202ccd0a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:23.895727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:23.908697 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2863/5725] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:24.845805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb7420-8be6-4706-a04e-1a9de3c40788 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:24.847520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b3eb7420-8be6-4706-a04e-1a9de3c40788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:24.867536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb7420-8be6-4706-a04e-1a9de3c40788 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:24.873534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0905ac9-3fa7-42ab-8020-1962d86a06f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:24.874155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0905ac9-3fa7-42ab-8020-1962d86a06f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:24.874439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0905ac9-3fa7-42ab-8020-1962d86a06f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:24.874776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0905ac9-3fa7-42ab-8020-1962d86a06f0 admin admin] PATH_INFO: `/v3/users/9e57d4e6e06747dc96033a7b6688ba4e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:24.876289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0905ac9-3fa7-42ab-8020-1962d86a06f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e57d4e6e06747dc96033a7b6688ba4e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:24.878651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0905ac9-3fa7-42ab-8020-1962d86a06f0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:24.898552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0d1e4-fce6-455c-b753-65b9202ccd0a service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:24.900065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aef0d1e4-fce6-455c-b753-65b9202ccd0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:24.924863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0d1e4-fce6-455c-b753-65b9202ccd0a service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:24.940434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:24.942332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:24.942840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:24.943363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436 admin admin] PATH_INFO: `/v3/projects/793bd3f49da64c918601cb21c7b11b6b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:24.947653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=793bd3f49da64c918601cb21c7b11b6b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:24.972598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:25.024734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c0905ac9-3fa7-42ab-8020-1962d86a06f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e57d4e6e06747dc96033a7b6688ba4e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:25.025583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c0905ac9-3fa7-42ab-8020-1962d86a06f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e57d4e6e06747dc96033a7b6688ba4e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:25.046143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c0905ac9-3fa7-42ab-8020-1962d86a06f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e57d4e6e06747dc96033a7b6688ba4e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:25.071860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c0905ac9-3fa7-42ab-8020-1962d86a06f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e57d4e6e06747dc96033a7b6688ba4e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:25.117946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793bd3f49da64c918601cb21c7b11b6b', 'request_id': 'req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:25.126173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c0905ac9-3fa7-42ab-8020-1962d86a06f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e57d4e6e06747dc96033a7b6688ba4e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:25.141482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793bd3f49da64c918601cb21c7b11b6b', 'request_id': 'req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:25.150716 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2863/5726] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:43:24 2022] DELETE /identity/v3/users/9e57d4e6e06747dc96033a7b6688ba4e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:25.157076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b78367-d317-45ef-8c25-ad34f7956f68 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:25.157594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b78367-d317-45ef-8c25-ad34f7956f68 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:25.158160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b78367-d317-45ef-8c25-ad34f7956f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:25.164389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793bd3f49da64c918601cb21c7b11b6b', 'request_id': 'req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:25.192654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436 admin admin] The token cache is being invalidate because project 793bd3f49da64c918601cb21c7b11b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:43:25.195556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:25.196164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:25.196609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:25.201997 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2864/5727] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:43:24 2022] DELETE /identity/v3/projects/793bd3f49da64c918601cb21c7b11b6b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:25.209095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:25.212158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:25.215235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-83b78367-d317-45ef-8c25-ad34f7956f68 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:25.218525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-83b78367-d317-45ef-8c25-ad34f7956f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:25.356974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5b2b6-d41e-4ca7-a9be-5771c02f8436 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:25.399366 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2864/5728] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:25.409938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b78367-d317-45ef-8c25-ad34f7956f68 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:25.411548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-83b78367-d317-45ef-8c25-ad34f7956f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:25.465055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173bcfb-b996-4a69-a01a-f0688711b5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:25.465996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173bcfb-b996-4a69-a01a-f0688711b5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:25.466475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173bcfb-b996-4a69-a01a-f0688711b5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:25.466916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173bcfb-b996-4a69-a01a-f0688711b5b3 admin admin] PATH_INFO: `/v3/users/7df229309b2941a2a6c660bf7f2ef5f6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:25.469170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173bcfb-b996-4a69-a01a-f0688711b5b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7df229309b2941a2a6c660bf7f2ef5f6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:25.472683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173bcfb-b996-4a69-a01a-f0688711b5b3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:25.512763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b78367-d317-45ef-8c25-ad34f7956f68 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:25.518098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a42c17-20bd-402d-9e5c-467536f0fd25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:25.518726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a42c17-20bd-402d-9e5c-467536f0fd25 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:25.519013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a42c17-20bd-402d-9e5c-467536f0fd25 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:25.519319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a42c17-20bd-402d-9e5c-467536f0fd25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:25.534364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a42c17-20bd-402d-9e5c-467536f0fd25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:25.537304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a42c17-20bd-402d-9e5c-467536f0fd25 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:25.540957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:25.559607 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2865/5729] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:25.579890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8173bcfb-b996-4a69-a01a-f0688711b5b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7df229309b2941a2a6c660bf7f2ef5f6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:25.609575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8173bcfb-b996-4a69-a01a-f0688711b5b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7df229309b2941a2a6c660bf7f2ef5f6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:25.612041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8173bcfb-b996-4a69-a01a-f0688711b5b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7df229309b2941a2a6c660bf7f2ef5f6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:25.615245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8173bcfb-b996-4a69-a01a-f0688711b5b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7df229309b2941a2a6c660bf7f2ef5f6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:25.644141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8173bcfb-b996-4a69-a01a-f0688711b5b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7df229309b2941a2a6c660bf7f2ef5f6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:25.671342 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2865/5730] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:43:25 2022] DELETE /identity/v3/users/7df229309b2941a2a6c660bf7f2ef5f6 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:25.939592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a42c17-20bd-402d-9e5c-467536f0fd25 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:25.941017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0a42c17-20bd-402d-9e5c-467536f0fd25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:25.978526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a42c17-20bd-402d-9e5c-467536f0fd25 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:26.162864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09327ed9-eaec-469c-acff-870d1b01b629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:26.164123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09327ed9-eaec-469c-acff-870d1b01b629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:26.165741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09327ed9-eaec-469c-acff-870d1b01b629 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:26.165741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09327ed9-eaec-469c-acff-870d1b01b629 admin admin] PATH_INFO: `/v3/projects/503b0304128943c699c536d637c6eecb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:26.166847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09327ed9-eaec-469c-acff-870d1b01b629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=503b0304128943c699c536d637c6eecb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:26.169691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09327ed9-eaec-469c-acff-870d1b01b629 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:26.215627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173bcfb-b996-4a69-a01a-f0688711b5b3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:26.220082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8173bcfb-b996-4a69-a01a-f0688711b5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:26.252242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173bcfb-b996-4a69-a01a-f0688711b5b3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:26.306542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4dff9-ccc1-44f6-a210-31c51147b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:26.308383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4dff9-ccc1-44f6-a210-31c51147b26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:26.310525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4dff9-ccc1-44f6-a210-31c51147b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:26.310807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4dff9-ccc1-44f6-a210-31c51147b26d admin admin] PATH_INFO: `/v3/projects/bcc42da37b594f6cacdee7dec4cc437b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:26.315023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4dff9-ccc1-44f6-a210-31c51147b26d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc42da37b594f6cacdee7dec4cc437b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:26.318887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4dff9-ccc1-44f6-a210-31c51147b26d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:26.354208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09327ed9-eaec-469c-acff-870d1b01b629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '503b0304128943c699c536d637c6eecb', 'request_id': 'req-09327ed9-eaec-469c-acff-870d1b01b629'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:26.362780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:26.375997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09327ed9-eaec-469c-acff-870d1b01b629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '503b0304128943c699c536d637c6eecb', 'request_id': 'req-09327ed9-eaec-469c-acff-870d1b01b629'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:26.385651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09327ed9-eaec-469c-acff-870d1b01b629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '503b0304128943c699c536d637c6eecb', 'request_id': 'req-09327ed9-eaec-469c-acff-870d1b01b629'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:26.413572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09327ed9-eaec-469c-acff-870d1b01b629 admin admin] The token cache is being invalidate because project 503b0304128943c699c536d637c6eecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:43:26.414070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09327ed9-eaec-469c-acff-870d1b01b629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:26.415822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09327ed9-eaec-469c-acff-870d1b01b629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:26.430971 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2866/5731] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:43:25 2022] DELETE /identity/v3/projects/503b0304128943c699c536d637c6eecb => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:26.436337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c704ec5-ee25-49d3-beb7-b0cb9cc96481 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:26.436337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c704ec5-ee25-49d3-beb7-b0cb9cc96481 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:26.436337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c704ec5-ee25-49d3-beb7-b0cb9cc96481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:26.483154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2c704ec5-ee25-49d3-beb7-b0cb9cc96481 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:26.483405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80b4dff9-ccc1-44f6-a210-31c51147b26d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc42da37b594f6cacdee7dec4cc437b', 'request_id': 'req-80b4dff9-ccc1-44f6-a210-31c51147b26d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:26.487152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2c704ec5-ee25-49d3-beb7-b0cb9cc96481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:26.499183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80b4dff9-ccc1-44f6-a210-31c51147b26d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc42da37b594f6cacdee7dec4cc437b', 'request_id': 'req-80b4dff9-ccc1-44f6-a210-31c51147b26d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:26.522470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80b4dff9-ccc1-44f6-a210-31c51147b26d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc42da37b594f6cacdee7dec4cc437b', 'request_id': 'req-80b4dff9-ccc1-44f6-a210-31c51147b26d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:26.569531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80b4dff9-ccc1-44f6-a210-31c51147b26d admin admin] The token cache is being invalidate because project bcc42da37b594f6cacdee7dec4cc437b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:43:26.569898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80b4dff9-ccc1-44f6-a210-31c51147b26d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:26.579669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80b4dff9-ccc1-44f6-a210-31c51147b26d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:26.583616 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2866/5732] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:43:26 2022] DELETE /identity/v3/projects/bcc42da37b594f6cacdee7dec4cc437b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:43:26.588401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bec8d-f6b4-4a24-b92b-aaf34a06d85c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:26.591746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bec8d-f6b4-4a24-b92b-aaf34a06d85c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:26.592433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bec8d-f6b4-4a24-b92b-aaf34a06d85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:26.617742 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2867/5733] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:26.625549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8d6b0-752b-4dd2-bb6c-369c8ed0be4a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:26.625825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8d6b0-752b-4dd2-bb6c-369c8ed0be4a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:26.626104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8d6b0-752b-4dd2-bb6c-369c8ed0be4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:26.634232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0e7bec8d-f6b4-4a24-b92b-aaf34a06d85c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:26.639225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0e7bec8d-f6b4-4a24-b92b-aaf34a06d85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:26.661620 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2867/5734] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:26.670299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7ef7d-c6c1-4f82-8b2c-ea0d16f690dd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:26.670938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7ef7d-c6c1-4f82-8b2c-ea0d16f690dd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:26.671695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7ef7d-c6c1-4f82-8b2c-ea0d16f690dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:26.672563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-57b8d6b0-752b-4dd2-bb6c-369c8ed0be4a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:26.673877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-57b8d6b0-752b-4dd2-bb6c-369c8ed0be4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:26.687313 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2868/5735] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:26.692468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8d6b0-752b-4dd2-bb6c-369c8ed0be4a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:26.714632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8d6b0-752b-4dd2-bb6c-369c8ed0be4a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:26.722692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-62a7ef7d-c6c1-4f82-8b2c-ea0d16f690dd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:26.724058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-62a7ef7d-c6c1-4f82-8b2c-ea0d16f690dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:26.734435 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2868/5736] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:43:26.737135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a7e33-c74c-4ba9-846d-4535e93b3b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:26.738137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a7e33-c74c-4ba9-846d-4535e93b3b45 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:26.738424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a7e33-c74c-4ba9-846d-4535e93b3b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:26.738705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a7e33-c74c-4ba9-846d-4535e93b3b45 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:26.738849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7ef7d-c6c1-4f82-8b2c-ea0d16f690dd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:26.742638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a7e33-c74c-4ba9-846d-4535e93b3b45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:43:26.742960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a7e33-c74c-4ba9-846d-4535e93b3b45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:26.748865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a7e33-c74c-4ba9-846d-4535e93b3b45 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:26.754614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7ef7d-c6c1-4f82-8b2c-ea0d16f690dd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:26.760636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea1019-d68d-4e29-bdda-5b04b30b1e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:26.761475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea1019-d68d-4e29-bdda-5b04b30b1e7b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:26.761917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea1019-d68d-4e29-bdda-5b04b30b1e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:26.762300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea1019-d68d-4e29-bdda-5b04b30b1e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:26.763908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea1019-d68d-4e29-bdda-5b04b30b1e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:43:26.764414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea1019-d68d-4e29-bdda-5b04b30b1e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:26.766156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea1019-d68d-4e29-bdda-5b04b30b1e7b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:26.775134 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2869/5737] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:43:26.784068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a7e33-c74c-4ba9-846d-4535e93b3b45 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:26.785058 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2869/5738] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:43:26.786088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea1019-d68d-4e29-bdda-5b04b30b1e7b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:26.810641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea1019-d68d-4e29-bdda-5b04b30b1e7b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:26.811594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a7e33-c74c-4ba9-846d-4535e93b3b45 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:26.820902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d721807-43ee-4c45-b870-17a3eb46d414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:26.821618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d721807-43ee-4c45-b870-17a3eb46d414 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:26.822241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d721807-43ee-4c45-b870-17a3eb46d414 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:26.822241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d721807-43ee-4c45-b870-17a3eb46d414 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:26.823055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d721807-43ee-4c45-b870-17a3eb46d414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:26.825157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d721807-43ee-4c45-b870-17a3eb46d414 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:26.828078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67467413-f68c-4387-b599-daff2795d867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:26.831024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67467413-f68c-4387-b599-daff2795d867 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:26.833964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67467413-f68c-4387-b599-daff2795d867 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:26.834773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67467413-f68c-4387-b599-daff2795d867 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:26.838179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67467413-f68c-4387-b599-daff2795d867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:26.840520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67467413-f68c-4387-b599-daff2795d867 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:26.876139 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2870/5739] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:43:26 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:26.886089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d721807-43ee-4c45-b870-17a3eb46d414 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:26.922537 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2870/5740] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:43:26 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:26.926749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67467413-f68c-4387-b599-daff2795d867 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:27.003315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d721807-43ee-4c45-b870-17a3eb46d414 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:27.029501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:27.052936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67467413-f68c-4387-b599-daff2795d867 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:27.058182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1f20f-52ca-43bc-a3c0-75902690b309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:27.058949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1f20f-52ca-43bc-a3c0-75902690b309 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:27.060034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1f20f-52ca-43bc-a3c0-75902690b309 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:27.060415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1f20f-52ca-43bc-a3c0-75902690b309 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:27.061894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1f20f-52ca-43bc-a3c0-75902690b309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:27.064923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1f20f-52ca-43bc-a3c0-75902690b309 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:27.069468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:27.114305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64808800-0c00-4983-a7b0-1ef2bebcdfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:27.115182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808800-0c00-4983-a7b0-1ef2bebcdfeb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:27.115658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808800-0c00-4983-a7b0-1ef2bebcdfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:27.115784 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2871/5741] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:43:26 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:27.115939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808800-0c00-4983-a7b0-1ef2bebcdfeb admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:27.116602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64808800-0c00-4983-a7b0-1ef2bebcdfeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:27.118756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64808800-0c00-4983-a7b0-1ef2bebcdfeb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:27.119834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1f20f-52ca-43bc-a3c0-75902690b309 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:27.143859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1f20f-52ca-43bc-a3c0-75902690b309 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:27.147885 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2871/5742] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:43:26 2022] POST /identity/v3/users => generated 292 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:27.152466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64808800-0c00-4983-a7b0-1ef2bebcdfeb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:27.156231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690ce60-4105-4f39-8769-bd77ad51bcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:27.157165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690ce60-4105-4f39-8769-bd77ad51bcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:27.157656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690ce60-4105-4f39-8769-bd77ad51bcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:27.158318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690ce60-4105-4f39-8769-bd77ad51bcb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:27.163605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690ce60-4105-4f39-8769-bd77ad51bcb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:27.166282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64808800-0c00-4983-a7b0-1ef2bebcdfeb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:27.171745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690ce60-4105-4f39-8769-bd77ad51bcb6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:27.171963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717ebd0-7c6e-4118-af5f-3230b09b085c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:27.172578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ebd0-7c6e-4118-af5f-3230b09b085c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:27.172865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ebd0-7c6e-4118-af5f-3230b09b085c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:27.173153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ebd0-7c6e-4118-af5f-3230b09b085c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:27.173861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717ebd0-7c6e-4118-af5f-3230b09b085c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:27.175709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717ebd0-7c6e-4118-af5f-3230b09b085c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:27.189832 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2872/5743] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:27.192942 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2872/5744] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:27.194027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717ebd0-7c6e-4118-af5f-3230b09b085c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:27.198137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690ce60-4105-4f39-8769-bd77ad51bcb6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:27.210422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690ce60-4105-4f39-8769-bd77ad51bcb6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:27.213383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717ebd0-7c6e-4118-af5f-3230b09b085c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:27.218143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75016c6f-878a-4b5c-9504-dadeb0cd5e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:27.219619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75016c6f-878a-4b5c-9504-dadeb0cd5e05 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:27.219868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3327-ef28-4e6f-bef2-fcb0e04ead46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:27.220531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75016c6f-878a-4b5c-9504-dadeb0cd5e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:27.220775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3327-ef28-4e6f-bef2-fcb0e04ead46 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:27.221191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3327-ef28-4e6f-bef2-fcb0e04ead46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:27.221417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75016c6f-878a-4b5c-9504-dadeb0cd5e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:27.221693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3327-ef28-4e6f-bef2-fcb0e04ead46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:27.222549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf3327-ef28-4e6f-bef2-fcb0e04ead46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:27.222871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75016c6f-878a-4b5c-9504-dadeb0cd5e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:27.224688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf3327-ef28-4e6f-bef2-fcb0e04ead46 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:27.224883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75016c6f-878a-4b5c-9504-dadeb0cd5e05 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:27.243676 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2873/5745] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:27.244267 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2873/5746] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:27.244630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75016c6f-878a-4b5c-9504-dadeb0cd5e05 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:27.245488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3327-ef28-4e6f-bef2-fcb0e04ead46 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:27.268393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3327-ef28-4e6f-bef2-fcb0e04ead46 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:27.271461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75016c6f-878a-4b5c-9504-dadeb0cd5e05 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:27.274115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919a139-fccb-437d-83f3-74b9d568603d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:27.274990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919a139-fccb-437d-83f3-74b9d568603d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:27.275541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919a139-fccb-437d-83f3-74b9d568603d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:27.275971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919a139-fccb-437d-83f3-74b9d568603d admin admin] PATH_INFO: `/v3/projects/b49067d39dea40b8831e32a7e3ace25b/users/a2d27cf25d74408cb98a65ccc277635b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:27.280842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742efe2-4f7c-47a2-8af4-b2625aae9ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:27.282203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742efe2-4f7c-47a2-8af4-b2625aae9ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:27.284150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742efe2-4f7c-47a2-8af4-b2625aae9ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:27.284507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742efe2-4f7c-47a2-8af4-b2625aae9ae5 admin admin] PATH_INFO: `/v3/projects/b4b7fb6127f74a57806c9898293fafe5/users/d4a721d66c7a43baa865feb20ac942af/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:27.309651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919a139-fccb-437d-83f3-74b9d568603d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49067d39dea40b8831e32a7e3ace25b, user_id=a2d27cf25d74408cb98a65ccc277635b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:27.312882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919a139-fccb-437d-83f3-74b9d568603d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:27.323526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742efe2-4f7c-47a2-8af4-b2625aae9ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b7fb6127f74a57806c9898293fafe5, user_id=d4a721d66c7a43baa865feb20ac942af, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:27.326332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742efe2-4f7c-47a2-8af4-b2625aae9ae5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:27.343993 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2874/5747] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:43:27 2022] PUT /identity/v3/projects/b49067d39dea40b8831e32a7e3ace25b/users/a2d27cf25d74408cb98a65ccc277635b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:27.357081 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2874/5748] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:43:27 2022] PUT /identity/v3/projects/b4b7fb6127f74a57806c9898293fafe5/users/d4a721d66c7a43baa865feb20ac942af/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:27.357550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf06290-999c-4744-8e3f-20b5105b5159 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:27.358049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf06290-999c-4744-8e3f-20b5105b5159 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:27.358589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf06290-999c-4744-8e3f-20b5105b5159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:27.369943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e0e62-dae9-407a-bebe-a414a5804aa6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:27.370320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e0e62-dae9-407a-bebe-a414a5804aa6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:27.370666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e0e62-dae9-407a-bebe-a414a5804aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:27.414866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1cf06290-999c-4744-8e3f-20b5105b5159 None None] MFA Rules not processed for user `a2d27cf25d74408cb98a65ccc277635b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:27.416377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1cf06290-999c-4744-8e3f-20b5105b5159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:27.436854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4a1e0e62-dae9-407a-bebe-a414a5804aa6 None None] MFA Rules not processed for user `d4a721d66c7a43baa865feb20ac942af`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:27.442154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4a1e0e62-dae9-407a-bebe-a414a5804aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:27.581791 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2875/5749] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:43:27.612685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf06290-999c-4744-8e3f-20b5105b5159 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:27.614719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1cf06290-999c-4744-8e3f-20b5105b5159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:27.649049 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2875/5750] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:43:27.649912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e0e62-dae9-407a-bebe-a414a5804aa6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:27.745652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf06290-999c-4744-8e3f-20b5105b5159 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:27.762749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebcd91-44fc-4492-aca3-8b1da145f71b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:27.763193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebcd91-44fc-4492-aca3-8b1da145f71b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:27.764196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebcd91-44fc-4492-aca3-8b1da145f71b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:27.765173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebcd91-44fc-4492-aca3-8b1da145f71b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:27.772369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e0e62-dae9-407a-bebe-a414a5804aa6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:27.787652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bc566-0d1e-417a-a4fe-d253f9c56a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:27.789336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bc566-0d1e-417a-a4fe-d253f9c56a0a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:27.789621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bc566-0d1e-417a-a4fe-d253f9c56a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:27.789901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bc566-0d1e-417a-a4fe-d253f9c56a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:27.790453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebcd91-44fc-4492-aca3-8b1da145f71b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:27.790595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bc566-0d1e-417a-a4fe-d253f9c56a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:27.795934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebcd91-44fc-4492-aca3-8b1da145f71b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:27.796103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bc566-0d1e-417a-a4fe-d253f9c56a0a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:27.817039 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2876/5751] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:43:27.827501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:27.840781 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2876/5752] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:43:27 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:27.846407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebcd91-44fc-4492-aca3-8b1da145f71b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:27.867473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebcd91-44fc-4492-aca3-8b1da145f71b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:27.914890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:27.984352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21908fac-68a0-435f-9ee0-a1c348a4f091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:27.984994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21908fac-68a0-435f-9ee0-a1c348a4f091 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:27.985269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21908fac-68a0-435f-9ee0-a1c348a4f091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:27.985538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21908fac-68a0-435f-9ee0-a1c348a4f091 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:27.986183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21908fac-68a0-435f-9ee0-a1c348a4f091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:27.989075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21908fac-68a0-435f-9ee0-a1c348a4f091 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:28.030879 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2877/5753] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:43:27 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:28.032028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bc566-0d1e-417a-a4fe-d253f9c56a0a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:28.048097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bc566-0d1e-417a-a4fe-d253f9c56a0a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:28.071604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bede8-a97a-41ec-babe-51cbddc00b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:28.072906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bede8-a97a-41ec-babe-51cbddc00b65 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:28.073190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bede8-a97a-41ec-babe-51cbddc00b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:28.073931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bede8-a97a-41ec-babe-51cbddc00b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:28.078127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bede8-a97a-41ec-babe-51cbddc00b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:28.082799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bede8-a97a-41ec-babe-51cbddc00b65 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:28.175320 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2877/5754] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:43:28.177642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21908fac-68a0-435f-9ee0-a1c348a4f091 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:28.198546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21908fac-68a0-435f-9ee0-a1c348a4f091 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:28.216423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac44802-9359-4c3b-9533-c3ea02c129bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:28.218250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac44802-9359-4c3b-9533-c3ea02c129bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:28.218644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac44802-9359-4c3b-9533-c3ea02c129bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:28.219064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac44802-9359-4c3b-9533-c3ea02c129bc admin admin] PATH_INFO: `/v3/projects/b3f8b974ba434b1688fa923b26114ea0/users/e9944f1f916c46b49708251ea557c957/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:28.272868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac44802-9359-4c3b-9533-c3ea02c129bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f8b974ba434b1688fa923b26114ea0, user_id=e9944f1f916c46b49708251ea557c957, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:28.276174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac44802-9359-4c3b-9533-c3ea02c129bc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:28.293711 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2878/5755] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:43:28 2022] PUT /identity/v3/projects/b3f8b974ba434b1688fa923b26114ea0/users/e9944f1f916c46b49708251ea557c957/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:28.297661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bede8-a97a-41ec-babe-51cbddc00b65 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:28.311195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bede8-a97a-41ec-babe-51cbddc00b65 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:28.400839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f4645-c132-440f-ae49-094c27533f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:28.402686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f4645-c132-440f-ae49-094c27533f56 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:28.403421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f4645-c132-440f-ae49-094c27533f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:28.403711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f4645-c132-440f-ae49-094c27533f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:28.405798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f4645-c132-440f-ae49-094c27533f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:28.410381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f4645-c132-440f-ae49-094c27533f56 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:28.431175 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2878/5756] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:28.433604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac44802-9359-4c3b-9533-c3ea02c129bc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:28.463099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac44802-9359-4c3b-9533-c3ea02c129bc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:28.481768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7244be-0b86-4344-bdd3-f1ab9735307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:28.482553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7244be-0b86-4344-bdd3-f1ab9735307e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:28.483128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7244be-0b86-4344-bdd3-f1ab9735307e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:28.483501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7244be-0b86-4344-bdd3-f1ab9735307e admin admin] PATH_INFO: `/v3/projects/b3f8b974ba434b1688fa923b26114ea0/users/e9944f1f916c46b49708251ea557c957/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:28.487692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7244be-0b86-4344-bdd3-f1ab9735307e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f8b974ba434b1688fa923b26114ea0, user_id=e9944f1f916c46b49708251ea557c957, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:28.490495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7244be-0b86-4344-bdd3-f1ab9735307e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:28.530140 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2879/5757] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:43:28 2022] PUT /identity/v3/projects/b3f8b974ba434b1688fa923b26114ea0/users/e9944f1f916c46b49708251ea557c957/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:28.530483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db44b1-9f3b-4344-ab4f-4046a7d31142 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:28.530772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db44b1-9f3b-4344-ab4f-4046a7d31142 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:28.531066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db44b1-9f3b-4344-ab4f-4046a7d31142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:28.595527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a9db44b1-9f3b-4344-ab4f-4046a7d31142 None None] MFA Rules not processed for user `e9944f1f916c46b49708251ea557c957`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:28.596858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a9db44b1-9f3b-4344-ab4f-4046a7d31142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:28.763457 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2879/5758] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:43:28.785227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7244be-0b86-4344-bdd3-f1ab9735307e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:28.910097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7244be-0b86-4344-bdd3-f1ab9735307e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:28.914855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4665c-b29f-4e11-95f4-96be97001d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:28.915940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4665c-b29f-4e11-95f4-96be97001d1a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:28.916291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4665c-b29f-4e11-95f4-96be97001d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:28.916717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4665c-b29f-4e11-95f4-96be97001d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:28.942273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4665c-b29f-4e11-95f4-96be97001d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:28.943901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4665c-b29f-4e11-95f4-96be97001d1a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:28.976159 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2880/5759] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:38.752880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=68 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:38.964140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=60,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:39.504937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a9296-07bb-4248-b176-d3e9bb55facb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:39.505225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a9296-07bb-4248-b176-d3e9bb55facb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:39.505505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a9296-07bb-4248-b176-d3e9bb55facb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:39.542554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c56a9296-07bb-4248-b176-d3e9bb55facb None None] MFA Rules not processed for user `a4a0713f4bfc4b1fb99f4afe849b042d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:39.548115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c56a9296-07bb-4248-b176-d3e9bb55facb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:39.693498 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2880/5760] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:40.285916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4665c-b29f-4e11-95f4-96be97001d1a service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:40.303005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4665c-b29f-4e11-95f4-96be97001d1a service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:40.345059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8ea98-69f2-487a-ae35-d18d03a1f893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:40.345290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8ea98-69f2-487a-ae35-d18d03a1f893 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:40.345411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8ea98-69f2-487a-ae35-d18d03a1f893 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:40.347203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8ea98-69f2-487a-ae35-d18d03a1f893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:40.355963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9fe8ea98-69f2-487a-ae35-d18d03a1f893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:40.373359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8ea98-69f2-487a-ae35-d18d03a1f893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:40.374966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8ea98-69f2-487a-ae35-d18d03a1f893 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:40.400010 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2881/5761] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:46.241516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a9296-07bb-4248-b176-d3e9bb55facb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:46.260903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a9296-07bb-4248-b176-d3e9bb55facb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:46.274336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b27bea-9f19-4996-93de-1ff5ed11e69c tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9944f1f916c46b49708251ea557c957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3f8b974ba434b1688fa923b26114ea0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:46.275609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b27bea-9f19-4996-93de-1ff5ed11e69c tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:46.276611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b27bea-9f19-4996-93de-1ff5ed11e69c tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:46.276898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b27bea-9f19-4996-93de-1ff5ed11e69c tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:46.288723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b27bea-9f19-4996-93de-1ff5ed11e69c tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:43:46.291637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b27bea-9f19-4996-93de-1ff5ed11e69c tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:46.293351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b27bea-9f19-4996-93de-1ff5ed11e69c tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:46.325195 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2881/5762] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:43:46.326425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8ea98-69f2-487a-ae35-d18d03a1f893 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:46.341714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8ea98-69f2-487a-ae35-d18d03a1f893 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:46.369274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ae439-4948-4b10-b46d-8745b0f5f649 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9944f1f916c46b49708251ea557c957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3f8b974ba434b1688fa923b26114ea0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:46.369834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ae439-4948-4b10-b46d-8745b0f5f649 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:46.370117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ae439-4948-4b10-b46d-8745b0f5f649 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:46.384508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ae439-4948-4b10-b46d-8745b0f5f649 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:46.385401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ae439-4948-4b10-b46d-8745b0f5f649 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:46.387391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ae439-4948-4b10-b46d-8745b0f5f649 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:46.528029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b27bea-9f19-4996-93de-1ff5ed11e69c tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:46.537215 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2882/5763] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:43:46 2022] POST /identity/v3/projects => generated 349 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:46.539339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b27bea-9f19-4996-93de-1ff5ed11e69c tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:46.833040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac2a1a-99ad-4eb7-8f60-c6ceaf397a34 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9944f1f916c46b49708251ea557c957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3f8b974ba434b1688fa923b26114ea0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:46.833773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2a1a-99ad-4eb7-8f60-c6ceaf397a34 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:46.836022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2a1a-99ad-4eb7-8f60-c6ceaf397a34 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:46.836464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2a1a-99ad-4eb7-8f60-c6ceaf397a34 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:46.837702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac2a1a-99ad-4eb7-8f60-c6ceaf397a34 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:43:46.838687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac2a1a-99ad-4eb7-8f60-c6ceaf397a34 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:46.847328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac2a1a-99ad-4eb7-8f60-c6ceaf397a34 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:46.891679 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2882/5764] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:43:46.956175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ae439-4948-4b10-b46d-8745b0f5f649 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:47.094391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ae439-4948-4b10-b46d-8745b0f5f649 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:47.111578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb53d0-7025-4ebf-94e8-777cb3235888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:47.112408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb53d0-7025-4ebf-94e8-777cb3235888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:47.115475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb53d0-7025-4ebf-94e8-777cb3235888 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:47.115898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb53d0-7025-4ebf-94e8-777cb3235888 admin admin] PATH_INFO: `/v3/users/a2d27cf25d74408cb98a65ccc277635b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:47.118516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb53d0-7025-4ebf-94e8-777cb3235888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d27cf25d74408cb98a65ccc277635b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:47.122599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb53d0-7025-4ebf-94e8-777cb3235888 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:47.244379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f6bb53d0-7025-4ebf-94e8-777cb3235888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d27cf25d74408cb98a65ccc277635b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:47.246012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f6bb53d0-7025-4ebf-94e8-777cb3235888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d27cf25d74408cb98a65ccc277635b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:47.280165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f6bb53d0-7025-4ebf-94e8-777cb3235888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d27cf25d74408cb98a65ccc277635b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:47.307216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f6bb53d0-7025-4ebf-94e8-777cb3235888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d27cf25d74408cb98a65ccc277635b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:47.394334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f6bb53d0-7025-4ebf-94e8-777cb3235888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d27cf25d74408cb98a65ccc277635b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:47.436477 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2883/5765] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:43:46 2022] DELETE /identity/v3/users/a2d27cf25d74408cb98a65ccc277635b => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:47.438315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934099ad-4fc9-4a69-8b96-d483ee7891f7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:47.438804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934099ad-4fc9-4a69-8b96-d483ee7891f7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:47.439040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934099ad-4fc9-4a69-8b96-d483ee7891f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:47.495501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-934099ad-4fc9-4a69-8b96-d483ee7891f7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:47.501391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-934099ad-4fc9-4a69-8b96-d483ee7891f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:47.751981 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2883/5766] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:43:47.881422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb53d0-7025-4ebf-94e8-777cb3235888 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:47.883104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f6bb53d0-7025-4ebf-94e8-777cb3235888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:47.999759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:48.018415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934099ad-4fc9-4a69-8b96-d483ee7891f7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:48.019887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-934099ad-4fc9-4a69-8b96-d483ee7891f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:48.066991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb53d0-7025-4ebf-94e8-777cb3235888 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:48.085624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:48.090696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed05ae-7313-426d-a3aa-0bd3dd20b03b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:48.091548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed05ae-7313-426d-a3aa-0bd3dd20b03b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:48.091826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed05ae-7313-426d-a3aa-0bd3dd20b03b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:48.092616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed05ae-7313-426d-a3aa-0bd3dd20b03b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:48.127067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed05ae-7313-426d-a3aa-0bd3dd20b03b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:48.138590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed05ae-7313-426d-a3aa-0bd3dd20b03b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:48.197739 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2884/5767] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:48.300552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934099ad-4fc9-4a69-8b96-d483ee7891f7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:48.311770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9944f1f916c46b49708251ea557c957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3f8b974ba434b1688fa923b26114ea0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:48.314399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:48.314781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:48.315146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] PATH_INFO: `/v3/projects/4851c3de8990407cb58eecbe6870130a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:48.317504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4851c3de8990407cb58eecbe6870130a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:48.328747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:48.458786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4851c3de8990407cb58eecbe6870130a', 'request_id': 'req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:48.472076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4851c3de8990407cb58eecbe6870130a', 'request_id': 'req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:48.485909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4851c3de8990407cb58eecbe6870130a', 'request_id': 'req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:48.540906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] The token cache is being invalidate because project 4851c3de8990407cb58eecbe6870130a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:43:48.541298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:48.542200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:48.544130 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2884/5768] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:43:48 2022] DELETE /identity/v3/projects/4851c3de8990407cb58eecbe6870130a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:43:48.627532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed05ae-7313-426d-a3aa-0bd3dd20b03b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:48.640255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed05ae-7313-426d-a3aa-0bd3dd20b03b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:48.774880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57e784-0b94-439a-8bf3-3a09c3c80d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:48.775786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e784-0b94-439a-8bf3-3a09c3c80d63 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:48.777578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e784-0b94-439a-8bf3-3a09c3c80d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:48.778796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e784-0b94-439a-8bf3-3a09c3c80d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:48.785186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fa57e784-0b94-439a-8bf3-3a09c3c80d63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:48.926134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57e784-0b94-439a-8bf3-3a09c3c80d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:48.927924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57e784-0b94-439a-8bf3-3a09c3c80d63 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:48.942158 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2885/5769] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:49.270956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:49.272449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:49.408839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d144f-fb0c-4d9f-8e0d-4f68a389a217 tempest-RoutersIpV6AdminTest-1129783012 tempest-RoutersIpV6AdminTest-1129783012-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:49.415453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decc9be-6a9d-45db-8a9e-1bd40bc571bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:49.416118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decc9be-6a9d-45db-8a9e-1bd40bc571bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:49.416399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decc9be-6a9d-45db-8a9e-1bd40bc571bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:49.416672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decc9be-6a9d-45db-8a9e-1bd40bc571bb admin admin] PATH_INFO: `/v3/projects/b49067d39dea40b8831e32a7e3ace25b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:49.420038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decc9be-6a9d-45db-8a9e-1bd40bc571bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49067d39dea40b8831e32a7e3ace25b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:49.421998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decc9be-6a9d-45db-8a9e-1bd40bc571bb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:49.550393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5decc9be-6a9d-45db-8a9e-1bd40bc571bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49067d39dea40b8831e32a7e3ace25b', 'request_id': 'req-5decc9be-6a9d-45db-8a9e-1bd40bc571bb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:49.552817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:49.567334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5decc9be-6a9d-45db-8a9e-1bd40bc571bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49067d39dea40b8831e32a7e3ace25b', 'request_id': 'req-5decc9be-6a9d-45db-8a9e-1bd40bc571bb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:49.582090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5decc9be-6a9d-45db-8a9e-1bd40bc571bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49067d39dea40b8831e32a7e3ace25b', 'request_id': 'req-5decc9be-6a9d-45db-8a9e-1bd40bc571bb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:49.622518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5decc9be-6a9d-45db-8a9e-1bd40bc571bb admin admin] The token cache is being invalidate because project b49067d39dea40b8831e32a7e3ace25b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:43:49.622817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5decc9be-6a9d-45db-8a9e-1bd40bc571bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:49.627107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5decc9be-6a9d-45db-8a9e-1bd40bc571bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:49.634517 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2885/5770] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:43:49 2022] DELETE /identity/v3/projects/b49067d39dea40b8831e32a7e3ace25b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:49.636495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08cbcf-9987-4bcc-be37-953b5c65cd51 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:49.637012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08cbcf-9987-4bcc-be37-953b5c65cd51 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:49.637012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08cbcf-9987-4bcc-be37-953b5c65cd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:49.684579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4f08cbcf-9987-4bcc-be37-953b5c65cd51 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:49.691207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f08cbcf-9987-4bcc-be37-953b5c65cd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:49.882686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e20f8-25ec-47da-8307-b6a804e45886 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:49.883230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e20f8-25ec-47da-8307-b6a804e45886 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:49.884055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e20f8-25ec-47da-8307-b6a804e45886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:49.901237 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2886/5771] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:49.946501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ae1e20f8-25ec-47da-8307-b6a804e45886 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:49.947784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ae1e20f8-25ec-47da-8307-b6a804e45886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:49.987571 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2886/5772] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:49.989639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08cbcf-9987-4bcc-be37-953b5c65cd51 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:50.005004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08cbcf-9987-4bcc-be37-953b5c65cd51 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:50.025964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ec8d7-6247-4847-bf53-55ed10693ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:50.027496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec8d7-6247-4847-bf53-55ed10693ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:50.028006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec8d7-6247-4847-bf53-55ed10693ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:50.028462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec8d7-6247-4847-bf53-55ed10693ec8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:50.029903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ec8d7-6247-4847-bf53-55ed10693ec8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:43:50.030379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ec8d7-6247-4847-bf53-55ed10693ec8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:50.032427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ec8d7-6247-4847-bf53-55ed10693ec8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:50.054800 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2887/5773] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:43:50.059212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e20f8-25ec-47da-8307-b6a804e45886 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:50.074019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e20f8-25ec-47da-8307-b6a804e45886 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:50.082101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e609d-737a-48cf-9e59-85e7417d6547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:50.084127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e609d-737a-48cf-9e59-85e7417d6547 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:50.084412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e609d-737a-48cf-9e59-85e7417d6547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:50.084687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e609d-737a-48cf-9e59-85e7417d6547 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:50.085973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e609d-737a-48cf-9e59-85e7417d6547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:50.091456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e609d-737a-48cf-9e59-85e7417d6547 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:50.161578 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2887/5774] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:43:50 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:50.164848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ec8d7-6247-4847-bf53-55ed10693ec8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:50.181696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ec8d7-6247-4847-bf53-55ed10693ec8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:50.243444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:50.316234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86503377-1df2-4ac2-bb30-4bc71bc72331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:50.316871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86503377-1df2-4ac2-bb30-4bc71bc72331 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:50.317188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86503377-1df2-4ac2-bb30-4bc71bc72331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:50.317475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86503377-1df2-4ac2-bb30-4bc71bc72331 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:50.318117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86503377-1df2-4ac2-bb30-4bc71bc72331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:50.320167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86503377-1df2-4ac2-bb30-4bc71bc72331 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:50.373204 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2888/5775] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:43:50 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:50.377090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e609d-737a-48cf-9e59-85e7417d6547 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:50.388197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e609d-737a-48cf-9e59-85e7417d6547 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:50.411748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bed3fd-e727-411a-904d-2e499a1a3e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:50.412395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bed3fd-e727-411a-904d-2e499a1a3e4a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:50.412671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bed3fd-e727-411a-904d-2e499a1a3e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:50.412940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bed3fd-e727-411a-904d-2e499a1a3e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:50.413608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bed3fd-e727-411a-904d-2e499a1a3e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:50.415965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bed3fd-e727-411a-904d-2e499a1a3e4a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:50.449756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86503377-1df2-4ac2-bb30-4bc71bc72331 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:50.458576 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2888/5776] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:50.464967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86503377-1df2-4ac2-bb30-4bc71bc72331 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:50.476003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8858e25-0dcc-4f8a-b4f7-bfe550379114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:50.476641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8858e25-0dcc-4f8a-b4f7-bfe550379114 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:50.476919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8858e25-0dcc-4f8a-b4f7-bfe550379114 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:50.477266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8858e25-0dcc-4f8a-b4f7-bfe550379114 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:50.477928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8858e25-0dcc-4f8a-b4f7-bfe550379114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:50.481403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8858e25-0dcc-4f8a-b4f7-bfe550379114 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:50.514040 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2889/5777] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:50.518307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bed3fd-e727-411a-904d-2e499a1a3e4a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:50.532726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bed3fd-e727-411a-904d-2e499a1a3e4a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:50.537629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b539e0-db01-4a08-8265-67072d26b5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:50.538313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b539e0-db01-4a08-8265-67072d26b5a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:50.538647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b539e0-db01-4a08-8265-67072d26b5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:50.538930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b539e0-db01-4a08-8265-67072d26b5a4 admin admin] PATH_INFO: `/v3/projects/913fdaabe6514b98ad677f88b9ef63b6/users/ca6ea006428a4057b179fa9e7919cfc2/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:50.562888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b539e0-db01-4a08-8265-67072d26b5a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=913fdaabe6514b98ad677f88b9ef63b6, user_id=ca6ea006428a4057b179fa9e7919cfc2, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:50.565827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b539e0-db01-4a08-8265-67072d26b5a4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:50.604677 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2889/5778] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:43:50 2022] PUT /identity/v3/projects/913fdaabe6514b98ad677f88b9ef63b6/users/ca6ea006428a4057b179fa9e7919cfc2/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:50.615862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209b6b1-0e77-4a02-b516-2e0d92634eb9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:50.616243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209b6b1-0e77-4a02-b516-2e0d92634eb9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:50.616534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209b6b1-0e77-4a02-b516-2e0d92634eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:50.722482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e209b6b1-0e77-4a02-b516-2e0d92634eb9 None None] MFA Rules not processed for user `ca6ea006428a4057b179fa9e7919cfc2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:50.724139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e209b6b1-0e77-4a02-b516-2e0d92634eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:50.952677 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2890/5779] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:51.074736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b539e0-db01-4a08-8265-67072d26b5a4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:51.077848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-71b539e0-db01-4a08-8265-67072d26b5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:51.284857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b539e0-db01-4a08-8265-67072d26b5a4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:51.293530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb786a6-37f2-4e35-9995-c0a637408933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:51.294392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb786a6-37f2-4e35-9995-c0a637408933 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:51.294848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb786a6-37f2-4e35-9995-c0a637408933 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:51.295306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb786a6-37f2-4e35-9995-c0a637408933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:51.330466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb786a6-37f2-4e35-9995-c0a637408933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:51.332565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb786a6-37f2-4e35-9995-c0a637408933 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:51.363167 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2890/5780] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:53.719006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209b6b1-0e77-4a02-b516-2e0d92634eb9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:53.721095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e209b6b1-0e77-4a02-b516-2e0d92634eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:53.868123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209b6b1-0e77-4a02-b516-2e0d92634eb9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:53.879622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a0e08-31f5-4873-b047-ed5eb7498353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:53.880520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a0e08-31f5-4873-b047-ed5eb7498353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:53.880973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a0e08-31f5-4873-b047-ed5eb7498353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:53.881534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a0e08-31f5-4873-b047-ed5eb7498353 admin admin] PATH_INFO: `/v3/users/16fedc13d7fd4e82bffc0e34e476266b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:53.883767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a0e08-31f5-4873-b047-ed5eb7498353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16fedc13d7fd4e82bffc0e34e476266b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:53.886895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a0e08-31f5-4873-b047-ed5eb7498353 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:53.987006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:54.001878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f35a0e08-31f5-4873-b047-ed5eb7498353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16fedc13d7fd4e82bffc0e34e476266b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:54.002778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f35a0e08-31f5-4873-b047-ed5eb7498353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16fedc13d7fd4e82bffc0e34e476266b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:54.017611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f35a0e08-31f5-4873-b047-ed5eb7498353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16fedc13d7fd4e82bffc0e34e476266b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:54.037450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f35a0e08-31f5-4873-b047-ed5eb7498353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16fedc13d7fd4e82bffc0e34e476266b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:54.071848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f35a0e08-31f5-4873-b047-ed5eb7498353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16fedc13d7fd4e82bffc0e34e476266b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:54.093322 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2891/5781] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:43:53 2022] DELETE /identity/v3/users/16fedc13d7fd4e82bffc0e34e476266b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:54.603568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb786a6-37f2-4e35-9995-c0a637408933 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:54.606135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4fb786a6-37f2-4e35-9995-c0a637408933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:54.627015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb786a6-37f2-4e35-9995-c0a637408933 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:54.747675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a0e08-31f5-4873-b047-ed5eb7498353 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:54.749139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f35a0e08-31f5-4873-b047-ed5eb7498353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:54.829707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9225b39-b35c-426e-b622-83637462c904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:54.830670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9225b39-b35c-426e-b622-83637462c904 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:54.830948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9225b39-b35c-426e-b622-83637462c904 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:54.831215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9225b39-b35c-426e-b622-83637462c904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:54.837567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b9225b39-b35c-426e-b622-83637462c904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:54.905899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a0e08-31f5-4873-b047-ed5eb7498353 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:54.917467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ca6ed-6471-43b7-babc-616f2e83ae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:54.918357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca6ed-6471-43b7-babc-616f2e83ae71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:54.918818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca6ed-6471-43b7-babc-616f2e83ae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:54.919280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca6ed-6471-43b7-babc-616f2e83ae71 admin admin] PATH_INFO: `/v3/projects/1bc4395bb17f4145999f78703a016ea1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:54.930552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:54.931917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ca6ed-6471-43b7-babc-616f2e83ae71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc4395bb17f4145999f78703a016ea1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:54.934568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ca6ed-6471-43b7-babc-616f2e83ae71 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:55.006775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9225b39-b35c-426e-b622-83637462c904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:55.010246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9225b39-b35c-426e-b622-83637462c904 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:55.029839 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2891/5782] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:55.047639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e9ca6ed-6471-43b7-babc-616f2e83ae71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc4395bb17f4145999f78703a016ea1', 'request_id': 'req-1e9ca6ed-6471-43b7-babc-616f2e83ae71'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:55.072167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e9ca6ed-6471-43b7-babc-616f2e83ae71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc4395bb17f4145999f78703a016ea1', 'request_id': 'req-1e9ca6ed-6471-43b7-babc-616f2e83ae71'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:55.098573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e9ca6ed-6471-43b7-babc-616f2e83ae71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc4395bb17f4145999f78703a016ea1', 'request_id': 'req-1e9ca6ed-6471-43b7-babc-616f2e83ae71'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:55.143596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e9ca6ed-6471-43b7-babc-616f2e83ae71 admin admin] The token cache is being invalidate because project 1bc4395bb17f4145999f78703a016ea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:43:55.146878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e9ca6ed-6471-43b7-babc-616f2e83ae71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:55.150133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e9ca6ed-6471-43b7-babc-616f2e83ae71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:43:55.160657 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2892/5783] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:43:54 2022] DELETE /identity/v3/projects/1bc4395bb17f4145999f78703a016ea1 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:55.161517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2547f40-b98e-4ba0-a6cb-c3c159c8e6fd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:55.161810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2547f40-b98e-4ba0-a6cb-c3c159c8e6fd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:55.162087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2547f40-b98e-4ba0-a6cb-c3c159c8e6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:55.197396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b2547f40-b98e-4ba0-a6cb-c3c159c8e6fd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:55.199374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b2547f40-b98e-4ba0-a6cb-c3c159c8e6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:55.331035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a82b52-8ba4-4d52-a97d-f06802751f22 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:55.331354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a82b52-8ba4-4d52-a97d-f06802751f22 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:55.331646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a82b52-8ba4-4d52-a97d-f06802751f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:55.334696 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2892/5784] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:55.364345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-97a82b52-8ba4-4d52-a97d-f06802751f22 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:55.396949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97a82b52-8ba4-4d52-a97d-f06802751f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:55.445441 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2893/5785] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:55.450930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2547f40-b98e-4ba0-a6cb-c3c159c8e6fd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:55.467087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2547f40-b98e-4ba0-a6cb-c3c159c8e6fd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:55.476640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43723c-a55b-459c-bbc7-b7cf12a9e37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:55.477311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43723c-a55b-459c-bbc7-b7cf12a9e37f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:55.477593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43723c-a55b-459c-bbc7-b7cf12a9e37f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:55.477930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43723c-a55b-459c-bbc7-b7cf12a9e37f admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:55.478616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43723c-a55b-459c-bbc7-b7cf12a9e37f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:43:55.478922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43723c-a55b-459c-bbc7-b7cf12a9e37f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:55.481787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43723c-a55b-459c-bbc7-b7cf12a9e37f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:55.513539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a82b52-8ba4-4d52-a97d-f06802751f22 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:55.514357 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2893/5786] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:43:55.529310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a82b52-8ba4-4d52-a97d-f06802751f22 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:55.537854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e64c1-0b64-4a13-94c9-83efcdfee901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:55.539429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e64c1-0b64-4a13-94c9-83efcdfee901 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:55.542333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e64c1-0b64-4a13-94c9-83efcdfee901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:55.542333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e64c1-0b64-4a13-94c9-83efcdfee901 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:55.543200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e64c1-0b64-4a13-94c9-83efcdfee901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:55.549827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e64c1-0b64-4a13-94c9-83efcdfee901 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:55.618449 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2894/5787] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:43:55 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:55.619680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43723c-a55b-459c-bbc7-b7cf12a9e37f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:55.641715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43723c-a55b-459c-bbc7-b7cf12a9e37f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:55.782919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28e698-ce61-4525-bb51-ccfe6cd77477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:55.783567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28e698-ce61-4525-bb51-ccfe6cd77477 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:55.783852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28e698-ce61-4525-bb51-ccfe6cd77477 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:55.784132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28e698-ce61-4525-bb51-ccfe6cd77477 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:55.784759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28e698-ce61-4525-bb51-ccfe6cd77477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:55.787409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28e698-ce61-4525-bb51-ccfe6cd77477 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:55.823815 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2894/5788] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:43:55 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:43:55.824731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e64c1-0b64-4a13-94c9-83efcdfee901 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:55.837428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e64c1-0b64-4a13-94c9-83efcdfee901 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:55.858715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd63ed2-5d37-4319-a655-e7de64a08a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:55.859799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd63ed2-5d37-4319-a655-e7de64a08a7c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:55.860629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd63ed2-5d37-4319-a655-e7de64a08a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:55.861485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd63ed2-5d37-4319-a655-e7de64a08a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:55.862350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd63ed2-5d37-4319-a655-e7de64a08a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:55.865644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd63ed2-5d37-4319-a655-e7de64a08a7c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:55.891917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28e698-ce61-4525-bb51-ccfe6cd77477 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:55.903118 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2895/5789] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:55.904798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28e698-ce61-4525-bb51-ccfe6cd77477 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:55.910035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1af6f6-ff22-46d0-918e-a2054c8caae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:55.910963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1af6f6-ff22-46d0-918e-a2054c8caae0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:55.911281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1af6f6-ff22-46d0-918e-a2054c8caae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:55.911562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1af6f6-ff22-46d0-918e-a2054c8caae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:55.912864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1af6f6-ff22-46d0-918e-a2054c8caae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:55.914941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1af6f6-ff22-46d0-918e-a2054c8caae0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:55.929538 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2895/5790] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:43:55.933858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd63ed2-5d37-4319-a655-e7de64a08a7c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:55.950091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd63ed2-5d37-4319-a655-e7de64a08a7c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:55.967495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28be618-5e4a-458d-af1f-e45d4afa7ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:55.968211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28be618-5e4a-458d-af1f-e45d4afa7ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:55.968500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28be618-5e4a-458d-af1f-e45d4afa7ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:55.968777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28be618-5e4a-458d-af1f-e45d4afa7ae3 admin admin] PATH_INFO: `/v3/projects/d4b5e2f97b974e1088ca6373c1967443/users/9c4b689dbd50466db582837f251af33f/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:55.975105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:56.005159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28be618-5e4a-458d-af1f-e45d4afa7ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b5e2f97b974e1088ca6373c1967443, user_id=9c4b689dbd50466db582837f251af33f, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:56.008628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28be618-5e4a-458d-af1f-e45d4afa7ae3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:56.043561 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2896/5791] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:43:55 2022] PUT /identity/v3/projects/d4b5e2f97b974e1088ca6373c1967443/users/9c4b689dbd50466db582837f251af33f/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:43:56.046225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b8b2f-0c6d-47d6-ac55-5fe5cd85b084 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:56.046735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b8b2f-0c6d-47d6-ac55-5fe5cd85b084 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:56.047626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b8b2f-0c6d-47d6-ac55-5fe5cd85b084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:56.112941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-940b8b2f-0c6d-47d6-ac55-5fe5cd85b084 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:56.114194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-940b8b2f-0c6d-47d6-ac55-5fe5cd85b084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:56.201872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:56.259989 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2896/5792] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:56.292581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28be618-5e4a-458d-af1f-e45d4afa7ae3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:56.295659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a28be618-5e4a-458d-af1f-e45d4afa7ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:56.459672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28be618-5e4a-458d-af1f-e45d4afa7ae3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:56.470197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9010b2-9f59-4345-88f0-968cf62ee2d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:56.470934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9010b2-9f59-4345-88f0-968cf62ee2d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:56.471726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9010b2-9f59-4345-88f0-968cf62ee2d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:56.473109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9010b2-9f59-4345-88f0-968cf62ee2d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:56.500935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9010b2-9f59-4345-88f0-968cf62ee2d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:56.505715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9010b2-9f59-4345-88f0-968cf62ee2d7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:56.529361 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2897/5793] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:59.332348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b879e0-b9bb-4c02-a2db-59dead471938 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:59.332939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b879e0-b9bb-4c02-a2db-59dead471938 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:59.333059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b879e0-b9bb-4c02-a2db-59dead471938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:59.373128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d9b879e0-b9bb-4c02-a2db-59dead471938 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:59.374554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d9b879e0-b9bb-4c02-a2db-59dead471938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:59.449381 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2897/5794] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:43:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:59.465131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9010b2-9f59-4345-88f0-968cf62ee2d7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:59.466553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac9010b2-9f59-4345-88f0-968cf62ee2d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:59.561232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9010b2-9f59-4345-88f0-968cf62ee2d7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:59.576011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a104bb5-25cc-4d64-b5a5-be97ed80d9f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:59.576678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a104bb5-25cc-4d64-b5a5-be97ed80d9f5 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:59.576964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a104bb5-25cc-4d64-b5a5-be97ed80d9f5 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:59.577392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a104bb5-25cc-4d64-b5a5-be97ed80d9f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:59.598799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a104bb5-25cc-4d64-b5a5-be97ed80d9f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:59.602951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a104bb5-25cc-4d64-b5a5-be97ed80d9f5 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:59.621658 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2898/5795] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:43:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:44:01.206950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b879e0-b9bb-4c02-a2db-59dead471938 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:01.214089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d9b879e0-b9bb-4c02-a2db-59dead471938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:01.257325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b879e0-b9bb-4c02-a2db-59dead471938 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:01.267420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c7eb0-f26c-4a5e-b84f-25ea7870e53a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:01.268609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c7eb0-f26c-4a5e-b84f-25ea7870e53a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:01.269277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c7eb0-f26c-4a5e-b84f-25ea7870e53a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:01.269904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c7eb0-f26c-4a5e-b84f-25ea7870e53a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:01.273967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b34c7eb0-f26c-4a5e-b84f-25ea7870e53a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:01.494618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c7eb0-f26c-4a5e-b84f-25ea7870e53a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:01.496403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c7eb0-f26c-4a5e-b84f-25ea7870e53a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:01.518114 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2898/5796] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:02.343504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a104bb5-25cc-4d64-b5a5-be97ed80d9f5 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:02.357841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a104bb5-25cc-4d64-b5a5-be97ed80d9f5 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:02.366010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa285115-923c-402b-afae-f18727453d5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:02.366654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa285115-923c-402b-afae-f18727453d5e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:02.366931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa285115-923c-402b-afae-f18727453d5e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:02.370323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa285115-923c-402b-afae-f18727453d5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:02.377305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa285115-923c-402b-afae-f18727453d5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:02.416274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa285115-923c-402b-afae-f18727453d5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:02.423447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa285115-923c-402b-afae-f18727453d5e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:02.453970 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2899/5797] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:05.860260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c7eb0-f26c-4a5e-b84f-25ea7870e53a service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:05.861750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b34c7eb0-f26c-4a5e-b84f-25ea7870e53a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:05.889527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c7eb0-f26c-4a5e-b84f-25ea7870e53a service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:05.894694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255f77c-9cee-4986-bd30-3288d4cc2498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:05.895700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255f77c-9cee-4986-bd30-3288d4cc2498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:05.896095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255f77c-9cee-4986-bd30-3288d4cc2498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:05.896436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255f77c-9cee-4986-bd30-3288d4cc2498 admin admin] PATH_INFO: `/v3/users/17d15356bf2941b2927f238f00ec836f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:05.897957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255f77c-9cee-4986-bd30-3288d4cc2498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d15356bf2941b2927f238f00ec836f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:05.900761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255f77c-9cee-4986-bd30-3288d4cc2498 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:05.984452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c255f77c-9cee-4986-bd30-3288d4cc2498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d15356bf2941b2927f238f00ec836f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:05.996718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:06.006790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c255f77c-9cee-4986-bd30-3288d4cc2498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d15356bf2941b2927f238f00ec836f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:06.007881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c255f77c-9cee-4986-bd30-3288d4cc2498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d15356bf2941b2927f238f00ec836f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:06.010381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c255f77c-9cee-4986-bd30-3288d4cc2498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d15356bf2941b2927f238f00ec836f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:06.031197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c255f77c-9cee-4986-bd30-3288d4cc2498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d15356bf2941b2927f238f00ec836f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:06.052080 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2899/5798] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:44:05 2022] DELETE /identity/v3/users/17d15356bf2941b2927f238f00ec836f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:44:06.480889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc896a-e241-403c-9715-891a6c8a0e23 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:06.481874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc896a-e241-403c-9715-891a6c8a0e23 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:06.482239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc896a-e241-403c-9715-891a6c8a0e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:06.505418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-00bc896a-e241-403c-9715-891a6c8a0e23 None None] MFA Rules not processed for user `a4a0713f4bfc4b1fb99f4afe849b042d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:06.507930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00bc896a-e241-403c-9715-891a6c8a0e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:06.622693 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2900/5799] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:07.082341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255f77c-9cee-4986-bd30-3288d4cc2498 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:07.084426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c255f77c-9cee-4986-bd30-3288d4cc2498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:07.320519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255f77c-9cee-4986-bd30-3288d4cc2498 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:07.332400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca74b7-4da2-48c2-88d3-430643d77e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:07.333069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca74b7-4da2-48c2-88d3-430643d77e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:07.333355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca74b7-4da2-48c2-88d3-430643d77e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:07.333637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca74b7-4da2-48c2-88d3-430643d77e4a admin admin] PATH_INFO: `/v3/projects/a258fc7f8cc849f7acd173ca4e49abaa` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:07.334935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca74b7-4da2-48c2-88d3-430643d77e4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a258fc7f8cc849f7acd173ca4e49abaa)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:07.347139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca74b7-4da2-48c2-88d3-430643d77e4a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:07.451202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b2ca74b7-4da2-48c2-88d3-430643d77e4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a258fc7f8cc849f7acd173ca4e49abaa', 'request_id': 'req-b2ca74b7-4da2-48c2-88d3-430643d77e4a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:07.471885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b2ca74b7-4da2-48c2-88d3-430643d77e4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a258fc7f8cc849f7acd173ca4e49abaa', 'request_id': 'req-b2ca74b7-4da2-48c2-88d3-430643d77e4a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:07.480115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b2ca74b7-4da2-48c2-88d3-430643d77e4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a258fc7f8cc849f7acd173ca4e49abaa', 'request_id': 'req-b2ca74b7-4da2-48c2-88d3-430643d77e4a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:07.504300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b2ca74b7-4da2-48c2-88d3-430643d77e4a admin admin] The token cache is being invalidate because project a258fc7f8cc849f7acd173ca4e49abaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:44:07.504823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b2ca74b7-4da2-48c2-88d3-430643d77e4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:07.505853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b2ca74b7-4da2-48c2-88d3-430643d77e4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:07.508214 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2900/5800] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:44:07 2022] DELETE /identity/v3/projects/a258fc7f8cc849f7acd173ca4e49abaa => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:44:07.513630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25e807-73a4-4aba-bf1a-48f74763424b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:07.514491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25e807-73a4-4aba-bf1a-48f74763424b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:07.514929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25e807-73a4-4aba-bf1a-48f74763424b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:07.547623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:07.564540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5f25e807-73a4-4aba-bf1a-48f74763424b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:07.568668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5f25e807-73a4-4aba-bf1a-48f74763424b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:07.729798 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2901/5801] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:07.737902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fd8dd-d153-4479-bb91-19ade2dbfb4a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:07.738137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fd8dd-d153-4479-bb91-19ade2dbfb4a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:07.738415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fd8dd-d153-4479-bb91-19ade2dbfb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:07.783418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d03fd8dd-d153-4479-bb91-19ade2dbfb4a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:07.787354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d03fd8dd-d153-4479-bb91-19ade2dbfb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:07.808320 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2901/5802] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:07.812743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25e807-73a4-4aba-bf1a-48f74763424b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:07.827228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25e807-73a4-4aba-bf1a-48f74763424b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:07.839916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6988ac7-9909-463b-a123-97b9cec1a9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:07.840838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6988ac7-9909-463b-a123-97b9cec1a9ea admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:07.843178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6988ac7-9909-463b-a123-97b9cec1a9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:07.844043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6988ac7-9909-463b-a123-97b9cec1a9ea admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:07.844946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6988ac7-9909-463b-a123-97b9cec1a9ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:44:07.846845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6988ac7-9909-463b-a123-97b9cec1a9ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:07.848971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6988ac7-9909-463b-a123-97b9cec1a9ea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:07.902137 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2902/5803] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:44:07.903513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03fd8dd-d153-4479-bb91-19ade2dbfb4a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:07.926091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03fd8dd-d153-4479-bb91-19ade2dbfb4a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:07.952914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d99ead-b94e-45ba-85e0-53578ec999ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:07.953933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d99ead-b94e-45ba-85e0-53578ec999ec admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:07.954764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d99ead-b94e-45ba-85e0-53578ec999ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:07.955357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d99ead-b94e-45ba-85e0-53578ec999ec admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:07.956242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d99ead-b94e-45ba-85e0-53578ec999ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:07.958422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d99ead-b94e-45ba-85e0-53578ec999ec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:08.019992 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2902/5804] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:44:07 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:44:08.024195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6988ac7-9909-463b-a123-97b9cec1a9ea admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:08.051231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6988ac7-9909-463b-a123-97b9cec1a9ea admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:08.219741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b7d50-5723-4479-bd13-372ded1388f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:08.223637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b7d50-5723-4479-bd13-372ded1388f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:08.224257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b7d50-5723-4479-bd13-372ded1388f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:08.225266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b7d50-5723-4479-bd13-372ded1388f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:08.228879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b7d50-5723-4479-bd13-372ded1388f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:08.236994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b7d50-5723-4479-bd13-372ded1388f9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:08.307237 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2903/5805] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:44:08 2022] POST /identity/v3/users => generated 287 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:44:08.311275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d99ead-b94e-45ba-85e0-53578ec999ec admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:08.323369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d99ead-b94e-45ba-85e0-53578ec999ec admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:08.345034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048d961-4c97-42fb-960a-49d222f2581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:08.345932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048d961-4c97-42fb-960a-49d222f2581a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:08.346397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048d961-4c97-42fb-960a-49d222f2581a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:08.351444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048d961-4c97-42fb-960a-49d222f2581a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:08.353978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048d961-4c97-42fb-960a-49d222f2581a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:08.358213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048d961-4c97-42fb-960a-49d222f2581a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:08.384267 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2903/5806] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:44:08.388850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b7d50-5723-4479-bd13-372ded1388f9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:08.407132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b7d50-5723-4479-bd13-372ded1388f9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:08.429397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35f64b-1ef4-473f-9e91-bcab4a1ec99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:08.430964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35f64b-1ef4-473f-9e91-bcab4a1ec99e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:08.431432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35f64b-1ef4-473f-9e91-bcab4a1ec99e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:08.431553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35f64b-1ef4-473f-9e91-bcab4a1ec99e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:08.432181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35f64b-1ef4-473f-9e91-bcab4a1ec99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:08.433843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35f64b-1ef4-473f-9e91-bcab4a1ec99e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:08.460947 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2904/5807] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:44:08.466106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048d961-4c97-42fb-960a-49d222f2581a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:08.478911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048d961-4c97-42fb-960a-49d222f2581a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:08.499508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe4e43-82f9-4514-addd-58e9cac16422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:08.500599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe4e43-82f9-4514-addd-58e9cac16422 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:08.501085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe4e43-82f9-4514-addd-58e9cac16422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:08.502047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe4e43-82f9-4514-addd-58e9cac16422 admin admin] PATH_INFO: `/v3/projects/03e0e963daeb4078b6e07050e0986804/users/84b840223840480293666cd1ecf96476/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:08.547761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe4e43-82f9-4514-addd-58e9cac16422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e0e963daeb4078b6e07050e0986804, user_id=84b840223840480293666cd1ecf96476, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:08.551869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe4e43-82f9-4514-addd-58e9cac16422 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:08.582098 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2904/5808] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:44:08 2022] PUT /identity/v3/projects/03e0e963daeb4078b6e07050e0986804/users/84b840223840480293666cd1ecf96476/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:44:08.593584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce03fc-feee-4151-80df-672ae70d1c2d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:08.594323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce03fc-feee-4151-80df-672ae70d1c2d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:08.594987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce03fc-feee-4151-80df-672ae70d1c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:08.714563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-75ce03fc-feee-4151-80df-672ae70d1c2d None None] MFA Rules not processed for user `84b840223840480293666cd1ecf96476`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:08.716112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-75ce03fc-feee-4151-80df-672ae70d1c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:08.867292 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2905/5809] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:44:08.877251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe4e43-82f9-4514-addd-58e9cac16422 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:08.879869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f9fe4e43-82f9-4514-addd-58e9cac16422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:08.885587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:09.090009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe4e43-82f9-4514-addd-58e9cac16422 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:09.109311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c262af6-6285-49ab-bcff-9d449f58e51d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:09.109946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c262af6-6285-49ab-bcff-9d449f58e51d service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:09.110222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c262af6-6285-49ab-bcff-9d449f58e51d service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:09.110491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c262af6-6285-49ab-bcff-9d449f58e51d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:09.129798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c262af6-6285-49ab-bcff-9d449f58e51d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:09.136431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c262af6-6285-49ab-bcff-9d449f58e51d service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:09.174131 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2905/5810] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:12.311345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481522c-4641-4538-baa9-e65cb03209e0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:12.312898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481522c-4641-4538-baa9-e65cb03209e0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:12.313488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481522c-4641-4538-baa9-e65cb03209e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:12.326045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:12.345162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2481522c-4641-4538-baa9-e65cb03209e0 None None] MFA Rules not processed for user `84b840223840480293666cd1ecf96476`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:12.347167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2481522c-4641-4538-baa9-e65cb03209e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:12.357102 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2906/5811] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:12.611679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79677-caf8-42a5-9500-bde67a326258 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:12.612230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79677-caf8-42a5-9500-bde67a326258 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:12.612230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79677-caf8-42a5-9500-bde67a326258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:12.648361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481522c-4641-4538-baa9-e65cb03209e0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:12.651066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2481522c-4641-4538-baa9-e65cb03209e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:12.680546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4ea79677-caf8-42a5-9500-bde67a326258 None None] MFA Rules not processed for user `9c4b689dbd50466db582837f251af33f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:12.683398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4ea79677-caf8-42a5-9500-bde67a326258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:12.780943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481522c-4641-4538-baa9-e65cb03209e0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:12.790990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0fb47-4056-4c31-8630-c5178c1b67ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:12.792085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0fb47-4056-4c31-8630-c5178c1b67ae service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:12.792625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0fb47-4056-4c31-8630-c5178c1b67ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:12.793298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0fb47-4056-4c31-8630-c5178c1b67ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:12.795986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-72a0fb47-4056-4c31-8630-c5178c1b67ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:12.822189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0fb47-4056-4c31-8630-c5178c1b67ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:12.823846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0fb47-4056-4c31-8630-c5178c1b67ae service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:12.841534 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2907/5812] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:12.866531 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2906/5813] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:12.877860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0fb47-4056-4c31-8630-c5178c1b67ae service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:12.879321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-72a0fb47-4056-4c31-8630-c5178c1b67ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:12.974080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0fb47-4056-4c31-8630-c5178c1b67ae service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:12.982398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c49d61-8435-4924-82e4-508cefadbb07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:12.983517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c49d61-8435-4924-82e4-508cefadbb07 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:12.984018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c49d61-8435-4924-82e4-508cefadbb07 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:12.984621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c49d61-8435-4924-82e4-508cefadbb07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:12.995320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c49d61-8435-4924-82e4-508cefadbb07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:12.997694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c49d61-8435-4924-82e4-508cefadbb07 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:13.024627 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2908/5814] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:44:13.436231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea79677-caf8-42a5-9500-bde67a326258 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:13.438243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4ea79677-caf8-42a5-9500-bde67a326258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:13.604895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea79677-caf8-42a5-9500-bde67a326258 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:13.625073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ab403-730e-4240-a666-6079c3c6b8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:13.625753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ab403-730e-4240-a666-6079c3c6b8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:13.625994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ab403-730e-4240-a666-6079c3c6b8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:13.626458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ab403-730e-4240-a666-6079c3c6b8f1 admin admin] PATH_INFO: `/v3/users/cddcb537be124c17a52951eed7a61305` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:13.638249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ab403-730e-4240-a666-6079c3c6b8f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cddcb537be124c17a52951eed7a61305)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:13.664835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ab403-730e-4240-a666-6079c3c6b8f1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:13.751372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:13.801504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d97ab403-730e-4240-a666-6079c3c6b8f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cddcb537be124c17a52951eed7a61305'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:13.828816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d97ab403-730e-4240-a666-6079c3c6b8f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cddcb537be124c17a52951eed7a61305'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:13.829929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d97ab403-730e-4240-a666-6079c3c6b8f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cddcb537be124c17a52951eed7a61305'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:13.831753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d97ab403-730e-4240-a666-6079c3c6b8f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cddcb537be124c17a52951eed7a61305'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:13.843120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d97ab403-730e-4240-a666-6079c3c6b8f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cddcb537be124c17a52951eed7a61305'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:13.876144 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2907/5815] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:44:13 2022] DELETE /identity/v3/users/cddcb537be124c17a52951eed7a61305 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:44:14.518147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c49d61-8435-4924-82e4-508cefadbb07 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:14.590014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c49d61-8435-4924-82e4-508cefadbb07 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:14.823693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a226f4e-af1f-4a6a-857c-23b15756ad2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:14.824354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a226f4e-af1f-4a6a-857c-23b15756ad2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:14.824636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a226f4e-af1f-4a6a-857c-23b15756ad2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:14.825132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a226f4e-af1f-4a6a-857c-23b15756ad2e admin admin] PATH_INFO: `/v3/projects/a10aa37d09f64c5d9e3fa6be401ff8fe` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:14.832943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a226f4e-af1f-4a6a-857c-23b15756ad2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a10aa37d09f64c5d9e3fa6be401ff8fe)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:14.835312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a226f4e-af1f-4a6a-857c-23b15756ad2e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:14.891124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:14.916744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a226f4e-af1f-4a6a-857c-23b15756ad2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a10aa37d09f64c5d9e3fa6be401ff8fe', 'request_id': 'req-4a226f4e-af1f-4a6a-857c-23b15756ad2e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:14.927695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a226f4e-af1f-4a6a-857c-23b15756ad2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a10aa37d09f64c5d9e3fa6be401ff8fe', 'request_id': 'req-4a226f4e-af1f-4a6a-857c-23b15756ad2e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:14.941796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a226f4e-af1f-4a6a-857c-23b15756ad2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a10aa37d09f64c5d9e3fa6be401ff8fe', 'request_id': 'req-4a226f4e-af1f-4a6a-857c-23b15756ad2e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:14.987762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a226f4e-af1f-4a6a-857c-23b15756ad2e admin admin] The token cache is being invalidate because project a10aa37d09f64c5d9e3fa6be401ff8fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:44:14.988227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a226f4e-af1f-4a6a-857c-23b15756ad2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:14.988980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a226f4e-af1f-4a6a-857c-23b15756ad2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:14.990960 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2909/5816] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:44:14 2022] DELETE /identity/v3/projects/a10aa37d09f64c5d9e3fa6be401ff8fe => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:44:14.994879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ab403-730e-4240-a666-6079c3c6b8f1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:14.996750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d97ab403-730e-4240-a666-6079c3c6b8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:15.033000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ab403-730e-4240-a666-6079c3c6b8f1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:15.179020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e9da5-4612-4744-9292-7bdd6b0fe6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:15.180619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e9da5-4612-4744-9292-7bdd6b0fe6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:15.181259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e9da5-4612-4744-9292-7bdd6b0fe6db admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:15.182113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e9da5-4612-4744-9292-7bdd6b0fe6db admin admin] PATH_INFO: `/v3/users/3071859e8d09432cb329669826287496` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:15.186429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e9da5-4612-4744-9292-7bdd6b0fe6db admin admin] RBAC: Authorizing `identity:delete_user(user_id=3071859e8d09432cb329669826287496)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:15.189468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e9da5-4612-4744-9292-7bdd6b0fe6db admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:15.286220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-928e9da5-4612-4744-9292-7bdd6b0fe6db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3071859e8d09432cb329669826287496'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:15.338067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-928e9da5-4612-4744-9292-7bdd6b0fe6db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3071859e8d09432cb329669826287496'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:15.339745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-928e9da5-4612-4744-9292-7bdd6b0fe6db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3071859e8d09432cb329669826287496'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:15.343454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-928e9da5-4612-4744-9292-7bdd6b0fe6db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3071859e8d09432cb329669826287496'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:15.362577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-928e9da5-4612-4744-9292-7bdd6b0fe6db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3071859e8d09432cb329669826287496'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:15.396518 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2908/5817] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:44:14 2022] DELETE /identity/v3/users/3071859e8d09432cb329669826287496 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:44:16.074787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a226f4e-af1f-4a6a-857c-23b15756ad2e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:16.076362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a226f4e-af1f-4a6a-857c-23b15756ad2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:16.108959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a226f4e-af1f-4a6a-857c-23b15756ad2e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:16.268983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa37e5-3da6-4fd3-b32c-7363bde5aa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:16.270134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa37e5-3da6-4fd3-b32c-7363bde5aa59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:16.270634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa37e5-3da6-4fd3-b32c-7363bde5aa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:16.271240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa37e5-3da6-4fd3-b32c-7363bde5aa59 admin admin] PATH_INFO: `/v3/projects/d2564041053244a08e83372d8d791113` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:16.276391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa37e5-3da6-4fd3-b32c-7363bde5aa59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2564041053244a08e83372d8d791113)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:16.278991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa37e5-3da6-4fd3-b32c-7363bde5aa59 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:16.369728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83fa37e5-3da6-4fd3-b32c-7363bde5aa59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2564041053244a08e83372d8d791113', 'request_id': 'req-83fa37e5-3da6-4fd3-b32c-7363bde5aa59'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:16.383627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83fa37e5-3da6-4fd3-b32c-7363bde5aa59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2564041053244a08e83372d8d791113', 'request_id': 'req-83fa37e5-3da6-4fd3-b32c-7363bde5aa59'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:16.393925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83fa37e5-3da6-4fd3-b32c-7363bde5aa59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2564041053244a08e83372d8d791113', 'request_id': 'req-83fa37e5-3da6-4fd3-b32c-7363bde5aa59'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:16.411845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83fa37e5-3da6-4fd3-b32c-7363bde5aa59 admin admin] The token cache is being invalidate because project d2564041053244a08e83372d8d791113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:44:16.412146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83fa37e5-3da6-4fd3-b32c-7363bde5aa59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:16.413048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83fa37e5-3da6-4fd3-b32c-7363bde5aa59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:16.429582 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2910/5818] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:44:16 2022] DELETE /identity/v3/projects/d2564041053244a08e83372d8d791113 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:44:16.434424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2800907-7342-4ca3-9eb7-96c81944ad68 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:16.434969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2800907-7342-4ca3-9eb7-96c81944ad68 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:16.434969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2800907-7342-4ca3-9eb7-96c81944ad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:16.472798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f2800907-7342-4ca3-9eb7-96c81944ad68 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:16.474213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f2800907-7342-4ca3-9eb7-96c81944ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:16.504520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:16.586113 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2909/5819] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:16.596938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c00cf9-6e3a-4503-b665-6a752d94d2ae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:16.597240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c00cf9-6e3a-4503-b665-6a752d94d2ae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:16.597651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c00cf9-6e3a-4503-b665-6a752d94d2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:16.693299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-52c00cf9-6e3a-4503-b665-6a752d94d2ae None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:16.695866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52c00cf9-6e3a-4503-b665-6a752d94d2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:16.731438 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2911/5820] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:16.733693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2800907-7342-4ca3-9eb7-96c81944ad68 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:16.746922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2800907-7342-4ca3-9eb7-96c81944ad68 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:16.754725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66328248-5a56-4c09-b5a9-78e6e4200dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:16.755868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66328248-5a56-4c09-b5a9-78e6e4200dac admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:16.756355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66328248-5a56-4c09-b5a9-78e6e4200dac admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:16.757771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66328248-5a56-4c09-b5a9-78e6e4200dac admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:16.759073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66328248-5a56-4c09-b5a9-78e6e4200dac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:44:16.759604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66328248-5a56-4c09-b5a9-78e6e4200dac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:16.762338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66328248-5a56-4c09-b5a9-78e6e4200dac admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:16.786258 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2910/5821] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:44:16.790023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c00cf9-6e3a-4503-b665-6a752d94d2ae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:16.806119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c00cf9-6e3a-4503-b665-6a752d94d2ae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:16.815674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914a665-3bfc-4fa5-aed0-148a2e3463f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:16.816320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914a665-3bfc-4fa5-aed0-148a2e3463f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:16.816597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914a665-3bfc-4fa5-aed0-148a2e3463f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:16.816876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914a665-3bfc-4fa5-aed0-148a2e3463f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:16.817532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914a665-3bfc-4fa5-aed0-148a2e3463f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:16.819581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914a665-3bfc-4fa5-aed0-148a2e3463f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:16.896901 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2912/5822] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:44:16 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:44:16.898584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66328248-5a56-4c09-b5a9-78e6e4200dac admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:16.913637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66328248-5a56-4c09-b5a9-78e6e4200dac admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:17.068162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081469fd-ba44-493c-b0b4-521d62839015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:17.068801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081469fd-ba44-493c-b0b4-521d62839015 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:17.069080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081469fd-ba44-493c-b0b4-521d62839015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:17.069402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081469fd-ba44-493c-b0b4-521d62839015 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:17.070053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081469fd-ba44-493c-b0b4-521d62839015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:17.072238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081469fd-ba44-493c-b0b4-521d62839015 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:17.122259 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2911/5823] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:44:16 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:44:17.125803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914a665-3bfc-4fa5-aed0-148a2e3463f6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:17.144533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914a665-3bfc-4fa5-aed0-148a2e3463f6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:17.152725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500e02a-1218-4009-9a7e-3e5287bff61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:17.153275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500e02a-1218-4009-9a7e-3e5287bff61b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:17.153560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500e02a-1218-4009-9a7e-3e5287bff61b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:17.153837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500e02a-1218-4009-9a7e-3e5287bff61b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:17.154526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500e02a-1218-4009-9a7e-3e5287bff61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:17.158357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500e02a-1218-4009-9a7e-3e5287bff61b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:17.187151 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2913/5824] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:44:17.191400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081469fd-ba44-493c-b0b4-521d62839015 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:17.208379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081469fd-ba44-493c-b0b4-521d62839015 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:17.224200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fa0e2-3e4a-425d-b7e9-884ae144cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:17.224859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fa0e2-3e4a-425d-b7e9-884ae144cad6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:17.225129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fa0e2-3e4a-425d-b7e9-884ae144cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:17.225405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fa0e2-3e4a-425d-b7e9-884ae144cad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:17.227377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fa0e2-3e4a-425d-b7e9-884ae144cad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:17.229094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fa0e2-3e4a-425d-b7e9-884ae144cad6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:17.257817 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2912/5825] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:44:17.263374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500e02a-1218-4009-9a7e-3e5287bff61b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:17.271298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:17.276143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500e02a-1218-4009-9a7e-3e5287bff61b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:17.301554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f79a8-93de-40e2-b86d-0453c00d28e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:17.302362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f79a8-93de-40e2-b86d-0453c00d28e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:17.307778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f79a8-93de-40e2-b86d-0453c00d28e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:17.308632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f79a8-93de-40e2-b86d-0453c00d28e3 admin admin] PATH_INFO: `/v3/projects/732eabd0fc584b0daae2d0ea24d998cb/users/f5f9d99ae530430c8c6461f8c88b0983/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:17.366212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f79a8-93de-40e2-b86d-0453c00d28e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=732eabd0fc584b0daae2d0ea24d998cb, user_id=f5f9d99ae530430c8c6461f8c88b0983, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:17.369017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f79a8-93de-40e2-b86d-0453c00d28e3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:17.412075 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2914/5826] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:44:17 2022] PUT /identity/v3/projects/732eabd0fc584b0daae2d0ea24d998cb/users/f5f9d99ae530430c8c6461f8c88b0983/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:44:17.417281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7a6c6-6474-4e7e-8561-ce87d1f232a7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:17.417571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7a6c6-6474-4e7e-8561-ce87d1f232a7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:17.417851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7a6c6-6474-4e7e-8561-ce87d1f232a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:17.451986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8ea7a6c6-6474-4e7e-8561-ce87d1f232a7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:17.453232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8ea7a6c6-6474-4e7e-8561-ce87d1f232a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:17.660262 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2913/5827] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:17.723634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f79a8-93de-40e2-b86d-0453c00d28e3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:17.727040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a1f79a8-93de-40e2-b86d-0453c00d28e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:17.986477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f79a8-93de-40e2-b86d-0453c00d28e3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:17.998644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9deff-d53b-4607-8ea6-60b74f921193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:17.999647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9deff-d53b-4607-8ea6-60b74f921193 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:18.001455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9deff-d53b-4607-8ea6-60b74f921193 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:18.002900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9deff-d53b-4607-8ea6-60b74f921193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:18.038434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9deff-d53b-4607-8ea6-60b74f921193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:18.039958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9deff-d53b-4607-8ea6-60b74f921193 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:18.071724 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2915/5828] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:20.613357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78049-9fbd-42e8-8459-fbff59f800fa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:20.614010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78049-9fbd-42e8-8459-fbff59f800fa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:20.614261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78049-9fbd-42e8-8459-fbff59f800fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:20.677614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fbf78049-9fbd-42e8-8459-fbff59f800fa None None] MFA Rules not processed for user `f5f9d99ae530430c8c6461f8c88b0983`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:20.680007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fbf78049-9fbd-42e8-8459-fbff59f800fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:20.722995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:20.856551 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2914/5829] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:20.868245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85d014-09aa-44ac-9cc1-86f9483229f3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:20.870169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85d014-09aa-44ac-9cc1-86f9483229f3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:20.870994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85d014-09aa-44ac-9cc1-86f9483229f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:20.923998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5e85d014-09aa-44ac-9cc1-86f9483229f3 None None] MFA Rules not processed for user `f5f9d99ae530430c8c6461f8c88b0983`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:20.926035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e85d014-09aa-44ac-9cc1-86f9483229f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:20.945732 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2916/5830] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:20.956705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c53d00-cb89-45bf-b4f4-b090b95383d4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:20.957360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c53d00-cb89-45bf-b4f4-b090b95383d4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:20.957921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c53d00-cb89-45bf-b4f4-b090b95383d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:20.995819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-22c53d00-cb89-45bf-b4f4-b090b95383d4 None None] MFA Rules not processed for user `f5f9d99ae530430c8c6461f8c88b0983`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:20.997903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-22c53d00-cb89-45bf-b4f4-b090b95383d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:21.016069 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2915/5831] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:21.027543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85d014-09aa-44ac-9cc1-86f9483229f3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:21.029124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e85d014-09aa-44ac-9cc1-86f9483229f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:21.175138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85d014-09aa-44ac-9cc1-86f9483229f3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:21.182030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273f35d-8e46-4ca1-926c-2e8095f0a04e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:21.182991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273f35d-8e46-4ca1-926c-2e8095f0a04e service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:21.183624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273f35d-8e46-4ca1-926c-2e8095f0a04e service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:21.184193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273f35d-8e46-4ca1-926c-2e8095f0a04e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:21.194312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273f35d-8e46-4ca1-926c-2e8095f0a04e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:21.196435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273f35d-8e46-4ca1-926c-2e8095f0a04e service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:21.219613 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2917/5832] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:23.308186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05faef-c9fc-4ed3-ab8d-e88595db23af None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:23.308869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05faef-c9fc-4ed3-ab8d-e88595db23af None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:23.309135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05faef-c9fc-4ed3-ab8d-e88595db23af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:23.371125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4f05faef-c9fc-4ed3-ab8d-e88595db23af None None] MFA Rules not processed for user `f5f9d99ae530430c8c6461f8c88b0983`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:23.380267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4f05faef-c9fc-4ed3-ab8d-e88595db23af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:23.396527 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2916/5833] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:24.036539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273f35d-8e46-4ca1-926c-2e8095f0a04e service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:24.038099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a273f35d-8e46-4ca1-926c-2e8095f0a04e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:24.066127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273f35d-8e46-4ca1-926c-2e8095f0a04e service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:24.086809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647a23a-1635-4912-960a-4ddc69aa2a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:24.088034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647a23a-1635-4912-960a-4ddc69aa2a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:24.088141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647a23a-1635-4912-960a-4ddc69aa2a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:24.088424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647a23a-1635-4912-960a-4ddc69aa2a11 admin admin] PATH_INFO: `/v3/users/9c4b689dbd50466db582837f251af33f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:24.089620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647a23a-1635-4912-960a-4ddc69aa2a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c4b689dbd50466db582837f251af33f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:24.091607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647a23a-1635-4912-960a-4ddc69aa2a11 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:24.236259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1647a23a-1635-4912-960a-4ddc69aa2a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c4b689dbd50466db582837f251af33f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:24.239628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1647a23a-1635-4912-960a-4ddc69aa2a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c4b689dbd50466db582837f251af33f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:24.263936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1647a23a-1635-4912-960a-4ddc69aa2a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c4b689dbd50466db582837f251af33f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:24.266062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:24.280257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1647a23a-1635-4912-960a-4ddc69aa2a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c4b689dbd50466db582837f251af33f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:24.309642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1647a23a-1635-4912-960a-4ddc69aa2a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c4b689dbd50466db582837f251af33f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:24.327952 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2918/5834] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:44:24 2022] DELETE /identity/v3/users/9c4b689dbd50466db582837f251af33f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:44:24.958569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcad09-b366-4a5f-9d31-8f258f68a6a4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:24.959181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcad09-b366-4a5f-9d31-8f258f68a6a4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:24.959471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcad09-b366-4a5f-9d31-8f258f68a6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:24.992824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c6fcad09-b366-4a5f-9d31-8f258f68a6a4 None None] MFA Rules not processed for user `f5f9d99ae530430c8c6461f8c88b0983`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:24.994596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c6fcad09-b366-4a5f-9d31-8f258f68a6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:25.043812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647a23a-1635-4912-960a-4ddc69aa2a11 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:25.046874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1647a23a-1635-4912-960a-4ddc69aa2a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:25.163245 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2917/5835] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:25.164739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcad09-b366-4a5f-9d31-8f258f68a6a4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:25.169760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c6fcad09-b366-4a5f-9d31-8f258f68a6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:25.220658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647a23a-1635-4912-960a-4ddc69aa2a11 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:25.238533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd655c8-0803-4802-a809-886de0b6ad40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:25.239405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd655c8-0803-4802-a809-886de0b6ad40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:25.239703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd655c8-0803-4802-a809-886de0b6ad40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:25.239990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd655c8-0803-4802-a809-886de0b6ad40 admin admin] PATH_INFO: `/v3/users/ca6ea006428a4057b179fa9e7919cfc2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:25.241759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd655c8-0803-4802-a809-886de0b6ad40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca6ea006428a4057b179fa9e7919cfc2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:25.244137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd655c8-0803-4802-a809-886de0b6ad40 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:25.318182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcad09-b366-4a5f-9d31-8f258f68a6a4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:25.330191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9198f06-a7de-40a2-902a-b4fa01cc6104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:25.331228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9198f06-a7de-40a2-902a-b4fa01cc6104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:25.331723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9198f06-a7de-40a2-902a-b4fa01cc6104 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:25.332174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9198f06-a7de-40a2-902a-b4fa01cc6104 admin admin] PATH_INFO: `/v3/projects/d4b5e2f97b974e1088ca6373c1967443` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:25.333582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9198f06-a7de-40a2-902a-b4fa01cc6104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b5e2f97b974e1088ca6373c1967443)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:25.336570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9198f06-a7de-40a2-902a-b4fa01cc6104 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:25.348554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fd655c8-0803-4802-a809-886de0b6ad40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca6ea006428a4057b179fa9e7919cfc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:25.349263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fd655c8-0803-4802-a809-886de0b6ad40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca6ea006428a4057b179fa9e7919cfc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:25.362325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fd655c8-0803-4802-a809-886de0b6ad40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca6ea006428a4057b179fa9e7919cfc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:25.381594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fd655c8-0803-4802-a809-886de0b6ad40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca6ea006428a4057b179fa9e7919cfc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:25.411752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fd655c8-0803-4802-a809-886de0b6ad40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca6ea006428a4057b179fa9e7919cfc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:25.435866 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2919/5836] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:44:25 2022] DELETE /identity/v3/users/ca6ea006428a4057b179fa9e7919cfc2 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:44:25.439517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509acc95-3f79-4f28-b444-e9e3ba45ad47 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:25.440679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509acc95-3f79-4f28-b444-e9e3ba45ad47 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:25.441134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509acc95-3f79-4f28-b444-e9e3ba45ad47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:25.446892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9198f06-a7de-40a2-902a-b4fa01cc6104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b5e2f97b974e1088ca6373c1967443', 'request_id': 'req-b9198f06-a7de-40a2-902a-b4fa01cc6104'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:25.464122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9198f06-a7de-40a2-902a-b4fa01cc6104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b5e2f97b974e1088ca6373c1967443', 'request_id': 'req-b9198f06-a7de-40a2-902a-b4fa01cc6104'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:25.467150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:25.480551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-509acc95-3f79-4f28-b444-e9e3ba45ad47 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:25.481827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-509acc95-3f79-4f28-b444-e9e3ba45ad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:25.484734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9198f06-a7de-40a2-902a-b4fa01cc6104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b5e2f97b974e1088ca6373c1967443', 'request_id': 'req-b9198f06-a7de-40a2-902a-b4fa01cc6104'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:25.508738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9198f06-a7de-40a2-902a-b4fa01cc6104 admin admin] The token cache is being invalidate because project d4b5e2f97b974e1088ca6373c1967443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:44:25.509537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9198f06-a7de-40a2-902a-b4fa01cc6104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:25.511561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9198f06-a7de-40a2-902a-b4fa01cc6104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:25.515217 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2918/5837] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:44:25 2022] DELETE /identity/v3/projects/d4b5e2f97b974e1088ca6373c1967443 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:44:25.521441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887e06b-6c94-4ea5-ad78-f335019141f9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:25.521953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887e06b-6c94-4ea5-ad78-f335019141f9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:25.523578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887e06b-6c94-4ea5-ad78-f335019141f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:25.570348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f887e06b-6c94-4ea5-ad78-f335019141f9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:25.573617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f887e06b-6c94-4ea5-ad78-f335019141f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:25.613598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:25.651841 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2920/5838] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:25.734521 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2919/5839] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:44:25.742061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b4ec8-5c4e-48c4-9d0b-b7b20e6fae55 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:25.742350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b4ec8-5c4e-48c4-9d0b-b7b20e6fae55 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:25.742635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b4ec8-5c4e-48c4-9d0b-b7b20e6fae55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:25.769427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ff3b4ec8-5c4e-48c4-9d0b-b7b20e6fae55 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:25.771212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ff3b4ec8-5c4e-48c4-9d0b-b7b20e6fae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:25.781193 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2921/5840] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:44:25.785464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887e06b-6c94-4ea5-ad78-f335019141f9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:25.807019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b4ec8-5c4e-48c4-9d0b-b7b20e6fae55 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:25.809551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887e06b-6c94-4ea5-ad78-f335019141f9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:25.812720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ff3b4ec8-5c4e-48c4-9d0b-b7b20e6fae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:25.826773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cc287-1951-4a86-ad23-3dfbaa4856d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:25.829290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cc287-1951-4a86-ad23-3dfbaa4856d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:25.829807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cc287-1951-4a86-ad23-3dfbaa4856d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:25.832259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cc287-1951-4a86-ad23-3dfbaa4856d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:25.833937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cc287-1951-4a86-ad23-3dfbaa4856d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:44:25.835196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cc287-1951-4a86-ad23-3dfbaa4856d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:25.839037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cc287-1951-4a86-ad23-3dfbaa4856d6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:25.867568 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2920/5841] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:44:25.874665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cc287-1951-4a86-ad23-3dfbaa4856d6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:25.902581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cc287-1951-4a86-ad23-3dfbaa4856d6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:25.914985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cbd90-71da-498b-878e-2e6106e69329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:25.915541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cbd90-71da-498b-878e-2e6106e69329 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:25.916352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cbd90-71da-498b-878e-2e6106e69329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:25.916352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cbd90-71da-498b-878e-2e6106e69329 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:25.916784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154cbd90-71da-498b-878e-2e6106e69329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:25.918839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154cbd90-71da-498b-878e-2e6106e69329 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:25.942480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b4ec8-5c4e-48c4-9d0b-b7b20e6fae55 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:25.948650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d9ed3-8753-4164-927c-5c1fa678d525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:25.949189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d9ed3-8753-4164-927c-5c1fa678d525 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:25.949668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d9ed3-8753-4164-927c-5c1fa678d525 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:25.949946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d9ed3-8753-4164-927c-5c1fa678d525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:25.965965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d9ed3-8753-4164-927c-5c1fa678d525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:25.967458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d9ed3-8753-4164-927c-5c1fa678d525 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:25.978418 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2921/5842] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:44:25 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:44:25.978983 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2922/5843] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:25.980678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cbd90-71da-498b-878e-2e6106e69329 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:26.065007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cbd90-71da-498b-878e-2e6106e69329 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:26.070990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5bd89-e77e-4cbb-9856-6c6b8871fcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:26.072098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5bd89-e77e-4cbb-9856-6c6b8871fcc7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:26.073348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5bd89-e77e-4cbb-9856-6c6b8871fcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:26.073821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5bd89-e77e-4cbb-9856-6c6b8871fcc7 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:26.074680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5bd89-e77e-4cbb-9856-6c6b8871fcc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:26.076894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5bd89-e77e-4cbb-9856-6c6b8871fcc7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:26.104845 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2922/5844] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:44:25 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:44:26.109717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d9ed3-8753-4164-927c-5c1fa678d525 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:26.124811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d9ed3-8753-4164-927c-5c1fa678d525 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:26.133315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331dd19-b308-427d-9677-44d293436554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:26.134568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331dd19-b308-427d-9677-44d293436554 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:26.135176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331dd19-b308-427d-9677-44d293436554 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:26.135688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331dd19-b308-427d-9677-44d293436554 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:26.136779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331dd19-b308-427d-9677-44d293436554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:26.138570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331dd19-b308-427d-9677-44d293436554 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:26.152919 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2923/5845] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:44:26.159566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5bd89-e77e-4cbb-9856-6c6b8871fcc7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:26.172861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5bd89-e77e-4cbb-9856-6c6b8871fcc7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:26.181335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec26b8-21d0-48d8-bf14-6f9b5dd63e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:26.182412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec26b8-21d0-48d8-bf14-6f9b5dd63e2f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:26.182824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec26b8-21d0-48d8-bf14-6f9b5dd63e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:26.183200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec26b8-21d0-48d8-bf14-6f9b5dd63e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:26.185095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec26b8-21d0-48d8-bf14-6f9b5dd63e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:26.186853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec26b8-21d0-48d8-bf14-6f9b5dd63e2f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:26.202327 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2923/5846] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:44:26.207042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331dd19-b308-427d-9677-44d293436554 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:26.223101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331dd19-b308-427d-9677-44d293436554 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:26.230869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957464a-1009-4108-80bb-0c505c0b4543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:26.231835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957464a-1009-4108-80bb-0c505c0b4543 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:26.232443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957464a-1009-4108-80bb-0c505c0b4543 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:26.234700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957464a-1009-4108-80bb-0c505c0b4543 admin admin] PATH_INFO: `/v3/projects/a985647b119f4a3ca8ce1cb956580066/users/e2056ca5c2954dda970a4c3751748203/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:26.257162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957464a-1009-4108-80bb-0c505c0b4543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a985647b119f4a3ca8ce1cb956580066, user_id=e2056ca5c2954dda970a4c3751748203, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:26.260143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957464a-1009-4108-80bb-0c505c0b4543 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:26.287823 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2924/5847] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:44:26 2022] PUT /identity/v3/projects/a985647b119f4a3ca8ce1cb956580066/users/e2056ca5c2954dda970a4c3751748203/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:44:26.292926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dc325-bfae-4b14-a92e-77ba4233d804 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:26.294157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dc325-bfae-4b14-a92e-77ba4233d804 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:26.294436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dc325-bfae-4b14-a92e-77ba4233d804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:26.320771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fa3dc325-bfae-4b14-a92e-77ba4233d804 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:26.322968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fa3dc325-bfae-4b14-a92e-77ba4233d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:26.368078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:26.429765 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2924/5848] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:26.445834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957464a-1009-4108-80bb-0c505c0b4543 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:26.541236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957464a-1009-4108-80bb-0c505c0b4543 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:26.564374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366773e-2450-463c-9372-86ff7487211d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:26.565020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366773e-2450-463c-9372-86ff7487211d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:26.565303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366773e-2450-463c-9372-86ff7487211d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:26.565571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366773e-2450-463c-9372-86ff7487211d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:26.592846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366773e-2450-463c-9372-86ff7487211d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:26.595428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366773e-2450-463c-9372-86ff7487211d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:26.609954 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2925/5849] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:26.912069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3dc325-bfae-4b14-a92e-77ba4233d804 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:26.914192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fa3dc325-bfae-4b14-a92e-77ba4233d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:26.933995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3dc325-bfae-4b14-a92e-77ba4233d804 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:26.945740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd1986-c16f-4867-8985-c0662baabe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:26.947079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd1986-c16f-4867-8985-c0662baabe7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:26.947626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd1986-c16f-4867-8985-c0662baabe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:26.948110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd1986-c16f-4867-8985-c0662baabe7f admin admin] PATH_INFO: `/v3/projects/913fdaabe6514b98ad677f88b9ef63b6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:26.949944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd1986-c16f-4867-8985-c0662baabe7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=913fdaabe6514b98ad677f88b9ef63b6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:26.952872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd1986-c16f-4867-8985-c0662baabe7f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:27.045200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-18dd1986-c16f-4867-8985-c0662baabe7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913fdaabe6514b98ad677f88b9ef63b6', 'request_id': 'req-18dd1986-c16f-4867-8985-c0662baabe7f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:27.055911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-18dd1986-c16f-4867-8985-c0662baabe7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913fdaabe6514b98ad677f88b9ef63b6', 'request_id': 'req-18dd1986-c16f-4867-8985-c0662baabe7f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:27.064860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-18dd1986-c16f-4867-8985-c0662baabe7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913fdaabe6514b98ad677f88b9ef63b6', 'request_id': 'req-18dd1986-c16f-4867-8985-c0662baabe7f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:27.087190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-18dd1986-c16f-4867-8985-c0662baabe7f admin admin] The token cache is being invalidate because project 913fdaabe6514b98ad677f88b9ef63b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:44:27.087615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-18dd1986-c16f-4867-8985-c0662baabe7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:27.088319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-18dd1986-c16f-4867-8985-c0662baabe7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:44:27.091287 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2925/5850] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:44:26 2022] DELETE /identity/v3/projects/913fdaabe6514b98ad677f88b9ef63b6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:44:27.096067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacad71-af74-4420-9fa6-b3f892124be0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:27.096549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacad71-af74-4420-9fa6-b3f892124be0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:27.097255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacad71-af74-4420-9fa6-b3f892124be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:27.162217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3aacad71-af74-4420-9fa6-b3f892124be0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:27.168786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3aacad71-af74-4420-9fa6-b3f892124be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:27.252927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:27.268670 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2926/5851] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:44:27.276778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7230d-dd98-45fb-a73b-33ef2bbcecd3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:27.277060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7230d-dd98-45fb-a73b-33ef2bbcecd3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:27.277344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7230d-dd98-45fb-a73b-33ef2bbcecd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:27.303080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b2c7230d-dd98-45fb-a73b-33ef2bbcecd3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:27.305306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b2c7230d-dd98-45fb-a73b-33ef2bbcecd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:27.315036 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2926/5852] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:27.320080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacad71-af74-4420-9fa6-b3f892124be0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:27.332991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacad71-af74-4420-9fa6-b3f892124be0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:27.338598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0f8c6-4667-466c-8b04-b7a1486b14be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:27.339530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0f8c6-4667-466c-8b04-b7a1486b14be admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:27.339825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0f8c6-4667-466c-8b04-b7a1486b14be admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:27.340098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0f8c6-4667-466c-8b04-b7a1486b14be admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:27.340927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0f8c6-4667-466c-8b04-b7a1486b14be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:44:27.341237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0f8c6-4667-466c-8b04-b7a1486b14be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:27.343076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0f8c6-4667-466c-8b04-b7a1486b14be admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:27.360662 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2927/5853] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:44:27.362956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7230d-dd98-45fb-a73b-33ef2bbcecd3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:27.380739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7230d-dd98-45fb-a73b-33ef2bbcecd3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:27.387290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17145a-ec46-4b54-97c4-f2e197cd6c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:27.387925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17145a-ec46-4b54-97c4-f2e197cd6c15 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:27.388274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17145a-ec46-4b54-97c4-f2e197cd6c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:27.388760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17145a-ec46-4b54-97c4-f2e197cd6c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:27.389491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17145a-ec46-4b54-97c4-f2e197cd6c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:27.392312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17145a-ec46-4b54-97c4-f2e197cd6c15 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:27.437336 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2927/5854] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:44:27 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:44:27.441965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0f8c6-4667-466c-8b04-b7a1486b14be admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:27.458138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0f8c6-4667-466c-8b04-b7a1486b14be admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:27.526326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f2a3d-8944-4aca-b8ef-d66d529d84e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:27.527133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f2a3d-8944-4aca-b8ef-d66d529d84e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:27.527452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f2a3d-8944-4aca-b8ef-d66d529d84e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:27.527731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f2a3d-8944-4aca-b8ef-d66d529d84e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:27.528379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f2a3d-8944-4aca-b8ef-d66d529d84e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:27.530402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f2a3d-8944-4aca-b8ef-d66d529d84e8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:27.567565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17145a-ec46-4b54-97c4-f2e197cd6c15 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:27.567743 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2928/5855] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:44:27 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:44:27.584601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17145a-ec46-4b54-97c4-f2e197cd6c15 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:27.592337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b003bc0-fd61-4d1b-9c87-f14bd94bf7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:27.592987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b003bc0-fd61-4d1b-9c87-f14bd94bf7cf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:27.593272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b003bc0-fd61-4d1b-9c87-f14bd94bf7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:27.593549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b003bc0-fd61-4d1b-9c87-f14bd94bf7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:27.594222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b003bc0-fd61-4d1b-9c87-f14bd94bf7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:27.597085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b003bc0-fd61-4d1b-9c87-f14bd94bf7cf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:27.610187 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2928/5856] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:44:27.614099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f2a3d-8944-4aca-b8ef-d66d529d84e8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:27.627942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f2a3d-8944-4aca-b8ef-d66d529d84e8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:27.636966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d18231-8d3a-4486-a3b8-7d82a3395324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:27.638414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d18231-8d3a-4486-a3b8-7d82a3395324 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:27.639195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d18231-8d3a-4486-a3b8-7d82a3395324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:27.640383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d18231-8d3a-4486-a3b8-7d82a3395324 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:27.641133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d18231-8d3a-4486-a3b8-7d82a3395324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:27.644601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d18231-8d3a-4486-a3b8-7d82a3395324 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:27.677157 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2929/5857] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:44:27.680592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b003bc0-fd61-4d1b-9c87-f14bd94bf7cf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:27.693926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b003bc0-fd61-4d1b-9c87-f14bd94bf7cf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:27.708158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc739cfe-12a9-41c9-976c-c42ee5eadf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:27.710132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc739cfe-12a9-41c9-976c-c42ee5eadf58 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:27.710546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc739cfe-12a9-41c9-976c-c42ee5eadf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:27.711968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc739cfe-12a9-41c9-976c-c42ee5eadf58 admin admin] PATH_INFO: `/v3/projects/5526842324b74474b7b3ef1b54251b3c/users/1ff3aa8ff75d4f73948ffdb37663fff6/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:27.777456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc739cfe-12a9-41c9-976c-c42ee5eadf58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5526842324b74474b7b3ef1b54251b3c, user_id=1ff3aa8ff75d4f73948ffdb37663fff6, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:27.784100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc739cfe-12a9-41c9-976c-c42ee5eadf58 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:27.812737 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2929/5858] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:44:27 2022] PUT /identity/v3/projects/5526842324b74474b7b3ef1b54251b3c/users/1ff3aa8ff75d4f73948ffdb37663fff6/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:44:27.823559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193f61-3cbc-49f3-966f-25a7c345773c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:27.824097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193f61-3cbc-49f3-966f-25a7c345773c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:27.824530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193f61-3cbc-49f3-966f-25a7c345773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:27.916436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e3193f61-3cbc-49f3-966f-25a7c345773c None None] MFA Rules not processed for user `1ff3aa8ff75d4f73948ffdb37663fff6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:27.917637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e3193f61-3cbc-49f3-966f-25a7c345773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:28.057400 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2930/5859] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:28.124588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc739cfe-12a9-41c9-976c-c42ee5eadf58 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:28.126319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fc739cfe-12a9-41c9-976c-c42ee5eadf58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:28.232929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:28.243290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc739cfe-12a9-41c9-976c-c42ee5eadf58 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:28.248322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632af38-64d2-42b3-ade8-4a6071fbcba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:28.249895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632af38-64d2-42b3-ade8-4a6071fbcba1 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:28.250439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632af38-64d2-42b3-ade8-4a6071fbcba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:28.251041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632af38-64d2-42b3-ade8-4a6071fbcba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:28.279741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632af38-64d2-42b3-ade8-4a6071fbcba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:28.281576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632af38-64d2-42b3-ade8-4a6071fbcba1 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:28.296429 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2930/5860] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:34.247849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3193f61-3cbc-49f3-966f-25a7c345773c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:34.249440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e3193f61-3cbc-49f3-966f-25a7c345773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:34.281363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3193f61-3cbc-49f3-966f-25a7c345773c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:34.285618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2236f6-1cfb-4f06-a067-debe8256424a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:34.287972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2236f6-1cfb-4f06-a067-debe8256424a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:34.288459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2236f6-1cfb-4f06-a067-debe8256424a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:34.289150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2236f6-1cfb-4f06-a067-debe8256424a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:34.293190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4d2236f6-1cfb-4f06-a067-debe8256424a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:34.310566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2236f6-1cfb-4f06-a067-debe8256424a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:34.313778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2236f6-1cfb-4f06-a067-debe8256424a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:34.340812 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2931/5861] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:38.289531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:41.173425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632af38-64d2-42b3-ade8-4a6071fbcba1 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:41.175022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9632af38-64d2-42b3-ade8-4a6071fbcba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:41.291839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632af38-64d2-42b3-ade8-4a6071fbcba1 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:41.302953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03645e49-b9b6-44e5-83b2-53a013a50cec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:41.303686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645e49-b9b6-44e5-83b2-53a013a50cec service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:41.303969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645e49-b9b6-44e5-83b2-53a013a50cec service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:41.304247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645e49-b9b6-44e5-83b2-53a013a50cec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:41.306174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-03645e49-b9b6-44e5-83b2-53a013a50cec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:41.326748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03645e49-b9b6-44e5-83b2-53a013a50cec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:41.328807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03645e49-b9b6-44e5-83b2-53a013a50cec service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:41.353861 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2931/5862] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:41.811644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74b65e-c2ce-4506-9167-db422aa2a212 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:41.812135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74b65e-c2ce-4506-9167-db422aa2a212 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:41.812253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74b65e-c2ce-4506-9167-db422aa2a212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:41.873084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8f74b65e-c2ce-4506-9167-db422aa2a212 None None] MFA Rules not processed for user `e2056ca5c2954dda970a4c3751748203`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:41.874485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8f74b65e-c2ce-4506-9167-db422aa2a212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:41.948477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:42.041616 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2932/5863] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:42.145683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03645e49-b9b6-44e5-83b2-53a013a50cec service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:42.149021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-03645e49-b9b6-44e5-83b2-53a013a50cec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:42.176318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03645e49-b9b6-44e5-83b2-53a013a50cec service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:42.190180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d80aa-b071-4d5a-9972-533f39c1945b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:42.191114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d80aa-b071-4d5a-9972-533f39c1945b service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:42.191427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d80aa-b071-4d5a-9972-533f39c1945b service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:42.191949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d80aa-b071-4d5a-9972-533f39c1945b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:42.206154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d80aa-b071-4d5a-9972-533f39c1945b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:42.208060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d80aa-b071-4d5a-9972-533f39c1945b service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:42.218921 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2932/5864] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:43.710024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d00f63-b7e6-4d25-b46a-eb9845e19725 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:43.710517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d00f63-b7e6-4d25-b46a-eb9845e19725 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:43.710609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d00f63-b7e6-4d25-b46a-eb9845e19725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:43.733164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f9d00f63-b7e6-4d25-b46a-eb9845e19725 None None] MFA Rules not processed for user `e2056ca5c2954dda970a4c3751748203`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:43.734799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9d00f63-b7e6-4d25-b46a-eb9845e19725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:43.751483 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2933/5865] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:44:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:46.069801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d80aa-b071-4d5a-9972-533f39c1945b service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:46.071395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c23d80aa-b071-4d5a-9972-533f39c1945b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:46.172997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d00f63-b7e6-4d25-b46a-eb9845e19725 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:46.204954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d00f63-b7e6-4d25-b46a-eb9845e19725 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:46.211203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d80aa-b071-4d5a-9972-533f39c1945b service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:46.223242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11523a5f-63f1-4963-a55b-1c7d24b09247 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:46.224197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11523a5f-63f1-4963-a55b-1c7d24b09247 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:46.224804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11523a5f-63f1-4963-a55b-1c7d24b09247 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:46.225377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11523a5f-63f1-4963-a55b-1c7d24b09247 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:46.231835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-11523a5f-63f1-4963-a55b-1c7d24b09247 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:46.235709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df9dc5-5e51-4874-88dd-2baf9130abf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:46.236365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df9dc5-5e51-4874-88dd-2baf9130abf4 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:46.236717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df9dc5-5e51-4874-88dd-2baf9130abf4 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:46.236993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df9dc5-5e51-4874-88dd-2baf9130abf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:46.239006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a1df9dc5-5e51-4874-88dd-2baf9130abf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:46.257229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11523a5f-63f1-4963-a55b-1c7d24b09247 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:46.259315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11523a5f-63f1-4963-a55b-1c7d24b09247 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:46.289206 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2933/5866] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:46.296255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df9dc5-5e51-4874-88dd-2baf9130abf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:46.297890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df9dc5-5e51-4874-88dd-2baf9130abf4 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:46.345568 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2934/5867] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:47.445984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130a3a0-df49-4dcd-b255-39c56bccdfb3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:47.446829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130a3a0-df49-4dcd-b255-39c56bccdfb3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:47.447295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130a3a0-df49-4dcd-b255-39c56bccdfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:47.470353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6130a3a0-df49-4dcd-b255-39c56bccdfb3 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:47.471877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6130a3a0-df49-4dcd-b255-39c56bccdfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:47.537117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:47.560995 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2934/5868] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:44:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:47.593868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df9dc5-5e51-4874-88dd-2baf9130abf4 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:47.596042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a1df9dc5-5e51-4874-88dd-2baf9130abf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:47.753720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df9dc5-5e51-4874-88dd-2baf9130abf4 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:47.765765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a47cac-8f03-4f27-b2e7-ccdbe4b26609 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:47.766872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a47cac-8f03-4f27-b2e7-ccdbe4b26609 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:47.767152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a47cac-8f03-4f27-b2e7-ccdbe4b26609 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:47.767458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a47cac-8f03-4f27-b2e7-ccdbe4b26609 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:47.797751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a47cac-8f03-4f27-b2e7-ccdbe4b26609 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:47.799707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a47cac-8f03-4f27-b2e7-ccdbe4b26609 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:47.821366 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2935/5869] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:44:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:44:57.549206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:57.815203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=55 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:15.060993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130a3a0-df49-4dcd-b255-39c56bccdfb3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:15.214074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130a3a0-df49-4dcd-b255-39c56bccdfb3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:15.228340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b305ef-676f-4234-bcf2-f6f8ea30a19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:15.228340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b305ef-676f-4234-bcf2-f6f8ea30a19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:15.228340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b305ef-676f-4234-bcf2-f6f8ea30a19c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:15.229204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b305ef-676f-4234-bcf2-f6f8ea30a19c admin admin] PATH_INFO: `/v3/users/1ff3aa8ff75d4f73948ffdb37663fff6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:15.231676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b305ef-676f-4234-bcf2-f6f8ea30a19c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff3aa8ff75d4f73948ffdb37663fff6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:15.236659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b305ef-676f-4234-bcf2-f6f8ea30a19c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:15.364562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e3b305ef-676f-4234-bcf2-f6f8ea30a19c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff3aa8ff75d4f73948ffdb37663fff6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:15.401884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e3b305ef-676f-4234-bcf2-f6f8ea30a19c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff3aa8ff75d4f73948ffdb37663fff6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:15.403057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e3b305ef-676f-4234-bcf2-f6f8ea30a19c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff3aa8ff75d4f73948ffdb37663fff6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:15.403949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e3b305ef-676f-4234-bcf2-f6f8ea30a19c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff3aa8ff75d4f73948ffdb37663fff6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:15.417063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e3b305ef-676f-4234-bcf2-f6f8ea30a19c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff3aa8ff75d4f73948ffdb37663fff6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:15.439867 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2935/5870] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:45:15 2022] DELETE /identity/v3/users/1ff3aa8ff75d4f73948ffdb37663fff6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:15.441351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cff84-1626-4c68-a2c1-114c1c4ad9f1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:15.441853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cff84-1626-4c68-a2c1-114c1c4ad9f1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:15.441964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cff84-1626-4c68-a2c1-114c1c4ad9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:15.474933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a05cff84-1626-4c68-a2c1-114c1c4ad9f1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:15.478791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a05cff84-1626-4c68-a2c1-114c1c4ad9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:15.583223 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2936/5871] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:45:15.665119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b305ef-676f-4234-bcf2-f6f8ea30a19c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:15.666750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e3b305ef-676f-4234-bcf2-f6f8ea30a19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:15.801150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b305ef-676f-4234-bcf2-f6f8ea30a19c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:15.805348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4049e23-9e2d-43c8-a815-6638e46ea18e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:15.805977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4049e23-9e2d-43c8-a815-6638e46ea18e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:15.806255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4049e23-9e2d-43c8-a815-6638e46ea18e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:15.806526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4049e23-9e2d-43c8-a815-6638e46ea18e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:15.825838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4049e23-9e2d-43c8-a815-6638e46ea18e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:15.829334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4049e23-9e2d-43c8-a815-6638e46ea18e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:15.843844 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2936/5872] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:45:16.513789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e163e0-679f-4597-bfbd-20bcdfae213e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:16.514345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e163e0-679f-4597-bfbd-20bcdfae213e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:16.514977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e163e0-679f-4597-bfbd-20bcdfae213e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:16.542106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c0e163e0-679f-4597-bfbd-20bcdfae213e None None] MFA Rules not processed for user `8ed50d414dc14715bfdade9ce2e7ee52`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:16.543066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c0e163e0-679f-4597-bfbd-20bcdfae213e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:16.613790 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2937/5873] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:16.685916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4049e23-9e2d-43c8-a815-6638e46ea18e service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:16.687655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c4049e23-9e2d-43c8-a815-6638e46ea18e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:16.750347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4049e23-9e2d-43c8-a815-6638e46ea18e service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:16.758142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adacaa-37e6-48d7-808c-ded613627b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:16.759651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adacaa-37e6-48d7-808c-ded613627b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:16.760393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adacaa-37e6-48d7-808c-ded613627b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:16.761343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adacaa-37e6-48d7-808c-ded613627b1f admin admin] PATH_INFO: `/v3/projects/5526842324b74474b7b3ef1b54251b3c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:16.762676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adacaa-37e6-48d7-808c-ded613627b1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5526842324b74474b7b3ef1b54251b3c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:16.764799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adacaa-37e6-48d7-808c-ded613627b1f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:16.809125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:16.855043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-42adacaa-37e6-48d7-808c-ded613627b1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5526842324b74474b7b3ef1b54251b3c', 'request_id': 'req-42adacaa-37e6-48d7-808c-ded613627b1f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:16.862424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-42adacaa-37e6-48d7-808c-ded613627b1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5526842324b74474b7b3ef1b54251b3c', 'request_id': 'req-42adacaa-37e6-48d7-808c-ded613627b1f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:16.868963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-42adacaa-37e6-48d7-808c-ded613627b1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5526842324b74474b7b3ef1b54251b3c', 'request_id': 'req-42adacaa-37e6-48d7-808c-ded613627b1f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:16.887032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-42adacaa-37e6-48d7-808c-ded613627b1f admin admin] The token cache is being invalidate because project 5526842324b74474b7b3ef1b54251b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:45:16.887332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-42adacaa-37e6-48d7-808c-ded613627b1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:16.888255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-42adacaa-37e6-48d7-808c-ded613627b1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:16.890363 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2937/5874] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:45:16 2022] DELETE /identity/v3/projects/5526842324b74474b7b3ef1b54251b3c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:16.895138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d2894-1ebd-4beb-a99b-bfd1050b1b5c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:16.895767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d2894-1ebd-4beb-a99b-bfd1050b1b5c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:16.896260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d2894-1ebd-4beb-a99b-bfd1050b1b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:16.921988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d55d2894-1ebd-4beb-a99b-bfd1050b1b5c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:16.923763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d55d2894-1ebd-4beb-a99b-bfd1050b1b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:17.012603 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2938/5875] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:17.014983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a420626-fa6f-4662-966a-d626ed15c8a4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:17.015292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a420626-fa6f-4662-966a-d626ed15c8a4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:17.015620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a420626-fa6f-4662-966a-d626ed15c8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:17.035972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8a420626-fa6f-4662-966a-d626ed15c8a4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:17.037295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8a420626-fa6f-4662-966a-d626ed15c8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:17.051417 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2938/5876] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:17.055350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d2894-1ebd-4beb-a99b-bfd1050b1b5c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:17.090276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d2894-1ebd-4beb-a99b-bfd1050b1b5c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:17.115299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6543fa-caf8-4512-8b7c-f996b8518500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:17.118199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6543fa-caf8-4512-8b7c-f996b8518500 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:17.122349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6543fa-caf8-4512-8b7c-f996b8518500 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:17.122634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6543fa-caf8-4512-8b7c-f996b8518500 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:17.127427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6543fa-caf8-4512-8b7c-f996b8518500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:45:17.127961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6543fa-caf8-4512-8b7c-f996b8518500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:17.131656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6543fa-caf8-4512-8b7c-f996b8518500 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:17.154191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a420626-fa6f-4662-966a-d626ed15c8a4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:17.155210 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2939/5877] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:45:17.169425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a420626-fa6f-4662-966a-d626ed15c8a4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:17.179854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cfb81-fb36-49f1-a19d-e14df509573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:17.179854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cfb81-fb36-49f1-a19d-e14df509573b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:17.180300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cfb81-fb36-49f1-a19d-e14df509573b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:17.180672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cfb81-fb36-49f1-a19d-e14df509573b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:17.181440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077cfb81-fb36-49f1-a19d-e14df509573b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:17.183508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077cfb81-fb36-49f1-a19d-e14df509573b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:17.227035 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2939/5878] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:45:17 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:45:17.231163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6543fa-caf8-4512-8b7c-f996b8518500 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:17.243064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6543fa-caf8-4512-8b7c-f996b8518500 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:17.300154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:17.349905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3b656-11bd-483c-ad5d-c1b16422077c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:17.350578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3b656-11bd-483c-ad5d-c1b16422077c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:17.350862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3b656-11bd-483c-ad5d-c1b16422077c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:17.351225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3b656-11bd-483c-ad5d-c1b16422077c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:17.352703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3b656-11bd-483c-ad5d-c1b16422077c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:17.354533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3b656-11bd-483c-ad5d-c1b16422077c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:17.383643 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2940/5879] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:45:17 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:45:17.386508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cfb81-fb36-49f1-a19d-e14df509573b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:17.398675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cfb81-fb36-49f1-a19d-e14df509573b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:17.404252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77cce5-5f45-457b-9189-d37ffda07bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:17.405114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77cce5-5f45-457b-9189-d37ffda07bde admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:17.405591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77cce5-5f45-457b-9189-d37ffda07bde admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:17.406031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77cce5-5f45-457b-9189-d37ffda07bde admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:17.406877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77cce5-5f45-457b-9189-d37ffda07bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:17.409014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77cce5-5f45-457b-9189-d37ffda07bde admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:17.427182 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2940/5880] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:45:17.428595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3b656-11bd-483c-ad5d-c1b16422077c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:17.440847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3b656-11bd-483c-ad5d-c1b16422077c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:17.446761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d73af4-ad12-446b-9d1a-3f125d2d9356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:17.447723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d73af4-ad12-446b-9d1a-3f125d2d9356 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:17.448319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d73af4-ad12-446b-9d1a-3f125d2d9356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:17.448854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d73af4-ad12-446b-9d1a-3f125d2d9356 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:17.450265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d73af4-ad12-446b-9d1a-3f125d2d9356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:17.453640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d73af4-ad12-446b-9d1a-3f125d2d9356 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:17.470958 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2941/5881] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:45:17.480501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77cce5-5f45-457b-9189-d37ffda07bde admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:17.525144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77cce5-5f45-457b-9189-d37ffda07bde admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:17.542945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba63f8-01e9-4762-917e-212bcad0a1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:17.543669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba63f8-01e9-4762-917e-212bcad0a1bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:17.543955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba63f8-01e9-4762-917e-212bcad0a1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:17.544230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba63f8-01e9-4762-917e-212bcad0a1bc admin admin] PATH_INFO: `/v3/projects/914006ae0d274722949b62b4b4079b58/users/cf6a5d7c782143bda54587550cb0c84a/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:17.588532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba63f8-01e9-4762-917e-212bcad0a1bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=914006ae0d274722949b62b4b4079b58, user_id=cf6a5d7c782143bda54587550cb0c84a, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:17.593808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba63f8-01e9-4762-917e-212bcad0a1bc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:17.624592 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2941/5882] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:45:17 2022] PUT /identity/v3/projects/914006ae0d274722949b62b4b4079b58/users/cf6a5d7c782143bda54587550cb0c84a/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:17.624853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e899b-2df6-4b3b-9609-c73eed312196 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:17.625308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e899b-2df6-4b3b-9609-c73eed312196 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:17.625414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e899b-2df6-4b3b-9609-c73eed312196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:17.696825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b57e899b-2df6-4b3b-9609-c73eed312196 None None] MFA Rules not processed for user `cf6a5d7c782143bda54587550cb0c84a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:17.699721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b57e899b-2df6-4b3b-9609-c73eed312196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:17.826313 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2942/5883] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:45:17.845840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba63f8-01e9-4762-917e-212bcad0a1bc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:17.847860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8cba63f8-01e9-4762-917e-212bcad0a1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:17.945525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba63f8-01e9-4762-917e-212bcad0a1bc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:17.949683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a256b-c54e-4b46-895f-a75eebfa38fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:17.950527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a256b-c54e-4b46-895f-a75eebfa38fc service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:17.951338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a256b-c54e-4b46-895f-a75eebfa38fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:17.951796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a256b-c54e-4b46-895f-a75eebfa38fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:17.972133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a256b-c54e-4b46-895f-a75eebfa38fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:17.973630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a256b-c54e-4b46-895f-a75eebfa38fc service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:17.986111 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2942/5884] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:45:18.045141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e899b-2df6-4b3b-9609-c73eed312196 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:18.131378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e899b-2df6-4b3b-9609-c73eed312196 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:18.136735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2439a-6943-4d5e-ba46-fcfdbcfb1c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:18.138321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2439a-6943-4d5e-ba46-fcfdbcfb1c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:18.138682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2439a-6943-4d5e-ba46-fcfdbcfb1c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:18.139153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2439a-6943-4d5e-ba46-fcfdbcfb1c50 admin admin] PATH_INFO: `/v3/users/cf6a5d7c782143bda54587550cb0c84a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:18.140442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2439a-6943-4d5e-ba46-fcfdbcfb1c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf6a5d7c782143bda54587550cb0c84a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:18.142626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2439a-6943-4d5e-ba46-fcfdbcfb1c50 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:18.235238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:18.239862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7bc2439a-6943-4d5e-ba46-fcfdbcfb1c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf6a5d7c782143bda54587550cb0c84a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:18.240845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7bc2439a-6943-4d5e-ba46-fcfdbcfb1c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf6a5d7c782143bda54587550cb0c84a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:18.254055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7bc2439a-6943-4d5e-ba46-fcfdbcfb1c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf6a5d7c782143bda54587550cb0c84a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:18.266047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7bc2439a-6943-4d5e-ba46-fcfdbcfb1c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf6a5d7c782143bda54587550cb0c84a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:18.307762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7bc2439a-6943-4d5e-ba46-fcfdbcfb1c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf6a5d7c782143bda54587550cb0c84a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:18.323512 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2943/5885] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:45:18 2022] DELETE /identity/v3/users/cf6a5d7c782143bda54587550cb0c84a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:18.325309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689554b2-fa16-4d79-99c5-f4bc80c21919 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:18.325601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689554b2-fa16-4d79-99c5-f4bc80c21919 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:18.325882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689554b2-fa16-4d79-99c5-f4bc80c21919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:18.357411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-689554b2-fa16-4d79-99c5-f4bc80c21919 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:18.358646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-689554b2-fa16-4d79-99c5-f4bc80c21919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:18.404886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:18.484392 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2943/5886] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:45:18.509002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2439a-6943-4d5e-ba46-fcfdbcfb1c50 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:18.510799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7bc2439a-6943-4d5e-ba46-fcfdbcfb1c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:18.664673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2439a-6943-4d5e-ba46-fcfdbcfb1c50 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:18.675663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2059f50-c335-4c96-ad34-15e575310063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:18.678310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2059f50-c335-4c96-ad34-15e575310063 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:18.678704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2059f50-c335-4c96-ad34-15e575310063 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:18.679081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2059f50-c335-4c96-ad34-15e575310063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:18.704061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2059f50-c335-4c96-ad34-15e575310063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:18.706007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2059f50-c335-4c96-ad34-15e575310063 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:18.731527 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2944/5887] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:45:19.127298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689554b2-fa16-4d79-99c5-f4bc80c21919 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:19.130406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-689554b2-fa16-4d79-99c5-f4bc80c21919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:19.149677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689554b2-fa16-4d79-99c5-f4bc80c21919 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:19.162429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430c0e3-46b4-4671-ac5d-2480abbf89fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:19.164151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430c0e3-46b4-4671-ac5d-2480abbf89fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:19.164948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430c0e3-46b4-4671-ac5d-2480abbf89fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:19.165358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430c0e3-46b4-4671-ac5d-2480abbf89fd admin admin] PATH_INFO: `/v3/users/d4a721d66c7a43baa865feb20ac942af` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:19.167754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430c0e3-46b4-4671-ac5d-2480abbf89fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a721d66c7a43baa865feb20ac942af)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:19.171998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430c0e3-46b4-4671-ac5d-2480abbf89fd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:19.265715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2430c0e3-46b4-4671-ac5d-2480abbf89fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a721d66c7a43baa865feb20ac942af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:19.308004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2430c0e3-46b4-4671-ac5d-2480abbf89fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a721d66c7a43baa865feb20ac942af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:19.309514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2430c0e3-46b4-4671-ac5d-2480abbf89fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a721d66c7a43baa865feb20ac942af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:19.310392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2430c0e3-46b4-4671-ac5d-2480abbf89fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a721d66c7a43baa865feb20ac942af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:19.353099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2430c0e3-46b4-4671-ac5d-2480abbf89fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a721d66c7a43baa865feb20ac942af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:19.400372 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2944/5888] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:45:19 2022] DELETE /identity/v3/users/d4a721d66c7a43baa865feb20ac942af => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:19.405120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbab45-6791-460b-878c-ec5253397bcf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:19.405795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbab45-6791-460b-878c-ec5253397bcf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:19.406251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbab45-6791-460b-878c-ec5253397bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:19.434165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0cdbab45-6791-460b-878c-ec5253397bcf None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:19.439921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0cdbab45-6791-460b-878c-ec5253397bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:19.500536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430c0e3-46b4-4671-ac5d-2480abbf89fd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:19.512053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2430c0e3-46b4-4671-ac5d-2480abbf89fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:19.575446 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2945/5889] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:45:19.591528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbab45-6791-460b-878c-ec5253397bcf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:19.594032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0cdbab45-6791-460b-878c-ec5253397bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:19.693532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbab45-6791-460b-878c-ec5253397bcf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:19.704334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf111d2-d849-4e09-8a9c-07a8ffade5b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:19.705385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf111d2-d849-4e09-8a9c-07a8ffade5b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:19.705912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf111d2-d849-4e09-8a9c-07a8ffade5b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:19.706306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf111d2-d849-4e09-8a9c-07a8ffade5b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:19.724392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf111d2-d849-4e09-8a9c-07a8ffade5b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:19.729074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf111d2-d849-4e09-8a9c-07a8ffade5b8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:19.771888 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2946/5890] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:45:19.772397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430c0e3-46b4-4671-ac5d-2480abbf89fd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:19.777463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd00ca3-ce28-4741-8362-ee351feb8a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:19.778514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd00ca3-ce28-4741-8362-ee351feb8a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:19.778514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd00ca3-ce28-4741-8362-ee351feb8a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:19.778738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd00ca3-ce28-4741-8362-ee351feb8a68 admin admin] PATH_INFO: `/v3/projects/914006ae0d274722949b62b4b4079b58` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:19.780029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd00ca3-ce28-4741-8362-ee351feb8a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=914006ae0d274722949b62b4b4079b58)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:19.782219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd00ca3-ce28-4741-8362-ee351feb8a68 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:19.870613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0dd00ca3-ce28-4741-8362-ee351feb8a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914006ae0d274722949b62b4b4079b58', 'request_id': 'req-0dd00ca3-ce28-4741-8362-ee351feb8a68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:19.889986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0dd00ca3-ce28-4741-8362-ee351feb8a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914006ae0d274722949b62b4b4079b58', 'request_id': 'req-0dd00ca3-ce28-4741-8362-ee351feb8a68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:19.903930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:19.909349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0dd00ca3-ce28-4741-8362-ee351feb8a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914006ae0d274722949b62b4b4079b58', 'request_id': 'req-0dd00ca3-ce28-4741-8362-ee351feb8a68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:19.946376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0dd00ca3-ce28-4741-8362-ee351feb8a68 admin admin] The token cache is being invalidate because project 914006ae0d274722949b62b4b4079b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:45:19.947750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0dd00ca3-ce28-4741-8362-ee351feb8a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:19.948628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0dd00ca3-ce28-4741-8362-ee351feb8a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:19.954051 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2945/5891] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:45:19 2022] DELETE /identity/v3/projects/914006ae0d274722949b62b4b4079b58 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:45:19.959952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07837e69-a2af-4486-bc49-7b26e8029fad None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:19.960647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07837e69-a2af-4486-bc49-7b26e8029fad None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:19.961155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07837e69-a2af-4486-bc49-7b26e8029fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:20.010560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:20.020143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-07837e69-a2af-4486-bc49-7b26e8029fad None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:20.023295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-07837e69-a2af-4486-bc49-7b26e8029fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:20.122840 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2947/5892] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:20.130191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9690a6e-aefb-4784-9c92-2fb84a8111cc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:20.130769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9690a6e-aefb-4784-9c92-2fb84a8111cc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:20.130769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9690a6e-aefb-4784-9c92-2fb84a8111cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:20.167118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d9690a6e-aefb-4784-9c92-2fb84a8111cc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:20.168654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d9690a6e-aefb-4784-9c92-2fb84a8111cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:20.177471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07837e69-a2af-4486-bc49-7b26e8029fad None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:20.178997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-07837e69-a2af-4486-bc49-7b26e8029fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:20.188990 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2946/5893] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:20.191195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9690a6e-aefb-4784-9c92-2fb84a8111cc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:20.204624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9690a6e-aefb-4784-9c92-2fb84a8111cc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:20.216692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260765de-e9a2-4bc5-8df0-9c3bcb303284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:20.217598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260765de-e9a2-4bc5-8df0-9c3bcb303284 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:20.218109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260765de-e9a2-4bc5-8df0-9c3bcb303284 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:20.218850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260765de-e9a2-4bc5-8df0-9c3bcb303284 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:20.219578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260765de-e9a2-4bc5-8df0-9c3bcb303284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:45:20.219891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260765de-e9a2-4bc5-8df0-9c3bcb303284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:20.222508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260765de-e9a2-4bc5-8df0-9c3bcb303284 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:20.228429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07837e69-a2af-4486-bc49-7b26e8029fad None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:20.246565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a40313-02b3-4b52-ad67-b6a82c862efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:20.249132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a40313-02b3-4b52-ad67-b6a82c862efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:20.249622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a40313-02b3-4b52-ad67-b6a82c862efe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:20.250389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a40313-02b3-4b52-ad67-b6a82c862efe admin admin] PATH_INFO: `/v3/projects/b4b7fb6127f74a57806c9898293fafe5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:20.256143 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2947/5894] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:45:20.256882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a40313-02b3-4b52-ad67-b6a82c862efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b7fb6127f74a57806c9898293fafe5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:20.257776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260765de-e9a2-4bc5-8df0-9c3bcb303284 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:20.260389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a40313-02b3-4b52-ad67-b6a82c862efe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:20.273306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260765de-e9a2-4bc5-8df0-9c3bcb303284 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:20.280538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd374821-7e71-44fe-b8f5-88511112ab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:20.281542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd374821-7e71-44fe-b8f5-88511112ab32 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:20.282090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd374821-7e71-44fe-b8f5-88511112ab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:20.282595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd374821-7e71-44fe-b8f5-88511112ab32 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:20.283526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd374821-7e71-44fe-b8f5-88511112ab32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:20.286961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd374821-7e71-44fe-b8f5-88511112ab32 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:20.325019 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2948/5895] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:45:20 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:45:20.329646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd374821-7e71-44fe-b8f5-88511112ab32 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:20.354506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17a40313-02b3-4b52-ad67-b6a82c862efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b7fb6127f74a57806c9898293fafe5', 'request_id': 'req-17a40313-02b3-4b52-ad67-b6a82c862efe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:20.370693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17a40313-02b3-4b52-ad67-b6a82c862efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b7fb6127f74a57806c9898293fafe5', 'request_id': 'req-17a40313-02b3-4b52-ad67-b6a82c862efe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:20.378644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17a40313-02b3-4b52-ad67-b6a82c862efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b7fb6127f74a57806c9898293fafe5', 'request_id': 'req-17a40313-02b3-4b52-ad67-b6a82c862efe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:20.399050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17a40313-02b3-4b52-ad67-b6a82c862efe admin admin] The token cache is being invalidate because project b4b7fb6127f74a57806c9898293fafe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:45:20.399688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17a40313-02b3-4b52-ad67-b6a82c862efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:20.400656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17a40313-02b3-4b52-ad67-b6a82c862efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:20.403613 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2948/5896] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:45:20 2022] DELETE /identity/v3/projects/b4b7fb6127f74a57806c9898293fafe5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:45:20.407386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a40313-02b3-4b52-ad67-b6a82c862efe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:20.411359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17a40313-02b3-4b52-ad67-b6a82c862efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:20.425935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd374821-7e71-44fe-b8f5-88511112ab32 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:20.537269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9921e-d411-4304-95d9-dda9ecc3d8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:20.539577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9921e-d411-4304-95d9-dda9ecc3d8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:20.540671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9921e-d411-4304-95d9-dda9ecc3d8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:20.541304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9921e-d411-4304-95d9-dda9ecc3d8e6 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:20.542450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9921e-d411-4304-95d9-dda9ecc3d8e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:20.547022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9921e-d411-4304-95d9-dda9ecc3d8e6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:20.556017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a40313-02b3-4b52-ad67-b6a82c862efe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:20.564436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d58d7-5d16-4aa1-9e2a-51754783d6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:20.565292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d58d7-5d16-4aa1-9e2a-51754783d6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:20.565560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d58d7-5d16-4aa1-9e2a-51754783d6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:20.565894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d58d7-5d16-4aa1-9e2a-51754783d6ca admin admin] PATH_INFO: `/v3/users/e9944f1f916c46b49708251ea557c957` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:20.567171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d58d7-5d16-4aa1-9e2a-51754783d6ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9944f1f916c46b49708251ea557c957)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:20.569384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d58d7-5d16-4aa1-9e2a-51754783d6ca admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:20.625545 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2949/5897] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:45:20 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:45:20.633872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9921e-d411-4304-95d9-dda9ecc3d8e6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:20.644644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-04d9921e-d411-4304-95d9-dda9ecc3d8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:20.662884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:20.672385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9921e-d411-4304-95d9-dda9ecc3d8e6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:20.690987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ead484-dbeb-4799-94d3-02ace05cbe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:20.691757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ead484-dbeb-4799-94d3-02ace05cbe52 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:20.692099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ead484-dbeb-4799-94d3-02ace05cbe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:20.692440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ead484-dbeb-4799-94d3-02ace05cbe52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:20.693162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ead484-dbeb-4799-94d3-02ace05cbe52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:20.696384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-531d58d7-5d16-4aa1-9e2a-51754783d6ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9944f1f916c46b49708251ea557c957'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:20.697221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-531d58d7-5d16-4aa1-9e2a-51754783d6ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9944f1f916c46b49708251ea557c957'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:20.698782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ead484-dbeb-4799-94d3-02ace05cbe52 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:20.716922 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2950/5898] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:45:20.717672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-531d58d7-5d16-4aa1-9e2a-51754783d6ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9944f1f916c46b49708251ea557c957'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:20.720374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ead484-dbeb-4799-94d3-02ace05cbe52 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:20.722803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a8ead484-dbeb-4799-94d3-02ace05cbe52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:20.734055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-531d58d7-5d16-4aa1-9e2a-51754783d6ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9944f1f916c46b49708251ea557c957'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:20.740740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ead484-dbeb-4799-94d3-02ace05cbe52 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:20.753078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-531d58d7-5d16-4aa1-9e2a-51754783d6ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9944f1f916c46b49708251ea557c957'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:20.761560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c9f40-417d-47d9-a138-e7533fa2ba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:20.762919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c9f40-417d-47d9-a138-e7533fa2ba92 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:20.763201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c9f40-417d-47d9-a138-e7533fa2ba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:20.763368 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2949/5899] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:45:20 2022] DELETE /identity/v3/users/e9944f1f916c46b49708251ea557c957 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:45:20.770446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c9f40-417d-47d9-a138-e7533fa2ba92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:20.771228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c9f40-417d-47d9-a138-e7533fa2ba92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:20.772960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c9f40-417d-47d9-a138-e7533fa2ba92 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:20.791209 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2951/5900] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:45:20.792455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d58d7-5d16-4aa1-9e2a-51754783d6ca admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:20.962908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d58d7-5d16-4aa1-9e2a-51754783d6ca admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:20.976945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fcc42-511a-452d-93c7-76b40d978174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:20.977797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fcc42-511a-452d-93c7-76b40d978174 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:20.978177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fcc42-511a-452d-93c7-76b40d978174 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:20.978550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fcc42-511a-452d-93c7-76b40d978174 admin admin] PATH_INFO: `/v3/projects/9e7ac70051194ba684fb586466c63317/users/4847764ba5f940dab3db2ab834f0c3b1/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:21.012628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fcc42-511a-452d-93c7-76b40d978174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7ac70051194ba684fb586466c63317, user_id=4847764ba5f940dab3db2ab834f0c3b1, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:21.015537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fcc42-511a-452d-93c7-76b40d978174 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:21.045032 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2950/5901] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:45:20 2022] PUT /identity/v3/projects/9e7ac70051194ba684fb586466c63317/users/4847764ba5f940dab3db2ab834f0c3b1/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:21.055033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e41546-d914-48f2-8bce-1f6edacadc78 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:21.055356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e41546-d914-48f2-8bce-1f6edacadc78 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:21.055635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e41546-d914-48f2-8bce-1f6edacadc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:21.114665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c4e41546-d914-48f2-8bce-1f6edacadc78 None None] MFA Rules not processed for user `4847764ba5f940dab3db2ab834f0c3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:21.115902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c4e41546-d914-48f2-8bce-1f6edacadc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:21.137744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:21.180156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fcc42-511a-452d-93c7-76b40d978174 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:21.181975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6c8fcc42-511a-452d-93c7-76b40d978174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:21.273848 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2952/5902] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:21.274756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e41546-d914-48f2-8bce-1f6edacadc78 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:21.320282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fcc42-511a-452d-93c7-76b40d978174 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:21.337812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681710bb-c7db-4155-a67c-5cdcf75bb436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:21.338494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681710bb-c7db-4155-a67c-5cdcf75bb436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:21.338873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681710bb-c7db-4155-a67c-5cdcf75bb436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:21.339046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681710bb-c7db-4155-a67c-5cdcf75bb436 admin admin] PATH_INFO: `/v3/projects/b3f8b974ba434b1688fa923b26114ea0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:21.340395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681710bb-c7db-4155-a67c-5cdcf75bb436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f8b974ba434b1688fa923b26114ea0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:21.344237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681710bb-c7db-4155-a67c-5cdcf75bb436 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:21.417945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e41546-d914-48f2-8bce-1f6edacadc78 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:21.422951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326502be-503c-4053-b1ee-3cd2a8fab80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:21.424123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326502be-503c-4053-b1ee-3cd2a8fab80c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:21.424123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326502be-503c-4053-b1ee-3cd2a8fab80c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:21.424294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326502be-503c-4053-b1ee-3cd2a8fab80c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:21.424889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326502be-503c-4053-b1ee-3cd2a8fab80c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:21.426883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326502be-503c-4053-b1ee-3cd2a8fab80c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:21.456352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:21.480745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-681710bb-c7db-4155-a67c-5cdcf75bb436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f8b974ba434b1688fa923b26114ea0', 'request_id': 'req-681710bb-c7db-4155-a67c-5cdcf75bb436'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:21.484920 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2953/5903] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:45:21 2022] POST /identity/v3/projects => generated 365 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:45:21.486506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326502be-503c-4053-b1ee-3cd2a8fab80c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:21.490914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-326502be-503c-4053-b1ee-3cd2a8fab80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:21.496044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-681710bb-c7db-4155-a67c-5cdcf75bb436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f8b974ba434b1688fa923b26114ea0', 'request_id': 'req-681710bb-c7db-4155-a67c-5cdcf75bb436'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:21.507937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-681710bb-c7db-4155-a67c-5cdcf75bb436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f8b974ba434b1688fa923b26114ea0', 'request_id': 'req-681710bb-c7db-4155-a67c-5cdcf75bb436'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:21.532008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-681710bb-c7db-4155-a67c-5cdcf75bb436 admin admin] The token cache is being invalidate because project b3f8b974ba434b1688fa923b26114ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:45:21.533174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-681710bb-c7db-4155-a67c-5cdcf75bb436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:21.534470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-681710bb-c7db-4155-a67c-5cdcf75bb436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:21.541227 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2951/5904] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:45:21 2022] DELETE /identity/v3/projects/b3f8b974ba434b1688fa923b26114ea0 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:45:21.543559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681710bb-c7db-4155-a67c-5cdcf75bb436 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:21.546238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-681710bb-c7db-4155-a67c-5cdcf75bb436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:21.633648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326502be-503c-4053-b1ee-3cd2a8fab80c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:21.639920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc70a9-dd4e-45be-b747-5e45beaed9a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:21.640553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc70a9-dd4e-45be-b747-5e45beaed9a0 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:21.640824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc70a9-dd4e-45be-b747-5e45beaed9a0 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:21.641100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc70a9-dd4e-45be-b747-5e45beaed9a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:21.642918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-26bc70a9-dd4e-45be-b747-5e45beaed9a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:21.651108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681710bb-c7db-4155-a67c-5cdcf75bb436 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:21.689102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:21.729284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27184146-2b39-4a04-a02d-617c1d6d0378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:21.730098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27184146-2b39-4a04-a02d-617c1d6d0378 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:21.730442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27184146-2b39-4a04-a02d-617c1d6d0378 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:21.730861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27184146-2b39-4a04-a02d-617c1d6d0378 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:21.731569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc70a9-dd4e-45be-b747-5e45beaed9a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:21.731723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27184146-2b39-4a04-a02d-617c1d6d0378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:21.733478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc70a9-dd4e-45be-b747-5e45beaed9a0 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:21.735116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27184146-2b39-4a04-a02d-617c1d6d0378 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:21.751976 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2954/5905] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:45:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:45:21.753469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f01df7-b667-4403-a8a2-a097204192d0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:21.753762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f01df7-b667-4403-a8a2-a097204192d0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:21.754041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f01df7-b667-4403-a8a2-a097204192d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:21.780422 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2952/5906] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:45:21 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:45:21.784798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27184146-2b39-4a04-a02d-617c1d6d0378 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:21.804321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c6f01df7-b667-4403-a8a2-a097204192d0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:21.805730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c6f01df7-b667-4403-a8a2-a097204192d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:21.831758 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2955/5907] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:21.832809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27184146-2b39-4a04-a02d-617c1d6d0378 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:21.834095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8d564-1270-49d9-9028-75a9e1818459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:21.834589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8d564-1270-49d9-9028-75a9e1818459 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:21.834881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8d564-1270-49d9-9028-75a9e1818459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:21.835618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8d564-1270-49d9-9028-75a9e1818459 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:21.835875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f97fce-64f6-4c5b-a036-82bf9a1e51a8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:21.836280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8d564-1270-49d9-9028-75a9e1818459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:21.836373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f97fce-64f6-4c5b-a036-82bf9a1e51a8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:21.836768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f97fce-64f6-4c5b-a036-82bf9a1e51a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:21.838986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8d564-1270-49d9-9028-75a9e1818459 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:21.856641 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2953/5908] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:45:21.860578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8d564-1270-49d9-9028-75a9e1818459 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:21.875107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8d564-1270-49d9-9028-75a9e1818459 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:21.883064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc75c75-6591-4fef-b87a-ecedf9ed0e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:21.883973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc75c75-6591-4fef-b87a-ecedf9ed0e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:21.884365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc75c75-6591-4fef-b87a-ecedf9ed0e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:21.884743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc75c75-6591-4fef-b87a-ecedf9ed0e98 admin admin] PATH_INFO: `/v3/projects/c4aeab68a15f4c7692166a941c577e3c/users/b76806b03cf445f4b70d5d0186a7716b/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:21.891336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-97f97fce-64f6-4c5b-a036-82bf9a1e51a8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:21.892635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-97f97fce-64f6-4c5b-a036-82bf9a1e51a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:21.906004 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2956/5909] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:45:21.906126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc75c75-6591-4fef-b87a-ecedf9ed0e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4aeab68a15f4c7692166a941c577e3c, user_id=b76806b03cf445f4b70d5d0186a7716b, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:21.907138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f97fce-64f6-4c5b-a036-82bf9a1e51a8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:21.909710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc75c75-6591-4fef-b87a-ecedf9ed0e98 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:21.928551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f97fce-64f6-4c5b-a036-82bf9a1e51a8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:21.933708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36639042-46d5-4d9f-8129-2141df285af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:21.934320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36639042-46d5-4d9f-8129-2141df285af3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:21.934590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36639042-46d5-4d9f-8129-2141df285af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:21.934861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36639042-46d5-4d9f-8129-2141df285af3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:21.935555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36639042-46d5-4d9f-8129-2141df285af3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:45:21.935854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36639042-46d5-4d9f-8129-2141df285af3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:21.937505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36639042-46d5-4d9f-8129-2141df285af3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:21.950388 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2954/5910] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:45:21 2022] PUT /identity/v3/projects/c4aeab68a15f4c7692166a941c577e3c/users/b76806b03cf445f4b70d5d0186a7716b/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:21.954363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc75c75-6591-4fef-b87a-ecedf9ed0e98 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:21.955780 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2957/5911] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:45:21.960036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36639042-46d5-4d9f-8129-2141df285af3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:21.973133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36639042-46d5-4d9f-8129-2141df285af3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:22.003501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:22.054971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc75c75-6591-4fef-b87a-ecedf9ed0e98 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:22.073345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cf6a0-53fb-4c1a-b66c-a58c98286674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:22.073982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cf6a0-53fb-4c1a-b66c-a58c98286674 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:22.074254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cf6a0-53fb-4c1a-b66c-a58c98286674 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:22.074555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cf6a0-53fb-4c1a-b66c-a58c98286674 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:22.075208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cf6a0-53fb-4c1a-b66c-a58c98286674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:22.076869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cf6a0-53fb-4c1a-b66c-a58c98286674 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:22.096495 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2955/5912] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:45:22.096495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cf6a0-53fb-4c1a-b66c-a58c98286674 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:22.096495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-630cf6a0-53fb-4c1a-b66c-a58c98286674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:22.104007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa7459-ca5d-465f-86be-f0a5afd7c803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:22.104854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa7459-ca5d-465f-86be-f0a5afd7c803 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:22.105346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa7459-ca5d-465f-86be-f0a5afd7c803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:22.106009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa7459-ca5d-465f-86be-f0a5afd7c803 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:22.111484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa7459-ca5d-465f-86be-f0a5afd7c803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:22.117605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa7459-ca5d-465f-86be-f0a5afd7c803 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:22.157756 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2958/5913] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:45:21 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:45:22.157756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa7459-ca5d-465f-86be-f0a5afd7c803 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:22.201003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cf6a0-53fb-4c1a-b66c-a58c98286674 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:22.287854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa7459-ca5d-465f-86be-f0a5afd7c803 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:22.300476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c09922-df36-4b99-a1d6-09607c3b3db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:22.301303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c09922-df36-4b99-a1d6-09607c3b3db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:22.301585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c09922-df36-4b99-a1d6-09607c3b3db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:22.301857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c09922-df36-4b99-a1d6-09607c3b3db9 admin admin] PATH_INFO: `/v3/projects/c4aeab68a15f4c7692166a941c577e3c/users/b76806b03cf445f4b70d5d0186a7716b/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:22.305300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c09922-df36-4b99-a1d6-09607c3b3db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4aeab68a15f4c7692166a941c577e3c, user_id=b76806b03cf445f4b70d5d0186a7716b, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:22.315307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c09922-df36-4b99-a1d6-09607c3b3db9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:22.342785 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2959/5914] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:45:22 2022] PUT /identity/v3/projects/c4aeab68a15f4c7692166a941c577e3c/users/b76806b03cf445f4b70d5d0186a7716b/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:22.357158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c09922-df36-4b99-a1d6-09607c3b3db9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:22.360515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63be2f0-043b-4afc-866b-26a641ea12f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:22.362330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be2f0-043b-4afc-866b-26a641ea12f8 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:22.364966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be2f0-043b-4afc-866b-26a641ea12f8 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:22.364966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be2f0-043b-4afc-866b-26a641ea12f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:22.372485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b63be2f0-043b-4afc-866b-26a641ea12f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:22.445108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:22.528022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:22.536650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c09922-df36-4b99-a1d6-09607c3b3db9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:22.569226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67821e-e576-485c-9958-a6ea7a319dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:22.569894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67821e-e576-485c-9958-a6ea7a319dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:22.570178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67821e-e576-485c-9958-a6ea7a319dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:22.570461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67821e-e576-485c-9958-a6ea7a319dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:22.571123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67821e-e576-485c-9958-a6ea7a319dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:22.585088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67821e-e576-485c-9958-a6ea7a319dc0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:22.606264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63be2f0-043b-4afc-866b-26a641ea12f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:22.609320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63be2f0-043b-4afc-866b-26a641ea12f8 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:22.624064 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2960/5915] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:45:22 2022] POST /identity/v3/users => generated 287 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:45:22.625385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08b173-fda9-4a5c-a961-990b81471375 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:22.627358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08b173-fda9-4a5c-a961-990b81471375 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:22.627660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08b173-fda9-4a5c-a961-990b81471375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:22.633683 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2956/5916] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:45:22.634555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63be2f0-043b-4afc-866b-26a641ea12f8 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:22.664556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63be2f0-043b-4afc-866b-26a641ea12f8 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:22.681360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf776b8b-2a50-486b-bce8-4eb029926e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:22.682104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf776b8b-2a50-486b-bce8-4eb029926e81 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:22.682400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf776b8b-2a50-486b-bce8-4eb029926e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:22.682653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf776b8b-2a50-486b-bce8-4eb029926e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:22.683337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf776b8b-2a50-486b-bce8-4eb029926e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:22.684985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf776b8b-2a50-486b-bce8-4eb029926e81 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:22.703728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3a08b173-fda9-4a5c-a961-990b81471375 None None] MFA Rules not processed for user `b76806b03cf445f4b70d5d0186a7716b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:22.703728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a08b173-fda9-4a5c-a961-990b81471375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:22.720297 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2957/5917] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:45:22.722197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf776b8b-2a50-486b-bce8-4eb029926e81 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:22.737804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf776b8b-2a50-486b-bce8-4eb029926e81 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:22.755435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016241a9-8c30-4bfc-a2a7-a634bad8cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:22.756139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016241a9-8c30-4bfc-a2a7-a634bad8cfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:22.756431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016241a9-8c30-4bfc-a2a7-a634bad8cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:22.756722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016241a9-8c30-4bfc-a2a7-a634bad8cfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:22.757426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016241a9-8c30-4bfc-a2a7-a634bad8cfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:22.759084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016241a9-8c30-4bfc-a2a7-a634bad8cfe5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:22.788984 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2958/5918] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:45:22.792466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016241a9-8c30-4bfc-a2a7-a634bad8cfe5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:22.814120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016241a9-8c30-4bfc-a2a7-a634bad8cfe5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:22.826810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2c328-00f0-4ec9-b99f-58d7abfb14ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:22.829058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c328-00f0-4ec9-b99f-58d7abfb14ce admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:22.830346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c328-00f0-4ec9-b99f-58d7abfb14ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:22.830733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c328-00f0-4ec9-b99f-58d7abfb14ce admin admin] PATH_INFO: `/v3/projects/556dfc764e3747188a1b26380873fed1/users/a64e87750d1c41008e5ba2c485a52b81/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:22.867950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2c328-00f0-4ec9-b99f-58d7abfb14ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=556dfc764e3747188a1b26380873fed1, user_id=a64e87750d1c41008e5ba2c485a52b81, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:22.872472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2c328-00f0-4ec9-b99f-58d7abfb14ce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:22.876504 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2961/5919] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:22.888463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08b173-fda9-4a5c-a961-990b81471375 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:22.891177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a08b173-fda9-4a5c-a961-990b81471375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:22.903543 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2959/5920] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:45:22 2022] PUT /identity/v3/projects/556dfc764e3747188a1b26380873fed1/users/a64e87750d1c41008e5ba2c485a52b81/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:22.914834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25e77a-972e-41f7-a600-8b3e4e496478 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:22.915221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25e77a-972e-41f7-a600-8b3e4e496478 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:22.915457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25e77a-972e-41f7-a600-8b3e4e496478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:22.982364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0d25e77a-972e-41f7-a600-8b3e4e496478 None None] MFA Rules not processed for user `a64e87750d1c41008e5ba2c485a52b81`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:22.988543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d25e77a-972e-41f7-a600-8b3e4e496478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:23.083762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08b173-fda9-4a5c-a961-990b81471375 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:23.132910 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2960/5921] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:45:23.139964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25e77a-972e-41f7-a600-8b3e4e496478 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:23.141823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d25e77a-972e-41f7-a600-8b3e4e496478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:23.170618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1950f6d-55d5-4a5b-a524-a97609dccb78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:23.172126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1950f6d-55d5-4a5b-a524-a97609dccb78 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:23.172598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1950f6d-55d5-4a5b-a524-a97609dccb78 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:23.173051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1950f6d-55d5-4a5b-a524-a97609dccb78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:23.193466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:23.233186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25e77a-972e-41f7-a600-8b3e4e496478 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:23.237733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d2b01-4d09-4618-b8b8-1804f550abd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:23.238455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d2b01-4d09-4618-b8b8-1804f550abd0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:23.238807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d2b01-4d09-4618-b8b8-1804f550abd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:23.239154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d2b01-4d09-4618-b8b8-1804f550abd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:23.254609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d2b01-4d09-4618-b8b8-1804f550abd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:23.257051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d2b01-4d09-4618-b8b8-1804f550abd0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:23.270782 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2961/5922] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:45:23.272747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1950f6d-55d5-4a5b-a524-a97609dccb78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:23.274379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1950f6d-55d5-4a5b-a524-a97609dccb78 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:23.285867 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2962/5923] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:45:24.145418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d2b01-4d09-4618-b8b8-1804f550abd0 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:24.199579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:24.334726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d2b01-4d09-4618-b8b8-1804f550abd0 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:24.356683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea407ce-59be-4a0d-9026-7b12c7dcc81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:24.422591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea407ce-59be-4a0d-9026-7b12c7dcc81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:24.422986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea407ce-59be-4a0d-9026-7b12c7dcc81e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:24.423323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea407ce-59be-4a0d-9026-7b12c7dcc81e admin admin] PATH_INFO: `/v3/users/4847764ba5f940dab3db2ab834f0c3b1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:24.427577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea407ce-59be-4a0d-9026-7b12c7dcc81e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4847764ba5f940dab3db2ab834f0c3b1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:24.429746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea407ce-59be-4a0d-9026-7b12c7dcc81e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:24.540047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dea407ce-59be-4a0d-9026-7b12c7dcc81e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4847764ba5f940dab3db2ab834f0c3b1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:24.541134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dea407ce-59be-4a0d-9026-7b12c7dcc81e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4847764ba5f940dab3db2ab834f0c3b1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:24.564552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dea407ce-59be-4a0d-9026-7b12c7dcc81e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4847764ba5f940dab3db2ab834f0c3b1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:24.610258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dea407ce-59be-4a0d-9026-7b12c7dcc81e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4847764ba5f940dab3db2ab834f0c3b1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:24.651437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dea407ce-59be-4a0d-9026-7b12c7dcc81e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4847764ba5f940dab3db2ab834f0c3b1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:24.672748 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2962/5924] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:45:24 2022] DELETE /identity/v3/users/4847764ba5f940dab3db2ab834f0c3b1 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:24.677550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f424620-b8de-4c4d-9b38-d19db87c6d4d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:24.678524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f424620-b8de-4c4d-9b38-d19db87c6d4d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:24.679505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f424620-b8de-4c4d-9b38-d19db87c6d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:24.708174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1f424620-b8de-4c4d-9b38-d19db87c6d4d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:24.710892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1f424620-b8de-4c4d-9b38-d19db87c6d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:24.904204 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2963/5925] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:24.936789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea407ce-59be-4a0d-9026-7b12c7dcc81e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:24.938276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dea407ce-59be-4a0d-9026-7b12c7dcc81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:25.095321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea407ce-59be-4a0d-9026-7b12c7dcc81e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:25.113624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdb727-f4ee-4ed0-b2d3-21d272f56ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:25.115019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdb727-f4ee-4ed0-b2d3-21d272f56ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:25.118489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdb727-f4ee-4ed0-b2d3-21d272f56ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:25.118866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdb727-f4ee-4ed0-b2d3-21d272f56ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:25.139881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdb727-f4ee-4ed0-b2d3-21d272f56ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:25.141534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdb727-f4ee-4ed0-b2d3-21d272f56ed3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:25.156365 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2963/5926] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:45:26.506072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f424620-b8de-4c4d-9b38-d19db87c6d4d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:26.508330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1f424620-b8de-4c4d-9b38-d19db87c6d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:26.533544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f424620-b8de-4c4d-9b38-d19db87c6d4d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:26.594348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47113e8-05c7-4876-859b-e05125004062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:26.595120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47113e8-05c7-4876-859b-e05125004062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:26.595564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47113e8-05c7-4876-859b-e05125004062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:26.595961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47113e8-05c7-4876-859b-e05125004062 admin admin] PATH_INFO: `/v3/users/e2056ca5c2954dda970a4c3751748203` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:26.597573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47113e8-05c7-4876-859b-e05125004062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2056ca5c2954dda970a4c3751748203)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:26.599696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47113e8-05c7-4876-859b-e05125004062 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:26.678802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d47113e8-05c7-4876-859b-e05125004062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2056ca5c2954dda970a4c3751748203'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:26.704891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d47113e8-05c7-4876-859b-e05125004062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2056ca5c2954dda970a4c3751748203'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:26.705803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d47113e8-05c7-4876-859b-e05125004062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2056ca5c2954dda970a4c3751748203'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:26.706645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d47113e8-05c7-4876-859b-e05125004062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2056ca5c2954dda970a4c3751748203'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:26.720033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d47113e8-05c7-4876-859b-e05125004062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2056ca5c2954dda970a4c3751748203'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:26.741636 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2964/5927] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:45:26 2022] DELETE /identity/v3/users/e2056ca5c2954dda970a4c3751748203 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:26.788123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdb727-f4ee-4ed0-b2d3-21d272f56ed3 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:26.792681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ebdb727-f4ee-4ed0-b2d3-21d272f56ed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:26.830877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdb727-f4ee-4ed0-b2d3-21d272f56ed3 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:26.910365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:26.928030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4d97f-a662-4f64-8bb4-04094c5cd955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:26.928961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4d97f-a662-4f64-8bb4-04094c5cd955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:26.929437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4d97f-a662-4f64-8bb4-04094c5cd955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:26.929966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4d97f-a662-4f64-8bb4-04094c5cd955 admin admin] PATH_INFO: `/v3/projects/9e7ac70051194ba684fb586466c63317` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:26.932171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4d97f-a662-4f64-8bb4-04094c5cd955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e7ac70051194ba684fb586466c63317)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:26.936461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4d97f-a662-4f64-8bb4-04094c5cd955 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:27.037051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81c4d97f-a662-4f64-8bb4-04094c5cd955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7ac70051194ba684fb586466c63317', 'request_id': 'req-81c4d97f-a662-4f64-8bb4-04094c5cd955'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:27.045952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81c4d97f-a662-4f64-8bb4-04094c5cd955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7ac70051194ba684fb586466c63317', 'request_id': 'req-81c4d97f-a662-4f64-8bb4-04094c5cd955'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:27.056044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81c4d97f-a662-4f64-8bb4-04094c5cd955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7ac70051194ba684fb586466c63317', 'request_id': 'req-81c4d97f-a662-4f64-8bb4-04094c5cd955'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:27.074156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81c4d97f-a662-4f64-8bb4-04094c5cd955 admin admin] The token cache is being invalidate because project 9e7ac70051194ba684fb586466c63317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:45:27.074928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81c4d97f-a662-4f64-8bb4-04094c5cd955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:27.079729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81c4d97f-a662-4f64-8bb4-04094c5cd955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:27.083367 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2964/5928] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:45:26 2022] DELETE /identity/v3/projects/9e7ac70051194ba684fb586466c63317 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:27.087192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47113e8-05c7-4876-859b-e05125004062 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:27.090566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d47113e8-05c7-4876-859b-e05125004062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:27.108388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47113e8-05c7-4876-859b-e05125004062 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:27.134674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:27.219465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d94c6-e13b-41a2-932f-21ba1fa8afc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:27.221041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d94c6-e13b-41a2-932f-21ba1fa8afc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:27.221513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d94c6-e13b-41a2-932f-21ba1fa8afc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:27.222117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d94c6-e13b-41a2-932f-21ba1fa8afc6 admin admin] PATH_INFO: `/v3/users/b76806b03cf445f4b70d5d0186a7716b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:27.224340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d94c6-e13b-41a2-932f-21ba1fa8afc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b76806b03cf445f4b70d5d0186a7716b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:27.226898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d94c6-e13b-41a2-932f-21ba1fa8afc6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:27.244076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4d97f-a662-4f64-8bb4-04094c5cd955 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:27.246302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-81c4d97f-a662-4f64-8bb4-04094c5cd955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:27.265804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4d97f-a662-4f64-8bb4-04094c5cd955 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:27.278461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3cb0e-7604-4623-bdf3-e5be2024c6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:27.281086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3cb0e-7604-4623-bdf3-e5be2024c6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:27.282807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3cb0e-7604-4623-bdf3-e5be2024c6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:27.283346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3cb0e-7604-4623-bdf3-e5be2024c6e7 admin admin] PATH_INFO: `/v3/projects/a985647b119f4a3ca8ce1cb956580066` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:27.290196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3cb0e-7604-4623-bdf3-e5be2024c6e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a985647b119f4a3ca8ce1cb956580066)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:27.294257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3cb0e-7604-4623-bdf3-e5be2024c6e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:27.380634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cd9d94c6-e13b-41a2-932f-21ba1fa8afc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b76806b03cf445f4b70d5d0186a7716b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:27.417258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cd9d94c6-e13b-41a2-932f-21ba1fa8afc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b76806b03cf445f4b70d5d0186a7716b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:27.418050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cd9d94c6-e13b-41a2-932f-21ba1fa8afc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b76806b03cf445f4b70d5d0186a7716b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:27.419034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cd9d94c6-e13b-41a2-932f-21ba1fa8afc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b76806b03cf445f4b70d5d0186a7716b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:27.430901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cd9d94c6-e13b-41a2-932f-21ba1fa8afc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b76806b03cf445f4b70d5d0186a7716b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:27.453070 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2965/5929] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:45:27 2022] DELETE /identity/v3/users/b76806b03cf445f4b70d5d0186a7716b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:45:27.462032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5c3cb0e-7604-4623-bdf3-e5be2024c6e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a985647b119f4a3ca8ce1cb956580066', 'request_id': 'req-e5c3cb0e-7604-4623-bdf3-e5be2024c6e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:27.479041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5c3cb0e-7604-4623-bdf3-e5be2024c6e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a985647b119f4a3ca8ce1cb956580066', 'request_id': 'req-e5c3cb0e-7604-4623-bdf3-e5be2024c6e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:27.502441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5c3cb0e-7604-4623-bdf3-e5be2024c6e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a985647b119f4a3ca8ce1cb956580066', 'request_id': 'req-e5c3cb0e-7604-4623-bdf3-e5be2024c6e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:27.536254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5c3cb0e-7604-4623-bdf3-e5be2024c6e7 admin admin] The token cache is being invalidate because project a985647b119f4a3ca8ce1cb956580066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:45:27.536985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5c3cb0e-7604-4623-bdf3-e5be2024c6e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:27.538348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5c3cb0e-7604-4623-bdf3-e5be2024c6e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:27.541269 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2965/5930] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:45:27 2022] DELETE /identity/v3/projects/a985647b119f4a3ca8ce1cb956580066 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:27.548227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac375cd-64e2-4290-88c7-654c418e9497 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:27.549159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac375cd-64e2-4290-88c7-654c418e9497 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:27.549714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac375cd-64e2-4290-88c7-654c418e9497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:27.588055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5ac375cd-64e2-4290-88c7-654c418e9497 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:27.589658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5ac375cd-64e2-4290-88c7-654c418e9497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:27.712152 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2966/5931] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:27.713416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81e17b-42a3-4c9d-9440-4a0f714f32dc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:27.713703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81e17b-42a3-4c9d-9440-4a0f714f32dc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:27.714027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81e17b-42a3-4c9d-9440-4a0f714f32dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:27.744015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0b81e17b-42a3-4c9d-9440-4a0f714f32dc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:27.746013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0b81e17b-42a3-4c9d-9440-4a0f714f32dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:27.756160 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2966/5932] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:45:27.760705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac375cd-64e2-4290-88c7-654c418e9497 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:27.774120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac375cd-64e2-4290-88c7-654c418e9497 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:27.787779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664cf7f-e6c1-4ab5-835b-847df7721455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:27.788548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664cf7f-e6c1-4ab5-835b-847df7721455 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:27.788895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664cf7f-e6c1-4ab5-835b-847df7721455 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:27.789234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664cf7f-e6c1-4ab5-835b-847df7721455 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:27.790038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664cf7f-e6c1-4ab5-835b-847df7721455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:45:27.790410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664cf7f-e6c1-4ab5-835b-847df7721455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:27.792374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664cf7f-e6c1-4ab5-835b-847df7721455 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:27.828364 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2967/5933] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:45:27.831840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81e17b-42a3-4c9d-9440-4a0f714f32dc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:27.844362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81e17b-42a3-4c9d-9440-4a0f714f32dc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:27.860254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23509f3a-25ff-4481-9d0c-db27bce6c232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:27.861667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23509f3a-25ff-4481-9d0c-db27bce6c232 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:27.862001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23509f3a-25ff-4481-9d0c-db27bce6c232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:27.863230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23509f3a-25ff-4481-9d0c-db27bce6c232 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:27.864028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23509f3a-25ff-4481-9d0c-db27bce6c232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:27.869693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23509f3a-25ff-4481-9d0c-db27bce6c232 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:27.958175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664cf7f-e6c1-4ab5-835b-847df7721455 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:27.958647 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2967/5934] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:45:27 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:45:28.003804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664cf7f-e6c1-4ab5-835b-847df7721455 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:28.146971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:28.264622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c67b5-8b5c-4126-bd3b-80aa14e43d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:28.265264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c67b5-8b5c-4126-bd3b-80aa14e43d48 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:28.265558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c67b5-8b5c-4126-bd3b-80aa14e43d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:28.266007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c67b5-8b5c-4126-bd3b-80aa14e43d48 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:28.266658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c67b5-8b5c-4126-bd3b-80aa14e43d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:28.268740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c67b5-8b5c-4126-bd3b-80aa14e43d48 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:28.327650 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2968/5935] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:45:27 2022] POST /identity/v3/users => generated 283 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:45:28.331800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23509f3a-25ff-4481-9d0c-db27bce6c232 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:28.356101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23509f3a-25ff-4481-9d0c-db27bce6c232 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:28.375151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce5e4c-1510-42ec-be60-848321f8ad1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:28.375793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce5e4c-1510-42ec-be60-848321f8ad1c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:28.375977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce5e4c-1510-42ec-be60-848321f8ad1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:28.376535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce5e4c-1510-42ec-be60-848321f8ad1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:28.377248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce5e4c-1510-42ec-be60-848321f8ad1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:28.379103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce5e4c-1510-42ec-be60-848321f8ad1c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:28.435365 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2968/5936] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:45:28.440044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c67b5-8b5c-4126-bd3b-80aa14e43d48 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:28.461165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c67b5-8b5c-4126-bd3b-80aa14e43d48 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:28.478475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bdfef-9372-48c8-8348-6cff0f9d8274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:28.479112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bdfef-9372-48c8-8348-6cff0f9d8274 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:28.479493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bdfef-9372-48c8-8348-6cff0f9d8274 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:28.479837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bdfef-9372-48c8-8348-6cff0f9d8274 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:28.480561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bdfef-9372-48c8-8348-6cff0f9d8274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:28.482589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bdfef-9372-48c8-8348-6cff0f9d8274 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:28.524322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce5e4c-1510-42ec-be60-848321f8ad1c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:28.554436 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2969/5937] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:45:28.562691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce5e4c-1510-42ec-be60-848321f8ad1c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:28.568436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c41d85-e8a2-4ae1-b7da-892ec83cf3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:28.569512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c41d85-e8a2-4ae1-b7da-892ec83cf3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:28.570017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c41d85-e8a2-4ae1-b7da-892ec83cf3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:28.570499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c41d85-e8a2-4ae1-b7da-892ec83cf3cd admin admin] PATH_INFO: `/v3/projects/83bfb010992c43749b71e3e618494101/users/185b4855098e46449a5b3e44339e51f0/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:28.592901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c41d85-e8a2-4ae1-b7da-892ec83cf3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=83bfb010992c43749b71e3e618494101, user_id=185b4855098e46449a5b3e44339e51f0, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:28.597968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c41d85-e8a2-4ae1-b7da-892ec83cf3cd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:28.601631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:28.624471 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2969/5938] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:45:28 2022] PUT /identity/v3/projects/83bfb010992c43749b71e3e618494101/users/185b4855098e46449a5b3e44339e51f0/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:28.630553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39a12b-0ed1-434a-a660-6a1ce120ec27 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:28.631896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39a12b-0ed1-434a-a660-6a1ce120ec27 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:28.632420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39a12b-0ed1-434a-a660-6a1ce120ec27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:28.659599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7d39a12b-0ed1-434a-a660-6a1ce120ec27 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:28.661835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7d39a12b-0ed1-434a-a660-6a1ce120ec27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:28.818444 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2970/5939] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:28.835908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c41d85-e8a2-4ae1-b7da-892ec83cf3cd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:28.847685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a8c41d85-e8a2-4ae1-b7da-892ec83cf3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:28.880587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39a12b-0ed1-434a-a660-6a1ce120ec27 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:28.884253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7d39a12b-0ed1-434a-a660-6a1ce120ec27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:28.909736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39a12b-0ed1-434a-a660-6a1ce120ec27 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:28.926622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bbcf2-7560-4856-a9f8-36e5c2c87fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:28.927378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bbcf2-7560-4856-a9f8-36e5c2c87fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:28.927667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bbcf2-7560-4856-a9f8-36e5c2c87fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:28.928044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bbcf2-7560-4856-a9f8-36e5c2c87fa1 admin admin] PATH_INFO: `/v3/projects/c4aeab68a15f4c7692166a941c577e3c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:28.936092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bbcf2-7560-4856-a9f8-36e5c2c87fa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4aeab68a15f4c7692166a941c577e3c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:28.938344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bbcf2-7560-4856-a9f8-36e5c2c87fa1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:28.977216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c41d85-e8a2-4ae1-b7da-892ec83cf3cd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:28.983593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46591c67-36f3-4ba0-b226-140672494e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:28.984694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46591c67-36f3-4ba0-b226-140672494e34 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:28.985244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46591c67-36f3-4ba0-b226-140672494e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:28.985711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46591c67-36f3-4ba0-b226-140672494e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:29.004314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46591c67-36f3-4ba0-b226-140672494e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:29.006742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46591c67-36f3-4ba0-b226-140672494e34 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:29.020367 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2970/5940] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:45:29.036479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-563bbcf2-7560-4856-a9f8-36e5c2c87fa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4aeab68a15f4c7692166a941c577e3c', 'request_id': 'req-563bbcf2-7560-4856-a9f8-36e5c2c87fa1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:29.061035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-563bbcf2-7560-4856-a9f8-36e5c2c87fa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4aeab68a15f4c7692166a941c577e3c', 'request_id': 'req-563bbcf2-7560-4856-a9f8-36e5c2c87fa1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:29.093702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-563bbcf2-7560-4856-a9f8-36e5c2c87fa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4aeab68a15f4c7692166a941c577e3c', 'request_id': 'req-563bbcf2-7560-4856-a9f8-36e5c2c87fa1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:29.138439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-563bbcf2-7560-4856-a9f8-36e5c2c87fa1 admin admin] The token cache is being invalidate because project c4aeab68a15f4c7692166a941c577e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:45:29.138439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-563bbcf2-7560-4856-a9f8-36e5c2c87fa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:29.140540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-563bbcf2-7560-4856-a9f8-36e5c2c87fa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:29.146842 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2971/5941] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:45:28 2022] DELETE /identity/v3/projects/c4aeab68a15f4c7692166a941c577e3c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:29.150067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5dad8-39be-43e7-a936-26019ce4b25a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:29.150701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5dad8-39be-43e7-a936-26019ce4b25a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:29.151479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5dad8-39be-43e7-a936-26019ce4b25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:29.203692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b0f5dad8-39be-43e7-a936-26019ce4b25a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:29.207203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0f5dad8-39be-43e7-a936-26019ce4b25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:29.403196 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2971/5942] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:45:29.410908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6e6d-4767-48e9-8420-1666643ce66b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:29.411428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6e6d-4767-48e9-8420-1666643ce66b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:29.411796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6e6d-4767-48e9-8420-1666643ce66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:29.470129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-890d6e6d-4767-48e9-8420-1666643ce66b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:29.472514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-890d6e6d-4767-48e9-8420-1666643ce66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:29.495217 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2972/5943] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:29.496668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5dad8-39be-43e7-a936-26019ce4b25a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:29.508128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5dad8-39be-43e7-a936-26019ce4b25a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:29.514261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfa3d2-ec91-4546-ada3-e03bdfc44e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:29.515011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfa3d2-ec91-4546-ada3-e03bdfc44e45 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:29.515376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfa3d2-ec91-4546-ada3-e03bdfc44e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:29.515816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfa3d2-ec91-4546-ada3-e03bdfc44e45 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:29.516685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfa3d2-ec91-4546-ada3-e03bdfc44e45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:45:29.517183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfa3d2-ec91-4546-ada3-e03bdfc44e45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:29.519752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfa3d2-ec91-4546-ada3-e03bdfc44e45 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:29.538668 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2972/5944] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:45:29.543592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d6e6d-4767-48e9-8420-1666643ce66b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:29.582035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d6e6d-4767-48e9-8420-1666643ce66b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:29.598255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7810137-bf00-41bb-97c0-5c4b074e5e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:29.599147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7810137-bf00-41bb-97c0-5c4b074e5e2b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:29.599703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7810137-bf00-41bb-97c0-5c4b074e5e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:29.601924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7810137-bf00-41bb-97c0-5c4b074e5e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:29.603078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7810137-bf00-41bb-97c0-5c4b074e5e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:29.606984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7810137-bf00-41bb-97c0-5c4b074e5e2b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:29.672982 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2973/5945] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:45:29 2022] POST /identity/v3/projects => generated 355 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:45:29.677243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfa3d2-ec91-4546-ada3-e03bdfc44e45 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:29.692737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfa3d2-ec91-4546-ada3-e03bdfc44e45 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:29.790464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba220203-556b-467a-987f-1e49de47378a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:29.791405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba220203-556b-467a-987f-1e49de47378a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:29.791922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba220203-556b-467a-987f-1e49de47378a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:29.792368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba220203-556b-467a-987f-1e49de47378a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:29.793323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba220203-556b-467a-987f-1e49de47378a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:29.797322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba220203-556b-467a-987f-1e49de47378a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:29.831716 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2973/5946] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:45:29 2022] POST /identity/v3/users => generated 278 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:45:29.835431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7810137-bf00-41bb-97c0-5c4b074e5e2b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:29.841667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:29.854016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7810137-bf00-41bb-97c0-5c4b074e5e2b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:29.866489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383cd68-42ab-4e75-9a2b-41dcad6ec9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:29.867731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383cd68-42ab-4e75-9a2b-41dcad6ec9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:29.868720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383cd68-42ab-4e75-9a2b-41dcad6ec9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:29.869286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383cd68-42ab-4e75-9a2b-41dcad6ec9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:29.870844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383cd68-42ab-4e75-9a2b-41dcad6ec9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:29.873358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383cd68-42ab-4e75-9a2b-41dcad6ec9e6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:29.891541 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2974/5947] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:45:29.895301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba220203-556b-467a-987f-1e49de47378a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:29.917333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba220203-556b-467a-987f-1e49de47378a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:29.928948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687f803-f594-4053-9ae4-9c772a192929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:29.929743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f803-f594-4053-9ae4-9c772a192929 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:29.930125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f803-f594-4053-9ae4-9c772a192929 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:29.930500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f803-f594-4053-9ae4-9c772a192929 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:29.931807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687f803-f594-4053-9ae4-9c772a192929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:29.935970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687f803-f594-4053-9ae4-9c772a192929 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:29.965298 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2974/5948] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:45:29.969615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383cd68-42ab-4e75-9a2b-41dcad6ec9e6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:29.991099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383cd68-42ab-4e75-9a2b-41dcad6ec9e6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:30.003739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbe66e-9d4f-4f02-9aa8-400e0265082c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:30.004814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbe66e-9d4f-4f02-9aa8-400e0265082c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:30.005255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbe66e-9d4f-4f02-9aa8-400e0265082c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:30.005745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbe66e-9d4f-4f02-9aa8-400e0265082c admin admin] PATH_INFO: `/v3/projects/b6ab5a6b32f8449b89c75a8e92277b5d/users/7836f008e215493e9ecfa511a81579b5/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:30.035818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbe66e-9d4f-4f02-9aa8-400e0265082c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ab5a6b32f8449b89c75a8e92277b5d, user_id=7836f008e215493e9ecfa511a81579b5, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:30.039774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbe66e-9d4f-4f02-9aa8-400e0265082c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:30.074585 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2975/5949] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:45:29 2022] PUT /identity/v3/projects/b6ab5a6b32f8449b89c75a8e92277b5d/users/7836f008e215493e9ecfa511a81579b5/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:30.093795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79918855-781d-41d3-8e3f-4361276285b3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:30.094443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79918855-781d-41d3-8e3f-4361276285b3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:30.094821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79918855-781d-41d3-8e3f-4361276285b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:30.102630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:30.141029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-79918855-781d-41d3-8e3f-4361276285b3 None None] MFA Rules not processed for user `7836f008e215493e9ecfa511a81579b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:30.142647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79918855-781d-41d3-8e3f-4361276285b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:30.285241 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2975/5950] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:30.289713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbe66e-9d4f-4f02-9aa8-400e0265082c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:30.478107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbe66e-9d4f-4f02-9aa8-400e0265082c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:30.483696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd421f-15cb-4949-b0c3-4e103b36a092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:30.484379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd421f-15cb-4949-b0c3-4e103b36a092 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:30.484699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd421f-15cb-4949-b0c3-4e103b36a092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:30.484981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd421f-15cb-4949-b0c3-4e103b36a092 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:30.485752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd421f-15cb-4949-b0c3-4e103b36a092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:30.488026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd421f-15cb-4949-b0c3-4e103b36a092 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:30.530953 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2976/5951] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:45:30 2022] POST /identity/v3/projects => generated 355 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:45:30.538239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79918855-781d-41d3-8e3f-4361276285b3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:30.553502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79918855-781d-41d3-8e3f-4361276285b3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:30.662810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf7bdb-8f8c-4f93-9a07-e7ab6094507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:30.664044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7bdb-8f8c-4f93-9a07-e7ab6094507e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:30.664602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7bdb-8f8c-4f93-9a07-e7ab6094507e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:30.665733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7bdb-8f8c-4f93-9a07-e7ab6094507e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:30.666893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf7bdb-8f8c-4f93-9a07-e7ab6094507e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:30.671959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf7bdb-8f8c-4f93-9a07-e7ab6094507e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:30.727592 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2976/5952] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:45:30 2022] POST /identity/v3/users => generated 284 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:45:30.738931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd421f-15cb-4949-b0c3-4e103b36a092 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:30.776616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd421f-15cb-4949-b0c3-4e103b36a092 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:30.798739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e8dc9-09bc-4b98-9cf7-6102ae3d61b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:30.799615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e8dc9-09bc-4b98-9cf7-6102ae3d61b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:30.800109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e8dc9-09bc-4b98-9cf7-6102ae3d61b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:30.800385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e8dc9-09bc-4b98-9cf7-6102ae3d61b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:30.801055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e8dc9-09bc-4b98-9cf7-6102ae3d61b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:30.802662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e8dc9-09bc-4b98-9cf7-6102ae3d61b9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:30.818842 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2977/5953] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:45:30.823547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf7bdb-8f8c-4f93-9a07-e7ab6094507e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:30.851148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf7bdb-8f8c-4f93-9a07-e7ab6094507e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:30.858136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08800de-3105-4200-8e20-4b065c988ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:30.859637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08800de-3105-4200-8e20-4b065c988ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:30.860160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08800de-3105-4200-8e20-4b065c988ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:30.860903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08800de-3105-4200-8e20-4b065c988ebc admin admin] PATH_INFO: `/v3/projects/eda6b417d02c4b4fae3c7c7f5f66d4e5/users/01a23f29fd6f4f3fa142849a861f07ad/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:30.907307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08800de-3105-4200-8e20-4b065c988ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda6b417d02c4b4fae3c7c7f5f66d4e5, user_id=01a23f29fd6f4f3fa142849a861f07ad, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:30.928815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08800de-3105-4200-8e20-4b065c988ebc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:30.960526 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2977/5954] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:45:30 2022] PUT /identity/v3/projects/eda6b417d02c4b4fae3c7c7f5f66d4e5/users/01a23f29fd6f4f3fa142849a861f07ad/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:30.964450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e8dc9-09bc-4b98-9cf7-6102ae3d61b9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:30.981708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e8dc9-09bc-4b98-9cf7-6102ae3d61b9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:31.097278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33085bf-33cd-438e-90f0-bd3d517edd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:31.098831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33085bf-33cd-438e-90f0-bd3d517edd2b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:31.099217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33085bf-33cd-438e-90f0-bd3d517edd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:31.099618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33085bf-33cd-438e-90f0-bd3d517edd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:31.100601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33085bf-33cd-438e-90f0-bd3d517edd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:31.102614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33085bf-33cd-438e-90f0-bd3d517edd2b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:31.118593 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2978/5955] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:45:31.123706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08800de-3105-4200-8e20-4b065c988ebc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:31.140629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08800de-3105-4200-8e20-4b065c988ebc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:31.146886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1566d00-9cdc-45ac-b8d4-e79fcba0dd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:31.148131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1566d00-9cdc-45ac-b8d4-e79fcba0dd34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:31.148577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1566d00-9cdc-45ac-b8d4-e79fcba0dd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:31.149041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1566d00-9cdc-45ac-b8d4-e79fcba0dd34 admin admin] PATH_INFO: `/v3/projects/eda6b417d02c4b4fae3c7c7f5f66d4e5/users/01a23f29fd6f4f3fa142849a861f07ad/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:31.151188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1566d00-9cdc-45ac-b8d4-e79fcba0dd34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda6b417d02c4b4fae3c7c7f5f66d4e5, user_id=01a23f29fd6f4f3fa142849a861f07ad, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:31.154371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1566d00-9cdc-45ac-b8d4-e79fcba0dd34 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:31.172088 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2978/5956] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:45:31 2022] PUT /identity/v3/projects/eda6b417d02c4b4fae3c7c7f5f66d4e5/users/01a23f29fd6f4f3fa142849a861f07ad/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:31.184884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0659714-7b26-478a-bd89-13f04b9ed531 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:31.186092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0659714-7b26-478a-bd89-13f04b9ed531 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:31.187361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0659714-7b26-478a-bd89-13f04b9ed531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:31.253013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c0659714-7b26-478a-bd89-13f04b9ed531 None None] MFA Rules not processed for user `01a23f29fd6f4f3fa142849a861f07ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:31.254251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c0659714-7b26-478a-bd89-13f04b9ed531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:31.299267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:31.405321 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2979/5957] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:31.418146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1566d00-9cdc-45ac-b8d4-e79fcba0dd34 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:31.420549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a1566d00-9cdc-45ac-b8d4-e79fcba0dd34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:31.532717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:31.549933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1566d00-9cdc-45ac-b8d4-e79fcba0dd34 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:31.573795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7216f-0509-47db-b337-a9444612495b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:31.574664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7216f-0509-47db-b337-a9444612495b service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:31.574952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7216f-0509-47db-b337-a9444612495b service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:31.575246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7216f-0509-47db-b337-a9444612495b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:31.599789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7216f-0509-47db-b337-a9444612495b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:31.602575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7216f-0509-47db-b337-a9444612495b service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:31.626623 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2979/5958] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:45:31.759585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0659714-7b26-478a-bd89-13f04b9ed531 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:31.784131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0659714-7b26-478a-bd89-13f04b9ed531 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:31.795391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35604ee-8086-400c-b0ce-107f3ca35bb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:31.796663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35604ee-8086-400c-b0ce-107f3ca35bb1 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:31.798927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35604ee-8086-400c-b0ce-107f3ca35bb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:31.800133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35604ee-8086-400c-b0ce-107f3ca35bb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:31.903670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35604ee-8086-400c-b0ce-107f3ca35bb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:31.905862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35604ee-8086-400c-b0ce-107f3ca35bb1 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:31.920397 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2980/5959] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:45:41.614377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:41.914459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=45 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:42.535627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7216f-0509-47db-b337-a9444612495b service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:42.537796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d1e7216f-0509-47db-b337-a9444612495b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:42.800108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7216f-0509-47db-b337-a9444612495b service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:42.811321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a54155-c9e5-46ea-8a0a-717a33ec3f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:42.812107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a54155-c9e5-46ea-8a0a-717a33ec3f2c service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:42.812539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a54155-c9e5-46ea-8a0a-717a33ec3f2c service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:42.812918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a54155-c9e5-46ea-8a0a-717a33ec3f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:42.815080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-34a54155-c9e5-46ea-8a0a-717a33ec3f2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:42.833186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a54155-c9e5-46ea-8a0a-717a33ec3f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:42.834978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a54155-c9e5-46ea-8a0a-717a33ec3f2c service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:42.849451 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2980/5960] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:45:44.001991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918abf00-9f30-4c60-90a4-8be07634f18c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:44.002575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918abf00-9f30-4c60-90a4-8be07634f18c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:44.002834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918abf00-9f30-4c60-90a4-8be07634f18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:44.080958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-918abf00-9f30-4c60-90a4-8be07634f18c None None] MFA Rules not processed for user `185b4855098e46449a5b3e44339e51f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:44.084854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-918abf00-9f30-4c60-90a4-8be07634f18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:44.299963 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2981/5961] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:44.317822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb0529-5072-42d8-b5d5-2f87d30f4541 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:44.318447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb0529-5072-42d8-b5d5-2f87d30f4541 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:44.318790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb0529-5072-42d8-b5d5-2f87d30f4541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:44.365008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-50bb0529-5072-42d8-b5d5-2f87d30f4541 None None] MFA Rules not processed for user `185b4855098e46449a5b3e44339e51f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:44.366741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-50bb0529-5072-42d8-b5d5-2f87d30f4541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:44.375192 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2981/5962] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:44.387089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918abf00-9f30-4c60-90a4-8be07634f18c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:44.408486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918abf00-9f30-4c60-90a4-8be07634f18c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:44.423911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c915300-2493-4241-8f24-953ce409b032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:44.425010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c915300-2493-4241-8f24-953ce409b032 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:44.425582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c915300-2493-4241-8f24-953ce409b032 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:44.426108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c915300-2493-4241-8f24-953ce409b032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:44.449880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c915300-2493-4241-8f24-953ce409b032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:44.452565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c915300-2493-4241-8f24-953ce409b032 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:44.489581 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2982/5963] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:45:48.169536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb0529-5072-42d8-b5d5-2f87d30f4541 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:48.171528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-50bb0529-5072-42d8-b5d5-2f87d30f4541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:48.243178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c915300-2493-4241-8f24-953ce409b032 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:48.246401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c915300-2493-4241-8f24-953ce409b032 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:48.423552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb0529-5072-42d8-b5d5-2f87d30f4541 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:48.433850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f1605-872a-4887-ab84-d4e0990e8b41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:48.434634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f1605-872a-4887-ab84-d4e0990e8b41 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:48.436153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f1605-872a-4887-ab84-d4e0990e8b41 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:48.436539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f1605-872a-4887-ab84-d4e0990e8b41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:48.439209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c915300-2493-4241-8f24-953ce409b032 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:48.443331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b04f1605-872a-4887-ab84-d4e0990e8b41 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:48.452117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5584a-6e8a-4a85-9556-6344791318f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:48.452769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5584a-6e8a-4a85-9556-6344791318f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:48.454634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5584a-6e8a-4a85-9556-6344791318f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:48.455147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5584a-6e8a-4a85-9556-6344791318f5 admin admin] PATH_INFO: `/v3/users/f5f9d99ae530430c8c6461f8c88b0983` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:48.460928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5584a-6e8a-4a85-9556-6344791318f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f9d99ae530430c8c6461f8c88b0983)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:48.463184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5584a-6e8a-4a85-9556-6344791318f5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:48.473591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f1605-872a-4887-ab84-d4e0990e8b41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:48.475387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f1605-872a-4887-ab84-d4e0990e8b41 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:48.507210 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2982/5964] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:45:48.634770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16d5584a-6e8a-4a85-9556-6344791318f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f9d99ae530430c8c6461f8c88b0983'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:48.656271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16d5584a-6e8a-4a85-9556-6344791318f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f9d99ae530430c8c6461f8c88b0983'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:48.657237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16d5584a-6e8a-4a85-9556-6344791318f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f9d99ae530430c8c6461f8c88b0983'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:48.658166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16d5584a-6e8a-4a85-9556-6344791318f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f9d99ae530430c8c6461f8c88b0983'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:48.672527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16d5584a-6e8a-4a85-9556-6344791318f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f9d99ae530430c8c6461f8c88b0983'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:48.682156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:48.696328 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2983/5965] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:45:48 2022] DELETE /identity/v3/users/f5f9d99ae530430c8c6461f8c88b0983 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:49.060476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f1605-872a-4887-ab84-d4e0990e8b41 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:49.078126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f1605-872a-4887-ab84-d4e0990e8b41 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:49.378904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1cb82-174e-4e56-8510-5dcc44ec8a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:49.381566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1cb82-174e-4e56-8510-5dcc44ec8a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:49.402779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1cb82-174e-4e56-8510-5dcc44ec8a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:49.404336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1cb82-174e-4e56-8510-5dcc44ec8a7e admin admin] PATH_INFO: `/v3/projects/732eabd0fc584b0daae2d0ea24d998cb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:49.409466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1cb82-174e-4e56-8510-5dcc44ec8a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=732eabd0fc584b0daae2d0ea24d998cb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:49.415097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1cb82-174e-4e56-8510-5dcc44ec8a7e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:49.443359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:49.576354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09a1cb82-174e-4e56-8510-5dcc44ec8a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732eabd0fc584b0daae2d0ea24d998cb', 'request_id': 'req-09a1cb82-174e-4e56-8510-5dcc44ec8a7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:49.588156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09a1cb82-174e-4e56-8510-5dcc44ec8a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732eabd0fc584b0daae2d0ea24d998cb', 'request_id': 'req-09a1cb82-174e-4e56-8510-5dcc44ec8a7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:49.596122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09a1cb82-174e-4e56-8510-5dcc44ec8a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732eabd0fc584b0daae2d0ea24d998cb', 'request_id': 'req-09a1cb82-174e-4e56-8510-5dcc44ec8a7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:49.613199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09a1cb82-174e-4e56-8510-5dcc44ec8a7e admin admin] The token cache is being invalidate because project 732eabd0fc584b0daae2d0ea24d998cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:45:49.613826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09a1cb82-174e-4e56-8510-5dcc44ec8a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:49.614755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09a1cb82-174e-4e56-8510-5dcc44ec8a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:49.616846 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2983/5966] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:45:49 2022] DELETE /identity/v3/projects/732eabd0fc584b0daae2d0ea24d998cb => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:49.621911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00514510-c85a-463b-8284-b38db37d20df None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:49.622418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00514510-c85a-463b-8284-b38db37d20df None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:49.622526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00514510-c85a-463b-8284-b38db37d20df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:49.676949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-00514510-c85a-463b-8284-b38db37d20df None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:49.678217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00514510-c85a-463b-8284-b38db37d20df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:49.855965 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2984/5967] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:49.856159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcfe1c-a009-4477-8014-4e45c678c353 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:49.856652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcfe1c-a009-4477-8014-4e45c678c353 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:49.857475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcfe1c-a009-4477-8014-4e45c678c353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:49.904478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8ddcfe1c-a009-4477-8014-4e45c678c353 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:49.918946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ddcfe1c-a009-4477-8014-4e45c678c353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:50.009166 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2984/5968] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:50.014211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00514510-c85a-463b-8284-b38db37d20df None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:50.030271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00514510-c85a-463b-8284-b38db37d20df None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:50.042600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b2d25-49c9-4ac9-a460-fc2d810764d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:50.043638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b2d25-49c9-4ac9-a460-fc2d810764d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:50.044240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b2d25-49c9-4ac9-a460-fc2d810764d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:50.044674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b2d25-49c9-4ac9-a460-fc2d810764d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:50.045550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b2d25-49c9-4ac9-a460-fc2d810764d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:45:50.047531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b2d25-49c9-4ac9-a460-fc2d810764d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:50.052602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b2d25-49c9-4ac9-a460-fc2d810764d4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:50.101486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcfe1c-a009-4477-8014-4e45c678c353 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:50.115247 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2985/5969] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:45:50.123461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcfe1c-a009-4477-8014-4e45c678c353 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:50.139635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16b762-7c30-45de-8c99-ebd9a7efb330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:50.140332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16b762-7c30-45de-8c99-ebd9a7efb330 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:50.140683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16b762-7c30-45de-8c99-ebd9a7efb330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:50.140965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16b762-7c30-45de-8c99-ebd9a7efb330 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:50.141610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16b762-7c30-45de-8c99-ebd9a7efb330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:50.145718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16b762-7c30-45de-8c99-ebd9a7efb330 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:50.228552 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2985/5970] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:45:50 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:45:50.231735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b2d25-49c9-4ac9-a460-fc2d810764d4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:50.242888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b2d25-49c9-4ac9-a460-fc2d810764d4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:50.380952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0d5e4-170f-41fd-a4b7-a1bec7a88817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:50.381924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d5e4-170f-41fd-a4b7-a1bec7a88817 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:50.382132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d5e4-170f-41fd-a4b7-a1bec7a88817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:50.382366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d5e4-170f-41fd-a4b7-a1bec7a88817 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:50.383024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0d5e4-170f-41fd-a4b7-a1bec7a88817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:50.388068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0d5e4-170f-41fd-a4b7-a1bec7a88817 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:50.469780 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2986/5971] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:45:50 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:45:50.474013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16b762-7c30-45de-8c99-ebd9a7efb330 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:50.492037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16b762-7c30-45de-8c99-ebd9a7efb330 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:50.504795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b69f32-645c-45ac-a422-b0c31f78a0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:50.505750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b69f32-645c-45ac-a422-b0c31f78a0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:50.506263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b69f32-645c-45ac-a422-b0c31f78a0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:50.506824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b69f32-645c-45ac-a422-b0c31f78a0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:50.507790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b69f32-645c-45ac-a422-b0c31f78a0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:50.510021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b69f32-645c-45ac-a422-b0c31f78a0a9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:50.544150 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2986/5972] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:45:50.547946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0d5e4-170f-41fd-a4b7-a1bec7a88817 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:50.561997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0d5e4-170f-41fd-a4b7-a1bec7a88817 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:50.568032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abfbd9-f049-490d-9948-0ddfa1e5cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:50.569052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abfbd9-f049-490d-9948-0ddfa1e5cc9a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:50.569566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abfbd9-f049-490d-9948-0ddfa1e5cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:50.570057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abfbd9-f049-490d-9948-0ddfa1e5cc9a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:50.571178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abfbd9-f049-490d-9948-0ddfa1e5cc9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:50.573817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abfbd9-f049-490d-9948-0ddfa1e5cc9a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:50.588019 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2987/5973] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:45:50.592334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b69f32-645c-45ac-a422-b0c31f78a0a9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:50.604903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b69f32-645c-45ac-a422-b0c31f78a0a9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:50.609757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3ff80-a675-42f3-a55d-d5cacdd9ca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:50.610923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3ff80-a675-42f3-a55d-d5cacdd9ca67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:50.611554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3ff80-a675-42f3-a55d-d5cacdd9ca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:50.611840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3ff80-a675-42f3-a55d-d5cacdd9ca67 admin admin] PATH_INFO: `/v3/projects/17383ba856854db48b8e24df1f04e080/users/a9372b6a1aef4015a08dfbb1ef1b5a54/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:50.629766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3ff80-a675-42f3-a55d-d5cacdd9ca67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17383ba856854db48b8e24df1f04e080, user_id=a9372b6a1aef4015a08dfbb1ef1b5a54, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:50.635480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3ff80-a675-42f3-a55d-d5cacdd9ca67 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:50.667345 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2987/5974] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:45:50 2022] PUT /identity/v3/projects/17383ba856854db48b8e24df1f04e080/users/a9372b6a1aef4015a08dfbb1ef1b5a54/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:50.680207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ffa1f-7b9f-4ef2-83ec-84aa2341e1cb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:50.680673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ffa1f-7b9f-4ef2-83ec-84aa2341e1cb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:50.680767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ffa1f-7b9f-4ef2-83ec-84aa2341e1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:50.777149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-010ffa1f-7b9f-4ef2-83ec-84aa2341e1cb None None] MFA Rules not processed for user `a9372b6a1aef4015a08dfbb1ef1b5a54`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:50.778927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-010ffa1f-7b9f-4ef2-83ec-84aa2341e1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:50.865566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:50.921386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648f9c4-88a2-4692-b7a1-0d212922079f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:50.921699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648f9c4-88a2-4692-b7a1-0d212922079f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:50.921989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648f9c4-88a2-4692-b7a1-0d212922079f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:50.927458 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2988/5975] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:50.960518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e648f9c4-88a2-4692-b7a1-0d212922079f None None] MFA Rules not processed for user `a9372b6a1aef4015a08dfbb1ef1b5a54`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:50.962329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e648f9c4-88a2-4692-b7a1-0d212922079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:50.981463 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2988/5976] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:45:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:45:50.991362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ffa1f-7b9f-4ef2-83ec-84aa2341e1cb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:50.993954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-010ffa1f-7b9f-4ef2-83ec-84aa2341e1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:51.267779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ffa1f-7b9f-4ef2-83ec-84aa2341e1cb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:51.290612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac892593-f6cd-4352-b3a5-145f0daf15a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:51.291278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac892593-f6cd-4352-b3a5-145f0daf15a6 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:51.291601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac892593-f6cd-4352-b3a5-145f0daf15a6 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:51.291876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac892593-f6cd-4352-b3a5-145f0daf15a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:51.321016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac892593-f6cd-4352-b3a5-145f0daf15a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:51.322983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac892593-f6cd-4352-b3a5-145f0daf15a6 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:51.335697 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2989/5977] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:45:56.833930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a8334-0768-4ad3-998b-7bf019131879 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:56.834583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a8334-0768-4ad3-998b-7bf019131879 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:56.834583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a8334-0768-4ad3-998b-7bf019131879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:56.858200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7b9a8334-0768-4ad3-998b-7bf019131879 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:56.859696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7b9a8334-0768-4ad3-998b-7bf019131879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:57.029511 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2989/5978] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:45:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:45:57.088457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac892593-f6cd-4352-b3a5-145f0daf15a6 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:57.089901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ac892593-f6cd-4352-b3a5-145f0daf15a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:57.274928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac892593-f6cd-4352-b3a5-145f0daf15a6 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:57.280879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad5231-c41d-4189-9c58-7b0b53d602f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:57.281665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad5231-c41d-4189-9c58-7b0b53d602f9 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:57.282045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad5231-c41d-4189-9c58-7b0b53d602f9 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:57.282421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad5231-c41d-4189-9c58-7b0b53d602f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:57.293007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad5231-c41d-4189-9c58-7b0b53d602f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:57.294747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad5231-c41d-4189-9c58-7b0b53d602f9 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:57.304752 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2990/5979] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:45:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:45:59.530952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a8334-0768-4ad3-998b-7bf019131879 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:59.534222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7b9a8334-0768-4ad3-998b-7bf019131879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:59.650730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:59.787365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a8334-0768-4ad3-998b-7bf019131879 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:59.805575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d5058-0ffc-4870-9f1b-2bbfee52147a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:59.806222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d5058-0ffc-4870-9f1b-2bbfee52147a service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:59.806540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d5058-0ffc-4870-9f1b-2bbfee52147a service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:59.806827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d5058-0ffc-4870-9f1b-2bbfee52147a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:59.817487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4d6d5058-0ffc-4870-9f1b-2bbfee52147a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:59.851724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d5058-0ffc-4870-9f1b-2bbfee52147a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:59.853719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d5058-0ffc-4870-9f1b-2bbfee52147a service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:59.879008 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2990/5980] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:04.621473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad5231-c41d-4189-9c58-7b0b53d602f9 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:04.623380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-63ad5231-c41d-4189-9c58-7b0b53d602f9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:04.800630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad5231-c41d-4189-9c58-7b0b53d602f9 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:04.806682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91cfc0-35ca-412b-9f4d-e08404cd4b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:04.807686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91cfc0-35ca-412b-9f4d-e08404cd4b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:04.808189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91cfc0-35ca-412b-9f4d-e08404cd4b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:04.809612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91cfc0-35ca-412b-9f4d-e08404cd4b49 admin admin] PATH_INFO: `/v3/users/7836f008e215493e9ecfa511a81579b5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:04.811285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91cfc0-35ca-412b-9f4d-e08404cd4b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7836f008e215493e9ecfa511a81579b5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:04.813813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91cfc0-35ca-412b-9f4d-e08404cd4b49 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:04.822992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:04.938200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fa91cfc0-35ca-412b-9f4d-e08404cd4b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7836f008e215493e9ecfa511a81579b5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:04.959572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fa91cfc0-35ca-412b-9f4d-e08404cd4b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7836f008e215493e9ecfa511a81579b5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:04.962072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fa91cfc0-35ca-412b-9f4d-e08404cd4b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7836f008e215493e9ecfa511a81579b5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:04.962985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fa91cfc0-35ca-412b-9f4d-e08404cd4b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7836f008e215493e9ecfa511a81579b5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:04.977464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fa91cfc0-35ca-412b-9f4d-e08404cd4b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7836f008e215493e9ecfa511a81579b5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:05.012739 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2991/5981] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:04 2022] DELETE /identity/v3/users/7836f008e215493e9ecfa511a81579b5 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:05.017110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4b28-f48a-453f-8ec0-dac571278ae8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:05.017656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4b28-f48a-453f-8ec0-dac571278ae8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:05.017656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4b28-f48a-453f-8ec0-dac571278ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:05.050874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e32b4b28-f48a-453f-8ec0-dac571278ae8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:05.054321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e32b4b28-f48a-453f-8ec0-dac571278ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:05.291786 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2991/5982] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:05.303467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91cfc0-35ca-412b-9f4d-e08404cd4b49 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:05.305546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fa91cfc0-35ca-412b-9f4d-e08404cd4b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:05.463867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91cfc0-35ca-412b-9f4d-e08404cd4b49 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:05.476154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc5252-2793-4d5e-8ff7-277d8b63913d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:05.477242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc5252-2793-4d5e-8ff7-277d8b63913d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:05.477569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc5252-2793-4d5e-8ff7-277d8b63913d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:05.477937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc5252-2793-4d5e-8ff7-277d8b63913d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:05.503979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc5252-2793-4d5e-8ff7-277d8b63913d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:05.505315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc5252-2793-4d5e-8ff7-277d8b63913d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:05.526614 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2992/5983] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:46:06.103557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b4b28-f48a-453f-8ec0-dac571278ae8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:06.105063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e32b4b28-f48a-453f-8ec0-dac571278ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:06.129257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b4b28-f48a-453f-8ec0-dac571278ae8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:06.150740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:06.151810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:06.152101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:06.152374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6 admin admin] PATH_INFO: `/v3/projects/b6ab5a6b32f8449b89c75a8e92277b5d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:06.155695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ab5a6b32f8449b89c75a8e92277b5d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:06.159803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:06.278772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ab5a6b32f8449b89c75a8e92277b5d', 'request_id': 'req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:06.291736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ab5a6b32f8449b89c75a8e92277b5d', 'request_id': 'req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:06.303133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ab5a6b32f8449b89c75a8e92277b5d', 'request_id': 'req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:06.344353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6 admin admin] The token cache is being invalidate because project b6ab5a6b32f8449b89c75a8e92277b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:06.345312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:06.346814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:06.348930 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2992/5984] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:06 2022] DELETE /identity/v3/projects/b6ab5a6b32f8449b89c75a8e92277b5d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:06.353239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc5252-2793-4d5e-8ff7-277d8b63913d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:06.382948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc5252-2793-4d5e-8ff7-277d8b63913d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:06.471098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c15fed-bea7-438f-b970-f0579ebe8574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:06.473030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c15fed-bea7-438f-b970-f0579ebe8574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:06.473319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c15fed-bea7-438f-b970-f0579ebe8574 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:06.473596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c15fed-bea7-438f-b970-f0579ebe8574 admin admin] PATH_INFO: `/v3/users/01a23f29fd6f4f3fa142849a861f07ad` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:06.476520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c15fed-bea7-438f-b970-f0579ebe8574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a23f29fd6f4f3fa142849a861f07ad)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:06.482447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c15fed-bea7-438f-b970-f0579ebe8574 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:06.543600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:06.561211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52c15fed-bea7-438f-b970-f0579ebe8574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a23f29fd6f4f3fa142849a861f07ad'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:06.582125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52c15fed-bea7-438f-b970-f0579ebe8574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a23f29fd6f4f3fa142849a861f07ad'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:06.583202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52c15fed-bea7-438f-b970-f0579ebe8574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a23f29fd6f4f3fa142849a861f07ad'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:06.584001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52c15fed-bea7-438f-b970-f0579ebe8574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a23f29fd6f4f3fa142849a861f07ad'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:06.595518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52c15fed-bea7-438f-b970-f0579ebe8574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a23f29fd6f4f3fa142849a861f07ad'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:06.619954 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2993/5985] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:06 2022] DELETE /identity/v3/users/01a23f29fd6f4f3fa142849a861f07ad => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:46:06.937747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:06.939675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:06.970031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a373a-c5b6-4b42-b9bf-ae9568fffba6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:07.054176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:07.076449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a45c7-c346-4e38-a8dc-5360c322dad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:07.077646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a45c7-c346-4e38-a8dc-5360c322dad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:07.078181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a45c7-c346-4e38-a8dc-5360c322dad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:07.079410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a45c7-c346-4e38-a8dc-5360c322dad3 admin admin] PATH_INFO: `/v3/users/a9372b6a1aef4015a08dfbb1ef1b5a54` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:07.081770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a45c7-c346-4e38-a8dc-5360c322dad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9372b6a1aef4015a08dfbb1ef1b5a54)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:07.084933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a45c7-c346-4e38-a8dc-5360c322dad3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:07.116763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fea7b9-6e58-4a60-b946-89aa6df80058 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:07.117251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fea7b9-6e58-4a60-b946-89aa6df80058 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:07.117747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fea7b9-6e58-4a60-b946-89aa6df80058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:07.170850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c5fea7b9-6e58-4a60-b946-89aa6df80058 None None] MFA Rules not processed for user `185b4855098e46449a5b3e44339e51f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:07.176185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c5fea7b9-6e58-4a60-b946-89aa6df80058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:07.189849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f7a45c7-c346-4e38-a8dc-5360c322dad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9372b6a1aef4015a08dfbb1ef1b5a54'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:07.191037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f7a45c7-c346-4e38-a8dc-5360c322dad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9372b6a1aef4015a08dfbb1ef1b5a54'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:07.214973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f7a45c7-c346-4e38-a8dc-5360c322dad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9372b6a1aef4015a08dfbb1ef1b5a54'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:07.236959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f7a45c7-c346-4e38-a8dc-5360c322dad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9372b6a1aef4015a08dfbb1ef1b5a54'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:07.272255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f7a45c7-c346-4e38-a8dc-5360c322dad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9372b6a1aef4015a08dfbb1ef1b5a54'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:07.290051 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2993/5986] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:06 2022] DELETE /identity/v3/users/a9372b6a1aef4015a08dfbb1ef1b5a54 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:07.291645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a45c7-c346-4e38-a8dc-5360c322dad3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:07.293683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2f7a45c7-c346-4e38-a8dc-5360c322dad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:07.315635 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2994/5987] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:46:07.317096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a8d6d-1963-4d79-b2cc-2e3e4dd7c124 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:07.317493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a8d6d-1963-4d79-b2cc-2e3e4dd7c124 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:07.318308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a8d6d-1963-4d79-b2cc-2e3e4dd7c124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:07.356970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-070a8d6d-1963-4d79-b2cc-2e3e4dd7c124 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:07.358911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-070a8d6d-1963-4d79-b2cc-2e3e4dd7c124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:07.450021 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2995/5988] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:07.476917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a8d6d-1963-4d79-b2cc-2e3e4dd7c124 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:07.478422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-070a8d6d-1963-4d79-b2cc-2e3e4dd7c124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:07.480963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a45c7-c346-4e38-a8dc-5360c322dad3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:07.503469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51043713-9628-4180-9c29-46ab94c44744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:07.504724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51043713-9628-4180-9c29-46ab94c44744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:07.505385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51043713-9628-4180-9c29-46ab94c44744 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:07.505673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51043713-9628-4180-9c29-46ab94c44744 admin admin] PATH_INFO: `/v3/projects/eda6b417d02c4b4fae3c7c7f5f66d4e5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:07.507350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51043713-9628-4180-9c29-46ab94c44744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda6b417d02c4b4fae3c7c7f5f66d4e5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:07.510076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51043713-9628-4180-9c29-46ab94c44744 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:07.584336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51043713-9628-4180-9c29-46ab94c44744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda6b417d02c4b4fae3c7c7f5f66d4e5', 'request_id': 'req-51043713-9628-4180-9c29-46ab94c44744'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:07.597332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51043713-9628-4180-9c29-46ab94c44744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda6b417d02c4b4fae3c7c7f5f66d4e5', 'request_id': 'req-51043713-9628-4180-9c29-46ab94c44744'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:07.609430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51043713-9628-4180-9c29-46ab94c44744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda6b417d02c4b4fae3c7c7f5f66d4e5', 'request_id': 'req-51043713-9628-4180-9c29-46ab94c44744'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:07.616307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:07.639598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51043713-9628-4180-9c29-46ab94c44744 admin admin] The token cache is being invalidate because project eda6b417d02c4b4fae3c7c7f5f66d4e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:07.640957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a8d6d-1963-4d79-b2cc-2e3e4dd7c124 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:07.641478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51043713-9628-4180-9c29-46ab94c44744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:07.643006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51043713-9628-4180-9c29-46ab94c44744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:07.649547 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2994/5989] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:07 2022] DELETE /identity/v3/projects/eda6b417d02c4b4fae3c7c7f5f66d4e5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:07.651145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e4e1f-3399-45b7-aec6-701520c7cc7b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:07.651698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e4e1f-3399-45b7-aec6-701520c7cc7b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:07.651805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e4e1f-3399-45b7-aec6-701520c7cc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:07.652867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:07.694987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-165e4e1f-3399-45b7-aec6-701520c7cc7b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:07.696405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-165e4e1f-3399-45b7-aec6-701520c7cc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:07.771019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951a1e5-5f36-4c63-8746-0306a1222646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:07.775612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951a1e5-5f36-4c63-8746-0306a1222646 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:07.775612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951a1e5-5f36-4c63-8746-0306a1222646 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:07.779303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951a1e5-5f36-4c63-8746-0306a1222646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:07.784264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9951a1e5-5f36-4c63-8746-0306a1222646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:07.861291 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2995/5990] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:07.863943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0358e-d4d8-4d43-a82c-f649cc4c980e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:07.864347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0358e-d4d8-4d43-a82c-f649cc4c980e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:07.864640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0358e-d4d8-4d43-a82c-f649cc4c980e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:07.882688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951a1e5-5f36-4c63-8746-0306a1222646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:07.884439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951a1e5-5f36-4c63-8746-0306a1222646 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:07.915841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-12a0358e-d4d8-4d43-a82c-f649cc4c980e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:07.917169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-12a0358e-d4d8-4d43-a82c-f649cc4c980e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:07.920870 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2996/5991] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:07.943888 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2996/5992] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:46:07.949813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951a1e5-5f36-4c63-8746-0306a1222646 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:07.968736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951a1e5-5f36-4c63-8746-0306a1222646 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:07.983606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a49d79-187d-4d1a-a527-4cfda9224d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:07.984795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a49d79-187d-4d1a-a527-4cfda9224d2e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:07.985325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a49d79-187d-4d1a-a527-4cfda9224d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:07.988005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a49d79-187d-4d1a-a527-4cfda9224d2e admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:07.989057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a49d79-187d-4d1a-a527-4cfda9224d2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:46:07.989640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a49d79-187d-4d1a-a527-4cfda9224d2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:07.992687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a49d79-187d-4d1a-a527-4cfda9224d2e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:08.031418 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2997/5993] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:46:08.036195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0358e-d4d8-4d43-a82c-f649cc4c980e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:08.047099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0358e-d4d8-4d43-a82c-f649cc4c980e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:08.065157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8a107-f153-4d41-91c7-81404acc9c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:08.065858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8a107-f153-4d41-91c7-81404acc9c43 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:08.066139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8a107-f153-4d41-91c7-81404acc9c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:08.066411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8a107-f153-4d41-91c7-81404acc9c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:08.068215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8a107-f153-4d41-91c7-81404acc9c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:08.071607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8a107-f153-4d41-91c7-81404acc9c43 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:08.139610 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2997/5994] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:08 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:46:08.140802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a49d79-187d-4d1a-a527-4cfda9224d2e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:08.171580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a49d79-187d-4d1a-a527-4cfda9224d2e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:08.341039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539f076-abd8-4a17-ba59-82375f50b35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:08.341898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f076-abd8-4a17-ba59-82375f50b35a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:08.343504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f076-abd8-4a17-ba59-82375f50b35a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:08.345024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f076-abd8-4a17-ba59-82375f50b35a admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:08.346474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539f076-abd8-4a17-ba59-82375f50b35a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:08.352765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539f076-abd8-4a17-ba59-82375f50b35a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:08.428328 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2998/5995] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:08 2022] POST /identity/v3/users => generated 291 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:08.429564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8a107-f153-4d41-91c7-81404acc9c43 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:08.455412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8a107-f153-4d41-91c7-81404acc9c43 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:08.473904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f61e4-9f69-48c2-a605-91ff65027480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:08.477893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f61e4-9f69-48c2-a605-91ff65027480 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:08.478195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f61e4-9f69-48c2-a605-91ff65027480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:08.478472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f61e4-9f69-48c2-a605-91ff65027480 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:08.479620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f61e4-9f69-48c2-a605-91ff65027480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:08.485227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f61e4-9f69-48c2-a605-91ff65027480 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:08.519342 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2998/5996] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:46:08.523535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539f076-abd8-4a17-ba59-82375f50b35a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:08.555934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539f076-abd8-4a17-ba59-82375f50b35a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:08.588425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467a4f9-1f69-4588-8840-8bb330354841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:08.591590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467a4f9-1f69-4588-8840-8bb330354841 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:08.592301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467a4f9-1f69-4588-8840-8bb330354841 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:08.592597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467a4f9-1f69-4588-8840-8bb330354841 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:08.593277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467a4f9-1f69-4588-8840-8bb330354841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:08.595168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467a4f9-1f69-4588-8840-8bb330354841 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:08.620824 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2999/5997] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:08.622163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f61e4-9f69-48c2-a605-91ff65027480 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:08.635842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f61e4-9f69-48c2-a605-91ff65027480 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:08.641475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887b5d8-75a7-4de4-b628-cdbf4fe459fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:08.642406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887b5d8-75a7-4de4-b628-cdbf4fe459fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:08.643034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887b5d8-75a7-4de4-b628-cdbf4fe459fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:08.643832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887b5d8-75a7-4de4-b628-cdbf4fe459fb admin admin] PATH_INFO: `/v3/projects/1bbdf0f2c5e74d428cbd232763868729/users/e743bd9900a34e05aaffbbbc8c3eadc9/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:08.697208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887b5d8-75a7-4de4-b628-cdbf4fe459fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbdf0f2c5e74d428cbd232763868729, user_id=e743bd9900a34e05aaffbbbc8c3eadc9, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:08.722449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887b5d8-75a7-4de4-b628-cdbf4fe459fb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:08.777641 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2999/5998] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:08 2022] PUT /identity/v3/projects/1bbdf0f2c5e74d428cbd232763868729/users/e743bd9900a34e05aaffbbbc8c3eadc9/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:46:08.778488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0bae4-ebf8-43e9-8c4b-d503fa3ef58d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:08.778778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0bae4-ebf8-43e9-8c4b-d503fa3ef58d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:08.779057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0bae4-ebf8-43e9-8c4b-d503fa3ef58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:08.808676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887b5d8-75a7-4de4-b628-cdbf4fe459fb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:08.811197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8887b5d8-75a7-4de4-b628-cdbf4fe459fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:08.856935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2fd0bae4-ebf8-43e9-8c4b-d503fa3ef58d None None] MFA Rules not processed for user `e743bd9900a34e05aaffbbbc8c3eadc9`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:08.858540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2fd0bae4-ebf8-43e9-8c4b-d503fa3ef58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:08.891317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:08.978888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887b5d8-75a7-4de4-b628-cdbf4fe459fb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:08.987970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0d6e0-3ff8-45c8-8f42-757d89d1895d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:08.989022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0d6e0-3ff8-45c8-8f42-757d89d1895d service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:08.989635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0d6e0-3ff8-45c8-8f42-757d89d1895d service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:08.990223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0d6e0-3ff8-45c8-8f42-757d89d1895d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:08.995899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-26b0d6e0-3ff8-45c8-8f42-757d89d1895d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:09.014660 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3000/5999] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:46:09.019725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0bae4-ebf8-43e9-8c4b-d503fa3ef58d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:09.021593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0d6e0-3ff8-45c8-8f42-757d89d1895d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:09.023909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0d6e0-3ff8-45c8-8f42-757d89d1895d service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:09.050749 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3000/6000] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:09.051688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0d6e0-3ff8-45c8-8f42-757d89d1895d service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:09.065760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-26b0d6e0-3ff8-45c8-8f42-757d89d1895d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:09.135578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:09.235478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0d6e0-3ff8-45c8-8f42-757d89d1895d service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:09.248743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594568c-542c-4618-9deb-279ad8cf5b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:09.251133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594568c-542c-4618-9deb-279ad8cf5b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:09.252708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594568c-542c-4618-9deb-279ad8cf5b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:09.253631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594568c-542c-4618-9deb-279ad8cf5b4d admin admin] PATH_INFO: `/v3/projects/17383ba856854db48b8e24df1f04e080` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:09.256197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594568c-542c-4618-9deb-279ad8cf5b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=17383ba856854db48b8e24df1f04e080)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:09.260314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0bae4-ebf8-43e9-8c4b-d503fa3ef58d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:09.260797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594568c-542c-4618-9deb-279ad8cf5b4d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:09.272242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cf809-478b-4ec1-9666-c9162e1970a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:09.274164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cf809-478b-4ec1-9666-c9162e1970a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:09.275870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cf809-478b-4ec1-9666-c9162e1970a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:09.276314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cf809-478b-4ec1-9666-c9162e1970a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:09.279639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cf809-478b-4ec1-9666-c9162e1970a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:09.289227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cf809-478b-4ec1-9666-c9162e1970a4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:09.359667 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3001/6001] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:09 2022] POST /identity/v3/projects => generated 383 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:09.361098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca1338-d01b-4352-8005-4fd551fcf57a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:09.361460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca1338-d01b-4352-8005-4fd551fcf57a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:09.361742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca1338-d01b-4352-8005-4fd551fcf57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:09.386981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-49ca1338-d01b-4352-8005-4fd551fcf57a None None] MFA Rules not processed for user `185b4855098e46449a5b3e44339e51f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:09.388794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-49ca1338-d01b-4352-8005-4fd551fcf57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:09.441313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3594568c-542c-4618-9deb-279ad8cf5b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17383ba856854db48b8e24df1f04e080', 'request_id': 'req-3594568c-542c-4618-9deb-279ad8cf5b4d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:09.463177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3594568c-542c-4618-9deb-279ad8cf5b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17383ba856854db48b8e24df1f04e080', 'request_id': 'req-3594568c-542c-4618-9deb-279ad8cf5b4d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:09.483030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3594568c-542c-4618-9deb-279ad8cf5b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17383ba856854db48b8e24df1f04e080', 'request_id': 'req-3594568c-542c-4618-9deb-279ad8cf5b4d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:09.502060 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3002/6002] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:09.502963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca1338-d01b-4352-8005-4fd551fcf57a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:09.515131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3594568c-542c-4618-9deb-279ad8cf5b4d admin admin] The token cache is being invalidate because project 17383ba856854db48b8e24df1f04e080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:09.515707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3594568c-542c-4618-9deb-279ad8cf5b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:09.517620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3594568c-542c-4618-9deb-279ad8cf5b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:09.520871 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3001/6003] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:09 2022] DELETE /identity/v3/projects/17383ba856854db48b8e24df1f04e080 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:09.523108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594568c-542c-4618-9deb-279ad8cf5b4d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:09.532524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3594568c-542c-4618-9deb-279ad8cf5b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:09.659642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:09.723650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca1338-d01b-4352-8005-4fd551fcf57a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:09.752173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594568c-542c-4618-9deb-279ad8cf5b4d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:09.769259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5667c76-2880-4f4a-a73a-cc0ddeadf8dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:09.770110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5667c76-2880-4f4a-a73a-cc0ddeadf8dc service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:09.770889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5667c76-2880-4f4a-a73a-cc0ddeadf8dc service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:09.771643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5667c76-2880-4f4a-a73a-cc0ddeadf8dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:09.774894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a5667c76-2880-4f4a-a73a-cc0ddeadf8dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:09.810318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5667c76-2880-4f4a-a73a-cc0ddeadf8dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:09.813269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5667c76-2880-4f4a-a73a-cc0ddeadf8dc service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:09.845994 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3002/6004] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:09.848531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa75c81-4711-4541-8e7f-a0de701a4430 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:09.848834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa75c81-4711-4541-8e7f-a0de701a4430 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:09.849118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa75c81-4711-4541-8e7f-a0de701a4430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:09.890310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56894bc3-a6b0-4ed7-847f-0edb177b8a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:09.891082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56894bc3-a6b0-4ed7-847f-0edb177b8a7c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:09.891438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56894bc3-a6b0-4ed7-847f-0edb177b8a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:09.891719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56894bc3-a6b0-4ed7-847f-0edb177b8a7c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:09.892406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56894bc3-a6b0-4ed7-847f-0edb177b8a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:09.898582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56894bc3-a6b0-4ed7-847f-0edb177b8a7c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:09.900470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9aa75c81-4711-4541-8e7f-a0de701a4430 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:09.901720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9aa75c81-4711-4541-8e7f-a0de701a4430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:09.937000 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3003/6005] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:09.944928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7db49-9eb1-40eb-a04d-979a7c53c084 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:09.945273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7db49-9eb1-40eb-a04d-979a7c53c084 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:09.945586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7db49-9eb1-40eb-a04d-979a7c53c084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:09.962919 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3003/6006] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:09 2022] POST /identity/v3/users => generated 298 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:09.967924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56894bc3-a6b0-4ed7-847f-0edb177b8a7c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:09.971908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-56894bc3-a6b0-4ed7-847f-0edb177b8a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:09.992551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-16d7db49-9eb1-40eb-a04d-979a7c53c084 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:09.993802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-16d7db49-9eb1-40eb-a04d-979a7c53c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:09.998210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56894bc3-a6b0-4ed7-847f-0edb177b8a7c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:10.005183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9057c-8df0-4fd3-b49c-fdbc6e3a4ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:10.006130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9057c-8df0-4fd3-b49c-fdbc6e3a4ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:10.006559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9057c-8df0-4fd3-b49c-fdbc6e3a4ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:10.006943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9057c-8df0-4fd3-b49c-fdbc6e3a4ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:10.007752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9057c-8df0-4fd3-b49c-fdbc6e3a4ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:10.009621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9057c-8df0-4fd3-b49c-fdbc6e3a4ee0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:10.026963 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3004/6007] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:10.027999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9057c-8df0-4fd3-b49c-fdbc6e3a4ee0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:10.040268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9057c-8df0-4fd3-b49c-fdbc6e3a4ee0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:10.047299 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3004/6008] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:10.048402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7db49-9eb1-40eb-a04d-979a7c53c084 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:10.049342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393c1d7-9722-4f14-aec9-e3b093d661d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:10.050331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393c1d7-9722-4f14-aec9-e3b093d661d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:10.050836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393c1d7-9722-4f14-aec9-e3b093d661d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:10.051458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393c1d7-9722-4f14-aec9-e3b093d661d0 admin admin] PATH_INFO: `/v3/projects/f531a89f75784ce28bc1de6e6acfebbc/users/4756cfe0bf374a449c8c181e250743f8/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:10.090642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393c1d7-9722-4f14-aec9-e3b093d661d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f531a89f75784ce28bc1de6e6acfebbc, user_id=4756cfe0bf374a449c8c181e250743f8, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:10.090907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7db49-9eb1-40eb-a04d-979a7c53c084 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:10.094307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393c1d7-9722-4f14-aec9-e3b093d661d0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:10.097198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0df89-d7ef-4577-8eb5-05069f8b5653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:10.097996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0df89-d7ef-4577-8eb5-05069f8b5653 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:10.098111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0df89-d7ef-4577-8eb5-05069f8b5653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:10.098381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0df89-d7ef-4577-8eb5-05069f8b5653 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:10.099299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0df89-d7ef-4577-8eb5-05069f8b5653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:46:10.099799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0df89-d7ef-4577-8eb5-05069f8b5653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:10.101425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0df89-d7ef-4577-8eb5-05069f8b5653 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:10.130379 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3005/6009] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:10 2022] PUT /identity/v3/projects/f531a89f75784ce28bc1de6e6acfebbc/users/4756cfe0bf374a449c8c181e250743f8/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:10.131735 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3005/6010] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:46:10.134328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393c1d7-9722-4f14-aec9-e3b093d661d0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:10.138079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0df89-d7ef-4577-8eb5-05069f8b5653 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:10.163660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0df89-d7ef-4577-8eb5-05069f8b5653 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:10.197657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:10.350501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393c1d7-9722-4f14-aec9-e3b093d661d0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:10.365039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb67f7-823f-4a7d-843a-b700ff6accf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:10.366406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb67f7-823f-4a7d-843a-b700ff6accf1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:10.366708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb67f7-823f-4a7d-843a-b700ff6accf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:10.366993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb67f7-823f-4a7d-843a-b700ff6accf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:10.367771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb67f7-823f-4a7d-843a-b700ff6accf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:10.370261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb67f7-823f-4a7d-843a-b700ff6accf1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:10.387116 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3006/6011] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:46:10.389725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167f9bc-4fdb-4ae1-bc1c-1edd762a25c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:10.390632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167f9bc-4fdb-4ae1-bc1c-1edd762a25c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:10.391956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb67f7-823f-4a7d-843a-b700ff6accf1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:10.393576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167f9bc-4fdb-4ae1-bc1c-1edd762a25c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:10.394090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167f9bc-4fdb-4ae1-bc1c-1edd762a25c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:10.394974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167f9bc-4fdb-4ae1-bc1c-1edd762a25c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:10.399013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167f9bc-4fdb-4ae1-bc1c-1edd762a25c2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:10.430488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb67f7-823f-4a7d-843a-b700ff6accf1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:10.445606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be831c-b8e5-449a-8797-3bf42494725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:10.446336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be831c-b8e5-449a-8797-3bf42494725f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:10.446622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be831c-b8e5-449a-8797-3bf42494725f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:10.449227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be831c-b8e5-449a-8797-3bf42494725f admin admin] PATH_INFO: `/v3/projects/f531a89f75784ce28bc1de6e6acfebbc/users/4756cfe0bf374a449c8c181e250743f8/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:10.455974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be831c-b8e5-449a-8797-3bf42494725f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f531a89f75784ce28bc1de6e6acfebbc, user_id=4756cfe0bf374a449c8c181e250743f8, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:10.463824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be831c-b8e5-449a-8797-3bf42494725f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:10.464464 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3006/6012] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:10 2022] POST /identity/v3/projects => generated 383 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:10.473820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167f9bc-4fdb-4ae1-bc1c-1edd762a25c2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:10.494076 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3007/6013] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:10 2022] PUT /identity/v3/projects/f531a89f75784ce28bc1de6e6acfebbc/users/4756cfe0bf374a449c8c181e250743f8/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:10.505754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09f8a1-b997-4dda-8ae0-71daa251cda4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:10.506322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09f8a1-b997-4dda-8ae0-71daa251cda4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:10.507713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09f8a1-b997-4dda-8ae0-71daa251cda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:10.610649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-da09f8a1-b997-4dda-8ae0-71daa251cda4 None None] MFA Rules not processed for user `4756cfe0bf374a449c8c181e250743f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:10.617269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-da09f8a1-b997-4dda-8ae0-71daa251cda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:10.661247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167f9bc-4fdb-4ae1-bc1c-1edd762a25c2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:10.664845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:10.786608 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3008/6014] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:10.799512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09f8a1-b997-4dda-8ae0-71daa251cda4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:10.801667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-da09f8a1-b997-4dda-8ae0-71daa251cda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:10.827914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8808dd6-2c40-45b4-adce-77870503a145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:10.828793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8808dd6-2c40-45b4-adce-77870503a145 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:10.829704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8808dd6-2c40-45b4-adce-77870503a145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:10.830149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8808dd6-2c40-45b4-adce-77870503a145 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:10.831112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8808dd6-2c40-45b4-adce-77870503a145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:10.833408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8808dd6-2c40-45b4-adce-77870503a145 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:10.877531 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3007/6015] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:10 2022] POST /identity/v3/users => generated 292 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:10.891049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8808dd6-2c40-45b4-adce-77870503a145 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:10.920365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8808dd6-2c40-45b4-adce-77870503a145 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:10.953388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf7843-1177-426b-b9f3-75166639df01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:10.957635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf7843-1177-426b-b9f3-75166639df01 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:10.958222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf7843-1177-426b-b9f3-75166639df01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:10.958688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf7843-1177-426b-b9f3-75166639df01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:10.959634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf7843-1177-426b-b9f3-75166639df01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:10.965879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09f8a1-b997-4dda-8ae0-71daa251cda4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:10.977011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf7843-1177-426b-b9f3-75166639df01 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:10.977668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aefe6-8e9f-4d07-8783-7d7030189baa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:10.978240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aefe6-8e9f-4d07-8783-7d7030189baa service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:10.978521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aefe6-8e9f-4d07-8783-7d7030189baa service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:10.978799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aefe6-8e9f-4d07-8783-7d7030189baa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:11.003735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2aefe6-8e9f-4d07-8783-7d7030189baa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:11.005339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2aefe6-8e9f-4d07-8783-7d7030189baa service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:11.024460 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3008/6016] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:11.028715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf7843-1177-426b-b9f3-75166639df01 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:11.042241 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3009/6017] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:46:11.042923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf7843-1177-426b-b9f3-75166639df01 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:11.051680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdccf6-1661-4bfd-9bc7-f391e9db6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:11.052784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdccf6-1661-4bfd-9bc7-f391e9db6cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:11.053582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdccf6-1661-4bfd-9bc7-f391e9db6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:11.054530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdccf6-1661-4bfd-9bc7-f391e9db6cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:11.055804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdccf6-1661-4bfd-9bc7-f391e9db6cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:11.058387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdccf6-1661-4bfd-9bc7-f391e9db6cf3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:11.074175 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3009/6018] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:11.079453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aefe6-8e9f-4d07-8783-7d7030189baa service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:11.095828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aefe6-8e9f-4d07-8783-7d7030189baa service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:11.104266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59015667-1f08-4610-9b30-0365d5231ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:11.105047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59015667-1f08-4610-9b30-0365d5231ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:11.105329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59015667-1f08-4610-9b30-0365d5231ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:11.105655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59015667-1f08-4610-9b30-0365d5231ee5 admin admin] PATH_INFO: `/v3/projects/933aaab625964ac3b792df3abb084ead/users/415da9ea735b4b79b866334a7ae6ff4e/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:11.144430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59015667-1f08-4610-9b30-0365d5231ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=933aaab625964ac3b792df3abb084ead, user_id=415da9ea735b4b79b866334a7ae6ff4e, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:11.148902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59015667-1f08-4610-9b30-0365d5231ee5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:11.186729 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3010/6019] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:11 2022] PUT /identity/v3/projects/933aaab625964ac3b792df3abb084ead/users/415da9ea735b4b79b866334a7ae6ff4e/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:11.189487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca06a9d-2142-458f-9572-733ba10c40b2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:11.192468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca06a9d-2142-458f-9572-733ba10c40b2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:11.194301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca06a9d-2142-458f-9572-733ba10c40b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:11.265090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59015667-1f08-4610-9b30-0365d5231ee5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:11.281224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aca06a9d-2142-458f-9572-733ba10c40b2 None None] MFA Rules not processed for user `415da9ea735b4b79b866334a7ae6ff4e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:11.283728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aca06a9d-2142-458f-9572-733ba10c40b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:11.289180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:11.404634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59015667-1f08-4610-9b30-0365d5231ee5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:11.411376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4f82d-56c3-4d7c-bb5a-f913216d26d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:11.412827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4f82d-56c3-4d7c-bb5a-f913216d26d6 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:11.413183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4f82d-56c3-4d7c-bb5a-f913216d26d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:11.413525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4f82d-56c3-4d7c-bb5a-f913216d26d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:11.415563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-77b4f82d-56c3-4d7c-bb5a-f913216d26d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:11.421120 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3010/6020] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:11.427027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca06a9d-2142-458f-9572-733ba10c40b2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:11.548047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:11.574152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca06a9d-2142-458f-9572-733ba10c40b2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:11.582401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb3830-33cd-4dbb-8468-edb9fdca5e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:11.584079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb3830-33cd-4dbb-8468-edb9fdca5e2f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:11.584491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb3830-33cd-4dbb-8468-edb9fdca5e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:11.584650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb3830-33cd-4dbb-8468-edb9fdca5e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:11.585908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb3830-33cd-4dbb-8468-edb9fdca5e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:11.588696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb3830-33cd-4dbb-8468-edb9fdca5e2f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:11.601625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4f82d-56c3-4d7c-bb5a-f913216d26d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:11.603739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4f82d-56c3-4d7c-bb5a-f913216d26d6 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:11.637551 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3011/6021] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:11 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:46:11.639943 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3011/6022] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:11.641760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb3830-33cd-4dbb-8468-edb9fdca5e2f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:11.800785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb3830-33cd-4dbb-8468-edb9fdca5e2f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:11.808616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64e0c6-eab7-4945-973c-11d42e4080e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:11.809683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64e0c6-eab7-4945-973c-11d42e4080e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:11.810168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64e0c6-eab7-4945-973c-11d42e4080e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:11.810656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64e0c6-eab7-4945-973c-11d42e4080e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:11.811960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64e0c6-eab7-4945-973c-11d42e4080e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:11.827786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64e0c6-eab7-4945-973c-11d42e4080e3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:11.884876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4f82d-56c3-4d7c-bb5a-f913216d26d6 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:11.892677 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3012/6023] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:11 2022] POST /identity/v3/users => generated 300 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:11.900235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4f82d-56c3-4d7c-bb5a-f913216d26d6 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:11.909531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83b391-24e3-4cad-bad9-7162cf3661e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:11.910173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83b391-24e3-4cad-bad9-7162cf3661e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:11.910645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83b391-24e3-4cad-bad9-7162cf3661e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:11.912194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83b391-24e3-4cad-bad9-7162cf3661e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:11.913074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83b391-24e3-4cad-bad9-7162cf3661e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:11.916239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83b391-24e3-4cad-bad9-7162cf3661e9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:11.937946 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3012/6024] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:11.942448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64e0c6-eab7-4945-973c-11d42e4080e3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:11.962503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64e0c6-eab7-4945-973c-11d42e4080e3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:11.962503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6566a2b-fdea-44e9-8f7b-7822baa5c18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:11.963053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6566a2b-fdea-44e9-8f7b-7822baa5c18b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:11.963538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6566a2b-fdea-44e9-8f7b-7822baa5c18b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:11.964216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6566a2b-fdea-44e9-8f7b-7822baa5c18b admin admin] PATH_INFO: `/v3/projects/afd9e5b69b5144819fdea121c5b19d28/users/aa97b682ae064b20ba44aa612a5ea60a/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:11.992435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6566a2b-fdea-44e9-8f7b-7822baa5c18b admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd9e5b69b5144819fdea121c5b19d28, user_id=aa97b682ae064b20ba44aa612a5ea60a, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:11.997131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6566a2b-fdea-44e9-8f7b-7822baa5c18b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:12.001876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:12.017354 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3013/6025] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:11 2022] PUT /identity/v3/projects/afd9e5b69b5144819fdea121c5b19d28/users/aa97b682ae064b20ba44aa612a5ea60a/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:46:12.021371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83b391-24e3-4cad-bad9-7162cf3661e9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:12.047156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83b391-24e3-4cad-bad9-7162cf3661e9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:12.231820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25325f4-ca9b-4b38-8539-33d1baad7971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:12.234741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25325f4-ca9b-4b38-8539-33d1baad7971 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:12.235274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25325f4-ca9b-4b38-8539-33d1baad7971 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:12.235733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25325f4-ca9b-4b38-8539-33d1baad7971 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:12.236509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25325f4-ca9b-4b38-8539-33d1baad7971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:12.240687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25325f4-ca9b-4b38-8539-33d1baad7971 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:12.282414 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3013/6026] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:12.284148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6566a2b-fdea-44e9-8f7b-7822baa5c18b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:12.299011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6566a2b-fdea-44e9-8f7b-7822baa5c18b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:12.309412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cea69-a9f8-4e05-8fdb-98c7d7260a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:12.311485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cea69-a9f8-4e05-8fdb-98c7d7260a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:12.312691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cea69-a9f8-4e05-8fdb-98c7d7260a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:12.313330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cea69-a9f8-4e05-8fdb-98c7d7260a03 admin admin] PATH_INFO: `/v3/projects/afd9e5b69b5144819fdea121c5b19d28/users/aa97b682ae064b20ba44aa612a5ea60a/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:12.332325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cea69-a9f8-4e05-8fdb-98c7d7260a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd9e5b69b5144819fdea121c5b19d28, user_id=aa97b682ae064b20ba44aa612a5ea60a, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:12.351714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cea69-a9f8-4e05-8fdb-98c7d7260a03 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:12.375109 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3014/6027] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:12 2022] PUT /identity/v3/projects/afd9e5b69b5144819fdea121c5b19d28/users/aa97b682ae064b20ba44aa612a5ea60a/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:12.389193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f77cb3-5be1-4b8e-8d0a-56d4c75e69b9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:12.389580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f77cb3-5be1-4b8e-8d0a-56d4c75e69b9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:12.389962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f77cb3-5be1-4b8e-8d0a-56d4c75e69b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:12.465717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-45f77cb3-5be1-4b8e-8d0a-56d4c75e69b9 None None] MFA Rules not processed for user `aa97b682ae064b20ba44aa612a5ea60a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:12.467156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-45f77cb3-5be1-4b8e-8d0a-56d4c75e69b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:12.597215 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3014/6028] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:12.603857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cea69-a9f8-4e05-8fdb-98c7d7260a03 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:12.615470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cea69-a9f8-4e05-8fdb-98c7d7260a03 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:12.624081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376dc39-ba17-4bd4-932e-7484f84c2e09 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa97b682ae064b20ba44aa612a5ea60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd9e5b69b5144819fdea121c5b19d28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:12.624724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376dc39-ba17-4bd4-932e-7484f84c2e09 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:12.625013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376dc39-ba17-4bd4-932e-7484f84c2e09 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:12.625295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376dc39-ba17-4bd4-932e-7484f84c2e09 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:12.626471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376dc39-ba17-4bd4-932e-7484f84c2e09 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:12.630408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376dc39-ba17-4bd4-932e-7484f84c2e09 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:12.719348 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3015/6029] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:12 2022] POST /identity/v3/projects => generated 360 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:12.720708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f77cb3-5be1-4b8e-8d0a-56d4c75e69b9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:12.734268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f77cb3-5be1-4b8e-8d0a-56d4c75e69b9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:12.860209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:12.879480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00a36c-553c-4aa7-b57d-4aacf6e47944 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa97b682ae064b20ba44aa612a5ea60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd9e5b69b5144819fdea121c5b19d28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:12.880181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00a36c-553c-4aa7-b57d-4aacf6e47944 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:12.880464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00a36c-553c-4aa7-b57d-4aacf6e47944 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:12.880738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00a36c-553c-4aa7-b57d-4aacf6e47944 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] PATH_INFO: `/v3/projects/528afd6219174d2982489af715a60bdc/tags/tempest-tag-907647804` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:12.889097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00a36c-553c-4aa7-b57d-4aacf6e47944 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=528afd6219174d2982489af715a60bdc, value=tempest-tag-907647804)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:12.891355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00a36c-553c-4aa7-b57d-4aacf6e47944 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:12.982454 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-3b00a36c-553c-4aa7-b57d-4aacf6e47944 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-907647804. To ensure interoperability, identifiers should be a valid uuid. Aug 28 18:46:12.982454 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 18:46:12.982454 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:46:13.006685 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3015/6030] 10.222.0.27 () {60 vars in 1330 bytes} [Sun Aug 28 18:46:12 2022] PUT /identity/v3/projects/528afd6219174d2982489af715a60bdc/tags/tempest-tag-907647804 => generated 0 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) Aug 28 18:46:13.007992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376dc39-ba17-4bd4-932e-7484f84c2e09 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:13.029502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376dc39-ba17-4bd4-932e-7484f84c2e09 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:13.043757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fad0e-a6f9-42f1-a19e-42c0e83f905d tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa97b682ae064b20ba44aa612a5ea60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd9e5b69b5144819fdea121c5b19d28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:13.044904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fad0e-a6f9-42f1-a19e-42c0e83f905d tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:13.045545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fad0e-a6f9-42f1-a19e-42c0e83f905d tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:13.046454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fad0e-a6f9-42f1-a19e-42c0e83f905d tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] PATH_INFO: `/v3/projects/528afd6219174d2982489af715a60bdc/tags/tempest-tag-907647804` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:13.076604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fad0e-a6f9-42f1-a19e-42c0e83f905d tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=528afd6219174d2982489af715a60bdc, value=tempest-tag-907647804)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:13.082764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fad0e-a6f9-42f1-a19e-42c0e83f905d tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:13.127179 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3016/6031] 10.222.0.27 () {58 vars in 1311 bytes} [Sun Aug 28 18:46:13 2022] GET /identity/v3/projects/528afd6219174d2982489af715a60bdc/tags/tempest-tag-907647804 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:46:13.132078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00a36c-553c-4aa7-b57d-4aacf6e47944 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:13.157660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00a36c-553c-4aa7-b57d-4aacf6e47944 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:13.167451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36559b-5f72-40ca-8fd2-1711672019b5 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa97b682ae064b20ba44aa612a5ea60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd9e5b69b5144819fdea121c5b19d28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:13.169640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36559b-5f72-40ca-8fd2-1711672019b5 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:13.169929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36559b-5f72-40ca-8fd2-1711672019b5 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:13.172789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36559b-5f72-40ca-8fd2-1711672019b5 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] PATH_INFO: `/v3/projects/528afd6219174d2982489af715a60bdc/tags` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:13.187279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36559b-5f72-40ca-8fd2-1711672019b5 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=528afd6219174d2982489af715a60bdc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:13.196756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36559b-5f72-40ca-8fd2-1711672019b5 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:13.333317 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3016/6032] 10.222.0.27 () {60 vars in 1265 bytes} [Sun Aug 28 18:46:13 2022] PUT /identity/v3/projects/528afd6219174d2982489af715a60bdc/tags => generated 140 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:46:13.338083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fad0e-a6f9-42f1-a19e-42c0e83f905d tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:13.371562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fad0e-a6f9-42f1-a19e-42c0e83f905d tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:13.408913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c064e3-893c-484c-9869-e2d6821f49d5 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa97b682ae064b20ba44aa612a5ea60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd9e5b69b5144819fdea121c5b19d28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:13.412862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c064e3-893c-484c-9869-e2d6821f49d5 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:13.418661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c064e3-893c-484c-9869-e2d6821f49d5 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:13.419103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c064e3-893c-484c-9869-e2d6821f49d5 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] PATH_INFO: `/v3/projects/528afd6219174d2982489af715a60bdc/tags` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:13.464076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c064e3-893c-484c-9869-e2d6821f49d5 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=528afd6219174d2982489af715a60bdc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:13.466663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c064e3-893c-484c-9869-e2d6821f49d5 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:13.498521 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3017/6033] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Aug 28 18:46:13 2022] GET /identity/v3/projects/528afd6219174d2982489af715a60bdc/tags => generated 140 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:46:13.509457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36559b-5f72-40ca-8fd2-1711672019b5 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:13.538769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36559b-5f72-40ca-8fd2-1711672019b5 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:13.549588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f52c9c-9fa9-46d0-a159-4b6d95b7136b tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa97b682ae064b20ba44aa612a5ea60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd9e5b69b5144819fdea121c5b19d28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:13.550270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f52c9c-9fa9-46d0-a159-4b6d95b7136b tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:13.550555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f52c9c-9fa9-46d0-a159-4b6d95b7136b tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:13.550834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f52c9c-9fa9-46d0-a159-4b6d95b7136b tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] PATH_INFO: `/v3/projects/528afd6219174d2982489af715a60bdc/tags/tempest-tag-649809127` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:13.560709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f52c9c-9fa9-46d0-a159-4b6d95b7136b tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=528afd6219174d2982489af715a60bdc, value=tempest-tag-649809127)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:13.562917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f52c9c-9fa9-46d0-a159-4b6d95b7136b tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:13.805707 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-c4f52c9c-9fa9-46d0-a159-4b6d95b7136b tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-649809127. To ensure interoperability, identifiers should be a valid uuid. Aug 28 18:46:13.805707 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 18:46:13.805707 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:46:13.820059 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3017/6034] 10.222.0.27 () {58 vars in 1314 bytes} [Sun Aug 28 18:46:13 2022] DELETE /identity/v3/projects/528afd6219174d2982489af715a60bdc/tags/tempest-tag-649809127 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:13.820810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c064e3-893c-484c-9869-e2d6821f49d5 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:13.843906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c064e3-893c-484c-9869-e2d6821f49d5 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:13.867029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6d90c-ff34-4513-85d2-b4c0b4bd5bea tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa97b682ae064b20ba44aa612a5ea60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd9e5b69b5144819fdea121c5b19d28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:13.867755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6d90c-ff34-4513-85d2-b4c0b4bd5bea tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:13.868045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6d90c-ff34-4513-85d2-b4c0b4bd5bea tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:13.868456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6d90c-ff34-4513-85d2-b4c0b4bd5bea tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] PATH_INFO: `/v3/projects/528afd6219174d2982489af715a60bdc/tags/tempest-tag-649809127` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:13.922198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6d90c-ff34-4513-85d2-b4c0b4bd5bea tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=528afd6219174d2982489af715a60bdc, value=tempest-tag-649809127)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:13.936281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6d90c-ff34-4513-85d2-b4c0b4bd5bea tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:13.977241 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-36b6d90c-ff34-4513-85d2-b4c0b4bd5bea tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Could not find project tag: tempest-tag-649809127.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-649809127. Aug 28 18:46:13.977241 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:46:13.977241 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:46:13.977241 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:46:13.977241 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:46:13.977241 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:46:13.977241 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:46:13.977241 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:46:13.977241 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:46:13.977241 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:46:13.977241 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:46:13.977241 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:46:13.977241 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Aug 28 18:46:13.977241 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Aug 28 18:46:13.978683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:46:13.978683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:46:13.978683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Aug 28 18:46:13.978683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Aug 28 18:46:13.978683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-649809127. Aug 28 18:46:13.978683 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:46:13.981971 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3018/6035] 10.222.0.27 () {58 vars in 1311 bytes} [Sun Aug 28 18:46:13 2022] GET /identity/v3/projects/528afd6219174d2982489af715a60bdc/tags/tempest-tag-649809127 => generated 106 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:46:13.985849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f52c9c-9fa9-46d0-a159-4b6d95b7136b tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:14.001854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f52c9c-9fa9-46d0-a159-4b6d95b7136b tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:14.010081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fdf84-6d90-42e7-9617-8d95d47692f6 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa97b682ae064b20ba44aa612a5ea60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd9e5b69b5144819fdea121c5b19d28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:14.012450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fdf84-6d90-42e7-9617-8d95d47692f6 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:14.013072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fdf84-6d90-42e7-9617-8d95d47692f6 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:14.013632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fdf84-6d90-42e7-9617-8d95d47692f6 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] PATH_INFO: `/v3/projects/528afd6219174d2982489af715a60bdc/tags` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:14.030662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fdf84-6d90-42e7-9617-8d95d47692f6 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=528afd6219174d2982489af715a60bdc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:14.036320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fdf84-6d90-42e7-9617-8d95d47692f6 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:14.107636 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3018/6036] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Aug 28 18:46:13 2022] DELETE /identity/v3/projects/528afd6219174d2982489af715a60bdc/tags => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:46:14.109115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6d90c-ff34-4513-85d2-b4c0b4bd5bea tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:14.120649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6d90c-ff34-4513-85d2-b4c0b4bd5bea tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:14.127936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459f3d0-8fcb-4a43-a9f6-80ba39af6d29 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa97b682ae064b20ba44aa612a5ea60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd9e5b69b5144819fdea121c5b19d28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:14.129947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459f3d0-8fcb-4a43-a9f6-80ba39af6d29 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:14.130676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459f3d0-8fcb-4a43-a9f6-80ba39af6d29 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:14.132566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459f3d0-8fcb-4a43-a9f6-80ba39af6d29 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] PATH_INFO: `/v3/projects/528afd6219174d2982489af715a60bdc/tags` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:14.154222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459f3d0-8fcb-4a43-a9f6-80ba39af6d29 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=528afd6219174d2982489af715a60bdc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:14.157983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459f3d0-8fcb-4a43-a9f6-80ba39af6d29 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:14.185061 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3019/6037] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Aug 28 18:46:14 2022] GET /identity/v3/projects/528afd6219174d2982489af715a60bdc/tags => generated 66 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 18:46:14.189101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fdf84-6d90-42e7-9617-8d95d47692f6 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:14.204892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fdf84-6d90-42e7-9617-8d95d47692f6 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:14.215975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238229ab-93c3-4716-a65a-b685cb41225c tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa97b682ae064b20ba44aa612a5ea60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd9e5b69b5144819fdea121c5b19d28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:14.216868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238229ab-93c3-4716-a65a-b685cb41225c tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:14.217307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238229ab-93c3-4716-a65a-b685cb41225c tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:14.217740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238229ab-93c3-4716-a65a-b685cb41225c tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] PATH_INFO: `/v3/projects/528afd6219174d2982489af715a60bdc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:14.219233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238229ab-93c3-4716-a65a-b685cb41225c tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorizing `identity:delete_project(project_id=528afd6219174d2982489af715a60bdc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:14.221028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238229ab-93c3-4716-a65a-b685cb41225c tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:14.294747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-238229ab-93c3-4716-a65a-b685cb41225c tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '528afd6219174d2982489af715a60bdc', 'request_id': 'req-238229ab-93c3-4716-a65a-b685cb41225c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:14.296370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:14.307975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-238229ab-93c3-4716-a65a-b685cb41225c tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '528afd6219174d2982489af715a60bdc', 'request_id': 'req-238229ab-93c3-4716-a65a-b685cb41225c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:14.318020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-238229ab-93c3-4716-a65a-b685cb41225c tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '528afd6219174d2982489af715a60bdc', 'request_id': 'req-238229ab-93c3-4716-a65a-b685cb41225c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:14.343868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-238229ab-93c3-4716-a65a-b685cb41225c tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] The token cache is being invalidate because project 528afd6219174d2982489af715a60bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:14.345680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-238229ab-93c3-4716-a65a-b685cb41225c tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:14.347423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-238229ab-93c3-4716-a65a-b685cb41225c tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:14.351185 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3019/6038] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:14 2022] DELETE /identity/v3/projects/528afd6219174d2982489af715a60bdc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:14.356252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459f3d0-8fcb-4a43-a9f6-80ba39af6d29 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:14.358276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d459f3d0-8fcb-4a43-a9f6-80ba39af6d29 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:14.608050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459f3d0-8fcb-4a43-a9f6-80ba39af6d29 tempest-IdentityV3ProjectTagsTest-1590543250 tempest-IdentityV3ProjectTagsTest-1590543250-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:14.782118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:14.879872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7558a-6193-4c72-94a2-017e30da744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:14.881468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7558a-6193-4c72-94a2-017e30da744e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:14.881940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7558a-6193-4c72-94a2-017e30da744e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:14.882406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7558a-6193-4c72-94a2-017e30da744e admin admin] PATH_INFO: `/v3/users/415da9ea735b4b79b866334a7ae6ff4e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:14.883753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7558a-6193-4c72-94a2-017e30da744e admin admin] RBAC: Authorizing `identity:delete_user(user_id=415da9ea735b4b79b866334a7ae6ff4e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:14.885825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7558a-6193-4c72-94a2-017e30da744e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:14.956755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cba7558a-6193-4c72-94a2-017e30da744e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '415da9ea735b4b79b866334a7ae6ff4e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:14.957872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cba7558a-6193-4c72-94a2-017e30da744e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '415da9ea735b4b79b866334a7ae6ff4e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:14.967021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cba7558a-6193-4c72-94a2-017e30da744e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '415da9ea735b4b79b866334a7ae6ff4e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:14.983602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cba7558a-6193-4c72-94a2-017e30da744e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '415da9ea735b4b79b866334a7ae6ff4e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:15.015146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cba7558a-6193-4c72-94a2-017e30da744e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '415da9ea735b4b79b866334a7ae6ff4e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:15.026318 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3020/6039] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:14 2022] DELETE /identity/v3/users/415da9ea735b4b79b866334a7ae6ff4e => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:15.031771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d196ee-e2c4-4a91-b9f7-e912b8119ad2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:15.032740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d196ee-e2c4-4a91-b9f7-e912b8119ad2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:15.033373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d196ee-e2c4-4a91-b9f7-e912b8119ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:15.062511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-52d196ee-e2c4-4a91-b9f7-e912b8119ad2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:15.065773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-52d196ee-e2c4-4a91-b9f7-e912b8119ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:15.256780 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3020/6040] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:46:15.307506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7558a-6193-4c72-94a2-017e30da744e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:15.309898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cba7558a-6193-4c72-94a2-017e30da744e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:15.500541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7558a-6193-4c72-94a2-017e30da744e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:15.513905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed82ec-7695-4c34-a388-0ff4198c0608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:15.514401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed82ec-7695-4c34-a388-0ff4198c0608 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:15.514686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed82ec-7695-4c34-a388-0ff4198c0608 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:15.514962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed82ec-7695-4c34-a388-0ff4198c0608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:15.533318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed82ec-7695-4c34-a388-0ff4198c0608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:15.536113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed82ec-7695-4c34-a388-0ff4198c0608 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:15.583630 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3021/6041] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:17.903155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d196ee-e2c4-4a91-b9f7-e912b8119ad2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:17.904670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-52d196ee-e2c4-4a91-b9f7-e912b8119ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:17.931832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d196ee-e2c4-4a91-b9f7-e912b8119ad2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:17.951762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcffeaa-c136-424c-a7e4-5c0192cb607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:17.952582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcffeaa-c136-424c-a7e4-5c0192cb607d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:17.952957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcffeaa-c136-424c-a7e4-5c0192cb607d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:17.956696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcffeaa-c136-424c-a7e4-5c0192cb607d admin admin] PATH_INFO: `/v3/projects/933aaab625964ac3b792df3abb084ead` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:17.960351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcffeaa-c136-424c-a7e4-5c0192cb607d admin admin] RBAC: Authorizing `identity:delete_project(project_id=933aaab625964ac3b792df3abb084ead)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:17.962493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcffeaa-c136-424c-a7e4-5c0192cb607d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:18.119596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6fcffeaa-c136-424c-a7e4-5c0192cb607d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '933aaab625964ac3b792df3abb084ead', 'request_id': 'req-6fcffeaa-c136-424c-a7e4-5c0192cb607d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:18.134264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6fcffeaa-c136-424c-a7e4-5c0192cb607d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '933aaab625964ac3b792df3abb084ead', 'request_id': 'req-6fcffeaa-c136-424c-a7e4-5c0192cb607d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:18.158818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6fcffeaa-c136-424c-a7e4-5c0192cb607d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '933aaab625964ac3b792df3abb084ead', 'request_id': 'req-6fcffeaa-c136-424c-a7e4-5c0192cb607d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:18.190811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6fcffeaa-c136-424c-a7e4-5c0192cb607d admin admin] The token cache is being invalidate because project 933aaab625964ac3b792df3abb084ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:18.191379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6fcffeaa-c136-424c-a7e4-5c0192cb607d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:18.192425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6fcffeaa-c136-424c-a7e4-5c0192cb607d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:18.196396 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3021/6042] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:17 2022] DELETE /identity/v3/projects/933aaab625964ac3b792df3abb084ead => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:18.201612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed82ec-7695-4c34-a388-0ff4198c0608 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:18.213712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed82ec-7695-4c34-a388-0ff4198c0608 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:18.447866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d3549-f79d-437f-8ad1-535c87309365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:18.448814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d3549-f79d-437f-8ad1-535c87309365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:18.449094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d3549-f79d-437f-8ad1-535c87309365 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:18.449369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d3549-f79d-437f-8ad1-535c87309365 admin admin] PATH_INFO: `/v3/users/aa97b682ae064b20ba44aa612a5ea60a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:18.450856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d3549-f79d-437f-8ad1-535c87309365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa97b682ae064b20ba44aa612a5ea60a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:18.452895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d3549-f79d-437f-8ad1-535c87309365 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:18.463417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:18.594654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-486d3549-f79d-437f-8ad1-535c87309365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa97b682ae064b20ba44aa612a5ea60a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:18.596719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-486d3549-f79d-437f-8ad1-535c87309365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa97b682ae064b20ba44aa612a5ea60a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:18.619532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-486d3549-f79d-437f-8ad1-535c87309365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa97b682ae064b20ba44aa612a5ea60a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:18.637013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-486d3549-f79d-437f-8ad1-535c87309365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa97b682ae064b20ba44aa612a5ea60a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:18.676880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-486d3549-f79d-437f-8ad1-535c87309365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa97b682ae064b20ba44aa612a5ea60a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:18.713397 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3022/6043] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:18 2022] DELETE /identity/v3/users/aa97b682ae064b20ba44aa612a5ea60a => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:19.295501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcffeaa-c136-424c-a7e4-5c0192cb607d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:19.297236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6fcffeaa-c136-424c-a7e4-5c0192cb607d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:19.318104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcffeaa-c136-424c-a7e4-5c0192cb607d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:19.481631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdae069-5460-474c-a313-96c40ee65548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:19.482297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdae069-5460-474c-a313-96c40ee65548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:19.482587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdae069-5460-474c-a313-96c40ee65548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:19.482865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdae069-5460-474c-a313-96c40ee65548 admin admin] PATH_INFO: `/v3/users/e743bd9900a34e05aaffbbbc8c3eadc9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:19.488088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdae069-5460-474c-a313-96c40ee65548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e743bd9900a34e05aaffbbbc8c3eadc9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:19.490073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdae069-5460-474c-a313-96c40ee65548 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:19.502791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:19.593472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ccdae069-5460-474c-a313-96c40ee65548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e743bd9900a34e05aaffbbbc8c3eadc9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:19.613703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ccdae069-5460-474c-a313-96c40ee65548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e743bd9900a34e05aaffbbbc8c3eadc9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:19.614746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ccdae069-5460-474c-a313-96c40ee65548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e743bd9900a34e05aaffbbbc8c3eadc9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:19.615713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ccdae069-5460-474c-a313-96c40ee65548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e743bd9900a34e05aaffbbbc8c3eadc9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:19.629314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ccdae069-5460-474c-a313-96c40ee65548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e743bd9900a34e05aaffbbbc8c3eadc9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:19.654942 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3022/6044] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:19 2022] DELETE /identity/v3/users/e743bd9900a34e05aaffbbbc8c3eadc9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:19.659999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56325f-6b39-4395-87f5-aa9246b22c4b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:19.660570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56325f-6b39-4395-87f5-aa9246b22c4b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:19.661327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56325f-6b39-4395-87f5-aa9246b22c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:19.715566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6b56325f-6b39-4395-87f5-aa9246b22c4b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:19.717916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b56325f-6b39-4395-87f5-aa9246b22c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:19.858260 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3023/6045] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:20.023915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdae069-5460-474c-a313-96c40ee65548 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:20.025399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ccdae069-5460-474c-a313-96c40ee65548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:20.157276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdae069-5460-474c-a313-96c40ee65548 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:20.165852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fed53-f913-487a-b1d8-476bd7feb530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:20.167077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fed53-f913-487a-b1d8-476bd7feb530 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:20.167630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fed53-f913-487a-b1d8-476bd7feb530 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:20.168076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fed53-f913-487a-b1d8-476bd7feb530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:20.191161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fed53-f913-487a-b1d8-476bd7feb530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:20.193973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fed53-f913-487a-b1d8-476bd7feb530 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:20.222779 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3023/6046] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:20.612092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56325f-6b39-4395-87f5-aa9246b22c4b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:20.613730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b56325f-6b39-4395-87f5-aa9246b22c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:20.664257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56325f-6b39-4395-87f5-aa9246b22c4b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:20.696056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca5789-d6e6-4266-b00e-cf550afcc10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:20.697002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca5789-d6e6-4266-b00e-cf550afcc10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:20.697476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca5789-d6e6-4266-b00e-cf550afcc10c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:20.698280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca5789-d6e6-4266-b00e-cf550afcc10c admin admin] PATH_INFO: `/v3/projects/afd9e5b69b5144819fdea121c5b19d28` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:20.704958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca5789-d6e6-4266-b00e-cf550afcc10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd9e5b69b5144819fdea121c5b19d28)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:20.707014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca5789-d6e6-4266-b00e-cf550afcc10c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:20.904821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22ca5789-d6e6-4266-b00e-cf550afcc10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd9e5b69b5144819fdea121c5b19d28', 'request_id': 'req-22ca5789-d6e6-4266-b00e-cf550afcc10c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:20.918608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22ca5789-d6e6-4266-b00e-cf550afcc10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd9e5b69b5144819fdea121c5b19d28', 'request_id': 'req-22ca5789-d6e6-4266-b00e-cf550afcc10c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:20.935661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22ca5789-d6e6-4266-b00e-cf550afcc10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd9e5b69b5144819fdea121c5b19d28', 'request_id': 'req-22ca5789-d6e6-4266-b00e-cf550afcc10c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:20.977856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22ca5789-d6e6-4266-b00e-cf550afcc10c admin admin] The token cache is being invalidate because project afd9e5b69b5144819fdea121c5b19d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:20.978780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22ca5789-d6e6-4266-b00e-cf550afcc10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:20.979604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22ca5789-d6e6-4266-b00e-cf550afcc10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:20.986005 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3024/6047] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:20 2022] DELETE /identity/v3/projects/afd9e5b69b5144819fdea121c5b19d28 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:20.990723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0500a8f-dfff-41c5-8fbd-a532ac834f00 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:20.991307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0500a8f-dfff-41c5-8fbd-a532ac834f00 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:20.991307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0500a8f-dfff-41c5-8fbd-a532ac834f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:21.057751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e0500a8f-dfff-41c5-8fbd-a532ac834f00 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:21.059156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e0500a8f-dfff-41c5-8fbd-a532ac834f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:21.210069 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3024/6048] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:21.217939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7bb79-3945-4669-b574-1cc8e44db2df None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:21.218603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7bb79-3945-4669-b574-1cc8e44db2df None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:21.220104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7bb79-3945-4669-b574-1cc8e44db2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:21.237772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:21.292674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dde7bb79-3945-4669-b574-1cc8e44db2df None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:21.301027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dde7bb79-3945-4669-b574-1cc8e44db2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:21.346937 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3025/6049] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:21.351341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0500a8f-dfff-41c5-8fbd-a532ac834f00 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:21.376004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0500a8f-dfff-41c5-8fbd-a532ac834f00 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:21.397309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43594faa-4894-4a51-84e3-d7a4dfb92a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:21.398088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43594faa-4894-4a51-84e3-d7a4dfb92a2d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:21.398363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43594faa-4894-4a51-84e3-d7a4dfb92a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:21.398845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43594faa-4894-4a51-84e3-d7a4dfb92a2d admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:21.399724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43594faa-4894-4a51-84e3-d7a4dfb92a2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:46:21.400201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43594faa-4894-4a51-84e3-d7a4dfb92a2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:21.402003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43594faa-4894-4a51-84e3-d7a4dfb92a2d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:21.433538 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3025/6050] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:46:21.438067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7bb79-3945-4669-b574-1cc8e44db2df None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:21.455199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7bb79-3945-4669-b574-1cc8e44db2df None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:21.462740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518302bd-0c4a-4e6b-9177-1ad67cf33434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:21.463608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518302bd-0c4a-4e6b-9177-1ad67cf33434 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:21.464066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518302bd-0c4a-4e6b-9177-1ad67cf33434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:21.464503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518302bd-0c4a-4e6b-9177-1ad67cf33434 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:21.465322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518302bd-0c4a-4e6b-9177-1ad67cf33434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:21.467600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518302bd-0c4a-4e6b-9177-1ad67cf33434 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:21.529935 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3026/6051] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:21 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:21.534689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43594faa-4894-4a51-84e3-d7a4dfb92a2d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:21.545291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43594faa-4894-4a51-84e3-d7a4dfb92a2d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:21.566969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:21.678924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15deb4b-f911-4502-933c-502fc69104d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:21.680452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15deb4b-f911-4502-933c-502fc69104d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:21.681269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15deb4b-f911-4502-933c-502fc69104d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:21.682039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15deb4b-f911-4502-933c-502fc69104d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:21.698462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15deb4b-f911-4502-933c-502fc69104d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:21.714116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15deb4b-f911-4502-933c-502fc69104d6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:21.820654 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3026/6052] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:21 2022] POST /identity/v3/users => generated 292 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:21.822472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518302bd-0c4a-4e6b-9177-1ad67cf33434 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:21.840273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518302bd-0c4a-4e6b-9177-1ad67cf33434 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:21.852831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389f421-506e-4c36-9e78-abfafab43f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:21.853668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389f421-506e-4c36-9e78-abfafab43f9d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:21.854251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389f421-506e-4c36-9e78-abfafab43f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:21.854689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389f421-506e-4c36-9e78-abfafab43f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:21.855716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389f421-506e-4c36-9e78-abfafab43f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:21.857533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389f421-506e-4c36-9e78-abfafab43f9d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:21.889191 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3027/6053] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:21.894724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15deb4b-f911-4502-933c-502fc69104d6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:21.943790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15deb4b-f911-4502-933c-502fc69104d6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:21.951831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48757fdf-f225-4289-86db-a7c7b12ffe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:21.952925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48757fdf-f225-4289-86db-a7c7b12ffe44 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:21.957632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48757fdf-f225-4289-86db-a7c7b12ffe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:21.958501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48757fdf-f225-4289-86db-a7c7b12ffe44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:21.959749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48757fdf-f225-4289-86db-a7c7b12ffe44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:21.970500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48757fdf-f225-4289-86db-a7c7b12ffe44 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:22.010364 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3027/6054] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:22.015288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389f421-506e-4c36-9e78-abfafab43f9d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:22.028111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389f421-506e-4c36-9e78-abfafab43f9d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:22.035394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5acc30-5e14-4831-ac44-d07fd7d1789b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:22.036522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5acc30-5e14-4831-ac44-d07fd7d1789b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:22.037047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5acc30-5e14-4831-ac44-d07fd7d1789b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:22.038032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5acc30-5e14-4831-ac44-d07fd7d1789b admin admin] PATH_INFO: `/v3/projects/92b7c780067c44c6bdc2ce6cd4a0eeca/users/9e9e067e45284e219c08f38c7e654ef9/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:22.061899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5acc30-5e14-4831-ac44-d07fd7d1789b admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b7c780067c44c6bdc2ce6cd4a0eeca, user_id=9e9e067e45284e219c08f38c7e654ef9, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:22.067086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5acc30-5e14-4831-ac44-d07fd7d1789b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:22.108119 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3028/6055] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:22 2022] PUT /identity/v3/projects/92b7c780067c44c6bdc2ce6cd4a0eeca/users/9e9e067e45284e219c08f38c7e654ef9/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:22.110362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a4b15-979d-4687-bd8c-da6e7dc4c87d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:22.110850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a4b15-979d-4687-bd8c-da6e7dc4c87d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:22.111588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a4b15-979d-4687-bd8c-da6e7dc4c87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:22.188545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cc2a4b15-979d-4687-bd8c-da6e7dc4c87d None None] MFA Rules not processed for user `9e9e067e45284e219c08f38c7e654ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:22.192137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cc2a4b15-979d-4687-bd8c-da6e7dc4c87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:22.284439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5acc30-5e14-4831-ac44-d07fd7d1789b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:22.287413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ba5acc30-5e14-4831-ac44-d07fd7d1789b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:22.396669 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3028/6056] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:22.401208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a4b15-979d-4687-bd8c-da6e7dc4c87d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:22.432083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5acc30-5e14-4831-ac44-d07fd7d1789b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:22.440621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846173ff-0373-4de5-8587-2523455b8fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:22.441659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846173ff-0373-4de5-8587-2523455b8fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:22.441659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846173ff-0373-4de5-8587-2523455b8fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:22.442036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846173ff-0373-4de5-8587-2523455b8fd5 admin admin] PATH_INFO: `/v3/projects/1bbdf0f2c5e74d428cbd232763868729` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:22.445186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846173ff-0373-4de5-8587-2523455b8fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bbdf0f2c5e74d428cbd232763868729)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:22.448347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846173ff-0373-4de5-8587-2523455b8fd5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:22.544448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-846173ff-0373-4de5-8587-2523455b8fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bbdf0f2c5e74d428cbd232763868729', 'request_id': 'req-846173ff-0373-4de5-8587-2523455b8fd5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:22.546521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a4b15-979d-4687-bd8c-da6e7dc4c87d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:22.558546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-846173ff-0373-4de5-8587-2523455b8fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bbdf0f2c5e74d428cbd232763868729', 'request_id': 'req-846173ff-0373-4de5-8587-2523455b8fd5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:22.580310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-846173ff-0373-4de5-8587-2523455b8fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bbdf0f2c5e74d428cbd232763868729', 'request_id': 'req-846173ff-0373-4de5-8587-2523455b8fd5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:22.596387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-846173ff-0373-4de5-8587-2523455b8fd5 admin admin] The token cache is being invalidate because project 1bbdf0f2c5e74d428cbd232763868729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:22.597057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-846173ff-0373-4de5-8587-2523455b8fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:22.598206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-846173ff-0373-4de5-8587-2523455b8fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:22.600385 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3029/6057] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:22 2022] DELETE /identity/v3/projects/1bbdf0f2c5e74d428cbd232763868729 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:22.602437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:22.604168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846173ff-0373-4de5-8587-2523455b8fd5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:22.605999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-846173ff-0373-4de5-8587-2523455b8fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:22.649207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:22.655702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f98cb-fda1-4378-b7bf-fa290c5b09a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:22.656945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f98cb-fda1-4378-b7bf-fa290c5b09a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:22.659444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f98cb-fda1-4378-b7bf-fa290c5b09a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:22.659954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f98cb-fda1-4378-b7bf-fa290c5b09a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:22.661568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f98cb-fda1-4378-b7bf-fa290c5b09a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:22.669544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f98cb-fda1-4378-b7bf-fa290c5b09a9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:22.714764 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3029/6058] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:22 2022] POST /identity/v3/projects => generated 383 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:46:22.716497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f98cb-fda1-4378-b7bf-fa290c5b09a9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:22.719057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-166f98cb-fda1-4378-b7bf-fa290c5b09a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:22.774969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846173ff-0373-4de5-8587-2523455b8fd5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:22.890137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f98cb-fda1-4378-b7bf-fa290c5b09a9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:22.894551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc5b94-4d07-4d73-a557-4df330630092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:22.895805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5b94-4d07-4d73-a557-4df330630092 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:22.896161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5b94-4d07-4d73-a557-4df330630092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:22.896587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5b94-4d07-4d73-a557-4df330630092 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:22.897305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc5b94-4d07-4d73-a557-4df330630092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:22.899777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc5b94-4d07-4d73-a557-4df330630092 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:22.911036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e1ac6-4ec3-4362-9cd5-b24cd1d82442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:22.912084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e1ac6-4ec3-4362-9cd5-b24cd1d82442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:22.912467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e1ac6-4ec3-4362-9cd5-b24cd1d82442 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:22.915328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e1ac6-4ec3-4362-9cd5-b24cd1d82442 admin admin] PATH_INFO: `/v3/users/4756cfe0bf374a449c8c181e250743f8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:22.917186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e1ac6-4ec3-4362-9cd5-b24cd1d82442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4756cfe0bf374a449c8c181e250743f8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:22.923895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e1ac6-4ec3-4362-9cd5-b24cd1d82442 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:22.934094 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3030/6059] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:22 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:22.938836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc5b94-4d07-4d73-a557-4df330630092 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:22.962442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc5b94-4d07-4d73-a557-4df330630092 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:22.978889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73049d2a-6c98-4e24-8302-fea5c9301eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:22.980236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73049d2a-6c98-4e24-8302-fea5c9301eae admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:22.980737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73049d2a-6c98-4e24-8302-fea5c9301eae admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:22.981126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73049d2a-6c98-4e24-8302-fea5c9301eae admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:22.983933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73049d2a-6c98-4e24-8302-fea5c9301eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:22.987802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73049d2a-6c98-4e24-8302-fea5c9301eae admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:23.012707 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3031/6060] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:23.029204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73049d2a-6c98-4e24-8302-fea5c9301eae admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:23.042881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e3e1ac6-4ec3-4362-9cd5-b24cd1d82442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4756cfe0bf374a449c8c181e250743f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:23.044508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e3e1ac6-4ec3-4362-9cd5-b24cd1d82442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4756cfe0bf374a449c8c181e250743f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:23.059225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e3e1ac6-4ec3-4362-9cd5-b24cd1d82442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4756cfe0bf374a449c8c181e250743f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:23.062106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73049d2a-6c98-4e24-8302-fea5c9301eae admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:23.071736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e3e1ac6-4ec3-4362-9cd5-b24cd1d82442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4756cfe0bf374a449c8c181e250743f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:23.072698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aa327-7595-4362-ac8d-7b7fa3c35301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:23.073405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa327-7595-4362-ac8d-7b7fa3c35301 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:23.073689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa327-7595-4362-ac8d-7b7fa3c35301 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:23.073967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa327-7595-4362-ac8d-7b7fa3c35301 admin admin] PATH_INFO: `/v3/projects/3392faa5378f41b9a7aad8c8d752ea9e/users/4e78c51c8a294184a8306efea27b7828/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:23.095805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e3e1ac6-4ec3-4362-9cd5-b24cd1d82442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4756cfe0bf374a449c8c181e250743f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:23.112641 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3030/6061] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:22 2022] DELETE /identity/v3/users/4756cfe0bf374a449c8c181e250743f8 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:46:23.133935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37aa327-7595-4362-ac8d-7b7fa3c35301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3392faa5378f41b9a7aad8c8d752ea9e, user_id=4e78c51c8a294184a8306efea27b7828, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:23.140225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37aa327-7595-4362-ac8d-7b7fa3c35301 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:23.179833 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3032/6062] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:23 2022] PUT /identity/v3/projects/3392faa5378f41b9a7aad8c8d752ea9e/users/4e78c51c8a294184a8306efea27b7828/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:23.184555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e1ac6-4ec3-4362-9cd5-b24cd1d82442 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:23.186848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e3e1ac6-4ec3-4362-9cd5-b24cd1d82442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:23.345302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:23.357537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e1ac6-4ec3-4362-9cd5-b24cd1d82442 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:23.634968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3b73c-8c82-4f86-b919-df86ba8b3ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:23.635850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3b73c-8c82-4f86-b919-df86ba8b3ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:23.636260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3b73c-8c82-4f86-b919-df86ba8b3ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:23.636676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3b73c-8c82-4f86-b919-df86ba8b3ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:23.638333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3b73c-8c82-4f86-b919-df86ba8b3ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:23.655616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3b73c-8c82-4f86-b919-df86ba8b3ef7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:23.697141 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3031/6063] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 514 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:23.699374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aa327-7595-4362-ac8d-7b7fa3c35301 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:23.709691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3b73c-8c82-4f86-b919-df86ba8b3ef7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:23.712123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bed3b73c-8c82-4f86-b919-df86ba8b3ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:23.727432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aa327-7595-4362-ac8d-7b7fa3c35301 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:23.736158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce4996-796e-497b-9615-2807fc526ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:23.737955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce4996-796e-497b-9615-2807fc526ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:23.738453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce4996-796e-497b-9615-2807fc526ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:23.738916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce4996-796e-497b-9615-2807fc526ba8 admin admin] PATH_INFO: `/v3/projects/3392faa5378f41b9a7aad8c8d752ea9e/users/4e78c51c8a294184a8306efea27b7828/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:23.741642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce4996-796e-497b-9615-2807fc526ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3392faa5378f41b9a7aad8c8d752ea9e, user_id=4e78c51c8a294184a8306efea27b7828, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:23.743798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3b73c-8c82-4f86-b919-df86ba8b3ef7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:23.760182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f6c21-30e6-49b9-98c3-5f4c25088bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:23.760871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f6c21-30e6-49b9-98c3-5f4c25088bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:23.761256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f6c21-30e6-49b9-98c3-5f4c25088bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:23.761448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f6c21-30e6-49b9-98c3-5f4c25088bcf admin admin] PATH_INFO: `/v3/projects/f531a89f75784ce28bc1de6e6acfebbc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:23.768512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f6c21-30e6-49b9-98c3-5f4c25088bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f531a89f75784ce28bc1de6e6acfebbc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:23.770085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce4996-796e-497b-9615-2807fc526ba8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:23.774318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f6c21-30e6-49b9-98c3-5f4c25088bcf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:23.819945 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3033/6064] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:23 2022] PUT /identity/v3/projects/3392faa5378f41b9a7aad8c8d752ea9e/users/4e78c51c8a294184a8306efea27b7828/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:23.822599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce4996-796e-497b-9615-2807fc526ba8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:23.825728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-afce4996-796e-497b-9615-2807fc526ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:23.929095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d13f6c21-30e6-49b9-98c3-5f4c25088bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f531a89f75784ce28bc1de6e6acfebbc', 'request_id': 'req-d13f6c21-30e6-49b9-98c3-5f4c25088bcf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:23.949800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d13f6c21-30e6-49b9-98c3-5f4c25088bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f531a89f75784ce28bc1de6e6acfebbc', 'request_id': 'req-d13f6c21-30e6-49b9-98c3-5f4c25088bcf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:23.964386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce4996-796e-497b-9615-2807fc526ba8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:23.967611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d13f6c21-30e6-49b9-98c3-5f4c25088bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f531a89f75784ce28bc1de6e6acfebbc', 'request_id': 'req-d13f6c21-30e6-49b9-98c3-5f4c25088bcf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:23.973546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:24.011530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d13f6c21-30e6-49b9-98c3-5f4c25088bcf admin admin] The token cache is being invalidate because project f531a89f75784ce28bc1de6e6acfebbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:24.011871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d13f6c21-30e6-49b9-98c3-5f4c25088bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:24.021536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d13f6c21-30e6-49b9-98c3-5f4c25088bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:24.033763 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3032/6065] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:23 2022] DELETE /identity/v3/projects/f531a89f75784ce28bc1de6e6acfebbc => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:24.035873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaccccb-0bd5-4cd3-a44b-8fe66d86c258 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:24.036666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaccccb-0bd5-4cd3-a44b-8fe66d86c258 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:24.037152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaccccb-0bd5-4cd3-a44b-8fe66d86c258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:24.106390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06857872-d669-4013-92f9-66aca607189a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:24.107155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06857872-d669-4013-92f9-66aca607189a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:24.107489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06857872-d669-4013-92f9-66aca607189a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:24.107604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06857872-d669-4013-92f9-66aca607189a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:24.118029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-06857872-d669-4013-92f9-66aca607189a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:24.122941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-beaccccb-0bd5-4cd3-a44b-8fe66d86c258 None None] MFA Rules not processed for user `4e78c51c8a294184a8306efea27b7828`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:24.140875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-beaccccb-0bd5-4cd3-a44b-8fe66d86c258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:24.363091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06857872-d669-4013-92f9-66aca607189a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:24.364606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06857872-d669-4013-92f9-66aca607189a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:24.407916 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3034/6066] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:24.409459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51b7a3-1d94-4a8f-86f2-86692fba2f10 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:24.410064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51b7a3-1d94-4a8f-86f2-86692fba2f10 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:24.410678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51b7a3-1d94-4a8f-86f2-86692fba2f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:24.420038 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3033/6067] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:24.424271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaccccb-0bd5-4cd3-a44b-8fe66d86c258 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:24.458016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaccccb-0bd5-4cd3-a44b-8fe66d86c258 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:24.481185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9a51b7a3-1d94-4a8f-86f2-86692fba2f10 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:24.482383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9a51b7a3-1d94-4a8f-86f2-86692fba2f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:24.483879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b17ebe-e25d-45fb-84b6-4bb09cf08483 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e78c51c8a294184a8306efea27b7828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3392faa5378f41b9a7aad8c8d752ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:24.484575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b17ebe-e25d-45fb-84b6-4bb09cf08483 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:24.484856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b17ebe-e25d-45fb-84b6-4bb09cf08483 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:24.485130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b17ebe-e25d-45fb-84b6-4bb09cf08483 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:24.485767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b17ebe-e25d-45fb-84b6-4bb09cf08483 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:24.487675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b17ebe-e25d-45fb-84b6-4bb09cf08483 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:24.502526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:24.510804 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3035/6068] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:24.518960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0852a73-742e-4f68-975b-ff163ac2d99b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:24.519354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0852a73-742e-4f68-975b-ff163ac2d99b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:24.519567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0852a73-742e-4f68-975b-ff163ac2d99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:24.558197 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3034/6069] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:24 2022] POST /identity/v3/projects => generated 359 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:24.560552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b17ebe-e25d-45fb-84b6-4bb09cf08483 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:24.562031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d0852a73-742e-4f68-975b-ff163ac2d99b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:24.565025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-84b17ebe-e25d-45fb-84b6-4bb09cf08483 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:24.568185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d0852a73-742e-4f68-975b-ff163ac2d99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:24.739290 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3036/6070] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:46:24.744406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0852a73-742e-4f68-975b-ff163ac2d99b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:24.767060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0852a73-742e-4f68-975b-ff163ac2d99b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:24.788502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdec3b-00b0-4a12-a467-f343df9c396e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:24.789243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdec3b-00b0-4a12-a467-f343df9c396e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:24.789527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdec3b-00b0-4a12-a467-f343df9c396e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:24.789798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdec3b-00b0-4a12-a467-f343df9c396e admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:24.790621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fdec3b-00b0-4a12-a467-f343df9c396e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:46:24.790735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b17ebe-e25d-45fb-84b6-4bb09cf08483 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:24.790852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fdec3b-00b0-4a12-a467-f343df9c396e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:24.792595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fdec3b-00b0-4a12-a467-f343df9c396e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:24.795437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f5bdc-4c44-4ea6-855f-06ba454315b5 tempest-ProjectsNegativeTestJSON-133119128 tempest-ProjectsNegativeTestJSON-133119128-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e9e067e45284e219c08f38c7e654ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b7c780067c44c6bdc2ce6cd4a0eeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:24.796163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f5bdc-4c44-4ea6-855f-06ba454315b5 tempest-ProjectsNegativeTestJSON-133119128 tempest-ProjectsNegativeTestJSON-133119128-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:24.796926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f5bdc-4c44-4ea6-855f-06ba454315b5 tempest-ProjectsNegativeTestJSON-133119128 tempest-ProjectsNegativeTestJSON-133119128-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:24.797762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f5bdc-4c44-4ea6-855f-06ba454315b5 tempest-ProjectsNegativeTestJSON-133119128 tempest-ProjectsNegativeTestJSON-133119128-project] PATH_INFO: `/v3/projects/4c56050e32db43c5b27b4f25a266669c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:24.799096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f5bdc-4c44-4ea6-855f-06ba454315b5 tempest-ProjectsNegativeTestJSON-133119128 tempest-ProjectsNegativeTestJSON-133119128-project] RBAC: Authorizing `identity:delete_project(project_id=4c56050e32db43c5b27b4f25a266669c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:24.807432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-919f5bdc-4c44-4ea6-855f-06ba454315b5 tempest-ProjectsNegativeTestJSON-133119128 tempest-ProjectsNegativeTestJSON-133119128-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 28 18:46:24.807432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:46:24.807432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:46:24.807432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:46:24.807432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:46:24.807432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:46:24.807432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:46:24.807432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:46:24.807432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:46:24.807432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:46:24.807432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:46:24.807432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:46:24.807432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Aug 28 18:46:24.807432 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 28 18:46:24.808750 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 28 18:46:24.808750 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 28 18:46:24.808750 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 28 18:46:24.808750 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 28 18:46:24.808750 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 28 18:46:24.808750 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 28 18:46:24.808750 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 28 18:46:24.808750 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:46:24.817267 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3037/6071] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:46:24.824379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdec3b-00b0-4a12-a467-f343df9c396e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:24.839569 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3035/6072] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:24 2022] DELETE /identity/v3/projects/4c56050e32db43c5b27b4f25a266669c => generated 136 bytes in 279 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:46:24.845028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f5bdc-4c44-4ea6-855f-06ba454315b5 tempest-ProjectsNegativeTestJSON-133119128 tempest-ProjectsNegativeTestJSON-133119128-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:24.859898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdec3b-00b0-4a12-a467-f343df9c396e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:24.886077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2a61c-36ae-43a6-a285-7c7c2ba5f961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:24.890215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2a61c-36ae-43a6-a285-7c7c2ba5f961 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:24.890540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2a61c-36ae-43a6-a285-7c7c2ba5f961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:24.890827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2a61c-36ae-43a6-a285-7c7c2ba5f961 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:24.891524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2a61c-36ae-43a6-a285-7c7c2ba5f961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:24.903949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2a61c-36ae-43a6-a285-7c7c2ba5f961 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:25.006422 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3038/6073] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:24 2022] POST /identity/v3/projects => generated 409 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:25.022662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2a61c-36ae-43a6-a285-7c7c2ba5f961 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:25.041140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f5bdc-4c44-4ea6-855f-06ba454315b5 tempest-ProjectsNegativeTestJSON-133119128 tempest-ProjectsNegativeTestJSON-133119128-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:25.118827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:25.197756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30238b-922d-4dbf-9080-448716b1f7a1 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e78c51c8a294184a8306efea27b7828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3392faa5378f41b9a7aad8c8d752ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:25.199140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30238b-922d-4dbf-9080-448716b1f7a1 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:25.199827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30238b-922d-4dbf-9080-448716b1f7a1 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:25.201971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30238b-922d-4dbf-9080-448716b1f7a1 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] PATH_INFO: `/v3/projects/4c56050e32db43c5b27b4f25a266669c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:25.203659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30238b-922d-4dbf-9080-448716b1f7a1 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4c56050e32db43c5b27b4f25a266669c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:25.206402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30238b-922d-4dbf-9080-448716b1f7a1 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:25.213543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2a61c-36ae-43a6-a285-7c7c2ba5f961 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:25.225289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6be85-f12a-409c-886d-26cafd033bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:25.227902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6be85-f12a-409c-886d-26cafd033bed admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:25.228979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6be85-f12a-409c-886d-26cafd033bed admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:25.229265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6be85-f12a-409c-886d-26cafd033bed admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:25.233193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6be85-f12a-409c-886d-26cafd033bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:25.242014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6be85-f12a-409c-886d-26cafd033bed admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:25.315970 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3039/6074] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:25 2022] POST /identity/v3/users => generated 305 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:25.315970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6be85-f12a-409c-886d-26cafd033bed admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:25.344761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6be85-f12a-409c-886d-26cafd033bed admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:25.364074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:25.371815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f30238b-922d-4dbf-9080-448716b1f7a1 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c56050e32db43c5b27b4f25a266669c', 'request_id': 'req-3f30238b-922d-4dbf-9080-448716b1f7a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:25.395215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f30238b-922d-4dbf-9080-448716b1f7a1 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c56050e32db43c5b27b4f25a266669c', 'request_id': 'req-3f30238b-922d-4dbf-9080-448716b1f7a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:25.412296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f30238b-922d-4dbf-9080-448716b1f7a1 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c56050e32db43c5b27b4f25a266669c', 'request_id': 'req-3f30238b-922d-4dbf-9080-448716b1f7a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:25.451860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf390923-5ad0-4c18-a935-fea8814d73aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:25.452651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf390923-5ad0-4c18-a935-fea8814d73aa admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:25.453022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf390923-5ad0-4c18-a935-fea8814d73aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:25.453307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf390923-5ad0-4c18-a935-fea8814d73aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:25.453966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf390923-5ad0-4c18-a935-fea8814d73aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:25.455497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f30238b-922d-4dbf-9080-448716b1f7a1 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] The token cache is being invalidate because project 4c56050e32db43c5b27b4f25a266669c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:25.455675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf390923-5ad0-4c18-a935-fea8814d73aa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:25.457253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f30238b-922d-4dbf-9080-448716b1f7a1 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:25.459697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f30238b-922d-4dbf-9080-448716b1f7a1 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:25.467860 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3036/6075] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:24 2022] DELETE /identity/v3/projects/4c56050e32db43c5b27b4f25a266669c => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:25.472169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30238b-922d-4dbf-9080-448716b1f7a1 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:25.477529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f30238b-922d-4dbf-9080-448716b1f7a1 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:25.482406 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3040/6076] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:25.483939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf390923-5ad0-4c18-a935-fea8814d73aa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:25.485935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cf390923-5ad0-4c18-a935-fea8814d73aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:25.505926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf390923-5ad0-4c18-a935-fea8814d73aa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:25.513828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78093b56-91f1-444f-af4e-4ce47805b280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:25.514363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78093b56-91f1-444f-af4e-4ce47805b280 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:25.514624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78093b56-91f1-444f-af4e-4ce47805b280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:25.515000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78093b56-91f1-444f-af4e-4ce47805b280 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:25.517335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30238b-922d-4dbf-9080-448716b1f7a1 tempest-ProjectsNegativeTestJSON-187817054 tempest-ProjectsNegativeTestJSON-187817054-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:25.518641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78093b56-91f1-444f-af4e-4ce47805b280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:25.536600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78093b56-91f1-444f-af4e-4ce47805b280 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:25.540468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc3843-f09e-4d3e-ae4b-76705b98a78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:25.542670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc3843-f09e-4d3e-ae4b-76705b98a78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:25.543790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc3843-f09e-4d3e-ae4b-76705b98a78a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:25.545655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc3843-f09e-4d3e-ae4b-76705b98a78a admin admin] PATH_INFO: `/v3/users/9e9e067e45284e219c08f38c7e654ef9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:25.550299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc3843-f09e-4d3e-ae4b-76705b98a78a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9e067e45284e219c08f38c7e654ef9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:25.554736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc3843-f09e-4d3e-ae4b-76705b98a78a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:25.587173 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3041/6077] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:46:25.588334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78093b56-91f1-444f-af4e-4ce47805b280 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:25.600360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78093b56-91f1-444f-af4e-4ce47805b280 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:25.608513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93fb20-906e-4782-8e7b-78f32caea95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:25.609258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93fb20-906e-4782-8e7b-78f32caea95c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:25.609543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93fb20-906e-4782-8e7b-78f32caea95c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:25.610180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93fb20-906e-4782-8e7b-78f32caea95c admin admin] PATH_INFO: `/v3/projects/7a22d2db966045069b94e35625e41c9e/users/2ba3c9d813cb4a07a5482866b98e9e88/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:25.628223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93fb20-906e-4782-8e7b-78f32caea95c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a22d2db966045069b94e35625e41c9e, user_id=2ba3c9d813cb4a07a5482866b98e9e88, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:25.631123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93fb20-906e-4782-8e7b-78f32caea95c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:25.653131 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3042/6078] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:25 2022] PUT /identity/v3/projects/7a22d2db966045069b94e35625e41c9e/users/2ba3c9d813cb4a07a5482866b98e9e88/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:25.653779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-27bc3843-f09e-4d3e-ae4b-76705b98a78a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9e067e45284e219c08f38c7e654ef9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:25.654451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-27bc3843-f09e-4d3e-ae4b-76705b98a78a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9e067e45284e219c08f38c7e654ef9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:25.663312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-27bc3843-f09e-4d3e-ae4b-76705b98a78a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9e067e45284e219c08f38c7e654ef9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:25.666772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7861a-7d43-4437-84e8-ba7f2b34e115 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:25.666772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7861a-7d43-4437-84e8-ba7f2b34e115 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:25.667043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7861a-7d43-4437-84e8-ba7f2b34e115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:25.678843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-27bc3843-f09e-4d3e-ae4b-76705b98a78a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9e067e45284e219c08f38c7e654ef9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:25.699038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-27bc3843-f09e-4d3e-ae4b-76705b98a78a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9e067e45284e219c08f38c7e654ef9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:25.711161 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3037/6079] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:25 2022] DELETE /identity/v3/users/9e9e067e45284e219c08f38c7e654ef9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:25.714212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef8aa8-e3ec-4fcb-bfd8-6cdc4e693c61 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:25.717053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef8aa8-e3ec-4fcb-bfd8-6cdc4e693c61 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:25.717345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef8aa8-e3ec-4fcb-bfd8-6cdc4e693c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:25.750042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-28d7861a-7d43-4437-84e8-ba7f2b34e115 None None] MFA Rules not processed for user `2ba3c9d813cb4a07a5482866b98e9e88`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:25.751835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-28d7861a-7d43-4437-84e8-ba7f2b34e115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:25.785980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d9ef8aa8-e3ec-4fcb-bfd8-6cdc4e693c61 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:25.787889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9ef8aa8-e3ec-4fcb-bfd8-6cdc4e693c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:25.844643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:25.857738 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3043/6080] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:25 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:46:25.859065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7861a-7d43-4437-84e8-ba7f2b34e115 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:25.862338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-28d7861a-7d43-4437-84e8-ba7f2b34e115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:25.924173 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3038/6081] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:25.939522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef8aa8-e3ec-4fcb-bfd8-6cdc4e693c61 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:25.941858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9ef8aa8-e3ec-4fcb-bfd8-6cdc4e693c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:26.035674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7861a-7d43-4437-84e8-ba7f2b34e115 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:26.047790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4042e-ad17-4b45-b614-4a1a9aef8ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:26.048422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4042e-ad17-4b45-b614-4a1a9aef8ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:26.048702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4042e-ad17-4b45-b614-4a1a9aef8ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:26.048976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4042e-ad17-4b45-b614-4a1a9aef8ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:26.049722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4042e-ad17-4b45-b614-4a1a9aef8ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:26.051579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4042e-ad17-4b45-b614-4a1a9aef8ce0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:26.053590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:26.087565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef8aa8-e3ec-4fcb-bfd8-6cdc4e693c61 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:26.092897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530aa48-3657-4c67-af02-f5e86c020bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:26.093506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530aa48-3657-4c67-af02-f5e86c020bdc service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:26.094094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530aa48-3657-4c67-af02-f5e86c020bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:26.094384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530aa48-3657-4c67-af02-f5e86c020bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:26.125964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530aa48-3657-4c67-af02-f5e86c020bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:26.129960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530aa48-3657-4c67-af02-f5e86c020bdc service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:26.133001 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3044/6082] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:25 2022] POST /identity/v3/projects => generated 407 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:26.143689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4042e-ad17-4b45-b614-4a1a9aef8ce0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:26.185041 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3039/6083] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:46:26.279275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4042e-ad17-4b45-b614-4a1a9aef8ce0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:26.285104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14e91f-90a8-4de6-b390-9a9930d18b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:26.285971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14e91f-90a8-4de6-b390-9a9930d18b9a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:26.286428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14e91f-90a8-4de6-b390-9a9930d18b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:26.286709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14e91f-90a8-4de6-b390-9a9930d18b9a admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:26.287608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14e91f-90a8-4de6-b390-9a9930d18b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:26.289955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14e91f-90a8-4de6-b390-9a9930d18b9a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:26.324570 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3045/6084] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:26 2022] POST /identity/v3/users => generated 310 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:26.329105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530aa48-3657-4c67-af02-f5e86c020bdc service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:26.341460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530aa48-3657-4c67-af02-f5e86c020bdc service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:26.354510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab7fee-65f9-4225-86df-d36169445934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:26.355147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7fee-65f9-4225-86df-d36169445934 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:26.355450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7fee-65f9-4225-86df-d36169445934 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:26.355723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7fee-65f9-4225-86df-d36169445934 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:26.356370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab7fee-65f9-4225-86df-d36169445934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:26.368131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab7fee-65f9-4225-86df-d36169445934 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:26.415861 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3040/6085] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:26.420048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14e91f-90a8-4de6-b390-9a9930d18b9a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:26.437230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14e91f-90a8-4de6-b390-9a9930d18b9a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:26.449541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fcd01-31e0-4e85-9b0d-1ea17fce24b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:26.450560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fcd01-31e0-4e85-9b0d-1ea17fce24b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:26.450844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fcd01-31e0-4e85-9b0d-1ea17fce24b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:26.451120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fcd01-31e0-4e85-9b0d-1ea17fce24b6 admin admin] PATH_INFO: `/v3/projects/d7bc2c4a7a05470faf7cc5d47efaf22d/users/0c176cea2f00471d84b5fea52a4ece42/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:26.480335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fcd01-31e0-4e85-9b0d-1ea17fce24b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7bc2c4a7a05470faf7cc5d47efaf22d, user_id=0c176cea2f00471d84b5fea52a4ece42, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:26.493266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fcd01-31e0-4e85-9b0d-1ea17fce24b6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:26.529103 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3046/6086] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:26 2022] PUT /identity/v3/projects/d7bc2c4a7a05470faf7cc5d47efaf22d/users/0c176cea2f00471d84b5fea52a4ece42/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:26.533093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab7fee-65f9-4225-86df-d36169445934 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:26.548355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab7fee-65f9-4225-86df-d36169445934 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:26.687611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a53d27-b8b0-4a7d-a4a6-e5a7bab3564b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:26.688321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53d27-b8b0-4a7d-a4a6-e5a7bab3564b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:26.688602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53d27-b8b0-4a7d-a4a6-e5a7bab3564b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:26.688878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53d27-b8b0-4a7d-a4a6-e5a7bab3564b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:26.689562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a53d27-b8b0-4a7d-a4a6-e5a7bab3564b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:26.692105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a53d27-b8b0-4a7d-a4a6-e5a7bab3564b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:26.706261 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3041/6087] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:26.711782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fcd01-31e0-4e85-9b0d-1ea17fce24b6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:26.725178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fcd01-31e0-4e85-9b0d-1ea17fce24b6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:26.733945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4001d5-69c5-4f56-84f8-ecb1d86ac806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:26.735051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4001d5-69c5-4f56-84f8-ecb1d86ac806 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:26.735539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4001d5-69c5-4f56-84f8-ecb1d86ac806 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:26.736006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4001d5-69c5-4f56-84f8-ecb1d86ac806 admin admin] PATH_INFO: `/v3/projects/d7bc2c4a7a05470faf7cc5d47efaf22d/users/0c176cea2f00471d84b5fea52a4ece42/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:26.738808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4001d5-69c5-4f56-84f8-ecb1d86ac806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7bc2c4a7a05470faf7cc5d47efaf22d, user_id=0c176cea2f00471d84b5fea52a4ece42, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:26.741835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4001d5-69c5-4f56-84f8-ecb1d86ac806 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:26.799571 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3047/6088] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:26 2022] PUT /identity/v3/projects/d7bc2c4a7a05470faf7cc5d47efaf22d/users/0c176cea2f00471d84b5fea52a4ece42/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:46:26.799789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb83d1-c1db-47b4-9644-8a3058a65030 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:26.800297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb83d1-c1db-47b4-9644-8a3058a65030 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:26.800707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb83d1-c1db-47b4-9644-8a3058a65030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:26.860324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9dfb83d1-c1db-47b4-9644-8a3058a65030 None None] MFA Rules not processed for user `0c176cea2f00471d84b5fea52a4ece42`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:26.862014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9dfb83d1-c1db-47b4-9644-8a3058a65030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:27.004652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4001d5-69c5-4f56-84f8-ecb1d86ac806 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:27.007653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0d4001d5-69c5-4f56-84f8-ecb1d86ac806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:27.040080 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3042/6089] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:26 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:27.053944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb83d1-c1db-47b4-9644-8a3058a65030 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:27.056113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9dfb83d1-c1db-47b4-9644-8a3058a65030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:27.105864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:27.179481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4001d5-69c5-4f56-84f8-ecb1d86ac806 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:27.200721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8dcb6-96e6-4371-83fd-c9fea1091445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:27.202826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8dcb6-96e6-4371-83fd-c9fea1091445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:27.203040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb83d1-c1db-47b4-9644-8a3058a65030 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:27.203416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8dcb6-96e6-4371-83fd-c9fea1091445 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:27.204416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8dcb6-96e6-4371-83fd-c9fea1091445 admin admin] PATH_INFO: `/v3/projects/92b7c780067c44c6bdc2ce6cd4a0eeca` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:27.208024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8dcb6-96e6-4371-83fd-c9fea1091445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92b7c780067c44c6bdc2ce6cd4a0eeca)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:27.210806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8dcb6-96e6-4371-83fd-c9fea1091445 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:27.224236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b079f6-efa5-4ac2-b6fd-136829b9565d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:27.225059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b079f6-efa5-4ac2-b6fd-136829b9565d service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:27.225446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b079f6-efa5-4ac2-b6fd-136829b9565d service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:27.225827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b079f6-efa5-4ac2-b6fd-136829b9565d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:27.253928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b079f6-efa5-4ac2-b6fd-136829b9565d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:27.256277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b079f6-efa5-4ac2-b6fd-136829b9565d service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:27.269268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:27.281657 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3043/6090] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:27 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:46:27.360550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbb8dcb6-96e6-4371-83fd-c9fea1091445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b7c780067c44c6bdc2ce6cd4a0eeca', 'request_id': 'req-dbb8dcb6-96e6-4371-83fd-c9fea1091445'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:27.388411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbb8dcb6-96e6-4371-83fd-c9fea1091445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b7c780067c44c6bdc2ce6cd4a0eeca', 'request_id': 'req-dbb8dcb6-96e6-4371-83fd-c9fea1091445'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:27.436464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbb8dcb6-96e6-4371-83fd-c9fea1091445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b7c780067c44c6bdc2ce6cd4a0eeca', 'request_id': 'req-dbb8dcb6-96e6-4371-83fd-c9fea1091445'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:27.499273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbb8dcb6-96e6-4371-83fd-c9fea1091445 admin admin] The token cache is being invalidate because project 92b7c780067c44c6bdc2ce6cd4a0eeca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:27.499622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbb8dcb6-96e6-4371-83fd-c9fea1091445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:27.505640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbb8dcb6-96e6-4371-83fd-c9fea1091445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:27.519021 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3048/6091] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:27 2022] DELETE /identity/v3/projects/92b7c780067c44c6bdc2ce6cd4a0eeca => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:46:27.520381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b079f6-efa5-4ac2-b6fd-136829b9565d service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:27.541871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b079f6-efa5-4ac2-b6fd-136829b9565d service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:27.682792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf732c9c-c5a3-4488-8e85-6668c27e8dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:27.683493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf732c9c-c5a3-4488-8e85-6668c27e8dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:27.683781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf732c9c-c5a3-4488-8e85-6668c27e8dff admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:27.684064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf732c9c-c5a3-4488-8e85-6668c27e8dff admin admin] PATH_INFO: `/v3/users/4e78c51c8a294184a8306efea27b7828` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:27.687442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf732c9c-c5a3-4488-8e85-6668c27e8dff admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e78c51c8a294184a8306efea27b7828)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:27.689426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf732c9c-c5a3-4488-8e85-6668c27e8dff admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:27.798194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf732c9c-c5a3-4488-8e85-6668c27e8dff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e78c51c8a294184a8306efea27b7828'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:27.800316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf732c9c-c5a3-4488-8e85-6668c27e8dff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e78c51c8a294184a8306efea27b7828'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:27.823126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8dcb6-96e6-4371-83fd-c9fea1091445 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:27.825230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dbb8dcb6-96e6-4371-83fd-c9fea1091445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:27.839580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf732c9c-c5a3-4488-8e85-6668c27e8dff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e78c51c8a294184a8306efea27b7828'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:27.859653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf732c9c-c5a3-4488-8e85-6668c27e8dff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e78c51c8a294184a8306efea27b7828'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:27.900214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf732c9c-c5a3-4488-8e85-6668c27e8dff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e78c51c8a294184a8306efea27b7828'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:27.918986 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3044/6092] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:27 2022] DELETE /identity/v3/users/4e78c51c8a294184a8306efea27b7828 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:27.969560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8dcb6-96e6-4371-83fd-c9fea1091445 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:28.058215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67181bc-6ec2-4dd1-8be8-a278563d8bed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:28.059186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67181bc-6ec2-4dd1-8be8-a278563d8bed service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:28.059186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67181bc-6ec2-4dd1-8be8-a278563d8bed service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:28.059742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67181bc-6ec2-4dd1-8be8-a278563d8bed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:28.062861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e67181bc-6ec2-4dd1-8be8-a278563d8bed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:28.116580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:28.192275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67181bc-6ec2-4dd1-8be8-a278563d8bed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:28.195247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67181bc-6ec2-4dd1-8be8-a278563d8bed service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:28.225791 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3049/6093] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:27 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:46:30.286028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf732c9c-c5a3-4488-8e85-6668c27e8dff admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:30.288281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf732c9c-c5a3-4488-8e85-6668c27e8dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:30.409059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf732c9c-c5a3-4488-8e85-6668c27e8dff admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:30.417391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1a4f8-ebe3-4992-9c41-c51b3c38c8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:30.418234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1a4f8-ebe3-4992-9c41-c51b3c38c8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:30.418608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1a4f8-ebe3-4992-9c41-c51b3c38c8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:30.418978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1a4f8-ebe3-4992-9c41-c51b3c38c8fd admin admin] PATH_INFO: `/v3/projects/3392faa5378f41b9a7aad8c8d752ea9e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:30.420978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1a4f8-ebe3-4992-9c41-c51b3c38c8fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3392faa5378f41b9a7aad8c8d752ea9e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:30.424054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1a4f8-ebe3-4992-9c41-c51b3c38c8fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:30.463414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:30.512351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bec1a4f8-ebe3-4992-9c41-c51b3c38c8fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3392faa5378f41b9a7aad8c8d752ea9e', 'request_id': 'req-bec1a4f8-ebe3-4992-9c41-c51b3c38c8fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:30.524281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bec1a4f8-ebe3-4992-9c41-c51b3c38c8fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3392faa5378f41b9a7aad8c8d752ea9e', 'request_id': 'req-bec1a4f8-ebe3-4992-9c41-c51b3c38c8fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:30.539356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bec1a4f8-ebe3-4992-9c41-c51b3c38c8fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3392faa5378f41b9a7aad8c8d752ea9e', 'request_id': 'req-bec1a4f8-ebe3-4992-9c41-c51b3c38c8fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:30.554560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bec1a4f8-ebe3-4992-9c41-c51b3c38c8fd admin admin] The token cache is being invalidate because project 3392faa5378f41b9a7aad8c8d752ea9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:30.555039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bec1a4f8-ebe3-4992-9c41-c51b3c38c8fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:30.557247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bec1a4f8-ebe3-4992-9c41-c51b3c38c8fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:30.562739 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3045/6094] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:30 2022] DELETE /identity/v3/projects/3392faa5378f41b9a7aad8c8d752ea9e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:30.564319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1e87-3e98-49a9-bf85-eaef312223ec None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:30.564761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1e87-3e98-49a9-bf85-eaef312223ec None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:30.565417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1e87-3e98-49a9-bf85-eaef312223ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:30.599810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-54fe1e87-3e98-49a9-bf85-eaef312223ec None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:30.601043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-54fe1e87-3e98-49a9-bf85-eaef312223ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:30.687577 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3050/6095] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:30.691089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e380ec-0f6f-47f7-84ed-5117ab644016 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:30.694451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e380ec-0f6f-47f7-84ed-5117ab644016 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:30.694968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e380ec-0f6f-47f7-84ed-5117ab644016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:30.757637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-96e380ec-0f6f-47f7-84ed-5117ab644016 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:30.759851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-96e380ec-0f6f-47f7-84ed-5117ab644016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:30.790152 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3046/6096] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:30.793593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe1e87-3e98-49a9-bf85-eaef312223ec None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:30.815430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe1e87-3e98-49a9-bf85-eaef312223ec None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:30.828087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae1644-5146-4b34-baa9-e5e3e88d3149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:30.829151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae1644-5146-4b34-baa9-e5e3e88d3149 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:30.829597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae1644-5146-4b34-baa9-e5e3e88d3149 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:30.830060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae1644-5146-4b34-baa9-e5e3e88d3149 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:30.832362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae1644-5146-4b34-baa9-e5e3e88d3149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:46:30.832849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae1644-5146-4b34-baa9-e5e3e88d3149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:30.847560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae1644-5146-4b34-baa9-e5e3e88d3149 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:30.875421 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3051/6097] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:46:30.880559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e380ec-0f6f-47f7-84ed-5117ab644016 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:30.898660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e380ec-0f6f-47f7-84ed-5117ab644016 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:30.913468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ccf6f-3911-4ef1-bb76-b4628377690b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:30.914147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ccf6f-3911-4ef1-bb76-b4628377690b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:30.914429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ccf6f-3911-4ef1-bb76-b4628377690b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:30.914711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ccf6f-3911-4ef1-bb76-b4628377690b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:30.915394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ccf6f-3911-4ef1-bb76-b4628377690b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:30.922558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ccf6f-3911-4ef1-bb76-b4628377690b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:30.990737 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3047/6098] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:30 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:30.992297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae1644-5146-4b34-baa9-e5e3e88d3149 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:31.021508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae1644-5146-4b34-baa9-e5e3e88d3149 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:31.144196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddef3ea-c76b-4586-9d2d-25611223a84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:31.145019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddef3ea-c76b-4586-9d2d-25611223a84a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:31.145303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddef3ea-c76b-4586-9d2d-25611223a84a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:31.145582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddef3ea-c76b-4586-9d2d-25611223a84a admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:31.146726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddef3ea-c76b-4586-9d2d-25611223a84a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:31.148884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddef3ea-c76b-4586-9d2d-25611223a84a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:31.195467 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3052/6099] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:30 2022] POST /identity/v3/users => generated 284 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:31.196673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ccf6f-3911-4ef1-bb76-b4628377690b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:31.215313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ccf6f-3911-4ef1-bb76-b4628377690b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:31.234659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daf116-6b90-43e2-b112-6f497160bb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:31.238337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daf116-6b90-43e2-b112-6f497160bb51 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:31.238687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daf116-6b90-43e2-b112-6f497160bb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:31.241766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daf116-6b90-43e2-b112-6f497160bb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:31.242474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daf116-6b90-43e2-b112-6f497160bb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:31.246320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daf116-6b90-43e2-b112-6f497160bb51 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:31.276721 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3048/6100] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:31.281734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddef3ea-c76b-4586-9d2d-25611223a84a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:31.296824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddef3ea-c76b-4586-9d2d-25611223a84a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:31.310699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bf6ec-ad74-4094-b1e4-4e0ddc7c7a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:31.312204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bf6ec-ad74-4094-b1e4-4e0ddc7c7a87 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:31.313624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bf6ec-ad74-4094-b1e4-4e0ddc7c7a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:31.313905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bf6ec-ad74-4094-b1e4-4e0ddc7c7a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:31.316766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bf6ec-ad74-4094-b1e4-4e0ddc7c7a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:31.319242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bf6ec-ad74-4094-b1e4-4e0ddc7c7a87 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:31.347535 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3053/6101] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:31.351857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daf116-6b90-43e2-b112-6f497160bb51 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:31.365233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daf116-6b90-43e2-b112-6f497160bb51 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:31.380008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacae414-bac8-48b4-853b-b161ac88a6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:31.380824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacae414-bac8-48b4-853b-b161ac88a6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:31.381106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacae414-bac8-48b4-853b-b161ac88a6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:31.381379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacae414-bac8-48b4-853b-b161ac88a6c3 admin admin] PATH_INFO: `/v3/projects/bf0449cbd6a942fd8e4095bf05dd1c35/users/4be924cdd47549a7849854561e455370/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:31.484932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacae414-bac8-48b4-853b-b161ac88a6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0449cbd6a942fd8e4095bf05dd1c35, user_id=4be924cdd47549a7849854561e455370, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:31.489212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacae414-bac8-48b4-853b-b161ac88a6c3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:31.554188 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3049/6102] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:31 2022] PUT /identity/v3/projects/bf0449cbd6a942fd8e4095bf05dd1c35/users/4be924cdd47549a7849854561e455370/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:46:31.555012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3c96d-76dc-4b2d-b088-454e43e92c44 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:31.555475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3c96d-76dc-4b2d-b088-454e43e92c44 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:31.556093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3c96d-76dc-4b2d-b088-454e43e92c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:31.618916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-93f3c96d-76dc-4b2d-b088-454e43e92c44 None None] MFA Rules not processed for user `4be924cdd47549a7849854561e455370`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:31.620783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-93f3c96d-76dc-4b2d-b088-454e43e92c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:31.692411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:31.775882 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3054/6103] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:31.780980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacae414-bac8-48b4-853b-b161ac88a6c3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:31.922352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacae414-bac8-48b4-853b-b161ac88a6c3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:31.937233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fce3d-8a91-43fc-b140-9b05d9cfca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:31.937879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fce3d-8a91-43fc-b140-9b05d9cfca56 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:31.938155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fce3d-8a91-43fc-b140-9b05d9cfca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:31.938424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fce3d-8a91-43fc-b140-9b05d9cfca56 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:31.939067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fce3d-8a91-43fc-b140-9b05d9cfca56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:31.941030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fce3d-8a91-43fc-b140-9b05d9cfca56 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:32.004612 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3050/6104] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:31 2022] POST /identity/v3/projects => generated 367 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:32.009163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3c96d-76dc-4b2d-b088-454e43e92c44 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:32.028283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3c96d-76dc-4b2d-b088-454e43e92c44 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:32.208922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050613c-7184-456d-8ba7-f68622570670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:32.209641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050613c-7184-456d-8ba7-f68622570670 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:32.209990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050613c-7184-456d-8ba7-f68622570670 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:32.210327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050613c-7184-456d-8ba7-f68622570670 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:32.211042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050613c-7184-456d-8ba7-f68622570670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:32.213213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050613c-7184-456d-8ba7-f68622570670 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:32.232057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fce3d-8a91-43fc-b140-9b05d9cfca56 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:32.234540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d3fce3d-8a91-43fc-b140-9b05d9cfca56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:32.253505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fce3d-8a91-43fc-b140-9b05d9cfca56 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:32.259446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b54b3-85dc-40a9-b0d6-2f20c7373a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:32.260147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b54b3-85dc-40a9-b0d6-2f20c7373a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:32.260570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b54b3-85dc-40a9-b0d6-2f20c7373a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:32.260848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b54b3-85dc-40a9-b0d6-2f20c7373a9b admin admin] PATH_INFO: `/v3/users/a4a0713f4bfc4b1fb99f4afe849b042d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:32.262735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b54b3-85dc-40a9-b0d6-2f20c7373a9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a0713f4bfc4b1fb99f4afe849b042d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:32.265514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b54b3-85dc-40a9-b0d6-2f20c7373a9b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:32.273368 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3055/6105] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:32 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:32.274785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050613c-7184-456d-8ba7-f68622570670 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:32.301144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050613c-7184-456d-8ba7-f68622570670 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:32.317396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f79ac-105b-40d9-98e1-cf1e35622462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:32.318031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f79ac-105b-40d9-98e1-cf1e35622462 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:32.318312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f79ac-105b-40d9-98e1-cf1e35622462 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:32.318691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f79ac-105b-40d9-98e1-cf1e35622462 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:32.319389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f79ac-105b-40d9-98e1-cf1e35622462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:32.321154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f79ac-105b-40d9-98e1-cf1e35622462 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:32.341090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:32.349471 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3056/6106] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:32.353603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f79ac-105b-40d9-98e1-cf1e35622462 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:32.382565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f79ac-105b-40d9-98e1-cf1e35622462 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:32.384201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-913b54b3-85dc-40a9-b0d6-2f20c7373a9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a0713f4bfc4b1fb99f4afe849b042d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:32.385086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-913b54b3-85dc-40a9-b0d6-2f20c7373a9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a0713f4bfc4b1fb99f4afe849b042d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:32.397598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4cbbe-c96e-4db5-916e-b011dd040878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:32.401480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4cbbe-c96e-4db5-916e-b011dd040878 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:32.401907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4cbbe-c96e-4db5-916e-b011dd040878 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:32.402309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4cbbe-c96e-4db5-916e-b011dd040878 admin admin] PATH_INFO: `/v3/projects/c7f35b2233854b6bb42b0f8e1ef4aa9b/users/39ba678e1e774521b15e7ecec79b8212/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:32.402863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-913b54b3-85dc-40a9-b0d6-2f20c7373a9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a0713f4bfc4b1fb99f4afe849b042d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:32.422816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-913b54b3-85dc-40a9-b0d6-2f20c7373a9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a0713f4bfc4b1fb99f4afe849b042d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:32.441553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4cbbe-c96e-4db5-916e-b011dd040878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f35b2233854b6bb42b0f8e1ef4aa9b, user_id=39ba678e1e774521b15e7ecec79b8212, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:32.444745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4cbbe-c96e-4db5-916e-b011dd040878 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:32.446697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-913b54b3-85dc-40a9-b0d6-2f20c7373a9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a0713f4bfc4b1fb99f4afe849b042d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:32.460003 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3051/6107] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:32 2022] DELETE /identity/v3/users/a4a0713f4bfc4b1fb99f4afe849b042d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:32.477214 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3057/6108] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:32 2022] PUT /identity/v3/projects/c7f35b2233854b6bb42b0f8e1ef4aa9b/users/39ba678e1e774521b15e7ecec79b8212/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:32.481156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b54b3-85dc-40a9-b0d6-2f20c7373a9b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:32.484206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-913b54b3-85dc-40a9-b0d6-2f20c7373a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:32.630652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b54b3-85dc-40a9-b0d6-2f20c7373a9b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:32.716149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756789e-702a-4c86-afd6-42321c8755d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:32.717858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756789e-702a-4c86-afd6-42321c8755d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:32.718354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756789e-702a-4c86-afd6-42321c8755d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:32.718761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756789e-702a-4c86-afd6-42321c8755d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:32.719583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756789e-702a-4c86-afd6-42321c8755d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:32.722264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756789e-702a-4c86-afd6-42321c8755d4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:32.754515 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3052/6109] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:32.758842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4cbbe-c96e-4db5-916e-b011dd040878 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:32.774756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4cbbe-c96e-4db5-916e-b011dd040878 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:32.786221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b9cb7-29a9-4f1d-ab8e-fa1787da42a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:32.786963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b9cb7-29a9-4f1d-ab8e-fa1787da42a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:32.787248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b9cb7-29a9-4f1d-ab8e-fa1787da42a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:32.787603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b9cb7-29a9-4f1d-ab8e-fa1787da42a6 admin admin] PATH_INFO: `/v3/projects/c7f35b2233854b6bb42b0f8e1ef4aa9b/users/39ba678e1e774521b15e7ecec79b8212/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:32.792130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b9cb7-29a9-4f1d-ab8e-fa1787da42a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f35b2233854b6bb42b0f8e1ef4aa9b, user_id=39ba678e1e774521b15e7ecec79b8212, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:32.795097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b9cb7-29a9-4f1d-ab8e-fa1787da42a6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:32.825047 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3058/6110] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:32 2022] PUT /identity/v3/projects/c7f35b2233854b6bb42b0f8e1ef4aa9b/users/39ba678e1e774521b15e7ecec79b8212/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:46:32.837356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23b5d2-82f5-442c-b30b-83abe8d8771d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:32.837948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23b5d2-82f5-442c-b30b-83abe8d8771d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:32.838393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23b5d2-82f5-442c-b30b-83abe8d8771d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:32.848354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b9cb7-29a9-4f1d-ab8e-fa1787da42a6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:32.850939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ba4b9cb7-29a9-4f1d-ab8e-fa1787da42a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:32.914712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4b23b5d2-82f5-442c-b30b-83abe8d8771d None None] MFA Rules not processed for user `39ba678e1e774521b15e7ecec79b8212`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:32.915969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4b23b5d2-82f5-442c-b30b-83abe8d8771d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:32.959287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b9cb7-29a9-4f1d-ab8e-fa1787da42a6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:32.968655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49768a88-2ff6-4156-9e75-607485dca22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:32.969753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49768a88-2ff6-4156-9e75-607485dca22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:32.970287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49768a88-2ff6-4156-9e75-607485dca22d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:32.970870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49768a88-2ff6-4156-9e75-607485dca22d admin admin] PATH_INFO: `/v3/projects/6cf22e385b8f4e4bb0e802416446fe1d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:32.972872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49768a88-2ff6-4156-9e75-607485dca22d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf22e385b8f4e4bb0e802416446fe1d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:32.976917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49768a88-2ff6-4156-9e75-607485dca22d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:32.977057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:33.001919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:33.037696 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3053/6111] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:33.041727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23b5d2-82f5-442c-b30b-83abe8d8771d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:33.053140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23b5d2-82f5-442c-b30b-83abe8d8771d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:33.071997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49768a88-2ff6-4156-9e75-607485dca22d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf22e385b8f4e4bb0e802416446fe1d', 'request_id': 'req-49768a88-2ff6-4156-9e75-607485dca22d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:33.092589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49768a88-2ff6-4156-9e75-607485dca22d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf22e385b8f4e4bb0e802416446fe1d', 'request_id': 'req-49768a88-2ff6-4156-9e75-607485dca22d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:33.106519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49768a88-2ff6-4156-9e75-607485dca22d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf22e385b8f4e4bb0e802416446fe1d', 'request_id': 'req-49768a88-2ff6-4156-9e75-607485dca22d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:33.137227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49768a88-2ff6-4156-9e75-607485dca22d admin admin] The token cache is being invalidate because project 6cf22e385b8f4e4bb0e802416446fe1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:33.137533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49768a88-2ff6-4156-9e75-607485dca22d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:33.139565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49768a88-2ff6-4156-9e75-607485dca22d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:33.144310 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3059/6112] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:32 2022] DELETE /identity/v3/projects/6cf22e385b8f4e4bb0e802416446fe1d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:33.149161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75da35-e018-4f4c-a013-ea1449ac64f1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:33.149873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75da35-e018-4f4c-a013-ea1449ac64f1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:33.151289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75da35-e018-4f4c-a013-ea1449ac64f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:33.181697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d7a0d-4c81-4c32-8d37-aa36f287d120 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ba678e1e774521b15e7ecec79b8212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:33.183455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d7a0d-4c81-4c32-8d37-aa36f287d120 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:33.184567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d7a0d-4c81-4c32-8d37-aa36f287d120 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:33.186200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d7a0d-4c81-4c32-8d37-aa36f287d120 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] PATH_INFO: `/v3/regions` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:33.191012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d7a0d-4c81-4c32-8d37-aa36f287d120 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:33.195992 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-5e5d7a0d-4c81-4c32-8d37-aa36f287d120 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:46:33.195992 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:46:33.195992 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:46:33.197037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d7a0d-4c81-4c32-8d37-aa36f287d120 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:33.220797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5e75da35-e018-4f4c-a013-ea1449ac64f1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:33.225801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5e75da35-e018-4f4c-a013-ea1449ac64f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:33.252044 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3054/6113] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:46:33 2022] POST /identity/v3/regions => generated 223 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:33.255398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d7a0d-4c81-4c32-8d37-aa36f287d120 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:33.259514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e5d7a0d-4c81-4c32-8d37-aa36f287d120 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:33.316284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d7a0d-4c81-4c32-8d37-aa36f287d120 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:33.335635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eecf6c-426d-4a56-a1f1-02bd7b09a513 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ba678e1e774521b15e7ecec79b8212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:33.336468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eecf6c-426d-4a56-a1f1-02bd7b09a513 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:33.336751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eecf6c-426d-4a56-a1f1-02bd7b09a513 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:33.337032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eecf6c-426d-4a56-a1f1-02bd7b09a513 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] PATH_INFO: `/v3/regions` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:33.337689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eecf6c-426d-4a56-a1f1-02bd7b09a513 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:33.340467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eecf6c-426d-4a56-a1f1-02bd7b09a513 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:33.375761 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3055/6114] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:46:33 2022] POST /identity/v3/regions => generated 223 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:33.380184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eecf6c-426d-4a56-a1f1-02bd7b09a513 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:33.408991 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3060/6115] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:33.416592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebbdff-eb76-461f-b46c-e89ccaa943e3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:33.416886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebbdff-eb76-461f-b46c-e89ccaa943e3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:33.417161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebbdff-eb76-461f-b46c-e89ccaa943e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:33.432190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eecf6c-426d-4a56-a1f1-02bd7b09a513 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:33.445097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb77881-2dc9-4ee0-917e-f5af19aaffe5 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ba678e1e774521b15e7ecec79b8212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:33.446937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb77881-2dc9-4ee0-917e-f5af19aaffe5 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:33.447226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb77881-2dc9-4ee0-917e-f5af19aaffe5 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:33.448430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb77881-2dc9-4ee0-917e-f5af19aaffe5 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] PATH_INFO: `/v3/regions/0ea96bed-fce9-4223-b744-7eb9c71ef5be` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:33.449120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb77881-2dc9-4ee0-917e-f5af19aaffe5 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorizing `identity:create_region(region_id=0ea96bed-fce9-4223-b744-7eb9c71ef5be)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:33.451287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4aebbdff-eb76-461f-b46c-e89ccaa943e3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:33.452612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4aebbdff-eb76-461f-b46c-e89ccaa943e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:33.453041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb77881-2dc9-4ee0-917e-f5af19aaffe5 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:33.462200 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3061/6116] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:46:33.466729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebbdff-eb76-461f-b46c-e89ccaa943e3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:33.490296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebbdff-eb76-461f-b46c-e89ccaa943e3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:33.502494 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3056/6117] 10.222.0.27 () {60 vars in 1259 bytes} [Sun Aug 28 18:46:33 2022] PUT /identity/v3/regions/0ea96bed-fce9-4223-b744-7eb9c71ef5be => generated 231 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:33.511568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb77881-2dc9-4ee0-917e-f5af19aaffe5 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:33.526457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d657240-dfe2-4be0-84a5-8c86984f63e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:33.529256 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d657240-dfe2-4be0-84a5-8c86984f63e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:33.529628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d657240-dfe2-4be0-84a5-8c86984f63e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:33.529981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d657240-dfe2-4be0-84a5-8c86984f63e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:33.531531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d657240-dfe2-4be0-84a5-8c86984f63e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:46:33.533134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d657240-dfe2-4be0-84a5-8c86984f63e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:33.534907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d657240-dfe2-4be0-84a5-8c86984f63e3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:33.573107 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3062/6118] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:46:33.575152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d657240-dfe2-4be0-84a5-8c86984f63e3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:33.576093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb77881-2dc9-4ee0-917e-f5af19aaffe5 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:33.586574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839f39e-d00a-4e78-909b-761a2f8d0ecf tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ba678e1e774521b15e7ecec79b8212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:33.587414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839f39e-d00a-4e78-909b-761a2f8d0ecf tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:33.587702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839f39e-d00a-4e78-909b-761a2f8d0ecf tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:33.588318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839f39e-d00a-4e78-909b-761a2f8d0ecf tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] PATH_INFO: `/v3/regions/0ea96bed-fce9-4223-b744-7eb9c71ef5be` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:33.588749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839f39e-d00a-4e78-909b-761a2f8d0ecf tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorizing `identity:delete_region(region_id=0ea96bed-fce9-4223-b744-7eb9c71ef5be)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:33.590419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839f39e-d00a-4e78-909b-761a2f8d0ecf tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:33.602663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d657240-dfe2-4be0-84a5-8c86984f63e3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:33.614648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28e40c-4e8d-482b-aa28-c6239d54978f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:33.616774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28e40c-4e8d-482b-aa28-c6239d54978f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:33.617189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28e40c-4e8d-482b-aa28-c6239d54978f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:33.617691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28e40c-4e8d-482b-aa28-c6239d54978f admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:33.618831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28e40c-4e8d-482b-aa28-c6239d54978f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:33.625938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28e40c-4e8d-482b-aa28-c6239d54978f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:33.636519 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3057/6119] 10.222.0.27 () {58 vars in 1242 bytes} [Sun Aug 28 18:46:33 2022] DELETE /identity/v3/regions/0ea96bed-fce9-4223-b744-7eb9c71ef5be => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:33.641638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839f39e-d00a-4e78-909b-761a2f8d0ecf tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:33.689155 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3063/6120] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:33 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:33.693045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28e40c-4e8d-482b-aa28-c6239d54978f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:33.703301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839f39e-d00a-4e78-909b-761a2f8d0ecf tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:33.781861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:33.876533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:33.924900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844783be-5fb8-4258-9895-4c903f8dab40 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ba678e1e774521b15e7ecec79b8212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:33.925106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844783be-5fb8-4258-9895-4c903f8dab40 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:33.925374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844783be-5fb8-4258-9895-4c903f8dab40 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:33.925643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844783be-5fb8-4258-9895-4c903f8dab40 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] PATH_INFO: `/v3/regions` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:33.926309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844783be-5fb8-4258-9895-4c903f8dab40 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:33.928235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844783be-5fb8-4258-9895-4c903f8dab40 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:33.934475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28e40c-4e8d-482b-aa28-c6239d54978f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:33.989616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ec305-5394-43ae-a08e-2eef350f1197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:33.994223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ec305-5394-43ae-a08e-2eef350f1197 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:33.996342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ec305-5394-43ae-a08e-2eef350f1197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:33.996637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ec305-5394-43ae-a08e-2eef350f1197 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:34.000706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ec305-5394-43ae-a08e-2eef350f1197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:34.004886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ec305-5394-43ae-a08e-2eef350f1197 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:34.011025 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3058/6121] 10.222.0.27 () {60 vars in 1150 bytes} [Sun Aug 28 18:46:33 2022] POST /identity/v3/regions => generated 254 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:46:34.014240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844783be-5fb8-4258-9895-4c903f8dab40 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:34.081983 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3064/6122] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:33 2022] POST /identity/v3/users => generated 288 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:34.086430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ec305-5394-43ae-a08e-2eef350f1197 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:34.096762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844783be-5fb8-4258-9895-4c903f8dab40 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:34.105153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09979ee-f8b5-490d-a7bc-f101bf841ee7 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ba678e1e774521b15e7ecec79b8212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:34.106226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09979ee-f8b5-490d-a7bc-f101bf841ee7 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:34.107764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09979ee-f8b5-490d-a7bc-f101bf841ee7 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:34.108050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09979ee-f8b5-490d-a7bc-f101bf841ee7 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] PATH_INFO: `/v3/regions/a620f4da188e45de9525c2808d48fdb3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:34.109427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09979ee-f8b5-490d-a7bc-f101bf841ee7 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorizing `identity:update_region(region_id=a620f4da188e45de9525c2808d48fdb3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:34.111667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ec305-5394-43ae-a08e-2eef350f1197 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:34.112667 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-d09979ee-f8b5-490d-a7bc-f101bf841ee7 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:46:34.112667 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:46:34.112667 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:46:34.113640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09979ee-f8b5-490d-a7bc-f101bf841ee7 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:34.143015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69683ede-23dc-470b-8ef6-9fd12e992d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:34.143015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69683ede-23dc-470b-8ef6-9fd12e992d62 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:34.143455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69683ede-23dc-470b-8ef6-9fd12e992d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:34.143618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69683ede-23dc-470b-8ef6-9fd12e992d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:34.144330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69683ede-23dc-470b-8ef6-9fd12e992d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:34.146566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69683ede-23dc-470b-8ef6-9fd12e992d62 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:34.161264 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3059/6123] 10.222.0.27 () {60 vars in 1250 bytes} [Sun Aug 28 18:46:34 2022] PATCH /identity/v3/regions/a620f4da188e45de9525c2808d48fdb3 => generated 254 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:46:34.163204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09979ee-f8b5-490d-a7bc-f101bf841ee7 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:34.184692 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3065/6124] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:34.188704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69683ede-23dc-470b-8ef6-9fd12e992d62 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:34.215537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69683ede-23dc-470b-8ef6-9fd12e992d62 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:34.218254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09979ee-f8b5-490d-a7bc-f101bf841ee7 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:34.229800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d67406-b4cd-4a57-ba4b-d8e86fd0a640 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ba678e1e774521b15e7ecec79b8212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:34.230011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d67406-b4cd-4a57-ba4b-d8e86fd0a640 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:34.230284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d67406-b4cd-4a57-ba4b-d8e86fd0a640 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:34.230559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d67406-b4cd-4a57-ba4b-d8e86fd0a640 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] PATH_INFO: `/v3/regions/a620f4da188e45de9525c2808d48fdb3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:34.231161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d67406-b4cd-4a57-ba4b-d8e86fd0a640 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorizing `identity:get_region(region_id=a620f4da188e45de9525c2808d48fdb3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:34.232287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d67406-b4cd-4a57-ba4b-d8e86fd0a640 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:34.254703 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3060/6125] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:46:34 2022] GET /identity/v3/regions/a620f4da188e45de9525c2808d48fdb3 => generated 254 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:46:34.256425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d67406-b4cd-4a57-ba4b-d8e86fd0a640 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:34.259211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d6165-ec06-465a-a227-65f3e2092c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:34.259965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d6165-ec06-465a-a227-65f3e2092c58 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:34.260244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d6165-ec06-465a-a227-65f3e2092c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:34.260520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d6165-ec06-465a-a227-65f3e2092c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:34.262060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d6165-ec06-465a-a227-65f3e2092c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:34.263248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d6165-ec06-465a-a227-65f3e2092c58 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:34.280104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d67406-b4cd-4a57-ba4b-d8e86fd0a640 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:34.291666 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3066/6126] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:34.293414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6c984-7047-44d6-82c1-cfbc8870c5ed tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ba678e1e774521b15e7ecec79b8212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:34.293710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d6165-ec06-465a-a227-65f3e2092c58 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:34.294162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6c984-7047-44d6-82c1-cfbc8870c5ed tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:34.294457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6c984-7047-44d6-82c1-cfbc8870c5ed tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:34.294735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6c984-7047-44d6-82c1-cfbc8870c5ed tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] PATH_INFO: `/v3/regions/a620f4da188e45de9525c2808d48fdb3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:34.295356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6c984-7047-44d6-82c1-cfbc8870c5ed tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a620f4da188e45de9525c2808d48fdb3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:34.297028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6c984-7047-44d6-82c1-cfbc8870c5ed tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:34.306078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d6165-ec06-465a-a227-65f3e2092c58 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:34.311493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bde859-9373-4fc1-88d3-f27b5eb63449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:34.312642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bde859-9373-4fc1-88d3-f27b5eb63449 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:34.313236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bde859-9373-4fc1-88d3-f27b5eb63449 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:34.313634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bde859-9373-4fc1-88d3-f27b5eb63449 admin admin] PATH_INFO: `/v3/projects/1fef510420d0432b875c32dce48d102d/users/afdf62f3cae74b359622eb3bb55f43d9/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:34.352536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bde859-9373-4fc1-88d3-f27b5eb63449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fef510420d0432b875c32dce48d102d, user_id=afdf62f3cae74b359622eb3bb55f43d9, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:34.361970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bde859-9373-4fc1-88d3-f27b5eb63449 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:34.362603 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3061/6127] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:46:34 2022] DELETE /identity/v3/regions/a620f4da188e45de9525c2808d48fdb3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:34.365240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6c984-7047-44d6-82c1-cfbc8870c5ed tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:34.395518 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3067/6128] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:34 2022] PUT /identity/v3/projects/1fef510420d0432b875c32dce48d102d/users/afdf62f3cae74b359622eb3bb55f43d9/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:34.400022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c535d65-8186-4b72-a04a-e318f98169b0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:34.400346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c535d65-8186-4b72-a04a-e318f98169b0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:34.400631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c535d65-8186-4b72-a04a-e318f98169b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:34.422401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6c984-7047-44d6-82c1-cfbc8870c5ed tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:34.451698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1c535d65-8186-4b72-a04a-e318f98169b0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:34.455448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1c535d65-8186-4b72-a04a-e318f98169b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:34.628241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff4e1b-9c63-407a-a10d-56e9ebdf9494 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ba678e1e774521b15e7ecec79b8212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:34.628241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4e1b-9c63-407a-a10d-56e9ebdf9494 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:34.628241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4e1b-9c63-407a-a10d-56e9ebdf9494 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:34.628864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4e1b-9c63-407a-a10d-56e9ebdf9494 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] PATH_INFO: `/v3/regions` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:34.628864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff4e1b-9c63-407a-a10d-56e9ebdf9494 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:34.628864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff4e1b-9c63-407a-a10d-56e9ebdf9494 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:34.648470 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3062/6129] 10.222.0.27 () {58 vars in 1128 bytes} [Sun Aug 28 18:46:34 2022] GET /identity/v3/regions => generated 668 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:46:34.655004 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3068/6130] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:34.655125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff4e1b-9c63-407a-a10d-56e9ebdf9494 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:34.660301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c535d65-8186-4b72-a04a-e318f98169b0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:34.662049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1c535d65-8186-4b72-a04a-e318f98169b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:34.693306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff4e1b-9c63-407a-a10d-56e9ebdf9494 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:34.706661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3f7d1-86da-414e-8904-9627bc9481aa tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ba678e1e774521b15e7ecec79b8212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:34.707366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3f7d1-86da-414e-8904-9627bc9481aa tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:34.707652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3f7d1-86da-414e-8904-9627bc9481aa tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:34.707926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3f7d1-86da-414e-8904-9627bc9481aa tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] PATH_INFO: `/v3/regions/a620f4da188e45de9525c2808d48fdb3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:34.708525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3f7d1-86da-414e-8904-9627bc9481aa tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a620f4da188e45de9525c2808d48fdb3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:34.715471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3f7d1-86da-414e-8904-9627bc9481aa tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:34.735079 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-1ec3f7d1-86da-414e-8904-9627bc9481aa tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Could not find region: a620f4da188e45de9525c2808d48fdb3.: keystone.exception.RegionNotFound: Could not find region: a620f4da188e45de9525c2808d48fdb3. Aug 28 18:46:34.735079 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:46:34.735079 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Aug 28 18:46:34.735079 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Aug 28 18:46:34.735079 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Aug 28 18:46:34.735079 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Aug 28 18:46:34.735079 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Aug 28 18:46:34.735079 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 28 18:46:34.735079 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: a620f4da188e45de9525c2808d48fdb3. Aug 28 18:46:34.735079 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:46:34.735079 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:46:34.735079 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:46:34.735079 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:46:34.735079 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:46:34.735079 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:46:34.735079 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:46:34.736078 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:46:34.736078 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:46:34.736078 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:46:34.736078 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:46:34.736078 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:46:34.736078 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:46:34.736078 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:46:34.736078 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Aug 28 18:46:34.736078 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Aug 28 18:46:34.736078 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:46:34.736078 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:46:34.736078 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Aug 28 18:46:34.736078 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 28 18:46:34.736078 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: a620f4da188e45de9525c2808d48fdb3. Aug 28 18:46:34.736078 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:46:34.741904 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3063/6131] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:46:34 2022] DELETE /identity/v3/regions/a620f4da188e45de9525c2808d48fdb3 => generated 112 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:46:34.743628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3f7d1-86da-414e-8904-9627bc9481aa tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:34.805371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3f7d1-86da-414e-8904-9627bc9481aa tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:34.809052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:34.826200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be049d1-4245-4ea3-97b8-11524706f201 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ba678e1e774521b15e7ecec79b8212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:34.829251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be049d1-4245-4ea3-97b8-11524706f201 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:34.830774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be049d1-4245-4ea3-97b8-11524706f201 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:34.835794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be049d1-4245-4ea3-97b8-11524706f201 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] PATH_INFO: `/v3/regions` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:34.836607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c535d65-8186-4b72-a04a-e318f98169b0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:34.836816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be049d1-4245-4ea3-97b8-11524706f201 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:34.838073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be049d1-4245-4ea3-97b8-11524706f201 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:34.852550 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3064/6132] 10.222.0.27 () {58 vars in 1128 bytes} [Sun Aug 28 18:46:34 2022] GET /identity/v3/regions => generated 668 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:46:34.857319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be049d1-4245-4ea3-97b8-11524706f201 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:34.861071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01d95f-896f-40d6-92b1-3e9ac1223afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:34.863410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01d95f-896f-40d6-92b1-3e9ac1223afc service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:34.868005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01d95f-896f-40d6-92b1-3e9ac1223afc service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:34.868514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01d95f-896f-40d6-92b1-3e9ac1223afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:34.876151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be049d1-4245-4ea3-97b8-11524706f201 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:34.895203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c4496-c933-4c17-9a9c-d86d2024589d tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ba678e1e774521b15e7ecec79b8212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:34.895881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c4496-c933-4c17-9a9c-d86d2024589d tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:34.896162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c4496-c933-4c17-9a9c-d86d2024589d tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:34.896437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c4496-c933-4c17-9a9c-d86d2024589d tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] PATH_INFO: `/v3/regions` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:34.897250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c4496-c933-4c17-9a9c-d86d2024589d tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:34.898265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01d95f-896f-40d6-92b1-3e9ac1223afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:34.899072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c4496-c933-4c17-9a9c-d86d2024589d tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:34.902299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01d95f-896f-40d6-92b1-3e9ac1223afc service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:34.928316 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3069/6133] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:34.933324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:34.941979 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3065/6134] 10.222.0.27 () {60 vars in 1150 bytes} [Sun Aug 28 18:46:34 2022] POST /identity/v3/regions => generated 254 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:34.946685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01d95f-896f-40d6-92b1-3e9ac1223afc service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:34.962647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01d95f-896f-40d6-92b1-3e9ac1223afc service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:35.025841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b175eb5-37ca-4974-9073-00679100bf50 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ba678e1e774521b15e7ecec79b8212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:35.026499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b175eb5-37ca-4974-9073-00679100bf50 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:35.028347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b175eb5-37ca-4974-9073-00679100bf50 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:35.028677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b175eb5-37ca-4974-9073-00679100bf50 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] PATH_INFO: `/v3/regions` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:35.030454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b175eb5-37ca-4974-9073-00679100bf50 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Adding query filter params (parent_region_id=d9a78d3b7ff84bb28a50349d0c91a340) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:46:35.030793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b175eb5-37ca-4974-9073-00679100bf50 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:35.032924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b175eb5-37ca-4974-9073-00679100bf50 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:35.044238 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3070/6135] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:46:34 2022] GET /identity/v3/regions?parent_region_id=d9a78d3b7ff84bb28a50349d0c91a340 => generated 400 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:46:35.046094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c4496-c933-4c17-9a9c-d86d2024589d tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:35.063751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c4496-c933-4c17-9a9c-d86d2024589d tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:35.082255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2d7e4-655d-4fce-9733-694a0067b8e1 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ba678e1e774521b15e7ecec79b8212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:35.082912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2d7e4-655d-4fce-9733-694a0067b8e1 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:35.083191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2d7e4-655d-4fce-9733-694a0067b8e1 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:35.083507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2d7e4-655d-4fce-9733-694a0067b8e1 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] PATH_INFO: `/v3/regions/c16a3c5e6ca64ea6b88db0e46b55bc37` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:35.084441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2d7e4-655d-4fce-9733-694a0067b8e1 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorizing `identity:delete_region(region_id=c16a3c5e6ca64ea6b88db0e46b55bc37)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:35.086072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2d7e4-655d-4fce-9733-694a0067b8e1 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:35.144902 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3066/6136] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:46:35 2022] DELETE /identity/v3/regions/c16a3c5e6ca64ea6b88db0e46b55bc37 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:35.151232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b175eb5-37ca-4974-9073-00679100bf50 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:35.166460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b175eb5-37ca-4974-9073-00679100bf50 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:35.210916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd84ae-5d07-4af0-a48e-c49b6beafa43 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ba678e1e774521b15e7ecec79b8212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:35.211613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd84ae-5d07-4af0-a48e-c49b6beafa43 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:35.211898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd84ae-5d07-4af0-a48e-c49b6beafa43 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:35.212549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd84ae-5d07-4af0-a48e-c49b6beafa43 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] PATH_INFO: `/v3/regions/a5058f6166744b56bc349acbe82d4c5e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:35.213153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd84ae-5d07-4af0-a48e-c49b6beafa43 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a5058f6166744b56bc349acbe82d4c5e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:35.215028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd84ae-5d07-4af0-a48e-c49b6beafa43 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:35.269548 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3071/6137] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:46:35 2022] DELETE /identity/v3/regions/a5058f6166744b56bc349acbe82d4c5e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:35.273484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2d7e4-655d-4fce-9733-694a0067b8e1 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:35.308969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2d7e4-655d-4fce-9733-694a0067b8e1 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:35.376031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aaa12b-39f7-46e0-a085-f69a55b4b27c tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ba678e1e774521b15e7ecec79b8212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:35.378080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aaa12b-39f7-46e0-a085-f69a55b4b27c tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:35.378375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aaa12b-39f7-46e0-a085-f69a55b4b27c tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:35.378661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aaa12b-39f7-46e0-a085-f69a55b4b27c tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] PATH_INFO: `/v3/regions/d9a78d3b7ff84bb28a50349d0c91a340` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:35.379324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aaa12b-39f7-46e0-a085-f69a55b4b27c tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorizing `identity:delete_region(region_id=d9a78d3b7ff84bb28a50349d0c91a340)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:35.381126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aaa12b-39f7-46e0-a085-f69a55b4b27c tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:35.442974 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3067/6138] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:46:35 2022] DELETE /identity/v3/regions/d9a78d3b7ff84bb28a50349d0c91a340 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:35.444777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd84ae-5d07-4af0-a48e-c49b6beafa43 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:35.447561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bbdd84ae-5d07-4af0-a48e-c49b6beafa43 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:35.554907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd84ae-5d07-4af0-a48e-c49b6beafa43 tempest-RegionsTestJSON-1980292924 tempest-RegionsTestJSON-1980292924-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:35.608794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b3a9c-c165-4aab-8f7f-193003caa420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:35.609458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b3a9c-c165-4aab-8f7f-193003caa420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:35.610905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b3a9c-c165-4aab-8f7f-193003caa420 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:35.610905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b3a9c-c165-4aab-8f7f-193003caa420 admin admin] PATH_INFO: `/v3/users/4be924cdd47549a7849854561e455370` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:35.614407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b3a9c-c165-4aab-8f7f-193003caa420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be924cdd47549a7849854561e455370)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:35.618727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b3a9c-c165-4aab-8f7f-193003caa420 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:35.735179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-303b3a9c-c165-4aab-8f7f-193003caa420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be924cdd47549a7849854561e455370'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:35.767038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-303b3a9c-c165-4aab-8f7f-193003caa420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be924cdd47549a7849854561e455370'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:35.768163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-303b3a9c-c165-4aab-8f7f-193003caa420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be924cdd47549a7849854561e455370'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:35.769671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-303b3a9c-c165-4aab-8f7f-193003caa420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be924cdd47549a7849854561e455370'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:35.784071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-303b3a9c-c165-4aab-8f7f-193003caa420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be924cdd47549a7849854561e455370'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:35.832098 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3072/6139] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:35 2022] DELETE /identity/v3/users/4be924cdd47549a7849854561e455370 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:35.836510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9c26-0828-401f-b8b6-48446f0d3c86 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:35.837016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9c26-0828-401f-b8b6-48446f0d3c86 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:35.837240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9c26-0828-401f-b8b6-48446f0d3c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:35.871505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fb2f9c26-0828-401f-b8b6-48446f0d3c86 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:35.872714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb2f9c26-0828-401f-b8b6-48446f0d3c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:36.020754 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3068/6140] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:36.034461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b3a9c-c165-4aab-8f7f-193003caa420 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:36.037488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-303b3a9c-c165-4aab-8f7f-193003caa420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:36.171529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:36.186357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b3a9c-c165-4aab-8f7f-193003caa420 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:36.193449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1b6c2-60e0-4252-adb4-d49ba97be6fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:36.193765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1b6c2-60e0-4252-adb4-d49ba97be6fc service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:36.194046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1b6c2-60e0-4252-adb4-d49ba97be6fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:36.194317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1b6c2-60e0-4252-adb4-d49ba97be6fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:36.207158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1b6c2-60e0-4252-adb4-d49ba97be6fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:36.209016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1b6c2-60e0-4252-adb4-d49ba97be6fc service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:36.227122 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3073/6141] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:36.288898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d08e5-0380-4b00-a329-94aa631a8455 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:36.289197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d08e5-0380-4b00-a329-94aa631a8455 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:36.289470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d08e5-0380-4b00-a329-94aa631a8455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:36.336285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-631d08e5-0380-4b00-a329-94aa631a8455 None None] MFA Rules not processed for user `185b4855098e46449a5b3e44339e51f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:36.343438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-631d08e5-0380-4b00-a329-94aa631a8455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:36.444048 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3069/6142] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:37.582573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1b6c2-60e0-4252-adb4-d49ba97be6fc service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:37.584277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d6a1b6c2-60e0-4252-adb4-d49ba97be6fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:37.623286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1b6c2-60e0-4252-adb4-d49ba97be6fc service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:37.635398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:37.636136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:37.636528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:37.638712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1 admin admin] PATH_INFO: `/v3/projects/bf0449cbd6a942fd8e4095bf05dd1c35` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:37.640594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0449cbd6a942fd8e4095bf05dd1c35)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:37.645540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:37.761809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0449cbd6a942fd8e4095bf05dd1c35', 'request_id': 'req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:37.785701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0449cbd6a942fd8e4095bf05dd1c35', 'request_id': 'req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:37.801360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0449cbd6a942fd8e4095bf05dd1c35', 'request_id': 'req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:37.829049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1 admin admin] The token cache is being invalidate because project bf0449cbd6a942fd8e4095bf05dd1c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:37.829352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:37.839577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:37.842896 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3074/6143] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:37 2022] DELETE /identity/v3/projects/bf0449cbd6a942fd8e4095bf05dd1c35 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:37.847883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d08e5-0380-4b00-a329-94aa631a8455 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:37.871164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d08e5-0380-4b00-a329-94aa631a8455 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:37.994688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:38.018817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f350a17-1471-4cd7-a3f3-c6641d486d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:38.020084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f350a17-1471-4cd7-a3f3-c6641d486d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:38.020368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f350a17-1471-4cd7-a3f3-c6641d486d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:38.020686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f350a17-1471-4cd7-a3f3-c6641d486d0b admin admin] PATH_INFO: `/v3/users/39ba678e1e774521b15e7ecec79b8212` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:38.022205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f350a17-1471-4cd7-a3f3-c6641d486d0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ba678e1e774521b15e7ecec79b8212)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:38.025118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f350a17-1471-4cd7-a3f3-c6641d486d0b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:38.108764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f350a17-1471-4cd7-a3f3-c6641d486d0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ba678e1e774521b15e7ecec79b8212'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:38.109414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f350a17-1471-4cd7-a3f3-c6641d486d0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ba678e1e774521b15e7ecec79b8212'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:38.127531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f350a17-1471-4cd7-a3f3-c6641d486d0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ba678e1e774521b15e7ecec79b8212'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:38.139437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f350a17-1471-4cd7-a3f3-c6641d486d0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ba678e1e774521b15e7ecec79b8212'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:38.159402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f350a17-1471-4cd7-a3f3-c6641d486d0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ba678e1e774521b15e7ecec79b8212'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:38.167464 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3070/6144] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:37 2022] DELETE /identity/v3/users/39ba678e1e774521b15e7ecec79b8212 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:39.901829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:39.905722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:39.946871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408c6dd-d7e6-4526-a6ba-bde3846a97b1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:40.084678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15f40b-0287-4ce3-9533-c803ec970b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:40.085381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15f40b-0287-4ce3-9533-c803ec970b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:40.085662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15f40b-0287-4ce3-9533-c803ec970b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:40.085938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15f40b-0287-4ce3-9533-c803ec970b60 admin admin] PATH_INFO: `/v3/projects/c7f35b2233854b6bb42b0f8e1ef4aa9b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:40.088805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15f40b-0287-4ce3-9533-c803ec970b60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f35b2233854b6bb42b0f8e1ef4aa9b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:40.090497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15f40b-0287-4ce3-9533-c803ec970b60 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:40.222170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d15f40b-0287-4ce3-9533-c803ec970b60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'request_id': 'req-2d15f40b-0287-4ce3-9533-c803ec970b60'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:40.236947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d15f40b-0287-4ce3-9533-c803ec970b60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'request_id': 'req-2d15f40b-0287-4ce3-9533-c803ec970b60'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:40.243520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d15f40b-0287-4ce3-9533-c803ec970b60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f35b2233854b6bb42b0f8e1ef4aa9b', 'request_id': 'req-2d15f40b-0287-4ce3-9533-c803ec970b60'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:40.260881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:40.270496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d15f40b-0287-4ce3-9533-c803ec970b60 admin admin] The token cache is being invalidate because project c7f35b2233854b6bb42b0f8e1ef4aa9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:40.271138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d15f40b-0287-4ce3-9533-c803ec970b60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:40.272609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d15f40b-0287-4ce3-9533-c803ec970b60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:40.279227 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3075/6145] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:39 2022] DELETE /identity/v3/projects/c7f35b2233854b6bb42b0f8e1ef4aa9b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:40.283707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a59a00-390b-4154-84db-aa6a49f252d2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:40.284192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a59a00-390b-4154-84db-aa6a49f252d2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:40.284262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a59a00-390b-4154-84db-aa6a49f252d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:40.321123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e3a59a00-390b-4154-84db-aa6a49f252d2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:40.330377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e3a59a00-390b-4154-84db-aa6a49f252d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:40.489436 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3071/6146] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:46:40.491721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192f8c9-599e-42da-9fbe-ee850d853e5b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:40.492198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192f8c9-599e-42da-9fbe-ee850d853e5b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:40.492484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192f8c9-599e-42da-9fbe-ee850d853e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:40.535792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d192f8c9-599e-42da-9fbe-ee850d853e5b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:40.537389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d192f8c9-599e-42da-9fbe-ee850d853e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:40.559902 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3076/6147] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:40.565363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a59a00-390b-4154-84db-aa6a49f252d2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:40.593203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a59a00-390b-4154-84db-aa6a49f252d2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:40.608917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca59b07-e596-4ec9-b507-261f04536ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:40.610947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca59b07-e596-4ec9-b507-261f04536ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:40.611228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca59b07-e596-4ec9-b507-261f04536ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:40.611525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca59b07-e596-4ec9-b507-261f04536ec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:40.612195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca59b07-e596-4ec9-b507-261f04536ec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:46:40.612498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca59b07-e596-4ec9-b507-261f04536ec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:40.614482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca59b07-e596-4ec9-b507-261f04536ec9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:40.647980 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3072/6148] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:46:40.649381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192f8c9-599e-42da-9fbe-ee850d853e5b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:40.665438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192f8c9-599e-42da-9fbe-ee850d853e5b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:40.679139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d7ddc-4fb5-4eaf-a718-fb7536b359ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:40.680110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d7ddc-4fb5-4eaf-a718-fb7536b359ba admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:40.680563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d7ddc-4fb5-4eaf-a718-fb7536b359ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:40.681151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d7ddc-4fb5-4eaf-a718-fb7536b359ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:40.681971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d7ddc-4fb5-4eaf-a718-fb7536b359ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:40.695577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d7ddc-4fb5-4eaf-a718-fb7536b359ba admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:40.758969 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3077/6149] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:40 2022] POST /identity/v3/projects => generated 361 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:40.764760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca59b07-e596-4ec9-b507-261f04536ec9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:40.783669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca59b07-e596-4ec9-b507-261f04536ec9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:40.937508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:40.961954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfc987-a53a-42be-b320-068158968978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:40.962902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfc987-a53a-42be-b320-068158968978 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:40.964186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfc987-a53a-42be-b320-068158968978 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:40.964593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfc987-a53a-42be-b320-068158968978 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:40.965390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfc987-a53a-42be-b320-068158968978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:40.972325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfc987-a53a-42be-b320-068158968978 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:41.026913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d7ddc-4fb5-4eaf-a718-fb7536b359ba admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:41.034580 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3073/6150] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:40 2022] POST /identity/v3/users => generated 281 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:46:41.041975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d7ddc-4fb5-4eaf-a718-fb7536b359ba admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:41.051987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183d037-05b1-43d4-a793-016aed16e09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:41.057972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183d037-05b1-43d4-a793-016aed16e09b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:41.058257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183d037-05b1-43d4-a793-016aed16e09b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:41.058542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183d037-05b1-43d4-a793-016aed16e09b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:41.059247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183d037-05b1-43d4-a793-016aed16e09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:41.061190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183d037-05b1-43d4-a793-016aed16e09b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:41.094767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfc987-a53a-42be-b320-068158968978 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:41.095893 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3078/6151] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:41.135709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfc987-a53a-42be-b320-068158968978 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:41.151640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc215b-bf76-447e-9e1b-f7abdc040c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:41.152286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc215b-bf76-447e-9e1b-f7abdc040c9d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:41.152570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc215b-bf76-447e-9e1b-f7abdc040c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:41.152891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc215b-bf76-447e-9e1b-f7abdc040c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:41.153631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc215b-bf76-447e-9e1b-f7abdc040c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:41.156229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc215b-bf76-447e-9e1b-f7abdc040c9d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:41.217772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183d037-05b1-43d4-a793-016aed16e09b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:41.219111 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3074/6152] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:46:41.245374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183d037-05b1-43d4-a793-016aed16e09b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:41.296049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240aef7-6300-4f2e-a642-f79706717f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:41.297060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240aef7-6300-4f2e-a642-f79706717f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:41.297555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240aef7-6300-4f2e-a642-f79706717f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:41.297921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240aef7-6300-4f2e-a642-f79706717f48 admin admin] PATH_INFO: `/v3/projects/dcea327caa3540b79dbc5cbb1d1185e3/users/f2dc27d5f0e445408831121c429cf608/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:41.343583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240aef7-6300-4f2e-a642-f79706717f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcea327caa3540b79dbc5cbb1d1185e3, user_id=f2dc27d5f0e445408831121c429cf608, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:41.346508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240aef7-6300-4f2e-a642-f79706717f48 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:41.385776 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3079/6153] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:41 2022] PUT /identity/v3/projects/dcea327caa3540b79dbc5cbb1d1185e3/users/f2dc27d5f0e445408831121c429cf608/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:41.391864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d9d46-16bb-4b0b-9edb-8741d7ab28cf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:41.392402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d9d46-16bb-4b0b-9edb-8741d7ab28cf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:41.392402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d9d46-16bb-4b0b-9edb-8741d7ab28cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:41.455712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-979d9d46-16bb-4b0b-9edb-8741d7ab28cf None None] MFA Rules not processed for user `f2dc27d5f0e445408831121c429cf608`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:41.457029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-979d9d46-16bb-4b0b-9edb-8741d7ab28cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:41.642485 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3075/6154] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:41.644451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39039fbd-9b42-4c77-9e13-3ce58cb01569 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:41.644648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39039fbd-9b42-4c77-9e13-3ce58cb01569 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:41.644953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39039fbd-9b42-4c77-9e13-3ce58cb01569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:41.666775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-39039fbd-9b42-4c77-9e13-3ce58cb01569 None None] MFA Rules not processed for user `f2dc27d5f0e445408831121c429cf608`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:41.668088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-39039fbd-9b42-4c77-9e13-3ce58cb01569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:41.672077 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3080/6155] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:41 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:46:41.677523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e7866-fa4f-476a-b332-71f681987e23 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:41.677845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e7866-fa4f-476a-b332-71f681987e23 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:41.678083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e7866-fa4f-476a-b332-71f681987e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:41.738544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-404e7866-fa4f-476a-b332-71f681987e23 None None] MFA Rules not processed for user `f2dc27d5f0e445408831121c429cf608`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:41.739806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-404e7866-fa4f-476a-b332-71f681987e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:41.752037 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3076/6156] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:41 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:46:41.756193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39039fbd-9b42-4c77-9e13-3ce58cb01569 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:41.776932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39039fbd-9b42-4c77-9e13-3ce58cb01569 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:41.788403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e6613-5858-4699-a5e6-2e2621dab0cd tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2dc27d5f0e445408831121c429cf608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcea327caa3540b79dbc5cbb1d1185e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:41.790423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e6613-5858-4699-a5e6-2e2621dab0cd tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:41.790711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e6613-5858-4699-a5e6-2e2621dab0cd tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:41.790990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e6613-5858-4699-a5e6-2e2621dab0cd tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:41.802684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e6613-5858-4699-a5e6-2e2621dab0cd tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] RBAC: Authorizing `identity:check_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:41.805476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e6613-5858-4699-a5e6-2e2621dab0cd tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:41.824149 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3081/6157] 10.222.0.27 () {56 vars in 1264 bytes} [Sun Aug 28 18:46:41 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Aug 28 18:46:41.828616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e7866-fa4f-476a-b332-71f681987e23 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:41.843924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e7866-fa4f-476a-b332-71f681987e23 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:41.857333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93878c5a-bd62-420c-9fa7-d38c86e4b55a tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2dc27d5f0e445408831121c429cf608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcea327caa3540b79dbc5cbb1d1185e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:41.858931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93878c5a-bd62-420c-9fa7-d38c86e4b55a tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:41.859348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93878c5a-bd62-420c-9fa7-d38c86e4b55a tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:41.859788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93878c5a-bd62-420c-9fa7-d38c86e4b55a tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:41.873118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93878c5a-bd62-420c-9fa7-d38c86e4b55a tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:41.879067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93878c5a-bd62-420c-9fa7-d38c86e4b55a tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:41.894256 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3077/6158] 10.222.0.27 () {56 vars in 1263 bytes} [Sun Aug 28 18:46:41 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:46:41.898701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e6613-5858-4699-a5e6-2e2621dab0cd tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:41.909601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e6613-5858-4699-a5e6-2e2621dab0cd tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:41.924269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58242362-91e5-41e0-b6ae-fd0a195edcb6 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2dc27d5f0e445408831121c429cf608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcea327caa3540b79dbc5cbb1d1185e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:41.924995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242362-91e5-41e0-b6ae-fd0a195edcb6 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:41.925340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242362-91e5-41e0-b6ae-fd0a195edcb6 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:41.925677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242362-91e5-41e0-b6ae-fd0a195edcb6 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:41.937694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58242362-91e5-41e0-b6ae-fd0a195edcb6 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:41.940623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58242362-91e5-41e0-b6ae-fd0a195edcb6 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:41.978107 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3082/6159] 10.222.0.27 () {56 vars in 1266 bytes} [Sun Aug 28 18:46:41 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:41.982982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93878c5a-bd62-420c-9fa7-d38c86e4b55a tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:41.995130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93878c5a-bd62-420c-9fa7-d38c86e4b55a tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:42.008236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf84d9-bf8f-4929-9a07-16f493e1a545 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2dc27d5f0e445408831121c429cf608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcea327caa3540b79dbc5cbb1d1185e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:42.008969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf84d9-bf8f-4929-9a07-16f493e1a545 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:42.012587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf84d9-bf8f-4929-9a07-16f493e1a545 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:42.013005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf84d9-bf8f-4929-9a07-16f493e1a545 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:42.015319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6fdf84d9-bf8f-4929-9a07-16f493e1a545 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:42.059703 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-6fdf84d9-bf8f-4929-9a07-16f493e1a545 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 28 18:46:42.059703 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:46:42.059703 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:46:42.059703 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:46:42.059703 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:46:42.059703 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:46:42.059703 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:46:42.059703 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:46:42.059703 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:46:42.059703 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:46:42.059703 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:46:42.059703 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:46:42.059703 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Aug 28 18:46:42.059703 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Aug 28 18:46:42.059703 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 28 18:46:42.060529 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 28 18:46:42.060529 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 28 18:46:42.060529 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 28 18:46:42.060529 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:46:42.060529 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:46:42.060529 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 28 18:46:42.060529 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 28 18:46:42.060529 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 28 18:46:42.060529 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 28 18:46:42.060529 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:46:42.060529 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:46:42.060529 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 28 18:46:42.060529 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 28 18:46:42.060529 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:46:42.060529 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:46:42.060529 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 28 18:46:42.060529 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 28 18:46:42.061367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:46:42.061367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:46:42.061367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 28 18:46:42.061367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 28 18:46:42.061367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 28 18:46:42.061367 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:46:42.063321 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3078/6160] 10.222.0.27 () {56 vars in 1264 bytes} [Sun Aug 28 18:46:41 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Aug 28 18:46:42.069002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92df27a-9035-4196-ae29-6f617ce1f556 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:42.069388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92df27a-9035-4196-ae29-6f617ce1f556 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:42.069557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92df27a-9035-4196-ae29-6f617ce1f556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:42.123649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f92df27a-9035-4196-ae29-6f617ce1f556 None None] MFA Rules not processed for user `f2dc27d5f0e445408831121c429cf608`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:42.129128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f92df27a-9035-4196-ae29-6f617ce1f556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:42.142380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf84d9-bf8f-4929-9a07-16f493e1a545 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:42.151500 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3083/6161] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:42 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:46:42.162426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf84d9-bf8f-4929-9a07-16f493e1a545 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:42.205805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27050b22-393d-4f8c-bac7-77a7da7fbeca tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2dc27d5f0e445408831121c429cf608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcea327caa3540b79dbc5cbb1d1185e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:42.206445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050b22-393d-4f8c-bac7-77a7da7fbeca tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:42.206721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050b22-393d-4f8c-bac7-77a7da7fbeca tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:42.209340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050b22-393d-4f8c-bac7-77a7da7fbeca tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:42.226084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27050b22-393d-4f8c-bac7-77a7da7fbeca tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:42.230031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27050b22-393d-4f8c-bac7-77a7da7fbeca tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:42.249456 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3079/6162] 10.222.0.27 () {56 vars in 1263 bytes} [Sun Aug 28 18:46:42 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:46:42.250954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92df27a-9035-4196-ae29-6f617ce1f556 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:42.278849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92df27a-9035-4196-ae29-6f617ce1f556 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:42.289473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc0bc9-fe34-4ef5-86f0-d353b997511c tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2dc27d5f0e445408831121c429cf608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcea327caa3540b79dbc5cbb1d1185e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:42.290097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc0bc9-fe34-4ef5-86f0-d353b997511c tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:42.290380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc0bc9-fe34-4ef5-86f0-d353b997511c tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:42.291299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc0bc9-fe34-4ef5-86f0-d353b997511c tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:42.320868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc0bc9-fe34-4ef5-86f0-d353b997511c tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:42.323426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc0bc9-fe34-4ef5-86f0-d353b997511c tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:42.380714 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3084/6163] 10.222.0.27 () {56 vars in 1266 bytes} [Sun Aug 28 18:46:42 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:42.385302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27050b22-393d-4f8c-bac7-77a7da7fbeca tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:42.395783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27050b22-393d-4f8c-bac7-77a7da7fbeca tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:42.420855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1949e3d-c10c-40d4-92b7-df116755b061 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2dc27d5f0e445408831121c429cf608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcea327caa3540b79dbc5cbb1d1185e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:42.423395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1949e3d-c10c-40d4-92b7-df116755b061 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:42.423774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1949e3d-c10c-40d4-92b7-df116755b061 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:42.424061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1949e3d-c10c-40d4-92b7-df116755b061 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:42.429987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1949e3d-c10c-40d4-92b7-df116755b061 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:42.460111 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f1949e3d-c10c-40d4-92b7-df116755b061 tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 28 18:46:42.460111 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:46:42.460111 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:46:42.460111 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:46:42.460111 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:46:42.460111 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:46:42.460111 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:46:42.460111 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:46:42.460111 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:46:42.460111 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:46:42.460111 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:46:42.460111 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:46:42.460111 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Aug 28 18:46:42.460111 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Aug 28 18:46:42.460111 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 28 18:46:42.461045 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 28 18:46:42.461045 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 28 18:46:42.461045 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 28 18:46:42.461045 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:46:42.461045 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:46:42.461045 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 28 18:46:42.461045 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 28 18:46:42.461045 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 28 18:46:42.461045 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 28 18:46:42.461045 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:46:42.461045 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:46:42.461045 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 28 18:46:42.461045 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 28 18:46:42.461045 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:46:42.461045 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:46:42.461045 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 28 18:46:42.461045 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 28 18:46:42.461838 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:46:42.461838 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:46:42.461838 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 28 18:46:42.461838 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 28 18:46:42.461838 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 28 18:46:42.461838 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:46:42.467094 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3080/6164] 10.222.0.27 () {56 vars in 1263 bytes} [Sun Aug 28 18:46:42 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:46:42.469692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc0bc9-fe34-4ef5-86f0-d353b997511c tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:42.604693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc0bc9-fe34-4ef5-86f0-d353b997511c tempest-TokensV3Test-1683381344 tempest-TokensV3Test-1683381344-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:42.617413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431c3ca-d06a-4fc6-b1e4-2efa13d5da94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:42.619402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431c3ca-d06a-4fc6-b1e4-2efa13d5da94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:42.619691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431c3ca-d06a-4fc6-b1e4-2efa13d5da94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:42.619966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431c3ca-d06a-4fc6-b1e4-2efa13d5da94 admin admin] PATH_INFO: `/v3/users/f2dc27d5f0e445408831121c429cf608` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:42.632300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431c3ca-d06a-4fc6-b1e4-2efa13d5da94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2dc27d5f0e445408831121c429cf608)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:42.634446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431c3ca-d06a-4fc6-b1e4-2efa13d5da94 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:42.785033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:42.791856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6431c3ca-d06a-4fc6-b1e4-2efa13d5da94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2dc27d5f0e445408831121c429cf608'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:42.817613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6431c3ca-d06a-4fc6-b1e4-2efa13d5da94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2dc27d5f0e445408831121c429cf608'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:42.818604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6431c3ca-d06a-4fc6-b1e4-2efa13d5da94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2dc27d5f0e445408831121c429cf608'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:42.819306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6431c3ca-d06a-4fc6-b1e4-2efa13d5da94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2dc27d5f0e445408831121c429cf608'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:42.831887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6431c3ca-d06a-4fc6-b1e4-2efa13d5da94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2dc27d5f0e445408831121c429cf608'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:42.857497 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3085/6165] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:42 2022] DELETE /identity/v3/users/f2dc27d5f0e445408831121c429cf608 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:42.862544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24601183-d687-4158-8cad-680107d0cb1a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:42.862835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24601183-d687-4158-8cad-680107d0cb1a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:42.863297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24601183-d687-4158-8cad-680107d0cb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:42.887030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-24601183-d687-4158-8cad-680107d0cb1a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:42.888302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24601183-d687-4158-8cad-680107d0cb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:43.033917 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3081/6166] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:46:43.086899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431c3ca-d06a-4fc6-b1e4-2efa13d5da94 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:43.094830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6431c3ca-d06a-4fc6-b1e4-2efa13d5da94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:43.250032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431c3ca-d06a-4fc6-b1e4-2efa13d5da94 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:43.262108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca3809-19d2-420a-9d34-b4db89941a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:43.263503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca3809-19d2-420a-9d34-b4db89941a7d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:43.264127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca3809-19d2-420a-9d34-b4db89941a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:43.264667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca3809-19d2-420a-9d34-b4db89941a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:43.276220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca3809-19d2-420a-9d34-b4db89941a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:43.278003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca3809-19d2-420a-9d34-b4db89941a7d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:43.295079 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3086/6167] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:43.819993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24601183-d687-4158-8cad-680107d0cb1a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:43.822419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24601183-d687-4158-8cad-680107d0cb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:43.860358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24601183-d687-4158-8cad-680107d0cb1a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:43.878003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f272584-0f43-46d2-b1d2-828f17fe9f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:43.879010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f272584-0f43-46d2-b1d2-828f17fe9f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:43.879390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f272584-0f43-46d2-b1d2-828f17fe9f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:43.879745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f272584-0f43-46d2-b1d2-828f17fe9f21 admin admin] PATH_INFO: `/v3/users/2ba3c9d813cb4a07a5482866b98e9e88` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:43.882053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f272584-0f43-46d2-b1d2-828f17fe9f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba3c9d813cb4a07a5482866b98e9e88)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:43.884415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f272584-0f43-46d2-b1d2-828f17fe9f21 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:43.890470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:43.975925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6f272584-0f43-46d2-b1d2-828f17fe9f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba3c9d813cb4a07a5482866b98e9e88'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:43.977757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6f272584-0f43-46d2-b1d2-828f17fe9f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba3c9d813cb4a07a5482866b98e9e88'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:43.988456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6f272584-0f43-46d2-b1d2-828f17fe9f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba3c9d813cb4a07a5482866b98e9e88'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:43.994066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e01b1-6bdf-455b-911e-cc9032930e75 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:43.994461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e01b1-6bdf-455b-911e-cc9032930e75 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:43.994583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e01b1-6bdf-455b-911e-cc9032930e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:44.006249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6f272584-0f43-46d2-b1d2-828f17fe9f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba3c9d813cb4a07a5482866b98e9e88'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:44.042333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6f272584-0f43-46d2-b1d2-828f17fe9f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba3c9d813cb4a07a5482866b98e9e88'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:44.059743 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3082/6168] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:43 2022] DELETE /identity/v3/users/2ba3c9d813cb4a07a5482866b98e9e88 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:44.065483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fa8c4-1a21-4bf2-9bcc-312cca976aa2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:44.066030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fa8c4-1a21-4bf2-9bcc-312cca976aa2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:44.066751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1c1e01b1-6bdf-455b-911e-cc9032930e75 None None] MFA Rules not processed for user `afdf62f3cae74b359622eb3bb55f43d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:44.067216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fa8c4-1a21-4bf2-9bcc-312cca976aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:44.072170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1c1e01b1-6bdf-455b-911e-cc9032930e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:44.118671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-568fa8c4-1a21-4bf2-9bcc-312cca976aa2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:44.122169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-568fa8c4-1a21-4bf2-9bcc-312cca976aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:44.244338 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3087/6169] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:46:44.255432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78edeb4-7c88-4065-aa44-ca1e4caadbad None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:44.255933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78edeb4-7c88-4065-aa44-ca1e4caadbad None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:44.256352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78edeb4-7c88-4065-aa44-ca1e4caadbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:44.274520 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3083/6170] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:44.282029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e78edeb4-7c88-4065-aa44-ca1e4caadbad None None] MFA Rules not processed for user `afdf62f3cae74b359622eb3bb55f43d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:44.283795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e78edeb4-7c88-4065-aa44-ca1e4caadbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:44.293743 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3088/6171] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:44.305273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fa8c4-1a21-4bf2-9bcc-312cca976aa2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:44.307030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-568fa8c4-1a21-4bf2-9bcc-312cca976aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:44.406152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78edeb4-7c88-4065-aa44-ca1e4caadbad None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:44.407812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e78edeb4-7c88-4065-aa44-ca1e4caadbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:44.519177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:44.542197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fa8c4-1a21-4bf2-9bcc-312cca976aa2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:44.563271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84feed-66fd-4c06-a216-f96441a242cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:44.563918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84feed-66fd-4c06-a216-f96441a242cd service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:44.564200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84feed-66fd-4c06-a216-f96441a242cd service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:44.564478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84feed-66fd-4c06-a216-f96441a242cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:44.580985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78edeb4-7c88-4065-aa44-ca1e4caadbad None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:44.586947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84feed-66fd-4c06-a216-f96441a242cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:44.589983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84feed-66fd-4c06-a216-f96441a242cd service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:44.592819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085be99-94ee-4cb0-9f68-6987b258f26f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:44.593048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085be99-94ee-4cb0-9f68-6987b258f26f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:44.593846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085be99-94ee-4cb0-9f68-6987b258f26f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:44.594133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085be99-94ee-4cb0-9f68-6987b258f26f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:44.609099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:44.614441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085be99-94ee-4cb0-9f68-6987b258f26f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:44.616729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085be99-94ee-4cb0-9f68-6987b258f26f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:44.627370 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3084/6172] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:44.631311 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3089/6173] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:44.633897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84feed-66fd-4c06-a216-f96441a242cd service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:44.635964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc84feed-66fd-4c06-a216-f96441a242cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:44.665982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84feed-66fd-4c06-a216-f96441a242cd service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:44.693443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed8997-899f-4c46-9fb9-410bad4a3412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:44.694273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed8997-899f-4c46-9fb9-410bad4a3412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:44.694868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed8997-899f-4c46-9fb9-410bad4a3412 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:44.695103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed8997-899f-4c46-9fb9-410bad4a3412 admin admin] PATH_INFO: `/v3/projects/dcea327caa3540b79dbc5cbb1d1185e3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:44.696754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed8997-899f-4c46-9fb9-410bad4a3412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcea327caa3540b79dbc5cbb1d1185e3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:44.698778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed8997-899f-4c46-9fb9-410bad4a3412 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:44.817348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5ed8997-899f-4c46-9fb9-410bad4a3412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcea327caa3540b79dbc5cbb1d1185e3', 'request_id': 'req-f5ed8997-899f-4c46-9fb9-410bad4a3412'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:44.831997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5ed8997-899f-4c46-9fb9-410bad4a3412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcea327caa3540b79dbc5cbb1d1185e3', 'request_id': 'req-f5ed8997-899f-4c46-9fb9-410bad4a3412'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:44.844852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5ed8997-899f-4c46-9fb9-410bad4a3412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcea327caa3540b79dbc5cbb1d1185e3', 'request_id': 'req-f5ed8997-899f-4c46-9fb9-410bad4a3412'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:44.867358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5ed8997-899f-4c46-9fb9-410bad4a3412 admin admin] The token cache is being invalidate because project dcea327caa3540b79dbc5cbb1d1185e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:44.867771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5ed8997-899f-4c46-9fb9-410bad4a3412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:44.870802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5ed8997-899f-4c46-9fb9-410bad4a3412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:44.873711 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3085/6174] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:44 2022] DELETE /identity/v3/projects/dcea327caa3540b79dbc5cbb1d1185e3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:44.881811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5b805-b1bc-4ac4-9b12-3652908a39b8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:44.883060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5b805-b1bc-4ac4-9b12-3652908a39b8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:44.883452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5b805-b1bc-4ac4-9b12-3652908a39b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:44.930161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d2a5b805-b1bc-4ac4-9b12-3652908a39b8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:44.932624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d2a5b805-b1bc-4ac4-9b12-3652908a39b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:45.155707 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3090/6175] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:45.164651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af464b-49d4-4873-bcfa-4b9b064221ba None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:45.166317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af464b-49d4-4873-bcfa-4b9b064221ba None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:45.166317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af464b-49d4-4873-bcfa-4b9b064221ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:45.205111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a5af464b-49d4-4873-bcfa-4b9b064221ba None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:45.206608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a5af464b-49d4-4873-bcfa-4b9b064221ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:45.228826 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3086/6176] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:45.236330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5b805-b1bc-4ac4-9b12-3652908a39b8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:45.252599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5b805-b1bc-4ac4-9b12-3652908a39b8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:45.265924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75124f28-60b6-4489-b5ac-b995205e1e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:45.266748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75124f28-60b6-4489-b5ac-b995205e1e50 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:45.267127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75124f28-60b6-4489-b5ac-b995205e1e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:45.267515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75124f28-60b6-4489-b5ac-b995205e1e50 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:45.268279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75124f28-60b6-4489-b5ac-b995205e1e50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:46:45.268710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75124f28-60b6-4489-b5ac-b995205e1e50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:45.270425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75124f28-60b6-4489-b5ac-b995205e1e50 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:45.301034 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3091/6177] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:46:45.305928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af464b-49d4-4873-bcfa-4b9b064221ba None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:45.317372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af464b-49d4-4873-bcfa-4b9b064221ba None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:45.324026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ff750-55c4-4ce4-983b-2283985c419a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:45.325365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ff750-55c4-4ce4-983b-2283985c419a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:45.325832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ff750-55c4-4ce4-983b-2283985c419a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:45.326412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ff750-55c4-4ce4-983b-2283985c419a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:45.327491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ff750-55c4-4ce4-983b-2283985c419a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:45.331095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ff750-55c4-4ce4-983b-2283985c419a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:45.385214 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3087/6178] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:45 2022] POST /identity/v3/projects => generated 363 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:45.389345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75124f28-60b6-4489-b5ac-b995205e1e50 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:45.404595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75124f28-60b6-4489-b5ac-b995205e1e50 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:45.418031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ff750-55c4-4ce4-983b-2283985c419a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:45.420506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c89ff750-55c4-4ce4-983b-2283985c419a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:45.609196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7de18-9141-4256-a12d-73c687891d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:45.611015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7de18-9141-4256-a12d-73c687891d98 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:45.612948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7de18-9141-4256-a12d-73c687891d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:45.613451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7de18-9141-4256-a12d-73c687891d98 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:45.614309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7de18-9141-4256-a12d-73c687891d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:45.617353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7de18-9141-4256-a12d-73c687891d98 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:45.626315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ff750-55c4-4ce4-983b-2283985c419a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:45.641089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82376843-2807-403d-982c-d941961d6713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:45.641771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82376843-2807-403d-982c-d941961d6713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:45.642051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82376843-2807-403d-982c-d941961d6713 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:45.642327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82376843-2807-403d-982c-d941961d6713 admin admin] PATH_INFO: `/v3/projects/7a22d2db966045069b94e35625e41c9e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:45.646947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82376843-2807-403d-982c-d941961d6713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a22d2db966045069b94e35625e41c9e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:45.649203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82376843-2807-403d-982c-d941961d6713 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:45.695035 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3092/6179] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:45 2022] POST /identity/v3/users => generated 282 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:46:45.699634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7de18-9141-4256-a12d-73c687891d98 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:45.725534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7de18-9141-4256-a12d-73c687891d98 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:45.742579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3557b86-38da-414a-b280-7d4285381f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:45.743654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3557b86-38da-414a-b280-7d4285381f11 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:45.744124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3557b86-38da-414a-b280-7d4285381f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:45.744582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3557b86-38da-414a-b280-7d4285381f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:45.745421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3557b86-38da-414a-b280-7d4285381f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:45.747338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3557b86-38da-414a-b280-7d4285381f11 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:45.750747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82376843-2807-403d-982c-d941961d6713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a22d2db966045069b94e35625e41c9e', 'request_id': 'req-82376843-2807-403d-982c-d941961d6713'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:45.757800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:45.763964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82376843-2807-403d-982c-d941961d6713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a22d2db966045069b94e35625e41c9e', 'request_id': 'req-82376843-2807-403d-982c-d941961d6713'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:45.776507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82376843-2807-403d-982c-d941961d6713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a22d2db966045069b94e35625e41c9e', 'request_id': 'req-82376843-2807-403d-982c-d941961d6713'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:45.777760 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3093/6180] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:46:45.781529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3557b86-38da-414a-b280-7d4285381f11 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:45.797081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82376843-2807-403d-982c-d941961d6713 admin admin] The token cache is being invalidate because project 7a22d2db966045069b94e35625e41c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:45.797642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82376843-2807-403d-982c-d941961d6713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:45.798453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82376843-2807-403d-982c-d941961d6713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:45.800610 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3088/6181] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:45 2022] DELETE /identity/v3/projects/7a22d2db966045069b94e35625e41c9e => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:45.800956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3557b86-38da-414a-b280-7d4285381f11 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:45.804369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82376843-2807-403d-982c-d941961d6713 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:45.806545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-82376843-2807-403d-982c-d941961d6713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:45.936708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:45.938620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82376843-2807-403d-982c-d941961d6713 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:45.945235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbe743-5722-4eb9-96b7-c075226932ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:45.945773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbe743-5722-4eb9-96b7-c075226932ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:45.946061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbe743-5722-4eb9-96b7-c075226932ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:45.946806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbe743-5722-4eb9-96b7-c075226932ec admin admin] PATH_INFO: `/v3/users/0c176cea2f00471d84b5fea52a4ece42` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:45.948692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbe743-5722-4eb9-96b7-c075226932ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c176cea2f00471d84b5fea52a4ece42)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:45.952069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbe743-5722-4eb9-96b7-c075226932ec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:45.972456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e7775-dafd-494d-a709-f8e5c62e3210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:45.973571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e7775-dafd-494d-a709-f8e5c62e3210 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:45.974046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e7775-dafd-494d-a709-f8e5c62e3210 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:45.974510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e7775-dafd-494d-a709-f8e5c62e3210 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:45.975485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e7775-dafd-494d-a709-f8e5c62e3210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:45.977319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e7775-dafd-494d-a709-f8e5c62e3210 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:45.996081 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3094/6182] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:46:46.009803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e7775-dafd-494d-a709-f8e5c62e3210 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:46.013426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-016e7775-dafd-494d-a709-f8e5c62e3210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:46.035823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e7775-dafd-494d-a709-f8e5c62e3210 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:46.046686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91a54c-989e-4a25-9da6-a0fd99ee9bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:46.047204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6dbe743-5722-4eb9-96b7-c075226932ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c176cea2f00471d84b5fea52a4ece42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:46.047747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91a54c-989e-4a25-9da6-a0fd99ee9bda admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:46.048130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91a54c-989e-4a25-9da6-a0fd99ee9bda admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:46.048503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91a54c-989e-4a25-9da6-a0fd99ee9bda admin admin] PATH_INFO: `/v3/projects/f6ccaa84803a486f97e837e75d121a42/users/7fffa9989a564982bdd54ffb2b930057/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:46.048877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6dbe743-5722-4eb9-96b7-c075226932ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c176cea2f00471d84b5fea52a4ece42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:46.061840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6dbe743-5722-4eb9-96b7-c075226932ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c176cea2f00471d84b5fea52a4ece42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:46.074578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6dbe743-5722-4eb9-96b7-c075226932ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c176cea2f00471d84b5fea52a4ece42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:46.080999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91a54c-989e-4a25-9da6-a0fd99ee9bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ccaa84803a486f97e837e75d121a42, user_id=7fffa9989a564982bdd54ffb2b930057, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:46.085208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91a54c-989e-4a25-9da6-a0fd99ee9bda admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:46.104449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6dbe743-5722-4eb9-96b7-c075226932ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c176cea2f00471d84b5fea52a4ece42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:46.116372 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3095/6183] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:46 2022] PUT /identity/v3/projects/f6ccaa84803a486f97e837e75d121a42/users/7fffa9989a564982bdd54ffb2b930057/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:46.133151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf7f09-621d-4bb1-8d74-ed6383c0f29e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:46.133328 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3089/6184] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:45 2022] DELETE /identity/v3/users/0c176cea2f00471d84b5fea52a4ece42 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:46.133446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf7f09-621d-4bb1-8d74-ed6383c0f29e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:46.133446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf7f09-621d-4bb1-8d74-ed6383c0f29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:46.212877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-abdf7f09-621d-4bb1-8d74-ed6383c0f29e None None] MFA Rules not processed for user `7fffa9989a564982bdd54ffb2b930057`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:46.214874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-abdf7f09-621d-4bb1-8d74-ed6383c0f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:46.339534 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3096/6185] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:46.348538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbe743-5722-4eb9-96b7-c075226932ec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:46.350932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e6dbe743-5722-4eb9-96b7-c075226932ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:46.545038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbe743-5722-4eb9-96b7-c075226932ec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:46.562572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd58a73-6bd0-4ad4-88d9-6f0e0df27638 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:46.563377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd58a73-6bd0-4ad4-88d9-6f0e0df27638 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:46.563675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd58a73-6bd0-4ad4-88d9-6f0e0df27638 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:46.563957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd58a73-6bd0-4ad4-88d9-6f0e0df27638 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:46.584813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:46.590426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd58a73-6bd0-4ad4-88d9-6f0e0df27638 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:46.595239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd58a73-6bd0-4ad4-88d9-6f0e0df27638 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:46.619858 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3090/6186] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:47.180447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf7f09-621d-4bb1-8d74-ed6383c0f29e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:47.182040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-abdf7f09-621d-4bb1-8d74-ed6383c0f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:47.274617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd58a73-6bd0-4ad4-88d9-6f0e0df27638 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:47.276922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0dd58a73-6bd0-4ad4-88d9-6f0e0df27638 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:47.446941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf7f09-621d-4bb1-8d74-ed6383c0f29e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:47.464056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e7df1-5c7c-4edd-a823-4376e564ff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:47.473045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e7df1-5c7c-4edd-a823-4376e564ff5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:47.475395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e7df1-5c7c-4edd-a823-4376e564ff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:47.475780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e7df1-5c7c-4edd-a823-4376e564ff5d admin admin] PATH_INFO: `/v3/projects/d7bc2c4a7a05470faf7cc5d47efaf22d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:47.477185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e7df1-5c7c-4edd-a823-4376e564ff5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7bc2c4a7a05470faf7cc5d47efaf22d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:47.478574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd58a73-6bd0-4ad4-88d9-6f0e0df27638 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:47.482911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e7df1-5c7c-4edd-a823-4376e564ff5d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:47.485190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa9852-ea1e-4f7b-bfc6-bc880b5b78a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:47.486211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa9852-ea1e-4f7b-bfc6-bc880b5b78a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:47.486775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa9852-ea1e-4f7b-bfc6-bc880b5b78a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:47.487536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa9852-ea1e-4f7b-bfc6-bc880b5b78a7 admin admin] PATH_INFO: `/v3/users/7fffa9989a564982bdd54ffb2b930057` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:47.489270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa9852-ea1e-4f7b-bfc6-bc880b5b78a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fffa9989a564982bdd54ffb2b930057)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:47.492313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa9852-ea1e-4f7b-bfc6-bc880b5b78a7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:47.654359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:47.659734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d21e7df1-5c7c-4edd-a823-4376e564ff5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7bc2c4a7a05470faf7cc5d47efaf22d', 'request_id': 'req-d21e7df1-5c7c-4edd-a823-4376e564ff5d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:47.662705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0fa9852-ea1e-4f7b-bfc6-bc880b5b78a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fffa9989a564982bdd54ffb2b930057'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:47.666713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0fa9852-ea1e-4f7b-bfc6-bc880b5b78a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fffa9989a564982bdd54ffb2b930057'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:47.688466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d21e7df1-5c7c-4edd-a823-4376e564ff5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7bc2c4a7a05470faf7cc5d47efaf22d', 'request_id': 'req-d21e7df1-5c7c-4edd-a823-4376e564ff5d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:47.710073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0fa9852-ea1e-4f7b-bfc6-bc880b5b78a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fffa9989a564982bdd54ffb2b930057'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:47.714895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d21e7df1-5c7c-4edd-a823-4376e564ff5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7bc2c4a7a05470faf7cc5d47efaf22d', 'request_id': 'req-d21e7df1-5c7c-4edd-a823-4376e564ff5d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:47.735500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0fa9852-ea1e-4f7b-bfc6-bc880b5b78a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fffa9989a564982bdd54ffb2b930057'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:47.768653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d21e7df1-5c7c-4edd-a823-4376e564ff5d admin admin] The token cache is being invalidate because project d7bc2c4a7a05470faf7cc5d47efaf22d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:47.768932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d21e7df1-5c7c-4edd-a823-4376e564ff5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:47.774020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d21e7df1-5c7c-4edd-a823-4376e564ff5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:47.775845 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3097/6187] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:47 2022] DELETE /identity/v3/projects/d7bc2c4a7a05470faf7cc5d47efaf22d => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:47.790085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ea137-79be-40cc-bbd8-00b8b6ee9436 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:47.790359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ea137-79be-40cc-bbd8-00b8b6ee9436 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:47.790625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ea137-79be-40cc-bbd8-00b8b6ee9436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:47.805141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0fa9852-ea1e-4f7b-bfc6-bc880b5b78a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fffa9989a564982bdd54ffb2b930057'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:47.850050 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3091/6188] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:47 2022] DELETE /identity/v3/users/7fffa9989a564982bdd54ffb2b930057 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:46:47.859942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4561c-40a6-4488-bd94-43519e381423 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:47.860227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4561c-40a6-4488-bd94-43519e381423 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:47.860506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4561c-40a6-4488-bd94-43519e381423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:47.912670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d42ea137-79be-40cc-bbd8-00b8b6ee9436 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:47.915089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d42ea137-79be-40cc-bbd8-00b8b6ee9436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:47.952018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-65a4561c-40a6-4488-bd94-43519e381423 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:47.955609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-65a4561c-40a6-4488-bd94-43519e381423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:48.110516 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3098/6189] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:48.243024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502e8c3-cc2e-4fcc-a629-2c814645182a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:48.243496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502e8c3-cc2e-4fcc-a629-2c814645182a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:48.243935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502e8c3-cc2e-4fcc-a629-2c814645182a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:48.245883 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3092/6190] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:48.257006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4561c-40a6-4488-bd94-43519e381423 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:48.259453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-65a4561c-40a6-4488-bd94-43519e381423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:48.308946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5502e8c3-cc2e-4fcc-a629-2c814645182a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:48.310513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5502e8c3-cc2e-4fcc-a629-2c814645182a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:48.318323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:48.350658 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3099/6191] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:46:48.369236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502e8c3-cc2e-4fcc-a629-2c814645182a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:48.394718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502e8c3-cc2e-4fcc-a629-2c814645182a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:48.414699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2475b-352b-42f4-9504-8efdc8b3df0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:48.416235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2475b-352b-42f4-9504-8efdc8b3df0a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:48.417486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2475b-352b-42f4-9504-8efdc8b3df0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:48.418427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2475b-352b-42f4-9504-8efdc8b3df0a admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:48.419506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2475b-352b-42f4-9504-8efdc8b3df0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:46:48.420647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2475b-352b-42f4-9504-8efdc8b3df0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:48.422933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2475b-352b-42f4-9504-8efdc8b3df0a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:48.443521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4561c-40a6-4488-bd94-43519e381423 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:48.456828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b5e2e-cffd-4163-84b9-1f57af17aee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:48.457592 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3100/6192] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:46:48.459015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b5e2e-cffd-4163-84b9-1f57af17aee8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:48.460116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2475b-352b-42f4-9504-8efdc8b3df0a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:48.460584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b5e2e-cffd-4163-84b9-1f57af17aee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:48.460849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b5e2e-cffd-4163-84b9-1f57af17aee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:48.484062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2475b-352b-42f4-9504-8efdc8b3df0a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:48.487565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b5e2e-cffd-4163-84b9-1f57af17aee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:48.490449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b5e2e-cffd-4163-84b9-1f57af17aee8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:48.501902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb73312-9905-4631-abb2-4de25d2c847b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:48.502542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb73312-9905-4631-abb2-4de25d2c847b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:48.503367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb73312-9905-4631-abb2-4de25d2c847b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:48.503588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb73312-9905-4631-abb2-4de25d2c847b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:48.504252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb73312-9905-4631-abb2-4de25d2c847b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:48.510535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb73312-9905-4631-abb2-4de25d2c847b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:48.529473 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3093/6193] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:48.594287 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3101/6194] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:48 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:48.599070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b5e2e-cffd-4163-84b9-1f57af17aee8 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:48.622402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b5e2e-cffd-4163-84b9-1f57af17aee8 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:48.764833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773a274-1915-4861-9974-ee600d4e7425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:48.765505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773a274-1915-4861-9974-ee600d4e7425 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:48.765964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773a274-1915-4861-9974-ee600d4e7425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:48.766064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773a274-1915-4861-9974-ee600d4e7425 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:48.767044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773a274-1915-4861-9974-ee600d4e7425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:48.772146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773a274-1915-4861-9974-ee600d4e7425 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:48.820942 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3094/6195] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:48 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:48.825798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb73312-9905-4631-abb2-4de25d2c847b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:48.838571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb73312-9905-4631-abb2-4de25d2c847b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:48.868466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f447e2-1ae9-4356-842f-266e3c821478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:48.869373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f447e2-1ae9-4356-842f-266e3c821478 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:48.869851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f447e2-1ae9-4356-842f-266e3c821478 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:48.870335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f447e2-1ae9-4356-842f-266e3c821478 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:48.871190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f447e2-1ae9-4356-842f-266e3c821478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:48.873649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f447e2-1ae9-4356-842f-266e3c821478 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:48.899661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773a274-1915-4861-9974-ee600d4e7425 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:48.913219 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3102/6196] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:48.917564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773a274-1915-4861-9974-ee600d4e7425 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:48.935205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d918c-cc8d-4f34-8c34-41b16c94881a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:48.936207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d918c-cc8d-4f34-8c34-41b16c94881a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:48.936747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d918c-cc8d-4f34-8c34-41b16c94881a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:48.937171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d918c-cc8d-4f34-8c34-41b16c94881a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:48.942123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d918c-cc8d-4f34-8c34-41b16c94881a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:48.947204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d918c-cc8d-4f34-8c34-41b16c94881a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:48.986354 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3095/6197] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:46:48.990803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f447e2-1ae9-4356-842f-266e3c821478 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:49.009571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f447e2-1ae9-4356-842f-266e3c821478 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:49.030106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568f43c-972f-4c25-96ae-b36582b967b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:49.030990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568f43c-972f-4c25-96ae-b36582b967b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:49.032610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568f43c-972f-4c25-96ae-b36582b967b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:49.035330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568f43c-972f-4c25-96ae-b36582b967b7 admin admin] PATH_INFO: `/v3/projects/740a93b047a14738a964da78e23e4c12/users/6e36d2322bd24a74b98076a1074a8960/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:49.067148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568f43c-972f-4c25-96ae-b36582b967b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=740a93b047a14738a964da78e23e4c12, user_id=6e36d2322bd24a74b98076a1074a8960, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:49.087751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568f43c-972f-4c25-96ae-b36582b967b7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:49.142369 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3103/6198] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:48 2022] PUT /identity/v3/projects/740a93b047a14738a964da78e23e4c12/users/6e36d2322bd24a74b98076a1074a8960/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:49.143156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99996f-9fac-4a37-9007-7d8dfc6ee6bb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:49.143473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99996f-9fac-4a37-9007-7d8dfc6ee6bb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:49.143759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99996f-9fac-4a37-9007-7d8dfc6ee6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:49.217379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9b99996f-9fac-4a37-9007-7d8dfc6ee6bb None None] MFA Rules not processed for user `6e36d2322bd24a74b98076a1074a8960`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:49.218693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9b99996f-9fac-4a37-9007-7d8dfc6ee6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:49.383905 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3096/6199] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:46:49.385701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568f43c-972f-4c25-96ae-b36582b967b7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:49.527662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568f43c-972f-4c25-96ae-b36582b967b7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:49.545894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ba61b-6030-463d-a388-20242b7b68f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:49.546541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ba61b-6030-463d-a388-20242b7b68f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:49.546823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ba61b-6030-463d-a388-20242b7b68f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:49.547104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ba61b-6030-463d-a388-20242b7b68f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:49.548031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ba61b-6030-463d-a388-20242b7b68f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:49.549985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ba61b-6030-463d-a388-20242b7b68f0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:49.562674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:49.620085 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3104/6200] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:49 2022] POST /identity/v3/projects => generated 385 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:49.622889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99996f-9fac-4a37-9007-7d8dfc6ee6bb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:49.643816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99996f-9fac-4a37-9007-7d8dfc6ee6bb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:49.710760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:49.798704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fa132-cb80-4319-80eb-56010e153e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:49.801424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fa132-cb80-4319-80eb-56010e153e09 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:49.801862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fa132-cb80-4319-80eb-56010e153e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:49.802949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fa132-cb80-4319-80eb-56010e153e09 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:49.803156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fa132-cb80-4319-80eb-56010e153e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:49.806745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fa132-cb80-4319-80eb-56010e153e09 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:49.811570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ba61b-6030-463d-a388-20242b7b68f0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:49.813400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-598ba61b-6030-463d-a388-20242b7b68f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:49.837017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ba61b-6030-463d-a388-20242b7b68f0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:49.847630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c234fe9-07f9-463f-aa8d-98d8d588af5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:49.848448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c234fe9-07f9-463f-aa8d-98d8d588af5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:49.848865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c234fe9-07f9-463f-aa8d-98d8d588af5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:49.849243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c234fe9-07f9-463f-aa8d-98d8d588af5d admin admin] PATH_INFO: `/v3/projects/f6ccaa84803a486f97e837e75d121a42` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:49.851320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c234fe9-07f9-463f-aa8d-98d8d588af5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ccaa84803a486f97e837e75d121a42)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:49.865690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c234fe9-07f9-463f-aa8d-98d8d588af5d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:49.865876 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3097/6201] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:49 2022] POST /identity/v3/users => generated 299 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:49.872025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fa132-cb80-4319-80eb-56010e153e09 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:49.900939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fa132-cb80-4319-80eb-56010e153e09 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:49.913590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae4420-4041-4904-9037-b5e9af28f6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:49.914452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae4420-4041-4904-9037-b5e9af28f6ff admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:49.915707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae4420-4041-4904-9037-b5e9af28f6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:49.915707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae4420-4041-4904-9037-b5e9af28f6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:49.918362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae4420-4041-4904-9037-b5e9af28f6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:49.920304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae4420-4041-4904-9037-b5e9af28f6ff admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:49.947316 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3098/6202] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:49.950994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae4420-4041-4904-9037-b5e9af28f6ff admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:49.965316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae4420-4041-4904-9037-b5e9af28f6ff admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:50.018406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c234fe9-07f9-463f-aa8d-98d8d588af5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ccaa84803a486f97e837e75d121a42', 'request_id': 'req-2c234fe9-07f9-463f-aa8d-98d8d588af5d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:50.034546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c234fe9-07f9-463f-aa8d-98d8d588af5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ccaa84803a486f97e837e75d121a42', 'request_id': 'req-2c234fe9-07f9-463f-aa8d-98d8d588af5d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:50.086166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c234fe9-07f9-463f-aa8d-98d8d588af5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ccaa84803a486f97e837e75d121a42', 'request_id': 'req-2c234fe9-07f9-463f-aa8d-98d8d588af5d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:50.089660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a7337-bf5a-4b8c-8a2a-4865dfc45b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:50.090369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a7337-bf5a-4b8c-8a2a-4865dfc45b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:50.091360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a7337-bf5a-4b8c-8a2a-4865dfc45b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:50.091360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a7337-bf5a-4b8c-8a2a-4865dfc45b84 admin admin] PATH_INFO: `/v3/projects/92d291eeee1246e1817812cdb37aff50/users/d25df2c2dc22448ebecab41359a1b8b7/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:50.105120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c234fe9-07f9-463f-aa8d-98d8d588af5d admin admin] The token cache is being invalidate because project f6ccaa84803a486f97e837e75d121a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:50.105120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c234fe9-07f9-463f-aa8d-98d8d588af5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:50.106323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c234fe9-07f9-463f-aa8d-98d8d588af5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:50.112206 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3105/6203] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:49 2022] DELETE /identity/v3/projects/f6ccaa84803a486f97e837e75d121a42 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:46:50.130407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a7337-bf5a-4b8c-8a2a-4865dfc45b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d291eeee1246e1817812cdb37aff50, user_id=d25df2c2dc22448ebecab41359a1b8b7, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:50.132014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541faac-9a42-48ba-86cf-e05ce26d90de None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:50.133145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a7337-bf5a-4b8c-8a2a-4865dfc45b84 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:50.134426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541faac-9a42-48ba-86cf-e05ce26d90de None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:50.135168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541faac-9a42-48ba-86cf-e05ce26d90de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:50.164809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e541faac-9a42-48ba-86cf-e05ce26d90de None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:50.166506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e541faac-9a42-48ba-86cf-e05ce26d90de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:50.170399 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3099/6204] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:49 2022] PUT /identity/v3/projects/92d291eeee1246e1817812cdb37aff50/users/d25df2c2dc22448ebecab41359a1b8b7/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:46:50.174495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a7337-bf5a-4b8c-8a2a-4865dfc45b84 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:50.176994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a82a7337-bf5a-4b8c-8a2a-4865dfc45b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:50.299402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a7337-bf5a-4b8c-8a2a-4865dfc45b84 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:50.309797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ad318-cd39-4df4-90a2-c37ac4bcfce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:50.310997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ad318-cd39-4df4-90a2-c37ac4bcfce2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:50.311499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ad318-cd39-4df4-90a2-c37ac4bcfce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:50.311979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ad318-cd39-4df4-90a2-c37ac4bcfce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:50.313126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ad318-cd39-4df4-90a2-c37ac4bcfce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:50.317483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ad318-cd39-4df4-90a2-c37ac4bcfce2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:50.336857 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3100/6205] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:46:50.337449 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3106/6206] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:50.338415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aad72-fab0-401a-9bd2-91bb8d481cd3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:50.338707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aad72-fab0-401a-9bd2-91bb8d481cd3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:50.338983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aad72-fab0-401a-9bd2-91bb8d481cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:50.340530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541faac-9a42-48ba-86cf-e05ce26d90de None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:50.388459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-076aad72-fab0-401a-9bd2-91bb8d481cd3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:50.390687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-076aad72-fab0-401a-9bd2-91bb8d481cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:50.393400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541faac-9a42-48ba-86cf-e05ce26d90de None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:50.403384 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3101/6207] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:50.406329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45511c0-20ce-40ee-acb2-33ad467a1b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:50.406570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aad72-fab0-401a-9bd2-91bb8d481cd3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:50.407548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45511c0-20ce-40ee-acb2-33ad467a1b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:50.408027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45511c0-20ce-40ee-acb2-33ad467a1b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:50.408493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45511c0-20ce-40ee-acb2-33ad467a1b74 admin admin] PATH_INFO: `/v3/projects/92d291eeee1246e1817812cdb37aff50/users/d25df2c2dc22448ebecab41359a1b8b7/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:50.410732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45511c0-20ce-40ee-acb2-33ad467a1b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d291eeee1246e1817812cdb37aff50, user_id=d25df2c2dc22448ebecab41359a1b8b7, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:50.415552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45511c0-20ce-40ee-acb2-33ad467a1b74 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:50.423639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aad72-fab0-401a-9bd2-91bb8d481cd3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:50.439953 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3107/6208] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:50 2022] PUT /identity/v3/projects/92d291eeee1246e1817812cdb37aff50/users/d25df2c2dc22448ebecab41359a1b8b7/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:50.450909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc96d25-1ed2-48f6-ba16-e49fc8ef9b14 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:50.453751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc96d25-1ed2-48f6-ba16-e49fc8ef9b14 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:50.454283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc96d25-1ed2-48f6-ba16-e49fc8ef9b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:50.475979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:50.549142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-afc96d25-1ed2-48f6-ba16-e49fc8ef9b14 None None] MFA Rules not processed for user `d25df2c2dc22448ebecab41359a1b8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:50.550359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-afc96d25-1ed2-48f6-ba16-e49fc8ef9b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:50.567373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3162d38-4e14-4f8f-b5e5-efa4d0345662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:50.570349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3162d38-4e14-4f8f-b5e5-efa4d0345662 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:50.573164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3162d38-4e14-4f8f-b5e5-efa4d0345662 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:50.573647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3162d38-4e14-4f8f-b5e5-efa4d0345662 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:50.574696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3162d38-4e14-4f8f-b5e5-efa4d0345662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:46:50.575009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3162d38-4e14-4f8f-b5e5-efa4d0345662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:50.582166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3162d38-4e14-4f8f-b5e5-efa4d0345662 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:50.623144 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3102/6209] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:46:50.624547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3162d38-4e14-4f8f-b5e5-efa4d0345662 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:50.657556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3162d38-4e14-4f8f-b5e5-efa4d0345662 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:50.675294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc512d7-f378-4095-908b-5dd5bb949032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:50.676408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc512d7-f378-4095-908b-5dd5bb949032 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:50.676509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc512d7-f378-4095-908b-5dd5bb949032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:50.676732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc512d7-f378-4095-908b-5dd5bb949032 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:50.678179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc512d7-f378-4095-908b-5dd5bb949032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:50.687966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc512d7-f378-4095-908b-5dd5bb949032 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:50.700079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:50.765908 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3103/6210] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:50 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:50.772951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc512d7-f378-4095-908b-5dd5bb949032 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:50.798229 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3108/6211] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:50.810232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc96d25-1ed2-48f6-ba16-e49fc8ef9b14 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:50.812734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-afc96d25-1ed2-48f6-ba16-e49fc8ef9b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:50.904954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc512d7-f378-4095-908b-5dd5bb949032 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:50.924947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f371d6-a2b0-4e4f-ba76-f35af546906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:50.925621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f371d6-a2b0-4e4f-ba76-f35af546906b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:50.925903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f371d6-a2b0-4e4f-ba76-f35af546906b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:50.926176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f371d6-a2b0-4e4f-ba76-f35af546906b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:50.926827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f371d6-a2b0-4e4f-ba76-f35af546906b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:50.928862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f371d6-a2b0-4e4f-ba76-f35af546906b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:50.976213 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3104/6212] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:50 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:50.980258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f371d6-a2b0-4e4f-ba76-f35af546906b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:51.005594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc96d25-1ed2-48f6-ba16-e49fc8ef9b14 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:51.015670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f371d6-a2b0-4e4f-ba76-f35af546906b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:51.032245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580214f-737c-4471-975f-fc96454cd042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:51.032891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580214f-737c-4471-975f-fc96454cd042 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:51.033178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580214f-737c-4471-975f-fc96454cd042 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:51.033460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580214f-737c-4471-975f-fc96454cd042 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:51.034122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580214f-737c-4471-975f-fc96454cd042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:51.035820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580214f-737c-4471-975f-fc96454cd042 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:51.059624 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3105/6213] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:46:51.060603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580214f-737c-4471-975f-fc96454cd042 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:51.072880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7580214f-737c-4471-975f-fc96454cd042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:51.129703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5aef2-4b2f-45e1-897c-68ddbec36562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:51.130586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5aef2-4b2f-45e1-897c-68ddbec36562 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:51.131015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5aef2-4b2f-45e1-897c-68ddbec36562 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:51.131714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5aef2-4b2f-45e1-897c-68ddbec36562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:51.260983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580214f-737c-4471-975f-fc96454cd042 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:51.261210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5aef2-4b2f-45e1-897c-68ddbec36562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:51.263201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5aef2-4b2f-45e1-897c-68ddbec36562 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:51.278298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e3a03-9cf0-4df4-b15b-baddf2601398 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:51.279172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e3a03-9cf0-4df4-b15b-baddf2601398 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:51.279694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e3a03-9cf0-4df4-b15b-baddf2601398 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:51.283793 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3109/6214] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:51.284321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e3a03-9cf0-4df4-b15b-baddf2601398 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:51.286556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db2e3a03-9cf0-4df4-b15b-baddf2601398 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:51.287915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5aef2-4b2f-45e1-897c-68ddbec36562 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:51.297280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:51.311452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5aef2-4b2f-45e1-897c-68ddbec36562 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:51.325578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b643ac-656f-4dda-a27c-33b1487bdfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:51.326220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b643ac-656f-4dda-a27c-33b1487bdfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:51.326605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b643ac-656f-4dda-a27c-33b1487bdfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:51.326888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b643ac-656f-4dda-a27c-33b1487bdfe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:51.327580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b643ac-656f-4dda-a27c-33b1487bdfe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:51.329209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b643ac-656f-4dda-a27c-33b1487bdfe8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:51.379474 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3110/6215] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:51.383638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b643ac-656f-4dda-a27c-33b1487bdfe8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:51.401941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b643ac-656f-4dda-a27c-33b1487bdfe8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:51.426873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d2f9f-2cef-4607-b8e1-4db299e95e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:51.429734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2f9f-2cef-4607-b8e1-4db299e95e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:51.430130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2f9f-2cef-4607-b8e1-4db299e95e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:51.431148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2f9f-2cef-4607-b8e1-4db299e95e9a admin admin] PATH_INFO: `/v3/projects/c4d96459d5054b2fb6a75cd2981520fb/users/834b435ec6c14c4e9138f12eef840fc6/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:51.457583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e3a03-9cf0-4df4-b15b-baddf2601398 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:51.465874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e3a03-9cf0-4df4-b15b-baddf2601398 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:51.480110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d2f9f-2cef-4607-b8e1-4db299e95e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d96459d5054b2fb6a75cd2981520fb, user_id=834b435ec6c14c4e9138f12eef840fc6, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:51.483132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d2f9f-2cef-4607-b8e1-4db299e95e9a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:51.531340 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3111/6216] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:51 2022] PUT /identity/v3/projects/c4d96459d5054b2fb6a75cd2981520fb/users/834b435ec6c14c4e9138f12eef840fc6/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:51.532996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d306046-4bee-44dd-8ece-26de79ae91e1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:51.533289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d306046-4bee-44dd-8ece-26de79ae91e1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:51.543776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d306046-4bee-44dd-8ece-26de79ae91e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:51.561270 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3106/6217] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:51.563673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:51.618935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3d306046-4bee-44dd-8ece-26de79ae91e1 None None] MFA Rules not processed for user `834b435ec6c14c4e9138f12eef840fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:51.619606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3d306046-4bee-44dd-8ece-26de79ae91e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:51.768728 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3112/6218] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:51.784435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e3a03-9cf0-4df4-b15b-baddf2601398 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:51.786140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db2e3a03-9cf0-4df4-b15b-baddf2601398 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:51.976844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e3a03-9cf0-4df4-b15b-baddf2601398 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:52.230545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db408a-3d0e-460f-a187-85035bd71a40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:52.235370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db408a-3d0e-460f-a187-85035bd71a40 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:52.236627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db408a-3d0e-460f-a187-85035bd71a40 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:52.237238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db408a-3d0e-460f-a187-85035bd71a40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:52.260519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db408a-3d0e-460f-a187-85035bd71a40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:52.263361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db408a-3d0e-460f-a187-85035bd71a40 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:52.319025 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3107/6219] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:52.807587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d306046-4bee-44dd-8ece-26de79ae91e1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:52.986014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d306046-4bee-44dd-8ece-26de79ae91e1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:53.001631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570eeea1-7f82-446d-98a9-ecacdeef6851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:53.002268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570eeea1-7f82-446d-98a9-ecacdeef6851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:53.004564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570eeea1-7f82-446d-98a9-ecacdeef6851 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:53.004812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570eeea1-7f82-446d-98a9-ecacdeef6851 admin admin] PATH_INFO: `/v3/users/834b435ec6c14c4e9138f12eef840fc6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:53.009063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570eeea1-7f82-446d-98a9-ecacdeef6851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=834b435ec6c14c4e9138f12eef840fc6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:53.017600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570eeea1-7f82-446d-98a9-ecacdeef6851 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:53.162005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db408a-3d0e-460f-a187-85035bd71a40 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:53.177570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db408a-3d0e-460f-a187-85035bd71a40 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:53.183770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-570eeea1-7f82-446d-98a9-ecacdeef6851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '834b435ec6c14c4e9138f12eef840fc6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:53.188978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6729e-fbc6-4eb1-91c3-b8f8fb835249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:53.189947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6729e-fbc6-4eb1-91c3-b8f8fb835249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:53.190230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6729e-fbc6-4eb1-91c3-b8f8fb835249 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:53.190512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6729e-fbc6-4eb1-91c3-b8f8fb835249 admin admin] PATH_INFO: `/v3/users/6e36d2322bd24a74b98076a1074a8960` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:53.192533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6729e-fbc6-4eb1-91c3-b8f8fb835249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e36d2322bd24a74b98076a1074a8960)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:53.194695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6729e-fbc6-4eb1-91c3-b8f8fb835249 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:53.241203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-570eeea1-7f82-446d-98a9-ecacdeef6851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '834b435ec6c14c4e9138f12eef840fc6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:53.245694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-570eeea1-7f82-446d-98a9-ecacdeef6851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '834b435ec6c14c4e9138f12eef840fc6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:53.248980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-570eeea1-7f82-446d-98a9-ecacdeef6851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '834b435ec6c14c4e9138f12eef840fc6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:53.292045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-570eeea1-7f82-446d-98a9-ecacdeef6851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '834b435ec6c14c4e9138f12eef840fc6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:53.303868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4eb6729e-fbc6-4eb1-91c3-b8f8fb835249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e36d2322bd24a74b98076a1074a8960'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:53.307010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4eb6729e-fbc6-4eb1-91c3-b8f8fb835249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e36d2322bd24a74b98076a1074a8960'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:53.311596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:53.322155 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3113/6220] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:52 2022] DELETE /identity/v3/users/834b435ec6c14c4e9138f12eef840fc6 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:53.328555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba50e2-c6fa-491a-89f5-34c2ce4c1d4a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:53.328816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba50e2-c6fa-491a-89f5-34c2ce4c1d4a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:53.329175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba50e2-c6fa-491a-89f5-34c2ce4c1d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:53.336331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4eb6729e-fbc6-4eb1-91c3-b8f8fb835249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e36d2322bd24a74b98076a1074a8960'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:53.358092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4eb6729e-fbc6-4eb1-91c3-b8f8fb835249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e36d2322bd24a74b98076a1074a8960'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:53.380450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-46ba50e2-c6fa-491a-89f5-34c2ce4c1d4a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:53.381820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-46ba50e2-c6fa-491a-89f5-34c2ce4c1d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:53.400083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:53.406552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4eb6729e-fbc6-4eb1-91c3-b8f8fb835249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e36d2322bd24a74b98076a1074a8960'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:53.419314 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3108/6221] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:53 2022] DELETE /identity/v3/users/6e36d2322bd24a74b98076a1074a8960 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:53.423432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67711ea3-a910-4932-998c-e94589bdf897 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:53.426182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67711ea3-a910-4932-998c-e94589bdf897 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:53.426863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67711ea3-a910-4932-998c-e94589bdf897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:53.517453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-67711ea3-a910-4932-998c-e94589bdf897 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:53.518741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-67711ea3-a910-4932-998c-e94589bdf897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:53.577484 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3114/6222] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:53.610027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba50e2-c6fa-491a-89f5-34c2ce4c1d4a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:53.612231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-46ba50e2-c6fa-491a-89f5-34c2ce4c1d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:53.674925 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3109/6223] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:46:53.691118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67711ea3-a910-4932-998c-e94589bdf897 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:53.693280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-67711ea3-a910-4932-998c-e94589bdf897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:53.815442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba50e2-c6fa-491a-89f5-34c2ce4c1d4a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:53.885816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67711ea3-a910-4932-998c-e94589bdf897 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:53.908666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf715c-f64c-4f33-bbde-33cf3a0c75f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:53.909311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf715c-f64c-4f33-bbde-33cf3a0c75f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:53.911229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf715c-f64c-4f33-bbde-33cf3a0c75f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:53.911550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf715c-f64c-4f33-bbde-33cf3a0c75f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:53.941382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf715c-f64c-4f33-bbde-33cf3a0c75f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:53.941382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf715c-f64c-4f33-bbde-33cf3a0c75f8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:53.956120 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3110/6224] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:54.009119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c50b41-59b4-4dd3-9398-267e0348871b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:54.009757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c50b41-59b4-4dd3-9398-267e0348871b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:54.010032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c50b41-59b4-4dd3-9398-267e0348871b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:54.010303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c50b41-59b4-4dd3-9398-267e0348871b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:54.037531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c50b41-59b4-4dd3-9398-267e0348871b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:54.039379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c50b41-59b4-4dd3-9398-267e0348871b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:54.084030 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3115/6225] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:46:55.848176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf715c-f64c-4f33-bbde-33cf3a0c75f8 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:55.850993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eddf715c-f64c-4f33-bbde-33cf3a0c75f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:55.897066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf715c-f64c-4f33-bbde-33cf3a0c75f8 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:55.918473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bc933-26c9-413b-9567-0f57b00facf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:55.921740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bc933-26c9-413b-9567-0f57b00facf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:55.923728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bc933-26c9-413b-9567-0f57b00facf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:55.924286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bc933-26c9-413b-9567-0f57b00facf5 admin admin] PATH_INFO: `/v3/projects/c4d96459d5054b2fb6a75cd2981520fb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:55.929394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27bc933-26c9-413b-9567-0f57b00facf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d96459d5054b2fb6a75cd2981520fb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:55.934882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27bc933-26c9-413b-9567-0f57b00facf5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:56.117325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b27bc933-26c9-413b-9567-0f57b00facf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d96459d5054b2fb6a75cd2981520fb', 'request_id': 'req-b27bc933-26c9-413b-9567-0f57b00facf5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:56.140366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b27bc933-26c9-413b-9567-0f57b00facf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d96459d5054b2fb6a75cd2981520fb', 'request_id': 'req-b27bc933-26c9-413b-9567-0f57b00facf5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:56.161429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b27bc933-26c9-413b-9567-0f57b00facf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d96459d5054b2fb6a75cd2981520fb', 'request_id': 'req-b27bc933-26c9-413b-9567-0f57b00facf5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:56.172074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:56.218631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b27bc933-26c9-413b-9567-0f57b00facf5 admin admin] The token cache is being invalidate because project c4d96459d5054b2fb6a75cd2981520fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:56.218934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b27bc933-26c9-413b-9567-0f57b00facf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:56.224250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b27bc933-26c9-413b-9567-0f57b00facf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:56.236902 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3111/6226] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:55 2022] DELETE /identity/v3/projects/c4d96459d5054b2fb6a75cd2981520fb => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:56.238060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d4306-23e4-4f15-8d77-b39cd6833233 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:56.238614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d4306-23e4-4f15-8d77-b39cd6833233 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:56.238614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d4306-23e4-4f15-8d77-b39cd6833233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:56.276487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-897d4306-23e4-4f15-8d77-b39cd6833233 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:56.277996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-897d4306-23e4-4f15-8d77-b39cd6833233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:56.294334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bc933-26c9-413b-9567-0f57b00facf5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:56.295821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b27bc933-26c9-413b-9567-0f57b00facf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:56.475905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bc933-26c9-413b-9567-0f57b00facf5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:56.501706 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3116/6227] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:46:56.503347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7e8df-6d78-4225-a864-d3d26e10f65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:56.504277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7e8df-6d78-4225-a864-d3d26e10f65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:56.504568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7e8df-6d78-4225-a864-d3d26e10f65e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:56.504891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7e8df-6d78-4225-a864-d3d26e10f65e admin admin] PATH_INFO: `/v3/projects/740a93b047a14738a964da78e23e4c12` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:56.510617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7e8df-6d78-4225-a864-d3d26e10f65e admin admin] RBAC: Authorizing `identity:delete_project(project_id=740a93b047a14738a964da78e23e4c12)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:56.512169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b61f27-35c5-4ef3-a416-2bbeb917097a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:56.514191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7e8df-6d78-4225-a864-d3d26e10f65e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:56.514567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b61f27-35c5-4ef3-a416-2bbeb917097a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:56.515447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b61f27-35c5-4ef3-a416-2bbeb917097a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:56.592359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e0b61f27-35c5-4ef3-a416-2bbeb917097a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:56.592906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7df7e8df-6d78-4225-a864-d3d26e10f65e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '740a93b047a14738a964da78e23e4c12', 'request_id': 'req-7df7e8df-6d78-4225-a864-d3d26e10f65e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:56.598017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e0b61f27-35c5-4ef3-a416-2bbeb917097a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:56.604777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7df7e8df-6d78-4225-a864-d3d26e10f65e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '740a93b047a14738a964da78e23e4c12', 'request_id': 'req-7df7e8df-6d78-4225-a864-d3d26e10f65e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:56.625713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:56.625889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7df7e8df-6d78-4225-a864-d3d26e10f65e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '740a93b047a14738a964da78e23e4c12', 'request_id': 'req-7df7e8df-6d78-4225-a864-d3d26e10f65e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:56.643183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7df7e8df-6d78-4225-a864-d3d26e10f65e admin admin] The token cache is being invalidate because project 740a93b047a14738a964da78e23e4c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:56.644547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7df7e8df-6d78-4225-a864-d3d26e10f65e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:56.644931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7df7e8df-6d78-4225-a864-d3d26e10f65e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:56.647845 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3112/6228] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:56 2022] DELETE /identity/v3/projects/740a93b047a14738a964da78e23e4c12 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:56.653441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7e8df-6d78-4225-a864-d3d26e10f65e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:56.656039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7df7e8df-6d78-4225-a864-d3d26e10f65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:56.752780 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3117/6229] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:56.756847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b61f27-35c5-4ef3-a416-2bbeb917097a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:56.785091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b61f27-35c5-4ef3-a416-2bbeb917097a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:56.790450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193f2a0-c18b-4467-b861-805a1a63c950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:56.791564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f2a0-c18b-4467-b861-805a1a63c950 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:56.792199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f2a0-c18b-4467-b861-805a1a63c950 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:56.792539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f2a0-c18b-4467-b861-805a1a63c950 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:56.793328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193f2a0-c18b-4467-b861-805a1a63c950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:46:56.793824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193f2a0-c18b-4467-b861-805a1a63c950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:56.796119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193f2a0-c18b-4467-b861-805a1a63c950 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:56.810034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7e8df-6d78-4225-a864-d3d26e10f65e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:56.817838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3132337-e4ca-4a1a-aec2-09d0d4904873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:56.819104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3132337-e4ca-4a1a-aec2-09d0d4904873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:56.820222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3132337-e4ca-4a1a-aec2-09d0d4904873 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:56.820504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3132337-e4ca-4a1a-aec2-09d0d4904873 admin admin] PATH_INFO: `/v3/users/d25df2c2dc22448ebecab41359a1b8b7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:56.824956 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3118/6230] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:46:56.825090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3132337-e4ca-4a1a-aec2-09d0d4904873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d25df2c2dc22448ebecab41359a1b8b7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:56.825090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3132337-e4ca-4a1a-aec2-09d0d4904873 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:56.826640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193f2a0-c18b-4467-b861-805a1a63c950 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:56.849931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193f2a0-c18b-4467-b861-805a1a63c950 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:56.864468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8f7ab-dfa8-4c33-b326-a9cd5f0ffa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:56.865176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8f7ab-dfa8-4c33-b326-a9cd5f0ffa90 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:56.865587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8f7ab-dfa8-4c33-b326-a9cd5f0ffa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:56.867339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8f7ab-dfa8-4c33-b326-a9cd5f0ffa90 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:56.869460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8f7ab-dfa8-4c33-b326-a9cd5f0ffa90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:56.871709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8f7ab-dfa8-4c33-b326-a9cd5f0ffa90 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:56.881025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:56.917914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d3132337-e4ca-4a1a-aec2-09d0d4904873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd25df2c2dc22448ebecab41359a1b8b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:56.918908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d3132337-e4ca-4a1a-aec2-09d0d4904873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd25df2c2dc22448ebecab41359a1b8b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:56.927496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d3132337-e4ca-4a1a-aec2-09d0d4904873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd25df2c2dc22448ebecab41359a1b8b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:56.935316 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3119/6231] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:56 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:56.937671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d3132337-e4ca-4a1a-aec2-09d0d4904873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd25df2c2dc22448ebecab41359a1b8b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:56.940927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8f7ab-dfa8-4c33-b326-a9cd5f0ffa90 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:56.946212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-23c8f7ab-dfa8-4c33-b326-a9cd5f0ffa90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:56.954090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d3132337-e4ca-4a1a-aec2-09d0d4904873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd25df2c2dc22448ebecab41359a1b8b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:56.961524 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3113/6232] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:46:56 2022] DELETE /identity/v3/users/d25df2c2dc22448ebecab41359a1b8b7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:57.120773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8f7ab-dfa8-4c33-b326-a9cd5f0ffa90 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:57.283523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e7fa2-f18f-4fa6-8f7e-bf6cc0627848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:57.284155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7fa2-f18f-4fa6-8f7e-bf6cc0627848 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:57.284412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7fa2-f18f-4fa6-8f7e-bf6cc0627848 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:57.285133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7fa2-f18f-4fa6-8f7e-bf6cc0627848 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:57.285787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e7fa2-f18f-4fa6-8f7e-bf6cc0627848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:57.287921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e7fa2-f18f-4fa6-8f7e-bf6cc0627848 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:57.326945 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3120/6233] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:56 2022] POST /identity/v3/users => generated 293 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:57.328254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3132337-e4ca-4a1a-aec2-09d0d4904873 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:57.338991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3132337-e4ca-4a1a-aec2-09d0d4904873 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:57.352025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b99c9-3cc5-4709-a146-9639dbcf9450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:57.353577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b99c9-3cc5-4709-a146-9639dbcf9450 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:57.353886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b99c9-3cc5-4709-a146-9639dbcf9450 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:57.354132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b99c9-3cc5-4709-a146-9639dbcf9450 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:57.354812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b99c9-3cc5-4709-a146-9639dbcf9450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:57.358288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b99c9-3cc5-4709-a146-9639dbcf9450 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:57.385771 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3114/6234] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:57.389184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e7fa2-f18f-4fa6-8f7e-bf6cc0627848 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:57.402536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e7fa2-f18f-4fa6-8f7e-bf6cc0627848 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:57.414857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fff826-83eb-4a03-983d-f394ac88d4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:57.415542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fff826-83eb-4a03-983d-f394ac88d4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:57.415855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fff826-83eb-4a03-983d-f394ac88d4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:57.416084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fff826-83eb-4a03-983d-f394ac88d4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:57.416775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fff826-83eb-4a03-983d-f394ac88d4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:57.422761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fff826-83eb-4a03-983d-f394ac88d4f3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:57.445785 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3121/6235] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:57.451803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b99c9-3cc5-4709-a146-9639dbcf9450 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:57.482252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b99c9-3cc5-4709-a146-9639dbcf9450 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:57.503048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d532f-9f5c-4048-8b1b-4fa66978e77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:57.508181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d532f-9f5c-4048-8b1b-4fa66978e77f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:57.508401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d532f-9f5c-4048-8b1b-4fa66978e77f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:57.508680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d532f-9f5c-4048-8b1b-4fa66978e77f admin admin] PATH_INFO: `/v3/projects/704debdb38f24659bffb2b7271014d41/users/7c4357cf66c544ca95eedff94a981738/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:57.585596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d532f-9f5c-4048-8b1b-4fa66978e77f admin admin] RBAC: Authorizing `identity:create_grant(project_id=704debdb38f24659bffb2b7271014d41, user_id=7c4357cf66c544ca95eedff94a981738, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:57.593497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d532f-9f5c-4048-8b1b-4fa66978e77f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:57.623144 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3115/6236] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:57 2022] PUT /identity/v3/projects/704debdb38f24659bffb2b7271014d41/users/7c4357cf66c544ca95eedff94a981738/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:57.635743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae9413-ebd4-48e3-a0cd-18a4b2805abd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:57.635847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae9413-ebd4-48e3-a0cd-18a4b2805abd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:57.636193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae9413-ebd4-48e3-a0cd-18a4b2805abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:57.649334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:57.713488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-71ae9413-ebd4-48e3-a0cd-18a4b2805abd None None] MFA Rules not processed for user `7c4357cf66c544ca95eedff94a981738`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:57.714725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-71ae9413-ebd4-48e3-a0cd-18a4b2805abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:57.877829 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3122/6237] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:57.917651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d532f-9f5c-4048-8b1b-4fa66978e77f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:57.919761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d4d532f-9f5c-4048-8b1b-4fa66978e77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:58.010991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d532f-9f5c-4048-8b1b-4fa66978e77f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:58.014918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb25a9-48a7-45b6-9cf9-9b2335decd30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:58.015666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb25a9-48a7-45b6-9cf9-9b2335decd30 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:58.016024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb25a9-48a7-45b6-9cf9-9b2335decd30 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:58.016374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb25a9-48a7-45b6-9cf9-9b2335decd30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:58.027705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb25a9-48a7-45b6-9cf9-9b2335decd30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:58.034828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb25a9-48a7-45b6-9cf9-9b2335decd30 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:58.055241 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3116/6238] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:46:58.155145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae9413-ebd4-48e3-a0cd-18a4b2805abd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:58.156858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-71ae9413-ebd4-48e3-a0cd-18a4b2805abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:58.331433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae9413-ebd4-48e3-a0cd-18a4b2805abd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:58.344398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f552731-c261-4cd6-8c13-c71d28caa5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:58.345149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f552731-c261-4cd6-8c13-c71d28caa5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:58.345579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f552731-c261-4cd6-8c13-c71d28caa5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:58.347690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f552731-c261-4cd6-8c13-c71d28caa5d5 admin admin] PATH_INFO: `/v3/projects/92d291eeee1246e1817812cdb37aff50` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:58.349576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f552731-c261-4cd6-8c13-c71d28caa5d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d291eeee1246e1817812cdb37aff50)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:58.354359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f552731-c261-4cd6-8c13-c71d28caa5d5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:58.481527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8f552731-c261-4cd6-8c13-c71d28caa5d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d291eeee1246e1817812cdb37aff50', 'request_id': 'req-8f552731-c261-4cd6-8c13-c71d28caa5d5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:58.491973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8f552731-c261-4cd6-8c13-c71d28caa5d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d291eeee1246e1817812cdb37aff50', 'request_id': 'req-8f552731-c261-4cd6-8c13-c71d28caa5d5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:58.501343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8f552731-c261-4cd6-8c13-c71d28caa5d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d291eeee1246e1817812cdb37aff50', 'request_id': 'req-8f552731-c261-4cd6-8c13-c71d28caa5d5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:58.527534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8f552731-c261-4cd6-8c13-c71d28caa5d5 admin admin] The token cache is being invalidate because project 92d291eeee1246e1817812cdb37aff50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:46:58.527976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8f552731-c261-4cd6-8c13-c71d28caa5d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:58.529361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8f552731-c261-4cd6-8c13-c71d28caa5d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:46:58.532486 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3123/6239] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:46:58 2022] DELETE /identity/v3/projects/92d291eeee1246e1817812cdb37aff50 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:58.537927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f59d0d-4256-4b9c-afb8-5ed1cf676d5f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:58.538218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f59d0d-4256-4b9c-afb8-5ed1cf676d5f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:58.538607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f59d0d-4256-4b9c-afb8-5ed1cf676d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:58.583073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-92f59d0d-4256-4b9c-afb8-5ed1cf676d5f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:58.584650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-92f59d0d-4256-4b9c-afb8-5ed1cf676d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:58.690386 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3117/6240] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:46:58.701408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63605670-e8a4-4192-b608-ab3854f397f3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:58.701779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63605670-e8a4-4192-b608-ab3854f397f3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:58.702074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63605670-e8a4-4192-b608-ab3854f397f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:58.741738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-63605670-e8a4-4192-b608-ab3854f397f3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:58.743080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-63605670-e8a4-4192-b608-ab3854f397f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:58.769720 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3124/6241] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:58.774000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f59d0d-4256-4b9c-afb8-5ed1cf676d5f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:58.798573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f59d0d-4256-4b9c-afb8-5ed1cf676d5f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:58.808243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35dd75-8f08-4c3a-a020-c19fe3b573f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:58.808980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35dd75-8f08-4c3a-a020-c19fe3b573f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:58.809323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35dd75-8f08-4c3a-a020-c19fe3b573f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:58.809942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35dd75-8f08-4c3a-a020-c19fe3b573f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:58.811691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35dd75-8f08-4c3a-a020-c19fe3b573f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:46:58.811691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35dd75-8f08-4c3a-a020-c19fe3b573f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:58.813323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35dd75-8f08-4c3a-a020-c19fe3b573f3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:58.827737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:58.834676 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3118/6242] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:46:58.836066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63605670-e8a4-4192-b608-ab3854f397f3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:58.853725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63605670-e8a4-4192-b608-ab3854f397f3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:58.867212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba30fa-356b-433e-b85a-a12b6ba850e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:58.868229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba30fa-356b-433e-b85a-a12b6ba850e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:58.868582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba30fa-356b-433e-b85a-a12b6ba850e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:58.868958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba30fa-356b-433e-b85a-a12b6ba850e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:58.869684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba30fa-356b-433e-b85a-a12b6ba850e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:58.872643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba30fa-356b-433e-b85a-a12b6ba850e5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:58.917570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:58.947704 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3125/6243] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:46:58 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:58.949344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35dd75-8f08-4c3a-a020-c19fe3b573f3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:58.963852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35dd75-8f08-4c3a-a020-c19fe3b573f3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:59.174320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8db4d-c4cc-42e2-bf55-7df7f2a37614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:59.178486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8db4d-c4cc-42e2-bf55-7df7f2a37614 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:59.178859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8db4d-c4cc-42e2-bf55-7df7f2a37614 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:59.179351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8db4d-c4cc-42e2-bf55-7df7f2a37614 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:59.180057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8db4d-c4cc-42e2-bf55-7df7f2a37614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:59.193276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8db4d-c4cc-42e2-bf55-7df7f2a37614 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:59.264680 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3119/6244] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:46:58 2022] POST /identity/v3/users => generated 287 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:46:59.269626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba30fa-356b-433e-b85a-a12b6ba850e5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:59.284098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba30fa-356b-433e-b85a-a12b6ba850e5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:59.299454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a37dd-380e-4dc5-beee-9898f14729f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:59.300353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a37dd-380e-4dc5-beee-9898f14729f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:59.301013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a37dd-380e-4dc5-beee-9898f14729f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:59.301422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a37dd-380e-4dc5-beee-9898f14729f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:59.302226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a37dd-380e-4dc5-beee-9898f14729f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:59.306104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a37dd-380e-4dc5-beee-9898f14729f3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:59.337618 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3126/6245] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:59.338991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8db4d-c4cc-42e2-bf55-7df7f2a37614 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:59.377656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8db4d-c4cc-42e2-bf55-7df7f2a37614 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:59.394874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb2240-565c-4a45-bf31-56ce658077ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:59.395547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb2240-565c-4a45-bf31-56ce658077ff admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:59.395833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb2240-565c-4a45-bf31-56ce658077ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:59.396115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb2240-565c-4a45-bf31-56ce658077ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:59.396784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb2240-565c-4a45-bf31-56ce658077ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:59.398553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb2240-565c-4a45-bf31-56ce658077ff admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:59.436354 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3120/6246] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:46:59.437574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a37dd-380e-4dc5-beee-9898f14729f3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:59.448399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a37dd-380e-4dc5-beee-9898f14729f3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:46:59.463750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fceed2a-c562-464b-ac01-5a80e32ee8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:46:59.464446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fceed2a-c562-464b-ac01-5a80e32ee8e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:59.464723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fceed2a-c562-464b-ac01-5a80e32ee8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:59.464999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fceed2a-c562-464b-ac01-5a80e32ee8e6 admin admin] PATH_INFO: `/v3/projects/d7f58a04d92d4323aeed898f4b940689/users/2d92472b75b14465ada9c03d018d188c/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:59.504955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fceed2a-c562-464b-ac01-5a80e32ee8e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f58a04d92d4323aeed898f4b940689, user_id=2d92472b75b14465ada9c03d018d188c, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:46:59.507628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fceed2a-c562-464b-ac01-5a80e32ee8e6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:46:59.543472 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3127/6247] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:46:59 2022] PUT /identity/v3/projects/d7f58a04d92d4323aeed898f4b940689/users/2d92472b75b14465ada9c03d018d188c/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:59.549316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfad93f-6ff7-42ac-b8be-0cc313c3dcf0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:46:59.549316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfad93f-6ff7-42ac-b8be-0cc313c3dcf0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:46:59.549316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfad93f-6ff7-42ac-b8be-0cc313c3dcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:46:59.605582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0dfad93f-6ff7-42ac-b8be-0cc313c3dcf0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:46:59.607045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0dfad93f-6ff7-42ac-b8be-0cc313c3dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:46:59.779192 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3121/6248] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:46:59.814313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fceed2a-c562-464b-ac01-5a80e32ee8e6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:46:59.819179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8fceed2a-c562-464b-ac01-5a80e32ee8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:00.005866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fceed2a-c562-464b-ac01-5a80e32ee8e6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:00.010163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04e2c4-4fad-4d51-b5e3-373650e606a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:00.010804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04e2c4-4fad-4d51-b5e3-373650e606a4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:00.011088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04e2c4-4fad-4d51-b5e3-373650e606a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:00.011464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04e2c4-4fad-4d51-b5e3-373650e606a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:00.024656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04e2c4-4fad-4d51-b5e3-373650e606a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:00.026151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04e2c4-4fad-4d51-b5e3-373650e606a4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:00.048721 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3128/6249] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:46:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:47:03.131118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ee7db-6d9c-4d13-8d58-5ba818f69954 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:03.131851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ee7db-6d9c-4d13-8d58-5ba818f69954 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:03.131851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ee7db-6d9c-4d13-8d58-5ba818f69954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:03.226315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ab8ee7db-6d9c-4d13-8d58-5ba818f69954 None None] MFA Rules not processed for user `2d92472b75b14465ada9c03d018d188c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:47:03.227665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab8ee7db-6d9c-4d13-8d58-5ba818f69954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:03.565929 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3122/6250] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:47:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:47:03.571391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04e2c4-4fad-4d51-b5e3-373650e606a4 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:03.594703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04e2c4-4fad-4d51-b5e3-373650e606a4 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:03.606767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fe82c-de41-4aed-ad7f-7aa473e6c9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:03.607473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fe82c-de41-4aed-ad7f-7aa473e6c9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:03.607941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fe82c-de41-4aed-ad7f-7aa473e6c9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:03.608370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fe82c-de41-4aed-ad7f-7aa473e6c9c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:03.609190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fe82c-de41-4aed-ad7f-7aa473e6c9c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:03.613885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fe82c-de41-4aed-ad7f-7aa473e6c9c0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:03.695160 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3129/6251] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:47:03 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:47:03.699587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ee7db-6d9c-4d13-8d58-5ba818f69954 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:03.721253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ee7db-6d9c-4d13-8d58-5ba818f69954 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:03.736883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:47:03.860115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d350c-03b7-42e4-b010-2cd564d52736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:03.860821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d350c-03b7-42e4-b010-2cd564d52736 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:03.861106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d350c-03b7-42e4-b010-2cd564d52736 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:03.861733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d350c-03b7-42e4-b010-2cd564d52736 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:03.862423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d350c-03b7-42e4-b010-2cd564d52736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:03.870756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d350c-03b7-42e4-b010-2cd564d52736 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:03.954153 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3123/6252] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:47:03 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:47:03.955274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fe82c-de41-4aed-ad7f-7aa473e6c9c0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:03.971697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fe82c-de41-4aed-ad7f-7aa473e6c9c0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:03.991757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f88448-b1de-4a3c-b6e0-6bd249f6c14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:03.995766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f88448-b1de-4a3c-b6e0-6bd249f6c14c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:03.996099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f88448-b1de-4a3c-b6e0-6bd249f6c14c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:03.998602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f88448-b1de-4a3c-b6e0-6bd249f6c14c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:04.000579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f88448-b1de-4a3c-b6e0-6bd249f6c14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:04.004422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f88448-b1de-4a3c-b6e0-6bd249f6c14c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:04.053245 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3130/6253] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:47:04.054549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d350c-03b7-42e4-b010-2cd564d52736 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:04.069967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d350c-03b7-42e4-b010-2cd564d52736 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:04.101307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c0c96-f797-46d9-a358-7dcddcc99d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:04.102016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c0c96-f797-46d9-a358-7dcddcc99d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:04.103366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c0c96-f797-46d9-a358-7dcddcc99d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:04.103366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c0c96-f797-46d9-a358-7dcddcc99d5d admin admin] PATH_INFO: `/v3/projects/6ce2dc932fc34c1c8c4b23eeced19acd/users/ffb740fc3bc84d1b97a59c0aeb193776/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:04.125601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c0c96-f797-46d9-a358-7dcddcc99d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce2dc932fc34c1c8c4b23eeced19acd, user_id=ffb740fc3bc84d1b97a59c0aeb193776, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:04.135177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c0c96-f797-46d9-a358-7dcddcc99d5d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:04.167299 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3124/6254] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:47:04 2022] PUT /identity/v3/projects/6ce2dc932fc34c1c8c4b23eeced19acd/users/ffb740fc3bc84d1b97a59c0aeb193776/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:47:04.170090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f88448-b1de-4a3c-b6e0-6bd249f6c14c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:04.183692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f88448-b1de-4a3c-b6e0-6bd249f6c14c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:04.321220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1f88d-a147-487e-9385-4548d67dc9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:04.323018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1f88d-a147-487e-9385-4548d67dc9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:04.323334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1f88d-a147-487e-9385-4548d67dc9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:04.323622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1f88d-a147-487e-9385-4548d67dc9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:04.327276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1f88d-a147-487e-9385-4548d67dc9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:04.328944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1f88d-a147-487e-9385-4548d67dc9e0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:04.356738 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3131/6255] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:47:04.361047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c0c96-f797-46d9-a358-7dcddcc99d5d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:04.383205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c0c96-f797-46d9-a358-7dcddcc99d5d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:04.400458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f8901-76a7-4715-b24f-5a29736e54fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:04.401544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f8901-76a7-4715-b24f-5a29736e54fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:04.402033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f8901-76a7-4715-b24f-5a29736e54fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:04.402517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f8901-76a7-4715-b24f-5a29736e54fd admin admin] PATH_INFO: `/v3/projects/6ce2dc932fc34c1c8c4b23eeced19acd/users/ffb740fc3bc84d1b97a59c0aeb193776/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:04.412631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f8901-76a7-4715-b24f-5a29736e54fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce2dc932fc34c1c8c4b23eeced19acd, user_id=ffb740fc3bc84d1b97a59c0aeb193776, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:04.416090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f8901-76a7-4715-b24f-5a29736e54fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:04.439476 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3125/6256] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:47:04 2022] PUT /identity/v3/projects/6ce2dc932fc34c1c8c4b23eeced19acd/users/ffb740fc3bc84d1b97a59c0aeb193776/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:47:07.040611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f72c51-9fd5-4360-8170-a26662e17063 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:07.041616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f72c51-9fd5-4360-8170-a26662e17063 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:07.042052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f72c51-9fd5-4360-8170-a26662e17063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:07.118956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-29f72c51-9fd5-4360-8170-a26662e17063 None None] MFA Rules not processed for user `ffb740fc3bc84d1b97a59c0aeb193776`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:47:07.120503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-29f72c51-9fd5-4360-8170-a26662e17063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:07.131039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:47:07.337415 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3132/6257] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:47:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:47:07.348417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb70574-63c8-4863-9b0d-c7942faf1be5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:07.349251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb70574-63c8-4863-9b0d-c7942faf1be5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:07.349670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb70574-63c8-4863-9b0d-c7942faf1be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:07.404073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5cb70574-63c8-4863-9b0d-c7942faf1be5 None None] MFA Rules not processed for user `2d92472b75b14465ada9c03d018d188c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:47:07.405720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5cb70574-63c8-4863-9b0d-c7942faf1be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:07.495311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07410f4f-d2cd-4d71-9c02-770701fdebf6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:07.495457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07410f4f-d2cd-4d71-9c02-770701fdebf6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:07.495775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07410f4f-d2cd-4d71-9c02-770701fdebf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:07.535269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-07410f4f-d2cd-4d71-9c02-770701fdebf6 None None] MFA Rules not processed for user `185b4855098e46449a5b3e44339e51f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:47:07.536810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-07410f4f-d2cd-4d71-9c02-770701fdebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:07.548727 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3126/6258] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:47:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:47:07.578519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb70574-63c8-4863-9b0d-c7942faf1be5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:07.580669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5cb70574-63c8-4863-9b0d-c7942faf1be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:07.704234 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3133/6259] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:47:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:47:07.778486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:47:07.850624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb70574-63c8-4863-9b0d-c7942faf1be5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:07.870726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068960c-9759-4f48-9cad-78361adb345c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:07.873611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068960c-9759-4f48-9cad-78361adb345c service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:07.874739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068960c-9759-4f48-9cad-78361adb345c service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:07.875108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068960c-9759-4f48-9cad-78361adb345c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:07.895993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068960c-9759-4f48-9cad-78361adb345c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:07.897872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068960c-9759-4f48-9cad-78361adb345c service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:07.915354 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3127/6260] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:47:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:47:10.540758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07410f4f-d2cd-4d71-9c02-770701fdebf6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:10.543152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-07410f4f-d2cd-4d71-9c02-770701fdebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:10.561928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068960c-9759-4f48-9cad-78361adb345c service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:10.564132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3068960c-9759-4f48-9cad-78361adb345c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:10.849285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:47:10.856074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07410f4f-d2cd-4d71-9c02-770701fdebf6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:10.862353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14ec85-ac4f-4382-8578-4cb2a730d9f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:10.863137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ec85-ac4f-4382-8578-4cb2a730d9f4 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:10.863499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ec85-ac4f-4382-8578-4cb2a730d9f4 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:10.863784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ec85-ac4f-4382-8578-4cb2a730d9f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:10.866458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7f14ec85-ac4f-4382-8578-4cb2a730d9f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:10.886826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14ec85-ac4f-4382-8578-4cb2a730d9f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:10.889540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14ec85-ac4f-4382-8578-4cb2a730d9f4 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:10.893997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068960c-9759-4f48-9cad-78361adb345c service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:10.914351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce783bf0-4c56-4e89-88e2-648e5dead043 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:10.915857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce783bf0-4c56-4e89-88e2-648e5dead043 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:10.916821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce783bf0-4c56-4e89-88e2-648e5dead043 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:10.916821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce783bf0-4c56-4e89-88e2-648e5dead043 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:10.917501 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3134/6261] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:47:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:47:10.968584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce783bf0-4c56-4e89-88e2-648e5dead043 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:10.970220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce783bf0-4c56-4e89-88e2-648e5dead043 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:11.005118 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3128/6262] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:47:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:47:20.406398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14ec85-ac4f-4382-8578-4cb2a730d9f4 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:20.448076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14ec85-ac4f-4382-8578-4cb2a730d9f4 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:20.481251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95b05a-a86d-496d-a829-40212b83f7af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:20.484096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95b05a-a86d-496d-a829-40212b83f7af service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:20.485134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95b05a-a86d-496d-a829-40212b83f7af service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:20.485699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95b05a-a86d-496d-a829-40212b83f7af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:20.495330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fc95b05a-a86d-496d-a829-40212b83f7af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:20.532001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95b05a-a86d-496d-a829-40212b83f7af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:20.534013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95b05a-a86d-496d-a829-40212b83f7af service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:20.585517 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3135/6263] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:47:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:47:20.995025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=49 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:47:26.047392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce783bf0-4c56-4e89-88e2-648e5dead043 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:26.048840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce783bf0-4c56-4e89-88e2-648e5dead043 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:26.164012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce783bf0-4c56-4e89-88e2-648e5dead043 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:26.170301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7b76-08da-4c4a-9580-720f46979383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:26.171144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7b76-08da-4c4a-9580-720f46979383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:26.172119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7b76-08da-4c4a-9580-720f46979383 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:26.173070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7b76-08da-4c4a-9580-720f46979383 admin admin] PATH_INFO: `/v3/users/7c4357cf66c544ca95eedff94a981738` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:26.174372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a7b76-08da-4c4a-9580-720f46979383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c4357cf66c544ca95eedff94a981738)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:26.177276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a7b76-08da-4c4a-9580-720f46979383 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:26.272718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-072a7b76-08da-4c4a-9580-720f46979383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c4357cf66c544ca95eedff94a981738'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:26.273507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-072a7b76-08da-4c4a-9580-720f46979383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c4357cf66c544ca95eedff94a981738'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:26.282832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-072a7b76-08da-4c4a-9580-720f46979383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c4357cf66c544ca95eedff94a981738'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:26.298993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-072a7b76-08da-4c4a-9580-720f46979383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c4357cf66c544ca95eedff94a981738'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:26.322550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-072a7b76-08da-4c4a-9580-720f46979383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c4357cf66c544ca95eedff94a981738'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:26.333263 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3129/6264] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:47:26 2022] DELETE /identity/v3/users/7c4357cf66c544ca95eedff94a981738 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:47:26.341265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a34d83-b27c-4f09-b5dd-7c22d53e5793 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:26.342158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a34d83-b27c-4f09-b5dd-7c22d53e5793 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:26.347848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a34d83-b27c-4f09-b5dd-7c22d53e5793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:26.386591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e6a34d83-b27c-4f09-b5dd-7c22d53e5793 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:47:26.388302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e6a34d83-b27c-4f09-b5dd-7c22d53e5793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:26.532040 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3136/6265] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:47:26.539046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7b76-08da-4c4a-9580-720f46979383 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:26.540605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-072a7b76-08da-4c4a-9580-720f46979383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:26.627016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7b76-08da-4c4a-9580-720f46979383 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:26.633514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb5610-442a-4786-8ea6-9eaaabe91ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:26.633913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5610-442a-4786-8ea6-9eaaabe91ead service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:26.634305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5610-442a-4786-8ea6-9eaaabe91ead service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:26.634761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5610-442a-4786-8ea6-9eaaabe91ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:26.656879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb5610-442a-4786-8ea6-9eaaabe91ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:26.659128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb5610-442a-4786-8ea6-9eaaabe91ead service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:26.673484 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3130/6266] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:47:26.991588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a34d83-b27c-4f09-b5dd-7c22d53e5793 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:26.994152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e6a34d83-b27c-4f09-b5dd-7c22d53e5793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:27.038460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a34d83-b27c-4f09-b5dd-7c22d53e5793 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:27.062660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ca6c0-8acb-48bb-9796-8059c976a355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:27.063459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ca6c0-8acb-48bb-9796-8059c976a355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:27.063742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ca6c0-8acb-48bb-9796-8059c976a355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:27.064018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ca6c0-8acb-48bb-9796-8059c976a355 admin admin] PATH_INFO: `/v3/projects/704debdb38f24659bffb2b7271014d41` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:27.069256 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ca6c0-8acb-48bb-9796-8059c976a355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=704debdb38f24659bffb2b7271014d41)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:27.072842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ca6c0-8acb-48bb-9796-8059c976a355 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:27.174929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-041ca6c0-8acb-48bb-9796-8059c976a355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '704debdb38f24659bffb2b7271014d41', 'request_id': 'req-041ca6c0-8acb-48bb-9796-8059c976a355'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:27.184900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-041ca6c0-8acb-48bb-9796-8059c976a355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '704debdb38f24659bffb2b7271014d41', 'request_id': 'req-041ca6c0-8acb-48bb-9796-8059c976a355'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:27.194388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-041ca6c0-8acb-48bb-9796-8059c976a355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '704debdb38f24659bffb2b7271014d41', 'request_id': 'req-041ca6c0-8acb-48bb-9796-8059c976a355'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:27.238153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-041ca6c0-8acb-48bb-9796-8059c976a355 admin admin] The token cache is being invalidate because project 704debdb38f24659bffb2b7271014d41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:47:27.239111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-041ca6c0-8acb-48bb-9796-8059c976a355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:27.240531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-041ca6c0-8acb-48bb-9796-8059c976a355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:27.242776 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3137/6267] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:47:26 2022] DELETE /identity/v3/projects/704debdb38f24659bffb2b7271014d41 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:47:27.248320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2300c6-70dc-4af9-a6e4-5146a1257d51 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:27.249164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2300c6-70dc-4af9-a6e4-5146a1257d51 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:27.249629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2300c6-70dc-4af9-a6e4-5146a1257d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:27.270878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aa2300c6-70dc-4af9-a6e4-5146a1257d51 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:47:27.272203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa2300c6-70dc-4af9-a6e4-5146a1257d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:27.283104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:47:27.394535 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3131/6268] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:47:27.513298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839abd81-aef7-4365-8bd8-10d1583e81d3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:27.513834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839abd81-aef7-4365-8bd8-10d1583e81d3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:27.514106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839abd81-aef7-4365-8bd8-10d1583e81d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:27.663742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-839abd81-aef7-4365-8bd8-10d1583e81d3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:47:27.665303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-839abd81-aef7-4365-8bd8-10d1583e81d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:27.674385 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3138/6269] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:47:27.678602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2300c6-70dc-4af9-a6e4-5146a1257d51 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:27.691890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2300c6-70dc-4af9-a6e4-5146a1257d51 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:27.700552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8e216-60ee-4fa4-9371-59cb32e81809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:27.702212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8e216-60ee-4fa4-9371-59cb32e81809 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:27.703621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8e216-60ee-4fa4-9371-59cb32e81809 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:27.704158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8e216-60ee-4fa4-9371-59cb32e81809 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:27.712770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8e216-60ee-4fa4-9371-59cb32e81809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:47:27.713474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8e216-60ee-4fa4-9371-59cb32e81809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:27.715444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8e216-60ee-4fa4-9371-59cb32e81809 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:27.741455 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3132/6270] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:47:27.743390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839abd81-aef7-4365-8bd8-10d1583e81d3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:27.754500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839abd81-aef7-4365-8bd8-10d1583e81d3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:27.761536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b1aee-c878-48c8-9362-6b7ac75143fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:27.762644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b1aee-c878-48c8-9362-6b7ac75143fa admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:27.763302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b1aee-c878-48c8-9362-6b7ac75143fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:27.763813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b1aee-c878-48c8-9362-6b7ac75143fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:27.764735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b1aee-c878-48c8-9362-6b7ac75143fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:27.767011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b1aee-c878-48c8-9362-6b7ac75143fa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:27.783305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:47:27.820639 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3139/6271] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:47:27 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:47:27.824941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8e216-60ee-4fa4-9371-59cb32e81809 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:27.843694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8e216-60ee-4fa4-9371-59cb32e81809 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:27.994117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153842d3-2e48-41f9-bae9-182d6919ccfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:27.995131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153842d3-2e48-41f9-bae9-182d6919ccfb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:27.995443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153842d3-2e48-41f9-bae9-182d6919ccfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:27.995891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153842d3-2e48-41f9-bae9-182d6919ccfb admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:27.996623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153842d3-2e48-41f9-bae9-182d6919ccfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:27.998601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153842d3-2e48-41f9-bae9-182d6919ccfb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:28.033041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b1aee-c878-48c8-9362-6b7ac75143fa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:28.034063 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3133/6272] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:47:27 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:47:28.055632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b1aee-c878-48c8-9362-6b7ac75143fa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:28.063655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef9b3c-3d74-407f-a1b7-1ff386cb2df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:28.066994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef9b3c-3d74-407f-a1b7-1ff386cb2df4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:28.076450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef9b3c-3d74-407f-a1b7-1ff386cb2df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:28.076992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef9b3c-3d74-407f-a1b7-1ff386cb2df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:28.077790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef9b3c-3d74-407f-a1b7-1ff386cb2df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:28.083395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef9b3c-3d74-407f-a1b7-1ff386cb2df4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:28.112179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153842d3-2e48-41f9-bae9-182d6919ccfb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:28.114087 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3140/6273] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:47:28.130261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153842d3-2e48-41f9-bae9-182d6919ccfb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:28.137936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f4758-135b-41b8-95a2-79ec2f84dd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:28.138925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f4758-135b-41b8-95a2-79ec2f84dd33 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:28.139529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f4758-135b-41b8-95a2-79ec2f84dd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:28.140072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f4758-135b-41b8-95a2-79ec2f84dd33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:28.140989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f4758-135b-41b8-95a2-79ec2f84dd33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:28.143186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f4758-135b-41b8-95a2-79ec2f84dd33 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:28.163556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef9b3c-3d74-407f-a1b7-1ff386cb2df4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:28.170383 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3134/6274] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:47:28.192240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef9b3c-3d74-407f-a1b7-1ff386cb2df4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:28.200182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb6156-7026-49d0-919f-015f93f44697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:28.200969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb6156-7026-49d0-919f-015f93f44697 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:28.201320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb6156-7026-49d0-919f-015f93f44697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:28.201667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb6156-7026-49d0-919f-015f93f44697 admin admin] PATH_INFO: `/v3/projects/c9d47aeb47f846b2be70fd43db9ba509/users/f7c3119d4bed4f1b855f29c8f4cd6eb4/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:28.233323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb6156-7026-49d0-919f-015f93f44697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d47aeb47f846b2be70fd43db9ba509, user_id=f7c3119d4bed4f1b855f29c8f4cd6eb4, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:28.238141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb6156-7026-49d0-919f-015f93f44697 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:28.266145 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3141/6275] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:47:28 2022] PUT /identity/v3/projects/c9d47aeb47f846b2be70fd43db9ba509/users/f7c3119d4bed4f1b855f29c8f4cd6eb4/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:47:28.277540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb12e78-3750-40da-a404-86ff50018b6d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:28.278068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb12e78-3750-40da-a404-86ff50018b6d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:28.278434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb12e78-3750-40da-a404-86ff50018b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:28.360478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6cb12e78-3750-40da-a404-86ff50018b6d None None] MFA Rules not processed for user `f7c3119d4bed4f1b855f29c8f4cd6eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:47:28.362071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6cb12e78-3750-40da-a404-86ff50018b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:28.528859 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3135/6276] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:47:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:47:28.539968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb6156-7026-49d0-919f-015f93f44697 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:28.542356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-37bb6156-7026-49d0-919f-015f93f44697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:28.676362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb6156-7026-49d0-919f-015f93f44697 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:28.683643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b257-3d85-4ba7-b922-23488f107c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:28.684537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b257-3d85-4ba7-b922-23488f107c97 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:28.684962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b257-3d85-4ba7-b922-23488f107c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:28.685407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b257-3d85-4ba7-b922-23488f107c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:28.712031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2b257-3d85-4ba7-b922-23488f107c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:28.713517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2b257-3d85-4ba7-b922-23488f107c97 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:28.737364 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3142/6277] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:47:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:47:30.794939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb12e78-3750-40da-a404-86ff50018b6d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:30.815873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:47:31.027029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb12e78-3750-40da-a404-86ff50018b6d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:31.038087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5aab1-7660-4246-bb6f-24c905da6d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:31.038925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5aab1-7660-4246-bb6f-24c905da6d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:31.040819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5aab1-7660-4246-bb6f-24c905da6d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:31.041436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5aab1-7660-4246-bb6f-24c905da6d02 admin admin] PATH_INFO: `/v3/users/f7c3119d4bed4f1b855f29c8f4cd6eb4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:31.045139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5aab1-7660-4246-bb6f-24c905da6d02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c3119d4bed4f1b855f29c8f4cd6eb4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:31.059687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5aab1-7660-4246-bb6f-24c905da6d02 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:31.184017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06a5aab1-7660-4246-bb6f-24c905da6d02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c3119d4bed4f1b855f29c8f4cd6eb4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:31.189769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06a5aab1-7660-4246-bb6f-24c905da6d02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c3119d4bed4f1b855f29c8f4cd6eb4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:31.233114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06a5aab1-7660-4246-bb6f-24c905da6d02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c3119d4bed4f1b855f29c8f4cd6eb4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:31.264765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06a5aab1-7660-4246-bb6f-24c905da6d02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c3119d4bed4f1b855f29c8f4cd6eb4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:31.289145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06a5aab1-7660-4246-bb6f-24c905da6d02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c3119d4bed4f1b855f29c8f4cd6eb4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:31.306184 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3136/6278] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:47:30 2022] DELETE /identity/v3/users/f7c3119d4bed4f1b855f29c8f4cd6eb4 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:47:31.310699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260ae8f-85a6-4d79-ad7d-5b6551cfe60b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:31.311214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260ae8f-85a6-4d79-ad7d-5b6551cfe60b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:31.311214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260ae8f-85a6-4d79-ad7d-5b6551cfe60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:31.349191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f260ae8f-85a6-4d79-ad7d-5b6551cfe60b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:47:31.351935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f260ae8f-85a6-4d79-ad7d-5b6551cfe60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:31.504445 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3143/6279] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:47:31.527965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5aab1-7660-4246-bb6f-24c905da6d02 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:31.529468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-06a5aab1-7660-4246-bb6f-24c905da6d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:31.676636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5aab1-7660-4246-bb6f-24c905da6d02 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:31.684911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795f05e-da71-470a-bd7e-8d70909ee623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:31.685602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795f05e-da71-470a-bd7e-8d70909ee623 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:31.685886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795f05e-da71-470a-bd7e-8d70909ee623 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:31.686225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795f05e-da71-470a-bd7e-8d70909ee623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:31.706539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795f05e-da71-470a-bd7e-8d70909ee623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:31.708127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795f05e-da71-470a-bd7e-8d70909ee623 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:31.719954 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3137/6280] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:47:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:47:32.640253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260ae8f-85a6-4d79-ad7d-5b6551cfe60b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:32.641656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f260ae8f-85a6-4d79-ad7d-5b6551cfe60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:32.664952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260ae8f-85a6-4d79-ad7d-5b6551cfe60b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:32.673484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6465c-15a5-45de-8111-1c2835128de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:32.675180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6465c-15a5-45de-8111-1c2835128de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:32.676128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6465c-15a5-45de-8111-1c2835128de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:32.676607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6465c-15a5-45de-8111-1c2835128de2 admin admin] PATH_INFO: `/v3/projects/c9d47aeb47f846b2be70fd43db9ba509` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:32.678146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6465c-15a5-45de-8111-1c2835128de2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d47aeb47f846b2be70fd43db9ba509)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:32.681098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6465c-15a5-45de-8111-1c2835128de2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:32.781362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-41a6465c-15a5-45de-8111-1c2835128de2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d47aeb47f846b2be70fd43db9ba509', 'request_id': 'req-41a6465c-15a5-45de-8111-1c2835128de2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:32.791138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-41a6465c-15a5-45de-8111-1c2835128de2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d47aeb47f846b2be70fd43db9ba509', 'request_id': 'req-41a6465c-15a5-45de-8111-1c2835128de2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:32.792552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:47:32.803888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-41a6465c-15a5-45de-8111-1c2835128de2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d47aeb47f846b2be70fd43db9ba509', 'request_id': 'req-41a6465c-15a5-45de-8111-1c2835128de2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:32.826446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-41a6465c-15a5-45de-8111-1c2835128de2 admin admin] The token cache is being invalidate because project c9d47aeb47f846b2be70fd43db9ba509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:47:32.826744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-41a6465c-15a5-45de-8111-1c2835128de2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:32.828227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-41a6465c-15a5-45de-8111-1c2835128de2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:47:32.833383 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3144/6281] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:47:32 2022] DELETE /identity/v3/projects/c9d47aeb47f846b2be70fd43db9ba509 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:47:32.835696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1725bcc-a13f-4432-bf03-dcad0a7bf100 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:32.836419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1725bcc-a13f-4432-bf03-dcad0a7bf100 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:32.836419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1725bcc-a13f-4432-bf03-dcad0a7bf100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:32.870786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b1725bcc-a13f-4432-bf03-dcad0a7bf100 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:47:32.873472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b1725bcc-a13f-4432-bf03-dcad0a7bf100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:32.910039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:47:32.958637 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3138/6282] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:47:32.962003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b48ce0-a2ca-42fe-be8c-46a8a98aea59 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:32.962326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b48ce0-a2ca-42fe-be8c-46a8a98aea59 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:32.962635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b48ce0-a2ca-42fe-be8c-46a8a98aea59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:32.994795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d9b48ce0-a2ca-42fe-be8c-46a8a98aea59 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:47:32.997005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d9b48ce0-a2ca-42fe-be8c-46a8a98aea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:33.006738 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3145/6283] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:47:33.011042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1725bcc-a13f-4432-bf03-dcad0a7bf100 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:33.029750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1725bcc-a13f-4432-bf03-dcad0a7bf100 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:33.036712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069003c9-6cc8-4764-b5ef-c8cd8c3fc919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:33.037352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069003c9-6cc8-4764-b5ef-c8cd8c3fc919 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:33.037652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069003c9-6cc8-4764-b5ef-c8cd8c3fc919 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:33.037915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069003c9-6cc8-4764-b5ef-c8cd8c3fc919 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:33.038611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069003c9-6cc8-4764-b5ef-c8cd8c3fc919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:47:33.038878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069003c9-6cc8-4764-b5ef-c8cd8c3fc919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:33.040558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069003c9-6cc8-4764-b5ef-c8cd8c3fc919 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:33.055296 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3139/6284] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:47:33.060073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b48ce0-a2ca-42fe-be8c-46a8a98aea59 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:33.070049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b48ce0-a2ca-42fe-be8c-46a8a98aea59 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:33.076399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f277499-b374-4e11-ae33-2a2723d342f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:33.077261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f277499-b374-4e11-ae33-2a2723d342f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:33.077546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f277499-b374-4e11-ae33-2a2723d342f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:33.077829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f277499-b374-4e11-ae33-2a2723d342f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:33.078463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f277499-b374-4e11-ae33-2a2723d342f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:33.080453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f277499-b374-4e11-ae33-2a2723d342f0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:33.116697 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3146/6285] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:47:33 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:47:33.117841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069003c9-6cc8-4764-b5ef-c8cd8c3fc919 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:33.129267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069003c9-6cc8-4764-b5ef-c8cd8c3fc919 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:33.221892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ff2ac-1641-49b1-9f4a-046fbed0faf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:33.222617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ff2ac-1641-49b1-9f4a-046fbed0faf2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:33.222965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ff2ac-1641-49b1-9f4a-046fbed0faf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:33.223355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ff2ac-1641-49b1-9f4a-046fbed0faf2 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:33.224125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ff2ac-1641-49b1-9f4a-046fbed0faf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:33.226913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ff2ac-1641-49b1-9f4a-046fbed0faf2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:33.261497 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3140/6286] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:47:33 2022] POST /identity/v3/users => generated 282 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:47:33.266299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f277499-b374-4e11-ae33-2a2723d342f0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:33.281860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f277499-b374-4e11-ae33-2a2723d342f0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:33.287728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e33253-06a2-490f-8767-2ac4179dab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:33.289029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e33253-06a2-490f-8767-2ac4179dab30 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:33.289427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e33253-06a2-490f-8767-2ac4179dab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:33.289835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e33253-06a2-490f-8767-2ac4179dab30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:33.290603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e33253-06a2-490f-8767-2ac4179dab30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:33.292457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e33253-06a2-490f-8767-2ac4179dab30 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:33.306186 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3147/6287] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:47:33.311131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ff2ac-1641-49b1-9f4a-046fbed0faf2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:33.325779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ff2ac-1641-49b1-9f4a-046fbed0faf2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:33.331957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b27c86-1668-4d9e-8b42-21a5b28ac8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:33.332726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b27c86-1668-4d9e-8b42-21a5b28ac8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:33.333837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b27c86-1668-4d9e-8b42-21a5b28ac8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:33.334291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b27c86-1668-4d9e-8b42-21a5b28ac8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:33.335149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b27c86-1668-4d9e-8b42-21a5b28ac8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:33.337002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b27c86-1668-4d9e-8b42-21a5b28ac8c5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:33.374198 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3141/6288] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:47:33.376248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e33253-06a2-490f-8767-2ac4179dab30 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:33.388609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e33253-06a2-490f-8767-2ac4179dab30 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:33.394788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f60bb-a874-4c9f-8d49-fa1b824cfa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:33.395676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f60bb-a874-4c9f-8d49-fa1b824cfa5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:33.396035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f60bb-a874-4c9f-8d49-fa1b824cfa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:33.396441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f60bb-a874-4c9f-8d49-fa1b824cfa5f admin admin] PATH_INFO: `/v3/projects/da4d40ee9cf941248ffceb2a4448a73c/users/f85cbb2c929e4f949c57e1331e046464/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:33.427024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f60bb-a874-4c9f-8d49-fa1b824cfa5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4d40ee9cf941248ffceb2a4448a73c, user_id=f85cbb2c929e4f949c57e1331e046464, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:33.431007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f60bb-a874-4c9f-8d49-fa1b824cfa5f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:33.467963 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3148/6289] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:47:33 2022] PUT /identity/v3/projects/da4d40ee9cf941248ffceb2a4448a73c/users/f85cbb2c929e4f949c57e1331e046464/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:47:33.469143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fa7d4-956f-4b6d-a94e-c6b1879785c5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:33.469589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fa7d4-956f-4b6d-a94e-c6b1879785c5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:33.469915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fa7d4-956f-4b6d-a94e-c6b1879785c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:33.587768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0b3fa7d4-956f-4b6d-a94e-c6b1879785c5 None None] MFA Rules not processed for user `f85cbb2c929e4f949c57e1331e046464`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:47:33.610359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0b3fa7d4-956f-4b6d-a94e-c6b1879785c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:33.816908 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3142/6290] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:47:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:47:33.894952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f60bb-a874-4c9f-8d49-fa1b824cfa5f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:33.896817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a48f60bb-a874-4c9f-8d49-fa1b824cfa5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:33.976765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffc78c-9cd7-4331-a477-cd49cfd30a0c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:33.977259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffc78c-9cd7-4331-a477-cd49cfd30a0c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:33.977336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffc78c-9cd7-4331-a477-cd49cfd30a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:34.012739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-55ffc78c-9cd7-4331-a477-cd49cfd30a0c None None] MFA Rules not processed for user `8ed50d414dc14715bfdade9ce2e7ee52`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:47:34.014585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-55ffc78c-9cd7-4331-a477-cd49cfd30a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:34.069810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f60bb-a874-4c9f-8d49-fa1b824cfa5f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:34.078501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6f376-b5aa-4bdd-be01-708fc87d5cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:34.080268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6f376-b5aa-4bdd-be01-708fc87d5cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:34.080620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6f376-b5aa-4bdd-be01-708fc87d5cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:34.081241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:47:34.083140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6f376-b5aa-4bdd-be01-708fc87d5cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:34.105179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6f376-b5aa-4bdd-be01-708fc87d5cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:34.106841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6f376-b5aa-4bdd-be01-708fc87d5cc2 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:34.132095 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3149/6291] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:47:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:47:34.132991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6f376-b5aa-4bdd-be01-708fc87d5cc2 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:34.132991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e4e6f376-b5aa-4bdd-be01-708fc87d5cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:34.172729 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3143/6292] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:47:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:47:34.240465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6f376-b5aa-4bdd-be01-708fc87d5cc2 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:34.260208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb23c6d-301d-4ac8-abf2-a4aa1cb07701 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:34.260509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb23c6d-301d-4ac8-abf2-a4aa1cb07701 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:34.261001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb23c6d-301d-4ac8-abf2-a4aa1cb07701 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:34.261461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb23c6d-301d-4ac8-abf2-a4aa1cb07701 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:34.264954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5cb23c6d-301d-4ac8-abf2-a4aa1cb07701 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:34.315712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:47:34.382045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb23c6d-301d-4ac8-abf2-a4aa1cb07701 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:34.383806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb23c6d-301d-4ac8-abf2-a4aa1cb07701 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:34.395216 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3150/6293] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:47:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:47:36.641646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855903bc-1a7e-411f-812a-6bb0efef404e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:36.642205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855903bc-1a7e-411f-812a-6bb0efef404e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:36.642205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855903bc-1a7e-411f-812a-6bb0efef404e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:36.690130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-855903bc-1a7e-411f-812a-6bb0efef404e None None] MFA Rules not processed for user `185b4855098e46449a5b3e44339e51f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:47:36.694830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-855903bc-1a7e-411f-812a-6bb0efef404e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:36.913084 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3144/6294] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:47:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:47:40.848878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb23c6d-301d-4ac8-abf2-a4aa1cb07701 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:47:40.851690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5cb23c6d-301d-4ac8-abf2-a4aa1cb07701 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:41.007026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb23c6d-301d-4ac8-abf2-a4aa1cb07701 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:47:41.017633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0644e5-8cc2-42fd-a059-6a821a009a36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:47:41.018731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0644e5-8cc2-42fd-a059-6a821a009a36 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:41.018972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0644e5-8cc2-42fd-a059-6a821a009a36 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:41.019395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0644e5-8cc2-42fd-a059-6a821a009a36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:41.021282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ac0644e5-8cc2-42fd-a059-6a821a009a36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:41.040961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0644e5-8cc2-42fd-a059-6a821a009a36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:47:41.045986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0644e5-8cc2-42fd-a059-6a821a009a36 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:47:41.068027 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3151/6295] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:47:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:47:42.951813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396277f8-5608-4514-b595-7aace0111666 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:47:42.952377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396277f8-5608-4514-b595-7aace0111666 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:47:42.952377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396277f8-5608-4514-b595-7aace0111666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:47:42.999793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-396277f8-5608-4514-b595-7aace0111666 None None] MFA Rules not processed for user `afdf62f3cae74b359622eb3bb55f43d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:47:43.023594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-396277f8-5608-4514-b595-7aace0111666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:47:43.163005 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3145/6296] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:47:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:47:51.059328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=45 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:47:53.146232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=63 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:48:18.124375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64924faa-6a1d-4a98-ae41-3f1e2f5d41f9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:18.125183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64924faa-6a1d-4a98-ae41-3f1e2f5d41f9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:18.125183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64924faa-6a1d-4a98-ae41-3f1e2f5d41f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:18.167485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-64924faa-6a1d-4a98-ae41-3f1e2f5d41f9 None None] MFA Rules not processed for user `185b4855098e46449a5b3e44339e51f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:48:18.168741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-64924faa-6a1d-4a98-ae41-3f1e2f5d41f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:18.193318 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3152/6297] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:48:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:48:19.380780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396277f8-5608-4514-b595-7aace0111666 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:19.397680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396277f8-5608-4514-b595-7aace0111666 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:19.416160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9f167-cdd3-49c1-866a-3c12da140bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:19.416923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f167-cdd3-49c1-866a-3c12da140bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:19.417471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f167-cdd3-49c1-866a-3c12da140bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:19.417760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f167-cdd3-49c1-866a-3c12da140bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:19.424172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-66b9f167-cdd3-49c1-866a-3c12da140bf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:19.514214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9f167-cdd3-49c1-866a-3c12da140bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:19.516051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9f167-cdd3-49c1-866a-3c12da140bf6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:19.538414 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3146/6298] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:48:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:48:28.146319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:48:29.422559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64924faa-6a1d-4a98-ae41-3f1e2f5d41f9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:29.424167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-64924faa-6a1d-4a98-ae41-3f1e2f5d41f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:29.530017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=11 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:48:29.535628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64924faa-6a1d-4a98-ae41-3f1e2f5d41f9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:29.540737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779af28-4f68-4972-ad34-aadabc308ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:29.541851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779af28-4f68-4972-ad34-aadabc308ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:29.542306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779af28-4f68-4972-ad34-aadabc308ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:29.542820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779af28-4f68-4972-ad34-aadabc308ec4 admin admin] PATH_INFO: `/v3/users/2d92472b75b14465ada9c03d018d188c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:29.544740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779af28-4f68-4972-ad34-aadabc308ec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d92472b75b14465ada9c03d018d188c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:29.546952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779af28-4f68-4972-ad34-aadabc308ec4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:29.616714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f779af28-4f68-4972-ad34-aadabc308ec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d92472b75b14465ada9c03d018d188c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:29.633157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f779af28-4f68-4972-ad34-aadabc308ec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d92472b75b14465ada9c03d018d188c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:29.634485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f779af28-4f68-4972-ad34-aadabc308ec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d92472b75b14465ada9c03d018d188c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:29.635534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f779af28-4f68-4972-ad34-aadabc308ec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d92472b75b14465ada9c03d018d188c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:29.649354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f779af28-4f68-4972-ad34-aadabc308ec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d92472b75b14465ada9c03d018d188c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:29.663859 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3153/6299] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:48:29 2022] DELETE /identity/v3/users/2d92472b75b14465ada9c03d018d188c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:48:30.337728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9f167-cdd3-49c1-866a-3c12da140bf6 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:30.350219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9f167-cdd3-49c1-866a-3c12da140bf6 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:30.465654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2902f36-8ad5-47bb-91e7-e4e053bffa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:30.466215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2902f36-8ad5-47bb-91e7-e4e053bffa59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:30.466552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2902f36-8ad5-47bb-91e7-e4e053bffa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:30.466828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2902f36-8ad5-47bb-91e7-e4e053bffa59 admin admin] PATH_INFO: `/v3/projects/d7f58a04d92d4323aeed898f4b940689` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:30.468015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2902f36-8ad5-47bb-91e7-e4e053bffa59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f58a04d92d4323aeed898f4b940689)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:30.471085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2902f36-8ad5-47bb-91e7-e4e053bffa59 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:30.531654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e2902f36-8ad5-47bb-91e7-e4e053bffa59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f58a04d92d4323aeed898f4b940689', 'request_id': 'req-e2902f36-8ad5-47bb-91e7-e4e053bffa59'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:30.543215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e2902f36-8ad5-47bb-91e7-e4e053bffa59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f58a04d92d4323aeed898f4b940689', 'request_id': 'req-e2902f36-8ad5-47bb-91e7-e4e053bffa59'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:30.577696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e2902f36-8ad5-47bb-91e7-e4e053bffa59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f58a04d92d4323aeed898f4b940689', 'request_id': 'req-e2902f36-8ad5-47bb-91e7-e4e053bffa59'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:30.608173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e2902f36-8ad5-47bb-91e7-e4e053bffa59 admin admin] The token cache is being invalidate because project d7f58a04d92d4323aeed898f4b940689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:48:30.608869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e2902f36-8ad5-47bb-91e7-e4e053bffa59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:30.610777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e2902f36-8ad5-47bb-91e7-e4e053bffa59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:30.620681 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3147/6300] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:48:30 2022] DELETE /identity/v3/projects/d7f58a04d92d4323aeed898f4b940689 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:48:30.621959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779af28-4f68-4972-ad34-aadabc308ec4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:30.623488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f779af28-4f68-4972-ad34-aadabc308ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:30.697885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779af28-4f68-4972-ad34-aadabc308ec4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:30.813599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7e321-0815-4355-abb6-d093b8c18db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:30.815383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7e321-0815-4355-abb6-d093b8c18db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:30.815822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7e321-0815-4355-abb6-d093b8c18db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:30.816390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7e321-0815-4355-abb6-d093b8c18db8 admin admin] PATH_INFO: `/v3/users/ffb740fc3bc84d1b97a59c0aeb193776` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:30.818040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7e321-0815-4355-abb6-d093b8c18db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffb740fc3bc84d1b97a59c0aeb193776)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:30.820642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7e321-0815-4355-abb6-d093b8c18db8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:30.851318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:48:30.893698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-93a7e321-0815-4355-abb6-d093b8c18db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffb740fc3bc84d1b97a59c0aeb193776'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:30.915621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-93a7e321-0815-4355-abb6-d093b8c18db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffb740fc3bc84d1b97a59c0aeb193776'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:30.916927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-93a7e321-0815-4355-abb6-d093b8c18db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffb740fc3bc84d1b97a59c0aeb193776'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:30.917746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-93a7e321-0815-4355-abb6-d093b8c18db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffb740fc3bc84d1b97a59c0aeb193776'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:30.935863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-93a7e321-0815-4355-abb6-d093b8c18db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffb740fc3bc84d1b97a59c0aeb193776'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:30.966749 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3154/6301] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:48:30 2022] DELETE /identity/v3/users/ffb740fc3bc84d1b97a59c0aeb193776 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:48:31.508658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2902f36-8ad5-47bb-91e7-e4e053bffa59 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:31.510246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e2902f36-8ad5-47bb-91e7-e4e053bffa59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:31.536008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2902f36-8ad5-47bb-91e7-e4e053bffa59 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:31.669372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc027b3-dccc-4f2e-9d15-f30b0d495498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:31.670262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc027b3-dccc-4f2e-9d15-f30b0d495498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:31.670648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc027b3-dccc-4f2e-9d15-f30b0d495498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:31.671028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc027b3-dccc-4f2e-9d15-f30b0d495498 admin admin] PATH_INFO: `/v3/projects/6ce2dc932fc34c1c8c4b23eeced19acd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:31.675235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc027b3-dccc-4f2e-9d15-f30b0d495498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce2dc932fc34c1c8c4b23eeced19acd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:31.677445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc027b3-dccc-4f2e-9d15-f30b0d495498 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:31.770135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:48:31.793961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1bc027b3-dccc-4f2e-9d15-f30b0d495498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce2dc932fc34c1c8c4b23eeced19acd', 'request_id': 'req-1bc027b3-dccc-4f2e-9d15-f30b0d495498'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:31.813678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1bc027b3-dccc-4f2e-9d15-f30b0d495498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce2dc932fc34c1c8c4b23eeced19acd', 'request_id': 'req-1bc027b3-dccc-4f2e-9d15-f30b0d495498'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:31.822030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1bc027b3-dccc-4f2e-9d15-f30b0d495498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce2dc932fc34c1c8c4b23eeced19acd', 'request_id': 'req-1bc027b3-dccc-4f2e-9d15-f30b0d495498'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:31.837884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1bc027b3-dccc-4f2e-9d15-f30b0d495498 admin admin] The token cache is being invalidate because project 6ce2dc932fc34c1c8c4b23eeced19acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:48:31.838443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1bc027b3-dccc-4f2e-9d15-f30b0d495498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:31.839338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1bc027b3-dccc-4f2e-9d15-f30b0d495498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:31.841285 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3148/6302] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:48:31 2022] DELETE /identity/v3/projects/6ce2dc932fc34c1c8c4b23eeced19acd => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:48:31.846371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d379-40b4-43db-a72a-97e09ec8546f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:31.846880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d379-40b4-43db-a72a-97e09ec8546f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:31.847081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d379-40b4-43db-a72a-97e09ec8546f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:31.901024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bc46d379-40b4-43db-a72a-97e09ec8546f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:48:31.902415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bc46d379-40b4-43db-a72a-97e09ec8546f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:32.092948 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3155/6303] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:48:32.101882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd4706-da1e-4138-8250-720851a05b02 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:32.103062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd4706-da1e-4138-8250-720851a05b02 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:32.103062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd4706-da1e-4138-8250-720851a05b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:32.148316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b9cd4706-da1e-4138-8250-720851a05b02 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:48:32.152459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b9cd4706-da1e-4138-8250-720851a05b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:32.174256 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3149/6304] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:48:32.175210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46d379-40b4-43db-a72a-97e09ec8546f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:32.193445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46d379-40b4-43db-a72a-97e09ec8546f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:32.199798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e36ca3-f84e-453e-8366-eaed763c0313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:32.201548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e36ca3-f84e-453e-8366-eaed763c0313 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:32.203026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e36ca3-f84e-453e-8366-eaed763c0313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:32.203354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e36ca3-f84e-453e-8366-eaed763c0313 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:32.204637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e36ca3-f84e-453e-8366-eaed763c0313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:48:32.204950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e36ca3-f84e-453e-8366-eaed763c0313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:32.206721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e36ca3-f84e-453e-8366-eaed763c0313 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:32.266020 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3156/6305] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:48:32.270680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd4706-da1e-4138-8250-720851a05b02 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:32.288758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd4706-da1e-4138-8250-720851a05b02 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:32.305160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63046-a337-4da8-99d2-d65efddc5f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:32.306992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63046-a337-4da8-99d2-d65efddc5f82 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:32.307210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63046-a337-4da8-99d2-d65efddc5f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:32.312024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63046-a337-4da8-99d2-d65efddc5f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:32.312719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e63046-a337-4da8-99d2-d65efddc5f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:32.314669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e63046-a337-4da8-99d2-d65efddc5f82 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:32.394033 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3150/6306] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:48:32 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:48:32.399168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e36ca3-f84e-453e-8366-eaed763c0313 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:32.413172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e36ca3-f84e-453e-8366-eaed763c0313 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:32.496146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91727e1-a4bf-4653-a836-c7859fd60bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:32.497617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91727e1-a4bf-4653-a836-c7859fd60bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:32.498030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91727e1-a4bf-4653-a836-c7859fd60bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:32.498388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91727e1-a4bf-4653-a836-c7859fd60bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:32.499280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91727e1-a4bf-4653-a836-c7859fd60bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:32.502147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91727e1-a4bf-4653-a836-c7859fd60bc9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:32.541014 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3157/6307] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:48:32 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:48:32.542284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63046-a337-4da8-99d2-d65efddc5f82 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:32.555988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63046-a337-4da8-99d2-d65efddc5f82 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:32.561943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b5413-c019-4a9c-8d37-7ef8cbd59735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:32.562900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b5413-c019-4a9c-8d37-7ef8cbd59735 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:32.563341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b5413-c019-4a9c-8d37-7ef8cbd59735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:32.563772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b5413-c019-4a9c-8d37-7ef8cbd59735 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:32.564573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b5413-c019-4a9c-8d37-7ef8cbd59735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:32.566487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b5413-c019-4a9c-8d37-7ef8cbd59735 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:32.583769 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3151/6308] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:48:32.584695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91727e1-a4bf-4653-a836-c7859fd60bc9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:32.611278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91727e1-a4bf-4653-a836-c7859fd60bc9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:32.617219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6502529-b2c6-4948-b39f-1e0763a55787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:32.618258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6502529-b2c6-4948-b39f-1e0763a55787 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:32.619584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6502529-b2c6-4948-b39f-1e0763a55787 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:32.620010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6502529-b2c6-4948-b39f-1e0763a55787 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:32.621205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6502529-b2c6-4948-b39f-1e0763a55787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:32.623025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6502529-b2c6-4948-b39f-1e0763a55787 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:32.651721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b5413-c019-4a9c-8d37-7ef8cbd59735 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:32.666262 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3158/6309] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:48:32.667371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b5413-c019-4a9c-8d37-7ef8cbd59735 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:32.702587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185d682-780e-4352-af4f-b3db6157e522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:32.705734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185d682-780e-4352-af4f-b3db6157e522 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:32.706201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185d682-780e-4352-af4f-b3db6157e522 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:32.706658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185d682-780e-4352-af4f-b3db6157e522 admin admin] PATH_INFO: `/v3/projects/4d3af9ec6252477ab784adb053383a91/users/86ea85655b3445139096b436125aff5e/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:32.731126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185d682-780e-4352-af4f-b3db6157e522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d3af9ec6252477ab784adb053383a91, user_id=86ea85655b3445139096b436125aff5e, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:32.746247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185d682-780e-4352-af4f-b3db6157e522 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:32.769437 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3152/6310] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:48:32 2022] PUT /identity/v3/projects/4d3af9ec6252477ab784adb053383a91/users/86ea85655b3445139096b436125aff5e/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:48:32.781294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570d36d-cb44-46ac-8478-ff7a26ac49b4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:32.781577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570d36d-cb44-46ac-8478-ff7a26ac49b4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:32.781851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570d36d-cb44-46ac-8478-ff7a26ac49b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:32.800297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:48:32.864985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d570d36d-cb44-46ac-8478-ff7a26ac49b4 None None] MFA Rules not processed for user `86ea85655b3445139096b436125aff5e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:48:32.869210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d570d36d-cb44-46ac-8478-ff7a26ac49b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:33.010233 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3159/6311] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:48:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:48:33.014836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185d682-780e-4352-af4f-b3db6157e522 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:33.126276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185d682-780e-4352-af4f-b3db6157e522 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:33.134067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330239dd-ddf5-49a3-a481-3f02d8e3f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:33.134945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330239dd-ddf5-49a3-a481-3f02d8e3f018 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:33.135494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330239dd-ddf5-49a3-a481-3f02d8e3f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:33.136232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330239dd-ddf5-49a3-a481-3f02d8e3f018 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:33.137078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330239dd-ddf5-49a3-a481-3f02d8e3f018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:33.139466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330239dd-ddf5-49a3-a481-3f02d8e3f018 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:33.176751 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3153/6312] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:48:33 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:48:33.181882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570d36d-cb44-46ac-8478-ff7a26ac49b4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:33.201179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570d36d-cb44-46ac-8478-ff7a26ac49b4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:33.287931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08c643-105f-4884-8969-f459ee4e9edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:33.288729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08c643-105f-4884-8969-f459ee4e9edd admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:33.289077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08c643-105f-4884-8969-f459ee4e9edd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:33.290032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08c643-105f-4884-8969-f459ee4e9edd admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:33.290182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08c643-105f-4884-8969-f459ee4e9edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:33.292786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08c643-105f-4884-8969-f459ee4e9edd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:33.326045 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3160/6313] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:48:33 2022] POST /identity/v3/users => generated 298 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:48:33.330091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330239dd-ddf5-49a3-a481-3f02d8e3f018 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:33.340927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330239dd-ddf5-49a3-a481-3f02d8e3f018 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:33.346427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df175f66-f765-4762-93f1-5aafa8de55ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:33.346893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df175f66-f765-4762-93f1-5aafa8de55ab admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:33.347168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df175f66-f765-4762-93f1-5aafa8de55ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:33.347469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df175f66-f765-4762-93f1-5aafa8de55ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:33.348115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df175f66-f765-4762-93f1-5aafa8de55ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:33.349724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df175f66-f765-4762-93f1-5aafa8de55ab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:33.364499 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3154/6314] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:48:33.365694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08c643-105f-4884-8969-f459ee4e9edd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:33.376055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08c643-105f-4884-8969-f459ee4e9edd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:33.380728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf5b0a-e81b-48bb-b34f-b905c3f61353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:33.381506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf5b0a-e81b-48bb-b34f-b905c3f61353 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:33.381894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf5b0a-e81b-48bb-b34f-b905c3f61353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:33.382270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf5b0a-e81b-48bb-b34f-b905c3f61353 admin admin] PATH_INFO: `/v3/projects/c9413db186894864a6c6aec086063445/users/f72de09edc1449899667cb6abc5bfe89/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:33.399611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf5b0a-e81b-48bb-b34f-b905c3f61353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9413db186894864a6c6aec086063445, user_id=f72de09edc1449899667cb6abc5bfe89, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:33.402507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf5b0a-e81b-48bb-b34f-b905c3f61353 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:33.420019 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3161/6315] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:48:33 2022] PUT /identity/v3/projects/c9413db186894864a6c6aec086063445/users/f72de09edc1449899667cb6abc5bfe89/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:48:33.423834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df175f66-f765-4762-93f1-5aafa8de55ab admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:33.435050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df175f66-f765-4762-93f1-5aafa8de55ab admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:33.466754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:48:33.500869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ce6b2-1bb9-45ba-b089-20881ecac373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:33.501525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ce6b2-1bb9-45ba-b089-20881ecac373 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:33.501810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ce6b2-1bb9-45ba-b089-20881ecac373 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:33.502091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ce6b2-1bb9-45ba-b089-20881ecac373 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:33.502745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ce6b2-1bb9-45ba-b089-20881ecac373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:33.504407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ce6b2-1bb9-45ba-b089-20881ecac373 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:33.515585 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3155/6316] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:48:33.519812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf5b0a-e81b-48bb-b34f-b905c3f61353 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:33.531569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf5b0a-e81b-48bb-b34f-b905c3f61353 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:33.537392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42381609-3bbc-4762-8b97-fba48f681850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:33.538063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42381609-3bbc-4762-8b97-fba48f681850 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:33.538399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42381609-3bbc-4762-8b97-fba48f681850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:33.538697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42381609-3bbc-4762-8b97-fba48f681850 admin admin] PATH_INFO: `/v3/projects/c9413db186894864a6c6aec086063445/users/f72de09edc1449899667cb6abc5bfe89/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:33.545948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42381609-3bbc-4762-8b97-fba48f681850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9413db186894864a6c6aec086063445, user_id=f72de09edc1449899667cb6abc5bfe89, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:33.549197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42381609-3bbc-4762-8b97-fba48f681850 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:33.575991 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3162/6317] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:48:33 2022] PUT /identity/v3/projects/c9413db186894864a6c6aec086063445/users/f72de09edc1449899667cb6abc5bfe89/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:48:33.587323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff23c18-9048-486c-8b24-a2490685814c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:33.588594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff23c18-9048-486c-8b24-a2490685814c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:33.589106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff23c18-9048-486c-8b24-a2490685814c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:33.624269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fff23c18-9048-486c-8b24-a2490685814c None None] MFA Rules not processed for user `f72de09edc1449899667cb6abc5bfe89`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:48:33.626097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fff23c18-9048-486c-8b24-a2490685814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:33.733919 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3156/6318] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:48:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:48:33.743828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42381609-3bbc-4762-8b97-fba48f681850 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:33.746464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-42381609-3bbc-4762-8b97-fba48f681850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:33.849124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:48:33.861730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42381609-3bbc-4762-8b97-fba48f681850 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:33.870961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b6cb9-00e2-4bec-9e8a-fa3469867e2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:33.873018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b6cb9-00e2-4bec-9e8a-fa3469867e2d service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:33.874371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b6cb9-00e2-4bec-9e8a-fa3469867e2d service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:33.876045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b6cb9-00e2-4bec-9e8a-fa3469867e2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:34.023146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b6cb9-00e2-4bec-9e8a-fa3469867e2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:34.025929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b6cb9-00e2-4bec-9e8a-fa3469867e2d service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:34.071357 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3163/6319] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:48:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:48:39.970117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff23c18-9048-486c-8b24-a2490685814c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:39.979192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fff23c18-9048-486c-8b24-a2490685814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:40.118079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff23c18-9048-486c-8b24-a2490685814c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:40.123797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d8896-70b7-41da-afe2-f8f0aa6b7802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:40.124772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d8896-70b7-41da-afe2-f8f0aa6b7802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:40.125120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d8896-70b7-41da-afe2-f8f0aa6b7802 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:40.125456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d8896-70b7-41da-afe2-f8f0aa6b7802 admin admin] PATH_INFO: `/v3/users/a64e87750d1c41008e5ba2c485a52b81` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:40.126813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d8896-70b7-41da-afe2-f8f0aa6b7802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64e87750d1c41008e5ba2c485a52b81)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:40.128910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d8896-70b7-41da-afe2-f8f0aa6b7802 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:40.211462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d3d8896-70b7-41da-afe2-f8f0aa6b7802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64e87750d1c41008e5ba2c485a52b81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:40.215820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d3d8896-70b7-41da-afe2-f8f0aa6b7802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64e87750d1c41008e5ba2c485a52b81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:40.224902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:48:40.228550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d3d8896-70b7-41da-afe2-f8f0aa6b7802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64e87750d1c41008e5ba2c485a52b81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:40.257731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d3d8896-70b7-41da-afe2-f8f0aa6b7802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64e87750d1c41008e5ba2c485a52b81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:40.287905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d3d8896-70b7-41da-afe2-f8f0aa6b7802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64e87750d1c41008e5ba2c485a52b81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:40.295811 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3157/6320] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:48:39 2022] DELETE /identity/v3/users/a64e87750d1c41008e5ba2c485a52b81 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:48:40.300422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835f7b5-6565-4477-9973-080df11a5519 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:40.300900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835f7b5-6565-4477-9973-080df11a5519 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:40.301137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835f7b5-6565-4477-9973-080df11a5519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:40.324120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0835f7b5-6565-4477-9973-080df11a5519 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:48:40.325553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0835f7b5-6565-4477-9973-080df11a5519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:40.415281 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3164/6321] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:48:40.425821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d8896-70b7-41da-afe2-f8f0aa6b7802 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:40.428241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d3d8896-70b7-41da-afe2-f8f0aa6b7802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:40.614462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d8896-70b7-41da-afe2-f8f0aa6b7802 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:40.625497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5292bb7-0fc7-432b-a1bb-0c2c5bc6fff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:40.626340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5292bb7-0fc7-432b-a1bb-0c2c5bc6fff7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:40.628269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5292bb7-0fc7-432b-a1bb-0c2c5bc6fff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:40.629183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5292bb7-0fc7-432b-a1bb-0c2c5bc6fff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:40.654955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5292bb7-0fc7-432b-a1bb-0c2c5bc6fff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:40.656792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5292bb7-0fc7-432b-a1bb-0c2c5bc6fff7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:40.715740 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3158/6322] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:48:41.057937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835f7b5-6565-4477-9973-080df11a5519 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:41.059571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0835f7b5-6565-4477-9973-080df11a5519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:41.112002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835f7b5-6565-4477-9973-080df11a5519 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:41.121554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c232ba3-104e-4d62-a8d3-6ec42aba6e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:41.122757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c232ba3-104e-4d62-a8d3-6ec42aba6e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:41.123104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c232ba3-104e-4d62-a8d3-6ec42aba6e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:41.123685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c232ba3-104e-4d62-a8d3-6ec42aba6e45 admin admin] PATH_INFO: `/v3/projects/556dfc764e3747188a1b26380873fed1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:41.125914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c232ba3-104e-4d62-a8d3-6ec42aba6e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=556dfc764e3747188a1b26380873fed1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:41.127943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c232ba3-104e-4d62-a8d3-6ec42aba6e45 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:41.209422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7c232ba3-104e-4d62-a8d3-6ec42aba6e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '556dfc764e3747188a1b26380873fed1', 'request_id': 'req-7c232ba3-104e-4d62-a8d3-6ec42aba6e45'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:41.218243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7c232ba3-104e-4d62-a8d3-6ec42aba6e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '556dfc764e3747188a1b26380873fed1', 'request_id': 'req-7c232ba3-104e-4d62-a8d3-6ec42aba6e45'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:41.226007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7c232ba3-104e-4d62-a8d3-6ec42aba6e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '556dfc764e3747188a1b26380873fed1', 'request_id': 'req-7c232ba3-104e-4d62-a8d3-6ec42aba6e45'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:41.247824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7c232ba3-104e-4d62-a8d3-6ec42aba6e45 admin admin] The token cache is being invalidate because project 556dfc764e3747188a1b26380873fed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:48:41.248607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7c232ba3-104e-4d62-a8d3-6ec42aba6e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:41.249419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7c232ba3-104e-4d62-a8d3-6ec42aba6e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:41.256875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491942b-2a7e-40db-95cf-0ca118ac0928 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:41.257451 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3165/6323] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:48:41 2022] DELETE /identity/v3/projects/556dfc764e3747188a1b26380873fed1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:48:41.261360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491942b-2a7e-40db-95cf-0ca118ac0928 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:41.261709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491942b-2a7e-40db-95cf-0ca118ac0928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:41.306175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5491942b-2a7e-40db-95cf-0ca118ac0928 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:48:41.307776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5491942b-2a7e-40db-95cf-0ca118ac0928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:41.463433 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3159/6324] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:48:41.470902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e7077-bfa4-4fab-9261-ec9074d43e2d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:41.471740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e7077-bfa4-4fab-9261-ec9074d43e2d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:41.472157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e7077-bfa4-4fab-9261-ec9074d43e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:41.513257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1e4e7077-bfa4-4fab-9261-ec9074d43e2d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:48:41.516293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1e4e7077-bfa4-4fab-9261-ec9074d43e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:41.542695 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3166/6325] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:48:41.563678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491942b-2a7e-40db-95cf-0ca118ac0928 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:41.586761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491942b-2a7e-40db-95cf-0ca118ac0928 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:41.603162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a808d-aa1e-4256-87ea-21b4e0a0bc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:41.604863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a808d-aa1e-4256-87ea-21b4e0a0bc20 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:41.604996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a808d-aa1e-4256-87ea-21b4e0a0bc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:41.605236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a808d-aa1e-4256-87ea-21b4e0a0bc20 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:41.605913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a808d-aa1e-4256-87ea-21b4e0a0bc20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:48:41.606219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a808d-aa1e-4256-87ea-21b4e0a0bc20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:41.613257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a808d-aa1e-4256-87ea-21b4e0a0bc20 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:41.656203 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3160/6326] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:48:41.660621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e7077-bfa4-4fab-9261-ec9074d43e2d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:41.673931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e7077-bfa4-4fab-9261-ec9074d43e2d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:41.679372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39afac-81cf-4fcb-a5f9-9207ef40c31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:41.680260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39afac-81cf-4fcb-a5f9-9207ef40c31e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:41.680710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39afac-81cf-4fcb-a5f9-9207ef40c31e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:41.681421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39afac-81cf-4fcb-a5f9-9207ef40c31e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:41.682246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39afac-81cf-4fcb-a5f9-9207ef40c31e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:41.684577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39afac-81cf-4fcb-a5f9-9207ef40c31e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:41.720066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:48:41.740074 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3167/6327] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:48:41 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:48:41.743937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a808d-aa1e-4256-87ea-21b4e0a0bc20 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:41.763151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a808d-aa1e-4256-87ea-21b4e0a0bc20 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:41.872792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f0960-b72b-41b9-8654-18c2c4f9361b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:41.873816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f0960-b72b-41b9-8654-18c2c4f9361b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:41.874096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f0960-b72b-41b9-8654-18c2c4f9361b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:41.874445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f0960-b72b-41b9-8654-18c2c4f9361b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:41.875099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f0960-b72b-41b9-8654-18c2c4f9361b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:41.877905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f0960-b72b-41b9-8654-18c2c4f9361b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:41.892537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:48:41.917755 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3161/6328] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:48:41 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:48:41.922341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39afac-81cf-4fcb-a5f9-9207ef40c31e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:41.934053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39afac-81cf-4fcb-a5f9-9207ef40c31e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:41.939862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caf073-f06a-4790-a1a4-54dcaf5fa21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:41.942362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf073-f06a-4790-a1a4-54dcaf5fa21c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:41.942801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf073-f06a-4790-a1a4-54dcaf5fa21c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:41.943546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf073-f06a-4790-a1a4-54dcaf5fa21c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:41.944362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caf073-f06a-4790-a1a4-54dcaf5fa21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:41.950082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caf073-f06a-4790-a1a4-54dcaf5fa21c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:41.983785 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3168/6329] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:48:41.988037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f0960-b72b-41b9-8654-18c2c4f9361b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:42.014252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f0960-b72b-41b9-8654-18c2c4f9361b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:42.026674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14a397-a9d8-4240-af39-5e3b6cde72fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:42.027603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14a397-a9d8-4240-af39-5e3b6cde72fd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:42.030686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14a397-a9d8-4240-af39-5e3b6cde72fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:42.030686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14a397-a9d8-4240-af39-5e3b6cde72fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:42.032705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14a397-a9d8-4240-af39-5e3b6cde72fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:42.037982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14a397-a9d8-4240-af39-5e3b6cde72fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:42.059326 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3162/6330] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:48:42.062125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caf073-f06a-4790-a1a4-54dcaf5fa21c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:42.080179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caf073-f06a-4790-a1a4-54dcaf5fa21c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:42.088805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bf754-8d8a-4db6-97fe-1873382cdfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:42.089733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bf754-8d8a-4db6-97fe-1873382cdfb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:42.090195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bf754-8d8a-4db6-97fe-1873382cdfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:42.090713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bf754-8d8a-4db6-97fe-1873382cdfb1 admin admin] PATH_INFO: `/v3/projects/bb471ae2a5954f0897b86d53aca28419/users/256ebd29b5ee4ea6b50a0d5fdfee9a1b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:42.124813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bf754-8d8a-4db6-97fe-1873382cdfb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb471ae2a5954f0897b86d53aca28419, user_id=256ebd29b5ee4ea6b50a0d5fdfee9a1b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:42.155410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bf754-8d8a-4db6-97fe-1873382cdfb1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:42.186188 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3169/6331] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:48:42 2022] PUT /identity/v3/projects/bb471ae2a5954f0897b86d53aca28419/users/256ebd29b5ee4ea6b50a0d5fdfee9a1b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:48:42.190096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44379aae-6065-4479-9e7e-32ffa5ab8071 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:42.190442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44379aae-6065-4479-9e7e-32ffa5ab8071 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:42.190727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44379aae-6065-4479-9e7e-32ffa5ab8071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:42.221649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-44379aae-6065-4479-9e7e-32ffa5ab8071 None None] MFA Rules not processed for user `256ebd29b5ee4ea6b50a0d5fdfee9a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:48:42.222820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-44379aae-6065-4479-9e7e-32ffa5ab8071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:42.345514 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3163/6332] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:48:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:48:42.353058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bf754-8d8a-4db6-97fe-1873382cdfb1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:42.355415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2c4bf754-8d8a-4db6-97fe-1873382cdfb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:42.460315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bf754-8d8a-4db6-97fe-1873382cdfb1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:42.465216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74be58e-1c26-43e5-818a-622039e0357a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:42.466049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74be58e-1c26-43e5-818a-622039e0357a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:42.466414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74be58e-1c26-43e5-818a-622039e0357a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:42.466684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74be58e-1c26-43e5-818a-622039e0357a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:42.477037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74be58e-1c26-43e5-818a-622039e0357a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:42.478620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74be58e-1c26-43e5-818a-622039e0357a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:42.501075 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3170/6333] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:48:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:48:42.722434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44379aae-6065-4479-9e7e-32ffa5ab8071 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:42.724446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-44379aae-6065-4479-9e7e-32ffa5ab8071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:42.802041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44379aae-6065-4479-9e7e-32ffa5ab8071 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:42.806814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526befa-0077-43fc-9d3f-784c46b848cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:42.808066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526befa-0077-43fc-9d3f-784c46b848cd service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:42.808680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526befa-0077-43fc-9d3f-784c46b848cd service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:42.809286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526befa-0077-43fc-9d3f-784c46b848cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:42.811319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8526befa-0077-43fc-9d3f-784c46b848cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:42.899508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526befa-0077-43fc-9d3f-784c46b848cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:42.901811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526befa-0077-43fc-9d3f-784c46b848cd service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:42.930171 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3164/6334] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:48:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:48:47.171545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6012f-16ca-4bbe-aff6-0f72aeeab5d6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:47.172567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6012f-16ca-4bbe-aff6-0f72aeeab5d6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:47.172934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6012f-16ca-4bbe-aff6-0f72aeeab5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:47.211313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-91d6012f-16ca-4bbe-aff6-0f72aeeab5d6 None None] MFA Rules not processed for user `185b4855098e46449a5b3e44339e51f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:48:47.212550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-91d6012f-16ca-4bbe-aff6-0f72aeeab5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:47.346995 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3171/6335] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:48:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:48:52.931864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:SELECT=89 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:48:57.330225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=68,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:48:57.518369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526befa-0077-43fc-9d3f-784c46b848cd service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:57.525336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8526befa-0077-43fc-9d3f-784c46b848cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:57.668152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526befa-0077-43fc-9d3f-784c46b848cd service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:57.676047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c43fd-2fae-42e7-b792-c623ba9633ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:57.676714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c43fd-2fae-42e7-b792-c623ba9633ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:57.676994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c43fd-2fae-42e7-b792-c623ba9633ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:57.677268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c43fd-2fae-42e7-b792-c623ba9633ef admin admin] PATH_INFO: `/v3/users/86ea85655b3445139096b436125aff5e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:57.682322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c43fd-2fae-42e7-b792-c623ba9633ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ea85655b3445139096b436125aff5e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:57.684331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c43fd-2fae-42e7-b792-c623ba9633ef admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:57.810751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf7c43fd-2fae-42e7-b792-c623ba9633ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ea85655b3445139096b436125aff5e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:57.812041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf7c43fd-2fae-42e7-b792-c623ba9633ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ea85655b3445139096b436125aff5e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:57.861729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf7c43fd-2fae-42e7-b792-c623ba9633ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ea85655b3445139096b436125aff5e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:57.881771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf7c43fd-2fae-42e7-b792-c623ba9633ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ea85655b3445139096b436125aff5e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:57.920801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf7c43fd-2fae-42e7-b792-c623ba9633ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ea85655b3445139096b436125aff5e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:57.948209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c463a8-7b60-48a9-89a2-680eb6467784 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:57.948490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c463a8-7b60-48a9-89a2-680eb6467784 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:57.948769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c463a8-7b60-48a9-89a2-680eb6467784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:57.955913 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3165/6336] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:48:57 2022] DELETE /identity/v3/users/86ea85655b3445139096b436125aff5e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:48:57.989608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-57c463a8-7b60-48a9-89a2-680eb6467784 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:48:57.992284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-57c463a8-7b60-48a9-89a2-680eb6467784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:58.159239 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3172/6337] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:48:58.203052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c43fd-2fae-42e7-b792-c623ba9633ef admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:58.204810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf7c43fd-2fae-42e7-b792-c623ba9633ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:58.370037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c43fd-2fae-42e7-b792-c623ba9633ef admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:58.381401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3161c7-c72e-44aa-be47-dfe73b46c48b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:58.382290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3161c7-c72e-44aa-be47-dfe73b46c48b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:58.382675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3161c7-c72e-44aa-be47-dfe73b46c48b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:58.383080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3161c7-c72e-44aa-be47-dfe73b46c48b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:58.402136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3161c7-c72e-44aa-be47-dfe73b46c48b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:58.405475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3161c7-c72e-44aa-be47-dfe73b46c48b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:58.453690 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3166/6338] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:48:59.556693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c463a8-7b60-48a9-89a2-680eb6467784 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:59.558756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-57c463a8-7b60-48a9-89a2-680eb6467784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:48:59.608924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c463a8-7b60-48a9-89a2-680eb6467784 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:59.616128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58854cef-1663-4ea1-8ad1-541bc59edb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:59.617205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58854cef-1663-4ea1-8ad1-541bc59edb94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:59.617655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58854cef-1663-4ea1-8ad1-541bc59edb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:59.618273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58854cef-1663-4ea1-8ad1-541bc59edb94 admin admin] PATH_INFO: `/v3/projects/4d3af9ec6252477ab784adb053383a91` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:59.620259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58854cef-1663-4ea1-8ad1-541bc59edb94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d3af9ec6252477ab784adb053383a91)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:59.628190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58854cef-1663-4ea1-8ad1-541bc59edb94 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:48:59.717855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-58854cef-1663-4ea1-8ad1-541bc59edb94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d3af9ec6252477ab784adb053383a91', 'request_id': 'req-58854cef-1663-4ea1-8ad1-541bc59edb94'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:59.727455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-58854cef-1663-4ea1-8ad1-541bc59edb94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d3af9ec6252477ab784adb053383a91', 'request_id': 'req-58854cef-1663-4ea1-8ad1-541bc59edb94'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:59.737386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-58854cef-1663-4ea1-8ad1-541bc59edb94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d3af9ec6252477ab784adb053383a91', 'request_id': 'req-58854cef-1663-4ea1-8ad1-541bc59edb94'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:59.762455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-58854cef-1663-4ea1-8ad1-541bc59edb94 admin admin] The token cache is being invalidate because project 4d3af9ec6252477ab784adb053383a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:48:59.764232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-58854cef-1663-4ea1-8ad1-541bc59edb94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:59.765025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-58854cef-1663-4ea1-8ad1-541bc59edb94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:48:59.768758 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3173/6339] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:48:59 2022] DELETE /identity/v3/projects/4d3af9ec6252477ab784adb053383a91 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:48:59.772585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3161c7-c72e-44aa-be47-dfe73b46c48b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:48:59.797532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3161c7-c72e-44aa-be47-dfe73b46c48b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:48:59.830015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:48:59.916907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aea53a-159e-467c-bab0-171994f69982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:48:59.917692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aea53a-159e-467c-bab0-171994f69982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:48:59.918043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aea53a-159e-467c-bab0-171994f69982 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:48:59.918489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aea53a-159e-467c-bab0-171994f69982 admin admin] PATH_INFO: `/v3/users/f72de09edc1449899667cb6abc5bfe89` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:48:59.919767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aea53a-159e-467c-bab0-171994f69982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f72de09edc1449899667cb6abc5bfe89)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:48:59.922229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aea53a-159e-467c-bab0-171994f69982 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:00.109353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36aea53a-159e-467c-bab0-171994f69982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f72de09edc1449899667cb6abc5bfe89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:00.112475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36aea53a-159e-467c-bab0-171994f69982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f72de09edc1449899667cb6abc5bfe89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:00.154599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36aea53a-159e-467c-bab0-171994f69982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f72de09edc1449899667cb6abc5bfe89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:00.188694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36aea53a-159e-467c-bab0-171994f69982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f72de09edc1449899667cb6abc5bfe89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:00.222827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36aea53a-159e-467c-bab0-171994f69982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f72de09edc1449899667cb6abc5bfe89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:00.237636 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3167/6340] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:48:59 2022] DELETE /identity/v3/users/f72de09edc1449899667cb6abc5bfe89 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:01.527296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58854cef-1663-4ea1-8ad1-541bc59edb94 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:01.529387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-58854cef-1663-4ea1-8ad1-541bc59edb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:01.571388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58854cef-1663-4ea1-8ad1-541bc59edb94 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:01.688264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d4316-8c51-49a3-925f-bbac8f317a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:01.689567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d4316-8c51-49a3-925f-bbac8f317a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:01.689870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d4316-8c51-49a3-925f-bbac8f317a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:01.690290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d4316-8c51-49a3-925f-bbac8f317a6a admin admin] PATH_INFO: `/v3/projects/c9413db186894864a6c6aec086063445` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:01.691699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d4316-8c51-49a3-925f-bbac8f317a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9413db186894864a6c6aec086063445)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:01.697421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d4316-8c51-49a3-925f-bbac8f317a6a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:01.749701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:01.776514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e9d4316-8c51-49a3-925f-bbac8f317a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9413db186894864a6c6aec086063445', 'request_id': 'req-4e9d4316-8c51-49a3-925f-bbac8f317a6a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:01.785228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e9d4316-8c51-49a3-925f-bbac8f317a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9413db186894864a6c6aec086063445', 'request_id': 'req-4e9d4316-8c51-49a3-925f-bbac8f317a6a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:01.792315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e9d4316-8c51-49a3-925f-bbac8f317a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9413db186894864a6c6aec086063445', 'request_id': 'req-4e9d4316-8c51-49a3-925f-bbac8f317a6a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:01.811555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e9d4316-8c51-49a3-925f-bbac8f317a6a admin admin] The token cache is being invalidate because project c9413db186894864a6c6aec086063445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:01.811965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e9d4316-8c51-49a3-925f-bbac8f317a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:01.812731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e9d4316-8c51-49a3-925f-bbac8f317a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:01.815425 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3174/6341] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:01 2022] DELETE /identity/v3/projects/c9413db186894864a6c6aec086063445 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:01.823150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f86c3-b777-4efb-8c42-27de56d8bde7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:01.823655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f86c3-b777-4efb-8c42-27de56d8bde7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:01.823747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f86c3-b777-4efb-8c42-27de56d8bde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:01.867805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c05f86c3-b777-4efb-8c42-27de56d8bde7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:01.869307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c05f86c3-b777-4efb-8c42-27de56d8bde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:01.995911 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3168/6342] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:02.004282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf208b5-aca6-4b72-89b6-0388b2147bc6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:02.004682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf208b5-aca6-4b72-89b6-0388b2147bc6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:02.005083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf208b5-aca6-4b72-89b6-0388b2147bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:02.031806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-edf208b5-aca6-4b72-89b6-0388b2147bc6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:02.033369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-edf208b5-aca6-4b72-89b6-0388b2147bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:02.048867 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3175/6343] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:02.049867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f86c3-b777-4efb-8c42-27de56d8bde7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:02.067633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f86c3-b777-4efb-8c42-27de56d8bde7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:02.073422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c9cb5-ba04-480b-b32a-dbc9144209e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:02.075625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c9cb5-ba04-480b-b32a-dbc9144209e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:02.077358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c9cb5-ba04-480b-b32a-dbc9144209e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:02.077954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c9cb5-ba04-480b-b32a-dbc9144209e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:02.079708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c9cb5-ba04-480b-b32a-dbc9144209e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:49:02.080320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c9cb5-ba04-480b-b32a-dbc9144209e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:02.083449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c9cb5-ba04-480b-b32a-dbc9144209e1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:02.109772 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3169/6344] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:02.114559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf208b5-aca6-4b72-89b6-0388b2147bc6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:02.125364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf208b5-aca6-4b72-89b6-0388b2147bc6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:02.131538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2de07-17b4-4644-9716-606d79b93af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:02.132476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2de07-17b4-4644-9716-606d79b93af1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:02.132910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2de07-17b4-4644-9716-606d79b93af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:02.133391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2de07-17b4-4644-9716-606d79b93af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:02.134229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2de07-17b4-4644-9716-606d79b93af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:02.137074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2de07-17b4-4644-9716-606d79b93af1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:02.215022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c9cb5-ba04-480b-b32a-dbc9144209e1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:02.223484 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3176/6345] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:02 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:02.237972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c9cb5-ba04-480b-b32a-dbc9144209e1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:02.343799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:02.454562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099333c1-cd1c-4707-be2f-d7bfc8b57de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:02.455226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099333c1-cd1c-4707-be2f-d7bfc8b57de2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:02.456182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099333c1-cd1c-4707-be2f-d7bfc8b57de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:02.456318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099333c1-cd1c-4707-be2f-d7bfc8b57de2 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:02.458108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099333c1-cd1c-4707-be2f-d7bfc8b57de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:02.475111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099333c1-cd1c-4707-be2f-d7bfc8b57de2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:02.587824 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3170/6346] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:02 2022] POST /identity/v3/users => generated 292 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:02.588223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2de07-17b4-4644-9716-606d79b93af1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:02.602813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2de07-17b4-4644-9716-606d79b93af1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:02.620682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701ad71-db4e-4eaf-b1ae-2b9fa0dbc2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:02.621388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701ad71-db4e-4eaf-b1ae-2b9fa0dbc2ee admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:02.621811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701ad71-db4e-4eaf-b1ae-2b9fa0dbc2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:02.622261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701ad71-db4e-4eaf-b1ae-2b9fa0dbc2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:02.623083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701ad71-db4e-4eaf-b1ae-2b9fa0dbc2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:02.633136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701ad71-db4e-4eaf-b1ae-2b9fa0dbc2ee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:02.679064 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3177/6347] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:02.683506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099333c1-cd1c-4707-be2f-d7bfc8b57de2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:02.701591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099333c1-cd1c-4707-be2f-d7bfc8b57de2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:02.721691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db182ec6-a5b2-4d68-bc84-322861b23afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:02.722924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db182ec6-a5b2-4d68-bc84-322861b23afb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:02.723454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db182ec6-a5b2-4d68-bc84-322861b23afb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:02.723873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db182ec6-a5b2-4d68-bc84-322861b23afb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:02.724806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db182ec6-a5b2-4d68-bc84-322861b23afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:02.733126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db182ec6-a5b2-4d68-bc84-322861b23afb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:02.761397 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3171/6348] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:02.765587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701ad71-db4e-4eaf-b1ae-2b9fa0dbc2ee admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:02.784033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701ad71-db4e-4eaf-b1ae-2b9fa0dbc2ee admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:02.791810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74b42f-b26c-4294-8f33-eea115936a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:02.793154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74b42f-b26c-4294-8f33-eea115936a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:02.796691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74b42f-b26c-4294-8f33-eea115936a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:02.797397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74b42f-b26c-4294-8f33-eea115936a82 admin admin] PATH_INFO: `/v3/projects/346ee3c8347e4b84a323a06b96496694/users/693344d5baf44f32b2a262fb69f99b3b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:02.820671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db182ec6-a5b2-4d68-bc84-322861b23afb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:02.822563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db182ec6-a5b2-4d68-bc84-322861b23afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:02.831158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74b42f-b26c-4294-8f33-eea115936a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=346ee3c8347e4b84a323a06b96496694, user_id=693344d5baf44f32b2a262fb69f99b3b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:02.838825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74b42f-b26c-4294-8f33-eea115936a82 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:02.845043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db182ec6-a5b2-4d68-bc84-322861b23afb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:02.857048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea970c2a-9531-401b-affa-7508b4b8daa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:02.857712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea970c2a-9531-401b-affa-7508b4b8daa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:02.857994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea970c2a-9531-401b-affa-7508b4b8daa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:02.858326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea970c2a-9531-401b-affa-7508b4b8daa7 admin admin] PATH_INFO: `/v3/users/256ebd29b5ee4ea6b50a0d5fdfee9a1b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:02.864072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea970c2a-9531-401b-affa-7508b4b8daa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=256ebd29b5ee4ea6b50a0d5fdfee9a1b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:02.866071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea970c2a-9531-401b-affa-7508b4b8daa7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:02.876469 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3178/6349] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:02 2022] PUT /identity/v3/projects/346ee3c8347e4b84a323a06b96496694/users/693344d5baf44f32b2a262fb69f99b3b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:02.877722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74b42f-b26c-4294-8f33-eea115936a82 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:02.888159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db74b42f-b26c-4294-8f33-eea115936a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:02.991232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea970c2a-9531-401b-affa-7508b4b8daa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '256ebd29b5ee4ea6b50a0d5fdfee9a1b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:02.992223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea970c2a-9531-401b-affa-7508b4b8daa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '256ebd29b5ee4ea6b50a0d5fdfee9a1b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:03.000615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea970c2a-9531-401b-affa-7508b4b8daa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '256ebd29b5ee4ea6b50a0d5fdfee9a1b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:03.009820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74b42f-b26c-4294-8f33-eea115936a82 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:03.014486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea970c2a-9531-401b-affa-7508b4b8daa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '256ebd29b5ee4ea6b50a0d5fdfee9a1b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:03.016139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979081d2-8505-4c32-b90c-c5ab5b8198e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:03.017279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979081d2-8505-4c32-b90c-c5ab5b8198e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:03.017707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979081d2-8505-4c32-b90c-c5ab5b8198e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:03.018671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979081d2-8505-4c32-b90c-c5ab5b8198e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:03.021310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-979081d2-8505-4c32-b90c-c5ab5b8198e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:03.069198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea970c2a-9531-401b-affa-7508b4b8daa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '256ebd29b5ee4ea6b50a0d5fdfee9a1b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:03.091943 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3172/6350] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:02 2022] DELETE /identity/v3/users/256ebd29b5ee4ea6b50a0d5fdfee9a1b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:03.093632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b3111-4fed-4088-bb29-d1a009b04c3f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:03.093922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b3111-4fed-4088-bb29-d1a009b04c3f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:03.094247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b3111-4fed-4088-bb29-d1a009b04c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:03.140447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:03.141028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-137b3111-4fed-4088-bb29-d1a009b04c3f None None] MFA Rules not processed for user `693344d5baf44f32b2a262fb69f99b3b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:03.142437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-137b3111-4fed-4088-bb29-d1a009b04c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:03.227903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979081d2-8505-4c32-b90c-c5ab5b8198e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:03.229602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979081d2-8505-4c32-b90c-c5ab5b8198e2 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:03.243459 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3173/6351] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:03.244849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b3111-4fed-4088-bb29-d1a009b04c3f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:03.246685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-137b3111-4fed-4088-bb29-d1a009b04c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:03.252445 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3179/6352] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:03.254763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4a7af-dfd3-41f4-9347-0fe382841282 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:03.254763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4a7af-dfd3-41f4-9347-0fe382841282 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:03.256511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4a7af-dfd3-41f4-9347-0fe382841282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:03.261080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:03.295827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dcf4a7af-dfd3-41f4-9347-0fe382841282 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:03.298602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dcf4a7af-dfd3-41f4-9347-0fe382841282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:03.336493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b3111-4fed-4088-bb29-d1a009b04c3f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:03.342035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11fc39-5011-4e38-869a-9a7594cd0ef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:03.343164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11fc39-5011-4e38-869a-9a7594cd0ef1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:03.343932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11fc39-5011-4e38-869a-9a7594cd0ef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:03.344361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11fc39-5011-4e38-869a-9a7594cd0ef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:03.346676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe11fc39-5011-4e38-869a-9a7594cd0ef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:03.408563 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3180/6353] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:03.410275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4a7af-dfd3-41f4-9347-0fe382841282 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:03.423907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dcf4a7af-dfd3-41f4-9347-0fe382841282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:03.470166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11fc39-5011-4e38-869a-9a7594cd0ef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:03.472923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11fc39-5011-4e38-869a-9a7594cd0ef1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:03.498304 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3174/6354] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:03.499058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11fc39-5011-4e38-869a-9a7594cd0ef1 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:03.500788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe11fc39-5011-4e38-869a-9a7594cd0ef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:03.517305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11fc39-5011-4e38-869a-9a7594cd0ef1 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:03.521581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855348c1-1332-4f92-a477-7b7a9e159d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:03.522199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855348c1-1332-4f92-a477-7b7a9e159d05 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:03.522662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855348c1-1332-4f92-a477-7b7a9e159d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:03.522946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855348c1-1332-4f92-a477-7b7a9e159d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:03.541970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4a7af-dfd3-41f4-9347-0fe382841282 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:03.545818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855348c1-1332-4f92-a477-7b7a9e159d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:03.547941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855348c1-1332-4f92-a477-7b7a9e159d05 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:03.550306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294f3eb-3f1e-49f0-8e96-7fdc30f739a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:03.551216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294f3eb-3f1e-49f0-8e96-7fdc30f739a5 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:03.551725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294f3eb-3f1e-49f0-8e96-7fdc30f739a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:03.552219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294f3eb-3f1e-49f0-8e96-7fdc30f739a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:03.579752 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3175/6355] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:03.586234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294f3eb-3f1e-49f0-8e96-7fdc30f739a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:03.588263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294f3eb-3f1e-49f0-8e96-7fdc30f739a5 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:03.601163 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3181/6356] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:03.628192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855348c1-1332-4f92-a477-7b7a9e159d05 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:03.630917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-855348c1-1332-4f92-a477-7b7a9e159d05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:03.660764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855348c1-1332-4f92-a477-7b7a9e159d05 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:03.665851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f8bcf-ecb2-47d7-b7b7-1b36340f8baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:03.666828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f8bcf-ecb2-47d7-b7b7-1b36340f8baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:03.667292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f8bcf-ecb2-47d7-b7b7-1b36340f8baf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:03.667565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f8bcf-ecb2-47d7-b7b7-1b36340f8baf admin admin] PATH_INFO: `/v3/users/693344d5baf44f32b2a262fb69f99b3b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:03.668932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f8bcf-ecb2-47d7-b7b7-1b36340f8baf admin admin] RBAC: Authorizing `identity:delete_user(user_id=693344d5baf44f32b2a262fb69f99b3b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:03.671022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f8bcf-ecb2-47d7-b7b7-1b36340f8baf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:03.765644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f6f8bcf-ecb2-47d7-b7b7-1b36340f8baf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693344d5baf44f32b2a262fb69f99b3b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:03.767164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f6f8bcf-ecb2-47d7-b7b7-1b36340f8baf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693344d5baf44f32b2a262fb69f99b3b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:03.780494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f6f8bcf-ecb2-47d7-b7b7-1b36340f8baf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693344d5baf44f32b2a262fb69f99b3b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:03.795205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f6f8bcf-ecb2-47d7-b7b7-1b36340f8baf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693344d5baf44f32b2a262fb69f99b3b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:03.827634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f6f8bcf-ecb2-47d7-b7b7-1b36340f8baf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693344d5baf44f32b2a262fb69f99b3b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:03.837618 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3176/6357] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:03 2022] DELETE /identity/v3/users/693344d5baf44f32b2a262fb69f99b3b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:03.842267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85844973-0773-49f5-9d47-4742ae41bf94 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:03.842549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85844973-0773-49f5-9d47-4742ae41bf94 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:03.842822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85844973-0773-49f5-9d47-4742ae41bf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:03.869793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-85844973-0773-49f5-9d47-4742ae41bf94 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:03.872318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-85844973-0773-49f5-9d47-4742ae41bf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:03.974902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f8bcf-ecb2-47d7-b7b7-1b36340f8baf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:03.979182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7f6f8bcf-ecb2-47d7-b7b7-1b36340f8baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:04.015048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:04.054014 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3182/6358] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:04.071799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85844973-0773-49f5-9d47-4742ae41bf94 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:04.073225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-85844973-0773-49f5-9d47-4742ae41bf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:04.088617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:04.155867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f8bcf-ecb2-47d7-b7b7-1b36340f8baf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:04.166659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9661308-c598-47ad-a1e3-28503664e527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:04.167368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9661308-c598-47ad-a1e3-28503664e527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:04.167660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9661308-c598-47ad-a1e3-28503664e527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:04.167933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9661308-c598-47ad-a1e3-28503664e527 admin admin] PATH_INFO: `/v3/projects/bb471ae2a5954f0897b86d53aca28419` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:04.169541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9661308-c598-47ad-a1e3-28503664e527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb471ae2a5954f0897b86d53aca28419)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:04.172654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9661308-c598-47ad-a1e3-28503664e527 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:04.191553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85844973-0773-49f5-9d47-4742ae41bf94 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:04.202143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf72439-49a9-4d5f-9879-2d1443a89eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:04.202871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf72439-49a9-4d5f-9879-2d1443a89eac service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:04.203204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf72439-49a9-4d5f-9879-2d1443a89eac service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:04.203709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf72439-49a9-4d5f-9879-2d1443a89eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:04.224308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf72439-49a9-4d5f-9879-2d1443a89eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:04.226494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf72439-49a9-4d5f-9879-2d1443a89eac service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:04.249556 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3183/6359] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:04.258526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9661308-c598-47ad-a1e3-28503664e527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb471ae2a5954f0897b86d53aca28419', 'request_id': 'req-e9661308-c598-47ad-a1e3-28503664e527'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:04.268936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9661308-c598-47ad-a1e3-28503664e527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb471ae2a5954f0897b86d53aca28419', 'request_id': 'req-e9661308-c598-47ad-a1e3-28503664e527'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:04.276290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9661308-c598-47ad-a1e3-28503664e527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb471ae2a5954f0897b86d53aca28419', 'request_id': 'req-e9661308-c598-47ad-a1e3-28503664e527'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:04.307843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9661308-c598-47ad-a1e3-28503664e527 admin admin] The token cache is being invalidate because project bb471ae2a5954f0897b86d53aca28419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:04.307843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9661308-c598-47ad-a1e3-28503664e527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:04.309851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9661308-c598-47ad-a1e3-28503664e527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:04.317101 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3177/6360] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:03 2022] DELETE /identity/v3/projects/bb471ae2a5954f0897b86d53aca28419 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:04.319209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e62beb-0911-4219-9ae2-ec5a5780655a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:04.319697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e62beb-0911-4219-9ae2-ec5a5780655a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:04.320395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e62beb-0911-4219-9ae2-ec5a5780655a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:04.357635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c6e62beb-0911-4219-9ae2-ec5a5780655a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:04.358696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c6e62beb-0911-4219-9ae2-ec5a5780655a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:04.533901 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3184/6361] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:04.541974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f912d5-046d-437e-bcce-0257fc4bba05 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:04.542268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f912d5-046d-437e-bcce-0257fc4bba05 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:04.542699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f912d5-046d-437e-bcce-0257fc4bba05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:04.587792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-12f912d5-046d-437e-bcce-0257fc4bba05 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:04.590003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-12f912d5-046d-437e-bcce-0257fc4bba05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:04.635360 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3178/6362] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:04.640214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e62beb-0911-4219-9ae2-ec5a5780655a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:04.664587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e62beb-0911-4219-9ae2-ec5a5780655a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:04.678771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9f531-beba-49d8-8542-81b3525c5f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:04.679624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9f531-beba-49d8-8542-81b3525c5f31 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:04.680123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9f531-beba-49d8-8542-81b3525c5f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:04.680701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9f531-beba-49d8-8542-81b3525c5f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:04.681552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9f531-beba-49d8-8542-81b3525c5f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:49:04.681964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9f531-beba-49d8-8542-81b3525c5f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:04.706038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9f531-beba-49d8-8542-81b3525c5f31 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:04.759171 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3185/6363] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:04.763548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f912d5-046d-437e-bcce-0257fc4bba05 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:04.776835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f912d5-046d-437e-bcce-0257fc4bba05 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:04.797800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48f9d4-2d25-4119-b05c-c59a83b31448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:04.798442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48f9d4-2d25-4119-b05c-c59a83b31448 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:04.798723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48f9d4-2d25-4119-b05c-c59a83b31448 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:04.799001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48f9d4-2d25-4119-b05c-c59a83b31448 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:04.799704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48f9d4-2d25-4119-b05c-c59a83b31448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:04.801749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48f9d4-2d25-4119-b05c-c59a83b31448 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:04.842860 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3179/6364] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:04 2022] POST /identity/v3/projects => generated 381 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:04.843316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9f531-beba-49d8-8542-81b3525c5f31 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:04.853928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9f531-beba-49d8-8542-81b3525c5f31 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:04.917428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48f9d4-2d25-4119-b05c-c59a83b31448 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:04.919636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2a48f9d4-2d25-4119-b05c-c59a83b31448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:04.953779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf6622-8a99-489e-a03f-5ff08bfb7efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:04.954614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf6622-8a99-489e-a03f-5ff08bfb7efc admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:04.954995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf6622-8a99-489e-a03f-5ff08bfb7efc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:04.955396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf6622-8a99-489e-a03f-5ff08bfb7efc admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:04.956152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf6622-8a99-489e-a03f-5ff08bfb7efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:04.958210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf6622-8a99-489e-a03f-5ff08bfb7efc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:05.003443 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3186/6365] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:04 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:49:05.007382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf6622-8a99-489e-a03f-5ff08bfb7efc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:05.027809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf6622-8a99-489e-a03f-5ff08bfb7efc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:05.035938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce4dfe-ffd7-4398-bdca-6c01ce7cb3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:05.041172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce4dfe-ffd7-4398-bdca-6c01ce7cb3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:05.041632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce4dfe-ffd7-4398-bdca-6c01ce7cb3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:05.042053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce4dfe-ffd7-4398-bdca-6c01ce7cb3b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:05.042992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce4dfe-ffd7-4398-bdca-6c01ce7cb3b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:05.045540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce4dfe-ffd7-4398-bdca-6c01ce7cb3b5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:05.045793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48f9d4-2d25-4119-b05c-c59a83b31448 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:05.051117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535224b9-c8c4-4932-a2ca-42a6e0afb74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:05.052198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535224b9-c8c4-4932-a2ca-42a6e0afb74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:05.059626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535224b9-c8c4-4932-a2ca-42a6e0afb74f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:05.060116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535224b9-c8c4-4932-a2ca-42a6e0afb74f admin admin] PATH_INFO: `/v3/projects/346ee3c8347e4b84a323a06b96496694` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:05.062949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535224b9-c8c4-4932-a2ca-42a6e0afb74f admin admin] RBAC: Authorizing `identity:delete_project(project_id=346ee3c8347e4b84a323a06b96496694)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:05.065218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535224b9-c8c4-4932-a2ca-42a6e0afb74f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:05.069290 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3187/6366] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:49:05.074985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce4dfe-ffd7-4398-bdca-6c01ce7cb3b5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:05.095775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:05.097175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce4dfe-ffd7-4398-bdca-6c01ce7cb3b5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:05.110060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6475dd7-99b3-4d4d-aba3-281af7dfa8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:05.110789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6475dd7-99b3-4d4d-aba3-281af7dfa8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:05.111000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6475dd7-99b3-4d4d-aba3-281af7dfa8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:05.111289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6475dd7-99b3-4d4d-aba3-281af7dfa8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:05.111942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6475dd7-99b3-4d4d-aba3-281af7dfa8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:05.120608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6475dd7-99b3-4d4d-aba3-281af7dfa8f5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:05.140627 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3188/6367] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:05.152409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6475dd7-99b3-4d4d-aba3-281af7dfa8f5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:05.180039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6475dd7-99b3-4d4d-aba3-281af7dfa8f5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:05.182222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-535224b9-c8c4-4932-a2ca-42a6e0afb74f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '346ee3c8347e4b84a323a06b96496694', 'request_id': 'req-535224b9-c8c4-4932-a2ca-42a6e0afb74f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:05.192014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:05.199246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-535224b9-c8c4-4932-a2ca-42a6e0afb74f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '346ee3c8347e4b84a323a06b96496694', 'request_id': 'req-535224b9-c8c4-4932-a2ca-42a6e0afb74f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:05.214060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-535224b9-c8c4-4932-a2ca-42a6e0afb74f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '346ee3c8347e4b84a323a06b96496694', 'request_id': 'req-535224b9-c8c4-4932-a2ca-42a6e0afb74f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:05.262032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-535224b9-c8c4-4932-a2ca-42a6e0afb74f admin admin] The token cache is being invalidate because project 346ee3c8347e4b84a323a06b96496694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:05.262378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-535224b9-c8c4-4932-a2ca-42a6e0afb74f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:05.267521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-535224b9-c8c4-4932-a2ca-42a6e0afb74f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:05.274328 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3180/6368] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:04 2022] DELETE /identity/v3/projects/346ee3c8347e4b84a323a06b96496694 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:49:05.276540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4340a8-f641-4023-87d3-a6283f1ad397 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:05.276822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4340a8-f641-4023-87d3-a6283f1ad397 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:05.277087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4340a8-f641-4023-87d3-a6283f1ad397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:05.342054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-af4340a8-f641-4023-87d3-a6283f1ad397 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:05.343346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af4340a8-f641-4023-87d3-a6283f1ad397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:05.397984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c23fe-ff0b-4bdf-a360-2c4c75ecce2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:05.398648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c23fe-ff0b-4bdf-a360-2c4c75ecce2d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:05.398932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c23fe-ff0b-4bdf-a360-2c4c75ecce2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:05.399850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c23fe-ff0b-4bdf-a360-2c4c75ecce2d admin admin] PATH_INFO: `/v3/projects/1b5dc82458e7441a928fab52770292ba/users/26179618223f4a1a85fed7c178db259b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:05.448694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c23fe-ff0b-4bdf-a360-2c4c75ecce2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5dc82458e7441a928fab52770292ba, user_id=26179618223f4a1a85fed7c178db259b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:05.451442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c23fe-ff0b-4bdf-a360-2c4c75ecce2d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:05.515303 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3181/6370] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:05.517678 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3189/6370] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:05 2022] PUT /identity/v3/projects/1b5dc82458e7441a928fab52770292ba/users/26179618223f4a1a85fed7c178db259b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:05.518010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c18692-fd10-46fb-a413-c732a685a450 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:05.518299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c18692-fd10-46fb-a413-c732a685a450 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:05.518573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c18692-fd10-46fb-a413-c732a685a450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:05.531481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df448560-3e08-4c85-b1c7-85bdbf4f5b54 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:05.532061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df448560-3e08-4c85-b1c7-85bdbf4f5b54 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:05.532410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df448560-3e08-4c85-b1c7-85bdbf4f5b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:05.599245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f6c18692-fd10-46fb-a413-c732a685a450 None None] MFA Rules not processed for user `26179618223f4a1a85fed7c178db259b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:05.600561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f6c18692-fd10-46fb-a413-c732a685a450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:05.602964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-df448560-3e08-4c85-b1c7-85bdbf4f5b54 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:05.604781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-df448560-3e08-4c85-b1c7-85bdbf4f5b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:05.745747 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3182/6371] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:05.752157 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3190/6372] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:05.757589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c18692-fd10-46fb-a413-c732a685a450 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:05.763741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df448560-3e08-4c85-b1c7-85bdbf4f5b54 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:05.767983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-df448560-3e08-4c85-b1c7-85bdbf4f5b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:05.778406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c18692-fd10-46fb-a413-c732a685a450 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:05.795612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4059fd-5d8b-4395-be85-d359422a4d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:05.802751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4059fd-5d8b-4395-be85-d359422a4d4d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:05.802751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4059fd-5d8b-4395-be85-d359422a4d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:05.802751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4059fd-5d8b-4395-be85-d359422a4d4d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:05.802751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4059fd-5d8b-4395-be85-d359422a4d4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:49:05.802751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4059fd-5d8b-4395-be85-d359422a4d4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:05.802751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4059fd-5d8b-4395-be85-d359422a4d4d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:05.871729 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3183/6373] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:05.876189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4059fd-5d8b-4395-be85-d359422a4d4d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:05.900410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4059fd-5d8b-4395-be85-d359422a4d4d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:05.906292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df448560-3e08-4c85-b1c7-85bdbf4f5b54 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:05.924216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fb412-e7f6-4a3e-a625-c5aa44682bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:05.924652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fb412-e7f6-4a3e-a625-c5aa44682bad service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:05.924936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fb412-e7f6-4a3e-a625-c5aa44682bad service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:05.925496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fb412-e7f6-4a3e-a625-c5aa44682bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:05.931690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79463ac1-d065-4065-a2ad-7fef4595ad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:05.932435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79463ac1-d065-4065-a2ad-7fef4595ad68 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:05.932986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79463ac1-d065-4065-a2ad-7fef4595ad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:05.933269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79463ac1-d065-4065-a2ad-7fef4595ad68 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:05.933954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79463ac1-d065-4065-a2ad-7fef4595ad68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:05.948938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79463ac1-d065-4065-a2ad-7fef4595ad68 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:05.949972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fb412-e7f6-4a3e-a625-c5aa44682bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:05.951868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fb412-e7f6-4a3e-a625-c5aa44682bad service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:05.974269 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3191/6374] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:05.983662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:05.996201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fb412-e7f6-4a3e-a625-c5aa44682bad service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:05.998114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2a9fb412-e7f6-4a3e-a625-c5aa44682bad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:06.011447 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3184/6375] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:05 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:06.016455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79463ac1-d065-4065-a2ad-7fef4595ad68 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:06.022707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fb412-e7f6-4a3e-a625-c5aa44682bad service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:06.090515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:06.145896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79463ac1-d065-4065-a2ad-7fef4595ad68 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:06.152850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cebfc-a172-4f10-be26-e7c206f587f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:06.154012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cebfc-a172-4f10-be26-e7c206f587f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:06.154472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cebfc-a172-4f10-be26-e7c206f587f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:06.154916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cebfc-a172-4f10-be26-e7c206f587f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:06.155827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cebfc-a172-4f10-be26-e7c206f587f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:06.158017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cebfc-a172-4f10-be26-e7c206f587f7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:06.177522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e2105-af03-41f0-9094-331f1e7ae3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:06.178289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e2105-af03-41f0-9094-331f1e7ae3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:06.179544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e2105-af03-41f0-9094-331f1e7ae3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:06.179908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e2105-af03-41f0-9094-331f1e7ae3c1 admin admin] PATH_INFO: `/v3/users/26179618223f4a1a85fed7c178db259b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:06.181212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e2105-af03-41f0-9094-331f1e7ae3c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26179618223f4a1a85fed7c178db259b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:06.184931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e2105-af03-41f0-9094-331f1e7ae3c1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:06.194590 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3185/6376] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:06 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:06.199532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cebfc-a172-4f10-be26-e7c206f587f7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:06.229650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cebfc-a172-4f10-be26-e7c206f587f7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:06.240275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a5c8e-61f6-4cb8-bd45-3857d548d272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:06.241292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a5c8e-61f6-4cb8-bd45-3857d548d272 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:06.241750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a5c8e-61f6-4cb8-bd45-3857d548d272 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:06.242377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a5c8e-61f6-4cb8-bd45-3857d548d272 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:06.244613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a5c8e-61f6-4cb8-bd45-3857d548d272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:06.247650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a5c8e-61f6-4cb8-bd45-3857d548d272 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:06.266115 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3186/6377] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:06.274706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a5c8e-61f6-4cb8-bd45-3857d548d272 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:06.295017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a5c8e-61f6-4cb8-bd45-3857d548d272 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:06.301803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b2804-94ba-42bf-8007-2638e44091dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:06.303568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b2804-94ba-42bf-8007-2638e44091dd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:06.304067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b2804-94ba-42bf-8007-2638e44091dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:06.304841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b2804-94ba-42bf-8007-2638e44091dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:06.306889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b2804-94ba-42bf-8007-2638e44091dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:06.309306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b2804-94ba-42bf-8007-2638e44091dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:06.317356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d7e2105-af03-41f0-9094-331f1e7ae3c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26179618223f4a1a85fed7c178db259b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:06.328152 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3187/6378] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:06.331586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b2804-94ba-42bf-8007-2638e44091dd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:06.341945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d7e2105-af03-41f0-9094-331f1e7ae3c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26179618223f4a1a85fed7c178db259b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:06.342975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d7e2105-af03-41f0-9094-331f1e7ae3c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26179618223f4a1a85fed7c178db259b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:06.343903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d7e2105-af03-41f0-9094-331f1e7ae3c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26179618223f4a1a85fed7c178db259b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:06.354564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b2804-94ba-42bf-8007-2638e44091dd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:06.357437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d7e2105-af03-41f0-9094-331f1e7ae3c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26179618223f4a1a85fed7c178db259b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:06.364543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be099fd3-33cb-4e87-91b2-f4ae7e69cac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:06.368404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be099fd3-33cb-4e87-91b2-f4ae7e69cac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:06.368404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be099fd3-33cb-4e87-91b2-f4ae7e69cac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:06.368404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be099fd3-33cb-4e87-91b2-f4ae7e69cac9 admin admin] PATH_INFO: `/v3/projects/351ed8be4d18448f898371207b383458/users/27459faea15d4d699cabaa82ff68f3c7/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:06.392924 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3192/6379] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:05 2022] DELETE /identity/v3/users/26179618223f4a1a85fed7c178db259b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:49:06.398386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03801d71-c05a-4cf0-aeec-3a9bef90dc53 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:06.399343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03801d71-c05a-4cf0-aeec-3a9bef90dc53 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:06.400108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03801d71-c05a-4cf0-aeec-3a9bef90dc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:06.413932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be099fd3-33cb-4e87-91b2-f4ae7e69cac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=351ed8be4d18448f898371207b383458, user_id=27459faea15d4d699cabaa82ff68f3c7, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:06.420052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be099fd3-33cb-4e87-91b2-f4ae7e69cac9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:06.446689 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3188/6380] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:06 2022] PUT /identity/v3/projects/351ed8be4d18448f898371207b383458/users/27459faea15d4d699cabaa82ff68f3c7/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:06.458626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fee5f-7f5d-44a5-a4c6-2bab5a70e9c7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:06.459119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fee5f-7f5d-44a5-a4c6-2bab5a70e9c7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:06.460427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fee5f-7f5d-44a5-a4c6-2bab5a70e9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:06.469156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-03801d71-c05a-4cf0-aeec-3a9bef90dc53 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:06.473805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-03801d71-c05a-4cf0-aeec-3a9bef90dc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:06.542625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-954fee5f-7f5d-44a5-a4c6-2bab5a70e9c7 None None] MFA Rules not processed for user `27459faea15d4d699cabaa82ff68f3c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:06.543551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-954fee5f-7f5d-44a5-a4c6-2bab5a70e9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:06.655896 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3193/6381] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:06.697574 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3189/6382] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:06.701870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03801d71-c05a-4cf0-aeec-3a9bef90dc53 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:06.703607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-03801d71-c05a-4cf0-aeec-3a9bef90dc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:06.719723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03801d71-c05a-4cf0-aeec-3a9bef90dc53 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:06.724174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fee5f-7f5d-44a5-a4c6-2bab5a70e9c7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:06.725712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-954fee5f-7f5d-44a5-a4c6-2bab5a70e9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:06.732384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bbc65-b88e-4b0a-9879-932e2f833289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:06.734140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bbc65-b88e-4b0a-9879-932e2f833289 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:06.734429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bbc65-b88e-4b0a-9879-932e2f833289 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:06.734895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bbc65-b88e-4b0a-9879-932e2f833289 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:06.736330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bbc65-b88e-4b0a-9879-932e2f833289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:06.740770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bbc65-b88e-4b0a-9879-932e2f833289 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:06.787590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:06.808374 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3194/6383] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:06 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:06.813927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bbc65-b88e-4b0a-9879-932e2f833289 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:06.854703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fee5f-7f5d-44a5-a4c6-2bab5a70e9c7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:06.893475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:06.966255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc54729-407b-423b-a038-dd6a8a1b87f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:06.966255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc54729-407b-423b-a038-dd6a8a1b87f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:06.966255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc54729-407b-423b-a038-dd6a8a1b87f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:06.966255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc54729-407b-423b-a038-dd6a8a1b87f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:06.969142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bbc65-b88e-4b0a-9879-932e2f833289 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:06.975145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289724-d4a2-49fa-94a2-6b27b2ebb9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:06.975927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289724-d4a2-49fa-94a2-6b27b2ebb9cb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:06.976286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289724-d4a2-49fa-94a2-6b27b2ebb9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:06.976629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289724-d4a2-49fa-94a2-6b27b2ebb9cb admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:06.977367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289724-d4a2-49fa-94a2-6b27b2ebb9cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:06.980294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289724-d4a2-49fa-94a2-6b27b2ebb9cb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:06.999630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc54729-407b-423b-a038-dd6a8a1b87f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:07.001759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc54729-407b-423b-a038-dd6a8a1b87f8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:07.024896 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3190/6384] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:07.031201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc54729-407b-423b-a038-dd6a8a1b87f8 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:07.031432 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3195/6385] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:06 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:07.046455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc54729-407b-423b-a038-dd6a8a1b87f8 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:07.052883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc55361-c4cb-448e-8bff-3e21cf4b144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:07.053805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc55361-c4cb-448e-8bff-3e21cf4b144d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:07.054142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc55361-c4cb-448e-8bff-3e21cf4b144d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:07.054422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc55361-c4cb-448e-8bff-3e21cf4b144d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:07.055275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc55361-c4cb-448e-8bff-3e21cf4b144d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:07.056992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc55361-c4cb-448e-8bff-3e21cf4b144d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:07.077036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289724-d4a2-49fa-94a2-6b27b2ebb9cb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:07.085105 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3191/6386] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:49:07.092087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289724-d4a2-49fa-94a2-6b27b2ebb9cb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:07.102916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30fda7-8fde-44a2-934e-07cac377e887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:07.103676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30fda7-8fde-44a2-934e-07cac377e887 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:07.103988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30fda7-8fde-44a2-934e-07cac377e887 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:07.104358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30fda7-8fde-44a2-934e-07cac377e887 admin admin] PATH_INFO: `/v3/projects/9875f13edcfb4f72ac2c605aebe1aa55/users/75b1726b4e944f8db957eaa65e8d7811/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:07.124000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30fda7-8fde-44a2-934e-07cac377e887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9875f13edcfb4f72ac2c605aebe1aa55, user_id=75b1726b4e944f8db957eaa65e8d7811, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:07.127653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30fda7-8fde-44a2-934e-07cac377e887 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:07.153691 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3196/6387] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:07 2022] PUT /identity/v3/projects/9875f13edcfb4f72ac2c605aebe1aa55/users/75b1726b4e944f8db957eaa65e8d7811/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:07.158416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc55361-c4cb-448e-8bff-3e21cf4b144d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:07.184653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc55361-c4cb-448e-8bff-3e21cf4b144d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:07.332419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7311122-0c36-4728-83db-5a50826e0767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:07.333539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7311122-0c36-4728-83db-5a50826e0767 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:07.333539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7311122-0c36-4728-83db-5a50826e0767 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:07.333831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7311122-0c36-4728-83db-5a50826e0767 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:07.335290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7311122-0c36-4728-83db-5a50826e0767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:07.336917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7311122-0c36-4728-83db-5a50826e0767 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:07.355920 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3192/6388] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:07.360430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30fda7-8fde-44a2-934e-07cac377e887 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:07.376140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30fda7-8fde-44a2-934e-07cac377e887 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:07.389130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c002fe2-d890-4c9d-aa57-0052732ba77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:07.391314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002fe2-d890-4c9d-aa57-0052732ba77d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:07.391609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002fe2-d890-4c9d-aa57-0052732ba77d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:07.393125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002fe2-d890-4c9d-aa57-0052732ba77d admin admin] PATH_INFO: `/v3/projects/9875f13edcfb4f72ac2c605aebe1aa55/users/75b1726b4e944f8db957eaa65e8d7811/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:07.398053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c002fe2-d890-4c9d-aa57-0052732ba77d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9875f13edcfb4f72ac2c605aebe1aa55, user_id=75b1726b4e944f8db957eaa65e8d7811, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:07.409216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c002fe2-d890-4c9d-aa57-0052732ba77d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:07.454476 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3197/6389] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:07 2022] PUT /identity/v3/projects/9875f13edcfb4f72ac2c605aebe1aa55/users/75b1726b4e944f8db957eaa65e8d7811/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:07.454677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b8324-ac6b-4ec4-a613-2593167ff6af None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:07.454677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b8324-ac6b-4ec4-a613-2593167ff6af None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:07.454677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b8324-ac6b-4ec4-a613-2593167ff6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:07.506656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-800b8324-ac6b-4ec4-a613-2593167ff6af None None] MFA Rules not processed for user `75b1726b4e944f8db957eaa65e8d7811`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:07.508354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-800b8324-ac6b-4ec4-a613-2593167ff6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:07.601464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c002fe2-d890-4c9d-aa57-0052732ba77d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:07.605015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9c002fe2-d890-4c9d-aa57-0052732ba77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:07.643130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:07.659537 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3193/6390] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:07.672975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b8324-ac6b-4ec4-a613-2593167ff6af None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:07.678036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-800b8324-ac6b-4ec4-a613-2593167ff6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:07.768882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c002fe2-d890-4c9d-aa57-0052732ba77d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:07.774506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30576fa2-dad8-4893-9fbe-4e62826d8cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:07.775469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30576fa2-dad8-4893-9fbe-4e62826d8cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:07.775964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30576fa2-dad8-4893-9fbe-4e62826d8cea admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:07.776469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30576fa2-dad8-4893-9fbe-4e62826d8cea admin admin] PATH_INFO: `/v3/projects/1b5dc82458e7441a928fab52770292ba` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:07.777886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30576fa2-dad8-4893-9fbe-4e62826d8cea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5dc82458e7441a928fab52770292ba)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:07.780554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30576fa2-dad8-4893-9fbe-4e62826d8cea admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:07.833065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b8324-ac6b-4ec4-a613-2593167ff6af None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:07.837709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4394b-231a-46e7-a738-04f7565dfa87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:07.838639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4394b-231a-46e7-a738-04f7565dfa87 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:07.839194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4394b-231a-46e7-a738-04f7565dfa87 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:07.839727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4394b-231a-46e7-a738-04f7565dfa87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:07.879669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30576fa2-dad8-4893-9fbe-4e62826d8cea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5dc82458e7441a928fab52770292ba', 'request_id': 'req-30576fa2-dad8-4893-9fbe-4e62826d8cea'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:07.890671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30576fa2-dad8-4893-9fbe-4e62826d8cea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5dc82458e7441a928fab52770292ba', 'request_id': 'req-30576fa2-dad8-4893-9fbe-4e62826d8cea'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:07.907808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30576fa2-dad8-4893-9fbe-4e62826d8cea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5dc82458e7441a928fab52770292ba', 'request_id': 'req-30576fa2-dad8-4893-9fbe-4e62826d8cea'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:07.931861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30576fa2-dad8-4893-9fbe-4e62826d8cea admin admin] The token cache is being invalidate because project 1b5dc82458e7441a928fab52770292ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:07.932370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30576fa2-dad8-4893-9fbe-4e62826d8cea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:07.935565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30576fa2-dad8-4893-9fbe-4e62826d8cea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:07.937704 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3198/6391] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:07 2022] DELETE /identity/v3/projects/1b5dc82458e7441a928fab52770292ba => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:49:07.942609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca947ac-45db-44f6-bf36-02c6c7455f9e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:07.942896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca947ac-45db-44f6-bf36-02c6c7455f9e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:07.943172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca947ac-45db-44f6-bf36-02c6c7455f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:07.946566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4394b-231a-46e7-a738-04f7565dfa87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:07.948671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4394b-231a-46e7-a738-04f7565dfa87 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:07.981450 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3194/6392] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:08.001934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dca947ac-45db-44f6-bf36-02c6c7455f9e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:08.004580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dca947ac-45db-44f6-bf36-02c6c7455f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:08.042757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:08.241477 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3199/6393] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:08.247615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ce130-7fa1-46ad-abf4-127436b95add None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:08.248136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ce130-7fa1-46ad-abf4-127436b95add None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:08.248136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ce130-7fa1-46ad-abf4-127436b95add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:08.297176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ce0ce130-7fa1-46ad-abf4-127436b95add None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:08.302680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce0ce130-7fa1-46ad-abf4-127436b95add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:08.327321 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3195/6394] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:08.330164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca947ac-45db-44f6-bf36-02c6c7455f9e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:08.342066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca947ac-45db-44f6-bf36-02c6c7455f9e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:08.348948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad1742-4985-47f4-ad31-ffd40704aa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:08.349821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad1742-4985-47f4-ad31-ffd40704aa07 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:08.350271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad1742-4985-47f4-ad31-ffd40704aa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:08.350752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad1742-4985-47f4-ad31-ffd40704aa07 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:08.351885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad1742-4985-47f4-ad31-ffd40704aa07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:49:08.353489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad1742-4985-47f4-ad31-ffd40704aa07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:08.357533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad1742-4985-47f4-ad31-ffd40704aa07 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:08.397548 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3200/6395] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:49:08.403291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ce130-7fa1-46ad-abf4-127436b95add None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:08.419918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ce130-7fa1-46ad-abf4-127436b95add None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:08.426862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31062f-e67c-450e-8d75-83543bdc9a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:08.427705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31062f-e67c-450e-8d75-83543bdc9a4a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:08.428086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31062f-e67c-450e-8d75-83543bdc9a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:08.428582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31062f-e67c-450e-8d75-83543bdc9a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:08.429352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31062f-e67c-450e-8d75-83543bdc9a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:08.432080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31062f-e67c-450e-8d75-83543bdc9a4a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:08.499112 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3196/6396] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:08 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:08.503932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad1742-4985-47f4-ad31-ffd40704aa07 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:08.523882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad1742-4985-47f4-ad31-ffd40704aa07 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:08.770029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31062f-e67c-450e-8d75-83543bdc9a4a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:08.771892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bd31062f-e67c-450e-8d75-83543bdc9a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:08.791426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e67f4-1e3c-44a0-a406-a1959df4dc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:08.795974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e67f4-1e3c-44a0-a406-a1959df4dc88 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:08.796287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e67f4-1e3c-44a0-a406-a1959df4dc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:08.796555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e67f4-1e3c-44a0-a406-a1959df4dc88 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:08.799183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e67f4-1e3c-44a0-a406-a1959df4dc88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:08.805507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e67f4-1e3c-44a0-a406-a1959df4dc88 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:08.883742 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3201/6397] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:08 2022] POST /identity/v3/users => generated 291 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:08.887392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e67f4-1e3c-44a0-a406-a1959df4dc88 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:08.914432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e67f4-1e3c-44a0-a406-a1959df4dc88 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:08.928347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f2f5b-cb7e-419b-8777-808c44ed3ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:08.954444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f2f5b-cb7e-419b-8777-808c44ed3ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:08.954742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f2f5b-cb7e-419b-8777-808c44ed3ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:08.955030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f2f5b-cb7e-419b-8777-808c44ed3ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:08.960881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f2f5b-cb7e-419b-8777-808c44ed3ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:08.962574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f2f5b-cb7e-419b-8777-808c44ed3ca2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:08.984876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31062f-e67c-450e-8d75-83543bdc9a4a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:08.992108 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3202/6398] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:08.996343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f2f5b-cb7e-419b-8777-808c44ed3ca2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:08.996842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b464f01-30e3-432a-96d3-04ae69a2d2d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:08.997610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b464f01-30e3-432a-96d3-04ae69a2d2d9 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:08.997897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b464f01-30e3-432a-96d3-04ae69a2d2d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:08.998176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b464f01-30e3-432a-96d3-04ae69a2d2d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:09.004780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3b464f01-30e3-432a-96d3-04ae69a2d2d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:09.018751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f2f5b-cb7e-419b-8777-808c44ed3ca2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:09.028155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcecafb-5838-488e-bde0-aa9c302af089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:09.029115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcecafb-5838-488e-bde0-aa9c302af089 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:09.029618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcecafb-5838-488e-bde0-aa9c302af089 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:09.030263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcecafb-5838-488e-bde0-aa9c302af089 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:09.040849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcecafb-5838-488e-bde0-aa9c302af089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:09.043490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcecafb-5838-488e-bde0-aa9c302af089 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:09.073129 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3203/6399] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:49:09.076075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcecafb-5838-488e-bde0-aa9c302af089 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:09.087665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcecafb-5838-488e-bde0-aa9c302af089 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:09.099664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a76e7-1141-44a2-89ad-a5d91526a6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:09.100783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a76e7-1141-44a2-89ad-a5d91526a6ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:09.101418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a76e7-1141-44a2-89ad-a5d91526a6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:09.101923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a76e7-1141-44a2-89ad-a5d91526a6ef admin admin] PATH_INFO: `/v3/projects/3618eda983c4481e980755c8f98078d6/users/857cb1994afa417ca5f03e5e82b9167a/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:09.138007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a76e7-1141-44a2-89ad-a5d91526a6ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3618eda983c4481e980755c8f98078d6, user_id=857cb1994afa417ca5f03e5e82b9167a, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:09.140907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:09.141500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a76e7-1141-44a2-89ad-a5d91526a6ef admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:09.175667 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3204/6400] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:09 2022] PUT /identity/v3/projects/3618eda983c4481e980755c8f98078d6/users/857cb1994afa417ca5f03e5e82b9167a/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:09.188252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb950ad-9e71-44fa-ac85-053b7e40a871 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:09.189411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb950ad-9e71-44fa-ac85-053b7e40a871 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:09.190089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb950ad-9e71-44fa-ac85-053b7e40a871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:09.234816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b464f01-30e3-432a-96d3-04ae69a2d2d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:09.241136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b464f01-30e3-432a-96d3-04ae69a2d2d9 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:09.296185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4bb950ad-9e71-44fa-ac85-053b7e40a871 None None] MFA Rules not processed for user `857cb1994afa417ca5f03e5e82b9167a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:09.297997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4bb950ad-9e71-44fa-ac85-053b7e40a871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:09.307201 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3197/6401] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:09.347951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:09.418121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b464f01-30e3-432a-96d3-04ae69a2d2d9 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:09.427901 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3205/6402] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:09.438610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b464f01-30e3-432a-96d3-04ae69a2d2d9 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:09.605145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a4674-43b2-4651-a32c-3a0557da720c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:09.605954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a4674-43b2-4651-a32c-3a0557da720c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:09.606336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a4674-43b2-4651-a32c-3a0557da720c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:09.606713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a4674-43b2-4651-a32c-3a0557da720c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:09.607797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a4674-43b2-4651-a32c-3a0557da720c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:09.609978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a4674-43b2-4651-a32c-3a0557da720c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:09.649108 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3198/6403] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:09 2022] POST /identity/v3/projects => generated 381 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:09.653485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb950ad-9e71-44fa-ac85-053b7e40a871 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:09.676592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb950ad-9e71-44fa-ac85-053b7e40a871 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:09.812825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86835f-7280-4051-84be-39043ed73101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:09.813470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86835f-7280-4051-84be-39043ed73101 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:09.813755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86835f-7280-4051-84be-39043ed73101 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:09.814031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86835f-7280-4051-84be-39043ed73101 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:09.814683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86835f-7280-4051-84be-39043ed73101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:09.816740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86835f-7280-4051-84be-39043ed73101 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:09.867030 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3206/6404] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:09 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:49:09.868807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a4674-43b2-4651-a32c-3a0557da720c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:09.899364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a4674-43b2-4651-a32c-3a0557da720c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:09.909795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405de89c-19b4-427a-b99d-422b43185d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:09.911850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405de89c-19b4-427a-b99d-422b43185d12 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:09.913588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405de89c-19b4-427a-b99d-422b43185d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:09.913951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405de89c-19b4-427a-b99d-422b43185d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:09.914701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405de89c-19b4-427a-b99d-422b43185d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:09.919713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405de89c-19b4-427a-b99d-422b43185d12 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:09.948649 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3199/6405] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:09.949143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86835f-7280-4051-84be-39043ed73101 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:09.976342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86835f-7280-4051-84be-39043ed73101 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:09.992436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3f4c4-6216-4cfd-84c7-95296dc06e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:09.993136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3f4c4-6216-4cfd-84c7-95296dc06e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:09.995379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3f4c4-6216-4cfd-84c7-95296dc06e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:09.995690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3f4c4-6216-4cfd-84c7-95296dc06e24 admin admin] PATH_INFO: `/v3/projects/dace1a921408441cbc7ce3ad787cb66c/users/9177d35faf5e412c8118b1cd0598bd87/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:10.044168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3f4c4-6216-4cfd-84c7-95296dc06e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dace1a921408441cbc7ce3ad787cb66c, user_id=9177d35faf5e412c8118b1cd0598bd87, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:10.062721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3f4c4-6216-4cfd-84c7-95296dc06e24 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:10.081259 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3207/6406] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:09 2022] PUT /identity/v3/projects/dace1a921408441cbc7ce3ad787cb66c/users/9177d35faf5e412c8118b1cd0598bd87/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:10.086380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405de89c-19b4-427a-b99d-422b43185d12 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:10.102140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405de89c-19b4-427a-b99d-422b43185d12 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:10.212473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c547cf4-724e-4d36-acad-fcab540287b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:10.213398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c547cf4-724e-4d36-acad-fcab540287b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:10.214432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c547cf4-724e-4d36-acad-fcab540287b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:10.214913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c547cf4-724e-4d36-acad-fcab540287b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:10.216867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c547cf4-724e-4d36-acad-fcab540287b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:10.219945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c547cf4-724e-4d36-acad-fcab540287b5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:10.239631 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3200/6407] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:10.243922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3f4c4-6216-4cfd-84c7-95296dc06e24 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:10.257230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3f4c4-6216-4cfd-84c7-95296dc06e24 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:10.263674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b62c8-30c1-40b5-a4a0-a286e9523ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:10.265176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b62c8-30c1-40b5-a4a0-a286e9523ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:10.266208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b62c8-30c1-40b5-a4a0-a286e9523ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:10.267007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b62c8-30c1-40b5-a4a0-a286e9523ad2 admin admin] PATH_INFO: `/v3/projects/dace1a921408441cbc7ce3ad787cb66c/users/9177d35faf5e412c8118b1cd0598bd87/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:10.271531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b62c8-30c1-40b5-a4a0-a286e9523ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dace1a921408441cbc7ce3ad787cb66c, user_id=9177d35faf5e412c8118b1cd0598bd87, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:10.276562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b62c8-30c1-40b5-a4a0-a286e9523ad2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:10.291548 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3208/6408] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:10 2022] PUT /identity/v3/projects/dace1a921408441cbc7ce3ad787cb66c/users/9177d35faf5e412c8118b1cd0598bd87/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:49:10.302733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7ee50-96b3-42cf-99a7-20f8bf97d583 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:10.303111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7ee50-96b3-42cf-99a7-20f8bf97d583 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:10.303442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7ee50-96b3-42cf-99a7-20f8bf97d583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:10.368249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dad7ee50-96b3-42cf-99a7-20f8bf97d583 None None] MFA Rules not processed for user `9177d35faf5e412c8118b1cd0598bd87`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:10.369547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dad7ee50-96b3-42cf-99a7-20f8bf97d583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:10.480719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:10.575317 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3201/6409] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:10.583721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b62c8-30c1-40b5-a4a0-a286e9523ad2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:10.684569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b62c8-30c1-40b5-a4a0-a286e9523ad2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:10.688580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591a661-8d45-42db-ac27-d42c38da05ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:10.689395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591a661-8d45-42db-ac27-d42c38da05ca service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:10.689823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591a661-8d45-42db-ac27-d42c38da05ca service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:10.690284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591a661-8d45-42db-ac27-d42c38da05ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:10.706206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591a661-8d45-42db-ac27-d42c38da05ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:10.708735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591a661-8d45-42db-ac27-d42c38da05ca service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:10.726240 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3209/6410] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:10.874625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7ee50-96b3-42cf-99a7-20f8bf97d583 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:10.892943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7ee50-96b3-42cf-99a7-20f8bf97d583 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:10.902957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5637023-54fc-4a3e-88ad-9b482471ab41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:10.903628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5637023-54fc-4a3e-88ad-9b482471ab41 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:10.903903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5637023-54fc-4a3e-88ad-9b482471ab41 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:10.905696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5637023-54fc-4a3e-88ad-9b482471ab41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:11.081747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5637023-54fc-4a3e-88ad-9b482471ab41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:11.085878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5637023-54fc-4a3e-88ad-9b482471ab41 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:11.119638 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3202/6411] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:12.918808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591a661-8d45-42db-ac27-d42c38da05ca service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:12.921143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1591a661-8d45-42db-ac27-d42c38da05ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:13.004976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:13.105905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591a661-8d45-42db-ac27-d42c38da05ca service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:13.122097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e6c48-39a6-43ae-bcc2-f2148c37ef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:13.122922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e6c48-39a6-43ae-bcc2-f2148c37ef1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:13.123267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e6c48-39a6-43ae-bcc2-f2148c37ef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:13.123593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e6c48-39a6-43ae-bcc2-f2148c37ef1d admin admin] PATH_INFO: `/v3/users/afdf62f3cae74b359622eb3bb55f43d9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:13.126791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e6c48-39a6-43ae-bcc2-f2148c37ef1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=afdf62f3cae74b359622eb3bb55f43d9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:13.133144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e6c48-39a6-43ae-bcc2-f2148c37ef1d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:13.270076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eb7e6c48-39a6-43ae-bcc2-f2148c37ef1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afdf62f3cae74b359622eb3bb55f43d9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:13.301695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eb7e6c48-39a6-43ae-bcc2-f2148c37ef1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afdf62f3cae74b359622eb3bb55f43d9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:13.302689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eb7e6c48-39a6-43ae-bcc2-f2148c37ef1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afdf62f3cae74b359622eb3bb55f43d9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:13.305186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eb7e6c48-39a6-43ae-bcc2-f2148c37ef1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afdf62f3cae74b359622eb3bb55f43d9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:13.337563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eb7e6c48-39a6-43ae-bcc2-f2148c37ef1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afdf62f3cae74b359622eb3bb55f43d9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:13.361379 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3210/6412] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:12 2022] DELETE /identity/v3/users/afdf62f3cae74b359622eb3bb55f43d9 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:13.777014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5637023-54fc-4a3e-88ad-9b482471ab41 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:13.794156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5637023-54fc-4a3e-88ad-9b482471ab41 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:13.917222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d457cd-7ab0-4808-a14a-e1ebd93828de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:13.920613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d457cd-7ab0-4808-a14a-e1ebd93828de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:13.921009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d457cd-7ab0-4808-a14a-e1ebd93828de admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:13.921360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d457cd-7ab0-4808-a14a-e1ebd93828de admin admin] PATH_INFO: `/v3/projects/1fef510420d0432b875c32dce48d102d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:13.923302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d457cd-7ab0-4808-a14a-e1ebd93828de admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fef510420d0432b875c32dce48d102d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:13.925407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d457cd-7ab0-4808-a14a-e1ebd93828de admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:14.018547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35d457cd-7ab0-4808-a14a-e1ebd93828de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fef510420d0432b875c32dce48d102d', 'request_id': 'req-35d457cd-7ab0-4808-a14a-e1ebd93828de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:14.033283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35d457cd-7ab0-4808-a14a-e1ebd93828de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fef510420d0432b875c32dce48d102d', 'request_id': 'req-35d457cd-7ab0-4808-a14a-e1ebd93828de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:14.052135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35d457cd-7ab0-4808-a14a-e1ebd93828de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fef510420d0432b875c32dce48d102d', 'request_id': 'req-35d457cd-7ab0-4808-a14a-e1ebd93828de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:14.055898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:14.081742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35d457cd-7ab0-4808-a14a-e1ebd93828de admin admin] The token cache is being invalidate because project 1fef510420d0432b875c32dce48d102d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:14.082975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35d457cd-7ab0-4808-a14a-e1ebd93828de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:14.083774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35d457cd-7ab0-4808-a14a-e1ebd93828de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:14.091827 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3203/6413] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:13 2022] DELETE /identity/v3/projects/1fef510420d0432b875c32dce48d102d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:14.093551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b271af0-b363-48cd-a7a2-01bb06bc7f49 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:14.094380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b271af0-b363-48cd-a7a2-01bb06bc7f49 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:14.094811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b271af0-b363-48cd-a7a2-01bb06bc7f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:14.130563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3b271af0-b363-48cd-a7a2-01bb06bc7f49 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:14.131918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3b271af0-b363-48cd-a7a2-01bb06bc7f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:14.271353 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3211/6414] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:14.279515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f8361-8d7a-4d7d-b698-c45c71894633 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:14.280036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f8361-8d7a-4d7d-b698-c45c71894633 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:14.280496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f8361-8d7a-4d7d-b698-c45c71894633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:14.312695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f98f8361-8d7a-4d7d-b698-c45c71894633 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:14.314465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f98f8361-8d7a-4d7d-b698-c45c71894633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:14.326335 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3204/6415] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:14.329769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b271af0-b363-48cd-a7a2-01bb06bc7f49 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:14.345534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b271af0-b363-48cd-a7a2-01bb06bc7f49 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:14.359613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61275c0-9a86-4006-bbe0-0a71c025fd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:14.360306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61275c0-9a86-4006-bbe0-0a71c025fd1f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:14.360601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61275c0-9a86-4006-bbe0-0a71c025fd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:14.360882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61275c0-9a86-4006-bbe0-0a71c025fd1f admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:14.361724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61275c0-9a86-4006-bbe0-0a71c025fd1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:49:14.362089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61275c0-9a86-4006-bbe0-0a71c025fd1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:14.364171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61275c0-9a86-4006-bbe0-0a71c025fd1f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:14.403342 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3212/6416] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:14.406208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f8361-8d7a-4d7d-b698-c45c71894633 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:14.420965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f8361-8d7a-4d7d-b698-c45c71894633 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:14.431937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61562314-1bb2-4cf2-9cd6-752375f5d59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:14.434817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61562314-1bb2-4cf2-9cd6-752375f5d59b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:14.437868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61562314-1bb2-4cf2-9cd6-752375f5d59b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:14.438590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61562314-1bb2-4cf2-9cd6-752375f5d59b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:14.441963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61562314-1bb2-4cf2-9cd6-752375f5d59b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:14.468141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61562314-1bb2-4cf2-9cd6-752375f5d59b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:14.570863 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3205/6417] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:14 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:49:14.578032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61275c0-9a86-4006-bbe0-0a71c025fd1f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:14.595196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61275c0-9a86-4006-bbe0-0a71c025fd1f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:14.706630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:14.752546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb1c83-0229-4ca5-85d5-a4fd2107297e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:14.753244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb1c83-0229-4ca5-85d5-a4fd2107297e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:14.753524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb1c83-0229-4ca5-85d5-a4fd2107297e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:14.753868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb1c83-0229-4ca5-85d5-a4fd2107297e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:14.754525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb1c83-0229-4ca5-85d5-a4fd2107297e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:14.756706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb1c83-0229-4ca5-85d5-a4fd2107297e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:14.882811 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3213/6418] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:14 2022] POST /identity/v3/users => generated 294 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:14.885885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61562314-1bb2-4cf2-9cd6-752375f5d59b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:14.897445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61562314-1bb2-4cf2-9cd6-752375f5d59b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:14.936633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c994f-549a-4a6f-b1bd-d54ae0603931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:14.937479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c994f-549a-4a6f-b1bd-d54ae0603931 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:14.939636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c994f-549a-4a6f-b1bd-d54ae0603931 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:14.947896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c994f-549a-4a6f-b1bd-d54ae0603931 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:14.950041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c994f-549a-4a6f-b1bd-d54ae0603931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:14.951900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c994f-549a-4a6f-b1bd-d54ae0603931 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:14.984839 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3206/6419] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:14.986470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb1c83-0229-4ca5-85d5-a4fd2107297e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:15.005681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb1c83-0229-4ca5-85d5-a4fd2107297e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:15.015322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73d919-6c70-42d2-bc74-67d8b871d92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:15.017069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73d919-6c70-42d2-bc74-67d8b871d92f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:15.017356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73d919-6c70-42d2-bc74-67d8b871d92f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:15.017637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73d919-6c70-42d2-bc74-67d8b871d92f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:15.018343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73d919-6c70-42d2-bc74-67d8b871d92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:15.023928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73d919-6c70-42d2-bc74-67d8b871d92f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:15.056164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c994f-549a-4a6f-b1bd-d54ae0603931 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:15.070061 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3214/6420] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:15.070293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c994f-549a-4a6f-b1bd-d54ae0603931 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:15.086678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42b64b-175a-4c6a-a553-c0e794066636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:15.087416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42b64b-175a-4c6a-a553-c0e794066636 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:15.087728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42b64b-175a-4c6a-a553-c0e794066636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:15.088272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42b64b-175a-4c6a-a553-c0e794066636 admin admin] PATH_INFO: `/v3/projects/c69f1522847c4d2888daa0afabff195c/users/0d72553c40a04829b90ee4877f3b8a40/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:15.110183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42b64b-175a-4c6a-a553-c0e794066636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69f1522847c4d2888daa0afabff195c, user_id=0d72553c40a04829b90ee4877f3b8a40, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:15.113351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42b64b-175a-4c6a-a553-c0e794066636 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:15.130478 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3207/6421] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:15 2022] PUT /identity/v3/projects/c69f1522847c4d2888daa0afabff195c/users/0d72553c40a04829b90ee4877f3b8a40/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:49:15.135483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c2d28-7594-49e1-a136-5b0b1bbfdcc8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:15.136338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c2d28-7594-49e1-a136-5b0b1bbfdcc8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:15.136890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c2d28-7594-49e1-a136-5b0b1bbfdcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:15.168358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-639c2d28-7594-49e1-a136-5b0b1bbfdcc8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:15.171385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-639c2d28-7594-49e1-a136-5b0b1bbfdcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:15.293888 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3215/6422] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:15.294732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42b64b-175a-4c6a-a553-c0e794066636 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:15.296581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d42b64b-175a-4c6a-a553-c0e794066636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:15.411575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42b64b-175a-4c6a-a553-c0e794066636 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:15.417235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c5bc6-17e9-4f0c-8d4f-8c6011c6a17c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:15.417888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c5bc6-17e9-4f0c-8d4f-8c6011c6a17c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:15.418172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c5bc6-17e9-4f0c-8d4f-8c6011c6a17c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:15.418501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c5bc6-17e9-4f0c-8d4f-8c6011c6a17c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:15.429299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c5bc6-17e9-4f0c-8d4f-8c6011c6a17c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:15.430776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c5bc6-17e9-4f0c-8d4f-8c6011c6a17c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:15.443791 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3208/6423] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:15.697849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c2d28-7594-49e1-a136-5b0b1bbfdcc8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:15.700270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-639c2d28-7594-49e1-a136-5b0b1bbfdcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:15.721905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c2d28-7594-49e1-a136-5b0b1bbfdcc8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:15.736225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa46907-160e-446b-8098-7efb45072d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:15.736810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa46907-160e-446b-8098-7efb45072d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:15.737088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa46907-160e-446b-8098-7efb45072d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:15.737364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa46907-160e-446b-8098-7efb45072d65 admin admin] PATH_INFO: `/v3/users/27459faea15d4d699cabaa82ff68f3c7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:15.740606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa46907-160e-446b-8098-7efb45072d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27459faea15d4d699cabaa82ff68f3c7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:15.742500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa46907-160e-446b-8098-7efb45072d65 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:15.871099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dfa46907-160e-446b-8098-7efb45072d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27459faea15d4d699cabaa82ff68f3c7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:15.915075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dfa46907-160e-446b-8098-7efb45072d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27459faea15d4d699cabaa82ff68f3c7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:15.916318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dfa46907-160e-446b-8098-7efb45072d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27459faea15d4d699cabaa82ff68f3c7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:15.916952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dfa46907-160e-446b-8098-7efb45072d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27459faea15d4d699cabaa82ff68f3c7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:15.933391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dfa46907-160e-446b-8098-7efb45072d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27459faea15d4d699cabaa82ff68f3c7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:15.989884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02f7eb-ecc8-405d-89db-562dd7c22e26 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:15.990528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02f7eb-ecc8-405d-89db-562dd7c22e26 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:15.990528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02f7eb-ecc8-405d-89db-562dd7c22e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:15.994363 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3216/6424] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:15 2022] DELETE /identity/v3/users/27459faea15d4d699cabaa82ff68f3c7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:16.041961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa46907-160e-446b-8098-7efb45072d65 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:16.043119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4e02f7eb-ecc8-405d-89db-562dd7c22e26 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:16.043585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dfa46907-160e-446b-8098-7efb45072d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:16.054645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e02f7eb-ecc8-405d-89db-562dd7c22e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:16.133163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:16.205700 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3209/6425] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:16.242224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa46907-160e-446b-8098-7efb45072d65 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:16.255744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175201f-2c8c-4bde-8956-fd9b5e81dd48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:16.258788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175201f-2c8c-4bde-8956-fd9b5e81dd48 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:16.263423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175201f-2c8c-4bde-8956-fd9b5e81dd48 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:16.265378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175201f-2c8c-4bde-8956-fd9b5e81dd48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:16.269275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7175201f-2c8c-4bde-8956-fd9b5e81dd48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:16.311358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175201f-2c8c-4bde-8956-fd9b5e81dd48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:16.315271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175201f-2c8c-4bde-8956-fd9b5e81dd48 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:16.334468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02f7eb-ecc8-405d-89db-562dd7c22e26 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:16.336645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e02f7eb-ecc8-405d-89db-562dd7c22e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:16.356543 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3217/6426] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:49:16.366683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02f7eb-ecc8-405d-89db-562dd7c22e26 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:16.376098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cffef8-9bed-471a-ac78-255c56a29674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:16.376742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cffef8-9bed-471a-ac78-255c56a29674 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:16.379208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cffef8-9bed-471a-ac78-255c56a29674 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:16.379681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cffef8-9bed-471a-ac78-255c56a29674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:16.409738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cffef8-9bed-471a-ac78-255c56a29674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:16.415152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cffef8-9bed-471a-ac78-255c56a29674 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:16.444699 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3210/6427] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:49:17.718987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175201f-2c8c-4bde-8956-fd9b5e81dd48 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:17.720767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7175201f-2c8c-4bde-8956-fd9b5e81dd48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:17.767103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175201f-2c8c-4bde-8956-fd9b5e81dd48 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:17.784776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5286b-7776-43c7-9faf-d0064d645ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:17.786312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5286b-7776-43c7-9faf-d0064d645ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:17.788086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5286b-7776-43c7-9faf-d0064d645ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:17.788541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5286b-7776-43c7-9faf-d0064d645ee5 admin admin] PATH_INFO: `/v3/projects/351ed8be4d18448f898371207b383458` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:17.794384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5286b-7776-43c7-9faf-d0064d645ee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=351ed8be4d18448f898371207b383458)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:17.796608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5286b-7776-43c7-9faf-d0064d645ee5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:17.900255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c9d5286b-7776-43c7-9faf-d0064d645ee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351ed8be4d18448f898371207b383458', 'request_id': 'req-c9d5286b-7776-43c7-9faf-d0064d645ee5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:17.911910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c9d5286b-7776-43c7-9faf-d0064d645ee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351ed8be4d18448f898371207b383458', 'request_id': 'req-c9d5286b-7776-43c7-9faf-d0064d645ee5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:17.929888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c9d5286b-7776-43c7-9faf-d0064d645ee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351ed8be4d18448f898371207b383458', 'request_id': 'req-c9d5286b-7776-43c7-9faf-d0064d645ee5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:17.955994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c9d5286b-7776-43c7-9faf-d0064d645ee5 admin admin] The token cache is being invalidate because project 351ed8be4d18448f898371207b383458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:17.956537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c9d5286b-7776-43c7-9faf-d0064d645ee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:17.957491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c9d5286b-7776-43c7-9faf-d0064d645ee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:17.960869 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3218/6428] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:17 2022] DELETE /identity/v3/projects/351ed8be4d18448f898371207b383458 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:17.963866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cffef8-9bed-471a-ac78-255c56a29674 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:17.979770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cffef8-9bed-471a-ac78-255c56a29674 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:18.019764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:18.172969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be3231-fc94-46f2-ab29-41f73624c95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:18.172969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be3231-fc94-46f2-ab29-41f73624c95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:18.173290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be3231-fc94-46f2-ab29-41f73624c95d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:18.173616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be3231-fc94-46f2-ab29-41f73624c95d admin admin] PATH_INFO: `/v3/users/75b1726b4e944f8db957eaa65e8d7811` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:18.179428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be3231-fc94-46f2-ab29-41f73624c95d admin admin] RBAC: Authorizing `identity:delete_user(user_id=75b1726b4e944f8db957eaa65e8d7811)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:18.181518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be3231-fc94-46f2-ab29-41f73624c95d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:18.320400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-16be3231-fc94-46f2-ab29-41f73624c95d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75b1726b4e944f8db957eaa65e8d7811'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:18.323634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-16be3231-fc94-46f2-ab29-41f73624c95d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75b1726b4e944f8db957eaa65e8d7811'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:18.356807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-16be3231-fc94-46f2-ab29-41f73624c95d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75b1726b4e944f8db957eaa65e8d7811'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:18.374339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-16be3231-fc94-46f2-ab29-41f73624c95d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75b1726b4e944f8db957eaa65e8d7811'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:18.399564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-16be3231-fc94-46f2-ab29-41f73624c95d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75b1726b4e944f8db957eaa65e8d7811'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:18.412996 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3211/6429] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:17 2022] DELETE /identity/v3/users/75b1726b4e944f8db957eaa65e8d7811 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:19.960958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5286b-7776-43c7-9faf-d0064d645ee5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:19.963092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c9d5286b-7776-43c7-9faf-d0064d645ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:20.011068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5286b-7776-43c7-9faf-d0064d645ee5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:20.240585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d4932-5605-49d5-adc4-0f5254654ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:20.241478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d4932-5605-49d5-adc4-0f5254654ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:20.241767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d4932-5605-49d5-adc4-0f5254654ece admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:20.242046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d4932-5605-49d5-adc4-0f5254654ece admin admin] PATH_INFO: `/v3/projects/9875f13edcfb4f72ac2c605aebe1aa55` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:20.245270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d4932-5605-49d5-adc4-0f5254654ece admin admin] RBAC: Authorizing `identity:delete_project(project_id=9875f13edcfb4f72ac2c605aebe1aa55)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:20.248410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d4932-5605-49d5-adc4-0f5254654ece admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:20.366107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-391d4932-5605-49d5-adc4-0f5254654ece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9875f13edcfb4f72ac2c605aebe1aa55', 'request_id': 'req-391d4932-5605-49d5-adc4-0f5254654ece'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:20.376247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-391d4932-5605-49d5-adc4-0f5254654ece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9875f13edcfb4f72ac2c605aebe1aa55', 'request_id': 'req-391d4932-5605-49d5-adc4-0f5254654ece'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:20.378460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:20.391267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-391d4932-5605-49d5-adc4-0f5254654ece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9875f13edcfb4f72ac2c605aebe1aa55', 'request_id': 'req-391d4932-5605-49d5-adc4-0f5254654ece'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:20.416792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-391d4932-5605-49d5-adc4-0f5254654ece admin admin] The token cache is being invalidate because project 9875f13edcfb4f72ac2c605aebe1aa55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:20.417161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-391d4932-5605-49d5-adc4-0f5254654ece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:20.420359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-391d4932-5605-49d5-adc4-0f5254654ece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:20.422139 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3219/6430] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:19 2022] DELETE /identity/v3/projects/9875f13edcfb4f72ac2c605aebe1aa55 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:20.426959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b78f9-3622-414d-acc7-d99fec3034c8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:20.427515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b78f9-3622-414d-acc7-d99fec3034c8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:20.427865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b78f9-3622-414d-acc7-d99fec3034c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:20.486981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-701b78f9-3622-414d-acc7-d99fec3034c8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:20.493564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-701b78f9-3622-414d-acc7-d99fec3034c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:20.731814 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3212/6431] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:20.738708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb608c10-f298-4ef6-b1cd-c5292756adc9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:20.739511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb608c10-f298-4ef6-b1cd-c5292756adc9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:20.739511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb608c10-f298-4ef6-b1cd-c5292756adc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:20.785219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-eb608c10-f298-4ef6-b1cd-c5292756adc9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:20.786541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eb608c10-f298-4ef6-b1cd-c5292756adc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:20.803664 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3220/6432] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:20.808158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b78f9-3622-414d-acc7-d99fec3034c8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:20.821853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b78f9-3622-414d-acc7-d99fec3034c8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:20.845404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf89cfe-5f9b-4486-9a5a-da60b6e74b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:20.846046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf89cfe-5f9b-4486-9a5a-da60b6e74b1d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:20.846327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf89cfe-5f9b-4486-9a5a-da60b6e74b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:20.846603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf89cfe-5f9b-4486-9a5a-da60b6e74b1d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:20.847329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf89cfe-5f9b-4486-9a5a-da60b6e74b1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:49:20.847593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf89cfe-5f9b-4486-9a5a-da60b6e74b1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:20.852009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf89cfe-5f9b-4486-9a5a-da60b6e74b1d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:20.887764 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3213/6433] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:20.892286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb608c10-f298-4ef6-b1cd-c5292756adc9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:20.905760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb608c10-f298-4ef6-b1cd-c5292756adc9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:20.925474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba06fe-01c7-4ee7-a68e-674e031f47fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:20.930325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba06fe-01c7-4ee7-a68e-674e031f47fe admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:20.930638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba06fe-01c7-4ee7-a68e-674e031f47fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:20.930922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba06fe-01c7-4ee7-a68e-674e031f47fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:20.931802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba06fe-01c7-4ee7-a68e-674e031f47fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:20.947644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba06fe-01c7-4ee7-a68e-674e031f47fe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:21.035402 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3221/6434] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:20 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:21.039502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf89cfe-5f9b-4486-9a5a-da60b6e74b1d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:21.069853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf89cfe-5f9b-4486-9a5a-da60b6e74b1d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:21.186728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:21.263404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f50efb-bd70-4496-8aec-8e43b55f9b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:21.271372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f50efb-bd70-4496-8aec-8e43b55f9b86 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:21.271958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f50efb-bd70-4496-8aec-8e43b55f9b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:21.272383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f50efb-bd70-4496-8aec-8e43b55f9b86 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:21.273372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f50efb-bd70-4496-8aec-8e43b55f9b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:21.275536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f50efb-bd70-4496-8aec-8e43b55f9b86 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:21.323783 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3214/6435] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:21 2022] POST /identity/v3/users => generated 289 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:21.324800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba06fe-01c7-4ee7-a68e-674e031f47fe admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:21.358726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba06fe-01c7-4ee7-a68e-674e031f47fe admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:21.370333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ec92a-a6fa-4c4d-a883-3e886b5eab8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:21.371914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ec92a-a6fa-4c4d-a883-3e886b5eab8f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:21.372364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ec92a-a6fa-4c4d-a883-3e886b5eab8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:21.373064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ec92a-a6fa-4c4d-a883-3e886b5eab8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:21.374555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ec92a-a6fa-4c4d-a883-3e886b5eab8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:21.380366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ec92a-a6fa-4c4d-a883-3e886b5eab8f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:21.421471 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3222/6436] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:49:21.422518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f50efb-bd70-4496-8aec-8e43b55f9b86 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:21.438079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f50efb-bd70-4496-8aec-8e43b55f9b86 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:21.449902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f037d-d970-41be-99ae-7c1c1a25de94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:21.450537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f037d-d970-41be-99ae-7c1c1a25de94 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:21.450812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f037d-d970-41be-99ae-7c1c1a25de94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:21.451433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f037d-d970-41be-99ae-7c1c1a25de94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:21.457130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f037d-d970-41be-99ae-7c1c1a25de94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:21.459519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f037d-d970-41be-99ae-7c1c1a25de94 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:21.502702 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3215/6437] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:49:21.504253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ec92a-a6fa-4c4d-a883-3e886b5eab8f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:21.523954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ec92a-a6fa-4c4d-a883-3e886b5eab8f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:21.533547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f57aa5-9c24-4db8-977c-ad6f59550083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:21.534282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f57aa5-9c24-4db8-977c-ad6f59550083 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:21.534566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f57aa5-9c24-4db8-977c-ad6f59550083 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:21.534844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f57aa5-9c24-4db8-977c-ad6f59550083 admin admin] PATH_INFO: `/v3/projects/c1a372ff89484afeb599f24d78ef3cee/users/6bf32dbaf675466bbe099f01e17b5fc6/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:21.582977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f57aa5-9c24-4db8-977c-ad6f59550083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a372ff89484afeb599f24d78ef3cee, user_id=6bf32dbaf675466bbe099f01e17b5fc6, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:21.589677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f57aa5-9c24-4db8-977c-ad6f59550083 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:21.653641 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3223/6438] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:21 2022] PUT /identity/v3/projects/c1a372ff89484afeb599f24d78ef3cee/users/6bf32dbaf675466bbe099f01e17b5fc6/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:21.655074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fa6bf-de29-46b6-aa6a-1eead1794f32 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:21.655569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fa6bf-de29-46b6-aa6a-1eead1794f32 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:21.656002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fa6bf-de29-46b6-aa6a-1eead1794f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:21.731899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-af8fa6bf-de29-46b6-aa6a-1eead1794f32 None None] MFA Rules not processed for user `6bf32dbaf675466bbe099f01e17b5fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:21.733575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af8fa6bf-de29-46b6-aa6a-1eead1794f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:21.894316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f57aa5-9c24-4db8-977c-ad6f59550083 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:21.894518 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3216/6439] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:22.019089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f57aa5-9c24-4db8-977c-ad6f59550083 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:22.026416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18990db4-0b73-46d4-bbb5-56c140811cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:22.027454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18990db4-0b73-46d4-bbb5-56c140811cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:22.027834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18990db4-0b73-46d4-bbb5-56c140811cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:22.028387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18990db4-0b73-46d4-bbb5-56c140811cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:22.029158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18990db4-0b73-46d4-bbb5-56c140811cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:22.031297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18990db4-0b73-46d4-bbb5-56c140811cf7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:22.074959 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3224/6440] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:21 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:49:22.078873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fa6bf-de29-46b6-aa6a-1eead1794f32 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:22.096095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fa6bf-de29-46b6-aa6a-1eead1794f32 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:22.310014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f9202-e422-4dad-a71b-3777e43856c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:22.310970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f9202-e422-4dad-a71b-3777e43856c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:22.322742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f9202-e422-4dad-a71b-3777e43856c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:22.324174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f9202-e422-4dad-a71b-3777e43856c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:22.325028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f9202-e422-4dad-a71b-3777e43856c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:22.331189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f9202-e422-4dad-a71b-3777e43856c3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:22.381647 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3217/6441] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:22 2022] POST /identity/v3/users => generated 289 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:22.385449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18990db4-0b73-46d4-bbb5-56c140811cf7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:22.424743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18990db4-0b73-46d4-bbb5-56c140811cf7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:22.441880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cc28a-b823-476f-bd08-a1c72f777c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:22.442452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cc28a-b823-476f-bd08-a1c72f777c15 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:22.452304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cc28a-b823-476f-bd08-a1c72f777c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:22.452649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cc28a-b823-476f-bd08-a1c72f777c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:22.453355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cc28a-b823-476f-bd08-a1c72f777c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:22.463066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cc28a-b823-476f-bd08-a1c72f777c15 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:22.507551 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3225/6442] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:22.512536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f9202-e422-4dad-a71b-3777e43856c3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:22.567436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f9202-e422-4dad-a71b-3777e43856c3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:22.581927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b392da-7a9e-4759-84ca-83c5268fa485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:22.583192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b392da-7a9e-4759-84ca-83c5268fa485 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:22.583587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b392da-7a9e-4759-84ca-83c5268fa485 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:22.584129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b392da-7a9e-4759-84ca-83c5268fa485 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:22.584919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b392da-7a9e-4759-84ca-83c5268fa485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:22.589759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b392da-7a9e-4759-84ca-83c5268fa485 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:22.621805 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3218/6443] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:49:22.622614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cc28a-b823-476f-bd08-a1c72f777c15 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:22.642018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cc28a-b823-476f-bd08-a1c72f777c15 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:22.665823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf943e9f-9f65-4324-83c5-524900c1653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:22.666511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf943e9f-9f65-4324-83c5-524900c1653c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:22.666796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf943e9f-9f65-4324-83c5-524900c1653c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:22.667072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf943e9f-9f65-4324-83c5-524900c1653c admin admin] PATH_INFO: `/v3/projects/b117696af2cb4979aa3cf22f7f559134/users/314a7fe7cda54ecfb073d59af20898bf/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:22.742017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf943e9f-9f65-4324-83c5-524900c1653c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b117696af2cb4979aa3cf22f7f559134, user_id=314a7fe7cda54ecfb073d59af20898bf, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:22.744947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf943e9f-9f65-4324-83c5-524900c1653c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:22.781958 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3226/6444] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:22 2022] PUT /identity/v3/projects/b117696af2cb4979aa3cf22f7f559134/users/314a7fe7cda54ecfb073d59af20898bf/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:49:22.794275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c920d27-8434-4ada-9d94-f37bc7954cd0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:22.794522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c920d27-8434-4ada-9d94-f37bc7954cd0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:22.794692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c920d27-8434-4ada-9d94-f37bc7954cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:22.865015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:22.868608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6c920d27-8434-4ada-9d94-f37bc7954cd0 None None] MFA Rules not processed for user `314a7fe7cda54ecfb073d59af20898bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:22.869893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6c920d27-8434-4ada-9d94-f37bc7954cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:23.133509 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3219/6445] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:23.133618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf943e9f-9f65-4324-83c5-524900c1653c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:23.196305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:23.267311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf943e9f-9f65-4324-83c5-524900c1653c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:23.278659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc51980-0703-488d-9e40-1a0319963695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:23.279335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc51980-0703-488d-9e40-1a0319963695 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:23.279614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc51980-0703-488d-9e40-1a0319963695 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:23.280060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc51980-0703-488d-9e40-1a0319963695 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:23.280873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc51980-0703-488d-9e40-1a0319963695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:23.283079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc51980-0703-488d-9e40-1a0319963695 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:23.349417 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3227/6446] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:23 2022] POST /identity/v3/projects => generated 375 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:23.353215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c920d27-8434-4ada-9d94-f37bc7954cd0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:23.373095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c920d27-8434-4ada-9d94-f37bc7954cd0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:23.538338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a459d-606e-432c-8010-332e0856753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:23.538905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a459d-606e-432c-8010-332e0856753d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:23.539138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a459d-606e-432c-8010-332e0856753d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:23.539443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a459d-606e-432c-8010-332e0856753d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:23.540085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a459d-606e-432c-8010-332e0856753d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:23.542865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a459d-606e-432c-8010-332e0856753d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:23.589540 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3220/6447] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:23 2022] POST /identity/v3/users => generated 294 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:23.590146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc51980-0703-488d-9e40-1a0319963695 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:23.605208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc51980-0703-488d-9e40-1a0319963695 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:23.618437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd4ba6-19e8-4f3e-a41a-13a8d1ec97ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:23.619430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd4ba6-19e8-4f3e-a41a-13a8d1ec97ff admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:23.620098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd4ba6-19e8-4f3e-a41a-13a8d1ec97ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:23.620098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd4ba6-19e8-4f3e-a41a-13a8d1ec97ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:23.621165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd4ba6-19e8-4f3e-a41a-13a8d1ec97ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:23.622773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd4ba6-19e8-4f3e-a41a-13a8d1ec97ff admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:23.648794 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3228/6448] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:49:23.653046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a459d-606e-432c-8010-332e0856753d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:23.665848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a459d-606e-432c-8010-332e0856753d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:23.680315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fdce8-f1c3-4d29-be0a-0845a5b0fe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:23.681088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fdce8-f1c3-4d29-be0a-0845a5b0fe0e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:23.681436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fdce8-f1c3-4d29-be0a-0845a5b0fe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:23.681972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fdce8-f1c3-4d29-be0a-0845a5b0fe0e admin admin] PATH_INFO: `/v3/projects/f1b3d02ac93d48bba31b050d6402b9a1/users/08d9f476db9c4940b5c0f879405148e0/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:23.746478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fdce8-f1c3-4d29-be0a-0845a5b0fe0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b3d02ac93d48bba31b050d6402b9a1, user_id=08d9f476db9c4940b5c0f879405148e0, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:23.749591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fdce8-f1c3-4d29-be0a-0845a5b0fe0e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:23.782930 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3221/6449] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:23 2022] PUT /identity/v3/projects/f1b3d02ac93d48bba31b050d6402b9a1/users/08d9f476db9c4940b5c0f879405148e0/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:23.787800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd4ba6-19e8-4f3e-a41a-13a8d1ec97ff admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:23.803399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd4ba6-19e8-4f3e-a41a-13a8d1ec97ff admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:23.956806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3cb17-e2e8-4c73-8af8-81d73b3b046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:23.957527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3cb17-e2e8-4c73-8af8-81d73b3b046e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:23.958362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3cb17-e2e8-4c73-8af8-81d73b3b046e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:23.958362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3cb17-e2e8-4c73-8af8-81d73b3b046e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:23.959077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3cb17-e2e8-4c73-8af8-81d73b3b046e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:23.961059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3cb17-e2e8-4c73-8af8-81d73b3b046e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:23.981374 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3229/6450] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:49:23.986999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fdce8-f1c3-4d29-be0a-0845a5b0fe0e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:24.004161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fdce8-f1c3-4d29-be0a-0845a5b0fe0e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:24.023439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5874e7-ddcd-4c8f-a9e2-d1502096fa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:24.026928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5874e7-ddcd-4c8f-a9e2-d1502096fa5b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:24.027286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5874e7-ddcd-4c8f-a9e2-d1502096fa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:24.027620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5874e7-ddcd-4c8f-a9e2-d1502096fa5b admin admin] PATH_INFO: `/v3/projects/f1b3d02ac93d48bba31b050d6402b9a1/users/08d9f476db9c4940b5c0f879405148e0/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:24.032160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5874e7-ddcd-4c8f-a9e2-d1502096fa5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b3d02ac93d48bba31b050d6402b9a1, user_id=08d9f476db9c4940b5c0f879405148e0, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:24.040171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5874e7-ddcd-4c8f-a9e2-d1502096fa5b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:24.068915 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3222/6451] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:23 2022] PUT /identity/v3/projects/f1b3d02ac93d48bba31b050d6402b9a1/users/08d9f476db9c4940b5c0f879405148e0/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:24.079739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2435-70df-45cf-b314-ecc6d2c71ed3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:24.080092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2435-70df-45cf-b314-ecc6d2c71ed3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:24.080441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2435-70df-45cf-b314-ecc6d2c71ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:24.160454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-583b2435-70df-45cf-b314-ecc6d2c71ed3 None None] MFA Rules not processed for user `08d9f476db9c4940b5c0f879405148e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:24.161667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-583b2435-70df-45cf-b314-ecc6d2c71ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:24.367854 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3230/6452] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:24.380259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5874e7-ddcd-4c8f-a9e2-d1502096fa5b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:24.384280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a5874e7-ddcd-4c8f-a9e2-d1502096fa5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:24.520488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5874e7-ddcd-4c8f-a9e2-d1502096fa5b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:24.535474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4f0df-ed1e-49fc-9057-a9e69d184e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:24.536177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4f0df-ed1e-49fc-9057-a9e69d184e2a service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:24.546945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4f0df-ed1e-49fc-9057-a9e69d184e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:24.547679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4f0df-ed1e-49fc-9057-a9e69d184e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:24.584744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:24.706118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4f0df-ed1e-49fc-9057-a9e69d184e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:24.708211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4f0df-ed1e-49fc-9057-a9e69d184e2a service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:24.731730 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3223/6453] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:27.686196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9f49d-080e-4867-84a5-7d2577056b1c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:27.686707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9f49d-080e-4867-84a5-7d2577056b1c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:27.686929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9f49d-080e-4867-84a5-7d2577056b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:27.774159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-96b9f49d-080e-4867-84a5-7d2577056b1c None None] MFA Rules not processed for user `0d72553c40a04829b90ee4877f3b8a40`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:27.776433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-96b9f49d-080e-4867-84a5-7d2577056b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:27.798497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:27.868870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4f0df-ed1e-49fc-9057-a9e69d184e2a service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:27.872014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dfc4f0df-ed1e-49fc-9057-a9e69d184e2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:27.973199 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3231/6454] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:28.079309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4f0df-ed1e-49fc-9057-a9e69d184e2a service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:28.094739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8d81d-1dad-4084-954e-cfaf0240adf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:28.097955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8d81d-1dad-4084-954e-cfaf0240adf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:28.098831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8d81d-1dad-4084-954e-cfaf0240adf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:28.098937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8d81d-1dad-4084-954e-cfaf0240adf9 admin admin] PATH_INFO: `/v3/users/f85cbb2c929e4f949c57e1331e046464` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:28.101072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8d81d-1dad-4084-954e-cfaf0240adf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85cbb2c929e4f949c57e1331e046464)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:28.106615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8d81d-1dad-4084-954e-cfaf0240adf9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:28.142025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9f49d-080e-4867-84a5-7d2577056b1c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:28.155411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9f49d-080e-4867-84a5-7d2577056b1c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:28.172253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb2f5a-3634-4156-9829-97e5945c5149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:28.181377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb2f5a-3634-4156-9829-97e5945c5149 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:28.181377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb2f5a-3634-4156-9829-97e5945c5149 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:28.181377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb2f5a-3634-4156-9829-97e5945c5149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:28.200682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39b8d81d-1dad-4084-954e-cfaf0240adf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85cbb2c929e4f949c57e1331e046464'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:28.201384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39b8d81d-1dad-4084-954e-cfaf0240adf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85cbb2c929e4f949c57e1331e046464'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:28.209744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39b8d81d-1dad-4084-954e-cfaf0240adf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85cbb2c929e4f949c57e1331e046464'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:28.230739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39b8d81d-1dad-4084-954e-cfaf0240adf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85cbb2c929e4f949c57e1331e046464'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:28.257188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39b8d81d-1dad-4084-954e-cfaf0240adf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85cbb2c929e4f949c57e1331e046464'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:28.274253 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3224/6455] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:27 2022] DELETE /identity/v3/users/f85cbb2c929e4f949c57e1331e046464 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:49:28.282041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f00a9-8e5c-41c6-a6a9-12dce946eea5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:28.282320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f00a9-8e5c-41c6-a6a9-12dce946eea5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:28.282592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f00a9-8e5c-41c6-a6a9-12dce946eea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:28.304532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb2f5a-3634-4156-9829-97e5945c5149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:28.307447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb2f5a-3634-4156-9829-97e5945c5149 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:28.312016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c13f00a9-8e5c-41c6-a6a9-12dce946eea5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:28.313369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c13f00a9-8e5c-41c6-a6a9-12dce946eea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:28.331857 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3232/6456] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:28.373346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:28.474916 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3225/6457] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:28.479166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb2f5a-3634-4156-9829-97e5945c5149 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:28.480805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-97cb2f5a-3634-4156-9829-97e5945c5149 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:28.594235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb2f5a-3634-4156-9829-97e5945c5149 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:28.732279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ff72d-0b21-4dc6-8552-55d92b31503f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:28.733063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff72d-0b21-4dc6-8552-55d92b31503f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:28.733356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff72d-0b21-4dc6-8552-55d92b31503f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:28.733774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff72d-0b21-4dc6-8552-55d92b31503f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:28.752524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ff72d-0b21-4dc6-8552-55d92b31503f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:28.754004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ff72d-0b21-4dc6-8552-55d92b31503f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:28.778213 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3233/6458] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:29.504262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f00a9-8e5c-41c6-a6a9-12dce946eea5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:29.508134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c13f00a9-8e5c-41c6-a6a9-12dce946eea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:29.530898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f00a9-8e5c-41c6-a6a9-12dce946eea5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:29.539857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a0e73-141b-4acf-a556-b7dd1be524c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:29.541064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a0e73-141b-4acf-a556-b7dd1be524c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:29.541781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a0e73-141b-4acf-a556-b7dd1be524c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:29.542988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a0e73-141b-4acf-a556-b7dd1be524c2 admin admin] PATH_INFO: `/v3/projects/da4d40ee9cf941248ffceb2a4448a73c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:29.545562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a0e73-141b-4acf-a556-b7dd1be524c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da4d40ee9cf941248ffceb2a4448a73c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:29.549231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a0e73-141b-4acf-a556-b7dd1be524c2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:29.644013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f7a0e73-141b-4acf-a556-b7dd1be524c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da4d40ee9cf941248ffceb2a4448a73c', 'request_id': 'req-2f7a0e73-141b-4acf-a556-b7dd1be524c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:29.660174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f7a0e73-141b-4acf-a556-b7dd1be524c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da4d40ee9cf941248ffceb2a4448a73c', 'request_id': 'req-2f7a0e73-141b-4acf-a556-b7dd1be524c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:29.681064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f7a0e73-141b-4acf-a556-b7dd1be524c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da4d40ee9cf941248ffceb2a4448a73c', 'request_id': 'req-2f7a0e73-141b-4acf-a556-b7dd1be524c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:29.702930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f7a0e73-141b-4acf-a556-b7dd1be524c2 admin admin] The token cache is being invalidate because project da4d40ee9cf941248ffceb2a4448a73c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:29.703625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f7a0e73-141b-4acf-a556-b7dd1be524c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:29.704513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f7a0e73-141b-4acf-a556-b7dd1be524c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:29.707696 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3226/6459] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:29 2022] DELETE /identity/v3/projects/da4d40ee9cf941248ffceb2a4448a73c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:29.711559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e81b8-cee0-4698-8c20-c3a487d12f13 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:29.712329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e81b8-cee0-4698-8c20-c3a487d12f13 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:29.712818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e81b8-cee0-4698-8c20-c3a487d12f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:29.737574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4a4e81b8-cee0-4698-8c20-c3a487d12f13 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:29.739760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4a4e81b8-cee0-4698-8c20-c3a487d12f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:29.749129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:29.872193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a0e73-141b-4acf-a556-b7dd1be524c2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:29.874049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2f7a0e73-141b-4acf-a556-b7dd1be524c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:29.899224 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3234/6460] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:29.905379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faac2a3-8b47-46e5-9262-1670890f801a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:29.908897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faac2a3-8b47-46e5-9262-1670890f801a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:29.909285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faac2a3-8b47-46e5-9262-1670890f801a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:29.971149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0faac2a3-8b47-46e5-9262-1670890f801a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:29.977894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0faac2a3-8b47-46e5-9262-1670890f801a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:30.004249 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3235/6461] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:30.016936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faac2a3-8b47-46e5-9262-1670890f801a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:30.039116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a0e73-141b-4acf-a556-b7dd1be524c2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:30.049274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49ad83-ecfd-48bc-ab7e-45eead15eff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:30.050292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ad83-ecfd-48bc-ab7e-45eead15eff4 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:30.051206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ad83-ecfd-48bc-ab7e-45eead15eff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:30.052592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ad83-ecfd-48bc-ab7e-45eead15eff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:30.055006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faac2a3-8b47-46e5-9262-1670890f801a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:30.061596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-da49ad83-ecfd-48bc-ab7e-45eead15eff4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:30.062132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9329a-e3d9-4ce6-bea5-93ac2693bbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:30.062951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9329a-e3d9-4ce6-bea5-93ac2693bbca admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:30.063430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9329a-e3d9-4ce6-bea5-93ac2693bbca admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:30.063897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9329a-e3d9-4ce6-bea5-93ac2693bbca admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:30.064970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9329a-e3d9-4ce6-bea5-93ac2693bbca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:49:30.065718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9329a-e3d9-4ce6-bea5-93ac2693bbca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:30.071489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9329a-e3d9-4ce6-bea5-93ac2693bbca admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:30.099074 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3236/6462] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:30.100596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9329a-e3d9-4ce6-bea5-93ac2693bbca admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:30.115371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9329a-e3d9-4ce6-bea5-93ac2693bbca admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:30.121148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442fe7a-78b0-4940-88e5-a0f80f117425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:30.122001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442fe7a-78b0-4940-88e5-a0f80f117425 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:30.122583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442fe7a-78b0-4940-88e5-a0f80f117425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:30.123001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442fe7a-78b0-4940-88e5-a0f80f117425 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:30.124423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442fe7a-78b0-4940-88e5-a0f80f117425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:30.127223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442fe7a-78b0-4940-88e5-a0f80f117425 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:30.179498 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3237/6463] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:30 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:30.184560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442fe7a-78b0-4940-88e5-a0f80f117425 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:30.188108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f442fe7a-78b0-4940-88e5-a0f80f117425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:30.242364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49ad83-ecfd-48bc-ab7e-45eead15eff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:30.244031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49ad83-ecfd-48bc-ab7e-45eead15eff4 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:30.265562 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3227/6464] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:49:30.266607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49ad83-ecfd-48bc-ab7e-45eead15eff4 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:30.282797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:30.297530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49ad83-ecfd-48bc-ab7e-45eead15eff4 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:30.403968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442fe7a-78b0-4940-88e5-a0f80f117425 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:30.429317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78275a91-d643-4302-8bf0-23fd75a2db4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:30.430298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78275a91-d643-4302-8bf0-23fd75a2db4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:30.431998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78275a91-d643-4302-8bf0-23fd75a2db4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:30.432426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78275a91-d643-4302-8bf0-23fd75a2db4b admin admin] PATH_INFO: `/v3/users/857cb1994afa417ca5f03e5e82b9167a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:30.435103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255060f-d2e0-4d88-9532-a53dfbccbeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:30.435970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78275a91-d643-4302-8bf0-23fd75a2db4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=857cb1994afa417ca5f03e5e82b9167a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:30.437807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255060f-d2e0-4d88-9532-a53dfbccbeec admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:30.438107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255060f-d2e0-4d88-9532-a53dfbccbeec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:30.438377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255060f-d2e0-4d88-9532-a53dfbccbeec admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:30.439028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255060f-d2e0-4d88-9532-a53dfbccbeec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:30.444825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255060f-d2e0-4d88-9532-a53dfbccbeec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:30.445591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78275a91-d643-4302-8bf0-23fd75a2db4b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:30.513087 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3228/6465] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:30 2022] POST /identity/v3/users => generated 284 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:30.524391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255060f-d2e0-4d88-9532-a53dfbccbeec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:30.558066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255060f-d2e0-4d88-9532-a53dfbccbeec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:30.575543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7409ce-c038-416b-aa88-a01b95619d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:30.576186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7409ce-c038-416b-aa88-a01b95619d27 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:30.576470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7409ce-c038-416b-aa88-a01b95619d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:30.576748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7409ce-c038-416b-aa88-a01b95619d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:30.578560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7409ce-c038-416b-aa88-a01b95619d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:30.581183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78275a91-d643-4302-8bf0-23fd75a2db4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857cb1994afa417ca5f03e5e82b9167a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:30.582001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7409ce-c038-416b-aa88-a01b95619d27 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:30.610818 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3229/6466] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:30.610960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78275a91-d643-4302-8bf0-23fd75a2db4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857cb1994afa417ca5f03e5e82b9167a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:30.611625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78275a91-d643-4302-8bf0-23fd75a2db4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857cb1994afa417ca5f03e5e82b9167a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:30.612051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7409ce-c038-416b-aa88-a01b95619d27 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:30.612543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78275a91-d643-4302-8bf0-23fd75a2db4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857cb1994afa417ca5f03e5e82b9167a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:30.619963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc7409ce-c038-416b-aa88-a01b95619d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:30.632408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78275a91-d643-4302-8bf0-23fd75a2db4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857cb1994afa417ca5f03e5e82b9167a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:30.634003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:30.646854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7409ce-c038-416b-aa88-a01b95619d27 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:30.658437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682998c-1237-4ae9-9f5c-0f92794e472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:30.659085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682998c-1237-4ae9-9f5c-0f92794e472b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:30.659397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682998c-1237-4ae9-9f5c-0f92794e472b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:30.659680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682998c-1237-4ae9-9f5c-0f92794e472b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:30.662392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682998c-1237-4ae9-9f5c-0f92794e472b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:30.663355 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3238/6467] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:30 2022] DELETE /identity/v3/users/857cb1994afa417ca5f03e5e82b9167a => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:30.669319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682998c-1237-4ae9-9f5c-0f92794e472b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:30.673071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ef88a-5741-49a8-a868-395128bbb7f8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:30.673704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ef88a-5741-49a8-a868-395128bbb7f8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:30.674131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ef88a-5741-49a8-a868-395128bbb7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:30.693030 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3230/6468] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:30.697641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682998c-1237-4ae9-9f5c-0f92794e472b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:30.725304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682998c-1237-4ae9-9f5c-0f92794e472b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:30.744663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fc6ef88a-5741-49a8-a868-395128bbb7f8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:30.745872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fc6ef88a-5741-49a8-a868-395128bbb7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:30.976594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb4ad6-203e-4a12-9bf3-2be792164ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:30.977292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4ad6-203e-4a12-9bf3-2be792164ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:30.977573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4ad6-203e-4a12-9bf3-2be792164ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:30.981646 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3239/6469] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:30.981901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4ad6-203e-4a12-9bf3-2be792164ec0 admin admin] PATH_INFO: `/v3/projects/0ea56372b3a94fd3a90aea92e4b38edc/users/09ed4c684002431ea5eb01341fb71442/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:31.001801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ef88a-5741-49a8-a868-395128bbb7f8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:31.006080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fc6ef88a-5741-49a8-a868-395128bbb7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:31.043385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb4ad6-203e-4a12-9bf3-2be792164ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea56372b3a94fd3a90aea92e4b38edc, user_id=09ed4c684002431ea5eb01341fb71442, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:31.051012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb4ad6-203e-4a12-9bf3-2be792164ec0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:31.076737 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3231/6470] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:30 2022] PUT /identity/v3/projects/0ea56372b3a94fd3a90aea92e4b38edc/users/09ed4c684002431ea5eb01341fb71442/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:49:31.088621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcc547-e381-498d-a591-78234ce26d9b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:31.088849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcc547-e381-498d-a591-78234ce26d9b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:31.089566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcc547-e381-498d-a591-78234ce26d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:31.150683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ef88a-5741-49a8-a868-395128bbb7f8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:31.151548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9fbcc547-e381-498d-a591-78234ce26d9b None None] MFA Rules not processed for user `09ed4c684002431ea5eb01341fb71442`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:31.152816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9fbcc547-e381-498d-a591-78234ce26d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:31.224373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419102e-b89c-4320-b589-7701a2b3da77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:31.225427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419102e-b89c-4320-b589-7701a2b3da77 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:31.225931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419102e-b89c-4320-b589-7701a2b3da77 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:31.227579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419102e-b89c-4320-b589-7701a2b3da77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:31.240724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:31.303463 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3232/6471] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:31.316418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcc547-e381-498d-a591-78234ce26d9b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:31.318830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9fbcc547-e381-498d-a591-78234ce26d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:31.319620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:31.325218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419102e-b89c-4320-b589-7701a2b3da77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:31.326856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419102e-b89c-4320-b589-7701a2b3da77 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:31.341149 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3240/6472] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:31.350432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcc547-e381-498d-a591-78234ce26d9b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:31.360385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154639c1-5e02-488d-8869-8ac1bf448f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:31.361025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154639c1-5e02-488d-8869-8ac1bf448f84 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:31.361307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154639c1-5e02-488d-8869-8ac1bf448f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:31.361584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154639c1-5e02-488d-8869-8ac1bf448f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:31.380381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154639c1-5e02-488d-8869-8ac1bf448f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:31.381864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154639c1-5e02-488d-8869-8ac1bf448f84 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:31.415409 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3233/6473] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:49:32.252747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419102e-b89c-4320-b589-7701a2b3da77 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:32.254820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0419102e-b89c-4320-b589-7701a2b3da77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:32.281975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419102e-b89c-4320-b589-7701a2b3da77 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:32.303221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce8847-e074-4314-8da4-d2d890ee8fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:32.304189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce8847-e074-4314-8da4-d2d890ee8fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:32.304637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce8847-e074-4314-8da4-d2d890ee8fef admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:32.305068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce8847-e074-4314-8da4-d2d890ee8fef admin admin] PATH_INFO: `/v3/projects/3618eda983c4481e980755c8f98078d6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:32.306507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce8847-e074-4314-8da4-d2d890ee8fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3618eda983c4481e980755c8f98078d6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:32.308642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce8847-e074-4314-8da4-d2d890ee8fef admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:32.417743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f5ce8847-e074-4314-8da4-d2d890ee8fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3618eda983c4481e980755c8f98078d6', 'request_id': 'req-f5ce8847-e074-4314-8da4-d2d890ee8fef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:32.434018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f5ce8847-e074-4314-8da4-d2d890ee8fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3618eda983c4481e980755c8f98078d6', 'request_id': 'req-f5ce8847-e074-4314-8da4-d2d890ee8fef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:32.451753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f5ce8847-e074-4314-8da4-d2d890ee8fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3618eda983c4481e980755c8f98078d6', 'request_id': 'req-f5ce8847-e074-4314-8da4-d2d890ee8fef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:32.480379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f5ce8847-e074-4314-8da4-d2d890ee8fef admin admin] The token cache is being invalidate because project 3618eda983c4481e980755c8f98078d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:32.480711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f5ce8847-e074-4314-8da4-d2d890ee8fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:32.493779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f5ce8847-e074-4314-8da4-d2d890ee8fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:32.501441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154639c1-5e02-488d-8869-8ac1bf448f84 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:32.503275 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3241/6474] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:32 2022] DELETE /identity/v3/projects/3618eda983c4481e980755c8f98078d6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:32.554576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154639c1-5e02-488d-8869-8ac1bf448f84 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:32.804873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f37ba9-746e-430a-a66b-de77111a06b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:32.805538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f37ba9-746e-430a-a66b-de77111a06b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:32.805822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f37ba9-746e-430a-a66b-de77111a06b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:32.806092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f37ba9-746e-430a-a66b-de77111a06b2 admin admin] PATH_INFO: `/v3/users/9177d35faf5e412c8118b1cd0598bd87` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:32.807271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f37ba9-746e-430a-a66b-de77111a06b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9177d35faf5e412c8118b1cd0598bd87)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:32.809622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f37ba9-746e-430a-a66b-de77111a06b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:32.906882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-86f37ba9-746e-430a-a66b-de77111a06b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9177d35faf5e412c8118b1cd0598bd87'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:32.907648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-86f37ba9-746e-430a-a66b-de77111a06b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9177d35faf5e412c8118b1cd0598bd87'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:32.923461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-86f37ba9-746e-430a-a66b-de77111a06b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9177d35faf5e412c8118b1cd0598bd87'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:32.937986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-86f37ba9-746e-430a-a66b-de77111a06b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9177d35faf5e412c8118b1cd0598bd87'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:32.968315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-86f37ba9-746e-430a-a66b-de77111a06b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9177d35faf5e412c8118b1cd0598bd87'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:32.983680 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3234/6475] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:32 2022] DELETE /identity/v3/users/9177d35faf5e412c8118b1cd0598bd87 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:33.923017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce8847-e074-4314-8da4-d2d890ee8fef admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:33.925695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f5ce8847-e074-4314-8da4-d2d890ee8fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:33.958142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce8847-e074-4314-8da4-d2d890ee8fef admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:34.132826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c2f1b-a6a3-4990-8082-5a2a467e1109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:34.133750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c2f1b-a6a3-4990-8082-5a2a467e1109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:34.134244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c2f1b-a6a3-4990-8082-5a2a467e1109 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:34.134704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c2f1b-a6a3-4990-8082-5a2a467e1109 admin admin] PATH_INFO: `/v3/projects/dace1a921408441cbc7ce3ad787cb66c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:34.136257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c2f1b-a6a3-4990-8082-5a2a467e1109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dace1a921408441cbc7ce3ad787cb66c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:34.142531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c2f1b-a6a3-4990-8082-5a2a467e1109 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:34.245140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-186c2f1b-a6a3-4990-8082-5a2a467e1109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dace1a921408441cbc7ce3ad787cb66c', 'request_id': 'req-186c2f1b-a6a3-4990-8082-5a2a467e1109'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:34.264732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-186c2f1b-a6a3-4990-8082-5a2a467e1109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dace1a921408441cbc7ce3ad787cb66c', 'request_id': 'req-186c2f1b-a6a3-4990-8082-5a2a467e1109'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:34.273789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-186c2f1b-a6a3-4990-8082-5a2a467e1109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dace1a921408441cbc7ce3ad787cb66c', 'request_id': 'req-186c2f1b-a6a3-4990-8082-5a2a467e1109'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:34.300811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-186c2f1b-a6a3-4990-8082-5a2a467e1109 admin admin] The token cache is being invalidate because project dace1a921408441cbc7ce3ad787cb66c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:34.301230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-186c2f1b-a6a3-4990-8082-5a2a467e1109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:34.302444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-186c2f1b-a6a3-4990-8082-5a2a467e1109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:34.309811 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3242/6476] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:33 2022] DELETE /identity/v3/projects/dace1a921408441cbc7ce3ad787cb66c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:34.311183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3de69-9d1a-45ff-ac30-2b406ce9c22f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:34.312148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3de69-9d1a-45ff-ac30-2b406ce9c22f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:34.312578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3de69-9d1a-45ff-ac30-2b406ce9c22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:34.355164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-02a3de69-9d1a-45ff-ac30-2b406ce9c22f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:34.359658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-02a3de69-9d1a-45ff-ac30-2b406ce9c22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:34.440701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:34.495508 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3235/6477] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:34.504431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b8c49-c30d-4b22-bfc4-50f7f57dc3a4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:34.504939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b8c49-c30d-4b22-bfc4-50f7f57dc3a4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:34.505260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b8c49-c30d-4b22-bfc4-50f7f57dc3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:34.535508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ac4b8c49-c30d-4b22-bfc4-50f7f57dc3a4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:34.537236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ac4b8c49-c30d-4b22-bfc4-50f7f57dc3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:34.550061 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3243/6478] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:34.554150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3de69-9d1a-45ff-ac30-2b406ce9c22f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:34.570687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3de69-9d1a-45ff-ac30-2b406ce9c22f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:34.588620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bf1b2-3d71-4fa4-ba21-d0728c815ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:34.589660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bf1b2-3d71-4fa4-ba21-d0728c815ace admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:34.589813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bf1b2-3d71-4fa4-ba21-d0728c815ace admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:34.589992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bf1b2-3d71-4fa4-ba21-d0728c815ace admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:34.590721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bf1b2-3d71-4fa4-ba21-d0728c815ace admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:49:34.591168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bf1b2-3d71-4fa4-ba21-d0728c815ace admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:34.592825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bf1b2-3d71-4fa4-ba21-d0728c815ace admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:34.623125 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3236/6479] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:34.627663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b8c49-c30d-4b22-bfc4-50f7f57dc3a4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:34.632236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:34.638934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b8c49-c30d-4b22-bfc4-50f7f57dc3a4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:34.652410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d594d4-52e4-4a94-bb89-50e1aaf89b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:34.654173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d594d4-52e4-4a94-bb89-50e1aaf89b26 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:34.654842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d594d4-52e4-4a94-bb89-50e1aaf89b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:34.655342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d594d4-52e4-4a94-bb89-50e1aaf89b26 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:34.656282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d594d4-52e4-4a94-bb89-50e1aaf89b26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:34.659679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d594d4-52e4-4a94-bb89-50e1aaf89b26 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:34.709867 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3244/6480] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:34 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:34.710849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bf1b2-3d71-4fa4-ba21-d0728c815ace admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:34.727737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bf1b2-3d71-4fa4-ba21-d0728c815ace admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:34.857218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb9e37-9ecb-4696-a4fc-25c36aa45310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:34.858601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb9e37-9ecb-4696-a4fc-25c36aa45310 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:34.859382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb9e37-9ecb-4696-a4fc-25c36aa45310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:34.859675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb9e37-9ecb-4696-a4fc-25c36aa45310 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:34.863789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb9e37-9ecb-4696-a4fc-25c36aa45310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:34.865925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb9e37-9ecb-4696-a4fc-25c36aa45310 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:34.914156 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3237/6481] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:34 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:34.917681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d594d4-52e4-4a94-bb89-50e1aaf89b26 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:34.950499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d594d4-52e4-4a94-bb89-50e1aaf89b26 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:34.973159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4954513-9d69-4e96-bcdd-e07f300843ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:34.977926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4954513-9d69-4e96-bcdd-e07f300843ab admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:34.978296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4954513-9d69-4e96-bcdd-e07f300843ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:34.981410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4954513-9d69-4e96-bcdd-e07f300843ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:34.982292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4954513-9d69-4e96-bcdd-e07f300843ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:34.986727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4954513-9d69-4e96-bcdd-e07f300843ab admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:35.037446 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3245/6482] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:35.041387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb9e37-9ecb-4696-a4fc-25c36aa45310 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:35.055845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb9e37-9ecb-4696-a4fc-25c36aa45310 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:35.072950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2149104-3042-4a0d-b677-79b9b9c668d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:35.074534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2149104-3042-4a0d-b677-79b9b9c668d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:35.074889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2149104-3042-4a0d-b677-79b9b9c668d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:35.075236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2149104-3042-4a0d-b677-79b9b9c668d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:35.076229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2149104-3042-4a0d-b677-79b9b9c668d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:35.082899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2149104-3042-4a0d-b677-79b9b9c668d6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:35.113604 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3238/6483] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:35.117561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4954513-9d69-4e96-bcdd-e07f300843ab admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:35.130258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4954513-9d69-4e96-bcdd-e07f300843ab admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:35.139047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23907f0b-4ab1-49e9-b61a-24bb6fbc59aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:35.139807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23907f0b-4ab1-49e9-b61a-24bb6fbc59aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:35.140084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23907f0b-4ab1-49e9-b61a-24bb6fbc59aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:35.140362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23907f0b-4ab1-49e9-b61a-24bb6fbc59aa admin admin] PATH_INFO: `/v3/projects/37c6eac644e44149a72a40469df7f6f8/users/ad57810da1584a92a98ad32a6c4111db/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:35.161859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23907f0b-4ab1-49e9-b61a-24bb6fbc59aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c6eac644e44149a72a40469df7f6f8, user_id=ad57810da1584a92a98ad32a6c4111db, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:35.164809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23907f0b-4ab1-49e9-b61a-24bb6fbc59aa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:35.185642 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3246/6484] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:35 2022] PUT /identity/v3/projects/37c6eac644e44149a72a40469df7f6f8/users/ad57810da1584a92a98ad32a6c4111db/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:35.196442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb248762-9185-4b15-80a9-9649b10c0eea None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:35.196858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb248762-9185-4b15-80a9-9649b10c0eea None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:35.197010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb248762-9185-4b15-80a9-9649b10c0eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:35.253670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bb248762-9185-4b15-80a9-9649b10c0eea None None] MFA Rules not processed for user `ad57810da1584a92a98ad32a6c4111db`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:35.254980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb248762-9185-4b15-80a9-9649b10c0eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:35.408377 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3239/6485] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:35.409652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23907f0b-4ab1-49e9-b61a-24bb6fbc59aa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:35.440207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb248762-9185-4b15-80a9-9649b10c0eea None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:35.443199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb248762-9185-4b15-80a9-9649b10c0eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:35.552304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23907f0b-4ab1-49e9-b61a-24bb6fbc59aa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:35.564843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cfd9c-0ece-4104-b849-92251deaf73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:35.573151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cfd9c-0ece-4104-b849-92251deaf73c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:35.573151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cfd9c-0ece-4104-b849-92251deaf73c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:35.573151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cfd9c-0ece-4104-b849-92251deaf73c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:35.573151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cfd9c-0ece-4104-b849-92251deaf73c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:35.581307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cfd9c-0ece-4104-b849-92251deaf73c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:35.620327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:35.645630 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3247/6486] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:35 2022] POST /identity/v3/projects => generated 385 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:49:35.646661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cfd9c-0ece-4104-b849-92251deaf73c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:35.666179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb248762-9185-4b15-80a9-9649b10c0eea None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:35.871608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b9083-474d-43af-8df3-ddf444b95639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:35.873620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b9083-474d-43af-8df3-ddf444b95639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:35.874615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b9083-474d-43af-8df3-ddf444b95639 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:35.874906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b9083-474d-43af-8df3-ddf444b95639 admin admin] PATH_INFO: `/v3/users/0d72553c40a04829b90ee4877f3b8a40` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:35.878725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b9083-474d-43af-8df3-ddf444b95639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d72553c40a04829b90ee4877f3b8a40)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:35.881946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b9083-474d-43af-8df3-ddf444b95639 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:35.980876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f1b9083-474d-43af-8df3-ddf444b95639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d72553c40a04829b90ee4877f3b8a40'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:35.982919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f1b9083-474d-43af-8df3-ddf444b95639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d72553c40a04829b90ee4877f3b8a40'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:35.989198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cfd9c-0ece-4104-b849-92251deaf73c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:35.994922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab30225-e732-428f-ba9b-3c17ea0af796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:35.995284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f1b9083-474d-43af-8df3-ddf444b95639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d72553c40a04829b90ee4877f3b8a40'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:35.995948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab30225-e732-428f-ba9b-3c17ea0af796 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:35.996391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab30225-e732-428f-ba9b-3c17ea0af796 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:35.996809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab30225-e732-428f-ba9b-3c17ea0af796 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:35.997605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab30225-e732-428f-ba9b-3c17ea0af796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:35.999733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab30225-e732-428f-ba9b-3c17ea0af796 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:36.006438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f1b9083-474d-43af-8df3-ddf444b95639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d72553c40a04829b90ee4877f3b8a40'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:36.030959 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3248/6487] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:35 2022] POST /identity/v3/users => generated 299 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:36.032345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab30225-e732-428f-ba9b-3c17ea0af796 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:36.034323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3ab30225-e732-428f-ba9b-3c17ea0af796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:36.043317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f1b9083-474d-43af-8df3-ddf444b95639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d72553c40a04829b90ee4877f3b8a40'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:36.048803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab30225-e732-428f-ba9b-3c17ea0af796 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:36.054349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08846861-5f11-45d3-8619-d72a788230d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:36.055203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08846861-5f11-45d3-8619-d72a788230d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:36.055801 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3240/6488] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:35 2022] DELETE /identity/v3/users/0d72553c40a04829b90ee4877f3b8a40 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:36.058656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08846861-5f11-45d3-8619-d72a788230d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:36.058961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08846861-5f11-45d3-8619-d72a788230d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:36.059733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08846861-5f11-45d3-8619-d72a788230d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:36.061362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08846861-5f11-45d3-8619-d72a788230d1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:36.078626 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3249/6489] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:36.081093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b9083-474d-43af-8df3-ddf444b95639 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:36.274781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b9083-474d-43af-8df3-ddf444b95639 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:36.307836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa96be5-cf95-40ad-9be8-29255e32195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:36.309273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa96be5-cf95-40ad-9be8-29255e32195f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:36.312866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa96be5-cf95-40ad-9be8-29255e32195f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:36.313251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa96be5-cf95-40ad-9be8-29255e32195f admin admin] PATH_INFO: `/v3/projects/0e624e4cf07143f9944c1fe5e6b37f69/users/1c3bba705a5b4961971af594402e707e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:36.356779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa96be5-cf95-40ad-9be8-29255e32195f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e624e4cf07143f9944c1fe5e6b37f69, user_id=1c3bba705a5b4961971af594402e707e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:36.366680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa96be5-cf95-40ad-9be8-29255e32195f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:36.379865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:36.416330 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3241/6490] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:36 2022] PUT /identity/v3/projects/0e624e4cf07143f9944c1fe5e6b37f69/users/1c3bba705a5b4961971af594402e707e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:36.420412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08846861-5f11-45d3-8619-d72a788230d1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:36.432095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08846861-5f11-45d3-8619-d72a788230d1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:36.452552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:36.694301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318f869-dfe0-4cc0-9762-144508460213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:36.698259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318f869-dfe0-4cc0-9762-144508460213 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:36.699971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318f869-dfe0-4cc0-9762-144508460213 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:36.701412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318f869-dfe0-4cc0-9762-144508460213 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:36.704109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318f869-dfe0-4cc0-9762-144508460213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:36.708170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318f869-dfe0-4cc0-9762-144508460213 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:36.740119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa96be5-cf95-40ad-9be8-29255e32195f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:36.745220 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3250/6491] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:36.746122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9aa96be5-cf95-40ad-9be8-29255e32195f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:36.746647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318f869-dfe0-4cc0-9762-144508460213 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:36.769968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318f869-dfe0-4cc0-9762-144508460213 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:36.782219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155c0eb-6210-4a1e-a978-5eee1d005854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:36.783229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155c0eb-6210-4a1e-a978-5eee1d005854 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:36.783694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155c0eb-6210-4a1e-a978-5eee1d005854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:36.784119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155c0eb-6210-4a1e-a978-5eee1d005854 admin admin] PATH_INFO: `/v3/projects/0e624e4cf07143f9944c1fe5e6b37f69/users/1c3bba705a5b4961971af594402e707e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:36.787891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155c0eb-6210-4a1e-a978-5eee1d005854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e624e4cf07143f9944c1fe5e6b37f69, user_id=1c3bba705a5b4961971af594402e707e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:36.796617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155c0eb-6210-4a1e-a978-5eee1d005854 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:36.822026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa96be5-cf95-40ad-9be8-29255e32195f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:36.830517 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3251/6492] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:36 2022] PUT /identity/v3/projects/0e624e4cf07143f9944c1fe5e6b37f69/users/1c3bba705a5b4961971af594402e707e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:36.835873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b88a4-ae19-46f3-988f-a26a7e06b044 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:36.836090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b88a4-ae19-46f3-988f-a26a7e06b044 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:36.836541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b88a4-ae19-46f3-988f-a26a7e06b044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:36.893341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-522b88a4-ae19-46f3-988f-a26a7e06b044 None None] MFA Rules not processed for user `1c3bba705a5b4961971af594402e707e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:36.896146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-522b88a4-ae19-46f3-988f-a26a7e06b044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:37.010197 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3252/6493] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:37.016436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b88a4-ae19-46f3-988f-a26a7e06b044 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:37.018540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-522b88a4-ae19-46f3-988f-a26a7e06b044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:37.025219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd352a-b20a-4836-b036-ec5ca819b08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:37.026036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd352a-b20a-4836-b036-ec5ca819b08a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:37.026324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd352a-b20a-4836-b036-ec5ca819b08a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:37.026597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd352a-b20a-4836-b036-ec5ca819b08a admin admin] PATH_INFO: `/v3/projects/c69f1522847c4d2888daa0afabff195c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:37.027778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd352a-b20a-4836-b036-ec5ca819b08a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69f1522847c4d2888daa0afabff195c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:37.031622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd352a-b20a-4836-b036-ec5ca819b08a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:37.089764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b88a4-ae19-46f3-988f-a26a7e06b044 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:37.125405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12cd352a-b20a-4836-b036-ec5ca819b08a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69f1522847c4d2888daa0afabff195c', 'request_id': 'req-12cd352a-b20a-4836-b036-ec5ca819b08a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:37.127182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:37.142689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12cd352a-b20a-4836-b036-ec5ca819b08a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69f1522847c4d2888daa0afabff195c', 'request_id': 'req-12cd352a-b20a-4836-b036-ec5ca819b08a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:37.154410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12cd352a-b20a-4836-b036-ec5ca819b08a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69f1522847c4d2888daa0afabff195c', 'request_id': 'req-12cd352a-b20a-4836-b036-ec5ca819b08a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:37.172445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807af8d3-a958-43de-9478-289ccf9720d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:37.173558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807af8d3-a958-43de-9478-289ccf9720d8 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:37.174275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807af8d3-a958-43de-9478-289ccf9720d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:37.174832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807af8d3-a958-43de-9478-289ccf9720d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:37.192512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12cd352a-b20a-4836-b036-ec5ca819b08a admin admin] The token cache is being invalidate because project c69f1522847c4d2888daa0afabff195c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:37.192799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12cd352a-b20a-4836-b036-ec5ca819b08a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:37.194199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12cd352a-b20a-4836-b036-ec5ca819b08a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:37.196957 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3242/6494] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:36 2022] DELETE /identity/v3/projects/c69f1522847c4d2888daa0afabff195c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:49:37.202610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439d4ec-08c5-483d-819f-ae0ec533a91a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:37.204777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439d4ec-08c5-483d-819f-ae0ec533a91a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:37.206252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439d4ec-08c5-483d-819f-ae0ec533a91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:37.256590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7439d4ec-08c5-483d-819f-ae0ec533a91a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:37.261781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7439d4ec-08c5-483d-819f-ae0ec533a91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:37.319750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807af8d3-a958-43de-9478-289ccf9720d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:37.321212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807af8d3-a958-43de-9478-289ccf9720d8 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:37.349769 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3253/6495] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:37.488493 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3243/6496] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:37.497863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2974d7-4e04-4352-9ad7-46a59721df58 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:37.498478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2974d7-4e04-4352-9ad7-46a59721df58 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:37.498903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2974d7-4e04-4352-9ad7-46a59721df58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:37.564825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cd2974d7-4e04-4352-9ad7-46a59721df58 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:37.566485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cd2974d7-4e04-4352-9ad7-46a59721df58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:37.591524 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3254/6497] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:37.595154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439d4ec-08c5-483d-819f-ae0ec533a91a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:37.609414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439d4ec-08c5-483d-819f-ae0ec533a91a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:37.636302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a753e4-ab48-460c-af50-41db0d70942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:37.637095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a753e4-ab48-460c-af50-41db0d70942d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:37.637489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a753e4-ab48-460c-af50-41db0d70942d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:37.637855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a753e4-ab48-460c-af50-41db0d70942d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:37.638627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a753e4-ab48-460c-af50-41db0d70942d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:49:37.639031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a753e4-ab48-460c-af50-41db0d70942d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:37.640950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a753e4-ab48-460c-af50-41db0d70942d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:37.674039 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3244/6498] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:49:37.676615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2974d7-4e04-4352-9ad7-46a59721df58 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:37.691622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2974d7-4e04-4352-9ad7-46a59721df58 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:37.710340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82972ac-1886-4889-988c-aa24808ebf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:37.711395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82972ac-1886-4889-988c-aa24808ebf46 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:37.711557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82972ac-1886-4889-988c-aa24808ebf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:37.711834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82972ac-1886-4889-988c-aa24808ebf46 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:37.712494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82972ac-1886-4889-988c-aa24808ebf46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:37.714419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82972ac-1886-4889-988c-aa24808ebf46 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:37.745382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a753e4-ab48-460c-af50-41db0d70942d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:37.750520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-93a753e4-ab48-460c-af50-41db0d70942d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:37.769856 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3255/6499] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:37 2022] POST /identity/v3/projects => generated 403 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:49:37.778202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82972ac-1886-4889-988c-aa24808ebf46 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:37.802313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a753e4-ab48-460c-af50-41db0d70942d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:37.823175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:38.043883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82972ac-1886-4889-988c-aa24808ebf46 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:38.050173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6a319-7f3f-4450-b85a-795ed4fb0846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:38.050841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6a319-7f3f-4450-b85a-795ed4fb0846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:38.051320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6a319-7f3f-4450-b85a-795ed4fb0846 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:38.051784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6a319-7f3f-4450-b85a-795ed4fb0846 admin admin] PATH_INFO: `/v3/users/ad57810da1584a92a98ad32a6c4111db` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:38.055000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6a319-7f3f-4450-b85a-795ed4fb0846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad57810da1584a92a98ad32a6c4111db)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:38.057368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6a319-7f3f-4450-b85a-795ed4fb0846 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:38.076032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda878e8-9d9f-427e-9cbd-18448a91c540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:38.076669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda878e8-9d9f-427e-9cbd-18448a91c540 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:38.076953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda878e8-9d9f-427e-9cbd-18448a91c540 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:38.077229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda878e8-9d9f-427e-9cbd-18448a91c540 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:38.084156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda878e8-9d9f-427e-9cbd-18448a91c540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:38.086125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda878e8-9d9f-427e-9cbd-18448a91c540 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:38.156639 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3256/6500] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:37 2022] POST /identity/v3/users => generated 302 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:38.156836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bd6a319-7f3f-4450-b85a-795ed4fb0846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad57810da1584a92a98ad32a6c4111db'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:38.158683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda878e8-9d9f-427e-9cbd-18448a91c540 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:38.161075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bd6a319-7f3f-4450-b85a-795ed4fb0846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad57810da1584a92a98ad32a6c4111db'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:38.164027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eda878e8-9d9f-427e-9cbd-18448a91c540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:38.181433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bd6a319-7f3f-4450-b85a-795ed4fb0846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad57810da1584a92a98ad32a6c4111db'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:38.210935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda878e8-9d9f-427e-9cbd-18448a91c540 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:38.218916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b4110-d454-4451-ad07-7eea7ba26aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:38.220257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b4110-d454-4451-ad07-7eea7ba26aab admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:38.222374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b4110-d454-4451-ad07-7eea7ba26aab admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:38.224489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b4110-d454-4451-ad07-7eea7ba26aab admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:38.225556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b4110-d454-4451-ad07-7eea7ba26aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:38.227629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b4110-d454-4451-ad07-7eea7ba26aab admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:38.230131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bd6a319-7f3f-4450-b85a-795ed4fb0846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad57810da1584a92a98ad32a6c4111db'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:38.267906 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3257/6501] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:38.269561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bd6a319-7f3f-4450-b85a-795ed4fb0846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad57810da1584a92a98ad32a6c4111db'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:38.274598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b4110-d454-4451-ad07-7eea7ba26aab admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:38.279962 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3245/6502] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:37 2022] DELETE /identity/v3/users/ad57810da1584a92a98ad32a6c4111db => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:38.288690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971d253-5b6a-4ed6-81d6-98a25cc4bb1b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:38.288690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971d253-5b6a-4ed6-81d6-98a25cc4bb1b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:38.288690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971d253-5b6a-4ed6-81d6-98a25cc4bb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:38.306260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b4110-d454-4451-ad07-7eea7ba26aab admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:38.328310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3971d253-5b6a-4ed6-81d6-98a25cc4bb1b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:38.331900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3971d253-5b6a-4ed6-81d6-98a25cc4bb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:38.400093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:38.494062 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3246/6503] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:38.530199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971d253-5b6a-4ed6-81d6-98a25cc4bb1b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:38.532980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3971d253-5b6a-4ed6-81d6-98a25cc4bb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:38.541251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdd5f8-b27b-4ce5-aca0-0d8ff31f573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:38.546491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdd5f8-b27b-4ce5-aca0-0d8ff31f573b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:38.548002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdd5f8-b27b-4ce5-aca0-0d8ff31f573b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:38.548211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdd5f8-b27b-4ce5-aca0-0d8ff31f573b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:38.549011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdd5f8-b27b-4ce5-aca0-0d8ff31f573b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:38.551268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdd5f8-b27b-4ce5-aca0-0d8ff31f573b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:38.590597 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3258/6504] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:38.604285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdd5f8-b27b-4ce5-aca0-0d8ff31f573b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:38.615135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:38.644428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdd5f8-b27b-4ce5-aca0-0d8ff31f573b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:38.656737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e60f20-614c-426a-9c22-14e2b803ce15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:38.657445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e60f20-614c-426a-9c22-14e2b803ce15 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:38.659689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e60f20-614c-426a-9c22-14e2b803ce15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:38.659995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e60f20-614c-426a-9c22-14e2b803ce15 admin admin] PATH_INFO: `/v3/projects/f181fdb1d8d54034833cfe047607739e/users/1e8240437888445e9f0ad23616115b0f/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:38.696499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971d253-5b6a-4ed6-81d6-98a25cc4bb1b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:38.706097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cddb26-e370-45d1-990d-ab6925b4c93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:38.706737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cddb26-e370-45d1-990d-ab6925b4c93e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:38.707011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cddb26-e370-45d1-990d-ab6925b4c93e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:38.707295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cddb26-e370-45d1-990d-ab6925b4c93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:38.722785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cddb26-e370-45d1-990d-ab6925b4c93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:38.725676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cddb26-e370-45d1-990d-ab6925b4c93e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:38.744095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e60f20-614c-426a-9c22-14e2b803ce15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f181fdb1d8d54034833cfe047607739e, user_id=1e8240437888445e9f0ad23616115b0f, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:38.755061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e60f20-614c-426a-9c22-14e2b803ce15 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:38.756284 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3247/6505] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:38.837459 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3259/6506] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:38 2022] PUT /identity/v3/projects/f181fdb1d8d54034833cfe047607739e/users/1e8240437888445e9f0ad23616115b0f/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:38.848292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb48520-c2ea-4a3f-9abf-fbb9ff8a7699 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:38.848835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb48520-c2ea-4a3f-9abf-fbb9ff8a7699 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:38.849318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb48520-c2ea-4a3f-9abf-fbb9ff8a7699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:38.915351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0cb48520-c2ea-4a3f-9abf-fbb9ff8a7699 None None] MFA Rules not processed for user `1e8240437888445e9f0ad23616115b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:38.918574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0cb48520-c2ea-4a3f-9abf-fbb9ff8a7699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:39.101232 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3248/6507] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:38 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:39.115054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e60f20-614c-426a-9c22-14e2b803ce15 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:39.249954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e60f20-614c-426a-9c22-14e2b803ce15 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:39.268021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1d336-076c-4c65-85db-dddaff313926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:39.268943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1d336-076c-4c65-85db-dddaff313926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:39.269380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1d336-076c-4c65-85db-dddaff313926 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:39.269828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1d336-076c-4c65-85db-dddaff313926 admin admin] PATH_INFO: `/v3/users/1e8240437888445e9f0ad23616115b0f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:39.271430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1d336-076c-4c65-85db-dddaff313926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e8240437888445e9f0ad23616115b0f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:39.273566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1d336-076c-4c65-85db-dddaff313926 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:39.407452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5ac1d336-076c-4c65-85db-dddaff313926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8240437888445e9f0ad23616115b0f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:39.434144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5ac1d336-076c-4c65-85db-dddaff313926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8240437888445e9f0ad23616115b0f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:39.434919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5ac1d336-076c-4c65-85db-dddaff313926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8240437888445e9f0ad23616115b0f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:39.435883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5ac1d336-076c-4c65-85db-dddaff313926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8240437888445e9f0ad23616115b0f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:39.455984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5ac1d336-076c-4c65-85db-dddaff313926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8240437888445e9f0ad23616115b0f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:39.477222 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3260/6508] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:39 2022] DELETE /identity/v3/users/1e8240437888445e9f0ad23616115b0f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:39.483099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42f0e9-3b41-43cd-ad53-8339d78bacfb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:39.483590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42f0e9-3b41-43cd-ad53-8339d78bacfb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:39.484087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42f0e9-3b41-43cd-ad53-8339d78bacfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:39.510262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1d336-076c-4c65-85db-dddaff313926 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:39.511852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5ac1d336-076c-4c65-85db-dddaff313926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:39.548496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2f42f0e9-3b41-43cd-ad53-8339d78bacfb None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:39.550285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2f42f0e9-3b41-43cd-ad53-8339d78bacfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:39.582966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:39.669307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1d336-076c-4c65-85db-dddaff313926 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:39.675573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd977d-44d0-4e02-8ca8-50748cdde4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:39.676770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd977d-44d0-4e02-8ca8-50748cdde4f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:39.677104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd977d-44d0-4e02-8ca8-50748cdde4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:39.677378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd977d-44d0-4e02-8ca8-50748cdde4f1 admin admin] PATH_INFO: `/v3/projects/37c6eac644e44149a72a40469df7f6f8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:39.679011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd977d-44d0-4e02-8ca8-50748cdde4f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c6eac644e44149a72a40469df7f6f8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:39.681575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd977d-44d0-4e02-8ca8-50748cdde4f1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:39.713738 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3249/6509] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:39.724520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42f0e9-3b41-43cd-ad53-8339d78bacfb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:39.726216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2f42f0e9-3b41-43cd-ad53-8339d78bacfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:39.771949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-63cd977d-44d0-4e02-8ca8-50748cdde4f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c6eac644e44149a72a40469df7f6f8', 'request_id': 'req-63cd977d-44d0-4e02-8ca8-50748cdde4f1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:39.781451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-63cd977d-44d0-4e02-8ca8-50748cdde4f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c6eac644e44149a72a40469df7f6f8', 'request_id': 'req-63cd977d-44d0-4e02-8ca8-50748cdde4f1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:39.790890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-63cd977d-44d0-4e02-8ca8-50748cdde4f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c6eac644e44149a72a40469df7f6f8', 'request_id': 'req-63cd977d-44d0-4e02-8ca8-50748cdde4f1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:39.826076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-63cd977d-44d0-4e02-8ca8-50748cdde4f1 admin admin] The token cache is being invalidate because project 37c6eac644e44149a72a40469df7f6f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:39.826386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-63cd977d-44d0-4e02-8ca8-50748cdde4f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:39.829106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-63cd977d-44d0-4e02-8ca8-50748cdde4f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:39.830809 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3261/6510] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:39 2022] DELETE /identity/v3/projects/37c6eac644e44149a72a40469df7f6f8 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:39.837667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd977d-44d0-4e02-8ca8-50748cdde4f1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:39.841756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-63cd977d-44d0-4e02-8ca8-50748cdde4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:39.873382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42f0e9-3b41-43cd-ad53-8339d78bacfb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:39.913321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:39.999313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842b21b-1bff-4c17-a5ed-de251d1dadfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:40.001092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842b21b-1bff-4c17-a5ed-de251d1dadfd service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:40.002011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842b21b-1bff-4c17-a5ed-de251d1dadfd service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:40.002518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842b21b-1bff-4c17-a5ed-de251d1dadfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:40.005115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7842b21b-1bff-4c17-a5ed-de251d1dadfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:40.054887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd977d-44d0-4e02-8ca8-50748cdde4f1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:40.069553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4aa20-4ea8-49d0-8ae6-64486acd03b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:40.070210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4aa20-4ea8-49d0-8ae6-64486acd03b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:40.070495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4aa20-4ea8-49d0-8ae6-64486acd03b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:40.070788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4aa20-4ea8-49d0-8ae6-64486acd03b8 admin admin] PATH_INFO: `/v3/users/1c3bba705a5b4961971af594402e707e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:40.073273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4aa20-4ea8-49d0-8ae6-64486acd03b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c3bba705a5b4961971af594402e707e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:40.075212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4aa20-4ea8-49d0-8ae6-64486acd03b8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:40.174890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842b21b-1bff-4c17-a5ed-de251d1dadfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:40.176387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842b21b-1bff-4c17-a5ed-de251d1dadfd service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:40.180471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-47d4aa20-4ea8-49d0-8ae6-64486acd03b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c3bba705a5b4961971af594402e707e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:40.193076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:40.198903 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3250/6511] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:49:40.203026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-47d4aa20-4ea8-49d0-8ae6-64486acd03b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c3bba705a5b4961971af594402e707e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:40.204078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-47d4aa20-4ea8-49d0-8ae6-64486acd03b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c3bba705a5b4961971af594402e707e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:40.205048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-47d4aa20-4ea8-49d0-8ae6-64486acd03b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c3bba705a5b4961971af594402e707e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:40.220171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-47d4aa20-4ea8-49d0-8ae6-64486acd03b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c3bba705a5b4961971af594402e707e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:40.252187 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3262/6512] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:39 2022] DELETE /identity/v3/users/1c3bba705a5b4961971af594402e707e => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:40.821999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842b21b-1bff-4c17-a5ed-de251d1dadfd service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:40.856765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842b21b-1bff-4c17-a5ed-de251d1dadfd service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:41.250310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4aa20-4ea8-49d0-8ae6-64486acd03b8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:41.253013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-47d4aa20-4ea8-49d0-8ae6-64486acd03b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:41.349212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf89b8-ffac-4d11-8547-ed580fd511d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:41.350688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf89b8-ffac-4d11-8547-ed580fd511d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:41.351275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf89b8-ffac-4d11-8547-ed580fd511d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:41.351731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf89b8-ffac-4d11-8547-ed580fd511d3 admin admin] PATH_INFO: `/v3/projects/0e624e4cf07143f9944c1fe5e6b37f69` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:41.353286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf89b8-ffac-4d11-8547-ed580fd511d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e624e4cf07143f9944c1fe5e6b37f69)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:41.357100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf89b8-ffac-4d11-8547-ed580fd511d3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:41.465205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4aa20-4ea8-49d0-8ae6-64486acd03b8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:41.485851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df29d3e-5d16-488c-acc7-5e63d121f0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:41.489676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df29d3e-5d16-488c-acc7-5e63d121f0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:41.490127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df29d3e-5d16-488c-acc7-5e63d121f0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:41.490526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df29d3e-5d16-488c-acc7-5e63d121f0ab admin admin] PATH_INFO: `/v3/projects/f181fdb1d8d54034833cfe047607739e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:41.495200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df29d3e-5d16-488c-acc7-5e63d121f0ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f181fdb1d8d54034833cfe047607739e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:41.505345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df29d3e-5d16-488c-acc7-5e63d121f0ab admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:41.516724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cbaf89b8-ffac-4d11-8547-ed580fd511d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e624e4cf07143f9944c1fe5e6b37f69', 'request_id': 'req-cbaf89b8-ffac-4d11-8547-ed580fd511d3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:41.544138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cbaf89b8-ffac-4d11-8547-ed580fd511d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e624e4cf07143f9944c1fe5e6b37f69', 'request_id': 'req-cbaf89b8-ffac-4d11-8547-ed580fd511d3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:41.557016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cbaf89b8-ffac-4d11-8547-ed580fd511d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e624e4cf07143f9944c1fe5e6b37f69', 'request_id': 'req-cbaf89b8-ffac-4d11-8547-ed580fd511d3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:41.567122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:41.572851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cbaf89b8-ffac-4d11-8547-ed580fd511d3 admin admin] The token cache is being invalidate because project 0e624e4cf07143f9944c1fe5e6b37f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:41.573396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cbaf89b8-ffac-4d11-8547-ed580fd511d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:41.574477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cbaf89b8-ffac-4d11-8547-ed580fd511d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:41.578365 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3251/6513] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:40 2022] DELETE /identity/v3/projects/0e624e4cf07143f9944c1fe5e6b37f69 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:41.590657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c85fd5-20c9-4b4b-807b-b1d394f7f60d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:41.592187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c85fd5-20c9-4b4b-807b-b1d394f7f60d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:41.593147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c85fd5-20c9-4b4b-807b-b1d394f7f60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:41.630394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4df29d3e-5d16-488c-acc7-5e63d121f0ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f181fdb1d8d54034833cfe047607739e', 'request_id': 'req-4df29d3e-5d16-488c-acc7-5e63d121f0ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:41.642779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4df29d3e-5d16-488c-acc7-5e63d121f0ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f181fdb1d8d54034833cfe047607739e', 'request_id': 'req-4df29d3e-5d16-488c-acc7-5e63d121f0ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:41.662301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4df29d3e-5d16-488c-acc7-5e63d121f0ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f181fdb1d8d54034833cfe047607739e', 'request_id': 'req-4df29d3e-5d16-488c-acc7-5e63d121f0ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:41.689177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4df29d3e-5d16-488c-acc7-5e63d121f0ab admin admin] The token cache is being invalidate because project f181fdb1d8d54034833cfe047607739e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:41.689746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4df29d3e-5d16-488c-acc7-5e63d121f0ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:41.690477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-80c85fd5-20c9-4b4b-807b-b1d394f7f60d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:41.691183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4df29d3e-5d16-488c-acc7-5e63d121f0ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:41.694090 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3263/6514] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:41 2022] DELETE /identity/v3/projects/f181fdb1d8d54034833cfe047607739e => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:49:41.703578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80c85fd5-20c9-4b4b-807b-b1d394f7f60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:41.704250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03444a37-b082-4400-9daa-eff49646d0b5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:41.704526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03444a37-b082-4400-9daa-eff49646d0b5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:41.706182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03444a37-b082-4400-9daa-eff49646d0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:41.751836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-03444a37-b082-4400-9daa-eff49646d0b5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:41.754520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-03444a37-b082-4400-9daa-eff49646d0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:41.916522 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3252/6515] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:41.926819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44525e-3c70-4300-b42d-7a3d8c070a04 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:41.927224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44525e-3c70-4300-b42d-7a3d8c070a04 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:41.927522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44525e-3c70-4300-b42d-7a3d8c070a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:41.979623 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3264/6516] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:41.987160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be05c-dc73-4f51-ad3b-b886c0fff7af None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:41.987428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be05c-dc73-4f51-ad3b-b886c0fff7af None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:41.987676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be05c-dc73-4f51-ad3b-b886c0fff7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:42.000190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5f44525e-3c70-4300-b42d-7a3d8c070a04 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:42.000877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:42.001567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5f44525e-3c70-4300-b42d-7a3d8c070a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:42.020994 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3253/6517] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:42.024474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b71be05c-dc73-4f51-ad3b-b886c0fff7af None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:42.025456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44525e-3c70-4300-b42d-7a3d8c070a04 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:42.027818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b71be05c-dc73-4f51-ad3b-b886c0fff7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:42.045632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44525e-3c70-4300-b42d-7a3d8c070a04 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:42.049539 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3265/6518] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:42.055861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71be05c-dc73-4f51-ad3b-b886c0fff7af None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:42.058876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f9a52-ea64-480e-924b-d8867429c2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:42.060618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f9a52-ea64-480e-924b-d8867429c2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:42.061120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f9a52-ea64-480e-924b-d8867429c2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:42.061588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f9a52-ea64-480e-924b-d8867429c2f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:42.062434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f9a52-ea64-480e-924b-d8867429c2f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:49:42.063415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f9a52-ea64-480e-924b-d8867429c2f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:42.065375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f9a52-ea64-480e-924b-d8867429c2f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:42.070138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71be05c-dc73-4f51-ad3b-b886c0fff7af None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:42.084115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a139cf-4c2d-450c-9f5e-e9c8fb05fb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:42.084657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a139cf-4c2d-450c-9f5e-e9c8fb05fb2c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:42.084936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a139cf-4c2d-450c-9f5e-e9c8fb05fb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:42.085298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a139cf-4c2d-450c-9f5e-e9c8fb05fb2c admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:42.085972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a139cf-4c2d-450c-9f5e-e9c8fb05fb2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:49:42.086273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a139cf-4c2d-450c-9f5e-e9c8fb05fb2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:42.087958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a139cf-4c2d-450c-9f5e-e9c8fb05fb2c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:42.114892 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3254/6519] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:49:42.125907 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3266/6520] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:42.126135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f9a52-ea64-480e-924b-d8867429c2f6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:42.126992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a139cf-4c2d-450c-9f5e-e9c8fb05fb2c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:42.150772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a139cf-4c2d-450c-9f5e-e9c8fb05fb2c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:42.161305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af2481-3fce-41aa-9369-29bd20e8c7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:42.162173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af2481-3fce-41aa-9369-29bd20e8c7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:42.162173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af2481-3fce-41aa-9369-29bd20e8c7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:42.162481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af2481-3fce-41aa-9369-29bd20e8c7f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:42.163101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af2481-3fce-41aa-9369-29bd20e8c7f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:42.165028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af2481-3fce-41aa-9369-29bd20e8c7f8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:42.170202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f9a52-ea64-480e-924b-d8867429c2f6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:42.213355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebde98-ac77-424a-857f-fe3a3eb30d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:42.216558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebde98-ac77-424a-857f-fe3a3eb30d78 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:42.217715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebde98-ac77-424a-857f-fe3a3eb30d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:42.219487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebde98-ac77-424a-857f-fe3a3eb30d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:42.220810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebde98-ac77-424a-857f-fe3a3eb30d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:42.228433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebde98-ac77-424a-857f-fe3a3eb30d78 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:42.233220 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3267/6521] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:42 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:42.237173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af2481-3fce-41aa-9369-29bd20e8c7f8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:42.276561 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3255/6522] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:42 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:42.285692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebde98-ac77-424a-857f-fe3a3eb30d78 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:42.364610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af2481-3fce-41aa-9369-29bd20e8c7f8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:42.432919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebde98-ac77-424a-857f-fe3a3eb30d78 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:42.461044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae74c7-cdea-41e6-be66-162e4bb84fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:42.461687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae74c7-cdea-41e6-be66-162e4bb84fae admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:42.461965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae74c7-cdea-41e6-be66-162e4bb84fae admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:42.462247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae74c7-cdea-41e6-be66-162e4bb84fae admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:42.462878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae74c7-cdea-41e6-be66-162e4bb84fae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:42.472626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae74c7-cdea-41e6-be66-162e4bb84fae admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:42.518981 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3256/6523] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:42 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:42.520025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae74c7-cdea-41e6-be66-162e4bb84fae admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:42.530975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2792e-e39a-40ae-a1ea-f19c62d0920e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:42.531854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2792e-e39a-40ae-a1ea-f19c62d0920e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:42.533468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae74c7-cdea-41e6-be66-162e4bb84fae admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:42.533861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2792e-e39a-40ae-a1ea-f19c62d0920e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:42.534317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2792e-e39a-40ae-a1ea-f19c62d0920e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:42.535125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2792e-e39a-40ae-a1ea-f19c62d0920e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:42.537306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2792e-e39a-40ae-a1ea-f19c62d0920e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:42.555034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb88b43-25c3-479b-8262-e42a05cb82fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:42.556607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88b43-25c3-479b-8262-e42a05cb82fa admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:42.557717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88b43-25c3-479b-8262-e42a05cb82fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:42.558131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88b43-25c3-479b-8262-e42a05cb82fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:42.559031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb88b43-25c3-479b-8262-e42a05cb82fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:42.565522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb88b43-25c3-479b-8262-e42a05cb82fa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:42.603854 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3257/6524] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:42.606228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb88b43-25c3-479b-8262-e42a05cb82fa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:42.613128 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3268/6525] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:42 2022] POST /identity/v3/users => generated 283 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:42.619745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2792e-e39a-40ae-a1ea-f19c62d0920e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:42.631690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2792e-e39a-40ae-a1ea-f19c62d0920e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:42.637336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827f8b6-b7a0-414f-96e9-672216516865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:42.638105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827f8b6-b7a0-414f-96e9-672216516865 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:42.638479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827f8b6-b7a0-414f-96e9-672216516865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:42.638848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827f8b6-b7a0-414f-96e9-672216516865 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:42.639697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827f8b6-b7a0-414f-96e9-672216516865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:42.641505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827f8b6-b7a0-414f-96e9-672216516865 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:42.648980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb88b43-25c3-479b-8262-e42a05cb82fa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:42.656773 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3269/6526] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:49:42.657938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827f8b6-b7a0-414f-96e9-672216516865 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:42.666425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9ad68-843d-4d77-b839-66b3f9d7fc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:42.667448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9ad68-843d-4d77-b839-66b3f9d7fc8d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:42.667899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9ad68-843d-4d77-b839-66b3f9d7fc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:42.668471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9ad68-843d-4d77-b839-66b3f9d7fc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:42.670497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827f8b6-b7a0-414f-96e9-672216516865 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:42.670967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9ad68-843d-4d77-b839-66b3f9d7fc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:42.673056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9ad68-843d-4d77-b839-66b3f9d7fc8d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:42.677052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ef6cd-9d59-4406-b852-1156a1e39aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:42.677814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ef6cd-9d59-4406-b852-1156a1e39aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:42.678191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ef6cd-9d59-4406-b852-1156a1e39aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:42.678561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ef6cd-9d59-4406-b852-1156a1e39aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:42.679411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ef6cd-9d59-4406-b852-1156a1e39aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:42.681230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ef6cd-9d59-4406-b852-1156a1e39aa7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:42.687421 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3258/6527] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:42.691189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9ad68-843d-4d77-b839-66b3f9d7fc8d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:42.695898 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3270/6528] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:42.700110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ef6cd-9d59-4406-b852-1156a1e39aa7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:42.711749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9ad68-843d-4d77-b839-66b3f9d7fc8d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:42.723923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ef6cd-9d59-4406-b852-1156a1e39aa7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:42.726801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775bf8ab-8739-4c84-bcaf-059f8eb0a060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:42.728016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bf8ab-8739-4c84-bcaf-059f8eb0a060 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:42.728503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bf8ab-8739-4c84-bcaf-059f8eb0a060 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:42.728972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bf8ab-8739-4c84-bcaf-059f8eb0a060 admin admin] PATH_INFO: `/v3/projects/0a247f790c0041dab483475a2832f288/users/5a8e5b4f29a1459ea2235d1385ae74f5/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:42.741638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8929f1c-3e5e-4ba2-a975-0026ab7f12aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:42.742342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8929f1c-3e5e-4ba2-a975-0026ab7f12aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:42.742622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8929f1c-3e5e-4ba2-a975-0026ab7f12aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:42.742900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8929f1c-3e5e-4ba2-a975-0026ab7f12aa admin admin] PATH_INFO: `/v3/projects/e89e8dffc5674125b701f12cbf212ee0/users/3faff2b7360c4fa3b2bb4aee46a3f51c/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:42.775099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775bf8ab-8739-4c84-bcaf-059f8eb0a060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a247f790c0041dab483475a2832f288, user_id=5a8e5b4f29a1459ea2235d1385ae74f5, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:42.781274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775bf8ab-8739-4c84-bcaf-059f8eb0a060 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:42.809310 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3259/6529] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:42 2022] PUT /identity/v3/projects/0a247f790c0041dab483475a2832f288/users/5a8e5b4f29a1459ea2235d1385ae74f5/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:49:42.812251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8929f1c-3e5e-4ba2-a975-0026ab7f12aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e89e8dffc5674125b701f12cbf212ee0, user_id=3faff2b7360c4fa3b2bb4aee46a3f51c, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:42.815952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8929f1c-3e5e-4ba2-a975-0026ab7f12aa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:42.822252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d046729-ac1d-434c-84dd-cded5b37f893 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:42.822669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d046729-ac1d-434c-84dd-cded5b37f893 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:42.822911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d046729-ac1d-434c-84dd-cded5b37f893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:42.840528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:42.886708 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3271/6530] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:42 2022] PUT /identity/v3/projects/e89e8dffc5674125b701f12cbf212ee0/users/3faff2b7360c4fa3b2bb4aee46a3f51c/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:49:42.888608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ed133-5ccc-4556-9813-2683fdd9f90d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:42.888913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ed133-5ccc-4556-9813-2683fdd9f90d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:42.889172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ed133-5ccc-4556-9813-2683fdd9f90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:42.925439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1d046729-ac1d-434c-84dd-cded5b37f893 None None] MFA Rules not processed for user `5a8e5b4f29a1459ea2235d1385ae74f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:42.929420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d046729-ac1d-434c-84dd-cded5b37f893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:42.944380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:42.949458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b83ed133-5ccc-4556-9813-2683fdd9f90d None None] MFA Rules not processed for user `3faff2b7360c4fa3b2bb4aee46a3f51c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:42.953327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b83ed133-5ccc-4556-9813-2683fdd9f90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:43.031711 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3260/6531] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:43.036051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d046729-ac1d-434c-84dd-cded5b37f893 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:43.119190 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3272/6532] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:43.127204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ed133-5ccc-4556-9813-2683fdd9f90d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:43.129845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b83ed133-5ccc-4556-9813-2683fdd9f90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:43.131410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d046729-ac1d-434c-84dd-cded5b37f893 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:43.143107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362d953-6656-45fa-bea7-ba378c653326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:43.143840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362d953-6656-45fa-bea7-ba378c653326 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:43.145024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362d953-6656-45fa-bea7-ba378c653326 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:43.146647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362d953-6656-45fa-bea7-ba378c653326 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:43.147338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362d953-6656-45fa-bea7-ba378c653326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:43.151491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362d953-6656-45fa-bea7-ba378c653326 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:43.215632 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3261/6533] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:43 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:43.217663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362d953-6656-45fa-bea7-ba378c653326 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:43.334498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ed133-5ccc-4556-9813-2683fdd9f90d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:43.424083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362d953-6656-45fa-bea7-ba378c653326 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:43.440477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493d955-b36e-4d53-bc9a-793d4d494dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:43.441321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493d955-b36e-4d53-bc9a-793d4d494dbe admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:43.442190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493d955-b36e-4d53-bc9a-793d4d494dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:43.445256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493d955-b36e-4d53-bc9a-793d4d494dbe admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:43.446210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493d955-b36e-4d53-bc9a-793d4d494dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:43.448644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493d955-b36e-4d53-bc9a-793d4d494dbe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:43.499840 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3262/6534] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:43 2022] POST /identity/v3/users => generated 295 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:49:43.500160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ffdd7-acc2-4948-a619-f053167b15cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:43.501574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493d955-b36e-4d53-bc9a-793d4d494dbe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:43.501927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ffdd7-acc2-4948-a619-f053167b15cb service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:43.502304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ffdd7-acc2-4948-a619-f053167b15cb service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:43.504528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3493d955-b36e-4d53-bc9a-793d4d494dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:43.504974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ffdd7-acc2-4948-a619-f053167b15cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:43.518662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493d955-b36e-4d53-bc9a-793d4d494dbe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:43.524225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b3054-402d-405e-87b3-d02d59da36df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:43.525091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b3054-402d-405e-87b3-d02d59da36df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:43.526195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b3054-402d-405e-87b3-d02d59da36df admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:43.526639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b3054-402d-405e-87b3-d02d59da36df admin admin] PATH_INFO: `/v3/users/6bf32dbaf675466bbe099f01e17b5fc6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:43.528108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b3054-402d-405e-87b3-d02d59da36df admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf32dbaf675466bbe099f01e17b5fc6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:43.530692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b3054-402d-405e-87b3-d02d59da36df admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:43.532807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:43.588758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:43.603129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c7b3054-402d-405e-87b3-d02d59da36df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf32dbaf675466bbe099f01e17b5fc6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:43.604262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c7b3054-402d-405e-87b3-d02d59da36df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf32dbaf675466bbe099f01e17b5fc6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:43.613726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c7b3054-402d-405e-87b3-d02d59da36df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf32dbaf675466bbe099f01e17b5fc6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:43.624688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c7b3054-402d-405e-87b3-d02d59da36df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf32dbaf675466bbe099f01e17b5fc6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:43.626714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ffdd7-acc2-4948-a619-f053167b15cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:43.630494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ffdd7-acc2-4948-a619-f053167b15cb service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:43.641575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c7b3054-402d-405e-87b3-d02d59da36df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf32dbaf675466bbe099f01e17b5fc6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:43.653579 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3273/6536] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:49:43.654000 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3263/6536] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:43 2022] DELETE /identity/v3/users/6bf32dbaf675466bbe099f01e17b5fc6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:43.654767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ffdd7-acc2-4948-a619-f053167b15cb service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:43.655893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b535750-aa9f-465e-981e-c37b6d4403ac None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:43.656346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b535750-aa9f-465e-981e-c37b6d4403ac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:43.656795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b535750-aa9f-465e-981e-c37b6d4403ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:43.681706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ffdd7-acc2-4948-a619-f053167b15cb service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:43.681840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4b535750-aa9f-465e-981e-c37b6d4403ac None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:43.683156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4b535750-aa9f-465e-981e-c37b6d4403ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:43.827373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637cf76-04cf-45cc-af94-6c0a0751fd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:43.828169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637cf76-04cf-45cc-af94-6c0a0751fd53 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:43.828637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637cf76-04cf-45cc-af94-6c0a0751fd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:43.828929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637cf76-04cf-45cc-af94-6c0a0751fd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:43.829597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637cf76-04cf-45cc-af94-6c0a0751fd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:43.831236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637cf76-04cf-45cc-af94-6c0a0751fd53 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:43.847500 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3264/6537] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:43.851181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b535750-aa9f-465e-981e-c37b6d4403ac None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:43.851181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4b535750-aa9f-465e-981e-c37b6d4403ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:43.851509 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3274/6538] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:43.854704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637cf76-04cf-45cc-af94-6c0a0751fd53 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:43.858566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5637cf76-04cf-45cc-af94-6c0a0751fd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:43.867360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b535750-aa9f-465e-981e-c37b6d4403ac None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:43.872553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53af22-c815-4e8a-9eaf-76254cd2b252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:43.873540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53af22-c815-4e8a-9eaf-76254cd2b252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:43.874705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53af22-c815-4e8a-9eaf-76254cd2b252 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:43.875157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53af22-c815-4e8a-9eaf-76254cd2b252 admin admin] PATH_INFO: `/v3/users/3faff2b7360c4fa3b2bb4aee46a3f51c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:43.877386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53af22-c815-4e8a-9eaf-76254cd2b252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3faff2b7360c4fa3b2bb4aee46a3f51c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:43.879701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53af22-c815-4e8a-9eaf-76254cd2b252 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:43.884686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637cf76-04cf-45cc-af94-6c0a0751fd53 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:43.903007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde38663-05ce-46b9-aa97-cbbbee57ffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:43.904023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde38663-05ce-46b9-aa97-cbbbee57ffa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:43.904023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde38663-05ce-46b9-aa97-cbbbee57ffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:43.904288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde38663-05ce-46b9-aa97-cbbbee57ffa9 admin admin] PATH_INFO: `/v3/projects/d94ff65b11864909af257446ca3af4ac/users/88e56561262b45ebb94ab8e96c40d35b/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:43.925011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde38663-05ce-46b9-aa97-cbbbee57ffa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d94ff65b11864909af257446ca3af4ac, user_id=88e56561262b45ebb94ab8e96c40d35b, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:43.928440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde38663-05ce-46b9-aa97-cbbbee57ffa9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:43.949369 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3275/6539] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:43 2022] PUT /identity/v3/projects/d94ff65b11864909af257446ca3af4ac/users/88e56561262b45ebb94ab8e96c40d35b/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:49:43.950160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde38663-05ce-46b9-aa97-cbbbee57ffa9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:43.953791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dde38663-05ce-46b9-aa97-cbbbee57ffa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:43.966769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b53af22-c815-4e8a-9eaf-76254cd2b252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3faff2b7360c4fa3b2bb4aee46a3f51c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:43.975497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b53af22-c815-4e8a-9eaf-76254cd2b252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3faff2b7360c4fa3b2bb4aee46a3f51c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:44.020023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b53af22-c815-4e8a-9eaf-76254cd2b252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3faff2b7360c4fa3b2bb4aee46a3f51c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:44.036315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b53af22-c815-4e8a-9eaf-76254cd2b252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3faff2b7360c4fa3b2bb4aee46a3f51c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:44.049860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:44.062133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b53af22-c815-4e8a-9eaf-76254cd2b252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3faff2b7360c4fa3b2bb4aee46a3f51c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:44.077277 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3265/6540] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:43 2022] DELETE /identity/v3/users/3faff2b7360c4fa3b2bb4aee46a3f51c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:44.079723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53af22-c815-4e8a-9eaf-76254cd2b252 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:44.082676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4b53af22-c815-4e8a-9eaf-76254cd2b252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:44.123428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde38663-05ce-46b9-aa97-cbbbee57ffa9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:44.226402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5c934-f91f-4c3e-8873-352bdea67840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:44.227283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5c934-f91f-4c3e-8873-352bdea67840 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:44.233107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53af22-c815-4e8a-9eaf-76254cd2b252 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:44.234022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5c934-f91f-4c3e-8873-352bdea67840 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:44.234435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5c934-f91f-4c3e-8873-352bdea67840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:44.238969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-72d5c934-f91f-4c3e-8873-352bdea67840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:44.249339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77674eac-5edb-4ccf-be49-aa6307c8d461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:44.250014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77674eac-5edb-4ccf-be49-aa6307c8d461 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:44.250384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77674eac-5edb-4ccf-be49-aa6307c8d461 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:44.250668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77674eac-5edb-4ccf-be49-aa6307c8d461 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:44.251357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77674eac-5edb-4ccf-be49-aa6307c8d461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:44.253084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77674eac-5edb-4ccf-be49-aa6307c8d461 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:44.281712 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3266/6541] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:44.283045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e1adf-77cb-4b22-9371-c79ca65e631c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:44.283374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e1adf-77cb-4b22-9371-c79ca65e631c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:44.283651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e1adf-77cb-4b22-9371-c79ca65e631c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:44.284570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5c934-f91f-4c3e-8873-352bdea67840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:44.288879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5c934-f91f-4c3e-8873-352bdea67840 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:44.309253 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3276/6542] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:44.310313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5c934-f91f-4c3e-8873-352bdea67840 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:44.326246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5c934-f91f-4c3e-8873-352bdea67840 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:44.341951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f83e1adf-77cb-4b22-9371-c79ca65e631c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:44.343186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f83e1adf-77cb-4b22-9371-c79ca65e631c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:44.384593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fd891-fa16-4753-b7c0-e6537782126c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:44.387676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fd891-fa16-4753-b7c0-e6537782126c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:44.387676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fd891-fa16-4753-b7c0-e6537782126c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:44.387676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fd891-fa16-4753-b7c0-e6537782126c admin admin] PATH_INFO: `/v3/projects/d94ff65b11864909af257446ca3af4ac/users/88e56561262b45ebb94ab8e96c40d35b/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:44.396607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fd891-fa16-4753-b7c0-e6537782126c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d94ff65b11864909af257446ca3af4ac, user_id=88e56561262b45ebb94ab8e96c40d35b, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:44.405391 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3267/6543] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:44.416027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fd891-fa16-4753-b7c0-e6537782126c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:44.423588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:44.441910 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3277/6544] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:44 2022] PUT /identity/v3/projects/d94ff65b11864909af257446ca3af4ac/users/88e56561262b45ebb94ab8e96c40d35b/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:44.454836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acc101-0099-457d-aafc-4216aec96556 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:44.455451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acc101-0099-457d-aafc-4216aec96556 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:44.455451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acc101-0099-457d-aafc-4216aec96556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:44.565349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-41acc101-0099-457d-aafc-4216aec96556 None None] MFA Rules not processed for user `88e56561262b45ebb94ab8e96c40d35b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:44.575429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-41acc101-0099-457d-aafc-4216aec96556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:44.707199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fd891-fa16-4753-b7c0-e6537782126c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:44.709616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-268fd891-fa16-4753-b7c0-e6537782126c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:44.766269 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3268/6545] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:44.778121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acc101-0099-457d-aafc-4216aec96556 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:44.779873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-41acc101-0099-457d-aafc-4216aec96556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:44.840860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fd891-fa16-4753-b7c0-e6537782126c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:44.847394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c99c0-9b16-4b06-abd5-100f07536aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:44.848237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c99c0-9b16-4b06-abd5-100f07536aee service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:44.848647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c99c0-9b16-4b06-abd5-100f07536aee service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:44.849029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c99c0-9b16-4b06-abd5-100f07536aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:44.937699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c99c0-9b16-4b06-abd5-100f07536aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:44.940110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c99c0-9b16-4b06-abd5-100f07536aee service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:44.950074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acc101-0099-457d-aafc-4216aec96556 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:44.961187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4835163-a9b5-40b6-8946-7d5f6648873c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:44.962271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4835163-a9b5-40b6-8946-7d5f6648873c service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:44.962570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4835163-a9b5-40b6-8946-7d5f6648873c service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:44.962832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4835163-a9b5-40b6-8946-7d5f6648873c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:44.966041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4835163-a9b5-40b6-8946-7d5f6648873c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:44.971213 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3278/6546] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:45.022070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:45.095785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4835163-a9b5-40b6-8946-7d5f6648873c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:45.099339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4835163-a9b5-40b6-8946-7d5f6648873c service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:45.129173 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3269/6547] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:49:45.194416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c99c0-9b16-4b06-abd5-100f07536aee service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:45.196055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6a4c99c0-9b16-4b06-abd5-100f07536aee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:45.216990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c99c0-9b16-4b06-abd5-100f07536aee service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:45.242100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a88ae-fdd4-4349-8178-569b8f283a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:45.243527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a88ae-fdd4-4349-8178-569b8f283a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:45.244176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a88ae-fdd4-4349-8178-569b8f283a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:45.244636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a88ae-fdd4-4349-8178-569b8f283a4e admin admin] PATH_INFO: `/v3/projects/c1a372ff89484afeb599f24d78ef3cee` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:45.254233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a88ae-fdd4-4349-8178-569b8f283a4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a372ff89484afeb599f24d78ef3cee)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:45.256705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a88ae-fdd4-4349-8178-569b8f283a4e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:45.358109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a35a88ae-fdd4-4349-8178-569b8f283a4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a372ff89484afeb599f24d78ef3cee', 'request_id': 'req-a35a88ae-fdd4-4349-8178-569b8f283a4e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:45.373194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a35a88ae-fdd4-4349-8178-569b8f283a4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a372ff89484afeb599f24d78ef3cee', 'request_id': 'req-a35a88ae-fdd4-4349-8178-569b8f283a4e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:45.436252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a35a88ae-fdd4-4349-8178-569b8f283a4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a372ff89484afeb599f24d78ef3cee', 'request_id': 'req-a35a88ae-fdd4-4349-8178-569b8f283a4e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:45.480036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a35a88ae-fdd4-4349-8178-569b8f283a4e admin admin] The token cache is being invalidate because project c1a372ff89484afeb599f24d78ef3cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:45.480363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a35a88ae-fdd4-4349-8178-569b8f283a4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:45.482806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a35a88ae-fdd4-4349-8178-569b8f283a4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:45.491018 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3279/6548] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:45 2022] DELETE /identity/v3/projects/c1a372ff89484afeb599f24d78ef3cee => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:45.491523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4835163-a9b5-40b6-8946-7d5f6648873c service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:45.506282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4835163-a9b5-40b6-8946-7d5f6648873c service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:45.707863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17fe5c-30ed-46b8-800f-6a3832e78e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:45.708523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17fe5c-30ed-46b8-800f-6a3832e78e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:45.708785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17fe5c-30ed-46b8-800f-6a3832e78e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:45.709063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17fe5c-30ed-46b8-800f-6a3832e78e01 admin admin] PATH_INFO: `/v3/users/314a7fe7cda54ecfb073d59af20898bf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:45.710609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17fe5c-30ed-46b8-800f-6a3832e78e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=314a7fe7cda54ecfb073d59af20898bf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:45.716767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17fe5c-30ed-46b8-800f-6a3832e78e01 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:45.809624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a88ae-fdd4-4349-8178-569b8f283a4e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:45.811220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a35a88ae-fdd4-4349-8178-569b8f283a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:45.839643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a88ae-fdd4-4349-8178-569b8f283a4e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:45.840325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e17fe5c-30ed-46b8-800f-6a3832e78e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314a7fe7cda54ecfb073d59af20898bf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:45.842298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e17fe5c-30ed-46b8-800f-6a3832e78e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314a7fe7cda54ecfb073d59af20898bf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:45.850609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cc729-bbee-4982-a0c6-85b46758628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:45.851302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cc729-bbee-4982-a0c6-85b46758628e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:45.851666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cc729-bbee-4982-a0c6-85b46758628e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:45.851862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cc729-bbee-4982-a0c6-85b46758628e admin admin] PATH_INFO: `/v3/projects/e89e8dffc5674125b701f12cbf212ee0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:45.855557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cc729-bbee-4982-a0c6-85b46758628e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e89e8dffc5674125b701f12cbf212ee0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:45.857561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cc729-bbee-4982-a0c6-85b46758628e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:45.868755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e17fe5c-30ed-46b8-800f-6a3832e78e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314a7fe7cda54ecfb073d59af20898bf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:45.884204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e17fe5c-30ed-46b8-800f-6a3832e78e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314a7fe7cda54ecfb073d59af20898bf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:45.901232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e17fe5c-30ed-46b8-800f-6a3832e78e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314a7fe7cda54ecfb073d59af20898bf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:45.910421 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3270/6549] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:45 2022] DELETE /identity/v3/users/314a7fe7cda54ecfb073d59af20898bf => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:45.916420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:45.970074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-849cc729-bbee-4982-a0c6-85b46758628e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e89e8dffc5674125b701f12cbf212ee0', 'request_id': 'req-849cc729-bbee-4982-a0c6-85b46758628e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:45.977435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-849cc729-bbee-4982-a0c6-85b46758628e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e89e8dffc5674125b701f12cbf212ee0', 'request_id': 'req-849cc729-bbee-4982-a0c6-85b46758628e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:45.983921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-849cc729-bbee-4982-a0c6-85b46758628e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e89e8dffc5674125b701f12cbf212ee0', 'request_id': 'req-849cc729-bbee-4982-a0c6-85b46758628e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:46.006307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-849cc729-bbee-4982-a0c6-85b46758628e admin admin] The token cache is being invalidate because project e89e8dffc5674125b701f12cbf212ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:46.006624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-849cc729-bbee-4982-a0c6-85b46758628e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:46.008724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-849cc729-bbee-4982-a0c6-85b46758628e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:46.012499 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3280/6550] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:45 2022] DELETE /identity/v3/projects/e89e8dffc5674125b701f12cbf212ee0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:46.017875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34ba0f-4550-4d15-9f8d-ea0117e48dbf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:46.018150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34ba0f-4550-4d15-9f8d-ea0117e48dbf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:46.018426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34ba0f-4550-4d15-9f8d-ea0117e48dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:46.063482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3f34ba0f-4550-4d15-9f8d-ea0117e48dbf None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:46.064718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f34ba0f-4550-4d15-9f8d-ea0117e48dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:46.148374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:46.209414 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3271/6551] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:46.219973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb43a6-7c7b-402f-99e3-5d12f45a48ec None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:46.220360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb43a6-7c7b-402f-99e3-5d12f45a48ec None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:46.221919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb43a6-7c7b-402f-99e3-5d12f45a48ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:46.321264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4bbb43a6-7c7b-402f-99e3-5d12f45a48ec None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:46.322767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4bbb43a6-7c7b-402f-99e3-5d12f45a48ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:46.333180 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3281/6552] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:46.337214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34ba0f-4550-4d15-9f8d-ea0117e48dbf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:46.347606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34ba0f-4550-4d15-9f8d-ea0117e48dbf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:46.370707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33e657-63e8-45ec-be97-05f062ac2561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:46.371407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33e657-63e8-45ec-be97-05f062ac2561 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:46.371691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33e657-63e8-45ec-be97-05f062ac2561 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:46.371965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33e657-63e8-45ec-be97-05f062ac2561 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:46.372633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33e657-63e8-45ec-be97-05f062ac2561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:49:46.373284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33e657-63e8-45ec-be97-05f062ac2561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:46.375164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33e657-63e8-45ec-be97-05f062ac2561 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:46.397387 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3272/6553] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:46.404062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb43a6-7c7b-402f-99e3-5d12f45a48ec None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:46.419130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb43a6-7c7b-402f-99e3-5d12f45a48ec None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:46.425038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa3e36-0df9-4ebf-a9eb-b29453f8a7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:46.426201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3e36-0df9-4ebf-a9eb-b29453f8a7cd admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:46.426652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3e36-0df9-4ebf-a9eb-b29453f8a7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:46.427093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3e36-0df9-4ebf-a9eb-b29453f8a7cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:46.427987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa3e36-0df9-4ebf-a9eb-b29453f8a7cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:46.430278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa3e36-0df9-4ebf-a9eb-b29453f8a7cd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:46.500357 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3282/6554] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:46 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:46.505781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33e657-63e8-45ec-be97-05f062ac2561 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:46.520688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33e657-63e8-45ec-be97-05f062ac2561 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:46.726163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497d87f-1dcb-4cd1-b05e-8514f86c3e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:46.727116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d87f-1dcb-4cd1-b05e-8514f86c3e4b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:46.727361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d87f-1dcb-4cd1-b05e-8514f86c3e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:46.727642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d87f-1dcb-4cd1-b05e-8514f86c3e4b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:46.728331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497d87f-1dcb-4cd1-b05e-8514f86c3e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:46.730615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497d87f-1dcb-4cd1-b05e-8514f86c3e4b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:46.781082 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3273/6555] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:46 2022] POST /identity/v3/users => generated 283 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:46.781848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa3e36-0df9-4ebf-a9eb-b29453f8a7cd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:46.801629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa3e36-0df9-4ebf-a9eb-b29453f8a7cd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:46.825859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8dab1-46a5-4225-8e6a-e3feba6336fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:46.826543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8dab1-46a5-4225-8e6a-e3feba6336fd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:46.827083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8dab1-46a5-4225-8e6a-e3feba6336fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:46.828152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8dab1-46a5-4225-8e6a-e3feba6336fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:46.830111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8dab1-46a5-4225-8e6a-e3feba6336fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:46.844124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8dab1-46a5-4225-8e6a-e3feba6336fd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:46.890953 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3283/6556] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:46.894738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497d87f-1dcb-4cd1-b05e-8514f86c3e4b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:46.911876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497d87f-1dcb-4cd1-b05e-8514f86c3e4b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:46.944363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe60ec1-6c92-4c12-839e-38151a0fb3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:46.945006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe60ec1-6c92-4c12-839e-38151a0fb3fc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:46.946058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe60ec1-6c92-4c12-839e-38151a0fb3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:46.946350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe60ec1-6c92-4c12-839e-38151a0fb3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:46.947021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe60ec1-6c92-4c12-839e-38151a0fb3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:46.953938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe60ec1-6c92-4c12-839e-38151a0fb3fc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:46.959871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8dab1-46a5-4225-8e6a-e3feba6336fd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:46.962158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2ee8dab1-46a5-4225-8e6a-e3feba6336fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:46.985396 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3274/6557] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:47.000727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe60ec1-6c92-4c12-839e-38151a0fb3fc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:47.016651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8dab1-46a5-4225-8e6a-e3feba6336fd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:47.026903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed752de-a999-4b33-8918-18b7db91fa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:47.028091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe60ec1-6c92-4c12-839e-38151a0fb3fc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:47.033987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed752de-a999-4b33-8918-18b7db91fa96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:47.034857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed752de-a999-4b33-8918-18b7db91fa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:47.035322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed752de-a999-4b33-8918-18b7db91fa96 admin admin] PATH_INFO: `/v3/projects/b117696af2cb4979aa3cf22f7f559134` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:47.038858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed752de-a999-4b33-8918-18b7db91fa96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b117696af2cb4979aa3cf22f7f559134)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:47.042473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bef81-1ac0-4892-8894-dd564bb95955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:47.043107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bef81-1ac0-4892-8894-dd564bb95955 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:47.043417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bef81-1ac0-4892-8894-dd564bb95955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:47.043697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bef81-1ac0-4892-8894-dd564bb95955 admin admin] PATH_INFO: `/v3/projects/b32ec8b061694855a5379f071b22ca5c/users/6309326e62cc4a768c6704e3e9a9d1b8/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:47.046549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed752de-a999-4b33-8918-18b7db91fa96 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:47.092413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bef81-1ac0-4892-8894-dd564bb95955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b32ec8b061694855a5379f071b22ca5c, user_id=6309326e62cc4a768c6704e3e9a9d1b8, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:47.101430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bef81-1ac0-4892-8894-dd564bb95955 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:47.124842 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3275/6558] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:46 2022] PUT /identity/v3/projects/b32ec8b061694855a5379f071b22ca5c/users/6309326e62cc4a768c6704e3e9a9d1b8/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:47.141234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71473ea-dc49-4ef8-9e33-b91f94b3745b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:47.141524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71473ea-dc49-4ef8-9e33-b91f94b3745b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:47.141802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71473ea-dc49-4ef8-9e33-b91f94b3745b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:47.160314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ed752de-a999-4b33-8918-18b7db91fa96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b117696af2cb4979aa3cf22f7f559134', 'request_id': 'req-8ed752de-a999-4b33-8918-18b7db91fa96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:47.174785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ed752de-a999-4b33-8918-18b7db91fa96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b117696af2cb4979aa3cf22f7f559134', 'request_id': 'req-8ed752de-a999-4b33-8918-18b7db91fa96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:47.192743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ed752de-a999-4b33-8918-18b7db91fa96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b117696af2cb4979aa3cf22f7f559134', 'request_id': 'req-8ed752de-a999-4b33-8918-18b7db91fa96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:47.217478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a71473ea-dc49-4ef8-9e33-b91f94b3745b None None] MFA Rules not processed for user `6309326e62cc4a768c6704e3e9a9d1b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:47.220576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a71473ea-dc49-4ef8-9e33-b91f94b3745b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:47.228169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ed752de-a999-4b33-8918-18b7db91fa96 admin admin] The token cache is being invalidate because project b117696af2cb4979aa3cf22f7f559134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:47.228713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ed752de-a999-4b33-8918-18b7db91fa96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:47.230015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ed752de-a999-4b33-8918-18b7db91fa96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:47.232518 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3284/6559] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:46 2022] DELETE /identity/v3/projects/b117696af2cb4979aa3cf22f7f559134 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:49:47.237389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed752de-a999-4b33-8918-18b7db91fa96 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:47.239342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8ed752de-a999-4b33-8918-18b7db91fa96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:47.348003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:47.364615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed752de-a999-4b33-8918-18b7db91fa96 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:47.394347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9026b56-84d4-43ef-902c-49f0ca25273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:47.396299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9026b56-84d4-43ef-902c-49f0ca25273a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:47.396821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9026b56-84d4-43ef-902c-49f0ca25273a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:47.397114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9026b56-84d4-43ef-902c-49f0ca25273a admin admin] PATH_INFO: `/v3/users/08d9f476db9c4940b5c0f879405148e0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:47.400194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9026b56-84d4-43ef-902c-49f0ca25273a admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d9f476db9c4940b5c0f879405148e0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:47.415089 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3276/6560] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:47.418778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9026b56-84d4-43ef-902c-49f0ca25273a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:47.423243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71473ea-dc49-4ef8-9e33-b91f94b3745b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:47.425865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a71473ea-dc49-4ef8-9e33-b91f94b3745b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:47.454124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:47.538892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9026b56-84d4-43ef-902c-49f0ca25273a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d9f476db9c4940b5c0f879405148e0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:47.601978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9026b56-84d4-43ef-902c-49f0ca25273a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d9f476db9c4940b5c0f879405148e0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:47.603003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9026b56-84d4-43ef-902c-49f0ca25273a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d9f476db9c4940b5c0f879405148e0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:47.603663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9026b56-84d4-43ef-902c-49f0ca25273a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d9f476db9c4940b5c0f879405148e0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:47.606427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71473ea-dc49-4ef8-9e33-b91f94b3745b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:47.616804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495e3a8-8b33-49d2-ac5d-1dc3fb62b3cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:47.617713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495e3a8-8b33-49d2-ac5d-1dc3fb62b3cc service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:47.618194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495e3a8-8b33-49d2-ac5d-1dc3fb62b3cc service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:47.618613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495e3a8-8b33-49d2-ac5d-1dc3fb62b3cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:47.621455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5495e3a8-8b33-49d2-ac5d-1dc3fb62b3cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:47.624662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9026b56-84d4-43ef-902c-49f0ca25273a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d9f476db9c4940b5c0f879405148e0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:47.640262 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3285/6561] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:47 2022] DELETE /identity/v3/users/08d9f476db9c4940b5c0f879405148e0 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:47.651852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495e3a8-8b33-49d2-ac5d-1dc3fb62b3cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:47.654349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495e3a8-8b33-49d2-ac5d-1dc3fb62b3cc service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:47.691941 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3277/6562] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:49:47.699017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9950f-bf64-48a7-b890-3e3f8cf58111 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:47.699403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9950f-bf64-48a7-b890-3e3f8cf58111 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:47.699839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9950f-bf64-48a7-b890-3e3f8cf58111 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:47.701670 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3286/6563] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:49:47.708266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495e3a8-8b33-49d2-ac5d-1dc3fb62b3cc service nova] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:49:47.709777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5495e3a8-8b33-49d2-ac5d-1dc3fb62b3cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:47.745103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495e3a8-8b33-49d2-ac5d-1dc3fb62b3cc service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:47.765703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495e3a8-8b33-49d2-ac5d-1dc3fb62b3cc service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:47.834808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e36a62-1fab-400a-a41c-3aca30906229 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6309326e62cc4a768c6704e3e9a9d1b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b32ec8b061694855a5379f071b22ca5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:47.835917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e36a62-1fab-400a-a41c-3aca30906229 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:47.835917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e36a62-1fab-400a-a41c-3aca30906229 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:47.836234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e36a62-1fab-400a-a41c-3aca30906229 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] PATH_INFO: `/v3/projects/b32ec8b061694855a5379f071b22ca5c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:47.837252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e36a62-1fab-400a-a41c-3aca30906229 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] RBAC: Authorizing `identity:get_project(project_id=b32ec8b061694855a5379f071b22ca5c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:47.839043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e36a62-1fab-400a-a41c-3aca30906229 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:47.857604 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3278/6564] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:49:47 2022] GET /identity/v3/projects/b32ec8b061694855a5379f071b22ca5c => generated 365 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:47.880079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87efd23-601c-4a7c-ab17-8af729bf6760 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:47.880683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87efd23-601c-4a7c-ab17-8af729bf6760 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:47.880683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87efd23-601c-4a7c-ab17-8af729bf6760 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:47.881955 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3287/6565] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:49:47.887121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e36a62-1fab-400a-a41c-3aca30906229 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:49:47.889713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89e36a62-1fab-400a-a41c-3aca30906229 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:48.079155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87efd23-601c-4a7c-ab17-8af729bf6760 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:48.080968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f87efd23-601c-4a7c-ab17-8af729bf6760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:48.096471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e36a62-1fab-400a-a41c-3aca30906229 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:48.114756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e36a62-1fab-400a-a41c-3aca30906229 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:48.119728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fdee9-899e-473b-b354-d01e065553fa tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6309326e62cc4a768c6704e3e9a9d1b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b32ec8b061694855a5379f071b22ca5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:48.120467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fdee9-899e-473b-b354-d01e065553fa tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:48.126831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fdee9-899e-473b-b354-d01e065553fa tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:48.127017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fdee9-899e-473b-b354-d01e065553fa tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] PATH_INFO: `/v3/projects/b32ec8b061694855a5379f071b22ca5c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:48.130780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fdee9-899e-473b-b354-d01e065553fa tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] RBAC: Authorizing `identity:get_project(project_id=b32ec8b061694855a5379f071b22ca5c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:48.135569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fdee9-899e-473b-b354-d01e065553fa tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:48.141716 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3279/6566] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:49:47 2022] GET /identity/v3/projects/b32ec8b061694855a5379f071b22ca5c => generated 365 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:48.176298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87efd23-601c-4a7c-ab17-8af729bf6760 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:48.191043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dd9b2-8660-401f-a4fd-fbecc8beea3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:48.192730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dd9b2-8660-401f-a4fd-fbecc8beea3b service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:48.202621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dd9b2-8660-401f-a4fd-fbecc8beea3b service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:48.202940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dd9b2-8660-401f-a4fd-fbecc8beea3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:48.204813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3e071-90f0-4d42-ac14-eaca4075c5a9 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:48.205051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3e071-90f0-4d42-ac14-eaca4075c5a9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:48.205384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3e071-90f0-4d42-ac14-eaca4075c5a9 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:48.207162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d2dd9b2-8660-401f-a4fd-fbecc8beea3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:48.207416 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3280/6567] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:49:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:49:48.213359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3e071-90f0-4d42-ac14-eaca4075c5a9 None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:49:48.250102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3e071-90f0-4d42-ac14-eaca4075c5a9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:48.274620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3e071-90f0-4d42-ac14-eaca4075c5a9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:48.290494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f1e72-340d-49e1-9e33-afea6b3f2ee0 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6309326e62cc4a768c6704e3e9a9d1b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b32ec8b061694855a5379f071b22ca5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:48.291289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f1e72-340d-49e1-9e33-afea6b3f2ee0 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:48.293705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f1e72-340d-49e1-9e33-afea6b3f2ee0 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:48.294106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f1e72-340d-49e1-9e33-afea6b3f2ee0 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] PATH_INFO: `/v3/projects/b32ec8b061694855a5379f071b22ca5c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:48.296507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f1e72-340d-49e1-9e33-afea6b3f2ee0 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] RBAC: Authorizing `identity:get_project(project_id=b32ec8b061694855a5379f071b22ca5c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:48.302125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f1e72-340d-49e1-9e33-afea6b3f2ee0 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:48.309268 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3281/6568] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:49:48 2022] GET /identity/v3/projects/b32ec8b061694855a5379f071b22ca5c => generated 365 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:49:48.351827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2dd9b2-8660-401f-a4fd-fbecc8beea3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:48.354229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2dd9b2-8660-401f-a4fd-fbecc8beea3b service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:48.356988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f279ef7-fda9-4fd8-90a9-7d444515cea3 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:48.357393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f279ef7-fda9-4fd8-90a9-7d444515cea3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:48.357829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f279ef7-fda9-4fd8-90a9-7d444515cea3 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:48.359611 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3282/6569] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:49:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:49:48.367396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f279ef7-fda9-4fd8-90a9-7d444515cea3 None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:49:48.369574 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3288/6570] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:48.389475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f279ef7-fda9-4fd8-90a9-7d444515cea3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:48.408462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f279ef7-fda9-4fd8-90a9-7d444515cea3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:48.414366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6448e-759b-49ed-824d-261e63fb5ad0 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6309326e62cc4a768c6704e3e9a9d1b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b32ec8b061694855a5379f071b22ca5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:48.415789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6448e-759b-49ed-824d-261e63fb5ad0 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:48.415789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6448e-759b-49ed-824d-261e63fb5ad0 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:48.416195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6448e-759b-49ed-824d-261e63fb5ad0 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] PATH_INFO: `/v3/projects/b32ec8b061694855a5379f071b22ca5c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:48.417740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6448e-759b-49ed-824d-261e63fb5ad0 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] RBAC: Authorizing `identity:get_project(project_id=b32ec8b061694855a5379f071b22ca5c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:48.419767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6448e-759b-49ed-824d-261e63fb5ad0 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:48.423048 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3283/6571] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:49:48 2022] GET /identity/v3/projects/b32ec8b061694855a5379f071b22ca5c => generated 365 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:48.501545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2786be8-6141-4c54-9546-398267e9c1c7 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:48.503050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2786be8-6141-4c54-9546-398267e9c1c7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:48.503611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2786be8-6141-4c54-9546-398267e9c1c7 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:48.507402 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3289/6572] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 18:49:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:49:48.514091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6448e-759b-49ed-824d-261e63fb5ad0 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:49:48.535648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6448e-759b-49ed-824d-261e63fb5ad0 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:48.547537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6448e-759b-49ed-824d-261e63fb5ad0 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:48.559478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25694368-9117-4c52-ad36-d51b4ea85f16 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6309326e62cc4a768c6704e3e9a9d1b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b32ec8b061694855a5379f071b22ca5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:48.560261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25694368-9117-4c52-ad36-d51b4ea85f16 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:48.560643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25694368-9117-4c52-ad36-d51b4ea85f16 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:48.561011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25694368-9117-4c52-ad36-d51b4ea85f16 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] PATH_INFO: `/v3/projects/b32ec8b061694855a5379f071b22ca5c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:48.562529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25694368-9117-4c52-ad36-d51b4ea85f16 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] RBAC: Authorizing `identity:get_project(project_id=b32ec8b061694855a5379f071b22ca5c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:48.564688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25694368-9117-4c52-ad36-d51b4ea85f16 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:48.567391 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3284/6573] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 18:49:48 2022] GET /identity/v3/projects/b32ec8b061694855a5379f071b22ca5c => generated 365 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:49:48.626008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2786be8-6141-4c54-9546-398267e9c1c7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:48.633188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c2786be8-6141-4c54-9546-398267e9c1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:48.726946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:48.861926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2786be8-6141-4c54-9546-398267e9c1c7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:48.867768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25694368-9117-4c52-ad36-d51b4ea85f16 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:48.872601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-25694368-9117-4c52-ad36-d51b4ea85f16 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:48.890153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:48.895791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc889d0c-f7bc-4c0a-a63d-03e181477e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:48.902676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc889d0c-f7bc-4c0a-a63d-03e181477e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:48.904505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc889d0c-f7bc-4c0a-a63d-03e181477e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:48.905003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc889d0c-f7bc-4c0a-a63d-03e181477e81 admin admin] PATH_INFO: `/v3/users/6309326e62cc4a768c6704e3e9a9d1b8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:48.908969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc889d0c-f7bc-4c0a-a63d-03e181477e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6309326e62cc4a768c6704e3e9a9d1b8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:48.912545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25694368-9117-4c52-ad36-d51b4ea85f16 tempest-QuotasTestJSON-1734096827 tempest-QuotasTestJSON-1734096827-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:48.914635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc889d0c-f7bc-4c0a-a63d-03e181477e81 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:48.940997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28befd-b547-4ca4-a647-c75642a4fe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:48.945865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28befd-b547-4ca4-a647-c75642a4fe2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:48.947229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28befd-b547-4ca4-a647-c75642a4fe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:48.948179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28befd-b547-4ca4-a647-c75642a4fe2f admin admin] PATH_INFO: `/v3/projects/f1b3d02ac93d48bba31b050d6402b9a1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:48.952213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28befd-b547-4ca4-a647-c75642a4fe2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b3d02ac93d48bba31b050d6402b9a1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:48.969675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28befd-b547-4ca4-a647-c75642a4fe2f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:49.060069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc889d0c-f7bc-4c0a-a63d-03e181477e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6309326e62cc4a768c6704e3e9a9d1b8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:49.092938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc889d0c-f7bc-4c0a-a63d-03e181477e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6309326e62cc4a768c6704e3e9a9d1b8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:49.096681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc889d0c-f7bc-4c0a-a63d-03e181477e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6309326e62cc4a768c6704e3e9a9d1b8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:49.099192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc889d0c-f7bc-4c0a-a63d-03e181477e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6309326e62cc4a768c6704e3e9a9d1b8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:49.100129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7d28befd-b547-4ca4-a647-c75642a4fe2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b3d02ac93d48bba31b050d6402b9a1', 'request_id': 'req-7d28befd-b547-4ca4-a647-c75642a4fe2f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:49.121038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7d28befd-b547-4ca4-a647-c75642a4fe2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b3d02ac93d48bba31b050d6402b9a1', 'request_id': 'req-7d28befd-b547-4ca4-a647-c75642a4fe2f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:49.127835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7d28befd-b547-4ca4-a647-c75642a4fe2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b3d02ac93d48bba31b050d6402b9a1', 'request_id': 'req-7d28befd-b547-4ca4-a647-c75642a4fe2f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:49.128338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc889d0c-f7bc-4c0a-a63d-03e181477e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6309326e62cc4a768c6704e3e9a9d1b8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:49.153699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7d28befd-b547-4ca4-a647-c75642a4fe2f admin admin] The token cache is being invalidate because project f1b3d02ac93d48bba31b050d6402b9a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:49.154147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7d28befd-b547-4ca4-a647-c75642a4fe2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:49.154973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7d28befd-b547-4ca4-a647-c75642a4fe2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:49.156596 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3285/6575] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:48 2022] DELETE /identity/v3/projects/f1b3d02ac93d48bba31b050d6402b9a1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:49.158795 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3290/6575] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:48 2022] DELETE /identity/v3/users/6309326e62cc4a768c6704e3e9a9d1b8 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:49.160066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d261a3d-9539-431e-843f-493b8973f9d0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:49.160411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d261a3d-9539-431e-843f-493b8973f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:49.160698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d261a3d-9539-431e-843f-493b8973f9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:49.163247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c350ad-e8d2-4e27-903d-fdedb6e834b7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:49.163717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c350ad-e8d2-4e27-903d-fdedb6e834b7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:49.163998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c350ad-e8d2-4e27-903d-fdedb6e834b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:49.195050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6d261a3d-9539-431e-843f-493b8973f9d0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:49.196416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6d261a3d-9539-431e-843f-493b8973f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:49.219459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c7c350ad-e8d2-4e27-903d-fdedb6e834b7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:49.221588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c7c350ad-e8d2-4e27-903d-fdedb6e834b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:49.349730 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3291/6576] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:49.363860 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3286/6577] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:49.365000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa56435-362a-4143-9f19-143c5f025b45 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:49.365282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa56435-362a-4143-9f19-143c5f025b45 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:49.366137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa56435-362a-4143-9f19-143c5f025b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:49.408009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5fa56435-362a-4143-9f19-143c5f025b45 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:49.409579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5fa56435-362a-4143-9f19-143c5f025b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:49.418934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d261a3d-9539-431e-843f-493b8973f9d0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:49.420468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6d261a3d-9539-431e-843f-493b8973f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:49.421065 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3292/6578] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:49.425618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa56435-362a-4143-9f19-143c5f025b45 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:49.464280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa56435-362a-4143-9f19-143c5f025b45 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:49.477569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec3f56-bdfd-4e69-8fff-845f5d6d12e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:49.482628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec3f56-bdfd-4e69-8fff-845f5d6d12e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:49.482913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec3f56-bdfd-4e69-8fff-845f5d6d12e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:49.483744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec3f56-bdfd-4e69-8fff-845f5d6d12e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:49.487955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec3f56-bdfd-4e69-8fff-845f5d6d12e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:49:49.488964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec3f56-bdfd-4e69-8fff-845f5d6d12e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:49.491684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec3f56-bdfd-4e69-8fff-845f5d6d12e1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:49.510784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d261a3d-9539-431e-843f-493b8973f9d0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:49.517058 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3293/6579] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:49.519138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec3f56-bdfd-4e69-8fff-845f5d6d12e1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:49.527656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff859a-0fa3-4ceb-a253-e35c301c3ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:49.528297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff859a-0fa3-4ceb-a253-e35c301c3ccd service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:49.528575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff859a-0fa3-4ceb-a253-e35c301c3ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:49.528851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff859a-0fa3-4ceb-a253-e35c301c3ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:49.537955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec3f56-bdfd-4e69-8fff-845f5d6d12e1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:49.547123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff859a-0fa3-4ceb-a253-e35c301c3ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:49.549668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff859a-0fa3-4ceb-a253-e35c301c3ccd service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:49.554438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b2a26-b8ea-40b8-b517-3d8f6f2d62ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:49.555080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b2a26-b8ea-40b8-b517-3d8f6f2d62ce admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:49.555409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b2a26-b8ea-40b8-b517-3d8f6f2d62ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:49.555879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b2a26-b8ea-40b8-b517-3d8f6f2d62ce admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:49.556756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b2a26-b8ea-40b8-b517-3d8f6f2d62ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:49.559005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b2a26-b8ea-40b8-b517-3d8f6f2d62ce admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:49.582586 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3287/6580] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:49:49.631607 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3294/6581] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:49 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:49.634865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff859a-0fa3-4ceb-a253-e35c301c3ccd service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:49.662544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff859a-0fa3-4ceb-a253-e35c301c3ccd service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:49.734660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:49.840607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ade36a-628a-4f4a-8a15-527f8ca89db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:49.841361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ade36a-628a-4f4a-8a15-527f8ca89db6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:49.841644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ade36a-628a-4f4a-8a15-527f8ca89db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:49.842095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ade36a-628a-4f4a-8a15-527f8ca89db6 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:49.842760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ade36a-628a-4f4a-8a15-527f8ca89db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:49.850401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ade36a-628a-4f4a-8a15-527f8ca89db6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:49.902661 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3288/6582] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:49 2022] POST /identity/v3/users => generated 290 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:49.905724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b2a26-b8ea-40b8-b517-3d8f6f2d62ce admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:49.914767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:49.933633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b2a26-b8ea-40b8-b517-3d8f6f2d62ce admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:49.960638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40130a47-86c3-4470-9c17-301669f7bb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:49.961648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40130a47-86c3-4470-9c17-301669f7bb4d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:49.962049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40130a47-86c3-4470-9c17-301669f7bb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:49.962419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40130a47-86c3-4470-9c17-301669f7bb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:49.963402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40130a47-86c3-4470-9c17-301669f7bb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:49.974115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40130a47-86c3-4470-9c17-301669f7bb4d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:50.018232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ade36a-628a-4f4a-8a15-527f8ca89db6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:50.018895 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3295/6583] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:50.053647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ade36a-628a-4f4a-8a15-527f8ca89db6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:50.069091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada39b9-d2e1-419f-953e-e7776c2b4d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:50.072247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada39b9-d2e1-419f-953e-e7776c2b4d0d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:50.072769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada39b9-d2e1-419f-953e-e7776c2b4d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:50.073808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada39b9-d2e1-419f-953e-e7776c2b4d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:50.076961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada39b9-d2e1-419f-953e-e7776c2b4d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:50.080836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada39b9-d2e1-419f-953e-e7776c2b4d0d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:50.108925 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3289/6584] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:49:50.112921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40130a47-86c3-4470-9c17-301669f7bb4d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:50.125247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40130a47-86c3-4470-9c17-301669f7bb4d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:50.140552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80901222-14d1-4aa6-911f-993a4615f521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:50.141221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901222-14d1-4aa6-911f-993a4615f521 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:50.141500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901222-14d1-4aa6-911f-993a4615f521 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:50.141773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901222-14d1-4aa6-911f-993a4615f521 admin admin] PATH_INFO: `/v3/projects/8dd43a40f41f458c9e727dd450a1e1b6/users/3afce090f88e408da3e2672850f3cd54/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:50.174008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80901222-14d1-4aa6-911f-993a4615f521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd43a40f41f458c9e727dd450a1e1b6, user_id=3afce090f88e408da3e2672850f3cd54, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:50.177152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80901222-14d1-4aa6-911f-993a4615f521 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:50.204323 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3296/6585] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:50 2022] PUT /identity/v3/projects/8dd43a40f41f458c9e727dd450a1e1b6/users/3afce090f88e408da3e2672850f3cd54/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:50.215149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19075b8-5975-4f47-af8e-6d3caba9671a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:50.215477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19075b8-5975-4f47-af8e-6d3caba9671a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:50.215768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19075b8-5975-4f47-af8e-6d3caba9671a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:50.293026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c19075b8-5975-4f47-af8e-6d3caba9671a None None] MFA Rules not processed for user `3afce090f88e408da3e2672850f3cd54`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:50.294460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c19075b8-5975-4f47-af8e-6d3caba9671a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:50.470863 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3290/6586] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:50.480112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80901222-14d1-4aa6-911f-993a4615f521 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:50.483136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-80901222-14d1-4aa6-911f-993a4615f521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:50.580131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80901222-14d1-4aa6-911f-993a4615f521 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:50.584965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956e7fa-ccb5-4e61-ac05-81b6c0167f94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:50.585963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956e7fa-ccb5-4e61-ac05-81b6c0167f94 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:50.586398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956e7fa-ccb5-4e61-ac05-81b6c0167f94 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:50.586846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956e7fa-ccb5-4e61-ac05-81b6c0167f94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:50.599377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956e7fa-ccb5-4e61-ac05-81b6c0167f94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:50.601121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956e7fa-ccb5-4e61-ac05-81b6c0167f94 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:50.627629 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3297/6587] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:50.747863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19075b8-5975-4f47-af8e-6d3caba9671a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:50.749526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c19075b8-5975-4f47-af8e-6d3caba9671a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:51.050504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19075b8-5975-4f47-af8e-6d3caba9671a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:51.073341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079e634-2c7a-41d6-8c56-684c9237240b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:51.074584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079e634-2c7a-41d6-8c56-684c9237240b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:51.075441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079e634-2c7a-41d6-8c56-684c9237240b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:51.076130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079e634-2c7a-41d6-8c56-684c9237240b admin admin] PATH_INFO: `/v3/projects/b32ec8b061694855a5379f071b22ca5c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:51.080416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079e634-2c7a-41d6-8c56-684c9237240b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b32ec8b061694855a5379f071b22ca5c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:51.089790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079e634-2c7a-41d6-8c56-684c9237240b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:51.182127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:51.197641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4079e634-2c7a-41d6-8c56-684c9237240b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b32ec8b061694855a5379f071b22ca5c', 'request_id': 'req-4079e634-2c7a-41d6-8c56-684c9237240b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:51.234570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4079e634-2c7a-41d6-8c56-684c9237240b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b32ec8b061694855a5379f071b22ca5c', 'request_id': 'req-4079e634-2c7a-41d6-8c56-684c9237240b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:51.246380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4079e634-2c7a-41d6-8c56-684c9237240b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b32ec8b061694855a5379f071b22ca5c', 'request_id': 'req-4079e634-2c7a-41d6-8c56-684c9237240b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:51.286599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4079e634-2c7a-41d6-8c56-684c9237240b admin admin] The token cache is being invalidate because project b32ec8b061694855a5379f071b22ca5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:51.286919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4079e634-2c7a-41d6-8c56-684c9237240b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:51.287736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4079e634-2c7a-41d6-8c56-684c9237240b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:51.291332 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3291/6588] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:50 2022] DELETE /identity/v3/projects/b32ec8b061694855a5379f071b22ca5c => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:51.296778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3d7cc-9f05-4f49-865b-014de7b176c5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:51.297308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3d7cc-9f05-4f49-865b-014de7b176c5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:51.297432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3d7cc-9f05-4f49-865b-014de7b176c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:51.356324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-aec3d7cc-9f05-4f49-865b-014de7b176c5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:51.358235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aec3d7cc-9f05-4f49-865b-014de7b176c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:51.514037 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3298/6589] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:51.514251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9d310-2ff0-4eb9-bdf0-18dec4614fca None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:51.514354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9d310-2ff0-4eb9-bdf0-18dec4614fca None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:51.514617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9d310-2ff0-4eb9-bdf0-18dec4614fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:51.554871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-59b9d310-2ff0-4eb9-bdf0-18dec4614fca None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:51.556249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-59b9d310-2ff0-4eb9-bdf0-18dec4614fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:51.567592 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3292/6590] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:51.578608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3d7cc-9f05-4f49-865b-014de7b176c5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:51.612378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3d7cc-9f05-4f49-865b-014de7b176c5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:51.618162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371f037-826e-44a6-92ff-bca3656c5c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:51.619068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f037-826e-44a6-92ff-bca3656c5c8e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:51.619375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f037-826e-44a6-92ff-bca3656c5c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:51.619703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f037-826e-44a6-92ff-bca3656c5c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:51.620374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371f037-826e-44a6-92ff-bca3656c5c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:49:51.620679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371f037-826e-44a6-92ff-bca3656c5c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:51.622363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371f037-826e-44a6-92ff-bca3656c5c8e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:51.643508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9d310-2ff0-4eb9-bdf0-18dec4614fca None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:51.648522 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3299/6591] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:51.659332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9d310-2ff0-4eb9-bdf0-18dec4614fca None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:51.670198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c92a9-2c62-4e2f-908d-e60ef4ad0efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:51.671786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c92a9-2c62-4e2f-908d-e60ef4ad0efb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:51.672315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c92a9-2c62-4e2f-908d-e60ef4ad0efb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:51.672783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c92a9-2c62-4e2f-908d-e60ef4ad0efb admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:51.673670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c92a9-2c62-4e2f-908d-e60ef4ad0efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:51.675987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c92a9-2c62-4e2f-908d-e60ef4ad0efb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:51.716785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371f037-826e-44a6-92ff-bca3656c5c8e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:51.719029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f371f037-826e-44a6-92ff-bca3656c5c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:51.719496 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3293/6592] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:51 2022] POST /identity/v3/projects => generated 359 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:51.720858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c92a9-2c62-4e2f-908d-e60ef4ad0efb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:51.734777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371f037-826e-44a6-92ff-bca3656c5c8e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:51.820879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c92a9-2c62-4e2f-908d-e60ef4ad0efb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:51.826454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37ad25-6575-44ed-bc3d-d28cd7aa7d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:51.827447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37ad25-6575-44ed-bc3d-d28cd7aa7d51 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:51.827944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37ad25-6575-44ed-bc3d-d28cd7aa7d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:51.828444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37ad25-6575-44ed-bc3d-d28cd7aa7d51 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:51.829292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37ad25-6575-44ed-bc3d-d28cd7aa7d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:51.831503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37ad25-6575-44ed-bc3d-d28cd7aa7d51 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:51.843966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:51.856380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237456cb-6898-449f-b8ad-7f596d538024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:51.857323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237456cb-6898-449f-b8ad-7f596d538024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:51.857654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237456cb-6898-449f-b8ad-7f596d538024 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:51.857982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237456cb-6898-449f-b8ad-7f596d538024 admin admin] PATH_INFO: `/v3/users/09ed4c684002431ea5eb01341fb71442` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:51.865517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237456cb-6898-449f-b8ad-7f596d538024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09ed4c684002431ea5eb01341fb71442)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:51.871728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237456cb-6898-449f-b8ad-7f596d538024 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:51.899722 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3294/6593] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:51 2022] POST /identity/v3/users => generated 280 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:51.901277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37ad25-6575-44ed-bc3d-d28cd7aa7d51 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:51.925393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37ad25-6575-44ed-bc3d-d28cd7aa7d51 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:51.939424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e27f02-6a92-4121-bde5-e3dc542e2451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:51.943982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e27f02-6a92-4121-bde5-e3dc542e2451 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:51.943982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e27f02-6a92-4121-bde5-e3dc542e2451 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:51.943982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e27f02-6a92-4121-bde5-e3dc542e2451 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:51.943982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e27f02-6a92-4121-bde5-e3dc542e2451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:51.945313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e27f02-6a92-4121-bde5-e3dc542e2451 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:51.985199 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3295/6594] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:51.986419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e27f02-6a92-4121-bde5-e3dc542e2451 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:52.000210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e27f02-6a92-4121-bde5-e3dc542e2451 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:52.021067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf826d-660a-4e62-9c59-d00d36af6f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:52.022746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf826d-660a-4e62-9c59-d00d36af6f95 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:52.022952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-237456cb-6898-449f-b8ad-7f596d538024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09ed4c684002431ea5eb01341fb71442'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:52.023452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf826d-660a-4e62-9c59-d00d36af6f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:52.023924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf826d-660a-4e62-9c59-d00d36af6f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:52.024809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf826d-660a-4e62-9c59-d00d36af6f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:52.027228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf826d-660a-4e62-9c59-d00d36af6f95 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:52.049644 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3296/6595] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:52.053962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf826d-660a-4e62-9c59-d00d36af6f95 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:52.058052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-237456cb-6898-449f-b8ad-7f596d538024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09ed4c684002431ea5eb01341fb71442'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:52.062968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-237456cb-6898-449f-b8ad-7f596d538024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09ed4c684002431ea5eb01341fb71442'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:52.063695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-237456cb-6898-449f-b8ad-7f596d538024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09ed4c684002431ea5eb01341fb71442'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:52.076179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf826d-660a-4e62-9c59-d00d36af6f95 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:52.097717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799627a1-cf00-46ae-bd4b-358954d299bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:52.100374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799627a1-cf00-46ae-bd4b-358954d299bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:52.100668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799627a1-cf00-46ae-bd4b-358954d299bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:52.100952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799627a1-cf00-46ae-bd4b-358954d299bf admin admin] PATH_INFO: `/v3/projects/b6da414ef23b46b09dad3e6b0c692a85/users/10b4b6d0a8aa4d8694575f228928248b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:52.102055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-237456cb-6898-449f-b8ad-7f596d538024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09ed4c684002431ea5eb01341fb71442'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:52.152413 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3300/6596] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:51 2022] DELETE /identity/v3/users/09ed4c684002431ea5eb01341fb71442 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:52.157447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799627a1-cf00-46ae-bd4b-358954d299bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6da414ef23b46b09dad3e6b0c692a85, user_id=10b4b6d0a8aa4d8694575f228928248b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:52.157609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc55bab-e5ab-4c7e-9603-ddb2830364e7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:52.157834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc55bab-e5ab-4c7e-9603-ddb2830364e7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:52.158113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc55bab-e5ab-4c7e-9603-ddb2830364e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:52.164557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799627a1-cf00-46ae-bd4b-358954d299bf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:52.200859 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3297/6597] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:52 2022] PUT /identity/v3/projects/b6da414ef23b46b09dad3e6b0c692a85/users/10b4b6d0a8aa4d8694575f228928248b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:52.215035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dbde6-dea6-4183-b224-e043761e8f5d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:52.215403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dbde6-dea6-4183-b224-e043761e8f5d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:52.216118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dbde6-dea6-4183-b224-e043761e8f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:52.247776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-abc55bab-e5ab-4c7e-9603-ddb2830364e7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:52.249010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-abc55bab-e5ab-4c7e-9603-ddb2830364e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:52.304985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-611dbde6-dea6-4183-b224-e043761e8f5d None None] MFA Rules not processed for user `10b4b6d0a8aa4d8694575f228928248b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:52.304985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-611dbde6-dea6-4183-b224-e043761e8f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:52.417478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:52.482307 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3301/6598] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:52.514628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc55bab-e5ab-4c7e-9603-ddb2830364e7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:52.526010 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3298/6599] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:52.528304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-abc55bab-e5ab-4c7e-9603-ddb2830364e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:52.569842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dbde6-dea6-4183-b224-e043761e8f5d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:52.571784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-611dbde6-dea6-4183-b224-e043761e8f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:52.608149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dbde6-dea6-4183-b224-e043761e8f5d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:52.644142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a9519-17b2-4a7f-aaec-673eedcc2dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:52.648324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a9519-17b2-4a7f-aaec-673eedcc2dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:52.651806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a9519-17b2-4a7f-aaec-673eedcc2dea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:52.653265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a9519-17b2-4a7f-aaec-673eedcc2dea admin admin] PATH_INFO: `/v3/users/10b4b6d0a8aa4d8694575f228928248b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:52.655294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a9519-17b2-4a7f-aaec-673eedcc2dea admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b4b6d0a8aa4d8694575f228928248b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:52.661324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a9519-17b2-4a7f-aaec-673eedcc2dea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:52.716566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc55bab-e5ab-4c7e-9603-ddb2830364e7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:52.722010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7a56f-561a-4171-9201-0662605e0229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:52.724051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7a56f-561a-4171-9201-0662605e0229 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:52.724494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7a56f-561a-4171-9201-0662605e0229 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:52.725215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7a56f-561a-4171-9201-0662605e0229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:52.739173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7a56f-561a-4171-9201-0662605e0229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:52.741196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7a56f-561a-4171-9201-0662605e0229 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:52.759195 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3302/6600] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:52.875439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4e3a9519-17b2-4a7f-aaec-673eedcc2dea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b4b6d0a8aa4d8694575f228928248b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:52.878155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4e3a9519-17b2-4a7f-aaec-673eedcc2dea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b4b6d0a8aa4d8694575f228928248b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:52.907890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4e3a9519-17b2-4a7f-aaec-673eedcc2dea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b4b6d0a8aa4d8694575f228928248b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:52.925071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4e3a9519-17b2-4a7f-aaec-673eedcc2dea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b4b6d0a8aa4d8694575f228928248b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:52.972180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4e3a9519-17b2-4a7f-aaec-673eedcc2dea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b4b6d0a8aa4d8694575f228928248b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:52.980170 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3299/6601] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:52 2022] DELETE /identity/v3/users/10b4b6d0a8aa4d8694575f228928248b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:49:52.987132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed4094-8eea-434a-84ad-f960450797b5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:52.987906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed4094-8eea-434a-84ad-f960450797b5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:52.988401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed4094-8eea-434a-84ad-f960450797b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:53.011743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d4ed4094-8eea-434a-84ad-f960450797b5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:53.012993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d4ed4094-8eea-434a-84ad-f960450797b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:53.031052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:53.114809 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3303/6602] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:53.127515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a9519-17b2-4a7f-aaec-673eedcc2dea admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:53.129269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e3a9519-17b2-4a7f-aaec-673eedcc2dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:53.326764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a9519-17b2-4a7f-aaec-673eedcc2dea admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:53.334568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ed92e-deb8-4dae-be33-89023a317c21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:53.335216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ed92e-deb8-4dae-be33-89023a317c21 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:53.335519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ed92e-deb8-4dae-be33-89023a317c21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:53.335799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ed92e-deb8-4dae-be33-89023a317c21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:53.357108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ed92e-deb8-4dae-be33-89023a317c21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:53.363513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ed92e-deb8-4dae-be33-89023a317c21 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:53.375640 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3300/6603] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:53.639164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed4094-8eea-434a-84ad-f960450797b5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:53.642795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d4ed4094-8eea-434a-84ad-f960450797b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:53.902011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed4094-8eea-434a-84ad-f960450797b5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:53.948291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b89241-aed9-4259-b160-2d9df80ca46f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:53.949289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b89241-aed9-4259-b160-2d9df80ca46f service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:53.949573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b89241-aed9-4259-b160-2d9df80ca46f service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:53.949852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b89241-aed9-4259-b160-2d9df80ca46f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:53.973530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c3b89241-aed9-4259-b160-2d9df80ca46f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:54.043286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b89241-aed9-4259-b160-2d9df80ca46f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:54.049660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b89241-aed9-4259-b160-2d9df80ca46f service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:54.117326 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3304/6604] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:54.169620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ed92e-deb8-4dae-be33-89023a317c21 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:54.171376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c65ed92e-deb8-4dae-be33-89023a317c21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:54.236538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ed92e-deb8-4dae-be33-89023a317c21 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:54.261191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b89241-aed9-4259-b160-2d9df80ca46f service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:54.262859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c3b89241-aed9-4259-b160-2d9df80ca46f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:54.273463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb06bc4-cddf-467c-9d6e-4e613fbd0ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:54.274485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb06bc4-cddf-467c-9d6e-4e613fbd0ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:54.274709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb06bc4-cddf-467c-9d6e-4e613fbd0ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:54.282120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb06bc4-cddf-467c-9d6e-4e613fbd0ddd admin admin] PATH_INFO: `/v3/projects/0ea56372b3a94fd3a90aea92e4b38edc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:54.285307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb06bc4-cddf-467c-9d6e-4e613fbd0ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea56372b3a94fd3a90aea92e4b38edc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:54.287410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb06bc4-cddf-467c-9d6e-4e613fbd0ddd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:54.296333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b89241-aed9-4259-b160-2d9df80ca46f service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:54.306874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc06f0-706d-4c9c-a971-89221cf29ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:54.307608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc06f0-706d-4c9c-a971-89221cf29ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:54.307891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc06f0-706d-4c9c-a971-89221cf29ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:54.308164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc06f0-706d-4c9c-a971-89221cf29ae8 admin admin] PATH_INFO: `/v3/projects/b6da414ef23b46b09dad3e6b0c692a85` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:54.309416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc06f0-706d-4c9c-a971-89221cf29ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6da414ef23b46b09dad3e6b0c692a85)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:54.311795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc06f0-706d-4c9c-a971-89221cf29ae8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:54.441839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:54.456398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3bb06bc4-cddf-467c-9d6e-4e613fbd0ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea56372b3a94fd3a90aea92e4b38edc', 'request_id': 'req-3bb06bc4-cddf-467c-9d6e-4e613fbd0ddd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:54.473149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3bb06bc4-cddf-467c-9d6e-4e613fbd0ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea56372b3a94fd3a90aea92e4b38edc', 'request_id': 'req-3bb06bc4-cddf-467c-9d6e-4e613fbd0ddd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:54.489240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3bb06bc4-cddf-467c-9d6e-4e613fbd0ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea56372b3a94fd3a90aea92e4b38edc', 'request_id': 'req-3bb06bc4-cddf-467c-9d6e-4e613fbd0ddd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:54.499664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b4dc06f0-706d-4c9c-a971-89221cf29ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6da414ef23b46b09dad3e6b0c692a85', 'request_id': 'req-b4dc06f0-706d-4c9c-a971-89221cf29ae8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:54.514131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b4dc06f0-706d-4c9c-a971-89221cf29ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6da414ef23b46b09dad3e6b0c692a85', 'request_id': 'req-b4dc06f0-706d-4c9c-a971-89221cf29ae8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:54.538220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b4dc06f0-706d-4c9c-a971-89221cf29ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6da414ef23b46b09dad3e6b0c692a85', 'request_id': 'req-b4dc06f0-706d-4c9c-a971-89221cf29ae8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:54.580025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3bb06bc4-cddf-467c-9d6e-4e613fbd0ddd admin admin] The token cache is being invalidate because project 0ea56372b3a94fd3a90aea92e4b38edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:54.580322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3bb06bc4-cddf-467c-9d6e-4e613fbd0ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:54.581214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3bb06bc4-cddf-467c-9d6e-4e613fbd0ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:54.582431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b4dc06f0-706d-4c9c-a971-89221cf29ae8 admin admin] The token cache is being invalidate because project b6da414ef23b46b09dad3e6b0c692a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:54.582736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b4dc06f0-706d-4c9c-a971-89221cf29ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:54.583376 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3301/6605] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:54 2022] DELETE /identity/v3/projects/0ea56372b3a94fd3a90aea92e4b38edc => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:54.586754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b4dc06f0-706d-4c9c-a971-89221cf29ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:54.588778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078bafb-5256-43a9-97ec-41429b2a5b03 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:54.589061 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3305/6606] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:54 2022] DELETE /identity/v3/projects/b6da414ef23b46b09dad3e6b0c692a85 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:54.589504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078bafb-5256-43a9-97ec-41429b2a5b03 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:54.590078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078bafb-5256-43a9-97ec-41429b2a5b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:54.596861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25d5ec-533f-4c36-8011-795e6a9da65b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:54.597162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25d5ec-533f-4c36-8011-795e6a9da65b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:54.597433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25d5ec-533f-4c36-8011-795e6a9da65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:54.651122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6078bafb-5256-43a9-97ec-41429b2a5b03 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:54.652581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6078bafb-5256-43a9-97ec-41429b2a5b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:54.724333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9c25d5ec-533f-4c36-8011-795e6a9da65b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:54.732712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9c25d5ec-533f-4c36-8011-795e6a9da65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:54.844141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:54.885123 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3302/6607] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:54.888742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d749d-2e9a-478e-acdb-8f357e62af29 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:54.889041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d749d-2e9a-478e-acdb-8f357e62af29 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:54.889330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d749d-2e9a-478e-acdb-8f357e62af29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:54.934275 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3306/6608] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:54.943589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f643f58-d57b-4afc-9550-87ca73c6d572 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:54.946908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f643f58-d57b-4afc-9550-87ca73c6d572 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:54.947361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a80d749d-2e9a-478e-acdb-8f357e62af29 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:54.947776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f643f58-d57b-4afc-9550-87ca73c6d572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:54.948951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a80d749d-2e9a-478e-acdb-8f357e62af29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:54.962647 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3303/6609] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:54.964119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d749d-2e9a-478e-acdb-8f357e62af29 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:54.988683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d749d-2e9a-478e-acdb-8f357e62af29 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:55.008960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6f643f58-d57b-4afc-9550-87ca73c6d572 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:55.014185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6f643f58-d57b-4afc-9550-87ca73c6d572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:55.024778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2c46e-458e-4096-bf2d-72cf660ba9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:55.025446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2c46e-458e-4096-bf2d-72cf660ba9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:55.026216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2c46e-458e-4096-bf2d-72cf660ba9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:55.026503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2c46e-458e-4096-bf2d-72cf660ba9f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:55.027417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2c46e-458e-4096-bf2d-72cf660ba9f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:49:55.027729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2c46e-458e-4096-bf2d-72cf660ba9f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:55.029656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2c46e-458e-4096-bf2d-72cf660ba9f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:55.049607 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3307/6610] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:55.050984 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3304/6611] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:55.052550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f643f58-d57b-4afc-9550-87ca73c6d572 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:55.053290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2c46e-458e-4096-bf2d-72cf660ba9f6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:55.080458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2c46e-458e-4096-bf2d-72cf660ba9f6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:55.082350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f643f58-d57b-4afc-9550-87ca73c6d572 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:55.094268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc5d54-9cab-495f-810e-2d6565612184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:55.095052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc5d54-9cab-495f-810e-2d6565612184 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:55.095472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc5d54-9cab-495f-810e-2d6565612184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:55.096046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824c284-62df-4ebe-9e06-9cd381433344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:55.096457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc5d54-9cab-495f-810e-2d6565612184 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:55.097010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824c284-62df-4ebe-9e06-9cd381433344 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:55.097452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824c284-62df-4ebe-9e06-9cd381433344 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:55.097909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824c284-62df-4ebe-9e06-9cd381433344 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:55.098688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824c284-62df-4ebe-9e06-9cd381433344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:55.098976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc5d54-9cab-495f-810e-2d6565612184 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:49:55.099428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc5d54-9cab-495f-810e-2d6565612184 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:55.101383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824c284-62df-4ebe-9e06-9cd381433344 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:55.103234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc5d54-9cab-495f-810e-2d6565612184 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:55.148198 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3305/6612] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:55.149176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc5d54-9cab-495f-810e-2d6565612184 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:55.179600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc5d54-9cab-495f-810e-2d6565612184 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:55.203131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe12a31-4135-4996-8fa6-05394d063a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:55.203814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe12a31-4135-4996-8fa6-05394d063a87 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:55.204151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe12a31-4135-4996-8fa6-05394d063a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:55.204426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe12a31-4135-4996-8fa6-05394d063a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:55.205072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe12a31-4135-4996-8fa6-05394d063a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:55.207115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe12a31-4135-4996-8fa6-05394d063a87 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:55.225258 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3308/6613] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:55 2022] POST /identity/v3/projects => generated 361 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:55.227497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824c284-62df-4ebe-9e06-9cd381433344 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:55.272561 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3306/6614] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:55 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:55.273587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe12a31-4135-4996-8fa6-05394d063a87 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:55.400379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824c284-62df-4ebe-9e06-9cd381433344 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:55.409932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe12a31-4135-4996-8fa6-05394d063a87 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:55.413687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f98a76-001d-4d79-b0f7-add24221064e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:55.414405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f98a76-001d-4d79-b0f7-add24221064e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:55.416021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f98a76-001d-4d79-b0f7-add24221064e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:55.416311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f98a76-001d-4d79-b0f7-add24221064e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:55.416975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f98a76-001d-4d79-b0f7-add24221064e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:55.419498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe049c90-a5a1-4650-9e6d-676388708dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:55.420951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe049c90-a5a1-4650-9e6d-676388708dca admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:55.421379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe049c90-a5a1-4650-9e6d-676388708dca admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:55.421812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe049c90-a5a1-4650-9e6d-676388708dca admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:55.422460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe049c90-a5a1-4650-9e6d-676388708dca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:55.424649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe049c90-a5a1-4650-9e6d-676388708dca admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:55.432531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f98a76-001d-4d79-b0f7-add24221064e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:55.482963 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3309/6615] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:55 2022] POST /identity/v3/users => generated 281 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:55.483146 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3307/6616] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:55 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:55.487219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f98a76-001d-4d79-b0f7-add24221064e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:55.491287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe049c90-a5a1-4650-9e6d-676388708dca admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:55.505165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f98a76-001d-4d79-b0f7-add24221064e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:55.516035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0f8d5-4a7c-4232-b417-9cef6542326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:55.516725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0f8d5-4a7c-4232-b417-9cef6542326f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:55.518944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:55.521677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0f8d5-4a7c-4232-b417-9cef6542326f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:55.522093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0f8d5-4a7c-4232-b417-9cef6542326f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:55.522807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0f8d5-4a7c-4232-b417-9cef6542326f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:55.530076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0f8d5-4a7c-4232-b417-9cef6542326f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:55.534704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe049c90-a5a1-4650-9e6d-676388708dca admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:55.547154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6ed59-97e8-468a-957e-8796b4be865d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:55.548513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6ed59-97e8-468a-957e-8796b4be865d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:55.549011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6ed59-97e8-468a-957e-8796b4be865d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:55.550787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6ed59-97e8-468a-957e-8796b4be865d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:55.551954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6ed59-97e8-468a-957e-8796b4be865d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:55.555337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6ed59-97e8-468a-957e-8796b4be865d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:55.561872 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3310/6617] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:55.569309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0f8d5-4a7c-4232-b417-9cef6542326f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:55.581499 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3308/6618] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:55.586025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6ed59-97e8-468a-957e-8796b4be865d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:55.589146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0f8d5-4a7c-4232-b417-9cef6542326f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:55.609786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b092fb8-7c8c-4fdc-a5a5-b573f34bf6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:55.610523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092fb8-7c8c-4fdc-a5a5-b573f34bf6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:55.611540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092fb8-7c8c-4fdc-a5a5-b573f34bf6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:55.613438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6ed59-97e8-468a-957e-8796b4be865d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:55.613837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092fb8-7c8c-4fdc-a5a5-b573f34bf6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:55.614629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b092fb8-7c8c-4fdc-a5a5-b573f34bf6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:55.616399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b092fb8-7c8c-4fdc-a5a5-b573f34bf6c3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:55.628213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033ae2e-a347-4f36-81bf-4ea2a703a6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:55.629287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033ae2e-a347-4f36-81bf-4ea2a703a6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:55.629567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033ae2e-a347-4f36-81bf-4ea2a703a6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:55.629836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033ae2e-a347-4f36-81bf-4ea2a703a6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:55.630486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033ae2e-a347-4f36-81bf-4ea2a703a6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:55.632244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033ae2e-a347-4f36-81bf-4ea2a703a6d4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:55.641100 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3311/6619] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:55.645416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b092fb8-7c8c-4fdc-a5a5-b573f34bf6c3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:55.647573 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3309/6620] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:49:55.651494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033ae2e-a347-4f36-81bf-4ea2a703a6d4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:55.680901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033ae2e-a347-4f36-81bf-4ea2a703a6d4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:55.689851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b092fb8-7c8c-4fdc-a5a5-b573f34bf6c3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:55.706169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130359a2-2dba-45bd-b470-52390a41e24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:55.714255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130359a2-2dba-45bd-b470-52390a41e24f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:55.714868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130359a2-2dba-45bd-b470-52390a41e24f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:55.715398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130359a2-2dba-45bd-b470-52390a41e24f admin admin] PATH_INFO: `/v3/projects/54a3174e892248fa8d4b91f2117b2d4c/users/17566dd7c71a45fb847e56add641b0e3/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:55.729229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422fd90-3bce-4d43-a276-94dedd6f9296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:55.729832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422fd90-3bce-4d43-a276-94dedd6f9296 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:55.730289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422fd90-3bce-4d43-a276-94dedd6f9296 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:55.730905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422fd90-3bce-4d43-a276-94dedd6f9296 admin admin] PATH_INFO: `/v3/projects/d08cac93dfb544cea80c2fb9a768ccc6/users/43b0cf7ad1894607a4f21c3820686475/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:55.746847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130359a2-2dba-45bd-b470-52390a41e24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a3174e892248fa8d4b91f2117b2d4c, user_id=17566dd7c71a45fb847e56add641b0e3, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:55.751154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130359a2-2dba-45bd-b470-52390a41e24f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:55.779551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422fd90-3bce-4d43-a276-94dedd6f9296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08cac93dfb544cea80c2fb9a768ccc6, user_id=43b0cf7ad1894607a4f21c3820686475, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:55.782690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422fd90-3bce-4d43-a276-94dedd6f9296 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:55.785625 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3310/6621] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:55 2022] PUT /identity/v3/projects/54a3174e892248fa8d4b91f2117b2d4c/users/17566dd7c71a45fb847e56add641b0e3/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:55.796384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d108dbd-1ad2-4b4d-a950-fa119c078cec None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:55.796656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d108dbd-1ad2-4b4d-a950-fa119c078cec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:55.797177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d108dbd-1ad2-4b4d-a950-fa119c078cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:55.809529 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3312/6622] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:55 2022] PUT /identity/v3/projects/d08cac93dfb544cea80c2fb9a768ccc6/users/43b0cf7ad1894607a4f21c3820686475/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:55.820589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff1fdb-cf15-4926-a716-ddc6e173c7bb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:55.821206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff1fdb-cf15-4926-a716-ddc6e173c7bb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:55.821596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff1fdb-cf15-4926-a716-ddc6e173c7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:55.916784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1d108dbd-1ad2-4b4d-a950-fa119c078cec None None] MFA Rules not processed for user `17566dd7c71a45fb847e56add641b0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:55.918201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d108dbd-1ad2-4b4d-a950-fa119c078cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:55.919301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7aff1fdb-cf15-4926-a716-ddc6e173c7bb None None] MFA Rules not processed for user `43b0cf7ad1894607a4f21c3820686475`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:55.920648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7aff1fdb-cf15-4926-a716-ddc6e173c7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:55.984864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:56.112173 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3313/6623] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:56.127907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff1fdb-cf15-4926-a716-ddc6e173c7bb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:56.129893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7aff1fdb-cf15-4926-a716-ddc6e173c7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:56.138687 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3311/6624] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:56.141846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d108dbd-1ad2-4b4d-a950-fa119c078cec None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:56.360184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d108dbd-1ad2-4b4d-a950-fa119c078cec None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:56.387539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff1fdb-cf15-4926-a716-ddc6e173c7bb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:56.387817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0ebea-9584-402a-949c-aacbff34b44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:56.398316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e9f8c-a749-4a64-b7ac-4b94db98cf83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:56.399190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e9f8c-a749-4a64-b7ac-4b94db98cf83 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:56.399661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e9f8c-a749-4a64-b7ac-4b94db98cf83 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:56.400095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e9f8c-a749-4a64-b7ac-4b94db98cf83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:56.404469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0ebea-9584-402a-949c-aacbff34b44d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:56.404760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0ebea-9584-402a-949c-aacbff34b44d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:56.405048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0ebea-9584-402a-949c-aacbff34b44d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:56.405710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0ebea-9584-402a-949c-aacbff34b44d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:56.414818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0ebea-9584-402a-949c-aacbff34b44d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:56.419824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e9f8c-a749-4a64-b7ac-4b94db98cf83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:56.423987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e9f8c-a749-4a64-b7ac-4b94db98cf83 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:56.454239 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3314/6625] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:56.532700 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3312/6626] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:56 2022] POST /identity/v3/projects => generated 371 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:56.536467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e9f8c-a749-4a64-b7ac-4b94db98cf83 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:56.551131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e9f8c-a749-4a64-b7ac-4b94db98cf83 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:56.637806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813db37-f114-4d1c-8f2d-f5d74e0076c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:56.638434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813db37-f114-4d1c-8f2d-f5d74e0076c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:56.638751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813db37-f114-4d1c-8f2d-f5d74e0076c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:56.639029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813db37-f114-4d1c-8f2d-f5d74e0076c4 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:56.639800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813db37-f114-4d1c-8f2d-f5d74e0076c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:56.642043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813db37-f114-4d1c-8f2d-f5d74e0076c4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:56.679660 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3315/6627] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:56 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:56.682445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0ebea-9584-402a-949c-aacbff34b44d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:56.702977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0ebea-9584-402a-949c-aacbff34b44d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:56.734582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb40fdd-c5b9-498c-8c72-fa18da18dcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:56.735351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb40fdd-c5b9-498c-8c72-fa18da18dcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:56.735872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb40fdd-c5b9-498c-8c72-fa18da18dcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:56.736222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb40fdd-c5b9-498c-8c72-fa18da18dcb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:56.736967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb40fdd-c5b9-498c-8c72-fa18da18dcb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:56.753585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb40fdd-c5b9-498c-8c72-fa18da18dcb1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:56.787034 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3313/6628] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:56.792272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813db37-f114-4d1c-8f2d-f5d74e0076c4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:56.808621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813db37-f114-4d1c-8f2d-f5d74e0076c4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:56.822516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419de25-8017-46f3-96da-86602413093a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:56.823425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419de25-8017-46f3-96da-86602413093a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:56.823707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419de25-8017-46f3-96da-86602413093a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:56.823982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419de25-8017-46f3-96da-86602413093a admin admin] PATH_INFO: `/v3/projects/ce5b9e16950343f29d0e95f7baa2ae47/users/6a9aaba6da62462bb844aa535577d883/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:56.867193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419de25-8017-46f3-96da-86602413093a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5b9e16950343f29d0e95f7baa2ae47, user_id=6a9aaba6da62462bb844aa535577d883, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:56.870248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419de25-8017-46f3-96da-86602413093a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:56.907144 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3316/6629] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:56 2022] PUT /identity/v3/projects/ce5b9e16950343f29d0e95f7baa2ae47/users/6a9aaba6da62462bb844aa535577d883/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:56.908700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb40fdd-c5b9-498c-8c72-fa18da18dcb1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:56.920525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb40fdd-c5b9-498c-8c72-fa18da18dcb1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:56.947339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:57.066623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5bae3-5981-473c-8545-1d407560d9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:57.067501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5bae3-5981-473c-8545-1d407560d9fd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:57.067886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5bae3-5981-473c-8545-1d407560d9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:57.068602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5bae3-5981-473c-8545-1d407560d9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:57.069438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5bae3-5981-473c-8545-1d407560d9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:57.071221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5bae3-5981-473c-8545-1d407560d9fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:57.090004 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3314/6630] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:49:57.091209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419de25-8017-46f3-96da-86602413093a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:57.105059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419de25-8017-46f3-96da-86602413093a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:57.120515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4de8d3-d9c4-4f25-aed1-286625907582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:57.121847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4de8d3-d9c4-4f25-aed1-286625907582 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:57.122287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4de8d3-d9c4-4f25-aed1-286625907582 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:57.122723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4de8d3-d9c4-4f25-aed1-286625907582 admin admin] PATH_INFO: `/v3/projects/ce5b9e16950343f29d0e95f7baa2ae47/users/6a9aaba6da62462bb844aa535577d883/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:57.129068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4de8d3-d9c4-4f25-aed1-286625907582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5b9e16950343f29d0e95f7baa2ae47, user_id=6a9aaba6da62462bb844aa535577d883, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:57.132285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4de8d3-d9c4-4f25-aed1-286625907582 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:57.173293 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3317/6631] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:57 2022] PUT /identity/v3/projects/ce5b9e16950343f29d0e95f7baa2ae47/users/6a9aaba6da62462bb844aa535577d883/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:49:57.184689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e0a4d-21f7-47e7-9048-5b84612bd173 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:57.184978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e0a4d-21f7-47e7-9048-5b84612bd173 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:57.185262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e0a4d-21f7-47e7-9048-5b84612bd173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:57.267015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4de8d3-d9c4-4f25-aed1-286625907582 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:57.269694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3c4de8d3-d9c4-4f25-aed1-286625907582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:57.316852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-866e0a4d-21f7-47e7-9048-5b84612bd173 None None] MFA Rules not processed for user `6a9aaba6da62462bb844aa535577d883`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:57.318418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-866e0a4d-21f7-47e7-9048-5b84612bd173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:57.366518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:57.470459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4de8d3-d9c4-4f25-aed1-286625907582 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:57.480570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b18d4-5a07-4e14-aaf3-a079831caa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:57.481357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b18d4-5a07-4e14-aaf3-a079831caa1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:57.481644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b18d4-5a07-4e14-aaf3-a079831caa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:57.481921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b18d4-5a07-4e14-aaf3-a079831caa1e admin admin] PATH_INFO: `/v3/users/185b4855098e46449a5b3e44339e51f0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:57.483105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b18d4-5a07-4e14-aaf3-a079831caa1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=185b4855098e46449a5b3e44339e51f0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:57.505016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b18d4-5a07-4e14-aaf3-a079831caa1e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:57.507217 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3315/6632] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:57.508291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e0a4d-21f7-47e7-9048-5b84612bd173 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:57.532147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e0a4d-21f7-47e7-9048-5b84612bd173 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:57.546921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c34db-c3d3-4fc4-9e95-041264cd2af5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:57.547913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c34db-c3d3-4fc4-9e95-041264cd2af5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:57.548202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c34db-c3d3-4fc4-9e95-041264cd2af5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:57.548543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c34db-c3d3-4fc4-9e95-041264cd2af5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:57.549793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c34db-c3d3-4fc4-9e95-041264cd2af5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:57.553204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c34db-c3d3-4fc4-9e95-041264cd2af5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:57.589991 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3316/6633] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:49:57 2022] POST /identity/v3/domains => generated 277 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:57.594170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c34db-c3d3-4fc4-9e95-041264cd2af5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:57.668836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a23b18d4-5a07-4e14-aaf3-a079831caa1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '185b4855098e46449a5b3e44339e51f0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:57.691665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c34db-c3d3-4fc4-9e95-041264cd2af5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:57.698309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771a4d4-83c7-4d68-8468-899a4e314a0a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:57.700142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771a4d4-83c7-4d68-8468-899a4e314a0a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:57.700631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771a4d4-83c7-4d68-8468-899a4e314a0a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:57.701081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771a4d4-83c7-4d68-8468-899a4e314a0a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:57.702195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771a4d4-83c7-4d68-8468-899a4e314a0a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:57.704349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771a4d4-83c7-4d68-8468-899a4e314a0a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:57.732594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a23b18d4-5a07-4e14-aaf3-a079831caa1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '185b4855098e46449a5b3e44339e51f0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:57.735491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a23b18d4-5a07-4e14-aaf3-a079831caa1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '185b4855098e46449a5b3e44339e51f0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:57.738871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a23b18d4-5a07-4e14-aaf3-a079831caa1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '185b4855098e46449a5b3e44339e51f0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:57.751443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a23b18d4-5a07-4e14-aaf3-a079831caa1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '185b4855098e46449a5b3e44339e51f0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:57.751997 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3317/6634] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:57 2022] POST /identity/v3/projects => generated 402 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:49:57.756124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771a4d4-83c7-4d68-8468-899a4e314a0a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:57.758092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1771a4d4-83c7-4d68-8468-899a4e314a0a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:57.770458 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3318/6635] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:57 2022] DELETE /identity/v3/users/185b4855098e46449a5b3e44339e51f0 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:57.775806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:57.893959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771a4d4-83c7-4d68-8468-899a4e314a0a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:58.029014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85419be-3d35-476b-bb58-1ace5e87889a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:58.044494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85419be-3d35-476b-bb58-1ace5e87889a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:58.044494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85419be-3d35-476b-bb58-1ace5e87889a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:58.044494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85419be-3d35-476b-bb58-1ace5e87889a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:58.044494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85419be-3d35-476b-bb58-1ace5e87889a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:58.044494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85419be-3d35-476b-bb58-1ace5e87889a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:58.066944 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3318/6636] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Aug 28 18:49:57 2022] POST /identity/v3/groups => generated 302 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:49:58.071091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b18d4-5a07-4e14-aaf3-a079831caa1e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:58.086853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b18d4-5a07-4e14-aaf3-a079831caa1e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:58.094607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4de83-f3cf-47fc-8bb7-2e28627bfb5c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:58.095959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4de83-f3cf-47fc-8bb7-2e28627bfb5c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:58.096519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4de83-f3cf-47fc-8bb7-2e28627bfb5c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:58.097034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4de83-f3cf-47fc-8bb7-2e28627bfb5c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:58.098996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4de83-f3cf-47fc-8bb7-2e28627bfb5c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:58.102080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4de83-f3cf-47fc-8bb7-2e28627bfb5c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:58.162140 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3319/6637] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:58 2022] POST /identity/v3/users => generated 445 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:49:58.166117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85419be-3d35-476b-bb58-1ace5e87889a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:58.190682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85419be-3d35-476b-bb58-1ace5e87889a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:58.203687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477dd66-c484-40e8-aeca-674c8852c5fc tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:58.204664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477dd66-c484-40e8-aeca-674c8852c5fc tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:58.206197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477dd66-c484-40e8-aeca-674c8852c5fc tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:58.207101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477dd66-c484-40e8-aeca-674c8852c5fc tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:58.211337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477dd66-c484-40e8-aeca-674c8852c5fc tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:58.216659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4de83-f3cf-47fc-8bb7-2e28627bfb5c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:58.219489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-70c4de83-f3cf-47fc-8bb7-2e28627bfb5c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:58.231686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477dd66-c484-40e8-aeca-674c8852c5fc tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:58.298552 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3319/6638] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:49:58 2022] POST /identity/v3/roles => generated 239 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:58.300056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477dd66-c484-40e8-aeca-674c8852c5fc tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:58.329217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477dd66-c484-40e8-aeca-674c8852c5fc tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:58.348202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd2d10-0ef5-4355-a2fc-7bd99b29e5bb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:58.349119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd2d10-0ef5-4355-a2fc-7bd99b29e5bb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:58.349479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd2d10-0ef5-4355-a2fc-7bd99b29e5bb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:58.349919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd2d10-0ef5-4355-a2fc-7bd99b29e5bb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/666770e0bddd453cb0ca74c4fdde83b9/groups/f4efe6c0b991462eb531b47fe0cd52d8/roles/4db047f3a3344239a0f210271318faf8/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:58.362164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd2d10-0ef5-4355-a2fc-7bd99b29e5bb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_grant(project_id=666770e0bddd453cb0ca74c4fdde83b9, group_id=f4efe6c0b991462eb531b47fe0cd52d8, role_id=4db047f3a3344239a0f210271318faf8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:58.366047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4de83-f3cf-47fc-8bb7-2e28627bfb5c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:58.368210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd2d10-0ef5-4355-a2fc-7bd99b29e5bb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:58.371565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81eed8-4e7b-4aaa-87c1-f122540925a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:58.372230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81eed8-4e7b-4aaa-87c1-f122540925a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:58.372718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81eed8-4e7b-4aaa-87c1-f122540925a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:58.373009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81eed8-4e7b-4aaa-87c1-f122540925a9 admin admin] PATH_INFO: `/v3/projects/83bfb010992c43749b71e3e618494101` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:58.374247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81eed8-4e7b-4aaa-87c1-f122540925a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83bfb010992c43749b71e3e618494101)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:58.376359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81eed8-4e7b-4aaa-87c1-f122540925a9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:58.396090 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3320/6639] 10.222.0.27 () {60 vars in 1585 bytes} [Sun Aug 28 18:49:58 2022] PUT /identity/v3/OS-INHERIT/projects/666770e0bddd453cb0ca74c4fdde83b9/groups/f4efe6c0b991462eb531b47fe0cd52d8/roles/4db047f3a3344239a0f210271318faf8/inherited_to_projects => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:58.414561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd2d10-0ef5-4355-a2fc-7bd99b29e5bb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:58.470444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:58.499684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db81eed8-4e7b-4aaa-87c1-f122540925a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83bfb010992c43749b71e3e618494101', 'request_id': 'req-db81eed8-4e7b-4aaa-87c1-f122540925a9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:58.508688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db81eed8-4e7b-4aaa-87c1-f122540925a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83bfb010992c43749b71e3e618494101', 'request_id': 'req-db81eed8-4e7b-4aaa-87c1-f122540925a9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:58.515997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db81eed8-4e7b-4aaa-87c1-f122540925a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83bfb010992c43749b71e3e618494101', 'request_id': 'req-db81eed8-4e7b-4aaa-87c1-f122540925a9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:58.538452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db81eed8-4e7b-4aaa-87c1-f122540925a9 admin admin] The token cache is being invalidate because project 83bfb010992c43749b71e3e618494101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:58.538452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db81eed8-4e7b-4aaa-87c1-f122540925a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:58.540551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db81eed8-4e7b-4aaa-87c1-f122540925a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:58.543124 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3320/6640] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:49:58 2022] DELETE /identity/v3/projects/83bfb010992c43749b71e3e618494101 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:58.549268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c46d5e-e1fa-4607-a47c-d2e7be115e2f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:58.549551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c46d5e-e1fa-4607-a47c-d2e7be115e2f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:58.549831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c46d5e-e1fa-4607-a47c-d2e7be115e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:58.592471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-82c46d5e-e1fa-4607-a47c-d2e7be115e2f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:58.593695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-82c46d5e-e1fa-4607-a47c-d2e7be115e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:58.641935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd2d10-0ef5-4355-a2fc-7bd99b29e5bb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:58.682764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:58.728177 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3321/6641] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:58.741025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16619dd3-2226-401b-94d2-144730073797 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:58.741561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16619dd3-2226-401b-94d2-144730073797 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:58.744543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16619dd3-2226-401b-94d2-144730073797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:58.799981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-16619dd3-2226-401b-94d2-144730073797 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:58.801161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-16619dd3-2226-401b-94d2-144730073797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:58.856891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dfff7-8583-42d8-accd-99a3c4e4fbb6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:58.867791 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3322/6642] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:58.872366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16619dd3-2226-401b-94d2-144730073797 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:58.874034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dfff7-8583-42d8-accd-99a3c4e4fbb6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:58.874423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dfff7-8583-42d8-accd-99a3c4e4fbb6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:58.874726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dfff7-8583-42d8-accd-99a3c4e4fbb6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/666770e0bddd453cb0ca74c4fdde83b9/groups/f4efe6c0b991462eb531b47fe0cd52d8/roles/4db047f3a3344239a0f210271318faf8/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:58.877617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dfff7-8583-42d8-accd-99a3c4e4fbb6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:check_grant(project_id=666770e0bddd453cb0ca74c4fdde83b9, group_id=f4efe6c0b991462eb531b47fe0cd52d8, role_id=4db047f3a3344239a0f210271318faf8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:58.878904 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-c43dfff7-8583-42d8-accd-99a3c4e4fbb6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:49:58.878904 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:49:58.878904 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:49:58.883647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dfff7-8583-42d8-accd-99a3c4e4fbb6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:58.895648 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3321/6643] 10.222.0.27 () {58 vars in 1567 bytes} [Sun Aug 28 18:49:58 2022] HEAD /identity/v3/OS-INHERIT/projects/666770e0bddd453cb0ca74c4fdde83b9/groups/f4efe6c0b991462eb531b47fe0cd52d8/roles/4db047f3a3344239a0f210271318faf8/inherited_to_projects => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:58.908619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dfff7-8583-42d8-accd-99a3c4e4fbb6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:58.912023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c43dfff7-8583-42d8-accd-99a3c4e4fbb6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:58.912402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16619dd3-2226-401b-94d2-144730073797 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:58.944342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dfff7-8583-42d8-accd-99a3c4e4fbb6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:58.945034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95431847-e006-4731-b9c8-c202ae8d1b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:58.945668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95431847-e006-4731-b9c8-c202ae8d1b88 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:58.949369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95431847-e006-4731-b9c8-c202ae8d1b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:58.949679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95431847-e006-4731-b9c8-c202ae8d1b88 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:58.950366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95431847-e006-4731-b9c8-c202ae8d1b88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:49:58.950679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95431847-e006-4731-b9c8-c202ae8d1b88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:58.951326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a169b70-1acd-45f6-83f1-4ed1deca2c1c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:58.952253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a169b70-1acd-45f6-83f1-4ed1deca2c1c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:58.952814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a169b70-1acd-45f6-83f1-4ed1deca2c1c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:58.953340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a169b70-1acd-45f6-83f1-4ed1deca2c1c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/666770e0bddd453cb0ca74c4fdde83b9/groups/f4efe6c0b991462eb531b47fe0cd52d8/roles/4db047f3a3344239a0f210271318faf8/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:58.954766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95431847-e006-4731-b9c8-c202ae8d1b88 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:58.956842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a169b70-1acd-45f6-83f1-4ed1deca2c1c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=666770e0bddd453cb0ca74c4fdde83b9, group_id=f4efe6c0b991462eb531b47fe0cd52d8, role_id=4db047f3a3344239a0f210271318faf8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:58.960274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a169b70-1acd-45f6-83f1-4ed1deca2c1c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:58.968456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a169b70-1acd-45f6-83f1-4ed1deca2c1c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invalidating the token cache because role 4db047f3a3344239a0f210271318faf8 was removed from group f4efe6c0b991462eb531b47fe0cd52d8 on project 666770e0bddd453cb0ca74c4fdde83b9. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:58.969162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a169b70-1acd-45f6-83f1-4ed1deca2c1c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:58.970516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a169b70-1acd-45f6-83f1-4ed1deca2c1c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:58.980312 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3323/6644] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:49:58.985830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95431847-e006-4731-b9c8-c202ae8d1b88 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:58.993813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-95431847-e006-4731-b9c8-c202ae8d1b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:58.997453 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3322/6645] 10.222.0.27 () {58 vars in 1569 bytes} [Sun Aug 28 18:49:58 2022] DELETE /identity/v3/OS-INHERIT/projects/666770e0bddd453cb0ca74c4fdde83b9/groups/f4efe6c0b991462eb531b47fe0cd52d8/roles/4db047f3a3344239a0f210271318faf8/inherited_to_projects => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:59.001319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a169b70-1acd-45f6-83f1-4ed1deca2c1c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:59.007403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9a169b70-1acd-45f6-83f1-4ed1deca2c1c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:59.019949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95431847-e006-4731-b9c8-c202ae8d1b88 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:59.179542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a169b70-1acd-45f6-83f1-4ed1deca2c1c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:59.189562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df13f8-489f-4400-a542-32e2ccc78ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:59.191058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df13f8-489f-4400-a542-32e2ccc78ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:59.191597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df13f8-489f-4400-a542-32e2ccc78ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:59.192152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcbaef-1bd9-4a65-8044-0777ef5d95ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:59.192903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcbaef-1bd9-4a65-8044-0777ef5d95ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:59.193760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcbaef-1bd9-4a65-8044-0777ef5d95ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:59.193892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df13f8-489f-4400-a542-32e2ccc78ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:59.194393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcbaef-1bd9-4a65-8044-0777ef5d95ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/roles/4db047f3a3344239a0f210271318faf8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:59.195079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df13f8-489f-4400-a542-32e2ccc78ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:59.197918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df13f8-489f-4400-a542-32e2ccc78ad4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:59.198080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcbaef-1bd9-4a65-8044-0777ef5d95ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4db047f3a3344239a0f210271318faf8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:59.200626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcbaef-1bd9-4a65-8044-0777ef5d95ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:59.264500 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3324/6646] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:49:58 2022] POST /identity/v3/projects => generated 371 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:59.267686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df13f8-489f-4400-a542-32e2ccc78ad4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:59.289375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-badcbaef-1bd9-4a65-8044-0777ef5d95ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invalidating the token cache because role 4db047f3a3344239a0f210271318faf8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:59.289750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-badcbaef-1bd9-4a65-8044-0777ef5d95ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:59.291061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-badcbaef-1bd9-4a65-8044-0777ef5d95ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:59.295146 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3323/6647] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:59 2022] DELETE /identity/v3/roles/4db047f3a3344239a0f210271318faf8 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:59.307003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcbaef-1bd9-4a65-8044-0777ef5d95ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:59.308973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-badcbaef-1bd9-4a65-8044-0777ef5d95ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:59.337196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:59.423855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df13f8-489f-4400-a542-32e2ccc78ad4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:59.442383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcbaef-1bd9-4a65-8044-0777ef5d95ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:59.450844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ad38e-c4d5-4038-93dc-4e844bc47d69 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:59.452205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ad38e-c4d5-4038-93dc-4e844bc47d69 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:59.453065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ad38e-c4d5-4038-93dc-4e844bc47d69 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:59.453566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ad38e-c4d5-4038-93dc-4e844bc47d69 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:59.454768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ad38e-c4d5-4038-93dc-4e844bc47d69 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:59.462323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ad38e-c4d5-4038-93dc-4e844bc47d69 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:59.506472 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3324/6648] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:49:59 2022] POST /identity/v3/roles => generated 238 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:49:59.507682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ad38e-c4d5-4038-93dc-4e844bc47d69 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:59.527598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:59.542703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ad38e-c4d5-4038-93dc-4e844bc47d69 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:59.574100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df674de-32f0-4536-8a9d-2cb00f228920 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:59.574100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df674de-32f0-4536-8a9d-2cb00f228920 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:59.574100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df674de-32f0-4536-8a9d-2cb00f228920 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:59.574516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df674de-32f0-4536-8a9d-2cb00f228920 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/666770e0bddd453cb0ca74c4fdde83b9/users/b3763badd4b7448682cd1ef9b58eb243/roles/892e7370bc9b46048a48c5512fdf5d69/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:59.577757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a70b0e-8676-4467-8594-84fadb886f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:59.578452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a70b0e-8676-4467-8594-84fadb886f83 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:59.578681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a70b0e-8676-4467-8594-84fadb886f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:59.578959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a70b0e-8676-4467-8594-84fadb886f83 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:59.580023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a70b0e-8676-4467-8594-84fadb886f83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:59.581603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a70b0e-8676-4467-8594-84fadb886f83 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:59.612203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df674de-32f0-4536-8a9d-2cb00f228920 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_grant(project_id=666770e0bddd453cb0ca74c4fdde83b9, user_id=b3763badd4b7448682cd1ef9b58eb243, role_id=892e7370bc9b46048a48c5512fdf5d69)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:59.626734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df674de-32f0-4536-8a9d-2cb00f228920 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:59.637932 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3325/6649] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:49:59 2022] POST /identity/v3/users => generated 286 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:49:59.645035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a70b0e-8676-4467-8594-84fadb886f83 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:59.647482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b0a70b0e-8676-4467-8594-84fadb886f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:59.670295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a70b0e-8676-4467-8594-84fadb886f83 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:59.673522 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3325/6650] 10.222.0.27 () {60 vars in 1582 bytes} [Sun Aug 28 18:49:59 2022] PUT /identity/v3/OS-INHERIT/projects/666770e0bddd453cb0ca74c4fdde83b9/users/b3763badd4b7448682cd1ef9b58eb243/roles/892e7370bc9b46048a48c5512fdf5d69/inherited_to_projects => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:59.686651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df674de-32f0-4536-8a9d-2cb00f228920 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:59.788944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67498ed-a63d-4dec-b5be-754e3961342f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:59.791360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67498ed-a63d-4dec-b5be-754e3961342f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:59.791661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67498ed-a63d-4dec-b5be-754e3961342f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:59.791939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67498ed-a63d-4dec-b5be-754e3961342f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:59.792617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67498ed-a63d-4dec-b5be-754e3961342f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:59.800152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67498ed-a63d-4dec-b5be-754e3961342f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:59.814547 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3326/6651] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:59 2022] GET /identity/v3/roles => generated 1649 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:49:59.831209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67498ed-a63d-4dec-b5be-754e3961342f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:59.842836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df674de-32f0-4536-8a9d-2cb00f228920 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:59.845182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67498ed-a63d-4dec-b5be-754e3961342f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:59.850997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4226ee9-794a-42f9-bcd6-c5b61c801b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:59.852323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4226ee9-794a-42f9-bcd6-c5b61c801b4d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:59.852692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4226ee9-794a-42f9-bcd6-c5b61c801b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:59.852985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4226ee9-794a-42f9-bcd6-c5b61c801b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:59.853703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4226ee9-794a-42f9-bcd6-c5b61c801b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:59.856124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4226ee9-794a-42f9-bcd6-c5b61c801b4d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:59.856258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0c4a5-f45a-4e98-9e48-08b87626d032 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:59.857041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0c4a5-f45a-4e98-9e48-08b87626d032 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:59.858724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0c4a5-f45a-4e98-9e48-08b87626d032 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:59.859109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0c4a5-f45a-4e98-9e48-08b87626d032 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/666770e0bddd453cb0ca74c4fdde83b9/users/b3763badd4b7448682cd1ef9b58eb243/roles/892e7370bc9b46048a48c5512fdf5d69/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:59.864359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0c4a5-f45a-4e98-9e48-08b87626d032 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:check_grant(project_id=666770e0bddd453cb0ca74c4fdde83b9, user_id=b3763badd4b7448682cd1ef9b58eb243, role_id=892e7370bc9b46048a48c5512fdf5d69)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:59.868044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0c4a5-f45a-4e98-9e48-08b87626d032 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:59.872377 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3327/6652] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:49:59 2022] GET /identity/v3/roles => generated 1649 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:49:59.876294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4226ee9-794a-42f9-bcd6-c5b61c801b4d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:59.883357 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3326/6653] 10.222.0.27 () {58 vars in 1564 bytes} [Sun Aug 28 18:49:59 2022] HEAD /identity/v3/OS-INHERIT/projects/666770e0bddd453cb0ca74c4fdde83b9/users/b3763badd4b7448682cd1ef9b58eb243/roles/892e7370bc9b46048a48c5512fdf5d69/inherited_to_projects => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:59.884478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0c4a5-f45a-4e98-9e48-08b87626d032 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:59.903075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4226ee9-794a-42f9-bcd6-c5b61c801b4d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:59.913530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0c4a5-f45a-4e98-9e48-08b87626d032 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:59.913893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924323b-51cd-4a58-89a6-cf1712d0b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:59.914796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924323b-51cd-4a58-89a6-cf1712d0b8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:59.915468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924323b-51cd-4a58-89a6-cf1712d0b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:59.915692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924323b-51cd-4a58-89a6-cf1712d0b8a5 admin admin] PATH_INFO: `/v3/projects/8748594c5de349bdb66c576e79d1bf56/users/01c1eb3859e14164af0d2877a4c38840/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:59.921119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c2c56-aea3-4f1c-8740-a6a2f9d8753c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:59.921986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c2c56-aea3-4f1c-8740-a6a2f9d8753c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:59.923155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c2c56-aea3-4f1c-8740-a6a2f9d8753c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:59.923625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c2c56-aea3-4f1c-8740-a6a2f9d8753c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/666770e0bddd453cb0ca74c4fdde83b9/users/b3763badd4b7448682cd1ef9b58eb243/roles/892e7370bc9b46048a48c5512fdf5d69/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:59.927898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c2c56-aea3-4f1c-8740-a6a2f9d8753c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=666770e0bddd453cb0ca74c4fdde83b9, user_id=b3763badd4b7448682cd1ef9b58eb243, role_id=892e7370bc9b46048a48c5512fdf5d69)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:59.932589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c2c56-aea3-4f1c-8740-a6a2f9d8753c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:59.943359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e33c2c56-aea3-4f1c-8740-a6a2f9d8753c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invalidating the token cache because role 892e7370bc9b46048a48c5512fdf5d69 was removed from user b3763badd4b7448682cd1ef9b58eb243 on project 666770e0bddd453cb0ca74c4fdde83b9. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:49:59.943702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e33c2c56-aea3-4f1c-8740-a6a2f9d8753c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:59.944822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e33c2c56-aea3-4f1c-8740-a6a2f9d8753c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:49:59.956789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924323b-51cd-4a58-89a6-cf1712d0b8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8748594c5de349bdb66c576e79d1bf56, user_id=01c1eb3859e14164af0d2877a4c38840, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:59.963358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924323b-51cd-4a58-89a6-cf1712d0b8a5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:59.978206 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3327/6654] 10.222.0.27 () {58 vars in 1566 bytes} [Sun Aug 28 18:49:59 2022] DELETE /identity/v3/OS-INHERIT/projects/666770e0bddd453cb0ca74c4fdde83b9/users/b3763badd4b7448682cd1ef9b58eb243/roles/892e7370bc9b46048a48c5512fdf5d69/inherited_to_projects => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:49:59.980840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c2c56-aea3-4f1c-8740-a6a2f9d8753c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:59.985181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e33c2c56-aea3-4f1c-8740-a6a2f9d8753c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:59.989752 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3328/6655] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:49:59 2022] PUT /identity/v3/projects/8748594c5de349bdb66c576e79d1bf56/users/01c1eb3859e14164af0d2877a4c38840/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:00.000117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7743f1d-40cf-4501-923a-ea05acd21147 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:00.000426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7743f1d-40cf-4501-923a-ea05acd21147 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:00.000687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7743f1d-40cf-4501-923a-ea05acd21147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:00.058904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d7743f1d-40cf-4501-923a-ea05acd21147 None None] MFA Rules not processed for user `01c1eb3859e14164af0d2877a4c38840`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:00.060230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d7743f1d-40cf-4501-923a-ea05acd21147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:00.097931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c2c56-aea3-4f1c-8740-a6a2f9d8753c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:00.100562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:00.192073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d47256-5895-4063-bbcd-8139518f3bf8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:00.192820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d47256-5895-4063-bbcd-8139518f3bf8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:00.193313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d47256-5895-4063-bbcd-8139518f3bf8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:00.193578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d47256-5895-4063-bbcd-8139518f3bf8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/roles/892e7370bc9b46048a48c5512fdf5d69` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:00.194264 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3329/6656] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:49:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:50:00.196143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d47256-5895-4063-bbcd-8139518f3bf8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:delete_role(role_id=892e7370bc9b46048a48c5512fdf5d69)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:00.199524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d47256-5895-4063-bbcd-8139518f3bf8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:00.205173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9655a-1173-4cc1-a54f-454af62ea531 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:00.205524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9655a-1173-4cc1-a54f-454af62ea531 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:00.205835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9655a-1173-4cc1-a54f-454af62ea531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:00.218112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:00.234065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e2a9655a-1173-4cc1-a54f-454af62ea531 None None] MFA Rules not processed for user `01c1eb3859e14164af0d2877a4c38840`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:00.235593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e2a9655a-1173-4cc1-a54f-454af62ea531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:00.245626 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3330/6657] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:50:00.261326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9655a-1173-4cc1-a54f-454af62ea531 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:00.262822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e2a9655a-1173-4cc1-a54f-454af62ea531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:00.267689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7d47256-5895-4063-bbcd-8139518f3bf8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invalidating the token cache because role 892e7370bc9b46048a48c5512fdf5d69 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:00.267979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7d47256-5895-4063-bbcd-8139518f3bf8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:00.268724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7d47256-5895-4063-bbcd-8139518f3bf8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:00.274775 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3328/6658] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:49:59 2022] DELETE /identity/v3/roles/892e7370bc9b46048a48c5512fdf5d69 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:00.276490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d47256-5895-4063-bbcd-8139518f3bf8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:00.279173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7d47256-5895-4063-bbcd-8139518f3bf8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:00.400878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d47256-5895-4063-bbcd-8139518f3bf8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:00.407213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9655a-1173-4cc1-a54f-454af62ea531 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:00.409022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e04bd-2efd-463b-baa7-ab220bd73ea1 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:00.410008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e04bd-2efd-463b-baa7-ab220bd73ea1 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:00.410519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e04bd-2efd-463b-baa7-ab220bd73ea1 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:00.411005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e04bd-2efd-463b-baa7-ab220bd73ea1 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:00.412902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e04bd-2efd-463b-baa7-ab220bd73ea1 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:00.416093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e04bd-2efd-463b-baa7-ab220bd73ea1 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:00.452874 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3329/6659] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:50:00 2022] POST /identity/v3/roles => generated 239 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:00.453839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e04bd-2efd-463b-baa7-ab220bd73ea1 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:00.476558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e04bd-2efd-463b-baa7-ab220bd73ea1 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:00.486483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15475d80-a375-4da9-9f6e-1ace7e9f55d9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:00.487182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15475d80-a375-4da9-9f6e-1ace7e9f55d9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:00.487507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15475d80-a375-4da9-9f6e-1ace7e9f55d9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:00.487785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15475d80-a375-4da9-9f6e-1ace7e9f55d9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/groups/f4efe6c0b991462eb531b47fe0cd52d8/roles/6125c50e18304dacaaa184d94890bb77/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:00.493187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15475d80-a375-4da9-9f6e-1ace7e9f55d9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9e2d66f10e51417d9529b1d2b2d5305f, group_id=f4efe6c0b991462eb531b47fe0cd52d8, role_id=6125c50e18304dacaaa184d94890bb77)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:00.496234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15475d80-a375-4da9-9f6e-1ace7e9f55d9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:00.550687 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3330/6660] 10.222.0.27 () {60 vars in 1582 bytes} [Sun Aug 28 18:50:00 2022] PUT /identity/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/groups/f4efe6c0b991462eb531b47fe0cd52d8/roles/6125c50e18304dacaaa184d94890bb77/inherited_to_projects => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:00.552582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154be8c-5dbf-471a-a5df-a40aeeb87b89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:00.553705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154be8c-5dbf-471a-a5df-a40aeeb87b89 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:00.554503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154be8c-5dbf-471a-a5df-a40aeeb87b89 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:00.554819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15475d80-a375-4da9-9f6e-1ace7e9f55d9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:00.555378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154be8c-5dbf-471a-a5df-a40aeeb87b89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:00.557892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8154be8c-5dbf-471a-a5df-a40aeeb87b89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:00.645623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:00.669877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15475d80-a375-4da9-9f6e-1ace7e9f55d9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:00.677578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4345a-7022-4c55-bb41-6b2025969339 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:00.678390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4345a-7022-4c55-bb41-6b2025969339 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:00.678525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4345a-7022-4c55-bb41-6b2025969339 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:00.678810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4345a-7022-4c55-bb41-6b2025969339 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/groups/f4efe6c0b991462eb531b47fe0cd52d8/roles/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:00.680361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154be8c-5dbf-471a-a5df-a40aeeb87b89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:00.685987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154be8c-5dbf-471a-a5df-a40aeeb87b89 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:00.694362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4345a-7022-4c55-bb41-6b2025969339 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=9e2d66f10e51417d9529b1d2b2d5305f, group_id=f4efe6c0b991462eb531b47fe0cd52d8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:00.696120 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-14b4345a-7022-4c55-bb41-6b2025969339 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:50:00.696120 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:50:00.696120 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:50:00.709522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4345a-7022-4c55-bb41-6b2025969339 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:00.719936 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3331/6661] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:00.764363 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3331/6662] 10.222.0.27 () {58 vars in 1464 bytes} [Sun Aug 28 18:50:00 2022] GET /identity/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/groups/f4efe6c0b991462eb531b47fe0cd52d8/roles/inherited_to_projects => generated 447 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:00.772365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154be8c-5dbf-471a-a5df-a40aeeb87b89 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:00.795125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154be8c-5dbf-471a-a5df-a40aeeb87b89 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:00.821118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec939ad-09cc-469a-9dec-2c80ae68e0d5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:00.823910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec939ad-09cc-469a-9dec-2c80ae68e0d5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:00.826104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec939ad-09cc-469a-9dec-2c80ae68e0d5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:00.826636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec939ad-09cc-469a-9dec-2c80ae68e0d5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/groups/f4efe6c0b991462eb531b47fe0cd52d8/roles/6125c50e18304dacaaa184d94890bb77/inherited_to_projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:00.832463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec939ad-09cc-469a-9dec-2c80ae68e0d5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=9e2d66f10e51417d9529b1d2b2d5305f, group_id=f4efe6c0b991462eb531b47fe0cd52d8, role_id=6125c50e18304dacaaa184d94890bb77)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:00.833521 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-0ec939ad-09cc-469a-9dec-2c80ae68e0d5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:50:00.833521 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:50:00.833521 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:50:00.835490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec939ad-09cc-469a-9dec-2c80ae68e0d5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:00.856373 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3332/6663] 10.222.0.27 () {58 vars in 1564 bytes} [Sun Aug 28 18:50:00 2022] HEAD /identity/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/groups/f4efe6c0b991462eb531b47fe0cd52d8/roles/6125c50e18304dacaaa184d94890bb77/inherited_to_projects => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:00.860602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4345a-7022-4c55-bb41-6b2025969339 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:00.879873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4345a-7022-4c55-bb41-6b2025969339 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:00.889094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f0630-bf78-4b4d-923a-2746391ec215 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:00.889813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f0630-bf78-4b4d-923a-2746391ec215 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:00.890097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f0630-bf78-4b4d-923a-2746391ec215 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:00.890377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f0630-bf78-4b4d-923a-2746391ec215 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/groups/f4efe6c0b991462eb531b47fe0cd52d8/roles/6125c50e18304dacaaa184d94890bb77/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:00.896760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f0630-bf78-4b4d-923a-2746391ec215 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9e2d66f10e51417d9529b1d2b2d5305f, group_id=f4efe6c0b991462eb531b47fe0cd52d8, role_id=6125c50e18304dacaaa184d94890bb77)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:00.900176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f0630-bf78-4b4d-923a-2746391ec215 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:00.934307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-360f0630-bf78-4b4d-923a-2746391ec215 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invalidating the token cache because role 6125c50e18304dacaaa184d94890bb77 was removed from group f4efe6c0b991462eb531b47fe0cd52d8 on domain 9e2d66f10e51417d9529b1d2b2d5305f. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:00.934965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-360f0630-bf78-4b4d-923a-2746391ec215 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:00.938251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-360f0630-bf78-4b4d-923a-2746391ec215 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:00.972549 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3332/6664] 10.222.0.27 () {58 vars in 1566 bytes} [Sun Aug 28 18:50:00 2022] DELETE /identity/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/groups/f4efe6c0b991462eb531b47fe0cd52d8/roles/6125c50e18304dacaaa184d94890bb77/inherited_to_projects => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:00.976841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec939ad-09cc-469a-9dec-2c80ae68e0d5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:00.979505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0ec939ad-09cc-469a-9dec-2c80ae68e0d5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:01.037647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec939ad-09cc-469a-9dec-2c80ae68e0d5 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:01.104152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28764d75-9499-4946-85cf-ef43c797dabd tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:01.104806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28764d75-9499-4946-85cf-ef43c797dabd tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:01.105095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28764d75-9499-4946-85cf-ef43c797dabd tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:01.105376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28764d75-9499-4946-85cf-ef43c797dabd tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/roles/6125c50e18304dacaaa184d94890bb77` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:01.106981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28764d75-9499-4946-85cf-ef43c797dabd tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6125c50e18304dacaaa184d94890bb77)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:01.108650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28764d75-9499-4946-85cf-ef43c797dabd tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:01.159452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f0630-bf78-4b4d-923a-2746391ec215 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:01.161128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-360f0630-bf78-4b4d-923a-2746391ec215 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:01.180104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-28764d75-9499-4946-85cf-ef43c797dabd tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invalidating the token cache because role 6125c50e18304dacaaa184d94890bb77 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:01.180423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-28764d75-9499-4946-85cf-ef43c797dabd tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:01.181189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-28764d75-9499-4946-85cf-ef43c797dabd tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:01.189064 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3333/6665] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:00 2022] DELETE /identity/v3/roles/6125c50e18304dacaaa184d94890bb77 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:01.191046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28764d75-9499-4946-85cf-ef43c797dabd tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:01.193852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-28764d75-9499-4946-85cf-ef43c797dabd tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:01.239660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:01.326497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f0630-bf78-4b4d-923a-2746391ec215 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:01.345230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28764d75-9499-4946-85cf-ef43c797dabd tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:01.366095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21c8d7-ca7d-4f8a-a18e-8e3a26b1850a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:01.366739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21c8d7-ca7d-4f8a-a18e-8e3a26b1850a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:01.369437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21c8d7-ca7d-4f8a-a18e-8e3a26b1850a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:01.369772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21c8d7-ca7d-4f8a-a18e-8e3a26b1850a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:01.371131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21c8d7-ca7d-4f8a-a18e-8e3a26b1850a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:01.372838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21c8d7-ca7d-4f8a-a18e-8e3a26b1850a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:01.406904 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3334/6666] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:50:01 2022] POST /identity/v3/roles => generated 239 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:01.409415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21c8d7-ca7d-4f8a-a18e-8e3a26b1850a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:01.426623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21c8d7-ca7d-4f8a-a18e-8e3a26b1850a tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:01.437896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c9d0d-4b74-4e85-b617-6abc6c1d6364 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:01.439165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c9d0d-4b74-4e85-b617-6abc6c1d6364 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:01.439495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c9d0d-4b74-4e85-b617-6abc6c1d6364 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:01.439786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c9d0d-4b74-4e85-b617-6abc6c1d6364 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/users/b3763badd4b7448682cd1ef9b58eb243/roles/8130c9e9388645deb9552758b21da8c6/inherited_to_projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:01.442655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c9d0d-4b74-4e85-b617-6abc6c1d6364 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9e2d66f10e51417d9529b1d2b2d5305f, user_id=b3763badd4b7448682cd1ef9b58eb243, role_id=8130c9e9388645deb9552758b21da8c6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:01.446841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c9d0d-4b74-4e85-b617-6abc6c1d6364 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:01.470454 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3335/6667] 10.222.0.27 () {60 vars in 1579 bytes} [Sun Aug 28 18:50:01 2022] PUT /identity/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/users/b3763badd4b7448682cd1ef9b58eb243/roles/8130c9e9388645deb9552758b21da8c6/inherited_to_projects => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:01.471777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c9d0d-4b74-4e85-b617-6abc6c1d6364 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:01.502394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879843a-3fa8-4511-aba3-bedaf44a6775 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:01.502949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879843a-3fa8-4511-aba3-bedaf44a6775 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:01.503223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879843a-3fa8-4511-aba3-bedaf44a6775 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:01.503959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879843a-3fa8-4511-aba3-bedaf44a6775 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:01.505484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1879843a-3fa8-4511-aba3-bedaf44a6775 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:01.516006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:01.530621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879843a-3fa8-4511-aba3-bedaf44a6775 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:01.533579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879843a-3fa8-4511-aba3-bedaf44a6775 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:01.569141 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3333/6668] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:50:01.660090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c9d0d-4b74-4e85-b617-6abc6c1d6364 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:01.666579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48094cbf-2088-4e9b-92d8-578e64614962 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:01.667369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48094cbf-2088-4e9b-92d8-578e64614962 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:01.667656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48094cbf-2088-4e9b-92d8-578e64614962 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:01.668084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48094cbf-2088-4e9b-92d8-578e64614962 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/users/b3763badd4b7448682cd1ef9b58eb243/roles/inherited_to_projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:01.670910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48094cbf-2088-4e9b-92d8-578e64614962 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=9e2d66f10e51417d9529b1d2b2d5305f, user_id=b3763badd4b7448682cd1ef9b58eb243)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:01.673016 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-48094cbf-2088-4e9b-92d8-578e64614962 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:50:01.673016 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:50:01.673016 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:50:01.675138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48094cbf-2088-4e9b-92d8-578e64614962 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:01.700374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879843a-3fa8-4511-aba3-bedaf44a6775 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:01.701135 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3336/6669] 10.222.0.27 () {58 vars in 1461 bytes} [Sun Aug 28 18:50:01 2022] GET /identity/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/users/b3763badd4b7448682cd1ef9b58eb243/roles/inherited_to_projects => generated 446 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:01.715211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879843a-3fa8-4511-aba3-bedaf44a6775 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:01.723780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83862fc-0e38-4d29-a1e4-4768571fe883 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:01.725326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83862fc-0e38-4d29-a1e4-4768571fe883 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:01.725798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83862fc-0e38-4d29-a1e4-4768571fe883 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:01.726228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83862fc-0e38-4d29-a1e4-4768571fe883 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/users/b3763badd4b7448682cd1ef9b58eb243/roles/8130c9e9388645deb9552758b21da8c6/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:01.728875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83862fc-0e38-4d29-a1e4-4768571fe883 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=9e2d66f10e51417d9529b1d2b2d5305f, user_id=b3763badd4b7448682cd1ef9b58eb243, role_id=8130c9e9388645deb9552758b21da8c6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:01.733639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83862fc-0e38-4d29-a1e4-4768571fe883 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:01.753258 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3334/6670] 10.222.0.27 () {58 vars in 1561 bytes} [Sun Aug 28 18:50:01 2022] HEAD /identity/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/users/b3763badd4b7448682cd1ef9b58eb243/roles/8130c9e9388645deb9552758b21da8c6/inherited_to_projects => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:01.757627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48094cbf-2088-4e9b-92d8-578e64614962 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:01.775421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48094cbf-2088-4e9b-92d8-578e64614962 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:01.781537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afae43a-986e-46db-8aed-4d8c3d60c46b tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:01.782413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afae43a-986e-46db-8aed-4d8c3d60c46b tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:01.782801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afae43a-986e-46db-8aed-4d8c3d60c46b tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:01.783267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afae43a-986e-46db-8aed-4d8c3d60c46b tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/users/b3763badd4b7448682cd1ef9b58eb243/roles/8130c9e9388645deb9552758b21da8c6/inherited_to_projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:01.786515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afae43a-986e-46db-8aed-4d8c3d60c46b tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9e2d66f10e51417d9529b1d2b2d5305f, user_id=b3763badd4b7448682cd1ef9b58eb243, role_id=8130c9e9388645deb9552758b21da8c6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:01.790432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afae43a-986e-46db-8aed-4d8c3d60c46b tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:01.797912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6afae43a-986e-46db-8aed-4d8c3d60c46b tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invalidating the token cache because role 8130c9e9388645deb9552758b21da8c6 was removed from user b3763badd4b7448682cd1ef9b58eb243 on domain 9e2d66f10e51417d9529b1d2b2d5305f. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:01.798522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6afae43a-986e-46db-8aed-4d8c3d60c46b tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:01.799469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6afae43a-986e-46db-8aed-4d8c3d60c46b tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:01.820400 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3337/6671] 10.222.0.27 () {58 vars in 1563 bytes} [Sun Aug 28 18:50:01 2022] DELETE /identity/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/users/b3763badd4b7448682cd1ef9b58eb243/roles/8130c9e9388645deb9552758b21da8c6/inherited_to_projects => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:50:01.824633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83862fc-0e38-4d29-a1e4-4768571fe883 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:01.827177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c83862fc-0e38-4d29-a1e4-4768571fe883 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:01.845500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83862fc-0e38-4d29-a1e4-4768571fe883 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:02.007479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829d70b-6bd5-4d2b-bade-b916c4d750d6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:02.008147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829d70b-6bd5-4d2b-bade-b916c4d750d6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:02.008426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829d70b-6bd5-4d2b-bade-b916c4d750d6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:02.008702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829d70b-6bd5-4d2b-bade-b916c4d750d6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/roles/8130c9e9388645deb9552758b21da8c6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:02.011899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829d70b-6bd5-4d2b-bade-b916c4d750d6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8130c9e9388645deb9552758b21da8c6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:02.013540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829d70b-6bd5-4d2b-bade-b916c4d750d6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:02.098502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b829d70b-6bd5-4d2b-bade-b916c4d750d6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invalidating the token cache because role 8130c9e9388645deb9552758b21da8c6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:02.099322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b829d70b-6bd5-4d2b-bade-b916c4d750d6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:02.100185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b829d70b-6bd5-4d2b-bade-b916c4d750d6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:02.105402 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3335/6672] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:01 2022] DELETE /identity/v3/roles/8130c9e9388645deb9552758b21da8c6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:50:02.110125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afae43a-986e-46db-8aed-4d8c3d60c46b tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:02.121012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afae43a-986e-46db-8aed-4d8c3d60c46b tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:02.269712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64169db8-0893-4b19-a2d6-8c442c7584c1 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:02.270913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64169db8-0893-4b19-a2d6-8c442c7584c1 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:02.271489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64169db8-0893-4b19-a2d6-8c442c7584c1 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:02.272208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64169db8-0893-4b19-a2d6-8c442c7584c1 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:02.273875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64169db8-0893-4b19-a2d6-8c442c7584c1 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:02.276815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64169db8-0893-4b19-a2d6-8c442c7584c1 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:02.306941 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3338/6673] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:50:02 2022] POST /identity/v3/roles => generated 239 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:02.307457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829d70b-6bd5-4d2b-bade-b916c4d750d6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:02.308987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b829d70b-6bd5-4d2b-bade-b916c4d750d6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:02.341437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829d70b-6bd5-4d2b-bade-b916c4d750d6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:02.348696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d4775-47d0-450f-8cce-7365435f00d7 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:02.349360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d4775-47d0-450f-8cce-7365435f00d7 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:02.349640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d4775-47d0-450f-8cce-7365435f00d7 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:02.349910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d4775-47d0-450f-8cce-7365435f00d7 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:02.350554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d4775-47d0-450f-8cce-7365435f00d7 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:02.352912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d4775-47d0-450f-8cce-7365435f00d7 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:02.399121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:02.438630 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3336/6674] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:02 2022] POST /identity/v3/projects => generated 410 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:50:02.444371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64169db8-0893-4b19-a2d6-8c442c7584c1 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:02.460278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64169db8-0893-4b19-a2d6-8c442c7584c1 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:02.632487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4baeb-0c2a-40f7-9b6d-1118c3ca0460 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:02.633856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4baeb-0c2a-40f7-9b6d-1118c3ca0460 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:02.634445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4baeb-0c2a-40f7-9b6d-1118c3ca0460 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:02.635040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4baeb-0c2a-40f7-9b6d-1118c3ca0460 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/users/b3763badd4b7448682cd1ef9b58eb243/roles/021e03e1e5714c4c86e7ea7c4907acf7/inherited_to_projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:02.640975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4baeb-0c2a-40f7-9b6d-1118c3ca0460 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9e2d66f10e51417d9529b1d2b2d5305f, user_id=b3763badd4b7448682cd1ef9b58eb243, role_id=021e03e1e5714c4c86e7ea7c4907acf7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:02.644079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4baeb-0c2a-40f7-9b6d-1118c3ca0460 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:02.681467 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3339/6675] 10.222.0.27 () {60 vars in 1579 bytes} [Sun Aug 28 18:50:02 2022] PUT /identity/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/users/b3763badd4b7448682cd1ef9b58eb243/roles/021e03e1e5714c4c86e7ea7c4907acf7/inherited_to_projects => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:02.686032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d4775-47d0-450f-8cce-7365435f00d7 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:02.709594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d4775-47d0-450f-8cce-7365435f00d7 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:02.846810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8457bd-01b8-47c2-bd9b-423793665eab tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:02.848264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8457bd-01b8-47c2-bd9b-423793665eab tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:02.848264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8457bd-01b8-47c2-bd9b-423793665eab tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:02.852235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8457bd-01b8-47c2-bd9b-423793665eab tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:02.852235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8457bd-01b8-47c2-bd9b-423793665eab tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Adding query filter params (scope.project.id=666770e0bddd453cb0ca74c4fdde83b9, user.id=b3763badd4b7448682cd1ef9b58eb243) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:02.852703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8457bd-01b8-47c2-bd9b-423793665eab tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:02.854743 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-ba8457bd-01b8-47c2-bd9b-423793665eab tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:50:02.854743 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:50:02.854743 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:50:02.856064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8457bd-01b8-47c2-bd9b-423793665eab tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:02.926337 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3337/6676] 10.222.0.27 () {58 vars in 1356 bytes} [Sun Aug 28 18:50:02 2022] GET /identity/v3/role_assignments?scope.project.id=666770e0bddd453cb0ca74c4fdde83b9&user.id=b3763badd4b7448682cd1ef9b58eb243&effective => generated 648 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:02.929189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4baeb-0c2a-40f7-9b6d-1118c3ca0460 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:02.949673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4baeb-0c2a-40f7-9b6d-1118c3ca0460 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:02.964576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a18a3c-c131-4d29-b7f9-ef722dd402f9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:02.965243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a18a3c-c131-4d29-b7f9-ef722dd402f9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:02.965560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a18a3c-c131-4d29-b7f9-ef722dd402f9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:02.965870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a18a3c-c131-4d29-b7f9-ef722dd402f9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:02.966631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a18a3c-c131-4d29-b7f9-ef722dd402f9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Adding query filter params (scope.project.id=30972395bdfc48db92f429e97a75b2e4, user.id=b3763badd4b7448682cd1ef9b58eb243) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:02.966937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a18a3c-c131-4d29-b7f9-ef722dd402f9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:02.967981 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-10a18a3c-c131-4d29-b7f9-ef722dd402f9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:50:02.967981 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:50:02.967981 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:50:02.969123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a18a3c-c131-4d29-b7f9-ef722dd402f9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:03.012581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:03.082941 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3340/6677] 10.222.0.27 () {58 vars in 1356 bytes} [Sun Aug 28 18:50:02 2022] GET /identity/v3/role_assignments?scope.project.id=30972395bdfc48db92f429e97a75b2e4&user.id=b3763badd4b7448682cd1ef9b58eb243&effective => generated 648 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:03.087195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8457bd-01b8-47c2-bd9b-423793665eab tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:03.162776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8457bd-01b8-47c2-bd9b-423793665eab tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:03.173401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7bb97-92a8-4c0c-a5fd-0156f2963532 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:03.174172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7bb97-92a8-4c0c-a5fd-0156f2963532 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:03.174462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7bb97-92a8-4c0c-a5fd-0156f2963532 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:03.174753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7bb97-92a8-4c0c-a5fd-0156f2963532 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/users/b3763badd4b7448682cd1ef9b58eb243/roles/021e03e1e5714c4c86e7ea7c4907acf7/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:03.180661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7bb97-92a8-4c0c-a5fd-0156f2963532 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9e2d66f10e51417d9529b1d2b2d5305f, user_id=b3763badd4b7448682cd1ef9b58eb243, role_id=021e03e1e5714c4c86e7ea7c4907acf7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:03.186740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7bb97-92a8-4c0c-a5fd-0156f2963532 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:03.202258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-67b7bb97-92a8-4c0c-a5fd-0156f2963532 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invalidating the token cache because role 021e03e1e5714c4c86e7ea7c4907acf7 was removed from user b3763badd4b7448682cd1ef9b58eb243 on domain 9e2d66f10e51417d9529b1d2b2d5305f. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:03.203092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-67b7bb97-92a8-4c0c-a5fd-0156f2963532 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:03.203463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-67b7bb97-92a8-4c0c-a5fd-0156f2963532 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:03.209936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a18a3c-c131-4d29-b7f9-ef722dd402f9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:03.212078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-10a18a3c-c131-4d29-b7f9-ef722dd402f9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:03.232803 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3338/6678] 10.222.0.27 () {58 vars in 1563 bytes} [Sun Aug 28 18:50:03 2022] DELETE /identity/v3/OS-INHERIT/domains/9e2d66f10e51417d9529b1d2b2d5305f/users/b3763badd4b7448682cd1ef9b58eb243/roles/021e03e1e5714c4c86e7ea7c4907acf7/inherited_to_projects => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:03.239980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7bb97-92a8-4c0c-a5fd-0156f2963532 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:03.243002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-67b7bb97-92a8-4c0c-a5fd-0156f2963532 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:03.397105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a18a3c-c131-4d29-b7f9-ef722dd402f9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:03.436222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7bb97-92a8-4c0c-a5fd-0156f2963532 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:03.451763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ed974-03df-4a62-a9fa-dd939e03cbbe tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:03.452604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ed974-03df-4a62-a9fa-dd939e03cbbe tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:03.452898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ed974-03df-4a62-a9fa-dd939e03cbbe tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:03.453178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ed974-03df-4a62-a9fa-dd939e03cbbe tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:03.453946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ed974-03df-4a62-a9fa-dd939e03cbbe tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Adding query filter params (scope.project.id=666770e0bddd453cb0ca74c4fdde83b9, user.id=b3763badd4b7448682cd1ef9b58eb243) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:03.454260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ed974-03df-4a62-a9fa-dd939e03cbbe tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:03.459354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ed974-03df-4a62-a9fa-dd939e03cbbe tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:03.548565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f96d8-3f24-4584-83e9-8653930fbb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:03.549289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f96d8-3f24-4584-83e9-8653930fbb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:03.549699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f96d8-3f24-4584-83e9-8653930fbb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:03.550446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f96d8-3f24-4584-83e9-8653930fbb61 admin admin] PATH_INFO: `/v3/users/5a8e5b4f29a1459ea2235d1385ae74f5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:03.551854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f96d8-3f24-4584-83e9-8653930fbb61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a8e5b4f29a1459ea2235d1385ae74f5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:03.554155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f96d8-3f24-4584-83e9-8653930fbb61 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:03.642455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:03.653931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d6f96d8-3f24-4584-83e9-8653930fbb61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a8e5b4f29a1459ea2235d1385ae74f5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:03.686030 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3339/6679] 10.222.0.27 () {58 vars in 1356 bytes} [Sun Aug 28 18:50:03 2022] GET /identity/v3/role_assignments?scope.project.id=666770e0bddd453cb0ca74c4fdde83b9&user.id=b3763badd4b7448682cd1ef9b58eb243&effective => generated 228 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:03.697820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ed974-03df-4a62-a9fa-dd939e03cbbe tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:03.713377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d6f96d8-3f24-4584-83e9-8653930fbb61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a8e5b4f29a1459ea2235d1385ae74f5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:03.714691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d6f96d8-3f24-4584-83e9-8653930fbb61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a8e5b4f29a1459ea2235d1385ae74f5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:03.716418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d6f96d8-3f24-4584-83e9-8653930fbb61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a8e5b4f29a1459ea2235d1385ae74f5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:03.735407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ed974-03df-4a62-a9fa-dd939e03cbbe tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:03.744291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d6f96d8-3f24-4584-83e9-8653930fbb61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a8e5b4f29a1459ea2235d1385ae74f5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:03.756969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:03.757143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067e5c9-38e6-49bf-8071-8f69101d40ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:03.758668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067e5c9-38e6-49bf-8071-8f69101d40ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:03.760115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067e5c9-38e6-49bf-8071-8f69101d40ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:03.761091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067e5c9-38e6-49bf-8071-8f69101d40ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:03.763490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067e5c9-38e6-49bf-8071-8f69101d40ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Adding query filter params (scope.project.id=30972395bdfc48db92f429e97a75b2e4, user.id=b3763badd4b7448682cd1ef9b58eb243) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:03.764339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067e5c9-38e6-49bf-8071-8f69101d40ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:03.769371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067e5c9-38e6-49bf-8071-8f69101d40ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:03.778098 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3341/6680] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:03 2022] DELETE /identity/v3/users/5a8e5b4f29a1459ea2235d1385ae74f5 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:50:03.784715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eb985-fe11-448f-b25c-87e50c63c392 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:03.785051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eb985-fe11-448f-b25c-87e50c63c392 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:03.785395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eb985-fe11-448f-b25c-87e50c63c392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:03.832456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1d8eb985-fe11-448f-b25c-87e50c63c392 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:03.834379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d8eb985-fe11-448f-b25c-87e50c63c392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:03.900267 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3340/6681] 10.222.0.27 () {58 vars in 1356 bytes} [Sun Aug 28 18:50:03 2022] GET /identity/v3/role_assignments?scope.project.id=30972395bdfc48db92f429e97a75b2e4&user.id=b3763badd4b7448682cd1ef9b58eb243&effective => generated 228 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:03.908676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067e5c9-38e6-49bf-8071-8f69101d40ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:03.917352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c067e5c9-38e6-49bf-8071-8f69101d40ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:03.963855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067e5c9-38e6-49bf-8071-8f69101d40ae tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:03.990582 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3342/6682] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:50:04.001589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8eb985-fe11-448f-b25c-87e50c63c392 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:04.003894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d8eb985-fe11-448f-b25c-87e50c63c392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:04.095852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321eeb2-599a-4356-91ad-bee40c31d665 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:04.096950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321eeb2-599a-4356-91ad-bee40c31d665 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:04.097537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321eeb2-599a-4356-91ad-bee40c31d665 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:04.098074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321eeb2-599a-4356-91ad-bee40c31d665 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/projects/30972395bdfc48db92f429e97a75b2e4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:04.102204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321eeb2-599a-4356-91ad-bee40c31d665 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:delete_project(project_id=30972395bdfc48db92f429e97a75b2e4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:04.104657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321eeb2-599a-4356-91ad-bee40c31d665 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:04.142610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8eb985-fe11-448f-b25c-87e50c63c392 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:04.147354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab737c-1fd2-4ad8-afa2-372836d552d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:04.148184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab737c-1fd2-4ad8-afa2-372836d552d9 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:04.148689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab737c-1fd2-4ad8-afa2-372836d552d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:04.149163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab737c-1fd2-4ad8-afa2-372836d552d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:04.165940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab737c-1fd2-4ad8-afa2-372836d552d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:04.168171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab737c-1fd2-4ad8-afa2-372836d552d9 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:04.185120 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3343/6683] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:04.214554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3321eeb2-599a-4356-91ad-bee40c31d665 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30972395bdfc48db92f429e97a75b2e4', 'request_id': 'req-3321eeb2-599a-4356-91ad-bee40c31d665'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:04.239099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3321eeb2-599a-4356-91ad-bee40c31d665 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30972395bdfc48db92f429e97a75b2e4', 'request_id': 'req-3321eeb2-599a-4356-91ad-bee40c31d665'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:04.251367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3321eeb2-599a-4356-91ad-bee40c31d665 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30972395bdfc48db92f429e97a75b2e4', 'request_id': 'req-3321eeb2-599a-4356-91ad-bee40c31d665'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:04.274407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3321eeb2-599a-4356-91ad-bee40c31d665 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] The token cache is being invalidate because project 30972395bdfc48db92f429e97a75b2e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:04.275045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3321eeb2-599a-4356-91ad-bee40c31d665 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:04.276047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3321eeb2-599a-4356-91ad-bee40c31d665 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:04.282859 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3341/6684] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:03 2022] DELETE /identity/v3/projects/30972395bdfc48db92f429e97a75b2e4 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:04.283762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab737c-1fd2-4ad8-afa2-372836d552d9 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:04.299554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab737c-1fd2-4ad8-afa2-372836d552d9 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:04.423626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab892d43-7523-407c-b193-5123ca649df6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:04.424256 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab892d43-7523-407c-b193-5123ca649df6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:04.424515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab892d43-7523-407c-b193-5123ca649df6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:04.424795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab892d43-7523-407c-b193-5123ca649df6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/roles/021e03e1e5714c4c86e7ea7c4907acf7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:04.426356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab892d43-7523-407c-b193-5123ca649df6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:delete_role(role_id=021e03e1e5714c4c86e7ea7c4907acf7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:04.428011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab892d43-7523-407c-b193-5123ca649df6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:04.499216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ab892d43-7523-407c-b193-5123ca649df6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invalidating the token cache because role 021e03e1e5714c4c86e7ea7c4907acf7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:04.499549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ab892d43-7523-407c-b193-5123ca649df6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:04.504787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ab892d43-7523-407c-b193-5123ca649df6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:04.507013 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3344/6685] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:04 2022] DELETE /identity/v3/roles/021e03e1e5714c4c86e7ea7c4907acf7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:04.512727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321eeb2-599a-4356-91ad-bee40c31d665 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:04.514258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3321eeb2-599a-4356-91ad-bee40c31d665 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:04.539699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321eeb2-599a-4356-91ad-bee40c31d665 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:04.604454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:04.655425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34005e9-de3b-4ec4-9731-852f37e13c50 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:04.659653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34005e9-de3b-4ec4-9731-852f37e13c50 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:04.660436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34005e9-de3b-4ec4-9731-852f37e13c50 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:04.660796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34005e9-de3b-4ec4-9731-852f37e13c50 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:04.661971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34005e9-de3b-4ec4-9731-852f37e13c50 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:04.664005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34005e9-de3b-4ec4-9731-852f37e13c50 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:04.729677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab892d43-7523-407c-b193-5123ca649df6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:04.731472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ab892d43-7523-407c-b193-5123ca649df6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:04.733429 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3342/6686] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:50:04 2022] POST /identity/v3/roles => generated 240 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:04.748286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:04.756924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab892d43-7523-407c-b193-5123ca649df6 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:04.775471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05379334-3e57-4a01-832b-ed12baa23d06 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:04.775471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05379334-3e57-4a01-832b-ed12baa23d06 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:04.775471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05379334-3e57-4a01-832b-ed12baa23d06 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:04.775856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05379334-3e57-4a01-832b-ed12baa23d06 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:04.776491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05379334-3e57-4a01-832b-ed12baa23d06 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:04.778489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05379334-3e57-4a01-832b-ed12baa23d06 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:04.874859 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3345/6687] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:04 2022] POST /identity/v3/projects => generated 409 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:04.876354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34005e9-de3b-4ec4-9731-852f37e13c50 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:04.888742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34005e9-de3b-4ec4-9731-852f37e13c50 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:04.906814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05379334-3e57-4a01-832b-ed12baa23d06 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:04.909022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-05379334-3e57-4a01-832b-ed12baa23d06 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:05.040329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04827cc3-969d-4476-b1bf-601b8142d782 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:05.041859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04827cc3-969d-4476-b1bf-601b8142d782 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:05.042298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04827cc3-969d-4476-b1bf-601b8142d782 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:05.042585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04827cc3-969d-4476-b1bf-601b8142d782 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/666770e0bddd453cb0ca74c4fdde83b9/users/b3763badd4b7448682cd1ef9b58eb243/roles/3be31271eb5f45068984c62beb9b2e49/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:05.048258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04827cc3-969d-4476-b1bf-601b8142d782 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:create_grant(project_id=666770e0bddd453cb0ca74c4fdde83b9, user_id=b3763badd4b7448682cd1ef9b58eb243, role_id=3be31271eb5f45068984c62beb9b2e49)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:05.057701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04827cc3-969d-4476-b1bf-601b8142d782 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:05.085446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05379334-3e57-4a01-832b-ed12baa23d06 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:05.095381 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3343/6688] 10.222.0.27 () {60 vars in 1582 bytes} [Sun Aug 28 18:50:04 2022] PUT /identity/v3/OS-INHERIT/projects/666770e0bddd453cb0ca74c4fdde83b9/users/b3763badd4b7448682cd1ef9b58eb243/roles/3be31271eb5f45068984c62beb9b2e49/inherited_to_projects => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:05.096086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04827cc3-969d-4476-b1bf-601b8142d782 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:05.236018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04827cc3-969d-4476-b1bf-601b8142d782 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:05.249261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6067d39-c845-4f86-aafe-e163976639bf tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:05.249912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6067d39-c845-4f86-aafe-e163976639bf tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:05.250277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6067d39-c845-4f86-aafe-e163976639bf tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:05.250567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6067d39-c845-4f86-aafe-e163976639bf tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:05.252393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6067d39-c845-4f86-aafe-e163976639bf tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Adding query filter params (scope.project.id=765066c336994d8e9570a15cdb2cfc43, user.id=b3763badd4b7448682cd1ef9b58eb243) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:05.253004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:05.253731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6067d39-c845-4f86-aafe-e163976639bf tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:05.253887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:05.255898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:05.256187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268 admin admin] PATH_INFO: `/v3/projects/0a247f790c0041dab483475a2832f288` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:05.257566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6067d39-c845-4f86-aafe-e163976639bf tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:05.259144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a247f790c0041dab483475a2832f288)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:05.265410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:05.346690 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3344/6689] 10.222.0.27 () {58 vars in 1356 bytes} [Sun Aug 28 18:50:05 2022] GET /identity/v3/role_assignments?scope.project.id=765066c336994d8e9570a15cdb2cfc43&user.id=b3763badd4b7448682cd1ef9b58eb243&effective => generated 649 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:05.349960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6067d39-c845-4f86-aafe-e163976639bf tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:05.364671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a247f790c0041dab483475a2832f288', 'request_id': 'req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:05.372544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a247f790c0041dab483475a2832f288', 'request_id': 'req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:05.373702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6067d39-c845-4f86-aafe-e163976639bf tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:05.380704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a247f790c0041dab483475a2832f288', 'request_id': 'req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:05.399402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:05.417111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268 admin admin] The token cache is being invalidate because project 0a247f790c0041dab483475a2832f288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:05.417400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:05.418952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:05.421392 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3346/6690] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:04 2022] DELETE /identity/v3/projects/0a247f790c0041dab483475a2832f288 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:50:05.426015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:05.427731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:05.453220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:05.498715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2be53-b7de-4ed9-b35b-955d313e74c2 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:05.500126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2be53-b7de-4ed9-b35b-955d313e74c2 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:05.500875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2be53-b7de-4ed9-b35b-955d313e74c2 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:05.501705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2be53-b7de-4ed9-b35b-955d313e74c2 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/666770e0bddd453cb0ca74c4fdde83b9/users/b3763badd4b7448682cd1ef9b58eb243/roles/3be31271eb5f45068984c62beb9b2e49/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:05.505258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2be53-b7de-4ed9-b35b-955d313e74c2 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=666770e0bddd453cb0ca74c4fdde83b9, user_id=b3763badd4b7448682cd1ef9b58eb243, role_id=3be31271eb5f45068984c62beb9b2e49)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:05.509125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2be53-b7de-4ed9-b35b-955d313e74c2 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:05.533663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22a2be53-b7de-4ed9-b35b-955d313e74c2 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invalidating the token cache because role 3be31271eb5f45068984c62beb9b2e49 was removed from user b3763badd4b7448682cd1ef9b58eb243 on project 666770e0bddd453cb0ca74c4fdde83b9. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:05.533949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c3c5a-7f15-4ad0-adc4-0fb28bfab268 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:05.534174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22a2be53-b7de-4ed9-b35b-955d313e74c2 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:05.535655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22a2be53-b7de-4ed9-b35b-955d313e74c2 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:05.558077 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3345/6691] 10.222.0.27 () {58 vars in 1566 bytes} [Sun Aug 28 18:50:05 2022] DELETE /identity/v3/OS-INHERIT/projects/666770e0bddd453cb0ca74c4fdde83b9/users/b3763badd4b7448682cd1ef9b58eb243/roles/3be31271eb5f45068984c62beb9b2e49/inherited_to_projects => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:05.562565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2be53-b7de-4ed9-b35b-955d313e74c2 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:05.564625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-22a2be53-b7de-4ed9-b35b-955d313e74c2 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:05.578689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba37c0-a654-4a14-ac8b-bb3b8362c411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:05.579557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba37c0-a654-4a14-ac8b-bb3b8362c411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:05.579842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba37c0-a654-4a14-ac8b-bb3b8362c411 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:05.580123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba37c0-a654-4a14-ac8b-bb3b8362c411 admin admin] PATH_INFO: `/v3/users/88e56561262b45ebb94ab8e96c40d35b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:05.584776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba37c0-a654-4a14-ac8b-bb3b8362c411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e56561262b45ebb94ab8e96c40d35b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:05.593178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba37c0-a654-4a14-ac8b-bb3b8362c411 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:05.682672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7eba37c0-a654-4a14-ac8b-bb3b8362c411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e56561262b45ebb94ab8e96c40d35b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:05.709512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7eba37c0-a654-4a14-ac8b-bb3b8362c411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e56561262b45ebb94ab8e96c40d35b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:05.711006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7eba37c0-a654-4a14-ac8b-bb3b8362c411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e56561262b45ebb94ab8e96c40d35b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:05.711851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7eba37c0-a654-4a14-ac8b-bb3b8362c411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e56561262b45ebb94ab8e96c40d35b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:05.724293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2be53-b7de-4ed9-b35b-955d313e74c2 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:05.727596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7eba37c0-a654-4a14-ac8b-bb3b8362c411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e56561262b45ebb94ab8e96c40d35b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:05.734271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f194225-8a48-4e8b-ab2b-e9fad8bb6745 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:05.735038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f194225-8a48-4e8b-ab2b-e9fad8bb6745 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:05.735381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f194225-8a48-4e8b-ab2b-e9fad8bb6745 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:05.735663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f194225-8a48-4e8b-ab2b-e9fad8bb6745 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:05.736399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f194225-8a48-4e8b-ab2b-e9fad8bb6745 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Adding query filter params (scope.project.id=765066c336994d8e9570a15cdb2cfc43, user.id=b3763badd4b7448682cd1ef9b58eb243) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:05.736703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f194225-8a48-4e8b-ab2b-e9fad8bb6745 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:05.738675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f194225-8a48-4e8b-ab2b-e9fad8bb6745 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:05.761558 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3347/6692] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:05 2022] DELETE /identity/v3/users/88e56561262b45ebb94ab8e96c40d35b => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:05.838857 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3346/6693] 10.222.0.27 () {58 vars in 1356 bytes} [Sun Aug 28 18:50:05 2022] GET /identity/v3/role_assignments?scope.project.id=765066c336994d8e9570a15cdb2cfc43&user.id=b3763badd4b7448682cd1ef9b58eb243&effective => generated 228 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:05.843229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba37c0-a654-4a14-ac8b-bb3b8362c411 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:05.845008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7eba37c0-a654-4a14-ac8b-bb3b8362c411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:06.093658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba37c0-a654-4a14-ac8b-bb3b8362c411 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:06.104525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:06.105510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:06.105959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:06.106387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/projects/765066c336994d8e9570a15cdb2cfc43` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:06.107966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:delete_project(project_id=765066c336994d8e9570a15cdb2cfc43)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:06.110817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:06.139510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f194225-8a48-4e8b-ab2b-e9fad8bb6745 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:06.141577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2f194225-8a48-4e8b-ab2b-e9fad8bb6745 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:06.219881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:06.230124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f194225-8a48-4e8b-ab2b-e9fad8bb6745 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:06.247881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765066c336994d8e9570a15cdb2cfc43', 'request_id': 'req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:06.267970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765066c336994d8e9570a15cdb2cfc43', 'request_id': 'req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:06.281106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:06.286142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765066c336994d8e9570a15cdb2cfc43', 'request_id': 'req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:06.316716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] The token cache is being invalidate because project 765066c336994d8e9570a15cdb2cfc43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:06.317727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:06.320135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:06.327864 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3348/6694] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:05 2022] DELETE /identity/v3/projects/765066c336994d8e9570a15cdb2cfc43 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:06.330212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:06.336723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:06.338657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38efdc-1973-47b4-919e-d806e1e605da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:06.339584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38efdc-1973-47b4-919e-d806e1e605da service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:06.340032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38efdc-1973-47b4-919e-d806e1e605da service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:06.340450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38efdc-1973-47b4-919e-d806e1e605da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:06.343394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a38efdc-1973-47b4-919e-d806e1e605da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:06.372690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38efdc-1973-47b4-919e-d806e1e605da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:06.374991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38efdc-1973-47b4-919e-d806e1e605da service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:06.394333 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3347/6695] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:06.395830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38efdc-1973-47b4-919e-d806e1e605da service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:06.397629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a38efdc-1973-47b4-919e-d806e1e605da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:06.494072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727c8d0-bd41-43ad-92ae-d07bc5f3cae9 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:06.506143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413b455-4840-4741-9346-48654a88d20c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:06.506918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b455-4840-4741-9346-48654a88d20c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:06.508507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b455-4840-4741-9346-48654a88d20c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:06.508865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b455-4840-4741-9346-48654a88d20c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/roles/3be31271eb5f45068984c62beb9b2e49` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:06.512176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413b455-4840-4741-9346-48654a88d20c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3be31271eb5f45068984c62beb9b2e49)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:06.514422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413b455-4840-4741-9346-48654a88d20c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:06.539482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38efdc-1973-47b4-919e-d806e1e605da service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:06.550963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af201f72-ccb2-47a0-94fc-929618a3f1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:06.553266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af201f72-ccb2-47a0-94fc-929618a3f1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:06.555284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af201f72-ccb2-47a0-94fc-929618a3f1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:06.555284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af201f72-ccb2-47a0-94fc-929618a3f1b7 admin admin] PATH_INFO: `/v3/projects/d94ff65b11864909af257446ca3af4ac` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:06.557660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af201f72-ccb2-47a0-94fc-929618a3f1b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d94ff65b11864909af257446ca3af4ac)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:06.561226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af201f72-ccb2-47a0-94fc-929618a3f1b7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:06.594828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0413b455-4840-4741-9346-48654a88d20c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invalidating the token cache because role 3be31271eb5f45068984c62beb9b2e49 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:06.596282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0413b455-4840-4741-9346-48654a88d20c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:06.598537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0413b455-4840-4741-9346-48654a88d20c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:06.609680 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3349/6696] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:06 2022] DELETE /identity/v3/roles/3be31271eb5f45068984c62beb9b2e49 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:06.610684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413b455-4840-4741-9346-48654a88d20c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:06.612197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0413b455-4840-4741-9346-48654a88d20c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:06.677299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af201f72-ccb2-47a0-94fc-929618a3f1b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd94ff65b11864909af257446ca3af4ac', 'request_id': 'req-af201f72-ccb2-47a0-94fc-929618a3f1b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:06.699153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af201f72-ccb2-47a0-94fc-929618a3f1b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd94ff65b11864909af257446ca3af4ac', 'request_id': 'req-af201f72-ccb2-47a0-94fc-929618a3f1b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:06.707844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af201f72-ccb2-47a0-94fc-929618a3f1b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd94ff65b11864909af257446ca3af4ac', 'request_id': 'req-af201f72-ccb2-47a0-94fc-929618a3f1b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:06.737424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413b455-4840-4741-9346-48654a88d20c tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:06.746273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af201f72-ccb2-47a0-94fc-929618a3f1b7 admin admin] The token cache is being invalidate because project d94ff65b11864909af257446ca3af4ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:06.747089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af201f72-ccb2-47a0-94fc-929618a3f1b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:06.750400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af201f72-ccb2-47a0-94fc-929618a3f1b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:06.752324 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3348/6697] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:06 2022] DELETE /identity/v3/projects/d94ff65b11864909af257446ca3af4ac => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:06.757175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881ec3f-a3ee-442c-a68e-d28e3e6c94dc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:06.757517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881ec3f-a3ee-442c-a68e-d28e3e6c94dc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:06.757862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881ec3f-a3ee-442c-a68e-d28e3e6c94dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:06.780472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:06.781984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c881ec3f-a3ee-442c-a68e-d28e3e6c94dc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:06.783792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c881ec3f-a3ee-442c-a68e-d28e3e6c94dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:06.812617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8280a-f3cf-446f-9211-c1462ea3269f tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:06.813309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8280a-f3cf-446f-9211-c1462ea3269f tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:06.813604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8280a-f3cf-446f-9211-c1462ea3269f tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:06.813883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8280a-f3cf-446f-9211-c1462ea3269f tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/users/b3763badd4b7448682cd1ef9b58eb243` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:06.815192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8280a-f3cf-446f-9211-c1462ea3269f tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b3763badd4b7448682cd1ef9b58eb243)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:06.817272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8280a-f3cf-446f-9211-c1462ea3269f tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:06.849936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:06.888463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b1f8280a-f3cf-446f-9211-c1462ea3269f tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3763badd4b7448682cd1ef9b58eb243'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:06.897981 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3349/6698] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:06.900011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c6a05-2c10-4e03-82b2-826c0c04e5df None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:06.901413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c6a05-2c10-4e03-82b2-826c0c04e5df None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:06.901957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c6a05-2c10-4e03-82b2-826c0c04e5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:06.904240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b1f8280a-f3cf-446f-9211-c1462ea3269f tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3763badd4b7448682cd1ef9b58eb243'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:06.912328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b1f8280a-f3cf-446f-9211-c1462ea3269f tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3763badd4b7448682cd1ef9b58eb243'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:06.913890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b1f8280a-f3cf-446f-9211-c1462ea3269f tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3763badd4b7448682cd1ef9b58eb243'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:06.933718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b1f8280a-f3cf-446f-9211-c1462ea3269f tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3763badd4b7448682cd1ef9b58eb243'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:06.950802 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3350/6699] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:06 2022] DELETE /identity/v3/users/b3763badd4b7448682cd1ef9b58eb243 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:06.952026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-552c6a05-2c10-4e03-82b2-826c0c04e5df None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:06.954630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8280a-f3cf-446f-9211-c1462ea3269f tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:06.956150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-552c6a05-2c10-4e03-82b2-826c0c04e5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:06.957005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b1f8280a-f3cf-446f-9211-c1462ea3269f tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:07.086965 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3350/6700] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:07.089496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c6a05-2c10-4e03-82b2-826c0c04e5df None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:07.110801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c6a05-2c10-4e03-82b2-826c0c04e5df None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:07.117942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8280a-f3cf-446f-9211-c1462ea3269f tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:07.122896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce05d6-8ac7-4d8b-ab6a-24e89013d089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:07.123562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce05d6-8ac7-4d8b-ab6a-24e89013d089 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:07.123840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce05d6-8ac7-4d8b-ab6a-24e89013d089 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:07.124112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce05d6-8ac7-4d8b-ab6a-24e89013d089 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:07.126273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce05d6-8ac7-4d8b-ab6a-24e89013d089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:07.126582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce05d6-8ac7-4d8b-ab6a-24e89013d089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:07.130378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce05d6-8ac7-4d8b-ab6a-24e89013d089 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:07.132674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1289abd-00b4-424f-8e87-8119b29063fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:07.133330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1289abd-00b4-424f-8e87-8119b29063fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:07.133607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1289abd-00b4-424f-8e87-8119b29063fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:07.133883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1289abd-00b4-424f-8e87-8119b29063fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/groups/f4efe6c0b991462eb531b47fe0cd52d8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:07.136475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1289abd-00b4-424f-8e87-8119b29063fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f4efe6c0b991462eb531b47fe0cd52d8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:07.145126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1289abd-00b4-424f-8e87-8119b29063fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:07.172031 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3351/6701] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:07.174175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce05d6-8ac7-4d8b-ab6a-24e89013d089 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:07.197777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce05d6-8ac7-4d8b-ab6a-24e89013d089 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:07.212032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45433b75-a0f1-4295-87bc-6594ccf9ecd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:07.213003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45433b75-a0f1-4295-87bc-6594ccf9ecd6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:07.213280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45433b75-a0f1-4295-87bc-6594ccf9ecd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:07.214222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45433b75-a0f1-4295-87bc-6594ccf9ecd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:07.214222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45433b75-a0f1-4295-87bc-6594ccf9ecd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:07.216371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45433b75-a0f1-4295-87bc-6594ccf9ecd6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:07.248347 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3351/6702] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:50:06 2022] DELETE /identity/v3/groups/f4efe6c0b991462eb531b47fe0cd52d8 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:07.252676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1289abd-00b4-424f-8e87-8119b29063fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:07.260607 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3352/6703] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:07 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:07.264356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45433b75-a0f1-4295-87bc-6594ccf9ecd6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:07.286632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:07.363530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1289abd-00b4-424f-8e87-8119b29063fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:07.465876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45433b75-a0f1-4295-87bc-6594ccf9ecd6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:07.481278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82145995-6630-4d8d-8542-3baba8d2590a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:07.482207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82145995-6630-4d8d-8542-3baba8d2590a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:07.482642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82145995-6630-4d8d-8542-3baba8d2590a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:07.483069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82145995-6630-4d8d-8542-3baba8d2590a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:07.483888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82145995-6630-4d8d-8542-3baba8d2590a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:07.486005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82145995-6630-4d8d-8542-3baba8d2590a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:07.529771 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3353/6704] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:07 2022] POST /identity/v3/users => generated 289 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:07.533478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82145995-6630-4d8d-8542-3baba8d2590a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:07.552127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82145995-6630-4d8d-8542-3baba8d2590a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:07.561933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:07.562726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:07.563081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:07.563459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/projects/666770e0bddd453cb0ca74c4fdde83b9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:07.564751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:delete_project(project_id=666770e0bddd453cb0ca74c4fdde83b9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:07.564873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61edce5-3cd6-46b0-a489-3adfee0926e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:07.565508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61edce5-3cd6-46b0-a489-3adfee0926e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:07.565818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61edce5-3cd6-46b0-a489-3adfee0926e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:07.566096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61edce5-3cd6-46b0-a489-3adfee0926e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:07.566755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61edce5-3cd6-46b0-a489-3adfee0926e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:07.567180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:07.568703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61edce5-3cd6-46b0-a489-3adfee0926e5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:07.589959 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3354/6705] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:07.594058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61edce5-3cd6-46b0-a489-3adfee0926e5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:07.621920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61edce5-3cd6-46b0-a489-3adfee0926e5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:07.636191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefb371-82a7-4ed7-8dc8-c2590358d86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:07.639093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefb371-82a7-4ed7-8dc8-c2590358d86e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:07.639556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefb371-82a7-4ed7-8dc8-c2590358d86e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:07.641155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefb371-82a7-4ed7-8dc8-c2590358d86e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:07.643001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefb371-82a7-4ed7-8dc8-c2590358d86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:07.646610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefb371-82a7-4ed7-8dc8-c2590358d86e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:07.669270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '666770e0bddd453cb0ca74c4fdde83b9', 'request_id': 'req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:07.682834 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3355/6706] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:50:07.684434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefb371-82a7-4ed7-8dc8-c2590358d86e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:07.686019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '666770e0bddd453cb0ca74c4fdde83b9', 'request_id': 'req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:07.707152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefb371-82a7-4ed7-8dc8-c2590358d86e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:07.715675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '666770e0bddd453cb0ca74c4fdde83b9', 'request_id': 'req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:07.747582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] The token cache is being invalidate because project 666770e0bddd453cb0ca74c4fdde83b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:07.747888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:07.748847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:07.750798 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3352/6707] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:07 2022] DELETE /identity/v3/projects/666770e0bddd453cb0ca74c4fdde83b9 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:07.754537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:07.756306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:07.760351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:07.838014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:07.880798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1937b5-0f54-47a1-8e4e-599d2b4ce1fb tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:07.893286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16349ae0-f720-4de8-b136-094c0e2ccbd8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:07.894119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16349ae0-f720-4de8-b136-094c0e2ccbd8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:07.894473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16349ae0-f720-4de8-b136-094c0e2ccbd8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:07.894848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16349ae0-f720-4de8-b136-094c0e2ccbd8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/domains/9e2d66f10e51417d9529b1d2b2d5305f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:07.897040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16349ae0-f720-4de8-b136-094c0e2ccbd8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9e2d66f10e51417d9529b1d2b2d5305f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:07.898909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16349ae0-f720-4de8-b136-094c0e2ccbd8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:07.904913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f46db-ca34-47bc-b6a4-a57642954100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:07.911755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f46db-ca34-47bc-b6a4-a57642954100 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:07.912306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f46db-ca34-47bc-b6a4-a57642954100 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:07.912754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f46db-ca34-47bc-b6a4-a57642954100 admin admin] PATH_INFO: `/v3/projects/cd579586293b47f180e314ec524cba7f/users/ad7bc63215bf49169e4f2bc1557992c8/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:07.928233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16349ae0-f720-4de8-b136-094c0e2ccbd8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9e2d66f10e51417d9529b1d2b2d5305f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:07.930882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16349ae0-f720-4de8-b136-094c0e2ccbd8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9e2d66f10e51417d9529b1d2b2d5305f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:07.961328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f46db-ca34-47bc-b6a4-a57642954100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd579586293b47f180e314ec524cba7f, user_id=ad7bc63215bf49169e4f2bc1557992c8, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:07.968677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f46db-ca34-47bc-b6a4-a57642954100 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:07.997248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16349ae0-f720-4de8-b136-094c0e2ccbd8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9e2d66f10e51417d9529b1d2b2d5305f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:07.998721 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3356/6708] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:07 2022] PUT /identity/v3/projects/cd579586293b47f180e314ec524cba7f/users/ad7bc63215bf49169e4f2bc1557992c8/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:50:07.998928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16349ae0-f720-4de8-b136-094c0e2ccbd8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9e2d66f10e51417d9529b1d2b2d5305f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:08.005058 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3353/6709] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:50:07 2022] PATCH /identity/v3/domains/9e2d66f10e51417d9529b1d2b2d5305f => generated 278 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:08.009293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d26962-fd35-4be2-8a98-3d2fb22fdc9c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:08.010976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d26962-fd35-4be2-8a98-3d2fb22fdc9c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:08.011433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d26962-fd35-4be2-8a98-3d2fb22fdc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:08.024086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16349ae0-f720-4de8-b136-094c0e2ccbd8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:08.028681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-16349ae0-f720-4de8-b136-094c0e2ccbd8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:08.095528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-03d26962-fd35-4be2-8a98-3d2fb22fdc9c None None] MFA Rules not processed for user `ad7bc63215bf49169e4f2bc1557992c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:08.097250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-03d26962-fd35-4be2-8a98-3d2fb22fdc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:08.189069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16349ae0-f720-4de8-b136-094c0e2ccbd8 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:08.249985 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3357/6710] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:50:08.251526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d26962-fd35-4be2-8a98-3d2fb22fdc9c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:08.253162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-03d26962-fd35-4be2-8a98-3d2fb22fdc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:08.292034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a9aaba6da62462bb844aa535577d883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce5b9e16950343f29d0e95f7baa2ae47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:08.292808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:08.293160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:08.293504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] PATH_INFO: `/v3/domains/9e2d66f10e51417d9529b1d2b2d5305f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:08.307747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9e2d66f10e51417d9529b1d2b2d5305f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:08.309576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:08.337697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9e2d66f10e51417d9529b1d2b2d5305f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:08.351877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9e2d66f10e51417d9529b1d2b2d5305f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:08.399402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:08.406120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d26962-fd35-4be2-8a98-3d2fb22fdc9c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:08.435153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e2d66f10e51417d9529b1d2b2d5305f', 'request_id': 'req-6c38cbef-bad5-40c6-8739-b66710e48249'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:08.447162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:08.457983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e2d66f10e51417d9529b1d2b2d5305f', 'request_id': 'req-6c38cbef-bad5-40c6-8739-b66710e48249'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:08.473348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e2d66f10e51417d9529b1d2b2d5305f', 'request_id': 'req-6c38cbef-bad5-40c6-8739-b66710e48249'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:08.501990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] The token cache is being invalidate because project 9e2d66f10e51417d9529b1d2b2d5305f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:08.502567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:08.503324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:08.512189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9e2d66f10e51417d9529b1d2b2d5305f', 'request_id': 'req-6c38cbef-bad5-40c6-8739-b66710e48249'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:08.516337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9e2d66f10e51417d9529b1d2b2d5305f', 'request_id': 'req-6c38cbef-bad5-40c6-8739-b66710e48249'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:08.517061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9e2d66f10e51417d9529b1d2b2d5305f', 'request_id': 'req-6c38cbef-bad5-40c6-8739-b66710e48249'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:08.523149 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3354/6711] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:50:08 2022] DELETE /identity/v3/domains/9e2d66f10e51417d9529b1d2b2d5305f => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:08.524378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:08.527545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:08.529778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e91e5b-6460-4139-a0fc-5d46a4cd3849 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:08.530644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e91e5b-6460-4139-a0fc-5d46a4cd3849 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:08.531203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e91e5b-6460-4139-a0fc-5d46a4cd3849 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:08.531884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e91e5b-6460-4139-a0fc-5d46a4cd3849 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:08.535677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-26e91e5b-6460-4139-a0fc-5d46a4cd3849 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:08.619926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38cbef-bad5-40c6-8739-b66710e48249 tempest-InheritsV3TestJSON-651925466 tempest-InheritsV3TestJSON-651925466-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:08.624599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9a1c3-c6cb-4b76-a641-c6629fb49ee2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:08.625309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9a1c3-c6cb-4b76-a641-c6629fb49ee2 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:08.625692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9a1c3-c6cb-4b76-a641-c6629fb49ee2 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:08.626196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9a1c3-c6cb-4b76-a641-c6629fb49ee2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:08.628572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-90a9a1c3-c6cb-4b76-a641-c6629fb49ee2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:08.672175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e91e5b-6460-4139-a0fc-5d46a4cd3849 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:08.673900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e91e5b-6460-4139-a0fc-5d46a4cd3849 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:08.702814 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3358/6712] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:50:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:50:08.705336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e91e5b-6460-4139-a0fc-5d46a4cd3849 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:08.710069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-26e91e5b-6460-4139-a0fc-5d46a4cd3849 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:08.718261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9a1c3-c6cb-4b76-a641-c6629fb49ee2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:08.719612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9a1c3-c6cb-4b76-a641-c6629fb49ee2 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:08.733838 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3355/6713] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:08.933096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e91e5b-6460-4139-a0fc-5d46a4cd3849 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:08.947482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0c69e-c702-4aa6-ab6e-364688bdde44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:08.957447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0c69e-c702-4aa6-ab6e-364688bdde44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:08.957798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0c69e-c702-4aa6-ab6e-364688bdde44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:08.958306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0c69e-c702-4aa6-ab6e-364688bdde44 admin admin] PATH_INFO: `/v3/users/17566dd7c71a45fb847e56add641b0e3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:08.967537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0c69e-c702-4aa6-ab6e-364688bdde44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17566dd7c71a45fb847e56add641b0e3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:08.975052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0c69e-c702-4aa6-ab6e-364688bdde44 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:09.065853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8f0c69e-c702-4aa6-ab6e-364688bdde44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17566dd7c71a45fb847e56add641b0e3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:09.066572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8f0c69e-c702-4aa6-ab6e-364688bdde44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17566dd7c71a45fb847e56add641b0e3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:09.077010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8f0c69e-c702-4aa6-ab6e-364688bdde44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17566dd7c71a45fb847e56add641b0e3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:09.097781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8f0c69e-c702-4aa6-ab6e-364688bdde44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17566dd7c71a45fb847e56add641b0e3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:09.114473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:09.131131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8f0c69e-c702-4aa6-ab6e-364688bdde44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17566dd7c71a45fb847e56add641b0e3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:09.151214 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3359/6714] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:08 2022] DELETE /identity/v3/users/17566dd7c71a45fb847e56add641b0e3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:09.155584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae711dd4-3d09-49df-b1bb-0054dad239cf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:09.156363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae711dd4-3d09-49df-b1bb-0054dad239cf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:09.156787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae711dd4-3d09-49df-b1bb-0054dad239cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:09.204177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ae711dd4-3d09-49df-b1bb-0054dad239cf None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:09.205668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ae711dd4-3d09-49df-b1bb-0054dad239cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:09.324637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:09.341125 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3356/6715] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:09.353832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0c69e-c702-4aa6-ab6e-364688bdde44 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:09.357296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e8f0c69e-c702-4aa6-ab6e-364688bdde44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:09.458866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0c69e-c702-4aa6-ab6e-364688bdde44 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:09.472084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df91002-eb13-4776-a469-208a8e5702dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:09.472738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df91002-eb13-4776-a469-208a8e5702dc service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:09.473020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df91002-eb13-4776-a469-208a8e5702dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:09.473296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df91002-eb13-4776-a469-208a8e5702dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:09.490922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df91002-eb13-4776-a469-208a8e5702dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:09.492793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df91002-eb13-4776-a469-208a8e5702dc service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:09.506929 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3360/6716] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:10.206770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae711dd4-3d09-49df-b1bb-0054dad239cf None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:10.208449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ae711dd4-3d09-49df-b1bb-0054dad239cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:10.228698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae711dd4-3d09-49df-b1bb-0054dad239cf None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:10.252186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e172fd-c49f-4b67-b31d-c3d283303b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:10.252921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e172fd-c49f-4b67-b31d-c3d283303b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:10.253258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e172fd-c49f-4b67-b31d-c3d283303b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:10.253538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e172fd-c49f-4b67-b31d-c3d283303b4c admin admin] PATH_INFO: `/v3/projects/54a3174e892248fa8d4b91f2117b2d4c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:10.256109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e172fd-c49f-4b67-b31d-c3d283303b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a3174e892248fa8d4b91f2117b2d4c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:10.260759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e172fd-c49f-4b67-b31d-c3d283303b4c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:10.359963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80e172fd-c49f-4b67-b31d-c3d283303b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a3174e892248fa8d4b91f2117b2d4c', 'request_id': 'req-80e172fd-c49f-4b67-b31d-c3d283303b4c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:10.385894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80e172fd-c49f-4b67-b31d-c3d283303b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a3174e892248fa8d4b91f2117b2d4c', 'request_id': 'req-80e172fd-c49f-4b67-b31d-c3d283303b4c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:10.417234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80e172fd-c49f-4b67-b31d-c3d283303b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a3174e892248fa8d4b91f2117b2d4c', 'request_id': 'req-80e172fd-c49f-4b67-b31d-c3d283303b4c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:10.444215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80e172fd-c49f-4b67-b31d-c3d283303b4c admin admin] The token cache is being invalidate because project 54a3174e892248fa8d4b91f2117b2d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:10.444609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80e172fd-c49f-4b67-b31d-c3d283303b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:10.445576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80e172fd-c49f-4b67-b31d-c3d283303b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:10.448183 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3357/6717] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:10 2022] DELETE /identity/v3/projects/54a3174e892248fa8d4b91f2117b2d4c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:10.452346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df91002-eb13-4776-a469-208a8e5702dc service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:10.483289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df91002-eb13-4776-a469-208a8e5702dc service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:10.609102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06291a8-a4d6-407f-a2ee-f12512c7710e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:10.609929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06291a8-a4d6-407f-a2ee-f12512c7710e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:10.610726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06291a8-a4d6-407f-a2ee-f12512c7710e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:10.611126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06291a8-a4d6-407f-a2ee-f12512c7710e admin admin] PATH_INFO: `/v3/users/6a9aaba6da62462bb844aa535577d883` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:10.613625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06291a8-a4d6-407f-a2ee-f12512c7710e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a9aaba6da62462bb844aa535577d883)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:10.616634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06291a8-a4d6-407f-a2ee-f12512c7710e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:10.748596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e06291a8-a4d6-407f-a2ee-f12512c7710e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a9aaba6da62462bb844aa535577d883'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:10.749721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e06291a8-a4d6-407f-a2ee-f12512c7710e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a9aaba6da62462bb844aa535577d883'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:10.790977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e06291a8-a4d6-407f-a2ee-f12512c7710e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a9aaba6da62462bb844aa535577d883'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:10.819829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e06291a8-a4d6-407f-a2ee-f12512c7710e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a9aaba6da62462bb844aa535577d883'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:10.851180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e06291a8-a4d6-407f-a2ee-f12512c7710e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a9aaba6da62462bb844aa535577d883'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:10.869691 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3361/6718] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:10 2022] DELETE /identity/v3/users/6a9aaba6da62462bb844aa535577d883 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:11.504329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e172fd-c49f-4b67-b31d-c3d283303b4c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:11.505833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-80e172fd-c49f-4b67-b31d-c3d283303b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:11.538607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e172fd-c49f-4b67-b31d-c3d283303b4c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:11.640167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc5193-67e1-43d9-a604-d21f18d68d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:11.641080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc5193-67e1-43d9-a604-d21f18d68d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:11.641545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc5193-67e1-43d9-a604-d21f18d68d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:11.641977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc5193-67e1-43d9-a604-d21f18d68d8c admin admin] PATH_INFO: `/v3/projects/ce5b9e16950343f29d0e95f7baa2ae47` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:11.643664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc5193-67e1-43d9-a604-d21f18d68d8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5b9e16950343f29d0e95f7baa2ae47)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:11.646071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc5193-67e1-43d9-a604-d21f18d68d8c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:11.793702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06291a8-a4d6-407f-a2ee-f12512c7710e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:11.795227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e06291a8-a4d6-407f-a2ee-f12512c7710e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:11.795831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1dcc5193-67e1-43d9-a604-d21f18d68d8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5b9e16950343f29d0e95f7baa2ae47', 'request_id': 'req-1dcc5193-67e1-43d9-a604-d21f18d68d8c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:11.812008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1dcc5193-67e1-43d9-a604-d21f18d68d8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5b9e16950343f29d0e95f7baa2ae47', 'request_id': 'req-1dcc5193-67e1-43d9-a604-d21f18d68d8c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:11.819387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1dcc5193-67e1-43d9-a604-d21f18d68d8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5b9e16950343f29d0e95f7baa2ae47', 'request_id': 'req-1dcc5193-67e1-43d9-a604-d21f18d68d8c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:11.839540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06291a8-a4d6-407f-a2ee-f12512c7710e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:11.844555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1dcc5193-67e1-43d9-a604-d21f18d68d8c admin admin] The token cache is being invalidate because project ce5b9e16950343f29d0e95f7baa2ae47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:11.845081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1dcc5193-67e1-43d9-a604-d21f18d68d8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:11.846147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1dcc5193-67e1-43d9-a604-d21f18d68d8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:11.849072 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3358/6719] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:11 2022] DELETE /identity/v3/projects/ce5b9e16950343f29d0e95f7baa2ae47 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:11.853666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be801b3-88eb-43b3-a715-df4cc798535e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:11.854108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be801b3-88eb-43b3-a715-df4cc798535e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:11.854566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be801b3-88eb-43b3-a715-df4cc798535e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:11.869797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:11.888159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:11.900594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1be801b3-88eb-43b3-a715-df4cc798535e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:11.918178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1be801b3-88eb-43b3-a715-df4cc798535e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:12.055585 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3359/6720] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:50:12.064362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0977509-9207-48a1-9682-049d91f32d77 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:12.068718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0977509-9207-48a1-9682-049d91f32d77 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:12.069166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0977509-9207-48a1-9682-049d91f32d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:12.074366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b92da-4321-483e-9f9e-8a08ade39555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:12.075164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b92da-4321-483e-9f9e-8a08ade39555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:12.076967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b92da-4321-483e-9f9e-8a08ade39555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:12.077352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b92da-4321-483e-9f9e-8a08ade39555 admin admin] PATH_INFO: `/v3/users/43b0cf7ad1894607a4f21c3820686475` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:12.080537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b92da-4321-483e-9f9e-8a08ade39555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43b0cf7ad1894607a4f21c3820686475)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:12.083043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b92da-4321-483e-9f9e-8a08ade39555 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:12.167978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b0977509-9207-48a1-9682-049d91f32d77 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:12.170766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b0977509-9207-48a1-9682-049d91f32d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:12.177911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0a2b92da-4321-483e-9f9e-8a08ade39555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43b0cf7ad1894607a4f21c3820686475'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:12.177911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0a2b92da-4321-483e-9f9e-8a08ade39555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43b0cf7ad1894607a4f21c3820686475'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:12.188581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0a2b92da-4321-483e-9f9e-8a08ade39555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43b0cf7ad1894607a4f21c3820686475'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:12.192477 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3360/6721] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:12.194816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0977509-9207-48a1-9682-049d91f32d77 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:12.203717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0a2b92da-4321-483e-9f9e-8a08ade39555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43b0cf7ad1894607a4f21c3820686475'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:12.208425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0977509-9207-48a1-9682-049d91f32d77 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:12.216360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf2739-d613-42b5-b42b-d5ec7343d1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:12.217726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf2739-d613-42b5-b42b-d5ec7343d1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:12.217726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf2739-d613-42b5-b42b-d5ec7343d1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:12.217726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf2739-d613-42b5-b42b-d5ec7343d1d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:12.219580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf2739-d613-42b5-b42b-d5ec7343d1d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:12.219876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf2739-d613-42b5-b42b-d5ec7343d1d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:12.221763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf2739-d613-42b5-b42b-d5ec7343d1d1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:12.222778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0a2b92da-4321-483e-9f9e-8a08ade39555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43b0cf7ad1894607a4f21c3820686475'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:12.243334 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3362/6722] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:11 2022] DELETE /identity/v3/users/43b0cf7ad1894607a4f21c3820686475 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:12.249153 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3361/6723] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:12.251873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf2739-d613-42b5-b42b-d5ec7343d1d1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:12.253186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caa990-fd21-4aeb-b236-78b731eb273a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:12.254728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caa990-fd21-4aeb-b236-78b731eb273a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:12.255217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caa990-fd21-4aeb-b236-78b731eb273a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:12.279459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf2739-d613-42b5-b42b-d5ec7343d1d1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:12.305137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d1caa990-fd21-4aeb-b236-78b731eb273a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:12.307394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d1caa990-fd21-4aeb-b236-78b731eb273a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:12.396150 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3363/6724] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:12.408429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1caa990-fd21-4aeb-b236-78b731eb273a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:12.411051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d1caa990-fd21-4aeb-b236-78b731eb273a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:12.422589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9282e1b-2980-4ef5-9e03-a6743db4f4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:12.424076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9282e1b-2980-4ef5-9e03-a6743db4f4ba admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:12.424359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9282e1b-2980-4ef5-9e03-a6743db4f4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:12.424640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9282e1b-2980-4ef5-9e03-a6743db4f4ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:12.426954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9282e1b-2980-4ef5-9e03-a6743db4f4ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:12.429354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9282e1b-2980-4ef5-9e03-a6743db4f4ba admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:12.469546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:12.506740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1caa990-fd21-4aeb-b236-78b731eb273a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:12.513801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121bf83-cd84-42f6-921c-58461d0d9dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:12.515040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121bf83-cd84-42f6-921c-58461d0d9dad service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:12.515440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121bf83-cd84-42f6-921c-58461d0d9dad service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:12.516304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121bf83-cd84-42f6-921c-58461d0d9dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:12.520954 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3362/6725] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:12 2022] POST /identity/v3/projects => generated 397 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:12.523999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9282e1b-2980-4ef5-9e03-a6743db4f4ba admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:12.538135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121bf83-cd84-42f6-921c-58461d0d9dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:12.540743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121bf83-cd84-42f6-921c-58461d0d9dad service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:12.571645 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3364/6726] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:12.668453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9282e1b-2980-4ef5-9e03-a6743db4f4ba admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:12.675674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1aa9a-19af-4e4e-8957-c49119374c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:12.676484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1aa9a-19af-4e4e-8957-c49119374c13 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:12.676746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1aa9a-19af-4e4e-8957-c49119374c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:12.677072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1aa9a-19af-4e4e-8957-c49119374c13 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:12.677736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1aa9a-19af-4e4e-8957-c49119374c13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:12.679772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1aa9a-19af-4e4e-8957-c49119374c13 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:12.718856 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3363/6727] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:12 2022] POST /identity/v3/users => generated 299 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:50:12.723057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121bf83-cd84-42f6-921c-58461d0d9dad service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:12.733609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121bf83-cd84-42f6-921c-58461d0d9dad service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:12.746114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94978e9f-fdb6-4646-bdb6-990be71986dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:12.747537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94978e9f-fdb6-4646-bdb6-990be71986dd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:12.748677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94978e9f-fdb6-4646-bdb6-990be71986dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:12.749277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94978e9f-fdb6-4646-bdb6-990be71986dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:12.750755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94978e9f-fdb6-4646-bdb6-990be71986dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:12.753404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94978e9f-fdb6-4646-bdb6-990be71986dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:12.779147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1aa9a-19af-4e4e-8957-c49119374c13 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:12.782456 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3365/6728] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:12.785024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:12.793461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1aa9a-19af-4e4e-8957-c49119374c13 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:12.806722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0eba36-f664-4f97-82fc-bc09bb3e9647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:12.807184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0eba36-f664-4f97-82fc-bc09bb3e9647 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:12.807601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0eba36-f664-4f97-82fc-bc09bb3e9647 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:12.808018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0eba36-f664-4f97-82fc-bc09bb3e9647 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:12.808678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0eba36-f664-4f97-82fc-bc09bb3e9647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:12.810300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0eba36-f664-4f97-82fc-bc09bb3e9647 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:12.857270 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3364/6729] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:50:12.862390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94978e9f-fdb6-4646-bdb6-990be71986dd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:12.874396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94978e9f-fdb6-4646-bdb6-990be71986dd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:12.880769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ef2d1-04b4-46a6-89f7-f960e7f92ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:12.881884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ef2d1-04b4-46a6-89f7-f960e7f92ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:12.882013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ef2d1-04b4-46a6-89f7-f960e7f92ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:12.882289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ef2d1-04b4-46a6-89f7-f960e7f92ac3 admin admin] PATH_INFO: `/v3/projects/b159d7a70a2b4cf4be568d5f6db17879/users/f8f3154813cd4cd18cf65d5298ae58e4/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:12.901239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0eba36-f664-4f97-82fc-bc09bb3e9647 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:12.903147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ef2d1-04b4-46a6-89f7-f960e7f92ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b159d7a70a2b4cf4be568d5f6db17879, user_id=f8f3154813cd4cd18cf65d5298ae58e4, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:12.903688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7c0eba36-f664-4f97-82fc-bc09bb3e9647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:12.906389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ef2d1-04b4-46a6-89f7-f960e7f92ac3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:12.929824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0eba36-f664-4f97-82fc-bc09bb3e9647 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:12.939196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6b650-9a69-437b-a934-b49e446039e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:12.941334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6b650-9a69-437b-a934-b49e446039e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:12.941876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6b650-9a69-437b-a934-b49e446039e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:12.942557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6b650-9a69-437b-a934-b49e446039e2 admin admin] PATH_INFO: `/v3/projects/d08cac93dfb544cea80c2fb9a768ccc6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:12.947487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6b650-9a69-437b-a934-b49e446039e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d08cac93dfb544cea80c2fb9a768ccc6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:12.950798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6b650-9a69-437b-a934-b49e446039e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:12.965520 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3366/6730] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:12 2022] PUT /identity/v3/projects/b159d7a70a2b4cf4be568d5f6db17879/users/f8f3154813cd4cd18cf65d5298ae58e4/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:12.969505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfba9db-6114-40b2-9e4b-7c82149da019 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:12.969904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfba9db-6114-40b2-9e4b-7c82149da019 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:12.970299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfba9db-6114-40b2-9e4b-7c82149da019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:13.080896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bbfba9db-6114-40b2-9e4b-7c82149da019 None None] MFA Rules not processed for user `f8f3154813cd4cd18cf65d5298ae58e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:13.082396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bbfba9db-6114-40b2-9e4b-7c82149da019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:13.117261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a7f6b650-9a69-437b-a934-b49e446039e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd08cac93dfb544cea80c2fb9a768ccc6', 'request_id': 'req-a7f6b650-9a69-437b-a934-b49e446039e2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:13.136515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a7f6b650-9a69-437b-a934-b49e446039e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd08cac93dfb544cea80c2fb9a768ccc6', 'request_id': 'req-a7f6b650-9a69-437b-a934-b49e446039e2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:13.151947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a7f6b650-9a69-437b-a934-b49e446039e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd08cac93dfb544cea80c2fb9a768ccc6', 'request_id': 'req-a7f6b650-9a69-437b-a934-b49e446039e2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:13.183809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a7f6b650-9a69-437b-a934-b49e446039e2 admin admin] The token cache is being invalidate because project d08cac93dfb544cea80c2fb9a768ccc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:13.184150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a7f6b650-9a69-437b-a934-b49e446039e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:13.184788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a7f6b650-9a69-437b-a934-b49e446039e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:13.186528 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3365/6731] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:12 2022] DELETE /identity/v3/projects/d08cac93dfb544cea80c2fb9a768ccc6 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:50:13.205363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75b949-d432-46aa-b8fa-1a9f2e02c82f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:13.205363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75b949-d432-46aa-b8fa-1a9f2e02c82f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:13.205363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75b949-d432-46aa-b8fa-1a9f2e02c82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:13.232095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0d75b949-d432-46aa-b8fa-1a9f2e02c82f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:13.233640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0d75b949-d432-46aa-b8fa-1a9f2e02c82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:13.325241 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3366/6732] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:13.337716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2822f9-9e7e-4771-9cc9-80f6af6c3519 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:13.339456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2822f9-9e7e-4771-9cc9-80f6af6c3519 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:13.339748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2822f9-9e7e-4771-9cc9-80f6af6c3519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:13.360166 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3367/6733] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:13.362371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfba9db-6114-40b2-9e4b-7c82149da019 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:13.367515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bbfba9db-6114-40b2-9e4b-7c82149da019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:13.394927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fc2822f9-9e7e-4771-9cc9-80f6af6c3519 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:13.398372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fc2822f9-9e7e-4771-9cc9-80f6af6c3519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:13.400238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfba9db-6114-40b2-9e4b-7c82149da019 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:13.416598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0763954-79a4-4e71-819e-4bc83cf9ef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:13.418016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0763954-79a4-4e71-819e-4bc83cf9ef14 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:13.419010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0763954-79a4-4e71-819e-4bc83cf9ef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:13.419407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0763954-79a4-4e71-819e-4bc83cf9ef14 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:13.420753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0763954-79a4-4e71-819e-4bc83cf9ef14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:13.423684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0763954-79a4-4e71-819e-4bc83cf9ef14 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:13.424136 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3367/6734] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:13.425725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2822f9-9e7e-4771-9cc9-80f6af6c3519 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:13.454345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2822f9-9e7e-4771-9cc9-80f6af6c3519 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:13.483126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329910e-1441-4df5-a397-e040b601fffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:13.483126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329910e-1441-4df5-a397-e040b601fffc admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:13.483126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329910e-1441-4df5-a397-e040b601fffc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:13.483126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329910e-1441-4df5-a397-e040b601fffc admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:13.483625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329910e-1441-4df5-a397-e040b601fffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:13.483625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329910e-1441-4df5-a397-e040b601fffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:13.483625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329910e-1441-4df5-a397-e040b601fffc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:13.510979 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3368/6735] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:13 2022] POST /identity/v3/projects => generated 395 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:13.517494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0763954-79a4-4e71-819e-4bc83cf9ef14 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:13.522158 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3368/6736] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:13.530784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329910e-1441-4df5-a397-e040b601fffc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:13.593302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329910e-1441-4df5-a397-e040b601fffc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:13.663727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0763954-79a4-4e71-819e-4bc83cf9ef14 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:13.687595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba68654-629d-40c3-a01b-8ff8ee10765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:13.688877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba68654-629d-40c3-a01b-8ff8ee10765e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:13.689158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba68654-629d-40c3-a01b-8ff8ee10765e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:13.689430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba68654-629d-40c3-a01b-8ff8ee10765e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:13.690073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba68654-629d-40c3-a01b-8ff8ee10765e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:13.693066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba68654-629d-40c3-a01b-8ff8ee10765e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:13.706541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:13.710172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:13.725455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ebf83-2842-4cec-bc5c-531984835408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:13.726955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ebf83-2842-4cec-bc5c-531984835408 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:13.730419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ebf83-2842-4cec-bc5c-531984835408 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:13.731748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ebf83-2842-4cec-bc5c-531984835408 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:13.732672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ebf83-2842-4cec-bc5c-531984835408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:13.736550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ebf83-2842-4cec-bc5c-531984835408 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:13.744990 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3369/6737] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:13 2022] POST /identity/v3/users => generated 304 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:13.748503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba68654-629d-40c3-a01b-8ff8ee10765e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:13.774049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba68654-629d-40c3-a01b-8ff8ee10765e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:13.782112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26e286-4cf5-4831-938c-cc479a59fd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:13.782962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26e286-4cf5-4831-938c-cc479a59fd29 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:13.783378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26e286-4cf5-4831-938c-cc479a59fd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:13.783908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26e286-4cf5-4831-938c-cc479a59fd29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:13.784813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26e286-4cf5-4831-938c-cc479a59fd29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:13.788997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26e286-4cf5-4831-938c-cc479a59fd29 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:13.796805 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3369/6738] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:13 2022] POST /identity/v3/projects => generated 375 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:13.803823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ebf83-2842-4cec-bc5c-531984835408 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:13.819094 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3370/6739] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:13.823318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26e286-4cf5-4831-938c-cc479a59fd29 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:13.836309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26e286-4cf5-4831-938c-cc479a59fd29 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:13.922603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ebf83-2842-4cec-bc5c-531984835408 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:13.924814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71398fa5-c204-4b77-a527-dc7fe93f1a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:13.926074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71398fa5-c204-4b77-a527-dc7fe93f1a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:13.926413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71398fa5-c204-4b77-a527-dc7fe93f1a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:13.926658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71398fa5-c204-4b77-a527-dc7fe93f1a96 admin admin] PATH_INFO: `/v3/projects/2383352b16bd4da8ba7271b166d0b44c/users/4fdae8d47ac3428cb2b9369b322fb2b1/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:13.928381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd9140-9909-42e4-b586-2d06e09e9186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:13.929129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd9140-9909-42e4-b586-2d06e09e9186 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:13.929560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd9140-9909-42e4-b586-2d06e09e9186 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:13.929845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd9140-9909-42e4-b586-2d06e09e9186 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:13.930630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd9140-9909-42e4-b586-2d06e09e9186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:13.932623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd9140-9909-42e4-b586-2d06e09e9186 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:13.944137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71398fa5-c204-4b77-a527-dc7fe93f1a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2383352b16bd4da8ba7271b166d0b44c, user_id=4fdae8d47ac3428cb2b9369b322fb2b1, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:13.949301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71398fa5-c204-4b77-a527-dc7fe93f1a96 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:13.994965 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3371/6740] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:13 2022] PUT /identity/v3/projects/2383352b16bd4da8ba7271b166d0b44c/users/4fdae8d47ac3428cb2b9369b322fb2b1/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:50:13.998324 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3370/6741] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:13 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:13.999343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd9140-9909-42e4-b586-2d06e09e9186 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:13.999483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71398fa5-c204-4b77-a527-dc7fe93f1a96 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:14.018970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd9140-9909-42e4-b586-2d06e09e9186 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:14.134792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71398fa5-c204-4b77-a527-dc7fe93f1a96 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:14.140314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf7939-b75f-4328-a7ac-883350dce071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:14.140928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf7939-b75f-4328-a7ac-883350dce071 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:14.141109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf7939-b75f-4328-a7ac-883350dce071 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:14.141375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf7939-b75f-4328-a7ac-883350dce071 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:14.142023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf7939-b75f-4328-a7ac-883350dce071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:14.143987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf7939-b75f-4328-a7ac-883350dce071 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:14.167887 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3372/6742] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:14.171548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf7939-b75f-4328-a7ac-883350dce071 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:14.188479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcc948-9891-4d12-a0fd-482080265350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:14.189184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcc948-9891-4d12-a0fd-482080265350 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:14.189543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcc948-9891-4d12-a0fd-482080265350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:14.189893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcc948-9891-4d12-a0fd-482080265350 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:14.191088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcc948-9891-4d12-a0fd-482080265350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:14.193649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcc948-9891-4d12-a0fd-482080265350 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:14.202414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf7939-b75f-4328-a7ac-883350dce071 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:14.209514 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3371/6743] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:14.211648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcc948-9891-4d12-a0fd-482080265350 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:14.213319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22e7ba-e9ff-4292-a027-170aed9c79a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:14.215107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22e7ba-e9ff-4292-a027-170aed9c79a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:14.216910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22e7ba-e9ff-4292-a027-170aed9c79a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:14.217530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22e7ba-e9ff-4292-a027-170aed9c79a6 admin admin] PATH_INFO: `/v3/projects/2383352b16bd4da8ba7271b166d0b44c/users/4fdae8d47ac3428cb2b9369b322fb2b1/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:14.220662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22e7ba-e9ff-4292-a027-170aed9c79a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2383352b16bd4da8ba7271b166d0b44c, user_id=4fdae8d47ac3428cb2b9369b322fb2b1, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:14.225019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22e7ba-e9ff-4292-a027-170aed9c79a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:14.241265 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3373/6744] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:14 2022] PUT /identity/v3/projects/2383352b16bd4da8ba7271b166d0b44c/users/4fdae8d47ac3428cb2b9369b322fb2b1/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:14.248086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcc948-9891-4d12-a0fd-482080265350 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:14.251691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dbb41-76e7-4d37-a9b5-287975087c08 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:14.252272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dbb41-76e7-4d37-a9b5-287975087c08 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:14.253329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dbb41-76e7-4d37-a9b5-287975087c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:14.327295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-632dbb41-76e7-4d37-a9b5-287975087c08 None None] MFA Rules not processed for user `4fdae8d47ac3428cb2b9369b322fb2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:14.333315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-632dbb41-76e7-4d37-a9b5-287975087c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:14.349098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5515b26-e935-4563-b658-f741bc68a0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:14.350190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5515b26-e935-4563-b658-f741bc68a0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:14.350706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5515b26-e935-4563-b658-f741bc68a0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:14.367510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5515b26-e935-4563-b658-f741bc68a0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:14.368475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5515b26-e935-4563-b658-f741bc68a0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:14.371125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5515b26-e935-4563-b658-f741bc68a0b2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:14.403416 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3372/6745] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:14.407700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5515b26-e935-4563-b658-f741bc68a0b2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:14.424535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:14.426680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:14.441151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5515b26-e935-4563-b658-f741bc68a0b2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:14.451912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51849ca7-70f1-4dc6-9176-db44a96f5e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:14.452601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51849ca7-70f1-4dc6-9176-db44a96f5e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:14.453064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51849ca7-70f1-4dc6-9176-db44a96f5e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:14.453437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51849ca7-70f1-4dc6-9176-db44a96f5e25 admin admin] PATH_INFO: `/v3/projects/e32eda8a9b784f78abd6b89cb6ebbb1b/users/191dc18665b846d8a5da8314fd7b11bb/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:14.484322 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3374/6746] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:14 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:14.487982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51849ca7-70f1-4dc6-9176-db44a96f5e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32eda8a9b784f78abd6b89cb6ebbb1b, user_id=191dc18665b846d8a5da8314fd7b11bb, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:14.491124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51849ca7-70f1-4dc6-9176-db44a96f5e25 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:14.492261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dbb41-76e7-4d37-a9b5-287975087c08 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:14.557956 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3373/6747] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:14 2022] PUT /identity/v3/projects/e32eda8a9b784f78abd6b89cb6ebbb1b/users/191dc18665b846d8a5da8314fd7b11bb/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:14.573286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e124a9-fe17-4056-a153-55b38cfa2cd1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:14.573286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e124a9-fe17-4056-a153-55b38cfa2cd1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:14.573576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e124a9-fe17-4056-a153-55b38cfa2cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:14.650933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-83e124a9-fe17-4056-a153-55b38cfa2cd1 None None] MFA Rules not processed for user `191dc18665b846d8a5da8314fd7b11bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:14.652331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-83e124a9-fe17-4056-a153-55b38cfa2cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:14.675365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dbb41-76e7-4d37-a9b5-287975087c08 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:14.794257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec38d74-a4fe-4ee3-8ced-631e7405aa61 tempest-ProjectsNegativeStaticTestJSON-1737067350 tempest-ProjectsNegativeStaticTestJSON-1737067350-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f3154813cd4cd18cf65d5298ae58e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b159d7a70a2b4cf4be568d5f6db17879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:14.795539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec38d74-a4fe-4ee3-8ced-631e7405aa61 tempest-ProjectsNegativeStaticTestJSON-1737067350 tempest-ProjectsNegativeStaticTestJSON-1737067350-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:14.796254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec38d74-a4fe-4ee3-8ced-631e7405aa61 tempest-ProjectsNegativeStaticTestJSON-1737067350 tempest-ProjectsNegativeStaticTestJSON-1737067350-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:14.796716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec38d74-a4fe-4ee3-8ced-631e7405aa61 tempest-ProjectsNegativeStaticTestJSON-1737067350 tempest-ProjectsNegativeStaticTestJSON-1737067350-project] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:14.797770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec38d74-a4fe-4ee3-8ced-631e7405aa61 tempest-ProjectsNegativeStaticTestJSON-1737067350 tempest-ProjectsNegativeStaticTestJSON-1737067350-project] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:14.806087 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3374/6748] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:14.814991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e124a9-fe17-4056-a153-55b38cfa2cd1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:14.817098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-83e124a9-fe17-4056-a153-55b38cfa2cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:14.820379 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3ec38d74-a4fe-4ee3-8ced-631e7405aa61 tempest-ProjectsNegativeStaticTestJSON-1737067350 tempest-ProjectsNegativeStaticTestJSON-1737067350-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 28 18:50:14.820379 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:14.820379 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:14.820379 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:14.820379 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:14.820379 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:14.820379 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:14.820379 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:14.820379 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:14.820379 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:14.820379 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:14.820379 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:14.820379 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Aug 28 18:50:14.820379 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 28 18:50:14.821507 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 28 18:50:14.821507 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 28 18:50:14.821507 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 28 18:50:14.821507 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 28 18:50:14.821507 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 28 18:50:14.821507 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 28 18:50:14.821507 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 28 18:50:14.821507 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:14.827969 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3375/6749] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:50:14 2022] POST /identity/v3/projects => generated 136 bytes in 331 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:50:14.834459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec38d74-a4fe-4ee3-8ced-631e7405aa61 tempest-ProjectsNegativeStaticTestJSON-1737067350 tempest-ProjectsNegativeStaticTestJSON-1737067350-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:14.926695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec38d74-a4fe-4ee3-8ced-631e7405aa61 tempest-ProjectsNegativeStaticTestJSON-1737067350 tempest-ProjectsNegativeStaticTestJSON-1737067350-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:14.933579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8e299-c475-45c0-9d55-41ad53e4948e tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdae8d47ac3428cb2b9369b322fb2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2383352b16bd4da8ba7271b166d0b44c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:14.934519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8e299-c475-45c0-9d55-41ad53e4948e tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:14.935111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8e299-c475-45c0-9d55-41ad53e4948e tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:14.935501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8e299-c475-45c0-9d55-41ad53e4948e tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:14.936796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8e299-c475-45c0-9d55-41ad53e4948e tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:14.952512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8e299-c475-45c0-9d55-41ad53e4948e tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-66b8e299-c475-45c0-9d55-41ad53e4948e tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Invalid input for field 'name': '' is too short Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: Failed validating 'minLength' in schema['properties']['name']: Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: On instance['name']: Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: Failed validating 'minLength' in schema['properties']['name']: Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: On instance['name']: Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: '' Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise error Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['name']: Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application '' Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:14.964769 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:50:14.975878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:14.975878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:14.975878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:14.975878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:14.975878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:14.975878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:14.975878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:14.975878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:14.975878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:14.975878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:14.975878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:14.975878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:14.975878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 28 18:50:14.975878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 28 18:50:14.975878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 18:50:14.975878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 18:50:14.975878 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 18:50:14.977106 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 18:50:14.977106 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 28 18:50:14.977106 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:14.977106 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 28 18:50:14.977106 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 18:50:14.977106 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:14.977106 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['name']: Aug 28 18:50:14.977106 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application '' Aug 28 18:50:14.977106 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:14.977106 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3376/6750] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:50:14 2022] POST /identity/v3/projects => generated 283 bytes in 122 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 18:50:14.977106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8e299-c475-45c0-9d55-41ad53e4948e tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:15.010703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8e299-c475-45c0-9d55-41ad53e4948e tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:15.022982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b6a94-d91a-47cb-b1c7-e91b9232b9b0 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdae8d47ac3428cb2b9369b322fb2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2383352b16bd4da8ba7271b166d0b44c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:15.024837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b6a94-d91a-47cb-b1c7-e91b9232b9b0 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:15.025912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b6a94-d91a-47cb-b1c7-e91b9232b9b0 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:15.026289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b6a94-d91a-47cb-b1c7-e91b9232b9b0 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:15.027486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e124a9-fe17-4056-a153-55b38cfa2cd1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:15.028226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b6a94-d91a-47cb-b1c7-e91b9232b9b0 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:15.033182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b6a94-d91a-47cb-b1c7-e91b9232b9b0 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:15.034352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879a49a-3132-483d-a6a6-c2266f68a0f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:15.037001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879a49a-3132-483d-a6a6-c2266f68a0f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:15.037296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879a49a-3132-483d-a6a6-c2266f68a0f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:15.037575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879a49a-3132-483d-a6a6-c2266f68a0f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-c32b6a94-d91a-47cb-b1c7-e91b9232b9b0 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: Failed validating 'maxLength' in schema['properties']['name']: Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: On instance['name']: Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: Failed validating 'maxLength' in schema['properties']['name']: Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: On instance['name']: Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise error Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 28 18:50:15.055069 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['name']: Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:15.056307 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 28 18:50:15.061429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 28 18:50:15.061429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 18:50:15.061429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 18:50:15.061429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 18:50:15.061429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 18:50:15.061429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 18:50:15.061429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:15.061429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 28 18:50:15.061429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 18:50:15.061429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:15.061429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['name']: Aug 28 18:50:15.061429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 18:50:15.061429 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:15.061429 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3377/6751] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:50:14 2022] POST /identity/v3/projects => generated 412 bytes in 95 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 28 18:50:15.062261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b6a94-d91a-47cb-b1c7-e91b9232b9b0 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:15.066420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879a49a-3132-483d-a6a6-c2266f68a0f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:15.069313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879a49a-3132-483d-a6a6-c2266f68a0f4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:15.085853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b6a94-d91a-47cb-b1c7-e91b9232b9b0 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:15.090941 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3375/6752] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:50:15.116395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b4690-b381-40f5-b9be-3afdd021a47a tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdae8d47ac3428cb2b9369b322fb2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2383352b16bd4da8ba7271b166d0b44c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:15.119162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b4690-b381-40f5-b9be-3afdd021a47a tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:15.121207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b4690-b381-40f5-b9be-3afdd021a47a tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:15.121567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b4690-b381-40f5-b9be-3afdd021a47a tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] PATH_INFO: `/v3/projects/8a9fb7e9b52b4a80a81507408d502e1d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:15.146544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b4690-b381-40f5-b9be-3afdd021a47a tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8a9fb7e9b52b4a80a81507408d502e1d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:15.150559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b4690-b381-40f5-b9be-3afdd021a47a tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:15.215680 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-428b4690-b381-40f5-b9be-3afdd021a47a tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Could not find project: 8a9fb7e9b52b4a80a81507408d502e1d.: keystone.exception.ProjectNotFound: Could not find project: 8a9fb7e9b52b4a80a81507408d502e1d. Aug 28 18:50:15.215680 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:15.215680 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:15.215680 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:15.215680 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:15.215680 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:15.215680 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:15.215680 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:15.215680 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:15.215680 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:15.215680 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:15.215680 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:15.215680 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 28 18:50:15.215680 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 28 18:50:15.216826 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:50:15.216826 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:50:15.216826 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 28 18:50:15.216826 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 28 18:50:15.216826 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:50:15.216826 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:50:15.216826 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:50:15.216826 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:50:15.216826 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8a9fb7e9b52b4a80a81507408d502e1d. Aug 28 18:50:15.216826 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:15.219823 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3378/6753] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:15 2022] DELETE /identity/v3/projects/8a9fb7e9b52b4a80a81507408d502e1d => generated 113 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:50:15.227055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879a49a-3132-483d-a6a6-c2266f68a0f4 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:15.248953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879a49a-3132-483d-a6a6-c2266f68a0f4 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:15.264390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5fc7-566b-495f-b3c1-6ff17111e068 tempest-ProjectsNegativeStaticTestJSON-1737067350 tempest-ProjectsNegativeStaticTestJSON-1737067350-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f3154813cd4cd18cf65d5298ae58e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b159d7a70a2b4cf4be568d5f6db17879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:15.265293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5fc7-566b-495f-b3c1-6ff17111e068 tempest-ProjectsNegativeStaticTestJSON-1737067350 tempest-ProjectsNegativeStaticTestJSON-1737067350-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:15.266410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5fc7-566b-495f-b3c1-6ff17111e068 tempest-ProjectsNegativeStaticTestJSON-1737067350 tempest-ProjectsNegativeStaticTestJSON-1737067350-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:15.267194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5fc7-566b-495f-b3c1-6ff17111e068 tempest-ProjectsNegativeStaticTestJSON-1737067350 tempest-ProjectsNegativeStaticTestJSON-1737067350-project] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:15.270317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d5fc7-566b-495f-b3c1-6ff17111e068 tempest-ProjectsNegativeStaticTestJSON-1737067350 tempest-ProjectsNegativeStaticTestJSON-1737067350-project] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:15.292362 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-fd1d5fc7-566b-495f-b3c1-6ff17111e068 tempest-ProjectsNegativeStaticTestJSON-1737067350 tempest-ProjectsNegativeStaticTestJSON-1737067350-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 28 18:50:15.292362 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:15.292362 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:15.292362 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:15.292362 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:15.292362 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:15.292362 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:15.292362 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:15.292362 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:15.292362 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:15.292362 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:15.292362 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:15.292362 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Aug 28 18:50:15.292362 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._list_projects() Aug 28 18:50:15.293476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Aug 28 18:50:15.293476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Aug 28 18:50:15.293476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 28 18:50:15.293476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 28 18:50:15.293476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 28 18:50:15.293476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 28 18:50:15.293476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 28 18:50:15.293476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 28 18:50:15.293476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 28 18:50:15.293476 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:50:15.299810 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3376/6754] 10.222.0.27 () {58 vars in 1131 bytes} [Sun Aug 28 18:50:15 2022] GET /identity/v3/projects => generated 135 bytes in 72 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:50:15.302292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b4690-b381-40f5-b9be-3afdd021a47a tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:15.316228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b4690-b381-40f5-b9be-3afdd021a47a tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:15.321870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e282a-cda6-4254-8ba0-940861c83c32 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdae8d47ac3428cb2b9369b322fb2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2383352b16bd4da8ba7271b166d0b44c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:15.322574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e282a-cda6-4254-8ba0-940861c83c32 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:15.322920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e282a-cda6-4254-8ba0-940861c83c32 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:15.323687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e282a-cda6-4254-8ba0-940861c83c32 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:15.324389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e282a-cda6-4254-8ba0-940861c83c32 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:15.326316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e282a-cda6-4254-8ba0-940861c83c32 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:15.359713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:15.379876 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3379/6755] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:15 2022] POST /identity/v3/projects => generated 358 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:15.384237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5fc7-566b-495f-b3c1-6ff17111e068 tempest-ProjectsNegativeStaticTestJSON-1737067350 tempest-ProjectsNegativeStaticTestJSON-1737067350-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:15.414275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5fc7-566b-495f-b3c1-6ff17111e068 tempest-ProjectsNegativeStaticTestJSON-1737067350 tempest-ProjectsNegativeStaticTestJSON-1737067350-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:15.565252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7aca2-e402-41d5-ae24-ada8eb1e94c5 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdae8d47ac3428cb2b9369b322fb2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2383352b16bd4da8ba7271b166d0b44c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:15.566045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7aca2-e402-41d5-ae24-ada8eb1e94c5 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:15.566460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7aca2-e402-41d5-ae24-ada8eb1e94c5 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:15.566752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7aca2-e402-41d5-ae24-ada8eb1e94c5 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:15.567803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7aca2-e402-41d5-ae24-ada8eb1e94c5 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:15.571393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7aca2-e402-41d5-ae24-ada8eb1e94c5 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:15.602517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:15.616668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.sql.core [None req-cef7aca2-e402-41d5-ae24-ada8eb1e94c5 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-976155598' for key 'project.ixu_project_name_domain_id'") Aug 28 18:50:15.616668 n-d-850468-20 devstack@keystone.service[82160]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 18:50:15.616668 n-d-850468-20 devstack@keystone.service[82160]: [parameters: {'id': '9cbf905a8a4e475a84b6835ff6ae69c1', 'name': 'tempest-project-dup-976155598', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 18:50:15.616668 n-d-850468-20 devstack@keystone.service[82160]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82160) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 18:50:15.626855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-cef7aca2-e402-41d5-ae24-ada8eb1e94c5 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-976155598, project id 9cbf905a8a4e475a84b6835ff6ae69c1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-976155598, project id 9cbf905a8a4e475a84b6835ff6ae69c1. Aug 28 18:50:15.626855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:15.626855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 18:50:15.626855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 18:50:15.626855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 18:50:15.626855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 18:50:15.626855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 18:50:15.626855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 18:50:15.626855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 18:50:15.626855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application conn.query(q) Aug 28 18:50:15.626855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 18:50:15.626855 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 18:50:15.627987 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 18:50:15.627987 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result.read() Aug 28 18:50:15.627987 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 18:50:15.627987 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 18:50:15.627987 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 18:50:15.627987 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 18:50:15.627987 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 18:50:15.627987 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 18:50:15.627987 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 18:50:15.627987 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 18:50:15.627987 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-976155598' for key 'project.ixu_project_name_domain_id'") Aug 28 18:50:15.627987 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:50:15.627987 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 18:50:15.627987 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:50:15.627987 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:15.627987 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 18:50:15.627987 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application yield resource Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise self.value Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 18:50:15.629309 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application session.commit() Aug 28 18:50:15.630600 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 18:50:15.630600 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 18:50:15.630600 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 18:50:15.630600 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 18:50:15.630600 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 18:50:15.630600 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.session.flush() Aug 28 18:50:15.630600 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 18:50:15.630600 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 18:50:15.630600 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 18:50:15.630600 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 18:50:15.630600 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 18:50:15.630600 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application compat.raise_( Aug 28 18:50:15.630600 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 18:50:15.630600 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception Aug 28 18:50:15.630600 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 18:50:15.630600 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 18:50:15.630600 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 18:50:15.632101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 18:50:15.632101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 18:50:15.632101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 18:50:15.632101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 18:50:15.632101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 18:50:15.632101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 18:50:15.632101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 18:50:15.632101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 18:50:15.632101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 18:50:15.632101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 18:50:15.632101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 18:50:15.632101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 18:50:15.632101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 18:50:15.632101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 18:50:15.632101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 18:50:15.632101 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 18:50:15.633227 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 18:50:15.633227 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 18:50:15.633227 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception Aug 28 18:50:15.633227 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 18:50:15.633227 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 18:50:15.633227 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 18:50:15.633227 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 18:50:15.633227 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 18:50:15.633227 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 18:50:15.633227 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 18:50:15.633227 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application conn.query(q) Aug 28 18:50:15.633227 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 18:50:15.633227 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 18:50:15.633227 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 18:50:15.633227 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result.read() Aug 28 18:50:15.633227 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 18:50:15.633227 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 18:50:15.634591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 18:50:15.634591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 18:50:15.634591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 18:50:15.634591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 18:50:15.634591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 18:50:15.634591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 18:50:15.634591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-976155598' for key 'project.ixu_project_name_domain_id'") Aug 28 18:50:15.634591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 18:50:15.634591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [parameters: {'id': '9cbf905a8a4e475a84b6835ff6ae69c1', 'name': 'tempest-project-dup-976155598', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 18:50:15.634591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 18:50:15.634591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:50:15.634591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:50:15.634591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:50:15.634591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:15.634591 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 28 18:50:15.637949 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 28 18:50:15.637949 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 18:50:15.637949 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 18:50:15.637949 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-976155598 at domain ID default. Aug 28 18:50:15.637949 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:50:15.637949 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:50:15.637949 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:50:15.637949 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:15.637949 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:15.637949 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:15.637949 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:15.637949 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:15.637949 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:15.637949 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:15.637949 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:15.637949 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:15.637949 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:15.639244 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:15.639244 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 28 18:50:15.639244 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 28 18:50:15.639244 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:50:15.639244 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:50:15.639244 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 28 18:50:15.639244 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 28 18:50:15.639244 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-976155598, project id 9cbf905a8a4e475a84b6835ff6ae69c1. Aug 28 18:50:15.639244 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:50:15.639244 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3377/6756] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:50:15 2022] POST /identity/v3/projects => generated 284 bytes in 253 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:50:15.640037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e282a-cda6-4254-8ba0-940861c83c32 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:15.661842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e282a-cda6-4254-8ba0-940861c83c32 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:15.688215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f1c04-b6fe-407b-a499-2333d4d06378 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdae8d47ac3428cb2b9369b322fb2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2383352b16bd4da8ba7271b166d0b44c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:15.695575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f1c04-b6fe-407b-a499-2333d4d06378 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:15.695967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f1c04-b6fe-407b-a499-2333d4d06378 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:15.696352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f1c04-b6fe-407b-a499-2333d4d06378 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] PATH_INFO: `/v3/projects/be1cc541586a45f197777ab718e8107d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:15.704144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f1c04-b6fe-407b-a499-2333d4d06378 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: Authorizing `identity:delete_project(project_id=be1cc541586a45f197777ab718e8107d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:15.707035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f1c04-b6fe-407b-a499-2333d4d06378 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:15.955159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c1f1c04-b6fe-407b-a499-2333d4d06378 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1cc541586a45f197777ab718e8107d', 'request_id': 'req-3c1f1c04-b6fe-407b-a499-2333d4d06378'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:15.982574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c1f1c04-b6fe-407b-a499-2333d4d06378 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1cc541586a45f197777ab718e8107d', 'request_id': 'req-3c1f1c04-b6fe-407b-a499-2333d4d06378'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:16.000102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c1f1c04-b6fe-407b-a499-2333d4d06378 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1cc541586a45f197777ab718e8107d', 'request_id': 'req-3c1f1c04-b6fe-407b-a499-2333d4d06378'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:16.025513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c1f1c04-b6fe-407b-a499-2333d4d06378 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] The token cache is being invalidate because project be1cc541586a45f197777ab718e8107d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:16.025888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c1f1c04-b6fe-407b-a499-2333d4d06378 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:16.027595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c1f1c04-b6fe-407b-a499-2333d4d06378 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:16.034845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7aca2-e402-41d5-ae24-ada8eb1e94c5 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:16.036288 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3380/6757] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:15 2022] DELETE /identity/v3/projects/be1cc541586a45f197777ab718e8107d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:16.037608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cef7aca2-e402-41d5-ae24-ada8eb1e94c5 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:16.052103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f1c04-b6fe-407b-a499-2333d4d06378 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:16.053879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3c1f1c04-b6fe-407b-a499-2333d4d06378 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:16.216206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7aca2-e402-41d5-ae24-ada8eb1e94c5 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:16.220922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f1c04-b6fe-407b-a499-2333d4d06378 tempest-ProjectsNegativeStaticTestJSON-431479564 tempest-ProjectsNegativeStaticTestJSON-431479564-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:16.241339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927935dc-c0c2-4108-a7f1-25da9d44b1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:16.242000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927935dc-c0c2-4108-a7f1-25da9d44b1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:16.242277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927935dc-c0c2-4108-a7f1-25da9d44b1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:16.242555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927935dc-c0c2-4108-a7f1-25da9d44b1eb admin admin] PATH_INFO: `/v3/users/f8f3154813cd4cd18cf65d5298ae58e4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:16.249456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e9272-7294-48c1-ad65-021673e7dfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:16.250122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e9272-7294-48c1-ad65-021673e7dfdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:16.250396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e9272-7294-48c1-ad65-021673e7dfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:16.250675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e9272-7294-48c1-ad65-021673e7dfdd admin admin] PATH_INFO: `/v3/users/191dc18665b846d8a5da8314fd7b11bb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:16.251678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927935dc-c0c2-4108-a7f1-25da9d44b1eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f3154813cd4cd18cf65d5298ae58e4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:16.255508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927935dc-c0c2-4108-a7f1-25da9d44b1eb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:16.257505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e9272-7294-48c1-ad65-021673e7dfdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=191dc18665b846d8a5da8314fd7b11bb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:16.259460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e9272-7294-48c1-ad65-021673e7dfdd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:16.364008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-927935dc-c0c2-4108-a7f1-25da9d44b1eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f3154813cd4cd18cf65d5298ae58e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:16.376996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f16e9272-7294-48c1-ad65-021673e7dfdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191dc18665b846d8a5da8314fd7b11bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:16.377785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f16e9272-7294-48c1-ad65-021673e7dfdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191dc18665b846d8a5da8314fd7b11bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:16.389345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-927935dc-c0c2-4108-a7f1-25da9d44b1eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f3154813cd4cd18cf65d5298ae58e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:16.391290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-927935dc-c0c2-4108-a7f1-25da9d44b1eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f3154813cd4cd18cf65d5298ae58e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:16.391984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-927935dc-c0c2-4108-a7f1-25da9d44b1eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f3154813cd4cd18cf65d5298ae58e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:16.394804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f16e9272-7294-48c1-ad65-021673e7dfdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191dc18665b846d8a5da8314fd7b11bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:16.414135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f16e9272-7294-48c1-ad65-021673e7dfdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191dc18665b846d8a5da8314fd7b11bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:16.423776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-927935dc-c0c2-4108-a7f1-25da9d44b1eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f3154813cd4cd18cf65d5298ae58e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:16.452777 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3378/6758] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:16 2022] DELETE /identity/v3/users/f8f3154813cd4cd18cf65d5298ae58e4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:16.456616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a1b73-e451-4304-9965-fb08b18655b4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:16.458852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a1b73-e451-4304-9965-fb08b18655b4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:16.459205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a1b73-e451-4304-9965-fb08b18655b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:16.460051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f16e9272-7294-48c1-ad65-021673e7dfdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191dc18665b846d8a5da8314fd7b11bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:16.489798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:16.490239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f84a1b73-e451-4304-9965-fb08b18655b4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:16.492135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f84a1b73-e451-4304-9965-fb08b18655b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:16.501350 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3381/6759] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:16 2022] DELETE /identity/v3/users/191dc18665b846d8a5da8314fd7b11bb => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:50:16.508169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5e8a8-49f7-46d1-ab87-3d79a328a06c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:16.508456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5e8a8-49f7-46d1-ab87-3d79a328a06c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:16.510850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5e8a8-49f7-46d1-ab87-3d79a328a06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:16.591803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d5d5e8a8-49f7-46d1-ab87-3d79a328a06c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:16.593687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5d5e8a8-49f7-46d1-ab87-3d79a328a06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:16.627342 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3379/6760] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:16.635680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a1b73-e451-4304-9965-fb08b18655b4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:16.638065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f84a1b73-e451-4304-9965-fb08b18655b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:16.681814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:16.707189 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3382/6761] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:16.718966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5e8a8-49f7-46d1-ab87-3d79a328a06c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:16.721113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5d5e8a8-49f7-46d1-ab87-3d79a328a06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:16.787622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a1b73-e451-4304-9965-fb08b18655b4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:16.889661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5e8a8-49f7-46d1-ab87-3d79a328a06c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:16.902111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12f4ac-7c65-42f8-8e07-56eaeeb91968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:16.903192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12f4ac-7c65-42f8-8e07-56eaeeb91968 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:16.903992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12f4ac-7c65-42f8-8e07-56eaeeb91968 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:16.904425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12f4ac-7c65-42f8-8e07-56eaeeb91968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:16.915640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00b012-21ea-4fb0-bb00-0e7bb9b8e19a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:16.916332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00b012-21ea-4fb0-bb00-0e7bb9b8e19a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:16.916620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00b012-21ea-4fb0-bb00-0e7bb9b8e19a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:16.916898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00b012-21ea-4fb0-bb00-0e7bb9b8e19a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:16.928214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12f4ac-7c65-42f8-8e07-56eaeeb91968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:16.932467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00b012-21ea-4fb0-bb00-0e7bb9b8e19a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:16.934691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12f4ac-7c65-42f8-8e07-56eaeeb91968 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:16.941409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00b012-21ea-4fb0-bb00-0e7bb9b8e19a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:16.982220 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3383/6762] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:17.016085 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3380/6763] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:17.717125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12f4ac-7c65-42f8-8e07-56eaeeb91968 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:17.718710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac12f4ac-7c65-42f8-8e07-56eaeeb91968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:17.742602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12f4ac-7c65-42f8-8e07-56eaeeb91968 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:17.754529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ae657-2e02-4690-a746-ad2c8cb909be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:17.757375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ae657-2e02-4690-a746-ad2c8cb909be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:17.757940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ae657-2e02-4690-a746-ad2c8cb909be admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:17.758277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ae657-2e02-4690-a746-ad2c8cb909be admin admin] PATH_INFO: `/v3/projects/b159d7a70a2b4cf4be568d5f6db17879` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:17.760889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ae657-2e02-4690-a746-ad2c8cb909be admin admin] RBAC: Authorizing `identity:delete_project(project_id=b159d7a70a2b4cf4be568d5f6db17879)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:17.766314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ae657-2e02-4690-a746-ad2c8cb909be admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:17.872076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef5ae657-2e02-4690-a746-ad2c8cb909be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b159d7a70a2b4cf4be568d5f6db17879', 'request_id': 'req-ef5ae657-2e02-4690-a746-ad2c8cb909be'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:17.889994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef5ae657-2e02-4690-a746-ad2c8cb909be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b159d7a70a2b4cf4be568d5f6db17879', 'request_id': 'req-ef5ae657-2e02-4690-a746-ad2c8cb909be'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:17.899921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef5ae657-2e02-4690-a746-ad2c8cb909be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b159d7a70a2b4cf4be568d5f6db17879', 'request_id': 'req-ef5ae657-2e02-4690-a746-ad2c8cb909be'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:17.927333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef5ae657-2e02-4690-a746-ad2c8cb909be admin admin] The token cache is being invalidate because project b159d7a70a2b4cf4be568d5f6db17879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:17.927633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef5ae657-2e02-4690-a746-ad2c8cb909be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:17.931806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef5ae657-2e02-4690-a746-ad2c8cb909be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:17.935147 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3384/6764] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:17 2022] DELETE /identity/v3/projects/b159d7a70a2b4cf4be568d5f6db17879 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:17.939195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00b012-21ea-4fb0-bb00-0e7bb9b8e19a service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:17.961736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00b012-21ea-4fb0-bb00-0e7bb9b8e19a service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:18.198990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ae657-2e02-4690-a746-ad2c8cb909be admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:18.200604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef5ae657-2e02-4690-a746-ad2c8cb909be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:18.250165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00dcd2-2bb4-47d5-b7e0-9fdaff5af4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:18.250834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00dcd2-2bb4-47d5-b7e0-9fdaff5af4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:18.251119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00dcd2-2bb4-47d5-b7e0-9fdaff5af4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:18.253774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00dcd2-2bb4-47d5-b7e0-9fdaff5af4ba admin admin] PATH_INFO: `/v3/users/4fdae8d47ac3428cb2b9369b322fb2b1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:18.257154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00dcd2-2bb4-47d5-b7e0-9fdaff5af4ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fdae8d47ac3428cb2b9369b322fb2b1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:18.259087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00dcd2-2bb4-47d5-b7e0-9fdaff5af4ba admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:18.279831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:18.406877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ae657-2e02-4690-a746-ad2c8cb909be admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:18.411056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed00dcd2-2bb4-47d5-b7e0-9fdaff5af4ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fdae8d47ac3428cb2b9369b322fb2b1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:18.420405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98bcc1-cc26-4359-a33e-141c071f380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:18.421222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98bcc1-cc26-4359-a33e-141c071f380d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:18.421619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98bcc1-cc26-4359-a33e-141c071f380d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:18.421996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98bcc1-cc26-4359-a33e-141c071f380d admin admin] PATH_INFO: `/v3/projects/e32eda8a9b784f78abd6b89cb6ebbb1b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:18.423933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98bcc1-cc26-4359-a33e-141c071f380d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e32eda8a9b784f78abd6b89cb6ebbb1b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:18.426240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98bcc1-cc26-4359-a33e-141c071f380d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:18.442145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed00dcd2-2bb4-47d5-b7e0-9fdaff5af4ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fdae8d47ac3428cb2b9369b322fb2b1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:18.444255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed00dcd2-2bb4-47d5-b7e0-9fdaff5af4ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fdae8d47ac3428cb2b9369b322fb2b1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:18.445500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed00dcd2-2bb4-47d5-b7e0-9fdaff5af4ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fdae8d47ac3428cb2b9369b322fb2b1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:18.460413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed00dcd2-2bb4-47d5-b7e0-9fdaff5af4ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fdae8d47ac3428cb2b9369b322fb2b1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:18.469366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:18.489475 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3381/6765] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:17 2022] DELETE /identity/v3/users/4fdae8d47ac3428cb2b9369b322fb2b1 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:18.528228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e98bcc1-cc26-4359-a33e-141c071f380d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e32eda8a9b784f78abd6b89cb6ebbb1b', 'request_id': 'req-9e98bcc1-cc26-4359-a33e-141c071f380d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:18.538706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e98bcc1-cc26-4359-a33e-141c071f380d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e32eda8a9b784f78abd6b89cb6ebbb1b', 'request_id': 'req-9e98bcc1-cc26-4359-a33e-141c071f380d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:18.552200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e98bcc1-cc26-4359-a33e-141c071f380d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e32eda8a9b784f78abd6b89cb6ebbb1b', 'request_id': 'req-9e98bcc1-cc26-4359-a33e-141c071f380d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:18.573905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e98bcc1-cc26-4359-a33e-141c071f380d admin admin] The token cache is being invalidate because project e32eda8a9b784f78abd6b89cb6ebbb1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:18.573905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e98bcc1-cc26-4359-a33e-141c071f380d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:18.574407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e98bcc1-cc26-4359-a33e-141c071f380d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:18.576330 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3385/6766] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:18 2022] DELETE /identity/v3/projects/e32eda8a9b784f78abd6b89cb6ebbb1b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:18.581644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e818c70-bf81-4ff8-b640-6361ebc71625 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:18.582879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e818c70-bf81-4ff8-b640-6361ebc71625 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:18.583934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e818c70-bf81-4ff8-b640-6361ebc71625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:18.637946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2e818c70-bf81-4ff8-b640-6361ebc71625 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:18.641693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2e818c70-bf81-4ff8-b640-6361ebc71625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:18.798874 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3382/6767] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:18.806818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8af0-c716-4e33-bdeb-5101bebfbbcc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:18.807090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8af0-c716-4e33-bdeb-5101bebfbbcc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:18.807547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8af0-c716-4e33-bdeb-5101bebfbbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:18.834645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2dde8af0-c716-4e33-bdeb-5101bebfbbcc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:18.835740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2dde8af0-c716-4e33-bdeb-5101bebfbbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:18.845480 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3386/6768] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:18.850050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e818c70-bf81-4ff8-b640-6361ebc71625 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:18.877484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e818c70-bf81-4ff8-b640-6361ebc71625 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:18.890645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14206674-e36c-4205-aa43-b3f49b4c89a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:18.891346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14206674-e36c-4205-aa43-b3f49b4c89a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:18.891675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14206674-e36c-4205-aa43-b3f49b4c89a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:18.891890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14206674-e36c-4205-aa43-b3f49b4c89a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:18.894432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14206674-e36c-4205-aa43-b3f49b4c89a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:18.894744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14206674-e36c-4205-aa43-b3f49b4c89a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:18.896390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14206674-e36c-4205-aa43-b3f49b4c89a4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:18.945590 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3383/6769] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:18.958540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde8af0-c716-4e33-bdeb-5101bebfbbcc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:18.971152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde8af0-c716-4e33-bdeb-5101bebfbbcc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:18.982101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83606a-8e4c-4a2e-9c03-61ffff98229a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:18.983034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83606a-8e4c-4a2e-9c03-61ffff98229a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:18.983500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83606a-8e4c-4a2e-9c03-61ffff98229a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:18.983948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83606a-8e4c-4a2e-9c03-61ffff98229a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:18.984775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83606a-8e4c-4a2e-9c03-61ffff98229a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:18.987354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83606a-8e4c-4a2e-9c03-61ffff98229a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:19.038862 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3387/6770] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:18 2022] POST /identity/v3/projects => generated 405 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:19.042759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14206674-e36c-4205-aa43-b3f49b4c89a4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:19.058087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14206674-e36c-4205-aa43-b3f49b4c89a4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:19.141688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83606a-8e4c-4a2e-9c03-61ffff98229a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:19.144555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c83606a-8e4c-4a2e-9c03-61ffff98229a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:19.280317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccf422-e979-47b2-85b0-17d14b5b5824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:19.280951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccf422-e979-47b2-85b0-17d14b5b5824 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:19.283163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccf422-e979-47b2-85b0-17d14b5b5824 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:19.284740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccf422-e979-47b2-85b0-17d14b5b5824 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:19.285401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccf422-e979-47b2-85b0-17d14b5b5824 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:19.291914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccf422-e979-47b2-85b0-17d14b5b5824 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:19.349323 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3384/6771] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:19 2022] POST /identity/v3/users => generated 303 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:50:19.350799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83606a-8e4c-4a2e-9c03-61ffff98229a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:19.360966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccf422-e979-47b2-85b0-17d14b5b5824 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:19.361159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa30b3-1035-4514-be06-91b407e88aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:19.361305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa30b3-1035-4514-be06-91b407e88aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:19.361653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa30b3-1035-4514-be06-91b407e88aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:19.362193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa30b3-1035-4514-be06-91b407e88aeb admin admin] PATH_INFO: `/v3/projects/2383352b16bd4da8ba7271b166d0b44c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:19.364996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa30b3-1035-4514-be06-91b407e88aeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2383352b16bd4da8ba7271b166d0b44c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:19.370784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa30b3-1035-4514-be06-91b407e88aeb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:19.386473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccf422-e979-47b2-85b0-17d14b5b5824 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:19.394840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c24f4e-094b-462c-b7af-9ad371467485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:19.395520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c24f4e-094b-462c-b7af-9ad371467485 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:19.395800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c24f4e-094b-462c-b7af-9ad371467485 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:19.396076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c24f4e-094b-462c-b7af-9ad371467485 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:19.396727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c24f4e-094b-462c-b7af-9ad371467485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:19.398323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c24f4e-094b-462c-b7af-9ad371467485 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:19.427035 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3385/6772] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:19.435042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c24f4e-094b-462c-b7af-9ad371467485 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:19.458035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:19.459673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c24f4e-094b-462c-b7af-9ad371467485 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:19.503236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9aaa30b3-1035-4514-be06-91b407e88aeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2383352b16bd4da8ba7271b166d0b44c', 'request_id': 'req-9aaa30b3-1035-4514-be06-91b407e88aeb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:19.517102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9aaa30b3-1035-4514-be06-91b407e88aeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2383352b16bd4da8ba7271b166d0b44c', 'request_id': 'req-9aaa30b3-1035-4514-be06-91b407e88aeb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:19.535967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9aaa30b3-1035-4514-be06-91b407e88aeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2383352b16bd4da8ba7271b166d0b44c', 'request_id': 'req-9aaa30b3-1035-4514-be06-91b407e88aeb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:19.574527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9aaa30b3-1035-4514-be06-91b407e88aeb admin admin] The token cache is being invalidate because project 2383352b16bd4da8ba7271b166d0b44c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:19.574832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9aaa30b3-1035-4514-be06-91b407e88aeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:19.580045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9aaa30b3-1035-4514-be06-91b407e88aeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:19.583795 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3388/6773] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:19 2022] DELETE /identity/v3/projects/2383352b16bd4da8ba7271b166d0b44c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:19.589182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ee5e8-211d-424b-badd-a96131e087c2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:19.589616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ee5e8-211d-424b-badd-a96131e087c2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:19.589753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ee5e8-211d-424b-badd-a96131e087c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:19.613841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2fee6-1042-477b-8b6d-4e5a07904f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:19.614811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2fee6-1042-477b-8b6d-4e5a07904f6b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:19.615550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2fee6-1042-477b-8b6d-4e5a07904f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:19.615990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2fee6-1042-477b-8b6d-4e5a07904f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:19.616842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2fee6-1042-477b-8b6d-4e5a07904f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:19.620085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2fee6-1042-477b-8b6d-4e5a07904f6b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:19.622113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:19.638881 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3386/6774] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:19.640584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2fee6-1042-477b-8b6d-4e5a07904f6b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:19.642736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-49b2fee6-1042-477b-8b6d-4e5a07904f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:19.655591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-825ee5e8-211d-424b-badd-a96131e087c2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:19.656856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-825ee5e8-211d-424b-badd-a96131e087c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:19.658305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2fee6-1042-477b-8b6d-4e5a07904f6b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:19.664177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7165757-5012-4a7e-ac2e-e397880ccd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:19.665122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7165757-5012-4a7e-ac2e-e397880ccd44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:19.665578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7165757-5012-4a7e-ac2e-e397880ccd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:19.666004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7165757-5012-4a7e-ac2e-e397880ccd44 admin admin] PATH_INFO: `/v3/projects/1bc5690bcf7d4199b70244fcdda0e016/users/75987df331d740c9b99b40d5ccf49b4e/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:19.686516 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3389/6775] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:50:19.689568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7165757-5012-4a7e-ac2e-e397880ccd44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc5690bcf7d4199b70244fcdda0e016, user_id=75987df331d740c9b99b40d5ccf49b4e, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:19.693311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7165757-5012-4a7e-ac2e-e397880ccd44 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:19.694947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c9869-6e79-47dd-b8f8-46c1e817dab0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:19.695235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c9869-6e79-47dd-b8f8-46c1e817dab0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:19.695543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c9869-6e79-47dd-b8f8-46c1e817dab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:19.725473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-730c9869-6e79-47dd-b8f8-46c1e817dab0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:19.727140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-730c9869-6e79-47dd-b8f8-46c1e817dab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:19.735721 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3387/6776] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:19 2022] PUT /identity/v3/projects/1bc5690bcf7d4199b70244fcdda0e016/users/75987df331d740c9b99b40d5ccf49b4e/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:19.738844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15ffe7-81e8-4dde-9b20-8eb06270ebfe None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:19.739747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15ffe7-81e8-4dde-9b20-8eb06270ebfe None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:19.740119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15ffe7-81e8-4dde-9b20-8eb06270ebfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:19.768822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ba15ffe7-81e8-4dde-9b20-8eb06270ebfe None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:19.770601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ba15ffe7-81e8-4dde-9b20-8eb06270ebfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:19.850862 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3388/6777] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:50:19.852556 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3390/6778] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:19.856711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15ffe7-81e8-4dde-9b20-8eb06270ebfe None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:19.867070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c9869-6e79-47dd-b8f8-46c1e817dab0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:19.868876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15ffe7-81e8-4dde-9b20-8eb06270ebfe None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:19.869637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-730c9869-6e79-47dd-b8f8-46c1e817dab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:19.877929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a464f-bd52-4ba0-b652-aca79a87e6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:19.878660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a464f-bd52-4ba0-b652-aca79a87e6bb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:19.879013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a464f-bd52-4ba0-b652-aca79a87e6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:19.879382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a464f-bd52-4ba0-b652-aca79a87e6bb admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:19.880125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a464f-bd52-4ba0-b652-aca79a87e6bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:19.880749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a464f-bd52-4ba0-b652-aca79a87e6bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:19.882870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a464f-bd52-4ba0-b652-aca79a87e6bb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:19.917390 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3389/6779] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:19.919010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a464f-bd52-4ba0-b652-aca79a87e6bb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:19.940034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a464f-bd52-4ba0-b652-aca79a87e6bb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:19.956483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0db9b-cb53-43dd-a793-74ac7836beef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:19.957270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0db9b-cb53-43dd-a793-74ac7836beef admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:19.957767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0db9b-cb53-43dd-a793-74ac7836beef admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:19.958404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0db9b-cb53-43dd-a793-74ac7836beef admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:19.959651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0db9b-cb53-43dd-a793-74ac7836beef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:19.961954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0db9b-cb53-43dd-a793-74ac7836beef admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:19.981140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c9869-6e79-47dd-b8f8-46c1e817dab0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:19.987576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1da264-2d23-4e3b-8576-dd9f5e80b6bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:19.988488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da264-2d23-4e3b-8576-dd9f5e80b6bc service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:19.988998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da264-2d23-4e3b-8576-dd9f5e80b6bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:19.989432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da264-2d23-4e3b-8576-dd9f5e80b6bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:20.016037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1da264-2d23-4e3b-8576-dd9f5e80b6bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:20.019121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1da264-2d23-4e3b-8576-dd9f5e80b6bc service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:20.029924 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3390/6780] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:19 2022] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:20.034738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0db9b-cb53-43dd-a793-74ac7836beef admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:20.047608 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3391/6781] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:50:20.181341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0db9b-cb53-43dd-a793-74ac7836beef admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:20.205379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a386573-8c33-4906-add8-53327111f349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:20.206419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386573-8c33-4906-add8-53327111f349 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:20.206946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386573-8c33-4906-add8-53327111f349 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:20.207593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386573-8c33-4906-add8-53327111f349 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:20.208472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a386573-8c33-4906-add8-53327111f349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:20.210618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a386573-8c33-4906-add8-53327111f349 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:20.289729 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3391/6782] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:20 2022] POST /identity/v3/users => generated 284 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:20.294100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1da264-2d23-4e3b-8576-dd9f5e80b6bc service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:20.307736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1da264-2d23-4e3b-8576-dd9f5e80b6bc service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:20.322583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b3ee1-5f56-44e5-86a6-39cffdb535d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:20.323640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b3ee1-5f56-44e5-86a6-39cffdb535d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:20.323924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b3ee1-5f56-44e5-86a6-39cffdb535d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:20.324201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b3ee1-5f56-44e5-86a6-39cffdb535d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:20.324862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b3ee1-5f56-44e5-86a6-39cffdb535d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:20.326475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b3ee1-5f56-44e5-86a6-39cffdb535d5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:20.352705 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3392/6783] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:20.355964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a386573-8c33-4906-add8-53327111f349 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:20.391610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a386573-8c33-4906-add8-53327111f349 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:20.409291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81b7b3-74a4-43bd-9a88-dc0bf1415b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:20.410177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81b7b3-74a4-43bd-9a88-dc0bf1415b70 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:20.410614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81b7b3-74a4-43bd-9a88-dc0bf1415b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:20.411792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81b7b3-74a4-43bd-9a88-dc0bf1415b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:20.412593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81b7b3-74a4-43bd-9a88-dc0bf1415b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:20.414613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81b7b3-74a4-43bd-9a88-dc0bf1415b70 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:20.440735 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3392/6784] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:20.445839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b3ee1-5f56-44e5-86a6-39cffdb535d5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:20.466899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b3ee1-5f56-44e5-86a6-39cffdb535d5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:20.496860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce84f6f-4a3e-495a-86aa-6a75b735c481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:20.497556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84f6f-4a3e-495a-86aa-6a75b735c481 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:20.497837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84f6f-4a3e-495a-86aa-6a75b735c481 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:20.498111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84f6f-4a3e-495a-86aa-6a75b735c481 admin admin] PATH_INFO: `/v3/projects/b13b4fddf365465588968e4a92a8f172/users/598a941612464608bfa629112d2c9c8c/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:20.515770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81b7b3-74a4-43bd-9a88-dc0bf1415b70 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:20.519644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1f81b7b3-74a4-43bd-9a88-dc0bf1415b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:20.558085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:20.572946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce84f6f-4a3e-495a-86aa-6a75b735c481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13b4fddf365465588968e4a92a8f172, user_id=598a941612464608bfa629112d2c9c8c, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:20.588899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce84f6f-4a3e-495a-86aa-6a75b735c481 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:20.645729 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3393/6785] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:20 2022] PUT /identity/v3/projects/b13b4fddf365465588968e4a92a8f172/users/598a941612464608bfa629112d2c9c8c/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:20.647785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002416ab-a1fb-4d37-94f3-4b3ea578965b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:20.648074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002416ab-a1fb-4d37-94f3-4b3ea578965b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:20.648372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002416ab-a1fb-4d37-94f3-4b3ea578965b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:20.683361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81b7b3-74a4-43bd-9a88-dc0bf1415b70 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:20.713508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-002416ab-a1fb-4d37-94f3-4b3ea578965b None None] MFA Rules not processed for user `598a941612464608bfa629112d2c9c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:20.715166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-002416ab-a1fb-4d37-94f3-4b3ea578965b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:20.756215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:20.837969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb64fb-5c48-43a9-b71d-1b729f711574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:20.838716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb64fb-5c48-43a9-b71d-1b729f711574 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:20.839118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb64fb-5c48-43a9-b71d-1b729f711574 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:20.839513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb64fb-5c48-43a9-b71d-1b729f711574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:20.842818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-44fb64fb-5c48-43a9-b71d-1b729f711574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:20.877974 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3394/6786] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:20.882894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002416ab-a1fb-4d37-94f3-4b3ea578965b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:21.033061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002416ab-a1fb-4d37-94f3-4b3ea578965b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:21.050026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18241576-66b3-42d6-aaf7-b67f21b70cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:21.051742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18241576-66b3-42d6-aaf7-b67f21b70cfa admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:21.053375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18241576-66b3-42d6-aaf7-b67f21b70cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:21.054004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18241576-66b3-42d6-aaf7-b67f21b70cfa admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:21.057121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18241576-66b3-42d6-aaf7-b67f21b70cfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:21.065063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18241576-66b3-42d6-aaf7-b67f21b70cfa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:21.068531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb64fb-5c48-43a9-b71d-1b729f711574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:21.070703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb64fb-5c48-43a9-b71d-1b729f711574 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:21.094735 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3393/6787] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:50:21.117580 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3395/6788] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:20 2022] POST /identity/v3/projects => generated 369 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:21.121596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb64fb-5c48-43a9-b71d-1b729f711574 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:21.177587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb64fb-5c48-43a9-b71d-1b729f711574 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:21.298554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b70de2-ddb7-4c2e-9015-e68d22081abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:21.299740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b70de2-ddb7-4c2e-9015-e68d22081abb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:21.300462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b70de2-ddb7-4c2e-9015-e68d22081abb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:21.300973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b70de2-ddb7-4c2e-9015-e68d22081abb admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:21.301955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b70de2-ddb7-4c2e-9015-e68d22081abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:21.304338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b70de2-ddb7-4c2e-9015-e68d22081abb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:21.352890 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3394/6789] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:21 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:21.354247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18241576-66b3-42d6-aaf7-b67f21b70cfa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:21.385829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18241576-66b3-42d6-aaf7-b67f21b70cfa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:21.392132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50af72e-1a5a-481a-a7cb-89fb73e7e16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:21.392768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50af72e-1a5a-481a-a7cb-89fb73e7e16c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:21.393123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50af72e-1a5a-481a-a7cb-89fb73e7e16c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:21.393447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50af72e-1a5a-481a-a7cb-89fb73e7e16c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:21.394114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50af72e-1a5a-481a-a7cb-89fb73e7e16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:21.395849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50af72e-1a5a-481a-a7cb-89fb73e7e16c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:21.421375 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3396/6790] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:21.425318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b70de2-ddb7-4c2e-9015-e68d22081abb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:21.443877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b70de2-ddb7-4c2e-9015-e68d22081abb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:21.450112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61d3ca-7034-48ec-8a84-52398720fe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:21.450798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61d3ca-7034-48ec-8a84-52398720fe66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:21.451073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61d3ca-7034-48ec-8a84-52398720fe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:21.451385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61d3ca-7034-48ec-8a84-52398720fe66 admin admin] PATH_INFO: `/v3/projects/ed6afc4004ea4422b6032a07d5528b9c/users/b0a9446d77d1491d893011e0937f3c91/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:21.470807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:21.479464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61d3ca-7034-48ec-8a84-52398720fe66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6afc4004ea4422b6032a07d5528b9c, user_id=b0a9446d77d1491d893011e0937f3c91, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:21.482500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61d3ca-7034-48ec-8a84-52398720fe66 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:21.526371 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3395/6791] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:21 2022] PUT /identity/v3/projects/ed6afc4004ea4422b6032a07d5528b9c/users/b0a9446d77d1491d893011e0937f3c91/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:21.527040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50af72e-1a5a-481a-a7cb-89fb73e7e16c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:21.542032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50af72e-1a5a-481a-a7cb-89fb73e7e16c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:21.656906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931ae2a-19ae-4e87-82ae-9fbb584ca008 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:21.657197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931ae2a-19ae-4e87-82ae-9fbb584ca008 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:21.657481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931ae2a-19ae-4e87-82ae-9fbb584ca008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:21.732635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8931ae2a-19ae-4e87-82ae-9fbb584ca008 None None] MFA Rules not processed for user `75987df331d740c9b99b40d5ccf49b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:21.733897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8931ae2a-19ae-4e87-82ae-9fbb584ca008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:21.777854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac9c12-2188-4234-9e5c-8d873a5fea4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:21.778493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac9c12-2188-4234-9e5c-8d873a5fea4e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:21.779152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac9c12-2188-4234-9e5c-8d873a5fea4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:21.780310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac9c12-2188-4234-9e5c-8d873a5fea4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:21.781191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac9c12-2188-4234-9e5c-8d873a5fea4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:21.785987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac9c12-2188-4234-9e5c-8d873a5fea4e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:21.814664 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3397/6792] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:21.819207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac9c12-2188-4234-9e5c-8d873a5fea4e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:21.836965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac9c12-2188-4234-9e5c-8d873a5fea4e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:21.852126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f972f-07a8-49c3-af34-e2a380d9ca5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:21.852822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f972f-07a8-49c3-af34-e2a380d9ca5a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:21.853109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f972f-07a8-49c3-af34-e2a380d9ca5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:21.853375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f972f-07a8-49c3-af34-e2a380d9ca5a admin admin] PATH_INFO: `/v3/projects/ed6afc4004ea4422b6032a07d5528b9c/users/b0a9446d77d1491d893011e0937f3c91/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:21.859509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f972f-07a8-49c3-af34-e2a380d9ca5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6afc4004ea4422b6032a07d5528b9c, user_id=b0a9446d77d1491d893011e0937f3c91, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:21.864651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f972f-07a8-49c3-af34-e2a380d9ca5a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:21.893193 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3396/6793] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:21 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:21.899100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931ae2a-19ae-4e87-82ae-9fbb584ca008 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:21.913782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931ae2a-19ae-4e87-82ae-9fbb584ca008 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:21.922395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef0388-27d1-47f6-99f6-351b90e96809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:21.923067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef0388-27d1-47f6-99f6-351b90e96809 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:21.923403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef0388-27d1-47f6-99f6-351b90e96809 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:21.923690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef0388-27d1-47f6-99f6-351b90e96809 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:21.924435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef0388-27d1-47f6-99f6-351b90e96809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:21.926419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef0388-27d1-47f6-99f6-351b90e96809 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:21.956131 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3398/6794] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:21 2022] PUT /identity/v3/projects/ed6afc4004ea4422b6032a07d5528b9c/users/b0a9446d77d1491d893011e0937f3c91/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:21.957709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe746700-7ef0-4e58-86ce-87f00b8957e8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:21.957995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe746700-7ef0-4e58-86ce-87f00b8957e8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:21.958273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe746700-7ef0-4e58-86ce-87f00b8957e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:21.989521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:22.039936 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3397/6795] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:21 2022] POST /identity/v3/projects => generated 405 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:22.042225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fe746700-7ef0-4e58-86ce-87f00b8957e8 None None] MFA Rules not processed for user `b0a9446d77d1491d893011e0937f3c91`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:22.042496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef0388-27d1-47f6-99f6-351b90e96809 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:22.043501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe746700-7ef0-4e58-86ce-87f00b8957e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:22.175820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef0388-27d1-47f6-99f6-351b90e96809 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:22.188550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0ed92-80c2-4abd-8c8b-180703c4c6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:22.189197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ed92-80c2-4abd-8c8b-180703c4c6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:22.189483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ed92-80c2-4abd-8c8b-180703c4c6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:22.190008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ed92-80c2-4abd-8c8b-180703c4c6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:22.190483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0ed92-80c2-4abd-8c8b-180703c4c6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:22.192757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0ed92-80c2-4abd-8c8b-180703c4c6d1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:22.249369 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3398/6796] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:22 2022] POST /identity/v3/users => generated 309 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:22.250436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0ed92-80c2-4abd-8c8b-180703c4c6d1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:22.269183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0ed92-80c2-4abd-8c8b-180703c4c6d1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:22.275182 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3399/6797] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:22.276156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe746700-7ef0-4e58-86ce-87f00b8957e8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:22.279974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb2595-ea22-4553-bfa9-d7b76241c91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:22.281855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb2595-ea22-4553-bfa9-d7b76241c91c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:22.282255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb2595-ea22-4553-bfa9-d7b76241c91c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:22.282646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb2595-ea22-4553-bfa9-d7b76241c91c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:22.283557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb2595-ea22-4553-bfa9-d7b76241c91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:22.286306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb2595-ea22-4553-bfa9-d7b76241c91c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:22.302986 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3399/6798] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:22.307277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb2595-ea22-4553-bfa9-d7b76241c91c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:22.308466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe746700-7ef0-4e58-86ce-87f00b8957e8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:22.322133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb2595-ea22-4553-bfa9-d7b76241c91c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:22.329940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37636210-bc19-4245-b2b6-fff0dc78890b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:22.331283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37636210-bc19-4245-b2b6-fff0dc78890b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:22.332120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37636210-bc19-4245-b2b6-fff0dc78890b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:22.332948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37636210-bc19-4245-b2b6-fff0dc78890b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:22.333807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37636210-bc19-4245-b2b6-fff0dc78890b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:22.336117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd001f8-e301-45f3-8ea4-76038e01728c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:22.338677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd001f8-e301-45f3-8ea4-76038e01728c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:22.340303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd001f8-e301-45f3-8ea4-76038e01728c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:22.340858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd001f8-e301-45f3-8ea4-76038e01728c admin admin] PATH_INFO: `/v3/projects/af5920f442694616888945571bcd719c/users/f9fc07ad92d14ebc9c730404b48599e1/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:22.341490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37636210-bc19-4245-b2b6-fff0dc78890b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:22.382056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd001f8-e301-45f3-8ea4-76038e01728c admin admin] RBAC: Authorizing `identity:create_grant(project_id=af5920f442694616888945571bcd719c, user_id=f9fc07ad92d14ebc9c730404b48599e1, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:22.387571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd001f8-e301-45f3-8ea4-76038e01728c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:22.428612 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3400/6799] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:50:22 2022] POST /identity/v3/projects => generated 329 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:22.434628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37636210-bc19-4245-b2b6-fff0dc78890b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:22.445608 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3400/6800] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:22 2022] PUT /identity/v3/projects/af5920f442694616888945571bcd719c/users/f9fc07ad92d14ebc9c730404b48599e1/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:50:22.465448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd001f8-e301-45f3-8ea4-76038e01728c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:22.514174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:22.690462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37636210-bc19-4245-b2b6-fff0dc78890b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:22.695969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd001f8-e301-45f3-8ea4-76038e01728c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:22.701370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e754a9-c49e-4bd9-a49c-8f871ea49967 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:22.702094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e754a9-c49e-4bd9-a49c-8f871ea49967 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:22.702276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e754a9-c49e-4bd9-a49c-8f871ea49967 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:22.702551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e754a9-c49e-4bd9-a49c-8f871ea49967 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:22.703210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e754a9-c49e-4bd9-a49c-8f871ea49967 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:22.707469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e754a9-c49e-4bd9-a49c-8f871ea49967 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:22.756779 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3401/6801] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:22 2022] POST /identity/v3/users => generated 416 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:22.757903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e754a9-c49e-4bd9-a49c-8f871ea49967 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:22.766440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5e754a9-c49e-4bd9-a49c-8f871ea49967 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:22.860925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b1944-368e-4a70-a73d-7c49981ebab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:22.861764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b1944-368e-4a70-a73d-7c49981ebab8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:22.862046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b1944-368e-4a70-a73d-7c49981ebab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:22.862320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b1944-368e-4a70-a73d-7c49981ebab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:22.865986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b1944-368e-4a70-a73d-7c49981ebab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:22.870548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b1944-368e-4a70-a73d-7c49981ebab8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:22.913546 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3401/6802] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:22.918259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b1944-368e-4a70-a73d-7c49981ebab8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:22.944329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b1944-368e-4a70-a73d-7c49981ebab8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:22.956656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149fa13-67dd-4de3-a900-2023f23cdf63 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:22.962387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149fa13-67dd-4de3-a900-2023f23cdf63 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:22.962924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149fa13-67dd-4de3-a900-2023f23cdf63 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:22.963191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149fa13-67dd-4de3-a900-2023f23cdf63 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:22.963929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149fa13-67dd-4de3-a900-2023f23cdf63 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:22.966009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149fa13-67dd-4de3-a900-2023f23cdf63 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:22.974537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:23.013887 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3402/6803] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:50:22 2022] POST /identity/v3/roles => generated 243 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:23.014765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149fa13-67dd-4de3-a900-2023f23cdf63 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:23.036812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e754a9-c49e-4bd9-a49c-8f871ea49967 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:23.039996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149fa13-67dd-4de3-a900-2023f23cdf63 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:23.048891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3822a9-bf85-467f-b5e6-de83438c55ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:23.051318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84829146-1917-42ab-b81c-9eda94686498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:23.052028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84829146-1917-42ab-b81c-9eda94686498 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:23.052434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3822a9-bf85-467f-b5e6-de83438c55ca service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:23.052804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3822a9-bf85-467f-b5e6-de83438c55ca service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:23.053134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3822a9-bf85-467f-b5e6-de83438c55ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:23.053980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84829146-1917-42ab-b81c-9eda94686498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:23.054219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84829146-1917-42ab-b81c-9eda94686498 admin admin] PATH_INFO: `/v3/projects/af5920f442694616888945571bcd719c/users/f9fc07ad92d14ebc9c730404b48599e1/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:23.056540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ff3822a9-bf85-467f-b5e6-de83438c55ca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:23.059375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84829146-1917-42ab-b81c-9eda94686498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af5920f442694616888945571bcd719c, user_id=f9fc07ad92d14ebc9c730404b48599e1, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:23.066648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84829146-1917-42ab-b81c-9eda94686498 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:23.101289 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3403/6804] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:23 2022] PUT /identity/v3/projects/af5920f442694616888945571bcd719c/users/f9fc07ad92d14ebc9c730404b48599e1/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:23.101289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84829146-1917-42ab-b81c-9eda94686498 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:23.221277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3822a9-bf85-467f-b5e6-de83438c55ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:23.222907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3822a9-bf85-467f-b5e6-de83438c55ca service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:23.251203 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3402/6805] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:50:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:50:23.257818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84829146-1917-42ab-b81c-9eda94686498 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:23.274972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f09e31-ad64-4582-b9d1-3e11d90300e5 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:23.275646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f09e31-ad64-4582-b9d1-3e11d90300e5 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:23.276203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f09e31-ad64-4582-b9d1-3e11d90300e5 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:23.276493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f09e31-ad64-4582-b9d1-3e11d90300e5 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:23.277184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f09e31-ad64-4582-b9d1-3e11d90300e5 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:23.278811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f09e31-ad64-4582-b9d1-3e11d90300e5 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:23.309837 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3404/6806] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:50:23 2022] POST /identity/v3/roles => generated 246 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:23.314205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3822a9-bf85-467f-b5e6-de83438c55ca service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:23.346388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3822a9-bf85-467f-b5e6-de83438c55ca service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:23.369323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8926530-bf4d-431e-a4ed-f1aa501a560e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:23.369993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8926530-bf4d-431e-a4ed-f1aa501a560e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:23.370266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8926530-bf4d-431e-a4ed-f1aa501a560e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:23.370544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8926530-bf4d-431e-a4ed-f1aa501a560e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/d12585a90a424a8facb0b7dadf2d241f/users/a75ea3eeac624f9c891fcdb3ed130f69/roles/c83c3e1a8ee54d89baec8dd6dc21744e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:23.413526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8926530-bf4d-431e-a4ed-f1aa501a560e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d12585a90a424a8facb0b7dadf2d241f, user_id=a75ea3eeac624f9c891fcdb3ed130f69, role_id=c83c3e1a8ee54d89baec8dd6dc21744e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:23.417818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8926530-bf4d-431e-a4ed-f1aa501a560e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:23.468784 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3403/6807] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:23 2022] PUT /identity/v3/projects/d12585a90a424a8facb0b7dadf2d241f/users/a75ea3eeac624f9c891fcdb3ed130f69/roles/c83c3e1a8ee54d89baec8dd6dc21744e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:23.470405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f09e31-ad64-4582-b9d1-3e11d90300e5 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:23.484445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f09e31-ad64-4582-b9d1-3e11d90300e5 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:23.552178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:23.756580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366a970-9b6c-44b8-b7e2-ce2cf0ac1006 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:23.757475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366a970-9b6c-44b8-b7e2-ce2cf0ac1006 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:23.758925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366a970-9b6c-44b8-b7e2-ce2cf0ac1006 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:23.759345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366a970-9b6c-44b8-b7e2-ce2cf0ac1006 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/d12585a90a424a8facb0b7dadf2d241f/users/a75ea3eeac624f9c891fcdb3ed130f69/roles/67c96c81cc0349e48b45c2af96e81923` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:23.776897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366a970-9b6c-44b8-b7e2-ce2cf0ac1006 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d12585a90a424a8facb0b7dadf2d241f, user_id=a75ea3eeac624f9c891fcdb3ed130f69, role_id=67c96c81cc0349e48b45c2af96e81923)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:23.784587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366a970-9b6c-44b8-b7e2-ce2cf0ac1006 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:23.830372 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3405/6808] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:23 2022] PUT /identity/v3/projects/d12585a90a424a8facb0b7dadf2d241f/users/a75ea3eeac624f9c891fcdb3ed130f69/roles/67c96c81cc0349e48b45c2af96e81923 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:23.834864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8926530-bf4d-431e-a4ed-f1aa501a560e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:23.860014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8926530-bf4d-431e-a4ed-f1aa501a560e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:24.030918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2b31c-293d-4248-b08c-68c1cc2f2af0 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:24.032310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2b31c-293d-4248-b08c-68c1cc2f2af0 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:24.032815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2b31c-293d-4248-b08c-68c1cc2f2af0 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:24.033326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2b31c-293d-4248-b08c-68c1cc2f2af0 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:24.034335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2b31c-293d-4248-b08c-68c1cc2f2af0 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:24.035692 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-b0f2b31c-293d-4248-b08c-68c1cc2f2af0 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:50:24.035692 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:50:24.035692 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:50:24.042918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2b31c-293d-4248-b08c-68c1cc2f2af0 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:24.188644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007b76a-1049-45b2-bb74-0d79e7630fb6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:24.188942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007b76a-1049-45b2-bb74-0d79e7630fb6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:24.189522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007b76a-1049-45b2-bb74-0d79e7630fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:24.204231 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3404/6809] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:23 2022] GET /identity/v3/users => generated 8075 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:24.313362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5007b76a-1049-45b2-bb74-0d79e7630fb6 None None] MFA Rules not processed for user `a75ea3eeac624f9c891fcdb3ed130f69`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:24.314594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5007b76a-1049-45b2-bb74-0d79e7630fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:24.497520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42325c9a-9a82-4066-b9a1-ab8f41179110 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:24.498669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42325c9a-9a82-4066-b9a1-ab8f41179110 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:24.499138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42325c9a-9a82-4066-b9a1-ab8f41179110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:24.503413 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3406/6810] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:24 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:24.546352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-42325c9a-9a82-4066-b9a1-ab8f41179110 None None] MFA Rules not processed for user `a75ea3eeac624f9c891fcdb3ed130f69`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:24.585438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-42325c9a-9a82-4066-b9a1-ab8f41179110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:24.614274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007b76a-1049-45b2-bb74-0d79e7630fb6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:24.642667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007b76a-1049-45b2-bb74-0d79e7630fb6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:24.643080 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3405/6811] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:24 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:24.660788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560b351-b132-47aa-b73c-365c409d1f82 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75ea3eeac624f9c891fcdb3ed130f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd12585a90a424a8facb0b7dadf2d241f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-943699455', 'tempest-NotDelegatedRole-647228534'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:24.661485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560b351-b132-47aa-b73c-365c409d1f82 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:24.661760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560b351-b132-47aa-b73c-365c409d1f82 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:24.662036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560b351-b132-47aa-b73c-365c409d1f82 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:24.663535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560b351-b132-47aa-b73c-365c409d1f82 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] RBAC: Authorizing `identity:create_trust()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:24.670727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560b351-b132-47aa-b73c-365c409d1f82 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:24.907125 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3407/6812] 10.222.0.27 () {60 vars in 1174 bytes} [Sun Aug 28 18:50:24 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:24.907951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42325c9a-9a82-4066-b9a1-ab8f41179110 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:24.930085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42325c9a-9a82-4066-b9a1-ab8f41179110 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:24.952312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f13a8-fe9e-4ffb-b828-9079997d61ac tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:24.954757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f13a8-fe9e-4ffb-b828-9079997d61ac tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:24.957527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f13a8-fe9e-4ffb-b828-9079997d61ac tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:24.957834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f13a8-fe9e-4ffb-b828-9079997d61ac tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:24.959591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f13a8-fe9e-4ffb-b828-9079997d61ac tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:24.966019 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-840f13a8-fe9e-4ffb-b828-9079997d61ac tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:50:24.966019 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:50:24.966019 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:50:24.966897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f13a8-fe9e-4ffb-b828-9079997d61ac tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:24.997839 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3406/6813] 10.222.0.27 () {58 vars in 1155 bytes} [Sun Aug 28 18:50:24 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:24.998388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560b351-b132-47aa-b73c-365c409d1f82 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:25.013904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560b351-b132-47aa-b73c-365c409d1f82 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:25.026618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2842a-2125-469d-9166-a810f987e633 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75ea3eeac624f9c891fcdb3ed130f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd12585a90a424a8facb0b7dadf2d241f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-943699455', 'tempest-NotDelegatedRole-647228534'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:25.028795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2842a-2125-469d-9166-a810f987e633 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:25.028795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2842a-2125-469d-9166-a810f987e633 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:25.028795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2842a-2125-469d-9166-a810f987e633 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] PATH_INFO: `/v3/OS-TRUST/trusts/02d1e98a37254307b7e386abbd4c6ac6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:25.051275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2842a-2125-469d-9166-a810f987e633 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] RBAC: Authorizing `identity:delete_trust(trust_id=02d1e98a37254307b7e386abbd4c6ac6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:25.052648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2842a-2125-469d-9166-a810f987e633 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:25.121318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:25.142504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c8a2842a-2125-469d-9166-a810f987e633 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '02d1e98a37254307b7e386abbd4c6ac6', 'request_id': 'req-c8a2842a-2125-469d-9166-a810f987e633'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:25.171540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c8a2842a-2125-469d-9166-a810f987e633 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '02d1e98a37254307b7e386abbd4c6ac6', 'request_id': 'req-c8a2842a-2125-469d-9166-a810f987e633'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:25.172976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c8a2842a-2125-469d-9166-a810f987e633 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '02d1e98a37254307b7e386abbd4c6ac6', 'request_id': 'req-c8a2842a-2125-469d-9166-a810f987e633'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:25.199192 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3408/6814] 10.222.0.27 () {58 vars in 1254 bytes} [Sun Aug 28 18:50:24 2022] DELETE /identity/v3/OS-TRUST/trusts/02d1e98a37254307b7e386abbd4c6ac6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:25.200419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f13a8-fe9e-4ffb-b828-9079997d61ac tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:25.202827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-840f13a8-fe9e-4ffb-b828-9079997d61ac tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:25.258024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f13a8-fe9e-4ffb-b828-9079997d61ac tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:25.269755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3d267-96b1-493c-9c50-5306b5a5c118 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75ea3eeac624f9c891fcdb3ed130f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd12585a90a424a8facb0b7dadf2d241f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-943699455', 'tempest-NotDelegatedRole-647228534'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:25.270500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3d267-96b1-493c-9c50-5306b5a5c118 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:25.271809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3d267-96b1-493c-9c50-5306b5a5c118 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:25.272208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3d267-96b1-493c-9c50-5306b5a5c118 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] PATH_INFO: `/v3/OS-TRUST/trusts/02d1e98a37254307b7e386abbd4c6ac6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:25.343958 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-56e3d267-96b1-493c-9c50-5306b5a5c118 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] Could not find trust: 02d1e98a37254307b7e386abbd4c6ac6.: keystone.exception.TrustNotFound: Could not find trust: 02d1e98a37254307b7e386abbd4c6ac6. Aug 28 18:50:25.343958 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:25.343958 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:25.343958 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:25.343958 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:25.343958 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:25.343958 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:25.343958 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:25.343958 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:25.343958 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:25.343958 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:25.343958 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:25.343958 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 18:50:25.343958 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 18:50:25.343958 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 18:50:25.345282 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 18:50:25.345282 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 18:50:25.345282 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 18:50:25.345282 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 18:50:25.345282 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 18:50:25.345282 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:50:25.345282 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:50:25.345282 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 18:50:25.345282 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 18:50:25.345282 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 18:50:25.345282 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 18:50:25.345282 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 02d1e98a37254307b7e386abbd4c6ac6. Aug 28 18:50:25.345282 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:25.346332 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3407/6815] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Aug 28 18:50:25 2022] GET /identity/v3/OS-TRUST/trusts/02d1e98a37254307b7e386abbd4c6ac6 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 18:50:25.351134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2842a-2125-469d-9166-a810f987e633 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:25.352960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c8a2842a-2125-469d-9166-a810f987e633 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:25.392186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2842a-2125-469d-9166-a810f987e633 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:25.410711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147875f-8d41-42fb-b2e7-109c0579d898 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:25.411877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147875f-8d41-42fb-b2e7-109c0579d898 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:25.412168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147875f-8d41-42fb-b2e7-109c0579d898 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:25.412454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147875f-8d41-42fb-b2e7-109c0579d898 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles/67c96c81cc0349e48b45c2af96e81923` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:25.421880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147875f-8d41-42fb-b2e7-109c0579d898 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=67c96c81cc0349e48b45c2af96e81923)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:25.424966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147875f-8d41-42fb-b2e7-109c0579d898 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:25.513266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b147875f-8d41-42fb-b2e7-109c0579d898 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invalidating the token cache because role 67c96c81cc0349e48b45c2af96e81923 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:25.513742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b147875f-8d41-42fb-b2e7-109c0579d898 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:25.515153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b147875f-8d41-42fb-b2e7-109c0579d898 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:25.517941 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3409/6816] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:25 2022] DELETE /identity/v3/roles/67c96c81cc0349e48b45c2af96e81923 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:25.522119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3d267-96b1-493c-9c50-5306b5a5c118 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:25.525034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56e3d267-96b1-493c-9c50-5306b5a5c118 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:25.596159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3d267-96b1-493c-9c50-5306b5a5c118 tempest-TrustsV3TestJSON-1062790760 tempest-user-1470555030] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:25.829160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:25.856531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06559990-0db4-46f9-a9be-95e54372a51a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:25.856814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06559990-0db4-46f9-a9be-95e54372a51a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:25.860049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06559990-0db4-46f9-a9be-95e54372a51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:25.933657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b494ce1-3f99-42f0-96de-cabc953a115a tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:25.934335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b494ce1-3f99-42f0-96de-cabc953a115a tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:25.934615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b494ce1-3f99-42f0-96de-cabc953a115a tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:25.934892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b494ce1-3f99-42f0-96de-cabc953a115a tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles/c83c3e1a8ee54d89baec8dd6dc21744e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:25.952691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b494ce1-3f99-42f0-96de-cabc953a115a tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c83c3e1a8ee54d89baec8dd6dc21744e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:25.968816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b494ce1-3f99-42f0-96de-cabc953a115a tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:25.993145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-06559990-0db4-46f9-a9be-95e54372a51a None None] MFA Rules not processed for user `f9fc07ad92d14ebc9c730404b48599e1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:25.994396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-06559990-0db4-46f9-a9be-95e54372a51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:26.112847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b494ce1-3f99-42f0-96de-cabc953a115a tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invalidating the token cache because role c83c3e1a8ee54d89baec8dd6dc21744e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:26.113768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b494ce1-3f99-42f0-96de-cabc953a115a tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:26.116250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b494ce1-3f99-42f0-96de-cabc953a115a tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:26.120081 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3408/6817] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:25 2022] DELETE /identity/v3/roles/c83c3e1a8ee54d89baec8dd6dc21744e => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:26.124163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b494ce1-3f99-42f0-96de-cabc953a115a tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:26.126671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4b494ce1-3f99-42f0-96de-cabc953a115a tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:26.256963 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3410/6818] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:25 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:50:26.362253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b494ce1-3f99-42f0-96de-cabc953a115a tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:26.380990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42143339-f684-45cd-b3b0-bda678810f5d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:26.381954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42143339-f684-45cd-b3b0-bda678810f5d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:26.382395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42143339-f684-45cd-b3b0-bda678810f5d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:26.382889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42143339-f684-45cd-b3b0-bda678810f5d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users/a75ea3eeac624f9c891fcdb3ed130f69` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:26.384717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42143339-f684-45cd-b3b0-bda678810f5d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a75ea3eeac624f9c891fcdb3ed130f69)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:26.390975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42143339-f684-45cd-b3b0-bda678810f5d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:26.517767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42143339-f684-45cd-b3b0-bda678810f5d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75ea3eeac624f9c891fcdb3ed130f69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:26.518475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42143339-f684-45cd-b3b0-bda678810f5d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75ea3eeac624f9c891fcdb3ed130f69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:26.533896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42143339-f684-45cd-b3b0-bda678810f5d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75ea3eeac624f9c891fcdb3ed130f69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:26.563757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42143339-f684-45cd-b3b0-bda678810f5d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75ea3eeac624f9c891fcdb3ed130f69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:26.610365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42143339-f684-45cd-b3b0-bda678810f5d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75ea3eeac624f9c891fcdb3ed130f69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:26.640867 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3409/6819] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:26 2022] DELETE /identity/v3/users/a75ea3eeac624f9c891fcdb3ed130f69 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:50:26.645049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06559990-0db4-46f9-a9be-95e54372a51a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:26.684081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06559990-0db4-46f9-a9be-95e54372a51a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:26.820404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233471b-acb6-47fc-adca-f0d5f2b86f6c tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:26.823955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233471b-acb6-47fc-adca-f0d5f2b86f6c tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:26.825006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233471b-acb6-47fc-adca-f0d5f2b86f6c tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:26.825518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233471b-acb6-47fc-adca-f0d5f2b86f6c tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/d12585a90a424a8facb0b7dadf2d241f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:26.832267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233471b-acb6-47fc-adca-f0d5f2b86f6c tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d12585a90a424a8facb0b7dadf2d241f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:26.837160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233471b-acb6-47fc-adca-f0d5f2b86f6c tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:26.928404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:UPDATE=1,keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:26.986702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8233471b-acb6-47fc-adca-f0d5f2b86f6c tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd12585a90a424a8facb0b7dadf2d241f', 'request_id': 'req-8233471b-acb6-47fc-adca-f0d5f2b86f6c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:26.999220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8233471b-acb6-47fc-adca-f0d5f2b86f6c tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd12585a90a424a8facb0b7dadf2d241f', 'request_id': 'req-8233471b-acb6-47fc-adca-f0d5f2b86f6c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:27.021180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8233471b-acb6-47fc-adca-f0d5f2b86f6c tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd12585a90a424a8facb0b7dadf2d241f', 'request_id': 'req-8233471b-acb6-47fc-adca-f0d5f2b86f6c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:27.039823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8233471b-acb6-47fc-adca-f0d5f2b86f6c tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] The token cache is being invalidate because project d12585a90a424a8facb0b7dadf2d241f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:27.040141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8233471b-acb6-47fc-adca-f0d5f2b86f6c tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:27.041626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8233471b-acb6-47fc-adca-f0d5f2b86f6c tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:27.063041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42143339-f684-45cd-b3b0-bda678810f5d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:27.063473 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3411/6820] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:26 2022] DELETE /identity/v3/projects/d12585a90a424a8facb0b7dadf2d241f => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:27.078820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-42143339-f684-45cd-b3b0-bda678810f5d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:27.103920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42143339-f684-45cd-b3b0-bda678810f5d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:27.125051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:27.177234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581acea-20ec-435a-860f-f526416bc7db tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:27.178687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581acea-20ec-435a-860f-f526416bc7db tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:27.179088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581acea-20ec-435a-860f-f526416bc7db tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:27.179584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581acea-20ec-435a-860f-f526416bc7db tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:27.180357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581acea-20ec-435a-860f-f526416bc7db tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:27.188150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581acea-20ec-435a-860f-f526416bc7db tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:27.270704 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3410/6821] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:50:27 2022] POST /identity/v3/projects => generated 329 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:27.271299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233471b-acb6-47fc-adca-f0d5f2b86f6c tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:27.272995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8233471b-acb6-47fc-adca-f0d5f2b86f6c tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:27.317521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233471b-acb6-47fc-adca-f0d5f2b86f6c tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:27.546399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a885a8f-cb91-4581-b5b2-e888424b8476 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:27.547649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a885a8f-cb91-4581-b5b2-e888424b8476 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:27.549538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a885a8f-cb91-4581-b5b2-e888424b8476 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:27.550038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a885a8f-cb91-4581-b5b2-e888424b8476 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:27.550944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a885a8f-cb91-4581-b5b2-e888424b8476 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:27.559022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a885a8f-cb91-4581-b5b2-e888424b8476 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:27.640848 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3412/6822] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:27 2022] POST /identity/v3/users => generated 413 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:27.643335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581acea-20ec-435a-860f-f526416bc7db tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:27.666984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581acea-20ec-435a-860f-f526416bc7db tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:27.673548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf02ae2-2494-4cfb-8473-2ecae14da452 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:27.674467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf02ae2-2494-4cfb-8473-2ecae14da452 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:27.674859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf02ae2-2494-4cfb-8473-2ecae14da452 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:27.675298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf02ae2-2494-4cfb-8473-2ecae14da452 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:27.676830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf02ae2-2494-4cfb-8473-2ecae14da452 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:27.681010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf02ae2-2494-4cfb-8473-2ecae14da452 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:27.723375 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3411/6823] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:50:27 2022] POST /identity/v3/roles => generated 244 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:27.724966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a885a8f-cb91-4581-b5b2-e888424b8476 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:27.739557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a885a8f-cb91-4581-b5b2-e888424b8476 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:27.751718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52740fc-8f21-4be2-be81-089168162f30 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:27.752605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52740fc-8f21-4be2-be81-089168162f30 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:27.753698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52740fc-8f21-4be2-be81-089168162f30 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:27.754146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52740fc-8f21-4be2-be81-089168162f30 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:27.755006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52740fc-8f21-4be2-be81-089168162f30 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:27.757930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52740fc-8f21-4be2-be81-089168162f30 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:27.794325 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3413/6824] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:50:27 2022] POST /identity/v3/roles => generated 246 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:50:27.800541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf02ae2-2494-4cfb-8473-2ecae14da452 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:27.830451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf02ae2-2494-4cfb-8473-2ecae14da452 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:27.858801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f47a2-8a7b-4025-8b5a-9c51160bf33d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:27.859535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f47a2-8a7b-4025-8b5a-9c51160bf33d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:27.860001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f47a2-8a7b-4025-8b5a-9c51160bf33d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:27.860336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f47a2-8a7b-4025-8b5a-9c51160bf33d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/7df51698a3cf4632850706b1ad3056b0/users/2a6d0d54b5fe488ab00a8b4e5f6f8ba2/roles/02c60e10fcd240d7865789d9c412b0cd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:27.925281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f47a2-8a7b-4025-8b5a-9c51160bf33d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7df51698a3cf4632850706b1ad3056b0, user_id=2a6d0d54b5fe488ab00a8b4e5f6f8ba2, role_id=02c60e10fcd240d7865789d9c412b0cd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:27.958213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f47a2-8a7b-4025-8b5a-9c51160bf33d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:27.992704 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3412/6825] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:27 2022] PUT /identity/v3/projects/7df51698a3cf4632850706b1ad3056b0/users/2a6d0d54b5fe488ab00a8b4e5f6f8ba2/roles/02c60e10fcd240d7865789d9c412b0cd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:27.997199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52740fc-8f21-4be2-be81-089168162f30 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:28.015701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52740fc-8f21-4be2-be81-089168162f30 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:28.196642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4dab79-59ec-4603-a73d-1cdef67e71f7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:28.204574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dab79-59ec-4603-a73d-1cdef67e71f7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:28.205150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dab79-59ec-4603-a73d-1cdef67e71f7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:28.205682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dab79-59ec-4603-a73d-1cdef67e71f7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/7df51698a3cf4632850706b1ad3056b0/users/2a6d0d54b5fe488ab00a8b4e5f6f8ba2/roles/4bce21dbf50b4284a5c79553fc8fefc5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:28.231834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4dab79-59ec-4603-a73d-1cdef67e71f7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7df51698a3cf4632850706b1ad3056b0, user_id=2a6d0d54b5fe488ab00a8b4e5f6f8ba2, role_id=4bce21dbf50b4284a5c79553fc8fefc5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:28.234566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4dab79-59ec-4603-a73d-1cdef67e71f7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:28.291507 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3414/6826] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:27 2022] PUT /identity/v3/projects/7df51698a3cf4632850706b1ad3056b0/users/2a6d0d54b5fe488ab00a8b4e5f6f8ba2/roles/4bce21dbf50b4284a5c79553fc8fefc5 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:28.295793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f47a2-8a7b-4025-8b5a-9c51160bf33d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:28.312011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f47a2-8a7b-4025-8b5a-9c51160bf33d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:28.452073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4234f4-0d11-4d67-8f7e-d52019862c66 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:28.452686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4234f4-0d11-4d67-8f7e-d52019862c66 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:28.453016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4234f4-0d11-4d67-8f7e-d52019862c66 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:28.453273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4234f4-0d11-4d67-8f7e-d52019862c66 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:28.453914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4234f4-0d11-4d67-8f7e-d52019862c66 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:28.457705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4234f4-0d11-4d67-8f7e-d52019862c66 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:28.538751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce8059-183b-492b-837e-27a226b2ab74 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:28.538991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce8059-183b-492b-837e-27a226b2ab74 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:28.544239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce8059-183b-492b-837e-27a226b2ab74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:28.545456 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3413/6827] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:28 2022] GET /identity/v3/users => generated 8072 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:28.634831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d9ce8059-183b-492b-837e-27a226b2ab74 None None] MFA Rules not processed for user `2a6d0d54b5fe488ab00a8b4e5f6f8ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:28.653059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d9ce8059-183b-492b-837e-27a226b2ab74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:28.679094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=5,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:29.149353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4234f4-0d11-4d67-8f7e-d52019862c66 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:29.153216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-df4234f4-0d11-4d67-8f7e-d52019862c66 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:29.184554 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3415/6828] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:28 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 647 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:29.194944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea792ba-3894-4347-a74d-dddf12e947a9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:29.195230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea792ba-3894-4347-a74d-dddf12e947a9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:29.196296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea792ba-3894-4347-a74d-dddf12e947a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:29.238587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fea792ba-3894-4347-a74d-dddf12e947a9 None None] MFA Rules not processed for user `2a6d0d54b5fe488ab00a8b4e5f6f8ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:29.240261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fea792ba-3894-4347-a74d-dddf12e947a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:29.295103 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3416/6829] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:29 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:29.297096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea792ba-3894-4347-a74d-dddf12e947a9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:29.307705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4234f4-0d11-4d67-8f7e-d52019862c66 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:29.313956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489efc5-6194-450b-a86b-604d487fbb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:29.314658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489efc5-6194-450b-a86b-604d487fbb30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:29.314917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489efc5-6194-450b-a86b-604d487fbb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:29.315349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489efc5-6194-450b-a86b-604d487fbb30 admin admin] PATH_INFO: `/v3/users/8ed50d414dc14715bfdade9ce2e7ee52` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:29.316616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489efc5-6194-450b-a86b-604d487fbb30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed50d414dc14715bfdade9ce2e7ee52)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:29.320301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489efc5-6194-450b-a86b-604d487fbb30 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:29.324675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fea792ba-3894-4347-a74d-dddf12e947a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:29.347044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:29.357420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea792ba-3894-4347-a74d-dddf12e947a9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:29.367471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3059cc8-2b75-436e-b336-2c9019144724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:29.368811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3059cc8-2b75-436e-b336-2c9019144724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:29.371172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3059cc8-2b75-436e-b336-2c9019144724 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:29.371600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3059cc8-2b75-436e-b336-2c9019144724 admin admin] PATH_INFO: `/v3/users/75987df331d740c9b99b40d5ccf49b4e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:29.374360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3059cc8-2b75-436e-b336-2c9019144724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75987df331d740c9b99b40d5ccf49b4e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:29.382147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3059cc8-2b75-436e-b336-2c9019144724 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:29.438490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6489efc5-6194-450b-a86b-604d487fbb30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed50d414dc14715bfdade9ce2e7ee52'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:29.439687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6489efc5-6194-450b-a86b-604d487fbb30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed50d414dc14715bfdade9ce2e7ee52'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:29.456750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6489efc5-6194-450b-a86b-604d487fbb30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed50d414dc14715bfdade9ce2e7ee52'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:29.468438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6489efc5-6194-450b-a86b-604d487fbb30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed50d414dc14715bfdade9ce2e7ee52'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:29.472633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3059cc8-2b75-436e-b336-2c9019144724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75987df331d740c9b99b40d5ccf49b4e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:29.494991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3059cc8-2b75-436e-b336-2c9019144724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75987df331d740c9b99b40d5ccf49b4e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:29.495890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3059cc8-2b75-436e-b336-2c9019144724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75987df331d740c9b99b40d5ccf49b4e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:29.497445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3059cc8-2b75-436e-b336-2c9019144724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75987df331d740c9b99b40d5ccf49b4e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:29.497738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6489efc5-6194-450b-a86b-604d487fbb30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed50d414dc14715bfdade9ce2e7ee52'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:29.504969 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3414/6830] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:29 2022] DELETE /identity/v3/users/8ed50d414dc14715bfdade9ce2e7ee52 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:29.505999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489efc5-6194-450b-a86b-604d487fbb30 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:29.507750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6489efc5-6194-450b-a86b-604d487fbb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:29.512402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3059cc8-2b75-436e-b336-2c9019144724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75987df331d740c9b99b40d5ccf49b4e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:29.535688 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3417/6831] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:29 2022] DELETE /identity/v3/users/75987df331d740c9b99b40d5ccf49b4e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:29.697057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489efc5-6194-450b-a86b-604d487fbb30 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:29.774705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102bb48-1f96-4fcc-b921-43244e16d1d9 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d0d54b5fe488ab00a8b4e5f6f8ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7df51698a3cf4632850706b1ad3056b0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-473954990', 'tempest-DelegatedRole-1269076650'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:29.775518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102bb48-1f96-4fcc-b921-43244e16d1d9 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:29.777596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102bb48-1f96-4fcc-b921-43244e16d1d9 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:29.778819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102bb48-1f96-4fcc-b921-43244e16d1d9 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:29.780270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102bb48-1f96-4fcc-b921-43244e16d1d9 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] RBAC: Authorizing `identity:create_trust()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:29.783338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102bb48-1f96-4fcc-b921-43244e16d1d9 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:29.858668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3059cc8-2b75-436e-b336-2c9019144724 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:29.860569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f3059cc8-2b75-436e-b336-2c9019144724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:30.013504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:30.019813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3059cc8-2b75-436e-b336-2c9019144724 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:30.026515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882ee3f-581c-46e9-9777-f351fc9eeaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:30.027946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882ee3f-581c-46e9-9777-f351fc9eeaa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:30.029367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882ee3f-581c-46e9-9777-f351fc9eeaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:30.030038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882ee3f-581c-46e9-9777-f351fc9eeaa6 admin admin] PATH_INFO: `/v3/projects/1bc5690bcf7d4199b70244fcdda0e016` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:30.032034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882ee3f-581c-46e9-9777-f351fc9eeaa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc5690bcf7d4199b70244fcdda0e016)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:30.034320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882ee3f-581c-46e9-9777-f351fc9eeaa6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:30.064337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:30.095032 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3415/6832] 10.222.0.27 () {60 vars in 1174 bytes} [Sun Aug 28 18:50:29 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:30.096906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102bb48-1f96-4fcc-b921-43244e16d1d9 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:30.101791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1102bb48-1f96-4fcc-b921-43244e16d1d9 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:30.110467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1882ee3f-581c-46e9-9777-f351fc9eeaa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc5690bcf7d4199b70244fcdda0e016', 'request_id': 'req-1882ee3f-581c-46e9-9777-f351fc9eeaa6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.117737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1882ee3f-581c-46e9-9777-f351fc9eeaa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc5690bcf7d4199b70244fcdda0e016', 'request_id': 'req-1882ee3f-581c-46e9-9777-f351fc9eeaa6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.124358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1882ee3f-581c-46e9-9777-f351fc9eeaa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc5690bcf7d4199b70244fcdda0e016', 'request_id': 'req-1882ee3f-581c-46e9-9777-f351fc9eeaa6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.140578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102bb48-1f96-4fcc-b921-43244e16d1d9 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:30.154098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1882ee3f-581c-46e9-9777-f351fc9eeaa6 admin admin] The token cache is being invalidate because project 1bc5690bcf7d4199b70244fcdda0e016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:30.154412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1882ee3f-581c-46e9-9777-f351fc9eeaa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.155279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1882ee3f-581c-46e9-9777-f351fc9eeaa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.168956 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3418/6833] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:29 2022] DELETE /identity/v3/projects/1bc5690bcf7d4199b70244fcdda0e016 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:30.170316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882ee3f-581c-46e9-9777-f351fc9eeaa6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:30.177968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1882ee3f-581c-46e9-9777-f351fc9eeaa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:30.248964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:30.249767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:30.250178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:30.250468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3 admin admin] PATH_INFO: `/v3/projects/abd3d2eb8d3a461a923ef424b4b651d9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:30.252039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd3d2eb8d3a461a923ef424b4b651d9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:30.254499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:30.294923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882ee3f-581c-46e9-9777-f351fc9eeaa6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:30.302199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e135051-6a5a-4899-a3e0-f81a24434a01 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d0d54b5fe488ab00a8b4e5f6f8ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7df51698a3cf4632850706b1ad3056b0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-473954990', 'tempest-DelegatedRole-1269076650'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:30.303203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e135051-6a5a-4899-a3e0-f81a24434a01 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:30.303986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e135051-6a5a-4899-a3e0-f81a24434a01 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:30.304268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e135051-6a5a-4899-a3e0-f81a24434a01 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:30.304949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e135051-6a5a-4899-a3e0-f81a24434a01 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:30.306335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e135051-6a5a-4899-a3e0-f81a24434a01 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:30.315518 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3419/6834] 10.222.0.27 () {58 vars in 1252 bytes} [Sun Aug 28 18:50:30 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=2a6d0d54b5fe488ab00a8b4e5f6f8ba2 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:30.315518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e135051-6a5a-4899-a3e0-f81a24434a01 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:30.318266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9e135051-6a5a-4899-a3e0-f81a24434a01 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:30.342965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd3d2eb8d3a461a923ef424b4b651d9', 'request_id': 'req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.354631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd3d2eb8d3a461a923ef424b4b651d9', 'request_id': 'req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.357430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e135051-6a5a-4899-a3e0-f81a24434a01 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:30.365546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd3d2eb8d3a461a923ef424b4b651d9', 'request_id': 'req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.382396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3 admin admin] The token cache is being invalidate because project abd3d2eb8d3a461a923ef424b4b651d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:30.383133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.385694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.387539 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3416/6835] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:30 2022] DELETE /identity/v3/projects/abd3d2eb8d3a461a923ef424b4b651d9 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:30.393922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:30.398534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:30.468671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ade57-1eaf-4e54-8704-2f99e97cd940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:30.469744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ade57-1eaf-4e54-8704-2f99e97cd940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:30.470039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ade57-1eaf-4e54-8704-2f99e97cd940 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:30.470323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ade57-1eaf-4e54-8704-2f99e97cd940 admin admin] PATH_INFO: `/v3/users/f9fc07ad92d14ebc9c730404b48599e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:30.472305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ade57-1eaf-4e54-8704-2f99e97cd940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9fc07ad92d14ebc9c730404b48599e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:30.474816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ade57-1eaf-4e54-8704-2f99e97cd940 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:30.524224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf293c6-3d0a-4ae3-93d2-3bbd905688a3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:30.531473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9a871-00d0-44c9-a420-e498899e0604 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d0d54b5fe488ab00a8b4e5f6f8ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7df51698a3cf4632850706b1ad3056b0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-473954990', 'tempest-DelegatedRole-1269076650'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:30.533044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9a871-00d0-44c9-a420-e498899e0604 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:30.534230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9a871-00d0-44c9-a420-e498899e0604 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:30.534662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9a871-00d0-44c9-a420-e498899e0604 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] PATH_INFO: `/v3/OS-TRUST/trusts/6049aae8ed6442f6acd564bc10f3f8a3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:30.545663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9a871-00d0-44c9-a420-e498899e0604 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] RBAC: Authorizing `identity:delete_trust(trust_id=6049aae8ed6442f6acd564bc10f3f8a3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:30.554316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9a871-00d0-44c9-a420-e498899e0604 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:30.566541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:30.581443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a5ade57-1eaf-4e54-8704-2f99e97cd940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9fc07ad92d14ebc9c730404b48599e1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.587547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:30.600279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a5ade57-1eaf-4e54-8704-2f99e97cd940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9fc07ad92d14ebc9c730404b48599e1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.601114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a5ade57-1eaf-4e54-8704-2f99e97cd940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9fc07ad92d14ebc9c730404b48599e1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.601940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a5ade57-1eaf-4e54-8704-2f99e97cd940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9fc07ad92d14ebc9c730404b48599e1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.614705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9e9a871-00d0-44c9-a420-e498899e0604 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6049aae8ed6442f6acd564bc10f3f8a3', 'request_id': 'req-e9e9a871-00d0-44c9-a420-e498899e0604'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.615567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9e9a871-00d0-44c9-a420-e498899e0604 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '6049aae8ed6442f6acd564bc10f3f8a3', 'request_id': 'req-e9e9a871-00d0-44c9-a420-e498899e0604'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.616859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a5ade57-1eaf-4e54-8704-2f99e97cd940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9fc07ad92d14ebc9c730404b48599e1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.639665 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3420/6836] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:30 2022] DELETE /identity/v3/users/f9fc07ad92d14ebc9c730404b48599e1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:30.641194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8066cd2-3a31-4afc-8e79-e946b0c4553e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:30.641490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8066cd2-3a31-4afc-8e79-e946b0c4553e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:30.641822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8066cd2-3a31-4afc-8e79-e946b0c4553e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:30.643501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9e9a871-00d0-44c9-a420-e498899e0604 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6049aae8ed6442f6acd564bc10f3f8a3', 'request_id': 'req-e9e9a871-00d0-44c9-a420-e498899e0604'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:30.663204 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3417/6837] 10.222.0.27 () {58 vars in 1254 bytes} [Sun Aug 28 18:50:30 2022] DELETE /identity/v3/OS-TRUST/trusts/6049aae8ed6442f6acd564bc10f3f8a3 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:30.666438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d8066cd2-3a31-4afc-8e79-e946b0c4553e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:30.667634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9a871-00d0-44c9-a420-e498899e0604 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:30.667744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d8066cd2-3a31-4afc-8e79-e946b0c4553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:30.669993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e9e9a871-00d0-44c9-a420-e498899e0604 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:30.687313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9a871-00d0-44c9-a420-e498899e0604 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:30.769017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07334d-71b1-4d7a-9eff-58fc63e867c6 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d0d54b5fe488ab00a8b4e5f6f8ba2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7df51698a3cf4632850706b1ad3056b0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-473954990', 'tempest-DelegatedRole-1269076650'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:30.769857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07334d-71b1-4d7a-9eff-58fc63e867c6 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:30.770342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07334d-71b1-4d7a-9eff-58fc63e867c6 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:30.770640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07334d-71b1-4d7a-9eff-58fc63e867c6 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] PATH_INFO: `/v3/OS-TRUST/trusts/6049aae8ed6442f6acd564bc10f3f8a3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:30.784108 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-2a07334d-71b1-4d7a-9eff-58fc63e867c6 tempest-TrustsV3TestJSON-1949482276 tempest-user-991118984] Could not find trust: 6049aae8ed6442f6acd564bc10f3f8a3.: keystone.exception.TrustNotFound: Could not find trust: 6049aae8ed6442f6acd564bc10f3f8a3. Aug 28 18:50:30.784108 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:30.784108 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:30.784108 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:30.784108 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:30.784108 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:30.784108 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:30.784108 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:30.784108 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:30.784108 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:30.784108 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:30.784108 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:30.784108 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 18:50:30.784108 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 18:50:30.784108 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 18:50:30.785119 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 18:50:30.785119 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 18:50:30.785119 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 18:50:30.785119 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 18:50:30.785119 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 18:50:30.785119 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:50:30.785119 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:50:30.785119 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 18:50:30.785119 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 18:50:30.785119 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 18:50:30.785119 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 18:50:30.785119 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 6049aae8ed6442f6acd564bc10f3f8a3. Aug 28 18:50:30.785119 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:30.788047 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3421/6838] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:30.788130 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3418/6839] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Aug 28 18:50:30 2022] GET /identity/v3/OS-TRUST/trusts/6049aae8ed6442f6acd564bc10f3f8a3 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 18:50:30.789859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8066cd2-3a31-4afc-8e79-e946b0c4553e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:30.791680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d8066cd2-3a31-4afc-8e79-e946b0c4553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:30.794372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156c6c5-598d-489c-9b93-9f5c0f1dbba2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:30.795960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156c6c5-598d-489c-9b93-9f5c0f1dbba2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:30.800139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156c6c5-598d-489c-9b93-9f5c0f1dbba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:30.845395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a156c6c5-598d-489c-9b93-9f5c0f1dbba2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:30.847200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a156c6c5-598d-489c-9b93-9f5c0f1dbba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:30.868582 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3419/6840] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:30.880606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156c6c5-598d-489c-9b93-9f5c0f1dbba2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:30.913908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8066cd2-3a31-4afc-8e79-e946b0c4553e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:30.922122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156c6c5-598d-489c-9b93-9f5c0f1dbba2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:30.927054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a0074-b296-46f0-a242-6a7592f81750 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:30.929176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a0074-b296-46f0-a242-6a7592f81750 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:30.929466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a0074-b296-46f0-a242-6a7592f81750 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:30.929753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a0074-b296-46f0-a242-6a7592f81750 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles/4bce21dbf50b4284a5c79553fc8fefc5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:30.931857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f80ba-7b4d-4819-a459-d01d8417130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:30.932872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f80ba-7b4d-4819-a459-d01d8417130f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:30.933591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a0074-b296-46f0-a242-6a7592f81750 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4bce21dbf50b4284a5c79553fc8fefc5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:30.933877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f80ba-7b4d-4819-a459-d01d8417130f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:30.934378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f80ba-7b4d-4819-a459-d01d8417130f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:30.935223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a0074-b296-46f0-a242-6a7592f81750 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:30.935782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f80ba-7b4d-4819-a459-d01d8417130f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:30.936333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f80ba-7b4d-4819-a459-d01d8417130f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:30.940790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f80ba-7b4d-4819-a459-d01d8417130f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:30.960337 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3420/6841] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:30.963274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f80ba-7b4d-4819-a459-d01d8417130f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:30.966825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-912f80ba-7b4d-4819-a459-d01d8417130f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:30.987596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f80ba-7b4d-4819-a459-d01d8417130f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:30.990521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1598b43-94fd-4e06-bd20-af9ca5c29322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:30.991179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598b43-94fd-4e06-bd20-af9ca5c29322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:30.991565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598b43-94fd-4e06-bd20-af9ca5c29322 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:30.991848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598b43-94fd-4e06-bd20-af9ca5c29322 admin admin] PATH_INFO: `/v3/projects/af5920f442694616888945571bcd719c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:30.993064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1598b43-94fd-4e06-bd20-af9ca5c29322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af5920f442694616888945571bcd719c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:31.000304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1598b43-94fd-4e06-bd20-af9ca5c29322 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:31.047697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-746a0074-b296-46f0-a242-6a7592f81750 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invalidating the token cache because role 4bce21dbf50b4284a5c79553fc8fefc5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:31.048047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-746a0074-b296-46f0-a242-6a7592f81750 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:31.048997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-746a0074-b296-46f0-a242-6a7592f81750 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:31.059649 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3422/6842] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:30 2022] DELETE /identity/v3/roles/4bce21dbf50b4284a5c79553fc8fefc5 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:50:31.066637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a0074-b296-46f0-a242-6a7592f81750 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:31.069109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-746a0074-b296-46f0-a242-6a7592f81750 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:31.142138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1598b43-94fd-4e06-bd20-af9ca5c29322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af5920f442694616888945571bcd719c', 'request_id': 'req-f1598b43-94fd-4e06-bd20-af9ca5c29322'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:31.155599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1598b43-94fd-4e06-bd20-af9ca5c29322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af5920f442694616888945571bcd719c', 'request_id': 'req-f1598b43-94fd-4e06-bd20-af9ca5c29322'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:31.163392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:31.176526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1598b43-94fd-4e06-bd20-af9ca5c29322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af5920f442694616888945571bcd719c', 'request_id': 'req-f1598b43-94fd-4e06-bd20-af9ca5c29322'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:31.193430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1598b43-94fd-4e06-bd20-af9ca5c29322 admin admin] The token cache is being invalidate because project af5920f442694616888945571bcd719c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:31.194148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1598b43-94fd-4e06-bd20-af9ca5c29322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:31.195442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1598b43-94fd-4e06-bd20-af9ca5c29322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:31.197690 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3421/6843] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:30 2022] DELETE /identity/v3/projects/af5920f442694616888945571bcd719c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:31.198812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1598b43-94fd-4e06-bd20-af9ca5c29322 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:31.200450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1598b43-94fd-4e06-bd20-af9ca5c29322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:31.208664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a0074-b296-46f0-a242-6a7592f81750 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:31.292446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:31.293882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dd34a-4e98-4dc7-b89a-379b0589cc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:31.295286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dd34a-4e98-4dc7-b89a-379b0589cc87 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:31.296184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dd34a-4e98-4dc7-b89a-379b0589cc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:31.296632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dd34a-4e98-4dc7-b89a-379b0589cc87 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:31.298430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dd34a-4e98-4dc7-b89a-379b0589cc87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:31.301693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dd34a-4e98-4dc7-b89a-379b0589cc87 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:31.325773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1598b43-94fd-4e06-bd20-af9ca5c29322 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:31.334812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f333ab-a226-4b37-9056-328ae64ee338 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:31.336628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f333ab-a226-4b37-9056-328ae64ee338 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:31.336971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f333ab-a226-4b37-9056-328ae64ee338 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:31.337467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f333ab-a226-4b37-9056-328ae64ee338 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles/02c60e10fcd240d7865789d9c412b0cd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:31.339046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f333ab-a226-4b37-9056-328ae64ee338 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=02c60e10fcd240d7865789d9c412b0cd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:31.340931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f333ab-a226-4b37-9056-328ae64ee338 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:31.379863 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3423/6844] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:31 2022] POST /identity/v3/projects => generated 403 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:31.382968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d554c9-f483-465d-9ad9-a559031ca471 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:31.383288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d554c9-f483-465d-9ad9-a559031ca471 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:31.383555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d554c9-f483-465d-9ad9-a559031ca471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:31.397636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97f333ab-a226-4b37-9056-328ae64ee338 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invalidating the token cache because role 02c60e10fcd240d7865789d9c412b0cd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:31.398232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97f333ab-a226-4b37-9056-328ae64ee338 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:31.399954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97f333ab-a226-4b37-9056-328ae64ee338 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:31.403147 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3422/6845] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:31 2022] DELETE /identity/v3/roles/02c60e10fcd240d7865789d9c412b0cd => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:31.407501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a5d554c9-f483-465d-9ad9-a559031ca471 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:31.407931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f333ab-a226-4b37-9056-328ae64ee338 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:31.408923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a5d554c9-f483-465d-9ad9-a559031ca471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:31.411624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97f333ab-a226-4b37-9056-328ae64ee338 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:31.496821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f333ab-a226-4b37-9056-328ae64ee338 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:31.497203 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3424/6846] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:31.498817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d554c9-f483-465d-9ad9-a559031ca471 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:31.500131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a5d554c9-f483-465d-9ad9-a559031ca471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:31.502295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913eb47-d58d-4938-89c7-a457267c71bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:31.503147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913eb47-d58d-4938-89c7-a457267c71bb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:31.503468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913eb47-d58d-4938-89c7-a457267c71bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:31.504102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913eb47-d58d-4938-89c7-a457267c71bb admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:31.504741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913eb47-d58d-4938-89c7-a457267c71bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:31.506696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913eb47-d58d-4938-89c7-a457267c71bb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:31.538814 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3423/6847] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:31 2022] POST /identity/v3/users => generated 302 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:31.540663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65660276-4307-482b-b207-48c345c5e649 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:31.541058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65660276-4307-482b-b207-48c345c5e649 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:31.541545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65660276-4307-482b-b207-48c345c5e649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:31.578018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-65660276-4307-482b-b207-48c345c5e649 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:31.579421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-65660276-4307-482b-b207-48c345c5e649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:31.601104 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3424/6848] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:31.602156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65660276-4307-482b-b207-48c345c5e649 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:31.607507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d554c9-f483-465d-9ad9-a559031ca471 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:31.615323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325f9e9-45b1-405a-857d-b08dc7c72848 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:31.615979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f9e9-45b1-405a-857d-b08dc7c72848 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:31.616260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f9e9-45b1-405a-857d-b08dc7c72848 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:31.616538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f9e9-45b1-405a-857d-b08dc7c72848 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users/2a6d0d54b5fe488ab00a8b4e5f6f8ba2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:31.618149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325f9e9-45b1-405a-857d-b08dc7c72848 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2a6d0d54b5fe488ab00a8b4e5f6f8ba2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:31.620160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325f9e9-45b1-405a-857d-b08dc7c72848 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:31.636209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65660276-4307-482b-b207-48c345c5e649 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:31.636387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:31.643409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afc472-dc91-48aa-9682-4992569da708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:31.644394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afc472-dc91-48aa-9682-4992569da708 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:31.644842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afc472-dc91-48aa-9682-4992569da708 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:31.645055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afc472-dc91-48aa-9682-4992569da708 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:31.645800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afc472-dc91-48aa-9682-4992569da708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:31.647707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afc472-dc91-48aa-9682-4992569da708 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:31.659589 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3425/6849] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:31.663572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afc472-dc91-48aa-9682-4992569da708 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:31.676647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afc472-dc91-48aa-9682-4992569da708 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:31.685409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3de30d-8430-41a9-bd9e-edbbb6d23bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:31.686039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3de30d-8430-41a9-bd9e-edbbb6d23bfa admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:31.686326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3de30d-8430-41a9-bd9e-edbbb6d23bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:31.686609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3de30d-8430-41a9-bd9e-edbbb6d23bfa admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:31.687284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3de30d-8430-41a9-bd9e-edbbb6d23bfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:31.687640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3de30d-8430-41a9-bd9e-edbbb6d23bfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:31.688945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1325f9e9-45b1-405a-857d-b08dc7c72848 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a6d0d54b5fe488ab00a8b4e5f6f8ba2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:31.689236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3de30d-8430-41a9-bd9e-edbbb6d23bfa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:31.726107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1325f9e9-45b1-405a-857d-b08dc7c72848 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a6d0d54b5fe488ab00a8b4e5f6f8ba2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:31.727036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1325f9e9-45b1-405a-857d-b08dc7c72848 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a6d0d54b5fe488ab00a8b4e5f6f8ba2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:31.728155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1325f9e9-45b1-405a-857d-b08dc7c72848 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a6d0d54b5fe488ab00a8b4e5f6f8ba2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:31.744175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1325f9e9-45b1-405a-857d-b08dc7c72848 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a6d0d54b5fe488ab00a8b4e5f6f8ba2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:31.753956 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3426/6850] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:31.753956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3de30d-8430-41a9-bd9e-edbbb6d23bfa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:31.755649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d3de30d-8430-41a9-bd9e-edbbb6d23bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:31.768249 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3425/6851] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:31 2022] DELETE /identity/v3/users/2a6d0d54b5fe488ab00a8b4e5f6f8ba2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:31.772537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325f9e9-45b1-405a-857d-b08dc7c72848 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:31.774059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1325f9e9-45b1-405a-857d-b08dc7c72848 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:31.792401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3de30d-8430-41a9-bd9e-edbbb6d23bfa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:31.884164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745065ae-ab19-4f10-9679-ace71e6aab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:31.884905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745065ae-ab19-4f10-9679-ace71e6aab20 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:31.885069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745065ae-ab19-4f10-9679-ace71e6aab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:31.885483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745065ae-ab19-4f10-9679-ace71e6aab20 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:31.886270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745065ae-ab19-4f10-9679-ace71e6aab20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:31.888663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745065ae-ab19-4f10-9679-ace71e6aab20 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:31.901301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325f9e9-45b1-405a-857d-b08dc7c72848 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:31.906515 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3427/6852] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:31.907406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745065ae-ab19-4f10-9679-ace71e6aab20 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:31.907534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa224935-f8c5-4ac5-8c92-1882eedfc871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:31.908205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa224935-f8c5-4ac5-8c92-1882eedfc871 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:31.908535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa224935-f8c5-4ac5-8c92-1882eedfc871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:31.908814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa224935-f8c5-4ac5-8c92-1882eedfc871 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:31.909406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-745065ae-ab19-4f10-9679-ace71e6aab20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:31.909759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa224935-f8c5-4ac5-8c92-1882eedfc871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:31.911812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa224935-f8c5-4ac5-8c92-1882eedfc871 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:31.925196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:31.966739 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3426/6853] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:31 2022] POST /identity/v3/projects => generated 371 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:31.966739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa224935-f8c5-4ac5-8c92-1882eedfc871 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:32.021915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745065ae-ab19-4f10-9679-ace71e6aab20 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:32.067953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa224935-f8c5-4ac5-8c92-1882eedfc871 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:32.073728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aacddb-49b7-4a73-b97b-b1264344a65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:32.074668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aacddb-49b7-4a73-b97b-b1264344a65a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:32.074945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aacddb-49b7-4a73-b97b-b1264344a65a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:32.075373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aacddb-49b7-4a73-b97b-b1264344a65a admin admin] PATH_INFO: `/v3/projects/8303f6615e89487fa35d124ebb991acd/users/e2378d99b6e34e7ab3600e59a1b22d37/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:32.093768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aacddb-49b7-4a73-b97b-b1264344a65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8303f6615e89487fa35d124ebb991acd, user_id=e2378d99b6e34e7ab3600e59a1b22d37, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:32.096988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd5aa7-95da-4972-a158-6d932c97dbb7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:32.097145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aacddb-49b7-4a73-b97b-b1264344a65a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:32.099686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd5aa7-95da-4972-a158-6d932c97dbb7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:32.099994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd5aa7-95da-4972-a158-6d932c97dbb7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:32.100281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd5aa7-95da-4972-a158-6d932c97dbb7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/7df51698a3cf4632850706b1ad3056b0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:32.102217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:32.102574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd5aa7-95da-4972-a158-6d932c97dbb7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7df51698a3cf4632850706b1ad3056b0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:32.105076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd5aa7-95da-4972-a158-6d932c97dbb7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:32.124456 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3427/6854] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:31 2022] PUT /identity/v3/projects/8303f6615e89487fa35d124ebb991acd/users/e2378d99b6e34e7ab3600e59a1b22d37/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:32.127810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aacddb-49b7-4a73-b97b-b1264344a65a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:32.261342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aacddb-49b7-4a73-b97b-b1264344a65a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:32.272238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1fd5aa7-95da-4972-a158-6d932c97dbb7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7df51698a3cf4632850706b1ad3056b0', 'request_id': 'req-e1fd5aa7-95da-4972-a158-6d932c97dbb7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:32.285930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1fd5aa7-95da-4972-a158-6d932c97dbb7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7df51698a3cf4632850706b1ad3056b0', 'request_id': 'req-e1fd5aa7-95da-4972-a158-6d932c97dbb7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:32.298563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1fd5aa7-95da-4972-a158-6d932c97dbb7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7df51698a3cf4632850706b1ad3056b0', 'request_id': 'req-e1fd5aa7-95da-4972-a158-6d932c97dbb7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:32.316847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1fd5aa7-95da-4972-a158-6d932c97dbb7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] The token cache is being invalidate because project 7df51698a3cf4632850706b1ad3056b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:32.317450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1fd5aa7-95da-4972-a158-6d932c97dbb7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:32.320174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1fd5aa7-95da-4972-a158-6d932c97dbb7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:32.320992 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3428/6855] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:31 2022] DELETE /identity/v3/projects/7df51698a3cf4632850706b1ad3056b0 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:32.322971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b5fd7-3546-4b72-80db-8bb8d897e9dc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:32.323389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b5fd7-3546-4b72-80db-8bb8d897e9dc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:32.323782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b5fd7-3546-4b72-80db-8bb8d897e9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:32.369890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0c5b5fd7-3546-4b72-80db-8bb8d897e9dc None None] MFA Rules not processed for user `e2378d99b6e34e7ab3600e59a1b22d37`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:32.371343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0c5b5fd7-3546-4b72-80db-8bb8d897e9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:32.387573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4f178-6e7e-451d-864e-09e6e4e05201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:32.388191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4f178-6e7e-451d-864e-09e6e4e05201 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:32.388453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4f178-6e7e-451d-864e-09e6e4e05201 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:32.388722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4f178-6e7e-451d-864e-09e6e4e05201 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:32.389356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4f178-6e7e-451d-864e-09e6e4e05201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:32.391608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4f178-6e7e-451d-864e-09e6e4e05201 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:32.434655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:32.447411 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3428/6856] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:32 2022] POST /identity/v3/users => generated 286 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:32.449950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4f178-6e7e-451d-864e-09e6e4e05201 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:32.454246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bbf4f178-6e7e-451d-864e-09e6e4e05201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:32.515915 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3429/6857] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:32 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:32.519633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b5fd7-3546-4b72-80db-8bb8d897e9dc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:32.519633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0c5b5fd7-3546-4b72-80db-8bb8d897e9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:32.537129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b5fd7-3546-4b72-80db-8bb8d897e9dc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:32.542783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755acff-b04a-42fb-91ed-1247cce9ac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:32.543561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755acff-b04a-42fb-91ed-1247cce9ac7e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:32.543946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755acff-b04a-42fb-91ed-1247cce9ac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:32.544321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755acff-b04a-42fb-91ed-1247cce9ac7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:32.545087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755acff-b04a-42fb-91ed-1247cce9ac7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:32.546999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755acff-b04a-42fb-91ed-1247cce9ac7e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:32.558460 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3430/6858] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:32.559591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755acff-b04a-42fb-91ed-1247cce9ac7e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:32.562161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4755acff-b04a-42fb-91ed-1247cce9ac7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:32.607731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755acff-b04a-42fb-91ed-1247cce9ac7e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:32.613035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f011de5-4012-4a48-9778-bcc40b6caac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:32.613829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f011de5-4012-4a48-9778-bcc40b6caac9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:32.614210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f011de5-4012-4a48-9778-bcc40b6caac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:32.614590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f011de5-4012-4a48-9778-bcc40b6caac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:32.615760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f011de5-4012-4a48-9778-bcc40b6caac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:32.618246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f011de5-4012-4a48-9778-bcc40b6caac9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:32.659083 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3431/6859] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:32 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:32.660292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f011de5-4012-4a48-9778-bcc40b6caac9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:32.660732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4f178-6e7e-451d-864e-09e6e4e05201 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:32.725086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:32.764325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285e239-069d-4b48-8587-ac971862747e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:32.765511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285e239-069d-4b48-8587-ac971862747e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:32.766027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285e239-069d-4b48-8587-ac971862747e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:32.766450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285e239-069d-4b48-8587-ac971862747e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:32.767244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285e239-069d-4b48-8587-ac971862747e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:32.769687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285e239-069d-4b48-8587-ac971862747e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:32.780790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f011de5-4012-4a48-9778-bcc40b6caac9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:32.800279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65817b-044d-4826-a005-7db3cf18169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:32.800926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65817b-044d-4826-a005-7db3cf18169c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:32.801203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65817b-044d-4826-a005-7db3cf18169c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:32.801659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65817b-044d-4826-a005-7db3cf18169c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:32.802486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65817b-044d-4826-a005-7db3cf18169c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:32.804158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65817b-044d-4826-a005-7db3cf18169c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:32.831072 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3432/6860] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:32.832843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65817b-044d-4826-a005-7db3cf18169c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:32.836494 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3429/6861] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:50:32 2022] POST /identity/v3/projects => generated 329 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:32.840890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285e239-069d-4b48-8587-ac971862747e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:32.861876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65817b-044d-4826-a005-7db3cf18169c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:32.950544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285e239-069d-4b48-8587-ac971862747e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:32.955478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db015b4-058f-4ea7-b8cb-f590afe8b652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:32.956383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db015b4-058f-4ea7-b8cb-f590afe8b652 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:32.956662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db015b4-058f-4ea7-b8cb-f590afe8b652 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:32.956938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db015b4-058f-4ea7-b8cb-f590afe8b652 admin admin] PATH_INFO: `/v3/projects/34a067fddd5547c18eadc492bcef2ce7/users/355053b0b5764a86ad4fa3ae2c68b963/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:32.986562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9939b1-b8f2-4739-b3f2-b7af146dde1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:32.987158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db015b4-058f-4ea7-b8cb-f590afe8b652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a067fddd5547c18eadc492bcef2ce7, user_id=355053b0b5764a86ad4fa3ae2c68b963, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:32.987489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9939b1-b8f2-4739-b3f2-b7af146dde1a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:32.987998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9939b1-b8f2-4739-b3f2-b7af146dde1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:32.988423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9939b1-b8f2-4739-b3f2-b7af146dde1a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:32.989271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9939b1-b8f2-4739-b3f2-b7af146dde1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:32.990989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db015b4-058f-4ea7-b8cb-f590afe8b652 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:32.991598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9939b1-b8f2-4739-b3f2-b7af146dde1a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:33.035041 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3430/6862] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:32 2022] PUT /identity/v3/projects/34a067fddd5547c18eadc492bcef2ce7/users/355053b0b5764a86ad4fa3ae2c68b963/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:33.035041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db015b4-058f-4ea7-b8cb-f590afe8b652 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:33.039495 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3433/6863] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:32 2022] POST /identity/v3/users => generated 308 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:33.042603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabc8c5-8896-4f13-9bf0-412582b8c819 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:33.042755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabc8c5-8896-4f13-9bf0-412582b8c819 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:33.043279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabc8c5-8896-4f13-9bf0-412582b8c819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:33.089520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6aabc8c5-8896-4f13-9bf0-412582b8c819 None None] MFA Rules not processed for user `355053b0b5764a86ad4fa3ae2c68b963`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:33.091119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6aabc8c5-8896-4f13-9bf0-412582b8c819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:33.108053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:33.164761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db015b4-058f-4ea7-b8cb-f590afe8b652 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:33.175407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcc226-3f4d-4e2c-8814-f225e3c2c915 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:33.176083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcc226-3f4d-4e2c-8814-f225e3c2c915 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:33.176372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcc226-3f4d-4e2c-8814-f225e3c2c915 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:33.176643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcc226-3f4d-4e2c-8814-f225e3c2c915 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:33.177309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcc226-3f4d-4e2c-8814-f225e3c2c915 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:33.179235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcc226-3f4d-4e2c-8814-f225e3c2c915 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:33.180371 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3434/6864] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:33.181311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabc8c5-8896-4f13-9bf0-412582b8c819 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:33.229040 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3431/6865] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:33 2022] POST /identity/v3/users => generated 416 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:33.229632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcc226-3f4d-4e2c-8814-f225e3c2c915 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:33.253074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabc8c5-8896-4f13-9bf0-412582b8c819 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:33.264161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec76679-b7db-48a9-8479-d6046e8d975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:33.264794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76679-b7db-48a9-8479-d6046e8d975c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:33.265074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76679-b7db-48a9-8479-d6046e8d975c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:33.265349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76679-b7db-48a9-8479-d6046e8d975c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:33.266008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec76679-b7db-48a9-8479-d6046e8d975c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:33.267872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec76679-b7db-48a9-8479-d6046e8d975c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:33.292807 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3435/6866] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:33.292807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec76679-b7db-48a9-8479-d6046e8d975c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:33.305859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec76679-b7db-48a9-8479-d6046e8d975c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:33.306549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:33.315164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b84aa-d878-4c8d-ae41-4185aab291f7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:33.315909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b84aa-d878-4c8d-ae41-4185aab291f7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:33.316195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b84aa-d878-4c8d-ae41-4185aab291f7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:33.316474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b84aa-d878-4c8d-ae41-4185aab291f7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:33.317474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b84aa-d878-4c8d-ae41-4185aab291f7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:33.319096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b84aa-d878-4c8d-ae41-4185aab291f7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:33.344549 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3436/6867] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:50:33 2022] POST /identity/v3/roles => generated 243 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:33.348966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b84aa-d878-4c8d-ae41-4185aab291f7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:33.357027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcc226-3f4d-4e2c-8814-f225e3c2c915 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:33.368317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d089d-756e-4cd3-85b6-be24dfb412be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:33.368971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d089d-756e-4cd3-85b6-be24dfb412be admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:33.369253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d089d-756e-4cd3-85b6-be24dfb412be admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:33.369525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d089d-756e-4cd3-85b6-be24dfb412be admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:33.370183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d089d-756e-4cd3-85b6-be24dfb412be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:33.375745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b84aa-d878-4c8d-ae41-4185aab291f7 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:33.376747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d089d-756e-4cd3-85b6-be24dfb412be admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:33.402171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd82f7-9152-4f46-9e23-42304ba07944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:33.402866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd82f7-9152-4f46-9e23-42304ba07944 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:33.403141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd82f7-9152-4f46-9e23-42304ba07944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:33.403449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd82f7-9152-4f46-9e23-42304ba07944 admin admin] PATH_INFO: `/v3/projects/58baef9b94e845dfa697a4181d3db17b/users/b5be114f80444436af654ca44ba43c11/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:33.430019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd82f7-9152-4f46-9e23-42304ba07944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58baef9b94e845dfa697a4181d3db17b, user_id=b5be114f80444436af654ca44ba43c11, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:33.437207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd82f7-9152-4f46-9e23-42304ba07944 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:33.444782 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3432/6868] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:33 2022] POST /identity/v3/projects => generated 371 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:33.446527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d089d-756e-4cd3-85b6-be24dfb412be admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:33.465019 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3437/6869] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:33 2022] PUT /identity/v3/projects/58baef9b94e845dfa697a4181d3db17b/users/b5be114f80444436af654ca44ba43c11/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:33.466136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd82f7-9152-4f46-9e23-42304ba07944 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:33.573264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d089d-756e-4cd3-85b6-be24dfb412be admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:33.599702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd82f7-9152-4f46-9e23-42304ba07944 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:33.612900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a326c4-f081-4fce-bfdf-bf4bfd47e5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:33.613547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a326c4-f081-4fce-bfdf-bf4bfd47e5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:33.619565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a326c4-f081-4fce-bfdf-bf4bfd47e5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:33.620099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a326c4-f081-4fce-bfdf-bf4bfd47e5c4 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:33.621002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a326c4-f081-4fce-bfdf-bf4bfd47e5c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:33.623467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a326c4-f081-4fce-bfdf-bf4bfd47e5c4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:33.661445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ad38e-6570-4ce7-aac6-885cc414c7d6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:33.662297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ad38e-6570-4ce7-aac6-885cc414c7d6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:33.662698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ad38e-6570-4ce7-aac6-885cc414c7d6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:33.663307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ad38e-6570-4ce7-aac6-885cc414c7d6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:33.664117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ad38e-6570-4ce7-aac6-885cc414c7d6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:33.665924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ad38e-6570-4ce7-aac6-885cc414c7d6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:33.681727 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3438/6870] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:33 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:33.682757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a326c4-f081-4fce-bfdf-bf4bfd47e5c4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:33.686626 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3433/6871] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:50:33 2022] POST /identity/v3/roles => generated 247 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:33.687840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ad38e-6570-4ce7-aac6-885cc414c7d6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:33.694248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:33.700806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a326c4-f081-4fce-bfdf-bf4bfd47e5c4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:33.702689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ad38e-6570-4ce7-aac6-885cc414c7d6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:33.707944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1b3ec-3518-4c76-8ba6-52b273a294d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:33.708646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1b3ec-3518-4c76-8ba6-52b273a294d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:33.709253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1b3ec-3518-4c76-8ba6-52b273a294d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:33.709594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1b3ec-3518-4c76-8ba6-52b273a294d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:33.709989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abe36c-bf86-4b39-8194-15d2c4196eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:33.710768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abe36c-bf86-4b39-8194-15d2c4196eee admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:33.711197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abe36c-bf86-4b39-8194-15d2c4196eee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:33.711431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1b3ec-3518-4c76-8ba6-52b273a294d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:33.711938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abe36c-bf86-4b39-8194-15d2c4196eee admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:33.712736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abe36c-bf86-4b39-8194-15d2c4196eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:33.713285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1b3ec-3518-4c76-8ba6-52b273a294d5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:33.714690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abe36c-bf86-4b39-8194-15d2c4196eee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:33.731181 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3439/6872] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:33 2022] GET /identity/v3/roles => generated 1892 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:33.731711 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3434/6873] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:33 2022] GET /identity/v3/roles => generated 1892 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:33.732263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1b3ec-3518-4c76-8ba6-52b273a294d5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:33.736060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abe36c-bf86-4b39-8194-15d2c4196eee admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:33.752740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abe36c-bf86-4b39-8194-15d2c4196eee admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:33.753487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1b3ec-3518-4c76-8ba6-52b273a294d5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:33.759440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc3cdb-e36d-4e5e-8c32-21968030e1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:33.770105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc3cdb-e36d-4e5e-8c32-21968030e1df admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:33.770105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc3cdb-e36d-4e5e-8c32-21968030e1df admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:33.770105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc3cdb-e36d-4e5e-8c32-21968030e1df admin admin] PATH_INFO: `/v3/projects/045d0ef424644c28a3b09fef3607b27a/users/2b2bcf06cebb49d7b485f0b67ecd7cf8/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:33.778024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b630c37-2449-4b31-bc6e-013870b030a8 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:33.778724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b630c37-2449-4b31-bc6e-013870b030a8 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:33.779010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b630c37-2449-4b31-bc6e-013870b030a8 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:33.779314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b630c37-2449-4b31-bc6e-013870b030a8 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/df8da38254a34c87a94b8d4539f37da3/users/347c18b7c139449fab631e69cb495d32/roles/3c33ad78394a4ce2975cb055d65e4f74` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:33.805632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc3cdb-e36d-4e5e-8c32-21968030e1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=045d0ef424644c28a3b09fef3607b27a, user_id=2b2bcf06cebb49d7b485f0b67ecd7cf8, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:33.808451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc3cdb-e36d-4e5e-8c32-21968030e1df admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:33.813827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b630c37-2449-4b31-bc6e-013870b030a8 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_grant(project_id=df8da38254a34c87a94b8d4539f37da3, user_id=347c18b7c139449fab631e69cb495d32, role_id=3c33ad78394a4ce2975cb055d65e4f74)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:33.817978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b630c37-2449-4b31-bc6e-013870b030a8 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:33.836277 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3435/6874] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:33 2022] PUT /identity/v3/projects/045d0ef424644c28a3b09fef3607b27a/users/2b2bcf06cebb49d7b485f0b67ecd7cf8/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:33.840433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc3cdb-e36d-4e5e-8c32-21968030e1df admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:33.844250 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3440/6875] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:33 2022] PUT /identity/v3/projects/df8da38254a34c87a94b8d4539f37da3/users/347c18b7c139449fab631e69cb495d32/roles/3c33ad78394a4ce2975cb055d65e4f74 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:33.844996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b630c37-2449-4b31-bc6e-013870b030a8 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:33.877657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:33.917339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc3cdb-e36d-4e5e-8c32-21968030e1df admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:33.965099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b630c37-2449-4b31-bc6e-013870b030a8 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:33.971104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9435e-8cfa-48bf-a186-3daa1dc2e918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:33.971883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9435e-8cfa-48bf-a186-3daa1dc2e918 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:33.972273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9435e-8cfa-48bf-a186-3daa1dc2e918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:33.972804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9435e-8cfa-48bf-a186-3daa1dc2e918 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:33.973838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9435e-8cfa-48bf-a186-3daa1dc2e918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:33.975693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9435e-8cfa-48bf-a186-3daa1dc2e918 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:33.993992 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3441/6876] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:33 2022] GET /identity/v3/roles => generated 1892 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:33.993992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9435e-8cfa-48bf-a186-3daa1dc2e918 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:33.998136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f02cae-4625-432f-b170-8345660e7da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:33.999345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f02cae-4625-432f-b170-8345660e7da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:33.999819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f02cae-4625-432f-b170-8345660e7da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:34.001104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f02cae-4625-432f-b170-8345660e7da8 admin admin] PATH_INFO: `/v3/projects/58baef9b94e845dfa697a4181d3db17b/users/b5be114f80444436af654ca44ba43c11/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:34.005578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f02cae-4625-432f-b170-8345660e7da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58baef9b94e845dfa697a4181d3db17b, user_id=b5be114f80444436af654ca44ba43c11, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:34.009206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f02cae-4625-432f-b170-8345660e7da8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:34.063993 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3436/6877] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:33 2022] PUT /identity/v3/projects/58baef9b94e845dfa697a4181d3db17b/users/b5be114f80444436af654ca44ba43c11/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:34.076423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f02cae-4625-432f-b170-8345660e7da8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:34.100048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9435e-8cfa-48bf-a186-3daa1dc2e918 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:34.209503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f02cae-4625-432f-b170-8345660e7da8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:34.214893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee7976-28e1-45d2-9323-bc88bffd72db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:34.215812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee7976-28e1-45d2-9323-bc88bffd72db admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:34.216119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee7976-28e1-45d2-9323-bc88bffd72db admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:34.216467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee7976-28e1-45d2-9323-bc88bffd72db admin admin] PATH_INFO: `/v3/projects/045d0ef424644c28a3b09fef3607b27a/users/2b2bcf06cebb49d7b485f0b67ecd7cf8/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:34.218537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee7976-28e1-45d2-9323-bc88bffd72db admin admin] RBAC: Authorizing `identity:create_grant(project_id=045d0ef424644c28a3b09fef3607b27a, user_id=2b2bcf06cebb49d7b485f0b67ecd7cf8, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:34.221641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee7976-28e1-45d2-9323-bc88bffd72db admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:34.235266 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3437/6878] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:34 2022] PUT /identity/v3/projects/045d0ef424644c28a3b09fef3607b27a/users/2b2bcf06cebb49d7b485f0b67ecd7cf8/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:34.237013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d457bec-b9ff-4a66-87b2-30ec1eb9e9ee None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:34.237303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d457bec-b9ff-4a66-87b2-30ec1eb9e9ee None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:34.237578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d457bec-b9ff-4a66-87b2-30ec1eb9e9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:34.238772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0a80b-0cf6-432a-ba8a-fd18d8df40d9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:34.239855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0a80b-0cf6-432a-ba8a-fd18d8df40d9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:34.240427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0a80b-0cf6-432a-ba8a-fd18d8df40d9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:34.240852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0a80b-0cf6-432a-ba8a-fd18d8df40d9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/df8da38254a34c87a94b8d4539f37da3/users/347c18b7c139449fab631e69cb495d32/roles/0fbf7a89cf4f4cabb840631c5371b3cf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:34.248929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0a80b-0cf6-432a-ba8a-fd18d8df40d9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_grant(project_id=df8da38254a34c87a94b8d4539f37da3, user_id=347c18b7c139449fab631e69cb495d32, role_id=0fbf7a89cf4f4cabb840631c5371b3cf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:34.252228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0a80b-0cf6-432a-ba8a-fd18d8df40d9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:34.271355 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3442/6879] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:33 2022] PUT /identity/v3/projects/df8da38254a34c87a94b8d4539f37da3/users/347c18b7c139449fab631e69cb495d32/roles/0fbf7a89cf4f4cabb840631c5371b3cf => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:34.272718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3bf05-4a72-48cd-9d22-28fbdfb29253 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:34.273151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3bf05-4a72-48cd-9d22-28fbdfb29253 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:34.273516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3bf05-4a72-48cd-9d22-28fbdfb29253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:34.283973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:34.285533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1d457bec-b9ff-4a66-87b2-30ec1eb9e9ee None None] MFA Rules not processed for user `b5be114f80444436af654ca44ba43c11`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:34.286976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d457bec-b9ff-4a66-87b2-30ec1eb9e9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:34.311710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-99e3bf05-4a72-48cd-9d22-28fbdfb29253 None None] MFA Rules not processed for user `2b2bcf06cebb49d7b485f0b67ecd7cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:34.312981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-99e3bf05-4a72-48cd-9d22-28fbdfb29253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:34.387409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:34.412959 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3443/6880] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:34.416008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3bf05-4a72-48cd-9d22-28fbdfb29253 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:34.425524 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3438/6881] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:34 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:34.426631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d457bec-b9ff-4a66-87b2-30ec1eb9e9ee None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:34.428575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d457bec-b9ff-4a66-87b2-30ec1eb9e9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:34.536605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d457bec-b9ff-4a66-87b2-30ec1eb9e9ee None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:34.538651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3bf05-4a72-48cd-9d22-28fbdfb29253 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:34.541961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b3068-2df3-41af-931b-91dba45e9238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:34.543029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b3068-2df3-41af-931b-91dba45e9238 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:34.543594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b3068-2df3-41af-931b-91dba45e9238 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:34.544032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b3068-2df3-41af-931b-91dba45e9238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:34.544151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611bef7-9b9d-4f5b-bf8e-4fb56bbbfd41 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:34.544703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611bef7-9b9d-4f5b-bf8e-4fb56bbbfd41 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:34.544986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611bef7-9b9d-4f5b-bf8e-4fb56bbbfd41 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:34.545347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611bef7-9b9d-4f5b-bf8e-4fb56bbbfd41 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:34.546018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611bef7-9b9d-4f5b-bf8e-4fb56bbbfd41 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:34.548152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611bef7-9b9d-4f5b-bf8e-4fb56bbbfd41 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:34.559012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b3068-2df3-41af-931b-91dba45e9238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:34.560767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b3068-2df3-41af-931b-91dba45e9238 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:34.572942 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3439/6882] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:34.574188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b3068-2df3-41af-931b-91dba45e9238 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:34.585373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b3068-2df3-41af-931b-91dba45e9238 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:34.590662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835be6bc-8e27-4cff-9978-ce47ca8b7150 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5be114f80444436af654ca44ba43c11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58baef9b94e845dfa697a4181d3db17b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:34.591284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835be6bc-8e27-4cff-9978-ce47ca8b7150 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:34.591586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835be6bc-8e27-4cff-9978-ce47ca8b7150 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:34.591898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835be6bc-8e27-4cff-9978-ce47ca8b7150 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:34.592569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835be6bc-8e27-4cff-9978-ce47ca8b7150 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:34.594327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835be6bc-8e27-4cff-9978-ce47ca8b7150 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:34.616930 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3440/6883] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:50:34 2022] POST /identity/v3/roles => generated 240 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:34.618201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835be6bc-8e27-4cff-9978-ce47ca8b7150 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:34.630070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835be6bc-8e27-4cff-9978-ce47ca8b7150 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:34.634999 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3444/6884] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:34 2022] GET /identity/v3/users => generated 8349 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:34.636064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacbf38-9f4e-4a8a-9e99-776fa321d5a0 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5be114f80444436af654ca44ba43c11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58baef9b94e845dfa697a4181d3db17b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:34.636740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacbf38-9f4e-4a8a-9e99-776fa321d5a0 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:34.637020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacbf38-9f4e-4a8a-9e99-776fa321d5a0 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:34.637294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacbf38-9f4e-4a8a-9e99-776fa321d5a0 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] PATH_INFO: `/v3/projects/8303f6615e89487fa35d124ebb991acd/users/e2378d99b6e34e7ab3600e59a1b22d37/roles/72cb833a594049b0bc9f8d4a2f24bfc7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:34.639594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacbf38-9f4e-4a8a-9e99-776fa321d5a0 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8303f6615e89487fa35d124ebb991acd, user_id=e2378d99b6e34e7ab3600e59a1b22d37, role_id=72cb833a594049b0bc9f8d4a2f24bfc7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:34.640389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa0d0a-fc69-475b-bd90-34f7d57be74a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:34.640665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa0d0a-fc69-475b-bd90-34f7d57be74a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:34.640938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa0d0a-fc69-475b-bd90-34f7d57be74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:34.642827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacbf38-9f4e-4a8a-9e99-776fa321d5a0 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:34.669701 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3441/6885] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:34 2022] PUT /identity/v3/projects/8303f6615e89487fa35d124ebb991acd/users/e2378d99b6e34e7ab3600e59a1b22d37/roles/72cb833a594049b0bc9f8d4a2f24bfc7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:34.675003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacbf38-9f4e-4a8a-9e99-776fa321d5a0 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:34.711353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fbfa0d0a-fc69-475b-bd90-34f7d57be74a None None] MFA Rules not processed for user `347c18b7c139449fab631e69cb495d32`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:34.713142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fbfa0d0a-fc69-475b-bd90-34f7d57be74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:34.809523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacbf38-9f4e-4a8a-9e99-776fa321d5a0 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:34.821976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d6382-1d2c-4fed-8f00-6b219101bb62 tempest-ApplicationCredentialsV3AdminTest-1006395110 tempest-ApplicationCredentialsV3AdminTest-1006395110-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2378d99b6e34e7ab3600e59a1b22d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8303f6615e89487fa35d124ebb991acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'tempest-test_role-1526012584'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:34.822804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d6382-1d2c-4fed-8f00-6b219101bb62 tempest-ApplicationCredentialsV3AdminTest-1006395110 tempest-ApplicationCredentialsV3AdminTest-1006395110-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:34.823183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d6382-1d2c-4fed-8f00-6b219101bb62 tempest-ApplicationCredentialsV3AdminTest-1006395110 tempest-ApplicationCredentialsV3AdminTest-1006395110-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:34.823586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d6382-1d2c-4fed-8f00-6b219101bb62 tempest-ApplicationCredentialsV3AdminTest-1006395110 tempest-ApplicationCredentialsV3AdminTest-1006395110-project] PATH_INFO: `/v3/users/e2378d99b6e34e7ab3600e59a1b22d37/application_credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:34.824499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d6382-1d2c-4fed-8f00-6b219101bb62 tempest-ApplicationCredentialsV3AdminTest-1006395110 tempest-ApplicationCredentialsV3AdminTest-1006395110-project] RBAC: Authorizing `identity:create_application_credential(user_id=e2378d99b6e34e7ab3600e59a1b22d37)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:34.826898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d6382-1d2c-4fed-8f00-6b219101bb62 tempest-ApplicationCredentialsV3AdminTest-1006395110 tempest-ApplicationCredentialsV3AdminTest-1006395110-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:34.904332 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3445/6886] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:34 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:34.998710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5fef7-992a-48ff-8de5-73ac3f647e79 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:34.998710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5fef7-992a-48ff-8de5-73ac3f647e79 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:34.998939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5fef7-992a-48ff-8de5-73ac3f647e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:35.020601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:35.041630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-62a5fef7-992a-48ff-8de5-73ac3f647e79 None None] MFA Rules not processed for user `347c18b7c139449fab631e69cb495d32`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:35.041630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-62a5fef7-992a-48ff-8de5-73ac3f647e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:35.062144 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3446/6887] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:34 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:50:35.070388 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3442/6888] 10.222.0.27 () {60 vars in 1315 bytes} [Sun Aug 28 18:50:34 2022] POST /identity/v3/users/e2378d99b6e34e7ab3600e59a1b22d37/application_credentials => generated 659 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:35.070646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ac040-7392-4470-a0bd-7f6150754d91 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:35.070864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ac040-7392-4470-a0bd-7f6150754d91 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:35.072797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ac040-7392-4470-a0bd-7f6150754d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:35.074820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d6382-1d2c-4fed-8f00-6b219101bb62 tempest-ApplicationCredentialsV3AdminTest-1006395110 tempest-ApplicationCredentialsV3AdminTest-1006395110-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:35.077788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:35.098272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d6382-1d2c-4fed-8f00-6b219101bb62 tempest-ApplicationCredentialsV3AdminTest-1006395110 tempest-ApplicationCredentialsV3AdminTest-1006395110-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:35.103468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b572961-3f55-4d5a-999c-2107a8a72e62 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '347c18b7c139449fab631e69cb495d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8da38254a34c87a94b8d4539f37da3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1962298515', 'tempest-DelegatedRole-199599837'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:35.104238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b572961-3f55-4d5a-999c-2107a8a72e62 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:35.104520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b572961-3f55-4d5a-999c-2107a8a72e62 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:35.105006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b572961-3f55-4d5a-999c-2107a8a72e62 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:35.106174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b572961-3f55-4d5a-999c-2107a8a72e62 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: Authorizing `identity:create_trust()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:35.107719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b572961-3f55-4d5a-999c-2107a8a72e62 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:35.121445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-735ac040-7392-4470-a0bd-7f6150754d91 None None] MFA Rules not processed for user `e2378d99b6e34e7ab3600e59a1b22d37`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:35.122692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-735ac040-7392-4470-a0bd-7f6150754d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:35.228444 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3443/6889] 10.222.0.27 () {60 vars in 1174 bytes} [Sun Aug 28 18:50:35 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:35.229902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b572961-3f55-4d5a-999c-2107a8a72e62 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:35.254380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b572961-3f55-4d5a-999c-2107a8a72e62 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:35.265570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1b6f6-5ea7-4449-a97e-ac55b0048179 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '347c18b7c139449fab631e69cb495d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8da38254a34c87a94b8d4539f37da3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1962298515', 'tempest-DelegatedRole-199599837'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:35.267512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1b6f6-5ea7-4449-a97e-ac55b0048179 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:35.267790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1b6f6-5ea7-4449-a97e-ac55b0048179 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:35.268067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1b6f6-5ea7-4449-a97e-ac55b0048179 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] PATH_INFO: `/v3/OS-TRUST/trusts/47e2e07a6ba94741a955db10b6434765` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:35.281744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1b6f6-5ea7-4449-a97e-ac55b0048179 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: Authorizing `identity:get_trust(trust_id=47e2e07a6ba94741a955db10b6434765)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:35.284480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1b6f6-5ea7-4449-a97e-ac55b0048179 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:35.298330 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3444/6890] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Aug 28 18:50:35 2022] GET /identity/v3/OS-TRUST/trusts/47e2e07a6ba94741a955db10b6434765 => generated 858 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:35.303100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1b6f6-5ea7-4449-a97e-ac55b0048179 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:35.326695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1b6f6-5ea7-4449-a97e-ac55b0048179 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:35.330855 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3447/6891] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:35 2022] POST /identity/v3/auth/tokens => generated 3396 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Aug 28 18:50:35.330855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ac040-7392-4470-a0bd-7f6150754d91 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:35.334562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcd004-cd3c-44f1-bb2a-b9872f7b54d4 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '347c18b7c139449fab631e69cb495d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8da38254a34c87a94b8d4539f37da3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1962298515', 'tempest-DelegatedRole-199599837'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:35.335355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcd004-cd3c-44f1-bb2a-b9872f7b54d4 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:35.336613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcd004-cd3c-44f1-bb2a-b9872f7b54d4 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:35.336901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcd004-cd3c-44f1-bb2a-b9872f7b54d4 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] PATH_INFO: `/v3/OS-TRUST/trusts/47e2e07a6ba94741a955db10b6434765/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:35.343410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcd004-cd3c-44f1-bb2a-b9872f7b54d4 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=47e2e07a6ba94741a955db10b6434765)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:35.345044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcd004-cd3c-44f1-bb2a-b9872f7b54d4 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:35.352929 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3445/6892] 10.222.0.27 () {58 vars in 1269 bytes} [Sun Aug 28 18:50:35 2022] GET /identity/v3/OS-TRUST/trusts/47e2e07a6ba94741a955db10b6434765/roles => generated 370 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:35.353872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcd004-cd3c-44f1-bb2a-b9872f7b54d4 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:35.381250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcd004-cd3c-44f1-bb2a-b9872f7b54d4 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:35.388848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6384cc1-71ca-4fd5-9671-0a2385c88953 tempest-ApplicationCredentialsV3AdminTest-1006395110 tempest-ApplicationCredentialsV3AdminTest-1006395110-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2378d99b6e34e7ab3600e59a1b22d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8303f6615e89487fa35d124ebb991acd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'tempest-test_role-1526012584'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:35.389666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6384cc1-71ca-4fd5-9671-0a2385c88953 tempest-ApplicationCredentialsV3AdminTest-1006395110 tempest-ApplicationCredentialsV3AdminTest-1006395110-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:35.389952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6384cc1-71ca-4fd5-9671-0a2385c88953 tempest-ApplicationCredentialsV3AdminTest-1006395110 tempest-ApplicationCredentialsV3AdminTest-1006395110-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:35.390307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6384cc1-71ca-4fd5-9671-0a2385c88953 tempest-ApplicationCredentialsV3AdminTest-1006395110 tempest-ApplicationCredentialsV3AdminTest-1006395110-project] PATH_INFO: `/v3/users/e2378d99b6e34e7ab3600e59a1b22d37/application_credentials/83129632243b4e8fabe2e2c1418ba0d6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:35.391870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6384cc1-71ca-4fd5-9671-0a2385c88953 tempest-ApplicationCredentialsV3AdminTest-1006395110 tempest-ApplicationCredentialsV3AdminTest-1006395110-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e2378d99b6e34e7ab3600e59a1b22d37, application_credential_id=83129632243b4e8fabe2e2c1418ba0d6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:35.393935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6384cc1-71ca-4fd5-9671-0a2385c88953 tempest-ApplicationCredentialsV3AdminTest-1006395110 tempest-ApplicationCredentialsV3AdminTest-1006395110-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:35.421090 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3446/6893] 10.222.0.27 () {58 vars in 1395 bytes} [Sun Aug 28 18:50:35 2022] DELETE /identity/v3/users/e2378d99b6e34e7ab3600e59a1b22d37/application_credentials/83129632243b4e8fabe2e2c1418ba0d6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:35.422165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6384cc1-71ca-4fd5-9671-0a2385c88953 tempest-ApplicationCredentialsV3AdminTest-1006395110 tempest-ApplicationCredentialsV3AdminTest-1006395110-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:35.439153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6384cc1-71ca-4fd5-9671-0a2385c88953 tempest-ApplicationCredentialsV3AdminTest-1006395110 tempest-ApplicationCredentialsV3AdminTest-1006395110-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:35.444025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dddb5-9d54-46aa-b6cf-d38e3c728666 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '347c18b7c139449fab631e69cb495d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8da38254a34c87a94b8d4539f37da3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1962298515', 'tempest-DelegatedRole-199599837'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:35.444714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dddb5-9d54-46aa-b6cf-d38e3c728666 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:35.445085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dddb5-9d54-46aa-b6cf-d38e3c728666 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:35.445567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dddb5-9d54-46aa-b6cf-d38e3c728666 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] PATH_INFO: `/v3/OS-TRUST/trusts/47e2e07a6ba94741a955db10b6434765/roles/3c33ad78394a4ce2975cb055d65e4f74` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:35.453532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347dddb5-9d54-46aa-b6cf-d38e3c728666 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: Authorizing `identity:get_role_for_trust(trust_id=47e2e07a6ba94741a955db10b6434765, role_id=3c33ad78394a4ce2975cb055d65e4f74)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:35.455228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347dddb5-9d54-46aa-b6cf-d38e3c728666 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:35.467639 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3447/6894] 10.222.0.27 () {58 vars in 1368 bytes} [Sun Aug 28 18:50:35 2022] GET /identity/v3/OS-TRUST/trusts/47e2e07a6ba94741a955db10b6434765/roles/3c33ad78394a4ce2975cb055d65e4f74 => generated 243 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:35.468859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dddb5-9d54-46aa-b6cf-d38e3c728666 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:35.472575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ac040-7392-4470-a0bd-7f6150754d91 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:35.478826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3c0e3-08fb-4be2-bb4d-d2c4990a3325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:35.480011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3c0e3-08fb-4be2-bb4d-d2c4990a3325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:35.480598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3c0e3-08fb-4be2-bb4d-d2c4990a3325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:35.481131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3c0e3-08fb-4be2-bb4d-d2c4990a3325 admin admin] PATH_INFO: `/v3/users/355053b0b5764a86ad4fa3ae2c68b963` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:35.482759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3c0e3-08fb-4be2-bb4d-d2c4990a3325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=355053b0b5764a86ad4fa3ae2c68b963)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:35.485149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3c0e3-08fb-4be2-bb4d-d2c4990a3325 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:35.597521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dddb5-9d54-46aa-b6cf-d38e3c728666 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:35.611076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c65e6-faa9-46bc-9386-3c4643cbd1c8 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5be114f80444436af654ca44ba43c11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58baef9b94e845dfa697a4181d3db17b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:35.611784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c65e6-faa9-46bc-9386-3c4643cbd1c8 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:35.612142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c65e6-faa9-46bc-9386-3c4643cbd1c8 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:35.612525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c65e6-faa9-46bc-9386-3c4643cbd1c8 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] PATH_INFO: `/v3/roles/72cb833a594049b0bc9f8d4a2f24bfc7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:35.614156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c65e6-faa9-46bc-9386-3c4643cbd1c8 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] RBAC: Authorizing `identity:delete_role(role_id=72cb833a594049b0bc9f8d4a2f24bfc7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:35.617512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c65e6-faa9-46bc-9386-3c4643cbd1c8 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:35.628191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:35.649889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c4f3c0e3-08fb-4be2-bb4d-d2c4990a3325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '355053b0b5764a86ad4fa3ae2c68b963'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:35.651265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=3,keystone:SELECT=94,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:35.652667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c4f3c0e3-08fb-4be2-bb4d-d2c4990a3325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '355053b0b5764a86ad4fa3ae2c68b963'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:35.676816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c4f3c0e3-08fb-4be2-bb4d-d2c4990a3325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '355053b0b5764a86ad4fa3ae2c68b963'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:35.689383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c4f3c0e3-08fb-4be2-bb4d-d2c4990a3325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '355053b0b5764a86ad4fa3ae2c68b963'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:35.705025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c4f3c0e3-08fb-4be2-bb4d-d2c4990a3325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '355053b0b5764a86ad4fa3ae2c68b963'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:35.706653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c86c65e6-faa9-46bc-9386-3c4643cbd1c8 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] Invalidating the token cache because role 72cb833a594049b0bc9f8d4a2f24bfc7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:35.707179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c86c65e6-faa9-46bc-9386-3c4643cbd1c8 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:35.708285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c86c65e6-faa9-46bc-9386-3c4643cbd1c8 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:35.710608 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3448/6895] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:35 2022] DELETE /identity/v3/roles/72cb833a594049b0bc9f8d4a2f24bfc7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:35.711701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c65e6-faa9-46bc-9386-3c4643cbd1c8 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:35.714878 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3448/6896] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:35 2022] DELETE /identity/v3/users/355053b0b5764a86ad4fa3ae2c68b963 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:35.715459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c86c65e6-faa9-46bc-9386-3c4643cbd1c8 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:35.716718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3ec52-8cbc-4769-a71f-f48c2f2386aa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:35.717041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3ec52-8cbc-4769-a71f-f48c2f2386aa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:35.717282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3ec52-8cbc-4769-a71f-f48c2f2386aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:35.739775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-24c3ec52-8cbc-4769-a71f-f48c2f2386aa None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:35.742961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24c3ec52-8cbc-4769-a71f-f48c2f2386aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:35.819893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c65e6-faa9-46bc-9386-3c4643cbd1c8 tempest-ApplicationCredentialsV3AdminTest-1260170358 tempest-ApplicationCredentialsV3AdminTest-1260170358-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:35.848030 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3449/6897] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:35.848579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3ec52-8cbc-4769-a71f-f48c2f2386aa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:35.850182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24c3ec52-8cbc-4769-a71f-f48c2f2386aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:35.930734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3ec52-8cbc-4769-a71f-f48c2f2386aa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:35.932234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836bf24-729c-4252-882a-005bc8099800 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '347c18b7c139449fab631e69cb495d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8da38254a34c87a94b8d4539f37da3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1962298515', 'tempest-DelegatedRole-199599837'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:35.932989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836bf24-729c-4252-882a-005bc8099800 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:35.933274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836bf24-729c-4252-882a-005bc8099800 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:35.933554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836bf24-729c-4252-882a-005bc8099800 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] PATH_INFO: `/v3/OS-TRUST/trusts/47e2e07a6ba94741a955db10b6434765/roles/3c33ad78394a4ce2975cb055d65e4f74` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:35.942290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836bf24-729c-4252-882a-005bc8099800 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: Authorizing `identity:get_role_for_trust(trust_id=47e2e07a6ba94741a955db10b6434765, role_id=3c33ad78394a4ce2975cb055d65e4f74)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:35.943917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836bf24-729c-4252-882a-005bc8099800 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:35.947073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7917d-000f-444e-95a1-6a7adc946f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:35.947955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7917d-000f-444e-95a1-6a7adc946f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:35.948237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7917d-000f-444e-95a1-6a7adc946f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:35.948516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7917d-000f-444e-95a1-6a7adc946f16 admin admin] PATH_INFO: `/v3/users/e2378d99b6e34e7ab3600e59a1b22d37` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:35.953378 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3449/6898] 10.222.0.27 () {58 vars in 1369 bytes} [Sun Aug 28 18:50:35 2022] HEAD /identity/v3/OS-TRUST/trusts/47e2e07a6ba94741a955db10b6434765/roles/3c33ad78394a4ce2975cb055d65e4f74 => generated 0 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 28 18:50:35.954274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836bf24-729c-4252-882a-005bc8099800 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:35.964654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a836bf24-729c-4252-882a-005bc8099800 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:35.968182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7917d-000f-444e-95a1-6a7adc946f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2378d99b6e34e7ab3600e59a1b22d37)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:35.983051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7917d-000f-444e-95a1-6a7adc946f16 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:36.084468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ce7917d-000f-444e-95a1-6a7adc946f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2378d99b6e34e7ab3600e59a1b22d37'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:36.085884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ce7917d-000f-444e-95a1-6a7adc946f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2378d99b6e34e7ab3600e59a1b22d37'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:36.094452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ce7917d-000f-444e-95a1-6a7adc946f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2378d99b6e34e7ab3600e59a1b22d37'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:36.128942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ce7917d-000f-444e-95a1-6a7adc946f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2378d99b6e34e7ab3600e59a1b22d37'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:36.147837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836bf24-729c-4252-882a-005bc8099800 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:36.152935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ce7917d-000f-444e-95a1-6a7adc946f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2378d99b6e34e7ab3600e59a1b22d37'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:36.155987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268690a2-cd26-4591-8785-90beaa9337ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:36.156971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268690a2-cd26-4591-8785-90beaa9337ac service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:36.157608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268690a2-cd26-4591-8785-90beaa9337ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:36.158116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268690a2-cd26-4591-8785-90beaa9337ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:36.162101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-268690a2-cd26-4591-8785-90beaa9337ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:36.170171 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3450/6899] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:35 2022] DELETE /identity/v3/users/e2378d99b6e34e7ab3600e59a1b22d37 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:36.171181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7917d-000f-444e-95a1-6a7adc946f16 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:36.172624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1ce7917d-000f-444e-95a1-6a7adc946f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:36.179985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268690a2-cd26-4591-8785-90beaa9337ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:36.182805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268690a2-cd26-4591-8785-90beaa9337ac service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:36.197307 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3450/6900] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:36.198984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9464dfd-1231-4b86-9be5-e85a86b93d96 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:36.199523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9464dfd-1231-4b86-9be5-e85a86b93d96 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:36.199995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9464dfd-1231-4b86-9be5-e85a86b93d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:36.223642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d9464dfd-1231-4b86-9be5-e85a86b93d96 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:36.225245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d9464dfd-1231-4b86-9be5-e85a86b93d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:36.245344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:36.262153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:36.303349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7917d-000f-444e-95a1-6a7adc946f16 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:36.315445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c22bef-b65f-46e1-a660-e5764f5ccaee tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '347c18b7c139449fab631e69cb495d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8da38254a34c87a94b8d4539f37da3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1962298515', 'tempest-DelegatedRole-199599837'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:36.318397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c22bef-b65f-46e1-a660-e5764f5ccaee tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:36.319623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c22bef-b65f-46e1-a660-e5764f5ccaee tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:36.320019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c22bef-b65f-46e1-a660-e5764f5ccaee tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] PATH_INFO: `/v3/OS-TRUST/trusts/47e2e07a6ba94741a955db10b6434765/roles/0fbf7a89cf4f4cabb840631c5371b3cf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:36.339144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c22bef-b65f-46e1-a660-e5764f5ccaee tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: Authorizing `identity:get_role_for_trust(trust_id=47e2e07a6ba94741a955db10b6434765, role_id=0fbf7a89cf4f4cabb840631c5371b3cf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:36.341612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c22bef-b65f-46e1-a660-e5764f5ccaee tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:36.344820 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3451/6901] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:36.365806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9464dfd-1231-4b86-9be5-e85a86b93d96 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:36.378223 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-22c22bef-b65f-46e1-a660-e5764f5ccaee tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Could not find role: 0fbf7a89cf4f4cabb840631c5371b3cf.: keystone.exception.RoleNotFound: Could not find role: 0fbf7a89cf4f4cabb840631c5371b3cf. Aug 28 18:50:36.378223 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:36.378223 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:36.378223 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:36.378223 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:36.378223 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:36.378223 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:36.378223 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:36.378223 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:36.378223 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:36.378223 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:36.378223 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:36.378223 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 18:50:36.378223 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:50:36.378223 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 0fbf7a89cf4f4cabb840631c5371b3cf. Aug 28 18:50:36.379314 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:36.383970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d9464dfd-1231-4b86-9be5-e85a86b93d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:36.390003 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3451/6902] 10.222.0.27 () {58 vars in 1368 bytes} [Sun Aug 28 18:50:36 2022] GET /identity/v3/OS-TRUST/trusts/47e2e07a6ba94741a955db10b6434765/roles/0fbf7a89cf4f4cabb840631c5371b3cf => generated 110 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:50:36.391208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c22bef-b65f-46e1-a660-e5764f5ccaee tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:36.406046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c22bef-b65f-46e1-a660-e5764f5ccaee tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:36.424729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af24c1-3e20-47eb-beaf-415ab3ecabbf tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '347c18b7c139449fab631e69cb495d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8da38254a34c87a94b8d4539f37da3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1962298515', 'tempest-DelegatedRole-199599837'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:36.425592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af24c1-3e20-47eb-beaf-415ab3ecabbf tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:36.425972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af24c1-3e20-47eb-beaf-415ab3ecabbf tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:36.426354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af24c1-3e20-47eb-beaf-415ab3ecabbf tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] PATH_INFO: `/v3/OS-TRUST/trusts/47e2e07a6ba94741a955db10b6434765/roles/0fbf7a89cf4f4cabb840631c5371b3cf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:36.437109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af24c1-3e20-47eb-beaf-415ab3ecabbf tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: Authorizing `identity:get_role_for_trust(trust_id=47e2e07a6ba94741a955db10b6434765, role_id=0fbf7a89cf4f4cabb840631c5371b3cf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:36.438742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af24c1-3e20-47eb-beaf-415ab3ecabbf tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:36.463853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f6af24c1-3e20-47eb-beaf-415ab3ecabbf tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Could not find role: 0fbf7a89cf4f4cabb840631c5371b3cf.: keystone.exception.RoleNotFound: Could not find role: 0fbf7a89cf4f4cabb840631c5371b3cf. Aug 28 18:50:36.463853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:36.463853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:36.463853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:36.463853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:36.463853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:36.463853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:36.463853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:36.463853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:36.463853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:36.463853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:36.463853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:36.463853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 18:50:36.463853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:50:36.463853 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 0fbf7a89cf4f4cabb840631c5371b3cf. Aug 28 18:50:36.465064 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:36.469398 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3452/6903] 10.222.0.27 () {58 vars in 1369 bytes} [Sun Aug 28 18:50:36 2022] HEAD /identity/v3/OS-TRUST/trusts/47e2e07a6ba94741a955db10b6434765/roles/0fbf7a89cf4f4cabb840631c5371b3cf => generated 0 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:50:36.474208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af24c1-3e20-47eb-beaf-415ab3ecabbf tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:36.501776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af24c1-3e20-47eb-beaf-415ab3ecabbf tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:36.509956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9464dfd-1231-4b86-9be5-e85a86b93d96 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:36.514098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7029ba-a798-46e3-8064-dedbc8a89dba tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '347c18b7c139449fab631e69cb495d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8da38254a34c87a94b8d4539f37da3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1962298515', 'tempest-DelegatedRole-199599837'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:36.514784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7029ba-a798-46e3-8064-dedbc8a89dba tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:36.515061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7029ba-a798-46e3-8064-dedbc8a89dba tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:36.515380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7029ba-a798-46e3-8064-dedbc8a89dba tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] PATH_INFO: `/v3/OS-TRUST/trusts/47e2e07a6ba94741a955db10b6434765` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:36.521143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e776962-ce15-48e0-916b-8bd4085d3740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:36.522062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e776962-ce15-48e0-916b-8bd4085d3740 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:36.522422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7029ba-a798-46e3-8064-dedbc8a89dba tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: Authorizing `identity:delete_trust(trust_id=47e2e07a6ba94741a955db10b6434765)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:36.522672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e776962-ce15-48e0-916b-8bd4085d3740 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:36.523052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e776962-ce15-48e0-916b-8bd4085d3740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:36.523942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7029ba-a798-46e3-8064-dedbc8a89dba tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:36.545805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e776962-ce15-48e0-916b-8bd4085d3740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:36.547122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d7029ba-a798-46e3-8064-dedbc8a89dba tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '47e2e07a6ba94741a955db10b6434765', 'request_id': 'req-8d7029ba-a798-46e3-8064-dedbc8a89dba'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:36.547551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e776962-ce15-48e0-916b-8bd4085d3740 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:36.548405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d7029ba-a798-46e3-8064-dedbc8a89dba tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '47e2e07a6ba94741a955db10b6434765', 'request_id': 'req-8d7029ba-a798-46e3-8064-dedbc8a89dba'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:36.567481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d7029ba-a798-46e3-8064-dedbc8a89dba tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '47e2e07a6ba94741a955db10b6434765', 'request_id': 'req-8d7029ba-a798-46e3-8064-dedbc8a89dba'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:36.571576 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3452/6904] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:36.583477 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3453/6905] 10.222.0.27 () {58 vars in 1254 bytes} [Sun Aug 28 18:50:36 2022] DELETE /identity/v3/OS-TRUST/trusts/47e2e07a6ba94741a955db10b6434765 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:50:36.583680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e776962-ce15-48e0-916b-8bd4085d3740 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:36.600483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e776962-ce15-48e0-916b-8bd4085d3740 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:36.615191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e918019-dfb1-47c2-b1a6-b5766f4a7447 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '347c18b7c139449fab631e69cb495d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8da38254a34c87a94b8d4539f37da3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1962298515', 'tempest-DelegatedRole-199599837'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:36.616101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e918019-dfb1-47c2-b1a6-b5766f4a7447 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:36.616486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e918019-dfb1-47c2-b1a6-b5766f4a7447 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:36.616867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e918019-dfb1-47c2-b1a6-b5766f4a7447 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] PATH_INFO: `/v3/OS-TRUST/trusts/47e2e07a6ba94741a955db10b6434765` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:36.628124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-4e918019-dfb1-47c2-b1a6-b5766f4a7447 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Could not find trust: 47e2e07a6ba94741a955db10b6434765.: keystone.exception.TrustNotFound: Could not find trust: 47e2e07a6ba94741a955db10b6434765. Aug 28 18:50:36.628124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:36.628124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:36.628124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:36.628124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:36.628124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:36.628124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:36.628124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:36.628124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:36.628124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:36.628124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:36.628124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:36.628124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 18:50:36.628124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 18:50:36.628124 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 18:50:36.629294 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 18:50:36.629294 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 18:50:36.629294 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 18:50:36.629294 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 18:50:36.629294 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 18:50:36.629294 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:50:36.629294 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:50:36.629294 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 18:50:36.629294 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 18:50:36.629294 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 18:50:36.629294 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 18:50:36.629294 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 47e2e07a6ba94741a955db10b6434765. Aug 28 18:50:36.629294 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:50:36.636511 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3453/6906] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Aug 28 18:50:36 2022] GET /identity/v3/OS-TRUST/trusts/47e2e07a6ba94741a955db10b6434765 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:50:36.640886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7029ba-a798-46e3-8064-dedbc8a89dba tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:36.642931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d7029ba-a798-46e3-8064-dedbc8a89dba tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:36.784504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e918019-dfb1-47c2-b1a6-b5766f4a7447 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:36.786528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4e918019-dfb1-47c2-b1a6-b5766f4a7447 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:36.816595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e918019-dfb1-47c2-b1a6-b5766f4a7447 tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:36.822816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7029ba-a798-46e3-8064-dedbc8a89dba tempest-TrustsV3TestJSON-1290484159 tempest-user-1981530229] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:36.823402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693c0ce-8b10-43ee-97f0-99502db07e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:36.824216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693c0ce-8b10-43ee-97f0-99502db07e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:36.824515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693c0ce-8b10-43ee-97f0-99502db07e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:36.824788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693c0ce-8b10-43ee-97f0-99502db07e15 admin admin] PATH_INFO: `/v3/projects/34a067fddd5547c18eadc492bcef2ce7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:36.825944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693c0ce-8b10-43ee-97f0-99502db07e15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a067fddd5547c18eadc492bcef2ce7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:36.828580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693c0ce-8b10-43ee-97f0-99502db07e15 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:36.836039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fabfe-f4af-48cf-9640-31d8d1ac341e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:36.836863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fabfe-f4af-48cf-9640-31d8d1ac341e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:36.837153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fabfe-f4af-48cf-9640-31d8d1ac341e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:36.837475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fabfe-f4af-48cf-9640-31d8d1ac341e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles/0fbf7a89cf4f4cabb840631c5371b3cf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:36.839214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fabfe-f4af-48cf-9640-31d8d1ac341e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0fbf7a89cf4f4cabb840631c5371b3cf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:36.841502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fabfe-f4af-48cf-9640-31d8d1ac341e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:36.895620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2693c0ce-8b10-43ee-97f0-99502db07e15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a067fddd5547c18eadc492bcef2ce7', 'request_id': 'req-2693c0ce-8b10-43ee-97f0-99502db07e15'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:36.918451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2693c0ce-8b10-43ee-97f0-99502db07e15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a067fddd5547c18eadc492bcef2ce7', 'request_id': 'req-2693c0ce-8b10-43ee-97f0-99502db07e15'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:36.924264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-762fabfe-f4af-48cf-9640-31d8d1ac341e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invalidating the token cache because role 0fbf7a89cf4f4cabb840631c5371b3cf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:36.924585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-762fabfe-f4af-48cf-9640-31d8d1ac341e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:36.927076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-762fabfe-f4af-48cf-9640-31d8d1ac341e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:36.932508 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3454/6907] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:36 2022] DELETE /identity/v3/roles/0fbf7a89cf4f4cabb840631c5371b3cf => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:36.933856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fabfe-f4af-48cf-9640-31d8d1ac341e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:36.938043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-762fabfe-f4af-48cf-9640-31d8d1ac341e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:36.938442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2693c0ce-8b10-43ee-97f0-99502db07e15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a067fddd5547c18eadc492bcef2ce7', 'request_id': 'req-2693c0ce-8b10-43ee-97f0-99502db07e15'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:36.967154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2693c0ce-8b10-43ee-97f0-99502db07e15 admin admin] The token cache is being invalidate because project 34a067fddd5547c18eadc492bcef2ce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:36.967526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2693c0ce-8b10-43ee-97f0-99502db07e15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:36.969055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2693c0ce-8b10-43ee-97f0-99502db07e15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:36.976435 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3454/6908] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:36 2022] DELETE /identity/v3/projects/34a067fddd5547c18eadc492bcef2ce7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:36.977917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693c0ce-8b10-43ee-97f0-99502db07e15 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:36.982268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2693c0ce-8b10-43ee-97f0-99502db07e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:37.025095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:37.098079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:37.115050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fabfe-f4af-48cf-9640-31d8d1ac341e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:37.125485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c92ed-15e7-47df-8294-b1a1bae98144 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:37.126152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c92ed-15e7-47df-8294-b1a1bae98144 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:37.126477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c92ed-15e7-47df-8294-b1a1bae98144 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:37.128175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c92ed-15e7-47df-8294-b1a1bae98144 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles/3c33ad78394a4ce2975cb055d65e4f74` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:37.132520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c92ed-15e7-47df-8294-b1a1bae98144 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3c33ad78394a4ce2975cb055d65e4f74)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:37.134331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c92ed-15e7-47df-8294-b1a1bae98144 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:37.143977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693c0ce-8b10-43ee-97f0-99502db07e15 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:37.253605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-068c92ed-15e7-47df-8294-b1a1bae98144 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invalidating the token cache because role 3c33ad78394a4ce2975cb055d65e4f74 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:37.254199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-068c92ed-15e7-47df-8294-b1a1bae98144 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:37.255235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-068c92ed-15e7-47df-8294-b1a1bae98144 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:37.257661 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3455/6909] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:36 2022] DELETE /identity/v3/roles/3c33ad78394a4ce2975cb055d65e4f74 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:37.258791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c92ed-15e7-47df-8294-b1a1bae98144 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:37.259889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d51e21-c98f-47df-b9f5-53fbf8659cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:37.260949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d51e21-c98f-47df-b9f5-53fbf8659cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:37.261307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d51e21-c98f-47df-b9f5-53fbf8659cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:37.261648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d51e21-c98f-47df-b9f5-53fbf8659cb5 admin admin] PATH_INFO: `/v3/users/2b2bcf06cebb49d7b485f0b67ecd7cf8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:37.262909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d51e21-c98f-47df-b9f5-53fbf8659cb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2bcf06cebb49d7b485f0b67ecd7cf8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:37.263188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-068c92ed-15e7-47df-8294-b1a1bae98144 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:37.265656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d51e21-c98f-47df-b9f5-53fbf8659cb5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:37.374234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-77d51e21-c98f-47df-b9f5-53fbf8659cb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2bcf06cebb49d7b485f0b67ecd7cf8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:37.389202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-77d51e21-c98f-47df-b9f5-53fbf8659cb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2bcf06cebb49d7b485f0b67ecd7cf8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:37.390099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-77d51e21-c98f-47df-b9f5-53fbf8659cb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2bcf06cebb49d7b485f0b67ecd7cf8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:37.390768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-77d51e21-c98f-47df-b9f5-53fbf8659cb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2bcf06cebb49d7b485f0b67ecd7cf8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:37.395292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c92ed-15e7-47df-8294-b1a1bae98144 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:37.401490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5625c-d0d4-4d58-ae44-a5222f015a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:37.402072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5625c-d0d4-4d58-ae44-a5222f015a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:37.402355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5625c-d0d4-4d58-ae44-a5222f015a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:37.402638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5625c-d0d4-4d58-ae44-a5222f015a98 admin admin] PATH_INFO: `/v3/projects/8303f6615e89487fa35d124ebb991acd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:37.403860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-77d51e21-c98f-47df-b9f5-53fbf8659cb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2bcf06cebb49d7b485f0b67ecd7cf8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:37.404014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5625c-d0d4-4d58-ae44-a5222f015a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8303f6615e89487fa35d124ebb991acd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:37.405931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5625c-d0d4-4d58-ae44-a5222f015a98 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:37.424516 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3455/6910] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:36 2022] DELETE /identity/v3/users/2b2bcf06cebb49d7b485f0b67ecd7cf8 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:37.426629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d51e21-c98f-47df-b9f5-53fbf8659cb5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:37.429088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-77d51e21-c98f-47df-b9f5-53fbf8659cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:37.533940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d51e21-c98f-47df-b9f5-53fbf8659cb5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:37.548320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:37.573866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25f5625c-d0d4-4d58-ae44-a5222f015a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8303f6615e89487fa35d124ebb991acd', 'request_id': 'req-25f5625c-d0d4-4d58-ae44-a5222f015a98'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:37.602348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25f5625c-d0d4-4d58-ae44-a5222f015a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8303f6615e89487fa35d124ebb991acd', 'request_id': 'req-25f5625c-d0d4-4d58-ae44-a5222f015a98'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:37.619651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25f5625c-d0d4-4d58-ae44-a5222f015a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8303f6615e89487fa35d124ebb991acd', 'request_id': 'req-25f5625c-d0d4-4d58-ae44-a5222f015a98'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:37.644242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25f5625c-d0d4-4d58-ae44-a5222f015a98 admin admin] The token cache is being invalidate because project 8303f6615e89487fa35d124ebb991acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:37.644685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25f5625c-d0d4-4d58-ae44-a5222f015a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:37.646104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25f5625c-d0d4-4d58-ae44-a5222f015a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:37.649160 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3456/6911] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:37 2022] DELETE /identity/v3/projects/8303f6615e89487fa35d124ebb991acd => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:37.653109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5625c-d0d4-4d58-ae44-a5222f015a98 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:37.655640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-25f5625c-d0d4-4d58-ae44-a5222f015a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:37.680643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295121c-8041-442a-90e7-6a68b810cf4e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:37.687054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295121c-8041-442a-90e7-6a68b810cf4e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:37.687617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295121c-8041-442a-90e7-6a68b810cf4e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:37.690631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295121c-8041-442a-90e7-6a68b810cf4e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users/347c18b7c139449fab631e69cb495d32` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:37.699032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295121c-8041-442a-90e7-6a68b810cf4e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_user(user_id=347c18b7c139449fab631e69cb495d32)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:37.711916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295121c-8041-442a-90e7-6a68b810cf4e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:37.731526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:37.885252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5625c-d0d4-4d58-ae44-a5222f015a98 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:37.894549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b295121c-8041-442a-90e7-6a68b810cf4e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '347c18b7c139449fab631e69cb495d32'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:37.902071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027fc7c-0505-48b4-aa12-2e1d00d70eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:37.902735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027fc7c-0505-48b4-aa12-2e1d00d70eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:37.903014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027fc7c-0505-48b4-aa12-2e1d00d70eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:37.903370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027fc7c-0505-48b4-aa12-2e1d00d70eb6 admin admin] PATH_INFO: `/v3/users/b5be114f80444436af654ca44ba43c11` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:37.912630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027fc7c-0505-48b4-aa12-2e1d00d70eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5be114f80444436af654ca44ba43c11)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:37.915430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027fc7c-0505-48b4-aa12-2e1d00d70eb6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:37.936846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b295121c-8041-442a-90e7-6a68b810cf4e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '347c18b7c139449fab631e69cb495d32'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:37.940536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b295121c-8041-442a-90e7-6a68b810cf4e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '347c18b7c139449fab631e69cb495d32'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:37.943904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b295121c-8041-442a-90e7-6a68b810cf4e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '347c18b7c139449fab631e69cb495d32'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:37.971342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b295121c-8041-442a-90e7-6a68b810cf4e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '347c18b7c139449fab631e69cb495d32'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.003038 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3456/6912] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:37 2022] DELETE /identity/v3/users/347c18b7c139449fab631e69cb495d32 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:38.006722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295121c-8041-442a-90e7-6a68b810cf4e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:38.010872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b295121c-8041-442a-90e7-6a68b810cf4e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:38.012214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2027fc7c-0505-48b4-aa12-2e1d00d70eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5be114f80444436af654ca44ba43c11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.014131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2027fc7c-0505-48b4-aa12-2e1d00d70eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5be114f80444436af654ca44ba43c11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.036448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2027fc7c-0505-48b4-aa12-2e1d00d70eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5be114f80444436af654ca44ba43c11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.053142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2027fc7c-0505-48b4-aa12-2e1d00d70eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5be114f80444436af654ca44ba43c11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.093414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2027fc7c-0505-48b4-aa12-2e1d00d70eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5be114f80444436af654ca44ba43c11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.118511 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3457/6913] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:37 2022] DELETE /identity/v3/users/b5be114f80444436af654ca44ba43c11 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:38.121724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027fc7c-0505-48b4-aa12-2e1d00d70eb6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:38.140955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2027fc7c-0505-48b4-aa12-2e1d00d70eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:38.151298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295121c-8041-442a-90e7-6a68b810cf4e tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:38.249184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:38.288105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ab084-3125-489e-ab90-2da204346bb6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:38.289223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ab084-3125-489e-ab90-2da204346bb6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:38.289761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ab084-3125-489e-ab90-2da204346bb6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:38.290285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ab084-3125-489e-ab90-2da204346bb6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/df8da38254a34c87a94b8d4539f37da3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:38.292198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ab084-3125-489e-ab90-2da204346bb6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_project(project_id=df8da38254a34c87a94b8d4539f37da3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:38.295703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ab084-3125-489e-ab90-2da204346bb6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:38.305280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027fc7c-0505-48b4-aa12-2e1d00d70eb6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:38.324486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e85bfa-416b-4336-9532-22f7c79aebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:38.325160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85bfa-416b-4336-9532-22f7c79aebe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:38.325439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85bfa-416b-4336-9532-22f7c79aebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:38.325720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85bfa-416b-4336-9532-22f7c79aebe2 admin admin] PATH_INFO: `/v3/projects/045d0ef424644c28a3b09fef3607b27a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:38.326929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e85bfa-416b-4336-9532-22f7c79aebe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=045d0ef424644c28a3b09fef3607b27a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:38.328950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e85bfa-416b-4336-9532-22f7c79aebe2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:38.424428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-625ab084-3125-489e-ab90-2da204346bb6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8da38254a34c87a94b8d4539f37da3', 'request_id': 'req-625ab084-3125-489e-ab90-2da204346bb6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.439651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-625ab084-3125-489e-ab90-2da204346bb6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8da38254a34c87a94b8d4539f37da3', 'request_id': 'req-625ab084-3125-489e-ab90-2da204346bb6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.445792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15e85bfa-416b-4336-9532-22f7c79aebe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '045d0ef424644c28a3b09fef3607b27a', 'request_id': 'req-15e85bfa-416b-4336-9532-22f7c79aebe2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.447804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:38.457355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-625ab084-3125-489e-ab90-2da204346bb6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8da38254a34c87a94b8d4539f37da3', 'request_id': 'req-625ab084-3125-489e-ab90-2da204346bb6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.478630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15e85bfa-416b-4336-9532-22f7c79aebe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '045d0ef424644c28a3b09fef3607b27a', 'request_id': 'req-15e85bfa-416b-4336-9532-22f7c79aebe2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.482384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-625ab084-3125-489e-ab90-2da204346bb6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] The token cache is being invalidate because project df8da38254a34c87a94b8d4539f37da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:38.483555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-625ab084-3125-489e-ab90-2da204346bb6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.485282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-625ab084-3125-489e-ab90-2da204346bb6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.488913 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3457/6914] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:38 2022] DELETE /identity/v3/projects/df8da38254a34c87a94b8d4539f37da3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:38.492636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15e85bfa-416b-4336-9532-22f7c79aebe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '045d0ef424644c28a3b09fef3607b27a', 'request_id': 'req-15e85bfa-416b-4336-9532-22f7c79aebe2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.495315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ab084-3125-489e-ab90-2da204346bb6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:38.498560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-625ab084-3125-489e-ab90-2da204346bb6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:38.532159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15e85bfa-416b-4336-9532-22f7c79aebe2 admin admin] The token cache is being invalidate because project 045d0ef424644c28a3b09fef3607b27a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:38.534250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15e85bfa-416b-4336-9532-22f7c79aebe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.535125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15e85bfa-416b-4336-9532-22f7c79aebe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.542527 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3458/6915] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:38 2022] DELETE /identity/v3/projects/045d0ef424644c28a3b09fef3607b27a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:38.545111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d91c2-711a-4408-a8ec-7c51e1724415 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:38.545930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d91c2-711a-4408-a8ec-7c51e1724415 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:38.546739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d91c2-711a-4408-a8ec-7c51e1724415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:38.592280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4e6d91c2-711a-4408-a8ec-7c51e1724415 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:38.593746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e6d91c2-711a-4408-a8ec-7c51e1724415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:38.613748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ab084-3125-489e-ab90-2da204346bb6 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:38.690819 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3459/6916] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:38.690819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d91c2-711a-4408-a8ec-7c51e1724415 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:38.690819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e6d91c2-711a-4408-a8ec-7c51e1724415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:38.711193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d91c2-711a-4408-a8ec-7c51e1724415 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:38.722972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f538151-8ffa-440e-bdc5-e99409ac110e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:38.723644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f538151-8ffa-440e-bdc5-e99409ac110e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:38.723923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f538151-8ffa-440e-bdc5-e99409ac110e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:38.724261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f538151-8ffa-440e-bdc5-e99409ac110e admin admin] PATH_INFO: `/v3/projects/58baef9b94e845dfa697a4181d3db17b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:38.726217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f538151-8ffa-440e-bdc5-e99409ac110e admin admin] RBAC: Authorizing `identity:delete_project(project_id=58baef9b94e845dfa697a4181d3db17b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:38.733052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f538151-8ffa-440e-bdc5-e99409ac110e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:38.806318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2f6c2-d3fc-4443-8ece-f7e5f04f4792 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:38.807837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2f6c2-d3fc-4443-8ece-f7e5f04f4792 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:38.808153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2f6c2-d3fc-4443-8ece-f7e5f04f4792 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:38.808425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f538151-8ffa-440e-bdc5-e99409ac110e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58baef9b94e845dfa697a4181d3db17b', 'request_id': 'req-1f538151-8ffa-440e-bdc5-e99409ac110e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.808553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2f6c2-d3fc-4443-8ece-f7e5f04f4792 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:38.809078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2f6c2-d3fc-4443-8ece-f7e5f04f4792 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:38.811001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2f6c2-d3fc-4443-8ece-f7e5f04f4792 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:38.821019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f538151-8ffa-440e-bdc5-e99409ac110e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58baef9b94e845dfa697a4181d3db17b', 'request_id': 'req-1f538151-8ffa-440e-bdc5-e99409ac110e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.829181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f538151-8ffa-440e-bdc5-e99409ac110e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58baef9b94e845dfa697a4181d3db17b', 'request_id': 'req-1f538151-8ffa-440e-bdc5-e99409ac110e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.844966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f538151-8ffa-440e-bdc5-e99409ac110e admin admin] The token cache is being invalidate because project 58baef9b94e845dfa697a4181d3db17b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:38.845604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f538151-8ffa-440e-bdc5-e99409ac110e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.846640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f538151-8ffa-440e-bdc5-e99409ac110e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:38.848954 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3460/6917] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:38 2022] DELETE /identity/v3/projects/58baef9b94e845dfa697a4181d3db17b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:38.871499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3becbb1-ae0f-43b7-beab-fa1e9fccc2aa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:38.873702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3becbb1-ae0f-43b7-beab-fa1e9fccc2aa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:38.874469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:38.875683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3becbb1-ae0f-43b7-beab-fa1e9fccc2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:38.884723 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3458/6918] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:50:38 2022] POST /identity/v3/projects => generated 328 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:50:38.884723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05b8d2-9f26-4e7d-93a0-5151c777da1d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:38.884723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05b8d2-9f26-4e7d-93a0-5151c777da1d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:38.884723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05b8d2-9f26-4e7d-93a0-5151c777da1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:38.937691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1e05b8d2-9f26-4e7d-93a0-5151c777da1d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:38.937898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e3becbb1-ae0f-43b7-beab-fa1e9fccc2aa None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:38.937991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1e05b8d2-9f26-4e7d-93a0-5151c777da1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:38.938084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e3becbb1-ae0f-43b7-beab-fa1e9fccc2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:39.051901 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3461/6919] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:39.053197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3becbb1-ae0f-43b7-beab-fa1e9fccc2aa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:39.057364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e3becbb1-ae0f-43b7-beab-fa1e9fccc2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:39.094391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:39.101431 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3459/6920] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:39.101431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05b8d2-9f26-4e7d-93a0-5151c777da1d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:39.107117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05b8d2-9f26-4e7d-93a0-5151c777da1d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:39.113126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7483f64-2505-479c-b727-57ffb6594687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:39.113887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7483f64-2505-479c-b727-57ffb6594687 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:39.114225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7483f64-2505-479c-b727-57ffb6594687 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:39.114670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7483f64-2505-479c-b727-57ffb6594687 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:39.116423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7483f64-2505-479c-b727-57ffb6594687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:39.116848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7483f64-2505-479c-b727-57ffb6594687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:39.119947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7483f64-2505-479c-b727-57ffb6594687 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:39.134763 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3460/6921] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:39.136160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cdb2f-432d-4ce4-9484-8c019693620b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:39.136515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cdb2f-432d-4ce4-9484-8c019693620b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:39.136856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cdb2f-432d-4ce4-9484-8c019693620b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:39.159555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cb4cdb2f-432d-4ce4-9484-8c019693620b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:39.161355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cb4cdb2f-432d-4ce4-9484-8c019693620b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:39.170738 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3461/6922] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:39.174377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cdb2f-432d-4ce4-9484-8c019693620b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:39.182263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cdb2f-432d-4ce4-9484-8c019693620b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:39.187285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7d872-7a43-46ab-a890-139848f399ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:39.187978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7d872-7a43-46ab-a890-139848f399ad admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:39.188328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7d872-7a43-46ab-a890-139848f399ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:39.188662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7d872-7a43-46ab-a890-139848f399ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:39.189463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7d872-7a43-46ab-a890-139848f399ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:39.192524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7d872-7a43-46ab-a890-139848f399ad admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:39.208136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3becbb1-ae0f-43b7-beab-fa1e9fccc2aa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:39.222206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61f752-cc38-4681-83be-753a872912f1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:39.223846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61f752-cc38-4681-83be-753a872912f1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:39.224901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61f752-cc38-4681-83be-753a872912f1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:39.226135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61f752-cc38-4681-83be-753a872912f1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:39.226957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61f752-cc38-4681-83be-753a872912f1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:39.233689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61f752-cc38-4681-83be-753a872912f1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:39.234997 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3462/6923] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:39 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:39.238580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7d872-7a43-46ab-a890-139848f399ad admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:39.281705 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3462/6924] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:39 2022] POST /identity/v3/users => generated 413 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:39.281705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61f752-cc38-4681-83be-753a872912f1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:39.303287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61f752-cc38-4681-83be-753a872912f1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:39.374496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7d872-7a43-46ab-a890-139848f399ad admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:39.380937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2de72-9830-4d0a-bf58-d4783367eec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:39.381569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2de72-9830-4d0a-bf58-d4783367eec3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:39.381886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2de72-9830-4d0a-bf58-d4783367eec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:39.382115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2de72-9830-4d0a-bf58-d4783367eec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:39.382777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2de72-9830-4d0a-bf58-d4783367eec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:39.383085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2de72-9830-4d0a-bf58-d4783367eec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:39.385345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2de72-9830-4d0a-bf58-d4783367eec3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:39.387952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da9928-e800-4bbc-9d15-114ec5c96356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:39.388630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9928-e800-4bbc-9d15-114ec5c96356 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:39.388847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9928-e800-4bbc-9d15-114ec5c96356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:39.389234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9928-e800-4bbc-9d15-114ec5c96356 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:39.389939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da9928-e800-4bbc-9d15-114ec5c96356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:39.392502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da9928-e800-4bbc-9d15-114ec5c96356 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:39.400556 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3463/6925] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:39.401242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2de72-9830-4d0a-bf58-d4783367eec3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:39.445469 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3463/6926] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:39 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:39.445469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da9928-e800-4bbc-9d15-114ec5c96356 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:39.477073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da9928-e800-4bbc-9d15-114ec5c96356 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:39.485894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:39.489237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac5fec-79ca-41ce-8ec3-7ae2ced76357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:39.489846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac5fec-79ca-41ce-8ec3-7ae2ced76357 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:39.502316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2de72-9830-4d0a-bf58-d4783367eec3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:39.508577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784d412-90d2-4c4b-80e8-e46f13987777 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:39.509486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784d412-90d2-4c4b-80e8-e46f13987777 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:39.509977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784d412-90d2-4c4b-80e8-e46f13987777 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:39.510481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784d412-90d2-4c4b-80e8-e46f13987777 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:39.511420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac5fec-79ca-41ce-8ec3-7ae2ced76357 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:39.511823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac5fec-79ca-41ce-8ec3-7ae2ced76357 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:39.512078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784d412-90d2-4c4b-80e8-e46f13987777 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:39.512514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac5fec-79ca-41ce-8ec3-7ae2ced76357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:39.514183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784d412-90d2-4c4b-80e8-e46f13987777 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:39.514443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac5fec-79ca-41ce-8ec3-7ae2ced76357 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:39.542875 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3464/6927] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:50:39 2022] POST /identity/v3/roles => generated 244 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:39.546131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784d412-90d2-4c4b-80e8-e46f13987777 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:39.582336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784d412-90d2-4c4b-80e8-e46f13987777 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:39.584528 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3464/6928] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:39 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:39.585456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac5fec-79ca-41ce-8ec3-7ae2ced76357 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:39.667510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce77fb7-e485-45d3-825e-6adad1ac7f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:39.668175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce77fb7-e485-45d3-825e-6adad1ac7f37 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:39.668455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce77fb7-e485-45d3-825e-6adad1ac7f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:39.668730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce77fb7-e485-45d3-825e-6adad1ac7f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:39.669395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce77fb7-e485-45d3-825e-6adad1ac7f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:39.671536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce77fb7-e485-45d3-825e-6adad1ac7f37 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:39.709973 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3465/6929] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:39 2022] GET /identity/v3/roles => generated 1655 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:39.709973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce77fb7-e485-45d3-825e-6adad1ac7f37 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:39.732531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac5fec-79ca-41ce-8ec3-7ae2ced76357 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:39.736511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce77fb7-e485-45d3-825e-6adad1ac7f37 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:39.744416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1b859-951d-48dc-9bde-0b59faf0b47b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:39.745609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1b859-951d-48dc-9bde-0b59faf0b47b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:39.746791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1b859-951d-48dc-9bde-0b59faf0b47b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:39.747611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcb0c5-fdea-4b4b-b75f-1f6df110d424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:39.747979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1b859-951d-48dc-9bde-0b59faf0b47b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:39.749020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1b859-951d-48dc-9bde-0b59faf0b47b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:39.749836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb0c5-fdea-4b4b-b75f-1f6df110d424 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:39.750208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb0c5-fdea-4b4b-b75f-1f6df110d424 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:39.751758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1b859-951d-48dc-9bde-0b59faf0b47b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:39.752143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb0c5-fdea-4b4b-b75f-1f6df110d424 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:39.752958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcb0c5-fdea-4b4b-b75f-1f6df110d424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:39.757893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcb0c5-fdea-4b4b-b75f-1f6df110d424 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:39.763242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:39.806257 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3466/6930] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:39 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:39.811864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcb0c5-fdea-4b4b-b75f-1f6df110d424 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:39.813599 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3465/6931] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:50:39 2022] POST /identity/v3/roles => generated 247 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:39.814585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1b859-951d-48dc-9bde-0b59faf0b47b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:39.827080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcb0c5-fdea-4b4b-b75f-1f6df110d424 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:39.829705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1b859-951d-48dc-9bde-0b59faf0b47b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:39.833891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3e9ab-0e03-4321-bbf7-f4f37450a1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:39.834709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3e9ab-0e03-4321-bbf7-f4f37450a1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:39.835081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3e9ab-0e03-4321-bbf7-f4f37450a1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:39.835498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3e9ab-0e03-4321-bbf7-f4f37450a1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:39.836600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3e9ab-0e03-4321-bbf7-f4f37450a1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:39.839654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3e9ab-0e03-4321-bbf7-f4f37450a1c5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:39.855523 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3467/6932] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:39 2022] GET /identity/v3/roles => generated 1893 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:39.855523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3e9ab-0e03-4321-bbf7-f4f37450a1c5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:39.857928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0aa22-ced5-4493-a7a1-3318c3b5afb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:39.860108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0aa22-ced5-4493-a7a1-3318c3b5afb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:39.862254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0aa22-ced5-4493-a7a1-3318c3b5afb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:39.862644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0aa22-ced5-4493-a7a1-3318c3b5afb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:39.863553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0aa22-ced5-4493-a7a1-3318c3b5afb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:39.867471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0aa22-ced5-4493-a7a1-3318c3b5afb3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:39.875568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3e9ab-0e03-4321-bbf7-f4f37450a1c5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:39.882703 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3466/6933] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:39 2022] GET /identity/v3/roles => generated 1893 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:39.883931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0aa22-ced5-4493-a7a1-3318c3b5afb3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:39.888417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71af47-d40e-43d2-a1d5-4abf98e8963b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:39.889346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71af47-d40e-43d2-a1d5-4abf98e8963b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:39.889631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71af47-d40e-43d2-a1d5-4abf98e8963b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:39.890031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71af47-d40e-43d2-a1d5-4abf98e8963b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/de425fce969949e8a116c7ad7310e98c/users/7296e15f4c44473bba9d7914b00e42fb/roles/882e0959d3544c29bfaa12ef539ff535` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:39.897584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0aa22-ced5-4493-a7a1-3318c3b5afb3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:39.904871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63898511-1710-40e8-86a1-cb1d24def744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:39.905604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63898511-1710-40e8-86a1-cb1d24def744 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:39.905893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63898511-1710-40e8-86a1-cb1d24def744 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:39.906174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63898511-1710-40e8-86a1-cb1d24def744 admin admin] PATH_INFO: `/v3/projects/a02e0332f1d14bdd83d38479da2d0e1f/users/e4174dc03acf4104a1dc90ec7ecab84d/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:39.921647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71af47-d40e-43d2-a1d5-4abf98e8963b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_grant(project_id=de425fce969949e8a116c7ad7310e98c, user_id=7296e15f4c44473bba9d7914b00e42fb, role_id=882e0959d3544c29bfaa12ef539ff535)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:39.925959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71af47-d40e-43d2-a1d5-4abf98e8963b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:39.945269 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3468/6934] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:39 2022] PUT /identity/v3/projects/de425fce969949e8a116c7ad7310e98c/users/7296e15f4c44473bba9d7914b00e42fb/roles/882e0959d3544c29bfaa12ef539ff535 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:39.946165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71af47-d40e-43d2-a1d5-4abf98e8963b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:39.949468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63898511-1710-40e8-86a1-cb1d24def744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02e0332f1d14bdd83d38479da2d0e1f, user_id=e4174dc03acf4104a1dc90ec7ecab84d, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:39.955953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63898511-1710-40e8-86a1-cb1d24def744 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:39.986327 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3467/6935] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:39 2022] PUT /identity/v3/projects/a02e0332f1d14bdd83d38479da2d0e1f/users/e4174dc03acf4104a1dc90ec7ecab84d/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:39.997966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63898511-1710-40e8-86a1-cb1d24def744 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:40.123105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63898511-1710-40e8-86a1-cb1d24def744 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:40.129051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2780de-9ba6-436f-a490-09e8a4c01641 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:40.130240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2780de-9ba6-436f-a490-09e8a4c01641 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:40.130758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2780de-9ba6-436f-a490-09e8a4c01641 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:40.131312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2780de-9ba6-436f-a490-09e8a4c01641 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/de425fce969949e8a116c7ad7310e98c/users/7296e15f4c44473bba9d7914b00e42fb/roles/d1666ad16ce942b1beb88f495b36e28a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:40.131502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71af47-d40e-43d2-a1d5-4abf98e8963b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:40.134367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2780de-9ba6-436f-a490-09e8a4c01641 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_grant(project_id=de425fce969949e8a116c7ad7310e98c, user_id=7296e15f4c44473bba9d7914b00e42fb, role_id=d1666ad16ce942b1beb88f495b36e28a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:40.137418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2780de-9ba6-436f-a490-09e8a4c01641 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:40.173779 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3468/6936] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:39 2022] PUT /identity/v3/projects/de425fce969949e8a116c7ad7310e98c/users/7296e15f4c44473bba9d7914b00e42fb/roles/d1666ad16ce942b1beb88f495b36e28a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:40.176528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d37d19-6355-4978-9f7e-828ccdcd9b30 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:40.176997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d37d19-6355-4978-9f7e-828ccdcd9b30 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:40.177496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d37d19-6355-4978-9f7e-828ccdcd9b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:40.205823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:40.258349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-10d37d19-6355-4978-9f7e-828ccdcd9b30 None None] MFA Rules not processed for user `e4174dc03acf4104a1dc90ec7ecab84d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:40.259922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-10d37d19-6355-4978-9f7e-828ccdcd9b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:40.292910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583ba40-b44d-4efe-baa8-eb9b62d6aca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:40.294220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583ba40-b44d-4efe-baa8-eb9b62d6aca8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:40.294220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583ba40-b44d-4efe-baa8-eb9b62d6aca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:40.294631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583ba40-b44d-4efe-baa8-eb9b62d6aca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:40.296298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583ba40-b44d-4efe-baa8-eb9b62d6aca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:40.307772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583ba40-b44d-4efe-baa8-eb9b62d6aca8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:40.329376 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3469/6937] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:39 2022] GET /identity/v3/roles => generated 1893 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:40.335166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583ba40-b44d-4efe-baa8-eb9b62d6aca8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:40.349927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583ba40-b44d-4efe-baa8-eb9b62d6aca8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:40.460400 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3469/6938] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:40.463099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d37d19-6355-4978-9f7e-828ccdcd9b30 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:40.469945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989d520-fb6b-4d5e-a853-d34107134fc4 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:40.470745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989d520-fb6b-4d5e-a853-d34107134fc4 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:40.471092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989d520-fb6b-4d5e-a853-d34107134fc4 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:40.471482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989d520-fb6b-4d5e-a853-d34107134fc4 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:40.472256 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989d520-fb6b-4d5e-a853-d34107134fc4 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:40.474265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989d520-fb6b-4d5e-a853-d34107134fc4 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:40.524239 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3470/6939] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:40 2022] GET /identity/v3/users => generated 7750 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:40.525814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989d520-fb6b-4d5e-a853-d34107134fc4 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:40.540128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:40.592048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d37d19-6355-4978-9f7e-828ccdcd9b30 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:40.599309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196555a3-7c92-49c5-94d0-c5616765ac40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:40.600535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196555a3-7c92-49c5-94d0-c5616765ac40 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:40.600903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196555a3-7c92-49c5-94d0-c5616765ac40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:40.601189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196555a3-7c92-49c5-94d0-c5616765ac40 admin admin] PATH_INFO: `/v3/projects/b597632da8bc42c392cf8e2c33ea4f2e/users/f5ccc0fc05144a52aae124d14056b64d/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:40.621388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989d520-fb6b-4d5e-a853-d34107134fc4 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:40.622771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196555a3-7c92-49c5-94d0-c5616765ac40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b597632da8bc42c392cf8e2c33ea4f2e, user_id=f5ccc0fc05144a52aae124d14056b64d, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:40.626144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196555a3-7c92-49c5-94d0-c5616765ac40 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:40.627858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccde12f-6fd5-4e0f-b379-06246a5cdcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:40.628851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccde12f-6fd5-4e0f-b379-06246a5cdcca admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:40.629306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccde12f-6fd5-4e0f-b379-06246a5cdcca admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:40.629687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccde12f-6fd5-4e0f-b379-06246a5cdcca admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:40.630421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccde12f-6fd5-4e0f-b379-06246a5cdcca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:40.632823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccde12f-6fd5-4e0f-b379-06246a5cdcca admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:40.649080 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3470/6940] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:40 2022] PUT /identity/v3/projects/b597632da8bc42c392cf8e2c33ea4f2e/users/f5ccc0fc05144a52aae124d14056b64d/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:40.653696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3618185-13b1-49e5-ab0a-8553abe3e910 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:40.654007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3618185-13b1-49e5-ab0a-8553abe3e910 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:40.654431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3618185-13b1-49e5-ab0a-8553abe3e910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:40.677765 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3471/6941] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:40 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:40.679597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692c38e-ffe0-4bfc-8668-944dd0d5a8ed None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:40.679597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692c38e-ffe0-4bfc-8668-944dd0d5a8ed None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:40.680039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692c38e-ffe0-4bfc-8668-944dd0d5a8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:40.713952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f3618185-13b1-49e5-ab0a-8553abe3e910 None None] MFA Rules not processed for user `7296e15f4c44473bba9d7914b00e42fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:40.715555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f3618185-13b1-49e5-ab0a-8553abe3e910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:40.724896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d692c38e-ffe0-4bfc-8668-944dd0d5a8ed None None] MFA Rules not processed for user `f5ccc0fc05144a52aae124d14056b64d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:40.727508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d692c38e-ffe0-4bfc-8668-944dd0d5a8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:40.802257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:40.846945 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3471/6942] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:40 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:40.847968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3618185-13b1-49e5-ab0a-8553abe3e910 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:40.883423 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3472/6943] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:40.884948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00701e3d-e14f-4d48-88b3-8da3a82ee458 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:40.885781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00701e3d-e14f-4d48-88b3-8da3a82ee458 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:40.886140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00701e3d-e14f-4d48-88b3-8da3a82ee458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:40.921230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-00701e3d-e14f-4d48-88b3-8da3a82ee458 None None] MFA Rules not processed for user `7296e15f4c44473bba9d7914b00e42fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:40.923207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00701e3d-e14f-4d48-88b3-8da3a82ee458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:40.931510 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3473/6944] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:40 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:40.932597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00701e3d-e14f-4d48-88b3-8da3a82ee458 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:40.969891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3618185-13b1-49e5-ab0a-8553abe3e910 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:40.993047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41510e4-ef5e-4c43-98ef-945a21880000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:40.993712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41510e4-ef5e-4c43-98ef-945a21880000 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:40.994407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41510e4-ef5e-4c43-98ef-945a21880000 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:40.994644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41510e4-ef5e-4c43-98ef-945a21880000 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:40.995376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41510e4-ef5e-4c43-98ef-945a21880000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:40.997623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41510e4-ef5e-4c43-98ef-945a21880000 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:41.051236 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3472/6945] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:40 2022] POST /identity/v3/users => generated 298 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:41.052258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41510e4-ef5e-4c43-98ef-945a21880000 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:41.063891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00701e3d-e14f-4d48-88b3-8da3a82ee458 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:41.068895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41510e4-ef5e-4c43-98ef-945a21880000 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:41.076162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b84528-cb09-4af6-8bce-00925f23a7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:41.077483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84528-cb09-4af6-8bce-00925f23a7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:41.077483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84528-cb09-4af6-8bce-00925f23a7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:41.077483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84528-cb09-4af6-8bce-00925f23a7e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:41.078393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b84528-cb09-4af6-8bce-00925f23a7e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:41.080675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b84528-cb09-4af6-8bce-00925f23a7e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:41.089894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8b7a1-ad47-477f-bb62-d3691088c25c tempest-TrustsV3TestJSON-126106140 tempest-user-765351569] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7296e15f4c44473bba9d7914b00e42fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de425fce969949e8a116c7ad7310e98c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1072287527', 'tempest-DelegatedRole-1091167559'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:41.090545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8b7a1-ad47-477f-bb62-d3691088c25c tempest-TrustsV3TestJSON-126106140 tempest-user-765351569] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:41.090826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8b7a1-ad47-477f-bb62-d3691088c25c tempest-TrustsV3TestJSON-126106140 tempest-user-765351569] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:41.091102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8b7a1-ad47-477f-bb62-d3691088c25c tempest-TrustsV3TestJSON-126106140 tempest-user-765351569] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:41.091829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8b7a1-ad47-477f-bb62-d3691088c25c tempest-TrustsV3TestJSON-126106140 tempest-user-765351569] RBAC: Authorizing `identity:create_trust()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:41.092994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8b7a1-ad47-477f-bb62-d3691088c25c tempest-TrustsV3TestJSON-126106140 tempest-user-765351569] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:41.146373 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3474/6946] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:40 2022] POST /identity/v3/projects => generated 367 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:41.147598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b84528-cb09-4af6-8bce-00925f23a7e2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:41.167074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:41.236618 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-14c8b7a1-ad47-477f-bb62-d3691088c25c tempest-TrustsV3TestJSON-126106140 tempest-user-765351569] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 28 18:50:41.236618 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:41.236618 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Aug 28 18:50:41.236618 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Aug 28 18:50:41.236618 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Aug 28 18:50:41.236618 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Aug 28 18:50:41.236618 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Aug 28 18:50:41.236618 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:41.236618 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:50:41.236618 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:41.236618 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:41.236618 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Aug 28 18:50:41.236618 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Aug 28 18:50:41.236618 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise ValueError(str(e)) Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Aug 28 18:50:41.237887 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Aug 28 18:50:41.239472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Aug 28 18:50:41.239472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Aug 28 18:50:41.239472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Aug 28 18:50:41.239472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Aug 28 18:50:41.239472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 28 18:50:41.239472 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:41.241238 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3473/6947] 10.222.0.27 () {60 vars in 1174 bytes} [Sun Aug 28 18:50:41 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 189 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 18:50:41.242563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8b7a1-ad47-477f-bb62-d3691088c25c tempest-TrustsV3TestJSON-126106140 tempest-user-765351569] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:41.248913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b84528-cb09-4af6-8bce-00925f23a7e2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:41.255859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45073bd2-a37f-4d60-b615-0113d533f3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:41.256683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45073bd2-a37f-4d60-b615-0113d533f3af admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:41.257119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45073bd2-a37f-4d60-b615-0113d533f3af admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:41.257549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45073bd2-a37f-4d60-b615-0113d533f3af admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:41.258361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45073bd2-a37f-4d60-b615-0113d533f3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:41.260199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45073bd2-a37f-4d60-b615-0113d533f3af admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:41.276099 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3475/6948] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:41 2022] GET /identity/v3/roles => generated 1893 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:41.277225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45073bd2-a37f-4d60-b615-0113d533f3af admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:41.283526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8b7a1-ad47-477f-bb62-d3691088c25c tempest-TrustsV3TestJSON-126106140 tempest-user-765351569] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:41.288765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a29ef-cec4-46d2-bea3-1346dada9f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:41.289386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a29ef-cec4-46d2-bea3-1346dada9f8b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:41.289677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a29ef-cec4-46d2-bea3-1346dada9f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:41.290059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a29ef-cec4-46d2-bea3-1346dada9f8b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:41.290816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a29ef-cec4-46d2-bea3-1346dada9f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:41.295366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a29ef-cec4-46d2-bea3-1346dada9f8b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:41.337139 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3474/6949] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:41 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:41.338203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a29ef-cec4-46d2-bea3-1346dada9f8b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:41.364212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a29ef-cec4-46d2-bea3-1346dada9f8b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:41.370799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45073bd2-a37f-4d60-b615-0113d533f3af admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:41.372650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e4866-5b49-40db-9afe-7763cb48f55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:41.373819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e4866-5b49-40db-9afe-7763cb48f55a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:41.374250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e4866-5b49-40db-9afe-7763cb48f55a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:41.374662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e4866-5b49-40db-9afe-7763cb48f55a admin admin] PATH_INFO: `/v3/projects/3bfb314555414c899514cf0310f966d5/users/510505cecc1b4a18b44ab43869898e6c/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:41.376880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4bff0-c09d-4887-8bf6-61e13e339f22 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:41.377639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4bff0-c09d-4887-8bf6-61e13e339f22 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:41.377930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4bff0-c09d-4887-8bf6-61e13e339f22 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:41.378216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4bff0-c09d-4887-8bf6-61e13e339f22 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles/d1666ad16ce942b1beb88f495b36e28a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:41.379840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4bff0-c09d-4887-8bf6-61e13e339f22 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d1666ad16ce942b1beb88f495b36e28a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:41.381642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4bff0-c09d-4887-8bf6-61e13e339f22 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:41.384038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:41.412352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e4866-5b49-40db-9afe-7763cb48f55a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bfb314555414c899514cf0310f966d5, user_id=510505cecc1b4a18b44ab43869898e6c, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:41.417618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e4866-5b49-40db-9afe-7763cb48f55a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:41.446427 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3475/6950] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:41 2022] PUT /identity/v3/projects/3bfb314555414c899514cf0310f966d5/users/510505cecc1b4a18b44ab43869898e6c/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:41.448962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e4866-5b49-40db-9afe-7763cb48f55a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:41.454078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-abe4bff0-c09d-4887-8bf6-61e13e339f22 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invalidating the token cache because role d1666ad16ce942b1beb88f495b36e28a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:41.454440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-abe4bff0-c09d-4887-8bf6-61e13e339f22 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:41.455214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-abe4bff0-c09d-4887-8bf6-61e13e339f22 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:41.460079 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3476/6951] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:41 2022] DELETE /identity/v3/roles/d1666ad16ce942b1beb88f495b36e28a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:41.460079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4bff0-c09d-4887-8bf6-61e13e339f22 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:41.460079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-abe4bff0-c09d-4887-8bf6-61e13e339f22 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:41.572926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e4866-5b49-40db-9afe-7763cb48f55a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:41.580550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4bff0-c09d-4887-8bf6-61e13e339f22 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:41.586469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedabd7b-a860-44d1-a8c4-84284be0099e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:41.587217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedabd7b-a860-44d1-a8c4-84284be0099e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:41.587802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedabd7b-a860-44d1-a8c4-84284be0099e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:41.588182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedabd7b-a860-44d1-a8c4-84284be0099e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:41.588950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedabd7b-a860-44d1-a8c4-84284be0099e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:41.590666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedabd7b-a860-44d1-a8c4-84284be0099e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:41.615315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08690cb4-8c06-40b8-aee0-53fe7947b375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:41.615315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08690cb4-8c06-40b8-aee0-53fe7947b375 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:41.615315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08690cb4-8c06-40b8-aee0-53fe7947b375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:41.615315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08690cb4-8c06-40b8-aee0-53fe7947b375 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:41.631053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08690cb4-8c06-40b8-aee0-53fe7947b375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:41.631053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08690cb4-8c06-40b8-aee0-53fe7947b375 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:41.636846 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3477/6952] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:41 2022] GET /identity/v3/roles => generated 1655 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:41.640573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedabd7b-a860-44d1-a8c4-84284be0099e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:41.645816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dedabd7b-a860-44d1-a8c4-84284be0099e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:41.656000 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3476/6953] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:41 2022] GET /identity/v3/roles => generated 1655 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:41.657024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08690cb4-8c06-40b8-aee0-53fe7947b375 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:41.682656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08690cb4-8c06-40b8-aee0-53fe7947b375 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:41.690392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0b78a-83fd-4f18-867e-f20eaca9f284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:41.691336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0b78a-83fd-4f18-867e-f20eaca9f284 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:41.692106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0b78a-83fd-4f18-867e-f20eaca9f284 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:41.692577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0b78a-83fd-4f18-867e-f20eaca9f284 admin admin] PATH_INFO: `/v3/projects/3bfb314555414c899514cf0310f966d5/users/510505cecc1b4a18b44ab43869898e6c/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:41.695183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0b78a-83fd-4f18-867e-f20eaca9f284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bfb314555414c899514cf0310f966d5, user_id=510505cecc1b4a18b44ab43869898e6c, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:41.698165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0b78a-83fd-4f18-867e-f20eaca9f284 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:41.711365 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3477/6954] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:41 2022] PUT /identity/v3/projects/3bfb314555414c899514cf0310f966d5/users/510505cecc1b4a18b44ab43869898e6c/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:41.712612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0b78a-83fd-4f18-867e-f20eaca9f284 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:41.723617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6cc0b78a-83fd-4f18-867e-f20eaca9f284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:41.829864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0b78a-83fd-4f18-867e-f20eaca9f284 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:41.832996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedabd7b-a860-44d1-a8c4-84284be0099e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:41.836682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c27ce7-c56f-4c22-800a-7f501efd832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:41.837410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c27ce7-c56f-4c22-800a-7f501efd832c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:41.837836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c27ce7-c56f-4c22-800a-7f501efd832c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:41.838111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c27ce7-c56f-4c22-800a-7f501efd832c admin admin] PATH_INFO: `/v3/projects/5dd33fe9379f4c8c980680ca41d48482/users/d57bd1fe8fc040b1a2674737da406a8e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:41.856632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c27ce7-c56f-4c22-800a-7f501efd832c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd33fe9379f4c8c980680ca41d48482, user_id=d57bd1fe8fc040b1a2674737da406a8e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:41.861898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c27ce7-c56f-4c22-800a-7f501efd832c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:41.886471 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3478/6955] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:41 2022] PUT /identity/v3/projects/5dd33fe9379f4c8c980680ca41d48482/users/d57bd1fe8fc040b1a2674737da406a8e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:41.888758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576842bb-198a-4c84-9e34-1b89c74aa727 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:41.889281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576842bb-198a-4c84-9e34-1b89c74aa727 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:41.889562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576842bb-198a-4c84-9e34-1b89c74aa727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:41.915041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:41.951350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04e20c-6398-40b7-a4a8-4d15eea71438 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:41.952165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04e20c-6398-40b7-a4a8-4d15eea71438 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:41.952551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04e20c-6398-40b7-a4a8-4d15eea71438 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:41.952953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04e20c-6398-40b7-a4a8-4d15eea71438 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles/882e0959d3544c29bfaa12ef539ff535` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:41.955238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04e20c-6398-40b7-a4a8-4d15eea71438 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=882e0959d3544c29bfaa12ef539ff535)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:41.957092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04e20c-6398-40b7-a4a8-4d15eea71438 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:41.968845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:41.972716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-576842bb-198a-4c84-9e34-1b89c74aa727 None None] MFA Rules not processed for user `510505cecc1b4a18b44ab43869898e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:41.974002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-576842bb-198a-4c84-9e34-1b89c74aa727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:42.065622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec04e20c-6398-40b7-a4a8-4d15eea71438 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invalidating the token cache because role 882e0959d3544c29bfaa12ef539ff535 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:42.066152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec04e20c-6398-40b7-a4a8-4d15eea71438 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:42.067713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec04e20c-6398-40b7-a4a8-4d15eea71438 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:42.073847 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3478/6956] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:41 2022] DELETE /identity/v3/roles/882e0959d3544c29bfaa12ef539ff535 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:42.073847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04e20c-6398-40b7-a4a8-4d15eea71438 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:42.074278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ec04e20c-6398-40b7-a4a8-4d15eea71438 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:42.205253 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3479/6957] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:42.206223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576842bb-198a-4c84-9e34-1b89c74aa727 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:42.209759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-576842bb-198a-4c84-9e34-1b89c74aa727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:42.260483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04e20c-6398-40b7-a4a8-4d15eea71438 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:42.268068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242fbf8-6fda-40d1-9092-4b7a69b783fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:42.268462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242fbf8-6fda-40d1-9092-4b7a69b783fa admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:42.268880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242fbf8-6fda-40d1-9092-4b7a69b783fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:42.281313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242fbf8-6fda-40d1-9092-4b7a69b783fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:42.281313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242fbf8-6fda-40d1-9092-4b7a69b783fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:42.281313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242fbf8-6fda-40d1-9092-4b7a69b783fa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:42.290290 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3479/6958] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:42.290290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242fbf8-6fda-40d1-9092-4b7a69b783fa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:42.296926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8242fbf8-6fda-40d1-9092-4b7a69b783fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:42.365812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576842bb-198a-4c84-9e34-1b89c74aa727 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:42.378635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242fbf8-6fda-40d1-9092-4b7a69b783fa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:42.389585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e70402-6f9c-4ad3-a99f-5e14bfbf8f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:42.390205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e70402-6f9c-4ad3-a99f-5e14bfbf8f6e service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:42.390484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e70402-6f9c-4ad3-a99f-5e14bfbf8f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:42.390756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e70402-6f9c-4ad3-a99f-5e14bfbf8f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:42.395111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-63e70402-6f9c-4ad3-a99f-5e14bfbf8f6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:42.468551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c710102-2f38-4408-af14-cecf69cb08e1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:42.469235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c710102-2f38-4408-af14-cecf69cb08e1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:42.469515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c710102-2f38-4408-af14-cecf69cb08e1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:42.470065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c710102-2f38-4408-af14-cecf69cb08e1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users/7296e15f4c44473bba9d7914b00e42fb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:42.471565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c710102-2f38-4408-af14-cecf69cb08e1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7296e15f4c44473bba9d7914b00e42fb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:42.476426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c710102-2f38-4408-af14-cecf69cb08e1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:42.496235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e70402-6f9c-4ad3-a99f-5e14bfbf8f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:42.497712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e70402-6f9c-4ad3-a99f-5e14bfbf8f6e service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:42.530723 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3480/6959] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:42.531940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e70402-6f9c-4ad3-a99f-5e14bfbf8f6e service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:42.564354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:42.579975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e70402-6f9c-4ad3-a99f-5e14bfbf8f6e service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:42.585495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c710102-2f38-4408-af14-cecf69cb08e1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7296e15f4c44473bba9d7914b00e42fb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:42.586713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c710102-2f38-4408-af14-cecf69cb08e1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7296e15f4c44473bba9d7914b00e42fb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:42.621903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c710102-2f38-4408-af14-cecf69cb08e1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7296e15f4c44473bba9d7914b00e42fb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:42.624527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6df0db-fd24-4aeb-86fb-a8a5246cb8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:42.625631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6df0db-fd24-4aeb-86fb-a8a5246cb8da admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:42.626127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6df0db-fd24-4aeb-86fb-a8a5246cb8da admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:42.626585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6df0db-fd24-4aeb-86fb-a8a5246cb8da admin admin] PATH_INFO: `/v3/projects/5dd33fe9379f4c8c980680ca41d48482/users/d57bd1fe8fc040b1a2674737da406a8e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:42.632957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6df0db-fd24-4aeb-86fb-a8a5246cb8da admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd33fe9379f4c8c980680ca41d48482, user_id=d57bd1fe8fc040b1a2674737da406a8e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:42.638026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6df0db-fd24-4aeb-86fb-a8a5246cb8da admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:42.649762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c710102-2f38-4408-af14-cecf69cb08e1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7296e15f4c44473bba9d7914b00e42fb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:42.667646 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3481/6960] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:42 2022] PUT /identity/v3/projects/5dd33fe9379f4c8c980680ca41d48482/users/d57bd1fe8fc040b1a2674737da406a8e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:42.682327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06b637-e1c2-4c09-93e8-efc43a734216 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:42.682785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06b637-e1c2-4c09-93e8-efc43a734216 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:42.683212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06b637-e1c2-4c09-93e8-efc43a734216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:42.683923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c710102-2f38-4408-af14-cecf69cb08e1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7296e15f4c44473bba9d7914b00e42fb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:42.704793 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3480/6961] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:42 2022] DELETE /identity/v3/users/7296e15f4c44473bba9d7914b00e42fb => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:42.721575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:42.723208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c710102-2f38-4408-af14-cecf69cb08e1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:42.726392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c710102-2f38-4408-af14-cecf69cb08e1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:42.732998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1b06b637-e1c2-4c09-93e8-efc43a734216 None None] MFA Rules not processed for user `d57bd1fe8fc040b1a2674737da406a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:42.734961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1b06b637-e1c2-4c09-93e8-efc43a734216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:42.859532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c710102-2f38-4408-af14-cecf69cb08e1 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:42.869467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d4619-6341-43f0-8b80-c9b95b8671b9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:42.870258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d4619-6341-43f0-8b80-c9b95b8671b9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:42.870713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d4619-6341-43f0-8b80-c9b95b8671b9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:42.871009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d4619-6341-43f0-8b80-c9b95b8671b9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/de425fce969949e8a116c7ad7310e98c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:42.873586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d4619-6341-43f0-8b80-c9b95b8671b9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_project(project_id=de425fce969949e8a116c7ad7310e98c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:42.877694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d4619-6341-43f0-8b80-c9b95b8671b9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:42.879980 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3482/6962] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:42.881005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06b637-e1c2-4c09-93e8-efc43a734216 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:42.902490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06b637-e1c2-4c09-93e8-efc43a734216 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:42.912409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf4b4b-83e4-40ea-a3b9-adab15215fb8 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd57bd1fe8fc040b1a2674737da406a8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd33fe9379f4c8c980680ca41d48482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:42.918128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf4b4b-83e4-40ea-a3b9-adab15215fb8 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:42.918128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf4b4b-83e4-40ea-a3b9-adab15215fb8 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:42.918128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf4b4b-83e4-40ea-a3b9-adab15215fb8 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:42.918128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf4b4b-83e4-40ea-a3b9-adab15215fb8 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:42.925230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf4b4b-83e4-40ea-a3b9-adab15215fb8 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:42.958457 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3483/6963] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:50:42 2022] POST /identity/v3/domains => generated 277 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:42.963362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf4b4b-83e4-40ea-a3b9-adab15215fb8 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:42.964528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b80d4619-6341-43f0-8b80-c9b95b8671b9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de425fce969949e8a116c7ad7310e98c', 'request_id': 'req-b80d4619-6341-43f0-8b80-c9b95b8671b9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:42.980903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b80d4619-6341-43f0-8b80-c9b95b8671b9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de425fce969949e8a116c7ad7310e98c', 'request_id': 'req-b80d4619-6341-43f0-8b80-c9b95b8671b9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:42.988259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b80d4619-6341-43f0-8b80-c9b95b8671b9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de425fce969949e8a116c7ad7310e98c', 'request_id': 'req-b80d4619-6341-43f0-8b80-c9b95b8671b9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:43.002983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b80d4619-6341-43f0-8b80-c9b95b8671b9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] The token cache is being invalidate because project de425fce969949e8a116c7ad7310e98c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:43.003345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b80d4619-6341-43f0-8b80-c9b95b8671b9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:43.004177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b80d4619-6341-43f0-8b80-c9b95b8671b9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:43.005794 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3481/6964] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:42 2022] DELETE /identity/v3/projects/de425fce969949e8a116c7ad7310e98c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:50:43.011422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d4619-6341-43f0-8b80-c9b95b8671b9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:43.016315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b80d4619-6341-43f0-8b80-c9b95b8671b9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:43.095270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:43.096312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf4b4b-83e4-40ea-a3b9-adab15215fb8 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:43.109474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60056f-328b-4623-bf9f-f32670caaa81 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd57bd1fe8fc040b1a2674737da406a8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd33fe9379f4c8c980680ca41d48482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:43.119319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60056f-328b-4623-bf9f-f32670caaa81 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:43.119319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60056f-328b-4623-bf9f-f32670caaa81 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:43.119319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60056f-328b-4623-bf9f-f32670caaa81 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:43.119319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60056f-328b-4623-bf9f-f32670caaa81 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:43.121649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60056f-328b-4623-bf9f-f32670caaa81 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:43.133094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d4619-6341-43f0-8b80-c9b95b8671b9 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:43.201993 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3484/6965] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:42 2022] POST /identity/v3/users => generated 347 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:43.208098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60056f-328b-4623-bf9f-f32670caaa81 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:43.217505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eb60056f-328b-4623-bf9f-f32670caaa81 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:43.237587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60056f-328b-4623-bf9f-f32670caaa81 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:43.245714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9ed29-072a-4e3a-b9ef-af871963b025 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd57bd1fe8fc040b1a2674737da406a8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd33fe9379f4c8c980680ca41d48482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:43.246342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9ed29-072a-4e3a-b9ef-af871963b025 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:43.246767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9ed29-072a-4e3a-b9ef-af871963b025 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:43.247052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9ed29-072a-4e3a-b9ef-af871963b025 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:43.248187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9ed29-072a-4e3a-b9ef-af871963b025 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:43.250113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9ed29-072a-4e3a-b9ef-af871963b025 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:43.261686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57583978-e1b9-406f-889e-6ae59852e1d0 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:43.262590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57583978-e1b9-406f-889e-6ae59852e1d0 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:43.262947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57583978-e1b9-406f-889e-6ae59852e1d0 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:43.263545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57583978-e1b9-406f-889e-6ae59852e1d0 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:43.264493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57583978-e1b9-406f-889e-6ae59852e1d0 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:43.266829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57583978-e1b9-406f-889e-6ae59852e1d0 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:43.299631 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3485/6966] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:43 2022] POST /identity/v3/users => generated 322 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:43.302050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9ed29-072a-4e3a-b9ef-af871963b025 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:43.336740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9ed29-072a-4e3a-b9ef-af871963b025 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:43.337105 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3482/6967] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:50:43 2022] POST /identity/v3/projects => generated 329 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:43.337642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57583978-e1b9-406f-889e-6ae59852e1d0 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:43.429904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:43.454141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46b1ad-15c6-4a37-98de-3c6f3b12b07f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd57bd1fe8fc040b1a2674737da406a8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd33fe9379f4c8c980680ca41d48482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:43.455429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46b1ad-15c6-4a37-98de-3c6f3b12b07f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:43.455867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46b1ad-15c6-4a37-98de-3c6f3b12b07f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:43.456679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46b1ad-15c6-4a37-98de-3c6f3b12b07f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] PATH_INFO: `/v3/users/9d127e3c9e6249caa47045c4b9527c46` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:43.476631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57583978-e1b9-406f-889e-6ae59852e1d0 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:43.490679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46b1ad-15c6-4a37-98de-3c6f3b12b07f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorizing `identity:get_user(user_id=9d127e3c9e6249caa47045c4b9527c46)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:43.497510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c8ec2-f26b-405d-ae41-3978c175baf8 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:43.498214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c8ec2-f26b-405d-ae41-3978c175baf8 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:43.498530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c8ec2-f26b-405d-ae41-3978c175baf8 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:43.498775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c8ec2-f26b-405d-ae41-3978c175baf8 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:43.499518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c8ec2-f26b-405d-ae41-3978c175baf8 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:43.499803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46b1ad-15c6-4a37-98de-3c6f3b12b07f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:43.501771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c8ec2-f26b-405d-ae41-3978c175baf8 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:43.503381 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3486/6968] 10.222.0.27 () {58 vars in 1221 bytes} [Sun Aug 28 18:50:43 2022] GET /identity/v3/users/9d127e3c9e6249caa47045c4b9527c46 => generated 347 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:43.508090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46b1ad-15c6-4a37-98de-3c6f3b12b07f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:43.533123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46b1ad-15c6-4a37-98de-3c6f3b12b07f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:43.542163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e6227-1260-4f73-91fe-6b96b0a7024c tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd57bd1fe8fc040b1a2674737da406a8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd33fe9379f4c8c980680ca41d48482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:43.542798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e6227-1260-4f73-91fe-6b96b0a7024c tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:43.543084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e6227-1260-4f73-91fe-6b96b0a7024c tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:43.543477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e6227-1260-4f73-91fe-6b96b0a7024c tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:43.544202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e6227-1260-4f73-91fe-6b96b0a7024c tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Adding query filter params (domain_id=12fb9fc947d54dbbbef22b47796ad1a6) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:43.544506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e6227-1260-4f73-91fe-6b96b0a7024c tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:43.547032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e6227-1260-4f73-91fe-6b96b0a7024c tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:43.550638 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3483/6969] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:43 2022] POST /identity/v3/users => generated 416 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:43.551557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c8ec2-f26b-405d-ae41-3978c175baf8 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:43.583231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c8ec2-f26b-405d-ae41-3978c175baf8 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:43.588280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ab8f8-15ca-477c-9c76-898835151f53 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:43.589017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ab8f8-15ca-477c-9c76-898835151f53 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:43.589302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ab8f8-15ca-477c-9c76-898835151f53 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:43.589581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ab8f8-15ca-477c-9c76-898835151f53 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:43.590626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ab8f8-15ca-477c-9c76-898835151f53 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:43.592362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ab8f8-15ca-477c-9c76-898835151f53 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:43.596530 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3487/6970] 10.222.0.27 () {58 vars in 1207 bytes} [Sun Aug 28 18:50:43 2022] GET /identity/v3/users?domain_id=12fb9fc947d54dbbbef22b47796ad1a6 => generated 484 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:43.598907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e6227-1260-4f73-91fe-6b96b0a7024c tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:43.624062 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3484/6971] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:50:43 2022] POST /identity/v3/roles => generated 243 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:43.629708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e6227-1260-4f73-91fe-6b96b0a7024c tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:43.631271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ab8f8-15ca-477c-9c76-898835151f53 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:43.644023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d21224-eebf-4b60-92bd-699614d5a72a tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd57bd1fe8fc040b1a2674737da406a8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd33fe9379f4c8c980680ca41d48482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:43.644653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d21224-eebf-4b60-92bd-699614d5a72a tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:43.646119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d21224-eebf-4b60-92bd-699614d5a72a tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:43.646411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d21224-eebf-4b60-92bd-699614d5a72a tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:43.648682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d21224-eebf-4b60-92bd-699614d5a72a tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:43.649520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d21224-eebf-4b60-92bd-699614d5a72a tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:43.663789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ab8f8-15ca-477c-9c76-898835151f53 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:43.672448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976c99e-b1ab-4d36-92a9-9c63b352eee4 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:43.673370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976c99e-b1ab-4d36-92a9-9c63b352eee4 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:43.673654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976c99e-b1ab-4d36-92a9-9c63b352eee4 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:43.673932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976c99e-b1ab-4d36-92a9-9c63b352eee4 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:43.674605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976c99e-b1ab-4d36-92a9-9c63b352eee4 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:43.677003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976c99e-b1ab-4d36-92a9-9c63b352eee4 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:43.700766 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3485/6972] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:50:43 2022] POST /identity/v3/roles => generated 246 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:43.701918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976c99e-b1ab-4d36-92a9-9c63b352eee4 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:43.713869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976c99e-b1ab-4d36-92a9-9c63b352eee4 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:43.718020 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3488/6973] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:43 2022] GET /identity/v3/users => generated 8974 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:43.719144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d21224-eebf-4b60-92bd-699614d5a72a tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:43.721880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8889d6e-0cea-463c-984e-8410c8447c3b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:43.722852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8889d6e-0cea-463c-984e-8410c8447c3b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:43.723332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8889d6e-0cea-463c-984e-8410c8447c3b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:43.724055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8889d6e-0cea-463c-984e-8410c8447c3b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/c84d8788b5ad418c9aa6eb93f26b43a8/users/ffeb690e6813454ca141a6514613feaa/roles/7c7757db7e014bcf97ef6514e957561c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:43.739968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d21224-eebf-4b60-92bd-699614d5a72a tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:43.750640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791da6df-b81d-4a30-8a58-c9d081f714f9 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd57bd1fe8fc040b1a2674737da406a8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd33fe9379f4c8c980680ca41d48482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:43.751365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da6df-b81d-4a30-8a58-c9d081f714f9 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:43.751651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da6df-b81d-4a30-8a58-c9d081f714f9 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:43.751928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da6df-b81d-4a30-8a58-c9d081f714f9 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:43.752644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791da6df-b81d-4a30-8a58-c9d081f714f9 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1377626884) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:43.752943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791da6df-b81d-4a30-8a58-c9d081f714f9 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:43.754771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791da6df-b81d-4a30-8a58-c9d081f714f9 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:43.770758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8889d6e-0cea-463c-984e-8410c8447c3b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c84d8788b5ad418c9aa6eb93f26b43a8, user_id=ffeb690e6813454ca141a6514613feaa, role_id=7c7757db7e014bcf97ef6514e957561c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:43.777943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8889d6e-0cea-463c-984e-8410c8447c3b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:43.810265 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3486/6974] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:43 2022] PUT /identity/v3/projects/c84d8788b5ad418c9aa6eb93f26b43a8/users/ffeb690e6813454ca141a6514613feaa/roles/7c7757db7e014bcf97ef6514e957561c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:43.812106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8889d6e-0cea-463c-984e-8410c8447c3b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:43.842710 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3489/6975] 10.222.0.27 () {58 vars in 1189 bytes} [Sun Aug 28 18:50:43 2022] GET /identity/v3/users?name=tempest-test_user-1377626884 => generated 475 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:43.852066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791da6df-b81d-4a30-8a58-c9d081f714f9 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:43.868681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791da6df-b81d-4a30-8a58-c9d081f714f9 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:43.885675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:44.029223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8889d6e-0cea-463c-984e-8410c8447c3b tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:44.033906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86b477-a3c0-4600-a0c1-f191b73ced90 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd57bd1fe8fc040b1a2674737da406a8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd33fe9379f4c8c980680ca41d48482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:44.035450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86b477-a3c0-4600-a0c1-f191b73ced90 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:44.035980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86b477-a3c0-4600-a0c1-f191b73ced90 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:44.037130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86b477-a3c0-4600-a0c1-f191b73ced90 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:44.037439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86b477-a3c0-4600-a0c1-f191b73ced90 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:44.037824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86b477-a3c0-4600-a0c1-f191b73ced90 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:44.040690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86b477-a3c0-4600-a0c1-f191b73ced90 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:44.067722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9b291-4e2f-4f4c-a6e3-d9a8ab8e7e44 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:44.071197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9b291-4e2f-4f4c-a6e3-d9a8ab8e7e44 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:44.071533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9b291-4e2f-4f4c-a6e3-d9a8ab8e7e44 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:44.075860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9b291-4e2f-4f4c-a6e3-d9a8ab8e7e44 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/c84d8788b5ad418c9aa6eb93f26b43a8/users/ffeb690e6813454ca141a6514613feaa/roles/782ff1bb4dbd47aa8d506ca8782533d6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:44.088842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9b291-4e2f-4f4c-a6e3-d9a8ab8e7e44 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c84d8788b5ad418c9aa6eb93f26b43a8, user_id=ffeb690e6813454ca141a6514613feaa, role_id=782ff1bb4dbd47aa8d506ca8782533d6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:44.100496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9b291-4e2f-4f4c-a6e3-d9a8ab8e7e44 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:44.103311 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3490/6976] 10.222.0.27 () {58 vars in 1149 bytes} [Sun Aug 28 18:50:43 2022] GET /identity/v3/users?enabled=False => generated 430 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:44.107916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86b477-a3c0-4600-a0c1-f191b73ced90 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:44.120413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86b477-a3c0-4600-a0c1-f191b73ced90 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:44.150106 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3487/6977] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:43 2022] PUT /identity/v3/projects/c84d8788b5ad418c9aa6eb93f26b43a8/users/ffeb690e6813454ca141a6514613feaa/roles/782ff1bb4dbd47aa8d506ca8782533d6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:44.151572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9b291-4e2f-4f4c-a6e3-d9a8ab8e7e44 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:44.152776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b42542-5c47-4764-b934-ea2b22c4f761 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd57bd1fe8fc040b1a2674737da406a8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd33fe9379f4c8c980680ca41d48482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:44.154250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b42542-5c47-4764-b934-ea2b22c4f761 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:44.154525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b42542-5c47-4764-b934-ea2b22c4f761 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:44.154999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b42542-5c47-4764-b934-ea2b22c4f761 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] PATH_INFO: `/v3/users/624c109a192b4400b4c2e26e039bebbd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:44.196219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b42542-5c47-4764-b934-ea2b22c4f761 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorizing `identity:delete_user(user_id=624c109a192b4400b4c2e26e039bebbd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:44.200636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b42542-5c47-4764-b934-ea2b22c4f761 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:44.312964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06b42542-5c47-4764-b934-ea2b22c4f761 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '624c109a192b4400b4c2e26e039bebbd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:44.333492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06b42542-5c47-4764-b934-ea2b22c4f761 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '624c109a192b4400b4c2e26e039bebbd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:44.334526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06b42542-5c47-4764-b934-ea2b22c4f761 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '624c109a192b4400b4c2e26e039bebbd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:44.335449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06b42542-5c47-4764-b934-ea2b22c4f761 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '624c109a192b4400b4c2e26e039bebbd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:44.350602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06b42542-5c47-4764-b934-ea2b22c4f761 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '624c109a192b4400b4c2e26e039bebbd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:44.369243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:44.383447 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3491/6978] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:44 2022] DELETE /identity/v3/users/624c109a192b4400b4c2e26e039bebbd => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:44.386152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b42542-5c47-4764-b934-ea2b22c4f761 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:44.389769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9b291-4e2f-4f4c-a6e3-d9a8ab8e7e44 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:44.390820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-06b42542-5c47-4764-b934-ea2b22c4f761 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:44.585570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606a851-eda9-4e30-988d-18c29c7f7358 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:44.587414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606a851-eda9-4e30-988d-18c29c7f7358 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:44.587806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606a851-eda9-4e30-988d-18c29c7f7358 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:44.588228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606a851-eda9-4e30-988d-18c29c7f7358 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:44.589008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606a851-eda9-4e30-988d-18c29c7f7358 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:44.594613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606a851-eda9-4e30-988d-18c29c7f7358 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:44.602522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b42542-5c47-4764-b934-ea2b22c4f761 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:44.636705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99699842-c209-4e21-8a8b-b4938cb7182f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd57bd1fe8fc040b1a2674737da406a8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd33fe9379f4c8c980680ca41d48482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:44.637370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99699842-c209-4e21-8a8b-b4938cb7182f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:44.637648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99699842-c209-4e21-8a8b-b4938cb7182f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:44.638026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99699842-c209-4e21-8a8b-b4938cb7182f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] PATH_INFO: `/v3/users/9d127e3c9e6249caa47045c4b9527c46` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:44.639961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99699842-c209-4e21-8a8b-b4938cb7182f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9d127e3c9e6249caa47045c4b9527c46)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:44.644309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99699842-c209-4e21-8a8b-b4938cb7182f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:44.650206 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3488/6979] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:44 2022] GET /identity/v3/users => generated 8661 bytes in 499 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:44.651828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48864bc8-fd0d-47a2-8e78-3a51664e845f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:44.652224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48864bc8-fd0d-47a2-8e78-3a51664e845f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:44.652434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48864bc8-fd0d-47a2-8e78-3a51664e845f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:44.750155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-48864bc8-fd0d-47a2-8e78-3a51664e845f None None] MFA Rules not processed for user `ffeb690e6813454ca141a6514613feaa`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:44.751240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48864bc8-fd0d-47a2-8e78-3a51664e845f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:44.778174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99699842-c209-4e21-8a8b-b4938cb7182f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d127e3c9e6249caa47045c4b9527c46'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:44.793296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99699842-c209-4e21-8a8b-b4938cb7182f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d127e3c9e6249caa47045c4b9527c46'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:44.795328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99699842-c209-4e21-8a8b-b4938cb7182f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d127e3c9e6249caa47045c4b9527c46'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:44.796923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99699842-c209-4e21-8a8b-b4938cb7182f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d127e3c9e6249caa47045c4b9527c46'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:44.817009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99699842-c209-4e21-8a8b-b4938cb7182f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d127e3c9e6249caa47045c4b9527c46'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:44.817617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:44.871108 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3489/6981] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:44 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:44.871341 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3492/6981] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:44 2022] DELETE /identity/v3/users/9d127e3c9e6249caa47045c4b9527c46 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:44.871796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bc797-70ca-4fd9-90f3-6f56e0ca84c2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:44.872016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bc797-70ca-4fd9-90f3-6f56e0ca84c2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:44.872221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99699842-c209-4e21-8a8b-b4938cb7182f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:44.872373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bc797-70ca-4fd9-90f3-6f56e0ca84c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:44.876696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-99699842-c209-4e21-8a8b-b4938cb7182f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:44.903737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-773bc797-70ca-4fd9-90f3-6f56e0ca84c2 None None] MFA Rules not processed for user `ffeb690e6813454ca141a6514613feaa`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:44.908057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-773bc797-70ca-4fd9-90f3-6f56e0ca84c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:45.051792 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3490/6982] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:44 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:45.056311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bc797-70ca-4fd9-90f3-6f56e0ca84c2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:45.066486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bc797-70ca-4fd9-90f3-6f56e0ca84c2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:45.073337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7d4a1-2663-4f85-8b01-df6d9ea99d31 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeb690e6813454ca141a6514613feaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c84d8788b5ad418c9aa6eb93f26b43a8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-840728241', 'tempest-DelegatedRole-297979753'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:45.074122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7d4a1-2663-4f85-8b01-df6d9ea99d31 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:45.074600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7d4a1-2663-4f85-8b01-df6d9ea99d31 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:45.074991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7d4a1-2663-4f85-8b01-df6d9ea99d31 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:45.075803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7d4a1-2663-4f85-8b01-df6d9ea99d31 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: Authorizing `identity:create_trust()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:45.077659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7d4a1-2663-4f85-8b01-df6d9ea99d31 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:45.097187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99699842-c209-4e21-8a8b-b4938cb7182f tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:45.117427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb7eef-3a5b-427b-9529-e5e582ac9386 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd57bd1fe8fc040b1a2674737da406a8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd33fe9379f4c8c980680ca41d48482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:45.119011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb7eef-3a5b-427b-9529-e5e582ac9386 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:45.119498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb7eef-3a5b-427b-9529-e5e582ac9386 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:45.119951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb7eef-3a5b-427b-9529-e5e582ac9386 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] PATH_INFO: `/v3/domains/12fb9fc947d54dbbbef22b47796ad1a6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:45.128816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb7eef-3a5b-427b-9529-e5e582ac9386 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=12fb9fc947d54dbbbef22b47796ad1a6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:45.130776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb7eef-3a5b-427b-9529-e5e582ac9386 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:45.217632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-69fb7eef-3a5b-427b-9529-e5e582ac9386 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '12fb9fc947d54dbbbef22b47796ad1a6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:45.227793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-69fb7eef-3a5b-427b-9529-e5e582ac9386 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '12fb9fc947d54dbbbef22b47796ad1a6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:45.229675 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3491/6983] 10.222.0.27 () {60 vars in 1174 bytes} [Sun Aug 28 18:50:45 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:45.234566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7d4a1-2663-4f85-8b01-df6d9ea99d31 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:45.237411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:45.240918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2aa7d4a1-2663-4f85-8b01-df6d9ea99d31 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:45.278074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7d4a1-2663-4f85-8b01-df6d9ea99d31 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:45.280137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-69fb7eef-3a5b-427b-9529-e5e582ac9386 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '12fb9fc947d54dbbbef22b47796ad1a6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:45.281682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-69fb7eef-3a5b-427b-9529-e5e582ac9386 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '12fb9fc947d54dbbbef22b47796ad1a6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:45.286101 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3493/6984] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:50:44 2022] PATCH /identity/v3/domains/12fb9fc947d54dbbbef22b47796ad1a6 => generated 278 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:45.289666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb7eef-3a5b-427b-9529-e5e582ac9386 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:45.292212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-69fb7eef-3a5b-427b-9529-e5e582ac9386 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:45.486485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff8508-f98a-4731-880c-90bf801bf5f4 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeb690e6813454ca141a6514613feaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c84d8788b5ad418c9aa6eb93f26b43a8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-840728241', 'tempest-DelegatedRole-297979753'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:45.487158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff8508-f98a-4731-880c-90bf801bf5f4 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:45.489197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff8508-f98a-4731-880c-90bf801bf5f4 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:45.489496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff8508-f98a-4731-880c-90bf801bf5f4 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] PATH_INFO: `/v3/OS-TRUST/trusts/8d1142c856bb4249a5832ae544ecf33e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:45.500062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff8508-f98a-4731-880c-90bf801bf5f4 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: Authorizing `identity:get_trust(trust_id=8d1142c856bb4249a5832ae544ecf33e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:45.501536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff8508-f98a-4731-880c-90bf801bf5f4 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:45.509656 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3492/6985] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Aug 28 18:50:45 2022] GET /identity/v3/OS-TRUST/trusts/8d1142c856bb4249a5832ae544ecf33e => generated 833 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:45.513794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff8508-f98a-4731-880c-90bf801bf5f4 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:45.518297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b3ff8508-f98a-4731-880c-90bf801bf5f4 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:45.533430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:45.549832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff8508-f98a-4731-880c-90bf801bf5f4 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:45.566177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb7eef-3a5b-427b-9529-e5e582ac9386 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:45.579648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a31079-4dba-48b9-b144-bccaef0bd605 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeb690e6813454ca141a6514613feaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c84d8788b5ad418c9aa6eb93f26b43a8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-840728241', 'tempest-DelegatedRole-297979753'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:45.581646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a31079-4dba-48b9-b144-bccaef0bd605 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:45.583169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a31079-4dba-48b9-b144-bccaef0bd605 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:45.583725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a31079-4dba-48b9-b144-bccaef0bd605 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] PATH_INFO: `/v3/OS-TRUST/trusts/8d1142c856bb4249a5832ae544ecf33e/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:45.586793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd57bd1fe8fc040b1a2674737da406a8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd33fe9379f4c8c980680ca41d48482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:45.587645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:45.589226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:45.589226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] PATH_INFO: `/v3/domains/12fb9fc947d54dbbbef22b47796ad1a6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:45.602468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a31079-4dba-48b9-b144-bccaef0bd605 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=8d1142c856bb4249a5832ae544ecf33e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:45.603962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=12fb9fc947d54dbbbef22b47796ad1a6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:45.606554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:45.607291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a31079-4dba-48b9-b144-bccaef0bd605 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:45.623306 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3493/6986] 10.222.0.27 () {58 vars in 1269 bytes} [Sun Aug 28 18:50:45 2022] GET /identity/v3/OS-TRUST/trusts/8d1142c856bb4249a5832ae544ecf33e/roles => generated 370 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:45.626552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a31079-4dba-48b9-b144-bccaef0bd605 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:45.644448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a31079-4dba-48b9-b144-bccaef0bd605 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:45.655106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d307c-981a-40c1-87ea-09285ea3e009 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeb690e6813454ca141a6514613feaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c84d8788b5ad418c9aa6eb93f26b43a8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-840728241', 'tempest-DelegatedRole-297979753'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:45.656310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d307c-981a-40c1-87ea-09285ea3e009 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:45.656642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d307c-981a-40c1-87ea-09285ea3e009 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:45.656922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d307c-981a-40c1-87ea-09285ea3e009 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] PATH_INFO: `/v3/OS-TRUST/trusts/8d1142c856bb4249a5832ae544ecf33e/roles/7c7757db7e014bcf97ef6514e957561c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:45.674546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '12fb9fc947d54dbbbef22b47796ad1a6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:45.675395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d307c-981a-40c1-87ea-09285ea3e009 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8d1142c856bb4249a5832ae544ecf33e, role_id=7c7757db7e014bcf97ef6514e957561c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:45.677845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d307c-981a-40c1-87ea-09285ea3e009 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:45.694740 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3494/6987] 10.222.0.27 () {58 vars in 1368 bytes} [Sun Aug 28 18:50:45 2022] GET /identity/v3/OS-TRUST/trusts/8d1142c856bb4249a5832ae544ecf33e/roles/7c7757db7e014bcf97ef6514e957561c => generated 243 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:45.695767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d307c-981a-40c1-87ea-09285ea3e009 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:45.699223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '12fb9fc947d54dbbbef22b47796ad1a6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:45.731777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d307c-981a-40c1-87ea-09285ea3e009 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:45.739692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96241925-c608-4c64-9b02-8f04bc57948d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeb690e6813454ca141a6514613feaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c84d8788b5ad418c9aa6eb93f26b43a8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-840728241', 'tempest-DelegatedRole-297979753'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:45.740509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96241925-c608-4c64-9b02-8f04bc57948d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:45.740682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96241925-c608-4c64-9b02-8f04bc57948d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:45.740911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96241925-c608-4c64-9b02-8f04bc57948d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] PATH_INFO: `/v3/OS-TRUST/trusts/8d1142c856bb4249a5832ae544ecf33e/roles/7c7757db7e014bcf97ef6514e957561c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:45.752149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96241925-c608-4c64-9b02-8f04bc57948d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8d1142c856bb4249a5832ae544ecf33e, role_id=7c7757db7e014bcf97ef6514e957561c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:45.759910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96241925-c608-4c64-9b02-8f04bc57948d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:45.774734 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3495/6988] 10.222.0.27 () {58 vars in 1369 bytes} [Sun Aug 28 18:50:45 2022] HEAD /identity/v3/OS-TRUST/trusts/8d1142c856bb4249a5832ae544ecf33e/roles/7c7757db7e014bcf97ef6514e957561c => generated 0 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 28 18:50:45.775994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96241925-c608-4c64-9b02-8f04bc57948d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:45.788997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96241925-c608-4c64-9b02-8f04bc57948d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:45.800298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836f998-8162-4da2-be94-ec86a361a739 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeb690e6813454ca141a6514613feaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c84d8788b5ad418c9aa6eb93f26b43a8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-840728241', 'tempest-DelegatedRole-297979753'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:45.802239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836f998-8162-4da2-be94-ec86a361a739 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:45.805284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836f998-8162-4da2-be94-ec86a361a739 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:45.805641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836f998-8162-4da2-be94-ec86a361a739 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] PATH_INFO: `/v3/OS-TRUST/trusts/8d1142c856bb4249a5832ae544ecf33e/roles/782ff1bb4dbd47aa8d506ca8782533d6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:45.822725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836f998-8162-4da2-be94-ec86a361a739 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8d1142c856bb4249a5832ae544ecf33e, role_id=782ff1bb4dbd47aa8d506ca8782533d6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:45.823824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12fb9fc947d54dbbbef22b47796ad1a6', 'request_id': 'req-fe74fbe8-7e6a-4782-9edb-ca3573c65810'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:45.824346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836f998-8162-4da2-be94-ec86a361a739 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:45.842648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12fb9fc947d54dbbbef22b47796ad1a6', 'request_id': 'req-fe74fbe8-7e6a-4782-9edb-ca3573c65810'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:45.851309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3836f998-8162-4da2-be94-ec86a361a739 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Could not find role: 782ff1bb4dbd47aa8d506ca8782533d6.: keystone.exception.RoleNotFound: Could not find role: 782ff1bb4dbd47aa8d506ca8782533d6. Aug 28 18:50:45.851309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:45.851309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:45.851309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:45.851309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:45.851309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:45.851309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:45.851309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:45.851309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:45.851309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:45.851309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:45.851309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:45.851309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 18:50:45.851309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:50:45.851309 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 782ff1bb4dbd47aa8d506ca8782533d6. Aug 28 18:50:45.853047 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:45.855436 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3496/6989] 10.222.0.27 () {58 vars in 1368 bytes} [Sun Aug 28 18:50:45 2022] GET /identity/v3/OS-TRUST/trusts/8d1142c856bb4249a5832ae544ecf33e/roles/782ff1bb4dbd47aa8d506ca8782533d6 => generated 110 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:50:45.857277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836f998-8162-4da2-be94-ec86a361a739 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:45.868221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12fb9fc947d54dbbbef22b47796ad1a6', 'request_id': 'req-fe74fbe8-7e6a-4782-9edb-ca3573c65810'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:45.884314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836f998-8162-4da2-be94-ec86a361a739 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:45.892296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] The token cache is being invalidate because project 12fb9fc947d54dbbbef22b47796ad1a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:45.892742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:45.893465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:45.907371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '12fb9fc947d54dbbbef22b47796ad1a6', 'request_id': 'req-fe74fbe8-7e6a-4782-9edb-ca3573c65810'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:45.916382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '12fb9fc947d54dbbbef22b47796ad1a6', 'request_id': 'req-fe74fbe8-7e6a-4782-9edb-ca3573c65810'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:45.918710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '12fb9fc947d54dbbbef22b47796ad1a6', 'request_id': 'req-fe74fbe8-7e6a-4782-9edb-ca3573c65810'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:45.936407 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3494/6990] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:50:45 2022] DELETE /identity/v3/domains/12fb9fc947d54dbbbef22b47796ad1a6 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:45.940388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:45.942325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:45.953274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46c3c0-afd3-4826-b16b-a75e5dfb529f tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeb690e6813454ca141a6514613feaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c84d8788b5ad418c9aa6eb93f26b43a8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-840728241', 'tempest-DelegatedRole-297979753'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:45.954394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c3c0-afd3-4826-b16b-a75e5dfb529f tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:45.955037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c3c0-afd3-4826-b16b-a75e5dfb529f tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:45.955413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c3c0-afd3-4826-b16b-a75e5dfb529f tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] PATH_INFO: `/v3/OS-TRUST/trusts/8d1142c856bb4249a5832ae544ecf33e/roles/782ff1bb4dbd47aa8d506ca8782533d6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:45.987145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46c3c0-afd3-4826-b16b-a75e5dfb529f tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8d1142c856bb4249a5832ae544ecf33e, role_id=782ff1bb4dbd47aa8d506ca8782533d6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:45.994760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46c3c0-afd3-4826-b16b-a75e5dfb529f tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:46.014531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-1a46c3c0-afd3-4826-b16b-a75e5dfb529f tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Could not find role: 782ff1bb4dbd47aa8d506ca8782533d6.: keystone.exception.RoleNotFound: Could not find role: 782ff1bb4dbd47aa8d506ca8782533d6. Aug 28 18:50:46.014531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:46.014531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:46.014531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:46.014531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:46.014531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:46.014531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:46.014531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:46.014531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:46.014531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:46.014531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:46.014531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:46.014531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 18:50:46.014531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:50:46.014531 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 782ff1bb4dbd47aa8d506ca8782533d6. Aug 28 18:50:46.015697 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:46.016283 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3497/6991] 10.222.0.27 () {58 vars in 1369 bytes} [Sun Aug 28 18:50:45 2022] HEAD /identity/v3/OS-TRUST/trusts/8d1142c856bb4249a5832ae544ecf33e/roles/782ff1bb4dbd47aa8d506ca8782533d6 => generated 0 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 28 18:50:46.020527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46c3c0-afd3-4826-b16b-a75e5dfb529f tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:46.021978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:46.035921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1a46c3c0-afd3-4826-b16b-a75e5dfb529f tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:46.064839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46c3c0-afd3-4826-b16b-a75e5dfb529f tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:46.075295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1e92f-fca4-4f68-87a7-eabb94b0525d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeb690e6813454ca141a6514613feaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c84d8788b5ad418c9aa6eb93f26b43a8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-840728241', 'tempest-DelegatedRole-297979753'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:46.075295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1e92f-fca4-4f68-87a7-eabb94b0525d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:46.075295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1e92f-fca4-4f68-87a7-eabb94b0525d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:46.075713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1e92f-fca4-4f68-87a7-eabb94b0525d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] PATH_INFO: `/v3/OS-TRUST/trusts/8d1142c856bb4249a5832ae544ecf33e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:46.084979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1e92f-fca4-4f68-87a7-eabb94b0525d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: Authorizing `identity:delete_trust(trust_id=8d1142c856bb4249a5832ae544ecf33e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:46.086380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1e92f-fca4-4f68-87a7-eabb94b0525d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:46.109491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64e1e92f-fca4-4f68-87a7-eabb94b0525d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8d1142c856bb4249a5832ae544ecf33e', 'request_id': 'req-64e1e92f-fca4-4f68-87a7-eabb94b0525d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:46.110230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64e1e92f-fca4-4f68-87a7-eabb94b0525d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '8d1142c856bb4249a5832ae544ecf33e', 'request_id': 'req-64e1e92f-fca4-4f68-87a7-eabb94b0525d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:46.119218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74fbe8-7e6a-4782-9edb-ca3573c65810 tempest-UsersV3TestJSON-2125190045 tempest-UsersV3TestJSON-2125190045-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:46.125794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acb7fd-0ec4-4f71-a43e-24efacf2ed3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:46.127038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acb7fd-0ec4-4f71-a43e-24efacf2ed3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:46.127606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acb7fd-0ec4-4f71-a43e-24efacf2ed3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:46.129324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64e1e92f-fca4-4f68-87a7-eabb94b0525d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8d1142c856bb4249a5832ae544ecf33e', 'request_id': 'req-64e1e92f-fca4-4f68-87a7-eabb94b0525d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:46.129430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acb7fd-0ec4-4f71-a43e-24efacf2ed3d admin admin] PATH_INFO: `/v3/users/f5ccc0fc05144a52aae124d14056b64d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:46.129714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acb7fd-0ec4-4f71-a43e-24efacf2ed3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ccc0fc05144a52aae124d14056b64d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:46.133136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acb7fd-0ec4-4f71-a43e-24efacf2ed3d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:46.136155 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3498/6992] 10.222.0.27 () {58 vars in 1254 bytes} [Sun Aug 28 18:50:46 2022] DELETE /identity/v3/OS-TRUST/trusts/8d1142c856bb4249a5832ae544ecf33e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:46.140172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1e92f-fca4-4f68-87a7-eabb94b0525d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:46.142177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-64e1e92f-fca4-4f68-87a7-eabb94b0525d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:46.168631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1e92f-fca4-4f68-87a7-eabb94b0525d tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:46.182941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcfa81-98a5-4274-92fb-728fd5e02a32 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeb690e6813454ca141a6514613feaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c84d8788b5ad418c9aa6eb93f26b43a8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-840728241', 'tempest-DelegatedRole-297979753'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:46.184101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcfa81-98a5-4274-92fb-728fd5e02a32 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:46.184588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcfa81-98a5-4274-92fb-728fd5e02a32 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:46.185267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcfa81-98a5-4274-92fb-728fd5e02a32 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] PATH_INFO: `/v3/OS-TRUST/trusts/8d1142c856bb4249a5832ae544ecf33e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:46.197418 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-ccbcfa81-98a5-4274-92fb-728fd5e02a32 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Could not find trust: 8d1142c856bb4249a5832ae544ecf33e.: keystone.exception.TrustNotFound: Could not find trust: 8d1142c856bb4249a5832ae544ecf33e. Aug 28 18:50:46.197418 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:46.197418 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:46.197418 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:46.197418 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:46.197418 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:46.197418 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:46.197418 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:46.197418 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:46.197418 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:46.197418 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:46.197418 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:46.197418 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 18:50:46.197418 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 18:50:46.197418 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 18:50:46.198501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 18:50:46.198501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 18:50:46.198501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 18:50:46.198501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 18:50:46.198501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 18:50:46.198501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:50:46.198501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:50:46.198501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 18:50:46.198501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 18:50:46.198501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 18:50:46.198501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 18:50:46.198501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 8d1142c856bb4249a5832ae544ecf33e. Aug 28 18:50:46.198501 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:46.202003 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3499/6993] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Aug 28 18:50:46 2022] GET /identity/v3/OS-TRUST/trusts/8d1142c856bb4249a5832ae544ecf33e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:50:46.206494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcfa81-98a5-4274-92fb-728fd5e02a32 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:46.210165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ccbcfa81-98a5-4274-92fb-728fd5e02a32 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:46.251643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9acb7fd-0ec4-4f71-a43e-24efacf2ed3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ccc0fc05144a52aae124d14056b64d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:46.283214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9acb7fd-0ec4-4f71-a43e-24efacf2ed3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ccc0fc05144a52aae124d14056b64d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:46.285301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9acb7fd-0ec4-4f71-a43e-24efacf2ed3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ccc0fc05144a52aae124d14056b64d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:46.287186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9acb7fd-0ec4-4f71-a43e-24efacf2ed3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ccc0fc05144a52aae124d14056b64d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:46.304645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9acb7fd-0ec4-4f71-a43e-24efacf2ed3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ccc0fc05144a52aae124d14056b64d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:46.311339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:46.326210 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3495/6994] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:45 2022] DELETE /identity/v3/users/f5ccc0fc05144a52aae124d14056b64d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:50:46.330829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a1878-3bb4-48cf-a691-9baccf43eb00 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:46.331108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a1878-3bb4-48cf-a691-9baccf43eb00 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:46.331447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a1878-3bb4-48cf-a691-9baccf43eb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:46.358179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcfa81-98a5-4274-92fb-728fd5e02a32 tempest-TrustsV3TestJSON-1396001557 tempest-user-1574884134] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:46.361030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7a3a1878-3bb4-48cf-a691-9baccf43eb00 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:46.362378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7a3a1878-3bb4-48cf-a691-9baccf43eb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:46.457794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ea53f-b26f-40ce-bf85-a7d12543484f tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:46.458818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea53f-b26f-40ce-bf85-a7d12543484f tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:46.459248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea53f-b26f-40ce-bf85-a7d12543484f tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:46.459885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea53f-b26f-40ce-bf85-a7d12543484f tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles/782ff1bb4dbd47aa8d506ca8782533d6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:46.461762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ea53f-b26f-40ce-bf85-a7d12543484f tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=782ff1bb4dbd47aa8d506ca8782533d6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:46.463852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ea53f-b26f-40ce-bf85-a7d12543484f tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:46.527008 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3496/6995] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:46.538277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a1878-3bb4-48cf-a691-9baccf43eb00 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:46.549852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7a3a1878-3bb4-48cf-a691-9baccf43eb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:46.575417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-899ea53f-b26f-40ce-bf85-a7d12543484f tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invalidating the token cache because role 782ff1bb4dbd47aa8d506ca8782533d6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:46.575812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-899ea53f-b26f-40ce-bf85-a7d12543484f tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:46.580633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a1878-3bb4-48cf-a691-9baccf43eb00 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:46.587121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499bdf2-b1c2-4f50-93ae-8c77f4f73fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:46.587958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499bdf2-b1c2-4f50-93ae-8c77f4f73fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:46.588571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499bdf2-b1c2-4f50-93ae-8c77f4f73fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:46.588951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499bdf2-b1c2-4f50-93ae-8c77f4f73fd7 admin admin] PATH_INFO: `/v3/users/01c1eb3859e14164af0d2877a4c38840` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:46.589715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-899ea53f-b26f-40ce-bf85-a7d12543484f tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:46.590313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499bdf2-b1c2-4f50-93ae-8c77f4f73fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01c1eb3859e14164af0d2877a4c38840)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:46.592422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499bdf2-b1c2-4f50-93ae-8c77f4f73fd7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:46.629686 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3500/6996] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:46 2022] DELETE /identity/v3/roles/782ff1bb4dbd47aa8d506ca8782533d6 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:46.630878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ea53f-b26f-40ce-bf85-a7d12543484f tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:46.639880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-899ea53f-b26f-40ce-bf85-a7d12543484f tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:46.655036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:46.679645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1499bdf2-b1c2-4f50-93ae-8c77f4f73fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01c1eb3859e14164af0d2877a4c38840'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:46.704689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1499bdf2-b1c2-4f50-93ae-8c77f4f73fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01c1eb3859e14164af0d2877a4c38840'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:46.706316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1499bdf2-b1c2-4f50-93ae-8c77f4f73fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01c1eb3859e14164af0d2877a4c38840'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:46.707015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1499bdf2-b1c2-4f50-93ae-8c77f4f73fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01c1eb3859e14164af0d2877a4c38840'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:46.718339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1499bdf2-b1c2-4f50-93ae-8c77f4f73fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01c1eb3859e14164af0d2877a4c38840'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:46.733908 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3497/6997] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:46 2022] DELETE /identity/v3/users/01c1eb3859e14164af0d2877a4c38840 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:46.738301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499bdf2-b1c2-4f50-93ae-8c77f4f73fd7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:46.739831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1499bdf2-b1c2-4f50-93ae-8c77f4f73fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:46.759630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ea53f-b26f-40ce-bf85-a7d12543484f tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:46.842484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6145ea-aece-4605-84a0-1fcbc1809b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:46.843596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6145ea-aece-4605-84a0-1fcbc1809b58 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:46.844025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6145ea-aece-4605-84a0-1fcbc1809b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:46.844444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6145ea-aece-4605-84a0-1fcbc1809b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:46.846487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab6145ea-aece-4605-84a0-1fcbc1809b58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:46.847674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499bdf2-b1c2-4f50-93ae-8c77f4f73fd7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:46.853342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfd46e-1459-486f-bde8-ec80abd54569 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:46.854177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfd46e-1459-486f-bde8-ec80abd54569 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:46.855123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfd46e-1459-486f-bde8-ec80abd54569 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:46.855123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfd46e-1459-486f-bde8-ec80abd54569 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles/7c7757db7e014bcf97ef6514e957561c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:46.856557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfd46e-1459-486f-bde8-ec80abd54569 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7c7757db7e014bcf97ef6514e957561c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:46.858338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfd46e-1459-486f-bde8-ec80abd54569 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:46.874900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:46.944261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6145ea-aece-4605-84a0-1fcbc1809b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:46.945723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6145ea-aece-4605-84a0-1fcbc1809b58 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:46.952685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23dfd46e-1459-486f-bde8-ec80abd54569 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invalidating the token cache because role 7c7757db7e014bcf97ef6514e957561c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:46.952988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23dfd46e-1459-486f-bde8-ec80abd54569 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:46.953724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23dfd46e-1459-486f-bde8-ec80abd54569 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:46.959081 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3498/6998] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:46 2022] DELETE /identity/v3/roles/7c7757db7e014bcf97ef6514e957561c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:46.959081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c1491-38e0-45f0-9931-226a1a4c0a5b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:46.959081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c1491-38e0-45f0-9931-226a1a4c0a5b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:46.959081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c1491-38e0-45f0-9931-226a1a4c0a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:46.963322 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3501/6999] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:46.964558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6145ea-aece-4605-84a0-1fcbc1809b58 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:46.991535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ea8c1491-38e0-45f0-9931-226a1a4c0a5b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:46.992762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ea8c1491-38e0-45f0-9931-226a1a4c0a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:46.994325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6145ea-aece-4605-84a0-1fcbc1809b58 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:47.087014 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3499/7000] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:47.128793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c1491-38e0-45f0-9931-226a1a4c0a5b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:47.130565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ea8c1491-38e0-45f0-9931-226a1a4c0a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:47.171992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:47.190923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191113b2-dfa4-415e-9842-6db259578c84 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:47.193013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191113b2-dfa4-415e-9842-6db259578c84 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:47.194108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191113b2-dfa4-415e-9842-6db259578c84 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:47.195130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191113b2-dfa4-415e-9842-6db259578c84 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users/ffeb690e6813454ca141a6514613feaa` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:47.198368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191113b2-dfa4-415e-9842-6db259578c84 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ffeb690e6813454ca141a6514613feaa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:47.203023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191113b2-dfa4-415e-9842-6db259578c84 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:47.279378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-191113b2-dfa4-415e-9842-6db259578c84 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffeb690e6813454ca141a6514613feaa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:47.280589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-191113b2-dfa4-415e-9842-6db259578c84 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffeb690e6813454ca141a6514613feaa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:47.289953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-191113b2-dfa4-415e-9842-6db259578c84 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffeb690e6813454ca141a6514613feaa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:47.293556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c1491-38e0-45f0-9931-226a1a4c0a5b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:47.300511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-191113b2-dfa4-415e-9842-6db259578c84 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffeb690e6813454ca141a6514613feaa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:47.312733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b9f0b-be3e-4de4-980f-27abae75f3f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:47.313476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b9f0b-be3e-4de4-980f-27abae75f3f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:47.313767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b9f0b-be3e-4de4-980f-27abae75f3f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:47.314237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b9f0b-be3e-4de4-980f-27abae75f3f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:47.318592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-486b9f0b-be3e-4de4-980f-27abae75f3f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:47.321008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-191113b2-dfa4-415e-9842-6db259578c84 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffeb690e6813454ca141a6514613feaa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:47.338954 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3502/7001] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:46 2022] DELETE /identity/v3/users/ffeb690e6813454ca141a6514613feaa => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:47.340129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191113b2-dfa4-415e-9842-6db259578c84 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:47.341854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-191113b2-dfa4-415e-9842-6db259578c84 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:47.347144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b9f0b-be3e-4de4-980f-27abae75f3f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:47.348634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b9f0b-be3e-4de4-980f-27abae75f3f7 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:47.380749 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3500/7002] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:50:47.417360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:47.450166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191113b2-dfa4-415e-9842-6db259578c84 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:47.466459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:47.466459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:47.466459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:47.466792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/c84d8788b5ad418c9aa6eb93f26b43a8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:47.466792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c84d8788b5ad418c9aa6eb93f26b43a8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:47.466792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:47.621758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c84d8788b5ad418c9aa6eb93f26b43a8', 'request_id': 'req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:47.636233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c84d8788b5ad418c9aa6eb93f26b43a8', 'request_id': 'req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:47.661603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c84d8788b5ad418c9aa6eb93f26b43a8', 'request_id': 'req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:47.679563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] The token cache is being invalidate because project c84d8788b5ad418c9aa6eb93f26b43a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:47.679972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:47.680777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:47.683111 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3503/7003] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:47 2022] DELETE /identity/v3/projects/c84d8788b5ad418c9aa6eb93f26b43a8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:47.690834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b9f0b-be3e-4de4-980f-27abae75f3f7 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:47.701586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:47.705315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:47.711617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b9f0b-be3e-4de4-980f-27abae75f3f7 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:47.886084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fc5e3-d8e7-4719-9979-ec22658ecca5 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:47.887042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fc5e3-d8e7-4719-9979-ec22658ecca5 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:47.887527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fc5e3-d8e7-4719-9979-ec22658ecca5 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:47.887957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fc5e3-d8e7-4719-9979-ec22658ecca5 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:47.892641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fc5e3-d8e7-4719-9979-ec22658ecca5 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:47.898867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fc5e3-d8e7-4719-9979-ec22658ecca5 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:48.023121 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3501/7004] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:50:47 2022] POST /identity/v3/projects => generated 329 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:48.027908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fc5e3-d8e7-4719-9979-ec22658ecca5 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:48.029253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e76fc5e3-d8e7-4719-9979-ec22658ecca5 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:48.042558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cf48c-b2bf-47e9-acfc-7722ea35e0e3 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:48.172038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e456055-fe77-4f47-b6e7-b0152e2315eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:48.172736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e456055-fe77-4f47-b6e7-b0152e2315eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:48.173057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e456055-fe77-4f47-b6e7-b0152e2315eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:48.173340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e456055-fe77-4f47-b6e7-b0152e2315eb admin admin] PATH_INFO: `/v3/projects/b597632da8bc42c392cf8e2c33ea4f2e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:48.174497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e456055-fe77-4f47-b6e7-b0152e2315eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b597632da8bc42c392cf8e2c33ea4f2e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:48.176559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e456055-fe77-4f47-b6e7-b0152e2315eb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:48.221255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:48.233117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fc5e3-d8e7-4719-9979-ec22658ecca5 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:48.260377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b8203-7a1f-4b0f-87af-e88efeab8c3d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:48.260565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b8203-7a1f-4b0f-87af-e88efeab8c3d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:48.260863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b8203-7a1f-4b0f-87af-e88efeab8c3d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:48.261545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b8203-7a1f-4b0f-87af-e88efeab8c3d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:48.262213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b8203-7a1f-4b0f-87af-e88efeab8c3d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:48.267183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b8203-7a1f-4b0f-87af-e88efeab8c3d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:48.308515 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3502/7005] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:48 2022] POST /identity/v3/users => generated 416 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:48.312376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e456055-fe77-4f47-b6e7-b0152e2315eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b597632da8bc42c392cf8e2c33ea4f2e', 'request_id': 'req-1e456055-fe77-4f47-b6e7-b0152e2315eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:48.312521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b8203-7a1f-4b0f-87af-e88efeab8c3d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:48.334916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b8203-7a1f-4b0f-87af-e88efeab8c3d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:48.343038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e456055-fe77-4f47-b6e7-b0152e2315eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b597632da8bc42c392cf8e2c33ea4f2e', 'request_id': 'req-1e456055-fe77-4f47-b6e7-b0152e2315eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:48.350151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e456055-fe77-4f47-b6e7-b0152e2315eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b597632da8bc42c392cf8e2c33ea4f2e', 'request_id': 'req-1e456055-fe77-4f47-b6e7-b0152e2315eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:48.376656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e456055-fe77-4f47-b6e7-b0152e2315eb admin admin] The token cache is being invalidate because project b597632da8bc42c392cf8e2c33ea4f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:48.376950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e456055-fe77-4f47-b6e7-b0152e2315eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:48.377631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e456055-fe77-4f47-b6e7-b0152e2315eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:48.379355 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3504/7006] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:47 2022] DELETE /identity/v3/projects/b597632da8bc42c392cf8e2c33ea4f2e => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:48.380276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e456055-fe77-4f47-b6e7-b0152e2315eb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:48.381757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e456055-fe77-4f47-b6e7-b0152e2315eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:48.416562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:48.444655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae9344-61b7-4aae-8962-552b4fbc6895 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:48.445282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae9344-61b7-4aae-8962-552b4fbc6895 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:48.445565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae9344-61b7-4aae-8962-552b4fbc6895 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:48.445892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae9344-61b7-4aae-8962-552b4fbc6895 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:48.446675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae9344-61b7-4aae-8962-552b4fbc6895 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:48.448434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae9344-61b7-4aae-8962-552b4fbc6895 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:48.466117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e456055-fe77-4f47-b6e7-b0152e2315eb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:48.467842 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3503/7007] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:50:48 2022] POST /identity/v3/roles => generated 243 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:50:48.469459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae9344-61b7-4aae-8962-552b4fbc6895 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:48.474413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-40ae9344-61b7-4aae-8962-552b4fbc6895 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:48.482157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59058ba3-8421-489f-a512-8bbb982d03eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:48.482872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59058ba3-8421-489f-a512-8bbb982d03eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:48.483156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59058ba3-8421-489f-a512-8bbb982d03eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:48.483460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59058ba3-8421-489f-a512-8bbb982d03eb admin admin] PATH_INFO: `/v3/projects/8748594c5de349bdb66c576e79d1bf56` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:48.487008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59058ba3-8421-489f-a512-8bbb982d03eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8748594c5de349bdb66c576e79d1bf56)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:48.494632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59058ba3-8421-489f-a512-8bbb982d03eb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:48.503483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae9344-61b7-4aae-8962-552b4fbc6895 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:48.511202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e9486-ea6a-4f72-875d-f221609a348e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:48.512381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e9486-ea6a-4f72-875d-f221609a348e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:48.513210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e9486-ea6a-4f72-875d-f221609a348e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:48.513656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e9486-ea6a-4f72-875d-f221609a348e admin admin] PATH_INFO: `/v3/users/d57bd1fe8fc040b1a2674737da406a8e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:48.516056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e9486-ea6a-4f72-875d-f221609a348e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57bd1fe8fc040b1a2674737da406a8e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:48.522541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e9486-ea6a-4f72-875d-f221609a348e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:48.571041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-59058ba3-8421-489f-a512-8bbb982d03eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8748594c5de349bdb66c576e79d1bf56', 'request_id': 'req-59058ba3-8421-489f-a512-8bbb982d03eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:48.586891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-59058ba3-8421-489f-a512-8bbb982d03eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8748594c5de349bdb66c576e79d1bf56', 'request_id': 'req-59058ba3-8421-489f-a512-8bbb982d03eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:48.587123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b6e9486-ea6a-4f72-875d-f221609a348e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57bd1fe8fc040b1a2674737da406a8e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:48.600468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-59058ba3-8421-489f-a512-8bbb982d03eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8748594c5de349bdb66c576e79d1bf56', 'request_id': 'req-59058ba3-8421-489f-a512-8bbb982d03eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:48.602188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b6e9486-ea6a-4f72-875d-f221609a348e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57bd1fe8fc040b1a2674737da406a8e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:48.603046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b6e9486-ea6a-4f72-875d-f221609a348e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57bd1fe8fc040b1a2674737da406a8e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:48.604769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b6e9486-ea6a-4f72-875d-f221609a348e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57bd1fe8fc040b1a2674737da406a8e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:48.620674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b6e9486-ea6a-4f72-875d-f221609a348e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57bd1fe8fc040b1a2674737da406a8e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:48.625924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-59058ba3-8421-489f-a512-8bbb982d03eb admin admin] The token cache is being invalidate because project 8748594c5de349bdb66c576e79d1bf56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:48.626225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-59058ba3-8421-489f-a512-8bbb982d03eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:48.627077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-59058ba3-8421-489f-a512-8bbb982d03eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:48.629928 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3505/7008] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:48 2022] DELETE /identity/v3/projects/8748594c5de349bdb66c576e79d1bf56 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:48.630902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59058ba3-8421-489f-a512-8bbb982d03eb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:48.633681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-59058ba3-8421-489f-a512-8bbb982d03eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:48.640982 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3504/7009] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:48 2022] DELETE /identity/v3/users/d57bd1fe8fc040b1a2674737da406a8e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:48.642249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e9486-ea6a-4f72-875d-f221609a348e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:48.643918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8b6e9486-ea6a-4f72-875d-f221609a348e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:48.708008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:48.737695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59058ba3-8421-489f-a512-8bbb982d03eb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:48.832409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ec525-b35c-4dc1-8a59-927a5d9b7835 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:48.835471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ec525-b35c-4dc1-8a59-927a5d9b7835 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:48.837830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ec525-b35c-4dc1-8a59-927a5d9b7835 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:48.838268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ec525-b35c-4dc1-8a59-927a5d9b7835 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:48.841593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ec525-b35c-4dc1-8a59-927a5d9b7835 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:48.847325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ec525-b35c-4dc1-8a59-927a5d9b7835 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:48.882763 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3506/7010] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:50:48 2022] POST /identity/v3/roles => generated 246 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:48.884787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27328897-32a4-4c15-a574-ee98a5271165 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:48.885214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27328897-32a4-4c15-a574-ee98a5271165 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:48.885616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27328897-32a4-4c15-a574-ee98a5271165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:48.914120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e9486-ea6a-4f72-875d-f221609a348e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:48.920638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-27328897-32a4-4c15-a574-ee98a5271165 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:48.922029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27328897-32a4-4c15-a574-ee98a5271165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:48.931048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a12527-60e8-46e2-8904-b538bf121bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:48.931862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a12527-60e8-46e2-8904-b538bf121bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:48.932341 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3507/7011] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:48.933271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27328897-32a4-4c15-a574-ee98a5271165 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:48.938625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a12527-60e8-46e2-8904-b538bf121bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:48.939007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a12527-60e8-46e2-8904-b538bf121bdf admin admin] PATH_INFO: `/v3/users/ad7bc63215bf49169e4f2bc1557992c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:48.941893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a12527-60e8-46e2-8904-b538bf121bdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7bc63215bf49169e4f2bc1557992c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:48.943923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a12527-60e8-46e2-8904-b538bf121bdf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:48.948694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27328897-32a4-4c15-a574-ee98a5271165 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:48.953703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d5566-8fca-4c27-8b0d-15fb3edfba77 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:48.954689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5566-8fca-4c27-8b0d-15fb3edfba77 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:48.955000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5566-8fca-4c27-8b0d-15fb3edfba77 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:48.955414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5566-8fca-4c27-8b0d-15fb3edfba77 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/fd40d53e884345d09ede81b6c6ea5588/users/f404788b4cc74837b90b059fe0a2153c/roles/c339144aa22d4495acd9d24a5bcda1f4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:48.974932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d5566-8fca-4c27-8b0d-15fb3edfba77 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fd40d53e884345d09ede81b6c6ea5588, user_id=f404788b4cc74837b90b059fe0a2153c, role_id=c339144aa22d4495acd9d24a5bcda1f4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:48.978123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d5566-8fca-4c27-8b0d-15fb3edfba77 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:49.015351 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3508/7012] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:48 2022] PUT /identity/v3/projects/fd40d53e884345d09ede81b6c6ea5588/users/f404788b4cc74837b90b059fe0a2153c/roles/c339144aa22d4495acd9d24a5bcda1f4 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:49.016486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d5566-8fca-4c27-8b0d-15fb3edfba77 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:49.018332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-184d5566-8fca-4c27-8b0d-15fb3edfba77 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:49.054051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=82,keystone:INSERT=2,keystone:DELETE=16 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:49.063696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1a12527-60e8-46e2-8904-b538bf121bdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7bc63215bf49169e4f2bc1557992c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:49.093157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1a12527-60e8-46e2-8904-b538bf121bdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7bc63215bf49169e4f2bc1557992c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:49.094079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1a12527-60e8-46e2-8904-b538bf121bdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7bc63215bf49169e4f2bc1557992c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:49.094974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1a12527-60e8-46e2-8904-b538bf121bdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7bc63215bf49169e4f2bc1557992c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:49.111984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1a12527-60e8-46e2-8904-b538bf121bdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7bc63215bf49169e4f2bc1557992c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:49.127667 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3505/7013] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:48 2022] DELETE /identity/v3/users/ad7bc63215bf49169e4f2bc1557992c8 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:49.134506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ddd3f-98ae-4722-b790-e8c91752cf09 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:49.134783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ddd3f-98ae-4722-b790-e8c91752cf09 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:49.135133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ddd3f-98ae-4722-b790-e8c91752cf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:49.205955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d5566-8fca-4c27-8b0d-15fb3edfba77 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:49.206868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a35ddd3f-98ae-4722-b790-e8c91752cf09 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:49.208145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a35ddd3f-98ae-4722-b790-e8c91752cf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:49.351832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3ea79-22ee-4a53-ae5e-cd984f3d40e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:49.351832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3ea79-22ee-4a53-ae5e-cd984f3d40e1 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:49.351832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3ea79-22ee-4a53-ae5e-cd984f3d40e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:49.351832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3ea79-22ee-4a53-ae5e-cd984f3d40e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:49.358388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-73f3ea79-22ee-4a53-ae5e-cd984f3d40e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:49.378913 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3506/7014] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:49.379636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ddd3f-98ae-4722-b790-e8c91752cf09 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:49.381445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a35ddd3f-98ae-4722-b790-e8c91752cf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:49.386773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:49.455605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3ea79-22ee-4a53-ae5e-cd984f3d40e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:49.457408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3ea79-22ee-4a53-ae5e-cd984f3d40e1 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:49.474853 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3509/7015] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:49.476496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4a09b-1773-4079-9afb-2c9f865085bb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:49.476966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4a09b-1773-4079-9afb-2c9f865085bb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:49.479064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4a09b-1773-4079-9afb-2c9f865085bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:49.486300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ddd3f-98ae-4722-b790-e8c91752cf09 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:49.493132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b438dd-4615-4050-9ccb-6efeafa993aa tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:49.494695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b438dd-4615-4050-9ccb-6efeafa993aa tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:49.495237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b438dd-4615-4050-9ccb-6efeafa993aa tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:49.495807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b438dd-4615-4050-9ccb-6efeafa993aa tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/fd40d53e884345d09ede81b6c6ea5588/users/f404788b4cc74837b90b059fe0a2153c/roles/9f5d764389fc4e518c5cd0ef42053622` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:49.498408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b438dd-4615-4050-9ccb-6efeafa993aa tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fd40d53e884345d09ede81b6c6ea5588, user_id=f404788b4cc74837b90b059fe0a2153c, role_id=9f5d764389fc4e518c5cd0ef42053622)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:49.502585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b438dd-4615-4050-9ccb-6efeafa993aa tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:49.525342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-caf4a09b-1773-4079-9afb-2c9f865085bb None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:49.526881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-caf4a09b-1773-4079-9afb-2c9f865085bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:49.548933 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3507/7016] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:49 2022] PUT /identity/v3/projects/fd40d53e884345d09ede81b6c6ea5588/users/f404788b4cc74837b90b059fe0a2153c/roles/9f5d764389fc4e518c5cd0ef42053622 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:49.552148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b438dd-4615-4050-9ccb-6efeafa993aa tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:49.556007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-17b438dd-4615-4050-9ccb-6efeafa993aa tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:49.650486 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3510/7017] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:49.651403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4a09b-1773-4079-9afb-2c9f865085bb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:49.673037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4a09b-1773-4079-9afb-2c9f865085bb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:49.678169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc37b7a-08cb-4ef3-b823-82e01760c589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:49.678795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc37b7a-08cb-4ef3-b823-82e01760c589 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:49.679076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc37b7a-08cb-4ef3-b823-82e01760c589 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:49.679398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc37b7a-08cb-4ef3-b823-82e01760c589 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:49.679528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:49.680218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc37b7a-08cb-4ef3-b823-82e01760c589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:49.680525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc37b7a-08cb-4ef3-b823-82e01760c589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:49.683219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc37b7a-08cb-4ef3-b823-82e01760c589 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:49.692001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b438dd-4615-4050-9ccb-6efeafa993aa tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:49.698776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:49.699462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:49.699741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:49.700009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675 admin admin] PATH_INFO: `/v3/projects/5dd33fe9379f4c8c980680ca41d48482` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:49.701502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd33fe9379f4c8c980680ca41d48482)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:49.703027 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3511/7018] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:49.703556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:49.704033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc37b7a-08cb-4ef3-b823-82e01760c589 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:49.819139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd33fe9379f4c8c980680ca41d48482', 'request_id': 'req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:49.828829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd33fe9379f4c8c980680ca41d48482', 'request_id': 'req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:49.837484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc37b7a-08cb-4ef3-b823-82e01760c589 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:49.840253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd33fe9379f4c8c980680ca41d48482', 'request_id': 'req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:49.873381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675 admin admin] The token cache is being invalidate because project 5dd33fe9379f4c8c980680ca41d48482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:49.874786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:49.876812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:49.881765 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3508/7019] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:49 2022] DELETE /identity/v3/projects/5dd33fe9379f4c8c980680ca41d48482 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:49.881765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:49.885691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:49.932716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:49.949877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930fd37-533e-4726-97ea-fa43ce43460d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:49.950764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930fd37-533e-4726-97ea-fa43ce43460d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:49.951223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930fd37-533e-4726-97ea-fa43ce43460d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:49.951671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930fd37-533e-4726-97ea-fa43ce43460d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:49.952482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930fd37-533e-4726-97ea-fa43ce43460d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:49.955092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930fd37-533e-4726-97ea-fa43ce43460d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:49.961644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ef73d-a4c4-4da7-ae71-c1db5b801675 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:49.967729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31a0f0-9861-461e-b274-109f326febdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:49.968524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31a0f0-9861-461e-b274-109f326febdf service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:49.968898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31a0f0-9861-461e-b274-109f326febdf service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:49.969322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31a0f0-9861-461e-b274-109f326febdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:49.971502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-df31a0f0-9861-461e-b274-109f326febdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:49.987385 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3512/7020] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:49 2022] GET /identity/v3/users => generated 7211 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:49.987385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930fd37-533e-4726-97ea-fa43ce43460d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:49.993160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a930fd37-533e-4726-97ea-fa43ce43460d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:50.111339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31a0f0-9861-461e-b274-109f326febdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:50.112053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930fd37-533e-4726-97ea-fa43ce43460d tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:50.113061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31a0f0-9861-461e-b274-109f326febdf service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:50.117755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd13f8b-0cac-4f56-b777-2910b8d91ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:50.118375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd13f8b-0cac-4f56-b777-2910b8d91ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:50.118699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd13f8b-0cac-4f56-b777-2910b8d91ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:50.118917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd13f8b-0cac-4f56-b777-2910b8d91ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:50.119757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd13f8b-0cac-4f56-b777-2910b8d91ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:50.121921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd13f8b-0cac-4f56-b777-2910b8d91ba7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:50.138303 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3509/7021] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:50.139899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432e623-916f-4281-ab78-e27dfd9d00c9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:50.140255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432e623-916f-4281-ab78-e27dfd9d00c9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:50.140599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432e623-916f-4281-ab78-e27dfd9d00c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:50.167031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8432e623-916f-4281-ab78-e27dfd9d00c9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:50.168480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8432e623-916f-4281-ab78-e27dfd9d00c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:50.172864 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3513/7022] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:49 2022] POST /identity/v3/projects => generated 401 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:50.176029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e467946-3d1b-4fb8-a4ec-1d4de47d06c2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:50.176620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e467946-3d1b-4fb8-a4ec-1d4de47d06c2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:50.177998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e467946-3d1b-4fb8-a4ec-1d4de47d06c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:50.232206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:50.277823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7e467946-3d1b-4fb8-a4ec-1d4de47d06c2 None None] MFA Rules not processed for user `f404788b4cc74837b90b059fe0a2153c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:50.280744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7e467946-3d1b-4fb8-a4ec-1d4de47d06c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:50.288648 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3510/7023] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:50.289458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432e623-916f-4281-ab78-e27dfd9d00c9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:50.310497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432e623-916f-4281-ab78-e27dfd9d00c9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:50.316358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896fc74-112f-4178-bd56-9882425d11d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:50.317588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896fc74-112f-4178-bd56-9882425d11d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:50.317991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896fc74-112f-4178-bd56-9882425d11d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:50.319168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896fc74-112f-4178-bd56-9882425d11d0 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:50.320194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896fc74-112f-4178-bd56-9882425d11d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:50.322916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896fc74-112f-4178-bd56-9882425d11d0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:50.374517 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3511/7024] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:50 2022] POST /identity/v3/users => generated 301 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:50.376131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81638376-cd4f-4b88-8956-610a387af2b9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:50.376543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81638376-cd4f-4b88-8956-610a387af2b9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:50.376822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81638376-cd4f-4b88-8956-610a387af2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:50.397642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-81638376-cd4f-4b88-8956-610a387af2b9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:50.398798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-81638376-cd4f-4b88-8956-610a387af2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:50.401491 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3514/7025] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:50 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:50.407408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e467946-3d1b-4fb8-a4ec-1d4de47d06c2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:50.411618 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3512/7026] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:50.413315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05254dee-3b43-4ed5-8be9-b5045889eaeb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:50.413658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05254dee-3b43-4ed5-8be9-b5045889eaeb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:50.413990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05254dee-3b43-4ed5-8be9-b5045889eaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:50.439504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e467946-3d1b-4fb8-a4ec-1d4de47d06c2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:50.440799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-05254dee-3b43-4ed5-8be9-b5045889eaeb None None] MFA Rules not processed for user `f404788b4cc74837b90b059fe0a2153c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:50.444127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-05254dee-3b43-4ed5-8be9-b5045889eaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:50.448845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf11aeb-cf66-4c5f-ac0a-952ce26f4e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:50.449490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf11aeb-cf66-4c5f-ac0a-952ce26f4e33 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:50.449810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf11aeb-cf66-4c5f-ac0a-952ce26f4e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:50.450475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf11aeb-cf66-4c5f-ac0a-952ce26f4e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:50.457452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf11aeb-cf66-4c5f-ac0a-952ce26f4e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:50.457624 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3513/7027] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:50 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:50.457754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf11aeb-cf66-4c5f-ac0a-952ce26f4e33 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:50.457858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05254dee-3b43-4ed5-8be9-b5045889eaeb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:50.477618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05254dee-3b43-4ed5-8be9-b5045889eaeb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:50.481167 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3515/7028] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:50 2022] GET /identity/v3/roles => generated 1891 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:50.481167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf11aeb-cf66-4c5f-ac0a-952ce26f4e33 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:50.484634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e7971-5668-486c-a806-60b8a28fa871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:50.485472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e7971-5668-486c-a806-60b8a28fa871 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:50.485968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e7971-5668-486c-a806-60b8a28fa871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:50.486336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e7971-5668-486c-a806-60b8a28fa871 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:50.487240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e7971-5668-486c-a806-60b8a28fa871 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:50.487665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e7971-5668-486c-a806-60b8a28fa871 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:50.489502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e7971-5668-486c-a806-60b8a28fa871 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:50.492415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf11aeb-cf66-4c5f-ac0a-952ce26f4e33 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:50.503775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d361f-e610-44d2-bfce-cf6a87e07cf9 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f404788b4cc74837b90b059fe0a2153c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd40d53e884345d09ede81b6c6ea5588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-388733800', 'tempest-DelegatedRole-329296995'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:50.504674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d361f-e610-44d2-bfce-cf6a87e07cf9 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:50.505100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d361f-e610-44d2-bfce-cf6a87e07cf9 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:50.509149 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3514/7029] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:50.509149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e7971-5668-486c-a806-60b8a28fa871 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:50.510568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d361f-e610-44d2-bfce-cf6a87e07cf9 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:50.513909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d361f-e610-44d2-bfce-cf6a87e07cf9 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: Authorizing `identity:create_trust()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:50.515889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d361f-e610-44d2-bfce-cf6a87e07cf9 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:50.523167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e7971-5668-486c-a806-60b8a28fa871 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:50.535238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00f035-ae26-4572-9c24-c600c43fcd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:50.535966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00f035-ae26-4572-9c24-c600c43fcd2b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:50.537281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00f035-ae26-4572-9c24-c600c43fcd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:50.537630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00f035-ae26-4572-9c24-c600c43fcd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:50.538361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00f035-ae26-4572-9c24-c600c43fcd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:50.543466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00f035-ae26-4572-9c24-c600c43fcd2b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:50.557465 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3515/7030] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:50 2022] GET /identity/v3/roles => generated 1891 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:50.558566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00f035-ae26-4572-9c24-c600c43fcd2b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:50.572217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:50.589938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00f035-ae26-4572-9c24-c600c43fcd2b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:50.602130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161dba1-61cf-422a-93d6-c35d07903867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:50.602884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161dba1-61cf-422a-93d6-c35d07903867 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:50.606231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161dba1-61cf-422a-93d6-c35d07903867 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:50.606231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161dba1-61cf-422a-93d6-c35d07903867 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:50.606231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161dba1-61cf-422a-93d6-c35d07903867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:50.606946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161dba1-61cf-422a-93d6-c35d07903867 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:50.630531 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3516/7031] 10.222.0.27 () {60 vars in 1174 bytes} [Sun Aug 28 18:50:50 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:50.631960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d361f-e610-44d2-bfce-cf6a87e07cf9 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:50.646852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d361f-e610-44d2-bfce-cf6a87e07cf9 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:50.653290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6a164-0da3-4c2f-bb3a-3f835072c643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:50.654254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6a164-0da3-4c2f-bb3a-3f835072c643 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:50.654764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6a164-0da3-4c2f-bb3a-3f835072c643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:50.655112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6a164-0da3-4c2f-bb3a-3f835072c643 admin admin] PATH_INFO: `/v3/projects/e3b80857b8124be8b30a4ee36e79636b/users/e8252a305455469ba107ba34952a20c0/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:50.666252 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3516/7032] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:50 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:50.667329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161dba1-61cf-422a-93d6-c35d07903867 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:50.669112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2161dba1-61cf-422a-93d6-c35d07903867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:50.673270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6a164-0da3-4c2f-bb3a-3f835072c643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b80857b8124be8b30a4ee36e79636b, user_id=e8252a305455469ba107ba34952a20c0, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:50.676093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6a164-0da3-4c2f-bb3a-3f835072c643 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:50.701974 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3517/7033] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:50 2022] PUT /identity/v3/projects/e3b80857b8124be8b30a4ee36e79636b/users/e8252a305455469ba107ba34952a20c0/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:50.702985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6a164-0da3-4c2f-bb3a-3f835072c643 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:50.781005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161dba1-61cf-422a-93d6-c35d07903867 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:50.827481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6a164-0da3-4c2f-bb3a-3f835072c643 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:50.835379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0571f-38e4-4b00-adb5-524ae0fe83bb tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f404788b4cc74837b90b059fe0a2153c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd40d53e884345d09ede81b6c6ea5588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-388733800', 'tempest-DelegatedRole-329296995'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:50.836462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0571f-38e4-4b00-adb5-524ae0fe83bb tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:50.836815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0571f-38e4-4b00-adb5-524ae0fe83bb tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:50.837176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0571f-38e4-4b00-adb5-524ae0fe83bb tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] PATH_INFO: `/v3/OS-TRUST/trusts/830d68e97d2248a5b74cc0cbbfadf2d6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:50.845882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0571f-38e4-4b00-adb5-524ae0fe83bb tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: Authorizing `identity:get_trust(trust_id=830d68e97d2248a5b74cc0cbbfadf2d6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:50.847473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0571f-38e4-4b00-adb5-524ae0fe83bb tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:50.858989 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3518/7034] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Aug 28 18:50:50 2022] GET /identity/v3/OS-TRUST/trusts/830d68e97d2248a5b74cc0cbbfadf2d6 => generated 834 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:50.859878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0571f-38e4-4b00-adb5-524ae0fe83bb tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:50.898362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfefa2-954a-44d3-8302-75f315b45054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:50.899715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfefa2-954a-44d3-8302-75f315b45054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:50.900876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfefa2-954a-44d3-8302-75f315b45054 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:50.901250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfefa2-954a-44d3-8302-75f315b45054 admin admin] PATH_INFO: `/v3/projects/cd579586293b47f180e314ec524cba7f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:50.910668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddfefa2-954a-44d3-8302-75f315b45054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd579586293b47f180e314ec524cba7f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:50.915290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddfefa2-954a-44d3-8302-75f315b45054 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:50.926310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:50.961474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0571f-38e4-4b00-adb5-524ae0fe83bb tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:50.970570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6229957-4086-45e8-a5c8-1c88b2df352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:50.971607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6229957-4086-45e8-a5c8-1c88b2df352c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:50.971998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6229957-4086-45e8-a5c8-1c88b2df352c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:50.972312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6229957-4086-45e8-a5c8-1c88b2df352c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:50.973021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6229957-4086-45e8-a5c8-1c88b2df352c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:50.975103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6229957-4086-45e8-a5c8-1c88b2df352c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:50.992732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ddfefa2-954a-44d3-8302-75f315b45054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd579586293b47f180e314ec524cba7f', 'request_id': 'req-8ddfefa2-954a-44d3-8302-75f315b45054'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:51.002521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ddfefa2-954a-44d3-8302-75f315b45054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd579586293b47f180e314ec524cba7f', 'request_id': 'req-8ddfefa2-954a-44d3-8302-75f315b45054'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:51.004229 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3519/7035] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:50 2022] POST /identity/v3/users => generated 284 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:51.005567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb2600-b06f-4095-893f-1f5940cba989 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:51.005998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb2600-b06f-4095-893f-1f5940cba989 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:51.006129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb2600-b06f-4095-893f-1f5940cba989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:51.025673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ddfefa2-954a-44d3-8302-75f315b45054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd579586293b47f180e314ec524cba7f', 'request_id': 'req-8ddfefa2-954a-44d3-8302-75f315b45054'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:51.028863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-afeb2600-b06f-4095-893f-1f5940cba989 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:51.030455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-afeb2600-b06f-4095-893f-1f5940cba989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:51.048633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ddfefa2-954a-44d3-8302-75f315b45054 admin admin] The token cache is being invalidate because project cd579586293b47f180e314ec524cba7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:51.049186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ddfefa2-954a-44d3-8302-75f315b45054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:51.050242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ddfefa2-954a-44d3-8302-75f315b45054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:51.055244 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3517/7036] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:50 2022] DELETE /identity/v3/projects/cd579586293b47f180e314ec524cba7f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:51.055244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfefa2-954a-44d3-8302-75f315b45054 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:51.056788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8ddfefa2-954a-44d3-8302-75f315b45054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:51.080241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:51.160976 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3520/7037] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:51.161832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb2600-b06f-4095-893f-1f5940cba989 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:51.163732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-afeb2600-b06f-4095-893f-1f5940cba989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:51.179034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb2600-b06f-4095-893f-1f5940cba989 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:51.213813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760ba42-5b28-4bbb-80de-c52ae890f4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:51.214463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760ba42-5b28-4bbb-80de-c52ae890f4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:51.214742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760ba42-5b28-4bbb-80de-c52ae890f4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:51.215053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760ba42-5b28-4bbb-80de-c52ae890f4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:51.215988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760ba42-5b28-4bbb-80de-c52ae890f4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:51.217654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760ba42-5b28-4bbb-80de-c52ae890f4a7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:51.239691 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3521/7038] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:51 2022] GET /identity/v3/roles => generated 1891 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:51.241038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e54d4f-d6b7-45b5-a9ec-44d8ad58eb89 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:51.241307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e54d4f-d6b7-45b5-a9ec-44d8ad58eb89 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:51.241586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e54d4f-d6b7-45b5-a9ec-44d8ad58eb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:51.250704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfefa2-954a-44d3-8302-75f315b45054 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:51.263531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edc939-e490-44c7-a539-d565c4df7465 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f404788b4cc74837b90b059fe0a2153c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd40d53e884345d09ede81b6c6ea5588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-388733800', 'tempest-DelegatedRole-329296995'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:51.264281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edc939-e490-44c7-a539-d565c4df7465 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:51.264642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edc939-e490-44c7-a539-d565c4df7465 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:51.264986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edc939-e490-44c7-a539-d565c4df7465 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] PATH_INFO: `/v3/OS-TRUST/trusts/830d68e97d2248a5b74cc0cbbfadf2d6/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:51.274289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-37e54d4f-d6b7-45b5-a9ec-44d8ad58eb89 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:51.274619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edc939-e490-44c7-a539-d565c4df7465 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=830d68e97d2248a5b74cc0cbbfadf2d6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:51.276204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edc939-e490-44c7-a539-d565c4df7465 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:51.276850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-37e54d4f-d6b7-45b5-a9ec-44d8ad58eb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:51.287391 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3522/7039] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:51.289672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e54d4f-d6b7-45b5-a9ec-44d8ad58eb89 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:51.291675 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3518/7040] 10.222.0.27 () {58 vars in 1269 bytes} [Sun Aug 28 18:50:51 2022] GET /identity/v3/OS-TRUST/trusts/830d68e97d2248a5b74cc0cbbfadf2d6/roles => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:51.292399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-37e54d4f-d6b7-45b5-a9ec-44d8ad58eb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:51.292948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edc939-e490-44c7-a539-d565c4df7465 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:51.305775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edc939-e490-44c7-a539-d565c4df7465 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:51.311146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79485ad-6450-4d24-af88-dac3825c1403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:51.312181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79485ad-6450-4d24-af88-dac3825c1403 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:51.312647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79485ad-6450-4d24-af88-dac3825c1403 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:51.313083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79485ad-6450-4d24-af88-dac3825c1403 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:51.314095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79485ad-6450-4d24-af88-dac3825c1403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:51.315965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79485ad-6450-4d24-af88-dac3825c1403 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:51.328200 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3519/7041] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:51 2022] GET /identity/v3/roles => generated 1891 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:51.329479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79485ad-6450-4d24-af88-dac3825c1403 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:51.355745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79485ad-6450-4d24-af88-dac3825c1403 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:51.362331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6c44d-0505-4796-a3c9-02790ba4cd0e tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f404788b4cc74837b90b059fe0a2153c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd40d53e884345d09ede81b6c6ea5588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-388733800', 'tempest-DelegatedRole-329296995'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:51.363321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6c44d-0505-4796-a3c9-02790ba4cd0e tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:51.364026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6c44d-0505-4796-a3c9-02790ba4cd0e tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:51.364630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6c44d-0505-4796-a3c9-02790ba4cd0e tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] PATH_INFO: `/v3/OS-TRUST/trusts/830d68e97d2248a5b74cc0cbbfadf2d6/roles/c339144aa22d4495acd9d24a5bcda1f4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:51.367520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e54d4f-d6b7-45b5-a9ec-44d8ad58eb89 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:51.372648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829ace9-ebbe-4290-bcf6-e749f288e32b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:51.373271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829ace9-ebbe-4290-bcf6-e749f288e32b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:51.373549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829ace9-ebbe-4290-bcf6-e749f288e32b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:51.373868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829ace9-ebbe-4290-bcf6-e749f288e32b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:51.374453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6c44d-0505-4796-a3c9-02790ba4cd0e tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: Authorizing `identity:get_role_for_trust(trust_id=830d68e97d2248a5b74cc0cbbfadf2d6, role_id=c339144aa22d4495acd9d24a5bcda1f4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:51.376812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6c44d-0505-4796-a3c9-02790ba4cd0e tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:51.388424 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3520/7042] 10.222.0.27 () {58 vars in 1368 bytes} [Sun Aug 28 18:50:51 2022] GET /identity/v3/OS-TRUST/trusts/830d68e97d2248a5b74cc0cbbfadf2d6/roles/c339144aa22d4495acd9d24a5bcda1f4 => generated 243 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:51.389885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1593167-8936-4dd6-8a4b-f20db412f479 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:51.390299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1593167-8936-4dd6-8a4b-f20db412f479 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:51.390701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1593167-8936-4dd6-8a4b-f20db412f479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:51.392496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829ace9-ebbe-4290-bcf6-e749f288e32b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:51.394281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829ace9-ebbe-4290-bcf6-e749f288e32b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:51.409440 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3523/7043] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:51.410559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829ace9-ebbe-4290-bcf6-e749f288e32b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:51.422422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829ace9-ebbe-4290-bcf6-e749f288e32b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:51.429150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d6305-4003-4c56-b58f-2f847a4024a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:51.430095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d6305-4003-4c56-b58f-2f847a4024a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:51.430521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d6305-4003-4c56-b58f-2f847a4024a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:51.430944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d6305-4003-4c56-b58f-2f847a4024a4 admin admin] PATH_INFO: `/v3/projects/275d3cad0ce44ac6b2bbcb4f4e562284/users/0e6f276ab5304bf9ad4387e80651d32b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:51.437951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a1593167-8936-4dd6-8a4b-f20db412f479 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:51.441739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a1593167-8936-4dd6-8a4b-f20db412f479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:51.451713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d6305-4003-4c56-b58f-2f847a4024a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=275d3cad0ce44ac6b2bbcb4f4e562284, user_id=0e6f276ab5304bf9ad4387e80651d32b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:51.454647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d6305-4003-4c56-b58f-2f847a4024a4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:51.459044 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3521/7044] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:51.459899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1593167-8936-4dd6-8a4b-f20db412f479 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:51.480139 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3524/7045] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:51 2022] PUT /identity/v3/projects/275d3cad0ce44ac6b2bbcb4f4e562284/users/0e6f276ab5304bf9ad4387e80651d32b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:51.481198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d6305-4003-4c56-b58f-2f847a4024a4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:51.492764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1593167-8936-4dd6-8a4b-f20db412f479 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:51.667604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d2aba-2143-42b6-969e-977ca429c9cd tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f404788b4cc74837b90b059fe0a2153c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd40d53e884345d09ede81b6c6ea5588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-388733800', 'tempest-DelegatedRole-329296995'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:51.668198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d2aba-2143-42b6-969e-977ca429c9cd tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:51.668615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d2aba-2143-42b6-969e-977ca429c9cd tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:51.668969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d2aba-2143-42b6-969e-977ca429c9cd tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] PATH_INFO: `/v3/OS-TRUST/trusts/830d68e97d2248a5b74cc0cbbfadf2d6/roles/c339144aa22d4495acd9d24a5bcda1f4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:51.672381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:51.684494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d2aba-2143-42b6-969e-977ca429c9cd tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: Authorizing `identity:get_role_for_trust(trust_id=830d68e97d2248a5b74cc0cbbfadf2d6, role_id=c339144aa22d4495acd9d24a5bcda1f4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:51.687850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d2aba-2143-42b6-969e-977ca429c9cd tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:51.713019 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3522/7046] 10.222.0.27 () {58 vars in 1369 bytes} [Sun Aug 28 18:50:51 2022] HEAD /identity/v3/OS-TRUST/trusts/830d68e97d2248a5b74cc0cbbfadf2d6/roles/c339144aa22d4495acd9d24a5bcda1f4 => generated 0 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 28 18:50:51.714308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32727c92-e189-43de-988c-c770fefa4aca None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:51.720409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32727c92-e189-43de-988c-c770fefa4aca None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:51.720684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32727c92-e189-43de-988c-c770fefa4aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:51.729445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d6305-4003-4c56-b58f-2f847a4024a4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:51.754581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b4984-69e8-4f30-8cac-42b9b46a7b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:51.755444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b4984-69e8-4f30-8cac-42b9b46a7b4b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:51.755764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b4984-69e8-4f30-8cac-42b9b46a7b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:51.756038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b4984-69e8-4f30-8cac-42b9b46a7b4b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:51.756949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b4984-69e8-4f30-8cac-42b9b46a7b4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:51.757253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b4984-69e8-4f30-8cac-42b9b46a7b4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:51.758875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b4984-69e8-4f30-8cac-42b9b46a7b4b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:51.800756 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3525/7047] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:51.806341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b4984-69e8-4f30-8cac-42b9b46a7b4b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:51.810462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-32727c92-e189-43de-988c-c770fefa4aca None None] MFA Rules not processed for user `0e6f276ab5304bf9ad4387e80651d32b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:51.812314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-32727c92-e189-43de-988c-c770fefa4aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:51.830725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b4984-69e8-4f30-8cac-42b9b46a7b4b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:51.844991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c132f-1a86-4c27-9e83-e3ad74b5f34e tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f404788b4cc74837b90b059fe0a2153c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd40d53e884345d09ede81b6c6ea5588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-388733800', 'tempest-DelegatedRole-329296995'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:51.845714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c132f-1a86-4c27-9e83-e3ad74b5f34e tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:51.845948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c132f-1a86-4c27-9e83-e3ad74b5f34e tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:51.846483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c132f-1a86-4c27-9e83-e3ad74b5f34e tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] PATH_INFO: `/v3/OS-TRUST/trusts/830d68e97d2248a5b74cc0cbbfadf2d6/roles/9f5d764389fc4e518c5cd0ef42053622` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:51.857706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c132f-1a86-4c27-9e83-e3ad74b5f34e tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: Authorizing `identity:get_role_for_trust(trust_id=830d68e97d2248a5b74cc0cbbfadf2d6, role_id=9f5d764389fc4e518c5cd0ef42053622)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:51.859359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c132f-1a86-4c27-9e83-e3ad74b5f34e tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:51.881121 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f00c132f-1a86-4c27-9e83-e3ad74b5f34e tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Could not find role: 9f5d764389fc4e518c5cd0ef42053622.: keystone.exception.RoleNotFound: Could not find role: 9f5d764389fc4e518c5cd0ef42053622. Aug 28 18:50:51.881121 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:51.881121 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:51.881121 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:51.881121 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:51.881121 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:51.881121 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:51.881121 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:51.881121 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:51.881121 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:51.881121 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:51.881121 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:51.881121 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 18:50:51.881121 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:50:51.881121 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 9f5d764389fc4e518c5cd0ef42053622. Aug 28 18:50:51.882165 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:51.893428 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3526/7048] 10.222.0.27 () {58 vars in 1368 bytes} [Sun Aug 28 18:50:51 2022] GET /identity/v3/OS-TRUST/trusts/830d68e97d2248a5b74cc0cbbfadf2d6/roles/9f5d764389fc4e518c5cd0ef42053622 => generated 110 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:50:51.894387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c132f-1a86-4c27-9e83-e3ad74b5f34e tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:51.902887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:51.916586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c132f-1a86-4c27-9e83-e3ad74b5f34e tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:51.922104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c82ae-7003-440b-b86c-d050c0e8e1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:51.922976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c82ae-7003-440b-b86c-d050c0e8e1ec admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:51.923960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c82ae-7003-440b-b86c-d050c0e8e1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:51.924396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c82ae-7003-440b-b86c-d050c0e8e1ec admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:51.925217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c82ae-7003-440b-b86c-d050c0e8e1ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:51.927345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c82ae-7003-440b-b86c-d050c0e8e1ec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:52.020838 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3527/7049] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:51 2022] POST /identity/v3/projects => generated 399 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:52.021916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c82ae-7003-440b-b86c-d050c0e8e1ec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:52.055070 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3523/7050] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:52.056788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32727c92-e189-43de-988c-c770fefa4aca None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:52.102551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32727c92-e189-43de-988c-c770fefa4aca None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:52.195104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c82ae-7003-440b-b86c-d050c0e8e1ec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:52.204429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a8275-6403-428b-8f3a-5b069f3a7930 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f404788b4cc74837b90b059fe0a2153c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd40d53e884345d09ede81b6c6ea5588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-388733800', 'tempest-DelegatedRole-329296995'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:52.207507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a8275-6403-428b-8f3a-5b069f3a7930 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:52.208063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a8275-6403-428b-8f3a-5b069f3a7930 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:52.208335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a8275-6403-428b-8f3a-5b069f3a7930 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] PATH_INFO: `/v3/OS-TRUST/trusts/830d68e97d2248a5b74cc0cbbfadf2d6/roles/9f5d764389fc4e518c5cd0ef42053622` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:52.226680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a8275-6403-428b-8f3a-5b069f3a7930 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: Authorizing `identity:get_role_for_trust(trust_id=830d68e97d2248a5b74cc0cbbfadf2d6, role_id=9f5d764389fc4e518c5cd0ef42053622)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:52.228384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a8275-6403-428b-8f3a-5b069f3a7930 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:52.255914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e38a9-c80c-42a0-a244-6c66af60a838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:52.256608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e38a9-c80c-42a0-a244-6c66af60a838 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:52.256964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e38a9-c80c-42a0-a244-6c66af60a838 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:52.257500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e38a9-c80c-42a0-a244-6c66af60a838 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:52.261672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e38a9-c80c-42a0-a244-6c66af60a838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:52.264166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e38a9-c80c-42a0-a244-6c66af60a838 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:52.266020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-316a8275-6403-428b-8f3a-5b069f3a7930 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Could not find role: 9f5d764389fc4e518c5cd0ef42053622.: keystone.exception.RoleNotFound: Could not find role: 9f5d764389fc4e518c5cd0ef42053622. Aug 28 18:50:52.266020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:52.266020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:52.266020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:52.266020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:52.266020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:52.266020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:52.266020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:52.266020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:52.266020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:52.266020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:52.266020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:52.266020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 18:50:52.266020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:50:52.266020 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 9f5d764389fc4e518c5cd0ef42053622. Aug 28 18:50:52.267296 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:52.271455 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3528/7051] 10.222.0.27 () {58 vars in 1369 bytes} [Sun Aug 28 18:50:52 2022] HEAD /identity/v3/OS-TRUST/trusts/830d68e97d2248a5b74cc0cbbfadf2d6/roles/9f5d764389fc4e518c5cd0ef42053622 => generated 0 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 28 18:50:52.275564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a8275-6403-428b-8f3a-5b069f3a7930 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:52.304826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a8275-6403-428b-8f3a-5b069f3a7930 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:52.316777 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3524/7052] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:52 2022] POST /identity/v3/users => generated 300 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:52.318093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f969f-aca1-44dd-86c7-77a67a439d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:52.318703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f969f-aca1-44dd-86c7-77a67a439d9b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:52.318987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f969f-aca1-44dd-86c7-77a67a439d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:52.319282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f969f-aca1-44dd-86c7-77a67a439d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:52.319977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f969f-aca1-44dd-86c7-77a67a439d9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:52.321181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e38a9-c80c-42a0-a244-6c66af60a838 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:52.321915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f969f-aca1-44dd-86c7-77a67a439d9b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:52.335888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e38a9-c80c-42a0-a244-6c66af60a838 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:52.341750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b742d-2311-43ae-a672-4cc4224225ac tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f404788b4cc74837b90b059fe0a2153c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd40d53e884345d09ede81b6c6ea5588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-388733800', 'tempest-DelegatedRole-329296995'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:52.342476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b742d-2311-43ae-a672-4cc4224225ac tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:52.342941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b742d-2311-43ae-a672-4cc4224225ac tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:52.343310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b742d-2311-43ae-a672-4cc4224225ac tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] PATH_INFO: `/v3/OS-TRUST/trusts/830d68e97d2248a5b74cc0cbbfadf2d6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:52.352737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b742d-2311-43ae-a672-4cc4224225ac tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: Authorizing `identity:delete_trust(trust_id=830d68e97d2248a5b74cc0cbbfadf2d6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:52.355060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b742d-2311-43ae-a672-4cc4224225ac tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:52.384810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f79b742d-2311-43ae-a672-4cc4224225ac tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '830d68e97d2248a5b74cc0cbbfadf2d6', 'request_id': 'req-f79b742d-2311-43ae-a672-4cc4224225ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:52.404133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f79b742d-2311-43ae-a672-4cc4224225ac tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '830d68e97d2248a5b74cc0cbbfadf2d6', 'request_id': 'req-f79b742d-2311-43ae-a672-4cc4224225ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:52.405059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f79b742d-2311-43ae-a672-4cc4224225ac tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '830d68e97d2248a5b74cc0cbbfadf2d6', 'request_id': 'req-f79b742d-2311-43ae-a672-4cc4224225ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:52.408479 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3529/7053] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:52 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:52.409543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f969f-aca1-44dd-86c7-77a67a439d9b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:52.411392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e3f969f-aca1-44dd-86c7-77a67a439d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:52.413841 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3525/7054] 10.222.0.27 () {58 vars in 1254 bytes} [Sun Aug 28 18:50:52 2022] DELETE /identity/v3/OS-TRUST/trusts/830d68e97d2248a5b74cc0cbbfadf2d6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:52.417708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b742d-2311-43ae-a672-4cc4224225ac tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:52.419763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f79b742d-2311-43ae-a672-4cc4224225ac tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:52.466989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b742d-2311-43ae-a672-4cc4224225ac tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:52.523682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:52.552413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f969f-aca1-44dd-86c7-77a67a439d9b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:52.566769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455015fc-b99f-497b-9212-2d882c3e6e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:52.567446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455015fc-b99f-497b-9212-2d882c3e6e16 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:52.567766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455015fc-b99f-497b-9212-2d882c3e6e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:52.568165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455015fc-b99f-497b-9212-2d882c3e6e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:52.568851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455015fc-b99f-497b-9212-2d882c3e6e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:52.571616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455015fc-b99f-497b-9212-2d882c3e6e16 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:52.574555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaa510-1044-4b18-b745-b030c9874fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:52.575332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaa510-1044-4b18-b745-b030c9874fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:52.575719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaa510-1044-4b18-b745-b030c9874fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:52.576091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaa510-1044-4b18-b745-b030c9874fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:52.576975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcaa510-1044-4b18-b745-b030c9874fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:52.580036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcaa510-1044-4b18-b745-b030c9874fe3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:52.596747 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3530/7055] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:52 2022] GET /identity/v3/roles => generated 1891 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:52.597653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455015fc-b99f-497b-9212-2d882c3e6e16 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:52.602299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-455015fc-b99f-497b-9212-2d882c3e6e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:52.627931 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3526/7056] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:50:52 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:52.629572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaa510-1044-4b18-b745-b030c9874fe3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:52.650082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaa510-1044-4b18-b745-b030c9874fe3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:52.655755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59065c-979b-41af-a6d0-e1fa506eef32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:52.656566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59065c-979b-41af-a6d0-e1fa506eef32 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:52.657078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59065c-979b-41af-a6d0-e1fa506eef32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:52.657519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59065c-979b-41af-a6d0-e1fa506eef32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:52.658549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59065c-979b-41af-a6d0-e1fa506eef32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:52.660386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59065c-979b-41af-a6d0-e1fa506eef32 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:52.686029 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3527/7057] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:52 2022] GET /identity/v3/roles => generated 1891 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:52.687212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59065c-979b-41af-a6d0-e1fa506eef32 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:52.712327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59065c-979b-41af-a6d0-e1fa506eef32 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:52.718351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615870a3-0cef-4c2a-8403-bb9799fdfa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:52.719175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615870a3-0cef-4c2a-8403-bb9799fdfa0f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:52.719655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615870a3-0cef-4c2a-8403-bb9799fdfa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:52.719939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615870a3-0cef-4c2a-8403-bb9799fdfa0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:52.720594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615870a3-0cef-4c2a-8403-bb9799fdfa0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:52.723709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615870a3-0cef-4c2a-8403-bb9799fdfa0f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:52.743170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:52.753094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455015fc-b99f-497b-9212-2d882c3e6e16 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:52.778388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5dec7-19e5-4de5-8af1-2ecdc1012ae9 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f404788b4cc74837b90b059fe0a2153c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd40d53e884345d09ede81b6c6ea5588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-388733800', 'tempest-DelegatedRole-329296995'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:52.779377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5dec7-19e5-4de5-8af1-2ecdc1012ae9 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:52.779724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5dec7-19e5-4de5-8af1-2ecdc1012ae9 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:52.780326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5dec7-19e5-4de5-8af1-2ecdc1012ae9 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] PATH_INFO: `/v3/OS-TRUST/trusts/830d68e97d2248a5b74cc0cbbfadf2d6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:52.795014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f1f5dec7-19e5-4de5-8af1-2ecdc1012ae9 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Could not find trust: 830d68e97d2248a5b74cc0cbbfadf2d6.: keystone.exception.TrustNotFound: Could not find trust: 830d68e97d2248a5b74cc0cbbfadf2d6. Aug 28 18:50:52.795014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:50:52.795014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:50:52.795014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:50:52.795014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:50:52.795014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:50:52.795014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:50:52.795014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:50:52.795014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:50:52.795014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:50:52.795014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:50:52.795014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:50:52.795014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 18:50:52.795014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 18:50:52.795014 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 18:50:52.796699 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 18:50:52.796699 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 18:50:52.796699 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 18:50:52.796699 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 18:50:52.796699 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 18:50:52.796699 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:50:52.796699 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:50:52.796699 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 18:50:52.796699 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 18:50:52.796699 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 18:50:52.796699 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 18:50:52.796699 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 830d68e97d2248a5b74cc0cbbfadf2d6. Aug 28 18:50:52.796699 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:50:52.803385 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3531/7059] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Aug 28 18:50:52 2022] GET /identity/v3/OS-TRUST/trusts/830d68e97d2248a5b74cc0cbbfadf2d6 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:50:52.803558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5dec7-19e5-4de5-8af1-2ecdc1012ae9 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:52.804567 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3528/7059] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:52 2022] GET /identity/v3/roles => generated 1891 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:52.806023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615870a3-0cef-4c2a-8403-bb9799fdfa0f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:52.815002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-615870a3-0cef-4c2a-8403-bb9799fdfa0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:52.822342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5dec7-19e5-4de5-8af1-2ecdc1012ae9 tempest-TrustsV3TestJSON-1433030701 tempest-user-2138458129] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:52.833717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceeefe6-745b-466d-a629-342a3261db03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:52.835606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceeefe6-745b-466d-a629-342a3261db03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:52.835901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceeefe6-745b-466d-a629-342a3261db03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:52.836658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceeefe6-745b-466d-a629-342a3261db03 admin admin] PATH_INFO: `/v3/projects/23df98bc277847e79cef5d03ad4e540e/users/5f93b124a96e4a5688a8778509d5cb80/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:52.875718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceeefe6-745b-466d-a629-342a3261db03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23df98bc277847e79cef5d03ad4e540e, user_id=5f93b124a96e4a5688a8778509d5cb80, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:52.878987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceeefe6-745b-466d-a629-342a3261db03 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:52.927092 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3532/7060] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:52 2022] PUT /identity/v3/projects/23df98bc277847e79cef5d03ad4e540e/users/5f93b124a96e4a5688a8778509d5cb80/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:52.928362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceeefe6-745b-466d-a629-342a3261db03 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:53.008492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615870a3-0cef-4c2a-8403-bb9799fdfa0f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:53.074986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceeefe6-745b-466d-a629-342a3261db03 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:53.093265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67fe57-4e3b-4ff0-8e0c-3fbbc732afb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:53.093970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67fe57-4e3b-4ff0-8e0c-3fbbc732afb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:53.094255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67fe57-4e3b-4ff0-8e0c-3fbbc732afb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:53.094632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67fe57-4e3b-4ff0-8e0c-3fbbc732afb9 admin admin] PATH_INFO: `/v3/projects/5e22449e73c740bfba9e17bd18c13370/users/de3e276434c24d7e9acae49fe995e157/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:53.095417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a205dce-f716-4243-a69e-7a4820ba4654 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:53.096072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a205dce-f716-4243-a69e-7a4820ba4654 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:53.096359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a205dce-f716-4243-a69e-7a4820ba4654 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:53.096644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a205dce-f716-4243-a69e-7a4820ba4654 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles/9f5d764389fc4e518c5cd0ef42053622` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:53.098219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a205dce-f716-4243-a69e-7a4820ba4654 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9f5d764389fc4e518c5cd0ef42053622)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:53.100474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a205dce-f716-4243-a69e-7a4820ba4654 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:53.126592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67fe57-4e3b-4ff0-8e0c-3fbbc732afb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e22449e73c740bfba9e17bd18c13370, user_id=de3e276434c24d7e9acae49fe995e157, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:53.130411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67fe57-4e3b-4ff0-8e0c-3fbbc732afb9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:53.156732 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3533/7061] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:52 2022] PUT /identity/v3/projects/5e22449e73c740bfba9e17bd18c13370/users/de3e276434c24d7e9acae49fe995e157/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:53.160644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dfa98-eb84-4ac1-9fee-5346c841c6ae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:53.160933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dfa98-eb84-4ac1-9fee-5346c841c6ae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:53.161216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dfa98-eb84-4ac1-9fee-5346c841c6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:53.165701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9a205dce-f716-4243-a69e-7a4820ba4654 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invalidating the token cache because role 9f5d764389fc4e518c5cd0ef42053622 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:53.166202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9a205dce-f716-4243-a69e-7a4820ba4654 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:53.168193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9a205dce-f716-4243-a69e-7a4820ba4654 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:53.173827 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3529/7062] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:52 2022] DELETE /identity/v3/roles/9f5d764389fc4e518c5cd0ef42053622 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:53.175061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a205dce-f716-4243-a69e-7a4820ba4654 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:53.178755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9a205dce-f716-4243-a69e-7a4820ba4654 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:53.205456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:53.233351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e98dfa98-eb84-4ac1-9fee-5346c841c6ae None None] MFA Rules not processed for user `5f93b124a96e4a5688a8778509d5cb80`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:53.234738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e98dfa98-eb84-4ac1-9fee-5346c841c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:53.338172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a205dce-f716-4243-a69e-7a4820ba4654 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:53.368672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e01ae6-f01b-492c-ba7a-02f59bcab9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:53.369607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e01ae6-f01b-492c-ba7a-02f59bcab9be admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:53.370029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e01ae6-f01b-492c-ba7a-02f59bcab9be admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:53.370469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e01ae6-f01b-492c-ba7a-02f59bcab9be admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:53.371337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e01ae6-f01b-492c-ba7a-02f59bcab9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:53.373270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e01ae6-f01b-492c-ba7a-02f59bcab9be admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:53.398069 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3534/7063] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:53 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:53.398969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dfa98-eb84-4ac1-9fee-5346c841c6ae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:53.400213 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3530/7064] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:50:53 2022] GET /identity/v3/roles => generated 1654 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:50:53.404498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e98dfa98-eb84-4ac1-9fee-5346c841c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:53.404981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e01ae6-f01b-492c-ba7a-02f59bcab9be admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:53.418479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e01ae6-f01b-492c-ba7a-02f59bcab9be admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:53.424151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9f15c-cda9-4222-8561-b0bf79ac626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:53.425328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9f15c-cda9-4222-8561-b0bf79ac626e admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:53.425765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9f15c-cda9-4222-8561-b0bf79ac626e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:53.426190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9f15c-cda9-4222-8561-b0bf79ac626e admin admin] PATH_INFO: `/v3/projects/5e22449e73c740bfba9e17bd18c13370/users/de3e276434c24d7e9acae49fe995e157/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:53.428733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9f15c-cda9-4222-8561-b0bf79ac626e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e22449e73c740bfba9e17bd18c13370, user_id=de3e276434c24d7e9acae49fe995e157, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:53.431864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9f15c-cda9-4222-8561-b0bf79ac626e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:53.448148 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3531/7065] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:50:53 2022] PUT /identity/v3/projects/5e22449e73c740bfba9e17bd18c13370/users/de3e276434c24d7e9acae49fe995e157/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:53.449354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9f15c-cda9-4222-8561-b0bf79ac626e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:53.461062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-32f9f15c-cda9-4222-8561-b0bf79ac626e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:53.550420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:53.598768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dfa98-eb84-4ac1-9fee-5346c841c6ae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:53.623988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9f15c-cda9-4222-8561-b0bf79ac626e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:53.635476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8865c-9ac2-4d12-bbbe-4605c888c92a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:53.636424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8865c-9ac2-4d12-bbbe-4605c888c92a service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:53.637038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8865c-9ac2-4d12-bbbe-4605c888c92a service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:53.637516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8865c-9ac2-4d12-bbbe-4605c888c92a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:53.725646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9765f-a252-468b-994f-e151d2572a74 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:53.726401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9765f-a252-468b-994f-e151d2572a74 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:53.727569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9765f-a252-468b-994f-e151d2572a74 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:53.727952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9765f-a252-468b-994f-e151d2572a74 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/roles/c339144aa22d4495acd9d24a5bcda1f4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:53.731821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9765f-a252-468b-994f-e151d2572a74 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c339144aa22d4495acd9d24a5bcda1f4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:53.752953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9765f-a252-468b-994f-e151d2572a74 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:53.796295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8865c-9ac2-4d12-bbbe-4605c888c92a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:53.798522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8865c-9ac2-4d12-bbbe-4605c888c92a service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:53.853999 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3532/7066] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:53.855963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a006-365c-4a6a-8991-e4df4b9909c7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:53.856190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a006-365c-4a6a-8991-e4df4b9909c7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:53.856415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a006-365c-4a6a-8991-e4df4b9909c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:53.977423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8f26a006-365c-4a6a-8991-e4df4b9909c7 None None] MFA Rules not processed for user `de3e276434c24d7e9acae49fe995e157`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:53.979072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2de9765f-a252-468b-994f-e151d2572a74 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invalidating the token cache because role c339144aa22d4495acd9d24a5bcda1f4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:53.981024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2de9765f-a252-468b-994f-e151d2572a74 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:53.981872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8f26a006-365c-4a6a-8991-e4df4b9909c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:53.983041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2de9765f-a252-468b-994f-e151d2572a74 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:53.996606 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3535/7067] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:53 2022] DELETE /identity/v3/roles/c339144aa22d4495acd9d24a5bcda1f4 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:54.003179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9765f-a252-468b-994f-e151d2572a74 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:54.006347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2de9765f-a252-468b-994f-e151d2572a74 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:54.072280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:54.167150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9765f-a252-468b-994f-e151d2572a74 tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:54.178080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bc6f7-51e6-413e-9c98-851c8b6b49de tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:54.180481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bc6f7-51e6-413e-9c98-851c8b6b49de tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:54.180931 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3533/7068] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:54.182040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bc6f7-51e6-413e-9c98-851c8b6b49de tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:54.183276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bc6f7-51e6-413e-9c98-851c8b6b49de tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/users/f404788b4cc74837b90b059fe0a2153c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:54.184957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26a006-365c-4a6a-8991-e4df4b9909c7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:54.186235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3bc6f7-51e6-413e-9c98-851c8b6b49de tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f404788b4cc74837b90b059fe0a2153c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:54.196486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3bc6f7-51e6-413e-9c98-851c8b6b49de tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:54.207155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26a006-365c-4a6a-8991-e4df4b9909c7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:54.316124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5e3bc6f7-51e6-413e-9c98-851c8b6b49de tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f404788b4cc74837b90b059fe0a2153c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:54.317143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5e3bc6f7-51e6-413e-9c98-851c8b6b49de tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f404788b4cc74837b90b059fe0a2153c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:54.337451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5e3bc6f7-51e6-413e-9c98-851c8b6b49de tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f404788b4cc74837b90b059fe0a2153c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:54.339579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:54.352915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5e3bc6f7-51e6-413e-9c98-851c8b6b49de tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f404788b4cc74837b90b059fe0a2153c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:54.368567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f459e-a7ca-4df7-8d31-63a9fbe92904 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3e276434c24d7e9acae49fe995e157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e22449e73c740bfba9e17bd18c13370', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:54.370097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f459e-a7ca-4df7-8d31-63a9fbe92904 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:54.370395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f459e-a7ca-4df7-8d31-63a9fbe92904 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:54.370681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f459e-a7ca-4df7-8d31-63a9fbe92904 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] PATH_INFO: `/v3/policies` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:54.371665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5e3bc6f7-51e6-413e-9c98-851c8b6b49de tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f404788b4cc74837b90b059fe0a2153c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:54.374352 n-d-850468-20 devstack@keystone.service[82160]: WARNING oslo_log.versionutils [None req-f27f459e-a7ca-4df7-8d31-63a9fbe92904 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 18:50:54.374912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f459e-a7ca-4df7-8d31-63a9fbe92904 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:54.376264 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-f27f459e-a7ca-4df7-8d31-63a9fbe92904 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:50:54.376264 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:50:54.376264 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:50:54.377990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f459e-a7ca-4df7-8d31-63a9fbe92904 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:54.389774 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3536/7069] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:54 2022] DELETE /identity/v3/users/f404788b4cc74837b90b059fe0a2153c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:50:54.390790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bc6f7-51e6-413e-9c98-851c8b6b49de tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:54.392909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e3bc6f7-51e6-413e-9c98-851c8b6b49de tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:54.451670 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3534/7070] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:50:54 2022] POST /identity/v3/policies => generated 230 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:54.461807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f459e-a7ca-4df7-8d31-63a9fbe92904 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:54.464051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f27f459e-a7ca-4df7-8d31-63a9fbe92904 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:54.478882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f459e-a7ca-4df7-8d31-63a9fbe92904 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:54.659192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b283fb3-98a0-4d57-985c-4c773f729840 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3e276434c24d7e9acae49fe995e157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e22449e73c740bfba9e17bd18c13370', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:54.661429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283fb3-98a0-4d57-985c-4c773f729840 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:54.662851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283fb3-98a0-4d57-985c-4c773f729840 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:54.663433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283fb3-98a0-4d57-985c-4c773f729840 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] PATH_INFO: `/v3/policies/6a5f9b3617984e39bb4a898c820e4e0a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:54.665145 n-d-850468-20 devstack@keystone.service[82160]: WARNING oslo_log.versionutils [None req-8b283fb3-98a0-4d57-985c-4c773f729840 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 18:50:54.666146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b283fb3-98a0-4d57-985c-4c773f729840 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=6a5f9b3617984e39bb4a898c820e4e0a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:54.672889 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-8b283fb3-98a0-4d57-985c-4c773f729840 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:50:54.672889 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:50:54.672889 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:50:54.674269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b283fb3-98a0-4d57-985c-4c773f729840 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:54.694009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bc6f7-51e6-413e-9c98-851c8b6b49de tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:54.716767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a39671-7719-4e0b-a621-f85fe236dfbf tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0a9446d77d1491d893011e0937f3c91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6afc4004ea4422b6032a07d5528b9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:54.717435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a39671-7719-4e0b-a621-f85fe236dfbf tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:54.717722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a39671-7719-4e0b-a621-f85fe236dfbf tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:54.718003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a39671-7719-4e0b-a621-f85fe236dfbf tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] PATH_INFO: `/v3/projects/fd40d53e884345d09ede81b6c6ea5588` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:54.748675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a39671-7719-4e0b-a621-f85fe236dfbf tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fd40d53e884345d09ede81b6c6ea5588)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:54.750824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a39671-7719-4e0b-a621-f85fe236dfbf tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:54.753063 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3535/7071] 10.222.0.27 () {60 vars in 1252 bytes} [Sun Aug 28 18:50:54 2022] PATCH /identity/v3/policies/6a5f9b3617984e39bb4a898c820e4e0a => generated 237 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:54.755024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b283fb3-98a0-4d57-985c-4c773f729840 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:54.780182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b283fb3-98a0-4d57-985c-4c773f729840 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:54.795832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87ac70-ff1a-48d1-ab63-b1db25d6d983 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3e276434c24d7e9acae49fe995e157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e22449e73c740bfba9e17bd18c13370', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:54.796806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ac70-ff1a-48d1-ab63-b1db25d6d983 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:54.798260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ac70-ff1a-48d1-ab63-b1db25d6d983 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:54.798681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ac70-ff1a-48d1-ab63-b1db25d6d983 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] PATH_INFO: `/v3/policies/6a5f9b3617984e39bb4a898c820e4e0a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:54.802172 n-d-850468-20 devstack@keystone.service[82160]: WARNING oslo_log.versionutils [None req-ee87ac70-ff1a-48d1-ab63-b1db25d6d983 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 18:50:54.802948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87ac70-ff1a-48d1-ab63-b1db25d6d983 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=6a5f9b3617984e39bb4a898c820e4e0a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:54.805857 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-ee87ac70-ff1a-48d1-ab63-b1db25d6d983 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:50:54.805857 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:50:54.805857 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:50:54.809179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87ac70-ff1a-48d1-ab63-b1db25d6d983 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:54.835733 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3536/7072] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:50:54 2022] GET /identity/v3/policies/6a5f9b3617984e39bb4a898c820e4e0a => generated 237 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:54.839282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87ac70-ff1a-48d1-ab63-b1db25d6d983 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:54.856844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03a39671-7719-4e0b-a621-f85fe236dfbf tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd40d53e884345d09ede81b6c6ea5588', 'request_id': 'req-03a39671-7719-4e0b-a621-f85fe236dfbf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:54.879877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03a39671-7719-4e0b-a621-f85fe236dfbf tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd40d53e884345d09ede81b6c6ea5588', 'request_id': 'req-03a39671-7719-4e0b-a621-f85fe236dfbf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:54.885058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87ac70-ff1a-48d1-ab63-b1db25d6d983 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:54.896119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03a39671-7719-4e0b-a621-f85fe236dfbf tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd40d53e884345d09ede81b6c6ea5588', 'request_id': 'req-03a39671-7719-4e0b-a621-f85fe236dfbf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:54.933801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03a39671-7719-4e0b-a621-f85fe236dfbf tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] The token cache is being invalidate because project fd40d53e884345d09ede81b6c6ea5588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:54.934084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03a39671-7719-4e0b-a621-f85fe236dfbf tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:54.948841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03a39671-7719-4e0b-a621-f85fe236dfbf tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:54.965359 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3537/7073] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:54 2022] DELETE /identity/v3/projects/fd40d53e884345d09ede81b6c6ea5588 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:54.965359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a39671-7719-4e0b-a621-f85fe236dfbf tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:54.978975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-03a39671-7719-4e0b-a621-f85fe236dfbf tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:55.024210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:55.061507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb4563-7470-426e-9270-b13d702ebbd6 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3e276434c24d7e9acae49fe995e157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e22449e73c740bfba9e17bd18c13370', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:55.066624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb4563-7470-426e-9270-b13d702ebbd6 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:55.067053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb4563-7470-426e-9270-b13d702ebbd6 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:55.067499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb4563-7470-426e-9270-b13d702ebbd6 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] PATH_INFO: `/v3/policies/6a5f9b3617984e39bb4a898c820e4e0a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:55.068449 n-d-850468-20 devstack@keystone.service[82160]: WARNING oslo_log.versionutils [None req-6fcb4563-7470-426e-9270-b13d702ebbd6 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 18:50:55.070014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb4563-7470-426e-9270-b13d702ebbd6 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=6a5f9b3617984e39bb4a898c820e4e0a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:55.076274 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-6fcb4563-7470-426e-9270-b13d702ebbd6 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:50:55.076274 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:50:55.076274 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:50:55.077514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb4563-7470-426e-9270-b13d702ebbd6 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:55.114264 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3537/7074] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:54 2022] DELETE /identity/v3/policies/6a5f9b3617984e39bb4a898c820e4e0a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:55.116385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb4563-7470-426e-9270-b13d702ebbd6 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:55.123645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6fcb4563-7470-426e-9270-b13d702ebbd6 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:55.169859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb4563-7470-426e-9270-b13d702ebbd6 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:55.170454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a39671-7719-4e0b-a621-f85fe236dfbf tempest-TrustsV3TestJSON-1588368890 tempest-TrustsV3TestJSON-1588368890-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:55.175994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029406d-f801-49c6-bcc3-eb5791548740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:55.176652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029406d-f801-49c6-bcc3-eb5791548740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:55.176929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029406d-f801-49c6-bcc3-eb5791548740 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:55.177141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92920e61-70a6-4790-8ba5-e50a826d4a68 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3e276434c24d7e9acae49fe995e157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e22449e73c740bfba9e17bd18c13370', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:55.177287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029406d-f801-49c6-bcc3-eb5791548740 admin admin] PATH_INFO: `/v3/users/598a941612464608bfa629112d2c9c8c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:55.177875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92920e61-70a6-4790-8ba5-e50a826d4a68 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:55.178172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92920e61-70a6-4790-8ba5-e50a826d4a68 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:55.178481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92920e61-70a6-4790-8ba5-e50a826d4a68 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] PATH_INFO: `/v3/policies` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:55.179673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92920e61-70a6-4790-8ba5-e50a826d4a68 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:55.181563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92920e61-70a6-4790-8ba5-e50a826d4a68 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:55.185416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029406d-f801-49c6-bcc3-eb5791548740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=598a941612464608bfa629112d2c9c8c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:55.208728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029406d-f801-49c6-bcc3-eb5791548740 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:55.210105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=87,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:55.237899 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3538/7075] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:50:55 2022] POST /identity/v3/policies => generated 229 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:55.240816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92920e61-70a6-4790-8ba5-e50a826d4a68 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:55.284413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92920e61-70a6-4790-8ba5-e50a826d4a68 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:55.299053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdbda4-51f8-422b-a058-9b19dde47861 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3e276434c24d7e9acae49fe995e157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e22449e73c740bfba9e17bd18c13370', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:55.300648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdbda4-51f8-422b-a058-9b19dde47861 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:55.305306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdbda4-51f8-422b-a058-9b19dde47861 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:55.305649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdbda4-51f8-422b-a058-9b19dde47861 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] PATH_INFO: `/v3/policies` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:55.306896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfdbda4-51f8-422b-a058-9b19dde47861 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:55.308839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfdbda4-51f8-422b-a058-9b19dde47861 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:55.329805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1029406d-f801-49c6-bcc3-eb5791548740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598a941612464608bfa629112d2c9c8c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:55.331165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1029406d-f801-49c6-bcc3-eb5791548740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598a941612464608bfa629112d2c9c8c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:55.342930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1029406d-f801-49c6-bcc3-eb5791548740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598a941612464608bfa629112d2c9c8c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:55.361046 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3539/7076] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:50:55 2022] POST /identity/v3/policies => generated 229 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:55.362158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1029406d-f801-49c6-bcc3-eb5791548740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598a941612464608bfa629112d2c9c8c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:55.362317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdbda4-51f8-422b-a058-9b19dde47861 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:55.369511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4bfdbda4-51f8-422b-a058-9b19dde47861 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:55.386270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdbda4-51f8-422b-a058-9b19dde47861 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:55.389550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1029406d-f801-49c6-bcc3-eb5791548740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598a941612464608bfa629112d2c9c8c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:55.391714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d48277-3add-49ee-9179-e07a3536838e tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3e276434c24d7e9acae49fe995e157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e22449e73c740bfba9e17bd18c13370', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:55.392398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d48277-3add-49ee-9179-e07a3536838e tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:55.392689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d48277-3add-49ee-9179-e07a3536838e tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:55.392975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d48277-3add-49ee-9179-e07a3536838e tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] PATH_INFO: `/v3/policies` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:55.394304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d48277-3add-49ee-9179-e07a3536838e tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:55.396928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d48277-3add-49ee-9179-e07a3536838e tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:55.406959 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3538/7077] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:54 2022] DELETE /identity/v3/users/598a941612464608bfa629112d2c9c8c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:55.411699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbdd68-f36a-4dfe-9290-2f856edda074 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:55.412062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbdd68-f36a-4dfe-9290-2f856edda074 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:55.412340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbdd68-f36a-4dfe-9290-2f856edda074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:55.437579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2ffbdd68-f36a-4dfe-9290-2f856edda074 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:55.438718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2ffbdd68-f36a-4dfe-9290-2f856edda074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:55.459618 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3540/7078] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Aug 28 18:50:55 2022] POST /identity/v3/policies => generated 230 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:50:55.464213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d48277-3add-49ee-9179-e07a3536838e tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:55.495534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d48277-3add-49ee-9179-e07a3536838e tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:55.544305 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3539/7079] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:55.589213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbdd68-f36a-4dfe-9290-2f856edda074 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:55.590725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2ffbdd68-f36a-4dfe-9290-2f856edda074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:55.629518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ed1ba-2562-4573-acda-88250653b28a tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3e276434c24d7e9acae49fe995e157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e22449e73c740bfba9e17bd18c13370', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:55.630158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ed1ba-2562-4573-acda-88250653b28a tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:55.630445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ed1ba-2562-4573-acda-88250653b28a tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:55.630725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ed1ba-2562-4573-acda-88250653b28a tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] PATH_INFO: `/v3/policies` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:55.631570 n-d-850468-20 devstack@keystone.service[82160]: WARNING oslo_log.versionutils [None req-034ed1ba-2562-4573-acda-88250653b28a tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 18:50:55.632273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ed1ba-2562-4573-acda-88250653b28a tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:55.633537 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-034ed1ba-2562-4573-acda-88250653b28a tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:50:55.633537 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:50:55.633537 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:50:55.651589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ed1ba-2562-4573-acda-88250653b28a tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:55.688025 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3541/7080] 10.222.0.27 () {58 vars in 1131 bytes} [Sun Aug 28 18:50:55 2022] GET /identity/v3/policies => generated 764 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:50:55.690335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ed1ba-2562-4573-acda-88250653b28a tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:55.715544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ed1ba-2562-4573-acda-88250653b28a tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:55.751662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddead3-80dc-4bcc-a5d9-623dc3640e22 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3e276434c24d7e9acae49fe995e157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e22449e73c740bfba9e17bd18c13370', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:55.752343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddead3-80dc-4bcc-a5d9-623dc3640e22 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:55.752632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddead3-80dc-4bcc-a5d9-623dc3640e22 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:55.753276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddead3-80dc-4bcc-a5d9-623dc3640e22 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] PATH_INFO: `/v3/policies/bb7b029f9dfc47378daa16209ed3cf2e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:55.755806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddead3-80dc-4bcc-a5d9-623dc3640e22 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=bb7b029f9dfc47378daa16209ed3cf2e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:55.763634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbdd68-f36a-4dfe-9290-2f856edda074 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:55.772142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddead3-80dc-4bcc-a5d9-623dc3640e22 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:55.783293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e476b-2936-403e-b64d-bb8e84bdc43c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:55.784714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e476b-2936-403e-b64d-bb8e84bdc43c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:55.785217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e476b-2936-403e-b64d-bb8e84bdc43c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:55.785717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e476b-2936-403e-b64d-bb8e84bdc43c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:55.805747 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3542/7081] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:55 2022] DELETE /identity/v3/policies/bb7b029f9dfc47378daa16209ed3cf2e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:55.809862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddead3-80dc-4bcc-a5d9-623dc3640e22 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:55.810184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e476b-2936-403e-b64d-bb8e84bdc43c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:55.812071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e476b-2936-403e-b64d-bb8e84bdc43c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:55.822103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddead3-80dc-4bcc-a5d9-623dc3640e22 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:55.845129 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3540/7082] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:55.847519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944aabbd-225a-4ebc-bc7a-f7ab1b06cd3d tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3e276434c24d7e9acae49fe995e157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e22449e73c740bfba9e17bd18c13370', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:55.849373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aabbd-225a-4ebc-bc7a-f7ab1b06cd3d tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:55.849520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aabbd-225a-4ebc-bc7a-f7ab1b06cd3d tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:55.850884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aabbd-225a-4ebc-bc7a-f7ab1b06cd3d tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] PATH_INFO: `/v3/policies/7ec4113b561a450daebdd5d04ab6d659` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:55.852754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944aabbd-225a-4ebc-bc7a-f7ab1b06cd3d tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=7ec4113b561a450daebdd5d04ab6d659)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:55.858746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944aabbd-225a-4ebc-bc7a-f7ab1b06cd3d tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:55.893180 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3543/7083] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:55 2022] DELETE /identity/v3/policies/7ec4113b561a450daebdd5d04ab6d659 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:55.894736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e476b-2936-403e-b64d-bb8e84bdc43c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:55.912427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e476b-2936-403e-b64d-bb8e84bdc43c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:55.924381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0367f-6d74-4117-b784-f6d0ebb9e0f2 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3e276434c24d7e9acae49fe995e157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e22449e73c740bfba9e17bd18c13370', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:55.926387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0367f-6d74-4117-b784-f6d0ebb9e0f2 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:55.926676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0367f-6d74-4117-b784-f6d0ebb9e0f2 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:55.928642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0367f-6d74-4117-b784-f6d0ebb9e0f2 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] PATH_INFO: `/v3/policies/d0d63465fa824f9d8ca087b276608c21` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:55.930463 n-d-850468-20 devstack@keystone.service[82161]: WARNING oslo_log.versionutils [None req-f7e0367f-6d74-4117-b784-f6d0ebb9e0f2 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 18:50:55.931052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0367f-6d74-4117-b784-f6d0ebb9e0f2 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=d0d63465fa824f9d8ca087b276608c21)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:55.935782 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-f7e0367f-6d74-4117-b784-f6d0ebb9e0f2 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:50:55.935782 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:50:55.935782 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:50:55.938618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0367f-6d74-4117-b784-f6d0ebb9e0f2 tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:55.997788 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3541/7084] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:55 2022] DELETE /identity/v3/policies/d0d63465fa824f9d8ca087b276608c21 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:56.003384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944aabbd-225a-4ebc-bc7a-f7ab1b06cd3d tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:56.005525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-944aabbd-225a-4ebc-bc7a-f7ab1b06cd3d tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:56.047077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944aabbd-225a-4ebc-bc7a-f7ab1b06cd3d tempest-PoliciesTestJSON-1024760409 tempest-PoliciesTestJSON-1024760409-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:56.067171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8237951-0a32-4fbb-8899-54e5b004a067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:56.070120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8237951-0a32-4fbb-8899-54e5b004a067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:56.071208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8237951-0a32-4fbb-8899-54e5b004a067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:56.071568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8237951-0a32-4fbb-8899-54e5b004a067 admin admin] PATH_INFO: `/v3/users/0e6f276ab5304bf9ad4387e80651d32b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:56.080222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8237951-0a32-4fbb-8899-54e5b004a067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e6f276ab5304bf9ad4387e80651d32b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:56.085586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8237951-0a32-4fbb-8899-54e5b004a067 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:56.263317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b8237951-0a32-4fbb-8899-54e5b004a067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e6f276ab5304bf9ad4387e80651d32b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:56.293944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:56.298923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b8237951-0a32-4fbb-8899-54e5b004a067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e6f276ab5304bf9ad4387e80651d32b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:56.300486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b8237951-0a32-4fbb-8899-54e5b004a067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e6f276ab5304bf9ad4387e80651d32b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:56.301514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b8237951-0a32-4fbb-8899-54e5b004a067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e6f276ab5304bf9ad4387e80651d32b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:56.331883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b8237951-0a32-4fbb-8899-54e5b004a067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e6f276ab5304bf9ad4387e80651d32b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:56.353356 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3544/7085] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:56 2022] DELETE /identity/v3/users/0e6f276ab5304bf9ad4387e80651d32b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:56.359395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc8de0-3679-4019-abe8-556e132db4a8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:56.359949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc8de0-3679-4019-abe8-556e132db4a8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:56.360080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc8de0-3679-4019-abe8-556e132db4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:56.397795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0cbc8de0-3679-4019-abe8-556e132db4a8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:56.400933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0cbc8de0-3679-4019-abe8-556e132db4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:56.414765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:56.616082 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3542/7086] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:56.628322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8237951-0a32-4fbb-8899-54e5b004a067 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:56.630164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b8237951-0a32-4fbb-8899-54e5b004a067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:56.688091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc8de0-3679-4019-abe8-556e132db4a8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:56.691633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0cbc8de0-3679-4019-abe8-556e132db4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:56.738217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc8de0-3679-4019-abe8-556e132db4a8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:56.748099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:56.748768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:56.749050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:56.749329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80 admin admin] PATH_INFO: `/v3/projects/b13b4fddf365465588968e4a92a8f172` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:56.757435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b13b4fddf365465588968e4a92a8f172)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:56.762737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:56.863715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8237951-0a32-4fbb-8899-54e5b004a067 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:56.868034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13b4fddf365465588968e4a92a8f172', 'request_id': 'req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:56.885151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13b4fddf365465588968e4a92a8f172', 'request_id': 'req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:56.895246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13b4fddf365465588968e4a92a8f172', 'request_id': 'req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:56.925020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80 admin admin] The token cache is being invalidate because project b13b4fddf365465588968e4a92a8f172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:56.928097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:56.930638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:56.933893 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3543/7087] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:56 2022] DELETE /identity/v3/projects/b13b4fddf365465588968e4a92a8f172 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:56.937555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:56.940086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:57.066737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2541e-2885-4854-bf56-acc649705cbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:57.067402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2541e-2885-4854-bf56-acc649705cbb service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:57.067697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2541e-2885-4854-bf56-acc649705cbb service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:57.067978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2541e-2885-4854-bf56-acc649705cbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:57.073928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c9f2541e-2885-4854-bf56-acc649705cbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:57.157508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffdb3d-b409-46a6-bb1b-596bb054bd80 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:57.201100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c549a69-007f-4c57-8113-e53fb213a182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:57.201781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c549a69-007f-4c57-8113-e53fb213a182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:57.202064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c549a69-007f-4c57-8113-e53fb213a182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:57.202342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c549a69-007f-4c57-8113-e53fb213a182 admin admin] PATH_INFO: `/v3/users/b0a9446d77d1491d893011e0937f3c91` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:57.210037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c549a69-007f-4c57-8113-e53fb213a182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0a9446d77d1491d893011e0937f3c91)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:57.232478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c549a69-007f-4c57-8113-e53fb213a182 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:57.343133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2541e-2885-4854-bf56-acc649705cbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:57.349291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2541e-2885-4854-bf56-acc649705cbb service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:57.349504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:57.374439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c549a69-007f-4c57-8113-e53fb213a182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0a9446d77d1491d893011e0937f3c91'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:57.378923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c549a69-007f-4c57-8113-e53fb213a182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0a9446d77d1491d893011e0937f3c91'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:57.390563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c549a69-007f-4c57-8113-e53fb213a182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0a9446d77d1491d893011e0937f3c91'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:57.391128 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3545/7088] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 763 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:57.428122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c549a69-007f-4c57-8113-e53fb213a182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0a9446d77d1491d893011e0937f3c91'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:57.469298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c549a69-007f-4c57-8113-e53fb213a182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0a9446d77d1491d893011e0937f3c91'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:57.485397 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3544/7089] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:56 2022] DELETE /identity/v3/users/b0a9446d77d1491d893011e0937f3c91 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:58.107811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2541e-2885-4854-bf56-acc649705cbb service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:58.108980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c9f2541e-2885-4854-bf56-acc649705cbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:58.140677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2541e-2885-4854-bf56-acc649705cbb service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:58.236808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:58.265168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2daf0b4-adff-4476-863e-c7e2a42b68e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:58.268047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daf0b4-adff-4476-863e-c7e2a42b68e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:58.269198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daf0b4-adff-4476-863e-c7e2a42b68e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:58.270201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daf0b4-adff-4476-863e-c7e2a42b68e6 admin admin] PATH_INFO: `/v3/projects/275d3cad0ce44ac6b2bbcb4f4e562284` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:58.273250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2daf0b4-adff-4476-863e-c7e2a42b68e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=275d3cad0ce44ac6b2bbcb4f4e562284)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:58.277169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2daf0b4-adff-4476-863e-c7e2a42b68e6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:58.382498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2daf0b4-adff-4476-863e-c7e2a42b68e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '275d3cad0ce44ac6b2bbcb4f4e562284', 'request_id': 'req-f2daf0b4-adff-4476-863e-c7e2a42b68e6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:58.402034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2daf0b4-adff-4476-863e-c7e2a42b68e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '275d3cad0ce44ac6b2bbcb4f4e562284', 'request_id': 'req-f2daf0b4-adff-4476-863e-c7e2a42b68e6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:58.417326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2daf0b4-adff-4476-863e-c7e2a42b68e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '275d3cad0ce44ac6b2bbcb4f4e562284', 'request_id': 'req-f2daf0b4-adff-4476-863e-c7e2a42b68e6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:58.463770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2daf0b4-adff-4476-863e-c7e2a42b68e6 admin admin] The token cache is being invalidate because project 275d3cad0ce44ac6b2bbcb4f4e562284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:58.463770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2daf0b4-adff-4476-863e-c7e2a42b68e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:58.464873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2daf0b4-adff-4476-863e-c7e2a42b68e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:58.470033 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3546/7090] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:58 2022] DELETE /identity/v3/projects/275d3cad0ce44ac6b2bbcb4f4e562284 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:58.470906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c549a69-007f-4c57-8113-e53fb213a182 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:58.472496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6c549a69-007f-4c57-8113-e53fb213a182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:58.490891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c549a69-007f-4c57-8113-e53fb213a182 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:58.584454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2daf0b4-adff-4476-863e-c7e2a42b68e6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:58.586182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f2daf0b4-adff-4476-863e-c7e2a42b68e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:58.596038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c61da6-5144-4be3-afd9-6bb5a8eca489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:58.600376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c61da6-5144-4be3-afd9-6bb5a8eca489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:58.602433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c61da6-5144-4be3-afd9-6bb5a8eca489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:58.603567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c61da6-5144-4be3-afd9-6bb5a8eca489 admin admin] PATH_INFO: `/v3/users/de3e276434c24d7e9acae49fe995e157` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:58.607117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c61da6-5144-4be3-afd9-6bb5a8eca489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de3e276434c24d7e9acae49fe995e157)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:58.613891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c61da6-5144-4be3-afd9-6bb5a8eca489 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:58.693374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98c61da6-5144-4be3-afd9-6bb5a8eca489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de3e276434c24d7e9acae49fe995e157'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:58.694247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98c61da6-5144-4be3-afd9-6bb5a8eca489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de3e276434c24d7e9acae49fe995e157'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:58.714861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98c61da6-5144-4be3-afd9-6bb5a8eca489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de3e276434c24d7e9acae49fe995e157'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:58.737213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98c61da6-5144-4be3-afd9-6bb5a8eca489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de3e276434c24d7e9acae49fe995e157'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:58.757456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98c61da6-5144-4be3-afd9-6bb5a8eca489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de3e276434c24d7e9acae49fe995e157'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:58.776405 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3545/7091] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:50:58 2022] DELETE /identity/v3/users/de3e276434c24d7e9acae49fe995e157 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:58.830172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2daf0b4-adff-4476-863e-c7e2a42b68e6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:59.034498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304ebb8-1fc3-4635-87b8-2d21409e20f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:59.035454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304ebb8-1fc3-4635-87b8-2d21409e20f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:59.035738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304ebb8-1fc3-4635-87b8-2d21409e20f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:59.036019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304ebb8-1fc3-4635-87b8-2d21409e20f5 admin admin] PATH_INFO: `/v3/projects/ed6afc4004ea4422b6032a07d5528b9c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:59.040265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304ebb8-1fc3-4635-87b8-2d21409e20f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed6afc4004ea4422b6032a07d5528b9c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:59.045809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304ebb8-1fc3-4635-87b8-2d21409e20f5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:59.189503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:59.272531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6304ebb8-1fc3-4635-87b8-2d21409e20f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed6afc4004ea4422b6032a07d5528b9c', 'request_id': 'req-6304ebb8-1fc3-4635-87b8-2d21409e20f5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:59.296114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6304ebb8-1fc3-4635-87b8-2d21409e20f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed6afc4004ea4422b6032a07d5528b9c', 'request_id': 'req-6304ebb8-1fc3-4635-87b8-2d21409e20f5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:59.310468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6304ebb8-1fc3-4635-87b8-2d21409e20f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed6afc4004ea4422b6032a07d5528b9c', 'request_id': 'req-6304ebb8-1fc3-4635-87b8-2d21409e20f5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:59.340084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6304ebb8-1fc3-4635-87b8-2d21409e20f5 admin admin] The token cache is being invalidate because project ed6afc4004ea4422b6032a07d5528b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:50:59.340660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6304ebb8-1fc3-4635-87b8-2d21409e20f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:59.344090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6304ebb8-1fc3-4635-87b8-2d21409e20f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:50:59.346758 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3547/7092] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:58 2022] DELETE /identity/v3/projects/ed6afc4004ea4422b6032a07d5528b9c => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:50:59.352002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06286ca6-c7e4-414b-92d5-dcfaa1a45414 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:59.352500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06286ca6-c7e4-414b-92d5-dcfaa1a45414 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:59.352953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06286ca6-c7e4-414b-92d5-dcfaa1a45414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:59.427295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-06286ca6-c7e4-414b-92d5-dcfaa1a45414 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:59.429115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-06286ca6-c7e4-414b-92d5-dcfaa1a45414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:59.587397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:59.652323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304ebb8-1fc3-4635-87b8-2d21409e20f5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:59.654451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6304ebb8-1fc3-4635-87b8-2d21409e20f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:59.681323 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3546/7093] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:59.689177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaf793-e393-475c-b20a-d55947942012 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:59.689724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaf793-e393-475c-b20a-d55947942012 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:59.690005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaf793-e393-475c-b20a-d55947942012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:59.756316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c7aaf793-e393-475c-b20a-d55947942012 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:59.757466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c7aaf793-e393-475c-b20a-d55947942012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:59.793292 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3547/7094] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:59.797804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaf793-e393-475c-b20a-d55947942012 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:59.820872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaf793-e393-475c-b20a-d55947942012 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:59.831937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982260d-ff27-4b71-a60c-e28a09a60883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:59.833240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982260d-ff27-4b71-a60c-e28a09a60883 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:59.834385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982260d-ff27-4b71-a60c-e28a09a60883 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:59.838967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982260d-ff27-4b71-a60c-e28a09a60883 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:59.839921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982260d-ff27-4b71-a60c-e28a09a60883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:50:59.840389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982260d-ff27-4b71-a60c-e28a09a60883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:59.842171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982260d-ff27-4b71-a60c-e28a09a60883 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:59.861353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304ebb8-1fc3-4635-87b8-2d21409e20f5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:59.875915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40076791-233c-4e28-9e94-4ecf2619ed89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:59.876811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40076791-233c-4e28-9e94-4ecf2619ed89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:59.877268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40076791-233c-4e28-9e94-4ecf2619ed89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:59.877695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40076791-233c-4e28-9e94-4ecf2619ed89 admin admin] PATH_INFO: `/v3/projects/5e22449e73c740bfba9e17bd18c13370` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:59.879367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40076791-233c-4e28-9e94-4ecf2619ed89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e22449e73c740bfba9e17bd18c13370)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:59.881498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40076791-233c-4e28-9e94-4ecf2619ed89 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:59.882057 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3548/7095] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:50:59.883142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982260d-ff27-4b71-a60c-e28a09a60883 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:59.905625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982260d-ff27-4b71-a60c-e28a09a60883 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:59.917625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143c045-f326-4966-855e-10ea2270e452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:59.919384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143c045-f326-4966-855e-10ea2270e452 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:59.921886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143c045-f326-4966-855e-10ea2270e452 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:59.922337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143c045-f326-4966-855e-10ea2270e452 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:59.923144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143c045-f326-4966-855e-10ea2270e452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:59.927627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143c045-f326-4966-855e-10ea2270e452 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:00.011244 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3549/7096] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:50:59 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:00.012244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-40076791-233c-4e28-9e94-4ecf2619ed89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e22449e73c740bfba9e17bd18c13370', 'request_id': 'req-40076791-233c-4e28-9e94-4ecf2619ed89'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:00.017511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143c045-f326-4966-855e-10ea2270e452 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:00.028143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-40076791-233c-4e28-9e94-4ecf2619ed89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e22449e73c740bfba9e17bd18c13370', 'request_id': 'req-40076791-233c-4e28-9e94-4ecf2619ed89'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:00.042760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-40076791-233c-4e28-9e94-4ecf2619ed89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e22449e73c740bfba9e17bd18c13370', 'request_id': 'req-40076791-233c-4e28-9e94-4ecf2619ed89'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:00.084254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-40076791-233c-4e28-9e94-4ecf2619ed89 admin admin] The token cache is being invalidate because project 5e22449e73c740bfba9e17bd18c13370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:00.084548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-40076791-233c-4e28-9e94-4ecf2619ed89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:00.088479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-40076791-233c-4e28-9e94-4ecf2619ed89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:00.102745 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3548/7097] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:50:59 2022] DELETE /identity/v3/projects/5e22449e73c740bfba9e17bd18c13370 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:00.104742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf3406-5b13-4aa9-9bb1-851436a510e1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:00.105028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf3406-5b13-4aa9-9bb1-851436a510e1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:00.105305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf3406-5b13-4aa9-9bb1-851436a510e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:00.154203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-efdf3406-5b13-4aa9-9bb1-851436a510e1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:00.157194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-efdf3406-5b13-4aa9-9bb1-851436a510e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:00.209451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143c045-f326-4966-855e-10ea2270e452 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:00.227169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d9396-1ae6-4b06-b8ee-d3b9cb79f19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:00.228488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d9396-1ae6-4b06-b8ee-d3b9cb79f19c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:00.232947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d9396-1ae6-4b06-b8ee-d3b9cb79f19c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:00.233134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d9396-1ae6-4b06-b8ee-d3b9cb79f19c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:00.233770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d9396-1ae6-4b06-b8ee-d3b9cb79f19c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:00.235990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d9396-1ae6-4b06-b8ee-d3b9cb79f19c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:00.271205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:00.288478 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3550/7098] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:00 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:00.291123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d9396-1ae6-4b06-b8ee-d3b9cb79f19c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:00.296498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4b3d9396-1ae6-4b06-b8ee-d3b9cb79f19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:00.336508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d9396-1ae6-4b06-b8ee-d3b9cb79f19c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:00.342860 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3549/7099] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:00.351864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac75c61-27bc-4c43-9bfd-35d2ca8027aa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:00.352156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac75c61-27bc-4c43-9bfd-35d2ca8027aa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:00.352950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac75c61-27bc-4c43-9bfd-35d2ca8027aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:00.359867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8d168-b9ce-483f-bcff-1cc2e70f6d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:00.362642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8d168-b9ce-483f-bcff-1cc2e70f6d00 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:00.362936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8d168-b9ce-483f-bcff-1cc2e70f6d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:00.364372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8d168-b9ce-483f-bcff-1cc2e70f6d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:00.366827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8d168-b9ce-483f-bcff-1cc2e70f6d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:00.374001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8d168-b9ce-483f-bcff-1cc2e70f6d00 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:00.413696 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3551/7100] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:00.415669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cac75c61-27bc-4c43-9bfd-35d2ca8027aa None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:00.417356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8d168-b9ce-483f-bcff-1cc2e70f6d00 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:00.422347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cac75c61-27bc-4c43-9bfd-35d2ca8027aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:00.452484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8d168-b9ce-483f-bcff-1cc2e70f6d00 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:00.456019 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3550/7101] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:00.459810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac75c61-27bc-4c43-9bfd-35d2ca8027aa None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:00.470767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51eb26-223d-4a84-90db-59ec1afd31f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:00.473994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51eb26-223d-4a84-90db-59ec1afd31f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:00.473994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51eb26-223d-4a84-90db-59ec1afd31f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:00.473994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51eb26-223d-4a84-90db-59ec1afd31f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:00.473994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51eb26-223d-4a84-90db-59ec1afd31f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:00.482357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51eb26-223d-4a84-90db-59ec1afd31f3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:00.492609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac75c61-27bc-4c43-9bfd-35d2ca8027aa None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:00.510797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371544be-2860-4091-aecf-0276793d9838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:00.511457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371544be-2860-4091-aecf-0276793d9838 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:00.515880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371544be-2860-4091-aecf-0276793d9838 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:00.516202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371544be-2860-4091-aecf-0276793d9838 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:00.519235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371544be-2860-4091-aecf-0276793d9838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:00.519627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371544be-2860-4091-aecf-0276793d9838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:00.524631 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3552/7102] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:00.526152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371544be-2860-4091-aecf-0276793d9838 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:00.528834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51eb26-223d-4a84-90db-59ec1afd31f3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:00.597347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51eb26-223d-4a84-90db-59ec1afd31f3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:00.610341 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3551/7103] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:00.614584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371544be-2860-4091-aecf-0276793d9838 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:00.620219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fdc14-e496-4bd3-aa5f-1714941a5ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:00.620962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fdc14-e496-4bd3-aa5f-1714941a5ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:00.621510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fdc14-e496-4bd3-aa5f-1714941a5ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:00.621849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fdc14-e496-4bd3-aa5f-1714941a5ba2 admin admin] PATH_INFO: `/v3/projects/522cd45abff741c6905d495a810a836c/users/850faf0ffaa74ed49806c4937d62d5bc/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:00.651470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371544be-2860-4091-aecf-0276793d9838 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:00.668351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4af7f-aa27-47d9-90ef-5339b2b5b1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:00.668986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4af7f-aa27-47d9-90ef-5339b2b5b1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:00.678983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fdc14-e496-4bd3-aa5f-1714941a5ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522cd45abff741c6905d495a810a836c, user_id=850faf0ffaa74ed49806c4937d62d5bc, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:00.679655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4af7f-aa27-47d9-90ef-5339b2b5b1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:00.680033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4af7f-aa27-47d9-90ef-5339b2b5b1b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:00.680726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4af7f-aa27-47d9-90ef-5339b2b5b1b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:00.682669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4af7f-aa27-47d9-90ef-5339b2b5b1b7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:00.688059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fdc14-e496-4bd3-aa5f-1714941a5ba2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:00.727433 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3553/7104] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:00 2022] PUT /identity/v3/projects/522cd45abff741c6905d495a810a836c/users/850faf0ffaa74ed49806c4937d62d5bc/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:00.737315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b8158-afe6-4c20-87d0-67d68dac6c67 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:00.737653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b8158-afe6-4c20-87d0-67d68dac6c67 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:00.737936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b8158-afe6-4c20-87d0-67d68dac6c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:00.769552 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3552/7105] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:00 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:00.771551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4af7f-aa27-47d9-90ef-5339b2b5b1b7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:00.798626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a51b8158-afe6-4c20-87d0-67d68dac6c67 None None] MFA Rules not processed for user `850faf0ffaa74ed49806c4937d62d5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:00.799890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a51b8158-afe6-4c20-87d0-67d68dac6c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:00.843763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:00.967270 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3554/7106] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:51:00.968301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b8158-afe6-4c20-87d0-67d68dac6c67 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:00.998085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b8158-afe6-4c20-87d0-67d68dac6c67 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:01.001026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4af7f-aa27-47d9-90ef-5339b2b5b1b7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:01.010829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580c8a4-754f-4409-ad9f-a84f2b48f6bf tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850faf0ffaa74ed49806c4937d62d5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '522cd45abff741c6905d495a810a836c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:01.011543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580c8a4-754f-4409-ad9f-a84f2b48f6bf tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:01.011821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580c8a4-754f-4409-ad9f-a84f2b48f6bf tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:01.012094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580c8a4-754f-4409-ad9f-a84f2b48f6bf tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] PATH_INFO: `/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:01.012728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580c8a4-754f-4409-ad9f-a84f2b48f6bf tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=850faf0ffaa74ed49806c4937d62d5bc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:01.014250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843166a6-8795-46d6-811c-292a64a3e69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:01.015071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843166a6-8795-46d6-811c-292a64a3e69a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:01.017051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843166a6-8795-46d6-811c-292a64a3e69a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:01.017560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580c8a4-754f-4409-ad9f-a84f2b48f6bf tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:01.020790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843166a6-8795-46d6-811c-292a64a3e69a admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:01.023534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843166a6-8795-46d6-811c-292a64a3e69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:01.029396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843166a6-8795-46d6-811c-292a64a3e69a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:01.049867 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3555/7107] 10.222.0.27 () {60 vars in 1299 bytes} [Sun Aug 28 18:51:00 2022] POST /identity/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2 => generated 367 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:01.055046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580c8a4-754f-4409-ad9f-a84f2b48f6bf tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:01.098419 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3553/7108] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:00 2022] POST /identity/v3/users => generated 290 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:01.100851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843166a6-8795-46d6-811c-292a64a3e69a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:01.132401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843166a6-8795-46d6-811c-292a64a3e69a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:01.132661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580c8a4-754f-4409-ad9f-a84f2b48f6bf tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:01.145895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4156bc6-fd1e-4996-983f-aaf1f275ce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:01.146754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156bc6-fd1e-4996-983f-aaf1f275ce4f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:01.147046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156bc6-fd1e-4996-983f-aaf1f275ce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:01.147368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156bc6-fd1e-4996-983f-aaf1f275ce4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:01.148028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4156bc6-fd1e-4996-983f-aaf1f275ce4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:01.149644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4156bc6-fd1e-4996-983f-aaf1f275ce4f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:01.171382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1146be7-eb6d-4d1c-bc6e-1b2603a309b2 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850faf0ffaa74ed49806c4937d62d5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '522cd45abff741c6905d495a810a836c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:01.172258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1146be7-eb6d-4d1c-bc6e-1b2603a309b2 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:01.172532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1146be7-eb6d-4d1c-bc6e-1b2603a309b2 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:01.172810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1146be7-eb6d-4d1c-bc6e-1b2603a309b2 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] PATH_INFO: `/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2/a3ee3aa288b446bcb14abc370bfbd1c4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:01.176888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1146be7-eb6d-4d1c-bc6e-1b2603a309b2 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=850faf0ffaa74ed49806c4937d62d5bc, credential_id=a3ee3aa288b446bcb14abc370bfbd1c4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:01.178340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1146be7-eb6d-4d1c-bc6e-1b2603a309b2 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:01.197938 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3554/7109] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:01.201971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4156bc6-fd1e-4996-983f-aaf1f275ce4f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:01.241442 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3556/7110] 10.222.0.27 () {58 vars in 1380 bytes} [Sun Aug 28 18:51:01 2022] DELETE /identity/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2/a3ee3aa288b446bcb14abc370bfbd1c4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:01.242721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1146be7-eb6d-4d1c-bc6e-1b2603a309b2 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:01.245986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4156bc6-fd1e-4996-983f-aaf1f275ce4f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:01.268034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1146be7-eb6d-4d1c-bc6e-1b2603a309b2 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:01.285670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7799ddd-d15e-4e44-a8c5-a41cb0aab9d8 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850faf0ffaa74ed49806c4937d62d5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '522cd45abff741c6905d495a810a836c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:01.286386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7799ddd-d15e-4e44-a8c5-a41cb0aab9d8 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:01.286856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7799ddd-d15e-4e44-a8c5-a41cb0aab9d8 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:01.287140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7799ddd-d15e-4e44-a8c5-a41cb0aab9d8 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] PATH_INFO: `/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:01.288174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7799ddd-d15e-4e44-a8c5-a41cb0aab9d8 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=850faf0ffaa74ed49806c4937d62d5bc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:01.289637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7799ddd-d15e-4e44-a8c5-a41cb0aab9d8 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:01.299777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c2a15-6dde-49a3-a587-faf00adde22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:01.300418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c2a15-6dde-49a3-a587-faf00adde22e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:01.300887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c2a15-6dde-49a3-a587-faf00adde22e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:01.301165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c2a15-6dde-49a3-a587-faf00adde22e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:01.301822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c2a15-6dde-49a3-a587-faf00adde22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:01.303473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c2a15-6dde-49a3-a587-faf00adde22e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:01.320242 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3555/7111] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:51:01.324618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c2a15-6dde-49a3-a587-faf00adde22e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:01.348756 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3557/7112] 10.222.0.27 () {60 vars in 1299 bytes} [Sun Aug 28 18:51:01 2022] POST /identity/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2 => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:01.352083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7799ddd-d15e-4e44-a8c5-a41cb0aab9d8 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:01.355303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c2a15-6dde-49a3-a587-faf00adde22e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:01.375730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7f8fc-2185-40be-b2a2-1be8e61af14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:01.378150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7f8fc-2185-40be-b2a2-1be8e61af14d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:01.379070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7f8fc-2185-40be-b2a2-1be8e61af14d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:01.388822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7f8fc-2185-40be-b2a2-1be8e61af14d admin admin] PATH_INFO: `/v3/projects/6c26cb2f945a4a87ae8419724e369e3b/users/0be0b97608524921a4e8e8ceb412cec5/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:01.393710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7799ddd-d15e-4e44-a8c5-a41cb0aab9d8 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:01.412880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c3b67-2597-4aa3-957a-f187024c1a51 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850faf0ffaa74ed49806c4937d62d5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '522cd45abff741c6905d495a810a836c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:01.413608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c3b67-2597-4aa3-957a-f187024c1a51 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:01.413901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c3b67-2597-4aa3-957a-f187024c1a51 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:01.414185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c3b67-2597-4aa3-957a-f187024c1a51 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] PATH_INFO: `/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2/463765f1f61a4dce8d4696214d790f9e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:01.418757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c3b67-2597-4aa3-957a-f187024c1a51 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=850faf0ffaa74ed49806c4937d62d5bc, credential_id=463765f1f61a4dce8d4696214d790f9e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:01.421895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7f8fc-2185-40be-b2a2-1be8e61af14d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c26cb2f945a4a87ae8419724e369e3b, user_id=0be0b97608524921a4e8e8ceb412cec5, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:01.422807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c3b67-2597-4aa3-957a-f187024c1a51 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:01.429327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7f8fc-2185-40be-b2a2-1be8e61af14d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:01.483144 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3556/7113] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:01 2022] PUT /identity/v3/projects/6c26cb2f945a4a87ae8419724e369e3b/users/0be0b97608524921a4e8e8ceb412cec5/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:01.506900 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3558/7114] 10.222.0.27 () {58 vars in 1380 bytes} [Sun Aug 28 18:51:01 2022] DELETE /identity/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2/463765f1f61a4dce8d4696214d790f9e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:01.511488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7f8fc-2185-40be-b2a2-1be8e61af14d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:01.604035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348809ff-e835-4b4b-aed3-d9b16e424685 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:01.604519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348809ff-e835-4b4b-aed3-d9b16e424685 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:01.604764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348809ff-e835-4b4b-aed3-d9b16e424685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:01.684329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-348809ff-e835-4b4b-aed3-d9b16e424685 None None] MFA Rules not processed for user `0be0b97608524921a4e8e8ceb412cec5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:01.685577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-348809ff-e835-4b4b-aed3-d9b16e424685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:01.692365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:01.711749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7f8fc-2185-40be-b2a2-1be8e61af14d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:01.720403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ddee5-da19-42a5-a0a7-8e1e4c7cba62 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850faf0ffaa74ed49806c4937d62d5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '522cd45abff741c6905d495a810a836c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:01.721239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ddee5-da19-42a5-a0a7-8e1e4c7cba62 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:01.721937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ddee5-da19-42a5-a0a7-8e1e4c7cba62 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:01.722674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ddee5-da19-42a5-a0a7-8e1e4c7cba62 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] PATH_INFO: `/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2/463765f1f61a4dce8d4696214d790f9e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:01.767114 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-636ddee5-da19-42a5-a0a7-8e1e4c7cba62 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Could not find credential: 53e73e5f2fc90622bb4c85fcd77dd61b5deb9db5665787a87c56abe7c117be4d.: keystone.exception.CredentialNotFound: Could not find credential: 53e73e5f2fc90622bb4c85fcd77dd61b5deb9db5665787a87c56abe7c117be4d. Aug 28 18:51:01.767114 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:51:01.767114 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:51:01.767114 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:51:01.767114 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:51:01.767114 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:51:01.767114 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:51:01.767114 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:51:01.767114 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:51:01.767114 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:51:01.767114 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:51:01.767114 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:51:01.767114 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Aug 28 18:51:01.767114 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 28 18:51:01.768081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 18:51:01.768081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 18:51:01.768081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Aug 28 18:51:01.768081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Aug 28 18:51:01.768081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:51:01.768081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:51:01.768081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Aug 28 18:51:01.768081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Aug 28 18:51:01.768081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:51:01.768081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:51:01.768081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:51:01.768081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:51:01.768081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:51:01.768081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Aug 28 18:51:01.768081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:51:01.768081 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:51:01.769075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:51:01.769075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:51:01.769075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:51:01.769075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:51:01.769075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:51:01.769075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:51:01.769075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Aug 28 18:51:01.769075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Aug 28 18:51:01.769075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Aug 28 18:51:01.769075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Aug 28 18:51:01.769075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Aug 28 18:51:01.769075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Aug 28 18:51:01.769075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 53e73e5f2fc90622bb4c85fcd77dd61b5deb9db5665787a87c56abe7c117be4d. Aug 28 18:51:01.769075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:51:01.776639 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3557/7115] 10.222.0.27 () {58 vars in 1377 bytes} [Sun Aug 28 18:51:01 2022] GET /identity/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2/463765f1f61a4dce8d4696214d790f9e => generated 148 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:51:01.778140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8167f-0f02-4863-93da-0fc212dffd14 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:01.778425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8167f-0f02-4863-93da-0fc212dffd14 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:01.778703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8167f-0f02-4863-93da-0fc212dffd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:01.857618 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3559/7116] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:01.858290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348809ff-e835-4b4b-aed3-d9b16e424685 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:01.958909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-65a8167f-0f02-4863-93da-0fc212dffd14 None None] MFA Rules not processed for user `e8252a305455469ba107ba34952a20c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:01.989870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-65a8167f-0f02-4863-93da-0fc212dffd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:02.003190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348809ff-e835-4b4b-aed3-d9b16e424685 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:02.025969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ac878-efd4-4d8d-aa23-20449e76ca91 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850faf0ffaa74ed49806c4937d62d5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '522cd45abff741c6905d495a810a836c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:02.026796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ac878-efd4-4d8d-aa23-20449e76ca91 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:02.028635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ac878-efd4-4d8d-aa23-20449e76ca91 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:02.029347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ac878-efd4-4d8d-aa23-20449e76ca91 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] PATH_INFO: `/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:02.030005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ac878-efd4-4d8d-aa23-20449e76ca91 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=850faf0ffaa74ed49806c4937d62d5bc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:02.035929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ac878-efd4-4d8d-aa23-20449e76ca91 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:02.076290 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3560/7117] 10.222.0.27 () {60 vars in 1299 bytes} [Sun Aug 28 18:51:01 2022] POST /identity/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2 => generated 367 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:02.088461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ac878-efd4-4d8d-aa23-20449e76ca91 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:02.114836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ac878-efd4-4d8d-aa23-20449e76ca91 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:02.160098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be1b96-03f6-4197-88c5-0e1538a93195 tempest-DefaultDomainTestJSON-1205903859 tempest-DefaultDomainTestJSON-1205903859-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be0b97608524921a4e8e8ceb412cec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c26cb2f945a4a87ae8419724e369e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:02.162583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be1b96-03f6-4197-88c5-0e1538a93195 tempest-DefaultDomainTestJSON-1205903859 tempest-DefaultDomainTestJSON-1205903859-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:02.167721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be1b96-03f6-4197-88c5-0e1538a93195 tempest-DefaultDomainTestJSON-1205903859 tempest-DefaultDomainTestJSON-1205903859-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:02.168664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be1b96-03f6-4197-88c5-0e1538a93195 tempest-DefaultDomainTestJSON-1205903859 tempest-DefaultDomainTestJSON-1205903859-project] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:02.173751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be1b96-03f6-4197-88c5-0e1538a93195 tempest-DefaultDomainTestJSON-1205903859 tempest-DefaultDomainTestJSON-1205903859-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:02.175699 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3558/7118] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:01 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:02.179607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be1b96-03f6-4197-88c5-0e1538a93195 tempest-DefaultDomainTestJSON-1205903859 tempest-DefaultDomainTestJSON-1205903859-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:02.180352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8167f-0f02-4863-93da-0fc212dffd14 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:02.185256 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3561/7119] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Aug 28 18:51:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:02.186079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be1b96-03f6-4197-88c5-0e1538a93195 tempest-DefaultDomainTestJSON-1205903859 tempest-DefaultDomainTestJSON-1205903859-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:02.193194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94be1b96-03f6-4197-88c5-0e1538a93195 tempest-DefaultDomainTestJSON-1205903859 tempest-DefaultDomainTestJSON-1205903859-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:02.204569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8167f-0f02-4863-93da-0fc212dffd14 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:02.219095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a8ccd-eb86-404c-93ae-67120931d7a5 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850faf0ffaa74ed49806c4937d62d5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '522cd45abff741c6905d495a810a836c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:02.219806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a8ccd-eb86-404c-93ae-67120931d7a5 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:02.220162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a8ccd-eb86-404c-93ae-67120931d7a5 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:02.220426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a8ccd-eb86-404c-93ae-67120931d7a5 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] PATH_INFO: `/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:02.221002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a8ccd-eb86-404c-93ae-67120931d7a5 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=850faf0ffaa74ed49806c4937d62d5bc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:02.222719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a8ccd-eb86-404c-93ae-67120931d7a5 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:02.256655 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3559/7120] 10.222.0.27 () {60 vars in 1299 bytes} [Sun Aug 28 18:51:02 2022] POST /identity/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2 => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:02.257741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a8ccd-eb86-404c-93ae-67120931d7a5 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:02.314658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:02.368422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be1b96-03f6-4197-88c5-0e1538a93195 tempest-DefaultDomainTestJSON-1205903859 tempest-DefaultDomainTestJSON-1205903859-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:02.379701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff48b2-9afb-4b12-910c-1d4dfcfdee6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:02.380349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff48b2-9afb-4b12-910c-1d4dfcfdee6f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:02.382530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff48b2-9afb-4b12-910c-1d4dfcfdee6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:02.382806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff48b2-9afb-4b12-910c-1d4dfcfdee6f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:02.387149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff48b2-9afb-4b12-910c-1d4dfcfdee6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:02.387149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff48b2-9afb-4b12-910c-1d4dfcfdee6f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:02.391992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a8ccd-eb86-404c-93ae-67120931d7a5 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:02.398213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6f75c-e3da-4b86-a221-206786fdfc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:02.398992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6f75c-e3da-4b86-a221-206786fdfc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:02.399415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6f75c-e3da-4b86-a221-206786fdfc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:02.399788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6f75c-e3da-4b86-a221-206786fdfc57 admin admin] PATH_INFO: `/v3/users/0be0b97608524921a4e8e8ceb412cec5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:02.404070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6f75c-e3da-4b86-a221-206786fdfc57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be0b97608524921a4e8e8ceb412cec5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:02.407895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6f75c-e3da-4b86-a221-206786fdfc57 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:02.431866 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3562/7121] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:02 2022] POST /identity/v3/projects => generated 405 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:02.432980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff48b2-9afb-4b12-910c-1d4dfcfdee6f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:02.535995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4ca6f75c-e3da-4b86-a221-206786fdfc57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be0b97608524921a4e8e8ceb412cec5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:02.567399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff48b2-9afb-4b12-910c-1d4dfcfdee6f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:02.576762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daa6b8-c67f-4711-9de6-fa6fc353dac6 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850faf0ffaa74ed49806c4937d62d5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '522cd45abff741c6905d495a810a836c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:02.577741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daa6b8-c67f-4711-9de6-fa6fc353dac6 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:02.578278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daa6b8-c67f-4711-9de6-fa6fc353dac6 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:02.578945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daa6b8-c67f-4711-9de6-fa6fc353dac6 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] PATH_INFO: `/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:02.580226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daa6b8-c67f-4711-9de6-fa6fc353dac6 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=850faf0ffaa74ed49806c4937d62d5bc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:02.582220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daa6b8-c67f-4711-9de6-fa6fc353dac6 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:02.591985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4ca6f75c-e3da-4b86-a221-206786fdfc57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be0b97608524921a4e8e8ceb412cec5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:02.593059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4ca6f75c-e3da-4b86-a221-206786fdfc57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be0b97608524921a4e8e8ceb412cec5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:02.593958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4ca6f75c-e3da-4b86-a221-206786fdfc57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be0b97608524921a4e8e8ceb412cec5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:02.595167 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3563/7122] 10.222.0.27 () {58 vars in 1278 bytes} [Sun Aug 28 18:51:02 2022] GET /identity/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2 => generated 865 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:02.596440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daa6b8-c67f-4711-9de6-fa6fc353dac6 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:02.598974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:02.600394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-75daa6b8-c67f-4711-9de6-fa6fc353dac6 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:02.611705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4ca6f75c-e3da-4b86-a221-206786fdfc57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be0b97608524921a4e8e8ceb412cec5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:02.634172 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3560/7123] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:02 2022] DELETE /identity/v3/users/0be0b97608524921a4e8e8ceb412cec5 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:02.635525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6f75c-e3da-4b86-a221-206786fdfc57 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:02.638036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4ca6f75c-e3da-4b86-a221-206786fdfc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:02.755339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daa6b8-c67f-4711-9de6-fa6fc353dac6 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:02.776535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6f75c-e3da-4b86-a221-206786fdfc57 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:02.792435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c2ea6-5e16-473a-a077-51e3606d2689 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850faf0ffaa74ed49806c4937d62d5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '522cd45abff741c6905d495a810a836c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:02.794372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c2ea6-5e16-473a-a077-51e3606d2689 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:02.794761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c2ea6-5e16-473a-a077-51e3606d2689 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:02.795189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c2ea6-5e16-473a-a077-51e3606d2689 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] PATH_INFO: `/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2/eea4bc6324ce4531b623ec708d0e0066` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:02.797503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c2ea6-5e16-473a-a077-51e3606d2689 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=850faf0ffaa74ed49806c4937d62d5bc, credential_id=eea4bc6324ce4531b623ec708d0e0066)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:02.799098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c2ea6-5e16-473a-a077-51e3606d2689 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:02.847106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b96b64-031e-4e26-b3d7-e00e36416485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:02.849166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b96b64-031e-4e26-b3d7-e00e36416485 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:02.852477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b96b64-031e-4e26-b3d7-e00e36416485 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:02.852822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b96b64-031e-4e26-b3d7-e00e36416485 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:02.853557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b96b64-031e-4e26-b3d7-e00e36416485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:02.855832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b96b64-031e-4e26-b3d7-e00e36416485 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:02.861275 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3561/7124] 10.222.0.27 () {58 vars in 1380 bytes} [Sun Aug 28 18:51:02 2022] DELETE /identity/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2/eea4bc6324ce4531b623ec708d0e0066 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:02.862576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f0570-6913-428d-8bf9-c2e0364b330c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:02.862864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f0570-6913-428d-8bf9-c2e0364b330c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:02.863146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f0570-6913-428d-8bf9-c2e0364b330c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:02.898183 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3564/7125] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:02 2022] POST /identity/v3/users => generated 303 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:02.911668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b96b64-031e-4e26-b3d7-e00e36416485 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:02.916628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:02.927560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-459f0570-6913-428d-8bf9-c2e0364b330c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:02.928791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b96b64-031e-4e26-b3d7-e00e36416485 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:02.928947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-459f0570-6913-428d-8bf9-c2e0364b330c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:02.942920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dbf99-2a55-4898-a034-48167e7f6f6e tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850faf0ffaa74ed49806c4937d62d5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '522cd45abff741c6905d495a810a836c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:02.943698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dbf99-2a55-4898-a034-48167e7f6f6e tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:02.943957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dbf99-2a55-4898-a034-48167e7f6f6e tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:02.944237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dbf99-2a55-4898-a034-48167e7f6f6e tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] PATH_INFO: `/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2/0b91e3c1c20c40f98a80cddd2ac1d326` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:02.946583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859dbf99-2a55-4898-a034-48167e7f6f6e tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=850faf0ffaa74ed49806c4937d62d5bc, credential_id=0b91e3c1c20c40f98a80cddd2ac1d326)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:02.948053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859dbf99-2a55-4898-a034-48167e7f6f6e tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:02.954594 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3562/7126] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:02.955608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f0570-6913-428d-8bf9-c2e0364b330c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:02.983248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f0570-6913-428d-8bf9-c2e0364b330c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:02.998732 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3565/7127] 10.222.0.27 () {58 vars in 1380 bytes} [Sun Aug 28 18:51:02 2022] DELETE /identity/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2/0b91e3c1c20c40f98a80cddd2ac1d326 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:02.998732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dbf99-2a55-4898-a034-48167e7f6f6e tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:03.004349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-859dbf99-2a55-4898-a034-48167e7f6f6e tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:03.022462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f4afb-f846-4b6c-aaa5-5bc8c4046cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:03.023105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f4afb-f846-4b6c-aaa5-5bc8c4046cfa admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:03.023425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f4afb-f846-4b6c-aaa5-5bc8c4046cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:03.023703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f4afb-f846-4b6c-aaa5-5bc8c4046cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:03.024359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f4afb-f846-4b6c-aaa5-5bc8c4046cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:03.025985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f4afb-f846-4b6c-aaa5-5bc8c4046cfa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:03.073867 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3563/7128] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:03.079853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f4afb-f846-4b6c-aaa5-5bc8c4046cfa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:03.113700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f4afb-f846-4b6c-aaa5-5bc8c4046cfa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:03.139069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbf6ae-9ea0-4765-bf9c-114f5c55f8b4 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850faf0ffaa74ed49806c4937d62d5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '522cd45abff741c6905d495a810a836c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:03.139773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbf6ae-9ea0-4765-bf9c-114f5c55f8b4 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:03.140058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbf6ae-9ea0-4765-bf9c-114f5c55f8b4 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:03.140340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbf6ae-9ea0-4765-bf9c-114f5c55f8b4 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] PATH_INFO: `/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:03.140452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dbf99-2a55-4898-a034-48167e7f6f6e tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:03.141049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbf6ae-9ea0-4765-bf9c-114f5c55f8b4 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=850faf0ffaa74ed49806c4937d62d5bc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:03.142671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbf6ae-9ea0-4765-bf9c-114f5c55f8b4 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:03.150124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1c42c-535a-49e6-9677-ed4a36384ebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:03.150764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1c42c-535a-49e6-9677-ed4a36384ebe service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:03.151043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1c42c-535a-49e6-9677-ed4a36384ebe service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:03.151473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1c42c-535a-49e6-9677-ed4a36384ebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:03.187931 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3564/7129] 10.222.0.27 () {60 vars in 1299 bytes} [Sun Aug 28 18:51:03 2022] POST /identity/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2 => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:03.188827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbf6ae-9ea0-4765-bf9c-114f5c55f8b4 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:03.192975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1c42c-535a-49e6-9677-ed4a36384ebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:03.194765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1c42c-535a-49e6-9677-ed4a36384ebe service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:03.218290 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3566/7130] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:03.219063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1c42c-535a-49e6-9677-ed4a36384ebe service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:03.226173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbf6ae-9ea0-4765-bf9c-114f5c55f8b4 tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:03.245244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1c42c-535a-49e6-9677-ed4a36384ebe service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:03.252343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337ef89-f9e1-4c8e-a2d2-fcad121462b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:03.253288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337ef89-f9e1-4c8e-a2d2-fcad121462b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:03.253738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337ef89-f9e1-4c8e-a2d2-fcad121462b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:03.254220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337ef89-f9e1-4c8e-a2d2-fcad121462b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:03.255045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337ef89-f9e1-4c8e-a2d2-fcad121462b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:03.256447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea74f8-33ab-4cd9-83a3-c403f781dccd tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850faf0ffaa74ed49806c4937d62d5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '522cd45abff741c6905d495a810a836c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:03.257162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337ef89-f9e1-4c8e-a2d2-fcad121462b3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:03.257658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea74f8-33ab-4cd9-83a3-c403f781dccd tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:03.257950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea74f8-33ab-4cd9-83a3-c403f781dccd tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:03.258228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea74f8-33ab-4cd9-83a3-c403f781dccd tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] PATH_INFO: `/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2/391134d7f89849b69f7090ffaa45c81f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:03.265685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea74f8-33ab-4cd9-83a3-c403f781dccd tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=850faf0ffaa74ed49806c4937d62d5bc, credential_id=391134d7f89849b69f7090ffaa45c81f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:03.269663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea74f8-33ab-4cd9-83a3-c403f781dccd tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:03.288239 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3567/7131] 10.222.0.27 () {58 vars in 1377 bytes} [Sun Aug 28 18:51:03 2022] GET /identity/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2/391134d7f89849b69f7090ffaa45c81f => generated 367 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:03.289126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea74f8-33ab-4cd9-83a3-c403f781dccd tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:03.294401 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3565/7132] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:03.298294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337ef89-f9e1-4c8e-a2d2-fcad121462b3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:03.313559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea74f8-33ab-4cd9-83a3-c403f781dccd tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:03.332397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337ef89-f9e1-4c8e-a2d2-fcad121462b3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:03.336694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e69c7d-b5c6-4a93-9b35-b0cd722ca00c tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850faf0ffaa74ed49806c4937d62d5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '522cd45abff741c6905d495a810a836c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:03.338321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e69c7d-b5c6-4a93-9b35-b0cd722ca00c tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:03.339164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e69c7d-b5c6-4a93-9b35-b0cd722ca00c tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:03.339645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e69c7d-b5c6-4a93-9b35-b0cd722ca00c tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] PATH_INFO: `/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2/391134d7f89849b69f7090ffaa45c81f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:03.341719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e69c7d-b5c6-4a93-9b35-b0cd722ca00c tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=850faf0ffaa74ed49806c4937d62d5bc, credential_id=391134d7f89849b69f7090ffaa45c81f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:03.343227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e69c7d-b5c6-4a93-9b35-b0cd722ca00c tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:03.364982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9c67d-df83-4429-a3a3-3ba90de0cf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:03.365915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9c67d-df83-4429-a3a3-3ba90de0cf2a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:03.366396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9c67d-df83-4429-a3a3-3ba90de0cf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:03.366875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9c67d-df83-4429-a3a3-3ba90de0cf2a admin admin] PATH_INFO: `/v3/projects/cd55cb711bca4db287fc33111cfa67ab/users/5c3c1c3f4f9a4de085ef2e98c5303139/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:03.377441 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3568/7133] 10.222.0.27 () {58 vars in 1380 bytes} [Sun Aug 28 18:51:03 2022] DELETE /identity/v3/users/850faf0ffaa74ed49806c4937d62d5bc/credentials/OS-EC2/391134d7f89849b69f7090ffaa45c81f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:03.384423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e69c7d-b5c6-4a93-9b35-b0cd722ca00c tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:03.388268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e0e69c7d-b5c6-4a93-9b35-b0cd722ca00c tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:03.405358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9c67d-df83-4429-a3a3-3ba90de0cf2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd55cb711bca4db287fc33111cfa67ab, user_id=5c3c1c3f4f9a4de085ef2e98c5303139, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:03.415132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9c67d-df83-4429-a3a3-3ba90de0cf2a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:03.438760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e69c7d-b5c6-4a93-9b35-b0cd722ca00c tempest-EC2CredentialsTest-1665745564 tempest-EC2CredentialsTest-1665745564-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:03.453942 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3566/7134] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:03 2022] PUT /identity/v3/projects/cd55cb711bca4db287fc33111cfa67ab/users/5c3c1c3f4f9a4de085ef2e98c5303139/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:03.686621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be4807-3c38-430a-a611-6ffbcd39f604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:03.693969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be4807-3c38-430a-a611-6ffbcd39f604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:03.694318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be4807-3c38-430a-a611-6ffbcd39f604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:03.694698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be4807-3c38-430a-a611-6ffbcd39f604 admin admin] PATH_INFO: `/v3/users/850faf0ffaa74ed49806c4937d62d5bc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:03.700833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be4807-3c38-430a-a611-6ffbcd39f604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=850faf0ffaa74ed49806c4937d62d5bc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:03.703082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be4807-3c38-430a-a611-6ffbcd39f604 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:03.866071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85be4807-3c38-430a-a611-6ffbcd39f604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '850faf0ffaa74ed49806c4937d62d5bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:03.867148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85be4807-3c38-430a-a611-6ffbcd39f604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '850faf0ffaa74ed49806c4937d62d5bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:03.880666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85be4807-3c38-430a-a611-6ffbcd39f604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '850faf0ffaa74ed49806c4937d62d5bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:03.908157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85be4807-3c38-430a-a611-6ffbcd39f604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '850faf0ffaa74ed49806c4937d62d5bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:03.931613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:03.955321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85be4807-3c38-430a-a611-6ffbcd39f604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '850faf0ffaa74ed49806c4937d62d5bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:03.980151 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3569/7135] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:03 2022] DELETE /identity/v3/users/850faf0ffaa74ed49806c4937d62d5bc => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:03.982065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c65f-9267-4fea-90cc-a4d3666dfb9b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:03.982531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c65f-9267-4fea-90cc-a4d3666dfb9b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:03.982986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c65f-9267-4fea-90cc-a4d3666dfb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:04.056942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9ae9c65f-9267-4fea-90cc-a4d3666dfb9b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:04.058198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9ae9c65f-9267-4fea-90cc-a4d3666dfb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:04.067172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be4807-3c38-430a-a611-6ffbcd39f604 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:04.069448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-85be4807-3c38-430a-a611-6ffbcd39f604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:04.244279 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3567/7136] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:04.253565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9c65f-9267-4fea-90cc-a4d3666dfb9b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:04.255502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9ae9c65f-9267-4fea-90cc-a4d3666dfb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:04.287780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be4807-3c38-430a-a611-6ffbcd39f604 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:04.296159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:04.305026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83818e4e-6722-4348-a3e3-a8f10da0e0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:04.308103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818e4e-6722-4348-a3e3-a8f10da0e0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:04.308890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818e4e-6722-4348-a3e3-a8f10da0e0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:04.310239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818e4e-6722-4348-a3e3-a8f10da0e0f1 admin admin] PATH_INFO: `/v3/projects/6c26cb2f945a4a87ae8419724e369e3b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:04.314638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83818e4e-6722-4348-a3e3-a8f10da0e0f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c26cb2f945a4a87ae8419724e369e3b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:04.322152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83818e4e-6722-4348-a3e3-a8f10da0e0f1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:04.452311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9c65f-9267-4fea-90cc-a4d3666dfb9b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:04.453708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83818e4e-6722-4348-a3e3-a8f10da0e0f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c26cb2f945a4a87ae8419724e369e3b', 'request_id': 'req-83818e4e-6722-4348-a3e3-a8f10da0e0f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:04.469388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83818e4e-6722-4348-a3e3-a8f10da0e0f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c26cb2f945a4a87ae8419724e369e3b', 'request_id': 'req-83818e4e-6722-4348-a3e3-a8f10da0e0f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:04.482619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83818e4e-6722-4348-a3e3-a8f10da0e0f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c26cb2f945a4a87ae8419724e369e3b', 'request_id': 'req-83818e4e-6722-4348-a3e3-a8f10da0e0f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:04.517337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83818e4e-6722-4348-a3e3-a8f10da0e0f1 admin admin] The token cache is being invalidate because project 6c26cb2f945a4a87ae8419724e369e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:04.517889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83818e4e-6722-4348-a3e3-a8f10da0e0f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:04.521455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83818e4e-6722-4348-a3e3-a8f10da0e0f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:04.530788 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3570/7137] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:04 2022] DELETE /identity/v3/projects/6c26cb2f945a4a87ae8419724e369e3b => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:04.536993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7f551-623e-452f-ba27-35ec2c524663 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:04.537352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7f551-623e-452f-ba27-35ec2c524663 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:04.546016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7f551-623e-452f-ba27-35ec2c524663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:04.597199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5fe7f551-623e-452f-ba27-35ec2c524663 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:04.600500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5fe7f551-623e-452f-ba27-35ec2c524663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:04.615697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46f841-1df8-471a-85cf-bc5a149f1ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:04.616332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46f841-1df8-471a-85cf-bc5a149f1ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:04.616601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46f841-1df8-471a-85cf-bc5a149f1ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:04.616867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46f841-1df8-471a-85cf-bc5a149f1ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:04.620013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3f46f841-1df8-471a-85cf-bc5a149f1ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:04.747117 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3571/7138] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:04.748394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7f551-623e-452f-ba27-35ec2c524663 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:04.750703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5fe7f551-623e-452f-ba27-35ec2c524663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:04.768247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7f551-623e-452f-ba27-35ec2c524663 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:04.771179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46f841-1df8-471a-85cf-bc5a149f1ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:04.773425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46f841-1df8-471a-85cf-bc5a149f1ec3 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:04.773868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321654d1-08ca-4020-9fd1-7689194bd031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:04.774626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321654d1-08ca-4020-9fd1-7689194bd031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:04.775009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321654d1-08ca-4020-9fd1-7689194bd031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:04.775431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321654d1-08ca-4020-9fd1-7689194bd031 admin admin] PATH_INFO: `/v3/users/e4174dc03acf4104a1dc90ec7ecab84d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:04.776704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321654d1-08ca-4020-9fd1-7689194bd031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4174dc03acf4104a1dc90ec7ecab84d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:04.779372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321654d1-08ca-4020-9fd1-7689194bd031 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:04.795358 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3568/7139] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:51:04.796677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577597b-1c56-4a23-90cd-dc60c6bc1cf3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:04.798980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577597b-1c56-4a23-90cd-dc60c6bc1cf3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:04.800170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577597b-1c56-4a23-90cd-dc60c6bc1cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:04.815401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:04.874435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d577597b-1c56-4a23-90cd-dc60c6bc1cf3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:04.876007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d577597b-1c56-4a23-90cd-dc60c6bc1cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:04.901616 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3569/7140] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:04.902547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-321654d1-08ca-4020-9fd1-7689194bd031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4174dc03acf4104a1dc90ec7ecab84d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:04.903228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-321654d1-08ca-4020-9fd1-7689194bd031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4174dc03acf4104a1dc90ec7ecab84d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:04.905792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577597b-1c56-4a23-90cd-dc60c6bc1cf3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:04.932577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-321654d1-08ca-4020-9fd1-7689194bd031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4174dc03acf4104a1dc90ec7ecab84d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:04.942193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577597b-1c56-4a23-90cd-dc60c6bc1cf3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:04.956704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-321654d1-08ca-4020-9fd1-7689194bd031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4174dc03acf4104a1dc90ec7ecab84d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:04.962599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b191d-9999-4c0c-9f84-7c8856fb3eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:04.971691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b191d-9999-4c0c-9f84-7c8856fb3eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:04.972011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b191d-9999-4c0c-9f84-7c8856fb3eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:04.972294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b191d-9999-4c0c-9f84-7c8856fb3eb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:04.973081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b191d-9999-4c0c-9f84-7c8856fb3eb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:04.974779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b191d-9999-4c0c-9f84-7c8856fb3eb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:04.975215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b191d-9999-4c0c-9f84-7c8856fb3eb3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:04.995748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-321654d1-08ca-4020-9fd1-7689194bd031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4174dc03acf4104a1dc90ec7ecab84d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:05.011586 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3572/7141] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:04 2022] DELETE /identity/v3/users/e4174dc03acf4104a1dc90ec7ecab84d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:05.013822 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3570/7142] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:05.018523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12179b-33d6-486c-8e25-b144094ca0e9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:05.018881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12179b-33d6-486c-8e25-b144094ca0e9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:05.019158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12179b-33d6-486c-8e25-b144094ca0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:05.023147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b191d-9999-4c0c-9f84-7c8856fb3eb3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:05.025981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0f0b191d-9999-4c0c-9f84-7c8856fb3eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:05.060624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b191d-9999-4c0c-9f84-7c8856fb3eb3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:05.111003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ce12179b-33d6-486c-8e25-b144094ca0e9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:05.112273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce12179b-33d6-486c-8e25-b144094ca0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:05.257102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919ceb1-d4ac-43ff-a6c3-588e5fc44a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:05.259182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919ceb1-d4ac-43ff-a6c3-588e5fc44a81 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:05.260833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919ceb1-d4ac-43ff-a6c3-588e5fc44a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:05.261405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919ceb1-d4ac-43ff-a6c3-588e5fc44a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:05.263303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919ceb1-d4ac-43ff-a6c3-588e5fc44a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:05.271506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919ceb1-d4ac-43ff-a6c3-588e5fc44a81 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:05.286569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:05.321283 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3573/7143] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:05.332213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12179b-33d6-486c-8e25-b144094ca0e9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:05.333618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce12179b-33d6-486c-8e25-b144094ca0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:05.344130 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3571/7144] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:05 2022] POST /identity/v3/projects => generated 367 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:05.348345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919ceb1-d4ac-43ff-a6c3-588e5fc44a81 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:05.486368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12179b-33d6-486c-8e25-b144094ca0e9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:05.552810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919ceb1-d4ac-43ff-a6c3-588e5fc44a81 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:05.572894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588ab8e-f641-41e6-b572-04027a100d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:05.573916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588ab8e-f641-41e6-b572-04027a100d73 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:05.574206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588ab8e-f641-41e6-b572-04027a100d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:05.574542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588ab8e-f641-41e6-b572-04027a100d73 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:05.588118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588ab8e-f641-41e6-b572-04027a100d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:05.592641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588ab8e-f641-41e6-b572-04027a100d73 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:05.632259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:05.650140 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3572/7145] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:05 2022] POST /identity/v3/users => generated 284 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:05.651378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11589b-6637-4421-8e5f-78b5e8834fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:05.651791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588ab8e-f641-41e6-b572-04027a100d73 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:05.652835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11589b-6637-4421-8e5f-78b5e8834fcb service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:05.655444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11589b-6637-4421-8e5f-78b5e8834fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:05.656886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11589b-6637-4421-8e5f-78b5e8834fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:05.675310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588ab8e-f641-41e6-b572-04027a100d73 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:05.686258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691da26c-da0e-4206-91e6-af45288f1508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:05.688831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691da26c-da0e-4206-91e6-af45288f1508 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:05.689185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691da26c-da0e-4206-91e6-af45288f1508 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:05.690002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691da26c-da0e-4206-91e6-af45288f1508 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:05.690754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691da26c-da0e-4206-91e6-af45288f1508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:05.695896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691da26c-da0e-4206-91e6-af45288f1508 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:05.703413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11589b-6637-4421-8e5f-78b5e8834fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:05.707405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11589b-6637-4421-8e5f-78b5e8834fcb service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:05.731629 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3573/7146] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:05.732832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691da26c-da0e-4206-91e6-af45288f1508 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:05.757287 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3574/7147] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:51:05.768975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691da26c-da0e-4206-91e6-af45288f1508 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:05.784556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1eb41b-1a61-4283-94bb-51fdbba2320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:05.785230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1eb41b-1a61-4283-94bb-51fdbba2320e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:05.785424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1eb41b-1a61-4283-94bb-51fdbba2320e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:05.786515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1eb41b-1a61-4283-94bb-51fdbba2320e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:05.787681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1eb41b-1a61-4283-94bb-51fdbba2320e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:05.789639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1eb41b-1a61-4283-94bb-51fdbba2320e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:05.823175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11589b-6637-4421-8e5f-78b5e8834fcb service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:05.833952 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3574/7148] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:05.840560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11589b-6637-4421-8e5f-78b5e8834fcb service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:05.866670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc89e7-0cf4-4829-86c0-da7bd0c65b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:05.867439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc89e7-0cf4-4829-86c0-da7bd0c65b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:05.867722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc89e7-0cf4-4829-86c0-da7bd0c65b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:05.867994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc89e7-0cf4-4829-86c0-da7bd0c65b0e admin admin] PATH_INFO: `/v3/projects/f8b34eecdbb84edca129c329ffe377ca/users/9ba31c23a33f499d9c612e2efd99a35d/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:05.930985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc89e7-0cf4-4829-86c0-da7bd0c65b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b34eecdbb84edca129c329ffe377ca, user_id=9ba31c23a33f499d9c612e2efd99a35d, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:05.944080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc89e7-0cf4-4829-86c0-da7bd0c65b0e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:05.978961 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3575/7149] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:05 2022] PUT /identity/v3/projects/f8b34eecdbb84edca129c329ffe377ca/users/9ba31c23a33f499d9c612e2efd99a35d/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:51:05.990386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86002e-55bc-4b46-9395-4a474b32bc86 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:05.990386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86002e-55bc-4b46-9395-4a474b32bc86 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:05.990745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86002e-55bc-4b46-9395-4a474b32bc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:06.100298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3e86002e-55bc-4b46-9395-4a474b32bc86 None None] MFA Rules not processed for user `9ba31c23a33f499d9c612e2efd99a35d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:06.101553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3e86002e-55bc-4b46-9395-4a474b32bc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:06.277694 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3575/7150] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:06.282052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc89e7-0cf4-4829-86c0-da7bd0c65b0e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:06.510386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc89e7-0cf4-4829-86c0-da7bd0c65b0e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:06.536417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de3e7d-713b-4b04-b617-fa40781189e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:06.538265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de3e7d-713b-4b04-b617-fa40781189e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:06.538714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de3e7d-713b-4b04-b617-fa40781189e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:06.539151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de3e7d-713b-4b04-b617-fa40781189e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:06.540006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de3e7d-713b-4b04-b617-fa40781189e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:06.542117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de3e7d-713b-4b04-b617-fa40781189e5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:06.664362 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3576/7151] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:06 2022] POST /identity/v3/projects => generated 369 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:06.668180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86002e-55bc-4b46-9395-4a474b32bc86 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:06.695053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86002e-55bc-4b46-9395-4a474b32bc86 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:06.716257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de3e7d-713b-4b04-b617-fa40781189e5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:06.718590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-75de3e7d-713b-4b04-b617-fa40781189e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:06.975594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:07.022182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce0810-5558-4bc9-bc4c-3f3152b22aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:07.023815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce0810-5558-4bc9-bc4c-3f3152b22aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:07.025044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce0810-5558-4bc9-bc4c-3f3152b22aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:07.027013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce0810-5558-4bc9-bc4c-3f3152b22aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:07.028754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce0810-5558-4bc9-bc4c-3f3152b22aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:07.031902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce0810-5558-4bc9-bc4c-3f3152b22aa1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:07.036635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de3e7d-713b-4b04-b617-fa40781189e5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:07.052980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9c6ef-7326-490e-bdc8-016f825e13de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:07.053396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9c6ef-7326-490e-bdc8-016f825e13de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:07.053675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9c6ef-7326-490e-bdc8-016f825e13de admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:07.054163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9c6ef-7326-490e-bdc8-016f825e13de admin admin] PATH_INFO: `/v3/projects/a02e0332f1d14bdd83d38479da2d0e1f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:07.066527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9c6ef-7326-490e-bdc8-016f825e13de admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02e0332f1d14bdd83d38479da2d0e1f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:07.071749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9c6ef-7326-490e-bdc8-016f825e13de admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:07.092929 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3576/7152] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:06 2022] POST /identity/v3/users => generated 285 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:07.094311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce0810-5558-4bc9-bc4c-3f3152b22aa1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:07.115136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce0810-5558-4bc9-bc4c-3f3152b22aa1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:07.128858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ae036-914e-4fc3-8998-f8b956e93eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:07.129388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ae036-914e-4fc3-8998-f8b956e93eec admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:07.129840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ae036-914e-4fc3-8998-f8b956e93eec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:07.130099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ae036-914e-4fc3-8998-f8b956e93eec admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:07.130915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ae036-914e-4fc3-8998-f8b956e93eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:07.135144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ae036-914e-4fc3-8998-f8b956e93eec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:07.165164 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3577/7153] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:07.166672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ae036-914e-4fc3-8998-f8b956e93eec admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:07.190232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ae036-914e-4fc3-8998-f8b956e93eec admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:07.206166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c8172-45c0-45cc-ad7c-9ba73acf4711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:07.206842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c8172-45c0-45cc-ad7c-9ba73acf4711 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:07.207280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c8172-45c0-45cc-ad7c-9ba73acf4711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:07.207551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c8172-45c0-45cc-ad7c-9ba73acf4711 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:07.208202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c8172-45c0-45cc-ad7c-9ba73acf4711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:07.211911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c8172-45c0-45cc-ad7c-9ba73acf4711 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:07.239438 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3578/7154] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:51:07.243593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c8172-45c0-45cc-ad7c-9ba73acf4711 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:07.243878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7c9c6ef-7326-490e-bdc8-016f825e13de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02e0332f1d14bdd83d38479da2d0e1f', 'request_id': 'req-d7c9c6ef-7326-490e-bdc8-016f825e13de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:07.248234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:07.266684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c8172-45c0-45cc-ad7c-9ba73acf4711 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:07.268774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7c9c6ef-7326-490e-bdc8-016f825e13de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02e0332f1d14bdd83d38479da2d0e1f', 'request_id': 'req-d7c9c6ef-7326-490e-bdc8-016f825e13de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:07.279284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7c9c6ef-7326-490e-bdc8-016f825e13de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02e0332f1d14bdd83d38479da2d0e1f', 'request_id': 'req-d7c9c6ef-7326-490e-bdc8-016f825e13de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:07.320602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7c9c6ef-7326-490e-bdc8-016f825e13de admin admin] The token cache is being invalidate because project a02e0332f1d14bdd83d38479da2d0e1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:07.320898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7c9c6ef-7326-490e-bdc8-016f825e13de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:07.323270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7c9c6ef-7326-490e-bdc8-016f825e13de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:07.327058 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3577/7155] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:06 2022] DELETE /identity/v3/projects/a02e0332f1d14bdd83d38479da2d0e1f => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:07.330915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9c6ef-7326-490e-bdc8-016f825e13de admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:07.344238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d7c9c6ef-7326-490e-bdc8-016f825e13de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:07.437161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4c052-ef64-49e9-a3a0-4c681458bc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:07.438231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4c052-ef64-49e9-a3a0-4c681458bc19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:07.438513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4c052-ef64-49e9-a3a0-4c681458bc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:07.438788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4c052-ef64-49e9-a3a0-4c681458bc19 admin admin] PATH_INFO: `/v3/projects/f1a1ac0ce70a4954aacc18aafe9791b5/users/2b4aa1f7c48345348c6e2f659e8f56bc/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:07.480146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4c052-ef64-49e9-a3a0-4c681458bc19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a1ac0ce70a4954aacc18aafe9791b5, user_id=2b4aa1f7c48345348c6e2f659e8f56bc, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:07.496332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4c052-ef64-49e9-a3a0-4c681458bc19 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:07.547327 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3579/7156] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:07 2022] PUT /identity/v3/projects/f1a1ac0ce70a4954aacc18aafe9791b5/users/2b4aa1f7c48345348c6e2f659e8f56bc/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:07.547327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4c052-ef64-49e9-a3a0-4c681458bc19 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:07.548300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9c6ef-7326-490e-bdc8-016f825e13de admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:07.552409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b9a4c052-ef64-49e9-a3a0-4c681458bc19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:07.768103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94de6bb-6b99-4163-b2f0-ed89151c20f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:07.769005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94de6bb-6b99-4163-b2f0-ed89151c20f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:07.769285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94de6bb-6b99-4163-b2f0-ed89151c20f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:07.769564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94de6bb-6b99-4163-b2f0-ed89151c20f9 admin admin] PATH_INFO: `/v3/projects/522cd45abff741c6905d495a810a836c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:07.774183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94de6bb-6b99-4163-b2f0-ed89151c20f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=522cd45abff741c6905d495a810a836c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:07.777176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94de6bb-6b99-4163-b2f0-ed89151c20f9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:07.814095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4c052-ef64-49e9-a3a0-4c681458bc19 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:07.838590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0b143-a266-4faf-a5e0-9134c26fa427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:07.839276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0b143-a266-4faf-a5e0-9134c26fa427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:07.839555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0b143-a266-4faf-a5e0-9134c26fa427 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:07.839833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0b143-a266-4faf-a5e0-9134c26fa427 admin admin] PATH_INFO: `/v3/users/510505cecc1b4a18b44ab43869898e6c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:07.846447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0b143-a266-4faf-a5e0-9134c26fa427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=510505cecc1b4a18b44ab43869898e6c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:07.848831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0b143-a266-4faf-a5e0-9134c26fa427 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:07.962008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:08.002738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b94de6bb-6b99-4163-b2f0-ed89151c20f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522cd45abff741c6905d495a810a836c', 'request_id': 'req-b94de6bb-6b99-4163-b2f0-ed89151c20f9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:08.012448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f9c0b143-a266-4faf-a5e0-9134c26fa427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '510505cecc1b4a18b44ab43869898e6c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:08.036141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b94de6bb-6b99-4163-b2f0-ed89151c20f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522cd45abff741c6905d495a810a836c', 'request_id': 'req-b94de6bb-6b99-4163-b2f0-ed89151c20f9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:08.045098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b94de6bb-6b99-4163-b2f0-ed89151c20f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522cd45abff741c6905d495a810a836c', 'request_id': 'req-b94de6bb-6b99-4163-b2f0-ed89151c20f9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:08.055560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f9c0b143-a266-4faf-a5e0-9134c26fa427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '510505cecc1b4a18b44ab43869898e6c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:08.059320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f9c0b143-a266-4faf-a5e0-9134c26fa427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '510505cecc1b4a18b44ab43869898e6c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:08.060090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b94de6bb-6b99-4163-b2f0-ed89151c20f9 admin admin] The token cache is being invalidate because project 522cd45abff741c6905d495a810a836c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:08.060492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b94de6bb-6b99-4163-b2f0-ed89151c20f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:08.061156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b94de6bb-6b99-4163-b2f0-ed89151c20f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:08.063378 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3578/7157] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:07 2022] DELETE /identity/v3/projects/522cd45abff741c6905d495a810a836c => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:08.063680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f9c0b143-a266-4faf-a5e0-9134c26fa427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '510505cecc1b4a18b44ab43869898e6c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:08.065210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ad15f-0745-48df-89b8-e4f829fc275b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:08.065502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ad15f-0745-48df-89b8-e4f829fc275b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:08.066138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ad15f-0745-48df-89b8-e4f829fc275b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:08.095017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f9c0b143-a266-4faf-a5e0-9134c26fa427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '510505cecc1b4a18b44ab43869898e6c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:08.124539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-787ad15f-0745-48df-89b8-e4f829fc275b None None] MFA Rules not processed for user `2b4aa1f7c48345348c6e2f659e8f56bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:08.126068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-787ad15f-0745-48df-89b8-e4f829fc275b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:08.138802 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3580/7158] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:07 2022] DELETE /identity/v3/users/510505cecc1b4a18b44ab43869898e6c => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:08.142220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:08.147405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0b4ae-991c-4419-b795-06bc679144fb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:08.147710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0b4ae-991c-4419-b795-06bc679144fb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:08.148156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0b4ae-991c-4419-b795-06bc679144fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:08.209955 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3579/7159] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:08.211326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a7e0b4ae-991c-4419-b795-06bc679144fb None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:08.221671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a7e0b4ae-991c-4419-b795-06bc679144fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:08.223395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ad15f-0745-48df-89b8-e4f829fc275b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:08.224996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-787ad15f-0745-48df-89b8-e4f829fc275b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:08.375701 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3581/7160] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:08.398684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25c04f-92a8-47f5-bd95-f5f3f7f9c982 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:08.399458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25c04f-92a8-47f5-bd95-f5f3f7f9c982 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:08.399887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25c04f-92a8-47f5-bd95-f5f3f7f9c982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:08.421794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ad15f-0745-48df-89b8-e4f829fc275b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:08.444970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7d25c04f-92a8-47f5-bd95-f5f3f7f9c982 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:08.446307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7d25c04f-92a8-47f5-bd95-f5f3f7f9c982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:08.489003 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3582/7161] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:08.490237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25c04f-92a8-47f5-bd95-f5f3f7f9c982 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:08.523211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25c04f-92a8-47f5-bd95-f5f3f7f9c982 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:08.540613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb014a7-a1cb-45e1-a43d-9a5a76692c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:08.541238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb014a7-a1cb-45e1-a43d-9a5a76692c29 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:08.541519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb014a7-a1cb-45e1-a43d-9a5a76692c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:08.541782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb014a7-a1cb-45e1-a43d-9a5a76692c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:08.542442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb014a7-a1cb-45e1-a43d-9a5a76692c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:08.542742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb014a7-a1cb-45e1-a43d-9a5a76692c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:08.569512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb014a7-a1cb-45e1-a43d-9a5a76692c29 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:08.605738 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3583/7162] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:51:08.609609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb014a7-a1cb-45e1-a43d-9a5a76692c29 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:08.617417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46f569-ba8c-4e90-bae6-f8dedbe2937e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:08.623227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46f569-ba8c-4e90-bae6-f8dedbe2937e service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:08.623873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46f569-ba8c-4e90-bae6-f8dedbe2937e service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:08.624256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46f569-ba8c-4e90-bae6-f8dedbe2937e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:08.632244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f46f569-ba8c-4e90-bae6-f8dedbe2937e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:08.649871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb014a7-a1cb-45e1-a43d-9a5a76692c29 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:08.670854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5fc5d-9994-4461-a9fd-1f53949229d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:08.671664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5fc5d-9994-4461-a9fd-1f53949229d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:08.672032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5fc5d-9994-4461-a9fd-1f53949229d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:08.672681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5fc5d-9994-4461-a9fd-1f53949229d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:08.673494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5fc5d-9994-4461-a9fd-1f53949229d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:08.676103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5fc5d-9994-4461-a9fd-1f53949229d9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:08.741850 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3584/7163] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:08 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:08.744909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5fc5d-9994-4461-a9fd-1f53949229d9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:08.890102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46f569-ba8c-4e90-bae6-f8dedbe2937e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:08.893447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46f569-ba8c-4e90-bae6-f8dedbe2937e service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:08.930914 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3580/7164] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:08.931993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46f569-ba8c-4e90-bae6-f8dedbe2937e service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:08.934717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f46f569-ba8c-4e90-bae6-f8dedbe2937e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:08.975518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46f569-ba8c-4e90-bae6-f8dedbe2937e service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:08.984352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5fc5d-9994-4461-a9fd-1f53949229d9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:08.987497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a80f6-f686-4d6d-abb8-7d7a172e991a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:08.988245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a80f6-f686-4d6d-abb8-7d7a172e991a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:08.988584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a80f6-f686-4d6d-abb8-7d7a172e991a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:08.989085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a80f6-f686-4d6d-abb8-7d7a172e991a admin admin] PATH_INFO: `/v3/projects/3bfb314555414c899514cf0310f966d5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:08.992372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a80f6-f686-4d6d-abb8-7d7a172e991a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bfb314555414c899514cf0310f966d5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:08.996941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fe0c4-e380-487a-9f7e-721d15a26a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:08.997254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a80f6-f686-4d6d-abb8-7d7a172e991a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:09.000365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fe0c4-e380-487a-9f7e-721d15a26a2b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:09.000712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fe0c4-e380-487a-9f7e-721d15a26a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:09.001053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fe0c4-e380-487a-9f7e-721d15a26a2b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:09.003030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fe0c4-e380-487a-9f7e-721d15a26a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:09.005538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fe0c4-e380-487a-9f7e-721d15a26a2b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:09.066370 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3585/7165] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:08 2022] POST /identity/v3/users => generated 287 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:09.067583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fe0c4-e380-487a-9f7e-721d15a26a2b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:09.075423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:09.090997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:09.109553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fe0c4-e380-487a-9f7e-721d15a26a2b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:09.140671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f34a80f6-f686-4d6d-abb8-7d7a172e991a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bfb314555414c899514cf0310f966d5', 'request_id': 'req-f34a80f6-f686-4d6d-abb8-7d7a172e991a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:09.163628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f34a80f6-f686-4d6d-abb8-7d7a172e991a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bfb314555414c899514cf0310f966d5', 'request_id': 'req-f34a80f6-f686-4d6d-abb8-7d7a172e991a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:09.174086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f34a80f6-f686-4d6d-abb8-7d7a172e991a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bfb314555414c899514cf0310f966d5', 'request_id': 'req-f34a80f6-f686-4d6d-abb8-7d7a172e991a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:09.203754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f34a80f6-f686-4d6d-abb8-7d7a172e991a admin admin] The token cache is being invalidate because project 3bfb314555414c899514cf0310f966d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:09.204147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f34a80f6-f686-4d6d-abb8-7d7a172e991a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:09.207734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f34a80f6-f686-4d6d-abb8-7d7a172e991a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:09.214328 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3581/7166] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:08 2022] DELETE /identity/v3/projects/3bfb314555414c899514cf0310f966d5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:09.217209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af86c-f662-4b35-810e-e9b86ffbe9d7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:09.219477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af86c-f662-4b35-810e-e9b86ffbe9d7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:09.219768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af86c-f662-4b35-810e-e9b86ffbe9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:09.273901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435f961-bf73-4658-b181-7801462ca44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:09.274882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435f961-bf73-4658-b181-7801462ca44d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:09.276304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435f961-bf73-4658-b181-7801462ca44d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:09.277047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-194af86c-f662-4b35-810e-e9b86ffbe9d7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:09.277264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435f961-bf73-4658-b181-7801462ca44d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:09.278978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435f961-bf73-4658-b181-7801462ca44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:09.280180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-194af86c-f662-4b35-810e-e9b86ffbe9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:09.282813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435f961-bf73-4658-b181-7801462ca44d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:09.309744 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3582/7167] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:09.311479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af86c-f662-4b35-810e-e9b86ffbe9d7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:09.314700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-194af86c-f662-4b35-810e-e9b86ffbe9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:09.318220 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3586/7168] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:09.319783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e904413-1999-42d6-a3e7-df3983d21dde None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:09.320068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e904413-1999-42d6-a3e7-df3983d21dde None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:09.320343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e904413-1999-42d6-a3e7-df3983d21dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:09.349397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af86c-f662-4b35-810e-e9b86ffbe9d7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:09.364101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b8eac-f9fb-4d26-8331-a394dd3465c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:09.366493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b8eac-f9fb-4d26-8331-a394dd3465c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:09.366775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b8eac-f9fb-4d26-8331-a394dd3465c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:09.368007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b8eac-f9fb-4d26-8331-a394dd3465c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:09.370436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b8eac-f9fb-4d26-8331-a394dd3465c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:09.375720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b8eac-f9fb-4d26-8331-a394dd3465c3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:09.377692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4e904413-1999-42d6-a3e7-df3983d21dde None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:09.381166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4e904413-1999-42d6-a3e7-df3983d21dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:09.407553 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3587/7169] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:09.408434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e904413-1999-42d6-a3e7-df3983d21dde None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:09.412269 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3583/7170] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:09.414115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b8eac-f9fb-4d26-8331-a394dd3465c3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:09.415681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4e904413-1999-42d6-a3e7-df3983d21dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:09.438234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b8eac-f9fb-4d26-8331-a394dd3465c3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:09.450447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab947b0-7e98-4b2e-a59d-dba6581dcc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:09.451096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab947b0-7e98-4b2e-a59d-dba6581dcc71 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:09.451409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab947b0-7e98-4b2e-a59d-dba6581dcc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:09.451683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab947b0-7e98-4b2e-a59d-dba6581dcc71 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:09.452348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab947b0-7e98-4b2e-a59d-dba6581dcc71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:09.452650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab947b0-7e98-4b2e-a59d-dba6581dcc71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:09.454318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab947b0-7e98-4b2e-a59d-dba6581dcc71 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:09.499865 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3584/7171] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:09.499865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab947b0-7e98-4b2e-a59d-dba6581dcc71 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:09.523835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab947b0-7e98-4b2e-a59d-dba6581dcc71 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:09.535717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466588cb-1544-4d1e-9eaa-6d92cbbef3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:09.537332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466588cb-1544-4d1e-9eaa-6d92cbbef3aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:09.537613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466588cb-1544-4d1e-9eaa-6d92cbbef3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:09.537886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466588cb-1544-4d1e-9eaa-6d92cbbef3aa admin admin] PATH_INFO: `/v3/projects/8f460d1b626b4110b9d1ffa00a11bf05/users/ebff2470ee1b4d3d91dd6cc3ec889658/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:09.563684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e904413-1999-42d6-a3e7-df3983d21dde None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:09.569977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c372b-6a4d-426a-be61-a56c56c9792d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:09.571522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c372b-6a4d-426a-be61-a56c56c9792d service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:09.571725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c372b-6a4d-426a-be61-a56c56c9792d service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:09.571979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c372b-6a4d-426a-be61-a56c56c9792d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:09.577571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466588cb-1544-4d1e-9eaa-6d92cbbef3aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f460d1b626b4110b9d1ffa00a11bf05, user_id=ebff2470ee1b4d3d91dd6cc3ec889658, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:09.578325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b26c372b-6a4d-426a-be61-a56c56c9792d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:09.584616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466588cb-1544-4d1e-9eaa-6d92cbbef3aa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:09.628844 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3585/7172] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:09 2022] PUT /identity/v3/projects/8f460d1b626b4110b9d1ffa00a11bf05/users/ebff2470ee1b4d3d91dd6cc3ec889658/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:09.631378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466588cb-1544-4d1e-9eaa-6d92cbbef3aa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:09.747613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c372b-6a4d-426a-be61-a56c56c9792d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:09.749363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c372b-6a4d-426a-be61-a56c56c9792d service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:09.779623 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3588/7173] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:09.790117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeefdd-8e0d-4878-96e5-1aef63b5a121 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:09.790117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeefdd-8e0d-4878-96e5-1aef63b5a121 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:09.790117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeefdd-8e0d-4878-96e5-1aef63b5a121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:09.817287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466588cb-1544-4d1e-9eaa-6d92cbbef3aa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:09.840620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48e438-9a45-4197-844c-8ad3218f2efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:09.842466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48e438-9a45-4197-844c-8ad3218f2efd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:09.842746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48e438-9a45-4197-844c-8ad3218f2efd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:09.843020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48e438-9a45-4197-844c-8ad3218f2efd admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:09.843725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48e438-9a45-4197-844c-8ad3218f2efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:09.858750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48e438-9a45-4197-844c-8ad3218f2efd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:09.900875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0baeefdd-8e0d-4878-96e5-1aef63b5a121 None None] MFA Rules not processed for user `ebff2470ee1b4d3d91dd6cc3ec889658`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:09.902241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0baeefdd-8e0d-4878-96e5-1aef63b5a121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:09.959829 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3586/7174] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:09 2022] POST /identity/v3/projects => generated 367 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:09.960986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48e438-9a45-4197-844c-8ad3218f2efd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:10.046251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:10.096422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:10.171109 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3589/7175] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:10.173400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baeefdd-8e0d-4878-96e5-1aef63b5a121 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:10.198981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48e438-9a45-4197-844c-8ad3218f2efd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:10.202122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baeefdd-8e0d-4878-96e5-1aef63b5a121 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:10.208231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530703b4-37eb-417c-a413-5c80094b7fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:10.208477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530703b4-37eb-417c-a413-5c80094b7fee admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:10.208576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530703b4-37eb-417c-a413-5c80094b7fee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:10.209491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530703b4-37eb-417c-a413-5c80094b7fee admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:10.210620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530703b4-37eb-417c-a413-5c80094b7fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:10.213304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530703b4-37eb-417c-a413-5c80094b7fee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:10.217596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80eeac-f543-40fa-ac7d-c650b751b8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:10.218232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80eeac-f543-40fa-ac7d-c650b751b8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:10.218570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80eeac-f543-40fa-ac7d-c650b751b8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:10.218843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80eeac-f543-40fa-ac7d-c650b751b8f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:10.219514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80eeac-f543-40fa-ac7d-c650b751b8f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:10.229292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80eeac-f543-40fa-ac7d-c650b751b8f3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:10.261201 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3587/7176] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:09 2022] POST /identity/v3/users => generated 284 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:10.264997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530703b4-37eb-417c-a413-5c80094b7fee admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:10.306114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530703b4-37eb-417c-a413-5c80094b7fee admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:10.317320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8304e3-cf4b-45ed-8f5d-544f406ae2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:10.323079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8304e3-cf4b-45ed-8f5d-544f406ae2cb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:10.323525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8304e3-cf4b-45ed-8f5d-544f406ae2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:10.323875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8304e3-cf4b-45ed-8f5d-544f406ae2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:10.325145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8304e3-cf4b-45ed-8f5d-544f406ae2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:10.331516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8304e3-cf4b-45ed-8f5d-544f406ae2cb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:10.343307 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3590/7177] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:10 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:10.352786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80eeac-f543-40fa-ac7d-c650b751b8f3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:10.369635 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3588/7178] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:10.373847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8304e3-cf4b-45ed-8f5d-544f406ae2cb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:10.434040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8304e3-cf4b-45ed-8f5d-544f406ae2cb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:10.594323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80eeac-f543-40fa-ac7d-c650b751b8f3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:10.620692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5ee53-e0fc-428d-ab92-9ed5405cb697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:10.621247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5ee53-e0fc-428d-ab92-9ed5405cb697 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:10.621525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5ee53-e0fc-428d-ab92-9ed5405cb697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:10.621793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5ee53-e0fc-428d-ab92-9ed5405cb697 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:10.622435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5ee53-e0fc-428d-ab92-9ed5405cb697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:10.624434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5ee53-e0fc-428d-ab92-9ed5405cb697 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:10.692069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957a660-d898-45a8-a950-9d4f257b6f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:10.692721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957a660-d898-45a8-a950-9d4f257b6f18 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:10.692955 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3591/7179] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:10 2022] POST /identity/v3/users => generated 288 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:10.695177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957a660-d898-45a8-a950-9d4f257b6f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:10.695525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957a660-d898-45a8-a950-9d4f257b6f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:10.696215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957a660-d898-45a8-a950-9d4f257b6f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:10.697884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957a660-d898-45a8-a950-9d4f257b6f18 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:10.701305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5ee53-e0fc-428d-ab92-9ed5405cb697 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:10.742796 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3589/7180] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:10.747280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957a660-d898-45a8-a950-9d4f257b6f18 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:10.752738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5ee53-e0fc-428d-ab92-9ed5405cb697 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:10.771388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d8da5-4082-4222-9cba-e24056e636da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:10.771982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957a660-d898-45a8-a950-9d4f257b6f18 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:10.772555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d8da5-4082-4222-9cba-e24056e636da admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:10.773392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d8da5-4082-4222-9cba-e24056e636da admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:10.773832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d8da5-4082-4222-9cba-e24056e636da admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:10.774706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d8da5-4082-4222-9cba-e24056e636da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:10.777043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d8da5-4082-4222-9cba-e24056e636da admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:10.785535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d3f41-ee88-4b34-bb94-2400026e6af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:10.786885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d3f41-ee88-4b34-bb94-2400026e6af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:10.788070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d3f41-ee88-4b34-bb94-2400026e6af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:10.788586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d3f41-ee88-4b34-bb94-2400026e6af2 admin admin] PATH_INFO: `/v3/projects/6ac7a291dac04743bbc4113d4d554c86/users/b7f0352a153343258d654d2ae7a43ea8/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:10.792166 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3592/7181] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:10.797099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d8da5-4082-4222-9cba-e24056e636da admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:10.844578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d8da5-4082-4222-9cba-e24056e636da admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:10.858788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d3f41-ee88-4b34-bb94-2400026e6af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac7a291dac04743bbc4113d4d554c86, user_id=b7f0352a153343258d654d2ae7a43ea8, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:10.862207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d3f41-ee88-4b34-bb94-2400026e6af2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:10.870070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244efbf1-1de2-4f21-b7df-375b833977c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:10.872687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244efbf1-1de2-4f21-b7df-375b833977c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:10.873906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244efbf1-1de2-4f21-b7df-375b833977c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:10.876616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244efbf1-1de2-4f21-b7df-375b833977c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:10.879365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244efbf1-1de2-4f21-b7df-375b833977c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:10.887573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244efbf1-1de2-4f21-b7df-375b833977c2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:10.904923 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3590/7182] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:10 2022] PUT /identity/v3/projects/6ac7a291dac04743bbc4113d4d554c86/users/b7f0352a153343258d654d2ae7a43ea8/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:10.924962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e057a2-a091-42ed-a81f-97a5140b12ca None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:10.926515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e057a2-a091-42ed-a81f-97a5140b12ca None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:10.927010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e057a2-a091-42ed-a81f-97a5140b12ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:10.941364 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3593/7183] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:10.947896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244efbf1-1de2-4f21-b7df-375b833977c2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:11.002576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244efbf1-1de2-4f21-b7df-375b833977c2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:11.066242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b2e057a2-a091-42ed-a81f-97a5140b12ca None None] MFA Rules not processed for user `b7f0352a153343258d654d2ae7a43ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:11.070265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b2e057a2-a091-42ed-a81f-97a5140b12ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:11.217545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fbf3e-79ae-45f6-bb90-e374dd5caee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:11.218237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fbf3e-79ae-45f6-bb90-e374dd5caee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:11.218579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fbf3e-79ae-45f6-bb90-e374dd5caee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:11.218904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fbf3e-79ae-45f6-bb90-e374dd5caee8 admin admin] PATH_INFO: `/v3/projects/ac8348dfe0874d89b1772c224e0b4e0d/users/37e9ce20837d480ab6ed33c658d97c62/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:11.260479 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3591/7184] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:11.277563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e057a2-a091-42ed-a81f-97a5140b12ca None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:11.282620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fbf3e-79ae-45f6-bb90-e374dd5caee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8348dfe0874d89b1772c224e0b4e0d, user_id=37e9ce20837d480ab6ed33c658d97c62, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:11.285560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fbf3e-79ae-45f6-bb90-e374dd5caee8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:11.312432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e057a2-a091-42ed-a81f-97a5140b12ca None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:11.334909 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3594/7185] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:10 2022] PUT /identity/v3/projects/ac8348dfe0874d89b1772c224e0b4e0d/users/37e9ce20837d480ab6ed33c658d97c62/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:11.336838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57e99a-7bc5-4e91-abb9-8b071e1de081 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:11.337129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57e99a-7bc5-4e91-abb9-8b071e1de081 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:11.341626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57e99a-7bc5-4e91-abb9-8b071e1de081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:11.356706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:11.364606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:11.434353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0f57e99a-7bc5-4e91-abb9-8b071e1de081 None None] MFA Rules not processed for user `37e9ce20837d480ab6ed33c658d97c62`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:11.436130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0f57e99a-7bc5-4e91-abb9-8b071e1de081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:11.581837 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3595/7186] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:11.591869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57e99a-7bc5-4e91-abb9-8b071e1de081 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:11.598614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0f57e99a-7bc5-4e91-abb9-8b071e1de081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:11.658788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730d330-58ab-4c38-bfd3-07f420eda778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:11.659610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d330-58ab-4c38-bfd3-07f420eda778 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:11.659902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d330-58ab-4c38-bfd3-07f420eda778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:11.660186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d330-58ab-4c38-bfd3-07f420eda778 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:11.660855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730d330-58ab-4c38-bfd3-07f420eda778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:11.665996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730d330-58ab-4c38-bfd3-07f420eda778 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:11.732044 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3592/7187] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:11 2022] POST /identity/v3/projects => generated 367 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:11.746441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730d330-58ab-4c38-bfd3-07f420eda778 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:11.776887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57e99a-7bc5-4e91-abb9-8b071e1de081 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:11.853418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830825eb-a05f-47ad-878d-ab3d3e36925a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:11.854258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830825eb-a05f-47ad-878d-ab3d3e36925a service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:11.854733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830825eb-a05f-47ad-878d-ab3d3e36925a service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:11.855170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830825eb-a05f-47ad-878d-ab3d3e36925a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:11.979026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730d330-58ab-4c38-bfd3-07f420eda778 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:11.990921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830825eb-a05f-47ad-878d-ab3d3e36925a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:11.994341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830825eb-a05f-47ad-878d-ab3d3e36925a service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:11.994510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cd1d4-b652-4767-b965-d9ff863bfd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:11.995496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd1d4-b652-4767-b965-d9ff863bfd28 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:11.996076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd1d4-b652-4767-b965-d9ff863bfd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:11.996520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd1d4-b652-4767-b965-d9ff863bfd28 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:11.997382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cd1d4-b652-4767-b965-d9ff863bfd28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:11.999705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cd1d4-b652-4767-b965-d9ff863bfd28 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:12.024282 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3596/7188] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:12.028531 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3593/7189] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:11 2022] POST /identity/v3/users => generated 290 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:12.032789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830825eb-a05f-47ad-878d-ab3d3e36925a service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:12.046185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:12.056115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830825eb-a05f-47ad-878d-ab3d3e36925a service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:12.076932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66bd84-f64f-48b4-9e45-40b124f5d03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:12.077565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66bd84-f64f-48b4-9e45-40b124f5d03d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:12.077975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66bd84-f64f-48b4-9e45-40b124f5d03d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:12.078258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66bd84-f64f-48b4-9e45-40b124f5d03d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:12.078918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66bd84-f64f-48b4-9e45-40b124f5d03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:12.080625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66bd84-f64f-48b4-9e45-40b124f5d03d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:12.115323 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3597/7190] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:12.119741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cd1d4-b652-4767-b965-d9ff863bfd28 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:12.136282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cd1d4-b652-4767-b965-d9ff863bfd28 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:12.178400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fc9f4-d155-4ae2-8543-f4e899a7e558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:12.188330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fc9f4-d155-4ae2-8543-f4e899a7e558 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:12.188629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fc9f4-d155-4ae2-8543-f4e899a7e558 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:12.189355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fc9f4-d155-4ae2-8543-f4e899a7e558 admin admin] PATH_INFO: `/v3/projects/efbd3f789d474fdda6e2ca3098c9bb29/users/67ab2c6b11fc4a44aea88909573b3d85/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:12.244733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fc9f4-d155-4ae2-8543-f4e899a7e558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbd3f789d474fdda6e2ca3098c9bb29, user_id=67ab2c6b11fc4a44aea88909573b3d85, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:12.251736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fc9f4-d155-4ae2-8543-f4e899a7e558 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:12.289448 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3594/7191] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:12 2022] PUT /identity/v3/projects/efbd3f789d474fdda6e2ca3098c9bb29/users/67ab2c6b11fc4a44aea88909573b3d85/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:12.293138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66bd84-f64f-48b4-9e45-40b124f5d03d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:12.313711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66bd84-f64f-48b4-9e45-40b124f5d03d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:12.354312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874459f-8957-44e9-a724-14937fa6739e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:12.354593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874459f-8957-44e9-a724-14937fa6739e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:12.354874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874459f-8957-44e9-a724-14937fa6739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:12.552409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1874459f-8957-44e9-a724-14937fa6739e None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:12.561915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1874459f-8957-44e9-a724-14937fa6739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:12.603480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab514e-6f01-4ef1-9eab-4fb6ce126ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:12.606497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab514e-6f01-4ef1-9eab-4fb6ce126ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:12.606976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab514e-6f01-4ef1-9eab-4fb6ce126ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:12.607528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab514e-6f01-4ef1-9eab-4fb6ce126ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:12.608496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab514e-6f01-4ef1-9eab-4fb6ce126ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:12.611601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab514e-6f01-4ef1-9eab-4fb6ce126ba9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:12.627585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:12.655245 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3598/7192] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:12.659098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab514e-6f01-4ef1-9eab-4fb6ce126ba9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:12.678086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab514e-6f01-4ef1-9eab-4fb6ce126ba9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:12.685551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276f90e-c865-4484-bc8f-bd09291e5fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:12.686466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276f90e-c865-4484-bc8f-bd09291e5fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:12.686896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276f90e-c865-4484-bc8f-bd09291e5fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:12.687430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276f90e-c865-4484-bc8f-bd09291e5fd6 admin admin] PATH_INFO: `/v3/projects/efbd3f789d474fdda6e2ca3098c9bb29/users/67ab2c6b11fc4a44aea88909573b3d85/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:12.689582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276f90e-c865-4484-bc8f-bd09291e5fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbd3f789d474fdda6e2ca3098c9bb29, user_id=67ab2c6b11fc4a44aea88909573b3d85, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:12.692785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276f90e-c865-4484-bc8f-bd09291e5fd6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:12.706029 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3599/7193] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:12 2022] PUT /identity/v3/projects/efbd3f789d474fdda6e2ca3098c9bb29/users/67ab2c6b11fc4a44aea88909573b3d85/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:51:12.717246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44679b6-2a35-440c-88f9-9b045843a233 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:12.717801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44679b6-2a35-440c-88f9-9b045843a233 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:12.718279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44679b6-2a35-440c-88f9-9b045843a233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:12.718744 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3595/7194] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:51:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 28 18:51:12.779531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f44679b6-2a35-440c-88f9-9b045843a233 None None] MFA Rules not processed for user `67ab2c6b11fc4a44aea88909573b3d85`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:12.781140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f44679b6-2a35-440c-88f9-9b045843a233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:12.810081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874459f-8957-44e9-a724-14937fa6739e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:12.811375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1874459f-8957-44e9-a724-14937fa6739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:12.843611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874459f-8957-44e9-a724-14937fa6739e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:12.898823 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3600/7195] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:51:12.899710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44679b6-2a35-440c-88f9-9b045843a233 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:12.902269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f44679b6-2a35-440c-88f9-9b045843a233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:13.027165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b12a24-d80d-45dd-b42a-f030ad16c4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:13.027871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b12a24-d80d-45dd-b42a-f030ad16c4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:13.028150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b12a24-d80d-45dd-b42a-f030ad16c4be admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:13.028428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b12a24-d80d-45dd-b42a-f030ad16c4be admin admin] PATH_INFO: `/v3/users/9ba31c23a33f499d9c612e2efd99a35d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:13.048217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b12a24-d80d-45dd-b42a-f030ad16c4be admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba31c23a33f499d9c612e2efd99a35d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:13.050413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:13.069387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44679b6-2a35-440c-88f9-9b045843a233 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:13.073401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b12a24-d80d-45dd-b42a-f030ad16c4be admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:13.090052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c15351-55c3-4c40-8f34-c82cc1baa9d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:13.090691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c15351-55c3-4c40-8f34-c82cc1baa9d5 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:13.091033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c15351-55c3-4c40-8f34-c82cc1baa9d5 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:13.091425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c15351-55c3-4c40-8f34-c82cc1baa9d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:13.201349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c15351-55c3-4c40-8f34-c82cc1baa9d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:13.204401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c15351-55c3-4c40-8f34-c82cc1baa9d5 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:13.216578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10b12a24-d80d-45dd-b42a-f030ad16c4be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba31c23a33f499d9c612e2efd99a35d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:13.217280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10b12a24-d80d-45dd-b42a-f030ad16c4be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba31c23a33f499d9c612e2efd99a35d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:13.230880 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3601/7196] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:51:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:51:13.232019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c15351-55c3-4c40-8f34-c82cc1baa9d5 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:13.236892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-23c15351-55c3-4c40-8f34-c82cc1baa9d5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:13.258655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10b12a24-d80d-45dd-b42a-f030ad16c4be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba31c23a33f499d9c612e2efd99a35d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:13.290537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10b12a24-d80d-45dd-b42a-f030ad16c4be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba31c23a33f499d9c612e2efd99a35d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:13.348822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10b12a24-d80d-45dd-b42a-f030ad16c4be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba31c23a33f499d9c612e2efd99a35d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:13.367913 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3596/7197] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:12 2022] DELETE /identity/v3/users/9ba31c23a33f499d9c612e2efd99a35d => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:13.372797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9529aeb-e499-40da-b197-5e69b932156f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:13.372797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9529aeb-e499-40da-b197-5e69b932156f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:13.372797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9529aeb-e499-40da-b197-5e69b932156f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:13.407610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c9529aeb-e499-40da-b197-5e69b932156f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:13.409390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c9529aeb-e499-40da-b197-5e69b932156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:13.427900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c15351-55c3-4c40-8f34-c82cc1baa9d5 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:13.488179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:13.524358 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3597/7198] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:51:13.541278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9529aeb-e499-40da-b197-5e69b932156f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:13.543456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c9529aeb-e499-40da-b197-5e69b932156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:13.671378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98506c78-5829-4c89-95f7-af6614eefd14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:13.674883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98506c78-5829-4c89-95f7-af6614eefd14 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:13.674883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98506c78-5829-4c89-95f7-af6614eefd14 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:13.674883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98506c78-5829-4c89-95f7-af6614eefd14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:13.679380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-98506c78-5829-4c89-95f7-af6614eefd14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:13.725024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9529aeb-e499-40da-b197-5e69b932156f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:13.739239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8404e2-93e2-461f-a8db-568c8ff11b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:13.740069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8404e2-93e2-461f-a8db-568c8ff11b83 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:13.740412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8404e2-93e2-461f-a8db-568c8ff11b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:13.740750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8404e2-93e2-461f-a8db-568c8ff11b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:13.760971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8404e2-93e2-461f-a8db-568c8ff11b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:13.768021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8404e2-93e2-461f-a8db-568c8ff11b83 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:13.798051 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3598/7199] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:13.799050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8404e2-93e2-461f-a8db-568c8ff11b83 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:13.803027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1a8404e2-93e2-461f-a8db-568c8ff11b83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:13.806873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98506c78-5829-4c89-95f7-af6614eefd14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:13.808572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98506c78-5829-4c89-95f7-af6614eefd14 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:13.821375 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3602/7200] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:13.822352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98506c78-5829-4c89-95f7-af6614eefd14 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:13.823932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-98506c78-5829-4c89-95f7-af6614eefd14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:13.871221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98506c78-5829-4c89-95f7-af6614eefd14 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:13.879485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db08b3a-533c-41c8-b04c-83b614366cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:13.882841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db08b3a-533c-41c8-b04c-83b614366cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:13.883991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db08b3a-533c-41c8-b04c-83b614366cde admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:13.884482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db08b3a-533c-41c8-b04c-83b614366cde admin admin] PATH_INFO: `/v3/users/5f93b124a96e4a5688a8778509d5cb80` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:13.886556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db08b3a-533c-41c8-b04c-83b614366cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f93b124a96e4a5688a8778509d5cb80)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:13.893921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db08b3a-533c-41c8-b04c-83b614366cde admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:13.898504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:13.969978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0db08b3a-533c-41c8-b04c-83b614366cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f93b124a96e4a5688a8778509d5cb80'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:13.971684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8404e2-93e2-461f-a8db-568c8ff11b83 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:13.986936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0db08b3a-533c-41c8-b04c-83b614366cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f93b124a96e4a5688a8778509d5cb80'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:13.987912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0db08b3a-533c-41c8-b04c-83b614366cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f93b124a96e4a5688a8778509d5cb80'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:13.988532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0db08b3a-533c-41c8-b04c-83b614366cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f93b124a96e4a5688a8778509d5cb80'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:13.990230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a32f1-f9b9-414c-90ce-e5e80bf759a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:13.991221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a32f1-f9b9-414c-90ce-e5e80bf759a5 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:13.991759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a32f1-f9b9-414c-90ce-e5e80bf759a5 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:13.997383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a32f1-f9b9-414c-90ce-e5e80bf759a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:13.999553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0db08b3a-533c-41c8-b04c-83b614366cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f93b124a96e4a5688a8778509d5cb80'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:14.010092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c74a32f1-f9b9-414c-90ce-e5e80bf759a5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:14.023420 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3603/7201] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:13 2022] DELETE /identity/v3/users/5f93b124a96e4a5688a8778509d5cb80 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:14.026464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db08b3a-533c-41c8-b04c-83b614366cde admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:14.030852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0db08b3a-533c-41c8-b04c-83b614366cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:14.194898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a32f1-f9b9-414c-90ce-e5e80bf759a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:14.196411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a32f1-f9b9-414c-90ce-e5e80bf759a5 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:14.200494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db08b3a-533c-41c8-b04c-83b614366cde admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:14.220186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5295cf-7b94-499f-80d8-e0bfa15fd2f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:14.220836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5295cf-7b94-499f-80d8-e0bfa15fd2f4 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:14.221122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5295cf-7b94-499f-80d8-e0bfa15fd2f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:14.221382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5295cf-7b94-499f-80d8-e0bfa15fd2f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:14.234686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6d5295cf-7b94-499f-80d8-e0bfa15fd2f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:14.237985 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3599/7202] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:14.240412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd988b8-d1b9-41da-8498-8f7c021401cb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:14.240768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd988b8-d1b9-41da-8498-8f7c021401cb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:14.241049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd988b8-d1b9-41da-8498-8f7c021401cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:14.295432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9bd988b8-d1b9-41da-8498-8f7c021401cb None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:14.296720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9bd988b8-d1b9-41da-8498-8f7c021401cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:14.442639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5295cf-7b94-499f-80d8-e0bfa15fd2f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:14.444159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5295cf-7b94-499f-80d8-e0bfa15fd2f4 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:14.470882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:14.479087 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3604/7203] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:14.480456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb6635-0bdc-4a5f-8a27-683c466fb187 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:14.480749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb6635-0bdc-4a5f-8a27-683c466fb187 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:14.481036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb6635-0bdc-4a5f-8a27-683c466fb187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:14.534796 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3600/7204] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:14.542981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-eadb6635-0bdc-4a5f-8a27-683c466fb187 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:14.544344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eadb6635-0bdc-4a5f-8a27-683c466fb187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:14.582583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd988b8-d1b9-41da-8498-8f7c021401cb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:14.584700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9bd988b8-d1b9-41da-8498-8f7c021401cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:14.705435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:14.797824 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3605/7205] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:51:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:14.799003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb6635-0bdc-4a5f-8a27-683c466fb187 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:14.810057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eadb6635-0bdc-4a5f-8a27-683c466fb187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:14.840349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb6635-0bdc-4a5f-8a27-683c466fb187 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:14.843116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd988b8-d1b9-41da-8498-8f7c021401cb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:14.851293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530bae1-125b-4b21-98df-c21c067eed4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:14.851966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530bae1-125b-4b21-98df-c21c067eed4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:14.853852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530bae1-125b-4b21-98df-c21c067eed4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:14.854142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530bae1-125b-4b21-98df-c21c067eed4f admin admin] PATH_INFO: `/v3/projects/f8b34eecdbb84edca129c329ffe377ca` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:14.860592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530bae1-125b-4b21-98df-c21c067eed4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8b34eecdbb84edca129c329ffe377ca)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:14.868406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530bae1-125b-4b21-98df-c21c067eed4f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:14.878292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d2d79-2d64-4f3a-94db-cc0d3d4d6df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:14.878922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d2d79-2d64-4f3a-94db-cc0d3d4d6df3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:14.879205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d2d79-2d64-4f3a-94db-cc0d3d4d6df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:14.879608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d2d79-2d64-4f3a-94db-cc0d3d4d6df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:14.908422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d2d79-2d64-4f3a-94db-cc0d3d4d6df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:14.909898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d2d79-2d64-4f3a-94db-cc0d3d4d6df3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:14.948169 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3601/7206] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:51:14.950234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d2d79-2d64-4f3a-94db-cc0d3d4d6df3 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:14.952252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7e9d2d79-2d64-4f3a-94db-cc0d3d4d6df3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:15.023671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6530bae1-125b-4b21-98df-c21c067eed4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8b34eecdbb84edca129c329ffe377ca', 'request_id': 'req-6530bae1-125b-4b21-98df-c21c067eed4f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:15.054547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6530bae1-125b-4b21-98df-c21c067eed4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8b34eecdbb84edca129c329ffe377ca', 'request_id': 'req-6530bae1-125b-4b21-98df-c21c067eed4f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:15.076560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6530bae1-125b-4b21-98df-c21c067eed4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8b34eecdbb84edca129c329ffe377ca', 'request_id': 'req-6530bae1-125b-4b21-98df-c21c067eed4f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:15.105795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6530bae1-125b-4b21-98df-c21c067eed4f admin admin] The token cache is being invalidate because project f8b34eecdbb84edca129c329ffe377ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:15.105925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6530bae1-125b-4b21-98df-c21c067eed4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:15.107367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6530bae1-125b-4b21-98df-c21c067eed4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:15.110676 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3606/7207] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:14 2022] DELETE /identity/v3/projects/f8b34eecdbb84edca129c329ffe377ca => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:15.115603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530bae1-125b-4b21-98df-c21c067eed4f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:15.119688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6530bae1-125b-4b21-98df-c21c067eed4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:15.244165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d2d79-2d64-4f3a-94db-cc0d3d4d6df3 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:15.517203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530bae1-125b-4b21-98df-c21c067eed4f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:15.548965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5c566-835a-4f40-adba-314497dfc90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:15.549402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5c566-835a-4f40-adba-314497dfc90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:15.549668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5c566-835a-4f40-adba-314497dfc90e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:15.549945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5c566-835a-4f40-adba-314497dfc90e admin admin] PATH_INFO: `/v3/users/2b4aa1f7c48345348c6e2f659e8f56bc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:15.579813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5c566-835a-4f40-adba-314497dfc90e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b4aa1f7c48345348c6e2f659e8f56bc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:15.596032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5c566-835a-4f40-adba-314497dfc90e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:15.620192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bc2d9-7382-4bb5-a17a-0c2c591b47f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:15.621465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bc2d9-7382-4bb5-a17a-0c2c591b47f2 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:15.622259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bc2d9-7382-4bb5-a17a-0c2c591b47f2 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:15.622739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bc2d9-7382-4bb5-a17a-0c2c591b47f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:15.629984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e1bc2d9-7382-4bb5-a17a-0c2c591b47f2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:15.760490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:15.796076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-83b5c566-835a-4f40-adba-314497dfc90e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b4aa1f7c48345348c6e2f659e8f56bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:15.842780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-83b5c566-835a-4f40-adba-314497dfc90e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b4aa1f7c48345348c6e2f659e8f56bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:15.848175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-83b5c566-835a-4f40-adba-314497dfc90e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b4aa1f7c48345348c6e2f659e8f56bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:15.849458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-83b5c566-835a-4f40-adba-314497dfc90e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b4aa1f7c48345348c6e2f659e8f56bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:15.852431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bc2d9-7382-4bb5-a17a-0c2c591b47f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:15.855756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bc2d9-7382-4bb5-a17a-0c2c591b47f2 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:15.856788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:15.876895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-83b5c566-835a-4f40-adba-314497dfc90e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b4aa1f7c48345348c6e2f659e8f56bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:15.878586 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3602/7208] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:51:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 930 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:51:15.928349 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3607/7209] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:15 2022] DELETE /identity/v3/users/2b4aa1f7c48345348c6e2f659e8f56bc => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:16.167481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bc2d9-7382-4bb5-a17a-0c2c591b47f2 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:16.169554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e1bc2d9-7382-4bb5-a17a-0c2c591b47f2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:16.189804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5c566-835a-4f40-adba-314497dfc90e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:16.192705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-83b5c566-835a-4f40-adba-314497dfc90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:16.213365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bc2d9-7382-4bb5-a17a-0c2c591b47f2 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:16.382322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5c566-835a-4f40-adba-314497dfc90e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:16.397456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c806e76-6c20-46ac-a42b-b2be17a13204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:16.398205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c806e76-6c20-46ac-a42b-b2be17a13204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:16.398658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c806e76-6c20-46ac-a42b-b2be17a13204 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:16.398941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c806e76-6c20-46ac-a42b-b2be17a13204 admin admin] PATH_INFO: `/v3/projects/23df98bc277847e79cef5d03ad4e540e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:16.402357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c806e76-6c20-46ac-a42b-b2be17a13204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23df98bc277847e79cef5d03ad4e540e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:16.404491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c806e76-6c20-46ac-a42b-b2be17a13204 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:16.405332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11917296-f18d-45fa-914d-c96d7ba89370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:16.409056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917296-f18d-45fa-914d-c96d7ba89370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:16.409486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917296-f18d-45fa-914d-c96d7ba89370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:16.410511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917296-f18d-45fa-914d-c96d7ba89370 admin admin] PATH_INFO: `/v3/users/ebff2470ee1b4d3d91dd6cc3ec889658` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:16.417122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11917296-f18d-45fa-914d-c96d7ba89370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebff2470ee1b4d3d91dd6cc3ec889658)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:16.427548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11917296-f18d-45fa-914d-c96d7ba89370 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:16.624933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c806e76-6c20-46ac-a42b-b2be17a13204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23df98bc277847e79cef5d03ad4e540e', 'request_id': 'req-9c806e76-6c20-46ac-a42b-b2be17a13204'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:16.658019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c806e76-6c20-46ac-a42b-b2be17a13204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23df98bc277847e79cef5d03ad4e540e', 'request_id': 'req-9c806e76-6c20-46ac-a42b-b2be17a13204'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:16.685045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c806e76-6c20-46ac-a42b-b2be17a13204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23df98bc277847e79cef5d03ad4e540e', 'request_id': 'req-9c806e76-6c20-46ac-a42b-b2be17a13204'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:16.685994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-11917296-f18d-45fa-914d-c96d7ba89370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebff2470ee1b4d3d91dd6cc3ec889658'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:16.720507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-11917296-f18d-45fa-914d-c96d7ba89370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebff2470ee1b4d3d91dd6cc3ec889658'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:16.724935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-11917296-f18d-45fa-914d-c96d7ba89370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebff2470ee1b4d3d91dd6cc3ec889658'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:16.725296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c806e76-6c20-46ac-a42b-b2be17a13204 admin admin] The token cache is being invalidate because project 23df98bc277847e79cef5d03ad4e540e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:16.726237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c806e76-6c20-46ac-a42b-b2be17a13204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:16.726644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-11917296-f18d-45fa-914d-c96d7ba89370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebff2470ee1b4d3d91dd6cc3ec889658'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:16.726917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c806e76-6c20-46ac-a42b-b2be17a13204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:16.730789 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3603/7210] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:16 2022] DELETE /identity/v3/projects/23df98bc277847e79cef5d03ad4e540e => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:16.739489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c806e76-6c20-46ac-a42b-b2be17a13204 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:16.751873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-11917296-f18d-45fa-914d-c96d7ba89370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebff2470ee1b4d3d91dd6cc3ec889658'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:16.758697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c806e76-6c20-46ac-a42b-b2be17a13204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:16.807859 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3608/7211] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:16 2022] DELETE /identity/v3/users/ebff2470ee1b4d3d91dd6cc3ec889658 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:16.822857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b5062-0137-434b-8c06-f29f87a89d5c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:16.823304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b5062-0137-434b-8c06-f29f87a89d5c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:16.823596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b5062-0137-434b-8c06-f29f87a89d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:16.916973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c87b5062-0137-434b-8c06-f29f87a89d5c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:16.922395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c87b5062-0137-434b-8c06-f29f87a89d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:16.936704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c806e76-6c20-46ac-a42b-b2be17a13204 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:16.958270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:17.164504 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3609/7212] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:17.164504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdb456-bf9c-4938-81e5-b37491c5f8b4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:17.164504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdb456-bf9c-4938-81e5-b37491c5f8b4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:17.164504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdb456-bf9c-4938-81e5-b37491c5f8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:17.167514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:17.168180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:17.168460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:17.168735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb admin admin] PATH_INFO: `/v3/projects/f1a1ac0ce70a4954aacc18aafe9791b5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:17.172107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a1ac0ce70a4954aacc18aafe9791b5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:17.174081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:17.177102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:17.232912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b2cdb456-bf9c-4938-81e5-b37491c5f8b4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:17.236158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b2cdb456-bf9c-4938-81e5-b37491c5f8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:17.287753 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3610/7213] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:17.289501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820b578-66ba-4bb1-84be-41125d0efa7a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:17.289784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820b578-66ba-4bb1-84be-41125d0efa7a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:17.290060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820b578-66ba-4bb1-84be-41125d0efa7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:17.346230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1820b578-66ba-4bb1-84be-41125d0efa7a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:17.364266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a1ac0ce70a4954aacc18aafe9791b5', 'request_id': 'req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:17.365519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1820b578-66ba-4bb1-84be-41125d0efa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:17.390449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a1ac0ce70a4954aacc18aafe9791b5', 'request_id': 'req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:17.413799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a1ac0ce70a4954aacc18aafe9791b5', 'request_id': 'req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:17.460350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb admin admin] The token cache is being invalidate because project f1a1ac0ce70a4954aacc18aafe9791b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:17.462217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:17.465523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:17.483125 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3604/7214] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:16 2022] DELETE /identity/v3/projects/f1a1ac0ce70a4954aacc18aafe9791b5 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:17.483426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:17.501560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:17.619668 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3611/7215] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:17.626283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a2d41-5edd-4d3f-ae9b-11ee24b0a991 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:17.626573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a2d41-5edd-4d3f-ae9b-11ee24b0a991 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:17.626865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a2d41-5edd-4d3f-ae9b-11ee24b0a991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:17.651913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa82cb-2dd8-44ae-9e8f-ea93cf313ccb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:17.665254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcd014-ae42-48ed-9a12-a53ad4d7d7e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:17.665903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcd014-ae42-48ed-9a12-a53ad4d7d7e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:17.666192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcd014-ae42-48ed-9a12-a53ad4d7d7e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:17.666465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcd014-ae42-48ed-9a12-a53ad4d7d7e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:17.674614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-69dcd014-ae42-48ed-9a12-a53ad4d7d7e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:17.676562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-146a2d41-5edd-4d3f-ae9b-11ee24b0a991 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:17.680405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-146a2d41-5edd-4d3f-ae9b-11ee24b0a991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:17.710283 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3612/7216] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:17.712119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce15a09-9f0f-48d9-9a14-ba63f20f70a6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:17.715502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce15a09-9f0f-48d9-9a14-ba63f20f70a6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:17.716257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce15a09-9f0f-48d9-9a14-ba63f20f70a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:17.722763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcd014-ae42-48ed-9a12-a53ad4d7d7e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:17.736975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcd014-ae42-48ed-9a12-a53ad4d7d7e9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:17.761164 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3605/7217] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:17.762070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcd014-ae42-48ed-9a12-a53ad4d7d7e9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:17.787663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9ce15a09-9f0f-48d9-9a14-ba63f20f70a6 None None] MFA Rules not processed for user `5c3c1c3f4f9a4de085ef2e98c5303139`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:17.789283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9ce15a09-9f0f-48d9-9a14-ba63f20f70a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:17.794692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcd014-ae42-48ed-9a12-a53ad4d7d7e9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:17.814765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2800be6-d597-4aa8-b68b-3f4831871a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:17.817501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2800be6-d597-4aa8-b68b-3f4831871a99 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:17.817881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2800be6-d597-4aa8-b68b-3f4831871a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:17.819043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2800be6-d597-4aa8-b68b-3f4831871a99 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:17.820065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2800be6-d597-4aa8-b68b-3f4831871a99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:17.826173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2800be6-d597-4aa8-b68b-3f4831871a99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:17.833481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2800be6-d597-4aa8-b68b-3f4831871a99 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:17.880886 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3606/7218] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:17.884706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be857805-bc4e-4f80-86f2-f125ffdf2e2e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:17.887061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be857805-bc4e-4f80-86f2-f125ffdf2e2e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:17.887504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be857805-bc4e-4f80-86f2-f125ffdf2e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:17.921385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-be857805-bc4e-4f80-86f2-f125ffdf2e2e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:17.922773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-be857805-bc4e-4f80-86f2-f125ffdf2e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:17.935375 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3607/7219] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:17.935375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be857805-bc4e-4f80-86f2-f125ffdf2e2e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:17.981146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be857805-bc4e-4f80-86f2-f125ffdf2e2e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:17.990525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b3d90-6bb3-4894-b84c-f9c693894de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:17.991324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b3d90-6bb3-4894-b84c-f9c693894de1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:17.991496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b3d90-6bb3-4894-b84c-f9c693894de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:17.991777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b3d90-6bb3-4894-b84c-f9c693894de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:17.992427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b3d90-6bb3-4894-b84c-f9c693894de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:17.994389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b3d90-6bb3-4894-b84c-f9c693894de1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:18.065940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:18.076153 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3608/7220] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:17 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:18.077226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b3d90-6bb3-4894-b84c-f9c693894de1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:18.110460 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3613/7221] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:17 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:18.111652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce15a09-9f0f-48d9-9a14-ba63f20f70a6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:18.144694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce15a09-9f0f-48d9-9a14-ba63f20f70a6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:18.265073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b3d90-6bb3-4894-b84c-f9c693894de1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:18.276196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77b6b5-de45-4c63-947f-87f1199c4f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:18.277460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77b6b5-de45-4c63-947f-87f1199c4f38 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:18.279153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77b6b5-de45-4c63-947f-87f1199c4f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:18.279712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77b6b5-de45-4c63-947f-87f1199c4f38 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:18.280661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77b6b5-de45-4c63-947f-87f1199c4f38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:18.281208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77b6b5-de45-4c63-947f-87f1199c4f38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:18.287168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77b6b5-de45-4c63-947f-87f1199c4f38 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:18.302775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d2d7a-c257-4c24-9399-0eec12c7baa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:18.303542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d2d7a-c257-4c24-9399-0eec12c7baa3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:18.303720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d2d7a-c257-4c24-9399-0eec12c7baa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:18.304020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d2d7a-c257-4c24-9399-0eec12c7baa3 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:18.305132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d2d7a-c257-4c24-9399-0eec12c7baa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:18.308384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d2d7a-c257-4c24-9399-0eec12c7baa3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:18.317097 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3609/7222] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:18.318590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cf25e-eaf4-4296-9f68-3a0794641385 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:18.319019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cf25e-eaf4-4296-9f68-3a0794641385 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:18.319486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cf25e-eaf4-4296-9f68-3a0794641385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:18.384898 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3614/7223] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:18 2022] POST /identity/v3/users => generated 288 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:18.386110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d2d7a-c257-4c24-9399-0eec12c7baa3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:18.398294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7f5cf25e-eaf4-4296-9f68-3a0794641385 None None] MFA Rules not processed for user `e8252a305455469ba107ba34952a20c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:18.399546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7f5cf25e-eaf4-4296-9f68-3a0794641385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:18.420364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d2d7a-c257-4c24-9399-0eec12c7baa3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:18.432518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19fade-6a10-4e0e-9f16-6bb32cc08466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:18.433769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19fade-6a10-4e0e-9f16-6bb32cc08466 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:18.434217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19fade-6a10-4e0e-9f16-6bb32cc08466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:18.436310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19fade-6a10-4e0e-9f16-6bb32cc08466 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:18.440104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19fade-6a10-4e0e-9f16-6bb32cc08466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:18.442437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19fade-6a10-4e0e-9f16-6bb32cc08466 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:18.462081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:18.484743 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3610/7224] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:18 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:18.484743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cf25e-eaf4-4296-9f68-3a0794641385 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:18.528035 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3615/7225] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:18 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:18.528215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cf25e-eaf4-4296-9f68-3a0794641385 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:18.529255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19fade-6a10-4e0e-9f16-6bb32cc08466 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:18.537740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2a19fade-6a10-4e0e-9f16-6bb32cc08466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:18.631475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd3492-31f5-4ef0-aca6-26c89cf37985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:18.632835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd3492-31f5-4ef0-aca6-26c89cf37985 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:18.633270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd3492-31f5-4ef0-aca6-26c89cf37985 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:18.633696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd3492-31f5-4ef0-aca6-26c89cf37985 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:18.635140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd3492-31f5-4ef0-aca6-26c89cf37985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:18.638773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd3492-31f5-4ef0-aca6-26c89cf37985 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:18.654820 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3611/7226] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:18.656056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd3492-31f5-4ef0-aca6-26c89cf37985 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:18.672933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd3492-31f5-4ef0-aca6-26c89cf37985 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:18.679553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfa1b8-9a06-4dc2-a86f-56c50f3baaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:18.680175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfa1b8-9a06-4dc2-a86f-56c50f3baaba admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:18.680455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfa1b8-9a06-4dc2-a86f-56c50f3baaba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:18.680868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfa1b8-9a06-4dc2-a86f-56c50f3baaba admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:18.681513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfa1b8-9a06-4dc2-a86f-56c50f3baaba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:18.684203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfa1b8-9a06-4dc2-a86f-56c50f3baaba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:18.714413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19fade-6a10-4e0e-9f16-6bb32cc08466 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:18.723136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2166cf6-a48e-4b9d-bfac-386a7fa343a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:18.723934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2166cf6-a48e-4b9d-bfac-386a7fa343a6 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:18.724192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2166cf6-a48e-4b9d-bfac-386a7fa343a6 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:18.724630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2166cf6-a48e-4b9d-bfac-386a7fa343a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:18.726481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c2166cf6-a48e-4b9d-bfac-386a7fa343a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:18.754277 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3612/7227] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:18 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:18.755434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfa1b8-9a06-4dc2-a86f-56c50f3baaba admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:18.757954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c8cfa1b8-9a06-4dc2-a86f-56c50f3baaba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:18.773299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfa1b8-9a06-4dc2-a86f-56c50f3baaba admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:18.780604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194cc8c-0149-45b9-9a47-b08f265c446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:18.782384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194cc8c-0149-45b9-9a47-b08f265c446f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:18.782919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194cc8c-0149-45b9-9a47-b08f265c446f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:18.783727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194cc8c-0149-45b9-9a47-b08f265c446f admin admin] PATH_INFO: `/v3/projects/8f460d1b626b4110b9d1ffa00a11bf05` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:18.785936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194cc8c-0149-45b9-9a47-b08f265c446f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f460d1b626b4110b9d1ffa00a11bf05)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:18.788629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194cc8c-0149-45b9-9a47-b08f265c446f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:18.802864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:18.872440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2166cf6-a48e-4b9d-bfac-386a7fa343a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:18.878924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2166cf6-a48e-4b9d-bfac-386a7fa343a6 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:18.885428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0194cc8c-0149-45b9-9a47-b08f265c446f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f460d1b626b4110b9d1ffa00a11bf05', 'request_id': 'req-0194cc8c-0149-45b9-9a47-b08f265c446f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:18.905036 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3616/7228] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:18 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:18.905213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2166cf6-a48e-4b9d-bfac-386a7fa343a6 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:18.919708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0194cc8c-0149-45b9-9a47-b08f265c446f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f460d1b626b4110b9d1ffa00a11bf05', 'request_id': 'req-0194cc8c-0149-45b9-9a47-b08f265c446f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:18.933079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2166cf6-a48e-4b9d-bfac-386a7fa343a6 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:18.935620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0194cc8c-0149-45b9-9a47-b08f265c446f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f460d1b626b4110b9d1ffa00a11bf05', 'request_id': 'req-0194cc8c-0149-45b9-9a47-b08f265c446f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:18.965315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0194cc8c-0149-45b9-9a47-b08f265c446f admin admin] The token cache is being invalidate because project 8f460d1b626b4110b9d1ffa00a11bf05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:18.965614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0194cc8c-0149-45b9-9a47-b08f265c446f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:18.967152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0194cc8c-0149-45b9-9a47-b08f265c446f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:18.971716 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3613/7229] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:18 2022] DELETE /identity/v3/projects/8f460d1b626b4110b9d1ffa00a11bf05 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:18.973454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194cc8c-0149-45b9-9a47-b08f265c446f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:18.979456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0194cc8c-0149-45b9-9a47-b08f265c446f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:19.109069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdc58f-95ad-483c-a47a-f182b0bbcb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:19.109725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdc58f-95ad-483c-a47a-f182b0bbcb28 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:19.110013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdc58f-95ad-483c-a47a-f182b0bbcb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:19.110422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdc58f-95ad-483c-a47a-f182b0bbcb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:19.111696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdc58f-95ad-483c-a47a-f182b0bbcb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:19.117041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdc58f-95ad-483c-a47a-f182b0bbcb28 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:19.159208 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3617/7230] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:19.159208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdc58f-95ad-483c-a47a-f182b0bbcb28 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:19.164132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5fbdc58f-95ad-483c-a47a-f182b0bbcb28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:19.182343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194cc8c-0149-45b9-9a47-b08f265c446f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:19.193064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdc58f-95ad-483c-a47a-f182b0bbcb28 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:19.196795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1322278-b191-4cce-b3c5-ffa111dbafdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:19.197436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1322278-b191-4cce-b3c5-ffa111dbafdf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:19.197714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1322278-b191-4cce-b3c5-ffa111dbafdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:19.200277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1322278-b191-4cce-b3c5-ffa111dbafdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:19.200960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1322278-b191-4cce-b3c5-ffa111dbafdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:19.204253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1322278-b191-4cce-b3c5-ffa111dbafdf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:19.208878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350d732-d13e-4a14-9aed-4887927e774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:19.209478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350d732-d13e-4a14-9aed-4887927e774a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:19.210025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350d732-d13e-4a14-9aed-4887927e774a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:19.210285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350d732-d13e-4a14-9aed-4887927e774a admin admin] PATH_INFO: `/v3/users/37e9ce20837d480ab6ed33c658d97c62` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:19.215964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350d732-d13e-4a14-9aed-4887927e774a admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e9ce20837d480ab6ed33c658d97c62)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:19.218188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350d732-d13e-4a14-9aed-4887927e774a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:19.232171 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3614/7231] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:19.237172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1322278-b191-4cce-b3c5-ffa111dbafdf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:19.242671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b1322278-b191-4cce-b3c5-ffa111dbafdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:19.258170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:19.276820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1322278-b191-4cce-b3c5-ffa111dbafdf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:19.288881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662acdbd-30a0-4628-81c6-3a43f2d2ec62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:19.289574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662acdbd-30a0-4628-81c6-3a43f2d2ec62 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:19.290070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662acdbd-30a0-4628-81c6-3a43f2d2ec62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:19.290650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662acdbd-30a0-4628-81c6-3a43f2d2ec62 admin admin] PATH_INFO: `/v3/projects/cafa7fa7ca3f45369b2dbb26772217fd/users/c2eb2f3c887947d5978d6bebd51c5b72/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:19.354565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2350d732-d13e-4a14-9aed-4887927e774a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e9ce20837d480ab6ed33c658d97c62'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:19.356203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662acdbd-30a0-4628-81c6-3a43f2d2ec62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafa7fa7ca3f45369b2dbb26772217fd, user_id=c2eb2f3c887947d5978d6bebd51c5b72, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:19.361149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662acdbd-30a0-4628-81c6-3a43f2d2ec62 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:19.376205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2350d732-d13e-4a14-9aed-4887927e774a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e9ce20837d480ab6ed33c658d97c62'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:19.377622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2350d732-d13e-4a14-9aed-4887927e774a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e9ce20837d480ab6ed33c658d97c62'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:19.378463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2350d732-d13e-4a14-9aed-4887927e774a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e9ce20837d480ab6ed33c658d97c62'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:19.392694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2350d732-d13e-4a14-9aed-4887927e774a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e9ce20837d480ab6ed33c658d97c62'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:19.426555 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3618/7232] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:19 2022] DELETE /identity/v3/users/37e9ce20837d480ab6ed33c658d97c62 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:19.431245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350d732-d13e-4a14-9aed-4887927e774a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:19.434108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2350d732-d13e-4a14-9aed-4887927e774a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:19.486043 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3615/7233] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:19 2022] PUT /identity/v3/projects/cafa7fa7ca3f45369b2dbb26772217fd/users/c2eb2f3c887947d5978d6bebd51c5b72/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:19.496416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e18b4c-acfa-48ce-b8fc-d581dd3878a5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:19.497030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e18b4c-acfa-48ce-b8fc-d581dd3878a5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:19.497505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e18b4c-acfa-48ce-b8fc-d581dd3878a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:19.618529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e6e18b4c-acfa-48ce-b8fc-d581dd3878a5 None None] MFA Rules not processed for user `c2eb2f3c887947d5978d6bebd51c5b72`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:19.620078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e6e18b4c-acfa-48ce-b8fc-d581dd3878a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:19.668019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350d732-d13e-4a14-9aed-4887927e774a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:19.834725 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3616/7234] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:51:19.835783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e18b4c-acfa-48ce-b8fc-d581dd3878a5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:19.837392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e6e18b4c-acfa-48ce-b8fc-d581dd3878a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:19.849706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:19.874346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d402f-d4d3-4408-9888-4110c5ae393b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:19.876061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d402f-d4d3-4408-9888-4110c5ae393b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:19.876976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d402f-d4d3-4408-9888-4110c5ae393b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:19.877514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d402f-d4d3-4408-9888-4110c5ae393b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:19.878591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d402f-d4d3-4408-9888-4110c5ae393b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:19.881390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d402f-d4d3-4408-9888-4110c5ae393b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:19.913020 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3619/7235] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:19.914324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d402f-d4d3-4408-9888-4110c5ae393b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:19.920520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-177d402f-d4d3-4408-9888-4110c5ae393b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:19.938423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d402f-d4d3-4408-9888-4110c5ae393b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:19.945919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cdd0e-1a9b-46bc-bc7f-b18954b23ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:19.947229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cdd0e-1a9b-46bc-bc7f-b18954b23ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:19.948027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cdd0e-1a9b-46bc-bc7f-b18954b23ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:19.948027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cdd0e-1a9b-46bc-bc7f-b18954b23ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:19.948728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cdd0e-1a9b-46bc-bc7f-b18954b23ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:19.951408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cdd0e-1a9b-46bc-bc7f-b18954b23ef7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:19.996923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e18b4c-acfa-48ce-b8fc-d581dd3878a5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:19.999149 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3620/7236] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:19 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:20.001452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cdd0e-1a9b-46bc-bc7f-b18954b23ef7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:20.039364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:20.110266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a279a7b-4fa0-4d14-afe5-dc34263a9b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:20.111769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a279a7b-4fa0-4d14-afe5-dc34263a9b8c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:20.113141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a279a7b-4fa0-4d14-afe5-dc34263a9b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:20.113487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a279a7b-4fa0-4d14-afe5-dc34263a9b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:20.122646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3a279a7b-4fa0-4d14-afe5-dc34263a9b8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:20.144258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a279a7b-4fa0-4d14-afe5-dc34263a9b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:20.146109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a279a7b-4fa0-4d14-afe5-dc34263a9b8c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:20.154512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cdd0e-1a9b-46bc-bc7f-b18954b23ef7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:20.160507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a6429-a67e-4018-9f8a-4ed1f21b2064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:20.161299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a6429-a67e-4018-9f8a-4ed1f21b2064 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:20.161681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a6429-a67e-4018-9f8a-4ed1f21b2064 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:20.162091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a6429-a67e-4018-9f8a-4ed1f21b2064 admin admin] PATH_INFO: `/v3/projects/f9c55edd41bd4235bfcefda60ce3a48e/users/f1cce2ffee5243309c74a087382645c1/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:20.179490 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3617/7237] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:20.180678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a279a7b-4fa0-4d14-afe5-dc34263a9b8c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:20.232538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a6429-a67e-4018-9f8a-4ed1f21b2064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c55edd41bd4235bfcefda60ce3a48e, user_id=f1cce2ffee5243309c74a087382645c1, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:20.242567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a6429-a67e-4018-9f8a-4ed1f21b2064 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:20.249543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a279a7b-4fa0-4d14-afe5-dc34263a9b8c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:20.267959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2504da-a6df-4611-8957-6a9678f5dd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:20.268861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2504da-a6df-4611-8957-6a9678f5dd82 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:20.269170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2504da-a6df-4611-8957-6a9678f5dd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:20.269561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2504da-a6df-4611-8957-6a9678f5dd82 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:20.272222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2504da-a6df-4611-8957-6a9678f5dd82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:20.277544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2504da-a6df-4611-8957-6a9678f5dd82 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:20.283532 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3621/7238] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:19 2022] PUT /identity/v3/projects/f9c55edd41bd4235bfcefda60ce3a48e/users/f1cce2ffee5243309c74a087382645c1/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:20.284336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a6429-a67e-4018-9f8a-4ed1f21b2064 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:20.289455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-833a6429-a67e-4018-9f8a-4ed1f21b2064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:20.325558 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3618/7239] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:20 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:20.330847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5f4f5-2694-45ce-99b5-f8468945b4b9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:20.331434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5f4f5-2694-45ce-99b5-f8468945b4b9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:20.332680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5f4f5-2694-45ce-99b5-f8468945b4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:20.403605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ccb5f4f5-2694-45ce-99b5-f8468945b4b9 None None] MFA Rules not processed for user `f1cce2ffee5243309c74a087382645c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:20.404840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ccb5f4f5-2694-45ce-99b5-f8468945b4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:20.465118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a6429-a67e-4018-9f8a-4ed1f21b2064 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:20.493747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe63ae-6f44-4539-a739-2a1865554617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:20.495749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe63ae-6f44-4539-a739-2a1865554617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:20.497741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe63ae-6f44-4539-a739-2a1865554617 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:20.499113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe63ae-6f44-4539-a739-2a1865554617 admin admin] PATH_INFO: `/v3/projects/ac8348dfe0874d89b1772c224e0b4e0d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:20.510481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe63ae-6f44-4539-a739-2a1865554617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac8348dfe0874d89b1772c224e0b4e0d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:20.517898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe63ae-6f44-4539-a739-2a1865554617 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:20.578433 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3619/7240] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:20.579545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5f4f5-2694-45ce-99b5-f8468945b4b9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:20.605792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5f4f5-2694-45ce-99b5-f8468945b4b9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:20.636039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb8ad7-1c5b-4e97-b5be-c9de4eacff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:20.637984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb8ad7-1c5b-4e97-b5be-c9de4eacff49 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:20.642519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb8ad7-1c5b-4e97-b5be-c9de4eacff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:20.642925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb8ad7-1c5b-4e97-b5be-c9de4eacff49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:20.643667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb8ad7-1c5b-4e97-b5be-c9de4eacff49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:20.649815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb8ad7-1c5b-4e97-b5be-c9de4eacff49 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:20.669270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0cfe63ae-6f44-4539-a739-2a1865554617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac8348dfe0874d89b1772c224e0b4e0d', 'request_id': 'req-0cfe63ae-6f44-4539-a739-2a1865554617'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:20.686179 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3620/7241] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:20.687332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb8ad7-1c5b-4e97-b5be-c9de4eacff49 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:20.694009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-50cb8ad7-1c5b-4e97-b5be-c9de4eacff49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:20.699906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0cfe63ae-6f44-4539-a739-2a1865554617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac8348dfe0874d89b1772c224e0b4e0d', 'request_id': 'req-0cfe63ae-6f44-4539-a739-2a1865554617'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:20.725796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0cfe63ae-6f44-4539-a739-2a1865554617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac8348dfe0874d89b1772c224e0b4e0d', 'request_id': 'req-0cfe63ae-6f44-4539-a739-2a1865554617'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:20.738150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb8ad7-1c5b-4e97-b5be-c9de4eacff49 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:20.750675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0cfe63ae-6f44-4539-a739-2a1865554617 admin admin] The token cache is being invalidate because project ac8348dfe0874d89b1772c224e0b4e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:20.751042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0cfe63ae-6f44-4539-a739-2a1865554617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:20.751989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0cfe63ae-6f44-4539-a739-2a1865554617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:20.754077 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3622/7242] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:20 2022] DELETE /identity/v3/projects/ac8348dfe0874d89b1772c224e0b4e0d => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:20.754997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe63ae-6f44-4539-a739-2a1865554617 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:20.756618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0cfe63ae-6f44-4539-a739-2a1865554617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:20.789872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:20.873596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:20.899909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19dcec5-f333-4d18-a0c2-59b4997933c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:20.901269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dcec5-f333-4d18-a0c2-59b4997933c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:20.901554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dcec5-f333-4d18-a0c2-59b4997933c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:20.904681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dcec5-f333-4d18-a0c2-59b4997933c9 admin admin] PATH_INFO: `/v3/users/b7f0352a153343258d654d2ae7a43ea8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:20.906228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19dcec5-f333-4d18-a0c2-59b4997933c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f0352a153343258d654d2ae7a43ea8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:20.909317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19dcec5-f333-4d18-a0c2-59b4997933c9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:20.947986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe63ae-6f44-4539-a739-2a1865554617 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:20.953399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396baa8-d24c-4548-8a52-e0054f2801f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:20.954068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396baa8-d24c-4548-8a52-e0054f2801f7 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:20.954352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396baa8-d24c-4548-8a52-e0054f2801f7 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:20.954741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396baa8-d24c-4548-8a52-e0054f2801f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:20.957171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b396baa8-d24c-4548-8a52-e0054f2801f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:21.066452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d19dcec5-f333-4d18-a0c2-59b4997933c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f0352a153343258d654d2ae7a43ea8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:21.069744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d19dcec5-f333-4d18-a0c2-59b4997933c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f0352a153343258d654d2ae7a43ea8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:21.082264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396baa8-d24c-4548-8a52-e0054f2801f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:21.085398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396baa8-d24c-4548-8a52-e0054f2801f7 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:21.095408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d19dcec5-f333-4d18-a0c2-59b4997933c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f0352a153343258d654d2ae7a43ea8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:21.106144 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3623/7243] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:21.106591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396baa8-d24c-4548-8a52-e0054f2801f7 service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:21.108261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b396baa8-d24c-4548-8a52-e0054f2801f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:21.111540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d19dcec5-f333-4d18-a0c2-59b4997933c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f0352a153343258d654d2ae7a43ea8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:21.145167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396baa8-d24c-4548-8a52-e0054f2801f7 service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:21.152154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efc567-c24d-44da-a33d-fe582362209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:21.152849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efc567-c24d-44da-a33d-fe582362209c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:21.153135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efc567-c24d-44da-a33d-fe582362209c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:21.153422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efc567-c24d-44da-a33d-fe582362209c admin admin] PATH_INFO: `/v3/projects/da1686b8ac814944aace0dea9ac471b6/users/dc6fc646ae294d55b5d0ef31da75f153/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:21.188526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efc567-c24d-44da-a33d-fe582362209c admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1686b8ac814944aace0dea9ac471b6, user_id=dc6fc646ae294d55b5d0ef31da75f153, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:21.191428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d19dcec5-f333-4d18-a0c2-59b4997933c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f0352a153343258d654d2ae7a43ea8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:21.193756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efc567-c24d-44da-a33d-fe582362209c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:21.216598 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3621/7244] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:20 2022] DELETE /identity/v3/users/b7f0352a153343258d654d2ae7a43ea8 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:21.221743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001f060-2c9c-4b21-a79b-e418d565c4f7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:21.222025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001f060-2c9c-4b21-a79b-e418d565c4f7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:21.222455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001f060-2c9c-4b21-a79b-e418d565c4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:21.225405 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3624/7245] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:21 2022] PUT /identity/v3/projects/da1686b8ac814944aace0dea9ac471b6/users/dc6fc646ae294d55b5d0ef31da75f153/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:21.231715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b290f-dd55-4ce2-baa2-953d0ea46098 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:21.231715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b290f-dd55-4ce2-baa2-953d0ea46098 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:21.231715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b290f-dd55-4ce2-baa2-953d0ea46098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:21.278554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bb1b290f-dd55-4ce2-baa2-953d0ea46098 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:21.279939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bb1b290f-dd55-4ce2-baa2-953d0ea46098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:21.280153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3001f060-2c9c-4b21-a79b-e418d565c4f7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:21.281375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3001f060-2c9c-4b21-a79b-e418d565c4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:21.421138 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3622/7246] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:21.422392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001f060-2c9c-4b21-a79b-e418d565c4f7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:21.426298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3001f060-2c9c-4b21-a79b-e418d565c4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:21.442626 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3625/7247] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:21.443967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b290f-dd55-4ce2-baa2-953d0ea46098 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:21.452265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bb1b290f-dd55-4ce2-baa2-953d0ea46098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:21.468881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001f060-2c9c-4b21-a79b-e418d565c4f7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:21.494380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad8b20-947b-48d3-93fd-f70a8a339fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:21.495289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad8b20-947b-48d3-93fd-f70a8a339fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:21.495457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad8b20-947b-48d3-93fd-f70a8a339fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:21.495931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad8b20-947b-48d3-93fd-f70a8a339fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:21.497123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad8b20-947b-48d3-93fd-f70a8a339fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:21.499624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad8b20-947b-48d3-93fd-f70a8a339fb3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:21.506293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b290f-dd55-4ce2-baa2-953d0ea46098 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:21.525895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb10f7e-4e8c-4a72-8613-d9935992424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:21.526778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb10f7e-4e8c-4a72-8613-d9935992424e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:21.527010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb10f7e-4e8c-4a72-8613-d9935992424e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:21.528659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb10f7e-4e8c-4a72-8613-d9935992424e admin admin] PATH_INFO: `/v3/users/f1cce2ffee5243309c74a087382645c1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:21.535734 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3623/7248] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:21.537406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eb7f0-d2fe-4df2-8cb1-fddd3c569d00 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:21.537837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eb7f0-d2fe-4df2-8cb1-fddd3c569d00 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:21.538270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eb7f0-d2fe-4df2-8cb1-fddd3c569d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:21.543624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb10f7e-4e8c-4a72-8613-d9935992424e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1cce2ffee5243309c74a087382645c1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:21.546671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb10f7e-4e8c-4a72-8613-d9935992424e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:21.626696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0a0eb7f0-d2fe-4df2-8cb1-fddd3c569d00 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:21.630631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a0eb7f0-d2fe-4df2-8cb1-fddd3c569d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:21.649209 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3624/7249] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:21.653629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0eb7f0-d2fe-4df2-8cb1-fddd3c569d00 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:21.659818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a0eb7f0-d2fe-4df2-8cb1-fddd3c569d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:21.702311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bfb10f7e-4e8c-4a72-8613-d9935992424e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1cce2ffee5243309c74a087382645c1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:21.708022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:21.725356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bfb10f7e-4e8c-4a72-8613-d9935992424e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1cce2ffee5243309c74a087382645c1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:21.728239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bfb10f7e-4e8c-4a72-8613-d9935992424e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1cce2ffee5243309c74a087382645c1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:21.729921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bfb10f7e-4e8c-4a72-8613-d9935992424e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1cce2ffee5243309c74a087382645c1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:21.745992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bfb10f7e-4e8c-4a72-8613-d9935992424e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1cce2ffee5243309c74a087382645c1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:21.747940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:21.779641 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3626/7250] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:21 2022] DELETE /identity/v3/users/f1cce2ffee5243309c74a087382645c1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:21.785585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb10f7e-4e8c-4a72-8613-d9935992424e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:21.788985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bfb10f7e-4e8c-4a72-8613-d9935992424e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:21.819035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0eb7f0-d2fe-4df2-8cb1-fddd3c569d00 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:21.900768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb10f7e-4e8c-4a72-8613-d9935992424e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:21.909882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d48d3-f363-4b68-8c82-3fac800afece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:21.910595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d48d3-f363-4b68-8c82-3fac800afece service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:21.910885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d48d3-f363-4b68-8c82-3fac800afece service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:21.911146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d48d3-f363-4b68-8c82-3fac800afece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:21.912355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4879512-31ec-48f6-9252-d46b7cf934fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:21.913102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4879512-31ec-48f6-9252-d46b7cf934fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:21.913377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4879512-31ec-48f6-9252-d46b7cf934fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:21.913707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4879512-31ec-48f6-9252-d46b7cf934fb admin admin] PATH_INFO: `/v3/projects/da1686b8ac814944aace0dea9ac471b6/users/dc6fc646ae294d55b5d0ef31da75f153/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:21.916093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4879512-31ec-48f6-9252-d46b7cf934fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1686b8ac814944aace0dea9ac471b6, user_id=dc6fc646ae294d55b5d0ef31da75f153, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:21.917475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f2d48d3-f363-4b68-8c82-3fac800afece service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:21.921268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4879512-31ec-48f6-9252-d46b7cf934fb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:21.943110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d48d3-f363-4b68-8c82-3fac800afece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:21.944612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d48d3-f363-4b68-8c82-3fac800afece service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:21.950401 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3627/7251] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:21 2022] PUT /identity/v3/projects/da1686b8ac814944aace0dea9ac471b6/users/dc6fc646ae294d55b5d0ef31da75f153/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:21.951290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4879512-31ec-48f6-9252-d46b7cf934fb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:21.954572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c4879512-31ec-48f6-9252-d46b7cf934fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:21.975652 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3625/7252] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:21.979312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2d0cc-9c1b-4522-ba4a-88d744084df9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:21.979831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2d0cc-9c1b-4522-ba4a-88d744084df9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:21.982380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2d0cc-9c1b-4522-ba4a-88d744084df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:22.023830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f0d2d0cc-9c1b-4522-ba4a-88d744084df9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:22.025110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f0d2d0cc-9c1b-4522-ba4a-88d744084df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:22.111016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4879512-31ec-48f6-9252-d46b7cf934fb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:22.116484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b3738-36db-4b5d-aabc-2dc85dd19124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:22.117230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b3738-36db-4b5d-aabc-2dc85dd19124 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:22.117611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b3738-36db-4b5d-aabc-2dc85dd19124 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:22.117984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b3738-36db-4b5d-aabc-2dc85dd19124 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:22.118755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b3738-36db-4b5d-aabc-2dc85dd19124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:22.119160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b3738-36db-4b5d-aabc-2dc85dd19124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:22.121374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b3738-36db-4b5d-aabc-2dc85dd19124 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:22.136089 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3628/7253] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:22.139425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685ec97-07c4-4289-95b4-f79ae26dec6b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:22.139425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685ec97-07c4-4289-95b4-f79ae26dec6b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:22.139425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685ec97-07c4-4289-95b4-f79ae26dec6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:22.220605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9685ec97-07c4-4289-95b4-f79ae26dec6b None None] MFA Rules not processed for user `dc6fc646ae294d55b5d0ef31da75f153`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:22.225131 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3626/7254] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:22.225532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9685ec97-07c4-4289-95b4-f79ae26dec6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:22.226617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2d0cc-9c1b-4522-ba4a-88d744084df9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:22.254582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2d0cc-9c1b-4522-ba4a-88d744084df9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:22.278538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50771c8f-27f3-4fab-9b6f-2b892473696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:22.279835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771c8f-27f3-4fab-9b6f-2b892473696e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:22.280628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771c8f-27f3-4fab-9b6f-2b892473696e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:22.280628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771c8f-27f3-4fab-9b6f-2b892473696e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:22.281536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50771c8f-27f3-4fab-9b6f-2b892473696e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:22.284847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50771c8f-27f3-4fab-9b6f-2b892473696e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:22.322519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:22.355612 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3627/7255] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:22 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:22.358758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50771c8f-27f3-4fab-9b6f-2b892473696e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:22.365703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-50771c8f-27f3-4fab-9b6f-2b892473696e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:22.378657 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3629/7256] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:22.383200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685ec97-07c4-4289-95b4-f79ae26dec6b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:22.405220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685ec97-07c4-4289-95b4-f79ae26dec6b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:22.520673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50771c8f-27f3-4fab-9b6f-2b892473696e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:22.532075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8edb9-12c7-4c70-a622-e8bb6c93e1e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:22.532717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8edb9-12c7-4c70-a622-e8bb6c93e1e6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:22.532999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8edb9-12c7-4c70-a622-e8bb6c93e1e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:22.533273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8edb9-12c7-4c70-a622-e8bb6c93e1e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:22.600289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0748977-f544-4bc8-9cb4-3992be53bcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:22.601147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0748977-f544-4bc8-9cb4-3992be53bcb3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:22.601431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0748977-f544-4bc8-9cb4-3992be53bcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:22.601705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0748977-f544-4bc8-9cb4-3992be53bcb3 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:22.602353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0748977-f544-4bc8-9cb4-3992be53bcb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:22.609072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0748977-f544-4bc8-9cb4-3992be53bcb3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:22.614935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:22.720520 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3630/7257] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:22 2022] POST /identity/v3/users => generated 287 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:22.721416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0748977-f544-4bc8-9cb4-3992be53bcb3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:22.723296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d0748977-f544-4bc8-9cb4-3992be53bcb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:22.730283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8edb9-12c7-4c70-a622-e8bb6c93e1e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:22.733946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8edb9-12c7-4c70-a622-e8bb6c93e1e6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:22.757682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0748977-f544-4bc8-9cb4-3992be53bcb3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:22.761900 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3628/7258] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:22.777521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8edb9-12c7-4c70-a622-e8bb6c93e1e6 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:22.780824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5855ead-2fd6-48dc-96c2-02d35cc167a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:22.782775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5855ead-2fd6-48dc-96c2-02d35cc167a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:22.785080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5855ead-2fd6-48dc-96c2-02d35cc167a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:22.785973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5855ead-2fd6-48dc-96c2-02d35cc167a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:22.792688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f5855ead-2fd6-48dc-96c2-02d35cc167a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:22.808317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8edb9-12c7-4c70-a622-e8bb6c93e1e6 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:22.816524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3609d06-7df7-4b31-94c0-9460ae40a9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:22.817335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3609d06-7df7-4b31-94c0-9460ae40a9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:22.818550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3609d06-7df7-4b31-94c0-9460ae40a9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:22.818834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3609d06-7df7-4b31-94c0-9460ae40a9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:22.819528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3609d06-7df7-4b31-94c0-9460ae40a9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:22.822407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3609d06-7df7-4b31-94c0-9460ae40a9e0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:22.850152 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3629/7259] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:22.851066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3609d06-7df7-4b31-94c0-9460ae40a9e0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:22.857466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f3609d06-7df7-4b31-94c0-9460ae40a9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:22.887442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3609d06-7df7-4b31-94c0-9460ae40a9e0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:22.894235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819ed2c-0862-4d10-8af9-2c3a33354a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:22.894889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819ed2c-0862-4d10-8af9-2c3a33354a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:22.895356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819ed2c-0862-4d10-8af9-2c3a33354a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:22.895631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819ed2c-0862-4d10-8af9-2c3a33354a97 admin admin] PATH_INFO: `/v3/projects/6ac7a291dac04743bbc4113d4d554c86` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:22.908423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819ed2c-0862-4d10-8af9-2c3a33354a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ac7a291dac04743bbc4113d4d554c86)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:22.910247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819ed2c-0862-4d10-8af9-2c3a33354a97 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:22.999672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5855ead-2fd6-48dc-96c2-02d35cc167a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:23.004292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5855ead-2fd6-48dc-96c2-02d35cc167a7 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:23.018588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b819ed2c-0862-4d10-8af9-2c3a33354a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ac7a291dac04743bbc4113d4d554c86', 'request_id': 'req-b819ed2c-0862-4d10-8af9-2c3a33354a97'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:23.032505 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3631/7260] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:23.034743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5855ead-2fd6-48dc-96c2-02d35cc167a7 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:23.037749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b819ed2c-0862-4d10-8af9-2c3a33354a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ac7a291dac04743bbc4113d4d554c86', 'request_id': 'req-b819ed2c-0862-4d10-8af9-2c3a33354a97'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:23.059656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b819ed2c-0862-4d10-8af9-2c3a33354a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ac7a291dac04743bbc4113d4d554c86', 'request_id': 'req-b819ed2c-0862-4d10-8af9-2c3a33354a97'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:23.061106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5855ead-2fd6-48dc-96c2-02d35cc167a7 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:23.112623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b819ed2c-0862-4d10-8af9-2c3a33354a97 admin admin] The token cache is being invalidate because project 6ac7a291dac04743bbc4113d4d554c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:23.115330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b819ed2c-0862-4d10-8af9-2c3a33354a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:23.116507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b819ed2c-0862-4d10-8af9-2c3a33354a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:23.122805 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3630/7261] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:22 2022] DELETE /identity/v3/projects/6ac7a291dac04743bbc4113d4d554c86 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:23.126758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819ed2c-0862-4d10-8af9-2c3a33354a97 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:23.128514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b819ed2c-0862-4d10-8af9-2c3a33354a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:23.225843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934712e-47c1-4a3e-b414-bfcda53c67fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:23.227286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934712e-47c1-4a3e-b414-bfcda53c67fd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:23.227286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934712e-47c1-4a3e-b414-bfcda53c67fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:23.234202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934712e-47c1-4a3e-b414-bfcda53c67fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:23.235136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934712e-47c1-4a3e-b414-bfcda53c67fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:23.240514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934712e-47c1-4a3e-b414-bfcda53c67fd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:23.275145 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3632/7262] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:23.278071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934712e-47c1-4a3e-b414-bfcda53c67fd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:23.284019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c934712e-47c1-4a3e-b414-bfcda53c67fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:23.315139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934712e-47c1-4a3e-b414-bfcda53c67fd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:23.324286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45958d-59b5-4593-a930-02a28a179665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:23.327204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45958d-59b5-4593-a930-02a28a179665 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:23.327704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45958d-59b5-4593-a930-02a28a179665 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:23.328704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45958d-59b5-4593-a930-02a28a179665 admin admin] PATH_INFO: `/v3/projects/d7f8be9b02ce4c0c90bd997a77b4d13b/users/2fd55b3ff7ad47d69f0f7b5aed7ec40c/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:23.341335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:23.388654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45958d-59b5-4593-a930-02a28a179665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f8be9b02ce4c0c90bd997a77b4d13b, user_id=2fd55b3ff7ad47d69f0f7b5aed7ec40c, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:23.393161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45958d-59b5-4593-a930-02a28a179665 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:23.408173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819ed2c-0862-4d10-8af9-2c3a33354a97 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:23.433603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e5977-d0a2-4b91-b7fd-2900cefddd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:23.435394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e5977-d0a2-4b91-b7fd-2900cefddd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:23.435613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e5977-d0a2-4b91-b7fd-2900cefddd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:23.437874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e5977-d0a2-4b91-b7fd-2900cefddd24 admin admin] PATH_INFO: `/v3/users/67ab2c6b11fc4a44aea88909573b3d85` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:23.442304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e5977-d0a2-4b91-b7fd-2900cefddd24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ab2c6b11fc4a44aea88909573b3d85)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:23.455190 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3633/7263] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:23 2022] PUT /identity/v3/projects/d7f8be9b02ce4c0c90bd997a77b4d13b/users/2fd55b3ff7ad47d69f0f7b5aed7ec40c/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:23.457386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e5977-d0a2-4b91-b7fd-2900cefddd24 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:23.460865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831657b4-2c1c-4ffc-81b7-85b2a3f5c5ba None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:23.461451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831657b4-2c1c-4ffc-81b7-85b2a3f5c5ba None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:23.462268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831657b4-2c1c-4ffc-81b7-85b2a3f5c5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:23.528986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-831657b4-2c1c-4ffc-81b7-85b2a3f5c5ba None None] MFA Rules not processed for user `2fd55b3ff7ad47d69f0f7b5aed7ec40c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:23.537782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-831657b4-2c1c-4ffc-81b7-85b2a3f5c5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:23.563297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:23.630808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d3e5977-d0a2-4b91-b7fd-2900cefddd24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ab2c6b11fc4a44aea88909573b3d85'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:23.631557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d3e5977-d0a2-4b91-b7fd-2900cefddd24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ab2c6b11fc4a44aea88909573b3d85'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:23.651344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d3e5977-d0a2-4b91-b7fd-2900cefddd24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ab2c6b11fc4a44aea88909573b3d85'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:23.669642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d3e5977-d0a2-4b91-b7fd-2900cefddd24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ab2c6b11fc4a44aea88909573b3d85'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:23.697519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d3e5977-d0a2-4b91-b7fd-2900cefddd24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ab2c6b11fc4a44aea88909573b3d85'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:23.722864 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3631/7264] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:23 2022] DELETE /identity/v3/users/67ab2c6b11fc4a44aea88909573b3d85 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:51:23.728100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e5977-d0a2-4b91-b7fd-2900cefddd24 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:23.732551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d3e5977-d0a2-4b91-b7fd-2900cefddd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:23.767741 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3634/7265] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:23.777153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831657b4-2c1c-4ffc-81b7-85b2a3f5c5ba None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:23.780107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-831657b4-2c1c-4ffc-81b7-85b2a3f5c5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:23.905984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831657b4-2c1c-4ffc-81b7-85b2a3f5c5ba None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:23.950710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e5977-d0a2-4b91-b7fd-2900cefddd24 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:23.966948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f8d6f-88c2-45b4-afb0-92019c133474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:23.972492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f8d6f-88c2-45b4-afb0-92019c133474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:23.972778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f8d6f-88c2-45b4-afb0-92019c133474 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:23.973057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f8d6f-88c2-45b4-afb0-92019c133474 admin admin] PATH_INFO: `/v3/projects/f9c55edd41bd4235bfcefda60ce3a48e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:23.974341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f8d6f-88c2-45b4-afb0-92019c133474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c55edd41bd4235bfcefda60ce3a48e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:23.977340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f8d6f-88c2-45b4-afb0-92019c133474 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:24.026674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab90462-090a-42cf-a30e-dccd5ca3be5d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:24.027922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab90462-090a-42cf-a30e-dccd5ca3be5d service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:24.027922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab90462-090a-42cf-a30e-dccd5ca3be5d service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:24.028231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab90462-090a-42cf-a30e-dccd5ca3be5d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:24.072825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f27f8d6f-88c2-45b4-afb0-92019c133474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c55edd41bd4235bfcefda60ce3a48e', 'request_id': 'req-f27f8d6f-88c2-45b4-afb0-92019c133474'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:24.102688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f27f8d6f-88c2-45b4-afb0-92019c133474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c55edd41bd4235bfcefda60ce3a48e', 'request_id': 'req-f27f8d6f-88c2-45b4-afb0-92019c133474'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:24.114117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f27f8d6f-88c2-45b4-afb0-92019c133474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c55edd41bd4235bfcefda60ce3a48e', 'request_id': 'req-f27f8d6f-88c2-45b4-afb0-92019c133474'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:24.149675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f27f8d6f-88c2-45b4-afb0-92019c133474 admin admin] The token cache is being invalidate because project f9c55edd41bd4235bfcefda60ce3a48e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:24.150070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f27f8d6f-88c2-45b4-afb0-92019c133474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:24.150837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f27f8d6f-88c2-45b4-afb0-92019c133474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:24.152726 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3632/7266] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:23 2022] DELETE /identity/v3/projects/f9c55edd41bd4235bfcefda60ce3a48e => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:24.157527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dded7-1cc6-4f84-8ed0-5036333965dc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:24.157811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dded7-1cc6-4f84-8ed0-5036333965dc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:24.158339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:24.158825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dded7-1cc6-4f84-8ed0-5036333965dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:24.195693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab90462-090a-42cf-a30e-dccd5ca3be5d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:24.197763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab90462-090a-42cf-a30e-dccd5ca3be5d service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:24.199113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-374dded7-1cc6-4f84-8ed0-5036333965dc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:24.200561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-374dded7-1cc6-4f84-8ed0-5036333965dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:24.219715 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3635/7267] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:24.273803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:24.338443 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3633/7268] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:51:24.349660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2caed-efe5-4bf6-83e8-0e344f170789 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:24.350187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2caed-efe5-4bf6-83e8-0e344f170789 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:24.350611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2caed-efe5-4bf6-83e8-0e344f170789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:24.375299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-58d2caed-efe5-4bf6-83e8-0e344f170789 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:24.376798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-58d2caed-efe5-4bf6-83e8-0e344f170789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:24.385475 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3636/7269] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:24.389728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dded7-1cc6-4f84-8ed0-5036333965dc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:24.411728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dded7-1cc6-4f84-8ed0-5036333965dc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:24.418996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53ee46-f11a-46a5-9604-6fd87f89f5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:24.419987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53ee46-f11a-46a5-9604-6fd87f89f5ac admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:24.420336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53ee46-f11a-46a5-9604-6fd87f89f5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:24.420695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53ee46-f11a-46a5-9604-6fd87f89f5ac admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:24.421422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53ee46-f11a-46a5-9604-6fd87f89f5ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:24.421834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53ee46-f11a-46a5-9604-6fd87f89f5ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:24.426911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53ee46-f11a-46a5-9604-6fd87f89f5ac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:24.461486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2caed-efe5-4bf6-83e8-0e344f170789 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:24.461701 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3634/7270] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:24.489188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2caed-efe5-4bf6-83e8-0e344f170789 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:24.527626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b33cd-3383-45c3-9c8b-515115294e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:24.528537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b33cd-3383-45c3-9c8b-515115294e0f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:24.528972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b33cd-3383-45c3-9c8b-515115294e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:24.529427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b33cd-3383-45c3-9c8b-515115294e0f admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:24.534652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b33cd-3383-45c3-9c8b-515115294e0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:24.542217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b33cd-3383-45c3-9c8b-515115294e0f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:24.644823 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3637/7271] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:24 2022] POST /identity/v3/projects => generated 405 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:51:24.649066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53ee46-f11a-46a5-9604-6fd87f89f5ac admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:24.662433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53ee46-f11a-46a5-9604-6fd87f89f5ac admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:24.794944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52ce19-9fdf-40b8-8d16-fa9d840fcf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:24.795626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52ce19-9fdf-40b8-8d16-fa9d840fcf7c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:24.795954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52ce19-9fdf-40b8-8d16-fa9d840fcf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:24.796231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52ce19-9fdf-40b8-8d16-fa9d840fcf7c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:24.796934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52ce19-9fdf-40b8-8d16-fa9d840fcf7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:24.798911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52ce19-9fdf-40b8-8d16-fa9d840fcf7c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:24.839320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b33cd-3383-45c3-9c8b-515115294e0f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:24.841174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-621b33cd-3383-45c3-9c8b-515115294e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:24.856698 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3635/7272] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:24 2022] POST /identity/v3/users => generated 303 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:51:24.861718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52ce19-9fdf-40b8-8d16-fa9d840fcf7c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:24.885291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b33cd-3383-45c3-9c8b-515115294e0f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:24.894081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52ce19-9fdf-40b8-8d16-fa9d840fcf7c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:24.897787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067a952-6a28-4f9d-8ffa-9078ccbd92b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:24.898442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067a952-6a28-4f9d-8ffa-9078ccbd92b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:24.898717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067a952-6a28-4f9d-8ffa-9078ccbd92b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:24.899655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067a952-6a28-4f9d-8ffa-9078ccbd92b2 admin admin] PATH_INFO: `/v3/projects/efbd3f789d474fdda6e2ca3098c9bb29` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:24.901693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067a952-6a28-4f9d-8ffa-9078ccbd92b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efbd3f789d474fdda6e2ca3098c9bb29)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:24.903727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067a952-6a28-4f9d-8ffa-9078ccbd92b2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:24.922158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99a816-b262-4607-aeb8-3e19c6eb8f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:24.922795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99a816-b262-4607-aeb8-3e19c6eb8f7b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:24.923071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99a816-b262-4607-aeb8-3e19c6eb8f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:24.923371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99a816-b262-4607-aeb8-3e19c6eb8f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:24.924027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99a816-b262-4607-aeb8-3e19c6eb8f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:24.925645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99a816-b262-4607-aeb8-3e19c6eb8f7b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:24.959590 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3636/7273] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:24.961763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99a816-b262-4607-aeb8-3e19c6eb8f7b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:24.982623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99a816-b262-4607-aeb8-3e19c6eb8f7b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:24.999441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c377f16-41d3-4542-9fe1-695104aa7fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:25.001840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c377f16-41d3-4542-9fe1-695104aa7fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:25.002429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c377f16-41d3-4542-9fe1-695104aa7fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:25.002725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c377f16-41d3-4542-9fe1-695104aa7fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:25.004780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c377f16-41d3-4542-9fe1-695104aa7fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:25.008908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c377f16-41d3-4542-9fe1-695104aa7fa2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:25.026069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0067a952-6a28-4f9d-8ffa-9078ccbd92b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efbd3f789d474fdda6e2ca3098c9bb29', 'request_id': 'req-0067a952-6a28-4f9d-8ffa-9078ccbd92b2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:25.032174 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3637/7274] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:25.036060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c377f16-41d3-4542-9fe1-695104aa7fa2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:25.039441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0067a952-6a28-4f9d-8ffa-9078ccbd92b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efbd3f789d474fdda6e2ca3098c9bb29', 'request_id': 'req-0067a952-6a28-4f9d-8ffa-9078ccbd92b2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:25.058951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0067a952-6a28-4f9d-8ffa-9078ccbd92b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efbd3f789d474fdda6e2ca3098c9bb29', 'request_id': 'req-0067a952-6a28-4f9d-8ffa-9078ccbd92b2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:25.062751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c377f16-41d3-4542-9fe1-695104aa7fa2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:25.085504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0067a952-6a28-4f9d-8ffa-9078ccbd92b2 admin admin] The token cache is being invalidate because project efbd3f789d474fdda6e2ca3098c9bb29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:25.085815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0067a952-6a28-4f9d-8ffa-9078ccbd92b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:25.091171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0067a952-6a28-4f9d-8ffa-9078ccbd92b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:25.093896 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3638/7275] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:24 2022] DELETE /identity/v3/projects/efbd3f789d474fdda6e2ca3098c9bb29 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:51:25.098573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4103498-a99a-42d3-9bc0-0cbc5de97a07 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:25.099248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4103498-a99a-42d3-9bc0-0cbc5de97a07 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:25.099985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4103498-a99a-42d3-9bc0-0cbc5de97a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:25.126629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f4103498-a99a-42d3-9bc0-0cbc5de97a07 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:25.128336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f4103498-a99a-42d3-9bc0-0cbc5de97a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:25.207993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b4e7b-97eb-469e-b11c-639ce2bbd249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:25.209294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b4e7b-97eb-469e-b11c-639ce2bbd249 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:25.209603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b4e7b-97eb-469e-b11c-639ce2bbd249 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:25.210116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b4e7b-97eb-469e-b11c-639ce2bbd249 admin admin] PATH_INFO: `/v3/projects/191b3625211142c9b1fdb43ecf3ce143/users/4092f136affb40698983b7e55965a865/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:25.246290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b4e7b-97eb-469e-b11c-639ce2bbd249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=191b3625211142c9b1fdb43ecf3ce143, user_id=4092f136affb40698983b7e55965a865, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:25.253640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b4e7b-97eb-469e-b11c-639ce2bbd249 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:25.268805 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3639/7276] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:51:25.277395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4667c92-3692-4dd1-9b61-993d1764afaa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:25.278621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4667c92-3692-4dd1-9b61-993d1764afaa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:25.278917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4667c92-3692-4dd1-9b61-993d1764afaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:25.306146 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3638/7277] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:25 2022] PUT /identity/v3/projects/191b3625211142c9b1fdb43ecf3ce143/users/4092f136affb40698983b7e55965a865/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:25.316961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183148a8-5568-4ac5-aa4c-5c4814ab5b42 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:25.317593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183148a8-5568-4ac5-aa4c-5c4814ab5b42 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:25.317938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183148a8-5568-4ac5-aa4c-5c4814ab5b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:25.365791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a4667c92-3692-4dd1-9b61-993d1764afaa None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:25.367023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a4667c92-3692-4dd1-9b61-993d1764afaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:25.400914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:25.421371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-183148a8-5568-4ac5-aa4c-5c4814ab5b42 None None] MFA Rules not processed for user `4092f136affb40698983b7e55965a865`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:25.424383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-183148a8-5568-4ac5-aa4c-5c4814ab5b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:25.439717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:25.504409 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3640/7278] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:25.509543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4667c92-3692-4dd1-9b61-993d1764afaa None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:25.533867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4667c92-3692-4dd1-9b61-993d1764afaa None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:25.546812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9abc4-2048-4bf4-8d16-190c4cd1b06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:25.547544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9abc4-2048-4bf4-8d16-190c4cd1b06a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:25.549791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9abc4-2048-4bf4-8d16-190c4cd1b06a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:25.549791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9abc4-2048-4bf4-8d16-190c4cd1b06a admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:25.550506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9abc4-2048-4bf4-8d16-190c4cd1b06a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:25.551783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9abc4-2048-4bf4-8d16-190c4cd1b06a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:25.555563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9abc4-2048-4bf4-8d16-190c4cd1b06a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:25.612681 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3641/7279] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:25.613663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9abc4-2048-4bf4-8d16-190c4cd1b06a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:25.634513 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3639/7280] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:25 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:25.636817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183148a8-5568-4ac5-aa4c-5c4814ab5b42 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:25.641161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-183148a8-5568-4ac5-aa4c-5c4814ab5b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:25.642457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9abc4-2048-4bf4-8d16-190c4cd1b06a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:25.655126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c9aa3-e7d7-4479-b353-986458d68945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:25.656553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c9aa3-e7d7-4479-b353-986458d68945 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:25.656843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c9aa3-e7d7-4479-b353-986458d68945 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:25.657125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c9aa3-e7d7-4479-b353-986458d68945 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:25.658814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c9aa3-e7d7-4479-b353-986458d68945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:25.662013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c9aa3-e7d7-4479-b353-986458d68945 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:25.694347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183148a8-5568-4ac5-aa4c-5c4814ab5b42 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:25.705775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523eb85b-d197-46cc-82f2-f695766e85aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:25.707075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eb85b-d197-46cc-82f2-f695766e85aa admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:25.707626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eb85b-d197-46cc-82f2-f695766e85aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:25.708775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eb85b-d197-46cc-82f2-f695766e85aa admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:25.709835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523eb85b-d197-46cc-82f2-f695766e85aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:25.713170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523eb85b-d197-46cc-82f2-f695766e85aa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:25.756184 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3642/7281] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:25 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:25.758074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c9aa3-e7d7-4479-b353-986458d68945 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:25.806601 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3640/7282] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:25 2022] POST /identity/v3/projects => generated 407 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:25.808299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523eb85b-d197-46cc-82f2-f695766e85aa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:25.955323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c9aa3-e7d7-4479-b353-986458d68945 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:25.975304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523eb85b-d197-46cc-82f2-f695766e85aa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:25.978557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a667e-4029-45ad-8988-238103703ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:25.979301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a667e-4029-45ad-8988-238103703ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:25.979654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a667e-4029-45ad-8988-238103703ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:25.979992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a667e-4029-45ad-8988-238103703ba0 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:25.980730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a667e-4029-45ad-8988-238103703ba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:25.982780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a667e-4029-45ad-8988-238103703ba0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:25.999343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad61fa6-be5d-4c7c-8ef7-48f842f5d122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:26.001127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad61fa6-be5d-4c7c-8ef7-48f842f5d122 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:26.001511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad61fa6-be5d-4c7c-8ef7-48f842f5d122 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:26.001710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad61fa6-be5d-4c7c-8ef7-48f842f5d122 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:26.003369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad61fa6-be5d-4c7c-8ef7-48f842f5d122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:26.009283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad61fa6-be5d-4c7c-8ef7-48f842f5d122 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:26.029212 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3643/7283] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:25 2022] POST /identity/v3/users => generated 294 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:26.033642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a667e-4029-45ad-8988-238103703ba0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:26.047737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a667e-4029-45ad-8988-238103703ba0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:26.069728 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3641/7284] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:25 2022] POST /identity/v3/users => generated 310 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:26.070014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fad51-a846-440b-8884-fff204a4dadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:26.070533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fad51-a846-440b-8884-fff204a4dadf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:26.070715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fad51-a846-440b-8884-fff204a4dadf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:26.071153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fad51-a846-440b-8884-fff204a4dadf admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:26.072494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fad51-a846-440b-8884-fff204a4dadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:26.074138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fad51-a846-440b-8884-fff204a4dadf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:26.074928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad61fa6-be5d-4c7c-8ef7-48f842f5d122 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:26.103487 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3644/7285] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:51:26.105656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad61fa6-be5d-4c7c-8ef7-48f842f5d122 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:26.107765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fad51-a846-440b-8884-fff204a4dadf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:26.119433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be83386-03fb-40d8-a121-6898d47caacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:26.123224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fad51-a846-440b-8884-fff204a4dadf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:26.130591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be83386-03fb-40d8-a121-6898d47caacb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:26.130901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be83386-03fb-40d8-a121-6898d47caacb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:26.131174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be83386-03fb-40d8-a121-6898d47caacb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:26.136608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be83386-03fb-40d8-a121-6898d47caacb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:26.138331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be83386-03fb-40d8-a121-6898d47caacb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:26.142740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7b598-e118-49ea-94cb-e4a8f0fdfb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:26.145323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7b598-e118-49ea-94cb-e4a8f0fdfb11 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:26.146878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7b598-e118-49ea-94cb-e4a8f0fdfb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:26.147393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7b598-e118-49ea-94cb-e4a8f0fdfb11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:26.150966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7b598-e118-49ea-94cb-e4a8f0fdfb11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:26.160200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7b598-e118-49ea-94cb-e4a8f0fdfb11 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:26.162182 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3642/7286] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:26.168689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be83386-03fb-40d8-a121-6898d47caacb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:26.184703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be83386-03fb-40d8-a121-6898d47caacb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:26.192427 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3645/7287] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:26.194265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7b598-e118-49ea-94cb-e4a8f0fdfb11 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:26.195049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46047bf-25cb-4832-a3ca-ab568d27410b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:26.195860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46047bf-25cb-4832-a3ca-ab568d27410b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:26.196278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46047bf-25cb-4832-a3ca-ab568d27410b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:26.196560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46047bf-25cb-4832-a3ca-ab568d27410b admin admin] PATH_INFO: `/v3/projects/8161473ea9774b7d825c4fbbb9d71c93/users/9ff9177b7ec4438da2707e3b05eecd8f/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:26.220869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7b598-e118-49ea-94cb-e4a8f0fdfb11 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:26.254216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98176797-4d7b-4ae5-9950-c5d87ad6f9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:26.257376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176797-4d7b-4ae5-9950-c5d87ad6f9cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:26.257662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176797-4d7b-4ae5-9950-c5d87ad6f9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:26.257927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176797-4d7b-4ae5-9950-c5d87ad6f9cd admin admin] PATH_INFO: `/v3/projects/a67ba3f74f974fd2ae608fbcd1b94525/users/702eab1e1cf54579bbf12e4cb588cf9b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:26.264349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46047bf-25cb-4832-a3ca-ab568d27410b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8161473ea9774b7d825c4fbbb9d71c93, user_id=9ff9177b7ec4438da2707e3b05eecd8f, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:26.272478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46047bf-25cb-4832-a3ca-ab568d27410b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:26.295470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98176797-4d7b-4ae5-9950-c5d87ad6f9cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a67ba3f74f974fd2ae608fbcd1b94525, user_id=702eab1e1cf54579bbf12e4cb588cf9b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:26.305757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98176797-4d7b-4ae5-9950-c5d87ad6f9cd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:26.309734 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3643/7288] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:26 2022] PUT /identity/v3/projects/8161473ea9774b7d825c4fbbb9d71c93/users/9ff9177b7ec4438da2707e3b05eecd8f/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:26.313513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46047bf-25cb-4832-a3ca-ab568d27410b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:26.350094 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3646/7289] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:26 2022] PUT /identity/v3/projects/a67ba3f74f974fd2ae608fbcd1b94525/users/702eab1e1cf54579bbf12e4cb588cf9b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:26.353709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd892554-3e56-423e-aad5-64d354417642 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:26.369060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd892554-3e56-423e-aad5-64d354417642 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:26.370140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd892554-3e56-423e-aad5-64d354417642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:26.449872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:26.452225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fd892554-3e56-423e-aad5-64d354417642 None None] MFA Rules not processed for user `702eab1e1cf54579bbf12e4cb588cf9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:26.453590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fd892554-3e56-423e-aad5-64d354417642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:26.496895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:26.534765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46047bf-25cb-4832-a3ca-ab568d27410b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:26.577045 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3647/7290] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:26.577045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd892554-3e56-423e-aad5-64d354417642 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:26.577665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fd892554-3e56-423e-aad5-64d354417642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:26.684948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526134a1-e774-4ba3-adea-6fbbf02dbf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:26.685802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526134a1-e774-4ba3-adea-6fbbf02dbf17 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:26.686321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526134a1-e774-4ba3-adea-6fbbf02dbf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:26.687006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526134a1-e774-4ba3-adea-6fbbf02dbf17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:26.688047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526134a1-e774-4ba3-adea-6fbbf02dbf17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:26.689898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526134a1-e774-4ba3-adea-6fbbf02dbf17 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:26.707431 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3644/7291] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:26.708680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526134a1-e774-4ba3-adea-6fbbf02dbf17 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:26.724184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526134a1-e774-4ba3-adea-6fbbf02dbf17 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:26.730079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a295e7-c790-45e0-9613-494fee13555d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:26.730905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a295e7-c790-45e0-9613-494fee13555d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:26.731410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a295e7-c790-45e0-9613-494fee13555d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:26.732698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a295e7-c790-45e0-9613-494fee13555d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:26.733675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a295e7-c790-45e0-9613-494fee13555d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:26.741340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd892554-3e56-423e-aad5-64d354417642 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:26.749456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4b19f-a1a5-4454-8ac0-d4494550221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:26.750117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4b19f-a1a5-4454-8ac0-d4494550221e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:26.750399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4b19f-a1a5-4454-8ac0-d4494550221e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:26.750682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4b19f-a1a5-4454-8ac0-d4494550221e admin admin] PATH_INFO: `/v3/users/2fd55b3ff7ad47d69f0f7b5aed7ec40c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:26.754238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4b19f-a1a5-4454-8ac0-d4494550221e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd55b3ff7ad47d69f0f7b5aed7ec40c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:26.755998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a295e7-c790-45e0-9613-494fee13555d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:26.756235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4b19f-a1a5-4454-8ac0-d4494550221e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:26.838242 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3645/7292] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:26 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:26.840485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a295e7-c790-45e0-9613-494fee13555d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:26.849469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fdf4b19f-a1a5-4454-8ac0-d4494550221e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd55b3ff7ad47d69f0f7b5aed7ec40c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:26.864694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fdf4b19f-a1a5-4454-8ac0-d4494550221e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd55b3ff7ad47d69f0f7b5aed7ec40c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:26.865396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fdf4b19f-a1a5-4454-8ac0-d4494550221e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd55b3ff7ad47d69f0f7b5aed7ec40c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:26.866118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fdf4b19f-a1a5-4454-8ac0-d4494550221e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd55b3ff7ad47d69f0f7b5aed7ec40c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:26.881064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fdf4b19f-a1a5-4454-8ac0-d4494550221e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd55b3ff7ad47d69f0f7b5aed7ec40c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:26.915426 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3648/7293] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:26 2022] DELETE /identity/v3/users/2fd55b3ff7ad47d69f0f7b5aed7ec40c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:26.918548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4b19f-a1a5-4454-8ac0-d4494550221e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:26.922066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fdf4b19f-a1a5-4454-8ac0-d4494550221e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:26.995144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a295e7-c790-45e0-9613-494fee13555d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:27.042112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:27.052542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4b19f-a1a5-4454-8ac0-d4494550221e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:27.062775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732a29f-252a-44df-8761-c8455cc722cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:27.063728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732a29f-252a-44df-8761-c8455cc722cf admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:27.064169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732a29f-252a-44df-8761-c8455cc722cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:27.064605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732a29f-252a-44df-8761-c8455cc722cf admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:27.066117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732a29f-252a-44df-8761-c8455cc722cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:27.068317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732a29f-252a-44df-8761-c8455cc722cf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:27.100084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77028b-30ed-4483-ac80-45cf31cd275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:27.102455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77028b-30ed-4483-ac80-45cf31cd275f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:27.102763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77028b-30ed-4483-ac80-45cf31cd275f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:27.103957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77028b-30ed-4483-ac80-45cf31cd275f admin admin] PATH_INFO: `/v3/projects/8161473ea9774b7d825c4fbbb9d71c93/users/9ff9177b7ec4438da2707e3b05eecd8f/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:27.111304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77028b-30ed-4483-ac80-45cf31cd275f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8161473ea9774b7d825c4fbbb9d71c93, user_id=9ff9177b7ec4438da2707e3b05eecd8f, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:27.114976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77028b-30ed-4483-ac80-45cf31cd275f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:27.115508 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3649/7294] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:26 2022] POST /identity/v3/users => generated 299 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:27.117431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da7762-8aa1-430c-a2d5-19e7132f5662 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:27.117970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da7762-8aa1-430c-a2d5-19e7132f5662 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:27.118408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da7762-8aa1-430c-a2d5-19e7132f5662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:27.126808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:27.148270 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3646/7295] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:26 2022] PUT /identity/v3/projects/8161473ea9774b7d825c4fbbb9d71c93/users/9ff9177b7ec4438da2707e3b05eecd8f/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:27.150862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77028b-30ed-4483-ac80-45cf31cd275f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:27.163462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-39da7762-8aa1-430c-a2d5-19e7132f5662 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:27.164717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-39da7762-8aa1-430c-a2d5-19e7132f5662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:27.322176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77028b-30ed-4483-ac80-45cf31cd275f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:27.328117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3e93b-8405-4b86-8032-2f7d8af51378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:27.328735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3e93b-8405-4b86-8032-2f7d8af51378 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:27.329101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3e93b-8405-4b86-8032-2f7d8af51378 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:27.329374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3e93b-8405-4b86-8032-2f7d8af51378 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:27.330245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3e93b-8405-4b86-8032-2f7d8af51378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:27.332038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3e93b-8405-4b86-8032-2f7d8af51378 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:27.336417 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3650/7296] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:27.345397 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3647/7297] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:27.350734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3e93b-8405-4b86-8032-2f7d8af51378 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:27.352932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418a34c-5668-4ae9-906e-321f760195cd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:27.353330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418a34c-5668-4ae9-906e-321f760195cd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:27.353615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418a34c-5668-4ae9-906e-321f760195cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:27.391673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3e93b-8405-4b86-8032-2f7d8af51378 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:27.401129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6386768-594b-47f3-9a45-b996fbe23562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:27.402079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6386768-594b-47f3-9a45-b996fbe23562 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:27.402516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6386768-594b-47f3-9a45-b996fbe23562 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:27.404270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6386768-594b-47f3-9a45-b996fbe23562 admin admin] PATH_INFO: `/v3/projects/bd14c6ca01be4fce91741e74edfbe576/users/a94161d13e4e4ce7afe5659591c7807c/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:27.431416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7418a34c-5668-4ae9-906e-321f760195cd None None] MFA Rules not processed for user `9ff9177b7ec4438da2707e3b05eecd8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:27.431751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6386768-594b-47f3-9a45-b996fbe23562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd14c6ca01be4fce91741e74edfbe576, user_id=a94161d13e4e4ce7afe5659591c7807c, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:27.432652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7418a34c-5668-4ae9-906e-321f760195cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:27.437538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6386768-594b-47f3-9a45-b996fbe23562 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:27.468245 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3648/7298] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:27 2022] PUT /identity/v3/projects/bd14c6ca01be4fce91741e74edfbe576/users/a94161d13e4e4ce7afe5659591c7807c/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:27.468977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6386768-594b-47f3-9a45-b996fbe23562 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:27.473757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6386768-594b-47f3-9a45-b996fbe23562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:27.613049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6386768-594b-47f3-9a45-b996fbe23562 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:27.625797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10898326-7052-4023-8748-de2197ea28c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:27.626627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10898326-7052-4023-8748-de2197ea28c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:27.627090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10898326-7052-4023-8748-de2197ea28c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:27.627422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10898326-7052-4023-8748-de2197ea28c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:27.639197 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3651/7299] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:27 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:27.640713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418a34c-5668-4ae9-906e-321f760195cd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:27.677593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418a34c-5668-4ae9-906e-321f760195cd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:27.781220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10898326-7052-4023-8748-de2197ea28c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:27.782747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10898326-7052-4023-8748-de2197ea28c3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:27.794533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d96791-1721-4e2e-b1f4-03f2dd232986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:27.795378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d96791-1721-4e2e-b1f4-03f2dd232986 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:27.795823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d96791-1721-4e2e-b1f4-03f2dd232986 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:27.796316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d96791-1721-4e2e-b1f4-03f2dd232986 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:27.797071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d96791-1721-4e2e-b1f4-03f2dd232986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:27.798893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d96791-1721-4e2e-b1f4-03f2dd232986 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:27.805249 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3649/7300] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:27.808074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10898326-7052-4023-8748-de2197ea28c3 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:27.809403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-10898326-7052-4023-8748-de2197ea28c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:27.812783 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3652/7301] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:27.813955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d96791-1721-4e2e-b1f4-03f2dd232986 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:27.816949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-26d96791-1721-4e2e-b1f4-03f2dd232986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:27.835824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d96791-1721-4e2e-b1f4-03f2dd232986 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:27.868592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:27.871783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb8e18-1fb1-43fb-9b13-969a76e9a004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:27.875696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb8e18-1fb1-43fb-9b13-969a76e9a004 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:27.876629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb8e18-1fb1-43fb-9b13-969a76e9a004 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:27.881465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb8e18-1fb1-43fb-9b13-969a76e9a004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:27.888153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-13cb8e18-1fb1-43fb-9b13-969a76e9a004 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:27.915827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:27.974946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10898326-7052-4023-8748-de2197ea28c3 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:27.981738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a416d11-3465-4946-8e0a-93e0479eb9c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:27.982366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a416d11-3465-4946-8e0a-93e0479eb9c9 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:27.982700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a416d11-3465-4946-8e0a-93e0479eb9c9 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:27.982981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a416d11-3465-4946-8e0a-93e0479eb9c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:27.985534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a416d11-3465-4946-8e0a-93e0479eb9c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:28.011195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a416d11-3465-4946-8e0a-93e0479eb9c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:28.015721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a416d11-3465-4946-8e0a-93e0479eb9c9 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:28.055129 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3650/7302] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:28.056591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a416d11-3465-4946-8e0a-93e0479eb9c9 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:28.089186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a416d11-3465-4946-8e0a-93e0479eb9c9 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:28.108235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83031530-f04e-4ab0-8161-456acc241949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:28.108974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83031530-f04e-4ab0-8161-456acc241949 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:28.109244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83031530-f04e-4ab0-8161-456acc241949 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:28.109522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83031530-f04e-4ab0-8161-456acc241949 admin admin] PATH_INFO: `/v3/projects/bd14c6ca01be4fce91741e74edfbe576/users/a94161d13e4e4ce7afe5659591c7807c/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:28.115344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83031530-f04e-4ab0-8161-456acc241949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd14c6ca01be4fce91741e74edfbe576, user_id=a94161d13e4e4ce7afe5659591c7807c, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:28.124763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83031530-f04e-4ab0-8161-456acc241949 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:28.143032 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3651/7303] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:28 2022] PUT /identity/v3/projects/bd14c6ca01be4fce91741e74edfbe576/users/a94161d13e4e4ce7afe5659591c7807c/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:28.144418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83031530-f04e-4ab0-8161-456acc241949 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:28.166025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb8e18-1fb1-43fb-9b13-969a76e9a004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:28.170424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb8e18-1fb1-43fb-9b13-969a76e9a004 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:28.196007 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3653/7304] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:27 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:28.198863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aba64-947f-4310-a440-fb723f7dcbd4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:28.201016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aba64-947f-4310-a440-fb723f7dcbd4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:28.201016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aba64-947f-4310-a440-fb723f7dcbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:28.252678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-794aba64-947f-4310-a440-fb723f7dcbd4 None None] MFA Rules not processed for user `a94161d13e4e4ce7afe5659591c7807c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:28.256407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-794aba64-947f-4310-a440-fb723f7dcbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:28.361538 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3654/7305] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:28.362374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aba64-947f-4310-a440-fb723f7dcbd4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:28.364005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-794aba64-947f-4310-a440-fb723f7dcbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:28.382208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83031530-f04e-4ab0-8161-456acc241949 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:28.390667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c5b38-4747-4efc-8edb-90274e841e27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:28.391318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c5b38-4747-4efc-8edb-90274e841e27 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:28.391601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c5b38-4747-4efc-8edb-90274e841e27 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:28.391874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c5b38-4747-4efc-8edb-90274e841e27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:28.396663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c04c5b38-4747-4efc-8edb-90274e841e27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:28.456432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aba64-947f-4310-a440-fb723f7dcbd4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:28.462334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72b4df-d810-478f-9574-71c4cb5302d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:28.463174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72b4df-d810-478f-9574-71c4cb5302d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:28.463489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72b4df-d810-478f-9574-71c4cb5302d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:28.463774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72b4df-d810-478f-9574-71c4cb5302d6 admin admin] PATH_INFO: `/v3/users/3afce090f88e408da3e2672850f3cd54` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:28.465019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72b4df-d810-478f-9574-71c4cb5302d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3afce090f88e408da3e2672850f3cd54)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:28.466976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72b4df-d810-478f-9574-71c4cb5302d6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:28.533805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c5b38-4747-4efc-8edb-90274e841e27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:28.535467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c5b38-4747-4efc-8edb-90274e841e27 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:28.540801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:28.557487 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3652/7306] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:28.558438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c5b38-4747-4efc-8edb-90274e841e27 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:28.564894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c04c5b38-4747-4efc-8edb-90274e841e27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:28.593416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d72b4df-d810-478f-9574-71c4cb5302d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3afce090f88e408da3e2672850f3cd54'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:28.633697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d72b4df-d810-478f-9574-71c4cb5302d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3afce090f88e408da3e2672850f3cd54'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:28.636637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d72b4df-d810-478f-9574-71c4cb5302d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3afce090f88e408da3e2672850f3cd54'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:28.637231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d72b4df-d810-478f-9574-71c4cb5302d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3afce090f88e408da3e2672850f3cd54'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:28.657111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:28.658271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d72b4df-d810-478f-9574-71c4cb5302d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3afce090f88e408da3e2672850f3cd54'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:28.684636 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3655/7307] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:28 2022] DELETE /identity/v3/users/3afce090f88e408da3e2672850f3cd54 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:28.691292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc802cd6-3676-49fa-a346-a93d6fdc5a6c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:28.691587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc802cd6-3676-49fa-a346-a93d6fdc5a6c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:28.691819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c5b38-4747-4efc-8edb-90274e841e27 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:28.692620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc802cd6-3676-49fa-a346-a93d6fdc5a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:28.739989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cc802cd6-3676-49fa-a346-a93d6fdc5a6c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:28.741369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cc802cd6-3676-49fa-a346-a93d6fdc5a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:28.805292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f450d8f-b2b0-47bc-9b6f-b0d59efd3c44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:28.806552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f450d8f-b2b0-47bc-9b6f-b0d59efd3c44 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:28.807042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f450d8f-b2b0-47bc-9b6f-b0d59efd3c44 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:28.807550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f450d8f-b2b0-47bc-9b6f-b0d59efd3c44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:28.810423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f450d8f-b2b0-47bc-9b6f-b0d59efd3c44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:28.946159 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3656/7308] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:28.963041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc802cd6-3676-49fa-a346-a93d6fdc5a6c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:28.965378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cc802cd6-3676-49fa-a346-a93d6fdc5a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:28.984867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f450d8f-b2b0-47bc-9b6f-b0d59efd3c44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:28.986274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f450d8f-b2b0-47bc-9b6f-b0d59efd3c44 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:29.029103 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3653/7309] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:29.046053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f450d8f-b2b0-47bc-9b6f-b0d59efd3c44 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:29.047552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f450d8f-b2b0-47bc-9b6f-b0d59efd3c44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:29.096768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc802cd6-3676-49fa-a346-a93d6fdc5a6c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:29.108146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b12e87-ab55-4596-9805-cbf06d8fcd4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:29.108853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b12e87-ab55-4596-9805-cbf06d8fcd4a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:29.109138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b12e87-ab55-4596-9805-cbf06d8fcd4a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:29.109416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b12e87-ab55-4596-9805-cbf06d8fcd4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:29.120912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b12e87-ab55-4596-9805-cbf06d8fcd4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:29.122226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b12e87-ab55-4596-9805-cbf06d8fcd4a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:29.141384 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3657/7310] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:29.146754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b12e87-ab55-4596-9805-cbf06d8fcd4a service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:29.150116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-26b12e87-ab55-4596-9805-cbf06d8fcd4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:29.180357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b12e87-ab55-4596-9805-cbf06d8fcd4a service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:29.195405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626317f-a0f2-4cc2-a49d-75be47dec15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:29.196067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626317f-a0f2-4cc2-a49d-75be47dec15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:29.196347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626317f-a0f2-4cc2-a49d-75be47dec15e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:29.196624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626317f-a0f2-4cc2-a49d-75be47dec15e admin admin] PATH_INFO: `/v3/users/702eab1e1cf54579bbf12e4cb588cf9b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:29.205705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626317f-a0f2-4cc2-a49d-75be47dec15e admin admin] RBAC: Authorizing `identity:delete_user(user_id=702eab1e1cf54579bbf12e4cb588cf9b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:29.207962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626317f-a0f2-4cc2-a49d-75be47dec15e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:29.227414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f450d8f-b2b0-47bc-9b6f-b0d59efd3c44 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:29.245456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871890a-5690-4020-9eb1-e6e90dc63a9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:29.246786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871890a-5690-4020-9eb1-e6e90dc63a9a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:29.247080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871890a-5690-4020-9eb1-e6e90dc63a9a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:29.247429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871890a-5690-4020-9eb1-e6e90dc63a9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:29.250042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4871890a-5690-4020-9eb1-e6e90dc63a9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:29.327692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7626317f-a0f2-4cc2-a49d-75be47dec15e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702eab1e1cf54579bbf12e4cb588cf9b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:29.331381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:29.358750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7626317f-a0f2-4cc2-a49d-75be47dec15e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702eab1e1cf54579bbf12e4cb588cf9b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:29.359665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7626317f-a0f2-4cc2-a49d-75be47dec15e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702eab1e1cf54579bbf12e4cb588cf9b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:29.360713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7626317f-a0f2-4cc2-a49d-75be47dec15e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702eab1e1cf54579bbf12e4cb588cf9b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:29.384075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7626317f-a0f2-4cc2-a49d-75be47dec15e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702eab1e1cf54579bbf12e4cb588cf9b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:29.397474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:29.440552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871890a-5690-4020-9eb1-e6e90dc63a9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:29.442257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871890a-5690-4020-9eb1-e6e90dc63a9a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:29.443363 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3658/7311] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:29 2022] DELETE /identity/v3/users/702eab1e1cf54579bbf12e4cb588cf9b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:29.444336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626317f-a0f2-4cc2-a49d-75be47dec15e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:29.449665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7626317f-a0f2-4cc2-a49d-75be47dec15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:29.477552 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3654/7312] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:29 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:51:29.495910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9d54a-fa3d-440f-95b1-144c09cc10f8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:29.496206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9d54a-fa3d-440f-95b1-144c09cc10f8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:29.496490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9d54a-fa3d-440f-95b1-144c09cc10f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:29.571188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-faf9d54a-fa3d-440f-95b1-144c09cc10f8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:29.572714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-faf9d54a-fa3d-440f-95b1-144c09cc10f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:29.586741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626317f-a0f2-4cc2-a49d-75be47dec15e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:29.592477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f535566-f965-4333-9681-82cf556b55db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:29.593292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f535566-f965-4333-9681-82cf556b55db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:29.593668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f535566-f965-4333-9681-82cf556b55db admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:29.594067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f535566-f965-4333-9681-82cf556b55db admin admin] PATH_INFO: `/v3/projects/d7f8be9b02ce4c0c90bd997a77b4d13b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:29.595381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f535566-f965-4333-9681-82cf556b55db admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f8be9b02ce4c0c90bd997a77b4d13b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:29.597408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f535566-f965-4333-9681-82cf556b55db admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:29.618221 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3655/7313] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:29.629136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9d54a-fa3d-440f-95b1-144c09cc10f8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:29.632404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-faf9d54a-fa3d-440f-95b1-144c09cc10f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:29.668527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4f535566-f965-4333-9681-82cf556b55db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f8be9b02ce4c0c90bd997a77b4d13b', 'request_id': 'req-4f535566-f965-4333-9681-82cf556b55db'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:29.679395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4f535566-f965-4333-9681-82cf556b55db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f8be9b02ce4c0c90bd997a77b4d13b', 'request_id': 'req-4f535566-f965-4333-9681-82cf556b55db'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:29.688984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4f535566-f965-4333-9681-82cf556b55db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f8be9b02ce4c0c90bd997a77b4d13b', 'request_id': 'req-4f535566-f965-4333-9681-82cf556b55db'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:29.709255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4f535566-f965-4333-9681-82cf556b55db admin admin] The token cache is being invalidate because project d7f8be9b02ce4c0c90bd997a77b4d13b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:29.709570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4f535566-f965-4333-9681-82cf556b55db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:29.710398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4f535566-f965-4333-9681-82cf556b55db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:29.717127 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3659/7314] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:29 2022] DELETE /identity/v3/projects/d7f8be9b02ce4c0c90bd997a77b4d13b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:29.720481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f998044-5ef2-4eaa-acf4-c13d8590e702 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:29.720868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f998044-5ef2-4eaa-acf4-c13d8590e702 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:29.721184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f998044-5ef2-4eaa-acf4-c13d8590e702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:29.748763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1f998044-5ef2-4eaa-acf4-c13d8590e702 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:29.750992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1f998044-5ef2-4eaa-acf4-c13d8590e702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:29.804641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9d54a-fa3d-440f-95b1-144c09cc10f8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:29.924016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba75d30-915f-4e2c-ab72-5f28fa823784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:29.924755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba75d30-915f-4e2c-ab72-5f28fa823784 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:29.925093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba75d30-915f-4e2c-ab72-5f28fa823784 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:29.925431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba75d30-915f-4e2c-ab72-5f28fa823784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:29.928642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ba75d30-915f-4e2c-ab72-5f28fa823784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:29.931438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:29.974751 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3660/7315] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:29.976416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd029a-1c5d-473e-8203-4b99ba6532ad None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:29.976704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd029a-1c5d-473e-8203-4b99ba6532ad None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:29.977420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd029a-1c5d-473e-8203-4b99ba6532ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:30.041927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-95fd029a-1c5d-473e-8203-4b99ba6532ad None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:30.044915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-95fd029a-1c5d-473e-8203-4b99ba6532ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:30.077290 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3661/7316] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:30.082355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd029a-1c5d-473e-8203-4b99ba6532ad None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:30.102459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba75d30-915f-4e2c-ab72-5f28fa823784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:30.104539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba75d30-915f-4e2c-ab72-5f28fa823784 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:30.119373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd029a-1c5d-473e-8203-4b99ba6532ad None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:30.129365 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3656/7317] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:30.133211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c00339-328f-4243-b7f0-96343c002993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:30.133962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c00339-328f-4243-b7f0-96343c002993 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:30.134401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c00339-328f-4243-b7f0-96343c002993 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:30.134749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c00339-328f-4243-b7f0-96343c002993 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:30.135576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c00339-328f-4243-b7f0-96343c002993 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:30.135963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c00339-328f-4243-b7f0-96343c002993 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:30.140178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c00339-328f-4243-b7f0-96343c002993 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:30.174212 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3662/7318] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:30.184220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba75d30-915f-4e2c-ab72-5f28fa823784 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:30.203352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba75d30-915f-4e2c-ab72-5f28fa823784 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:30.211526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e81c77-6df4-4997-be88-09e2f1c365a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:30.212921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e81c77-6df4-4997-be88-09e2f1c365a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:30.213421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e81c77-6df4-4997-be88-09e2f1c365a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:30.213898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e81c77-6df4-4997-be88-09e2f1c365a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:30.214763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e81c77-6df4-4997-be88-09e2f1c365a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:30.216995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e81c77-6df4-4997-be88-09e2f1c365a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:30.287394 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3657/7319] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:30 2022] POST /identity/v3/projects => generated 359 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:30.291550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c00339-328f-4243-b7f0-96343c002993 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:30.307145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c00339-328f-4243-b7f0-96343c002993 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:30.430944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e1b9c-607b-458b-886b-1091cbda8309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:30.431781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e1b9c-607b-458b-886b-1091cbda8309 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:30.432070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e1b9c-607b-458b-886b-1091cbda8309 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:30.432355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e1b9c-607b-458b-886b-1091cbda8309 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:30.432995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e1b9c-607b-458b-886b-1091cbda8309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:30.436473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e1b9c-607b-458b-886b-1091cbda8309 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:30.507542 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3663/7320] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:30 2022] POST /identity/v3/users => generated 280 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:51:30.513293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e81c77-6df4-4997-be88-09e2f1c365a6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:30.534404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e81c77-6df4-4997-be88-09e2f1c365a6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:30.546792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d5862-6075-41d1-aaa0-101e2d4a110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:30.547427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d5862-6075-41d1-aaa0-101e2d4a110c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:30.547710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d5862-6075-41d1-aaa0-101e2d4a110c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:30.548050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d5862-6075-41d1-aaa0-101e2d4a110c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:30.548643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d5862-6075-41d1-aaa0-101e2d4a110c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:30.550399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d5862-6075-41d1-aaa0-101e2d4a110c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:30.577626 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3658/7321] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:30.578751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e1b9c-607b-458b-886b-1091cbda8309 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:30.589978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e1b9c-607b-458b-886b-1091cbda8309 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:30.608050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895a8c5-742b-4b51-a454-ba71ed03bcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:30.608695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895a8c5-742b-4b51-a454-ba71ed03bcae admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:30.609074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895a8c5-742b-4b51-a454-ba71ed03bcae admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:30.609359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895a8c5-742b-4b51-a454-ba71ed03bcae admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:30.610028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895a8c5-742b-4b51-a454-ba71ed03bcae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:30.612273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895a8c5-742b-4b51-a454-ba71ed03bcae admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:30.626955 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3664/7322] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:51:30.632578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d5862-6075-41d1-aaa0-101e2d4a110c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:30.639712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:30.644426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d5862-6075-41d1-aaa0-101e2d4a110c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:30.652043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d47eb-2f84-408e-89ef-9e82e3af51f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:30.652927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d47eb-2f84-408e-89ef-9e82e3af51f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:30.653583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d47eb-2f84-408e-89ef-9e82e3af51f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:30.653948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d47eb-2f84-408e-89ef-9e82e3af51f4 admin admin] PATH_INFO: `/v3/projects/8477e44bf1144c57aa4350885d8482e0/users/a7835951a8a14fa5aee6a635b1c51777/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:30.680046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895a8c5-742b-4b51-a454-ba71ed03bcae admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:30.683131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8895a8c5-742b-4b51-a454-ba71ed03bcae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:30.698892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d47eb-2f84-408e-89ef-9e82e3af51f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8477e44bf1144c57aa4350885d8482e0, user_id=a7835951a8a14fa5aee6a635b1c51777, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:30.703892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d47eb-2f84-408e-89ef-9e82e3af51f4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:30.719510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895a8c5-742b-4b51-a454-ba71ed03bcae admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:30.741514 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3659/7323] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:30 2022] PUT /identity/v3/projects/8477e44bf1144c57aa4350885d8482e0/users/a7835951a8a14fa5aee6a635b1c51777/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:51:30.753088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585c865-be88-4af2-a9c2-60ccd8bed9f9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:30.753413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585c865-be88-4af2-a9c2-60ccd8bed9f9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:30.753661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585c865-be88-4af2-a9c2-60ccd8bed9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:30.755779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459db17-15c3-4830-947e-f75c6d71647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:30.756351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459db17-15c3-4830-947e-f75c6d71647e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:30.756627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459db17-15c3-4830-947e-f75c6d71647e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:30.756897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459db17-15c3-4830-947e-f75c6d71647e admin admin] PATH_INFO: `/v3/projects/a67ba3f74f974fd2ae608fbcd1b94525` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:30.758857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459db17-15c3-4830-947e-f75c6d71647e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a67ba3f74f974fd2ae608fbcd1b94525)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:30.760882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459db17-15c3-4830-947e-f75c6d71647e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:30.809147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7585c865-be88-4af2-a9c2-60ccd8bed9f9 None None] MFA Rules not processed for user `a7835951a8a14fa5aee6a635b1c51777`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:30.810852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7585c865-be88-4af2-a9c2-60ccd8bed9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:30.837503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d459db17-15c3-4830-947e-f75c6d71647e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a67ba3f74f974fd2ae608fbcd1b94525', 'request_id': 'req-d459db17-15c3-4830-947e-f75c6d71647e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:30.845172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d459db17-15c3-4830-947e-f75c6d71647e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a67ba3f74f974fd2ae608fbcd1b94525', 'request_id': 'req-d459db17-15c3-4830-947e-f75c6d71647e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:30.854373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d459db17-15c3-4830-947e-f75c6d71647e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a67ba3f74f974fd2ae608fbcd1b94525', 'request_id': 'req-d459db17-15c3-4830-947e-f75c6d71647e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:30.880703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d459db17-15c3-4830-947e-f75c6d71647e admin admin] The token cache is being invalidate because project a67ba3f74f974fd2ae608fbcd1b94525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:30.881051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d459db17-15c3-4830-947e-f75c6d71647e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:30.882252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d459db17-15c3-4830-947e-f75c6d71647e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:30.889938 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3665/7324] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:30 2022] DELETE /identity/v3/projects/a67ba3f74f974fd2ae608fbcd1b94525 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:30.892426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459db17-15c3-4830-947e-f75c6d71647e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:30.897552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d459db17-15c3-4830-947e-f75c6d71647e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:30.999813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:31.109857 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3660/7325] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:31.113193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585c865-be88-4af2-a9c2-60ccd8bed9f9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.119975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7585c865-be88-4af2-a9c2-60ccd8bed9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:31.169103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459db17-15c3-4830-947e-f75c6d71647e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.185058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9cf54-0df3-420e-9a50-a25a102ba8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.185737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9cf54-0df3-420e-9a50-a25a102ba8c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.186219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9cf54-0df3-420e-9a50-a25a102ba8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.186507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9cf54-0df3-420e-9a50-a25a102ba8c5 admin admin] PATH_INFO: `/v3/users/a94161d13e4e4ce7afe5659591c7807c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.192013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9cf54-0df3-420e-9a50-a25a102ba8c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a94161d13e4e4ce7afe5659591c7807c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.194622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9cf54-0df3-420e-9a50-a25a102ba8c5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.388390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-daa9cf54-0df3-420e-9a50-a25a102ba8c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a94161d13e4e4ce7afe5659591c7807c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:31.408169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-daa9cf54-0df3-420e-9a50-a25a102ba8c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a94161d13e4e4ce7afe5659591c7807c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:31.409773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-daa9cf54-0df3-420e-9a50-a25a102ba8c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a94161d13e4e4ce7afe5659591c7807c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:31.410618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585c865-be88-4af2-a9c2-60ccd8bed9f9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.410739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-daa9cf54-0df3-420e-9a50-a25a102ba8c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a94161d13e4e4ce7afe5659591c7807c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:31.430202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333679fa-4d41-4f8b-8b05-0605b790c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.430982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333679fa-4d41-4f8b-8b05-0605b790c642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.432673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333679fa-4d41-4f8b-8b05-0605b790c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.432673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333679fa-4d41-4f8b-8b05-0605b790c642 admin admin] PATH_INFO: `/v3/projects/8dd43a40f41f458c9e727dd450a1e1b6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.434130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333679fa-4d41-4f8b-8b05-0605b790c642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd43a40f41f458c9e727dd450a1e1b6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.446989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333679fa-4d41-4f8b-8b05-0605b790c642 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.472048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-daa9cf54-0df3-420e-9a50-a25a102ba8c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a94161d13e4e4ce7afe5659591c7807c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:31.493643 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3666/7326] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:30 2022] DELETE /identity/v3/users/a94161d13e4e4ce7afe5659591c7807c => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:31.494884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9cf54-0df3-420e-9a50-a25a102ba8c5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.499795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-daa9cf54-0df3-420e-9a50-a25a102ba8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:31.579543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-333679fa-4d41-4f8b-8b05-0605b790c642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd43a40f41f458c9e727dd450a1e1b6', 'request_id': 'req-333679fa-4d41-4f8b-8b05-0605b790c642'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:31.621313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-333679fa-4d41-4f8b-8b05-0605b790c642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd43a40f41f458c9e727dd450a1e1b6', 'request_id': 'req-333679fa-4d41-4f8b-8b05-0605b790c642'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:31.624850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-333679fa-4d41-4f8b-8b05-0605b790c642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd43a40f41f458c9e727dd450a1e1b6', 'request_id': 'req-333679fa-4d41-4f8b-8b05-0605b790c642'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:31.654164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:31.671013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-333679fa-4d41-4f8b-8b05-0605b790c642 admin admin] The token cache is being invalidate because project 8dd43a40f41f458c9e727dd450a1e1b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:31.672103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-333679fa-4d41-4f8b-8b05-0605b790c642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:31.673922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-333679fa-4d41-4f8b-8b05-0605b790c642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:31.680508 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3661/7327] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:31 2022] DELETE /identity/v3/projects/8dd43a40f41f458c9e727dd450a1e1b6 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:31.687209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a032a18-57e0-478e-8bd8-44b29d3254a1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.688383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a032a18-57e0-478e-8bd8-44b29d3254a1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.688808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a032a18-57e0-478e-8bd8-44b29d3254a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.707838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9cf54-0df3-420e-9a50-a25a102ba8c5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.738239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0a032a18-57e0-478e-8bd8-44b29d3254a1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:31.741984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a032a18-57e0-478e-8bd8-44b29d3254a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:31.862152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9c8ac-8193-4366-8a30-f544246f785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.863145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9c8ac-8193-4366-8a30-f544246f785b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.864230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9c8ac-8193-4366-8a30-f544246f785b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.865123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9c8ac-8193-4366-8a30-f544246f785b admin admin] PATH_INFO: `/v3/users/a7835951a8a14fa5aee6a635b1c51777` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.867643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9c8ac-8193-4366-8a30-f544246f785b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7835951a8a14fa5aee6a635b1c51777)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.871650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9c8ac-8193-4366-8a30-f544246f785b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.882231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:31.898280 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3662/7328] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:31.907070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d3ac6-78c9-4860-8825-5ec2dd179200 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.907798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d3ac6-78c9-4860-8825-5ec2dd179200 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.908294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d3ac6-78c9-4860-8825-5ec2dd179200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.952154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9e1d3ac6-78c9-4860-8825-5ec2dd179200 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:31.957480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e1d3ac6-78c9-4860-8825-5ec2dd179200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:31.977871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-33e9c8ac-8193-4366-8a30-f544246f785b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7835951a8a14fa5aee6a635b1c51777'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:31.983682 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3663/7329] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:31.986854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d3ac6-78c9-4860-8825-5ec2dd179200 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.003404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d3ac6-78c9-4860-8825-5ec2dd179200 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.006900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-33e9c8ac-8193-4366-8a30-f544246f785b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7835951a8a14fa5aee6a635b1c51777'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:32.008433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-33e9c8ac-8193-4366-8a30-f544246f785b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7835951a8a14fa5aee6a635b1c51777'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:32.009436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-33e9c8ac-8193-4366-8a30-f544246f785b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7835951a8a14fa5aee6a635b1c51777'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:32.020006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c128b-98d9-4d1d-8123-f7d4d483f03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.021493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c128b-98d9-4d1d-8123-f7d4d483f03a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.021973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c128b-98d9-4d1d-8123-f7d4d483f03a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.022541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c128b-98d9-4d1d-8123-f7d4d483f03a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.023932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c128b-98d9-4d1d-8123-f7d4d483f03a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:32.024494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c128b-98d9-4d1d-8123-f7d4d483f03a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.028269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-33e9c8ac-8193-4366-8a30-f544246f785b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7835951a8a14fa5aee6a635b1c51777'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:32.029951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c128b-98d9-4d1d-8123-f7d4d483f03a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.056377 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3667/7330] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:31 2022] DELETE /identity/v3/users/a7835951a8a14fa5aee6a635b1c51777 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:32.059052 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3664/7331] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:32.061786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faaf45-6a20-4be5-99fd-9abeed757ed6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.062891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faaf45-6a20-4be5-99fd-9abeed757ed6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.064096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faaf45-6a20-4be5-99fd-9abeed757ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.086266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c128b-98d9-4d1d-8123-f7d4d483f03a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.092908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ed3c128b-98d9-4d1d-8123-f7d4d483f03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:32.143849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c128b-98d9-4d1d-8123-f7d4d483f03a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.154920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-00faaf45-6a20-4be5-99fd-9abeed757ed6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:32.159468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00faaf45-6a20-4be5-99fd-9abeed757ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:32.301119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d8c9d-b9b6-4559-b06e-216d7a96a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.301750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d8c9d-b9b6-4559-b06e-216d7a96a2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.302026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d8c9d-b9b6-4559-b06e-216d7a96a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.302451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d8c9d-b9b6-4559-b06e-216d7a96a2d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.303225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d8c9d-b9b6-4559-b06e-216d7a96a2d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.308376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d8c9d-b9b6-4559-b06e-216d7a96a2d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.331659 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3668/7332] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:32.374850 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3665/7333] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:32 2022] POST /identity/v3/projects => generated 391 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:32.379145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faaf45-6a20-4be5-99fd-9abeed757ed6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.386305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d8c9d-b9b6-4559-b06e-216d7a96a2d1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.391365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d11d8c9d-b9b6-4559-b06e-216d7a96a2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:32.404315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faaf45-6a20-4be5-99fd-9abeed757ed6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.613823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4f9ed-6dc1-49d2-842c-3d483b0bffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.614722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4f9ed-6dc1-49d2-842c-3d483b0bffc2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.615050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4f9ed-6dc1-49d2-842c-3d483b0bffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.615468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4f9ed-6dc1-49d2-842c-3d483b0bffc2 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.616129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4f9ed-6dc1-49d2-842c-3d483b0bffc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.616667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d8c9d-b9b6-4559-b06e-216d7a96a2d1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.624849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4f9ed-6dc1-49d2-842c-3d483b0bffc2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.626209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69779724-b8bc-467b-b540-491c2eea2edd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.626865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69779724-b8bc-467b-b540-491c2eea2edd service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.627149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69779724-b8bc-467b-b540-491c2eea2edd service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.627455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69779724-b8bc-467b-b540-491c2eea2edd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.652736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69779724-b8bc-467b-b540-491c2eea2edd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.654515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69779724-b8bc-467b-b540-491c2eea2edd service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.686508 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3666/7334] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:32.691451 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3669/7335] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:32 2022] POST /identity/v3/users => generated 296 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:32.696276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69779724-b8bc-467b-b540-491c2eea2edd service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.709527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69779724-b8bc-467b-b540-491c2eea2edd service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.716945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7ac69-2731-40bf-a4c8-c4cd460159e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.718145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7ac69-2731-40bf-a4c8-c4cd460159e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.718598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7ac69-2731-40bf-a4c8-c4cd460159e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.719039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7ac69-2731-40bf-a4c8-c4cd460159e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.719890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7ac69-2731-40bf-a4c8-c4cd460159e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.721722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7ac69-2731-40bf-a4c8-c4cd460159e2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.725939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:32.746326 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3667/7336] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:32.751409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4f9ed-6dc1-49d2-842c-3d483b0bffc2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.774863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4f9ed-6dc1-49d2-842c-3d483b0bffc2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.795793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8012a-4135-4c0e-8f86-428907f3a7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.796912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8012a-4135-4c0e-8f86-428907f3a7da admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.799606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8012a-4135-4c0e-8f86-428907f3a7da admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.799963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8012a-4135-4c0e-8f86-428907f3a7da admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.801714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8012a-4135-4c0e-8f86-428907f3a7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.807945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8012a-4135-4c0e-8f86-428907f3a7da admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.836766 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3670/7337] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:32.838056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7ac69-2731-40bf-a4c8-c4cd460159e2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.852540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7ac69-2731-40bf-a4c8-c4cd460159e2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.869559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385f8ad-a682-48e5-8da3-b82210868cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.870170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385f8ad-a682-48e5-8da3-b82210868cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.870454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385f8ad-a682-48e5-8da3-b82210868cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.870731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385f8ad-a682-48e5-8da3-b82210868cf0 admin admin] PATH_INFO: `/v3/projects/96cc707a4a6044f99f9264160618b739/users/7afaa3dd70cd4a64a2b3c51e8a3b9582/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.903383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385f8ad-a682-48e5-8da3-b82210868cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96cc707a4a6044f99f9264160618b739, user_id=7afaa3dd70cd4a64a2b3c51e8a3b9582, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.907091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385f8ad-a682-48e5-8da3-b82210868cf0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.935234 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3668/7338] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:32 2022] PUT /identity/v3/projects/96cc707a4a6044f99f9264160618b739/users/7afaa3dd70cd4a64a2b3c51e8a3b9582/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:32.946766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52d533-18de-4181-bcdf-c95d8a8fe539 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.947416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52d533-18de-4181-bcdf-c95d8a8fe539 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.947927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52d533-18de-4181-bcdf-c95d8a8fe539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.968256 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:33.021595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ae52d533-18de-4181-bcdf-c95d8a8fe539 None None] MFA Rules not processed for user `7afaa3dd70cd4a64a2b3c51e8a3b9582`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:33.023533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ae52d533-18de-4181-bcdf-c95d8a8fe539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:33.226823 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3671/7339] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:33.230815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385f8ad-a682-48e5-8da3-b82210868cf0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.385215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385f8ad-a682-48e5-8da3-b82210868cf0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.397902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c3576-ac6b-4243-9918-47de7da88784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.398539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c3576-ac6b-4243-9918-47de7da88784 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.398813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c3576-ac6b-4243-9918-47de7da88784 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.401234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c3576-ac6b-4243-9918-47de7da88784 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.401871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c3576-ac6b-4243-9918-47de7da88784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.407414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c3576-ac6b-4243-9918-47de7da88784 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.460411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52d533-18de-4181-bcdf-c95d8a8fe539 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.462676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ae52d533-18de-4181-bcdf-c95d8a8fe539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:33.468013 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3669/7340] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:33 2022] POST /identity/v3/projects => generated 393 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:33.472018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c3576-ac6b-4243-9918-47de7da88784 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.492203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52d533-18de-4181-bcdf-c95d8a8fe539 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.703103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c3576-ac6b-4243-9918-47de7da88784 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.716585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3958094-38c8-4154-ab0a-edc3290ae7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.721921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3958094-38c8-4154-ab0a-edc3290ae7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.723132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3958094-38c8-4154-ab0a-edc3290ae7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.723445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3958094-38c8-4154-ab0a-edc3290ae7b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.725245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3958094-38c8-4154-ab0a-edc3290ae7b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.729532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a0c48-0671-41f2-97f7-917621ac0260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.730284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a0c48-0671-41f2-97f7-917621ac0260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.730569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a0c48-0671-41f2-97f7-917621ac0260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.730957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a0c48-0671-41f2-97f7-917621ac0260 admin admin] PATH_INFO: `/v3/projects/bd14c6ca01be4fce91741e74edfbe576` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.735881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3958094-38c8-4154-ab0a-edc3290ae7b5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.739722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a0c48-0671-41f2-97f7-917621ac0260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd14c6ca01be4fce91741e74edfbe576)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.741750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a0c48-0671-41f2-97f7-917621ac0260 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.770628 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3670/7341] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:33 2022] POST /identity/v3/users => generated 303 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:51:33.774443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3958094-38c8-4154-ab0a-edc3290ae7b5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.796154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3958094-38c8-4154-ab0a-edc3290ae7b5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.813378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18fae6-3305-4078-b312-454a3c43e0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.814026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18fae6-3305-4078-b312-454a3c43e0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.814324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18fae6-3305-4078-b312-454a3c43e0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.814637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18fae6-3305-4078-b312-454a3c43e0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.815670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18fae6-3305-4078-b312-454a3c43e0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.819857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18fae6-3305-4078-b312-454a3c43e0c6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.850371 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3671/7342] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:33.854665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18fae6-3305-4078-b312-454a3c43e0c6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.866745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b11a0c48-0671-41f2-97f7-917621ac0260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd14c6ca01be4fce91741e74edfbe576', 'request_id': 'req-b11a0c48-0671-41f2-97f7-917621ac0260'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:33.876946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18fae6-3305-4078-b312-454a3c43e0c6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.878094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b11a0c48-0671-41f2-97f7-917621ac0260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd14c6ca01be4fce91741e74edfbe576', 'request_id': 'req-b11a0c48-0671-41f2-97f7-917621ac0260'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:33.894608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b11a0c48-0671-41f2-97f7-917621ac0260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd14c6ca01be4fce91741e74edfbe576', 'request_id': 'req-b11a0c48-0671-41f2-97f7-917621ac0260'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:33.921710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b11a0c48-0671-41f2-97f7-917621ac0260 admin admin] The token cache is being invalidate because project bd14c6ca01be4fce91741e74edfbe576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:33.922455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b11a0c48-0671-41f2-97f7-917621ac0260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:33.923508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b11a0c48-0671-41f2-97f7-917621ac0260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:33.926449 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3672/7343] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:33 2022] DELETE /identity/v3/projects/bd14c6ca01be4fce91741e74edfbe576 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:33.935725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3492d-2af2-41fc-ad75-1aee8d7f8a26 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.937225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3492d-2af2-41fc-ad75-1aee8d7f8a26 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.937509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3492d-2af2-41fc-ad75-1aee8d7f8a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.982081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:33.993775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-25b3492d-2af2-41fc-ad75-1aee8d7f8a26 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:33.998347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-25b3492d-2af2-41fc-ad75-1aee8d7f8a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:34.034342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb90a8-7611-4dd9-bc58-ddb6cc957f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.035041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb90a8-7611-4dd9-bc58-ddb6cc957f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.035347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb90a8-7611-4dd9-bc58-ddb6cc957f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.035696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb90a8-7611-4dd9-bc58-ddb6cc957f8f admin admin] PATH_INFO: `/v3/projects/876c21d6965e41ccbabd230baee3f1dc/users/f416e77bae98497282e4a561bcc64eef/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.064929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb90a8-7611-4dd9-bc58-ddb6cc957f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=876c21d6965e41ccbabd230baee3f1dc, user_id=f416e77bae98497282e4a561bcc64eef, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.068158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb90a8-7611-4dd9-bc58-ddb6cc957f8f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.074899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:34.111757 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3672/7344] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:33 2022] PUT /identity/v3/projects/876c21d6965e41ccbabd230baee3f1dc/users/f416e77bae98497282e4a561bcc64eef/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:51:34.115801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb90a8-7611-4dd9-bc58-ddb6cc957f8f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.124730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58fb90a8-7611-4dd9-bc58-ddb6cc957f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:34.182507 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3673/7345] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:34.196014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1555c-42c4-41ce-8db2-7b6c3dec155c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.196578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1555c-42c4-41ce-8db2-7b6c3dec155c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.199979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1555c-42c4-41ce-8db2-7b6c3dec155c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.247986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f4e1555c-42c4-41ce-8db2-7b6c3dec155c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:34.251204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f4e1555c-42c4-41ce-8db2-7b6c3dec155c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:34.317398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb90a8-7611-4dd9-bc58-ddb6cc957f8f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.330165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396ebfc-7009-4a25-b007-af548e6144ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.330815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396ebfc-7009-4a25-b007-af548e6144ea admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.331100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396ebfc-7009-4a25-b007-af548e6144ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.331407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396ebfc-7009-4a25-b007-af548e6144ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.336678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396ebfc-7009-4a25-b007-af548e6144ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.337623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396ebfc-7009-4a25-b007-af548e6144ea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.366763 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3673/7346] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:34.367777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396ebfc-7009-4a25-b007-af548e6144ea admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.375094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7396ebfc-7009-4a25-b007-af548e6144ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:34.406431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396ebfc-7009-4a25-b007-af548e6144ea admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.415127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f7de7-c674-47e2-b20c-5509bf8114a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.416496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f7de7-c674-47e2-b20c-5509bf8114a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.416947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f7de7-c674-47e2-b20c-5509bf8114a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.417379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f7de7-c674-47e2-b20c-5509bf8114a5 admin admin] PATH_INFO: `/v3/projects/8477e44bf1144c57aa4350885d8482e0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.418741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f7de7-c674-47e2-b20c-5509bf8114a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8477e44bf1144c57aa4350885d8482e0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.421793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f7de7-c674-47e2-b20c-5509bf8114a5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.424837 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3674/7347] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:34.426127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1555c-42c4-41ce-8db2-7b6c3dec155c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.441573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1555c-42c4-41ce-8db2-7b6c3dec155c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.448927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b9868-b09e-4415-b7a6-62a6ed274164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.449748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b9868-b09e-4415-b7a6-62a6ed274164 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.450189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b9868-b09e-4415-b7a6-62a6ed274164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.450571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b9868-b09e-4415-b7a6-62a6ed274164 admin admin] PATH_INFO: `/v3/projects/876c21d6965e41ccbabd230baee3f1dc/users/f416e77bae98497282e4a561bcc64eef/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.454565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b9868-b09e-4415-b7a6-62a6ed274164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=876c21d6965e41ccbabd230baee3f1dc, user_id=f416e77bae98497282e4a561bcc64eef, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.460482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b9868-b09e-4415-b7a6-62a6ed274164 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.490548 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3675/7348] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:34 2022] PUT /identity/v3/projects/876c21d6965e41ccbabd230baee3f1dc/users/f416e77bae98497282e4a561bcc64eef/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:34.492026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b9868-b09e-4415-b7a6-62a6ed274164 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.509680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc2f7de7-c674-47e2-b20c-5509bf8114a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8477e44bf1144c57aa4350885d8482e0', 'request_id': 'req-dc2f7de7-c674-47e2-b20c-5509bf8114a5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:34.523950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc2f7de7-c674-47e2-b20c-5509bf8114a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8477e44bf1144c57aa4350885d8482e0', 'request_id': 'req-dc2f7de7-c674-47e2-b20c-5509bf8114a5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:34.545506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc2f7de7-c674-47e2-b20c-5509bf8114a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8477e44bf1144c57aa4350885d8482e0', 'request_id': 'req-dc2f7de7-c674-47e2-b20c-5509bf8114a5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:34.579750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc2f7de7-c674-47e2-b20c-5509bf8114a5 admin admin] The token cache is being invalidate because project 8477e44bf1144c57aa4350885d8482e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:34.579963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc2f7de7-c674-47e2-b20c-5509bf8114a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:34.583656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc2f7de7-c674-47e2-b20c-5509bf8114a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:34.587820 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3674/7349] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:34 2022] DELETE /identity/v3/projects/8477e44bf1144c57aa4350885d8482e0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:34.593622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379f72a-1435-43d3-9d62-f34965bc3fdc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.594040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379f72a-1435-43d3-9d62-f34965bc3fdc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.594328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379f72a-1435-43d3-9d62-f34965bc3fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.662435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2379f72a-1435-43d3-9d62-f34965bc3fdc None None] MFA Rules not processed for user `f416e77bae98497282e4a561bcc64eef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:34.663973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2379f72a-1435-43d3-9d62-f34965bc3fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:34.721551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b9868-b09e-4415-b7a6-62a6ed274164 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.737911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:34.849250 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3675/7350] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:34.856615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a693ca-0e79-48db-a90d-c1d5083131db None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.856615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a693ca-0e79-48db-a90d-c1d5083131db None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.856615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a693ca-0e79-48db-a90d-c1d5083131db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.884637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:34.899476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe0e4a-0ed7-4202-b511-a50759fcb631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.900896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe0e4a-0ed7-4202-b511-a50759fcb631 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.901291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe0e4a-0ed7-4202-b511-a50759fcb631 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.901657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe0e4a-0ed7-4202-b511-a50759fcb631 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.902421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe0e4a-0ed7-4202-b511-a50759fcb631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:34.902832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe0e4a-0ed7-4202-b511-a50759fcb631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.907106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe0e4a-0ed7-4202-b511-a50759fcb631 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.913380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-39a693ca-0e79-48db-a90d-c1d5083131db None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:34.914761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-39a693ca-0e79-48db-a90d-c1d5083131db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:34.925089 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3676/7351] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:34.926123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe0e4a-0ed7-4202-b511-a50759fcb631 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.928167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6bfe0e4a-0ed7-4202-b511-a50759fcb631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:34.931181 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3676/7352] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:34.938238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a693ca-0e79-48db-a90d-c1d5083131db None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.947405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-39a693ca-0e79-48db-a90d-c1d5083131db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:34.959667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a693ca-0e79-48db-a90d-c1d5083131db None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.964396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69d178-f114-45d5-a45b-2da3ce69e63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.965086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69d178-f114-45d5-a45b-2da3ce69e63f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.965364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69d178-f114-45d5-a45b-2da3ce69e63f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.965641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69d178-f114-45d5-a45b-2da3ce69e63f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.966302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69d178-f114-45d5-a45b-2da3ce69e63f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.969067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69d178-f114-45d5-a45b-2da3ce69e63f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.018145 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3677/7353] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:34 2022] POST /identity/v3/projects => generated 401 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:35.019783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918997bd-3850-4b6b-8b0a-042472c8c9d4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.020243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918997bd-3850-4b6b-8b0a-042472c8c9d4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.020680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918997bd-3850-4b6b-8b0a-042472c8c9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.066754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-918997bd-3850-4b6b-8b0a-042472c8c9d4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:35.070578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-918997bd-3850-4b6b-8b0a-042472c8c9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:35.112157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe0e4a-0ed7-4202-b511-a50759fcb631 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.251440 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3678/7354] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:35.252806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918997bd-3850-4b6b-8b0a-042472c8c9d4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.271014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53496770-5fc7-4925-9728-d07409ce97ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.273100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53496770-5fc7-4925-9728-d07409ce97ef service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.273386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53496770-5fc7-4925-9728-d07409ce97ef service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.273662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53496770-5fc7-4925-9728-d07409ce97ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.275808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-53496770-5fc7-4925-9728-d07409ce97ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:35.281795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918997bd-3850-4b6b-8b0a-042472c8c9d4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.290754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b47087-cb98-43a5-9871-6088b54c6fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.292675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b47087-cb98-43a5-9871-6088b54c6fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.292949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b47087-cb98-43a5-9871-6088b54c6fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.293221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b47087-cb98-43a5-9871-6088b54c6fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.293976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b47087-cb98-43a5-9871-6088b54c6fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.298501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b47087-cb98-43a5-9871-6088b54c6fc0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.361473 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3679/7355] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:35 2022] POST /identity/v3/users => generated 301 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:35.361473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b47087-cb98-43a5-9871-6088b54c6fc0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.381760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b47087-cb98-43a5-9871-6088b54c6fc0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.394464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4464d-1907-4254-8e9b-d528708b2b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.395350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4464d-1907-4254-8e9b-d528708b2b3b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.395630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4464d-1907-4254-8e9b-d528708b2b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.395899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4464d-1907-4254-8e9b-d528708b2b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.396560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4464d-1907-4254-8e9b-d528708b2b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:35.396909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4464d-1907-4254-8e9b-d528708b2b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.398477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4464d-1907-4254-8e9b-d528708b2b3b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.416533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53496770-5fc7-4925-9728-d07409ce97ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.421207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53496770-5fc7-4925-9728-d07409ce97ef service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.431322 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3680/7356] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:35.438469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4464d-1907-4254-8e9b-d528708b2b3b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.450065 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3677/7357] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:35.451284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53496770-5fc7-4925-9728-d07409ce97ef service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.462265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4464d-1907-4254-8e9b-d528708b2b3b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.470890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53496770-5fc7-4925-9728-d07409ce97ef service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.475067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840659c-fe65-421a-8e15-78c61f6e2522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.475640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840659c-fe65-421a-8e15-78c61f6e2522 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.476052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840659c-fe65-421a-8e15-78c61f6e2522 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.476333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840659c-fe65-421a-8e15-78c61f6e2522 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.477424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840659c-fe65-421a-8e15-78c61f6e2522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.487094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840659c-fe65-421a-8e15-78c61f6e2522 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.491776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9abaa3-ad61-4f0b-9924-101212a857b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.492472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9abaa3-ad61-4f0b-9924-101212a857b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.494205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9abaa3-ad61-4f0b-9924-101212a857b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.494205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9abaa3-ad61-4f0b-9924-101212a857b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.494205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9abaa3-ad61-4f0b-9924-101212a857b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.505841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9abaa3-ad61-4f0b-9924-101212a857b0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.536081 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3681/7358] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:35.539189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840659c-fe65-421a-8e15-78c61f6e2522 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.579698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840659c-fe65-421a-8e15-78c61f6e2522 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.614794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0e2a3-593b-4690-bd41-12eb008a064c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.643291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0e2a3-593b-4690-bd41-12eb008a064c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.643291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0e2a3-593b-4690-bd41-12eb008a064c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.643291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0e2a3-593b-4690-bd41-12eb008a064c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.643291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0e2a3-593b-4690-bd41-12eb008a064c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.651310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0e2a3-593b-4690-bd41-12eb008a064c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.656680 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3678/7359] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:35 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:35.657692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9abaa3-ad61-4f0b-9924-101212a857b0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.669970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:35.686703 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3682/7360] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:35.687861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0e2a3-593b-4690-bd41-12eb008a064c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.710981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0e2a3-593b-4690-bd41-12eb008a064c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.835052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9abaa3-ad61-4f0b-9924-101212a857b0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.837459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:35.867438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa4828-f8ae-4e05-9a14-25d243634b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.868075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa4828-f8ae-4e05-9a14-25d243634b69 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.868353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa4828-f8ae-4e05-9a14-25d243634b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.873218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa4828-f8ae-4e05-9a14-25d243634b69 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.875235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa4828-f8ae-4e05-9a14-25d243634b69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.877265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa4828-f8ae-4e05-9a14-25d243634b69 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.908624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df53c4-03c0-47c4-b7af-2941f18f2a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.909501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df53c4-03c0-47c4-b7af-2941f18f2a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.909996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df53c4-03c0-47c4-b7af-2941f18f2a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.910105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df53c4-03c0-47c4-b7af-2941f18f2a67 admin admin] PATH_INFO: `/v3/projects/739c089b6dda43648ffd8d74eb88c82b/users/6b9da09d033c4412bb7bd606ce1d2d4f/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.951209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df53c4-03c0-47c4-b7af-2941f18f2a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=739c089b6dda43648ffd8d74eb88c82b, user_id=6b9da09d033c4412bb7bd606ce1d2d4f, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.958100 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3679/7361] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:35 2022] POST /identity/v3/users => generated 289 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:51:35.959219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df53c4-03c0-47c4-b7af-2941f18f2a67 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.960599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa4828-f8ae-4e05-9a14-25d243634b69 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.991930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa4828-f8ae-4e05-9a14-25d243634b69 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.992101 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3683/7362] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:35 2022] PUT /identity/v3/projects/739c089b6dda43648ffd8d74eb88c82b/users/6b9da09d033c4412bb7bd606ce1d2d4f/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:36.006677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127ee6b-d858-4972-874b-0e284bf9ac11 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.007035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127ee6b-d858-4972-874b-0e284bf9ac11 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.007241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127ee6b-d858-4972-874b-0e284bf9ac11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.093450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1127ee6b-d858-4972-874b-0e284bf9ac11 None None] MFA Rules not processed for user `6b9da09d033c4412bb7bd606ce1d2d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:36.094717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1127ee6b-d858-4972-874b-0e284bf9ac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:36.108413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56b161-0555-47a6-9a37-805265ced4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:36.109781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56b161-0555-47a6-9a37-805265ced4bc admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.110262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56b161-0555-47a6-9a37-805265ced4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.110703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56b161-0555-47a6-9a37-805265ced4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.112529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56b161-0555-47a6-9a37-805265ced4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:36.116657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56b161-0555-47a6-9a37-805265ced4bc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:36.133683 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3680/7363] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:36.138522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56b161-0555-47a6-9a37-805265ced4bc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:36.164829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56b161-0555-47a6-9a37-805265ced4bc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:36.177736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4105b3f-5d47-4d5c-b352-ba2f66e81597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:36.178329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4105b3f-5d47-4d5c-b352-ba2f66e81597 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.179856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4105b3f-5d47-4d5c-b352-ba2f66e81597 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.180162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4105b3f-5d47-4d5c-b352-ba2f66e81597 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.180829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4105b3f-5d47-4d5c-b352-ba2f66e81597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:36.182527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4105b3f-5d47-4d5c-b352-ba2f66e81597 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:36.257330 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3681/7364] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:36.261887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4105b3f-5d47-4d5c-b352-ba2f66e81597 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:36.285214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4105b3f-5d47-4d5c-b352-ba2f66e81597 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:36.300085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd3cbd-2d03-4829-8857-0c78d1a14129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:36.301022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd3cbd-2d03-4829-8857-0c78d1a14129 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.301022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd3cbd-2d03-4829-8857-0c78d1a14129 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.301278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd3cbd-2d03-4829-8857-0c78d1a14129 admin admin] PATH_INFO: `/v3/projects/cff8500e963f407f964c88752c98154c/users/f03556841d9c467d88f4b4a2f8d6afc0/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.316371 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3684/7365] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:36 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:36.320910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127ee6b-d858-4972-874b-0e284bf9ac11 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:36.342781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd3cbd-2d03-4829-8857-0c78d1a14129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff8500e963f407f964c88752c98154c, user_id=f03556841d9c467d88f4b4a2f8d6afc0, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:36.346036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127ee6b-d858-4972-874b-0e284bf9ac11 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:36.348361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd3cbd-2d03-4829-8857-0c78d1a14129 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:36.359005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0ebc3-5b63-47b7-8566-a8ddd236fc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:36.359699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ebc3-5b63-47b7-8566-a8ddd236fc8f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.359977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ebc3-5b63-47b7-8566-a8ddd236fc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.360253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ebc3-5b63-47b7-8566-a8ddd236fc8f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.361130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0ebc3-5b63-47b7-8566-a8ddd236fc8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:36.363036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0ebc3-5b63-47b7-8566-a8ddd236fc8f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:36.379636 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3682/7366] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:36 2022] PUT /identity/v3/projects/cff8500e963f407f964c88752c98154c/users/f03556841d9c467d88f4b4a2f8d6afc0/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:51:36.398180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea50c48-f0ea-4649-92a0-0e6aa7930a50 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.398468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea50c48-f0ea-4649-92a0-0e6aa7930a50 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.398746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea50c48-f0ea-4649-92a0-0e6aa7930a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.447440 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3685/7367] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:36 2022] POST /identity/v3/projects => generated 401 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:36.451953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0ebc3-5b63-47b7-8566-a8ddd236fc8f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:36.482289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0ea50c48-f0ea-4649-92a0-0e6aa7930a50 None None] MFA Rules not processed for user `f03556841d9c467d88f4b4a2f8d6afc0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:36.489317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0ea50c48-f0ea-4649-92a0-0e6aa7930a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:36.604061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0ebc3-5b63-47b7-8566-a8ddd236fc8f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:36.622733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:36.626277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66822726-666c-4c61-8a27-b4c8e690512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:36.626914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66822726-666c-4c61-8a27-b4c8e690512e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.627191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66822726-666c-4c61-8a27-b4c8e690512e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.627484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66822726-666c-4c61-8a27-b4c8e690512e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.628123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66822726-666c-4c61-8a27-b4c8e690512e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:36.630645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66822726-666c-4c61-8a27-b4c8e690512e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:36.677173 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3686/7368] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:36 2022] POST /identity/v3/users => generated 307 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:51:36.681682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66822726-666c-4c61-8a27-b4c8e690512e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:36.690314 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3683/7369] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:36.690652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea50c48-f0ea-4649-92a0-0e6aa7930a50 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:36.704011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea50c48-f0ea-4649-92a0-0e6aa7930a50 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:36.710761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607beb90-1b5f-40db-97ab-e25008c92075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:36.711434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607beb90-1b5f-40db-97ab-e25008c92075 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.711713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607beb90-1b5f-40db-97ab-e25008c92075 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.711984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607beb90-1b5f-40db-97ab-e25008c92075 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.712763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607beb90-1b5f-40db-97ab-e25008c92075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:36.714523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607beb90-1b5f-40db-97ab-e25008c92075 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:36.726115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66822726-666c-4c61-8a27-b4c8e690512e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:36.740976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aadb02-55ee-4f42-b1b4-09457e2f32e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:36.741723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aadb02-55ee-4f42-b1b4-09457e2f32e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.742047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aadb02-55ee-4f42-b1b4-09457e2f32e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.745937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aadb02-55ee-4f42-b1b4-09457e2f32e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.746798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aadb02-55ee-4f42-b1b4-09457e2f32e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:36.751482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aadb02-55ee-4f42-b1b4-09457e2f32e3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:36.770627 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3684/7370] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:36 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:36.772004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607beb90-1b5f-40db-97ab-e25008c92075 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:36.838440 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3687/7371] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:36.841395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aadb02-55ee-4f42-b1b4-09457e2f32e3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:36.844420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-59aadb02-55ee-4f42-b1b4-09457e2f32e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:36.882891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:36.915037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607beb90-1b5f-40db-97ab-e25008c92075 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:36.929639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072df8c-7e91-47ac-99c6-cbe26171e76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:36.930385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072df8c-7e91-47ac-99c6-cbe26171e76d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.930848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072df8c-7e91-47ac-99c6-cbe26171e76d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.931069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072df8c-7e91-47ac-99c6-cbe26171e76d admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.932061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072df8c-7e91-47ac-99c6-cbe26171e76d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:36.934137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072df8c-7e91-47ac-99c6-cbe26171e76d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:36.972172 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3685/7372] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:36 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:36.973603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072df8c-7e91-47ac-99c6-cbe26171e76d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:36.988141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072df8c-7e91-47ac-99c6-cbe26171e76d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:36.994268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3bfa5d-8375-4bbb-8c6f-b4422fcdf848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:36.995359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bfa5d-8375-4bbb-8c6f-b4422fcdf848 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.995925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bfa5d-8375-4bbb-8c6f-b4422fcdf848 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.996511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bfa5d-8375-4bbb-8c6f-b4422fcdf848 admin admin] PATH_INFO: `/v3/projects/51af8fc65d884756a190401e88305e99/users/53d1e87e1bee4e44b19e08ee03bc67bc/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.020653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3bfa5d-8375-4bbb-8c6f-b4422fcdf848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51af8fc65d884756a190401e88305e99, user_id=53d1e87e1bee4e44b19e08ee03bc67bc, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:37.027983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3bfa5d-8375-4bbb-8c6f-b4422fcdf848 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:37.049649 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3686/7373] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:36 2022] PUT /identity/v3/projects/51af8fc65d884756a190401e88305e99/users/53d1e87e1bee4e44b19e08ee03bc67bc/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:37.050511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3bfa5d-8375-4bbb-8c6f-b4422fcdf848 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:37.064465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aadb02-55ee-4f42-b1b4-09457e2f32e3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:37.203195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3bfa5d-8375-4bbb-8c6f-b4422fcdf848 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:37.231229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2310aee-ec12-4ebd-b095-b5087407cad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:37.234706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2310aee-ec12-4ebd-b095-b5087407cad5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:37.235414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2310aee-ec12-4ebd-b095-b5087407cad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:37.239001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2310aee-ec12-4ebd-b095-b5087407cad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.240014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2310aee-ec12-4ebd-b095-b5087407cad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:37.241820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2310aee-ec12-4ebd-b095-b5087407cad5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:37.261559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f473cef-d0f2-43bf-a5fd-179cea074d60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:37.262132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f473cef-d0f2-43bf-a5fd-179cea074d60 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:37.262418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f473cef-d0f2-43bf-a5fd-179cea074d60 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:37.262760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f473cef-d0f2-43bf-a5fd-179cea074d60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.265090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f473cef-d0f2-43bf-a5fd-179cea074d60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:37.270089 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3687/7374] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:37.271066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2310aee-ec12-4ebd-b095-b5087407cad5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:37.284642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2310aee-ec12-4ebd-b095-b5087407cad5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:37.295798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425be8a0-d429-406f-8ce0-12c2b61e8b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:37.296621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425be8a0-d429-406f-8ce0-12c2b61e8b9e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:37.296965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425be8a0-d429-406f-8ce0-12c2b61e8b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:37.297381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425be8a0-d429-406f-8ce0-12c2b61e8b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.299052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425be8a0-d429-406f-8ce0-12c2b61e8b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:37.300742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425be8a0-d429-406f-8ce0-12c2b61e8b9e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:37.323547 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3688/7375] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:37.325473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425be8a0-d429-406f-8ce0-12c2b61e8b9e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:37.338694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f473cef-d0f2-43bf-a5fd-179cea074d60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:37.343833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f473cef-d0f2-43bf-a5fd-179cea074d60 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:37.394005 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3688/7376] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:37.395524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f473cef-d0f2-43bf-a5fd-179cea074d60 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:37.417886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425be8a0-d429-406f-8ce0-12c2b61e8b9e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:37.432905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f473cef-d0f2-43bf-a5fd-179cea074d60 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:37.433951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803c3ad-40d0-4b1f-9742-3774645b4127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:37.434937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803c3ad-40d0-4b1f-9742-3774645b4127 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:37.436215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803c3ad-40d0-4b1f-9742-3774645b4127 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:37.437160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803c3ad-40d0-4b1f-9742-3774645b4127 admin admin] PATH_INFO: `/v3/projects/cafc583ae64b429696d4015eecae81b4/users/d2a1b1a588054ea2845792a92feaa1c3/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.456980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb7ea8-5edb-43ad-93de-1cf5e940d347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:37.457798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7ea8-5edb-43ad-93de-1cf5e940d347 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:37.458088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7ea8-5edb-43ad-93de-1cf5e940d347 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:37.458371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7ea8-5edb-43ad-93de-1cf5e940d347 admin admin] PATH_INFO: `/v3/projects/51af8fc65d884756a190401e88305e99/users/53d1e87e1bee4e44b19e08ee03bc67bc/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.460580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb7ea8-5edb-43ad-93de-1cf5e940d347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51af8fc65d884756a190401e88305e99, user_id=53d1e87e1bee4e44b19e08ee03bc67bc, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:37.464430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb7ea8-5edb-43ad-93de-1cf5e940d347 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:37.464587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:37.469777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803c3ad-40d0-4b1f-9742-3774645b4127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafc583ae64b429696d4015eecae81b4, user_id=d2a1b1a588054ea2845792a92feaa1c3, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:37.473425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803c3ad-40d0-4b1f-9742-3774645b4127 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:37.499670 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3689/7377] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:37 2022] PUT /identity/v3/projects/cafc583ae64b429696d4015eecae81b4/users/d2a1b1a588054ea2845792a92feaa1c3/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:37.503512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803c3ad-40d0-4b1f-9742-3774645b4127 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:37.511167 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3689/7378] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:37 2022] PUT /identity/v3/projects/51af8fc65d884756a190401e88305e99/users/53d1e87e1bee4e44b19e08ee03bc67bc/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:37.525984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aba452-12a7-4bfe-ad6a-dfa49619a0e8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:37.526944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aba452-12a7-4bfe-ad6a-dfa49619a0e8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:37.526944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aba452-12a7-4bfe-ad6a-dfa49619a0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.627190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-54aba452-12a7-4bfe-ad6a-dfa49619a0e8 None None] MFA Rules not processed for user `53d1e87e1bee4e44b19e08ee03bc67bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:37.631752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54aba452-12a7-4bfe-ad6a-dfa49619a0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:37.704421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803c3ad-40d0-4b1f-9742-3774645b4127 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:37.825150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09adf38-80e2-4094-a7b4-c2e3f2cfa3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:37.825778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09adf38-80e2-4094-a7b4-c2e3f2cfa3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:37.826056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09adf38-80e2-4094-a7b4-c2e3f2cfa3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:37.826432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09adf38-80e2-4094-a7b4-c2e3f2cfa3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.829261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09adf38-80e2-4094-a7b4-c2e3f2cfa3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:37.830707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09adf38-80e2-4094-a7b4-c2e3f2cfa3a3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:37.839028 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3690/7379] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:37 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:51:37.854842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aba452-12a7-4bfe-ad6a-dfa49619a0e8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:37.856656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54aba452-12a7-4bfe-ad6a-dfa49619a0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:37.861482 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3690/7380] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:37.865643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09adf38-80e2-4094-a7b4-c2e3f2cfa3a3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:37.876515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:37.885136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09adf38-80e2-4094-a7b4-c2e3f2cfa3a3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:37.894196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95211b5d-b810-41ba-a061-b807bd8d8180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:37.895106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95211b5d-b810-41ba-a061-b807bd8d8180 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:37.895452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95211b5d-b810-41ba-a061-b807bd8d8180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:37.896269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95211b5d-b810-41ba-a061-b807bd8d8180 admin admin] PATH_INFO: `/v3/projects/cafc583ae64b429696d4015eecae81b4/users/d2a1b1a588054ea2845792a92feaa1c3/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.900318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95211b5d-b810-41ba-a061-b807bd8d8180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafc583ae64b429696d4015eecae81b4, user_id=d2a1b1a588054ea2845792a92feaa1c3, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:37.903822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95211b5d-b810-41ba-a061-b807bd8d8180 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:37.918290 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3691/7381] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:37 2022] PUT /identity/v3/projects/cafc583ae64b429696d4015eecae81b4/users/d2a1b1a588054ea2845792a92feaa1c3/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:37.930997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3021d81-ba71-4ee5-bafa-9c02a4d47c59 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:37.931471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3021d81-ba71-4ee5-bafa-9c02a4d47c59 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:37.931749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3021d81-ba71-4ee5-bafa-9c02a4d47c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.971243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a3021d81-ba71-4ee5-bafa-9c02a4d47c59 None None] MFA Rules not processed for user `d2a1b1a588054ea2845792a92feaa1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:37.973467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a3021d81-ba71-4ee5-bafa-9c02a4d47c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:37.986313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aba452-12a7-4bfe-ad6a-dfa49619a0e8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:38.099740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750dd837-a3bc-4eff-a2fe-f595925a60ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:38.100381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dd837-a3bc-4eff-a2fe-f595925a60ca service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:38.100660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dd837-a3bc-4eff-a2fe-f595925a60ca service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:38.100934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dd837-a3bc-4eff-a2fe-f595925a60ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:38.173350 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3692/7382] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:38.256114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750dd837-a3bc-4eff-a2fe-f595925a60ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:38.260347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750dd837-a3bc-4eff-a2fe-f595925a60ca service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:38.285416 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3691/7383] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:37 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:38.289870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3021d81-ba71-4ee5-bafa-9c02a4d47c59 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:38.291326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a3021d81-ba71-4ee5-bafa-9c02a4d47c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:38.299749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:38.395814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3021d81-ba71-4ee5-bafa-9c02a4d47c59 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:38.408979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f7829-81c8-4ae0-8539-24772b8d6bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:38.409645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f7829-81c8-4ae0-8539-24772b8d6bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:38.409992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f7829-81c8-4ae0-8539-24772b8d6bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:38.410324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f7829-81c8-4ae0-8539-24772b8d6bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:38.422622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750dd837-a3bc-4eff-a2fe-f595925a60ca service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:38.424457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-750dd837-a3bc-4eff-a2fe-f595925a60ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:38.425506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f7829-81c8-4ae0-8539-24772b8d6bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:38.427151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f7829-81c8-4ae0-8539-24772b8d6bb4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:38.461227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750dd837-a3bc-4eff-a2fe-f595925a60ca service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:38.464223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9d46e-ce27-4684-8947-fee3858f2f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:38.464821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9d46e-ce27-4684-8947-fee3858f2f41 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:38.465204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9d46e-ce27-4684-8947-fee3858f2f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:38.465495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9d46e-ce27-4684-8947-fee3858f2f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:38.467849 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3693/7384] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:38.593313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9d46e-ce27-4684-8947-fee3858f2f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:38.595327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9d46e-ce27-4684-8947-fee3858f2f41 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:38.609218 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3692/7385] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:38 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:51:40.884510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f7829-81c8-4ae0-8539-24772b8d6bb4 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:41.077949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f7829-81c8-4ae0-8539-24772b8d6bb4 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:41.085012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fb6c0-b43a-41ea-b3ca-5d4921fcb6d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:41.086277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fb6c0-b43a-41ea-b3ca-5d4921fcb6d5 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:41.086673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fb6c0-b43a-41ea-b3ca-5d4921fcb6d5 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:41.087043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fb6c0-b43a-41ea-b3ca-5d4921fcb6d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:41.089296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-824fb6c0-b43a-41ea-b3ca-5d4921fcb6d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:41.169596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fb6c0-b43a-41ea-b3ca-5d4921fcb6d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:41.171592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fb6c0-b43a-41ea-b3ca-5d4921fcb6d5 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:41.191519 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3694/7386] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:40 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:42.400182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08432854-3ffc-4d61-b3e6-1be0f594f92f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:42.402557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08432854-3ffc-4d61-b3e6-1be0f594f92f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:42.403055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08432854-3ffc-4d61-b3e6-1be0f594f92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:42.449781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-08432854-3ffc-4d61-b3e6-1be0f594f92f None None] MFA Rules not processed for user `c2eb2f3c887947d5978d6bebd51c5b72`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:42.451471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08432854-3ffc-4d61-b3e6-1be0f594f92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:42.468658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:42.547685 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3693/7387] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:44.488291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fb6c0-b43a-41ea-b3ca-5d4921fcb6d5 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:44.597294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:44.618646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fb6c0-b43a-41ea-b3ca-5d4921fcb6d5 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:44.634373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f4bd8-2ff8-423a-9640-f76d43a866d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:44.635124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f4bd8-2ff8-423a-9640-f76d43a866d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:44.635636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f4bd8-2ff8-423a-9640-f76d43a866d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:44.635753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f4bd8-2ff8-423a-9640-f76d43a866d6 admin admin] PATH_INFO: `/v3/users/f03556841d9c467d88f4b4a2f8d6afc0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:44.637844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f4bd8-2ff8-423a-9640-f76d43a866d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f03556841d9c467d88f4b4a2f8d6afc0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:44.639915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f4bd8-2ff8-423a-9640-f76d43a866d6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:44.691480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08432854-3ffc-4d61-b3e6-1be0f594f92f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:44.693373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08432854-3ffc-4d61-b3e6-1be0f594f92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:44.740728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-137f4bd8-2ff8-423a-9640-f76d43a866d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f03556841d9c467d88f4b4a2f8d6afc0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.791444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-137f4bd8-2ff8-423a-9640-f76d43a866d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f03556841d9c467d88f4b4a2f8d6afc0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.792927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-137f4bd8-2ff8-423a-9640-f76d43a866d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f03556841d9c467d88f4b4a2f8d6afc0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.802772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-137f4bd8-2ff8-423a-9640-f76d43a866d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f03556841d9c467d88f4b4a2f8d6afc0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.815547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-137f4bd8-2ff8-423a-9640-f76d43a866d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f03556841d9c467d88f4b4a2f8d6afc0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.845233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08432854-3ffc-4d61-b3e6-1be0f594f92f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:44.848617 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3695/7388] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:44 2022] DELETE /identity/v3/users/f03556841d9c467d88f4b4a2f8d6afc0 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:44.849507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f4bd8-2ff8-423a-9640-f76d43a866d6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:44.850917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-137f4bd8-2ff8-423a-9640-f76d43a866d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:44.973603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae35ee-c798-42f4-88a0-cdd7587f1b7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:44.975273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae35ee-c798-42f4-88a0-cdd7587f1b7d service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:44.975745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae35ee-c798-42f4-88a0-cdd7587f1b7d service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:44.977457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae35ee-c798-42f4-88a0-cdd7587f1b7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:44.981396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d7ae35ee-c798-42f4-88a0-cdd7587f1b7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:45.004527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae35ee-c798-42f4-88a0-cdd7587f1b7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:45.007807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae35ee-c798-42f4-88a0-cdd7587f1b7d service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:45.025842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f4bd8-2ff8-423a-9640-f76d43a866d6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:45.039037 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3694/7389] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:51:45.041148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56962c24-4e51-4de3-a8ce-750781700970 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:45.042673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56962c24-4e51-4de3-a8ce-750781700970 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:45.043999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56962c24-4e51-4de3-a8ce-750781700970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:45.046031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601072fb-efe9-43ba-81e0-985e2cf96ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:45.046692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601072fb-efe9-43ba-81e0-985e2cf96ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:45.046973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601072fb-efe9-43ba-81e0-985e2cf96ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:45.047246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601072fb-efe9-43ba-81e0-985e2cf96ff4 admin admin] PATH_INFO: `/v3/users/4092f136affb40698983b7e55965a865` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:45.049961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601072fb-efe9-43ba-81e0-985e2cf96ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4092f136affb40698983b7e55965a865)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:45.054340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601072fb-efe9-43ba-81e0-985e2cf96ff4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:45.086974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-56962c24-4e51-4de3-a8ce-750781700970 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:45.088824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56962c24-4e51-4de3-a8ce-750781700970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:45.113409 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3695/7390] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:45.126022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56962c24-4e51-4de3-a8ce-750781700970 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:45.129185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56962c24-4e51-4de3-a8ce-750781700970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:45.154839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-601072fb-efe9-43ba-81e0-985e2cf96ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4092f136affb40698983b7e55965a865'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.172834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-601072fb-efe9-43ba-81e0-985e2cf96ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4092f136affb40698983b7e55965a865'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.175290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-601072fb-efe9-43ba-81e0-985e2cf96ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4092f136affb40698983b7e55965a865'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.175978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-601072fb-efe9-43ba-81e0-985e2cf96ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4092f136affb40698983b7e55965a865'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.178024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:45.206192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-601072fb-efe9-43ba-81e0-985e2cf96ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4092f136affb40698983b7e55965a865'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.234121 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3696/7391] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:44 2022] DELETE /identity/v3/users/4092f136affb40698983b7e55965a865 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:45.241247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e516c-8ba5-4800-81b0-42e4fff5264c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:45.242493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e516c-8ba5-4800-81b0-42e4fff5264c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:45.242493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e516c-8ba5-4800-81b0-42e4fff5264c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:45.283120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:45.285906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-388e516c-8ba5-4800-81b0-42e4fff5264c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:45.291518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-388e516c-8ba5-4800-81b0-42e4fff5264c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:45.326847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56962c24-4e51-4de3-a8ce-750781700970 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:45.390714 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3697/7392] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:45.402353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e516c-8ba5-4800-81b0-42e4fff5264c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:45.404052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-388e516c-8ba5-4800-81b0-42e4fff5264c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:45.484746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258cccc-3204-4dfd-ae30-7304f579bcbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:45.486816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258cccc-3204-4dfd-ae30-7304f579bcbe service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:45.486816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258cccc-3204-4dfd-ae30-7304f579bcbe service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:45.486816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258cccc-3204-4dfd-ae30-7304f579bcbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:45.491820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a258cccc-3204-4dfd-ae30-7304f579bcbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:45.522485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258cccc-3204-4dfd-ae30-7304f579bcbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:45.523900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258cccc-3204-4dfd-ae30-7304f579bcbe service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:45.551914 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3696/7393] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:45.596879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258cccc-3204-4dfd-ae30-7304f579bcbe service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:45.598824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a258cccc-3204-4dfd-ae30-7304f579bcbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:45.619498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e516c-8ba5-4800-81b0-42e4fff5264c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:45.625711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258cccc-3204-4dfd-ae30-7304f579bcbe service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:45.635573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8892475-780c-4b93-8ce2-e59130542b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:45.638688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8892475-780c-4b93-8ce2-e59130542b6a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:45.639179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8892475-780c-4b93-8ce2-e59130542b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:45.641683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8892475-780c-4b93-8ce2-e59130542b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:45.644920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f522f-6eb3-4923-8d00-a28fc150ea62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:45.645494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f522f-6eb3-4923-8d00-a28fc150ea62 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:45.645777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f522f-6eb3-4923-8d00-a28fc150ea62 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:45.646058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f522f-6eb3-4923-8d00-a28fc150ea62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:45.655666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-319f522f-6eb3-4923-8d00-a28fc150ea62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:45.674612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8892475-780c-4b93-8ce2-e59130542b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:45.676171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8892475-780c-4b93-8ce2-e59130542b6a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:45.695592 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3698/7394] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:45.855163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f522f-6eb3-4923-8d00-a28fc150ea62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:45.866182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f522f-6eb3-4923-8d00-a28fc150ea62 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:45.898864 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3697/7395] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:45 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:51:46.294813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8892475-780c-4b93-8ce2-e59130542b6a service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:46.296372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e8892475-780c-4b93-8ce2-e59130542b6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:46.322982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8892475-780c-4b93-8ce2-e59130542b6a service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:46.340751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab442153-85ed-411f-ab38-f3b0e20f5e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:46.344807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab442153-85ed-411f-ab38-f3b0e20f5e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:46.345370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab442153-85ed-411f-ab38-f3b0e20f5e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:46.346491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab442153-85ed-411f-ab38-f3b0e20f5e32 admin admin] PATH_INFO: `/v3/projects/191b3625211142c9b1fdb43ecf3ce143` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:46.350746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab442153-85ed-411f-ab38-f3b0e20f5e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=191b3625211142c9b1fdb43ecf3ce143)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:46.356822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab442153-85ed-411f-ab38-f3b0e20f5e32 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:46.488798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ab442153-85ed-411f-ab38-f3b0e20f5e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '191b3625211142c9b1fdb43ecf3ce143', 'request_id': 'req-ab442153-85ed-411f-ab38-f3b0e20f5e32'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.502378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ab442153-85ed-411f-ab38-f3b0e20f5e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '191b3625211142c9b1fdb43ecf3ce143', 'request_id': 'req-ab442153-85ed-411f-ab38-f3b0e20f5e32'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.524094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ab442153-85ed-411f-ab38-f3b0e20f5e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '191b3625211142c9b1fdb43ecf3ce143', 'request_id': 'req-ab442153-85ed-411f-ab38-f3b0e20f5e32'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.545725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ab442153-85ed-411f-ab38-f3b0e20f5e32 admin admin] The token cache is being invalidate because project 191b3625211142c9b1fdb43ecf3ce143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:46.547171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ab442153-85ed-411f-ab38-f3b0e20f5e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.549967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ab442153-85ed-411f-ab38-f3b0e20f5e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.554346 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3699/7396] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:46 2022] DELETE /identity/v3/projects/191b3625211142c9b1fdb43ecf3ce143 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:46.559562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f522f-6eb3-4923-8d00-a28fc150ea62 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:46.592424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f522f-6eb3-4923-8d00-a28fc150ea62 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:46.612871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab442153-85ed-411f-ab38-f3b0e20f5e32 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:46.614768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ab442153-85ed-411f-ab38-f3b0e20f5e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:46.628042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:46.745708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e3fe3-a1b9-4950-ba8c-97ec6a1ef9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:46.746407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e3fe3-a1b9-4950-ba8c-97ec6a1ef9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:46.746685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e3fe3-a1b9-4950-ba8c-97ec6a1ef9da admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:46.746981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e3fe3-a1b9-4950-ba8c-97ec6a1ef9da admin admin] PATH_INFO: `/v3/users/9ff9177b7ec4438da2707e3b05eecd8f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:46.755900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e3fe3-a1b9-4950-ba8c-97ec6a1ef9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ff9177b7ec4438da2707e3b05eecd8f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:46.764378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e3fe3-a1b9-4950-ba8c-97ec6a1ef9da admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:46.800260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab442153-85ed-411f-ab38-f3b0e20f5e32 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:46.806194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecc143-4047-47b5-877c-c7dca4c7227a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:46.808603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecc143-4047-47b5-877c-c7dca4c7227a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:46.808603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecc143-4047-47b5-877c-c7dca4c7227a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:46.808603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecc143-4047-47b5-877c-c7dca4c7227a admin admin] PATH_INFO: `/v3/projects/cff8500e963f407f964c88752c98154c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:46.809611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ecc143-4047-47b5-877c-c7dca4c7227a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff8500e963f407f964c88752c98154c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:46.813127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ecc143-4047-47b5-877c-c7dca4c7227a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:46.930553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:46.947368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a94e3fe3-a1b9-4950-ba8c-97ec6a1ef9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ff9177b7ec4438da2707e3b05eecd8f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.950197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a94e3fe3-a1b9-4950-ba8c-97ec6a1ef9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ff9177b7ec4438da2707e3b05eecd8f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.965012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a94e3fe3-a1b9-4950-ba8c-97ec6a1ef9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ff9177b7ec4438da2707e3b05eecd8f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.971512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-20ecc143-4047-47b5-877c-c7dca4c7227a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff8500e963f407f964c88752c98154c', 'request_id': 'req-20ecc143-4047-47b5-877c-c7dca4c7227a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.978652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a94e3fe3-a1b9-4950-ba8c-97ec6a1ef9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ff9177b7ec4438da2707e3b05eecd8f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.992271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-20ecc143-4047-47b5-877c-c7dca4c7227a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff8500e963f407f964c88752c98154c', 'request_id': 'req-20ecc143-4047-47b5-877c-c7dca4c7227a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:47.008590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-20ecc143-4047-47b5-877c-c7dca4c7227a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff8500e963f407f964c88752c98154c', 'request_id': 'req-20ecc143-4047-47b5-877c-c7dca4c7227a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:47.009900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a94e3fe3-a1b9-4950-ba8c-97ec6a1ef9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ff9177b7ec4438da2707e3b05eecd8f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:47.042743 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3698/7397] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:46 2022] DELETE /identity/v3/users/9ff9177b7ec4438da2707e3b05eecd8f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:47.049262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-20ecc143-4047-47b5-877c-c7dca4c7227a admin admin] The token cache is being invalidate because project cff8500e963f407f964c88752c98154c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:47.049650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-20ecc143-4047-47b5-877c-c7dca4c7227a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:47.050541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-20ecc143-4047-47b5-877c-c7dca4c7227a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:47.052530 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3700/7398] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:46 2022] DELETE /identity/v3/projects/cff8500e963f407f964c88752c98154c => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:47.062757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e3fe3-a1b9-4950-ba8c-97ec6a1ef9da admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:47.066921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a94e3fe3-a1b9-4950-ba8c-97ec6a1ef9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:47.217497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e3fe3-a1b9-4950-ba8c-97ec6a1ef9da admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:47.222676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3c786-6d51-453f-964c-3f2c6848e20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:47.223416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3c786-6d51-453f-964c-3f2c6848e20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:47.223837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3c786-6d51-453f-964c-3f2c6848e20c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:47.224125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3c786-6d51-453f-964c-3f2c6848e20c admin admin] PATH_INFO: `/v3/users/d2a1b1a588054ea2845792a92feaa1c3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:47.225302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3c786-6d51-453f-964c-3f2c6848e20c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2a1b1a588054ea2845792a92feaa1c3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:47.227522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3c786-6d51-453f-964c-3f2c6848e20c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:47.330013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79a3c786-6d51-453f-964c-3f2c6848e20c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2a1b1a588054ea2845792a92feaa1c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:47.331074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79a3c786-6d51-453f-964c-3f2c6848e20c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2a1b1a588054ea2845792a92feaa1c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:47.345879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79a3c786-6d51-453f-964c-3f2c6848e20c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2a1b1a588054ea2845792a92feaa1c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:47.375164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79a3c786-6d51-453f-964c-3f2c6848e20c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2a1b1a588054ea2845792a92feaa1c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:47.397589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79a3c786-6d51-453f-964c-3f2c6848e20c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2a1b1a588054ea2845792a92feaa1c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:47.412334 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3699/7399] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:47 2022] DELETE /identity/v3/users/d2a1b1a588054ea2845792a92feaa1c3 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:47.597435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecc143-4047-47b5-877c-c7dca4c7227a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:47.599481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-20ecc143-4047-47b5-877c-c7dca4c7227a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:47.832490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecc143-4047-47b5-877c-c7dca4c7227a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.013218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:48.040716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.041830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.042404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.043007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a admin admin] PATH_INFO: `/v3/projects/8161473ea9774b7d825c4fbbb9d71c93` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.045004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8161473ea9774b7d825c4fbbb9d71c93)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.048115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:48.165012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8161473ea9774b7d825c4fbbb9d71c93', 'request_id': 'req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:48.202994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8161473ea9774b7d825c4fbbb9d71c93', 'request_id': 'req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:48.218147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8161473ea9774b7d825c4fbbb9d71c93', 'request_id': 'req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:48.250088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a admin admin] The token cache is being invalidate because project 8161473ea9774b7d825c4fbbb9d71c93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:48.250396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:48.251665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:48.260103 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3701/7400] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:47 2022] DELETE /identity/v3/projects/8161473ea9774b7d825c4fbbb9d71c93 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:48.261407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34029e3e-48fb-49a9-ad54-95d69ed7b0a3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.261892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34029e3e-48fb-49a9-ad54-95d69ed7b0a3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.261999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34029e3e-48fb-49a9-ad54-95d69ed7b0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.272588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:48.274139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:48.293954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-34029e3e-48fb-49a9-ad54-95d69ed7b0a3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:48.295281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-34029e3e-48fb-49a9-ad54-95d69ed7b0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:48.370109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:48.381694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bb690-6e40-4e2b-b707-bd51a11ca69a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.393542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232e387-8d48-4af9-8e4a-53ff5d5888f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.396060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232e387-8d48-4af9-8e4a-53ff5d5888f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.396847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232e387-8d48-4af9-8e4a-53ff5d5888f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.398406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232e387-8d48-4af9-8e4a-53ff5d5888f6 admin admin] PATH_INFO: `/v3/users/6b9da09d033c4412bb7bd606ce1d2d4f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.400516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232e387-8d48-4af9-8e4a-53ff5d5888f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b9da09d033c4412bb7bd606ce1d2d4f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.402719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232e387-8d48-4af9-8e4a-53ff5d5888f6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:48.440833 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3700/7401] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:48.443701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4308b-4021-42e1-8878-b14871bdfb75 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.443701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4308b-4021-42e1-8878-b14871bdfb75 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.444061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4308b-4021-42e1-8878-b14871bdfb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.488974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-45c4308b-4021-42e1-8878-b14871bdfb75 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:48.490194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-45c4308b-4021-42e1-8878-b14871bdfb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:48.509339 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3701/7402] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:48.509589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9232e387-8d48-4af9-8e4a-53ff5d5888f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b9da09d033c4412bb7bd606ce1d2d4f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:48.510477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4308b-4021-42e1-8878-b14871bdfb75 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:48.527796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4308b-4021-42e1-8878-b14871bdfb75 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.541901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9232e387-8d48-4af9-8e4a-53ff5d5888f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b9da09d033c4412bb7bd606ce1d2d4f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:48.543623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9232e387-8d48-4af9-8e4a-53ff5d5888f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b9da09d033c4412bb7bd606ce1d2d4f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:48.544689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9232e387-8d48-4af9-8e4a-53ff5d5888f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b9da09d033c4412bb7bd606ce1d2d4f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:48.546768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc7a04-1a83-4e5c-aaee-e227fb3cd0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.547434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc7a04-1a83-4e5c-aaee-e227fb3cd0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.547715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc7a04-1a83-4e5c-aaee-e227fb3cd0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.547990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc7a04-1a83-4e5c-aaee-e227fb3cd0c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.548743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc7a04-1a83-4e5c-aaee-e227fb3cd0c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:48.548945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc7a04-1a83-4e5c-aaee-e227fb3cd0c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.550568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc7a04-1a83-4e5c-aaee-e227fb3cd0c5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:48.569308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9232e387-8d48-4af9-8e4a-53ff5d5888f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b9da09d033c4412bb7bd606ce1d2d4f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:48.577410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:48.577733 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3702/7403] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:48.582068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc7a04-1a83-4e5c-aaee-e227fb3cd0c5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:48.583860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-01cc7a04-1a83-4e5c-aaee-e227fb3cd0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:48.604163 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3702/7404] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:48 2022] DELETE /identity/v3/users/6b9da09d033c4412bb7bd606ce1d2d4f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:48.606075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22136033-424a-4d5e-803e-c6a19e84e607 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.606963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22136033-424a-4d5e-803e-c6a19e84e607 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.607366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22136033-424a-4d5e-803e-c6a19e84e607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.607571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc7a04-1a83-4e5c-aaee-e227fb3cd0c5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.649187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-22136033-424a-4d5e-803e-c6a19e84e607 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:48.650758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-22136033-424a-4d5e-803e-c6a19e84e607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:48.735322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801c6eb-3056-4579-b16f-06b2713e4844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.736183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801c6eb-3056-4579-b16f-06b2713e4844 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.736745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801c6eb-3056-4579-b16f-06b2713e4844 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.737170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801c6eb-3056-4579-b16f-06b2713e4844 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.738008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801c6eb-3056-4579-b16f-06b2713e4844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.740403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801c6eb-3056-4579-b16f-06b2713e4844 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:48.787613 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3703/7405] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:48 2022] POST /identity/v3/projects => generated 391 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:51:48.788036 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3703/7406] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:48.791856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801c6eb-3056-4579-b16f-06b2713e4844 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:48.804457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22136033-424a-4d5e-803e-c6a19e84e607 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:48.806288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-22136033-424a-4d5e-803e-c6a19e84e607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:48.959744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801c6eb-3056-4579-b16f-06b2713e4844 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.960868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22136033-424a-4d5e-803e-c6a19e84e607 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.970083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4e38c-907c-4424-ae85-ed45335f1a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.972554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4e38c-907c-4424-ae85-ed45335f1a0c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.973436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4e38c-907c-4424-ae85-ed45335f1a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.974580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4e38c-907c-4424-ae85-ed45335f1a0c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.975377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4e38c-907c-4424-ae85-ed45335f1a0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.980758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4e38c-907c-4424-ae85-ed45335f1a0c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:49.047457 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3704/7407] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:48 2022] POST /identity/v3/users => generated 296 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:51:49.049112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4e38c-907c-4424-ae85-ed45335f1a0c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:49.054752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4e4e38c-907c-4424-ae85-ed45335f1a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:49.090494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4e38c-907c-4424-ae85-ed45335f1a0c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:49.098980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea43296-49d8-44c2-83f3-1bb4b24099e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:49.099887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea43296-49d8-44c2-83f3-1bb4b24099e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:49.100252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea43296-49d8-44c2-83f3-1bb4b24099e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:49.100727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea43296-49d8-44c2-83f3-1bb4b24099e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:49.103570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4f1de-aab2-4150-971e-c4665027fff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:49.106306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4f1de-aab2-4150-971e-c4665027fff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:49.106659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4f1de-aab2-4150-971e-c4665027fff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:49.108214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4f1de-aab2-4150-971e-c4665027fff9 admin admin] PATH_INFO: `/v3/projects/cafc583ae64b429696d4015eecae81b4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:49.111584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4f1de-aab2-4150-971e-c4665027fff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cafc583ae64b429696d4015eecae81b4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:49.114464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4f1de-aab2-4150-971e-c4665027fff9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:49.126784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea43296-49d8-44c2-83f3-1bb4b24099e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:49.128650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea43296-49d8-44c2-83f3-1bb4b24099e4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:49.170935 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3704/7408] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:51:49.172007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea43296-49d8-44c2-83f3-1bb4b24099e4 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:49.189056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:49.215803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7b4f1de-aab2-4150-971e-c4665027fff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cafc583ae64b429696d4015eecae81b4', 'request_id': 'req-f7b4f1de-aab2-4150-971e-c4665027fff9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:49.225670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea43296-49d8-44c2-83f3-1bb4b24099e4 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:49.267799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7b4f1de-aab2-4150-971e-c4665027fff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cafc583ae64b429696d4015eecae81b4', 'request_id': 'req-f7b4f1de-aab2-4150-971e-c4665027fff9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:49.275948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7b4f1de-aab2-4150-971e-c4665027fff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cafc583ae64b429696d4015eecae81b4', 'request_id': 'req-f7b4f1de-aab2-4150-971e-c4665027fff9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:49.307002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7b4f1de-aab2-4150-971e-c4665027fff9 admin admin] The token cache is being invalidate because project cafc583ae64b429696d4015eecae81b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:49.311732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7b4f1de-aab2-4150-971e-c4665027fff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:49.311732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7b4f1de-aab2-4150-971e-c4665027fff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:49.332029 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3705/7409] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:49 2022] DELETE /identity/v3/projects/cafc583ae64b429696d4015eecae81b4 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:49.341794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec113b1-7b0a-4d24-821a-514535ea7c5b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:49.342519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec113b1-7b0a-4d24-821a-514535ea7c5b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:49.343169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec113b1-7b0a-4d24-821a-514535ea7c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:49.372091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:49.384933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbddf9b-ad7b-4ac6-8955-85a78b55860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:49.384933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbddf9b-ad7b-4ac6-8955-85a78b55860d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:49.384933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbddf9b-ad7b-4ac6-8955-85a78b55860d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:49.384933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbddf9b-ad7b-4ac6-8955-85a78b55860d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:49.387633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbddf9b-ad7b-4ac6-8955-85a78b55860d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:49.389418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbddf9b-ad7b-4ac6-8955-85a78b55860d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:49.422034 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3705/7410] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:49.427814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4ec113b1-7b0a-4d24-821a-514535ea7c5b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:49.432174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbddf9b-ad7b-4ac6-8955-85a78b55860d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:49.434814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4ec113b1-7b0a-4d24-821a-514535ea7c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:49.441918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5bbddf9b-ad7b-4ac6-8955-85a78b55860d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:49.472775 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3706/7411] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:49.482020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c9780-c78f-4bdc-92d0-30c664fa8663 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:49.482520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c9780-c78f-4bdc-92d0-30c664fa8663 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:49.482937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c9780-c78f-4bdc-92d0-30c664fa8663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:49.502701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbddf9b-ad7b-4ac6-8955-85a78b55860d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:49.530909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cebf40-aedb-4bf8-b067-55ef5028b557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:49.531655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cebf40-aedb-4bf8-b067-55ef5028b557 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:49.532057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cebf40-aedb-4bf8-b067-55ef5028b557 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:49.532283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cebf40-aedb-4bf8-b067-55ef5028b557 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:49.533008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cebf40-aedb-4bf8-b067-55ef5028b557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:49.536168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cebf40-aedb-4bf8-b067-55ef5028b557 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:49.560099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f87c9780-c78f-4bdc-92d0-30c664fa8663 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:49.565557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f87c9780-c78f-4bdc-92d0-30c664fa8663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:49.593086 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3706/7412] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:49.595544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cebf40-aedb-4bf8-b067-55ef5028b557 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:49.601291 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3707/7413] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:49.606232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c9780-c78f-4bdc-92d0-30c664fa8663 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:49.629992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cebf40-aedb-4bf8-b067-55ef5028b557 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:49.648769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c9780-c78f-4bdc-92d0-30c664fa8663 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:49.659009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf8727-f8ce-4592-9cf9-62fe8f001961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:49.661426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf8727-f8ce-4592-9cf9-62fe8f001961 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:49.661671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf8727-f8ce-4592-9cf9-62fe8f001961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:49.662850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf8727-f8ce-4592-9cf9-62fe8f001961 admin admin] PATH_INFO: `/v3/projects/9a8193c28c054de3aa2f32cea82808f8/users/1c94407c9bdf4bf4839a68612c3b85e1/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:49.667595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb439c-ccc3-4ebb-b3a8-5e21d059ddca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:49.670225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb439c-ccc3-4ebb-b3a8-5e21d059ddca admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:49.670577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb439c-ccc3-4ebb-b3a8-5e21d059ddca admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:49.670868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb439c-ccc3-4ebb-b3a8-5e21d059ddca admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:49.671600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb439c-ccc3-4ebb-b3a8-5e21d059ddca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:49.673738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb439c-ccc3-4ebb-b3a8-5e21d059ddca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:49.678741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb439c-ccc3-4ebb-b3a8-5e21d059ddca admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:49.729732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf8727-f8ce-4592-9cf9-62fe8f001961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8193c28c054de3aa2f32cea82808f8, user_id=1c94407c9bdf4bf4839a68612c3b85e1, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:49.733517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf8727-f8ce-4592-9cf9-62fe8f001961 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:49.738640 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3708/7414] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:49.741855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb439c-ccc3-4ebb-b3a8-5e21d059ddca admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:49.770988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb439c-ccc3-4ebb-b3a8-5e21d059ddca admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:49.772434 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3707/7415] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:49 2022] PUT /identity/v3/projects/9a8193c28c054de3aa2f32cea82808f8/users/1c94407c9bdf4bf4839a68612c3b85e1/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:49.783511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67701f-03f7-4caf-a025-ef79a9431f94 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:49.783922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67701f-03f7-4caf-a025-ef79a9431f94 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:49.784582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67701f-03f7-4caf-a025-ef79a9431f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:49.850053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-af67701f-03f7-4caf-a025-ef79a9431f94 None None] MFA Rules not processed for user `1c94407c9bdf4bf4839a68612c3b85e1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:49.850995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-af67701f-03f7-4caf-a025-ef79a9431f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:50.011341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bbbf6-659a-4970-973d-4b875f958c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:50.012611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bbbf6-659a-4970-973d-4b875f958c55 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.013148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bbbf6-659a-4970-973d-4b875f958c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.013641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bbbf6-659a-4970-973d-4b875f958c55 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.014728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bbbf6-659a-4970-973d-4b875f958c55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:50.025611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bbbf6-659a-4970-973d-4b875f958c55 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:50.075351 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3708/7416] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:51:50.081595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67701f-03f7-4caf-a025-ef79a9431f94 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:50.088879 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3709/7417] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:49 2022] POST /identity/v3/projects => generated 377 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:50.095227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bbbf6-659a-4970-973d-4b875f958c55 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:50.099725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67701f-03f7-4caf-a025-ef79a9431f94 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:50.208293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bbbf6-659a-4970-973d-4b875f958c55 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:50.214630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a28e4a-a70a-4a09-b141-f2950d7f7440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:50.215308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a28e4a-a70a-4a09-b141-f2950d7f7440 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.216309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a28e4a-a70a-4a09-b141-f2950d7f7440 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.216309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a28e4a-a70a-4a09-b141-f2950d7f7440 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.217194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a28e4a-a70a-4a09-b141-f2950d7f7440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:50.219660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a28e4a-a70a-4a09-b141-f2950d7f7440 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:50.250051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7796c-be90-4fb3-a043-0c73b2d240fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:50.251247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7796c-be90-4fb3-a043-0c73b2d240fb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.251617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7796c-be90-4fb3-a043-0c73b2d240fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.251956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7796c-be90-4fb3-a043-0c73b2d240fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.253293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7796c-be90-4fb3-a043-0c73b2d240fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:50.257275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7796c-be90-4fb3-a043-0c73b2d240fb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:50.277074 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3710/7418] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:50 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:50.282034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a28e4a-a70a-4a09-b141-f2950d7f7440 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:50.301839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:50.317021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a28e4a-a70a-4a09-b141-f2950d7f7440 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:50.335441 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3709/7419] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:50 2022] POST /identity/v3/projects => generated 393 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:50.335441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7796c-be90-4fb3-a043-0c73b2d240fb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:50.448836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed6a1f-8994-4b21-a089-b2e7ad36b374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:50.451653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed6a1f-8994-4b21-a089-b2e7ad36b374 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.452906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed6a1f-8994-4b21-a089-b2e7ad36b374 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.455714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:50.456203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed6a1f-8994-4b21-a089-b2e7ad36b374 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.458005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed6a1f-8994-4b21-a089-b2e7ad36b374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:50.469195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed6a1f-8994-4b21-a089-b2e7ad36b374 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:50.498348 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3711/7420] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:50.504038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed6a1f-8994-4b21-a089-b2e7ad36b374 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:50.522360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7796c-be90-4fb3-a043-0c73b2d240fb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:50.525371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed6a1f-8994-4b21-a089-b2e7ad36b374 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:50.534699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2886722-357a-45b0-ac28-3834fc16adff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:50.536930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2886722-357a-45b0-ac28-3834fc16adff admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.537381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2886722-357a-45b0-ac28-3834fc16adff admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.538517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2886722-357a-45b0-ac28-3834fc16adff admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.540627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2886722-357a-45b0-ac28-3834fc16adff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:50.543563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2886722-357a-45b0-ac28-3834fc16adff admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:50.546765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97856c-dabb-4751-978d-8f6ebb8c435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:50.547940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97856c-dabb-4751-978d-8f6ebb8c435a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.548517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97856c-dabb-4751-978d-8f6ebb8c435a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.548670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97856c-dabb-4751-978d-8f6ebb8c435a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.549449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97856c-dabb-4751-978d-8f6ebb8c435a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:50.551190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97856c-dabb-4751-978d-8f6ebb8c435a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:50.594525 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3710/7421] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:50 2022] POST /identity/v3/users => generated 303 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:50.598959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2886722-357a-45b0-ac28-3834fc16adff admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:50.615777 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3712/7422] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:50.625237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2886722-357a-45b0-ac28-3834fc16adff admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:50.634411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97856c-dabb-4751-978d-8f6ebb8c435a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:50.661185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f892979-0a9a-4604-8c27-d47d2e443817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:50.665423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f892979-0a9a-4604-8c27-d47d2e443817 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.667642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f892979-0a9a-4604-8c27-d47d2e443817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.668123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f892979-0a9a-4604-8c27-d47d2e443817 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.668986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f892979-0a9a-4604-8c27-d47d2e443817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:50.680595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97856c-dabb-4751-978d-8f6ebb8c435a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:50.681179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f892979-0a9a-4604-8c27-d47d2e443817 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:50.688499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16c367-f478-4c0f-b56a-adf65009d6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:50.689399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16c367-f478-4c0f-b56a-adf65009d6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.690131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16c367-f478-4c0f-b56a-adf65009d6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.690500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16c367-f478-4c0f-b56a-adf65009d6e6 admin admin] PATH_INFO: `/v3/projects/3ec08f20c42f42ce9ee35d33e0a5340a/users/f5cef0a949db4c65955d601ac8cde5d9/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.737301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16c367-f478-4c0f-b56a-adf65009d6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec08f20c42f42ce9ee35d33e0a5340a, user_id=f5cef0a949db4c65955d601ac8cde5d9, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:50.745162 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3711/7423] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:50.748478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f892979-0a9a-4604-8c27-d47d2e443817 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:50.751985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16c367-f478-4c0f-b56a-adf65009d6e6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:50.785815 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3713/7424] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:50 2022] PUT /identity/v3/projects/3ec08f20c42f42ce9ee35d33e0a5340a/users/f5cef0a949db4c65955d601ac8cde5d9/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:50.792910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f892979-0a9a-4604-8c27-d47d2e443817 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:50.798114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cb2d0-aa69-44d3-b235-ffd8769a954a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.798388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cb2d0-aa69-44d3-b235-ffd8769a954a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.798667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cb2d0-aa69-44d3-b235-ffd8769a954a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.866900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8a9cb2d0-aa69-44d3-b235-ffd8769a954a None None] MFA Rules not processed for user `f5cef0a949db4c65955d601ac8cde5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:50.868380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a9cb2d0-aa69-44d3-b235-ffd8769a954a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:51.057148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87ef87-3777-42b7-bf10-9a57c22bb8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:51.058130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87ef87-3777-42b7-bf10-9a57c22bb8ce admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.058420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87ef87-3777-42b7-bf10-9a57c22bb8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.058698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87ef87-3777-42b7-bf10-9a57c22bb8ce admin admin] PATH_INFO: `/v3/projects/401e548f58bc44a2b3f84d2f9b682067/users/74f5f415b69e41e089fcc0d213543200/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.100230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87ef87-3777-42b7-bf10-9a57c22bb8ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=401e548f58bc44a2b3f84d2f9b682067, user_id=74f5f415b69e41e089fcc0d213543200, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:51.103166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87ef87-3777-42b7-bf10-9a57c22bb8ce admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:51.142734 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3712/7425] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:50 2022] PUT /identity/v3/projects/401e548f58bc44a2b3f84d2f9b682067/users/74f5f415b69e41e089fcc0d213543200/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:51.144167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87ef87-3777-42b7-bf10-9a57c22bb8ce admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:51.160377 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3714/7426] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:51:51.273694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cb2d0-aa69-44d3-b235-ffd8769a954a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:51.275534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a9cb2d0-aa69-44d3-b235-ffd8769a954a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:51.324654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cb2d0-aa69-44d3-b235-ffd8769a954a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:51.373910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87ef87-3777-42b7-bf10-9a57c22bb8ce admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:51.396765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1af47-545a-4f22-9614-3f06a96a85eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:51.397566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1af47-545a-4f22-9614-3f06a96a85eb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.397958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1af47-545a-4f22-9614-3f06a96a85eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.398325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1af47-545a-4f22-9614-3f06a96a85eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.399302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1af47-545a-4f22-9614-3f06a96a85eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:51.401424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1af47-545a-4f22-9614-3f06a96a85eb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:51.439078 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3713/7427] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:51.442856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1af47-545a-4f22-9614-3f06a96a85eb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:51.452455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-76c1af47-545a-4f22-9614-3f06a96a85eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:51.492494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:51.526037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc74bf5-d8ce-450b-b361-87f88f119744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:51.526694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc74bf5-d8ce-450b-b361-87f88f119744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.526969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc74bf5-d8ce-450b-b361-87f88f119744 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.527245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc74bf5-d8ce-450b-b361-87f88f119744 admin admin] PATH_INFO: `/v3/projects/739c089b6dda43648ffd8d74eb88c82b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.533998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc74bf5-d8ce-450b-b361-87f88f119744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=739c089b6dda43648ffd8d74eb88c82b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:51.536507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc74bf5-d8ce-450b-b361-87f88f119744 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:51.550660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:51.650592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1af47-545a-4f22-9614-3f06a96a85eb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:51.668436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6dc74bf5-d8ce-450b-b361-87f88f119744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '739c089b6dda43648ffd8d74eb88c82b', 'request_id': 'req-6dc74bf5-d8ce-450b-b361-87f88f119744'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:51.680031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6dc74bf5-d8ce-450b-b361-87f88f119744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '739c089b6dda43648ffd8d74eb88c82b', 'request_id': 'req-6dc74bf5-d8ce-450b-b361-87f88f119744'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:51.692112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6dc74bf5-d8ce-450b-b361-87f88f119744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '739c089b6dda43648ffd8d74eb88c82b', 'request_id': 'req-6dc74bf5-d8ce-450b-b361-87f88f119744'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:51.730251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6dc74bf5-d8ce-450b-b361-87f88f119744 admin admin] The token cache is being invalidate because project 739c089b6dda43648ffd8d74eb88c82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:51.731684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6dc74bf5-d8ce-450b-b361-87f88f119744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:51.740667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6dc74bf5-d8ce-450b-b361-87f88f119744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:51.748045 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3715/7428] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:51 2022] DELETE /identity/v3/projects/739c089b6dda43648ffd8d74eb88c82b => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:51.748045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc74bf5-d8ce-450b-b361-87f88f119744 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:51.748779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6dc74bf5-d8ce-450b-b361-87f88f119744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:51.790941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b90a8-31e5-4283-b3f5-ca11a790154a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:51.792352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b90a8-31e5-4283-b3f5-ca11a790154a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.793663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b90a8-31e5-4283-b3f5-ca11a790154a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.794033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b90a8-31e5-4283-b3f5-ca11a790154a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.796521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ce1b90a8-31e5-4283-b3f5-ca11a790154a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:51.919757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc74bf5-d8ce-450b-b361-87f88f119744 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:51.931597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b90a8-31e5-4283-b3f5-ca11a790154a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:51.932878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bd59c-8bbc-4d5f-bad2-34d7749c50c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:51.934208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bd59c-8bbc-4d5f-bad2-34d7749c50c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.934494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bd59c-8bbc-4d5f-bad2-34d7749c50c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.934617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b90a8-31e5-4283-b3f5-ca11a790154a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:51.935197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bd59c-8bbc-4d5f-bad2-34d7749c50c6 admin admin] PATH_INFO: `/v3/projects/401e548f58bc44a2b3f84d2f9b682067/users/74f5f415b69e41e089fcc0d213543200/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.939897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bd59c-8bbc-4d5f-bad2-34d7749c50c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=401e548f58bc44a2b3f84d2f9b682067, user_id=74f5f415b69e41e089fcc0d213543200, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:51.949316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bd59c-8bbc-4d5f-bad2-34d7749c50c6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:51.971375 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3716/7429] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:51 2022] PUT /identity/v3/projects/401e548f58bc44a2b3f84d2f9b682067/users/74f5f415b69e41e089fcc0d213543200/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:51.972323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bd59c-8bbc-4d5f-bad2-34d7749c50c6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:51.984851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d8bd59c-8bbc-4d5f-bad2-34d7749c50c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:51.994314 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3714/7430] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:51.997334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3852a-0094-4e31-92ab-6cee6b29da86 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.999176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3852a-0094-4e31-92ab-6cee6b29da86 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.999650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3852a-0094-4e31-92ab-6cee6b29da86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:52.083659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-82b3852a-0094-4e31-92ab-6cee6b29da86 None None] MFA Rules not processed for user `74f5f415b69e41e089fcc0d213543200`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:52.091272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-82b3852a-0094-4e31-92ab-6cee6b29da86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:52.165786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bd59c-8bbc-4d5f-bad2-34d7749c50c6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:52.193509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd4e10-7627-45a6-9935-69701b6512ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:52.194357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd4e10-7627-45a6-9935-69701b6512ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:52.194816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd4e10-7627-45a6-9935-69701b6512ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:52.195292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd4e10-7627-45a6-9935-69701b6512ca admin admin] PATH_INFO: `/v3/users/53d1e87e1bee4e44b19e08ee03bc67bc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:52.198056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd4e10-7627-45a6-9935-69701b6512ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d1e87e1bee4e44b19e08ee03bc67bc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:52.200363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd4e10-7627-45a6-9935-69701b6512ca admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:52.262691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:52.298445 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3715/7431] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:51 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:52.326240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39bd4e10-7627-45a6-9935-69701b6512ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d1e87e1bee4e44b19e08ee03bc67bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:52.328068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39bd4e10-7627-45a6-9935-69701b6512ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d1e87e1bee4e44b19e08ee03bc67bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:52.355638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39bd4e10-7627-45a6-9935-69701b6512ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d1e87e1bee4e44b19e08ee03bc67bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:52.380378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39bd4e10-7627-45a6-9935-69701b6512ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d1e87e1bee4e44b19e08ee03bc67bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:52.405223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39bd4e10-7627-45a6-9935-69701b6512ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d1e87e1bee4e44b19e08ee03bc67bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:52.414224 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3717/7432] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:51 2022] DELETE /identity/v3/users/53d1e87e1bee4e44b19e08ee03bc67bc => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:52.540412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3852a-0094-4e31-92ab-6cee6b29da86 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:52.543165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-82b3852a-0094-4e31-92ab-6cee6b29da86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:52.663518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:52.714290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3852a-0094-4e31-92ab-6cee6b29da86 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:52.805412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3537a0a-bd0f-4609-a275-f2fc57342fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:52.806472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3537a0a-bd0f-4609-a275-f2fc57342fbf service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:52.807111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3537a0a-bd0f-4609-a275-f2fc57342fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:52.807612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3537a0a-bd0f-4609-a275-f2fc57342fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:52.810734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d3537a0a-bd0f-4609-a275-f2fc57342fbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:52.940780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3537a0a-bd0f-4609-a275-f2fc57342fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:52.942816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3537a0a-bd0f-4609-a275-f2fc57342fbf service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:52.959055 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3716/7433] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:52 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:54.528828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd4e10-7627-45a6-9935-69701b6512ca admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:54.530841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-39bd4e10-7627-45a6-9935-69701b6512ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:54.672787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e6a53-4fd6-4e2b-b71d-b8d6d3ef74cf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:54.673372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e6a53-4fd6-4e2b-b71d-b8d6d3ef74cf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:54.673372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e6a53-4fd6-4e2b-b71d-b8d6d3ef74cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:54.727953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd4e10-7627-45a6-9935-69701b6512ca admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:54.730524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-453e6a53-4fd6-4e2b-b71d-b8d6d3ef74cf None None] MFA Rules not processed for user `7afaa3dd70cd4a64a2b3c51e8a3b9582`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:54.738281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-453e6a53-4fd6-4e2b-b71d-b8d6d3ef74cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:54.740774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ec936-e71c-4faf-9d05-c6a52bcb3ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:54.741565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ec936-e71c-4faf-9d05-c6a52bcb3ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:54.741947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ec936-e71c-4faf-9d05-c6a52bcb3ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:54.742387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ec936-e71c-4faf-9d05-c6a52bcb3ac8 admin admin] PATH_INFO: `/v3/projects/51af8fc65d884756a190401e88305e99` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:54.747997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ec936-e71c-4faf-9d05-c6a52bcb3ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51af8fc65d884756a190401e88305e99)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:54.750758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ec936-e71c-4faf-9d05-c6a52bcb3ac8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:54.863873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-804ec936-e71c-4faf-9d05-c6a52bcb3ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51af8fc65d884756a190401e88305e99', 'request_id': 'req-804ec936-e71c-4faf-9d05-c6a52bcb3ac8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:54.883061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-804ec936-e71c-4faf-9d05-c6a52bcb3ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51af8fc65d884756a190401e88305e99', 'request_id': 'req-804ec936-e71c-4faf-9d05-c6a52bcb3ac8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:54.894711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-804ec936-e71c-4faf-9d05-c6a52bcb3ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51af8fc65d884756a190401e88305e99', 'request_id': 'req-804ec936-e71c-4faf-9d05-c6a52bcb3ac8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:54.924672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-804ec936-e71c-4faf-9d05-c6a52bcb3ac8 admin admin] The token cache is being invalidate because project 51af8fc65d884756a190401e88305e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:54.925352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-804ec936-e71c-4faf-9d05-c6a52bcb3ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:54.929171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-804ec936-e71c-4faf-9d05-c6a52bcb3ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:54.931081 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3718/7434] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:54 2022] DELETE /identity/v3/projects/51af8fc65d884756a190401e88305e99 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:54.936972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867960e6-b8fb-46c9-b19c-82fcd945f7c7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:54.937522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867960e6-b8fb-46c9-b19c-82fcd945f7c7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:54.938026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867960e6-b8fb-46c9-b19c-82fcd945f7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:54.960789 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3717/7435] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:54.992771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-867960e6-b8fb-46c9-b19c-82fcd945f7c7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:54.994171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-867960e6-b8fb-46c9-b19c-82fcd945f7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:55.072075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:55.218603 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3719/7436] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:51:55.229506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53407809-b7ca-468f-b67c-94feb39062bb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:55.230028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53407809-b7ca-468f-b67c-94feb39062bb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:55.230451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53407809-b7ca-468f-b67c-94feb39062bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:55.278016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-53407809-b7ca-468f-b67c-94feb39062bb None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:55.279212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-53407809-b7ca-468f-b67c-94feb39062bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:55.307571 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3718/7437] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:55.311096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867960e6-b8fb-46c9-b19c-82fcd945f7c7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:55.333932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867960e6-b8fb-46c9-b19c-82fcd945f7c7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:55.356174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afcc14-72ce-44ac-ad8b-891e0bb2ef4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:55.357380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afcc14-72ce-44ac-ad8b-891e0bb2ef4a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:55.358307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afcc14-72ce-44ac-ad8b-891e0bb2ef4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:55.358603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afcc14-72ce-44ac-ad8b-891e0bb2ef4a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:55.359307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afcc14-72ce-44ac-ad8b-891e0bb2ef4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:55.359707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afcc14-72ce-44ac-ad8b-891e0bb2ef4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:55.361246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afcc14-72ce-44ac-ad8b-891e0bb2ef4a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:55.406729 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3720/7438] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:55.408078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53407809-b7ca-468f-b67c-94feb39062bb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:55.429607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53407809-b7ca-468f-b67c-94feb39062bb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:55.442494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1af1c-5e9f-44fc-aabf-106f9088c892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:55.443141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1af1c-5e9f-44fc-aabf-106f9088c892 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:55.443446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1af1c-5e9f-44fc-aabf-106f9088c892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:55.443716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1af1c-5e9f-44fc-aabf-106f9088c892 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:55.444360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1af1c-5e9f-44fc-aabf-106f9088c892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:55.451632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1af1c-5e9f-44fc-aabf-106f9088c892 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:55.589432 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3719/7439] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:55 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:55.590636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afcc14-72ce-44ac-ad8b-891e0bb2ef4a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:55.609536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afcc14-72ce-44ac-ad8b-891e0bb2ef4a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:55.726978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82f37d-4117-486e-a7ea-b111d437b2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:55.728316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82f37d-4117-486e-a7ea-b111d437b2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:55.728602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82f37d-4117-486e-a7ea-b111d437b2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:55.728879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82f37d-4117-486e-a7ea-b111d437b2b4 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:55.729532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82f37d-4117-486e-a7ea-b111d437b2b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:55.731648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82f37d-4117-486e-a7ea-b111d437b2b4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:55.761652 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3721/7440] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:55 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:55.766569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1af1c-5e9f-44fc-aabf-106f9088c892 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:55.781357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1af1c-5e9f-44fc-aabf-106f9088c892 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:55.787605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057408c1-c6a3-4d54-bbc6-b299f1743d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:55.788579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057408c1-c6a3-4d54-bbc6-b299f1743d29 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:55.789943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057408c1-c6a3-4d54-bbc6-b299f1743d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:55.790409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057408c1-c6a3-4d54-bbc6-b299f1743d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:55.791340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057408c1-c6a3-4d54-bbc6-b299f1743d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:55.793201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057408c1-c6a3-4d54-bbc6-b299f1743d29 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:55.795052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:55.813614 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3720/7441] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:55.817735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82f37d-4117-486e-a7ea-b111d437b2b4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:55.833176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82f37d-4117-486e-a7ea-b111d437b2b4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:55.858573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a3b39-8007-4d6e-b317-86f517a4ae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:55.859994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a3b39-8007-4d6e-b317-86f517a4ae92 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:55.860279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a3b39-8007-4d6e-b317-86f517a4ae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:55.860558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a3b39-8007-4d6e-b317-86f517a4ae92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:55.862093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a3b39-8007-4d6e-b317-86f517a4ae92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:55.869319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a3b39-8007-4d6e-b317-86f517a4ae92 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:55.911562 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3722/7442] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:55.915619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057408c1-c6a3-4d54-bbc6-b299f1743d29 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:55.940425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057408c1-c6a3-4d54-bbc6-b299f1743d29 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:55.959826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a920d56-60d7-492c-82ad-e884af1927ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:55.961236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a920d56-60d7-492c-82ad-e884af1927ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:55.961516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a920d56-60d7-492c-82ad-e884af1927ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:55.961795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a920d56-60d7-492c-82ad-e884af1927ec admin admin] PATH_INFO: `/v3/projects/39d9422d150f4f3296649b54589271d1/users/f8e5239e799345c0aa4b1d17c7e77e7e/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:56.053545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a920d56-60d7-492c-82ad-e884af1927ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d9422d150f4f3296649b54589271d1, user_id=f8e5239e799345c0aa4b1d17c7e77e7e, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:56.056609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a920d56-60d7-492c-82ad-e884af1927ec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:56.081012 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3721/7443] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:55 2022] PUT /identity/v3/projects/39d9422d150f4f3296649b54589271d1/users/f8e5239e799345c0aa4b1d17c7e77e7e/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:51:56.254573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79664f2c-dd12-4624-9b21-28f008b4e1dc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:56.255105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79664f2c-dd12-4624-9b21-28f008b4e1dc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:56.255105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79664f2c-dd12-4624-9b21-28f008b4e1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:56.339700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-79664f2c-dd12-4624-9b21-28f008b4e1dc None None] MFA Rules not processed for user `f8e5239e799345c0aa4b1d17c7e77e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:56.341001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79664f2c-dd12-4624-9b21-28f008b4e1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:56.611355 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3723/7444] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:51:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:56.619302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a920d56-60d7-492c-82ad-e884af1927ec admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:56.626034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1a920d56-60d7-492c-82ad-e884af1927ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:56.769366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a920d56-60d7-492c-82ad-e884af1927ec admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:56.778125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d326c-e9da-486f-a320-0932a4ed6b30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:56.778810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d326c-e9da-486f-a320-0932a4ed6b30 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:56.781938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d326c-e9da-486f-a320-0932a4ed6b30 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:56.782085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d326c-e9da-486f-a320-0932a4ed6b30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:56.803616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d326c-e9da-486f-a320-0932a4ed6b30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:56.806384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d326c-e9da-486f-a320-0932a4ed6b30 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:56.832710 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3722/7445] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:03.616575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79664f2c-dd12-4624-9b21-28f008b4e1dc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:03.618171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79664f2c-dd12-4624-9b21-28f008b4e1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:03.669235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:03.753711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79664f2c-dd12-4624-9b21-28f008b4e1dc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:03.816568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f4fee-d43a-4838-8dcd-44c5fad000d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:03.818157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f4fee-d43a-4838-8dcd-44c5fad000d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:03.818605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f4fee-d43a-4838-8dcd-44c5fad000d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:03.819199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f4fee-d43a-4838-8dcd-44c5fad000d3 admin admin] PATH_INFO: `/v3/users/1c94407c9bdf4bf4839a68612c3b85e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:03.823863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f4fee-d43a-4838-8dcd-44c5fad000d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c94407c9bdf4bf4839a68612c3b85e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:03.826018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f4fee-d43a-4838-8dcd-44c5fad000d3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:03.980924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c3f4fee-d43a-4838-8dcd-44c5fad000d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c94407c9bdf4bf4839a68612c3b85e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:03.983001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c3f4fee-d43a-4838-8dcd-44c5fad000d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c94407c9bdf4bf4839a68612c3b85e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:03.999461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c3f4fee-d43a-4838-8dcd-44c5fad000d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c94407c9bdf4bf4839a68612c3b85e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:04.023695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c3f4fee-d43a-4838-8dcd-44c5fad000d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c94407c9bdf4bf4839a68612c3b85e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:04.056364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c3f4fee-d43a-4838-8dcd-44c5fad000d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c94407c9bdf4bf4839a68612c3b85e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:04.074704 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3724/7446] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:03 2022] DELETE /identity/v3/users/1c94407c9bdf4bf4839a68612c3b85e1 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:04.083559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694b5f0-2d07-4d64-b87d-0ea1585f0823 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:04.084015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694b5f0-2d07-4d64-b87d-0ea1585f0823 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:04.084015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694b5f0-2d07-4d64-b87d-0ea1585f0823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:04.129860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6694b5f0-2d07-4d64-b87d-0ea1585f0823 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:04.131177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6694b5f0-2d07-4d64-b87d-0ea1585f0823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:04.278734 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3723/7447] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:04.354801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f4fee-d43a-4838-8dcd-44c5fad000d3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:04.356464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c3f4fee-d43a-4838-8dcd-44c5fad000d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:04.442214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f4fee-d43a-4838-8dcd-44c5fad000d3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:04.454598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067df04c-9520-437b-962e-a7b3d7ac4e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:04.461318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067df04c-9520-437b-962e-a7b3d7ac4e29 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:04.461652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067df04c-9520-437b-962e-a7b3d7ac4e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:04.461933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067df04c-9520-437b-962e-a7b3d7ac4e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:04.489628 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067df04c-9520-437b-962e-a7b3d7ac4e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:04.499840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067df04c-9520-437b-962e-a7b3d7ac4e29 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:04.514274 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3725/7448] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:06.126301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694b5f0-2d07-4d64-b87d-0ea1585f0823 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:06.126301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6694b5f0-2d07-4d64-b87d-0ea1585f0823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:06.267527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694b5f0-2d07-4d64-b87d-0ea1585f0823 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:06.267527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00902c0-cce6-4115-90d4-df18b1e72144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:06.267527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00902c0-cce6-4115-90d4-df18b1e72144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:06.267527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00902c0-cce6-4115-90d4-df18b1e72144 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:06.269214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00902c0-cce6-4115-90d4-df18b1e72144 admin admin] PATH_INFO: `/v3/projects/9a8193c28c054de3aa2f32cea82808f8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:06.269214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00902c0-cce6-4115-90d4-df18b1e72144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a8193c28c054de3aa2f32cea82808f8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:06.269214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00902c0-cce6-4115-90d4-df18b1e72144 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:06.340226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d00902c0-cce6-4115-90d4-df18b1e72144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8193c28c054de3aa2f32cea82808f8', 'request_id': 'req-d00902c0-cce6-4115-90d4-df18b1e72144'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:06.354485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d00902c0-cce6-4115-90d4-df18b1e72144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8193c28c054de3aa2f32cea82808f8', 'request_id': 'req-d00902c0-cce6-4115-90d4-df18b1e72144'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:06.370812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d00902c0-cce6-4115-90d4-df18b1e72144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8193c28c054de3aa2f32cea82808f8', 'request_id': 'req-d00902c0-cce6-4115-90d4-df18b1e72144'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:06.394361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:06.403691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d00902c0-cce6-4115-90d4-df18b1e72144 admin admin] The token cache is being invalidate because project 9a8193c28c054de3aa2f32cea82808f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:06.404272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d00902c0-cce6-4115-90d4-df18b1e72144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:06.405191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d00902c0-cce6-4115-90d4-df18b1e72144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:06.407036 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3724/7449] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:06 2022] DELETE /identity/v3/projects/9a8193c28c054de3aa2f32cea82808f8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:06.411597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067df04c-9520-437b-962e-a7b3d7ac4e29 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:06.440991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067df04c-9520-437b-962e-a7b3d7ac4e29 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:06.641542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:06.694164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7376d-80e0-4ff1-bccd-55a6e1993ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:06.694811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7376d-80e0-4ff1-bccd-55a6e1993ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:06.695091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7376d-80e0-4ff1-bccd-55a6e1993ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:06.695403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7376d-80e0-4ff1-bccd-55a6e1993ce2 admin admin] PATH_INFO: `/v3/users/74f5f415b69e41e089fcc0d213543200` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:06.697553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7376d-80e0-4ff1-bccd-55a6e1993ce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f5f415b69e41e089fcc0d213543200)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:06.699739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7376d-80e0-4ff1-bccd-55a6e1993ce2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:06.982611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-40c7376d-80e0-4ff1-bccd-55a6e1993ce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f5f415b69e41e089fcc0d213543200'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:06.984393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-40c7376d-80e0-4ff1-bccd-55a6e1993ce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f5f415b69e41e089fcc0d213543200'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:07.019139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-40c7376d-80e0-4ff1-bccd-55a6e1993ce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f5f415b69e41e089fcc0d213543200'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:07.037462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-40c7376d-80e0-4ff1-bccd-55a6e1993ce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f5f415b69e41e089fcc0d213543200'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:07.069991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-40c7376d-80e0-4ff1-bccd-55a6e1993ce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f5f415b69e41e089fcc0d213543200'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:07.083329 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3726/7450] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:06 2022] DELETE /identity/v3/users/74f5f415b69e41e089fcc0d213543200 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:07.679949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00902c0-cce6-4115-90d4-df18b1e72144 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:07.686537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d00902c0-cce6-4115-90d4-df18b1e72144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:07.714856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00902c0-cce6-4115-90d4-df18b1e72144 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:07.874450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39bcd2-3509-4d10-accd-18a09e5f05fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:07.875203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39bcd2-3509-4d10-accd-18a09e5f05fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:07.875572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39bcd2-3509-4d10-accd-18a09e5f05fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:07.876551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39bcd2-3509-4d10-accd-18a09e5f05fa admin admin] PATH_INFO: `/v3/projects/401e548f58bc44a2b3f84d2f9b682067` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:07.878542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39bcd2-3509-4d10-accd-18a09e5f05fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=401e548f58bc44a2b3f84d2f9b682067)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:07.882819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39bcd2-3509-4d10-accd-18a09e5f05fa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:08.017210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f39bcd2-3509-4d10-accd-18a09e5f05fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '401e548f58bc44a2b3f84d2f9b682067', 'request_id': 'req-2f39bcd2-3509-4d10-accd-18a09e5f05fa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:08.036333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f39bcd2-3509-4d10-accd-18a09e5f05fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '401e548f58bc44a2b3f84d2f9b682067', 'request_id': 'req-2f39bcd2-3509-4d10-accd-18a09e5f05fa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:08.059908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f39bcd2-3509-4d10-accd-18a09e5f05fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '401e548f58bc44a2b3f84d2f9b682067', 'request_id': 'req-2f39bcd2-3509-4d10-accd-18a09e5f05fa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:08.101675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f39bcd2-3509-4d10-accd-18a09e5f05fa admin admin] The token cache is being invalidate because project 401e548f58bc44a2b3f84d2f9b682067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:08.101675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f39bcd2-3509-4d10-accd-18a09e5f05fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:08.104592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f39bcd2-3509-4d10-accd-18a09e5f05fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:08.107437 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3725/7451] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:07 2022] DELETE /identity/v3/projects/401e548f58bc44a2b3f84d2f9b682067 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:08.113020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe30686-202c-4272-93b7-28711224dae8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.113578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe30686-202c-4272-93b7-28711224dae8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.113578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe30686-202c-4272-93b7-28711224dae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.152797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7fe30686-202c-4272-93b7-28711224dae8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:08.153911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7fe30686-202c-4272-93b7-28711224dae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:08.253037 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3727/7452] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:08.266373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cbf47-812f-4c68-ba3a-1a78d20ec309 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.266656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cbf47-812f-4c68-ba3a-1a78d20ec309 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.271555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cbf47-812f-4c68-ba3a-1a78d20ec309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.330350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-035cbf47-812f-4c68-ba3a-1a78d20ec309 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:08.338153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-035cbf47-812f-4c68-ba3a-1a78d20ec309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:08.369701 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3726/7453] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:08.374323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe30686-202c-4272-93b7-28711224dae8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:08.389736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe30686-202c-4272-93b7-28711224dae8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:08.397427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461841a-6551-4e9d-8fc7-77a0d5f58ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:08.400775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461841a-6551-4e9d-8fc7-77a0d5f58ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.401362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461841a-6551-4e9d-8fc7-77a0d5f58ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.401839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461841a-6551-4e9d-8fc7-77a0d5f58ce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.403292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461841a-6551-4e9d-8fc7-77a0d5f58ce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:08.403871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461841a-6551-4e9d-8fc7-77a0d5f58ce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:08.406408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461841a-6551-4e9d-8fc7-77a0d5f58ce0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:08.425169 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3728/7454] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:08.429564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cbf47-812f-4c68-ba3a-1a78d20ec309 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:08.442440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cbf47-812f-4c68-ba3a-1a78d20ec309 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:08.451528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e266b4-26b4-4729-abd2-1fbad5e3742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:08.453015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e266b4-26b4-4729-abd2-1fbad5e3742d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.455023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e266b4-26b4-4729-abd2-1fbad5e3742d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.455457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e266b4-26b4-4729-abd2-1fbad5e3742d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.456238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e266b4-26b4-4729-abd2-1fbad5e3742d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:08.458482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e266b4-26b4-4729-abd2-1fbad5e3742d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:08.512054 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3727/7455] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:08 2022] POST /identity/v3/projects => generated 391 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:52:08.516832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461841a-6551-4e9d-8fc7-77a0d5f58ce0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:08.534211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461841a-6551-4e9d-8fc7-77a0d5f58ce0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:08.632154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:08.650609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ec700-1739-4e6c-912f-2181e8b6b81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:08.651204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ec700-1739-4e6c-912f-2181e8b6b81f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.651528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ec700-1739-4e6c-912f-2181e8b6b81f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.651808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ec700-1739-4e6c-912f-2181e8b6b81f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.652550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ec700-1739-4e6c-912f-2181e8b6b81f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:08.654656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ec700-1739-4e6c-912f-2181e8b6b81f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:08.715816 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3729/7456] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:08 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:08.721256 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e266b4-26b4-4729-abd2-1fbad5e3742d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:08.735234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e266b4-26b4-4729-abd2-1fbad5e3742d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:08.748006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb2e69-4ff3-4fb4-bd08-30b087872b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:08.748708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb2e69-4ff3-4fb4-bd08-30b087872b56 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.749014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb2e69-4ff3-4fb4-bd08-30b087872b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.749258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb2e69-4ff3-4fb4-bd08-30b087872b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.750092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb2e69-4ff3-4fb4-bd08-30b087872b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:08.752033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb2e69-4ff3-4fb4-bd08-30b087872b56 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:08.774653 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3728/7457] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:52:08.779573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ec700-1739-4e6c-912f-2181e8b6b81f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:08.794539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ec700-1739-4e6c-912f-2181e8b6b81f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:08.809267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c5afa-01db-4dc1-8edb-4080bcc1c5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:08.809905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c5afa-01db-4dc1-8edb-4080bcc1c5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.810181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c5afa-01db-4dc1-8edb-4080bcc1c5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.810451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c5afa-01db-4dc1-8edb-4080bcc1c5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.811113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c5afa-01db-4dc1-8edb-4080bcc1c5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:08.812861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c5afa-01db-4dc1-8edb-4080bcc1c5c4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:08.850106 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3730/7458] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:08.854540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb2e69-4ff3-4fb4-bd08-30b087872b56 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:08.866494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb2e69-4ff3-4fb4-bd08-30b087872b56 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:08.872817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eeacd3-fef2-4f28-a5a2-4d9ff99729ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:08.874029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeacd3-fef2-4f28-a5a2-4d9ff99729ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.874702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeacd3-fef2-4f28-a5a2-4d9ff99729ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.875675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeacd3-fef2-4f28-a5a2-4d9ff99729ee admin admin] PATH_INFO: `/v3/projects/b761146d2d4b46e080d7a5d61d8d71d3/users/2587b647eb4c40c99ba136e88e5c4f34/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.951990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eeacd3-fef2-4f28-a5a2-4d9ff99729ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b761146d2d4b46e080d7a5d61d8d71d3, user_id=2587b647eb4c40c99ba136e88e5c4f34, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:08.954936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eeacd3-fef2-4f28-a5a2-4d9ff99729ee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:08.991712 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3729/7459] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:08 2022] PUT /identity/v3/projects/b761146d2d4b46e080d7a5d61d8d71d3/users/2587b647eb4c40c99ba136e88e5c4f34/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:09.002220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5c4fb-e0e2-4a5c-9763-4ec2031f89ef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:09.002800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5c4fb-e0e2-4a5c-9763-4ec2031f89ef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:09.003612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5c4fb-e0e2-4a5c-9763-4ec2031f89ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:09.110441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9fa5c4fb-e0e2-4a5c-9763-4ec2031f89ef None None] MFA Rules not processed for user `2587b647eb4c40c99ba136e88e5c4f34`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:09.112172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9fa5c4fb-e0e2-4a5c-9763-4ec2031f89ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:09.303525 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3731/7460] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:09.352026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eeacd3-fef2-4f28-a5a2-4d9ff99729ee admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:09.353929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b0eeacd3-fef2-4f28-a5a2-4d9ff99729ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:09.458172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:09.559569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eeacd3-fef2-4f28-a5a2-4d9ff99729ee admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:09.570337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8abf1-f985-4b97-9b55-2eefffca6db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:09.572432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8abf1-f985-4b97-9b55-2eefffca6db6 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:09.572824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8abf1-f985-4b97-9b55-2eefffca6db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:09.573194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8abf1-f985-4b97-9b55-2eefffca6db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:09.610401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8abf1-f985-4b97-9b55-2eefffca6db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:09.612275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8abf1-f985-4b97-9b55-2eefffca6db6 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:09.645311 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3730/7461] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:09.698199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5c4fb-e0e2-4a5c-9763-4ec2031f89ef None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:09.834373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5c4fb-e0e2-4a5c-9763-4ec2031f89ef None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:09.841707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe92e95-7cc1-4d10-8acf-90ecb7b91230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:09.842694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe92e95-7cc1-4d10-8acf-90ecb7b91230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:09.843346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe92e95-7cc1-4d10-8acf-90ecb7b91230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:09.843810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe92e95-7cc1-4d10-8acf-90ecb7b91230 admin admin] PATH_INFO: `/v3/users/2587b647eb4c40c99ba136e88e5c4f34` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:09.846005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe92e95-7cc1-4d10-8acf-90ecb7b91230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2587b647eb4c40c99ba136e88e5c4f34)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:09.848245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe92e95-7cc1-4d10-8acf-90ecb7b91230 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:09.943507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fe92e95-7cc1-4d10-8acf-90ecb7b91230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2587b647eb4c40c99ba136e88e5c4f34'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:09.944352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fe92e95-7cc1-4d10-8acf-90ecb7b91230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2587b647eb4c40c99ba136e88e5c4f34'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:09.954764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fe92e95-7cc1-4d10-8acf-90ecb7b91230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2587b647eb4c40c99ba136e88e5c4f34'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:09.960432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:09.969459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fe92e95-7cc1-4d10-8acf-90ecb7b91230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2587b647eb4c40c99ba136e88e5c4f34'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:10.010345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fe92e95-7cc1-4d10-8acf-90ecb7b91230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2587b647eb4c40c99ba136e88e5c4f34'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:10.021995 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3732/7462] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:09 2022] DELETE /identity/v3/users/2587b647eb4c40c99ba136e88e5c4f34 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:10.026635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66072f81-8601-4c81-ba97-276fcc42c73d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:10.027181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66072f81-8601-4c81-ba97-276fcc42c73d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:10.027469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66072f81-8601-4c81-ba97-276fcc42c73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:10.088912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-66072f81-8601-4c81-ba97-276fcc42c73d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:10.090481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-66072f81-8601-4c81-ba97-276fcc42c73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:10.256615 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3731/7463] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:10.288207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe92e95-7cc1-4d10-8acf-90ecb7b91230 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:10.289444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6fe92e95-7cc1-4d10-8acf-90ecb7b91230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:10.395217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe92e95-7cc1-4d10-8acf-90ecb7b91230 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:10.408117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532402a-dca1-4e7b-a6bb-eb500b4e586e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:10.408744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532402a-dca1-4e7b-a6bb-eb500b4e586e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:10.409190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532402a-dca1-4e7b-a6bb-eb500b4e586e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:10.409486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532402a-dca1-4e7b-a6bb-eb500b4e586e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:10.432237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532402a-dca1-4e7b-a6bb-eb500b4e586e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:10.433714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532402a-dca1-4e7b-a6bb-eb500b4e586e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:10.451905 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3733/7464] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:11.856228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66072f81-8601-4c81-ba97-276fcc42c73d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:11.870020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-66072f81-8601-4c81-ba97-276fcc42c73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:11.938497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66072f81-8601-4c81-ba97-276fcc42c73d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:11.972279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59b8a4-ed5b-4e61-8fcf-e1da8646ec6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:11.973454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59b8a4-ed5b-4e61-8fcf-e1da8646ec6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:11.973892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59b8a4-ed5b-4e61-8fcf-e1da8646ec6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:11.974339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59b8a4-ed5b-4e61-8fcf-e1da8646ec6f admin admin] PATH_INFO: `/v3/projects/b761146d2d4b46e080d7a5d61d8d71d3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:11.975825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59b8a4-ed5b-4e61-8fcf-e1da8646ec6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b761146d2d4b46e080d7a5d61d8d71d3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:11.977936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59b8a4-ed5b-4e61-8fcf-e1da8646ec6f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:12.096107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a59b8a4-ed5b-4e61-8fcf-e1da8646ec6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b761146d2d4b46e080d7a5d61d8d71d3', 'request_id': 'req-5a59b8a4-ed5b-4e61-8fcf-e1da8646ec6f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:12.113863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a59b8a4-ed5b-4e61-8fcf-e1da8646ec6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b761146d2d4b46e080d7a5d61d8d71d3', 'request_id': 'req-5a59b8a4-ed5b-4e61-8fcf-e1da8646ec6f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:12.128579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a59b8a4-ed5b-4e61-8fcf-e1da8646ec6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b761146d2d4b46e080d7a5d61d8d71d3', 'request_id': 'req-5a59b8a4-ed5b-4e61-8fcf-e1da8646ec6f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:12.176811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a59b8a4-ed5b-4e61-8fcf-e1da8646ec6f admin admin] The token cache is being invalidate because project b761146d2d4b46e080d7a5d61d8d71d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:12.178364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a59b8a4-ed5b-4e61-8fcf-e1da8646ec6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:12.181311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a59b8a4-ed5b-4e61-8fcf-e1da8646ec6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:12.187417 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3732/7465] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:11 2022] DELETE /identity/v3/projects/b761146d2d4b46e080d7a5d61d8d71d3 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:12.192679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ab9ae-909b-49e5-af63-23c21704fc3a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:12.193186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ab9ae-909b-49e5-af63-23c21704fc3a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:12.193289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ab9ae-909b-49e5-af63-23c21704fc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:12.251217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-961ab9ae-909b-49e5-af63-23c21704fc3a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:12.253420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-961ab9ae-909b-49e5-af63-23c21704fc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:12.409593 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3734/7466] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:12.432105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565a384-a320-4f08-8e76-6436b46677f0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:12.432580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565a384-a320-4f08-8e76-6436b46677f0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:12.433033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565a384-a320-4f08-8e76-6436b46677f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:12.556952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8565a384-a320-4f08-8e76-6436b46677f0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:12.561682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8565a384-a320-4f08-8e76-6436b46677f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:12.578879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ab9ae-909b-49e5-af63-23c21704fc3a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:12.581669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-961ab9ae-909b-49e5-af63-23c21704fc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:12.595171 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3733/7467] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:12.604344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565a384-a320-4f08-8e76-6436b46677f0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:12.604523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ab9ae-909b-49e5-af63-23c21704fc3a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:12.611745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12145017-5af9-4f0e-980c-c6e6140f4080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:12.612618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12145017-5af9-4f0e-980c-c6e6140f4080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:12.613037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12145017-5af9-4f0e-980c-c6e6140f4080 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:12.613408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12145017-5af9-4f0e-980c-c6e6140f4080 admin admin] PATH_INFO: `/v3/users/f8e5239e799345c0aa4b1d17c7e77e7e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:12.615347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12145017-5af9-4f0e-980c-c6e6140f4080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8e5239e799345c0aa4b1d17c7e77e7e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:12.627944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12145017-5af9-4f0e-980c-c6e6140f4080 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:12.638730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565a384-a320-4f08-8e76-6436b46677f0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:12.676696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42323cbc-8b13-4b8a-9d6b-e825513f47c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:12.677518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42323cbc-8b13-4b8a-9d6b-e825513f47c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:12.677997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42323cbc-8b13-4b8a-9d6b-e825513f47c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:12.678222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42323cbc-8b13-4b8a-9d6b-e825513f47c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:12.678884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42323cbc-8b13-4b8a-9d6b-e825513f47c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:12.679191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42323cbc-8b13-4b8a-9d6b-e825513f47c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:12.680832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42323cbc-8b13-4b8a-9d6b-e825513f47c4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:12.707834 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3734/7468] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:12.712383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42323cbc-8b13-4b8a-9d6b-e825513f47c4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:12.730781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42323cbc-8b13-4b8a-9d6b-e825513f47c4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:12.748519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6d93b-544b-4217-8e31-0fc28953fc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:12.749116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6d93b-544b-4217-8e31-0fc28953fc14 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:12.749419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6d93b-544b-4217-8e31-0fc28953fc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:12.749707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6d93b-544b-4217-8e31-0fc28953fc14 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:12.750288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6d93b-544b-4217-8e31-0fc28953fc14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:12.752363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6d93b-544b-4217-8e31-0fc28953fc14 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:12.802141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12145017-5af9-4f0e-980c-c6e6140f4080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8e5239e799345c0aa4b1d17c7e77e7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:12.804058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12145017-5af9-4f0e-980c-c6e6140f4080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8e5239e799345c0aa4b1d17c7e77e7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:12.809311 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3735/7469] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:12 2022] POST /identity/v3/projects => generated 397 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:52:12.815002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6d93b-544b-4217-8e31-0fc28953fc14 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:12.823958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fdb6d93b-544b-4217-8e31-0fc28953fc14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:12.824666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12145017-5af9-4f0e-980c-c6e6140f4080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8e5239e799345c0aa4b1d17c7e77e7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:12.842754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:12.845075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12145017-5af9-4f0e-980c-c6e6140f4080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8e5239e799345c0aa4b1d17c7e77e7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:12.889012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:12.894777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12145017-5af9-4f0e-980c-c6e6140f4080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8e5239e799345c0aa4b1d17c7e77e7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:12.909155 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3735/7470] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:12 2022] DELETE /identity/v3/users/f8e5239e799345c0aa4b1d17c7e77e7e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:12.913387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70ac68-4994-4cfe-a62f-b9b837fd3fcf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:12.914095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70ac68-4994-4cfe-a62f-b9b837fd3fcf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:12.917058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70ac68-4994-4cfe-a62f-b9b837fd3fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:12.969699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9a70ac68-4994-4cfe-a62f-b9b837fd3fcf None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:12.973380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9a70ac68-4994-4cfe-a62f-b9b837fd3fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:12.973701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6d93b-544b-4217-8e31-0fc28953fc14 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:13.070483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022710b-cda1-416e-951f-faf62e8fe70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:13.078310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022710b-cda1-416e-951f-faf62e8fe70d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:13.078596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022710b-cda1-416e-951f-faf62e8fe70d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:13.078873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022710b-cda1-416e-951f-faf62e8fe70d admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:13.079571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022710b-cda1-416e-951f-faf62e8fe70d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:13.082199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022710b-cda1-416e-951f-faf62e8fe70d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:13.115398 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3736/7471] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:12 2022] POST /identity/v3/users => generated 299 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:52:13.119432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022710b-cda1-416e-951f-faf62e8fe70d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:13.132046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022710b-cda1-416e-951f-faf62e8fe70d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:13.154560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48183e5-fcaf-4185-94a4-36d90e51a6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:13.155204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48183e5-fcaf-4185-94a4-36d90e51a6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:13.155504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48183e5-fcaf-4185-94a4-36d90e51a6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:13.155774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48183e5-fcaf-4185-94a4-36d90e51a6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:13.156424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48183e5-fcaf-4185-94a4-36d90e51a6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:13.161485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48183e5-fcaf-4185-94a4-36d90e51a6a3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:13.174553 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3737/7472] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:13.179011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48183e5-fcaf-4185-94a4-36d90e51a6a3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:13.197425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48183e5-fcaf-4185-94a4-36d90e51a6a3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:13.208461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f016d10-ebf2-41aa-aaa2-12ab83c337a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:13.209424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f016d10-ebf2-41aa-aaa2-12ab83c337a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:13.209946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f016d10-ebf2-41aa-aaa2-12ab83c337a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:13.215591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f016d10-ebf2-41aa-aaa2-12ab83c337a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:13.217069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f016d10-ebf2-41aa-aaa2-12ab83c337a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:13.219185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f016d10-ebf2-41aa-aaa2-12ab83c337a8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:13.241868 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3738/7473] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:13.262132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f016d10-ebf2-41aa-aaa2-12ab83c337a8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:13.272340 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3736/7474] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:13.293390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f016d10-ebf2-41aa-aaa2-12ab83c337a8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:13.300758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70ac68-4994-4cfe-a62f-b9b837fd3fcf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:13.302858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9a70ac68-4994-4cfe-a62f-b9b837fd3fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:13.321291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73498c-b764-4fb1-9483-c47d6623d5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:13.323402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73498c-b764-4fb1-9483-c47d6623d5f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:13.323867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73498c-b764-4fb1-9483-c47d6623d5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:13.324618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73498c-b764-4fb1-9483-c47d6623d5f8 admin admin] PATH_INFO: `/v3/projects/2533ebb901ad4aee86ae6ba6ae6deef5/users/79c9128970504d7fb1e5cb09dd2df0a1/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:13.380372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73498c-b764-4fb1-9483-c47d6623d5f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2533ebb901ad4aee86ae6ba6ae6deef5, user_id=79c9128970504d7fb1e5cb09dd2df0a1, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:13.384563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73498c-b764-4fb1-9483-c47d6623d5f8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:13.442499 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3739/7475] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:13 2022] PUT /identity/v3/projects/2533ebb901ad4aee86ae6ba6ae6deef5/users/79c9128970504d7fb1e5cb09dd2df0a1/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:13.453347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a52c29-59bb-4723-b1dd-dfa8bc438858 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:13.453790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a52c29-59bb-4723-b1dd-dfa8bc438858 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:13.454091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a52c29-59bb-4723-b1dd-dfa8bc438858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:13.476716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70ac68-4994-4cfe-a62f-b9b837fd3fcf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:13.549693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-19a52c29-59bb-4723-b1dd-dfa8bc438858 None None] MFA Rules not processed for user `79c9128970504d7fb1e5cb09dd2df0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:13.553578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-19a52c29-59bb-4723-b1dd-dfa8bc438858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:13.724067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179ee38-d663-4805-a7e0-879101084f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:13.724712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179ee38-d663-4805-a7e0-879101084f4d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:13.725067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179ee38-d663-4805-a7e0-879101084f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:13.725259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179ee38-d663-4805-a7e0-879101084f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:13.860105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:13.892609 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3740/7476] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:13.905759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a52c29-59bb-4723-b1dd-dfa8bc438858 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:13.908151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-19a52c29-59bb-4723-b1dd-dfa8bc438858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:13.930691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a52c29-59bb-4723-b1dd-dfa8bc438858 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:13.943021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880a626-3e73-47d3-8b4b-d9f66d12c658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:13.945194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880a626-3e73-47d3-8b4b-d9f66d12c658 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:13.945705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880a626-3e73-47d3-8b4b-d9f66d12c658 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:13.946190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880a626-3e73-47d3-8b4b-d9f66d12c658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:13.948998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179ee38-d663-4805-a7e0-879101084f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:13.950661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179ee38-d663-4805-a7e0-879101084f4d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:13.958052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880a626-3e73-47d3-8b4b-d9f66d12c658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:13.960506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880a626-3e73-47d3-8b4b-d9f66d12c658 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:13.963227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:13.989798 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3737/7477] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:14.004776 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3741/7478] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:13 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:52:15.126330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179ee38-d663-4805-a7e0-879101084f4d service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:15.128429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1179ee38-d663-4805-a7e0-879101084f4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:15.176731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179ee38-d663-4805-a7e0-879101084f4d service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:15.188489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c1438-5db3-4812-bda8-8018e0591faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:15.190367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c1438-5db3-4812-bda8-8018e0591faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:15.193234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c1438-5db3-4812-bda8-8018e0591faa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:15.194295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c1438-5db3-4812-bda8-8018e0591faa admin admin] PATH_INFO: `/v3/users/e8252a305455469ba107ba34952a20c0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:15.196637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c1438-5db3-4812-bda8-8018e0591faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8252a305455469ba107ba34952a20c0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:15.199645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c1438-5db3-4812-bda8-8018e0591faa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:15.314210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e24c1438-5db3-4812-bda8-8018e0591faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8252a305455469ba107ba34952a20c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:15.315638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e24c1438-5db3-4812-bda8-8018e0591faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8252a305455469ba107ba34952a20c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:15.327845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e24c1438-5db3-4812-bda8-8018e0591faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8252a305455469ba107ba34952a20c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:15.375204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e24c1438-5db3-4812-bda8-8018e0591faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8252a305455469ba107ba34952a20c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:15.424375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e24c1438-5db3-4812-bda8-8018e0591faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8252a305455469ba107ba34952a20c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:15.436546 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3738/7479] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:15 2022] DELETE /identity/v3/users/e8252a305455469ba107ba34952a20c0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:15.925760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880a626-3e73-47d3-8b4b-d9f66d12c658 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:15.928508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7880a626-3e73-47d3-8b4b-d9f66d12c658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:15.961636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880a626-3e73-47d3-8b4b-d9f66d12c658 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:16.057060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c1438-5db3-4812-bda8-8018e0591faa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:16.058822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e24c1438-5db3-4812-bda8-8018e0591faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:16.110962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b6d52-70d8-487a-9449-885fd69efd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:16.112079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b6d52-70d8-487a-9449-885fd69efd73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:16.112601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b6d52-70d8-487a-9449-885fd69efd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:16.113858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b6d52-70d8-487a-9449-885fd69efd73 admin admin] PATH_INFO: `/v3/projects/39d9422d150f4f3296649b54589271d1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:16.122665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b6d52-70d8-487a-9449-885fd69efd73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d9422d150f4f3296649b54589271d1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:16.127920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b6d52-70d8-487a-9449-885fd69efd73 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:16.210807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-110b6d52-70d8-487a-9449-885fd69efd73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d9422d150f4f3296649b54589271d1', 'request_id': 'req-110b6d52-70d8-487a-9449-885fd69efd73'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:16.222992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-110b6d52-70d8-487a-9449-885fd69efd73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d9422d150f4f3296649b54589271d1', 'request_id': 'req-110b6d52-70d8-487a-9449-885fd69efd73'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:16.244759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-110b6d52-70d8-487a-9449-885fd69efd73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d9422d150f4f3296649b54589271d1', 'request_id': 'req-110b6d52-70d8-487a-9449-885fd69efd73'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:16.248936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c1438-5db3-4812-bda8-8018e0591faa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:16.279418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-110b6d52-70d8-487a-9449-885fd69efd73 admin admin] The token cache is being invalidate because project 39d9422d150f4f3296649b54589271d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:16.279721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-110b6d52-70d8-487a-9449-885fd69efd73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:16.287380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-110b6d52-70d8-487a-9449-885fd69efd73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:16.289070 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3742/7480] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:15 2022] DELETE /identity/v3/projects/39d9422d150f4f3296649b54589271d1 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:16.293905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f085f75-0db4-422c-af9c-045bc7e49d9d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:16.294294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f085f75-0db4-422c-af9c-045bc7e49d9d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:16.295000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f085f75-0db4-422c-af9c-045bc7e49d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:16.326895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2f085f75-0db4-422c-af9c-045bc7e49d9d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:16.332051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2f085f75-0db4-422c-af9c-045bc7e49d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:16.412246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:16.412710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:16.412971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:16.413267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9 admin admin] PATH_INFO: `/v3/projects/e3b80857b8124be8b30a4ee36e79636b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:16.415210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b80857b8124be8b30a4ee36e79636b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:16.417540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:16.498159 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3743/7481] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:16.499763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b26dee-5177-4243-a383-88e9ca572a37 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:16.500046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b26dee-5177-4243-a383-88e9ca572a37 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:16.500320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b26dee-5177-4243-a383-88e9ca572a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:16.500957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:16.528981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:16.538896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a0b26dee-5177-4243-a383-88e9ca572a37 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:16.541827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a0b26dee-5177-4243-a383-88e9ca572a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:16.575167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b80857b8124be8b30a4ee36e79636b', 'request_id': 'req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:16.599288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b80857b8124be8b30a4ee36e79636b', 'request_id': 'req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:16.627966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b80857b8124be8b30a4ee36e79636b', 'request_id': 'req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:16.668755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9 admin admin] The token cache is being invalidate because project e3b80857b8124be8b30a4ee36e79636b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:16.669050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:16.671272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:16.677377 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3739/7482] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:16 2022] DELETE /identity/v3/projects/e3b80857b8124be8b30a4ee36e79636b => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:16.682486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:16.688278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:16.723286 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3744/7483] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:16.729355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b26dee-5177-4243-a383-88e9ca572a37 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:16.771928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b26dee-5177-4243-a383-88e9ca572a37 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:16.798375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16005489-d1ad-4b58-a241-93620df891d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:16.799003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16005489-d1ad-4b58-a241-93620df891d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:16.799432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16005489-d1ad-4b58-a241-93620df891d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:16.799707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16005489-d1ad-4b58-a241-93620df891d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:16.800373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16005489-d1ad-4b58-a241-93620df891d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:16.800676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16005489-d1ad-4b58-a241-93620df891d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:16.802279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16005489-d1ad-4b58-a241-93620df891d0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:16.851594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8af4cf-d52c-408a-97b2-3a849ed55ca9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:16.857168 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3745/7484] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:16.862588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16005489-d1ad-4b58-a241-93620df891d0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:16.869659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604b87c-43e6-4c1c-94e3-56faa752a6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:16.870643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604b87c-43e6-4c1c-94e3-56faa752a6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:16.871163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604b87c-43e6-4c1c-94e3-56faa752a6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:16.871667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604b87c-43e6-4c1c-94e3-56faa752a6d4 admin admin] PATH_INFO: `/v3/users/5c3c1c3f4f9a4de085ef2e98c5303139` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:16.874287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604b87c-43e6-4c1c-94e3-56faa752a6d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3c1c3f4f9a4de085ef2e98c5303139)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:16.878248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604b87c-43e6-4c1c-94e3-56faa752a6d4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:16.880792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16005489-d1ad-4b58-a241-93620df891d0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:16.896118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81618c5-558e-4dcf-a4b6-85befe75fd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:16.897119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81618c5-558e-4dcf-a4b6-85befe75fd60 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:16.897665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81618c5-558e-4dcf-a4b6-85befe75fd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:16.898156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81618c5-558e-4dcf-a4b6-85befe75fd60 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:16.901798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81618c5-558e-4dcf-a4b6-85befe75fd60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:16.905764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81618c5-558e-4dcf-a4b6-85befe75fd60 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:16.975458 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3746/7485] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:16 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:16.976770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81618c5-558e-4dcf-a4b6-85befe75fd60 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:16.985503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0604b87c-43e6-4c1c-94e3-56faa752a6d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3c1c3f4f9a4de085ef2e98c5303139'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:16.986624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0604b87c-43e6-4c1c-94e3-56faa752a6d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3c1c3f4f9a4de085ef2e98c5303139'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:17.006683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0604b87c-43e6-4c1c-94e3-56faa752a6d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3c1c3f4f9a4de085ef2e98c5303139'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:17.025598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0604b87c-43e6-4c1c-94e3-56faa752a6d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3c1c3f4f9a4de085ef2e98c5303139'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:17.047247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0604b87c-43e6-4c1c-94e3-56faa752a6d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3c1c3f4f9a4de085ef2e98c5303139'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:17.063918 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3740/7486] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:16 2022] DELETE /identity/v3/users/5c3c1c3f4f9a4de085ef2e98c5303139 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:17.149059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81618c5-558e-4dcf-a4b6-85befe75fd60 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:17.362932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92befee0-3e34-4443-9606-79f1ae8fc26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:17.364654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92befee0-3e34-4443-9606-79f1ae8fc26b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:17.364941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92befee0-3e34-4443-9606-79f1ae8fc26b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:17.365216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92befee0-3e34-4443-9606-79f1ae8fc26b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:17.366049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92befee0-3e34-4443-9606-79f1ae8fc26b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:17.381226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92befee0-3e34-4443-9606-79f1ae8fc26b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:17.434412 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3747/7487] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:16 2022] POST /identity/v3/users => generated 282 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:17.438290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604b87c-43e6-4c1c-94e3-56faa752a6d4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:17.440983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0604b87c-43e6-4c1c-94e3-56faa752a6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:17.467957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604b87c-43e6-4c1c-94e3-56faa752a6d4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:17.478710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf5ba5-9d45-473f-9c4f-99b1d43a42f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:17.479816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf5ba5-9d45-473f-9c4f-99b1d43a42f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:17.481738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf5ba5-9d45-473f-9c4f-99b1d43a42f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:17.483027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf5ba5-9d45-473f-9c4f-99b1d43a42f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:17.484077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf5ba5-9d45-473f-9c4f-99b1d43a42f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:17.492280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf5ba5-9d45-473f-9c4f-99b1d43a42f7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:17.512220 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3741/7488] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:17.516510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92befee0-3e34-4443-9606-79f1ae8fc26b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:17.527986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92befee0-3e34-4443-9606-79f1ae8fc26b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:17.533013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99659c0e-8f88-46cc-b3dc-f8410390f66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:17.534094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99659c0e-8f88-46cc-b3dc-f8410390f66b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:17.534447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99659c0e-8f88-46cc-b3dc-f8410390f66b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:17.534793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99659c0e-8f88-46cc-b3dc-f8410390f66b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:17.536607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99659c0e-8f88-46cc-b3dc-f8410390f66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:17.538414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99659c0e-8f88-46cc-b3dc-f8410390f66b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:17.541101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:17.592870 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3748/7489] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:17.594155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf5ba5-9d45-473f-9c4f-99b1d43a42f7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:17.621413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf5ba5-9d45-473f-9c4f-99b1d43a42f7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:17.634384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993cbbf-040a-48b9-a7e5-d0fb57b4bae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:17.640013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993cbbf-040a-48b9-a7e5-d0fb57b4bae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:17.641002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993cbbf-040a-48b9-a7e5-d0fb57b4bae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:17.643051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993cbbf-040a-48b9-a7e5-d0fb57b4bae5 admin admin] PATH_INFO: `/v3/projects/8e38ac9f181b490fbbe3dc70a0a13444/users/09da0e6134774eb4bc9083e0126689ec/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:17.704213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993cbbf-040a-48b9-a7e5-d0fb57b4bae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e38ac9f181b490fbbe3dc70a0a13444, user_id=09da0e6134774eb4bc9083e0126689ec, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:17.710998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993cbbf-040a-48b9-a7e5-d0fb57b4bae5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:17.719019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:17.749377 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3742/7490] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:17 2022] PUT /identity/v3/projects/8e38ac9f181b490fbbe3dc70a0a13444/users/09da0e6134774eb4bc9083e0126689ec/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:17.761612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818ed35-ecfb-41a5-8597-c2c0515cd91f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:17.761922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818ed35-ecfb-41a5-8597-c2c0515cd91f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:17.762165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818ed35-ecfb-41a5-8597-c2c0515cd91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:17.825725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d818ed35-ecfb-41a5-8597-c2c0515cd91f None None] MFA Rules not processed for user `09da0e6134774eb4bc9083e0126689ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:17.837731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d818ed35-ecfb-41a5-8597-c2c0515cd91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:17.974375 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3749/7491] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:17.987065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993cbbf-040a-48b9-a7e5-d0fb57b4bae5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:17.989753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c993cbbf-040a-48b9-a7e5-d0fb57b4bae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:18.109616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993cbbf-040a-48b9-a7e5-d0fb57b4bae5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:18.115959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664196d2-3063-4fe5-81ed-d662f3cd7508 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:18.116801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664196d2-3063-4fe5-81ed-d662f3cd7508 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:18.117079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664196d2-3063-4fe5-81ed-d662f3cd7508 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:18.117528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664196d2-3063-4fe5-81ed-d662f3cd7508 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:18.147967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664196d2-3063-4fe5-81ed-d662f3cd7508 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:18.149982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664196d2-3063-4fe5-81ed-d662f3cd7508 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:18.187727 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3743/7492] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:52:18.524950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818ed35-ecfb-41a5-8597-c2c0515cd91f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:18.530086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d818ed35-ecfb-41a5-8597-c2c0515cd91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:18.861220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818ed35-ecfb-41a5-8597-c2c0515cd91f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:18.875139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a968b09-c45c-415c-82c2-9d3a908a7aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:18.875843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a968b09-c45c-415c-82c2-9d3a908a7aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:18.876235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a968b09-c45c-415c-82c2-9d3a908a7aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:18.876528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a968b09-c45c-415c-82c2-9d3a908a7aa0 admin admin] PATH_INFO: `/v3/projects/cd55cb711bca4db287fc33111cfa67ab` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:18.880931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a968b09-c45c-415c-82c2-9d3a908a7aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd55cb711bca4db287fc33111cfa67ab)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:18.885015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a968b09-c45c-415c-82c2-9d3a908a7aa0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:19.045303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8a968b09-c45c-415c-82c2-9d3a908a7aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd55cb711bca4db287fc33111cfa67ab', 'request_id': 'req-8a968b09-c45c-415c-82c2-9d3a908a7aa0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:19.066628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8a968b09-c45c-415c-82c2-9d3a908a7aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd55cb711bca4db287fc33111cfa67ab', 'request_id': 'req-8a968b09-c45c-415c-82c2-9d3a908a7aa0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:19.081619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8a968b09-c45c-415c-82c2-9d3a908a7aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd55cb711bca4db287fc33111cfa67ab', 'request_id': 'req-8a968b09-c45c-415c-82c2-9d3a908a7aa0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:19.109771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8a968b09-c45c-415c-82c2-9d3a908a7aa0 admin admin] The token cache is being invalidate because project cd55cb711bca4db287fc33111cfa67ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:19.110451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8a968b09-c45c-415c-82c2-9d3a908a7aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:19.111483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8a968b09-c45c-415c-82c2-9d3a908a7aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:19.118453 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3750/7493] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:18 2022] DELETE /identity/v3/projects/cd55cb711bca4db287fc33111cfa67ab => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:19.119845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142037-4be9-4ae1-b850-0f451b23024d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:19.120355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142037-4be9-4ae1-b850-0f451b23024d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:19.122836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142037-4be9-4ae1-b850-0f451b23024d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:19.231673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-51142037-4be9-4ae1-b850-0f451b23024d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:19.233326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51142037-4be9-4ae1-b850-0f451b23024d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:19.381332 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3744/7494] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:19.390165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07b22-c411-4284-ab45-4d787ba3ecc6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:19.390482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07b22-c411-4284-ab45-4d787ba3ecc6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:19.390764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07b22-c411-4284-ab45-4d787ba3ecc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:19.436674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5fc07b22-c411-4284-ab45-4d787ba3ecc6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:19.439567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5fc07b22-c411-4284-ab45-4d787ba3ecc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:19.469374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51142037-4be9-4ae1-b850-0f451b23024d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:19.488612 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3751/7495] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:19.493778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51142037-4be9-4ae1-b850-0f451b23024d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:19.504086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2f1da-11c6-475b-b342-b0014e7b701f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:19.504945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2f1da-11c6-475b-b342-b0014e7b701f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:19.505457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2f1da-11c6-475b-b342-b0014e7b701f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:19.506149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2f1da-11c6-475b-b342-b0014e7b701f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:19.506856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2f1da-11c6-475b-b342-b0014e7b701f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:19.507161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2f1da-11c6-475b-b342-b0014e7b701f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:19.509214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2f1da-11c6-475b-b342-b0014e7b701f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:19.531871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc07b22-c411-4284-ab45-4d787ba3ecc6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:19.538838 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3745/7496] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:19.543225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc07b22-c411-4284-ab45-4d787ba3ecc6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:19.549160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d565c-cc3d-4d31-aeeb-f148180dd4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:19.549362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d565c-cc3d-4d31-aeeb-f148180dd4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:19.549556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d565c-cc3d-4d31-aeeb-f148180dd4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:19.549857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d565c-cc3d-4d31-aeeb-f148180dd4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:19.550657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d565c-cc3d-4d31-aeeb-f148180dd4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:19.559400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d565c-cc3d-4d31-aeeb-f148180dd4b8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:19.592183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:19.630406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2f1da-11c6-475b-b342-b0014e7b701f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:19.638925 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3752/7497] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:19 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:19.646720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2f1da-11c6-475b-b342-b0014e7b701f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:19.813863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ce2ca-59d6-48f7-8222-6cc0cd7eb754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:19.814400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ce2ca-59d6-48f7-8222-6cc0cd7eb754 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:19.814564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ce2ca-59d6-48f7-8222-6cc0cd7eb754 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:19.814837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ce2ca-59d6-48f7-8222-6cc0cd7eb754 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:19.815902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ce2ca-59d6-48f7-8222-6cc0cd7eb754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:19.817948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ce2ca-59d6-48f7-8222-6cc0cd7eb754 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:19.875574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d565c-cc3d-4d31-aeeb-f148180dd4b8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:19.884960 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3746/7498] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:19 2022] POST /identity/v3/users => generated 286 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:19.899283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d565c-cc3d-4d31-aeeb-f148180dd4b8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:19.913045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afb114-9c1d-4c59-9736-9c1a44163669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:19.913706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afb114-9c1d-4c59-9736-9c1a44163669 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:19.914281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afb114-9c1d-4c59-9736-9c1a44163669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:19.914428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afb114-9c1d-4c59-9736-9c1a44163669 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:19.915054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afb114-9c1d-4c59-9736-9c1a44163669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:19.917719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afb114-9c1d-4c59-9736-9c1a44163669 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:19.946133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ce2ca-59d6-48f7-8222-6cc0cd7eb754 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:19.958135 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3753/7499] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:19.966257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ce2ca-59d6-48f7-8222-6cc0cd7eb754 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:19.993465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561fabd-82c8-4dba-b056-0ae7ef17e882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:19.994109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561fabd-82c8-4dba-b056-0ae7ef17e882 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:19.994898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561fabd-82c8-4dba-b056-0ae7ef17e882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:19.995211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561fabd-82c8-4dba-b056-0ae7ef17e882 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:19.995977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561fabd-82c8-4dba-b056-0ae7ef17e882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:19.997633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561fabd-82c8-4dba-b056-0ae7ef17e882 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:20.025303 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3747/7500] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:52:20.029877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afb114-9c1d-4c59-9736-9c1a44163669 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:20.046373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afb114-9c1d-4c59-9736-9c1a44163669 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:20.061501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59288d3-aec8-41c0-a439-46fc6997f8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:20.062131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59288d3-aec8-41c0-a439-46fc6997f8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:20.062726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59288d3-aec8-41c0-a439-46fc6997f8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:20.062726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59288d3-aec8-41c0-a439-46fc6997f8a0 admin admin] PATH_INFO: `/v3/projects/0519832d917e47be85042ff32f3a180c/users/0bb8496727eb40b3921463b4424a05da/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:20.108418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59288d3-aec8-41c0-a439-46fc6997f8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0519832d917e47be85042ff32f3a180c, user_id=0bb8496727eb40b3921463b4424a05da, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:20.111246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59288d3-aec8-41c0-a439-46fc6997f8a0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:20.166534 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3754/7501] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:20 2022] PUT /identity/v3/projects/0519832d917e47be85042ff32f3a180c/users/0bb8496727eb40b3921463b4424a05da/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:20.169184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc275bd-288c-4a32-a088-a104a7aba890 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:20.170117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc275bd-288c-4a32-a088-a104a7aba890 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:20.170117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc275bd-288c-4a32-a088-a104a7aba890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:20.179844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:20.245221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5cc275bd-288c-4a32-a088-a104a7aba890 None None] MFA Rules not processed for user `0bb8496727eb40b3921463b4424a05da`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:20.253227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5cc275bd-288c-4a32-a088-a104a7aba890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:20.483679 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3748/7502] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:20.498237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59288d3-aec8-41c0-a439-46fc6997f8a0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:20.508842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c59288d3-aec8-41c0-a439-46fc6997f8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:20.786969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc275bd-288c-4a32-a088-a104a7aba890 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:20.791156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5cc275bd-288c-4a32-a088-a104a7aba890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:20.892820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59288d3-aec8-41c0-a439-46fc6997f8a0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:20.914235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c50a3e-cd89-4022-939d-03d53777bb81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:20.914880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c50a3e-cd89-4022-939d-03d53777bb81 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:20.915164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c50a3e-cd89-4022-939d-03d53777bb81 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:20.915474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c50a3e-cd89-4022-939d-03d53777bb81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:20.957549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c50a3e-cd89-4022-939d-03d53777bb81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:20.962966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c50a3e-cd89-4022-939d-03d53777bb81 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:21.007869 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3755/7503] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:21.028437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc275bd-288c-4a32-a088-a104a7aba890 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:21.065903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c8315-e475-4064-903d-00cafc121a4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:21.066788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c8315-e475-4064-903d-00cafc121a4a service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:21.068447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c8315-e475-4064-903d-00cafc121a4a service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:21.070699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c8315-e475-4064-903d-00cafc121a4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:21.074340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-de4c8315-e475-4064-903d-00cafc121a4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:21.125483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c8315-e475-4064-903d-00cafc121a4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:21.135189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c8315-e475-4064-903d-00cafc121a4a service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:21.172508 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3749/7504] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:26.421246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c50a3e-cd89-4022-939d-03d53777bb81 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:26.425501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b2c50a3e-cd89-4022-939d-03d53777bb81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:26.493814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c50a3e-cd89-4022-939d-03d53777bb81 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:26.516875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d80cc-ed2e-4d25-9617-0064fcfa4016 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:26.517411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d80cc-ed2e-4d25-9617-0064fcfa4016 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:26.517695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d80cc-ed2e-4d25-9617-0064fcfa4016 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:26.517976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d80cc-ed2e-4d25-9617-0064fcfa4016 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:26.534926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ce4d80cc-ed2e-4d25-9617-0064fcfa4016 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:26.572584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d80cc-ed2e-4d25-9617-0064fcfa4016 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:26.574346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d80cc-ed2e-4d25-9617-0064fcfa4016 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:26.608961 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3756/7505] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:29.706924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c8315-e475-4064-903d-00cafc121a4a service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:29.898205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c8315-e475-4064-903d-00cafc121a4a service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:29.920011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4e00b-8765-4c2b-859a-4397e1d4fb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:29.920684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e00b-8765-4c2b-859a-4397e1d4fb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:29.920970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e00b-8765-4c2b-859a-4397e1d4fb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:29.921244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e00b-8765-4c2b-859a-4397e1d4fb67 admin admin] PATH_INFO: `/v3/users/0bb8496727eb40b3921463b4424a05da` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:29.939677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4e00b-8765-4c2b-859a-4397e1d4fb67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb8496727eb40b3921463b4424a05da)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:29.941795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4e00b-8765-4c2b-859a-4397e1d4fb67 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:29.998114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:30.070611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7fa4e00b-8765-4c2b-859a-4397e1d4fb67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb8496727eb40b3921463b4424a05da'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:30.072393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7fa4e00b-8765-4c2b-859a-4397e1d4fb67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb8496727eb40b3921463b4424a05da'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:30.081721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7fa4e00b-8765-4c2b-859a-4397e1d4fb67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb8496727eb40b3921463b4424a05da'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:30.097479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7fa4e00b-8765-4c2b-859a-4397e1d4fb67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb8496727eb40b3921463b4424a05da'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:30.119893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7fa4e00b-8765-4c2b-859a-4397e1d4fb67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb8496727eb40b3921463b4424a05da'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:30.134069 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3750/7506] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:29 2022] DELETE /identity/v3/users/0bb8496727eb40b3921463b4424a05da => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:30.134693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bd1e3-41b9-445d-b3dc-677a47398a53 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:30.135097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bd1e3-41b9-445d-b3dc-677a47398a53 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:30.135474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bd1e3-41b9-445d-b3dc-677a47398a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:30.172557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e35bd1e3-41b9-445d-b3dc-677a47398a53 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:30.174215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e35bd1e3-41b9-445d-b3dc-677a47398a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:30.326664 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3757/7507] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:30.338182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4e00b-8765-4c2b-859a-4397e1d4fb67 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:30.341429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7fa4e00b-8765-4c2b-859a-4397e1d4fb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:30.550125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4e00b-8765-4c2b-859a-4397e1d4fb67 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:30.571581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23af4f6-ad6a-4e60-a2f9-e49aa43a6bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:30.572349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23af4f6-ad6a-4e60-a2f9-e49aa43a6bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:30.572639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23af4f6-ad6a-4e60-a2f9-e49aa43a6bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:30.572963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23af4f6-ad6a-4e60-a2f9-e49aa43a6bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:30.621179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23af4f6-ad6a-4e60-a2f9-e49aa43a6bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:30.627393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23af4f6-ad6a-4e60-a2f9-e49aa43a6bc5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:30.670462 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3751/7508] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:31.387425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bd1e3-41b9-445d-b3dc-677a47398a53 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:31.389996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e35bd1e3-41b9-445d-b3dc-677a47398a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:31.410706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bd1e3-41b9-445d-b3dc-677a47398a53 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:31.431459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01707ea3-e539-4226-9da0-b184e6894692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:31.432267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707ea3-e539-4226-9da0-b184e6894692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:31.432607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707ea3-e539-4226-9da0-b184e6894692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:31.433038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707ea3-e539-4226-9da0-b184e6894692 admin admin] PATH_INFO: `/v3/projects/0519832d917e47be85042ff32f3a180c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:31.434633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01707ea3-e539-4226-9da0-b184e6894692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0519832d917e47be85042ff32f3a180c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:31.436850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01707ea3-e539-4226-9da0-b184e6894692 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:31.509404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:31.605346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-01707ea3-e539-4226-9da0-b184e6894692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0519832d917e47be85042ff32f3a180c', 'request_id': 'req-01707ea3-e539-4226-9da0-b184e6894692'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:31.646042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-01707ea3-e539-4226-9da0-b184e6894692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0519832d917e47be85042ff32f3a180c', 'request_id': 'req-01707ea3-e539-4226-9da0-b184e6894692'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:31.669203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-01707ea3-e539-4226-9da0-b184e6894692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0519832d917e47be85042ff32f3a180c', 'request_id': 'req-01707ea3-e539-4226-9da0-b184e6894692'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:31.699542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-01707ea3-e539-4226-9da0-b184e6894692 admin admin] The token cache is being invalidate because project 0519832d917e47be85042ff32f3a180c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:31.702292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-01707ea3-e539-4226-9da0-b184e6894692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:31.703675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-01707ea3-e539-4226-9da0-b184e6894692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:31.707415 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3758/7509] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:31 2022] DELETE /identity/v3/projects/0519832d917e47be85042ff32f3a180c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:31.715517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7b190-6b09-4ef8-a92b-e6b273325515 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:31.716104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7b190-6b09-4ef8-a92b-e6b273325515 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:31.717591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7b190-6b09-4ef8-a92b-e6b273325515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:31.766718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-32d7b190-6b09-4ef8-a92b-e6b273325515 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:31.772534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-32d7b190-6b09-4ef8-a92b-e6b273325515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:31.892873 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3752/7510] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:31.902660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3070fe-95ce-408a-b424-34077c819f66 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:31.903424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3070fe-95ce-408a-b424-34077c819f66 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:31.904184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3070fe-95ce-408a-b424-34077c819f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:31.952275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0d3070fe-95ce-408a-b424-34077c819f66 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:31.953920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0d3070fe-95ce-408a-b424-34077c819f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:31.966379 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3759/7511] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:31.973266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7b190-6b09-4ef8-a92b-e6b273325515 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:31.992522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7b190-6b09-4ef8-a92b-e6b273325515 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:32.011374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bffdd0-3962-4d8a-862f-a40a246398d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:32.013408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bffdd0-3962-4d8a-862f-a40a246398d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.014173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bffdd0-3962-4d8a-862f-a40a246398d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.016146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bffdd0-3962-4d8a-862f-a40a246398d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.020775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bffdd0-3962-4d8a-862f-a40a246398d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:32.021475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bffdd0-3962-4d8a-862f-a40a246398d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:32.027074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bffdd0-3962-4d8a-862f-a40a246398d2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:32.066017 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3753/7512] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:32.070216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3070fe-95ce-408a-b424-34077c819f66 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:32.085844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3070fe-95ce-408a-b424-34077c819f66 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:32.098125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407c908-7202-45e4-a14c-68af37cf08bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:32.099516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407c908-7202-45e4-a14c-68af37cf08bb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.101267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407c908-7202-45e4-a14c-68af37cf08bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.102933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407c908-7202-45e4-a14c-68af37cf08bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.104386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407c908-7202-45e4-a14c-68af37cf08bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:32.111075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407c908-7202-45e4-a14c-68af37cf08bb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:32.187303 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3760/7513] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:32 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:52:32.191015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bffdd0-3962-4d8a-862f-a40a246398d2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:32.205462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bffdd0-3962-4d8a-862f-a40a246398d2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:32.260448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:32.313880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898e04a-cb99-4af7-b2b8-9d4928ca7636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:32.315564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898e04a-cb99-4af7-b2b8-9d4928ca7636 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.316284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898e04a-cb99-4af7-b2b8-9d4928ca7636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.316833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898e04a-cb99-4af7-b2b8-9d4928ca7636 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.317823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898e04a-cb99-4af7-b2b8-9d4928ca7636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:32.320264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898e04a-cb99-4af7-b2b8-9d4928ca7636 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:32.352719 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3754/7514] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:32 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:32.356964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407c908-7202-45e4-a14c-68af37cf08bb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:32.370654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407c908-7202-45e4-a14c-68af37cf08bb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:32.393952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214620a-7d38-4cb6-a6ba-541fece387f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:32.395568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214620a-7d38-4cb6-a6ba-541fece387f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.396199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214620a-7d38-4cb6-a6ba-541fece387f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.396649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214620a-7d38-4cb6-a6ba-541fece387f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.397735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214620a-7d38-4cb6-a6ba-541fece387f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:32.402361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214620a-7d38-4cb6-a6ba-541fece387f3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:32.430825 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3761/7515] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:32.435972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898e04a-cb99-4af7-b2b8-9d4928ca7636 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:32.461163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898e04a-cb99-4af7-b2b8-9d4928ca7636 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:32.475851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb44a74-ff7f-4402-b0a6-9a4e8ddf9684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:32.481657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb44a74-ff7f-4402-b0a6-9a4e8ddf9684 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.481991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb44a74-ff7f-4402-b0a6-9a4e8ddf9684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.482435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb44a74-ff7f-4402-b0a6-9a4e8ddf9684 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.485049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb44a74-ff7f-4402-b0a6-9a4e8ddf9684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:32.491138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb44a74-ff7f-4402-b0a6-9a4e8ddf9684 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:32.518946 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3755/7516] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:32.523653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214620a-7d38-4cb6-a6ba-541fece387f3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:32.542432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214620a-7d38-4cb6-a6ba-541fece387f3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:32.556926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061aa8a-ceff-498d-90b8-6ff11a9ad6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:32.558905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061aa8a-ceff-498d-90b8-6ff11a9ad6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.559190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061aa8a-ceff-498d-90b8-6ff11a9ad6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.560088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061aa8a-ceff-498d-90b8-6ff11a9ad6a9 admin admin] PATH_INFO: `/v3/projects/3adfbe8d78c542b8abd7f98d6c10fcaa/users/743f381df0164ccbae8aae549467042a/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.613287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061aa8a-ceff-498d-90b8-6ff11a9ad6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3adfbe8d78c542b8abd7f98d6c10fcaa, user_id=743f381df0164ccbae8aae549467042a, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:32.618061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061aa8a-ceff-498d-90b8-6ff11a9ad6a9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:32.648226 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3762/7517] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:32 2022] PUT /identity/v3/projects/3adfbe8d78c542b8abd7f98d6c10fcaa/users/743f381df0164ccbae8aae549467042a/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:32.663138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73e8f3-4066-4a23-98aa-828ef4a9170a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.663451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73e8f3-4066-4a23-98aa-828ef4a9170a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.664399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73e8f3-4066-4a23-98aa-828ef4a9170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.722953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4e73e8f3-4066-4a23-98aa-828ef4a9170a None None] MFA Rules not processed for user `743f381df0164ccbae8aae549467042a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:32.724582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e73e8f3-4066-4a23-98aa-828ef4a9170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:32.820192 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3756/7518] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:32.823643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061aa8a-ceff-498d-90b8-6ff11a9ad6a9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:32.915299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061aa8a-ceff-498d-90b8-6ff11a9ad6a9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:32.922776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57742b-e81f-4bdb-aeb2-d0ae710f2f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:32.923861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57742b-e81f-4bdb-aeb2-d0ae710f2f76 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.924759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57742b-e81f-4bdb-aeb2-d0ae710f2f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.925350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57742b-e81f-4bdb-aeb2-d0ae710f2f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.926529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57742b-e81f-4bdb-aeb2-d0ae710f2f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:32.932185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57742b-e81f-4bdb-aeb2-d0ae710f2f76 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:33.017327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73e8f3-4066-4a23-98aa-828ef4a9170a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:33.032609 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3763/7519] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:32 2022] POST /identity/v3/projects => generated 367 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:33.034799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73e8f3-4066-4a23-98aa-828ef4a9170a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:33.190491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114e339-da7a-4cd8-90b9-d90a53de012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:33.191399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114e339-da7a-4cd8-90b9-d90a53de012d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:33.191805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114e339-da7a-4cd8-90b9-d90a53de012d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:33.192172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114e339-da7a-4cd8-90b9-d90a53de012d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.193047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114e339-da7a-4cd8-90b9-d90a53de012d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:33.195080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114e339-da7a-4cd8-90b9-d90a53de012d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:33.228667 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3757/7520] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:33 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:33.234544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57742b-e81f-4bdb-aeb2-d0ae710f2f76 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:33.251807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57742b-e81f-4bdb-aeb2-d0ae710f2f76 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:33.259459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912856a-bca0-47f3-bdb6-6985f00a06ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:33.260388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912856a-bca0-47f3-bdb6-6985f00a06ca admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:33.261123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912856a-bca0-47f3-bdb6-6985f00a06ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:33.261356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912856a-bca0-47f3-bdb6-6985f00a06ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.262337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912856a-bca0-47f3-bdb6-6985f00a06ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:33.265729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912856a-bca0-47f3-bdb6-6985f00a06ca admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:33.291590 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3764/7521] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:33.294047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114e339-da7a-4cd8-90b9-d90a53de012d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:33.308100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114e339-da7a-4cd8-90b9-d90a53de012d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:33.313967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938ee52-6b6a-4020-95f7-7a979123666a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:33.314721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938ee52-6b6a-4020-95f7-7a979123666a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:33.315007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938ee52-6b6a-4020-95f7-7a979123666a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:33.318176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938ee52-6b6a-4020-95f7-7a979123666a admin admin] PATH_INFO: `/v3/projects/f678e7534f2b4918b4cc18d1334c9cc6/users/ac8285c33fef4d31afac12b8ec80c9f7/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.341772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938ee52-6b6a-4020-95f7-7a979123666a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f678e7534f2b4918b4cc18d1334c9cc6, user_id=ac8285c33fef4d31afac12b8ec80c9f7, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:33.344966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938ee52-6b6a-4020-95f7-7a979123666a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:33.363688 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3758/7522] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:33 2022] PUT /identity/v3/projects/f678e7534f2b4918b4cc18d1334c9cc6/users/ac8285c33fef4d31afac12b8ec80c9f7/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:33.368700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912856a-bca0-47f3-bdb6-6985f00a06ca admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:33.387638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912856a-bca0-47f3-bdb6-6985f00a06ca admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:33.417783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:33.484835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072a280-18f8-46c8-88df-127aa77ee9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:33.486009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072a280-18f8-46c8-88df-127aa77ee9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:33.486434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072a280-18f8-46c8-88df-127aa77ee9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:33.487115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072a280-18f8-46c8-88df-127aa77ee9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.487416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072a280-18f8-46c8-88df-127aa77ee9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:33.489828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072a280-18f8-46c8-88df-127aa77ee9d4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:33.505484 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3765/7523] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:33.509779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938ee52-6b6a-4020-95f7-7a979123666a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:33.517754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:33.524226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938ee52-6b6a-4020-95f7-7a979123666a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:33.535944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23452fb2-434f-4232-b6c6-0e5e06d67dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:33.536912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23452fb2-434f-4232-b6c6-0e5e06d67dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:33.537508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23452fb2-434f-4232-b6c6-0e5e06d67dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:33.538072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23452fb2-434f-4232-b6c6-0e5e06d67dc9 admin admin] PATH_INFO: `/v3/projects/f678e7534f2b4918b4cc18d1334c9cc6/users/ac8285c33fef4d31afac12b8ec80c9f7/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.542470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23452fb2-434f-4232-b6c6-0e5e06d67dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f678e7534f2b4918b4cc18d1334c9cc6, user_id=ac8285c33fef4d31afac12b8ec80c9f7, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:33.545704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23452fb2-434f-4232-b6c6-0e5e06d67dc9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:33.588973 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3759/7524] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:33 2022] PUT /identity/v3/projects/f678e7534f2b4918b4cc18d1334c9cc6/users/ac8285c33fef4d31afac12b8ec80c9f7/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:33.590892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a9c6-fd91-4e3d-83b9-9d55c8bf19fe None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:33.591306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a9c6-fd91-4e3d-83b9-9d55c8bf19fe None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:33.591831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a9c6-fd91-4e3d-83b9-9d55c8bf19fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.639989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5192a9c6-fd91-4e3d-83b9-9d55c8bf19fe None None] MFA Rules not processed for user `ac8285c33fef4d31afac12b8ec80c9f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:33.641540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5192a9c6-fd91-4e3d-83b9-9d55c8bf19fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:33.854764 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3766/7525] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:33.856300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23452fb2-434f-4232-b6c6-0e5e06d67dc9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:33.877207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23452fb2-434f-4232-b6c6-0e5e06d67dc9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:33.889310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559d9e4-1c64-4ff7-87a6-c98088343648 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:33.890030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559d9e4-1c64-4ff7-87a6-c98088343648 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:33.890372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559d9e4-1c64-4ff7-87a6-c98088343648 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:33.892095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559d9e4-1c64-4ff7-87a6-c98088343648 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.893264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559d9e4-1c64-4ff7-87a6-c98088343648 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:33.898187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559d9e4-1c64-4ff7-87a6-c98088343648 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:33.941891 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3760/7526] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:52:33 2022] POST /identity/v3/roles => generated 235 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:33.943713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192a9c6-fd91-4e3d-83b9-9d55c8bf19fe None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:33.955324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192a9c6-fd91-4e3d-83b9-9d55c8bf19fe None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:33.988431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d6656-90b6-470f-9a4d-bd4d554456a7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:33.989020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d6656-90b6-470f-9a4d-bd4d554456a7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:33.989310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d6656-90b6-470f-9a4d-bd4d554456a7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:33.993276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d6656-90b6-470f-9a4d-bd4d554456a7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.993276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d6656-90b6-470f-9a4d-bd4d554456a7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:33.993276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d6656-90b6-470f-9a4d-bd4d554456a7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:34.039563 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3767/7527] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:52:33 2022] POST /identity/v3/roles => generated 234 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:34.041017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559d9e4-1c64-4ff7-87a6-c98088343648 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:34.055112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559d9e4-1c64-4ff7-87a6-c98088343648 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:34.071409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcb21e-25e2-4358-b55c-9d0cbf9afd37 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:34.072185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcb21e-25e2-4358-b55c-9d0cbf9afd37 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:34.072476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcb21e-25e2-4358-b55c-9d0cbf9afd37 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:34.072770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcb21e-25e2-4358-b55c-9d0cbf9afd37 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:34.073655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcb21e-25e2-4358-b55c-9d0cbf9afd37 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:34.076235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcb21e-25e2-4358-b55c-9d0cbf9afd37 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:34.113376 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3761/7528] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:52:34 2022] POST /identity/v3/roles => generated 234 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:34.115353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d6656-90b6-470f-9a4d-bd4d554456a7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:34.132327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d6656-90b6-470f-9a4d-bd4d554456a7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:34.139171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11945abd-f918-4547-b025-25c0d70e9e70 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:34.139962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11945abd-f918-4547-b025-25c0d70e9e70 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:34.140251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11945abd-f918-4547-b025-25c0d70e9e70 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:34.140527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11945abd-f918-4547-b025-25c0d70e9e70 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:34.141338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11945abd-f918-4547-b025-25c0d70e9e70 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:34.142845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11945abd-f918-4547-b025-25c0d70e9e70 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:34.177913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcb21e-25e2-4358-b55c-9d0cbf9afd37 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:34.179423 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3768/7529] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:52:34 2022] POST /identity/v3/domains => generated 277 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:34.205981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcb21e-25e2-4358-b55c-9d0cbf9afd37 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:34.346517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbc625-05bd-4403-a32d-584e84a340f5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:34.347197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbc625-05bd-4403-a32d-584e84a340f5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:34.347604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbc625-05bd-4403-a32d-584e84a340f5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:34.347884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbc625-05bd-4403-a32d-584e84a340f5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:34.348543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbc625-05bd-4403-a32d-584e84a340f5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:34.350522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbc625-05bd-4403-a32d-584e84a340f5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:34.422165 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3762/7530] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:34 2022] POST /identity/v3/projects => generated 401 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:34.426883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11945abd-f918-4547-b025-25c0d70e9e70 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:34.460312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11945abd-f918-4547-b025-25c0d70e9e70 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:34.608911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fa427-ee9c-4b24-bba6-6e0ccbcdd1a3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:34.610318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fa427-ee9c-4b24-bba6-6e0ccbcdd1a3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:34.610785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fa427-ee9c-4b24-bba6-6e0ccbcdd1a3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:34.611235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fa427-ee9c-4b24-bba6-6e0ccbcdd1a3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:34.612248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fa427-ee9c-4b24-bba6-6e0ccbcdd1a3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:34.614740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fa427-ee9c-4b24-bba6-6e0ccbcdd1a3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:34.655423 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3769/7531] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Aug 28 18:52:34 2022] POST /identity/v3/groups => generated 301 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:34.661542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbc625-05bd-4403-a32d-584e84a340f5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:34.689969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbc625-05bd-4403-a32d-584e84a340f5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:34.706048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0baf2e5-1096-4bb3-9e75-f3191344f3dc tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:34.706994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0baf2e5-1096-4bb3-9e75-f3191344f3dc tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:34.707577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0baf2e5-1096-4bb3-9e75-f3191344f3dc tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:34.708029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0baf2e5-1096-4bb3-9e75-f3191344f3dc tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:34.708915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0baf2e5-1096-4bb3-9e75-f3191344f3dc tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:34.710722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0baf2e5-1096-4bb3-9e75-f3191344f3dc tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:34.745096 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3763/7532] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:52:34 2022] POST /identity/v3/roles => generated 235 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:34.748514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fa427-ee9c-4b24-bba6-6e0ccbcdd1a3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:34.784742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fa427-ee9c-4b24-bba6-6e0ccbcdd1a3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:34.792918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3f5fa-f267-4206-855c-e1d6a116e228 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:34.816429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3f5fa-f267-4206-855c-e1d6a116e228 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:34.816816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3f5fa-f267-4206-855c-e1d6a116e228 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:34.817243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3f5fa-f267-4206-855c-e1d6a116e228 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:34.824624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3f5fa-f267-4206-855c-e1d6a116e228 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:34.832342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3f5fa-f267-4206-855c-e1d6a116e228 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:34.868129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:34.912648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0baf2e5-1096-4bb3-9e75-f3191344f3dc tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:34.913134 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3770/7533] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:34 2022] POST /identity/v3/users => generated 439 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:34.924266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0baf2e5-1096-4bb3-9e75-f3191344f3dc tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:34.950349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd377db-5b2e-4322-8926-4f40e42b13ef tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:34.951932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd377db-5b2e-4322-8926-4f40e42b13ef tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:34.952461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd377db-5b2e-4322-8926-4f40e42b13ef tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:34.954521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd377db-5b2e-4322-8926-4f40e42b13ef tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:34.958489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd377db-5b2e-4322-8926-4f40e42b13ef tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:34.959586 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-ecd377db-5b2e-4322-8926-4f40e42b13ef tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:34.959586 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:52:34.959586 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:52:34.970621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd377db-5b2e-4322-8926-4f40e42b13ef tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:35.020851 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3764/7534] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:52:34 2022] POST /identity/v3/roles => generated 270 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:35.024710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3f5fa-f267-4206-855c-e1d6a116e228 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:35.056612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3f5fa-f267-4206-855c-e1d6a116e228 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:35.072118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae6017-14df-4fed-b6d5-482108c40bd4 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:35.073279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae6017-14df-4fed-b6d5-482108c40bd4 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:35.073760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae6017-14df-4fed-b6d5-482108c40bd4 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:35.074053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae6017-14df-4fed-b6d5-482108c40bd4 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/projects/054efde02752418a9cfb0951281585b4/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/9c282cf344284ff18b813a39bca5c9f1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:35.106204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae6017-14df-4fed-b6d5-482108c40bd4 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_grant(project_id=054efde02752418a9cfb0951281585b4, user_id=fa60bbd2c35241bf8dd101dcc2b5251a, role_id=9c282cf344284ff18b813a39bca5c9f1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:35.110642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae6017-14df-4fed-b6d5-482108c40bd4 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:35.135394 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3771/7535] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:35 2022] PUT /identity/v3/projects/054efde02752418a9cfb0951281585b4/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/9c282cf344284ff18b813a39bca5c9f1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:35.140009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd377db-5b2e-4322-8926-4f40e42b13ef tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:35.160741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd377db-5b2e-4322-8926-4f40e42b13ef tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:35.332917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc871d16-2a39-456b-9bd6-07491df7fdf7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:35.333989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc871d16-2a39-456b-9bd6-07491df7fdf7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:35.334453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc871d16-2a39-456b-9bd6-07491df7fdf7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:35.335371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc871d16-2a39-456b-9bd6-07491df7fdf7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:35.336253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc871d16-2a39-456b-9bd6-07491df7fdf7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Adding query filter params (scope.project.id=054efde02752418a9cfb0951281585b4, user.id=fa60bbd2c35241bf8dd101dcc2b5251a) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:35.336763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc871d16-2a39-456b-9bd6-07491df7fdf7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:35.364957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc871d16-2a39-456b-9bd6-07491df7fdf7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:35.436715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:35.492432 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3765/7536] 10.222.0.27 () {58 vars in 1356 bytes} [Sun Aug 28 18:52:35 2022] GET /identity/v3/role_assignments?scope.project.id=054efde02752418a9cfb0951281585b4&user.id=fa60bbd2c35241bf8dd101dcc2b5251a&effective => generated 228 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:35.498151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae6017-14df-4fed-b6d5-482108c40bd4 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:35.516189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae6017-14df-4fed-b6d5-482108c40bd4 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:35.527741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2eeaa-ccd8-41ea-8e86-305852a3702c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:35.528212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2eeaa-ccd8-41ea-8e86-305852a3702c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:35.528634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2eeaa-ccd8-41ea-8e86-305852a3702c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:35.528936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2eeaa-ccd8-41ea-8e86-305852a3702c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/projects/054efde02752418a9cfb0951281585b4/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/9c282cf344284ff18b813a39bca5c9f1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:35.539140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2eeaa-ccd8-41ea-8e86-305852a3702c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=054efde02752418a9cfb0951281585b4, user_id=fa60bbd2c35241bf8dd101dcc2b5251a, role_id=9c282cf344284ff18b813a39bca5c9f1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:35.559681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2eeaa-ccd8-41ea-8e86-305852a3702c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:35.569635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fea2eeaa-ccd8-41ea-8e86-305852a3702c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invalidating the token cache because role 9c282cf344284ff18b813a39bca5c9f1 was removed from user fa60bbd2c35241bf8dd101dcc2b5251a on project 054efde02752418a9cfb0951281585b4. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:35.570211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fea2eeaa-ccd8-41ea-8e86-305852a3702c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:35.571151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fea2eeaa-ccd8-41ea-8e86-305852a3702c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:35.620061 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3772/7537] 10.222.0.27 () {58 vars in 1467 bytes} [Sun Aug 28 18:52:35 2022] DELETE /identity/v3/projects/054efde02752418a9cfb0951281585b4/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/9c282cf344284ff18b813a39bca5c9f1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:35.624371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc871d16-2a39-456b-9bd6-07491df7fdf7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:35.626421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc871d16-2a39-456b-9bd6-07491df7fdf7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:35.663747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc871d16-2a39-456b-9bd6-07491df7fdf7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:35.799179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ef2d4-a138-4d9f-8f10-c2623b4f275d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:35.803709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef2d4-a138-4d9f-8f10-c2623b4f275d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:35.804306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef2d4-a138-4d9f-8f10-c2623b4f275d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:35.804433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef2d4-a138-4d9f-8f10-c2623b4f275d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/9c282cf344284ff18b813a39bca5c9f1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:35.806724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ef2d4-a138-4d9f-8f10-c2623b4f275d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=9c282cf344284ff18b813a39bca5c9f1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:35.808755 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-489ef2d4-a138-4d9f-8f10-c2623b4f275d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:35.808755 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:52:35.808755 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:52:35.812157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ef2d4-a138-4d9f-8f10-c2623b4f275d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:35.920430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-489ef2d4-a138-4d9f-8f10-c2623b4f275d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invalidating the token cache because role 9c282cf344284ff18b813a39bca5c9f1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:35.921216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-489ef2d4-a138-4d9f-8f10-c2623b4f275d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:35.923540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-489ef2d4-a138-4d9f-8f10-c2623b4f275d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:35.930723 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3766/7538] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:35 2022] DELETE /identity/v3/roles/9c282cf344284ff18b813a39bca5c9f1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:35.936046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2eeaa-ccd8-41ea-8e86-305852a3702c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:35.954579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2eeaa-ccd8-41ea-8e86-305852a3702c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:36.166327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46494d74-98cc-4723-909c-660c8ddff168 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:36.167922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46494d74-98cc-4723-909c-660c8ddff168 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:36.168315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46494d74-98cc-4723-909c-660c8ddff168 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:36.168699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46494d74-98cc-4723-909c-660c8ddff168 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/projects/054efde02752418a9cfb0951281585b4/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/dce83b6d620442be9aa578f2ff592d19` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:36.172511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46494d74-98cc-4723-909c-660c8ddff168 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_grant(project_id=054efde02752418a9cfb0951281585b4, user_id=fa60bbd2c35241bf8dd101dcc2b5251a, role_id=dce83b6d620442be9aa578f2ff592d19)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:36.183429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46494d74-98cc-4723-909c-660c8ddff168 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:36.215869 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3773/7539] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:35 2022] PUT /identity/v3/projects/054efde02752418a9cfb0951281585b4/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/dce83b6d620442be9aa578f2ff592d19 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:36.220342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ef2d4-a138-4d9f-8f10-c2623b4f275d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:36.228574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-489ef2d4-a138-4d9f-8f10-c2623b4f275d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:36.267373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ef2d4-a138-4d9f-8f10-c2623b4f275d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:36.393897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38639460-df44-4193-b105-df3f53c8fc6a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:36.394774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38639460-df44-4193-b105-df3f53c8fc6a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:36.395220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38639460-df44-4193-b105-df3f53c8fc6a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:36.395709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38639460-df44-4193-b105-df3f53c8fc6a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:36.397709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38639460-df44-4193-b105-df3f53c8fc6a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=0729ef3d5be24f0cb69bcdf3d13ec839)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:36.399762 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-38639460-df44-4193-b105-df3f53c8fc6a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:36.399762 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:52:36.399762 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:52:36.400717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38639460-df44-4193-b105-df3f53c8fc6a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:36.450430 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3767/7540] 10.222.0.27 () {60 vars in 1363 bytes} [Sun Aug 28 18:52:36 2022] PUT /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839 => generated 520 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:36.454792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46494d74-98cc-4723-909c-660c8ddff168 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:36.474477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46494d74-98cc-4723-909c-660c8ddff168 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:36.563801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f197c-b90d-438d-aca8-022d1cccde4c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:36.564453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f197c-b90d-438d-aca8-022d1cccde4c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:36.564711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f197c-b90d-438d-aca8-022d1cccde4c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:36.564992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f197c-b90d-438d-aca8-022d1cccde4c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:36.565735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f197c-b90d-438d-aca8-022d1cccde4c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Adding query filter params (scope.project.id=054efde02752418a9cfb0951281585b4, user.id=fa60bbd2c35241bf8dd101dcc2b5251a) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:36.566051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f197c-b90d-438d-aca8-022d1cccde4c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:36.571293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f197c-b90d-438d-aca8-022d1cccde4c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:36.624265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=4,keystone:SELECT=95,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:36.631642 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3774/7541] 10.222.0.27 () {58 vars in 1356 bytes} [Sun Aug 28 18:52:36 2022] GET /identity/v3/role_assignments?scope.project.id=054efde02752418a9cfb0951281585b4&user.id=fa60bbd2c35241bf8dd101dcc2b5251a&effective => generated 1061 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:36.635085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38639460-df44-4193-b105-df3f53c8fc6a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:36.647141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38639460-df44-4193-b105-df3f53c8fc6a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:36.653497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41c3ac-9080-4378-90cb-dd36f73ffc5f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:36.654371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41c3ac-9080-4378-90cb-dd36f73ffc5f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:36.654829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41c3ac-9080-4378-90cb-dd36f73ffc5f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:36.655297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41c3ac-9080-4378-90cb-dd36f73ffc5f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:36.657324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41c3ac-9080-4378-90cb-dd36f73ffc5f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=0729ef3d5be24f0cb69bcdf3d13ec839)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:36.658702 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-9d41c3ac-9080-4378-90cb-dd36f73ffc5f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:36.658702 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:52:36.658702 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:52:36.660147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41c3ac-9080-4378-90cb-dd36f73ffc5f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:36.673015 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3768/7542] 10.222.0.27 () {58 vars in 1347 bytes} [Sun Aug 28 18:52:36 2022] DELETE /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:36.677254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f197c-b90d-438d-aca8-022d1cccde4c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:36.689193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f197c-b90d-438d-aca8-022d1cccde4c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:36.763957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68ea22-5e7f-4a65-b5dd-3002c4c532e3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:36.764795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68ea22-5e7f-4a65-b5dd-3002c4c532e3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:36.765096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68ea22-5e7f-4a65-b5dd-3002c4c532e3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:36.765399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68ea22-5e7f-4a65-b5dd-3002c4c532e3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:36.766281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68ea22-5e7f-4a65-b5dd-3002c4c532e3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Adding query filter params (scope.project.id=054efde02752418a9cfb0951281585b4, user.id=fa60bbd2c35241bf8dd101dcc2b5251a) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:36.766589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68ea22-5e7f-4a65-b5dd-3002c4c532e3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:36.768852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68ea22-5e7f-4a65-b5dd-3002c4c532e3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:36.839247 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3775/7543] 10.222.0.27 () {58 vars in 1356 bytes} [Sun Aug 28 18:52:36 2022] GET /identity/v3/role_assignments?scope.project.id=054efde02752418a9cfb0951281585b4&user.id=fa60bbd2c35241bf8dd101dcc2b5251a&effective => generated 577 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:36.844207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41c3ac-9080-4378-90cb-dd36f73ffc5f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:36.860155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41c3ac-9080-4378-90cb-dd36f73ffc5f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:36.866747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a5df8-db91-4159-b79e-9aad5f34853d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:36.867471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5df8-db91-4159-b79e-9aad5f34853d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:36.867753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5df8-db91-4159-b79e-9aad5f34853d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:36.868023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5df8-db91-4159-b79e-9aad5f34853d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:36.869720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a5df8-db91-4159-b79e-9aad5f34853d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=0729ef3d5be24f0cb69bcdf3d13ec839)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:36.871876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a5df8-db91-4159-b79e-9aad5f34853d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:36.875187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:36.902463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-7b3a5df8-db91-4159-b79e-9aad5f34853d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] dce83b6d620442be9aa578f2ff592d19 does not imply 0729ef3d5be24f0cb69bcdf3d13ec839.: keystone.exception.ImpliedRoleNotFound: dce83b6d620442be9aa578f2ff592d19 does not imply 0729ef3d5be24f0cb69bcdf3d13ec839. Aug 28 18:52:36.902463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:52:36.902463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 28 18:52:36.902463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = query.one() Aug 28 18:52:36.902463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 28 18:52:36.902463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._iter().one() Aug 28 18:52:36.902463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 28 18:52:36.902463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._only_one_row( Aug 28 18:52:36.902463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 28 18:52:36.902463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 28 18:52:36.902463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 28 18:52:36.902463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:52:36.902463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:52:36.902463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:52:36.902463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:52:36.902463 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:52:36.903988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:52:36.903988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:52:36.903988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:52:36.903988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:52:36.903988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:52:36.903988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:52:36.903988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:52:36.903988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:52:36.903988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:52:36.903988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 28 18:52:36.903988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 28 18:52:36.903988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:52:36.903988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:52:36.903988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 28 18:52:36.903988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 28 18:52:36.903988 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 28 18:52:36.905072 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 28 18:52:36.905072 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 28 18:52:36.905072 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 28 18:52:36.905072 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: dce83b6d620442be9aa578f2ff592d19 does not imply 0729ef3d5be24f0cb69bcdf3d13ec839. Aug 28 18:52:36.905072 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:52:36.905072 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3769/7544] 10.222.0.27 () {58 vars in 1347 bytes} [Sun Aug 28 18:52:36 2022] DELETE /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839 => generated 137 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 18:52:36.908268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68ea22-5e7f-4a65-b5dd-3002c4c532e3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:36.919903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68ea22-5e7f-4a65-b5dd-3002c4c532e3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:36.925465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1331b-0b51-46de-81b9-51b20fa7cc6f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:36.931511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1331b-0b51-46de-81b9-51b20fa7cc6f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:36.931511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1331b-0b51-46de-81b9-51b20fa7cc6f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:36.931511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1331b-0b51-46de-81b9-51b20fa7cc6f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/projects/054efde02752418a9cfb0951281585b4/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/dce83b6d620442be9aa578f2ff592d19` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:36.933398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1331b-0b51-46de-81b9-51b20fa7cc6f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=054efde02752418a9cfb0951281585b4, user_id=fa60bbd2c35241bf8dd101dcc2b5251a, role_id=dce83b6d620442be9aa578f2ff592d19)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:36.936843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1331b-0b51-46de-81b9-51b20fa7cc6f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:36.944285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98c1331b-0b51-46de-81b9-51b20fa7cc6f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invalidating the token cache because role dce83b6d620442be9aa578f2ff592d19 was removed from user fa60bbd2c35241bf8dd101dcc2b5251a on project 054efde02752418a9cfb0951281585b4. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:36.944722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98c1331b-0b51-46de-81b9-51b20fa7cc6f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:36.945579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98c1331b-0b51-46de-81b9-51b20fa7cc6f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:36.970767 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3776/7545] 10.222.0.27 () {58 vars in 1467 bytes} [Sun Aug 28 18:52:36 2022] DELETE /identity/v3/projects/054efde02752418a9cfb0951281585b4/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/dce83b6d620442be9aa578f2ff592d19 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:36.971890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a5df8-db91-4159-b79e-9aad5f34853d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:36.974334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7b3a5df8-db91-4159-b79e-9aad5f34853d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:36.995681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a5df8-db91-4159-b79e-9aad5f34853d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:37.077262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63288f-8d39-4f83-9049-6228879c302a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:37.077917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63288f-8d39-4f83-9049-6228879c302a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:37.078304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63288f-8d39-4f83-9049-6228879c302a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:37.078584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63288f-8d39-4f83-9049-6228879c302a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:37.079366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63288f-8d39-4f83-9049-6228879c302a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:37.081076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63288f-8d39-4f83-9049-6228879c302a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:37.105019 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3770/7546] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:36 2022] POST /identity/v3/roles => generated 272 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:52:37.109172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1331b-0b51-46de-81b9-51b20fa7cc6f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:37.120801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1331b-0b51-46de-81b9-51b20fa7cc6f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:37.139146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57987ba-322d-4438-bc82-5d26ec5771d1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:37.139893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57987ba-322d-4438-bc82-5d26ec5771d1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:37.140185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57987ba-322d-4438-bc82-5d26ec5771d1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:37.140468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57987ba-322d-4438-bc82-5d26ec5771d1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:37.141158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57987ba-322d-4438-bc82-5d26ec5771d1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Adding query filter params (domain_id=8e564fa64daf4f2fb19fc5ec2ed5d014) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:37.141471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57987ba-322d-4438-bc82-5d26ec5771d1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:37.143908 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-a57987ba-322d-4438-bc82-5d26ec5771d1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:37.143908 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:52:37.143908 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:52:37.144824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57987ba-322d-4438-bc82-5d26ec5771d1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:37.161349 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3777/7547] 10.222.0.27 () {58 vars in 1207 bytes} [Sun Aug 28 18:52:37 2022] GET /identity/v3/roles?domain_id=8e564fa64daf4f2fb19fc5ec2ed5d014 => generated 409 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:37.168890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63288f-8d39-4f83-9049-6228879c302a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:37.212525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63288f-8d39-4f83-9049-6228879c302a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:37.217983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a996c-4c20-49e4-a791-1cfb6874e748 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:37.219144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a996c-4c20-49e4-a791-1cfb6874e748 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:37.219619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a996c-4c20-49e4-a791-1cfb6874e748 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:37.220073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a996c-4c20-49e4-a791-1cfb6874e748 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/00584f1a8d3d484e83fd9ea526879c1f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:37.221703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a996c-4c20-49e4-a791-1cfb6874e748 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=00584f1a8d3d484e83fd9ea526879c1f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:37.223877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a996c-4c20-49e4-a791-1cfb6874e748 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:37.291939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d69a996c-4c20-49e4-a791-1cfb6874e748 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invalidating the token cache because role 00584f1a8d3d484e83fd9ea526879c1f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:37.292219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d69a996c-4c20-49e4-a791-1cfb6874e748 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:37.293078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d69a996c-4c20-49e4-a791-1cfb6874e748 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:37.301843 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3771/7548] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:37 2022] DELETE /identity/v3/roles/00584f1a8d3d484e83fd9ea526879c1f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:37.304706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57987ba-322d-4438-bc82-5d26ec5771d1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:37.306952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a57987ba-322d-4438-bc82-5d26ec5771d1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:37.327748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57987ba-322d-4438-bc82-5d26ec5771d1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:37.447664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d7218-b414-45ec-a2de-19b4094ce453 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:37.449276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d7218-b414-45ec-a2de-19b4094ce453 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:37.449276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d7218-b414-45ec-a2de-19b4094ce453 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:37.449276 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d7218-b414-45ec-a2de-19b4094ce453 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:37.450199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d7218-b414-45ec-a2de-19b4094ce453 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Adding query filter params (domain_id=8e564fa64daf4f2fb19fc5ec2ed5d014) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:37.450574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d7218-b414-45ec-a2de-19b4094ce453 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:37.464252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d7218-b414-45ec-a2de-19b4094ce453 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:37.473657 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3778/7549] 10.222.0.27 () {58 vars in 1207 bytes} [Sun Aug 28 18:52:37 2022] GET /identity/v3/roles?domain_id=8e564fa64daf4f2fb19fc5ec2ed5d014 => generated 148 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:37.477817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a996c-4c20-49e4-a791-1cfb6874e748 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:37.493040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a996c-4c20-49e4-a791-1cfb6874e748 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:37.499303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46641659-88c2-4da0-a098-b08ffc9e2b66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:37.500180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46641659-88c2-4da0-a098-b08ffc9e2b66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:37.500543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46641659-88c2-4da0-a098-b08ffc9e2b66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:37.500912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46641659-88c2-4da0-a098-b08ffc9e2b66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/00584f1a8d3d484e83fd9ea526879c1f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:37.515121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46641659-88c2-4da0-a098-b08ffc9e2b66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:52:37.520955 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-46641659-88c2-4da0-a098-b08ffc9e2b66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Could not find role: 00584f1a8d3d484e83fd9ea526879c1f.: keystone.exception.RoleNotFound: Could not find role: 00584f1a8d3d484e83fd9ea526879c1f. Aug 28 18:52:37.520955 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:52:37.520955 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:52:37.520955 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:52:37.520955 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:52:37.520955 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:52:37.520955 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:52:37.520955 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:52:37.520955 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:52:37.520955 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:52:37.520955 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:52:37.520955 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:52:37.520955 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Aug 28 18:52:37.520955 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Aug 28 18:52:37.522300 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:52:37.522300 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:52:37.522300 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:52:37.522300 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:52:37.522300 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:52:37.522300 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:52:37.522300 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:52:37.522300 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:52:37.522300 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:52:37.522300 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:52:37.522300 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:52:37.522300 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:52:37.522300 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:52:37.522300 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:52:37.522300 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:52:37.522300 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:52:37.523684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:52:37.523684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:52:37.523684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:52:37.523684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:52:37.523684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:52:37.523684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:52:37.523684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:52:37.523684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:52:37.523684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:52:37.523684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:52:37.523684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 00584f1a8d3d484e83fd9ea526879c1f. Aug 28 18:52:37.523684 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:52:37.530074 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3772/7550] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:37 2022] DELETE /identity/v3/roles/00584f1a8d3d484e83fd9ea526879c1f => generated 110 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:52:37.530836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d7218-b414-45ec-a2de-19b4094ce453 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:37.544414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d7218-b414-45ec-a2de-19b4094ce453 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:37.550936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572ce83-efe0-4e7b-9a6a-cdf3e499ba46 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:37.551700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572ce83-efe0-4e7b-9a6a-cdf3e499ba46 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:37.551982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572ce83-efe0-4e7b-9a6a-cdf3e499ba46 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:37.552260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572ce83-efe0-4e7b-9a6a-cdf3e499ba46 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:37.606379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572ce83-efe0-4e7b-9a6a-cdf3e499ba46 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8e564fa64daf4f2fb19fc5ec2ed5d014, group_id=331fe4ca2e29421b99e6e74a3a06411f, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:37.612893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572ce83-efe0-4e7b-9a6a-cdf3e499ba46 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:37.652436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46641659-88c2-4da0-a098-b08ffc9e2b66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:37.652949 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3779/7551] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:37 2022] PUT /identity/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:37.663972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46641659-88c2-4da0-a098-b08ffc9e2b66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:37.779988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385750c-af45-4143-88b6-e61edd22525b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:37.780677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385750c-af45-4143-88b6-e61edd22525b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:37.780975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385750c-af45-4143-88b6-e61edd22525b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:37.781255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385750c-af45-4143-88b6-e61edd22525b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014/groups/331fe4ca2e29421b99e6e74a3a06411f/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:37.794582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385750c-af45-4143-88b6-e61edd22525b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=8e564fa64daf4f2fb19fc5ec2ed5d014, group_id=331fe4ca2e29421b99e6e74a3a06411f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:37.800913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385750c-af45-4143-88b6-e61edd22525b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:37.823429 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3773/7552] 10.222.0.27 () {58 vars in 1365 bytes} [Sun Aug 28 18:52:37 2022] GET /identity/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014/groups/331fe4ca2e29421b99e6e74a3a06411f/roles => generated 410 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:37.825799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572ce83-efe0-4e7b-9a6a-cdf3e499ba46 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:37.841701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572ce83-efe0-4e7b-9a6a-cdf3e499ba46 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:37.854494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d136b6-52ac-4622-901b-b50194b27b14 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:37.854494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d136b6-52ac-4622-901b-b50194b27b14 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:37.854494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d136b6-52ac-4622-901b-b50194b27b14 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:37.854943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d136b6-52ac-4622-901b-b50194b27b14 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:37.860464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d136b6-52ac-4622-901b-b50194b27b14 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=8e564fa64daf4f2fb19fc5ec2ed5d014, group_id=331fe4ca2e29421b99e6e74a3a06411f, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:37.872824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d136b6-52ac-4622-901b-b50194b27b14 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:37.888642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:37.893994 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3780/7553] 10.222.0.27 () {58 vars in 1465 bytes} [Sun Aug 28 18:52:37 2022] HEAD /identity/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:37.902022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385750c-af45-4143-88b6-e61edd22525b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:37.918800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385750c-af45-4143-88b6-e61edd22525b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:37.932392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c806fb-fc7f-46c1-94b5-07319a7b499c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:37.933095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c806fb-fc7f-46c1-94b5-07319a7b499c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:37.933376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c806fb-fc7f-46c1-94b5-07319a7b499c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:37.933654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c806fb-fc7f-46c1-94b5-07319a7b499c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:37.941676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c806fb-fc7f-46c1-94b5-07319a7b499c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8e564fa64daf4f2fb19fc5ec2ed5d014, group_id=331fe4ca2e29421b99e6e74a3a06411f, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:37.944620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c806fb-fc7f-46c1-94b5-07319a7b499c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:37.958209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9c806fb-fc7f-46c1-94b5-07319a7b499c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invalidating the token cache because role d9e4c527d1574bf3b6dc32da701b4c39 was removed from group 331fe4ca2e29421b99e6e74a3a06411f on domain 8e564fa64daf4f2fb19fc5ec2ed5d014. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:37.959227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9c806fb-fc7f-46c1-94b5-07319a7b499c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:37.960317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9c806fb-fc7f-46c1-94b5-07319a7b499c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:37.996373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d136b6-52ac-4622-901b-b50194b27b14 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:37.996822 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3774/7554] 10.222.0.27 () {58 vars in 1467 bytes} [Sun Aug 28 18:52:37 2022] DELETE /identity/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:37.999034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a3d136b6-52ac-4622-901b-b50194b27b14 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:38.035312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d136b6-52ac-4622-901b-b50194b27b14 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:38.153178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029123d-6441-4702-9966-c81b6dcf764b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:38.153881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029123d-6441-4702-9966-c81b6dcf764b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:38.154169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029123d-6441-4702-9966-c81b6dcf764b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:38.154455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029123d-6441-4702-9966-c81b6dcf764b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/projects/054efde02752418a9cfb0951281585b4/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:38.156961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029123d-6441-4702-9966-c81b6dcf764b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_grant(project_id=054efde02752418a9cfb0951281585b4, group_id=331fe4ca2e29421b99e6e74a3a06411f, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:38.160201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029123d-6441-4702-9966-c81b6dcf764b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:38.186356 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3781/7555] 10.222.0.27 () {60 vars in 1486 bytes} [Sun Aug 28 18:52:37 2022] PUT /identity/v3/projects/054efde02752418a9cfb0951281585b4/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:38.190785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c806fb-fc7f-46c1-94b5-07319a7b499c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:38.207306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c806fb-fc7f-46c1-94b5-07319a7b499c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:38.225659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:38.321487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed47b5-a612-43c3-8465-4c2064f6ff50 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:38.322229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed47b5-a612-43c3-8465-4c2064f6ff50 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:38.322515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed47b5-a612-43c3-8465-4c2064f6ff50 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:38.322791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed47b5-a612-43c3-8465-4c2064f6ff50 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/projects/054efde02752418a9cfb0951281585b4/groups/331fe4ca2e29421b99e6e74a3a06411f/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:38.325749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed47b5-a612-43c3-8465-4c2064f6ff50 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:list_grants(project_id=054efde02752418a9cfb0951281585b4, group_id=331fe4ca2e29421b99e6e74a3a06411f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:38.329136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed47b5-a612-43c3-8465-4c2064f6ff50 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:38.349290 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3775/7556] 10.222.0.27 () {58 vars in 1368 bytes} [Sun Aug 28 18:52:38 2022] GET /identity/v3/projects/054efde02752418a9cfb0951281585b4/groups/331fe4ca2e29421b99e6e74a3a06411f/roles => generated 411 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:38.353263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029123d-6441-4702-9966-c81b6dcf764b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:38.364953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029123d-6441-4702-9966-c81b6dcf764b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:38.370819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c72c9f-8d36-4ba5-8451-49896cc5f710 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:38.372364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c72c9f-8d36-4ba5-8451-49896cc5f710 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:38.372886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c72c9f-8d36-4ba5-8451-49896cc5f710 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:38.373375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c72c9f-8d36-4ba5-8451-49896cc5f710 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/groups/331fe4ca2e29421b99e6e74a3a06411f/users/fa60bbd2c35241bf8dd101dcc2b5251a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:38.375469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c72c9f-8d36-4ba5-8451-49896cc5f710 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=331fe4ca2e29421b99e6e74a3a06411f, user_id=fa60bbd2c35241bf8dd101dcc2b5251a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:38.378050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c72c9f-8d36-4ba5-8451-49896cc5f710 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:38.423533 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3782/7557] 10.222.0.27 () {60 vars in 1360 bytes} [Sun Aug 28 18:52:38 2022] PUT /identity/v3/groups/331fe4ca2e29421b99e6e74a3a06411f/users/fa60bbd2c35241bf8dd101dcc2b5251a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:38.427743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e048909-6381-4416-87b4-f00dc2e9b6cc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:38.428338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e048909-6381-4416-87b4-f00dc2e9b6cc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:38.428835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e048909-6381-4416-87b4-f00dc2e9b6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:38.500328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9e048909-6381-4416-87b4-f00dc2e9b6cc None None] MFA Rules not processed for user `fa60bbd2c35241bf8dd101dcc2b5251a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:38.501750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e048909-6381-4416-87b4-f00dc2e9b6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:38.719710 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3776/7558] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:38 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:38.722247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c72c9f-8d36-4ba5-8451-49896cc5f710 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:38.827703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c72c9f-8d36-4ba5-8451-49896cc5f710 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:38.833718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddfe7e-7ead-406a-80a1-63da61da4854 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:38.834777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddfe7e-7ead-406a-80a1-63da61da4854 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:38.835288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddfe7e-7ead-406a-80a1-63da61da4854 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:38.835850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddfe7e-7ead-406a-80a1-63da61da4854 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/projects/054efde02752418a9cfb0951281585b4/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:38.839098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddfe7e-7ead-406a-80a1-63da61da4854 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:check_grant(project_id=054efde02752418a9cfb0951281585b4, group_id=331fe4ca2e29421b99e6e74a3a06411f, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:38.842152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddfe7e-7ead-406a-80a1-63da61da4854 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:38.849368 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3783/7559] 10.222.0.27 () {58 vars in 1468 bytes} [Sun Aug 28 18:52:38 2022] HEAD /identity/v3/projects/054efde02752418a9cfb0951281585b4/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:38.853382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e048909-6381-4416-87b4-f00dc2e9b6cc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:38.868942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e048909-6381-4416-87b4-f00dc2e9b6cc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:38.878767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c629884-3486-45cb-85b0-178b799a2415 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:38.879421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c629884-3486-45cb-85b0-178b799a2415 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:38.879711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c629884-3486-45cb-85b0-178b799a2415 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:38.879996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c629884-3486-45cb-85b0-178b799a2415 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/projects/054efde02752418a9cfb0951281585b4/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:38.886865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c629884-3486-45cb-85b0-178b799a2415 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=054efde02752418a9cfb0951281585b4, group_id=331fe4ca2e29421b99e6e74a3a06411f, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:38.890639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c629884-3486-45cb-85b0-178b799a2415 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:38.907109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c629884-3486-45cb-85b0-178b799a2415 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invalidating the token cache because role d9e4c527d1574bf3b6dc32da701b4c39 was removed from group 331fe4ca2e29421b99e6e74a3a06411f on project 054efde02752418a9cfb0951281585b4. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:38.907485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c629884-3486-45cb-85b0-178b799a2415 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:38.908248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c629884-3486-45cb-85b0-178b799a2415 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:38.934346 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3777/7560] 10.222.0.27 () {58 vars in 1470 bytes} [Sun Aug 28 18:52:38 2022] DELETE /identity/v3/projects/054efde02752418a9cfb0951281585b4/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:38.939010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddfe7e-7ead-406a-80a1-63da61da4854 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:38.940886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a0ddfe7e-7ead-406a-80a1-63da61da4854 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:38.962240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddfe7e-7ead-406a-80a1-63da61da4854 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:39.079911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32216d-e2e4-45d0-894d-20217adb30ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:39.080717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32216d-e2e4-45d0-894d-20217adb30ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:39.081016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32216d-e2e4-45d0-894d-20217adb30ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:39.081428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32216d-e2e4-45d0-894d-20217adb30ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/groups/331fe4ca2e29421b99e6e74a3a06411f/users/fa60bbd2c35241bf8dd101dcc2b5251a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:39.083472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32216d-e2e4-45d0-894d-20217adb30ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=331fe4ca2e29421b99e6e74a3a06411f, user_id=fa60bbd2c35241bf8dd101dcc2b5251a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:39.086797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32216d-e2e4-45d0-894d-20217adb30ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:39.100440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d32216d-e2e4-45d0-894d-20217adb30ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fa60bbd2c35241bf8dd101dcc2b5251a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.107073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:39.122857 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3784/7561] 10.222.0.27 () {58 vars in 1344 bytes} [Sun Aug 28 18:52:38 2022] DELETE /identity/v3/groups/331fe4ca2e29421b99e6e74a3a06411f/users/fa60bbd2c35241bf8dd101dcc2b5251a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:39.128646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c629884-3486-45cb-85b0-178b799a2415 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:39.151611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c629884-3486-45cb-85b0-178b799a2415 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:39.216099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:39.243938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d964e4-d5c6-48c2-b7ba-9d5e725a567f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:39.244817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d964e4-d5c6-48c2-b7ba-9d5e725a567f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:39.245107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d964e4-d5c6-48c2-b7ba-9d5e725a567f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:39.245379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d964e4-d5c6-48c2-b7ba-9d5e725a567f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/system/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:39.247503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d964e4-d5c6-48c2-b7ba-9d5e725a567f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=331fe4ca2e29421b99e6e74a3a06411f, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:39.249118 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-e4d964e4-d5c6-48c2-b7ba-9d5e725a567f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:39.249118 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:52:39.249118 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:52:39.250103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d964e4-d5c6-48c2-b7ba-9d5e725a567f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:39.261986 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3778/7562] 10.222.0.27 () {60 vars in 1381 bytes} [Sun Aug 28 18:52:39 2022] PUT /identity/v3/system/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:39.266036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32216d-e2e4-45d0-894d-20217adb30ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:39.284053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32216d-e2e4-45d0-894d-20217adb30ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:39.297532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7eee0-cfce-4794-bf97-474e7a7d40c2 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:39.298277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7eee0-cfce-4794-bf97-474e7a7d40c2 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:39.298665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7eee0-cfce-4794-bf97-474e7a7d40c2 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:39.301463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7eee0-cfce-4794-bf97-474e7a7d40c2 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/system/groups/331fe4ca2e29421b99e6e74a3a06411f/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:39.301463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7eee0-cfce-4794-bf97-474e7a7d40c2 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=331fe4ca2e29421b99e6e74a3a06411f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:39.301869 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-7be7eee0-cfce-4794-bf97-474e7a7d40c2 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:39.301869 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:52:39.301869 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:52:39.303314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7eee0-cfce-4794-bf97-474e7a7d40c2 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:39.340676 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3785/7563] 10.222.0.27 () {58 vars in 1263 bytes} [Sun Aug 28 18:52:39 2022] GET /identity/v3/system/groups/331fe4ca2e29421b99e6e74a3a06411f/roles => generated 376 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:39.344927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d964e4-d5c6-48c2-b7ba-9d5e725a567f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:39.359915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d964e4-d5c6-48c2-b7ba-9d5e725a567f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:39.366505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e2de1-831f-4f6a-b31a-c1953a90a48b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:39.367786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e2de1-831f-4f6a-b31a-c1953a90a48b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:39.368170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e2de1-831f-4f6a-b31a-c1953a90a48b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:39.376056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e2de1-831f-4f6a-b31a-c1953a90a48b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/system/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:39.386122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e2de1-831f-4f6a-b31a-c1953a90a48b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=331fe4ca2e29421b99e6e74a3a06411f, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:39.387570 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-684e2de1-831f-4f6a-b31a-c1953a90a48b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:39.387570 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:52:39.387570 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:52:39.389197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e2de1-831f-4f6a-b31a-c1953a90a48b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:39.404658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7eee0-cfce-4794-bf97-474e7a7d40c2 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:39.406458 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3779/7564] 10.222.0.27 () {58 vars in 1363 bytes} [Sun Aug 28 18:52:39 2022] HEAD /identity/v3/system/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:39.421896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7eee0-cfce-4794-bf97-474e7a7d40c2 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:39.433558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ee6d5-8734-4885-8d54-225a42c88e83 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:39.435204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ee6d5-8734-4885-8d54-225a42c88e83 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:39.436688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ee6d5-8734-4885-8d54-225a42c88e83 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:39.437088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ee6d5-8734-4885-8d54-225a42c88e83 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/system/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:39.439830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ee6d5-8734-4885-8d54-225a42c88e83 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=331fe4ca2e29421b99e6e74a3a06411f, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:39.440964 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-ce4ee6d5-8734-4885-8d54-225a42c88e83 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:39.440964 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:52:39.440964 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:52:39.441960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ee6d5-8734-4885-8d54-225a42c88e83 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:39.466575 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3786/7565] 10.222.0.27 () {58 vars in 1365 bytes} [Sun Aug 28 18:52:39 2022] DELETE /identity/v3/system/groups/331fe4ca2e29421b99e6e74a3a06411f/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:39.468041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e2de1-831f-4f6a-b31a-c1953a90a48b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:39.485181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e2de1-831f-4f6a-b31a-c1953a90a48b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:39.501477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11264a6f-ef1e-457d-87e3-2439d8c73d96 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:39.501752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11264a6f-ef1e-457d-87e3-2439d8c73d96 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:39.501850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11264a6f-ef1e-457d-87e3-2439d8c73d96 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:39.502122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11264a6f-ef1e-457d-87e3-2439d8c73d96 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:39.508624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11264a6f-ef1e-457d-87e3-2439d8c73d96 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8e564fa64daf4f2fb19fc5ec2ed5d014, user_id=fa60bbd2c35241bf8dd101dcc2b5251a, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:39.511709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11264a6f-ef1e-457d-87e3-2439d8c73d96 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:39.547620 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3780/7566] 10.222.0.27 () {60 vars in 1480 bytes} [Sun Aug 28 18:52:39 2022] PUT /identity/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:39.552581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ee6d5-8734-4885-8d54-225a42c88e83 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:39.589757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ee6d5-8734-4885-8d54-225a42c88e83 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:39.695093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02d09a-4e9e-489e-9843-6b7ea22e5bb4 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:39.699582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02d09a-4e9e-489e-9843-6b7ea22e5bb4 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:39.699988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02d09a-4e9e-489e-9843-6b7ea22e5bb4 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:39.700637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02d09a-4e9e-489e-9843-6b7ea22e5bb4 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:39.711434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02d09a-4e9e-489e-9843-6b7ea22e5bb4 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=8e564fa64daf4f2fb19fc5ec2ed5d014, user_id=fa60bbd2c35241bf8dd101dcc2b5251a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:39.723093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02d09a-4e9e-489e-9843-6b7ea22e5bb4 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:39.753584 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3787/7567] 10.222.0.27 () {58 vars in 1362 bytes} [Sun Aug 28 18:52:39 2022] GET /identity/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles => generated 409 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:39.762263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11264a6f-ef1e-457d-87e3-2439d8c73d96 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:39.786540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11264a6f-ef1e-457d-87e3-2439d8c73d96 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:39.806728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f6b1f-4d68-421d-a7fb-f5ca49c43879 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:39.807766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f6b1f-4d68-421d-a7fb-f5ca49c43879 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:39.808524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f6b1f-4d68-421d-a7fb-f5ca49c43879 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:39.808978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f6b1f-4d68-421d-a7fb-f5ca49c43879 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:39.817535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f6b1f-4d68-421d-a7fb-f5ca49c43879 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=8e564fa64daf4f2fb19fc5ec2ed5d014, user_id=fa60bbd2c35241bf8dd101dcc2b5251a, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:39.826983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f6b1f-4d68-421d-a7fb-f5ca49c43879 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:39.845196 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3781/7568] 10.222.0.27 () {58 vars in 1462 bytes} [Sun Aug 28 18:52:39 2022] HEAD /identity/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:39.849975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02d09a-4e9e-489e-9843-6b7ea22e5bb4 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:39.880517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02d09a-4e9e-489e-9843-6b7ea22e5bb4 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:39.918815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab2886-8ff7-4ff5-9133-d98119420bfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:39.920063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab2886-8ff7-4ff5-9133-d98119420bfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:39.920995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab2886-8ff7-4ff5-9133-d98119420bfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:39.922057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab2886-8ff7-4ff5-9133-d98119420bfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:39.929958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab2886-8ff7-4ff5-9133-d98119420bfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8e564fa64daf4f2fb19fc5ec2ed5d014, user_id=fa60bbd2c35241bf8dd101dcc2b5251a, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:39.937177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab2886-8ff7-4ff5-9133-d98119420bfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:39.948647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09ab2886-8ff7-4ff5-9133-d98119420bfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invalidating the token cache because role d9e4c527d1574bf3b6dc32da701b4c39 was removed from user fa60bbd2c35241bf8dd101dcc2b5251a on domain 8e564fa64daf4f2fb19fc5ec2ed5d014. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:39.949017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09ab2886-8ff7-4ff5-9133-d98119420bfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.949874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09ab2886-8ff7-4ff5-9133-d98119420bfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.971932 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3788/7569] 10.222.0.27 () {58 vars in 1464 bytes} [Sun Aug 28 18:52:39 2022] DELETE /identity/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:39.977176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f6b1f-4d68-421d-a7fb-f5ca49c43879 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:39.979202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-979f6b1f-4d68-421d-a7fb-f5ca49c43879 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:40.020346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f6b1f-4d68-421d-a7fb-f5ca49c43879 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:40.242983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb96f9-fb11-423d-97bc-b2168d6fd92e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:40.244473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb96f9-fb11-423d-97bc-b2168d6fd92e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:40.251045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb96f9-fb11-423d-97bc-b2168d6fd92e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:40.251764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb96f9-fb11-423d-97bc-b2168d6fd92e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/projects/054efde02752418a9cfb0951281585b4/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:40.257184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb96f9-fb11-423d-97bc-b2168d6fd92e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_grant(project_id=054efde02752418a9cfb0951281585b4, user_id=fa60bbd2c35241bf8dd101dcc2b5251a, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:40.278142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb96f9-fb11-423d-97bc-b2168d6fd92e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:40.321916 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3782/7570] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:39 2022] PUT /identity/v3/projects/054efde02752418a9cfb0951281585b4/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:40.326761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab2886-8ff7-4ff5-9133-d98119420bfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:40.343596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab2886-8ff7-4ff5-9133-d98119420bfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:40.443074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36adb2b-4f32-43f5-8547-38d72a02e924 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:40.444021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36adb2b-4f32-43f5-8547-38d72a02e924 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:40.444428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36adb2b-4f32-43f5-8547-38d72a02e924 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:40.444847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36adb2b-4f32-43f5-8547-38d72a02e924 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/projects/054efde02752418a9cfb0951281585b4/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:40.447920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36adb2b-4f32-43f5-8547-38d72a02e924 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:list_grants(project_id=054efde02752418a9cfb0951281585b4, user_id=fa60bbd2c35241bf8dd101dcc2b5251a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:40.450721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36adb2b-4f32-43f5-8547-38d72a02e924 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:40.466376 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3789/7571] 10.222.0.27 () {58 vars in 1365 bytes} [Sun Aug 28 18:52:40 2022] GET /identity/v3/projects/054efde02752418a9cfb0951281585b4/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles => generated 410 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:40.470836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb96f9-fb11-423d-97bc-b2168d6fd92e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:40.483790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb96f9-fb11-423d-97bc-b2168d6fd92e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:40.492950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c22dd-b2e4-41de-abc4-0c5e0d67774b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:40.494136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c22dd-b2e4-41de-abc4-0c5e0d67774b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:40.494481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c22dd-b2e4-41de-abc4-0c5e0d67774b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:40.494888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c22dd-b2e4-41de-abc4-0c5e0d67774b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/projects/054efde02752418a9cfb0951281585b4/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:40.497515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c22dd-b2e4-41de-abc4-0c5e0d67774b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:check_grant(project_id=054efde02752418a9cfb0951281585b4, user_id=fa60bbd2c35241bf8dd101dcc2b5251a, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:40.501176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c22dd-b2e4-41de-abc4-0c5e0d67774b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:40.508634 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3783/7572] 10.222.0.27 () {58 vars in 1465 bytes} [Sun Aug 28 18:52:40 2022] HEAD /identity/v3/projects/054efde02752418a9cfb0951281585b4/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:40.513244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36adb2b-4f32-43f5-8547-38d72a02e924 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:40.526244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36adb2b-4f32-43f5-8547-38d72a02e924 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:40.534063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a7c1f-658a-4365-9ebd-c47dfd5a992a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:40.534807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a7c1f-658a-4365-9ebd-c47dfd5a992a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:40.535146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a7c1f-658a-4365-9ebd-c47dfd5a992a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:40.535502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a7c1f-658a-4365-9ebd-c47dfd5a992a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/projects/054efde02752418a9cfb0951281585b4/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:40.539068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a7c1f-658a-4365-9ebd-c47dfd5a992a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=054efde02752418a9cfb0951281585b4, user_id=fa60bbd2c35241bf8dd101dcc2b5251a, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:40.544977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a7c1f-658a-4365-9ebd-c47dfd5a992a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:40.554812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-090a7c1f-658a-4365-9ebd-c47dfd5a992a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invalidating the token cache because role d9e4c527d1574bf3b6dc32da701b4c39 was removed from user fa60bbd2c35241bf8dd101dcc2b5251a on project 054efde02752418a9cfb0951281585b4. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:40.555652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-090a7c1f-658a-4365-9ebd-c47dfd5a992a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.556847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-090a7c1f-658a-4365-9ebd-c47dfd5a992a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.586676 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3790/7573] 10.222.0.27 () {58 vars in 1467 bytes} [Sun Aug 28 18:52:40 2022] DELETE /identity/v3/projects/054efde02752418a9cfb0951281585b4/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:40.592233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c22dd-b2e4-41de-abc4-0c5e0d67774b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:40.594579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a54c22dd-b2e4-41de-abc4-0c5e0d67774b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:40.612750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c22dd-b2e4-41de-abc4-0c5e0d67774b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:40.697695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f2177-12b6-4d36-b403-6d77149ee19f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:40.698525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f2177-12b6-4d36-b403-6d77149ee19f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:40.699304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f2177-12b6-4d36-b403-6d77149ee19f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:40.699304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f2177-12b6-4d36-b403-6d77149ee19f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/system/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:40.701556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f2177-12b6-4d36-b403-6d77149ee19f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fa60bbd2c35241bf8dd101dcc2b5251a, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:40.702307 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-f41f2177-12b6-4d36-b403-6d77149ee19f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:40.702307 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:52:40.702307 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:52:40.703548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f2177-12b6-4d36-b403-6d77149ee19f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:40.712503 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3784/7574] 10.222.0.27 () {60 vars in 1378 bytes} [Sun Aug 28 18:52:40 2022] PUT /identity/v3/system/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:40.716960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a7c1f-658a-4365-9ebd-c47dfd5a992a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:40.733258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a7c1f-658a-4365-9ebd-c47dfd5a992a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:40.743191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f053901-6ac6-4c0f-bf18-d30dc755ad25 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:40.744444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f053901-6ac6-4c0f-bf18-d30dc755ad25 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:40.744967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f053901-6ac6-4c0f-bf18-d30dc755ad25 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:40.745335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f053901-6ac6-4c0f-bf18-d30dc755ad25 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/system/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:40.746721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f053901-6ac6-4c0f-bf18-d30dc755ad25 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=fa60bbd2c35241bf8dd101dcc2b5251a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:40.748780 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-3f053901-6ac6-4c0f-bf18-d30dc755ad25 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:40.748780 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:52:40.748780 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:52:40.750964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f053901-6ac6-4c0f-bf18-d30dc755ad25 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:40.776383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f2177-12b6-4d36-b403-6d77149ee19f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:40.791130 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3791/7575] 10.222.0.27 () {58 vars in 1260 bytes} [Sun Aug 28 18:52:40 2022] GET /identity/v3/system/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles => generated 375 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:40.793995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f2177-12b6-4d36-b403-6d77149ee19f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:40.800107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92222532-2c9d-452a-9e43-a1e3f87aedc5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:40.800884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92222532-2c9d-452a-9e43-a1e3f87aedc5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:40.801807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92222532-2c9d-452a-9e43-a1e3f87aedc5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:40.802178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92222532-2c9d-452a-9e43-a1e3f87aedc5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/system/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:40.804842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92222532-2c9d-452a-9e43-a1e3f87aedc5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=fa60bbd2c35241bf8dd101dcc2b5251a, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:40.806351 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-92222532-2c9d-452a-9e43-a1e3f87aedc5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:40.806351 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:52:40.806351 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:52:40.807613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92222532-2c9d-452a-9e43-a1e3f87aedc5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:40.829339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f053901-6ac6-4c0f-bf18-d30dc755ad25 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:40.829562 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3785/7576] 10.222.0.27 () {58 vars in 1360 bytes} [Sun Aug 28 18:52:40 2022] HEAD /identity/v3/system/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:40.836745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:40.842197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f053901-6ac6-4c0f-bf18-d30dc755ad25 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:40.860194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67999a00-a083-4ef4-879a-c84f759a7343 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:40.861987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67999a00-a083-4ef4-879a-c84f759a7343 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:40.862641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67999a00-a083-4ef4-879a-c84f759a7343 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:40.863594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67999a00-a083-4ef4-879a-c84f759a7343 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/system/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:40.866316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67999a00-a083-4ef4-879a-c84f759a7343 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=fa60bbd2c35241bf8dd101dcc2b5251a, role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:40.868294 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-67999a00-a083-4ef4-879a-c84f759a7343 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:40.868294 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:52:40.868294 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:52:40.869693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67999a00-a083-4ef4-879a-c84f759a7343 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:40.888213 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3792/7577] 10.222.0.27 () {58 vars in 1362 bytes} [Sun Aug 28 18:52:40 2022] DELETE /identity/v3/system/users/fa60bbd2c35241bf8dd101dcc2b5251a/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:40.893733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92222532-2c9d-452a-9e43-a1e3f87aedc5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:40.910550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67999a00-a083-4ef4-879a-c84f759a7343 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:40.914813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-67999a00-a083-4ef4-879a-c84f759a7343 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:40.922171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92222532-2c9d-452a-9e43-a1e3f87aedc5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:40.945065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29f8aa-bed4-42b3-a036-06885f17585c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:40.947461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29f8aa-bed4-42b3-a036-06885f17585c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:40.948337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29f8aa-bed4-42b3-a036-06885f17585c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:40.948568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29f8aa-bed4-42b3-a036-06885f17585c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:40.949292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29f8aa-bed4-42b3-a036-06885f17585c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:40.955610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29f8aa-bed4-42b3-a036-06885f17585c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:41.056388 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3786/7578] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:52:40 2022] POST /identity/v3/roles => generated 270 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:41.059686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29f8aa-bed4-42b3-a036-06885f17585c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:41.094309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29f8aa-bed4-42b3-a036-06885f17585c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:41.107499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b0152-50c9-4f83-8411-641bb7931acf tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:41.108876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b0152-50c9-4f83-8411-641bb7931acf tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:41.110013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b0152-50c9-4f83-8411-641bb7931acf tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:41.111440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b0152-50c9-4f83-8411-641bb7931acf tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:41.112872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b0152-50c9-4f83-8411-641bb7931acf tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:41.138116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b0152-50c9-4f83-8411-641bb7931acf tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:41.165470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:41.220519 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3787/7579] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:52:41 2022] POST /identity/v3/roles => generated 270 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:41.225423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b0152-50c9-4f83-8411-641bb7931acf tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:41.274843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b0152-50c9-4f83-8411-641bb7931acf tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:41.276364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67999a00-a083-4ef4-879a-c84f759a7343 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:41.292302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1325e8-0106-412f-890a-21236fc88d47 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:41.293940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1325e8-0106-412f-890a-21236fc88d47 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:41.294370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240392d6-7bc2-4e0a-8ea9-a5945535851f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:41.295701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240392d6-7bc2-4e0a-8ea9-a5945535851f service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:41.296025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1325e8-0106-412f-890a-21236fc88d47 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:41.296486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1325e8-0106-412f-890a-21236fc88d47 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/d4fffbc1d5384fca8fb012ac140653fb/implies/6c288f024f524691999779adb5b06e32` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:41.296940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240392d6-7bc2-4e0a-8ea9-a5945535851f service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:41.298407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240392d6-7bc2-4e0a-8ea9-a5945535851f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:41.302409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1325e8-0106-412f-890a-21236fc88d47 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=d4fffbc1d5384fca8fb012ac140653fb, implied_role_id=6c288f024f524691999779adb5b06e32)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:41.304419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-240392d6-7bc2-4e0a-8ea9-a5945535851f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:41.306340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1325e8-0106-412f-890a-21236fc88d47 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:41.346995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240392d6-7bc2-4e0a-8ea9-a5945535851f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:41.348892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240392d6-7bc2-4e0a-8ea9-a5945535851f service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:41.390080 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3788/7580] 10.222.0.27 () {60 vars in 1363 bytes} [Sun Aug 28 18:52:41 2022] PUT /identity/v3/roles/d4fffbc1d5384fca8fb012ac140653fb/implies/6c288f024f524691999779adb5b06e32 => generated 531 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:41.392096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1325e8-0106-412f-890a-21236fc88d47 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:41.413731 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3793/7581] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:41.561917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1325e8-0106-412f-890a-21236fc88d47 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:41.569518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4341f00-f3ad-4d21-9200-fa345b54639f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:41.570638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4341f00-f3ad-4d21-9200-fa345b54639f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:41.571135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4341f00-f3ad-4d21-9200-fa345b54639f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:41.571757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4341f00-f3ad-4d21-9200-fa345b54639f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:41.572651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4341f00-f3ad-4d21-9200-fa345b54639f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:41.574563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4341f00-f3ad-4d21-9200-fa345b54639f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:41.625151 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3789/7582] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Aug 28 18:52:41 2022] POST /identity/v3/domains => generated 277 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:41.630911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240392d6-7bc2-4e0a-8ea9-a5945535851f service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:41.660212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240392d6-7bc2-4e0a-8ea9-a5945535851f service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:41.819561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d903c8-a2b0-4a08-bfe4-9d1d7d633504 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:41.820189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d903c8-a2b0-4a08-bfe4-9d1d7d633504 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:41.820476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d903c8-a2b0-4a08-bfe4-9d1d7d633504 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:41.826294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d903c8-a2b0-4a08-bfe4-9d1d7d633504 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:41.827287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d903c8-a2b0-4a08-bfe4-9d1d7d633504 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:41.830160 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-f0d903c8-a2b0-4a08-bfe4-9d1d7d633504 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:41.830160 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:52:41.830160 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:52:41.835886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d903c8-a2b0-4a08-bfe4-9d1d7d633504 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:41.901262 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3794/7583] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:52:41 2022] POST /identity/v3/roles => generated 269 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:41.908985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4341f00-f3ad-4d21-9200-fa345b54639f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:41.921975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4341f00-f3ad-4d21-9200-fa345b54639f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:41.927049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550ebe8-1086-4cc2-9a36-4e1107457f77 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:41.927826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550ebe8-1086-4cc2-9a36-4e1107457f77 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:41.928062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550ebe8-1086-4cc2-9a36-4e1107457f77 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:41.928568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550ebe8-1086-4cc2-9a36-4e1107457f77 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/d4fffbc1d5384fca8fb012ac140653fb/implies/3979c1bab6954ba5a110baf1b25b19e6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:41.930317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550ebe8-1086-4cc2-9a36-4e1107457f77 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=d4fffbc1d5384fca8fb012ac140653fb, implied_role_id=3979c1bab6954ba5a110baf1b25b19e6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:41.932257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550ebe8-1086-4cc2-9a36-4e1107457f77 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:41.967293 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3790/7584] 10.222.0.27 () {60 vars in 1363 bytes} [Sun Aug 28 18:52:41 2022] PUT /identity/v3/roles/d4fffbc1d5384fca8fb012ac140653fb/implies/3979c1bab6954ba5a110baf1b25b19e6 => generated 530 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:41.968195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d903c8-a2b0-4a08-bfe4-9d1d7d633504 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:41.986872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d903c8-a2b0-4a08-bfe4-9d1d7d633504 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:42.171175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a10621-0dfe-44e6-8d56-3172e41c47c7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:42.172249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a10621-0dfe-44e6-8d56-3172e41c47c7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:42.172747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a10621-0dfe-44e6-8d56-3172e41c47c7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:42.173236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a10621-0dfe-44e6-8d56-3172e41c47c7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/d4fffbc1d5384fca8fb012ac140653fb/implies/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:42.179705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a10621-0dfe-44e6-8d56-3172e41c47c7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=d4fffbc1d5384fca8fb012ac140653fb, implied_role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:42.181179 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-77a10621-0dfe-44e6-8d56-3172e41c47c7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:42.181179 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:52:42.181179 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:52:42.182616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a10621-0dfe-44e6-8d56-3172e41c47c7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:42.243794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:42.248280 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3795/7585] 10.222.0.27 () {60 vars in 1363 bytes} [Sun Aug 28 18:52:41 2022] PUT /identity/v3/roles/d4fffbc1d5384fca8fb012ac140653fb/implies/d9e4c527d1574bf3b6dc32da701b4c39 => generated 526 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:42.253033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550ebe8-1086-4cc2-9a36-4e1107457f77 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:42.268698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550ebe8-1086-4cc2-9a36-4e1107457f77 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:42.397057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93cdef-4ab5-4767-aa26-f16a367830c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:42.397748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93cdef-4ab5-4767-aa26-f16a367830c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:42.398033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93cdef-4ab5-4767-aa26-f16a367830c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:42.398306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93cdef-4ab5-4767-aa26-f16a367830c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/d9e4c527d1574bf3b6dc32da701b4c39/implies/d4fffbc1d5384fca8fb012ac140653fb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:42.404486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93cdef-4ab5-4767-aa26-f16a367830c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=d9e4c527d1574bf3b6dc32da701b4c39, implied_role_id=d4fffbc1d5384fca8fb012ac140653fb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:42.408954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93cdef-4ab5-4767-aa26-f16a367830c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:42.451426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-9f93cdef-4ab5-4767-aa26-f16a367830c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] d4fffbc1d5384fca8fb012ac140653fb cannot be an implied roles.: keystone.exception.InvalidImpliedRole: d4fffbc1d5384fca8fb012ac140653fb cannot be an implied roles. Aug 28 18:52:42.451426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:52:42.451426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:52:42.451426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:52:42.451426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:52:42.451426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:52:42.451426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:52:42.451426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:52:42.451426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:52:42.451426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:52:42.451426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:52:42.451426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:52:42.451426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Aug 28 18:52:42.451426 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Aug 28 18:52:42.452469 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:52:42.452469 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:52:42.452469 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Aug 28 18:52:42.452469 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Aug 28 18:52:42.452469 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: d4fffbc1d5384fca8fb012ac140653fb cannot be an implied roles. Aug 28 18:52:42.452469 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:52:42.452870 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3791/7586] 10.222.0.27 () {60 vars in 1363 bytes} [Sun Aug 28 18:52:42 2022] PUT /identity/v3/roles/d9e4c527d1574bf3b6dc32da701b4c39/implies/d4fffbc1d5384fca8fb012ac140653fb => generated 116 bytes in 201 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:52:42.458095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a10621-0dfe-44e6-8d56-3172e41c47c7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:42.485135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a10621-0dfe-44e6-8d56-3172e41c47c7 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:42.486326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93cdef-4ab5-4767-aa26-f16a367830c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:42.497698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f93cdef-4ab5-4767-aa26-f16a367830c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:42.505422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c2e61-4210-4c2d-bd60-6d2c45cc7bfa tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:42.505560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c2e61-4210-4c2d-bd60-6d2c45cc7bfa tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:42.505766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c2e61-4210-4c2d-bd60-6d2c45cc7bfa tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:42.510449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c2e61-4210-4c2d-bd60-6d2c45cc7bfa tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/d4fffbc1d5384fca8fb012ac140653fb/implies/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:42.512811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c2e61-4210-4c2d-bd60-6d2c45cc7bfa tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=d4fffbc1d5384fca8fb012ac140653fb, implied_role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:42.515705 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-194c2e61-4210-4c2d-bd60-6d2c45cc7bfa tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:42.515705 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:52:42.515705 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:52:42.525609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c2e61-4210-4c2d-bd60-6d2c45cc7bfa tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:42.546917 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3796/7587] 10.222.0.27 () {58 vars in 1347 bytes} [Sun Aug 28 18:52:42 2022] DELETE /identity/v3/roles/d4fffbc1d5384fca8fb012ac140653fb/implies/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:42.552441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c2e61-4210-4c2d-bd60-6d2c45cc7bfa tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:42.579909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:42.641880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93cdef-4ab5-4767-aa26-f16a367830c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:42.728508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c2e61-4210-4c2d-bd60-6d2c45cc7bfa tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:42.748447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d53b2-530d-49db-acfd-2bb2e83d2e8f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:42.749189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d53b2-530d-49db-acfd-2bb2e83d2e8f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:42.749748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d53b2-530d-49db-acfd-2bb2e83d2e8f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:42.749909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d53b2-530d-49db-acfd-2bb2e83d2e8f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/d4fffbc1d5384fca8fb012ac140653fb/implies/3979c1bab6954ba5a110baf1b25b19e6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:42.753838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d53b2-530d-49db-acfd-2bb2e83d2e8f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=d4fffbc1d5384fca8fb012ac140653fb, implied_role_id=3979c1bab6954ba5a110baf1b25b19e6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:42.756497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d53b2-530d-49db-acfd-2bb2e83d2e8f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:42.776222 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3797/7588] 10.222.0.27 () {58 vars in 1347 bytes} [Sun Aug 28 18:52:42 2022] DELETE /identity/v3/roles/d4fffbc1d5384fca8fb012ac140653fb/implies/3979c1bab6954ba5a110baf1b25b19e6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:42.780458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d53b2-530d-49db-acfd-2bb2e83d2e8f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:42.796334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac365f-d65d-4d11-9adf-935349132a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:42.797365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac365f-d65d-4d11-9adf-935349132a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:42.797855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac365f-d65d-4d11-9adf-935349132a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:42.798134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac365f-d65d-4d11-9adf-935349132a51 admin admin] PATH_INFO: `/v3/users/f5cef0a949db4c65955d601ac8cde5d9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:42.799531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac365f-d65d-4d11-9adf-935349132a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5cef0a949db4c65955d601ac8cde5d9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:42.807218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac365f-d65d-4d11-9adf-935349132a51 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:42.922894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d53b2-530d-49db-acfd-2bb2e83d2e8f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:42.931889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4cac365f-d65d-4d11-9adf-935349132a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5cef0a949db4c65955d601ac8cde5d9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:42.933711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4cac365f-d65d-4d11-9adf-935349132a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5cef0a949db4c65955d601ac8cde5d9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:42.936330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242be8b-b3f9-421a-9a13-5b829498c17a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:42.937031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242be8b-b3f9-421a-9a13-5b829498c17a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:42.938263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242be8b-b3f9-421a-9a13-5b829498c17a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:42.938547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242be8b-b3f9-421a-9a13-5b829498c17a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/3979c1bab6954ba5a110baf1b25b19e6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:42.942872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242be8b-b3f9-421a-9a13-5b829498c17a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=3979c1bab6954ba5a110baf1b25b19e6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:42.944068 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-4242be8b-b3f9-421a-9a13-5b829498c17a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:42.944068 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:52:42.944068 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:52:42.944894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242be8b-b3f9-421a-9a13-5b829498c17a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:42.952994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4cac365f-d65d-4d11-9adf-935349132a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5cef0a949db4c65955d601ac8cde5d9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:42.973555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4cac365f-d65d-4d11-9adf-935349132a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5cef0a949db4c65955d601ac8cde5d9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.041397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4cac365f-d65d-4d11-9adf-935349132a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5cef0a949db4c65955d601ac8cde5d9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.061462 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3792/7589] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:42 2022] DELETE /identity/v3/users/f5cef0a949db4c65955d601ac8cde5d9 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:43.066908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d819c-402f-468e-a4ec-a3f9f542a3dd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:43.068654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d819c-402f-468e-a4ec-a3f9f542a3dd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:43.069064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d819c-402f-468e-a4ec-a3f9f542a3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:43.073980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4242be8b-b3f9-421a-9a13-5b829498c17a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invalidating the token cache because role 3979c1bab6954ba5a110baf1b25b19e6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:43.075551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4242be8b-b3f9-421a-9a13-5b829498c17a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.076522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4242be8b-b3f9-421a-9a13-5b829498c17a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.080615 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3798/7590] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:42 2022] DELETE /identity/v3/roles/3979c1bab6954ba5a110baf1b25b19e6 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:43.085211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242be8b-b3f9-421a-9a13-5b829498c17a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:43.088717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4242be8b-b3f9-421a-9a13-5b829498c17a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:43.109480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-387d819c-402f-468e-a4ec-a3f9f542a3dd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:43.110700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-387d819c-402f-468e-a4ec-a3f9f542a3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:43.174138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:43.203051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242be8b-b3f9-421a-9a13-5b829498c17a tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:43.209917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225a3de-a971-4a26-b02d-7b1b802de5ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:43.210631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225a3de-a971-4a26-b02d-7b1b802de5ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:43.210803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225a3de-a971-4a26-b02d-7b1b802de5ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:43.211021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225a3de-a971-4a26-b02d-7b1b802de5ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/domains/b182801305424f20b981e925a2f970f3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:43.226182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225a3de-a971-4a26-b02d-7b1b802de5ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b182801305424f20b981e925a2f970f3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:43.227835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225a3de-a971-4a26-b02d-7b1b802de5ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:43.281400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:43.298720 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3793/7591] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:43.302145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d225a3de-a971-4a26-b02d-7b1b802de5ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b182801305424f20b981e925a2f970f3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.302550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d225a3de-a971-4a26-b02d-7b1b802de5ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b182801305424f20b981e925a2f970f3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.313743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d819c-402f-468e-a4ec-a3f9f542a3dd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:43.315477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-387d819c-402f-468e-a4ec-a3f9f542a3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:43.368192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d225a3de-a971-4a26-b02d-7b1b802de5ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b182801305424f20b981e925a2f970f3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.368917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d225a3de-a971-4a26-b02d-7b1b802de5ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b182801305424f20b981e925a2f970f3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.375417 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3799/7592] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:52:43 2022] PATCH /identity/v3/domains/b182801305424f20b981e925a2f970f3 => generated 278 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:43.379382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225a3de-a971-4a26-b02d-7b1b802de5ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:43.387294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d225a3de-a971-4a26-b02d-7b1b802de5ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:43.438270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d819c-402f-468e-a4ec-a3f9f542a3dd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:43.535801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225a3de-a971-4a26-b02d-7b1b802de5ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:43.537153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1bb29-a139-47fa-84b6-e7c8d3828571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:43.539617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1bb29-a139-47fa-84b6-e7c8d3828571 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:43.539960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1bb29-a139-47fa-84b6-e7c8d3828571 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:43.540998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1bb29-a139-47fa-84b6-e7c8d3828571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:43.541624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:43.542339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:43.542626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:43.542905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/domains/b182801305424f20b981e925a2f970f3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:43.559339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b182801305424f20b981e925a2f970f3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:43.559339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:43.565423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13f1bb29-a139-47fa-84b6-e7c8d3828571 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:43.585395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b182801305424f20b981e925a2f970f3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.598697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b182801305424f20b981e925a2f970f3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.694088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b182801305424f20b981e925a2f970f3', 'request_id': 'req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.726303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b182801305424f20b981e925a2f970f3', 'request_id': 'req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.749082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b182801305424f20b981e925a2f970f3', 'request_id': 'req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.772484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1bb29-a139-47fa-84b6-e7c8d3828571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:43.779818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1bb29-a139-47fa-84b6-e7c8d3828571 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:43.790133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] The token cache is being invalidate because project b182801305424f20b981e925a2f970f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:43.792625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.795876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.802787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:43.810072 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3794/7593] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:43.831509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b182801305424f20b981e925a2f970f3', 'request_id': 'req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.844737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b182801305424f20b981e925a2f970f3', 'request_id': 'req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.847932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b182801305424f20b981e925a2f970f3', 'request_id': 'req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.866011 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3800/7594] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:52:43 2022] DELETE /identity/v3/domains/b182801305424f20b981e925a2f970f3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:43.866844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1bb29-a139-47fa-84b6-e7c8d3828571 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:43.893372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1bb29-a139-47fa-84b6-e7c8d3828571 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:44.046130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36787663-46f4-4d37-8dfc-dbdeac9dfc65 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:44.046969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36787663-46f4-4d37-8dfc-dbdeac9dfc65 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:44.047271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36787663-46f4-4d37-8dfc-dbdeac9dfc65 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:44.047550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36787663-46f4-4d37-8dfc-dbdeac9dfc65 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/d4fffbc1d5384fca8fb012ac140653fb/implies/6c288f024f524691999779adb5b06e32` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:44.049298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36787663-46f4-4d37-8dfc-dbdeac9dfc65 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=d4fffbc1d5384fca8fb012ac140653fb, implied_role_id=6c288f024f524691999779adb5b06e32)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:44.050953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36787663-46f4-4d37-8dfc-dbdeac9dfc65 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:44.057144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:44.071473 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3795/7595] 10.222.0.27 () {58 vars in 1347 bytes} [Sun Aug 28 18:52:43 2022] DELETE /identity/v3/roles/d4fffbc1d5384fca8fb012ac140653fb/implies/6c288f024f524691999779adb5b06e32 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:44.075705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:44.077437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:44.094360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36787663-46f4-4d37-8dfc-dbdeac9dfc65 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:44.096977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-36787663-46f4-4d37-8dfc-dbdeac9dfc65 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:44.154064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe90c5c-8ef2-47ae-8c9a-c72ef50e0530 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:44.215352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36787663-46f4-4d37-8dfc-dbdeac9dfc65 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:44.227473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922c347-1263-4d7f-91d8-ca68d6dee045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:44.228186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922c347-1263-4d7f-91d8-ca68d6dee045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:44.233042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922c347-1263-4d7f-91d8-ca68d6dee045 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:44.233811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922c347-1263-4d7f-91d8-ca68d6dee045 admin admin] PATH_INFO: `/v3/projects/3ec08f20c42f42ce9ee35d33e0a5340a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:44.237030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922c347-1263-4d7f-91d8-ca68d6dee045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ec08f20c42f42ce9ee35d33e0a5340a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:44.239597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922c347-1263-4d7f-91d8-ca68d6dee045 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:44.334572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7fdc4-1efd-498e-8cdb-6994856cfc10 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:44.335221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7fdc4-1efd-498e-8cdb-6994856cfc10 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:44.335531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7fdc4-1efd-498e-8cdb-6994856cfc10 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:44.335807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7fdc4-1efd-498e-8cdb-6994856cfc10 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/6c288f024f524691999779adb5b06e32` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:44.337185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7fdc4-1efd-498e-8cdb-6994856cfc10 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=6c288f024f524691999779adb5b06e32)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:44.343401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7fdc4-1efd-498e-8cdb-6994856cfc10 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:44.394352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4922c347-1263-4d7f-91d8-ca68d6dee045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec08f20c42f42ce9ee35d33e0a5340a', 'request_id': 'req-4922c347-1263-4d7f-91d8-ca68d6dee045'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:44.417596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4922c347-1263-4d7f-91d8-ca68d6dee045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec08f20c42f42ce9ee35d33e0a5340a', 'request_id': 'req-4922c347-1263-4d7f-91d8-ca68d6dee045'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:44.432433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4922c347-1263-4d7f-91d8-ca68d6dee045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec08f20c42f42ce9ee35d33e0a5340a', 'request_id': 'req-4922c347-1263-4d7f-91d8-ca68d6dee045'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:44.462311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7c7fdc4-1efd-498e-8cdb-6994856cfc10 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invalidating the token cache because role 6c288f024f524691999779adb5b06e32 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:44.463675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7c7fdc4-1efd-498e-8cdb-6994856cfc10 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:44.465462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4922c347-1263-4d7f-91d8-ca68d6dee045 admin admin] The token cache is being invalidate because project 3ec08f20c42f42ce9ee35d33e0a5340a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:44.466975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4922c347-1263-4d7f-91d8-ca68d6dee045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:44.467535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7c7fdc4-1efd-498e-8cdb-6994856cfc10 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:44.468431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4922c347-1263-4d7f-91d8-ca68d6dee045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:44.470090 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3801/7596] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:44 2022] DELETE /identity/v3/roles/6c288f024f524691999779adb5b06e32 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:44.475836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7fdc4-1efd-498e-8cdb-6994856cfc10 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:44.477625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b7c7fdc4-1efd-498e-8cdb-6994856cfc10 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:44.480313 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3796/7597] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:44 2022] DELETE /identity/v3/projects/3ec08f20c42f42ce9ee35d33e0a5340a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:44.482452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047ad3-b743-47d8-86ef-f4529e0084f8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:44.482950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047ad3-b743-47d8-86ef-f4529e0084f8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:44.484296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047ad3-b743-47d8-86ef-f4529e0084f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:44.551162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f9047ad3-b743-47d8-86ef-f4529e0084f8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:44.558578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9047ad3-b743-47d8-86ef-f4529e0084f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:44.668080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7fdc4-1efd-498e-8cdb-6994856cfc10 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:44.682614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7917a-13a8-4c6f-af9f-3e0f5bff6a42 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:44.684652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7917a-13a8-4c6f-af9f-3e0f5bff6a42 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:44.686322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7917a-13a8-4c6f-af9f-3e0f5bff6a42 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:44.687403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7917a-13a8-4c6f-af9f-3e0f5bff6a42 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/d4fffbc1d5384fca8fb012ac140653fb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:44.691525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7917a-13a8-4c6f-af9f-3e0f5bff6a42 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=d4fffbc1d5384fca8fb012ac140653fb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:44.695017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7917a-13a8-4c6f-af9f-3e0f5bff6a42 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:44.726937 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3797/7598] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:44.739842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e536c42-b93b-41c9-896a-356669eea154 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:44.740290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e536c42-b93b-41c9-896a-356669eea154 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:44.740686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e536c42-b93b-41c9-896a-356669eea154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:44.777723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9e536c42-b93b-41c9-896a-356669eea154 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:44.780154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e536c42-b93b-41c9-896a-356669eea154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:44.806549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-87e7917a-13a8-4c6f-af9f-3e0f5bff6a42 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invalidating the token cache because role d4fffbc1d5384fca8fb012ac140653fb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:44.807872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-87e7917a-13a8-4c6f-af9f-3e0f5bff6a42 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:44.811012 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3798/7599] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:52:44.811363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-87e7917a-13a8-4c6f-af9f-3e0f5bff6a42 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:44.817777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e536c42-b93b-41c9-896a-356669eea154 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:44.821098 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3802/7600] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:44 2022] DELETE /identity/v3/roles/d4fffbc1d5384fca8fb012ac140653fb => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:44.830019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7917a-13a8-4c6f-af9f-3e0f5bff6a42 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:44.833925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-87e7917a-13a8-4c6f-af9f-3e0f5bff6a42 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:44.850799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e536c42-b93b-41c9-896a-356669eea154 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:44.913773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=9,keystone:SELECT=91 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:44.969418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:45.166472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29da86-612e-455e-88f7-aa5e25f7a56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.167135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29da86-612e-455e-88f7-aa5e25f7a56c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.168754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29da86-612e-455e-88f7-aa5e25f7a56c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.168942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29da86-612e-455e-88f7-aa5e25f7a56c admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.169620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29da86-612e-455e-88f7-aa5e25f7a56c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:45.169930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29da86-612e-455e-88f7-aa5e25f7a56c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.171616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29da86-612e-455e-88f7-aa5e25f7a56c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.177509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7917a-13a8-4c6f-af9f-3e0f5bff6a42 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.188520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204718cd-4ac8-4901-a25e-08f92d6c8766 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.189267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204718cd-4ac8-4901-a25e-08f92d6c8766 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.189552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204718cd-4ac8-4901-a25e-08f92d6c8766 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.194459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204718cd-4ac8-4901-a25e-08f92d6c8766 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.197052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204718cd-4ac8-4901-a25e-08f92d6c8766 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=0729ef3d5be24f0cb69bcdf3d13ec839)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.198908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204718cd-4ac8-4901-a25e-08f92d6c8766 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.213643 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3799/7601] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:45.218905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29da86-612e-455e-88f7-aa5e25f7a56c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:45.221064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f29da86-612e-455e-88f7-aa5e25f7a56c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:45.249415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29da86-612e-455e-88f7-aa5e25f7a56c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.259921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aba3c1-6387-4514-9ac4-8e8653146924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.261640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aba3c1-6387-4514-9ac4-8e8653146924 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.261933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aba3c1-6387-4514-9ac4-8e8653146924 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.262213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aba3c1-6387-4514-9ac4-8e8653146924 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.266545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aba3c1-6387-4514-9ac4-8e8653146924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.272510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aba3c1-6387-4514-9ac4-8e8653146924 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.344601 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3803/7602] 10.222.0.27 () {60 vars in 1363 bytes} [Sun Aug 28 18:52:44 2022] PUT /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839 => generated 520 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:45.348963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204718cd-4ac8-4901-a25e-08f92d6c8766 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:45.411120 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3800/7603] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:45 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:45.413492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aba3c1-6387-4514-9ac4-8e8653146924 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:45.662914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aba3c1-6387-4514-9ac4-8e8653146924 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.672534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204718cd-4ac8-4901-a25e-08f92d6c8766 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.681279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288dfab-46ae-4145-86ba-5e02e14c90b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.682158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288dfab-46ae-4145-86ba-5e02e14c90b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.682554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288dfab-46ae-4145-86ba-5e02e14c90b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.682942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288dfab-46ae-4145-86ba-5e02e14c90b4 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.683737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288dfab-46ae-4145-86ba-5e02e14c90b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.686634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288dfab-46ae-4145-86ba-5e02e14c90b4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.740514 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3801/7604] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:45 2022] POST /identity/v3/users => generated 284 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:45.748872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288dfab-46ae-4145-86ba-5e02e14c90b4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:45.778238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288dfab-46ae-4145-86ba-5e02e14c90b4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.789764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae64f3-7f0e-4c9a-b6ab-9bf45536cf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.790428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae64f3-7f0e-4c9a-b6ab-9bf45536cf30 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.791475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae64f3-7f0e-4c9a-b6ab-9bf45536cf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.792312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae64f3-7f0e-4c9a-b6ab-9bf45536cf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.794833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae64f3-7f0e-4c9a-b6ab-9bf45536cf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.798087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae64f3-7f0e-4c9a-b6ab-9bf45536cf30 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.828673 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3802/7605] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:45 2022] GET /identity/v3/roles => generated 2322 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:45.830002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae64f3-7f0e-4c9a-b6ab-9bf45536cf30 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:45.851614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cc72e-800d-417e-b3d8-9528085ff63b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.852259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cc72e-800d-417e-b3d8-9528085ff63b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.852760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cc72e-800d-417e-b3d8-9528085ff63b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.853204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cc72e-800d-417e-b3d8-9528085ff63b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.855804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cc72e-800d-417e-b3d8-9528085ff63b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=0729ef3d5be24f0cb69bcdf3d13ec839)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.857656 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-747cc72e-800d-417e-b3d8-9528085ff63b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:45.857656 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:52:45.857656 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:52:45.860429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cc72e-800d-417e-b3d8-9528085ff63b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.862051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cc72e-800d-417e-b3d8-9528085ff63b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=0729ef3d5be24f0cb69bcdf3d13ec839)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.864450 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-747cc72e-800d-417e-b3d8-9528085ff63b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:45.864450 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:52:45.864450 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:52:45.866105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cc72e-800d-417e-b3d8-9528085ff63b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.875709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae64f3-7f0e-4c9a-b6ab-9bf45536cf30 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.881185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e13bb-4d8d-43bc-8fbf-94b3e1303b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.882100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e13bb-4d8d-43bc-8fbf-94b3e1303b91 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.882501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e13bb-4d8d-43bc-8fbf-94b3e1303b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.882874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e13bb-4d8d-43bc-8fbf-94b3e1303b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.883702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e13bb-4d8d-43bc-8fbf-94b3e1303b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.889050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e13bb-4d8d-43bc-8fbf-94b3e1303b91 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.904270 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3804/7606] 10.222.0.27 () {58 vars in 1345 bytes} [Sun Aug 28 18:52:45 2022] HEAD /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:45.910651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cc72e-800d-417e-b3d8-9528085ff63b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:45.936669 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3803/7607] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:45 2022] GET /identity/v3/roles => generated 2322 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:45.938098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e13bb-4d8d-43bc-8fbf-94b3e1303b91 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:45.944780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cc72e-800d-417e-b3d8-9528085ff63b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.964598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e13bb-4d8d-43bc-8fbf-94b3e1303b91 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.968178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf719ce-4080-43c1-adaf-2646426f7cfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.973467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf719ce-4080-43c1-adaf-2646426f7cfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.976282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf719ce-4080-43c1-adaf-2646426f7cfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.976904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf719ce-4080-43c1-adaf-2646426f7cfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.980971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf719ce-4080-43c1-adaf-2646426f7cfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=0729ef3d5be24f0cb69bcdf3d13ec839)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.985797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf719ce-4080-43c1-adaf-2646426f7cfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.988066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a8fcf-f9a0-4e32-9de1-0cebcae9d4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.988826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a8fcf-f9a0-4e32-9de1-0cebcae9d4e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.002802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a8fcf-f9a0-4e32-9de1-0cebcae9d4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.003552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a8fcf-f9a0-4e32-9de1-0cebcae9d4e7 admin admin] PATH_INFO: `/v3/projects/44ee3e4980bf48e5a68704beb792e87a/users/bdf74d45169e4342a566271d5d2dc1a0/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.014960 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3805/7608] 10.222.0.27 () {58 vars in 1344 bytes} [Sun Aug 28 18:52:45 2022] GET /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839 => generated 520 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:46.015141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf719ce-4080-43c1-adaf-2646426f7cfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:46.038702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf719ce-4080-43c1-adaf-2646426f7cfd tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.049405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceadc30-7124-42f8-8966-44e60ffd1b26 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:46.050279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceadc30-7124-42f8-8966-44e60ffd1b26 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.050744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceadc30-7124-42f8-8966-44e60ffd1b26 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.051116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceadc30-7124-42f8-8966-44e60ffd1b26 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.061513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceadc30-7124-42f8-8966-44e60ffd1b26 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=0729ef3d5be24f0cb69bcdf3d13ec839)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.067559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceadc30-7124-42f8-8966-44e60ffd1b26 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.090069 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3806/7609] 10.222.0.27 () {58 vars in 1347 bytes} [Sun Aug 28 18:52:46 2022] DELETE /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:46.093215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a8fcf-f9a0-4e32-9de1-0cebcae9d4e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44ee3e4980bf48e5a68704beb792e87a, user_id=bdf74d45169e4342a566271d5d2dc1a0, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.095081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceadc30-7124-42f8-8966-44e60ffd1b26 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:46.098435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a8fcf-f9a0-4e32-9de1-0cebcae9d4e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.160425 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3804/7610] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:45 2022] PUT /identity/v3/projects/44ee3e4980bf48e5a68704beb792e87a/users/bdf74d45169e4342a566271d5d2dc1a0/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:46.170215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:46.179107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175cf8e-4135-47b2-9a41-53c30172f894 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.179697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175cf8e-4135-47b2-9a41-53c30172f894 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.181671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175cf8e-4135-47b2-9a41-53c30172f894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.305275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceadc30-7124-42f8-8966-44e60ffd1b26 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.313152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a175cf8e-4135-47b2-9a41-53c30172f894 None None] MFA Rules not processed for user `bdf74d45169e4342a566271d5d2dc1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:46.321234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a175cf8e-4135-47b2-9a41-53c30172f894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:46.420666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:46.494567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0aaa65-4e38-4255-a7c2-1dc5d23962ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:46.495438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aaa65-4e38-4255-a7c2-1dc5d23962ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.495934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aaa65-4e38-4255-a7c2-1dc5d23962ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.496424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aaa65-4e38-4255-a7c2-1dc5d23962ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.499927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0aaa65-4e38-4255-a7c2-1dc5d23962ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=0729ef3d5be24f0cb69bcdf3d13ec839)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.504506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0aaa65-4e38-4255-a7c2-1dc5d23962ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.524075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-6b0aaa65-4e38-4255-a7c2-1dc5d23962ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] dce83b6d620442be9aa578f2ff592d19 does not imply 0729ef3d5be24f0cb69bcdf3d13ec839.: keystone.exception.ImpliedRoleNotFound: dce83b6d620442be9aa578f2ff592d19 does not imply 0729ef3d5be24f0cb69bcdf3d13ec839. Aug 28 18:52:46.524075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:52:46.524075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 28 18:52:46.524075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = query.one() Aug 28 18:52:46.524075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 28 18:52:46.524075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._iter().one() Aug 28 18:52:46.524075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 28 18:52:46.524075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._only_one_row( Aug 28 18:52:46.524075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 28 18:52:46.524075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 28 18:52:46.524075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 28 18:52:46.524075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:52:46.524075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:52:46.524075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:52:46.524075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:52:46.524075 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:52:46.525483 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:52:46.525483 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:52:46.525483 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:52:46.525483 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:52:46.525483 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:52:46.525483 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:52:46.525483 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:52:46.525483 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:52:46.525483 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:52:46.525483 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Aug 28 18:52:46.525483 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Aug 28 18:52:46.525483 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Aug 28 18:52:46.525483 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Aug 28 18:52:46.525483 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Aug 28 18:52:46.525483 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 28 18:52:46.525483 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 28 18:52:46.526669 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 28 18:52:46.526669 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: dce83b6d620442be9aa578f2ff592d19 does not imply 0729ef3d5be24f0cb69bcdf3d13ec839. Aug 28 18:52:46.526669 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:52:46.538133 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3805/7611] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:46.538813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175cf8e-4135-47b2-9a41-53c30172f894 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:46.540987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a175cf8e-4135-47b2-9a41-53c30172f894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:46.567021 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3807/7612] 10.222.0.27 () {58 vars in 1344 bytes} [Sun Aug 28 18:52:46 2022] GET /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839 => generated 137 bytes in 468 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:52:46.567021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0aaa65-4e38-4255-a7c2-1dc5d23962ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:46.579161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6b0aaa65-4e38-4255-a7c2-1dc5d23962ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:46.714926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0aaa65-4e38-4255-a7c2-1dc5d23962ce tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.718467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175cf8e-4135-47b2-9a41-53c30172f894 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.720840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7834eed-3e0d-4703-88b1-d806eeb94c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:46.721914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7834eed-3e0d-4703-88b1-d806eeb94c39 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.722926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7834eed-3e0d-4703-88b1-d806eeb94c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.724351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e646901-5833-43eb-8663-39425fa9c78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:46.725115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e646901-5833-43eb-8663-39425fa9c78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.725260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7834eed-3e0d-4703-88b1-d806eeb94c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.725568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e646901-5833-43eb-8663-39425fa9c78d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.725920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e646901-5833-43eb-8663-39425fa9c78d admin admin] PATH_INFO: `/v3/users/79c9128970504d7fb1e5cb09dd2df0a1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.727375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e646901-5833-43eb-8663-39425fa9c78d admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c9128970504d7fb1e5cb09dd2df0a1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.729526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e646901-5833-43eb-8663-39425fa9c78d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.743300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7834eed-3e0d-4703-88b1-d806eeb94c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.745520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7834eed-3e0d-4703-88b1-d806eeb94c39 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.761699 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3808/7613] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:46.762926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7834eed-3e0d-4703-88b1-d806eeb94c39 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:46.793999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7834eed-3e0d-4703-88b1-d806eeb94c39 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.804445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a115c-a524-41e7-a135-764b5446073d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:46.805965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a115c-a524-41e7-a135-764b5446073d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.806558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a115c-a524-41e7-a135-764b5446073d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.807185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a115c-a524-41e7-a135-764b5446073d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.809289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a115c-a524-41e7-a135-764b5446073d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=0729ef3d5be24f0cb69bcdf3d13ec839)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.811480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a115c-a524-41e7-a135-764b5446073d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.823814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-5a2a115c-a524-41e7-a135-764b5446073d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] dce83b6d620442be9aa578f2ff592d19 does not imply 0729ef3d5be24f0cb69bcdf3d13ec839.: keystone.exception.ImpliedRoleNotFound: dce83b6d620442be9aa578f2ff592d19 does not imply 0729ef3d5be24f0cb69bcdf3d13ec839. Aug 28 18:52:46.823814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:52:46.823814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 28 18:52:46.823814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = query.one() Aug 28 18:52:46.823814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 28 18:52:46.823814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._iter().one() Aug 28 18:52:46.823814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 28 18:52:46.823814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._only_one_row( Aug 28 18:52:46.823814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 28 18:52:46.823814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 28 18:52:46.823814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 28 18:52:46.823814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:52:46.823814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:52:46.823814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:52:46.823814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:52:46.823814 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:52:46.825036 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:52:46.825036 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:52:46.825036 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:52:46.825036 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:52:46.825036 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:52:46.825036 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:52:46.825036 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:52:46.825036 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:52:46.825036 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:52:46.825036 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 28 18:52:46.825036 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 28 18:52:46.825036 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:52:46.825036 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:52:46.825036 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 28 18:52:46.825036 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 28 18:52:46.825036 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 28 18:52:46.826169 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 28 18:52:46.826169 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 28 18:52:46.826169 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 28 18:52:46.826169 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: dce83b6d620442be9aa578f2ff592d19 does not imply 0729ef3d5be24f0cb69bcdf3d13ec839. Aug 28 18:52:46.826169 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 18:52:46.829545 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3809/7614] 10.222.0.27 () {58 vars in 1347 bytes} [Sun Aug 28 18:52:46 2022] DELETE /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839 => generated 137 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:52:46.837623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a115c-a524-41e7-a135-764b5446073d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:46.867032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e646901-5833-43eb-8663-39425fa9c78d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c9128970504d7fb1e5cb09dd2df0a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:46.871229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a115c-a524-41e7-a135-764b5446073d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.872780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e646901-5833-43eb-8663-39425fa9c78d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c9128970504d7fb1e5cb09dd2df0a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:46.880666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10570d-202e-4353-8cd9-d4e3982f9925 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:46.881874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10570d-202e-4353-8cd9-d4e3982f9925 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.882326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10570d-202e-4353-8cd9-d4e3982f9925 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.882802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10570d-202e-4353-8cd9-d4e3982f9925 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.889326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10570d-202e-4353-8cd9-d4e3982f9925 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=0729ef3d5be24f0cb69bcdf3d13ec839)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.895689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10570d-202e-4353-8cd9-d4e3982f9925 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.907228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e646901-5833-43eb-8663-39425fa9c78d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c9128970504d7fb1e5cb09dd2df0a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:46.933501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e646901-5833-43eb-8663-39425fa9c78d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c9128970504d7fb1e5cb09dd2df0a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:46.955819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e646901-5833-43eb-8663-39425fa9c78d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c9128970504d7fb1e5cb09dd2df0a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:46.970206 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3806/7615] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:46 2022] DELETE /identity/v3/users/79c9128970504d7fb1e5cb09dd2df0a1 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:46.972872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d996d09-97b6-44f4-b07b-bb806293746d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.973330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d996d09-97b6-44f4-b07b-bb806293746d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.973865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d996d09-97b6-44f4-b07b-bb806293746d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.977191 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3810/7616] 10.222.0.27 () {60 vars in 1363 bytes} [Sun Aug 28 18:52:46 2022] PUT /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839 => generated 520 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:52:46.984024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10570d-202e-4353-8cd9-d4e3982f9925 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:46.991139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1f10570d-202e-4353-8cd9-d4e3982f9925 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:47.056169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6d996d09-97b6-44f4-b07b-bb806293746d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:47.061008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6d996d09-97b6-44f4-b07b-bb806293746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:47.148869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:47.198565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:47.210153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10570d-202e-4353-8cd9-d4e3982f9925 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:47.243944 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3807/7617] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:47.270573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d996d09-97b6-44f4-b07b-bb806293746d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:47.275795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6d996d09-97b6-44f4-b07b-bb806293746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:47.405504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b342a-bb71-4325-a197-26ad8f511b7e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:47.406247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b342a-bb71-4325-a197-26ad8f511b7e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.406492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b342a-bb71-4325-a197-26ad8f511b7e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.406776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b342a-bb71-4325-a197-26ad8f511b7e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/3d8d4e3ecf374ec5ba1cdcc687255d79` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.408542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b342a-bb71-4325-a197-26ad8f511b7e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=3d8d4e3ecf374ec5ba1cdcc687255d79)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:47.410268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b342a-bb71-4325-a197-26ad8f511b7e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:47.441120 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3811/7618] 10.222.0.27 () {60 vars in 1363 bytes} [Sun Aug 28 18:52:46 2022] PUT /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/3d8d4e3ecf374ec5ba1cdcc687255d79 => generated 520 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:47.449591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b342a-bb71-4325-a197-26ad8f511b7e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:47.509885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d996d09-97b6-44f4-b07b-bb806293746d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:47.532956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b342a-bb71-4325-a197-26ad8f511b7e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:47.544957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e436abf-b249-4f6f-b4bd-889b06f7f0e9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:47.545658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e436abf-b249-4f6f-b4bd-889b06f7f0e9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.546197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e436abf-b249-4f6f-b4bd-889b06f7f0e9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.546474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e436abf-b249-4f6f-b4bd-889b06f7f0e9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/3d8d4e3ecf374ec5ba1cdcc687255d79/implies/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.552675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e436abf-b249-4f6f-b4bd-889b06f7f0e9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3d8d4e3ecf374ec5ba1cdcc687255d79, implied_role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:47.579497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e436abf-b249-4f6f-b4bd-889b06f7f0e9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:47.617297 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3812/7619] 10.222.0.27 () {60 vars in 1363 bytes} [Sun Aug 28 18:52:47 2022] PUT /identity/v3/roles/3d8d4e3ecf374ec5ba1cdcc687255d79/implies/d9e4c527d1574bf3b6dc32da701b4c39 => generated 520 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:47.619396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e436abf-b249-4f6f-b4bd-889b06f7f0e9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:47.719698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:47.724595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985d344-54fb-4ee7-bbd2-0bfd02f7fb57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:47.725248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d344-54fb-4ee7-bbd2-0bfd02f7fb57 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.725775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d344-54fb-4ee7-bbd2-0bfd02f7fb57 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.726160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d344-54fb-4ee7-bbd2-0bfd02f7fb57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.766758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e436abf-b249-4f6f-b4bd-889b06f7f0e9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:47.804314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cc7d3-ad9d-43e6-a259-518b5374001c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:47.808543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cc7d3-ad9d-43e6-a259-518b5374001c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.808831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cc7d3-ad9d-43e6-a259-518b5374001c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.809200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cc7d3-ad9d-43e6-a259-518b5374001c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.809724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616cc7d3-ad9d-43e6-a259-518b5374001c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:47.810770 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-616cc7d3-ad9d-43e6-a259-518b5374001c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:47.810770 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:52:47.810770 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:52:47.815760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616cc7d3-ad9d-43e6-a259-518b5374001c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:47.863478 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3813/7620] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Aug 28 18:52:47 2022] GET /identity/v3/role_inferences => generated 1605 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:47.868939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cc7d3-ad9d-43e6-a259-518b5374001c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:47.889830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cc7d3-ad9d-43e6-a259-518b5374001c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:47.900626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc158333-6782-4929-a94d-3c92d56c68c9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:47.903721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158333-6782-4929-a94d-3c92d56c68c9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.904370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158333-6782-4929-a94d-3c92d56c68c9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.904370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158333-6782-4929-a94d-3c92d56c68c9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/3d8d4e3ecf374ec5ba1cdcc687255d79/implies/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.908573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc158333-6782-4929-a94d-3c92d56c68c9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=3d8d4e3ecf374ec5ba1cdcc687255d79, implied_role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:47.910466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc158333-6782-4929-a94d-3c92d56c68c9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:47.917595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985d344-54fb-4ee7-bbd2-0bfd02f7fb57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:47.919890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985d344-54fb-4ee7-bbd2-0bfd02f7fb57 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:47.932984 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3808/7621] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:47.943403 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3814/7622] 10.222.0.27 () {58 vars in 1347 bytes} [Sun Aug 28 18:52:47 2022] DELETE /identity/v3/roles/3d8d4e3ecf374ec5ba1cdcc687255d79/implies/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:47.944875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985d344-54fb-4ee7-bbd2-0bfd02f7fb57 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:47.975505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985d344-54fb-4ee7-bbd2-0bfd02f7fb57 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:48.097808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:48.114455 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a4efe-13db-4134-8001-ce9d2f449c3c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:48.115580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a4efe-13db-4134-8001-ce9d2f449c3c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.116252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a4efe-13db-4134-8001-ce9d2f449c3c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.116791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a4efe-13db-4134-8001-ce9d2f449c3c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/3d8d4e3ecf374ec5ba1cdcc687255d79` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.119359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a4efe-13db-4134-8001-ce9d2f449c3c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=3d8d4e3ecf374ec5ba1cdcc687255d79)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:48.121615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a4efe-13db-4134-8001-ce9d2f449c3c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:48.169128 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3809/7623] 10.222.0.27 () {58 vars in 1347 bytes} [Sun Aug 28 18:52:47 2022] DELETE /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/3d8d4e3ecf374ec5ba1cdcc687255d79 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:48.181397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc158333-6782-4929-a94d-3c92d56c68c9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:48.215717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc158333-6782-4929-a94d-3c92d56c68c9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:48.331704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc67268-57f6-42db-b912-22214df06da5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:48.332543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc67268-57f6-42db-b912-22214df06da5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.333117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc67268-57f6-42db-b912-22214df06da5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.333430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc67268-57f6-42db-b912-22214df06da5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.335415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc67268-57f6-42db-b912-22214df06da5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=0729ef3d5be24f0cb69bcdf3d13ec839)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:48.338078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc67268-57f6-42db-b912-22214df06da5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:48.362291 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3815/7624] 10.222.0.27 () {58 vars in 1347 bytes} [Sun Aug 28 18:52:48 2022] DELETE /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:48.368631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a4efe-13db-4134-8001-ce9d2f449c3c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:48.385434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a4efe-13db-4134-8001-ce9d2f449c3c tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:48.464503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc67268-57f6-42db-b912-22214df06da5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:48.466713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ffc67268-57f6-42db-b912-22214df06da5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:48.611031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f04ef-8322-4900-8043-579c750c2c3f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:48.611031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f04ef-8322-4900-8043-579c750c2c3f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.611031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f04ef-8322-4900-8043-579c750c2c3f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.611486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f04ef-8322-4900-8043-579c750c2c3f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.612483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f04ef-8322-4900-8043-579c750c2c3f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:48.613837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f04ef-8322-4900-8043-579c750c2c3f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:48.646156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc67268-57f6-42db-b912-22214df06da5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:48.653165 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3810/7625] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:48 2022] GET /identity/v3/roles => generated 2322 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:48.654822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f04ef-8322-4900-8043-579c750c2c3f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:48.660549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6216d-4ac4-4e40-a665-7f5af3584e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:48.661217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6216d-4ac4-4e40-a665-7f5af3584e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.661538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6216d-4ac4-4e40-a665-7f5af3584e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.661809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6216d-4ac4-4e40-a665-7f5af3584e5c admin admin] PATH_INFO: `/v3/projects/2533ebb901ad4aee86ae6ba6ae6deef5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.663087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6216d-4ac4-4e40-a665-7f5af3584e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2533ebb901ad4aee86ae6ba6ae6deef5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:48.665410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6216d-4ac4-4e40-a665-7f5af3584e5c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:48.688976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f04ef-8322-4900-8043-579c750c2c3f tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:48.694868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd899fe-562e-4093-a089-db38051cdaad tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:48.696860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd899fe-562e-4093-a089-db38051cdaad tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.696860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd899fe-562e-4093-a089-db38051cdaad tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.696860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd899fe-562e-4093-a089-db38051cdaad tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.696860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd899fe-562e-4093-a089-db38051cdaad tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:48.698784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd899fe-562e-4093-a089-db38051cdaad tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:48.728189 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3811/7626] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:52:48 2022] POST /identity/v3/roles => generated 235 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:48.729219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd899fe-562e-4093-a089-db38051cdaad tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:48.751109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd899fe-562e-4093-a089-db38051cdaad tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:48.784569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78f6216d-4ac4-4e40-a665-7f5af3584e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2533ebb901ad4aee86ae6ba6ae6deef5', 'request_id': 'req-78f6216d-4ac4-4e40-a665-7f5af3584e5c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:48.810236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78f6216d-4ac4-4e40-a665-7f5af3584e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2533ebb901ad4aee86ae6ba6ae6deef5', 'request_id': 'req-78f6216d-4ac4-4e40-a665-7f5af3584e5c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:48.830200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78f6216d-4ac4-4e40-a665-7f5af3584e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2533ebb901ad4aee86ae6ba6ae6deef5', 'request_id': 'req-78f6216d-4ac4-4e40-a665-7f5af3584e5c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:48.834729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:48.888790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78f6216d-4ac4-4e40-a665-7f5af3584e5c admin admin] The token cache is being invalidate because project 2533ebb901ad4aee86ae6ba6ae6deef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:48.889729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78f6216d-4ac4-4e40-a665-7f5af3584e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:48.894928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78f6216d-4ac4-4e40-a665-7f5af3584e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:48.905212 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3816/7627] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:48 2022] DELETE /identity/v3/projects/2533ebb901ad4aee86ae6ba6ae6deef5 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:48.912344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d978b-9c09-4427-a0e1-8cb19e4c9c37 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.913090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d978b-9c09-4427-a0e1-8cb19e4c9c37 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.913366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d978b-9c09-4427-a0e1-8cb19e4c9c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.979756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f82d978b-9c09-4427-a0e1-8cb19e4c9c37 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:48.981505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f82d978b-9c09-4427-a0e1-8cb19e4c9c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:48.987404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae02ae1-23aa-4550-bcb7-008b39ec6df5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:48.993496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae02ae1-23aa-4550-bcb7-008b39ec6df5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.994056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae02ae1-23aa-4550-bcb7-008b39ec6df5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.994591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae02ae1-23aa-4550-bcb7-008b39ec6df5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/784774ff1a4a4c3ba5dde53ca5f58ae8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.999374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae02ae1-23aa-4550-bcb7-008b39ec6df5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:update_role(role_id=784774ff1a4a4c3ba5dde53ca5f58ae8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:49.000664 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-cae02ae1-23aa-4550-bcb7-008b39ec6df5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:49.000664 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:52:49.000664 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:52:49.002261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae02ae1-23aa-4550-bcb7-008b39ec6df5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:49.060255 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3812/7628] 10.222.0.27 () {60 vars in 1243 bytes} [Sun Aug 28 18:52:48 2022] PATCH /identity/v3/roles/784774ff1a4a4c3ba5dde53ca5f58ae8 => generated 238 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:49.070459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae02ae1-23aa-4550-bcb7-008b39ec6df5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:49.074537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cae02ae1-23aa-4550-bcb7-008b39ec6df5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:49.108516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae02ae1-23aa-4550-bcb7-008b39ec6df5 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:49.121534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4756d-ac39-4567-93be-028731e1eaf9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:49.122645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4756d-ac39-4567-93be-028731e1eaf9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:49.123597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4756d-ac39-4567-93be-028731e1eaf9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:49.124680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4756d-ac39-4567-93be-028731e1eaf9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/784774ff1a4a4c3ba5dde53ca5f58ae8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:49.148702 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3817/7629] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:49.155374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dfb1f-7dba-478f-8f98-120ecf4d963a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:49.155702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dfb1f-7dba-478f-8f98-120ecf4d963a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:49.155941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dfb1f-7dba-478f-8f98-120ecf4d963a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:49.168231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4756d-ac39-4567-93be-028731e1eaf9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:get_role(role_id=784774ff1a4a4c3ba5dde53ca5f58ae8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:49.174367 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-53e4756d-ac39-4567-93be-028731e1eaf9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:49.174367 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:52:49.174367 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:52:49.181195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4756d-ac39-4567-93be-028731e1eaf9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:49.197973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-757dfb1f-7dba-478f-8f98-120ecf4d963a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:49.199838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-757dfb1f-7dba-478f-8f98-120ecf4d963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:49.202884 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3813/7630] 10.222.0.27 () {58 vars in 1221 bytes} [Sun Aug 28 18:52:49 2022] GET /identity/v3/roles/784774ff1a4a4c3ba5dde53ca5f58ae8 => generated 238 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:49.203978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4756d-ac39-4567-93be-028731e1eaf9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:49.231463 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3818/7631] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:49.232675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757dfb1f-7dba-478f-8f98-120ecf4d963a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:49.246880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757dfb1f-7dba-478f-8f98-120ecf4d963a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:49.252997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4756d-ac39-4567-93be-028731e1eaf9 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:49.259039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ce076-0896-4c6e-a561-86f5ae2aea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:49.259987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ce076-0896-4c6e-a561-86f5ae2aea87 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:49.260266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ce076-0896-4c6e-a561-86f5ae2aea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:49.260545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ce076-0896-4c6e-a561-86f5ae2aea87 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:49.261229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ce076-0896-4c6e-a561-86f5ae2aea87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:49.261537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ce076-0896-4c6e-a561-86f5ae2aea87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:49.263221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ce076-0896-4c6e-a561-86f5ae2aea87 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:49.274364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b857f-db42-47a6-abf9-ab0c2629a376 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:49.275363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b857f-db42-47a6-abf9-ab0c2629a376 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:49.275806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b857f-db42-47a6-abf9-ab0c2629a376 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:49.276128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b857f-db42-47a6-abf9-ab0c2629a376 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:49.277406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b857f-db42-47a6-abf9-ab0c2629a376 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:49.282220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b857f-db42-47a6-abf9-ab0c2629a376 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:49.302316 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3819/7632] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:52:49.304225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ce076-0896-4c6e-a561-86f5ae2aea87 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:49.333102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ce076-0896-4c6e-a561-86f5ae2aea87 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:49.348952 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3814/7633] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:49 2022] GET /identity/v3/roles => generated 2551 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:49.361207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b857f-db42-47a6-abf9-ab0c2629a376 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:49.367458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d81518-63d9-4684-9b63-fc70c219d0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:49.368101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d81518-63d9-4684-9b63-fc70c219d0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:49.368543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d81518-63d9-4684-9b63-fc70c219d0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:49.368820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d81518-63d9-4684-9b63-fc70c219d0d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:49.369841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d81518-63d9-4684-9b63-fc70c219d0d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:49.371843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d81518-63d9-4684-9b63-fc70c219d0d2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:49.378697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b857f-db42-47a6-abf9-ab0c2629a376 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:49.398673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26bfd8-d72e-48cd-a31e-3b3de9413d18 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:49.399362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26bfd8-d72e-48cd-a31e-3b3de9413d18 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:49.399647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26bfd8-d72e-48cd-a31e-3b3de9413d18 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:49.403357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26bfd8-d72e-48cd-a31e-3b3de9413d18 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/784774ff1a4a4c3ba5dde53ca5f58ae8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:49.405613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26bfd8-d72e-48cd-a31e-3b3de9413d18 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_role(role_id=784774ff1a4a4c3ba5dde53ca5f58ae8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:49.407476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26bfd8-d72e-48cd-a31e-3b3de9413d18 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:49.427943 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3820/7634] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:49 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:52:49.429289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d81518-63d9-4684-9b63-fc70c219d0d2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:49.457861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:49.500924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f26bfd8-d72e-48cd-a31e-3b3de9413d18 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invalidating the token cache because role 784774ff1a4a4c3ba5dde53ca5f58ae8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:49.503427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f26bfd8-d72e-48cd-a31e-3b3de9413d18 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:49.503427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f26bfd8-d72e-48cd-a31e-3b3de9413d18 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:49.509318 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3815/7635] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:49 2022] DELETE /identity/v3/roles/784774ff1a4a4c3ba5dde53ca5f58ae8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:49.510445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26bfd8-d72e-48cd-a31e-3b3de9413d18 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:49.512082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8f26bfd8-d72e-48cd-a31e-3b3de9413d18 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:49.640669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d81518-63d9-4684-9b63-fc70c219d0d2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:49.696995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:49.704203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975be9d-f6ff-4970-8e86-a306f1e2826e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:49.704832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975be9d-f6ff-4970-8e86-a306f1e2826e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:49.705118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975be9d-f6ff-4970-8e86-a306f1e2826e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:49.705489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975be9d-f6ff-4970-8e86-a306f1e2826e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:49.706042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975be9d-f6ff-4970-8e86-a306f1e2826e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:49.708100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975be9d-f6ff-4970-8e86-a306f1e2826e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:49.753960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26bfd8-d72e-48cd-a31e-3b3de9413d18 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:49.759756 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3821/7636] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:49 2022] POST /identity/v3/users => generated 294 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:49.766450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975be9d-f6ff-4970-8e86-a306f1e2826e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:49.767413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd0ca5-c848-4e38-b351-01cfcdd6d5a2 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:49.771787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd0ca5-c848-4e38-b351-01cfcdd6d5a2 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:49.772063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b975be9d-f6ff-4970-8e86-a306f1e2826e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:49.772206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd0ca5-c848-4e38-b351-01cfcdd6d5a2 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:49.772361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd0ca5-c848-4e38-b351-01cfcdd6d5a2 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:49.778074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd0ca5-c848-4e38-b351-01cfcdd6d5a2 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=0729ef3d5be24f0cb69bcdf3d13ec839)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:49.780011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd0ca5-c848-4e38-b351-01cfcdd6d5a2 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:49.798952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975be9d-f6ff-4970-8e86-a306f1e2826e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:49.808333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d54b77-da29-4f80-be51-fe687295f9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:49.809087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d54b77-da29-4f80-be51-fe687295f9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:49.809417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d54b77-da29-4f80-be51-fe687295f9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:49.809717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d54b77-da29-4f80-be51-fe687295f9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:49.810465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d54b77-da29-4f80-be51-fe687295f9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:49.812108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d54b77-da29-4f80-be51-fe687295f9a9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:49.826124 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3816/7637] 10.222.0.27 () {60 vars in 1363 bytes} [Sun Aug 28 18:52:49 2022] PUT /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839 => generated 520 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:49.830946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd0ca5-c848-4e38-b351-01cfcdd6d5a2 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:49.836866 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3822/7638] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:49 2022] GET /identity/v3/roles => generated 2322 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:49.844575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d54b77-da29-4f80-be51-fe687295f9a9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:49.934665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d54b77-da29-4f80-be51-fe687295f9a9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:49.995709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd0ca5-c848-4e38-b351-01cfcdd6d5a2 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:50.015318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf4f67-fbbe-4a87-bc44-0b492cdfd282 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:50.016065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf4f67-fbbe-4a87-bc44-0b492cdfd282 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:50.026105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf4f67-fbbe-4a87-bc44-0b492cdfd282 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:50.028051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf4f67-fbbe-4a87-bc44-0b492cdfd282 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/3d8d4e3ecf374ec5ba1cdcc687255d79` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:50.032442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf4f67-fbbe-4a87-bc44-0b492cdfd282 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=3d8d4e3ecf374ec5ba1cdcc687255d79)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:50.034284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf4f67-fbbe-4a87-bc44-0b492cdfd282 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:50.097425 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3817/7639] 10.222.0.27 () {60 vars in 1363 bytes} [Sun Aug 28 18:52:49 2022] PUT /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/3d8d4e3ecf374ec5ba1cdcc687255d79 => generated 520 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:50.098504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf4f67-fbbe-4a87-bc44-0b492cdfd282 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:50.112431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68ccab-6272-4e0f-9092-aa28dd322eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:50.113193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68ccab-6272-4e0f-9092-aa28dd322eea admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:50.113644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68ccab-6272-4e0f-9092-aa28dd322eea admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:50.113966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68ccab-6272-4e0f-9092-aa28dd322eea admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:50.118710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68ccab-6272-4e0f-9092-aa28dd322eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:50.124451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68ccab-6272-4e0f-9092-aa28dd322eea admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:50.170742 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3823/7640] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:49 2022] GET /identity/v3/roles => generated 2322 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:52:50.173397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:50.174363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68ccab-6272-4e0f-9092-aa28dd322eea admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:50.183296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf4f67-fbbe-4a87-bc44-0b492cdfd282 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:50.190763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48cc50-8e4d-4b8c-a65a-8e61793e0326 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:50.191835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48cc50-8e4d-4b8c-a65a-8e61793e0326 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:50.192779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48cc50-8e4d-4b8c-a65a-8e61793e0326 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:50.193273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48cc50-8e4d-4b8c-a65a-8e61793e0326 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/3d8d4e3ecf374ec5ba1cdcc687255d79/implies/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:50.198655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68ccab-6272-4e0f-9092-aa28dd322eea admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:50.200547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48cc50-8e4d-4b8c-a65a-8e61793e0326 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3d8d4e3ecf374ec5ba1cdcc687255d79, implied_role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:50.209945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48cc50-8e4d-4b8c-a65a-8e61793e0326 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:50.272425 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3818/7641] 10.222.0.27 () {60 vars in 1363 bytes} [Sun Aug 28 18:52:50 2022] PUT /identity/v3/roles/3d8d4e3ecf374ec5ba1cdcc687255d79/implies/d9e4c527d1574bf3b6dc32da701b4c39 => generated 520 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:50.275489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48cc50-8e4d-4b8c-a65a-8e61793e0326 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:50.319420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64ed2e-6330-4b3a-9e1b-01c939b33e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:50.320528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64ed2e-6330-4b3a-9e1b-01c939b33e1a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:50.320816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64ed2e-6330-4b3a-9e1b-01c939b33e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:50.321098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64ed2e-6330-4b3a-9e1b-01c939b33e1a admin admin] PATH_INFO: `/v3/projects/1df8454ce8854d128fb7b73d85d7ded1/users/60f97d80ddec402781f0cbe899957380/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:50.370167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64ed2e-6330-4b3a-9e1b-01c939b33e1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df8454ce8854d128fb7b73d85d7ded1, user_id=60f97d80ddec402781f0cbe899957380, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:50.375851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64ed2e-6330-4b3a-9e1b-01c939b33e1a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:50.441483 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3824/7642] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:50 2022] PUT /identity/v3/projects/1df8454ce8854d128fb7b73d85d7ded1/users/60f97d80ddec402781f0cbe899957380/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:50.445132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00b960-abac-4e6e-a330-b1be383b0e09 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:50.445823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00b960-abac-4e6e-a330-b1be383b0e09 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:50.446233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00b960-abac-4e6e-a330-b1be383b0e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:50.477417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48cc50-8e4d-4b8c-a65a-8e61793e0326 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:50.513462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ee00b960-abac-4e6e-a330-b1be383b0e09 None None] MFA Rules not processed for user `60f97d80ddec402781f0cbe899957380`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:50.523023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ee00b960-abac-4e6e-a330-b1be383b0e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:50.590308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1e4f9-4805-4b6a-9880-fcd89b308aae tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:50.591431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1e4f9-4805-4b6a-9880-fcd89b308aae tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:50.591962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1e4f9-4805-4b6a-9880-fcd89b308aae tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:50.592485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1e4f9-4805-4b6a-9880-fcd89b308aae tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/3d8d4e3ecf374ec5ba1cdcc687255d79/implies` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:50.595021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1e4f9-4805-4b6a-9880-fcd89b308aae tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=3d8d4e3ecf374ec5ba1cdcc687255d79)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:50.597005 n-d-850468-20 devstack@keystone.service[82161]: WARNING py.warnings [None req-18a1e4f9-4805-4b6a-9880-fcd89b308aae tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:52:50.597005 n-d-850468-20 devstack@keystone.service[82161]: warnings.warn(msg) Aug 28 18:52:50.597005 n-d-850468-20 devstack@keystone.service[82161]: Aug 28 18:52:50.598327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1e4f9-4805-4b6a-9880-fcd89b308aae tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:50.607550 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3819/7643] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Aug 28 18:52:50 2022] GET /identity/v3/roles/3d8d4e3ecf374ec5ba1cdcc687255d79/implies => generated 489 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:50.613043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1e4f9-4805-4b6a-9880-fcd89b308aae tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:50.630525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1e4f9-4805-4b6a-9880-fcd89b308aae tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:50.637110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13715a50-864d-4460-9161-66ce1cbb132b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:50.638143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13715a50-864d-4460-9161-66ce1cbb132b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:50.638636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13715a50-864d-4460-9161-66ce1cbb132b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:50.639447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13715a50-864d-4460-9161-66ce1cbb132b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:50.640925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13715a50-864d-4460-9161-66ce1cbb132b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=dce83b6d620442be9aa578f2ff592d19)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:50.642813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13715a50-864d-4460-9161-66ce1cbb132b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:50.651937 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3820/7644] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Aug 28 18:52:50 2022] GET /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies => generated 659 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:52:50.656183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13715a50-864d-4460-9161-66ce1cbb132b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:50.677452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13715a50-864d-4460-9161-66ce1cbb132b tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:50.684270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896700d-fab4-44e3-a117-f3efd75e5401 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:50.685340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896700d-fab4-44e3-a117-f3efd75e5401 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:50.685851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896700d-fab4-44e3-a117-f3efd75e5401 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:50.686334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896700d-fab4-44e3-a117-f3efd75e5401 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/3d8d4e3ecf374ec5ba1cdcc687255d79/implies/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:50.689724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896700d-fab4-44e3-a117-f3efd75e5401 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=3d8d4e3ecf374ec5ba1cdcc687255d79, implied_role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:50.691942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896700d-fab4-44e3-a117-f3efd75e5401 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:50.713892 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3821/7645] 10.222.0.27 () {58 vars in 1347 bytes} [Sun Aug 28 18:52:50 2022] DELETE /identity/v3/roles/3d8d4e3ecf374ec5ba1cdcc687255d79/implies/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:50.725953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896700d-fab4-44e3-a117-f3efd75e5401 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:50.730169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:50.795384 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3825/7646] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:52:50.811935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00b960-abac-4e6e-a330-b1be383b0e09 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:50.815965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ee00b960-abac-4e6e-a330-b1be383b0e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:50.897584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896700d-fab4-44e3-a117-f3efd75e5401 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:50.918089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369000d-7a0d-46ae-8ce8-7abbbca855c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:50.919298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369000d-7a0d-46ae-8ce8-7abbbca855c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:50.920693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369000d-7a0d-46ae-8ce8-7abbbca855c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:50.921449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369000d-7a0d-46ae-8ce8-7abbbca855c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/3d8d4e3ecf374ec5ba1cdcc687255d79` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:50.924818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369000d-7a0d-46ae-8ce8-7abbbca855c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=3d8d4e3ecf374ec5ba1cdcc687255d79)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:50.927590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369000d-7a0d-46ae-8ce8-7abbbca855c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:50.942738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:50.966743 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3822/7647] 10.222.0.27 () {58 vars in 1347 bytes} [Sun Aug 28 18:52:50 2022] DELETE /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/3d8d4e3ecf374ec5ba1cdcc687255d79 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:50.974438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369000d-7a0d-46ae-8ce8-7abbbca855c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:50.977863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00b960-abac-4e6e-a330-b1be383b0e09 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:51.108609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369000d-7a0d-46ae-8ce8-7abbbca855c3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:51.126230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc2810-f45b-4e44-ac4c-5cb43beb7a19 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:51.126994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc2810-f45b-4e44-ac4c-5cb43beb7a19 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:51.127354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc2810-f45b-4e44-ac4c-5cb43beb7a19 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:51.127671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc2810-f45b-4e44-ac4c-5cb43beb7a19 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:51.133787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc2810-f45b-4e44-ac4c-5cb43beb7a19 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=dce83b6d620442be9aa578f2ff592d19, implied_role_id=0729ef3d5be24f0cb69bcdf3d13ec839)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:51.136016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc2810-f45b-4e44-ac4c-5cb43beb7a19 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:51.155334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ae910-e060-4d51-a7ed-34cbe7524131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:51.156295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ae910-e060-4d51-a7ed-34cbe7524131 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:51.156681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ae910-e060-4d51-a7ed-34cbe7524131 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:51.157466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ae910-e060-4d51-a7ed-34cbe7524131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:51.167111 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3823/7648] 10.222.0.27 () {58 vars in 1347 bytes} [Sun Aug 28 18:52:50 2022] DELETE /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19/implies/0729ef3d5be24f0cb69bcdf3d13ec839 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:51.168977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc2810-f45b-4e44-ac4c-5cb43beb7a19 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:51.364026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ae910-e060-4d51-a7ed-34cbe7524131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:51.369587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ae910-e060-4d51-a7ed-34cbe7524131 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:51.375986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc2810-f45b-4e44-ac4c-5cb43beb7a19 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:51.402622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ff189-621a-4b58-a687-6061394463b3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:51.407933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ff189-621a-4b58-a687-6061394463b3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:51.408553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ff189-621a-4b58-a687-6061394463b3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:51.409710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ff189-621a-4b58-a687-6061394463b3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/domains/b182801305424f20b981e925a2f970f3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:51.431008 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3826/7649] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:51.485842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ff189-621a-4b58-a687-6061394463b3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:52:51.492135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a83ff189-621a-4b58-a687-6061394463b3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Could not find domain: b182801305424f20b981e925a2f970f3.: keystone.exception.DomainNotFound: Could not find domain: b182801305424f20b981e925a2f970f3. Aug 28 18:52:51.492135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:52:51.492135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:52:51.492135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:52:51.492135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:52:51.492135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:52:51.492135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:52:51.492135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:52:51.492135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b182801305424f20b981e925a2f970f3. Aug 28 18:52:51.492135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:52:51.492135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:52:51.492135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:52:51.492135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:52:51.492135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:52:51.492135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:52:51.492135 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:52:51.493568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:52:51.493568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:52:51.493568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:52:51.493568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:52:51.493568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:52:51.493568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:52:51.493568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:52:51.493568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 18:52:51.493568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 18:52:51.493568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:52:51.493568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:52:51.493568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:52:51.493568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:52:51.493568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:52:51.493568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:52:51.493568 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:52:51.494979 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:52:51.494979 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:52:51.494979 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:52:51.494979 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:52:51.494979 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Aug 28 18:52:51.494979 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:52:51.494979 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:52:51.494979 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:52:51.494979 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:52:51.494979 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:52:51.494979 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:52:51.494979 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:52:51.494979 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:52:51.494979 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:52:51.494979 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:52:51.494979 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b182801305424f20b981e925a2f970f3. Aug 28 18:52:51.494979 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 18:52:51.496198 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3824/7650] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:52:51 2022] PATCH /identity/v3/domains/b182801305424f20b981e925a2f970f3 => generated 112 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 18:52:51.497870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ae910-e060-4d51-a7ed-34cbe7524131 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:51.524912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ae910-e060-4d51-a7ed-34cbe7524131 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:51.544920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e140b96-2d40-4262-94a5-0f98b1973b8d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:51.546132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e140b96-2d40-4262-94a5-0f98b1973b8d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:51.547074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e140b96-2d40-4262-94a5-0f98b1973b8d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:51.548298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e140b96-2d40-4262-94a5-0f98b1973b8d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/users/fa60bbd2c35241bf8dd101dcc2b5251a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:51.606448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e140b96-2d40-4262-94a5-0f98b1973b8d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fa60bbd2c35241bf8dd101dcc2b5251a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:51.610783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e140b96-2d40-4262-94a5-0f98b1973b8d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:51.741231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e140b96-2d40-4262-94a5-0f98b1973b8d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa60bbd2c35241bf8dd101dcc2b5251a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:51.744850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:51.774978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e140b96-2d40-4262-94a5-0f98b1973b8d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa60bbd2c35241bf8dd101dcc2b5251a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:51.777243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e140b96-2d40-4262-94a5-0f98b1973b8d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa60bbd2c35241bf8dd101dcc2b5251a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:51.778212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e140b96-2d40-4262-94a5-0f98b1973b8d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa60bbd2c35241bf8dd101dcc2b5251a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:51.807095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e140b96-2d40-4262-94a5-0f98b1973b8d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa60bbd2c35241bf8dd101dcc2b5251a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:51.883616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ff189-621a-4b58-a687-6061394463b3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:51.884498 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3827/7651] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:51 2022] DELETE /identity/v3/users/fa60bbd2c35241bf8dd101dcc2b5251a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:51.885509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a83ff189-621a-4b58-a687-6061394463b3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:51.921206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ff189-621a-4b58-a687-6061394463b3 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:52.131721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74b125-db1c-4b51-9344-42f492233c76 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:52.136183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74b125-db1c-4b51-9344-42f492233c76 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:52.136503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74b125-db1c-4b51-9344-42f492233c76 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:52.136782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74b125-db1c-4b51-9344-42f492233c76 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/d9e4c527d1574bf3b6dc32da701b4c39` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:52.138655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74b125-db1c-4b51-9344-42f492233c76 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d9e4c527d1574bf3b6dc32da701b4c39)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:52.144621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74b125-db1c-4b51-9344-42f492233c76 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:52.236279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:52.246335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ab74b125-db1c-4b51-9344-42f492233c76 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invalidating the token cache because role d9e4c527d1574bf3b6dc32da701b4c39 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:52.250384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ab74b125-db1c-4b51-9344-42f492233c76 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:52.251225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ab74b125-db1c-4b51-9344-42f492233c76 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:52.257869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e140b96-2d40-4262-94a5-0f98b1973b8d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:52.263378 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3825/7652] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:51 2022] DELETE /identity/v3/roles/d9e4c527d1574bf3b6dc32da701b4c39 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:52.274871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e140b96-2d40-4262-94a5-0f98b1973b8d tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:52.407479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c7d28-a736-46f5-bac6-d97276a00356 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:52.408130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c7d28-a736-46f5-bac6-d97276a00356 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:52.408413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c7d28-a736-46f5-bac6-d97276a00356 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:52.408689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c7d28-a736-46f5-bac6-d97276a00356 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/groups/331fe4ca2e29421b99e6e74a3a06411f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:52.412032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c7d28-a736-46f5-bac6-d97276a00356 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_group(group_id=331fe4ca2e29421b99e6e74a3a06411f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:52.416304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c7d28-a736-46f5-bac6-d97276a00356 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:52.594996 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3828/7653] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Aug 28 18:52:52 2022] DELETE /identity/v3/groups/331fe4ca2e29421b99e6e74a3a06411f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:52.602587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74b125-db1c-4b51-9344-42f492233c76 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:52.604789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab74b125-db1c-4b51-9344-42f492233c76 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:52.633440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74b125-db1c-4b51-9344-42f492233c76 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:52.769120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7d2ec-c6d8-46fd-9626-446878ff0ad1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:52.769915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d2ec-c6d8-46fd-9626-446878ff0ad1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:52.770261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d2ec-c6d8-46fd-9626-446878ff0ad1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:52.770601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d2ec-c6d8-46fd-9626-446878ff0ad1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/projects/054efde02752418a9cfb0951281585b4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:52.773297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7d2ec-c6d8-46fd-9626-446878ff0ad1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_project(project_id=054efde02752418a9cfb0951281585b4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:52.784023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7d2ec-c6d8-46fd-9626-446878ff0ad1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:52.893764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88f7d2ec-c6d8-46fd-9626-446878ff0ad1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054efde02752418a9cfb0951281585b4', 'request_id': 'req-88f7d2ec-c6d8-46fd-9626-446878ff0ad1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:52.912987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88f7d2ec-c6d8-46fd-9626-446878ff0ad1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054efde02752418a9cfb0951281585b4', 'request_id': 'req-88f7d2ec-c6d8-46fd-9626-446878ff0ad1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:52.923908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88f7d2ec-c6d8-46fd-9626-446878ff0ad1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054efde02752418a9cfb0951281585b4', 'request_id': 'req-88f7d2ec-c6d8-46fd-9626-446878ff0ad1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:52.949902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88f7d2ec-c6d8-46fd-9626-446878ff0ad1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] The token cache is being invalidate because project 054efde02752418a9cfb0951281585b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:52.950741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88f7d2ec-c6d8-46fd-9626-446878ff0ad1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:52.951933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88f7d2ec-c6d8-46fd-9626-446878ff0ad1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:52.955930 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3826/7654] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:52 2022] DELETE /identity/v3/projects/054efde02752418a9cfb0951281585b4 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:52.960351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c7d28-a736-46f5-bac6-d97276a00356 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:52.963626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-775c7d28-a736-46f5-bac6-d97276a00356 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:52.981218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c7d28-a736-46f5-bac6-d97276a00356 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:53.102575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b308f83-3612-4706-829c-586f6d64cc66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:53.103224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b308f83-3612-4706-829c-586f6d64cc66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:53.103665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b308f83-3612-4706-829c-586f6d64cc66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:53.103956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b308f83-3612-4706-829c-586f6d64cc66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:53.105420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b308f83-3612-4706-829c-586f6d64cc66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8e564fa64daf4f2fb19fc5ec2ed5d014)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:53.107142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b308f83-3612-4706-829c-586f6d64cc66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:53.135495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3b308f83-3612-4706-829c-586f6d64cc66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8e564fa64daf4f2fb19fc5ec2ed5d014'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:53.136664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3b308f83-3612-4706-829c-586f6d64cc66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8e564fa64daf4f2fb19fc5ec2ed5d014'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:53.149362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:53.174289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3b308f83-3612-4706-829c-586f6d64cc66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8e564fa64daf4f2fb19fc5ec2ed5d014'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:53.175667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3b308f83-3612-4706-829c-586f6d64cc66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8e564fa64daf4f2fb19fc5ec2ed5d014'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:53.179331 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3829/7655] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Aug 28 18:52:52 2022] PATCH /identity/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014 => generated 278 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:53.183428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7d2ec-c6d8-46fd-9626-446878ff0ad1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:53.198959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7d2ec-c6d8-46fd-9626-446878ff0ad1 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:53.340547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:53.341407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:53.345504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:53.346925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:53.378556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8e564fa64daf4f2fb19fc5ec2ed5d014)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:53.380298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:53.438521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8e564fa64daf4f2fb19fc5ec2ed5d014'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:53.440249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:53.459168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8e564fa64daf4f2fb19fc5ec2ed5d014'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:53.551008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e564fa64daf4f2fb19fc5ec2ed5d014', 'request_id': 'req-195062e4-cbb1-4e2c-babc-c6604f850a1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:53.577584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e564fa64daf4f2fb19fc5ec2ed5d014', 'request_id': 'req-195062e4-cbb1-4e2c-babc-c6604f850a1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:53.585336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e564fa64daf4f2fb19fc5ec2ed5d014', 'request_id': 'req-195062e4-cbb1-4e2c-babc-c6604f850a1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:53.627211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] The token cache is being invalidate because project 8e564fa64daf4f2fb19fc5ec2ed5d014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:53.627754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:53.628604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:53.660672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8e564fa64daf4f2fb19fc5ec2ed5d014', 'request_id': 'req-195062e4-cbb1-4e2c-babc-c6604f850a1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:53.661585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8e564fa64daf4f2fb19fc5ec2ed5d014', 'request_id': 'req-195062e4-cbb1-4e2c-babc-c6604f850a1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:53.671984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8e564fa64daf4f2fb19fc5ec2ed5d014', 'request_id': 'req-195062e4-cbb1-4e2c-babc-c6604f850a1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:53.684962 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3827/7656] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:52:53 2022] DELETE /identity/v3/domains/8e564fa64daf4f2fb19fc5ec2ed5d014 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:53.689212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b308f83-3612-4706-829c-586f6d64cc66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:53.691675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3b308f83-3612-4706-829c-586f6d64cc66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:53.720397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b308f83-3612-4706-829c-586f6d64cc66 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:53.832702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa43c6-5eab-4f77-a5b5-c948898c38ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:53.833352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa43c6-5eab-4f77-a5b5-c948898c38ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:53.833633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa43c6-5eab-4f77-a5b5-c948898c38ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:53.833908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa43c6-5eab-4f77-a5b5-c948898c38ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/3d8d4e3ecf374ec5ba1cdcc687255d79` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:53.836783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa43c6-5eab-4f77-a5b5-c948898c38ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3d8d4e3ecf374ec5ba1cdcc687255d79)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:53.838979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa43c6-5eab-4f77-a5b5-c948898c38ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:53.899706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0faa43c6-5eab-4f77-a5b5-c948898c38ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invalidating the token cache because role 3d8d4e3ecf374ec5ba1cdcc687255d79 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:53.900007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0faa43c6-5eab-4f77-a5b5-c948898c38ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:53.902036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0faa43c6-5eab-4f77-a5b5-c948898c38ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:53.906767 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3830/7657] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:53 2022] DELETE /identity/v3/roles/3d8d4e3ecf374ec5ba1cdcc687255d79 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:53.910934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:53.912583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:53.932036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195062e4-cbb1-4e2c-babc-c6604f850a1e tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:54.017090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fb40d-bb71-44d6-9aec-506d623c6844 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:54.018150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb40d-bb71-44d6-9aec-506d623c6844 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:54.018567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb40d-bb71-44d6-9aec-506d623c6844 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:54.018952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb40d-bb71-44d6-9aec-506d623c6844 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/0729ef3d5be24f0cb69bcdf3d13ec839` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:54.020719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fb40d-bb71-44d6-9aec-506d623c6844 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0729ef3d5be24f0cb69bcdf3d13ec839)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:54.022925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fb40d-bb71-44d6-9aec-506d623c6844 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:54.105403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-328fb40d-bb71-44d6-9aec-506d623c6844 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invalidating the token cache because role 0729ef3d5be24f0cb69bcdf3d13ec839 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:54.105729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-328fb40d-bb71-44d6-9aec-506d623c6844 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:54.107169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-328fb40d-bb71-44d6-9aec-506d623c6844 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:54.115198 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3828/7658] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:53 2022] DELETE /identity/v3/roles/0729ef3d5be24f0cb69bcdf3d13ec839 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:54.116643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa43c6-5eab-4f77-a5b5-c948898c38ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:54.119332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0faa43c6-5eab-4f77-a5b5-c948898c38ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:54.154698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa43c6-5eab-4f77-a5b5-c948898c38ec tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:54.245131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40372bc-56c2-4967-b9cd-515ae86ee350 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8285c33fef4d31afac12b8ec80c9f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f678e7534f2b4918b4cc18d1334c9cc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:54.246625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40372bc-56c2-4967-b9cd-515ae86ee350 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:54.247154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40372bc-56c2-4967-b9cd-515ae86ee350 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:54.247698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40372bc-56c2-4967-b9cd-515ae86ee350 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] PATH_INFO: `/v3/roles/dce83b6d620442be9aa578f2ff592d19` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:54.249555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40372bc-56c2-4967-b9cd-515ae86ee350 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dce83b6d620442be9aa578f2ff592d19)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:54.252183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40372bc-56c2-4967-b9cd-515ae86ee350 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:54.318552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c40372bc-56c2-4967-b9cd-515ae86ee350 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invalidating the token cache because role dce83b6d620442be9aa578f2ff592d19 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:54.319121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c40372bc-56c2-4967-b9cd-515ae86ee350 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:54.320102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c40372bc-56c2-4967-b9cd-515ae86ee350 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:54.323740 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3831/7659] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:54 2022] DELETE /identity/v3/roles/dce83b6d620442be9aa578f2ff592d19 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:54.327489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fb40d-bb71-44d6-9aec-506d623c6844 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:54.329630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-328fb40d-bb71-44d6-9aec-506d623c6844 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:54.380202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:54.442659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fb40d-bb71-44d6-9aec-506d623c6844 tempest-RolesV3TestJSON-1882146789 tempest-RolesV3TestJSON-1882146789-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:54.566470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830b1e5-1b7c-4f7c-b02c-192a88efa69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:54.568494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830b1e5-1b7c-4f7c-b02c-192a88efa69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:54.569682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830b1e5-1b7c-4f7c-b02c-192a88efa69e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:54.570322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830b1e5-1b7c-4f7c-b02c-192a88efa69e admin admin] PATH_INFO: `/v3/users/743f381df0164ccbae8aae549467042a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:54.573120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830b1e5-1b7c-4f7c-b02c-192a88efa69e admin admin] RBAC: Authorizing `identity:delete_user(user_id=743f381df0164ccbae8aae549467042a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:54.575940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830b1e5-1b7c-4f7c-b02c-192a88efa69e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:54.771563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b830b1e5-1b7c-4f7c-b02c-192a88efa69e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '743f381df0164ccbae8aae549467042a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:54.776838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b830b1e5-1b7c-4f7c-b02c-192a88efa69e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '743f381df0164ccbae8aae549467042a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:54.797102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b830b1e5-1b7c-4f7c-b02c-192a88efa69e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '743f381df0164ccbae8aae549467042a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:54.818601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b830b1e5-1b7c-4f7c-b02c-192a88efa69e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '743f381df0164ccbae8aae549467042a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:54.850809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b830b1e5-1b7c-4f7c-b02c-192a88efa69e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '743f381df0164ccbae8aae549467042a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:54.866861 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3829/7660] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:54 2022] DELETE /identity/v3/users/743f381df0164ccbae8aae549467042a => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:54.868317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670a07e-4fba-45ab-bd6c-17e5cb643ce9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:54.869079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670a07e-4fba-45ab-bd6c-17e5cb643ce9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:54.869446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670a07e-4fba-45ab-bd6c-17e5cb643ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:54.900999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1670a07e-4fba-45ab-bd6c-17e5cb643ce9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:54.902384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1670a07e-4fba-45ab-bd6c-17e5cb643ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:54.929504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:55.031957 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3832/7661] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:55.041253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830b1e5-1b7c-4f7c-b02c-192a88efa69e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:55.042847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b830b1e5-1b7c-4f7c-b02c-192a88efa69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:55.281209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830b1e5-1b7c-4f7c-b02c-192a88efa69e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:55.297489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2ffc4-f65b-4801-8fd9-58ff6955093f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:55.298285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2ffc4-f65b-4801-8fd9-58ff6955093f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:55.298619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2ffc4-f65b-4801-8fd9-58ff6955093f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:55.298967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2ffc4-f65b-4801-8fd9-58ff6955093f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:55.332311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2ffc4-f65b-4801-8fd9-58ff6955093f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:55.332626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2ffc4-f65b-4801-8fd9-58ff6955093f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:55.342421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:55.355699 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3830/7662] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:56.535420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670a07e-4fba-45ab-bd6c-17e5cb643ce9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:56.537908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1670a07e-4fba-45ab-bd6c-17e5cb643ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:56.558940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670a07e-4fba-45ab-bd6c-17e5cb643ce9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:56.569455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddd543-a27f-49c6-b94d-59726cd497cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:56.569455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddd543-a27f-49c6-b94d-59726cd497cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:56.569455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddd543-a27f-49c6-b94d-59726cd497cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:56.569455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddd543-a27f-49c6-b94d-59726cd497cf admin admin] PATH_INFO: `/v3/projects/3adfbe8d78c542b8abd7f98d6c10fcaa` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:56.572649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddd543-a27f-49c6-b94d-59726cd497cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3adfbe8d78c542b8abd7f98d6c10fcaa)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:56.586626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddd543-a27f-49c6-b94d-59726cd497cf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:56.730561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-beddd543-a27f-49c6-b94d-59726cd497cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3adfbe8d78c542b8abd7f98d6c10fcaa', 'request_id': 'req-beddd543-a27f-49c6-b94d-59726cd497cf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:56.753715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-beddd543-a27f-49c6-b94d-59726cd497cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3adfbe8d78c542b8abd7f98d6c10fcaa', 'request_id': 'req-beddd543-a27f-49c6-b94d-59726cd497cf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:56.766485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-beddd543-a27f-49c6-b94d-59726cd497cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3adfbe8d78c542b8abd7f98d6c10fcaa', 'request_id': 'req-beddd543-a27f-49c6-b94d-59726cd497cf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:56.793085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-beddd543-a27f-49c6-b94d-59726cd497cf admin admin] The token cache is being invalidate because project 3adfbe8d78c542b8abd7f98d6c10fcaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:56.793564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-beddd543-a27f-49c6-b94d-59726cd497cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:56.805763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-beddd543-a27f-49c6-b94d-59726cd497cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:56.811891 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3833/7663] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:56 2022] DELETE /identity/v3/projects/3adfbe8d78c542b8abd7f98d6c10fcaa => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:56.817676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2ffc4-f65b-4801-8fd9-58ff6955093f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:56.830767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2ffc4-f65b-4801-8fd9-58ff6955093f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:56.902258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddd543-a27f-49c6-b94d-59726cd497cf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:56.904970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-beddd543-a27f-49c6-b94d-59726cd497cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:56.976847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17362b-2cf2-4600-a605-01abedd42eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:56.981647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17362b-2cf2-4600-a605-01abedd42eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:56.981938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17362b-2cf2-4600-a605-01abedd42eee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:56.982204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17362b-2cf2-4600-a605-01abedd42eee admin admin] PATH_INFO: `/v3/users/ac8285c33fef4d31afac12b8ec80c9f7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:56.990036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17362b-2cf2-4600-a605-01abedd42eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8285c33fef4d31afac12b8ec80c9f7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:56.998308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17362b-2cf2-4600-a605-01abedd42eee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:57.050654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddd543-a27f-49c6-b94d-59726cd497cf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:57.076713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce899c6-ebc2-404c-bf7d-2a4c49378e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:57.080990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce899c6-ebc2-404c-bf7d-2a4c49378e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:57.083358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce899c6-ebc2-404c-bf7d-2a4c49378e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:57.085504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce899c6-ebc2-404c-bf7d-2a4c49378e57 admin admin] PATH_INFO: `/v3/users/84b840223840480293666cd1ecf96476` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:57.098613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce899c6-ebc2-404c-bf7d-2a4c49378e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b840223840480293666cd1ecf96476)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:57.108599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce899c6-ebc2-404c-bf7d-2a4c49378e57 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:57.241206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac17362b-2cf2-4600-a605-01abedd42eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8285c33fef4d31afac12b8ec80c9f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:57.244088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac17362b-2cf2-4600-a605-01abedd42eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8285c33fef4d31afac12b8ec80c9f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:57.280566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bce899c6-ebc2-404c-bf7d-2a4c49378e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b840223840480293666cd1ecf96476'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:57.286850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:57.289879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac17362b-2cf2-4600-a605-01abedd42eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8285c33fef4d31afac12b8ec80c9f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:57.342890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac17362b-2cf2-4600-a605-01abedd42eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8285c33fef4d31afac12b8ec80c9f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:57.374811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bce899c6-ebc2-404c-bf7d-2a4c49378e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b840223840480293666cd1ecf96476'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:57.379865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bce899c6-ebc2-404c-bf7d-2a4c49378e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b840223840480293666cd1ecf96476'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:57.381465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bce899c6-ebc2-404c-bf7d-2a4c49378e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b840223840480293666cd1ecf96476'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:57.411446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bce899c6-ebc2-404c-bf7d-2a4c49378e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b840223840480293666cd1ecf96476'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:57.420575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac17362b-2cf2-4600-a605-01abedd42eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8285c33fef4d31afac12b8ec80c9f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:57.439069 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3831/7664] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:56 2022] DELETE /identity/v3/users/ac8285c33fef4d31afac12b8ec80c9f7 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:57.479005 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3834/7665] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:56 2022] DELETE /identity/v3/users/84b840223840480293666cd1ecf96476 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:57.484113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98ffd-abfd-4c97-96b7-a0365d0bdfd6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:57.484967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98ffd-abfd-4c97-96b7-a0365d0bdfd6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:57.485607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98ffd-abfd-4c97-96b7-a0365d0bdfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:57.537043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-67e98ffd-abfd-4c97-96b7-a0365d0bdfd6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:57.542202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-67e98ffd-abfd-4c97-96b7-a0365d0bdfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:57.737708 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3832/7666] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:57.743755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce899c6-ebc2-404c-bf7d-2a4c49378e57 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:57.745411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bce899c6-ebc2-404c-bf7d-2a4c49378e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:57.856580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce899c6-ebc2-404c-bf7d-2a4c49378e57 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:57.882088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e4af3-d2d9-4b4f-8899-1bf80dbec8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:57.896143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e4af3-d2d9-4b4f-8899-1bf80dbec8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:57.897718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e4af3-d2d9-4b4f-8899-1bf80dbec8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:57.899564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e4af3-d2d9-4b4f-8899-1bf80dbec8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:57.940354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e4af3-d2d9-4b4f-8899-1bf80dbec8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:57.950659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e4af3-d2d9-4b4f-8899-1bf80dbec8e8 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:57.989885 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3835/7667] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:59.166521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e98ffd-abfd-4c97-96b7-a0365d0bdfd6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:59.169707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-67e98ffd-abfd-4c97-96b7-a0365d0bdfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:59.216472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e98ffd-abfd-4c97-96b7-a0365d0bdfd6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:59.231554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bd575-a154-43b0-8549-6e3957ddf218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:59.232351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bd575-a154-43b0-8549-6e3957ddf218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:59.232626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bd575-a154-43b0-8549-6e3957ddf218 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:59.232906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bd575-a154-43b0-8549-6e3957ddf218 admin admin] PATH_INFO: `/v3/projects/f678e7534f2b4918b4cc18d1334c9cc6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:59.239434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bd575-a154-43b0-8549-6e3957ddf218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f678e7534f2b4918b4cc18d1334c9cc6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:59.241527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bd575-a154-43b0-8549-6e3957ddf218 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:59.329413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:59.420385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-950bd575-a154-43b0-8549-6e3957ddf218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f678e7534f2b4918b4cc18d1334c9cc6', 'request_id': 'req-950bd575-a154-43b0-8549-6e3957ddf218'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:59.441855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-950bd575-a154-43b0-8549-6e3957ddf218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f678e7534f2b4918b4cc18d1334c9cc6', 'request_id': 'req-950bd575-a154-43b0-8549-6e3957ddf218'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:59.458357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-950bd575-a154-43b0-8549-6e3957ddf218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f678e7534f2b4918b4cc18d1334c9cc6', 'request_id': 'req-950bd575-a154-43b0-8549-6e3957ddf218'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:59.482275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-950bd575-a154-43b0-8549-6e3957ddf218 admin admin] The token cache is being invalidate because project f678e7534f2b4918b4cc18d1334c9cc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:59.482667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-950bd575-a154-43b0-8549-6e3957ddf218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:59.485608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-950bd575-a154-43b0-8549-6e3957ddf218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:59.488275 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3833/7668] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:59 2022] DELETE /identity/v3/projects/f678e7534f2b4918b4cc18d1334c9cc6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:59.494427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743d3f-96d2-4303-b4fa-24e15f9eacd9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:59.494987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743d3f-96d2-4303-b4fa-24e15f9eacd9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:59.495204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743d3f-96d2-4303-b4fa-24e15f9eacd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:59.571089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7b743d3f-96d2-4303-b4fa-24e15f9eacd9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:59.572577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7b743d3f-96d2-4303-b4fa-24e15f9eacd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:59.794202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bd575-a154-43b0-8549-6e3957ddf218 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:59.795997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-950bd575-a154-43b0-8549-6e3957ddf218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:59.860959 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3836/7669] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:59.871360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b73f0-3d91-4a9b-a39b-04f344d817e1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:59.871655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b73f0-3d91-4a9b-a39b-04f344d817e1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:59.871945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b73f0-3d91-4a9b-a39b-04f344d817e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:59.928747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-966b73f0-3d91-4a9b-a39b-04f344d817e1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:59.932376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-966b73f0-3d91-4a9b-a39b-04f344d817e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:59.946474 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3837/7670] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:59.951077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b73f0-3d91-4a9b-a39b-04f344d817e1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:59.973526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b73f0-3d91-4a9b-a39b-04f344d817e1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:59.980783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046b3bc-83cb-430e-a873-0a309fc3d9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:59.982895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046b3bc-83cb-430e-a873-0a309fc3d9fa admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:59.983414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046b3bc-83cb-430e-a873-0a309fc3d9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:59.984008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046b3bc-83cb-430e-a873-0a309fc3d9fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:59.986125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046b3bc-83cb-430e-a873-0a309fc3d9fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:59.986453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046b3bc-83cb-430e-a873-0a309fc3d9fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:59.988167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046b3bc-83cb-430e-a873-0a309fc3d9fa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:00.024859 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3838/7671] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:53:00.041513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046b3bc-83cb-430e-a873-0a309fc3d9fa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:00.060533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046b3bc-83cb-430e-a873-0a309fc3d9fa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:00.065994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bd575-a154-43b0-8549-6e3957ddf218 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:00.068249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f73ff-47b3-4287-bf2f-62a362e3da81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:00.069431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f73ff-47b3-4287-bf2f-62a362e3da81 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.070031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f73ff-47b3-4287-bf2f-62a362e3da81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.070533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f73ff-47b3-4287-bf2f-62a362e3da81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:00.072281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f73ff-47b3-4287-bf2f-62a362e3da81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:00.074716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f73ff-47b3-4287-bf2f-62a362e3da81 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:00.097073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4bc23-3e1c-4003-a835-2a07d96c2fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:00.097983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4bc23-3e1c-4003-a835-2a07d96c2fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.098427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4bc23-3e1c-4003-a835-2a07d96c2fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.098895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4bc23-3e1c-4003-a835-2a07d96c2fdb admin admin] PATH_INFO: `/v3/projects/03e0e963daeb4078b6e07050e0986804` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:00.101873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4bc23-3e1c-4003-a835-2a07d96c2fdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e0e963daeb4078b6e07050e0986804)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:00.109161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4bc23-3e1c-4003-a835-2a07d96c2fdb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:00.160186 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3839/7672] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:00 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:00.165169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f73ff-47b3-4287-bf2f-62a362e3da81 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:00.219788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50a4bc23-3e1c-4003-a835-2a07d96c2fdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e0e963daeb4078b6e07050e0986804', 'request_id': 'req-50a4bc23-3e1c-4003-a835-2a07d96c2fdb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:00.232099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50a4bc23-3e1c-4003-a835-2a07d96c2fdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e0e963daeb4078b6e07050e0986804', 'request_id': 'req-50a4bc23-3e1c-4003-a835-2a07d96c2fdb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:00.244840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:00.249932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50a4bc23-3e1c-4003-a835-2a07d96c2fdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e0e963daeb4078b6e07050e0986804', 'request_id': 'req-50a4bc23-3e1c-4003-a835-2a07d96c2fdb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:00.280492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50a4bc23-3e1c-4003-a835-2a07d96c2fdb admin admin] The token cache is being invalidate because project 03e0e963daeb4078b6e07050e0986804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:00.281164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50a4bc23-3e1c-4003-a835-2a07d96c2fdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:00.282487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50a4bc23-3e1c-4003-a835-2a07d96c2fdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:00.285855 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3834/7673] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:59 2022] DELETE /identity/v3/projects/03e0e963daeb4078b6e07050e0986804 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:00.292184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aa6a1-5276-4095-850a-c91a0f6a28df None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.293798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aa6a1-5276-4095-850a-c91a0f6a28df None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.294599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aa6a1-5276-4095-850a-c91a0f6a28df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:00.331293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-692aa6a1-5276-4095-850a-c91a0f6a28df None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:00.333427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-692aa6a1-5276-4095-850a-c91a0f6a28df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:00.337450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f73ff-47b3-4287-bf2f-62a362e3da81 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:00.394828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:00.427041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd38cb6-1043-4f28-ae37-5db788db80e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:00.428887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd38cb6-1043-4f28-ae37-5db788db80e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.429175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd38cb6-1043-4f28-ae37-5db788db80e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.429456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd38cb6-1043-4f28-ae37-5db788db80e0 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:00.433970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd38cb6-1043-4f28-ae37-5db788db80e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:00.442939 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd38cb6-1043-4f28-ae37-5db788db80e0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:00.494532 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3835/7674] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:00.499765 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3840/7675] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:00 2022] POST /identity/v3/users => generated 283 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:00.500520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e024a3-65a4-4f20-bb08-adae13176dbf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.500520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e024a3-65a4-4f20-bb08-adae13176dbf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.500888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e024a3-65a4-4f20-bb08-adae13176dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:00.503206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd38cb6-1043-4f28-ae37-5db788db80e0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:00.507734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3cd38cb6-1043-4f28-ae37-5db788db80e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:00.533310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-13e024a3-65a4-4f20-bb08-adae13176dbf None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:00.535829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13e024a3-65a4-4f20-bb08-adae13176dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:00.557104 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3836/7676] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:00.564431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e024a3-65a4-4f20-bb08-adae13176dbf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:00.582859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd38cb6-1043-4f28-ae37-5db788db80e0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:00.610465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e024a3-65a4-4f20-bb08-adae13176dbf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:00.610758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5218ff-bc60-44a3-9f6b-1673803de976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:00.612165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5218ff-bc60-44a3-9f6b-1673803de976 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.613470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5218ff-bc60-44a3-9f6b-1673803de976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.614306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5218ff-bc60-44a3-9f6b-1673803de976 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:00.627531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5218ff-bc60-44a3-9f6b-1673803de976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:00.629218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5218ff-bc60-44a3-9f6b-1673803de976 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:00.637369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec26c11-70d7-4df5-87d6-36a34ef57efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:00.643821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec26c11-70d7-4df5-87d6-36a34ef57efc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.644325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec26c11-70d7-4df5-87d6-36a34ef57efc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.644595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec26c11-70d7-4df5-87d6-36a34ef57efc admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:00.645341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec26c11-70d7-4df5-87d6-36a34ef57efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:00.645648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec26c11-70d7-4df5-87d6-36a34ef57efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:00.647352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec26c11-70d7-4df5-87d6-36a34ef57efc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:00.655978 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3841/7677] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:00.659206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5218ff-bc60-44a3-9f6b-1673803de976 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:00.690057 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3837/7678] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:00.693308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5218ff-bc60-44a3-9f6b-1673803de976 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:00.695557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec26c11-70d7-4df5-87d6-36a34ef57efc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:00.738965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec26c11-70d7-4df5-87d6-36a34ef57efc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:00.740089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677599bf-1461-4a58-b91c-d7079f10cada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:00.741369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677599bf-1461-4a58-b91c-d7079f10cada admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.741856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677599bf-1461-4a58-b91c-d7079f10cada admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.742931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677599bf-1461-4a58-b91c-d7079f10cada admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:00.744278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677599bf-1461-4a58-b91c-d7079f10cada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:00.750468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677599bf-1461-4a58-b91c-d7079f10cada admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:00.763293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961ea87-e18e-48c8-b39f-16ff9f590454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:00.763293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961ea87-e18e-48c8-b39f-16ff9f590454 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.763293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961ea87-e18e-48c8-b39f-16ff9f590454 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.763293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961ea87-e18e-48c8-b39f-16ff9f590454 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:00.763815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961ea87-e18e-48c8-b39f-16ff9f590454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:00.763815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961ea87-e18e-48c8-b39f-16ff9f590454 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:00.773931 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3842/7679] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:00.775014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677599bf-1461-4a58-b91c-d7079f10cada admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:00.814709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677599bf-1461-4a58-b91c-d7079f10cada admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:00.829875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767ab4b-2dce-471a-8ded-26f3f19bca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:00.831428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767ab4b-2dce-471a-8ded-26f3f19bca24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.832625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767ab4b-2dce-471a-8ded-26f3f19bca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.833307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767ab4b-2dce-471a-8ded-26f3f19bca24 admin admin] PATH_INFO: `/v3/projects/ba48e2b910d64bc5953f8cd8ab18ea49/users/4aaa5d32151b431b975ea59719ffcd7f/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:00.837725 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3838/7680] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:00 2022] POST /identity/v3/projects => generated 369 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:00.843724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961ea87-e18e-48c8-b39f-16ff9f590454 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:00.878108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767ab4b-2dce-471a-8ded-26f3f19bca24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba48e2b910d64bc5953f8cd8ab18ea49, user_id=4aaa5d32151b431b975ea59719ffcd7f, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:00.882283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767ab4b-2dce-471a-8ded-26f3f19bca24 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:00.942250 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3843/7681] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:00 2022] PUT /identity/v3/projects/ba48e2b910d64bc5953f8cd8ab18ea49/users/4aaa5d32151b431b975ea59719ffcd7f/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:00.956327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6ee3d-8c2b-4441-92f6-01d1a1749afc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.956687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6ee3d-8c2b-4441-92f6-01d1a1749afc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.957228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6ee3d-8c2b-4441-92f6-01d1a1749afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.020669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961ea87-e18e-48c8-b39f-16ff9f590454 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:01.076867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-79b6ee3d-8c2b-4441-92f6-01d1a1749afc None None] MFA Rules not processed for user `4aaa5d32151b431b975ea59719ffcd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:01.079135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-79b6ee3d-8c2b-4441-92f6-01d1a1749afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:01.175070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466d2b4-c47b-4c67-a051-317f90960c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:01.175741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466d2b4-c47b-4c67-a051-317f90960c38 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:01.176096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466d2b4-c47b-4c67-a051-317f90960c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:01.176380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466d2b4-c47b-4c67-a051-317f90960c38 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.177212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466d2b4-c47b-4c67-a051-317f90960c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:01.179222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466d2b4-c47b-4c67-a051-317f90960c38 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:01.225817 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3844/7682] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:01.228078 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3839/7683] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:00 2022] POST /identity/v3/users => generated 285 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:01.234682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466d2b4-c47b-4c67-a051-317f90960c38 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:01.236809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6ee3d-8c2b-4441-92f6-01d1a1749afc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:01.254396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466d2b4-c47b-4c67-a051-317f90960c38 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:01.266573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4e591-42a4-4643-8caf-e7b3f207c54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:01.267694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4e591-42a4-4643-8caf-e7b3f207c54e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:01.268185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4e591-42a4-4643-8caf-e7b3f207c54e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:01.268777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4e591-42a4-4643-8caf-e7b3f207c54e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.269988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4e591-42a4-4643-8caf-e7b3f207c54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:01.273216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6ee3d-8c2b-4441-92f6-01d1a1749afc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:01.273662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4e591-42a4-4643-8caf-e7b3f207c54e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:01.293717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b50b6-b2b3-4412-be3b-5d8514708331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:01.294665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b50b6-b2b3-4412-be3b-5d8514708331 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:01.298152 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3840/7684] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:01.300001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b50b6-b2b3-4412-be3b-5d8514708331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:01.305248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b50b6-b2b3-4412-be3b-5d8514708331 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.305548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4e591-42a4-4643-8caf-e7b3f207c54e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:01.309951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b50b6-b2b3-4412-be3b-5d8514708331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:01.314570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b50b6-b2b3-4412-be3b-5d8514708331 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:01.325931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4e591-42a4-4643-8caf-e7b3f207c54e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:01.330010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:01.333576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58acb3-1361-4de6-b40a-f8ac8e04b9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:01.334607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58acb3-1361-4de6-b40a-f8ac8e04b9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:01.335026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58acb3-1361-4de6-b40a-f8ac8e04b9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:01.335531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58acb3-1361-4de6-b40a-f8ac8e04b9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.336414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58acb3-1361-4de6-b40a-f8ac8e04b9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:01.339621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58acb3-1361-4de6-b40a-f8ac8e04b9d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:01.387047 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3841/7685] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:53:01.393196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58acb3-1361-4de6-b40a-f8ac8e04b9d1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:01.410120 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3845/7686] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:01 2022] POST /identity/v3/projects => generated 365 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:01.414431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b50b6-b2b3-4412-be3b-5d8514708331 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:01.423867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58acb3-1361-4de6-b40a-f8ac8e04b9d1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:01.429846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:01.592111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b50b6-b2b3-4412-be3b-5d8514708331 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:01.593733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636be06c-86c9-40d8-aa14-5fc521856946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:01.595091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be06c-86c9-40d8-aa14-5fc521856946 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:01.595501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be06c-86c9-40d8-aa14-5fc521856946 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:01.595855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be06c-86c9-40d8-aa14-5fc521856946 admin admin] PATH_INFO: `/v3/projects/c061e2a2a05f4804a15e3c5c8af33afd/users/4dbf82f29f6b47c792b6d52228ed7fb3/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.599774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3d53a-3483-4a12-ae7f-928b570be7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:01.600556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3d53a-3483-4a12-ae7f-928b570be7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:01.600922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3d53a-3483-4a12-ae7f-928b570be7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:01.601265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3d53a-3483-4a12-ae7f-928b570be7a7 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.602035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3d53a-3483-4a12-ae7f-928b570be7a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:01.604418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3d53a-3483-4a12-ae7f-928b570be7a7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:01.625950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636be06c-86c9-40d8-aa14-5fc521856946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c061e2a2a05f4804a15e3c5c8af33afd, user_id=4dbf82f29f6b47c792b6d52228ed7fb3, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:01.629034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636be06c-86c9-40d8-aa14-5fc521856946 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:01.646358 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3846/7687] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:01 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:53:01.647597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3d53a-3483-4a12-ae7f-928b570be7a7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:01.651245 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3842/7688] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:01 2022] PUT /identity/v3/projects/c061e2a2a05f4804a15e3c5c8af33afd/users/4dbf82f29f6b47c792b6d52228ed7fb3/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:01.665436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3d53a-3483-4a12-ae7f-928b570be7a7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:01.665959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f8762-7740-4958-b8bb-ce173c192592 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:01.666551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f8762-7740-4958-b8bb-ce173c192592 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:01.667133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f8762-7740-4958-b8bb-ce173c192592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.776658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-911f8762-7740-4958-b8bb-ce173c192592 None None] MFA Rules not processed for user `4dbf82f29f6b47c792b6d52228ed7fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:01.778942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d33155-1e45-4454-ba15-cb6aa9c4f0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:01.780856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-911f8762-7740-4958-b8bb-ce173c192592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:01.780988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d33155-1e45-4454-ba15-cb6aa9c4f0dc admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:01.780988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d33155-1e45-4454-ba15-cb6aa9c4f0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:01.780988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d33155-1e45-4454-ba15-cb6aa9c4f0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.780988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d33155-1e45-4454-ba15-cb6aa9c4f0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:01.782260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d33155-1e45-4454-ba15-cb6aa9c4f0dc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:01.800803 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3847/7689] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:53:01.805687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d33155-1e45-4454-ba15-cb6aa9c4f0dc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:01.848255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d33155-1e45-4454-ba15-cb6aa9c4f0dc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:01.857284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282a63f-ac78-4886-8449-d786009f17c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:01.858066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282a63f-ac78-4886-8449-d786009f17c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:01.859741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282a63f-ac78-4886-8449-d786009f17c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:01.860096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282a63f-ac78-4886-8449-d786009f17c9 admin admin] PATH_INFO: `/v3/projects/03776c643595444c9e335e534560b873/users/7d33336a392b4025836c03c190e59100/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.911699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282a63f-ac78-4886-8449-d786009f17c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03776c643595444c9e335e534560b873, user_id=7d33336a392b4025836c03c190e59100, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:01.918750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282a63f-ac78-4886-8449-d786009f17c9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:01.952088 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3848/7690] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:01 2022] PUT /identity/v3/projects/03776c643595444c9e335e534560b873/users/7d33336a392b4025836c03c190e59100/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:01.956045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282a63f-ac78-4886-8449-d786009f17c9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:01.971588 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3843/7691] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:01.983472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f8762-7740-4958-b8bb-ce173c192592 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:01.985931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-911f8762-7740-4958-b8bb-ce173c192592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:02.061304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:02.108044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282a63f-ac78-4886-8449-d786009f17c9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:02.117910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79b7f3-747e-4dd9-8ae5-4a348e3a23d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:02.118775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79b7f3-747e-4dd9-8ae5-4a348e3a23d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:02.119152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79b7f3-747e-4dd9-8ae5-4a348e3a23d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:02.119582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79b7f3-747e-4dd9-8ae5-4a348e3a23d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:02.120346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79b7f3-747e-4dd9-8ae5-4a348e3a23d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:02.122784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79b7f3-747e-4dd9-8ae5-4a348e3a23d1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:02.139316 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3849/7692] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:53:02.150692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79b7f3-747e-4dd9-8ae5-4a348e3a23d1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:02.169970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79b7f3-747e-4dd9-8ae5-4a348e3a23d1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:02.177353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafa8fd-bab0-44b2-9632-891ea0989037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:02.179774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafa8fd-bab0-44b2-9632-891ea0989037 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:02.180659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafa8fd-bab0-44b2-9632-891ea0989037 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:02.184794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafa8fd-bab0-44b2-9632-891ea0989037 admin admin] PATH_INFO: `/v3/projects/03776c643595444c9e335e534560b873/users/7d33336a392b4025836c03c190e59100/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:02.191024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafa8fd-bab0-44b2-9632-891ea0989037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03776c643595444c9e335e534560b873, user_id=7d33336a392b4025836c03c190e59100, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:02.195651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafa8fd-bab0-44b2-9632-891ea0989037 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:02.204888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f8762-7740-4958-b8bb-ce173c192592 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:02.223914 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3850/7693] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:02 2022] PUT /identity/v3/projects/03776c643595444c9e335e534560b873/users/7d33336a392b4025836c03c190e59100/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:02.234617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd01702-eb1e-4795-9b0d-01fbc770570d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:02.234996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd01702-eb1e-4795-9b0d-01fbc770570d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:02.235362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd01702-eb1e-4795-9b0d-01fbc770570d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:02.239422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:02.296337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-edd01702-eb1e-4795-9b0d-01fbc770570d None None] MFA Rules not processed for user `7d33336a392b4025836c03c190e59100`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:02.297624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-edd01702-eb1e-4795-9b0d-01fbc770570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:02.304373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c84f5a-33ee-42ec-8cb7-8a99d7812c6e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:02.305289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c84f5a-33ee-42ec-8cb7-8a99d7812c6e service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:02.305736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c84f5a-33ee-42ec-8cb7-8a99d7812c6e service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:02.306169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c84f5a-33ee-42ec-8cb7-8a99d7812c6e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:02.433991 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3851/7694] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:53:02.434573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c84f5a-33ee-42ec-8cb7-8a99d7812c6e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:02.435527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd01702-eb1e-4795-9b0d-01fbc770570d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:02.436307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c84f5a-33ee-42ec-8cb7-8a99d7812c6e service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:02.449778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd01702-eb1e-4795-9b0d-01fbc770570d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:02.458310 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3844/7695] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:02.480567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679792af-154c-4573-ad07-618eb1d54500 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:02.481630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679792af-154c-4573-ad07-618eb1d54500 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:02.482093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679792af-154c-4573-ad07-618eb1d54500 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:02.482552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679792af-154c-4573-ad07-618eb1d54500 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:02.483941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679792af-154c-4573-ad07-618eb1d54500 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:02.488441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679792af-154c-4573-ad07-618eb1d54500 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:02.550475 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3852/7696] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:02 2022] POST /identity/v3/projects => generated 358 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:02.552010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c84f5a-33ee-42ec-8cb7-8a99d7812c6e service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:02.567290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c84f5a-33ee-42ec-8cb7-8a99d7812c6e service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:02.717085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fa880-a647-4f8d-939c-74d18ea10b6f tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:02.719679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fa880-a647-4f8d-939c-74d18ea10b6f tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:02.720588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fa880-a647-4f8d-939c-74d18ea10b6f tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:02.721451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fa880-a647-4f8d-939c-74d18ea10b6f tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:02.722331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fa880-a647-4f8d-939c-74d18ea10b6f tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:02.726077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fa880-a647-4f8d-939c-74d18ea10b6f tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:02.825066 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3845/7697] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:02 2022] POST /identity/v3/users => generated 373 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:02.827726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679792af-154c-4573-ad07-618eb1d54500 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:02.842394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679792af-154c-4573-ad07-618eb1d54500 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:02.874449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd6c69-41f4-4700-b45e-fd9e42a41a16 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:02.875488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd6c69-41f4-4700-b45e-fd9e42a41a16 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:02.875845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd6c69-41f4-4700-b45e-fd9e42a41a16 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:02.876199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd6c69-41f4-4700-b45e-fd9e42a41a16 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users/679e79c3e4ae4994aad4891971d4e686` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:02.928437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd6c69-41f4-4700-b45e-fd9e42a41a16 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:get_user(user_id=679e79c3e4ae4994aad4891971d4e686)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:02.934848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd6c69-41f4-4700-b45e-fd9e42a41a16 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:02.940395 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3853/7698] 10.222.0.27 () {58 vars in 1221 bytes} [Sun Aug 28 18:53:02 2022] GET /identity/v3/users/679e79c3e4ae4994aad4891971d4e686 => generated 373 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:02.943282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fa880-a647-4f8d-939c-74d18ea10b6f tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:02.967562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fa880-a647-4f8d-939c-74d18ea10b6f tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:02.977679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6a952-1b8e-4030-a1fe-93271de2ab41 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:02.978691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6a952-1b8e-4030-a1fe-93271de2ab41 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:02.979172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6a952-1b8e-4030-a1fe-93271de2ab41 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:02.979494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6a952-1b8e-4030-a1fe-93271de2ab41 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users/679e79c3e4ae4994aad4891971d4e686` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:02.981569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6a952-1b8e-4030-a1fe-93271de2ab41 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:delete_user(user_id=679e79c3e4ae4994aad4891971d4e686)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:02.983677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6a952-1b8e-4030-a1fe-93271de2ab41 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:03.065401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3ab6a952-1b8e-4030-a1fe-93271de2ab41 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '679e79c3e4ae4994aad4891971d4e686'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:03.066258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3ab6a952-1b8e-4030-a1fe-93271de2ab41 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '679e79c3e4ae4994aad4891971d4e686'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:03.080268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3ab6a952-1b8e-4030-a1fe-93271de2ab41 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '679e79c3e4ae4994aad4891971d4e686'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:03.098463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3ab6a952-1b8e-4030-a1fe-93271de2ab41 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '679e79c3e4ae4994aad4891971d4e686'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:03.100557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:03.130003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3ab6a952-1b8e-4030-a1fe-93271de2ab41 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '679e79c3e4ae4994aad4891971d4e686'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:03.143613 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3846/7699] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:02 2022] DELETE /identity/v3/users/679e79c3e4ae4994aad4891971d4e686 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:03.147604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd6c69-41f4-4700-b45e-fd9e42a41a16 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:03.164416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e7bd6c69-41f4-4700-b45e-fd9e42a41a16 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:03.191628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd6c69-41f4-4700-b45e-fd9e42a41a16 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:03.316312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:03.317327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:03.317549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:03.317975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/projects/afe978bf9002456fa49438525bb3de44` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:03.319457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:delete_project(project_id=afe978bf9002456fa49438525bb3de44)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:03.322755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:03.375797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:03.437090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe978bf9002456fa49438525bb3de44', 'request_id': 'req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:03.457925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe978bf9002456fa49438525bb3de44', 'request_id': 'req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:03.488139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe978bf9002456fa49438525bb3de44', 'request_id': 'req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:03.532883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] The token cache is being invalidate because project afe978bf9002456fa49438525bb3de44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:03.533159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:03.539174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:03.547893 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3854/7700] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:03 2022] DELETE /identity/v3/projects/afe978bf9002456fa49438525bb3de44 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:03.555860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6a952-1b8e-4030-a1fe-93271de2ab41 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:03.620310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6a952-1b8e-4030-a1fe-93271de2ab41 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:03.786707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1a41d-94d3-41ff-8780-fea0637b0fa1 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:03.787924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1a41d-94d3-41ff-8780-fea0637b0fa1 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:03.788468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1a41d-94d3-41ff-8780-fea0637b0fa1 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:03.788960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1a41d-94d3-41ff-8780-fea0637b0fa1 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:03.789841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1a41d-94d3-41ff-8780-fea0637b0fa1 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:03.796751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1a41d-94d3-41ff-8780-fea0637b0fa1 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:03.869658 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3847/7701] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:03 2022] POST /identity/v3/projects => generated 360 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:03.870469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:03.873412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:03.911022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23570a-1dee-42e0-a1f7-ef38bd88a2a5 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:04.129460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ee0e4-9be4-4748-9583-cae9073a6b6d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:04.132473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ee0e4-9be4-4748-9583-cae9073a6b6d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:04.132852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ee0e4-9be4-4748-9583-cae9073a6b6d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:04.133133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ee0e4-9be4-4748-9583-cae9073a6b6d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:04.133843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ee0e4-9be4-4748-9583-cae9073a6b6d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:04.135936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ee0e4-9be4-4748-9583-cae9073a6b6d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:04.212604 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3855/7702] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:03 2022] POST /identity/v3/users => generated 417 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:04.217100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1a41d-94d3-41ff-8780-fea0637b0fa1 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:04.242341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1a41d-94d3-41ff-8780-fea0637b0fa1 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:04.272418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087180ca-3583-45f8-800e-73f3c0d68ee9 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:04.273263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087180ca-3583-45f8-800e-73f3c0d68ee9 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:04.273644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087180ca-3583-45f8-800e-73f3c0d68ee9 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:04.274021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087180ca-3583-45f8-800e-73f3c0d68ee9 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:04.275388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087180ca-3583-45f8-800e-73f3c0d68ee9 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:04.278148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087180ca-3583-45f8-800e-73f3c0d68ee9 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:04.323387 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3848/7703] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:53:04 2022] POST /identity/v3/roles => generated 240 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:04.325820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ee0e4-9be4-4748-9583-cae9073a6b6d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:04.338427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ee0e4-9be4-4748-9583-cae9073a6b6d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:04.344245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08531c2-f820-4f6f-9b9b-457893fe3008 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:04.345160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08531c2-f820-4f6f-9b9b-457893fe3008 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:04.345552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08531c2-f820-4f6f-9b9b-457893fe3008 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:04.345923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08531c2-f820-4f6f-9b9b-457893fe3008 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users/ceea9ffd352c4cf9b709c935444ed140` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:04.366390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08531c2-f820-4f6f-9b9b-457893fe3008 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:get_user(user_id=ceea9ffd352c4cf9b709c935444ed140)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:04.369533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08531c2-f820-4f6f-9b9b-457893fe3008 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:04.374091 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3856/7704] 10.222.0.27 () {58 vars in 1221 bytes} [Sun Aug 28 18:53:04 2022] GET /identity/v3/users/ceea9ffd352c4cf9b709c935444ed140 => generated 417 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:04.378784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087180ca-3583-45f8-800e-73f3c0d68ee9 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:04.400775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087180ca-3583-45f8-800e-73f3c0d68ee9 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:04.413356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0a441-fb16-48f6-a885-7ee7e512e0e9 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:04.415051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0a441-fb16-48f6-a885-7ee7e512e0e9 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:04.416140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0a441-fb16-48f6-a885-7ee7e512e0e9 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:04.416518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0a441-fb16-48f6-a885-7ee7e512e0e9 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/roles/4720efd426b342b085b3ae314418c1ad` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:04.420661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0a441-fb16-48f6-a885-7ee7e512e0e9 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:get_role(role_id=4720efd426b342b085b3ae314418c1ad)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:04.423435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0a441-fb16-48f6-a885-7ee7e512e0e9 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:04.431179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08531c2-f820-4f6f-9b9b-457893fe3008 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:04.433440 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3849/7705] 10.222.0.27 () {58 vars in 1221 bytes} [Sun Aug 28 18:53:04 2022] GET /identity/v3/roles/4720efd426b342b085b3ae314418c1ad => generated 240 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:04.452122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08531c2-f820-4f6f-9b9b-457893fe3008 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:04.458381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c48f5-1f88-44b3-9dd4-3e2783d356ed tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:04.459499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c48f5-1f88-44b3-9dd4-3e2783d356ed tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:04.459944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c48f5-1f88-44b3-9dd4-3e2783d356ed tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:04.460583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c48f5-1f88-44b3-9dd4-3e2783d356ed tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:04.461392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c48f5-1f88-44b3-9dd4-3e2783d356ed tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:04.464564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c48f5-1f88-44b3-9dd4-3e2783d356ed tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:04.518403 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3857/7706] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:04 2022] POST /identity/v3/projects => generated 359 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:04.522107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0a441-fb16-48f6-a885-7ee7e512e0e9 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:04.534975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0a441-fb16-48f6-a885-7ee7e512e0e9 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:04.634791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d492bcb-5934-4a32-89e1-301f8a484c43 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:04.636317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d492bcb-5934-4a32-89e1-301f8a484c43 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:04.637594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d492bcb-5934-4a32-89e1-301f8a484c43 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:04.638056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d492bcb-5934-4a32-89e1-301f8a484c43 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/projects/5432e36e8bcf484e9c3c24252e539b70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:04.640478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d492bcb-5934-4a32-89e1-301f8a484c43 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:get_project(project_id=5432e36e8bcf484e9c3c24252e539b70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:04.642945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d492bcb-5934-4a32-89e1-301f8a484c43 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:04.649385 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3850/7707] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:53:04 2022] GET /identity/v3/projects/5432e36e8bcf484e9c3c24252e539b70 => generated 359 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:04.653799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c48f5-1f88-44b3-9dd4-3e2783d356ed tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:04.671620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c48f5-1f88-44b3-9dd4-3e2783d356ed tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:04.721816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ddfaf-d352-4f4b-89b0-ae5996d5d862 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:04.722539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ddfaf-d352-4f4b-89b0-ae5996d5d862 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:04.722830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ddfaf-d352-4f4b-89b0-ae5996d5d862 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:04.723112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ddfaf-d352-4f4b-89b0-ae5996d5d862 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/projects/5432e36e8bcf484e9c3c24252e539b70/users/ceea9ffd352c4cf9b709c935444ed140/roles/4720efd426b342b085b3ae314418c1ad` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:04.725656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ddfaf-d352-4f4b-89b0-ae5996d5d862 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5432e36e8bcf484e9c3c24252e539b70, user_id=ceea9ffd352c4cf9b709c935444ed140, role_id=4720efd426b342b085b3ae314418c1ad)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:04.728649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ddfaf-d352-4f4b-89b0-ae5996d5d862 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:04.755366 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3858/7708] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:04 2022] PUT /identity/v3/projects/5432e36e8bcf484e9c3c24252e539b70/users/ceea9ffd352c4cf9b709c935444ed140/roles/4720efd426b342b085b3ae314418c1ad => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:04.757536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d492bcb-5934-4a32-89e1-301f8a484c43 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:04.773675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d492bcb-5934-4a32-89e1-301f8a484c43 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:04.915526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:04.936451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7150c2-9bb6-430b-8c43-dcd9f4ec6895 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:04.937435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7150c2-9bb6-430b-8c43-dcd9f4ec6895 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:04.937872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7150c2-9bb6-430b-8c43-dcd9f4ec6895 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:04.938199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7150c2-9bb6-430b-8c43-dcd9f4ec6895 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:04.938849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7150c2-9bb6-430b-8c43-dcd9f4ec6895 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:04.941026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7150c2-9bb6-430b-8c43-dcd9f4ec6895 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:05.046360 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3851/7709] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:04 2022] POST /identity/v3/projects => generated 358 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:05.050100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ddfaf-d352-4f4b-89b0-ae5996d5d862 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:05.075899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ddfaf-d352-4f4b-89b0-ae5996d5d862 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:05.197772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:05.249464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae09968-594c-4da4-97b7-6603de647d8e tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:05.250129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae09968-594c-4da4-97b7-6603de647d8e tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:05.250418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae09968-594c-4da4-97b7-6603de647d8e tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:05.250690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae09968-594c-4da4-97b7-6603de647d8e tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/projects/5d8ebe2ac162488493440137306c5fbe` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:05.252015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae09968-594c-4da4-97b7-6603de647d8e tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:get_project(project_id=5d8ebe2ac162488493440137306c5fbe)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:05.260239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae09968-594c-4da4-97b7-6603de647d8e tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:05.265027 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3859/7710] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Aug 28 18:53:05 2022] GET /identity/v3/projects/5d8ebe2ac162488493440137306c5fbe => generated 358 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:05.266850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7150c2-9bb6-430b-8c43-dcd9f4ec6895 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:05.284334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7150c2-9bb6-430b-8c43-dcd9f4ec6895 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:05.295479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122db0d3-4aa5-412b-b29c-6144ba7e63aa tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:05.297267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122db0d3-4aa5-412b-b29c-6144ba7e63aa tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:05.298445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122db0d3-4aa5-412b-b29c-6144ba7e63aa tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:05.300264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122db0d3-4aa5-412b-b29c-6144ba7e63aa tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/projects/5d8ebe2ac162488493440137306c5fbe/users/ceea9ffd352c4cf9b709c935444ed140/roles/4720efd426b342b085b3ae314418c1ad` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:05.307366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122db0d3-4aa5-412b-b29c-6144ba7e63aa tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5d8ebe2ac162488493440137306c5fbe, user_id=ceea9ffd352c4cf9b709c935444ed140, role_id=4720efd426b342b085b3ae314418c1ad)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:05.334292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122db0d3-4aa5-412b-b29c-6144ba7e63aa tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:05.389622 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3852/7711] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:05 2022] PUT /identity/v3/projects/5d8ebe2ac162488493440137306c5fbe/users/ceea9ffd352c4cf9b709c935444ed140/roles/4720efd426b342b085b3ae314418c1ad => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:05.393494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae09968-594c-4da4-97b7-6603de647d8e tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:05.419124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae09968-594c-4da4-97b7-6603de647d8e tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:05.619875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0573297-f049-4dc6-afe3-b3655a778a94 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:05.621015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0573297-f049-4dc6-afe3-b3655a778a94 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:05.621884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0573297-f049-4dc6-afe3-b3655a778a94 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:05.622353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0573297-f049-4dc6-afe3-b3655a778a94 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users/ceea9ffd352c4cf9b709c935444ed140/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:05.625138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0573297-f049-4dc6-afe3-b3655a778a94 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=ceea9ffd352c4cf9b709c935444ed140)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:05.628684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0573297-f049-4dc6-afe3-b3655a778a94 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:05.717347 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3860/7712] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Aug 28 18:53:05 2022] GET /identity/v3/users/ceea9ffd352c4cf9b709c935444ed140/projects => generated 841 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:05.721544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122db0d3-4aa5-412b-b29c-6144ba7e63aa tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:05.734953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122db0d3-4aa5-412b-b29c-6144ba7e63aa tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:05.754330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191ed44-775b-497d-be77-664ce35b49da tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:05.755053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191ed44-775b-497d-be77-664ce35b49da tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:05.755468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191ed44-775b-497d-be77-664ce35b49da tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:05.755745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191ed44-775b-497d-be77-664ce35b49da tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/projects/5d8ebe2ac162488493440137306c5fbe` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:05.756924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191ed44-775b-497d-be77-664ce35b49da tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5d8ebe2ac162488493440137306c5fbe)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:05.758904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191ed44-775b-497d-be77-664ce35b49da tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:05.870944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4191ed44-775b-497d-be77-664ce35b49da tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8ebe2ac162488493440137306c5fbe', 'request_id': 'req-4191ed44-775b-497d-be77-664ce35b49da'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:05.894959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4191ed44-775b-497d-be77-664ce35b49da tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8ebe2ac162488493440137306c5fbe', 'request_id': 'req-4191ed44-775b-497d-be77-664ce35b49da'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:05.917766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4191ed44-775b-497d-be77-664ce35b49da tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8ebe2ac162488493440137306c5fbe', 'request_id': 'req-4191ed44-775b-497d-be77-664ce35b49da'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:05.955984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4191ed44-775b-497d-be77-664ce35b49da tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] The token cache is being invalidate because project 5d8ebe2ac162488493440137306c5fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:05.956372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4191ed44-775b-497d-be77-664ce35b49da tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:05.958435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4191ed44-775b-497d-be77-664ce35b49da tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:05.966199 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3853/7713] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:05 2022] DELETE /identity/v3/projects/5d8ebe2ac162488493440137306c5fbe => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:05.966582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0573297-f049-4dc6-afe3-b3655a778a94 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:05.969568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b0573297-f049-4dc6-afe3-b3655a778a94 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:05.997890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0573297-f049-4dc6-afe3-b3655a778a94 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:06.154475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f11b06-56ea-460d-9b85-897e75f92c2d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:06.155171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f11b06-56ea-460d-9b85-897e75f92c2d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:06.155449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f11b06-56ea-460d-9b85-897e75f92c2d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:06.156423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f11b06-56ea-460d-9b85-897e75f92c2d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/projects/5432e36e8bcf484e9c3c24252e539b70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:06.159085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f11b06-56ea-460d-9b85-897e75f92c2d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5432e36e8bcf484e9c3c24252e539b70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:06.161828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f11b06-56ea-460d-9b85-897e75f92c2d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:06.277534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-38f11b06-56ea-460d-9b85-897e75f92c2d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5432e36e8bcf484e9c3c24252e539b70', 'request_id': 'req-38f11b06-56ea-460d-9b85-897e75f92c2d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:06.296608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-38f11b06-56ea-460d-9b85-897e75f92c2d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5432e36e8bcf484e9c3c24252e539b70', 'request_id': 'req-38f11b06-56ea-460d-9b85-897e75f92c2d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:06.313272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:06.316274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-38f11b06-56ea-460d-9b85-897e75f92c2d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5432e36e8bcf484e9c3c24252e539b70', 'request_id': 'req-38f11b06-56ea-460d-9b85-897e75f92c2d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:06.360342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-38f11b06-56ea-460d-9b85-897e75f92c2d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] The token cache is being invalidate because project 5432e36e8bcf484e9c3c24252e539b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:06.360841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-38f11b06-56ea-460d-9b85-897e75f92c2d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:06.363447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-38f11b06-56ea-460d-9b85-897e75f92c2d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:06.367496 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3861/7714] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:05 2022] DELETE /identity/v3/projects/5432e36e8bcf484e9c3c24252e539b70 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:06.372158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191ed44-775b-497d-be77-664ce35b49da tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:06.400900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191ed44-775b-497d-be77-664ce35b49da tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:06.625991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5221cb8-751a-4736-922f-7898c3b29d82 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:06.627156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5221cb8-751a-4736-922f-7898c3b29d82 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:06.627653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5221cb8-751a-4736-922f-7898c3b29d82 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:06.628101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5221cb8-751a-4736-922f-7898c3b29d82 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/roles/4720efd426b342b085b3ae314418c1ad` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:06.632319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5221cb8-751a-4736-922f-7898c3b29d82 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4720efd426b342b085b3ae314418c1ad)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:06.649049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5221cb8-751a-4736-922f-7898c3b29d82 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:06.749110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d5221cb8-751a-4736-922f-7898c3b29d82 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invalidating the token cache because role 4720efd426b342b085b3ae314418c1ad has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:06.749803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d5221cb8-751a-4736-922f-7898c3b29d82 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:06.751157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d5221cb8-751a-4736-922f-7898c3b29d82 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:06.755309 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3854/7715] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:06 2022] DELETE /identity/v3/roles/4720efd426b342b085b3ae314418c1ad => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:06.761360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f11b06-56ea-460d-9b85-897e75f92c2d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:06.763138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-38f11b06-56ea-460d-9b85-897e75f92c2d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:06.782680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f11b06-56ea-460d-9b85-897e75f92c2d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:06.922146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37c9c3-7f80-4226-94ef-88ddb2f5aaa4 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:06.923218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37c9c3-7f80-4226-94ef-88ddb2f5aaa4 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:06.923218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37c9c3-7f80-4226-94ef-88ddb2f5aaa4 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:06.925364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37c9c3-7f80-4226-94ef-88ddb2f5aaa4 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users/ceea9ffd352c4cf9b709c935444ed140` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:06.927022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37c9c3-7f80-4226-94ef-88ddb2f5aaa4 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ceea9ffd352c4cf9b709c935444ed140)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:06.930350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37c9c3-7f80-4226-94ef-88ddb2f5aaa4 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:07.036924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db37c9c3-7f80-4226-94ef-88ddb2f5aaa4 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceea9ffd352c4cf9b709c935444ed140'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:07.063703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db37c9c3-7f80-4226-94ef-88ddb2f5aaa4 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceea9ffd352c4cf9b709c935444ed140'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:07.064463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db37c9c3-7f80-4226-94ef-88ddb2f5aaa4 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceea9ffd352c4cf9b709c935444ed140'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:07.065177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db37c9c3-7f80-4226-94ef-88ddb2f5aaa4 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceea9ffd352c4cf9b709c935444ed140'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:07.082023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db37c9c3-7f80-4226-94ef-88ddb2f5aaa4 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceea9ffd352c4cf9b709c935444ed140'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:07.104274 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3862/7716] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:06 2022] DELETE /identity/v3/users/ceea9ffd352c4cf9b709c935444ed140 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:07.108340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5221cb8-751a-4736-922f-7898c3b29d82 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:07.109994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5221cb8-751a-4736-922f-7898c3b29d82 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:07.134174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5221cb8-751a-4736-922f-7898c3b29d82 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:07.173298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:07.316996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4503fc-ba89-44f0-931e-b744848adc53 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:07.319437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4503fc-ba89-44f0-931e-b744848adc53 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:07.319736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4503fc-ba89-44f0-931e-b744848adc53 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:07.320037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4503fc-ba89-44f0-931e-b744848adc53 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/projects/b6e311e6904a46838edd97506f5b1f19` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:07.321943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4503fc-ba89-44f0-931e-b744848adc53 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b6e311e6904a46838edd97506f5b1f19)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:07.328099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4503fc-ba89-44f0-931e-b744848adc53 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:07.452514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d4503fc-ba89-44f0-931e-b744848adc53 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e311e6904a46838edd97506f5b1f19', 'request_id': 'req-2d4503fc-ba89-44f0-931e-b744848adc53'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:07.476230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d4503fc-ba89-44f0-931e-b744848adc53 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e311e6904a46838edd97506f5b1f19', 'request_id': 'req-2d4503fc-ba89-44f0-931e-b744848adc53'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:07.486540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d4503fc-ba89-44f0-931e-b744848adc53 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e311e6904a46838edd97506f5b1f19', 'request_id': 'req-2d4503fc-ba89-44f0-931e-b744848adc53'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:07.504035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d4503fc-ba89-44f0-931e-b744848adc53 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] The token cache is being invalidate because project b6e311e6904a46838edd97506f5b1f19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:07.504368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d4503fc-ba89-44f0-931e-b744848adc53 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:07.505085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d4503fc-ba89-44f0-931e-b744848adc53 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:07.507838 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3855/7717] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:07 2022] DELETE /identity/v3/projects/b6e311e6904a46838edd97506f5b1f19 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:07.513093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37c9c3-7f80-4226-94ef-88ddb2f5aaa4 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:07.514594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db37c9c3-7f80-4226-94ef-88ddb2f5aaa4 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:07.533652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37c9c3-7f80-4226-94ef-88ddb2f5aaa4 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:07.679432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb83cc-0302-40bd-9f98-bde22db76897 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:07.680084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb83cc-0302-40bd-9f98-bde22db76897 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:07.680371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb83cc-0302-40bd-9f98-bde22db76897 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:07.680954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb83cc-0302-40bd-9f98-bde22db76897 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users/4aaa5d32151b431b975ea59719ffcd7f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:07.682191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb83cc-0302-40bd-9f98-bde22db76897 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:update_user(user_id=4aaa5d32151b431b975ea59719ffcd7f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:07.683288 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-f3bb83cc-0302-40bd-9f98-bde22db76897 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:53:07.683288 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 18:53:07.683288 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 18:53:07.684542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb83cc-0302-40bd-9f98-bde22db76897 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:07.732788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=11,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:07.759645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3bb83cc-0302-40bd-9f98-bde22db76897 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4aaa5d32151b431b975ea59719ffcd7f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:07.783900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3bb83cc-0302-40bd-9f98-bde22db76897 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invalidating the token cache because user 4aaa5d32151b431b975ea59719ffcd7f was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:07.784333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3bb83cc-0302-40bd-9f98-bde22db76897 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:07.786231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3bb83cc-0302-40bd-9f98-bde22db76897 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:07.790330 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3863/7718] 10.222.0.27 () {60 vars in 1243 bytes} [Sun Aug 28 18:53:07 2022] PATCH /identity/v3/users/4aaa5d32151b431b975ea59719ffcd7f => generated 296 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:07.795185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071c361-acb2-4b9e-93f4-61a347a0473c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:07.795757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071c361-acb2-4b9e-93f4-61a347a0473c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:07.795881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071c361-acb2-4b9e-93f4-61a347a0473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:07.848373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3071c361-acb2-4b9e-93f4-61a347a0473c None None] MFA Rules not processed for user `4aaa5d32151b431b975ea59719ffcd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:07.854042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3071c361-acb2-4b9e-93f4-61a347a0473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:07.864008 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3856/7719] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:07 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:53:07.868735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb83cc-0302-40bd-9f98-bde22db76897 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:07.884600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f3bb83cc-0302-40bd-9f98-bde22db76897 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:07.902702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb83cc-0302-40bd-9f98-bde22db76897 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:07.913657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65523dd-b31b-46d8-a92b-97cbdd8f06a0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:07.914639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65523dd-b31b-46d8-a92b-97cbdd8f06a0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:07.915141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65523dd-b31b-46d8-a92b-97cbdd8f06a0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:07.915461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65523dd-b31b-46d8-a92b-97cbdd8f06a0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users/4aaa5d32151b431b975ea59719ffcd7f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:07.917195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65523dd-b31b-46d8-a92b-97cbdd8f06a0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:update_user(user_id=4aaa5d32151b431b975ea59719ffcd7f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:07.919498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65523dd-b31b-46d8-a92b-97cbdd8f06a0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:07.986125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d65523dd-b31b-46d8-a92b-97cbdd8f06a0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4aaa5d32151b431b975ea59719ffcd7f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:07.998283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d65523dd-b31b-46d8-a92b-97cbdd8f06a0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invalidating the token cache because user 4aaa5d32151b431b975ea59719ffcd7f was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:07.998955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d65523dd-b31b-46d8-a92b-97cbdd8f06a0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:07.999982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d65523dd-b31b-46d8-a92b-97cbdd8f06a0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:08.004820 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3864/7720] 10.222.0.27 () {60 vars in 1243 bytes} [Sun Aug 28 18:53:07 2022] PATCH /identity/v3/users/4aaa5d32151b431b975ea59719ffcd7f => generated 296 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:08.009451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071c361-acb2-4b9e-93f4-61a347a0473c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:08.027205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071c361-acb2-4b9e-93f4-61a347a0473c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:08.035161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5c252-daaa-4111-80a0-3f0c2e56adc3 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:08.036178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5c252-daaa-4111-80a0-3f0c2e56adc3 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:08.036715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5c252-daaa-4111-80a0-3f0c2e56adc3 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:08.037198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5c252-daaa-4111-80a0-3f0c2e56adc3 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users/4aaa5d32151b431b975ea59719ffcd7f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:08.066612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5c252-daaa-4111-80a0-3f0c2e56adc3 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:update_user(user_id=4aaa5d32151b431b975ea59719ffcd7f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:08.068651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5c252-daaa-4111-80a0-3f0c2e56adc3 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:08.128280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64b5c252-daaa-4111-80a0-3f0c2e56adc3 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4aaa5d32151b431b975ea59719ffcd7f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:08.140889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64b5c252-daaa-4111-80a0-3f0c2e56adc3 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invalidating the token cache because user 4aaa5d32151b431b975ea59719ffcd7f was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:08.141334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64b5c252-daaa-4111-80a0-3f0c2e56adc3 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:08.141992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64b5c252-daaa-4111-80a0-3f0c2e56adc3 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:08.148145 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3857/7721] 10.222.0.27 () {60 vars in 1243 bytes} [Sun Aug 28 18:53:08 2022] PATCH /identity/v3/users/4aaa5d32151b431b975ea59719ffcd7f => generated 296 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:08.150392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dc321-0fee-4c2e-baa6-8fe1324d21e8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:08.150694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dc321-0fee-4c2e-baa6-8fe1324d21e8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:08.150958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dc321-0fee-4c2e-baa6-8fe1324d21e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:08.234239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-958dc321-0fee-4c2e-baa6-8fe1324d21e8 None None] MFA Rules not processed for user `4aaa5d32151b431b975ea59719ffcd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:08.236363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-958dc321-0fee-4c2e-baa6-8fe1324d21e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:08.249596 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3865/7722] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:08 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:53:08.249847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5c252-daaa-4111-80a0-3f0c2e56adc3 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:08.251221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-64b5c252-daaa-4111-80a0-3f0c2e56adc3 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:08.272434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5c252-daaa-4111-80a0-3f0c2e56adc3 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:08.279951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5d1e4-8a65-4ce5-9794-829061012dd7 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:08.281220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d1e4-8a65-4ce5-9794-829061012dd7 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:08.281829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d1e4-8a65-4ce5-9794-829061012dd7 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:08.282298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d1e4-8a65-4ce5-9794-829061012dd7 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users/4aaa5d32151b431b975ea59719ffcd7f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:08.283857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5d1e4-8a65-4ce5-9794-829061012dd7 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:update_user(user_id=4aaa5d32151b431b975ea59719ffcd7f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:08.286831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5d1e4-8a65-4ce5-9794-829061012dd7 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:08.364972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ee5d1e4-8a65-4ce5-9794-829061012dd7 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4aaa5d32151b431b975ea59719ffcd7f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:08.385205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ee5d1e4-8a65-4ce5-9794-829061012dd7 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invalidating the token cache because user 4aaa5d32151b431b975ea59719ffcd7f was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:08.385585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ee5d1e4-8a65-4ce5-9794-829061012dd7 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:08.386984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ee5d1e4-8a65-4ce5-9794-829061012dd7 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:08.395318 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3858/7723] 10.222.0.27 () {60 vars in 1243 bytes} [Sun Aug 28 18:53:08 2022] PATCH /identity/v3/users/4aaa5d32151b431b975ea59719ffcd7f => generated 296 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:53:08.397480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958dc321-0fee-4c2e-baa6-8fe1324d21e8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:08.416996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958dc321-0fee-4c2e-baa6-8fe1324d21e8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:08.426997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dafff0-c3d9-411e-8001-8154e2c68171 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:08.428836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dafff0-c3d9-411e-8001-8154e2c68171 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:08.429129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dafff0-c3d9-411e-8001-8154e2c68171 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:08.429455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dafff0-c3d9-411e-8001-8154e2c68171 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:08.431750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dafff0-c3d9-411e-8001-8154e2c68171 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:08.438505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dafff0-c3d9-411e-8001-8154e2c68171 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:08.484069 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3866/7724] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Aug 28 18:53:08 2022] POST /identity/v3/users => generated 264 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:08.487980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5d1e4-8a65-4ce5-9794-829061012dd7 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:08.489585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4ee5d1e4-8a65-4ce5-9794-829061012dd7 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:08.518803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5d1e4-8a65-4ce5-9794-829061012dd7 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:08.526274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d582f-91c9-4d6c-8122-a6a645c637c6 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:08.526954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d582f-91c9-4d6c-8122-a6a645c637c6 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:08.531534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d582f-91c9-4d6c-8122-a6a645c637c6 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:08.531918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d582f-91c9-4d6c-8122-a6a645c637c6 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users/40945bcf94694ac29b132de5d7e16d0c/password` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:08.537814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82,keystone:DELETE=11,keystone:INSERT=5,keystone:UPDATE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:08.698919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d65d582f-91c9-4d6c-8122-a6a645c637c6 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '40945bcf94694ac29b132de5d7e16d0c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:08.744099 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3859/7725] 10.222.0.27 () {60 vars in 1269 bytes} [Sun Aug 28 18:53:08 2022] POST /identity/v3/users/40945bcf94694ac29b132de5d7e16d0c/password => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:09.749775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b2b3-65b6-4d96-90ec-fe6bcb7724da None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:09.750472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b2b3-65b6-4d96-90ec-fe6bcb7724da None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:09.750472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b2b3-65b6-4d96-90ec-fe6bcb7724da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:09.777104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f1c3b2b3-65b6-4d96-90ec-fe6bcb7724da None None] MFA Rules not processed for user `40945bcf94694ac29b132de5d7e16d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:09.778951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f1c3b2b3-65b6-4d96-90ec-fe6bcb7724da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:09.784238 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3867/7726] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:09 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:53:09.789177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d582f-91c9-4d6c-8122-a6a645c637c6 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:09.805047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d582f-91c9-4d6c-8122-a6a645c637c6 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:09.817287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2c8e6-7127-4489-a51d-145fb08a200d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:09.818510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2c8e6-7127-4489-a51d-145fb08a200d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:09.818788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2c8e6-7127-4489-a51d-145fb08a200d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:09.819056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2c8e6-7127-4489-a51d-145fb08a200d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:09.837287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2c8e6-7127-4489-a51d-145fb08a200d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:09.841727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2c8e6-7127-4489-a51d-145fb08a200d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:09.852256 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3860/7727] 10.222.0.27 () {56 vars in 1263 bytes} [Sun Aug 28 18:53:09 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:53:09.856359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3b2b3-65b6-4d96-90ec-fe6bcb7724da None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:09.888425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3b2b3-65b6-4d96-90ec-fe6bcb7724da None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:09.906015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f783093-28ff-4701-8ba4-5610b7291709 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:09.914721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f783093-28ff-4701-8ba4-5610b7291709 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:09.916264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f783093-28ff-4701-8ba4-5610b7291709 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:09.917126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f783093-28ff-4701-8ba4-5610b7291709 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users/40945bcf94694ac29b132de5d7e16d0c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:09.928085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f783093-28ff-4701-8ba4-5610b7291709 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:delete_user(user_id=40945bcf94694ac29b132de5d7e16d0c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:09.933928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f783093-28ff-4701-8ba4-5610b7291709 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:10.038550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1f783093-28ff-4701-8ba4-5610b7291709 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40945bcf94694ac29b132de5d7e16d0c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:10.057607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1f783093-28ff-4701-8ba4-5610b7291709 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40945bcf94694ac29b132de5d7e16d0c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:10.058942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1f783093-28ff-4701-8ba4-5610b7291709 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40945bcf94694ac29b132de5d7e16d0c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:10.059739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1f783093-28ff-4701-8ba4-5610b7291709 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40945bcf94694ac29b132de5d7e16d0c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:10.071590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1f783093-28ff-4701-8ba4-5610b7291709 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40945bcf94694ac29b132de5d7e16d0c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:10.096006 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3868/7728] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:09 2022] DELETE /identity/v3/users/40945bcf94694ac29b132de5d7e16d0c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:10.100731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2c8e6-7127-4489-a51d-145fb08a200d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:10.113233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2c8e6-7127-4489-a51d-145fb08a200d tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:10.220598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463efee6-8da1-462f-8f64-cb7693b612a1 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:10.221383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463efee6-8da1-462f-8f64-cb7693b612a1 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:10.221830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463efee6-8da1-462f-8f64-cb7693b612a1 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:10.222281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463efee6-8da1-462f-8f64-cb7693b612a1 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:10.223043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463efee6-8da1-462f-8f64-cb7693b612a1 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:10.228338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463efee6-8da1-462f-8f64-cb7693b612a1 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:10.274438 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3861/7729] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:10 2022] POST /identity/v3/users => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:53:10.278152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f783093-28ff-4701-8ba4-5610b7291709 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:10.281432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1f783093-28ff-4701-8ba4-5610b7291709 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:10.304183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f783093-28ff-4701-8ba4-5610b7291709 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:10.309426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754b917-0d3f-4971-a69a-05e82478bf0f tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:10.310305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754b917-0d3f-4971-a69a-05e82478bf0f tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:10.310771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754b917-0d3f-4971-a69a-05e82478bf0f tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:10.311203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754b917-0d3f-4971-a69a-05e82478bf0f tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:10.312381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754b917-0d3f-4971-a69a-05e82478bf0f tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:10.314596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754b917-0d3f-4971-a69a-05e82478bf0f tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:10.361623 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3869/7730] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:10 2022] POST /identity/v3/projects => generated 359 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:10.367970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463efee6-8da1-462f-8f64-cb7693b612a1 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:10.406296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463efee6-8da1-462f-8f64-cb7693b612a1 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:10.608859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b9d28-3613-4f7c-81c5-b8ffcfc87352 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:10.612582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b9d28-3613-4f7c-81c5-b8ffcfc87352 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:10.612966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b9d28-3613-4f7c-81c5-b8ffcfc87352 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:10.613283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b9d28-3613-4f7c-81c5-b8ffcfc87352 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users/5ea3f5a176e24efc8357c45b2c0750ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:10.650258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b9d28-3613-4f7c-81c5-b8ffcfc87352 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:update_user(user_id=5ea3f5a176e24efc8357c45b2c0750ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:10.659119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b9d28-3613-4f7c-81c5-b8ffcfc87352 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:10.735028 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3862/7731] 10.222.0.27 () {60 vars in 1244 bytes} [Sun Aug 28 18:53:10 2022] PATCH /identity/v3/users/5ea3f5a176e24efc8357c45b2c0750ae => generated 524 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:10.737348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754b917-0d3f-4971-a69a-05e82478bf0f tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:10.751036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754b917-0d3f-4971-a69a-05e82478bf0f tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:10.762546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a330143-9450-40a6-a984-61937c05571e tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:10.764010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a330143-9450-40a6-a984-61937c05571e tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:10.764694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a330143-9450-40a6-a984-61937c05571e tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:10.765266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a330143-9450-40a6-a984-61937c05571e tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users/5ea3f5a176e24efc8357c45b2c0750ae` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:10.796788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a330143-9450-40a6-a984-61937c05571e tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:get_user(user_id=5ea3f5a176e24efc8357c45b2c0750ae)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:10.800064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a330143-9450-40a6-a984-61937c05571e tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:10.830007 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3870/7732] 10.222.0.27 () {58 vars in 1221 bytes} [Sun Aug 28 18:53:10 2022] GET /identity/v3/users/5ea3f5a176e24efc8357c45b2c0750ae => generated 390 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:10.832177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b9d28-3613-4f7c-81c5-b8ffcfc87352 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:10.840606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:UPDATE=3,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:10.851023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b9d28-3613-4f7c-81c5-b8ffcfc87352 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:10.862513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacd38c-6249-41aa-824d-f13b4a5ae395 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:10.866255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacd38c-6249-41aa-824d-f13b4a5ae395 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:10.866806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacd38c-6249-41aa-824d-f13b4a5ae395 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:10.867231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacd38c-6249-41aa-824d-f13b4a5ae395 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/projects/6b008b3b34984cc0b2accc6c55ad2a81` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:10.869776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacd38c-6249-41aa-824d-f13b4a5ae395 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6b008b3b34984cc0b2accc6c55ad2a81)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:10.881147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacd38c-6249-41aa-824d-f13b4a5ae395 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:10.991359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9eacd38c-6249-41aa-824d-f13b4a5ae395 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b008b3b34984cc0b2accc6c55ad2a81', 'request_id': 'req-9eacd38c-6249-41aa-824d-f13b4a5ae395'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:11.009764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9eacd38c-6249-41aa-824d-f13b4a5ae395 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b008b3b34984cc0b2accc6c55ad2a81', 'request_id': 'req-9eacd38c-6249-41aa-824d-f13b4a5ae395'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:11.022412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9eacd38c-6249-41aa-824d-f13b4a5ae395 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b008b3b34984cc0b2accc6c55ad2a81', 'request_id': 'req-9eacd38c-6249-41aa-824d-f13b4a5ae395'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:11.043078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9eacd38c-6249-41aa-824d-f13b4a5ae395 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] The token cache is being invalidate because project 6b008b3b34984cc0b2accc6c55ad2a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:11.043944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9eacd38c-6249-41aa-824d-f13b4a5ae395 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:11.045403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9eacd38c-6249-41aa-824d-f13b4a5ae395 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:11.054995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a330143-9450-40a6-a984-61937c05571e tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:11.056965 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3863/7733] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:10 2022] DELETE /identity/v3/projects/6b008b3b34984cc0b2accc6c55ad2a81 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:11.059544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7a330143-9450-40a6-a984-61937c05571e tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:11.096050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a330143-9450-40a6-a984-61937c05571e tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:11.108318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=79,keystone:INSERT=8,keystone:DELETE=12,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:11.251363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7a92b-2421-4e3f-839f-1f30a1a825e0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d33336a392b4025836c03c190e59100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03776c643595444c9e335e534560b873', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:11.252470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7a92b-2421-4e3f-839f-1f30a1a825e0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:11.253052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7a92b-2421-4e3f-839f-1f30a1a825e0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:11.253587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7a92b-2421-4e3f-839f-1f30a1a825e0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] PATH_INFO: `/v3/users/5ea3f5a176e24efc8357c45b2c0750ae` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:11.256311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7a92b-2421-4e3f-839f-1f30a1a825e0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ea3f5a176e24efc8357c45b2c0750ae)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:11.262557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7a92b-2421-4e3f-839f-1f30a1a825e0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:11.363245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6cd7a92b-2421-4e3f-839f-1f30a1a825e0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea3f5a176e24efc8357c45b2c0750ae'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:11.386139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6cd7a92b-2421-4e3f-839f-1f30a1a825e0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea3f5a176e24efc8357c45b2c0750ae'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:11.387819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6cd7a92b-2421-4e3f-839f-1f30a1a825e0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea3f5a176e24efc8357c45b2c0750ae'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:11.388961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6cd7a92b-2421-4e3f-839f-1f30a1a825e0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea3f5a176e24efc8357c45b2c0750ae'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:11.413588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6cd7a92b-2421-4e3f-839f-1f30a1a825e0 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea3f5a176e24efc8357c45b2c0750ae'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:11.456698 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3871/7734] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:11 2022] DELETE /identity/v3/users/5ea3f5a176e24efc8357c45b2c0750ae => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:11.458344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacd38c-6249-41aa-824d-f13b4a5ae395 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:11.460087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9eacd38c-6249-41aa-824d-f13b4a5ae395 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:11.585957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacd38c-6249-41aa-824d-f13b4a5ae395 tempest-UsersV3TestJSON-881242355 tempest-UsersV3TestJSON-881242355-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:11.747855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff9ecf-9ebf-42f2-b5ae-9a777648aeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:11.748665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff9ecf-9ebf-42f2-b5ae-9a777648aeda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:11.749303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff9ecf-9ebf-42f2-b5ae-9a777648aeda admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:11.749709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff9ecf-9ebf-42f2-b5ae-9a777648aeda admin admin] PATH_INFO: `/v3/users/4aaa5d32151b431b975ea59719ffcd7f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:11.772110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff9ecf-9ebf-42f2-b5ae-9a777648aeda admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aaa5d32151b431b975ea59719ffcd7f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:11.774646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff9ecf-9ebf-42f2-b5ae-9a777648aeda admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:11.816655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:11.844052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31ff9ecf-9ebf-42f2-b5ae-9a777648aeda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aaa5d32151b431b975ea59719ffcd7f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:11.845492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31ff9ecf-9ebf-42f2-b5ae-9a777648aeda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aaa5d32151b431b975ea59719ffcd7f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:11.866527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31ff9ecf-9ebf-42f2-b5ae-9a777648aeda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aaa5d32151b431b975ea59719ffcd7f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:11.886023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31ff9ecf-9ebf-42f2-b5ae-9a777648aeda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aaa5d32151b431b975ea59719ffcd7f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:11.905751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31ff9ecf-9ebf-42f2-b5ae-9a777648aeda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aaa5d32151b431b975ea59719ffcd7f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:11.916533 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3864/7735] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:11 2022] DELETE /identity/v3/users/4aaa5d32151b431b975ea59719ffcd7f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:11.920887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582110a-7978-44a6-9f39-dd53d61fbb62 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:11.922364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582110a-7978-44a6-9f39-dd53d61fbb62 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:11.923616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582110a-7978-44a6-9f39-dd53d61fbb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:11.955907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5582110a-7978-44a6-9f39-dd53d61fbb62 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:11.957477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5582110a-7978-44a6-9f39-dd53d61fbb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:12.053514 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3872/7736] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:12.069195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff9ecf-9ebf-42f2-b5ae-9a777648aeda admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:12.075114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-31ff9ecf-9ebf-42f2-b5ae-9a777648aeda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:12.244808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff9ecf-9ebf-42f2-b5ae-9a777648aeda admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:12.259195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66333527-25ad-4971-a990-7538b56413b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:12.262232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66333527-25ad-4971-a990-7538b56413b9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:12.262885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66333527-25ad-4971-a990-7538b56413b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:12.264051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66333527-25ad-4971-a990-7538b56413b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:12.290689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66333527-25ad-4971-a990-7538b56413b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:12.293779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66333527-25ad-4971-a990-7538b56413b9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:12.313253 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3865/7737] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:12.476374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582110a-7978-44a6-9f39-dd53d61fbb62 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:12.479653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5582110a-7978-44a6-9f39-dd53d61fbb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:12.495564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582110a-7978-44a6-9f39-dd53d61fbb62 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:12.513730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f538178-6323-46ff-83f0-1cf0d60357b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:12.516035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f538178-6323-46ff-83f0-1cf0d60357b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:12.516342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f538178-6323-46ff-83f0-1cf0d60357b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:12.516603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f538178-6323-46ff-83f0-1cf0d60357b3 admin admin] PATH_INFO: `/v3/users/60f97d80ddec402781f0cbe899957380` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:12.518275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f538178-6323-46ff-83f0-1cf0d60357b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f97d80ddec402781f0cbe899957380)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:12.520284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f538178-6323-46ff-83f0-1cf0d60357b3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:12.564759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:12.624802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9f538178-6323-46ff-83f0-1cf0d60357b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f97d80ddec402781f0cbe899957380'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:12.644006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9f538178-6323-46ff-83f0-1cf0d60357b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f97d80ddec402781f0cbe899957380'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:12.645569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9f538178-6323-46ff-83f0-1cf0d60357b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f97d80ddec402781f0cbe899957380'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:12.646391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9f538178-6323-46ff-83f0-1cf0d60357b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f97d80ddec402781f0cbe899957380'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:12.657733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9f538178-6323-46ff-83f0-1cf0d60357b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f97d80ddec402781f0cbe899957380'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:12.687710 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3873/7738] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:12 2022] DELETE /identity/v3/users/60f97d80ddec402781f0cbe899957380 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:12.689275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8bd50-0cd6-433d-b210-7d7975bfc305 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:12.689419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8bd50-0cd6-433d-b210-7d7975bfc305 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:12.689695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8bd50-0cd6-433d-b210-7d7975bfc305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:12.712431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b6d8bd50-0cd6-433d-b210-7d7975bfc305 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:12.713676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b6d8bd50-0cd6-433d-b210-7d7975bfc305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:12.859608 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3866/7739] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:12.874017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f538178-6323-46ff-83f0-1cf0d60357b3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:12.875888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9f538178-6323-46ff-83f0-1cf0d60357b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:12.940917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8bd50-0cd6-433d-b210-7d7975bfc305 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:12.942644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b6d8bd50-0cd6-433d-b210-7d7975bfc305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:12.972230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8bd50-0cd6-433d-b210-7d7975bfc305 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:12.986533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632f38b-a8a6-4df9-bc79-465aca0aa901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:12.989394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632f38b-a8a6-4df9-bc79-465aca0aa901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:12.989678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632f38b-a8a6-4df9-bc79-465aca0aa901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:12.991755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632f38b-a8a6-4df9-bc79-465aca0aa901 admin admin] PATH_INFO: `/v3/projects/ba48e2b910d64bc5953f8cd8ab18ea49` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:12.998429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632f38b-a8a6-4df9-bc79-465aca0aa901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba48e2b910d64bc5953f8cd8ab18ea49)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:13.010895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632f38b-a8a6-4df9-bc79-465aca0aa901 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:13.020007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f538178-6323-46ff-83f0-1cf0d60357b3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:13.034815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed007c9-b417-4086-ae60-ea5cbedd2ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:13.035784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed007c9-b417-4086-ae60-ea5cbedd2ace service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:13.036242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed007c9-b417-4086-ae60-ea5cbedd2ace service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:13.036508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed007c9-b417-4086-ae60-ea5cbedd2ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:13.067919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed007c9-b417-4086-ae60-ea5cbedd2ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:13.069324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed007c9-b417-4086-ae60-ea5cbedd2ace service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:13.089220 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3874/7740] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:13.116001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:13.127762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f632f38b-a8a6-4df9-bc79-465aca0aa901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba48e2b910d64bc5953f8cd8ab18ea49', 'request_id': 'req-f632f38b-a8a6-4df9-bc79-465aca0aa901'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.159238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f632f38b-a8a6-4df9-bc79-465aca0aa901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba48e2b910d64bc5953f8cd8ab18ea49', 'request_id': 'req-f632f38b-a8a6-4df9-bc79-465aca0aa901'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.178795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f632f38b-a8a6-4df9-bc79-465aca0aa901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba48e2b910d64bc5953f8cd8ab18ea49', 'request_id': 'req-f632f38b-a8a6-4df9-bc79-465aca0aa901'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.215762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f632f38b-a8a6-4df9-bc79-465aca0aa901 admin admin] The token cache is being invalidate because project ba48e2b910d64bc5953f8cd8ab18ea49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:13.216253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f632f38b-a8a6-4df9-bc79-465aca0aa901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.219983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f632f38b-a8a6-4df9-bc79-465aca0aa901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.238604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed007c9-b417-4086-ae60-ea5cbedd2ace service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:13.238987 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3867/7741] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:12 2022] DELETE /identity/v3/projects/ba48e2b910d64bc5953f8cd8ab18ea49 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:13.244693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed007c9-b417-4086-ae60-ea5cbedd2ace service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:13.336025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5751105-7725-45d5-a430-7ecf03509a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:13.336886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5751105-7725-45d5-a430-7ecf03509a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:13.339134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5751105-7725-45d5-a430-7ecf03509a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:13.339550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5751105-7725-45d5-a430-7ecf03509a18 admin admin] PATH_INFO: `/v3/users/7d33336a392b4025836c03c190e59100` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:13.341156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5751105-7725-45d5-a430-7ecf03509a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d33336a392b4025836c03c190e59100)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:13.343625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5751105-7725-45d5-a430-7ecf03509a18 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:13.394956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632f38b-a8a6-4df9-bc79-465aca0aa901 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:13.397110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f632f38b-a8a6-4df9-bc79-465aca0aa901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:13.422624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:13.429034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d5751105-7725-45d5-a430-7ecf03509a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d33336a392b4025836c03c190e59100'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.431872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632f38b-a8a6-4df9-bc79-465aca0aa901 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:13.444547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acfce4-3edc-4353-a134-b0fbdd21e9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:13.445386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acfce4-3edc-4353-a134-b0fbdd21e9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:13.445758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acfce4-3edc-4353-a134-b0fbdd21e9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:13.446161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acfce4-3edc-4353-a134-b0fbdd21e9a6 admin admin] PATH_INFO: `/v3/projects/1df8454ce8854d128fb7b73d85d7ded1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:13.448670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acfce4-3edc-4353-a134-b0fbdd21e9a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df8454ce8854d128fb7b73d85d7ded1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:13.451081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acfce4-3edc-4353-a134-b0fbdd21e9a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:13.487071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d5751105-7725-45d5-a430-7ecf03509a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d33336a392b4025836c03c190e59100'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.489728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d5751105-7725-45d5-a430-7ecf03509a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d33336a392b4025836c03c190e59100'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.491191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d5751105-7725-45d5-a430-7ecf03509a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d33336a392b4025836c03c190e59100'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.504453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d5751105-7725-45d5-a430-7ecf03509a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d33336a392b4025836c03c190e59100'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.527403 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3875/7742] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:13 2022] DELETE /identity/v3/users/7d33336a392b4025836c03c190e59100 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:13.534130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32acfce4-3edc-4353-a134-b0fbdd21e9a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df8454ce8854d128fb7b73d85d7ded1', 'request_id': 'req-32acfce4-3edc-4353-a134-b0fbdd21e9a6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.548908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32acfce4-3edc-4353-a134-b0fbdd21e9a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df8454ce8854d128fb7b73d85d7ded1', 'request_id': 'req-32acfce4-3edc-4353-a134-b0fbdd21e9a6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.573699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32acfce4-3edc-4353-a134-b0fbdd21e9a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df8454ce8854d128fb7b73d85d7ded1', 'request_id': 'req-32acfce4-3edc-4353-a134-b0fbdd21e9a6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.590442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32acfce4-3edc-4353-a134-b0fbdd21e9a6 admin admin] The token cache is being invalidate because project 1df8454ce8854d128fb7b73d85d7ded1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:13.590743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32acfce4-3edc-4353-a134-b0fbdd21e9a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.591539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32acfce4-3edc-4353-a134-b0fbdd21e9a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.593361 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3868/7743] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:13 2022] DELETE /identity/v3/projects/1df8454ce8854d128fb7b73d85d7ded1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:13.598456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1db83d-0d65-4b5c-93fb-f6c28fd895f8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:13.598950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1db83d-0d65-4b5c-93fb-f6c28fd895f8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:13.599288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1db83d-0d65-4b5c-93fb-f6c28fd895f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:13.641230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4b1db83d-0d65-4b5c-93fb-f6c28fd895f8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:13.643148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4b1db83d-0d65-4b5c-93fb-f6c28fd895f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:13.755841 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3876/7744] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:13.757726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc03f76-e573-400b-bc33-b7e449ceb268 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:13.758232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc03f76-e573-400b-bc33-b7e449ceb268 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:13.758736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc03f76-e573-400b-bc33-b7e449ceb268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:13.802069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0cc03f76-e573-400b-bc33-b7e449ceb268 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:13.804612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0cc03f76-e573-400b-bc33-b7e449ceb268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:13.828855 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3869/7745] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:13.833283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1db83d-0d65-4b5c-93fb-f6c28fd895f8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:13.849104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1db83d-0d65-4b5c-93fb-f6c28fd895f8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:13.856409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d574eb-ece7-43f2-8705-6740e083d7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:13.857937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d574eb-ece7-43f2-8705-6740e083d7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:13.858385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d574eb-ece7-43f2-8705-6740e083d7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:13.858817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d574eb-ece7-43f2-8705-6740e083d7e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:13.860514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d574eb-ece7-43f2-8705-6740e083d7e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:13.861048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d574eb-ece7-43f2-8705-6740e083d7e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:13.863369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d574eb-ece7-43f2-8705-6740e083d7e9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:13.889688 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3877/7746] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:13.894119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc03f76-e573-400b-bc33-b7e449ceb268 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:13.908088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc03f76-e573-400b-bc33-b7e449ceb268 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:13.929528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707446b7-1503-4017-a0c6-57956b804fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:13.930453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707446b7-1503-4017-a0c6-57956b804fdf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:13.930993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707446b7-1503-4017-a0c6-57956b804fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:13.931372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707446b7-1503-4017-a0c6-57956b804fdf admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:13.932507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707446b7-1503-4017-a0c6-57956b804fdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:13.934966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707446b7-1503-4017-a0c6-57956b804fdf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:13.998573 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3870/7747] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:13 2022] POST /identity/v3/projects => generated 361 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:53:14.003730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d574eb-ece7-43f2-8705-6740e083d7e9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:14.017894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d574eb-ece7-43f2-8705-6740e083d7e9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:14.042868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707446b7-1503-4017-a0c6-57956b804fdf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:14.047750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-707446b7-1503-4017-a0c6-57956b804fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:14.168752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6345e-8a09-4ca0-9e3a-91239d00ef66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:14.170092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6345e-8a09-4ca0-9e3a-91239d00ef66 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:14.171345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6345e-8a09-4ca0-9e3a-91239d00ef66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:14.171803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6345e-8a09-4ca0-9e3a-91239d00ef66 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:14.175231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6345e-8a09-4ca0-9e3a-91239d00ef66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:14.177400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6345e-8a09-4ca0-9e3a-91239d00ef66 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:14.182310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707446b7-1503-4017-a0c6-57956b804fdf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:14.192747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad687fb-3e24-443e-85ab-28dfb465253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:14.193410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad687fb-3e24-443e-85ab-28dfb465253f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:14.193696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad687fb-3e24-443e-85ab-28dfb465253f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:14.193976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad687fb-3e24-443e-85ab-28dfb465253f admin admin] PATH_INFO: `/v3/projects/03776c643595444c9e335e534560b873` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:14.196556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad687fb-3e24-443e-85ab-28dfb465253f admin admin] RBAC: Authorizing `identity:delete_project(project_id=03776c643595444c9e335e534560b873)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:14.198569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad687fb-3e24-443e-85ab-28dfb465253f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:14.224958 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3878/7748] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:14 2022] POST /identity/v3/users => generated 281 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:53:14.225924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6345e-8a09-4ca0-9e3a-91239d00ef66 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:14.249469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6345e-8a09-4ca0-9e3a-91239d00ef66 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:14.259127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e317458-3298-4e71-b03e-41e245e38736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:14.259795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e317458-3298-4e71-b03e-41e245e38736 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:14.260081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e317458-3298-4e71-b03e-41e245e38736 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:14.260351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e317458-3298-4e71-b03e-41e245e38736 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:14.261522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e317458-3298-4e71-b03e-41e245e38736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:14.263499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e317458-3298-4e71-b03e-41e245e38736 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:14.269471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:14.294714 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3879/7749] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:14.296762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e317458-3298-4e71-b03e-41e245e38736 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:14.307690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ad687fb-3e24-443e-85ab-28dfb465253f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03776c643595444c9e335e534560b873', 'request_id': 'req-6ad687fb-3e24-443e-85ab-28dfb465253f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:14.316615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e317458-3298-4e71-b03e-41e245e38736 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:14.321901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ad687fb-3e24-443e-85ab-28dfb465253f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03776c643595444c9e335e534560b873', 'request_id': 'req-6ad687fb-3e24-443e-85ab-28dfb465253f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:14.331149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ad687fb-3e24-443e-85ab-28dfb465253f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03776c643595444c9e335e534560b873', 'request_id': 'req-6ad687fb-3e24-443e-85ab-28dfb465253f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:14.355086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ad687fb-3e24-443e-85ab-28dfb465253f admin admin] The token cache is being invalidate because project 03776c643595444c9e335e534560b873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:14.355449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ad687fb-3e24-443e-85ab-28dfb465253f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:14.359374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ad687fb-3e24-443e-85ab-28dfb465253f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:14.363361 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3871/7750] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:14 2022] DELETE /identity/v3/projects/03776c643595444c9e335e534560b873 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:14.367576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bf342-afdb-4fc4-af13-1d3d148fed39 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:14.367891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bf342-afdb-4fc4-af13-1d3d148fed39 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:14.368222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bf342-afdb-4fc4-af13-1d3d148fed39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:14.375421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:14.414231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7d8bf342-afdb-4fc4-af13-1d3d148fed39 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:14.415564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7d8bf342-afdb-4fc4-af13-1d3d148fed39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:14.448076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c741de5-9b8f-4900-a48b-2473becdfeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:14.448734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c741de5-9b8f-4900-a48b-2473becdfeb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:14.448988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c741de5-9b8f-4900-a48b-2473becdfeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:14.449835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c741de5-9b8f-4900-a48b-2473becdfeb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:14.453579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c741de5-9b8f-4900-a48b-2473becdfeb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:14.458987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c741de5-9b8f-4900-a48b-2473becdfeb3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:14.488318 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3880/7751] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:14.491242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c741de5-9b8f-4900-a48b-2473becdfeb3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:14.496322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c741de5-9b8f-4900-a48b-2473becdfeb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:14.535735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c741de5-9b8f-4900-a48b-2473becdfeb3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:14.548160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a15439-3293-4587-89c8-a3058d9ce45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:14.550146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a15439-3293-4587-89c8-a3058d9ce45e admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:14.550439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a15439-3293-4587-89c8-a3058d9ce45e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:14.553037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a15439-3293-4587-89c8-a3058d9ce45e admin admin] PATH_INFO: `/v3/projects/fea8b474d3384c01b97c9daccc82a996/users/8327a851c5f44c7aaa6845f94992895e/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:14.570555 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3872/7752] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:53:14.579050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85459db7-97c6-452b-8138-f6c56eaf54ab None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:14.579416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85459db7-97c6-452b-8138-f6c56eaf54ab None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:14.579639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85459db7-97c6-452b-8138-f6c56eaf54ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:14.590127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a15439-3293-4587-89c8-a3058d9ce45e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea8b474d3384c01b97c9daccc82a996, user_id=8327a851c5f44c7aaa6845f94992895e, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:14.599072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a15439-3293-4587-89c8-a3058d9ce45e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:14.605979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-85459db7-97c6-452b-8138-f6c56eaf54ab None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:14.607627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-85459db7-97c6-452b-8138-f6c56eaf54ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:14.625863 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3873/7753] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:53:14.628539 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3881/7754] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:14 2022] PUT /identity/v3/projects/fea8b474d3384c01b97c9daccc82a996/users/8327a851c5f44c7aaa6845f94992895e/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:14.631036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85459db7-97c6-452b-8138-f6c56eaf54ab None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:14.638996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550fb8d-76b8-49a1-9bdd-cfbda6b35c73 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:14.639459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550fb8d-76b8-49a1-9bdd-cfbda6b35c73 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:14.639834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550fb8d-76b8-49a1-9bdd-cfbda6b35c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:14.653482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85459db7-97c6-452b-8138-f6c56eaf54ab None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:14.689609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a550fb8d-76b8-49a1-9bdd-cfbda6b35c73 None None] MFA Rules not processed for user `8327a851c5f44c7aaa6845f94992895e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:14.691413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a550fb8d-76b8-49a1-9bdd-cfbda6b35c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:14.798239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20104080-6ed3-446a-86ce-de16f6420081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:14.799084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20104080-6ed3-446a-86ce-de16f6420081 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:14.799689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20104080-6ed3-446a-86ce-de16f6420081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:14.800290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20104080-6ed3-446a-86ce-de16f6420081 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:14.801826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20104080-6ed3-446a-86ce-de16f6420081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:14.802555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20104080-6ed3-446a-86ce-de16f6420081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:14.806439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20104080-6ed3-446a-86ce-de16f6420081 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:14.816815 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3882/7755] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:14.827761 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3874/7756] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:14.831754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20104080-6ed3-446a-86ce-de16f6420081 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:14.834504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550fb8d-76b8-49a1-9bdd-cfbda6b35c73 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:14.835776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-20104080-6ed3-446a-86ce-de16f6420081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:14.862491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550fb8d-76b8-49a1-9bdd-cfbda6b35c73 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:14.870162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c28af9-5a5e-4c5b-b431-f610bf183fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:14.871210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c28af9-5a5e-4c5b-b431-f610bf183fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:14.871830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c28af9-5a5e-4c5b-b431-f610bf183fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:14.872342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c28af9-5a5e-4c5b-b431-f610bf183fd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:14.873501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c28af9-5a5e-4c5b-b431-f610bf183fd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:14.876685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c28af9-5a5e-4c5b-b431-f610bf183fd6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:14.910372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:14.933880 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3883/7757] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:14 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:14.937992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c28af9-5a5e-4c5b-b431-f610bf183fd6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:14.949916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20104080-6ed3-446a-86ce-de16f6420081 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:15.084880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b1bec-c23b-4332-9543-4939c8c30c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:15.085851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b1bec-c23b-4332-9543-4939c8c30c25 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:15.086270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b1bec-c23b-4332-9543-4939c8c30c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:15.086631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b1bec-c23b-4332-9543-4939c8c30c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:15.097631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c28af9-5a5e-4c5b-b431-f610bf183fd6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:15.116049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c669e-3699-4c8a-8454-9b21a4343fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:15.116782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c669e-3699-4c8a-8454-9b21a4343fbc admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:15.118996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c669e-3699-4c8a-8454-9b21a4343fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:15.119387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c669e-3699-4c8a-8454-9b21a4343fbc admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:15.120152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c669e-3699-4c8a-8454-9b21a4343fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:15.122310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c669e-3699-4c8a-8454-9b21a4343fbc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:15.138621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:15.157146 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3884/7758] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:14 2022] POST /identity/v3/users => generated 285 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:15.165242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c669e-3699-4c8a-8454-9b21a4343fbc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:15.193341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c669e-3699-4c8a-8454-9b21a4343fbc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:15.198118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b1bec-c23b-4332-9543-4939c8c30c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:15.200751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b1bec-c23b-4332-9543-4939c8c30c25 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:15.203829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d4f03-0f2e-4699-b2e2-1b25de278c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:15.206198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d4f03-0f2e-4699-b2e2-1b25de278c93 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:15.207479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d4f03-0f2e-4699-b2e2-1b25de278c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:15.208001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d4f03-0f2e-4699-b2e2-1b25de278c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:15.209690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d4f03-0f2e-4699-b2e2-1b25de278c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:15.214204 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3875/7759] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:53:15.217205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d4f03-0f2e-4699-b2e2-1b25de278c93 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:15.268514 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3885/7760] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:15.270841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b1bec-c23b-4332-9543-4939c8c30c25 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:15.323733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b1bec-c23b-4332-9543-4939c8c30c25 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:15.331785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b01555-fa37-4dc0-8d28-ed0be52c5da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:15.333011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b01555-fa37-4dc0-8d28-ed0be52c5da3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:15.333527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b01555-fa37-4dc0-8d28-ed0be52c5da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:15.334006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b01555-fa37-4dc0-8d28-ed0be52c5da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:15.335315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b01555-fa37-4dc0-8d28-ed0be52c5da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:15.338173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b01555-fa37-4dc0-8d28-ed0be52c5da3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:15.357354 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3876/7761] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:15.359482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d4f03-0f2e-4699-b2e2-1b25de278c93 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:15.371321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d4f03-0f2e-4699-b2e2-1b25de278c93 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:15.376930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e4b09-4b90-4d25-972a-7fbb64f204be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:15.378086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e4b09-4b90-4d25-972a-7fbb64f204be admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:15.378735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e4b09-4b90-4d25-972a-7fbb64f204be admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:15.379374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e4b09-4b90-4d25-972a-7fbb64f204be admin admin] PATH_INFO: `/v3/projects/14d414041aa34a5eb6cef9a0651d24f3/users/6ee9dde4df7e4c1196e63a460652bb31/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:15.402121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e4b09-4b90-4d25-972a-7fbb64f204be admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d414041aa34a5eb6cef9a0651d24f3, user_id=6ee9dde4df7e4c1196e63a460652bb31, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:15.404875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e4b09-4b90-4d25-972a-7fbb64f204be admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:15.443330 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3886/7762] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:15 2022] PUT /identity/v3/projects/14d414041aa34a5eb6cef9a0651d24f3/users/6ee9dde4df7e4c1196e63a460652bb31/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:15.451761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593fb78-24d3-411b-8c60-7674361c2c12 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:15.452367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593fb78-24d3-411b-8c60-7674361c2c12 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:15.452959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593fb78-24d3-411b-8c60-7674361c2c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:15.490140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c593fb78-24d3-411b-8c60-7674361c2c12 None None] MFA Rules not processed for user `6ee9dde4df7e4c1196e63a460652bb31`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:15.491668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c593fb78-24d3-411b-8c60-7674361c2c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:15.586026 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3877/7763] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:53:15.590774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e4b09-4b90-4d25-972a-7fbb64f204be admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:15.602496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e4b09-4b90-4d25-972a-7fbb64f204be admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:15.608660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c97e43-a715-4a98-9440-d90458431c51 tempest-TestApiDiscovery-2037118444 tempest-TestApiDiscovery-2037118444-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee9dde4df7e4c1196e63a460652bb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14d414041aa34a5eb6cef9a0651d24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:15.609716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c97e43-a715-4a98-9440-d90458431c51 tempest-TestApiDiscovery-2037118444 tempest-TestApiDiscovery-2037118444-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:15.609716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c97e43-a715-4a98-9440-d90458431c51 tempest-TestApiDiscovery-2037118444 tempest-TestApiDiscovery-2037118444-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:15.610169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c97e43-a715-4a98-9440-d90458431c51 tempest-TestApiDiscovery-2037118444 tempest-TestApiDiscovery-2037118444-project] PATH_INFO: `/v3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:15.615497 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3887/7764] 10.222.0.27 () {58 vars in 1104 bytes} [Sun Aug 28 18:53:15 2022] GET /identity/v3 => generated 255 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:53:15.618955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593fb78-24d3-411b-8c60-7674361c2c12 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:15.633484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593fb78-24d3-411b-8c60-7674361c2c12 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:15.639076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab0951-b583-444d-a5b6-1be2e5aad395 tempest-TestApiDiscovery-2037118444 tempest-TestApiDiscovery-2037118444-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee9dde4df7e4c1196e63a460652bb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14d414041aa34a5eb6cef9a0651d24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:15.640652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab0951-b583-444d-a5b6-1be2e5aad395 tempest-TestApiDiscovery-2037118444 tempest-TestApiDiscovery-2037118444-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:15.640978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab0951-b583-444d-a5b6-1be2e5aad395 tempest-TestApiDiscovery-2037118444 tempest-TestApiDiscovery-2037118444-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:15.641518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab0951-b583-444d-a5b6-1be2e5aad395 tempest-TestApiDiscovery-2037118444 tempest-TestApiDiscovery-2037118444-project] PATH_INFO: `/v3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:15.642932 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3878/7765] 10.222.0.27 () {58 vars in 1104 bytes} [Sun Aug 28 18:53:15 2022] GET /identity/v3 => generated 255 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:15.648672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c97e43-a715-4a98-9440-d90458431c51 tempest-TestApiDiscovery-2037118444 tempest-TestApiDiscovery-2037118444-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:15.671155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c97e43-a715-4a98-9440-d90458431c51 tempest-TestApiDiscovery-2037118444 tempest-TestApiDiscovery-2037118444-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:15.681626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432531f-f0e3-406d-9de8-5871b9f74827 tempest-TestApiDiscovery-2037118444 tempest-TestApiDiscovery-2037118444-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee9dde4df7e4c1196e63a460652bb31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14d414041aa34a5eb6cef9a0651d24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:15.682277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432531f-f0e3-406d-9de8-5871b9f74827 tempest-TestApiDiscovery-2037118444 tempest-TestApiDiscovery-2037118444-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:15.683854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432531f-f0e3-406d-9de8-5871b9f74827 tempest-TestApiDiscovery-2037118444 tempest-TestApiDiscovery-2037118444-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:15.684166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432531f-f0e3-406d-9de8-5871b9f74827 tempest-TestApiDiscovery-2037118444 tempest-TestApiDiscovery-2037118444-project] PATH_INFO: `/v3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:15.688448 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3888/7766] 10.222.0.27 () {58 vars in 1104 bytes} [Sun Aug 28 18:53:15 2022] GET /identity/v3 => generated 255 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:15.693484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33508ae0-4b98-4fd2-998c-7836500028c4 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:15.693770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33508ae0-4b98-4fd2-998c-7836500028c4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:15.694154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33508ae0-4b98-4fd2-998c-7836500028c4 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:15.699599 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3879/7767] 10.222.0.27 () {56 vars in 895 bytes} [Sun Aug 28 18:53:15 2022] GET /identity/ => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:53:15.701846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de68f5-df3a-4496-beb3-18ab26fbd49c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:15.703644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de68f5-df3a-4496-beb3-18ab26fbd49c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:15.704124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de68f5-df3a-4496-beb3-18ab26fbd49c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:15.707028 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3889/7768] 10.222.0.27 () {56 vars in 895 bytes} [Sun Aug 28 18:53:15 2022] GET /identity/ => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:53:15.713281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33508ae0-4b98-4fd2-998c-7836500028c4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:15.795627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:15.889562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33508ae0-4b98-4fd2-998c-7836500028c4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:15.896028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d19c4-ef3a-4c63-93e0-49a84b42b3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:15.897046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d19c4-ef3a-4c63-93e0-49a84b42b3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:15.897482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d19c4-ef3a-4c63-93e0-49a84b42b3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:15.898137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d19c4-ef3a-4c63-93e0-49a84b42b3b0 admin admin] PATH_INFO: `/v3/users/6ee9dde4df7e4c1196e63a460652bb31` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:15.899864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d19c4-ef3a-4c63-93e0-49a84b42b3b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee9dde4df7e4c1196e63a460652bb31)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:15.904108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d19c4-ef3a-4c63-93e0-49a84b42b3b0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:16.016776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-894d19c4-ef3a-4c63-93e0-49a84b42b3b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee9dde4df7e4c1196e63a460652bb31'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:16.018219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-894d19c4-ef3a-4c63-93e0-49a84b42b3b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee9dde4df7e4c1196e63a460652bb31'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:16.038598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-894d19c4-ef3a-4c63-93e0-49a84b42b3b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee9dde4df7e4c1196e63a460652bb31'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:16.053127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-894d19c4-ef3a-4c63-93e0-49a84b42b3b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee9dde4df7e4c1196e63a460652bb31'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:16.072311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-894d19c4-ef3a-4c63-93e0-49a84b42b3b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee9dde4df7e4c1196e63a460652bb31'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:16.081001 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3880/7769] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:15 2022] DELETE /identity/v3/users/6ee9dde4df7e4c1196e63a460652bb31 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:16.085956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31b8da-5122-4d6c-8b5b-3a6c654d4a4b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:16.086263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31b8da-5122-4d6c-8b5b-3a6c654d4a4b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:16.087041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31b8da-5122-4d6c-8b5b-3a6c654d4a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:16.110258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5d31b8da-5122-4d6c-8b5b-3a6c654d4a4b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:16.111959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5d31b8da-5122-4d6c-8b5b-3a6c654d4a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:16.261808 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3890/7770] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:16.384756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d19c4-ef3a-4c63-93e0-49a84b42b3b0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:16.386519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-894d19c4-ef3a-4c63-93e0-49a84b42b3b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:16.553363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d19c4-ef3a-4c63-93e0-49a84b42b3b0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:16.564841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe435c6-d224-4225-bcb9-98ca0775293e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:16.566224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe435c6-d224-4225-bcb9-98ca0775293e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:16.566510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe435c6-d224-4225-bcb9-98ca0775293e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:16.568163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe435c6-d224-4225-bcb9-98ca0775293e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:16.594319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe435c6-d224-4225-bcb9-98ca0775293e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:16.599073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe435c6-d224-4225-bcb9-98ca0775293e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:16.620025 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3881/7771] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:17.701439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31b8da-5122-4d6c-8b5b-3a6c654d4a4b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:17.702337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5d31b8da-5122-4d6c-8b5b-3a6c654d4a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:17.720941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31b8da-5122-4d6c-8b5b-3a6c654d4a4b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:17.731543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12888802-41b5-4add-85b0-db47fe151c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:17.732628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12888802-41b5-4add-85b0-db47fe151c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:17.732777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12888802-41b5-4add-85b0-db47fe151c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:17.733078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12888802-41b5-4add-85b0-db47fe151c4e admin admin] PATH_INFO: `/v3/projects/14d414041aa34a5eb6cef9a0651d24f3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:17.734412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12888802-41b5-4add-85b0-db47fe151c4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d414041aa34a5eb6cef9a0651d24f3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:17.738085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12888802-41b5-4add-85b0-db47fe151c4e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:17.862530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-12888802-41b5-4add-85b0-db47fe151c4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d414041aa34a5eb6cef9a0651d24f3', 'request_id': 'req-12888802-41b5-4add-85b0-db47fe151c4e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:17.877247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-12888802-41b5-4add-85b0-db47fe151c4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d414041aa34a5eb6cef9a0651d24f3', 'request_id': 'req-12888802-41b5-4add-85b0-db47fe151c4e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:17.886618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-12888802-41b5-4add-85b0-db47fe151c4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d414041aa34a5eb6cef9a0651d24f3', 'request_id': 'req-12888802-41b5-4add-85b0-db47fe151c4e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:17.935444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-12888802-41b5-4add-85b0-db47fe151c4e admin admin] The token cache is being invalidate because project 14d414041aa34a5eb6cef9a0651d24f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:17.936131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-12888802-41b5-4add-85b0-db47fe151c4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:17.937605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-12888802-41b5-4add-85b0-db47fe151c4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:17.941791 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3891/7772] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:17 2022] DELETE /identity/v3/projects/14d414041aa34a5eb6cef9a0651d24f3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:17.948281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a898fa-6ee1-4640-853c-b3f205733d33 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:17.949516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a898fa-6ee1-4640-853c-b3f205733d33 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:17.949975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a898fa-6ee1-4640-853c-b3f205733d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:17.985224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-57a898fa-6ee1-4640-853c-b3f205733d33 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:17.987212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-57a898fa-6ee1-4640-853c-b3f205733d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:18.116927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:18.169116 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3882/7773] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:18.177162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c168341-6592-4bfb-ae89-4b914e864b55 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:18.177463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c168341-6592-4bfb-ae89-4b914e864b55 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:18.178785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c168341-6592-4bfb-ae89-4b914e864b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:18.219691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7c168341-6592-4bfb-ae89-4b914e864b55 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:18.223064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7c168341-6592-4bfb-ae89-4b914e864b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:18.260817 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3892/7774] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:18.265421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a898fa-6ee1-4640-853c-b3f205733d33 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:18.282487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a898fa-6ee1-4640-853c-b3f205733d33 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:18.297859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06695116-758b-400e-bacf-ee2ed432d9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:18.297859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695116-758b-400e-bacf-ee2ed432d9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:18.298236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695116-758b-400e-bacf-ee2ed432d9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:18.298413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695116-758b-400e-bacf-ee2ed432d9f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:18.299706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06695116-758b-400e-bacf-ee2ed432d9f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:18.300782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06695116-758b-400e-bacf-ee2ed432d9f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:18.302741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06695116-758b-400e-bacf-ee2ed432d9f9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:18.337903 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3883/7775] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:53:18.339777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c168341-6592-4bfb-ae89-4b914e864b55 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:18.385022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c168341-6592-4bfb-ae89-4b914e864b55 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:18.400548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec815412-50a1-4f66-a522-bcdbe3792c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:18.401594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec815412-50a1-4f66-a522-bcdbe3792c1b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:18.403642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec815412-50a1-4f66-a522-bcdbe3792c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:18.404042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec815412-50a1-4f66-a522-bcdbe3792c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:18.406287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec815412-50a1-4f66-a522-bcdbe3792c1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:18.410922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec815412-50a1-4f66-a522-bcdbe3792c1b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:18.482478 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3893/7776] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:18 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:18.483859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06695116-758b-400e-bacf-ee2ed432d9f9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:18.496682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06695116-758b-400e-bacf-ee2ed432d9f9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:18.603956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfd964-d7b5-4402-b04f-156d7868b34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:18.604785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfd964-d7b5-4402-b04f-156d7868b34f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:18.605501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfd964-d7b5-4402-b04f-156d7868b34f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:18.605844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfd964-d7b5-4402-b04f-156d7868b34f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:18.607087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfd964-d7b5-4402-b04f-156d7868b34f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:18.613194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfd964-d7b5-4402-b04f-156d7868b34f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:18.648589 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3884/7777] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:18 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:18.653120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec815412-50a1-4f66-a522-bcdbe3792c1b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:18.669087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec815412-50a1-4f66-a522-bcdbe3792c1b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:18.682000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aae95c-bc26-4eaf-bc67-44268e6ccd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:18.683077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aae95c-bc26-4eaf-bc67-44268e6ccd12 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:18.683077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aae95c-bc26-4eaf-bc67-44268e6ccd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:18.683411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aae95c-bc26-4eaf-bc67-44268e6ccd12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:18.684151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aae95c-bc26-4eaf-bc67-44268e6ccd12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:18.687842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aae95c-bc26-4eaf-bc67-44268e6ccd12 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:18.689827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:18.739398 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3894/7778] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:18.744597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfd964-d7b5-4402-b04f-156d7868b34f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:18.765370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfd964-d7b5-4402-b04f-156d7868b34f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:18.774110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca931acc-8af3-4882-b124-f9e504ab7afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:18.775102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca931acc-8af3-4882-b124-f9e504ab7afb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:18.775584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca931acc-8af3-4882-b124-f9e504ab7afb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:18.776037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca931acc-8af3-4882-b124-f9e504ab7afb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:18.777818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca931acc-8af3-4882-b124-f9e504ab7afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:18.782900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca931acc-8af3-4882-b124-f9e504ab7afb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:18.828343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aae95c-bc26-4eaf-bc67-44268e6ccd12 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:18.836092 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3885/7779] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:18.849586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aae95c-bc26-4eaf-bc67-44268e6ccd12 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:18.884620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7a13e-b7e7-418e-9d93-1e44d2f5dabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:18.885445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7a13e-b7e7-418e-9d93-1e44d2f5dabe admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:18.885728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7a13e-b7e7-418e-9d93-1e44d2f5dabe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:18.886003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7a13e-b7e7-418e-9d93-1e44d2f5dabe admin admin] PATH_INFO: `/v3/projects/00b5fe06a2da4c84894c1578d1d7a475/users/a2ef0ed60dbf4e298bcdae2d466e69b5/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:18.940809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7a13e-b7e7-418e-9d93-1e44d2f5dabe admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b5fe06a2da4c84894c1578d1d7a475, user_id=a2ef0ed60dbf4e298bcdae2d466e69b5, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:18.944747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7a13e-b7e7-418e-9d93-1e44d2f5dabe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:18.984661 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3895/7780] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:18 2022] PUT /identity/v3/projects/00b5fe06a2da4c84894c1578d1d7a475/users/a2ef0ed60dbf4e298bcdae2d466e69b5/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:18.997254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a32a9-07fa-4948-95b5-08730e6d7830 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:18.997878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a32a9-07fa-4948-95b5-08730e6d7830 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:18.997878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a32a9-07fa-4948-95b5-08730e6d7830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:19.085812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5a8a32a9-07fa-4948-95b5-08730e6d7830 None None] MFA Rules not processed for user `a2ef0ed60dbf4e298bcdae2d466e69b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:19.087092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a8a32a9-07fa-4948-95b5-08730e6d7830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:19.257679 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3886/7781] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:19.267021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7a13e-b7e7-418e-9d93-1e44d2f5dabe admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:19.292766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7a13e-b7e7-418e-9d93-1e44d2f5dabe admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:19.305894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e8a19-187f-479e-b5ae-e6fd36065da2 tempest-IdentityCatalogTest-1238899113 tempest-IdentityCatalogTest-1238899113-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2ef0ed60dbf4e298bcdae2d466e69b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b5fe06a2da4c84894c1578d1d7a475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:19.306570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e8a19-187f-479e-b5ae-e6fd36065da2 tempest-IdentityCatalogTest-1238899113 tempest-IdentityCatalogTest-1238899113-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:19.306855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e8a19-187f-479e-b5ae-e6fd36065da2 tempest-IdentityCatalogTest-1238899113 tempest-IdentityCatalogTest-1238899113-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:19.307133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e8a19-187f-479e-b5ae-e6fd36065da2 tempest-IdentityCatalogTest-1238899113 tempest-IdentityCatalogTest-1238899113-project] PATH_INFO: `/v3/auth/catalog` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:19.307765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e8a19-187f-479e-b5ae-e6fd36065da2 tempest-IdentityCatalogTest-1238899113 tempest-IdentityCatalogTest-1238899113-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:19.308875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e8a19-187f-479e-b5ae-e6fd36065da2 tempest-IdentityCatalogTest-1238899113 tempest-IdentityCatalogTest-1238899113-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:19.317815 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3896/7782] 10.222.0.27 () {58 vars in 1143 bytes} [Sun Aug 28 18:53:19 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:19.323651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a32a9-07fa-4948-95b5-08730e6d7830 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:19.430930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:19.464693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a32a9-07fa-4948-95b5-08730e6d7830 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:19.476923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b655b9-26d5-4756-abc9-f69890d0f236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:19.477593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b655b9-26d5-4756-abc9-f69890d0f236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:19.477873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b655b9-26d5-4756-abc9-f69890d0f236 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:19.478151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b655b9-26d5-4756-abc9-f69890d0f236 admin admin] PATH_INFO: `/v3/users/a2ef0ed60dbf4e298bcdae2d466e69b5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:19.479815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b655b9-26d5-4756-abc9-f69890d0f236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ef0ed60dbf4e298bcdae2d466e69b5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:19.486235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b655b9-26d5-4756-abc9-f69890d0f236 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:19.640354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-30b655b9-26d5-4756-abc9-f69890d0f236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ef0ed60dbf4e298bcdae2d466e69b5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:19.641332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-30b655b9-26d5-4756-abc9-f69890d0f236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ef0ed60dbf4e298bcdae2d466e69b5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:19.665769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-30b655b9-26d5-4756-abc9-f69890d0f236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ef0ed60dbf4e298bcdae2d466e69b5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:19.698963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-30b655b9-26d5-4756-abc9-f69890d0f236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ef0ed60dbf4e298bcdae2d466e69b5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:19.742172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-30b655b9-26d5-4756-abc9-f69890d0f236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ef0ed60dbf4e298bcdae2d466e69b5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:19.768084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd0f43-a751-4159-aefd-1baa8b27c915 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:19.768650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd0f43-a751-4159-aefd-1baa8b27c915 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:19.768650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd0f43-a751-4159-aefd-1baa8b27c915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:19.775139 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3887/7783] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:19 2022] DELETE /identity/v3/users/a2ef0ed60dbf4e298bcdae2d466e69b5 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:19.801359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-59fd0f43-a751-4159-aefd-1baa8b27c915 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:19.805531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-59fd0f43-a751-4159-aefd-1baa8b27c915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:20.010122 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3897/7784] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:20.017583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b655b9-26d5-4756-abc9-f69890d0f236 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:20.021073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-30b655b9-26d5-4756-abc9-f69890d0f236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:20.126986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b655b9-26d5-4756-abc9-f69890d0f236 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:20.131267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a2324-53b1-4498-97b4-9b1e796ff450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:20.132040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a2324-53b1-4498-97b4-9b1e796ff450 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:20.132324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a2324-53b1-4498-97b4-9b1e796ff450 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:20.132598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a2324-53b1-4498-97b4-9b1e796ff450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:20.150952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a2324-53b1-4498-97b4-9b1e796ff450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:20.152472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a2324-53b1-4498-97b4-9b1e796ff450 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:20.175673 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3888/7785] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:21.144078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd0f43-a751-4159-aefd-1baa8b27c915 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:21.146027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-59fd0f43-a751-4159-aefd-1baa8b27c915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:21.180941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd0f43-a751-4159-aefd-1baa8b27c915 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:21.198236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2407a02-39b9-4825-b7a5-2ccc718aae04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:21.198907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2407a02-39b9-4825-b7a5-2ccc718aae04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:21.199186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2407a02-39b9-4825-b7a5-2ccc718aae04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:21.199486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2407a02-39b9-4825-b7a5-2ccc718aae04 admin admin] PATH_INFO: `/v3/projects/00b5fe06a2da4c84894c1578d1d7a475` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:21.200822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2407a02-39b9-4825-b7a5-2ccc718aae04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b5fe06a2da4c84894c1578d1d7a475)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:21.214516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2407a02-39b9-4825-b7a5-2ccc718aae04 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:21.326073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d2407a02-39b9-4825-b7a5-2ccc718aae04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b5fe06a2da4c84894c1578d1d7a475', 'request_id': 'req-d2407a02-39b9-4825-b7a5-2ccc718aae04'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:21.337793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d2407a02-39b9-4825-b7a5-2ccc718aae04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b5fe06a2da4c84894c1578d1d7a475', 'request_id': 'req-d2407a02-39b9-4825-b7a5-2ccc718aae04'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:21.343867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d2407a02-39b9-4825-b7a5-2ccc718aae04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b5fe06a2da4c84894c1578d1d7a475', 'request_id': 'req-d2407a02-39b9-4825-b7a5-2ccc718aae04'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:21.380804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d2407a02-39b9-4825-b7a5-2ccc718aae04 admin admin] The token cache is being invalidate because project 00b5fe06a2da4c84894c1578d1d7a475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:21.381101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d2407a02-39b9-4825-b7a5-2ccc718aae04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:21.381781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d2407a02-39b9-4825-b7a5-2ccc718aae04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:21.384855 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3898/7786] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:21 2022] DELETE /identity/v3/projects/00b5fe06a2da4c84894c1578d1d7a475 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:21.393279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10011a0c-4ba2-431d-90c1-717ed4bb9793 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:21.394183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10011a0c-4ba2-431d-90c1-717ed4bb9793 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:21.394627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10011a0c-4ba2-431d-90c1-717ed4bb9793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:21.432476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-10011a0c-4ba2-431d-90c1-717ed4bb9793 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:21.435171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-10011a0c-4ba2-431d-90c1-717ed4bb9793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:21.628829 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3889/7787] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:21.630975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3ed9-15c4-40ca-b711-71426fb25244 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:21.631599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3ed9-15c4-40ca-b711-71426fb25244 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:21.632654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3ed9-15c4-40ca-b711-71426fb25244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:21.686161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f45a3ed9-15c4-40ca-b711-71426fb25244 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:21.690141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f45a3ed9-15c4-40ca-b711-71426fb25244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:21.735778 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3899/7788] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:21.737180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10011a0c-4ba2-431d-90c1-717ed4bb9793 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:21.760754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10011a0c-4ba2-431d-90c1-717ed4bb9793 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:21.775588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ac034-8897-45fc-8f5b-81fbf6a39a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:21.776374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ac034-8897-45fc-8f5b-81fbf6a39a1e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:21.777372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ac034-8897-45fc-8f5b-81fbf6a39a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:21.778814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ac034-8897-45fc-8f5b-81fbf6a39a1e admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:21.779646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ac034-8897-45fc-8f5b-81fbf6a39a1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:21.780516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ac034-8897-45fc-8f5b-81fbf6a39a1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:21.783152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ac034-8897-45fc-8f5b-81fbf6a39a1e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:21.790692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:21.818963 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3890/7789] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:53:21.821676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a3ed9-15c4-40ca-b711-71426fb25244 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:21.835063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a3ed9-15c4-40ca-b711-71426fb25244 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:21.851839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73805571-80ba-4feb-8fb9-8aa49ae0eaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:21.853986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73805571-80ba-4feb-8fb9-8aa49ae0eaa4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:21.854520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73805571-80ba-4feb-8fb9-8aa49ae0eaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:21.856264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73805571-80ba-4feb-8fb9-8aa49ae0eaa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:21.857323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73805571-80ba-4feb-8fb9-8aa49ae0eaa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:21.864388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73805571-80ba-4feb-8fb9-8aa49ae0eaa4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:21.950470 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3900/7790] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:21 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:21.954431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ac034-8897-45fc-8f5b-81fbf6a39a1e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:21.977071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ac034-8897-45fc-8f5b-81fbf6a39a1e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:22.159156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8b7e2-d5de-48c0-8dd3-7ce338827a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:22.160032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8b7e2-d5de-48c0-8dd3-7ce338827a5a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:22.160712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8b7e2-d5de-48c0-8dd3-7ce338827a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:22.161056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8b7e2-d5de-48c0-8dd3-7ce338827a5a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:22.162288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8b7e2-d5de-48c0-8dd3-7ce338827a5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:22.166327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8b7e2-d5de-48c0-8dd3-7ce338827a5a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:22.241187 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3891/7791] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:21 2022] POST /identity/v3/users => generated 300 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:22.245099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73805571-80ba-4feb-8fb9-8aa49ae0eaa4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:22.268780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73805571-80ba-4feb-8fb9-8aa49ae0eaa4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:22.283522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765408a-5be5-4571-beea-aab7e48291c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:22.284892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765408a-5be5-4571-beea-aab7e48291c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:22.285395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765408a-5be5-4571-beea-aab7e48291c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:22.285889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765408a-5be5-4571-beea-aab7e48291c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:22.286781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765408a-5be5-4571-beea-aab7e48291c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:22.289848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765408a-5be5-4571-beea-aab7e48291c1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:22.307975 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3901/7792] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:22.312396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8b7e2-d5de-48c0-8dd3-7ce338827a5a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:22.329929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8b7e2-d5de-48c0-8dd3-7ce338827a5a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:22.344055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b935159-7d49-4f27-87fd-1f2d262529d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:22.344748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b935159-7d49-4f27-87fd-1f2d262529d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:22.345084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b935159-7d49-4f27-87fd-1f2d262529d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:22.345469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b935159-7d49-4f27-87fd-1f2d262529d1 admin admin] PATH_INFO: `/v3/projects/19d9619149f44936a9f6ac3a549f9a64/users/3797bbcfbc504a58821f3f82763804c8/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:22.380196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b935159-7d49-4f27-87fd-1f2d262529d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d9619149f44936a9f6ac3a549f9a64, user_id=3797bbcfbc504a58821f3f82763804c8, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:22.383162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b935159-7d49-4f27-87fd-1f2d262529d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:22.418349 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3892/7793] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:22 2022] PUT /identity/v3/projects/19d9619149f44936a9f6ac3a549f9a64/users/3797bbcfbc504a58821f3f82763804c8/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:22.422625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765408a-5be5-4571-beea-aab7e48291c1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:22.439604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765408a-5be5-4571-beea-aab7e48291c1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:22.457993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:22.592048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41400c3-d357-4945-9eb7-ec7d4308f3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:22.592692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41400c3-d357-4945-9eb7-ec7d4308f3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:22.592975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41400c3-d357-4945-9eb7-ec7d4308f3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:22.593253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41400c3-d357-4945-9eb7-ec7d4308f3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:22.593921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41400c3-d357-4945-9eb7-ec7d4308f3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:22.597464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41400c3-d357-4945-9eb7-ec7d4308f3a2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:22.620571 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3902/7794] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:22.627529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b935159-7d49-4f27-87fd-1f2d262529d1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:22.638387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b935159-7d49-4f27-87fd-1f2d262529d1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:22.658246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901b868-a97a-486a-8b97-998f5456f1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:22.659231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901b868-a97a-486a-8b97-998f5456f1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:22.659703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901b868-a97a-486a-8b97-998f5456f1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:22.660373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901b868-a97a-486a-8b97-998f5456f1a6 admin admin] PATH_INFO: `/v3/projects/19d9619149f44936a9f6ac3a549f9a64/users/3797bbcfbc504a58821f3f82763804c8/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:22.666277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901b868-a97a-486a-8b97-998f5456f1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d9619149f44936a9f6ac3a549f9a64, user_id=3797bbcfbc504a58821f3f82763804c8, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:22.669499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901b868-a97a-486a-8b97-998f5456f1a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:22.699400 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3893/7795] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:22 2022] PUT /identity/v3/projects/19d9619149f44936a9f6ac3a549f9a64/users/3797bbcfbc504a58821f3f82763804c8/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:22.715841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a92fdc-adc2-4c6a-b7a4-a8ac9a1506bc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:22.716051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a92fdc-adc2-4c6a-b7a4-a8ac9a1506bc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:22.716318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a92fdc-adc2-4c6a-b7a4-a8ac9a1506bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:22.764410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-50a92fdc-adc2-4c6a-b7a4-a8ac9a1506bc None None] MFA Rules not processed for user `3797bbcfbc504a58821f3f82763804c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:22.768523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-50a92fdc-adc2-4c6a-b7a4-a8ac9a1506bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:22.980128 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3903/7796] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:53:22.985058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901b868-a97a-486a-8b97-998f5456f1a6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:23.088881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901b868-a97a-486a-8b97-998f5456f1a6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:23.095089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc9c05-50ff-4a3b-8a87-07f5f403461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:23.096243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc9c05-50ff-4a3b-8a87-07f5f403461d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:23.096474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc9c05-50ff-4a3b-8a87-07f5f403461d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:23.097336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc9c05-50ff-4a3b-8a87-07f5f403461d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:23.098521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc9c05-50ff-4a3b-8a87-07f5f403461d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:23.100398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc9c05-50ff-4a3b-8a87-07f5f403461d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:23.157059 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3894/7797] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:22 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:23.161336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a92fdc-adc2-4c6a-b7a4-a8ac9a1506bc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:23.177298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a92fdc-adc2-4c6a-b7a4-a8ac9a1506bc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:23.274581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6e452-bb20-4622-a975-918be4c98aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:23.275323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6e452-bb20-4622-a975-918be4c98aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:23.275680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6e452-bb20-4622-a975-918be4c98aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:23.276121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6e452-bb20-4622-a975-918be4c98aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:23.276916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6e452-bb20-4622-a975-918be4c98aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:23.280158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6e452-bb20-4622-a975-918be4c98aa5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:23.311880 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3904/7798] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:23 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:23.312751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc9c05-50ff-4a3b-8a87-07f5f403461d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:23.327670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc9c05-50ff-4a3b-8a87-07f5f403461d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:23.342692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0ac2b-4ad4-4511-a23d-c500a205b67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:23.344570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0ac2b-4ad4-4511-a23d-c500a205b67a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:23.345544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0ac2b-4ad4-4511-a23d-c500a205b67a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:23.345950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0ac2b-4ad4-4511-a23d-c500a205b67a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:23.346832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0ac2b-4ad4-4511-a23d-c500a205b67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:23.349287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0ac2b-4ad4-4511-a23d-c500a205b67a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:23.378647 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3895/7799] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:23.382538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6e452-bb20-4622-a975-918be4c98aa5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:23.394889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6e452-bb20-4622-a975-918be4c98aa5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:23.401686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f353da3-caa8-4ab2-874d-0478957d669b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:23.402670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f353da3-caa8-4ab2-874d-0478957d669b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:23.403002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f353da3-caa8-4ab2-874d-0478957d669b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:23.403612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f353da3-caa8-4ab2-874d-0478957d669b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:23.408716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f353da3-caa8-4ab2-874d-0478957d669b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:23.411369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f353da3-caa8-4ab2-874d-0478957d669b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:23.432289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0ac2b-4ad4-4511-a23d-c500a205b67a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:23.444259 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3905/7800] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:23.447647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0ac2b-4ad4-4511-a23d-c500a205b67a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:23.455933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce726c3e-19cb-4f14-9b41-0413f02f7f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:23.456959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726c3e-19cb-4f14-9b41-0413f02f7f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:23.457239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726c3e-19cb-4f14-9b41-0413f02f7f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:23.457517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726c3e-19cb-4f14-9b41-0413f02f7f58 admin admin] PATH_INFO: `/v3/projects/780544553ec3461c9641a0b046ba6970/users/b4b12658a80e4498b19821d0afc49e3c/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:23.494632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce726c3e-19cb-4f14-9b41-0413f02f7f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=780544553ec3461c9641a0b046ba6970, user_id=b4b12658a80e4498b19821d0afc49e3c, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:23.499088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce726c3e-19cb-4f14-9b41-0413f02f7f58 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:23.507468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:23.535624 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3896/7801] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:23 2022] PUT /identity/v3/projects/780544553ec3461c9641a0b046ba6970/users/b4b12658a80e4498b19821d0afc49e3c/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:23.547654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829adf5-9322-489b-b299-28198ae64937 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:23.548018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829adf5-9322-489b-b299-28198ae64937 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:23.548218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829adf5-9322-489b-b299-28198ae64937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:23.594143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:23.621242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c829adf5-9322-489b-b299-28198ae64937 None None] MFA Rules not processed for user `b4b12658a80e4498b19821d0afc49e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:23.624918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c829adf5-9322-489b-b299-28198ae64937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:23.756599 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3906/7802] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:25.845318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce726c3e-19cb-4f14-9b41-0413f02f7f58 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:25.848134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce726c3e-19cb-4f14-9b41-0413f02f7f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:25.964936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce726c3e-19cb-4f14-9b41-0413f02f7f58 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:25.970839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a9856-48b7-4e57-a3af-d1e79b2cf8aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:25.971729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a9856-48b7-4e57-a3af-d1e79b2cf8aa service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:25.972176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a9856-48b7-4e57-a3af-d1e79b2cf8aa service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:25.972701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a9856-48b7-4e57-a3af-d1e79b2cf8aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:25.974969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e4a9856-48b7-4e57-a3af-d1e79b2cf8aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:26.015568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a9856-48b7-4e57-a3af-d1e79b2cf8aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:26.017606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a9856-48b7-4e57-a3af-d1e79b2cf8aa service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:26.070077 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3897/7803] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:26.314507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829adf5-9322-489b-b299-28198ae64937 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:26.316522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c829adf5-9322-489b-b299-28198ae64937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:26.408445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829adf5-9322-489b-b299-28198ae64937 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:26.413531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ff7f5-dc8e-4683-b84e-0a4e980c43c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:26.415048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ff7f5-dc8e-4683-b84e-0a4e980c43c7 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:26.415637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ff7f5-dc8e-4683-b84e-0a4e980c43c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:26.416190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ff7f5-dc8e-4683-b84e-0a4e980c43c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:26.422268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4d2ff7f5-dc8e-4683-b84e-0a4e980c43c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:26.443100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ff7f5-dc8e-4683-b84e-0a4e980c43c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:26.450779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ff7f5-dc8e-4683-b84e-0a4e980c43c7 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:26.471358 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3907/7804] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:26.701388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a9856-48b7-4e57-a3af-d1e79b2cf8aa service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:26.703639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e4a9856-48b7-4e57-a3af-d1e79b2cf8aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:26.741661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a9856-48b7-4e57-a3af-d1e79b2cf8aa service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:26.748362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014666ab-deb1-4f18-90ae-a86f379d249d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:26.749505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014666ab-deb1-4f18-90ae-a86f379d249d service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:26.749787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014666ab-deb1-4f18-90ae-a86f379d249d service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:26.750245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014666ab-deb1-4f18-90ae-a86f379d249d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:26.752425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-014666ab-deb1-4f18-90ae-a86f379d249d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:26.773254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014666ab-deb1-4f18-90ae-a86f379d249d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:26.775407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014666ab-deb1-4f18-90ae-a86f379d249d service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:26.802099 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3898/7805] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:27.045593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ff7f5-dc8e-4683-b84e-0a4e980c43c7 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:27.063740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ff7f5-dc8e-4683-b84e-0a4e980c43c7 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:27.084402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb80db9-06a0-43ee-b803-cacfff419574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:27.085061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb80db9-06a0-43ee-b803-cacfff419574 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:27.085469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb80db9-06a0-43ee-b803-cacfff419574 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:27.085745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb80db9-06a0-43ee-b803-cacfff419574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:27.088922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ecb80db9-06a0-43ee-b803-cacfff419574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:27.227220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb80db9-06a0-43ee-b803-cacfff419574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:27.228719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb80db9-06a0-43ee-b803-cacfff419574 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:27.249958 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3908/7806] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:53:27.832248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014666ab-deb1-4f18-90ae-a86f379d249d service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:27.835001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-014666ab-deb1-4f18-90ae-a86f379d249d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:28.021217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014666ab-deb1-4f18-90ae-a86f379d249d service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:28.035060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ee8da-73ba-48f8-81f2-fc65b9617140 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:28.036037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ee8da-73ba-48f8-81f2-fc65b9617140 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:28.036685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ee8da-73ba-48f8-81f2-fc65b9617140 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:28.037131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ee8da-73ba-48f8-81f2-fc65b9617140 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:28.191161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ee8da-73ba-48f8-81f2-fc65b9617140 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:28.200868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ee8da-73ba-48f8-81f2-fc65b9617140 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:28.240140 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3899/7807] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:27 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:30.073539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb80db9-06a0-43ee-b803-cacfff419574 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:30.137474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:30.242111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb80db9-06a0-43ee-b803-cacfff419574 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:30.268271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f163878-66d5-428a-8ffc-290a572952e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:30.272555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f163878-66d5-428a-8ffc-290a572952e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:30.273115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f163878-66d5-428a-8ffc-290a572952e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:30.273745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f163878-66d5-428a-8ffc-290a572952e9 admin admin] PATH_INFO: `/v3/users/3797bbcfbc504a58821f3f82763804c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:30.279019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f163878-66d5-428a-8ffc-290a572952e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3797bbcfbc504a58821f3f82763804c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:30.281659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f163878-66d5-428a-8ffc-290a572952e9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:30.387558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f163878-66d5-428a-8ffc-290a572952e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3797bbcfbc504a58821f3f82763804c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:30.439992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f163878-66d5-428a-8ffc-290a572952e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3797bbcfbc504a58821f3f82763804c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:30.443436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f163878-66d5-428a-8ffc-290a572952e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3797bbcfbc504a58821f3f82763804c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:30.444319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f163878-66d5-428a-8ffc-290a572952e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3797bbcfbc504a58821f3f82763804c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:30.463970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f163878-66d5-428a-8ffc-290a572952e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3797bbcfbc504a58821f3f82763804c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:30.520797 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3909/7808] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:30 2022] DELETE /identity/v3/users/3797bbcfbc504a58821f3f82763804c8 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:30.522991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a016eb7-4b1d-4721-8f84-427aa9910ec0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:30.523656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a016eb7-4b1d-4721-8f84-427aa9910ec0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:30.523792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a016eb7-4b1d-4721-8f84-427aa9910ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:30.584076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1a016eb7-4b1d-4721-8f84-427aa9910ec0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:30.586237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1a016eb7-4b1d-4721-8f84-427aa9910ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:30.673419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:30.796408 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3900/7809] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:30.820894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f163878-66d5-428a-8ffc-290a572952e9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:30.822458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3f163878-66d5-428a-8ffc-290a572952e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:31.043878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f163878-66d5-428a-8ffc-290a572952e9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:31.051894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce3f09-d2ec-4bf9-9ad6-22cb4a0ea6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:31.056712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce3f09-d2ec-4bf9-9ad6-22cb4a0ea6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:31.057543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce3f09-d2ec-4bf9-9ad6-22cb4a0ea6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:31.057886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce3f09-d2ec-4bf9-9ad6-22cb4a0ea6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:31.084425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce3f09-d2ec-4bf9-9ad6-22cb4a0ea6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:31.090511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce3f09-d2ec-4bf9-9ad6-22cb4a0ea6b5 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:31.105364 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3910/7810] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:32.547446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a016eb7-4b1d-4721-8f84-427aa9910ec0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:32.551150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1a016eb7-4b1d-4721-8f84-427aa9910ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:32.577801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a016eb7-4b1d-4721-8f84-427aa9910ec0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:32.587573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:32.592077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:32.603059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:32.603768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2 admin admin] PATH_INFO: `/v3/projects/19d9619149f44936a9f6ac3a549f9a64` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:32.606772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d9619149f44936a9f6ac3a549f9a64)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:32.610568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:32.739816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d9619149f44936a9f6ac3a549f9a64', 'request_id': 'req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:32.756097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d9619149f44936a9f6ac3a549f9a64', 'request_id': 'req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:32.772497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d9619149f44936a9f6ac3a549f9a64', 'request_id': 'req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:32.803519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2 admin admin] The token cache is being invalidate because project 19d9619149f44936a9f6ac3a549f9a64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:32.803818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:32.805064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:32.808739 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3901/7811] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:32 2022] DELETE /identity/v3/projects/19d9619149f44936a9f6ac3a549f9a64 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:32.814723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce3f09-d2ec-4bf9-9ad6-22cb4a0ea6b5 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:32.831225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce3f09-d2ec-4bf9-9ad6-22cb4a0ea6b5 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:33.046570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:33.082871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ace61-4dd4-4c30-baf2-1537becec26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:33.084860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ace61-4dd4-4c30-baf2-1537becec26f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:33.087162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ace61-4dd4-4c30-baf2-1537becec26f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:33.088553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ace61-4dd4-4c30-baf2-1537becec26f admin admin] PATH_INFO: `/v3/users/b4b12658a80e4498b19821d0afc49e3c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:33.092551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ace61-4dd4-4c30-baf2-1537becec26f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b12658a80e4498b19821d0afc49e3c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:33.109413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ace61-4dd4-4c30-baf2-1537becec26f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:33.259420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-420ace61-4dd4-4c30-baf2-1537becec26f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b12658a80e4498b19821d0afc49e3c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:33.292814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-420ace61-4dd4-4c30-baf2-1537becec26f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b12658a80e4498b19821d0afc49e3c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:33.294302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-420ace61-4dd4-4c30-baf2-1537becec26f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b12658a80e4498b19821d0afc49e3c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:33.295879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-420ace61-4dd4-4c30-baf2-1537becec26f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b12658a80e4498b19821d0afc49e3c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:33.320787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-420ace61-4dd4-4c30-baf2-1537becec26f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b12658a80e4498b19821d0afc49e3c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:33.349179 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3911/7812] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:32 2022] DELETE /identity/v3/users/b4b12658a80e4498b19821d0afc49e3c => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:34.383547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:34.385635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:34.426071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafaf83-6d77-4356-8b3a-7ffd5be4baf2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:34.567095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152722d6-a3d8-4e42-81b3-e6049e94e933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:34.572324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152722d6-a3d8-4e42-81b3-e6049e94e933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:34.572615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152722d6-a3d8-4e42-81b3-e6049e94e933 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:34.572900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152722d6-a3d8-4e42-81b3-e6049e94e933 admin admin] PATH_INFO: `/v3/projects/780544553ec3461c9641a0b046ba6970` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:34.574243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152722d6-a3d8-4e42-81b3-e6049e94e933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=780544553ec3461c9641a0b046ba6970)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:34.578382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152722d6-a3d8-4e42-81b3-e6049e94e933 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:35.113322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:35.115085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-152722d6-a3d8-4e42-81b3-e6049e94e933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '780544553ec3461c9641a0b046ba6970', 'request_id': 'req-152722d6-a3d8-4e42-81b3-e6049e94e933'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:35.130003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-152722d6-a3d8-4e42-81b3-e6049e94e933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '780544553ec3461c9641a0b046ba6970', 'request_id': 'req-152722d6-a3d8-4e42-81b3-e6049e94e933'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:35.153169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-152722d6-a3d8-4e42-81b3-e6049e94e933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '780544553ec3461c9641a0b046ba6970', 'request_id': 'req-152722d6-a3d8-4e42-81b3-e6049e94e933'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:35.178834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-152722d6-a3d8-4e42-81b3-e6049e94e933 admin admin] The token cache is being invalidate because project 780544553ec3461c9641a0b046ba6970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:35.179049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-152722d6-a3d8-4e42-81b3-e6049e94e933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:35.183638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-152722d6-a3d8-4e42-81b3-e6049e94e933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:35.185301 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3902/7813] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:34 2022] DELETE /identity/v3/projects/780544553ec3461c9641a0b046ba6970 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:35.191125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3230a18-39e8-46f9-8630-770323f4b1b3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:35.191814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3230a18-39e8-46f9-8630-770323f4b1b3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:35.191976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3230a18-39e8-46f9-8630-770323f4b1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:35.234393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e3230a18-39e8-46f9-8630-770323f4b1b3 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:35.236287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e3230a18-39e8-46f9-8630-770323f4b1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:35.409480 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3912/7814] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:53:35.417763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03878ae-a29e-4325-8992-7ac0abe98984 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:35.418836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03878ae-a29e-4325-8992-7ac0abe98984 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:35.419410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03878ae-a29e-4325-8992-7ac0abe98984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:35.472776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c03878ae-a29e-4325-8992-7ac0abe98984 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:35.475559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c03878ae-a29e-4325-8992-7ac0abe98984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:35.518426 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3903/7815] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:35.523134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3230a18-39e8-46f9-8630-770323f4b1b3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:35.547123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3230a18-39e8-46f9-8630-770323f4b1b3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:35.566186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deba9fd-ea30-4629-ab8a-17a22716e6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:35.567439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deba9fd-ea30-4629-ab8a-17a22716e6ab admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:35.567964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deba9fd-ea30-4629-ab8a-17a22716e6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:35.568497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deba9fd-ea30-4629-ab8a-17a22716e6ab admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:35.569269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deba9fd-ea30-4629-ab8a-17a22716e6ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:35.569759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deba9fd-ea30-4629-ab8a-17a22716e6ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:35.571666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deba9fd-ea30-4629-ab8a-17a22716e6ab admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:35.593105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03878ae-a29e-4325-8992-7ac0abe98984 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:35.600301 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3913/7816] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:35.606384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03878ae-a29e-4325-8992-7ac0abe98984 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:35.614635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55be05-4881-4b8e-8ff2-98af83d90bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:35.615603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55be05-4881-4b8e-8ff2-98af83d90bde admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:35.616563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55be05-4881-4b8e-8ff2-98af83d90bde admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:35.618263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55be05-4881-4b8e-8ff2-98af83d90bde admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:35.619178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55be05-4881-4b8e-8ff2-98af83d90bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:35.621387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55be05-4881-4b8e-8ff2-98af83d90bde admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:35.671586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deba9fd-ea30-4629-ab8a-17a22716e6ab admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:35.680712 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3904/7817] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:35 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:53:35.687770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deba9fd-ea30-4629-ab8a-17a22716e6ab admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:35.794359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:35.814152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97026591-b2fc-4ad3-ba19-29516e309932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:35.830405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97026591-b2fc-4ad3-ba19-29516e309932 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:35.831435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97026591-b2fc-4ad3-ba19-29516e309932 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:35.832206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97026591-b2fc-4ad3-ba19-29516e309932 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:35.833875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97026591-b2fc-4ad3-ba19-29516e309932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:35.837968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97026591-b2fc-4ad3-ba19-29516e309932 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:35.893007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55be05-4881-4b8e-8ff2-98af83d90bde admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:35.906536 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3914/7818] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:35 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:35.914516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55be05-4881-4b8e-8ff2-98af83d90bde admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:35.928980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92895bd0-fa60-459c-bdf2-7936a932bc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:35.929801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92895bd0-fa60-459c-bdf2-7936a932bc5c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:35.930176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92895bd0-fa60-459c-bdf2-7936a932bc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:35.930547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92895bd0-fa60-459c-bdf2-7936a932bc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:35.931353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92895bd0-fa60-459c-bdf2-7936a932bc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:35.933354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92895bd0-fa60-459c-bdf2-7936a932bc5c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:35.950541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97026591-b2fc-4ad3-ba19-29516e309932 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:35.958245 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3905/7819] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:35.962434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97026591-b2fc-4ad3-ba19-29516e309932 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:35.967832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da847af7-7ea4-4cf2-976f-f1e4277256c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:35.968766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da847af7-7ea4-4cf2-976f-f1e4277256c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:35.969269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da847af7-7ea4-4cf2-976f-f1e4277256c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:35.969996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da847af7-7ea4-4cf2-976f-f1e4277256c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:35.971028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da847af7-7ea4-4cf2-976f-f1e4277256c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:35.972890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da847af7-7ea4-4cf2-976f-f1e4277256c3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:35.990125 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3915/7820] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:35.992548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92895bd0-fa60-459c-bdf2-7936a932bc5c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:36.023296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92895bd0-fa60-459c-bdf2-7936a932bc5c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:36.042946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f37b6c-d519-4de5-8d02-01dd3ea48120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:36.043935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f37b6c-d519-4de5-8d02-01dd3ea48120 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:36.044456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f37b6c-d519-4de5-8d02-01dd3ea48120 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:36.044988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f37b6c-d519-4de5-8d02-01dd3ea48120 admin admin] PATH_INFO: `/v3/projects/8515233fd0464471b462ec3088ce7c94/users/da644de4a6b3496abb0ba485fffa9277/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:36.082275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f37b6c-d519-4de5-8d02-01dd3ea48120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8515233fd0464471b462ec3088ce7c94, user_id=da644de4a6b3496abb0ba485fffa9277, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:36.086497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f37b6c-d519-4de5-8d02-01dd3ea48120 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:36.123625 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3906/7821] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:35 2022] PUT /identity/v3/projects/8515233fd0464471b462ec3088ce7c94/users/da644de4a6b3496abb0ba485fffa9277/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:36.124153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c13e6e-25a8-4aeb-8ebe-f7c0cb5766a5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:36.124438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c13e6e-25a8-4aeb-8ebe-f7c0cb5766a5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:36.124714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c13e6e-25a8-4aeb-8ebe-f7c0cb5766a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:36.184326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-99c13e6e-25a8-4aeb-8ebe-f7c0cb5766a5 None None] MFA Rules not processed for user `da644de4a6b3496abb0ba485fffa9277`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:36.185584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-99c13e6e-25a8-4aeb-8ebe-f7c0cb5766a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:36.377707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f37b6c-d519-4de5-8d02-01dd3ea48120 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:36.378404 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3916/7822] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:36.380729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-10f37b6c-d519-4de5-8d02-01dd3ea48120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:36.483448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f37b6c-d519-4de5-8d02-01dd3ea48120 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:36.487601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c492d51-8ebc-44d1-bc6a-f6d236bbaae4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:36.488248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c492d51-8ebc-44d1-bc6a-f6d236bbaae4 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:36.488529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c492d51-8ebc-44d1-bc6a-f6d236bbaae4 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:36.488806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c492d51-8ebc-44d1-bc6a-f6d236bbaae4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:36.501977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c492d51-8ebc-44d1-bc6a-f6d236bbaae4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:36.504231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c492d51-8ebc-44d1-bc6a-f6d236bbaae4 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:36.533422 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3907/7823] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:36.734338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02ab6e-3fb4-4bd6-b459-934a8cd98ac1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:36.735713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02ab6e-3fb4-4bd6-b459-934a8cd98ac1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:36.737873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02ab6e-3fb4-4bd6-b459-934a8cd98ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:36.765328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fe02ab6e-3fb4-4bd6-b459-934a8cd98ac1 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:36.767663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fe02ab6e-3fb4-4bd6-b459-934a8cd98ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:36.918597 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3917/7824] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:53:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:37.001274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c492d51-8ebc-44d1-bc6a-f6d236bbaae4 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:37.002732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5c492d51-8ebc-44d1-bc6a-f6d236bbaae4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:37.116546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c492d51-8ebc-44d1-bc6a-f6d236bbaae4 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:37.123207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62212b21-01bf-4136-b2e2-9e8c6bdfef64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:37.124193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62212b21-01bf-4136-b2e2-9e8c6bdfef64 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:37.125242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62212b21-01bf-4136-b2e2-9e8c6bdfef64 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:37.125951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62212b21-01bf-4136-b2e2-9e8c6bdfef64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:37.137538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62212b21-01bf-4136-b2e2-9e8c6bdfef64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:37.140981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62212b21-01bf-4136-b2e2-9e8c6bdfef64 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:37.151842 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3908/7825] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:53:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:53:37.700951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc8a3-b20e-4608-a677-759cbb7ba716 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:37.701568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc8a3-b20e-4608-a677-759cbb7ba716 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:37.701568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc8a3-b20e-4608-a677-759cbb7ba716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:37.753543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-252dc8a3-b20e-4608-a677-759cbb7ba716 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:37.756075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-252dc8a3-b20e-4608-a677-759cbb7ba716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:37.777020 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3918/7826] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:53:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:37.795014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62212b21-01bf-4136-b2e2-9e8c6bdfef64 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:37.808464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:37.822837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62212b21-01bf-4136-b2e2-9e8c6bdfef64 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:37.842462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54e3ce-6671-4911-83ea-916ceda3e264 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:37.843072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54e3ce-6671-4911-83ea-916ceda3e264 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:37.843569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54e3ce-6671-4911-83ea-916ceda3e264 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:37.844019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54e3ce-6671-4911-83ea-916ceda3e264 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:37.865780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54e3ce-6671-4911-83ea-916ceda3e264 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:37.872189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54e3ce-6671-4911-83ea-916ceda3e264 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:37.907713 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3909/7827] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:53:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:53:38.406150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69d6f6-b7ce-4dfe-8151-499953850dda None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:38.406562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69d6f6-b7ce-4dfe-8151-499953850dda None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:38.407034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69d6f6-b7ce-4dfe-8151-499953850dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:38.456178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2a69d6f6-b7ce-4dfe-8151-499953850dda None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:38.457224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2a69d6f6-b7ce-4dfe-8151-499953850dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:38.481454 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3919/7828] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:53:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:38.490966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54e3ce-6671-4911-83ea-916ceda3e264 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:38.556648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54e3ce-6671-4911-83ea-916ceda3e264 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:38.587282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626accb-e088-40c3-a698-54dd2e47b92c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:38.588299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626accb-e088-40c3-a698-54dd2e47b92c service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:38.589071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626accb-e088-40c3-a698-54dd2e47b92c service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:38.589363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626accb-e088-40c3-a698-54dd2e47b92c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:38.615217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626accb-e088-40c3-a698-54dd2e47b92c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:38.622828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626accb-e088-40c3-a698-54dd2e47b92c service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:38.653694 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3910/7829] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:53:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:53:39.435876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba8ad1-6149-482e-8433-d5541bc302f0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:39.436810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba8ad1-6149-482e-8433-d5541bc302f0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:39.437265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba8ad1-6149-482e-8433-d5541bc302f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:39.488692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-77ba8ad1-6149-482e-8433-d5541bc302f0 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:39.491112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-77ba8ad1-6149-482e-8433-d5541bc302f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:39.531882 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3920/7830] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:53:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:39.555526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626accb-e088-40c3-a698-54dd2e47b92c service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:39.591847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626accb-e088-40c3-a698-54dd2e47b92c service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:39.602296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9ff67-9703-4bd1-9b42-d0bf6fdfcd01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:39.603291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9ff67-9703-4bd1-9b42-d0bf6fdfcd01 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:39.604532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9ff67-9703-4bd1-9b42-d0bf6fdfcd01 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:39.605036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9ff67-9703-4bd1-9b42-d0bf6fdfcd01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:39.629442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9ff67-9703-4bd1-9b42-d0bf6fdfcd01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:39.632932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9ff67-9703-4bd1-9b42-d0bf6fdfcd01 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:39.663593 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3911/7831] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:53:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:53:40.218179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0cf17-9468-4c5b-a86a-b5cc3252c2ad None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:40.218478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0cf17-9468-4c5b-a86a-b5cc3252c2ad None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:40.218809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0cf17-9468-4c5b-a86a-b5cc3252c2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:40.256719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-27a0cf17-9468-4c5b-a86a-b5cc3252c2ad None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:40.267705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-27a0cf17-9468-4c5b-a86a-b5cc3252c2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:40.282315 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3921/7832] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:53:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:40.298992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9ff67-9703-4bd1-9b42-d0bf6fdfcd01 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:40.326331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9ff67-9703-4bd1-9b42-d0bf6fdfcd01 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:40.335727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a9a83-1544-4c38-b534-9475d7393e0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:40.336868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a9a83-1544-4c38-b534-9475d7393e0a service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:40.337554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a9a83-1544-4c38-b534-9475d7393e0a service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:40.338137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a9a83-1544-4c38-b534-9475d7393e0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:40.372059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a9a83-1544-4c38-b534-9475d7393e0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:40.373907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a9a83-1544-4c38-b534-9475d7393e0a service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:40.412263 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3912/7833] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:53:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:53:41.026837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725462fc-9bbb-4328-ab50-ebb7e30c02d8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:41.027425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725462fc-9bbb-4328-ab50-ebb7e30c02d8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:41.027565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725462fc-9bbb-4328-ab50-ebb7e30c02d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:41.064584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-725462fc-9bbb-4328-ab50-ebb7e30c02d8 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:41.073613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-725462fc-9bbb-4328-ab50-ebb7e30c02d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:41.100517 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3922/7834] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:53:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:53:41.116724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a9a83-1544-4c38-b534-9475d7393e0a service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:41.137420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a9a83-1544-4c38-b534-9475d7393e0a service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:41.153657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd3c24-9384-410c-980a-e6b44d560605 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:41.154682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd3c24-9384-410c-980a-e6b44d560605 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:41.157350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd3c24-9384-410c-980a-e6b44d560605 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:41.157904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd3c24-9384-410c-980a-e6b44d560605 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:41.188944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd3c24-9384-410c-980a-e6b44d560605 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:41.191633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd3c24-9384-410c-980a-e6b44d560605 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:41.239964 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3913/7835] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:53:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:53:43.484963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78fc71-7981-483a-950a-fdfbbd91e39c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:43.485667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78fc71-7981-483a-950a-fdfbbd91e39c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:43.485667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78fc71-7981-483a-950a-fdfbbd91e39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:43.539842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8a78fc71-7981-483a-950a-fdfbbd91e39c None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:43.541227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8a78fc71-7981-483a-950a-fdfbbd91e39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:43.566782 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3923/7836] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:53:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:43.580456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd3c24-9384-410c-980a-e6b44d560605 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:43.598055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd3c24-9384-410c-980a-e6b44d560605 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:43.610552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56364fc-7ee7-48a5-866d-57617e4273aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:43.611369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56364fc-7ee7-48a5-866d-57617e4273aa service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:43.611748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56364fc-7ee7-48a5-866d-57617e4273aa service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:43.612122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56364fc-7ee7-48a5-866d-57617e4273aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:43.632400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56364fc-7ee7-48a5-866d-57617e4273aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:43.634197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56364fc-7ee7-48a5-866d-57617e4273aa service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:43.657627 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3914/7837] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:53:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:53:43.970775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d9534-d379-4f2b-9d80-e6b6a9fd7316 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:43.971173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d9534-d379-4f2b-9d80-e6b6a9fd7316 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:43.971591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d9534-d379-4f2b-9d80-e6b6a9fd7316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:44.011476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e03d9534-d379-4f2b-9d80-e6b6a9fd7316 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:44.013142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e03d9534-d379-4f2b-9d80-e6b6a9fd7316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:44.033183 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3924/7838] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:53:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:44.052377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56364fc-7ee7-48a5-866d-57617e4273aa service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:44.072037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56364fc-7ee7-48a5-866d-57617e4273aa service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:44.087419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90239e4-4add-4918-8523-a1dbba5f42ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:44.088346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90239e4-4add-4918-8523-a1dbba5f42ea service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:44.088873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90239e4-4add-4918-8523-a1dbba5f42ea service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:44.089394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90239e4-4add-4918-8523-a1dbba5f42ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:44.109288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90239e4-4add-4918-8523-a1dbba5f42ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:44.111285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90239e4-4add-4918-8523-a1dbba5f42ea service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:44.142122 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3915/7839] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:53:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:53:44.442591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e4ff4-d3b0-4e35-ae4b-b582a6f51015 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:44.446341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e4ff4-d3b0-4e35-ae4b-b582a6f51015 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:44.447005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e4ff4-d3b0-4e35-ae4b-b582a6f51015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:44.521076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b54e4ff4-d3b0-4e35-ae4b-b582a6f51015 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:44.522399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b54e4ff4-d3b0-4e35-ae4b-b582a6f51015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:44.555783 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3925/7840] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:53:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:44.572439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90239e4-4add-4918-8523-a1dbba5f42ea service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:44.599986 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90239e4-4add-4918-8523-a1dbba5f42ea service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:44.607794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83625e-4277-4751-8e42-1367127b2c90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:44.608725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83625e-4277-4751-8e42-1367127b2c90 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:44.609206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83625e-4277-4751-8e42-1367127b2c90 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:44.609672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83625e-4277-4751-8e42-1367127b2c90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:44.625296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83625e-4277-4751-8e42-1367127b2c90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:44.632366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83625e-4277-4751-8e42-1367127b2c90 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:44.651012 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3916/7841] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:53:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:53:44.950556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4517689-83ad-4989-861c-d3e549ea9080 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:44.950765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4517689-83ad-4989-861c-d3e549ea9080 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:44.951034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4517689-83ad-4989-861c-d3e549ea9080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:44.996591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e4517689-83ad-4989-861c-d3e549ea9080 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:45.000841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e4517689-83ad-4989-861c-d3e549ea9080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:45.026100 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3926/7842] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:53:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:45.039132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83625e-4277-4751-8e42-1367127b2c90 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:45.058925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83625e-4277-4751-8e42-1367127b2c90 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:45.072178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918dd31-4146-474a-a775-fd52a44dbdf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:45.072367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918dd31-4146-474a-a775-fd52a44dbdf3 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:45.072486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918dd31-4146-474a-a775-fd52a44dbdf3 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:45.072759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918dd31-4146-474a-a775-fd52a44dbdf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:45.103441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918dd31-4146-474a-a775-fd52a44dbdf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:45.106014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918dd31-4146-474a-a775-fd52a44dbdf3 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:45.128601 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3917/7843] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:53:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:53:45.401476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06f3b1-00a5-42ee-bf20-43dd376a94a5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:45.401780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06f3b1-00a5-42ee-bf20-43dd376a94a5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:45.402059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06f3b1-00a5-42ee-bf20-43dd376a94a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:45.444099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ba06f3b1-00a5-42ee-bf20-43dd376a94a5 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:45.450071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ba06f3b1-00a5-42ee-bf20-43dd376a94a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:45.474012 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3927/7844] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:53:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:45.483881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918dd31-4146-474a-a775-fd52a44dbdf3 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:45.502302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918dd31-4146-474a-a775-fd52a44dbdf3 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:45.517135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda2249-e9a5-422b-a5ab-0ab4a829ed41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:45.517881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda2249-e9a5-422b-a5ab-0ab4a829ed41 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:45.518416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda2249-e9a5-422b-a5ab-0ab4a829ed41 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:45.518922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda2249-e9a5-422b-a5ab-0ab4a829ed41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:45.538335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda2249-e9a5-422b-a5ab-0ab4a829ed41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:45.540448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda2249-e9a5-422b-a5ab-0ab4a829ed41 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:45.561378 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3918/7845] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:53:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:53:45.810070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e2bf6-7b2b-4d7c-99a8-706ec63b0880 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:45.811405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e2bf6-7b2b-4d7c-99a8-706ec63b0880 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:45.811887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e2bf6-7b2b-4d7c-99a8-706ec63b0880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:45.818326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa4021-abae-4d13-a963-95eef86ab400 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:45.819321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa4021-abae-4d13-a963-95eef86ab400 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:45.819797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa4021-abae-4d13-a963-95eef86ab400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:45.838883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:45.904366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-899e2bf6-7b2b-4d7c-99a8-706ec63b0880 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:45.908330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-66fa4021-abae-4d13-a963-95eef86ab400 None None] MFA Rules not processed for user `c2eb2f3c887947d5978d6bebd51c5b72`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:45.909214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-899e2bf6-7b2b-4d7c-99a8-706ec63b0880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:45.913208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-66fa4021-abae-4d13-a963-95eef86ab400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:45.931981 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3928/7846] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:53:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:45.947621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e2bf6-7b2b-4d7c-99a8-706ec63b0880 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:45.979192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e2bf6-7b2b-4d7c-99a8-706ec63b0880 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:46.006313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3e6e5-78ff-4ac7-9587-df5ba85a75bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:46.007386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3e6e5-78ff-4ac7-9587-df5ba85a75bc service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:46.007898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3e6e5-78ff-4ac7-9587-df5ba85a75bc service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:46.008513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3e6e5-78ff-4ac7-9587-df5ba85a75bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:46.024239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3e6e5-78ff-4ac7-9587-df5ba85a75bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:46.026542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3e6e5-78ff-4ac7-9587-df5ba85a75bc service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:46.054285 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3919/7847] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:53:46.075647 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3929/7848] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:53:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:53:46.281312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa4021-abae-4d13-a963-95eef86ab400 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:46.478914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:46.543663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa4021-abae-4d13-a963-95eef86ab400 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:46.561346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e4b2b-3d55-40fa-bcf1-a9936f4894a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:46.562478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e4b2b-3d55-40fa-bcf1-a9936f4894a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:46.562935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e4b2b-3d55-40fa-bcf1-a9936f4894a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:46.563479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e4b2b-3d55-40fa-bcf1-a9936f4894a3 admin admin] PATH_INFO: `/v3/users/da644de4a6b3496abb0ba485fffa9277` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:46.568118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e4b2b-3d55-40fa-bcf1-a9936f4894a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da644de4a6b3496abb0ba485fffa9277)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:46.581001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e4b2b-3d55-40fa-bcf1-a9936f4894a3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:46.703714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4d4e4b2b-3d55-40fa-bcf1-a9936f4894a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da644de4a6b3496abb0ba485fffa9277'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:46.704690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4d4e4b2b-3d55-40fa-bcf1-a9936f4894a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da644de4a6b3496abb0ba485fffa9277'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:46.727997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4d4e4b2b-3d55-40fa-bcf1-a9936f4894a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da644de4a6b3496abb0ba485fffa9277'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:46.749724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4d4e4b2b-3d55-40fa-bcf1-a9936f4894a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da644de4a6b3496abb0ba485fffa9277'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:46.790267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4d4e4b2b-3d55-40fa-bcf1-a9936f4894a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da644de4a6b3496abb0ba485fffa9277'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:46.832732 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3920/7849] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:46 2022] DELETE /identity/v3/users/da644de4a6b3496abb0ba485fffa9277 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:46.851721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418482-a4b4-4816-bee4-9250f4914a9d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:46.851721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418482-a4b4-4816-bee4-9250f4914a9d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:46.851721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418482-a4b4-4816-bee4-9250f4914a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:46.883317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-24418482-a4b4-4816-bee4-9250f4914a9d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:46.884855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-24418482-a4b4-4816-bee4-9250f4914a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:47.062839 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3930/7850] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:47.086152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e4b2b-3d55-40fa-bcf1-a9936f4894a3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:47.087945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4d4e4b2b-3d55-40fa-bcf1-a9936f4894a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:47.273910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e4b2b-3d55-40fa-bcf1-a9936f4894a3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:47.286160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00be17-0049-4f88-acce-47f31cb69c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:47.286808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00be17-0049-4f88-acce-47f31cb69c24 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:47.287088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00be17-0049-4f88-acce-47f31cb69c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:47.287386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00be17-0049-4f88-acce-47f31cb69c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:47.323597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00be17-0049-4f88-acce-47f31cb69c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:47.325372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00be17-0049-4f88-acce-47f31cb69c24 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:47.341442 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3921/7851] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:49.304457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24418482-a4b4-4816-bee4-9250f4914a9d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:49.305994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-24418482-a4b4-4816-bee4-9250f4914a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:49.334723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24418482-a4b4-4816-bee4-9250f4914a9d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:49.343495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b2a04-aac4-4d58-be9d-f5afd0793e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:49.344510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b2a04-aac4-4d58-be9d-f5afd0793e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:49.345022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b2a04-aac4-4d58-be9d-f5afd0793e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:49.345500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b2a04-aac4-4d58-be9d-f5afd0793e44 admin admin] PATH_INFO: `/v3/projects/8515233fd0464471b462ec3088ce7c94` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:49.348294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b2a04-aac4-4d58-be9d-f5afd0793e44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8515233fd0464471b462ec3088ce7c94)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:49.350598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b2a04-aac4-4d58-be9d-f5afd0793e44 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:49.466757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-053b2a04-aac4-4d58-be9d-f5afd0793e44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8515233fd0464471b462ec3088ce7c94', 'request_id': 'req-053b2a04-aac4-4d58-be9d-f5afd0793e44'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:49.485542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-053b2a04-aac4-4d58-be9d-f5afd0793e44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8515233fd0464471b462ec3088ce7c94', 'request_id': 'req-053b2a04-aac4-4d58-be9d-f5afd0793e44'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:49.507013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-053b2a04-aac4-4d58-be9d-f5afd0793e44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8515233fd0464471b462ec3088ce7c94', 'request_id': 'req-053b2a04-aac4-4d58-be9d-f5afd0793e44'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:49.533911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-053b2a04-aac4-4d58-be9d-f5afd0793e44 admin admin] The token cache is being invalidate because project 8515233fd0464471b462ec3088ce7c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:49.534601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-053b2a04-aac4-4d58-be9d-f5afd0793e44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:49.535516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-053b2a04-aac4-4d58-be9d-f5afd0793e44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:49.537266 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3931/7852] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:49 2022] DELETE /identity/v3/projects/8515233fd0464471b462ec3088ce7c94 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:49.543064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e332e4d-b171-431c-8192-188172490d70 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:49.544107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e332e4d-b171-431c-8192-188172490d70 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:49.544553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e332e4d-b171-431c-8192-188172490d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:49.595875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8e332e4d-b171-431c-8192-188172490d70 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:49.597945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8e332e4d-b171-431c-8192-188172490d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:49.746120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:49.804730 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3922/7853] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:49.813373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d677f-6e19-4cdd-8250-f813a6bd6baa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:49.818572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d677f-6e19-4cdd-8250-f813a6bd6baa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:49.819314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d677f-6e19-4cdd-8250-f813a6bd6baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:49.844253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-672d677f-6e19-4cdd-8250-f813a6bd6baa None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:49.845656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-672d677f-6e19-4cdd-8250-f813a6bd6baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:49.858131 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3932/7854] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:49.859392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e332e4d-b171-431c-8192-188172490d70 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:49.907189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e332e4d-b171-431c-8192-188172490d70 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:49.917792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d8ac1-ac0a-4bc3-a3d8-73f65363ae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:49.919485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d8ac1-ac0a-4bc3-a3d8-73f65363ae72 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:49.920250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d8ac1-ac0a-4bc3-a3d8-73f65363ae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:49.920822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d8ac1-ac0a-4bc3-a3d8-73f65363ae72 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:49.922656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d8ac1-ac0a-4bc3-a3d8-73f65363ae72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:49.939713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d8ac1-ac0a-4bc3-a3d8-73f65363ae72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:49.946734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d8ac1-ac0a-4bc3-a3d8-73f65363ae72 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:49.976944 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3923/7855] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:49.981140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d677f-6e19-4cdd-8250-f813a6bd6baa None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:49.993410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d677f-6e19-4cdd-8250-f813a6bd6baa None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:50.004170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1190f-70e0-45de-bd87-43bdd2d925a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:50.004867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1190f-70e0-45de-bd87-43bdd2d925a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:50.005351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1190f-70e0-45de-bd87-43bdd2d925a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:50.006446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1190f-70e0-45de-bd87-43bdd2d925a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:50.008193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1190f-70e0-45de-bd87-43bdd2d925a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:50.016824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1190f-70e0-45de-bd87-43bdd2d925a1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:50.074505 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3933/7856] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:49 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:50.080431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d8ac1-ac0a-4bc3-a3d8-73f65363ae72 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:50.106599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d8ac1-ac0a-4bc3-a3d8-73f65363ae72 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:50.245450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbda9a-efcd-48f8-96ee-ea445591d1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:50.246382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbda9a-efcd-48f8-96ee-ea445591d1cc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:50.246759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbda9a-efcd-48f8-96ee-ea445591d1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:50.247374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbda9a-efcd-48f8-96ee-ea445591d1cc admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:50.248017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbda9a-efcd-48f8-96ee-ea445591d1cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:50.251091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbda9a-efcd-48f8-96ee-ea445591d1cc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:50.303021 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3924/7857] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:50 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:50.307284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1190f-70e0-45de-bd87-43bdd2d925a1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:50.322058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1190f-70e0-45de-bd87-43bdd2d925a1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:50.335156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596e336-56fe-4bd6-9d89-1458f53f8631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:50.335830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596e336-56fe-4bd6-9d89-1458f53f8631 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:50.336148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596e336-56fe-4bd6-9d89-1458f53f8631 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:50.336430 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596e336-56fe-4bd6-9d89-1458f53f8631 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:50.338112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596e336-56fe-4bd6-9d89-1458f53f8631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:50.339785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596e336-56fe-4bd6-9d89-1458f53f8631 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:50.369589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbda9a-efcd-48f8-96ee-ea445591d1cc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:50.376250 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3934/7858] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:50.384788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbda9a-efcd-48f8-96ee-ea445591d1cc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:50.399662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a005e-ffa7-4acf-aed9-f7f35f21ec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:50.400324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a005e-ffa7-4acf-aed9-f7f35f21ec95 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:50.400594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a005e-ffa7-4acf-aed9-f7f35f21ec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:50.400872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a005e-ffa7-4acf-aed9-f7f35f21ec95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:50.401531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a005e-ffa7-4acf-aed9-f7f35f21ec95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:50.407895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a005e-ffa7-4acf-aed9-f7f35f21ec95 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:50.431823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596e336-56fe-4bd6-9d89-1458f53f8631 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:50.445212 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3925/7859] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:50.486745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596e336-56fe-4bd6-9d89-1458f53f8631 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:50.524578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60054e29-c5f4-4d44-ac83-a8b954050493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:50.525288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60054e29-c5f4-4d44-ac83-a8b954050493 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:50.525570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60054e29-c5f4-4d44-ac83-a8b954050493 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:50.537971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60054e29-c5f4-4d44-ac83-a8b954050493 admin admin] PATH_INFO: `/v3/projects/84383b1afd254082813699eff35bd203/users/e196960c896f4c049bdde7bae04e4888/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:50.581598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60054e29-c5f4-4d44-ac83-a8b954050493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84383b1afd254082813699eff35bd203, user_id=e196960c896f4c049bdde7bae04e4888, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:50.592602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60054e29-c5f4-4d44-ac83-a8b954050493 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:50.617022 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3935/7860] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:50 2022] PUT /identity/v3/projects/84383b1afd254082813699eff35bd203/users/e196960c896f4c049bdde7bae04e4888/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:50.629536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4173-6c73-46c2-af58-f0b2d7a1d591 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:50.630290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4173-6c73-46c2-af58-f0b2d7a1d591 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:50.630290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4173-6c73-46c2-af58-f0b2d7a1d591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:50.688171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-810a4173-6c73-46c2-af58-f0b2d7a1d591 None None] MFA Rules not processed for user `e196960c896f4c049bdde7bae04e4888`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:50.691689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-810a4173-6c73-46c2-af58-f0b2d7a1d591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:50.848263 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3926/7861] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:50.853504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60054e29-c5f4-4d44-ac83-a8b954050493 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:50.862123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:51.084268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60054e29-c5f4-4d44-ac83-a8b954050493 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:51.099032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296b5d7-22f6-47f0-9fab-49a756131c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:51.099821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296b5d7-22f6-47f0-9fab-49a756131c00 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:51.100267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296b5d7-22f6-47f0-9fab-49a756131c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:51.100661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296b5d7-22f6-47f0-9fab-49a756131c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:51.101415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296b5d7-22f6-47f0-9fab-49a756131c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:51.105786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296b5d7-22f6-47f0-9fab-49a756131c00 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:51.196394 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3936/7862] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:50 2022] POST /identity/v3/projects => generated 385 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:51.202491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a4173-6c73-46c2-af58-f0b2d7a1d591 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:51.218393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a4173-6c73-46c2-af58-f0b2d7a1d591 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:51.297967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:51.310017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375f765-37c3-486e-b43f-75fc5e37c91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:51.311107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375f765-37c3-486e-b43f-75fc5e37c91e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:51.311878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375f765-37c3-486e-b43f-75fc5e37c91e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:51.312392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375f765-37c3-486e-b43f-75fc5e37c91e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:51.313262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375f765-37c3-486e-b43f-75fc5e37c91e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:51.315423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375f765-37c3-486e-b43f-75fc5e37c91e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:51.361861 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3927/7863] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:51 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:51.365003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296b5d7-22f6-47f0-9fab-49a756131c00 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:51.394941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296b5d7-22f6-47f0-9fab-49a756131c00 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:51.409408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fab2b-d8fb-4c78-8abe-8096b22952cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:51.410221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fab2b-d8fb-4c78-8abe-8096b22952cd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:51.410498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fab2b-d8fb-4c78-8abe-8096b22952cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:51.410897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fab2b-d8fb-4c78-8abe-8096b22952cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:51.411726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fab2b-d8fb-4c78-8abe-8096b22952cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:51.415815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fab2b-d8fb-4c78-8abe-8096b22952cd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:51.456226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375f765-37c3-486e-b43f-75fc5e37c91e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:51.466873 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3937/7864] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:51.469243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375f765-37c3-486e-b43f-75fc5e37c91e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:51.484887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ffd63-bcaa-4c7c-92de-639a61f37eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:51.485750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ffd63-bcaa-4c7c-92de-639a61f37eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:51.486016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ffd63-bcaa-4c7c-92de-639a61f37eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:51.486358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ffd63-bcaa-4c7c-92de-639a61f37eb5 admin admin] PATH_INFO: `/v3/projects/f988ae7820f942a9a873d5850a06375f/users/f43847105b7542828ac87755e485cdf7/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:51.521594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ffd63-bcaa-4c7c-92de-639a61f37eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f988ae7820f942a9a873d5850a06375f, user_id=f43847105b7542828ac87755e485cdf7, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:51.525917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ffd63-bcaa-4c7c-92de-639a61f37eb5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:51.554741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fab2b-d8fb-4c78-8abe-8096b22952cd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:51.555208 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3928/7865] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:51 2022] PUT /identity/v3/projects/f988ae7820f942a9a873d5850a06375f/users/f43847105b7542828ac87755e485cdf7/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:51.567050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fab2b-d8fb-4c78-8abe-8096b22952cd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:51.695911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68921c9d-cf32-429e-9532-8da165753e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:51.697249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68921c9d-cf32-429e-9532-8da165753e41 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:51.697722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68921c9d-cf32-429e-9532-8da165753e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:51.698166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68921c9d-cf32-429e-9532-8da165753e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:51.699158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68921c9d-cf32-429e-9532-8da165753e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:51.701363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68921c9d-cf32-429e-9532-8da165753e41 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:51.720965 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3938/7866] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:53:51.725924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ffd63-bcaa-4c7c-92de-639a61f37eb5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:51.739657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ffd63-bcaa-4c7c-92de-639a61f37eb5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:51.746996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f550c-4e79-49d5-a3aa-5ba041107522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:51.748544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f550c-4e79-49d5-a3aa-5ba041107522 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:51.748984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f550c-4e79-49d5-a3aa-5ba041107522 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:51.749435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f550c-4e79-49d5-a3aa-5ba041107522 admin admin] PATH_INFO: `/v3/projects/f988ae7820f942a9a873d5850a06375f/users/f43847105b7542828ac87755e485cdf7/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:51.751848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f550c-4e79-49d5-a3aa-5ba041107522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f988ae7820f942a9a873d5850a06375f, user_id=f43847105b7542828ac87755e485cdf7, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:51.755951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f550c-4e79-49d5-a3aa-5ba041107522 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:51.783977 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3929/7867] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:51 2022] PUT /identity/v3/projects/f988ae7820f942a9a873d5850a06375f/users/f43847105b7542828ac87755e485cdf7/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:51.801880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91aaa7-f9fb-4eda-a30c-64f54761bc2f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:51.802215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91aaa7-f9fb-4eda-a30c-64f54761bc2f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:51.802425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91aaa7-f9fb-4eda-a30c-64f54761bc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:51.873067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0e91aaa7-f9fb-4eda-a30c-64f54761bc2f None None] MFA Rules not processed for user `f43847105b7542828ac87755e485cdf7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:51.874308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0e91aaa7-f9fb-4eda-a30c-64f54761bc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:52.155672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:52.172874 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3939/7868] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:53:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:52.368090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f550c-4e79-49d5-a3aa-5ba041107522 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:52.371936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6f2f550c-4e79-49d5-a3aa-5ba041107522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:52.508451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f550c-4e79-49d5-a3aa-5ba041107522 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:52.520464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6e9c1-d158-4ff8-818e-a1583a8b21eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:52.522745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6e9c1-d158-4ff8-818e-a1583a8b21eb service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:52.523063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6e9c1-d158-4ff8-818e-a1583a8b21eb service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:52.525038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6e9c1-d158-4ff8-818e-a1583a8b21eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:52.700667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6e9c1-d158-4ff8-818e-a1583a8b21eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:52.702357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6e9c1-d158-4ff8-818e-a1583a8b21eb service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:52.729366 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3930/7869] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:53:56.324371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91aaa7-f9fb-4eda-a30c-64f54761bc2f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:56.362612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91aaa7-f9fb-4eda-a30c-64f54761bc2f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:56.406235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1683042-c137-4910-8142-703fd7acc4d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:56.415594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683042-c137-4910-8142-703fd7acc4d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:56.418603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683042-c137-4910-8142-703fd7acc4d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:56.419305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683042-c137-4910-8142-703fd7acc4d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:56.455110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1683042-c137-4910-8142-703fd7acc4d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:56.463110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1683042-c137-4910-8142-703fd7acc4d0 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:56.507585 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3940/7870] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:02.717427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=67,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:04.015800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6e9c1-d158-4ff8-818e-a1583a8b21eb service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:04.035144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6e9c1-d158-4ff8-818e-a1583a8b21eb service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:04.050311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee395c-e39f-4d74-9803-cea3d56e35e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:04.050760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee395c-e39f-4d74-9803-cea3d56e35e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:04.051049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee395c-e39f-4d74-9803-cea3d56e35e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:04.051354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee395c-e39f-4d74-9803-cea3d56e35e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:04.053269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f6ee395c-e39f-4d74-9803-cea3d56e35e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:04.265183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1683042-c137-4910-8142-703fd7acc4d0 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:04.267456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee395c-e39f-4d74-9803-cea3d56e35e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:04.273253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee395c-e39f-4d74-9803-cea3d56e35e9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:04.305861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1683042-c137-4910-8142-703fd7acc4d0 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:04.322331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9e09e-a763-4bce-bb4a-4ca3ff19f983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:04.323762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9e09e-a763-4bce-bb4a-4ca3ff19f983 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:04.324204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9e09e-a763-4bce-bb4a-4ca3ff19f983 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:04.324529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9e09e-a763-4bce-bb4a-4ca3ff19f983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:04.331548 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3931/7871] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:04.332181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-73c9e09e-a763-4bce-bb4a-4ca3ff19f983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:04.350853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9e09e-a763-4bce-bb4a-4ca3ff19f983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:04.352867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9e09e-a763-4bce-bb4a-4ca3ff19f983 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:04.373628 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3941/7872] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:54:05.303104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee395c-e39f-4d74-9803-cea3d56e35e9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:05.306792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f6ee395c-e39f-4d74-9803-cea3d56e35e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:05.507571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee395c-e39f-4d74-9803-cea3d56e35e9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:05.523821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd743763-2bb2-4934-8d21-0e1f8f57f1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:05.527953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743763-2bb2-4934-8d21-0e1f8f57f1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:05.530507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743763-2bb2-4934-8d21-0e1f8f57f1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:05.531322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743763-2bb2-4934-8d21-0e1f8f57f1f7 admin admin] PATH_INFO: `/v3/users/09da0e6134774eb4bc9083e0126689ec` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:05.538738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd743763-2bb2-4934-8d21-0e1f8f57f1f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09da0e6134774eb4bc9083e0126689ec)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:05.542630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd743763-2bb2-4934-8d21-0e1f8f57f1f7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:05.653409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd743763-2bb2-4934-8d21-0e1f8f57f1f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09da0e6134774eb4bc9083e0126689ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:05.654476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd743763-2bb2-4934-8d21-0e1f8f57f1f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09da0e6134774eb4bc9083e0126689ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:05.694549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd743763-2bb2-4934-8d21-0e1f8f57f1f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09da0e6134774eb4bc9083e0126689ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:05.725901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd743763-2bb2-4934-8d21-0e1f8f57f1f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09da0e6134774eb4bc9083e0126689ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:05.788415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd743763-2bb2-4934-8d21-0e1f8f57f1f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09da0e6134774eb4bc9083e0126689ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:05.826760 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3932/7873] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:05 2022] DELETE /identity/v3/users/09da0e6134774eb4bc9083e0126689ec => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:05.832558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9bae2-44f2-4a3f-8acd-cc7c157ebf93 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:05.833359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9bae2-44f2-4a3f-8acd-cc7c157ebf93 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:05.833359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9bae2-44f2-4a3f-8acd-cc7c157ebf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:05.910283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-48a9bae2-44f2-4a3f-8acd-cc7c157ebf93 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:05.912210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-48a9bae2-44f2-4a3f-8acd-cc7c157ebf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:06.053186 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3942/7874] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:06.068513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd743763-2bb2-4934-8d21-0e1f8f57f1f7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:06.070834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cd743763-2bb2-4934-8d21-0e1f8f57f1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:06.095590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:06.265323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd743763-2bb2-4934-8d21-0e1f8f57f1f7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:06.272747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be80e3b-648d-4400-9a3b-e44409534b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:06.273485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be80e3b-648d-4400-9a3b-e44409534b31 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:06.273866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be80e3b-648d-4400-9a3b-e44409534b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:06.274229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be80e3b-648d-4400-9a3b-e44409534b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:06.297253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be80e3b-648d-4400-9a3b-e44409534b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:06.299557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be80e3b-648d-4400-9a3b-e44409534b31 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:06.314120 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3933/7875] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:07.229833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9bae2-44f2-4a3f-8acd-cc7c157ebf93 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:07.231415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-48a9bae2-44f2-4a3f-8acd-cc7c157ebf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:07.245937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9bae2-44f2-4a3f-8acd-cc7c157ebf93 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:07.270941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b1582-9af0-4249-8c34-3bde39e28931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:07.272823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b1582-9af0-4249-8c34-3bde39e28931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:07.274377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b1582-9af0-4249-8c34-3bde39e28931 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:07.274975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b1582-9af0-4249-8c34-3bde39e28931 admin admin] PATH_INFO: `/v3/projects/8e38ac9f181b490fbbe3dc70a0a13444` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:07.278377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b1582-9af0-4249-8c34-3bde39e28931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e38ac9f181b490fbbe3dc70a0a13444)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:07.284005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b1582-9af0-4249-8c34-3bde39e28931 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:07.413828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e5b1582-9af0-4249-8c34-3bde39e28931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e38ac9f181b490fbbe3dc70a0a13444', 'request_id': 'req-2e5b1582-9af0-4249-8c34-3bde39e28931'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:07.429367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e5b1582-9af0-4249-8c34-3bde39e28931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e38ac9f181b490fbbe3dc70a0a13444', 'request_id': 'req-2e5b1582-9af0-4249-8c34-3bde39e28931'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:07.440342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e5b1582-9af0-4249-8c34-3bde39e28931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e38ac9f181b490fbbe3dc70a0a13444', 'request_id': 'req-2e5b1582-9af0-4249-8c34-3bde39e28931'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:07.471810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e5b1582-9af0-4249-8c34-3bde39e28931 admin admin] The token cache is being invalidate because project 8e38ac9f181b490fbbe3dc70a0a13444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:07.472087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e5b1582-9af0-4249-8c34-3bde39e28931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:07.473459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e5b1582-9af0-4249-8c34-3bde39e28931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:07.476966 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3943/7876] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:07 2022] DELETE /identity/v3/projects/8e38ac9f181b490fbbe3dc70a0a13444 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:07.484124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118767e7-b8fc-477b-b07e-d9075092fe5a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:07.486003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118767e7-b8fc-477b-b07e-d9075092fe5a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:07.496785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118767e7-b8fc-477b-b07e-d9075092fe5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:07.549091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-118767e7-b8fc-477b-b07e-d9075092fe5a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:07.550593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-118767e7-b8fc-477b-b07e-d9075092fe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:07.647454 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3934/7877] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:07.650038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b9d95-4a84-465c-86e6-70f978b144b4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:07.650698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b9d95-4a84-465c-86e6-70f978b144b4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:07.651217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b9d95-4a84-465c-86e6-70f978b144b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:07.696843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-045b9d95-4a84-465c-86e6-70f978b144b4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:07.699415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-045b9d95-4a84-465c-86e6-70f978b144b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:07.721124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118767e7-b8fc-477b-b07e-d9075092fe5a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:07.727844 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3944/7878] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:07.734184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118767e7-b8fc-477b-b07e-d9075092fe5a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:07.744431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df03f10-4fb9-428f-bec0-06cc42525dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:07.745271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df03f10-4fb9-428f-bec0-06cc42525dab admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:07.745760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df03f10-4fb9-428f-bec0-06cc42525dab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:07.746309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df03f10-4fb9-428f-bec0-06cc42525dab admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:07.748177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df03f10-4fb9-428f-bec0-06cc42525dab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:07.748672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df03f10-4fb9-428f-bec0-06cc42525dab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:07.751094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df03f10-4fb9-428f-bec0-06cc42525dab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:07.771871 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3935/7879] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:54:07.774204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b9d95-4a84-465c-86e6-70f978b144b4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:07.785624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b9d95-4a84-465c-86e6-70f978b144b4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:07.792808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa22aa1-33a0-4158-b586-d80eceeac1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:07.793395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa22aa1-33a0-4158-b586-d80eceeac1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:07.793677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa22aa1-33a0-4158-b586-d80eceeac1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:07.793952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa22aa1-33a0-4158-b586-d80eceeac1e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:07.799334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa22aa1-33a0-4158-b586-d80eceeac1e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:07.799334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa22aa1-33a0-4158-b586-d80eceeac1e6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:07.842794 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3945/7880] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:07 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:07.847451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df03f10-4fb9-428f-bec0-06cc42525dab admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:07.859456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df03f10-4fb9-428f-bec0-06cc42525dab admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:07.927240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b570d5-e5e4-478a-b65f-fd614f516018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:07.928000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b570d5-e5e4-478a-b65f-fd614f516018 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:07.928345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b570d5-e5e4-478a-b65f-fd614f516018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:07.928711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b570d5-e5e4-478a-b65f-fd614f516018 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:07.929444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b570d5-e5e4-478a-b65f-fd614f516018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:07.932367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b570d5-e5e4-478a-b65f-fd614f516018 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:07.959100 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3936/7881] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:07 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:54:07.963884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa22aa1-33a0-4158-b586-d80eceeac1e6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:07.979390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa22aa1-33a0-4158-b586-d80eceeac1e6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:07.985637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8e347-6215-4714-a5a6-0a3e58550908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:07.986253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8e347-6215-4714-a5a6-0a3e58550908 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:07.986525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8e347-6215-4714-a5a6-0a3e58550908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:07.986805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8e347-6215-4714-a5a6-0a3e58550908 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:07.987491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8e347-6215-4714-a5a6-0a3e58550908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:07.989107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8e347-6215-4714-a5a6-0a3e58550908 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:08.004725 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3946/7882] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:08.008768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b570d5-e5e4-478a-b65f-fd614f516018 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:08.019958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b570d5-e5e4-478a-b65f-fd614f516018 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:08.025925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bf9dd-fd64-4475-abcc-eca4b74cbcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:08.026743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bf9dd-fd64-4475-abcc-eca4b74cbcd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:08.027126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bf9dd-fd64-4475-abcc-eca4b74cbcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:08.027632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bf9dd-fd64-4475-abcc-eca4b74cbcd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:08.028469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bf9dd-fd64-4475-abcc-eca4b74cbcd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:08.030502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bf9dd-fd64-4475-abcc-eca4b74cbcd4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:08.045300 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3937/7883] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:08.049890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8e347-6215-4714-a5a6-0a3e58550908 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:08.061927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8e347-6215-4714-a5a6-0a3e58550908 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:08.068238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a58de4-ba52-4dbb-9ae7-05b854a6cbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:08.068934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a58de4-ba52-4dbb-9ae7-05b854a6cbf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:08.069210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a58de4-ba52-4dbb-9ae7-05b854a6cbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:08.069689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a58de4-ba52-4dbb-9ae7-05b854a6cbf9 admin admin] PATH_INFO: `/v3/projects/2d28c793978e4a7194e6080f1b2d7c50/users/b0e262cd2026418faae4982b5f646071/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:08.090577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a58de4-ba52-4dbb-9ae7-05b854a6cbf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d28c793978e4a7194e6080f1b2d7c50, user_id=b0e262cd2026418faae4982b5f646071, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:08.093841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a58de4-ba52-4dbb-9ae7-05b854a6cbf9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:08.096690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:08.123994 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3947/7884] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:08 2022] PUT /identity/v3/projects/2d28c793978e4a7194e6080f1b2d7c50/users/b0e262cd2026418faae4982b5f646071/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:08.131144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe627c02-91bd-4fc3-8c91-f936469cb7cf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:08.131590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe627c02-91bd-4fc3-8c91-f936469cb7cf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:08.132048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe627c02-91bd-4fc3-8c91-f936469cb7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:08.164974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:08.169509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fe627c02-91bd-4fc3-8c91-f936469cb7cf None None] MFA Rules not processed for user `b0e262cd2026418faae4982b5f646071`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:08.171073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe627c02-91bd-4fc3-8c91-f936469cb7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:08.262136 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3938/7885] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:08.275685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a58de4-ba52-4dbb-9ae7-05b854a6cbf9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:08.280459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f1a58de4-ba52-4dbb-9ae7-05b854a6cbf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:08.436752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a58de4-ba52-4dbb-9ae7-05b854a6cbf9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:08.445917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3267997-5449-4623-9d90-3289e66a609a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:08.446684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3267997-5449-4623-9d90-3289e66a609a service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:08.447068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3267997-5449-4623-9d90-3289e66a609a service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:08.447472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3267997-5449-4623-9d90-3289e66a609a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:08.469618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3267997-5449-4623-9d90-3289e66a609a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:08.473354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3267997-5449-4623-9d90-3289e66a609a service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:08.496493 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3948/7886] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:08.538715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe627c02-91bd-4fc3-8c91-f936469cb7cf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:08.688960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe627c02-91bd-4fc3-8c91-f936469cb7cf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:08.711166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f61538-b473-4f36-b9b2-8ae9a8e62f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:08.712713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f61538-b473-4f36-b9b2-8ae9a8e62f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:08.716059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f61538-b473-4f36-b9b2-8ae9a8e62f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:08.718902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f61538-b473-4f36-b9b2-8ae9a8e62f16 admin admin] PATH_INFO: `/v3/users/b0e262cd2026418faae4982b5f646071` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:08.735874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f61538-b473-4f36-b9b2-8ae9a8e62f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0e262cd2026418faae4982b5f646071)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:08.738046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f61538-b473-4f36-b9b2-8ae9a8e62f16 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:08.815460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5f61538-b473-4f36-b9b2-8ae9a8e62f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0e262cd2026418faae4982b5f646071'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:08.816538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5f61538-b473-4f36-b9b2-8ae9a8e62f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0e262cd2026418faae4982b5f646071'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:08.835929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5f61538-b473-4f36-b9b2-8ae9a8e62f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0e262cd2026418faae4982b5f646071'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:08.858420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5f61538-b473-4f36-b9b2-8ae9a8e62f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0e262cd2026418faae4982b5f646071'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:08.885003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5f61538-b473-4f36-b9b2-8ae9a8e62f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0e262cd2026418faae4982b5f646071'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:08.899099 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3939/7887] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:08 2022] DELETE /identity/v3/users/b0e262cd2026418faae4982b5f646071 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:08.901236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656a2dd-3f00-433c-a363-d87cf9c56816 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:08.901644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656a2dd-3f00-433c-a363-d87cf9c56816 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:08.902034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656a2dd-3f00-433c-a363-d87cf9c56816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:08.944700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8656a2dd-3f00-433c-a363-d87cf9c56816 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:08.946513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8656a2dd-3f00-433c-a363-d87cf9c56816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:09.068030 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3949/7888] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:09.086713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f61538-b473-4f36-b9b2-8ae9a8e62f16 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:09.088375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5f61538-b473-4f36-b9b2-8ae9a8e62f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:09.129103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:09.182672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f61538-b473-4f36-b9b2-8ae9a8e62f16 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:09.190522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a74f4-e81a-44aa-984e-735cf990e7b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:09.191392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a74f4-e81a-44aa-984e-735cf990e7b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:09.191778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a74f4-e81a-44aa-984e-735cf990e7b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:09.192155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a74f4-e81a-44aa-984e-735cf990e7b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:09.204889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a74f4-e81a-44aa-984e-735cf990e7b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:09.206512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a74f4-e81a-44aa-984e-735cf990e7b2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:09.232415 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3940/7889] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:10.087935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656a2dd-3f00-433c-a363-d87cf9c56816 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:10.090259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8656a2dd-3f00-433c-a363-d87cf9c56816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:10.122168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656a2dd-3f00-433c-a363-d87cf9c56816 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:10.134074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457e0a9-c716-4199-a868-90839e31bf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:10.135615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457e0a9-c716-4199-a868-90839e31bf2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:10.136090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457e0a9-c716-4199-a868-90839e31bf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:10.136544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457e0a9-c716-4199-a868-90839e31bf2c admin admin] PATH_INFO: `/v3/projects/2d28c793978e4a7194e6080f1b2d7c50` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:10.138918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457e0a9-c716-4199-a868-90839e31bf2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d28c793978e4a7194e6080f1b2d7c50)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:10.142639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457e0a9-c716-4199-a868-90839e31bf2c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:10.215001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9457e0a9-c716-4199-a868-90839e31bf2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d28c793978e4a7194e6080f1b2d7c50', 'request_id': 'req-9457e0a9-c716-4199-a868-90839e31bf2c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:10.225279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9457e0a9-c716-4199-a868-90839e31bf2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d28c793978e4a7194e6080f1b2d7c50', 'request_id': 'req-9457e0a9-c716-4199-a868-90839e31bf2c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:10.236850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9457e0a9-c716-4199-a868-90839e31bf2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d28c793978e4a7194e6080f1b2d7c50', 'request_id': 'req-9457e0a9-c716-4199-a868-90839e31bf2c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:10.269362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9457e0a9-c716-4199-a868-90839e31bf2c admin admin] The token cache is being invalidate because project 2d28c793978e4a7194e6080f1b2d7c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:10.270627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9457e0a9-c716-4199-a868-90839e31bf2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:10.273822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9457e0a9-c716-4199-a868-90839e31bf2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:10.283237 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3950/7890] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:10 2022] DELETE /identity/v3/projects/2d28c793978e4a7194e6080f1b2d7c50 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:10.283850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e3c07-d25e-4fdf-8111-eb0fd7817763 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:10.284521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e3c07-d25e-4fdf-8111-eb0fd7817763 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:10.284521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e3c07-d25e-4fdf-8111-eb0fd7817763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:10.323115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8a0e3c07-d25e-4fdf-8111-eb0fd7817763 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:10.325996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a0e3c07-d25e-4fdf-8111-eb0fd7817763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:10.481675 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3941/7891] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:10.489190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcaf90-e4e8-4261-94b1-0e815733ed3c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:10.489474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcaf90-e4e8-4261-94b1-0e815733ed3c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:10.489817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcaf90-e4e8-4261-94b1-0e815733ed3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:10.518998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4cbcaf90-e4e8-4261-94b1-0e815733ed3c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:10.520354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4cbcaf90-e4e8-4261-94b1-0e815733ed3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:10.529550 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3951/7892] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:10.533679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e3c07-d25e-4fdf-8111-eb0fd7817763 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:10.546492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e3c07-d25e-4fdf-8111-eb0fd7817763 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:10.575987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807eb25d-f140-4dbc-beac-9962268142d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:10.576853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eb25d-f140-4dbc-beac-9962268142d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:10.577343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eb25d-f140-4dbc-beac-9962268142d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:10.577794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eb25d-f140-4dbc-beac-9962268142d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:10.578554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807eb25d-f140-4dbc-beac-9962268142d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:10.578966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807eb25d-f140-4dbc-beac-9962268142d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:10.583168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807eb25d-f140-4dbc-beac-9962268142d0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:10.616733 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3942/7893] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:54:10.618033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcaf90-e4e8-4261-94b1-0e815733ed3c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:10.634973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcaf90-e4e8-4261-94b1-0e815733ed3c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:10.642819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb71922-61d4-4636-ab8c-b24028c0668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:10.643881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb71922-61d4-4636-ab8c-b24028c0668c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:10.644400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb71922-61d4-4636-ab8c-b24028c0668c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:10.644916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb71922-61d4-4636-ab8c-b24028c0668c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:10.645765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb71922-61d4-4636-ab8c-b24028c0668c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:10.647976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb71922-61d4-4636-ab8c-b24028c0668c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:10.676932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:10.716949 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3952/7894] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:10 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:10.720278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807eb25d-f140-4dbc-beac-9962268142d0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:10.754617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807eb25d-f140-4dbc-beac-9962268142d0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:10.926261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3bec8-0a9a-4efb-a06f-318ee0d75cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:10.926885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3bec8-0a9a-4efb-a06f-318ee0d75cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:10.927210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3bec8-0a9a-4efb-a06f-318ee0d75cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:10.927511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3bec8-0a9a-4efb-a06f-318ee0d75cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:10.928153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3bec8-0a9a-4efb-a06f-318ee0d75cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:10.930107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3bec8-0a9a-4efb-a06f-318ee0d75cb0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:10.992207 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3943/7895] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:10 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:10.997117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb71922-61d4-4636-ab8c-b24028c0668c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:11.019333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb71922-61d4-4636-ab8c-b24028c0668c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:11.032672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af12feb-57a9-4275-a15b-9334f1faa475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:11.033684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af12feb-57a9-4275-a15b-9334f1faa475 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:11.034073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af12feb-57a9-4275-a15b-9334f1faa475 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:11.034496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af12feb-57a9-4275-a15b-9334f1faa475 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:11.035347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af12feb-57a9-4275-a15b-9334f1faa475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:11.038834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af12feb-57a9-4275-a15b-9334f1faa475 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:11.067786 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3953/7896] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:11.069609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3bec8-0a9a-4efb-a06f-318ee0d75cb0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:11.089327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3bec8-0a9a-4efb-a06f-318ee0d75cb0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:11.103545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1254c-ef65-4e34-ae42-7d9db2d6bdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:11.105744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1254c-ef65-4e34-ae42-7d9db2d6bdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:11.105744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1254c-ef65-4e34-ae42-7d9db2d6bdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:11.105744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1254c-ef65-4e34-ae42-7d9db2d6bdc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:11.105744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1254c-ef65-4e34-ae42-7d9db2d6bdc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:11.108007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1254c-ef65-4e34-ae42-7d9db2d6bdc2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:11.167682 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3944/7897] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:11.171822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af12feb-57a9-4275-a15b-9334f1faa475 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:11.194121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af12feb-57a9-4275-a15b-9334f1faa475 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:11.200280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc6b71-ab8e-42db-b389-085a9b3d35fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:11.201080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc6b71-ab8e-42db-b389-085a9b3d35fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:11.201326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc6b71-ab8e-42db-b389-085a9b3d35fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:11.201616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc6b71-ab8e-42db-b389-085a9b3d35fa admin admin] PATH_INFO: `/v3/projects/6edd5121207446ec8169cd90b4baaa40/users/30d37ada0e244d029437d592a6e8d475/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:11.242535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc6b71-ab8e-42db-b389-085a9b3d35fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6edd5121207446ec8169cd90b4baaa40, user_id=30d37ada0e244d029437d592a6e8d475, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:11.245326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc6b71-ab8e-42db-b389-085a9b3d35fa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:11.273597 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3954/7898] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:11 2022] PUT /identity/v3/projects/6edd5121207446ec8169cd90b4baaa40/users/30d37ada0e244d029437d592a6e8d475/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:11.287869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eec52-a0ac-4ab2-bb26-0fb3939f51ca None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:11.288780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eec52-a0ac-4ab2-bb26-0fb3939f51ca None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:11.289274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eec52-a0ac-4ab2-bb26-0fb3939f51ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:11.352444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-768eec52-a0ac-4ab2-bb26-0fb3939f51ca None None] MFA Rules not processed for user `30d37ada0e244d029437d592a6e8d475`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:11.353721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-768eec52-a0ac-4ab2-bb26-0fb3939f51ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:11.397864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:11.528265 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3945/7899] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:11.540743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc6b71-ab8e-42db-b389-085a9b3d35fa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:11.542969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-61fc6b71-ab8e-42db-b389-085a9b3d35fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:11.700833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc6b71-ab8e-42db-b389-085a9b3d35fa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:11.710465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e648e-601e-4631-b8de-6bfb55576789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:11.711292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e648e-601e-4631-b8de-6bfb55576789 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:11.711695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e648e-601e-4631-b8de-6bfb55576789 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:11.712082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e648e-601e-4631-b8de-6bfb55576789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:11.747850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e648e-601e-4631-b8de-6bfb55576789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:11.749462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e648e-601e-4631-b8de-6bfb55576789 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:11.780011 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3955/7900] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:20.030266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768eec52-a0ac-4ab2-bb26-0fb3939f51ca None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:20.032029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-768eec52-a0ac-4ab2-bb26-0fb3939f51ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:20.233377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768eec52-a0ac-4ab2-bb26-0fb3939f51ca None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:20.242909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd331b-b189-4359-95f6-352427926093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:20.244001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd331b-b189-4359-95f6-352427926093 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:20.244174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd331b-b189-4359-95f6-352427926093 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:20.244358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd331b-b189-4359-95f6-352427926093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:20.246669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6fbd331b-b189-4359-95f6-352427926093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:20.265285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd331b-b189-4359-95f6-352427926093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:20.275050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd331b-b189-4359-95f6-352427926093 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:20.284703 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3946/7901] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:21.769273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:25.884555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e648e-601e-4631-b8de-6bfb55576789 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:25.886634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-091e648e-601e-4631-b8de-6bfb55576789 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:26.039738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e648e-601e-4631-b8de-6bfb55576789 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:26.047560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7be50d-4b0c-4154-97b1-0167d909bbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:26.048263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7be50d-4b0c-4154-97b1-0167d909bbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:26.049365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7be50d-4b0c-4154-97b1-0167d909bbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:26.051466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7be50d-4b0c-4154-97b1-0167d909bbbf admin admin] PATH_INFO: `/v3/users/e196960c896f4c049bdde7bae04e4888` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:26.056972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7be50d-4b0c-4154-97b1-0167d909bbbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e196960c896f4c049bdde7bae04e4888)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:26.070623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7be50d-4b0c-4154-97b1-0167d909bbbf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:26.155706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1e7be50d-4b0c-4154-97b1-0167d909bbbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e196960c896f4c049bdde7bae04e4888'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:26.178786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1e7be50d-4b0c-4154-97b1-0167d909bbbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e196960c896f4c049bdde7bae04e4888'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:26.181237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1e7be50d-4b0c-4154-97b1-0167d909bbbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e196960c896f4c049bdde7bae04e4888'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:26.182194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1e7be50d-4b0c-4154-97b1-0167d909bbbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e196960c896f4c049bdde7bae04e4888'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:26.195931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1e7be50d-4b0c-4154-97b1-0167d909bbbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e196960c896f4c049bdde7bae04e4888'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:26.214244 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3956/7902] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:25 2022] DELETE /identity/v3/users/e196960c896f4c049bdde7bae04e4888 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:26.219462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9c855-5b75-451e-804c-64555c59201a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:26.219462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9c855-5b75-451e-804c-64555c59201a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:26.220072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9c855-5b75-451e-804c-64555c59201a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:26.258400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2bd9c855-5b75-451e-804c-64555c59201a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:26.259982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2bd9c855-5b75-451e-804c-64555c59201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:26.400134 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3947/7903] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:26.415010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7be50d-4b0c-4154-97b1-0167d909bbbf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:26.417630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1e7be50d-4b0c-4154-97b1-0167d909bbbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:26.542146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7be50d-4b0c-4154-97b1-0167d909bbbf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:26.546758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8ec2d-8f5b-473f-a26b-71dedad23e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:26.547348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8ec2d-8f5b-473f-a26b-71dedad23e63 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:26.547633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8ec2d-8f5b-473f-a26b-71dedad23e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:26.547925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8ec2d-8f5b-473f-a26b-71dedad23e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:26.572919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8ec2d-8f5b-473f-a26b-71dedad23e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:26.576864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8ec2d-8f5b-473f-a26b-71dedad23e63 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:26.601511 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3957/7904] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:27.484761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9c855-5b75-451e-804c-64555c59201a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:27.487482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2bd9c855-5b75-451e-804c-64555c59201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:27.514231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9c855-5b75-451e-804c-64555c59201a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:27.520119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:27.521031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:27.521470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:27.521929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7 admin admin] PATH_INFO: `/v3/projects/84383b1afd254082813699eff35bd203` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:27.531554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84383b1afd254082813699eff35bd203)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:27.533808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:27.649673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84383b1afd254082813699eff35bd203', 'request_id': 'req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:27.665861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84383b1afd254082813699eff35bd203', 'request_id': 'req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:27.673144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:27.679976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84383b1afd254082813699eff35bd203', 'request_id': 'req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:27.697977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7 admin admin] The token cache is being invalidate because project 84383b1afd254082813699eff35bd203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:27.698561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:27.699453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:27.701985 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3948/7905] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:27 2022] DELETE /identity/v3/projects/84383b1afd254082813699eff35bd203 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:27.706004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8ec2d-8f5b-473f-a26b-71dedad23e63 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:27.731191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8ec2d-8f5b-473f-a26b-71dedad23e63 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:27.774945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:27.848074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce02c6d-2ba0-4cae-82d2-4401eb10dd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:27.849521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce02c6d-2ba0-4cae-82d2-4401eb10dd1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:27.850053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce02c6d-2ba0-4cae-82d2-4401eb10dd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:27.850382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce02c6d-2ba0-4cae-82d2-4401eb10dd1d admin admin] PATH_INFO: `/v3/users/f43847105b7542828ac87755e485cdf7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:27.852716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce02c6d-2ba0-4cae-82d2-4401eb10dd1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f43847105b7542828ac87755e485cdf7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:27.854957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce02c6d-2ba0-4cae-82d2-4401eb10dd1d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:27.981445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cce02c6d-2ba0-4cae-82d2-4401eb10dd1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f43847105b7542828ac87755e485cdf7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:28.020162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cce02c6d-2ba0-4cae-82d2-4401eb10dd1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f43847105b7542828ac87755e485cdf7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:28.024865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cce02c6d-2ba0-4cae-82d2-4401eb10dd1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f43847105b7542828ac87755e485cdf7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:28.026033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cce02c6d-2ba0-4cae-82d2-4401eb10dd1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f43847105b7542828ac87755e485cdf7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:28.049542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cce02c6d-2ba0-4cae-82d2-4401eb10dd1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f43847105b7542828ac87755e485cdf7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:28.095368 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3958/7906] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:27 2022] DELETE /identity/v3/users/f43847105b7542828ac87755e485cdf7 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:54:28.797519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:28.798983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:28.831417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ceed3-ed77-4f0e-af4d-0084cce5aeb7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:29.026329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74587f6a-74c6-4533-acc4-9d818b16c955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:29.027350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74587f6a-74c6-4533-acc4-9d818b16c955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:29.027820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74587f6a-74c6-4533-acc4-9d818b16c955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:29.028421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74587f6a-74c6-4533-acc4-9d818b16c955 admin admin] PATH_INFO: `/v3/projects/f988ae7820f942a9a873d5850a06375f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:29.031236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74587f6a-74c6-4533-acc4-9d818b16c955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f988ae7820f942a9a873d5850a06375f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:29.035393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74587f6a-74c6-4533-acc4-9d818b16c955 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:29.120408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-74587f6a-74c6-4533-acc4-9d818b16c955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f988ae7820f942a9a873d5850a06375f', 'request_id': 'req-74587f6a-74c6-4533-acc4-9d818b16c955'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:29.139041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-74587f6a-74c6-4533-acc4-9d818b16c955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f988ae7820f942a9a873d5850a06375f', 'request_id': 'req-74587f6a-74c6-4533-acc4-9d818b16c955'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:29.150092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-74587f6a-74c6-4533-acc4-9d818b16c955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f988ae7820f942a9a873d5850a06375f', 'request_id': 'req-74587f6a-74c6-4533-acc4-9d818b16c955'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:29.175602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-74587f6a-74c6-4533-acc4-9d818b16c955 admin admin] The token cache is being invalidate because project f988ae7820f942a9a873d5850a06375f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:29.176057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-74587f6a-74c6-4533-acc4-9d818b16c955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:29.176844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-74587f6a-74c6-4533-acc4-9d818b16c955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:29.179900 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3949/7907] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:28 2022] DELETE /identity/v3/projects/f988ae7820f942a9a873d5850a06375f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:29.185260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77149e6e-f000-4bd2-9f9e-9d0a6a44c808 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:29.185813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77149e6e-f000-4bd2-9f9e-9d0a6a44c808 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:29.186042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77149e6e-f000-4bd2-9f9e-9d0a6a44c808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:29.230737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-77149e6e-f000-4bd2-9f9e-9d0a6a44c808 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:29.234652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-77149e6e-f000-4bd2-9f9e-9d0a6a44c808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:29.393108 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3959/7908] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:29.519089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa46ffe-419d-4fd6-bdb4-758e28b049ef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:29.519595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa46ffe-419d-4fd6-bdb4-758e28b049ef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:29.520238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa46ffe-419d-4fd6-bdb4-758e28b049ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:29.588586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5fa46ffe-419d-4fd6-bdb4-758e28b049ef None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:29.592230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5fa46ffe-419d-4fd6-bdb4-758e28b049ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:29.614411 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3950/7909] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:29.618578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77149e6e-f000-4bd2-9f9e-9d0a6a44c808 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:29.632525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77149e6e-f000-4bd2-9f9e-9d0a6a44c808 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:29.639548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a12d1-5573-45ad-a324-d0ccfcb15cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:29.640559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a12d1-5573-45ad-a324-d0ccfcb15cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:29.641002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a12d1-5573-45ad-a324-d0ccfcb15cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:29.641492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a12d1-5573-45ad-a324-d0ccfcb15cf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:29.642572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a12d1-5573-45ad-a324-d0ccfcb15cf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:29.643055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a12d1-5573-45ad-a324-d0ccfcb15cf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:29.646109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a12d1-5573-45ad-a324-d0ccfcb15cf6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:29.680200 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3960/7910] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:54:29.685156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa46ffe-419d-4fd6-bdb4-758e28b049ef None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:29.697500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa46ffe-419d-4fd6-bdb4-758e28b049ef None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:29.713441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4b66b-dcf9-4265-80a5-bf874086e0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:29.715109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4b66b-dcf9-4265-80a5-bf874086e0b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:29.715930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4b66b-dcf9-4265-80a5-bf874086e0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:29.718525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4b66b-dcf9-4265-80a5-bf874086e0b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:29.719456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4b66b-dcf9-4265-80a5-bf874086e0b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:29.726127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4b66b-dcf9-4265-80a5-bf874086e0b3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:29.805999 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3951/7911] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:29 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:29.810138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a12d1-5573-45ad-a324-d0ccfcb15cf6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:29.829383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a12d1-5573-45ad-a324-d0ccfcb15cf6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:29.914575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:29.992962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1166f-b12a-4712-9c00-bc740512354b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:29.994070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1166f-b12a-4712-9c00-bc740512354b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:29.994520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1166f-b12a-4712-9c00-bc740512354b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:29.995002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1166f-b12a-4712-9c00-bc740512354b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:29.996992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1166f-b12a-4712-9c00-bc740512354b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:29.999629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1166f-b12a-4712-9c00-bc740512354b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:30.037890 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3961/7912] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:29 2022] POST /identity/v3/users => generated 284 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:30.042104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4b66b-dcf9-4265-80a5-bf874086e0b3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:30.058252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4b66b-dcf9-4265-80a5-bf874086e0b3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:30.084705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4874c95-32c5-4315-bf70-1785c07d3bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:30.085994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4874c95-32c5-4315-bf70-1785c07d3bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.086277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4874c95-32c5-4315-bf70-1785c07d3bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.086576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4874c95-32c5-4315-bf70-1785c07d3bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.087303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4874c95-32c5-4315-bf70-1785c07d3bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:30.088939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4874c95-32c5-4315-bf70-1785c07d3bc2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:30.136935 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3952/7913] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:30.138218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1166f-b12a-4712-9c00-bc740512354b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:30.162777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1166f-b12a-4712-9c00-bc740512354b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:30.178907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ef70b-4945-4aa0-9db7-0daad5779488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:30.179707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ef70b-4945-4aa0-9db7-0daad5779488 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.179988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ef70b-4945-4aa0-9db7-0daad5779488 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.180269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ef70b-4945-4aa0-9db7-0daad5779488 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.181012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ef70b-4945-4aa0-9db7-0daad5779488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:30.182849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ef70b-4945-4aa0-9db7-0daad5779488 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:30.210585 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3962/7914] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:30.211822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4874c95-32c5-4315-bf70-1785c07d3bc2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:30.223049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4874c95-32c5-4315-bf70-1785c07d3bc2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:30.248060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26791e85-4f9c-42e3-818e-ca1d0874d661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:30.248785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26791e85-4f9c-42e3-818e-ca1d0874d661 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.249053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26791e85-4f9c-42e3-818e-ca1d0874d661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.249329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26791e85-4f9c-42e3-818e-ca1d0874d661 admin admin] PATH_INFO: `/v3/projects/d4556172b5a74a28ae288df5b9ad9a0f/users/a9d87297b30d457d8ecb683ea80c1164/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.296404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26791e85-4f9c-42e3-818e-ca1d0874d661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4556172b5a74a28ae288df5b9ad9a0f, user_id=a9d87297b30d457d8ecb683ea80c1164, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:30.302202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26791e85-4f9c-42e3-818e-ca1d0874d661 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:30.333665 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3953/7915] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:30 2022] PUT /identity/v3/projects/d4556172b5a74a28ae288df5b9ad9a0f/users/a9d87297b30d457d8ecb683ea80c1164/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:30.350477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8be662-ea1e-4f38-97be-3061e21058ae None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.350841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8be662-ea1e-4f38-97be-3061e21058ae None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.351026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8be662-ea1e-4f38-97be-3061e21058ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.435322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0d8be662-ea1e-4f38-97be-3061e21058ae None None] MFA Rules not processed for user `a9d87297b30d457d8ecb683ea80c1164`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:30.439450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0d8be662-ea1e-4f38-97be-3061e21058ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:30.686461 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3963/7916] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:30.691141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26791e85-4f9c-42e3-818e-ca1d0874d661 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:30.717561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:30.859276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26791e85-4f9c-42e3-818e-ca1d0874d661 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:30.864232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a2148-dde6-449f-b763-6c577217a38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:30.864857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a2148-dde6-449f-b763-6c577217a38e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.865137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a2148-dde6-449f-b763-6c577217a38e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.865412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a2148-dde6-449f-b763-6c577217a38e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.866053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a2148-dde6-449f-b763-6c577217a38e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:30.868044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a2148-dde6-449f-b763-6c577217a38e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:30.921252 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3954/7917] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:30 2022] POST /identity/v3/projects => generated 369 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:30.925065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8be662-ea1e-4f38-97be-3061e21058ae None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:30.947084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8be662-ea1e-4f38-97be-3061e21058ae None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:31.066556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64566b8-078b-4c60-bbbb-32ac0eb78583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:31.067246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64566b8-078b-4c60-bbbb-32ac0eb78583 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:31.067608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64566b8-078b-4c60-bbbb-32ac0eb78583 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:31.067920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64566b8-078b-4c60-bbbb-32ac0eb78583 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:31.068567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64566b8-078b-4c60-bbbb-32ac0eb78583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:31.070901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64566b8-078b-4c60-bbbb-32ac0eb78583 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:31.115384 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3964/7918] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:30 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:31.119037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a2148-dde6-449f-b763-6c577217a38e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:31.131236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a2148-dde6-449f-b763-6c577217a38e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:31.149391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59db70-1fa7-49b6-b468-2fca3d780cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:31.150041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59db70-1fa7-49b6-b468-2fca3d780cef admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:31.150324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59db70-1fa7-49b6-b468-2fca3d780cef admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:31.150602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59db70-1fa7-49b6-b468-2fca3d780cef admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:31.151311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59db70-1fa7-49b6-b468-2fca3d780cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:31.152984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59db70-1fa7-49b6-b468-2fca3d780cef admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:31.176934 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3955/7919] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:31.178743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64566b8-078b-4c60-bbbb-32ac0eb78583 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:31.198435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64566b8-078b-4c60-bbbb-32ac0eb78583 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:31.215806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364e7ae-6807-4879-a8ce-3169fac7dd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:31.217310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364e7ae-6807-4879-a8ce-3169fac7dd57 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:31.217601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364e7ae-6807-4879-a8ce-3169fac7dd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:31.217884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364e7ae-6807-4879-a8ce-3169fac7dd57 admin admin] PATH_INFO: `/v3/projects/9d0f3288e7754bdda0038ea3e0cc81f6/users/5df4afa518e34a20b63e3790e3fd9afa/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:31.264057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364e7ae-6807-4879-a8ce-3169fac7dd57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d0f3288e7754bdda0038ea3e0cc81f6, user_id=5df4afa518e34a20b63e3790e3fd9afa, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:31.269290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364e7ae-6807-4879-a8ce-3169fac7dd57 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:31.300396 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3965/7920] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:31 2022] PUT /identity/v3/projects/9d0f3288e7754bdda0038ea3e0cc81f6/users/5df4afa518e34a20b63e3790e3fd9afa/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:31.304586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59db70-1fa7-49b6-b468-2fca3d780cef admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:31.320949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59db70-1fa7-49b6-b468-2fca3d780cef admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:31.473421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81142e35-bee3-4dff-adba-5a0370234704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:31.474134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81142e35-bee3-4dff-adba-5a0370234704 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:31.474402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81142e35-bee3-4dff-adba-5a0370234704 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:31.474946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81142e35-bee3-4dff-adba-5a0370234704 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:31.475649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81142e35-bee3-4dff-adba-5a0370234704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:31.478607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81142e35-bee3-4dff-adba-5a0370234704 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:31.504829 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3956/7921] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:31.506129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364e7ae-6807-4879-a8ce-3169fac7dd57 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:31.515688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:31.530509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364e7ae-6807-4879-a8ce-3169fac7dd57 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:31.552776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82983fbd-ed26-4c50-ae94-8cfeaee44639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:31.564918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82983fbd-ed26-4c50-ae94-8cfeaee44639 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:31.565359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82983fbd-ed26-4c50-ae94-8cfeaee44639 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:31.567829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82983fbd-ed26-4c50-ae94-8cfeaee44639 admin admin] PATH_INFO: `/v3/projects/9d0f3288e7754bdda0038ea3e0cc81f6/users/5df4afa518e34a20b63e3790e3fd9afa/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:31.581400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82983fbd-ed26-4c50-ae94-8cfeaee44639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d0f3288e7754bdda0038ea3e0cc81f6, user_id=5df4afa518e34a20b63e3790e3fd9afa, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:31.588604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82983fbd-ed26-4c50-ae94-8cfeaee44639 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:31.638986 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3966/7922] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:31 2022] PUT /identity/v3/projects/9d0f3288e7754bdda0038ea3e0cc81f6/users/5df4afa518e34a20b63e3790e3fd9afa/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:31.645475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35cef2-dc3d-4237-9833-ffa17a0de07f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:31.645475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35cef2-dc3d-4237-9833-ffa17a0de07f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:31.647016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35cef2-dc3d-4237-9833-ffa17a0de07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:31.770528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9a35cef2-dc3d-4237-9833-ffa17a0de07f None None] MFA Rules not processed for user `5df4afa518e34a20b63e3790e3fd9afa`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:31.771945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9a35cef2-dc3d-4237-9833-ffa17a0de07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:32.091871 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3957/7923] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:32.117115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82983fbd-ed26-4c50-ae94-8cfeaee44639 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:32.119082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-82983fbd-ed26-4c50-ae94-8cfeaee44639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:32.305546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82983fbd-ed26-4c50-ae94-8cfeaee44639 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:32.317749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11051d5e-4c8b-4842-8ddd-eee6dcc5f161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:32.318705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11051d5e-4c8b-4842-8ddd-eee6dcc5f161 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:32.318991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11051d5e-4c8b-4842-8ddd-eee6dcc5f161 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:32.319511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11051d5e-4c8b-4842-8ddd-eee6dcc5f161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:32.341028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11051d5e-4c8b-4842-8ddd-eee6dcc5f161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:32.357853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11051d5e-4c8b-4842-8ddd-eee6dcc5f161 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:32.388821 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3967/7924] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:35.162545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35cef2-dc3d-4237-9833-ffa17a0de07f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:35.164049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9a35cef2-dc3d-4237-9833-ffa17a0de07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:35.187878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:35.383896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35cef2-dc3d-4237-9833-ffa17a0de07f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:35.396435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66254e5-f4ac-425d-81f5-dbc95885518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:35.399975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66254e5-f4ac-425d-81f5-dbc95885518d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:35.400374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66254e5-f4ac-425d-81f5-dbc95885518d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:35.402743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66254e5-f4ac-425d-81f5-dbc95885518d admin admin] PATH_INFO: `/v3/users/8327a851c5f44c7aaa6845f94992895e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:35.404924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66254e5-f4ac-425d-81f5-dbc95885518d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8327a851c5f44c7aaa6845f94992895e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:35.411134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66254e5-f4ac-425d-81f5-dbc95885518d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:35.509148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a66254e5-f4ac-425d-81f5-dbc95885518d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8327a851c5f44c7aaa6845f94992895e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:35.511642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a66254e5-f4ac-425d-81f5-dbc95885518d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8327a851c5f44c7aaa6845f94992895e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:35.521857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a66254e5-f4ac-425d-81f5-dbc95885518d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8327a851c5f44c7aaa6845f94992895e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:35.536256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a66254e5-f4ac-425d-81f5-dbc95885518d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8327a851c5f44c7aaa6845f94992895e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:35.572070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a66254e5-f4ac-425d-81f5-dbc95885518d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8327a851c5f44c7aaa6845f94992895e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:35.586875 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3958/7925] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:35 2022] DELETE /identity/v3/users/8327a851c5f44c7aaa6845f94992895e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:35.592076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ce9fa-cd37-4087-b778-6765771f2b0e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:35.592582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ce9fa-cd37-4087-b778-6765771f2b0e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:35.592666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ce9fa-cd37-4087-b778-6765771f2b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:35.633404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d99ce9fa-cd37-4087-b778-6765771f2b0e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:35.635706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d99ce9fa-cd37-4087-b778-6765771f2b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:35.794768 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3968/7926] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:35.817974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66254e5-f4ac-425d-81f5-dbc95885518d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:35.820012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a66254e5-f4ac-425d-81f5-dbc95885518d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:35.971949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66254e5-f4ac-425d-81f5-dbc95885518d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:35.980588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a2cfc-25f7-4595-b146-50f2087d78fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:35.981553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a2cfc-25f7-4595-b146-50f2087d78fc service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:35.981892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a2cfc-25f7-4595-b146-50f2087d78fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:35.982099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a2cfc-25f7-4595-b146-50f2087d78fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:35.995773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a2cfc-25f7-4595-b146-50f2087d78fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:35.998498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a2cfc-25f7-4595-b146-50f2087d78fc service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:36.013942 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3959/7927] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:36.498670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ce9fa-cd37-4087-b778-6765771f2b0e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:36.500537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d99ce9fa-cd37-4087-b778-6765771f2b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:36.524389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ce9fa-cd37-4087-b778-6765771f2b0e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:36.549728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:36.550393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:36.551325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:36.551325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab admin admin] PATH_INFO: `/v3/projects/fea8b474d3384c01b97c9daccc82a996` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:36.556601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea8b474d3384c01b97c9daccc82a996)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:36.559039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:36.672426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea8b474d3384c01b97c9daccc82a996', 'request_id': 'req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:36.685400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea8b474d3384c01b97c9daccc82a996', 'request_id': 'req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:36.703918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea8b474d3384c01b97c9daccc82a996', 'request_id': 'req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:36.731977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab admin admin] The token cache is being invalidate because project fea8b474d3384c01b97c9daccc82a996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:36.732654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:36.734701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:36.748233 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3969/7928] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:36 2022] DELETE /identity/v3/projects/fea8b474d3384c01b97c9daccc82a996 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:36.748579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b531a7-7ecd-442b-a9c4-392863330462 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:36.749010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b531a7-7ecd-442b-a9c4-392863330462 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:36.749126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b531a7-7ecd-442b-a9c4-392863330462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:36.815341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-16b531a7-7ecd-442b-a9c4-392863330462 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:36.816988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-16b531a7-7ecd-442b-a9c4-392863330462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:36.858859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:36.860866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:36.914293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:36.916454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:37.028813 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3960/7929] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:37.037074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c0300-317a-4fea-b89f-3c3132f919d9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:37.038068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c0300-317a-4fea-b89f-3c3132f919d9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:37.038490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c0300-317a-4fea-b89f-3c3132f919d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:37.084486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-140c0300-317a-4fea-b89f-3c3132f919d9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:37.085987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-140c0300-317a-4fea-b89f-3c3132f919d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:37.094913 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3961/7930] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:37.095084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ab2c9-3470-4e99-87f1-b5b8db8c10ab admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:37.098970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c0300-317a-4fea-b89f-3c3132f919d9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:37.109629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb038dd-fbd6-413f-a66d-71d2a7f435a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:37.110791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb038dd-fbd6-413f-a66d-71d2a7f435a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:37.111559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb038dd-fbd6-413f-a66d-71d2a7f435a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:37.111936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb038dd-fbd6-413f-a66d-71d2a7f435a5 admin admin] PATH_INFO: `/v3/users/a9d87297b30d457d8ecb683ea80c1164` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:37.113837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb038dd-fbd6-413f-a66d-71d2a7f435a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d87297b30d457d8ecb683ea80c1164)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:37.116497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c0300-317a-4fea-b89f-3c3132f919d9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:37.118970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb038dd-fbd6-413f-a66d-71d2a7f435a5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:37.132096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83befa95-3f89-41f7-a309-17393e1b4a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:37.133027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83befa95-3f89-41f7-a309-17393e1b4a00 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:37.133448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83befa95-3f89-41f7-a309-17393e1b4a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:37.133849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83befa95-3f89-41f7-a309-17393e1b4a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:37.134665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83befa95-3f89-41f7-a309-17393e1b4a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:37.135173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83befa95-3f89-41f7-a309-17393e1b4a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:37.137039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83befa95-3f89-41f7-a309-17393e1b4a00 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:37.169307 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3962/7931] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:54:37.174602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83befa95-3f89-41f7-a309-17393e1b4a00 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:37.201895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83befa95-3f89-41f7-a309-17393e1b4a00 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:37.218365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a617eae-9dda-4fb8-8a94-aa805be33df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:37.219286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a617eae-9dda-4fb8-8a94-aa805be33df6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:37.219707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a617eae-9dda-4fb8-8a94-aa805be33df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:37.220109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a617eae-9dda-4fb8-8a94-aa805be33df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:37.220875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a617eae-9dda-4fb8-8a94-aa805be33df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:37.223008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a617eae-9dda-4fb8-8a94-aa805be33df6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:37.232717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1fb038dd-fbd6-413f-a66d-71d2a7f435a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d87297b30d457d8ecb683ea80c1164'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:37.269637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1fb038dd-fbd6-413f-a66d-71d2a7f435a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d87297b30d457d8ecb683ea80c1164'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:37.271398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1fb038dd-fbd6-413f-a66d-71d2a7f435a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d87297b30d457d8ecb683ea80c1164'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:37.272462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1fb038dd-fbd6-413f-a66d-71d2a7f435a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d87297b30d457d8ecb683ea80c1164'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:37.284400 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3963/7932] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:37 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:54:37.287559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a617eae-9dda-4fb8-8a94-aa805be33df6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:37.290030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a617eae-9dda-4fb8-8a94-aa805be33df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:37.299082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1fb038dd-fbd6-413f-a66d-71d2a7f435a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d87297b30d457d8ecb683ea80c1164'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:37.330778 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3970/7933] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:36 2022] DELETE /identity/v3/users/a9d87297b30d457d8ecb683ea80c1164 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:54:37.333249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b512d-bf05-459c-909f-9d14867d0e33 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:37.333613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b512d-bf05-459c-909f-9d14867d0e33 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:37.334095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b512d-bf05-459c-909f-9d14867d0e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:37.386820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-179b512d-bf05-459c-909f-9d14867d0e33 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:37.392292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-179b512d-bf05-459c-909f-9d14867d0e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:37.466407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a617eae-9dda-4fb8-8a94-aa805be33df6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:37.539333 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3971/7934] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:37.546725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b512d-bf05-459c-909f-9d14867d0e33 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:37.549401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-179b512d-bf05-459c-909f-9d14867d0e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:37.591469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb557ae-6055-4aec-aefd-755fb6ad688a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:37.592112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb557ae-6055-4aec-aefd-755fb6ad688a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:37.592387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb557ae-6055-4aec-aefd-755fb6ad688a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:37.592668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb557ae-6055-4aec-aefd-755fb6ad688a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:37.593412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb557ae-6055-4aec-aefd-755fb6ad688a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:37.595800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb557ae-6055-4aec-aefd-755fb6ad688a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:37.625782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:37.631657 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3964/7935] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:37 2022] POST /identity/v3/users => generated 283 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:37.633634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb557ae-6055-4aec-aefd-755fb6ad688a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:37.684927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb557ae-6055-4aec-aefd-755fb6ad688a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:37.727367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c1ef3-7435-4c24-b5b2-95481b8556b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:37.728249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c1ef3-7435-4c24-b5b2-95481b8556b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:37.728759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c1ef3-7435-4c24-b5b2-95481b8556b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:37.734306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b512d-bf05-459c-909f-9d14867d0e33 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:37.734871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c1ef3-7435-4c24-b5b2-95481b8556b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:37.735765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c1ef3-7435-4c24-b5b2-95481b8556b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:37.738956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c1ef3-7435-4c24-b5b2-95481b8556b5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:37.744409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a30ac-a117-429d-8932-97f267ad2120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:37.747576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a30ac-a117-429d-8932-97f267ad2120 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:37.748020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a30ac-a117-429d-8932-97f267ad2120 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:37.748418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a30ac-a117-429d-8932-97f267ad2120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:37.769065 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3965/7936] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:37.772700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a30ac-a117-429d-8932-97f267ad2120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:37.773204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c1ef3-7435-4c24-b5b2-95481b8556b5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:37.774818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a30ac-a117-429d-8932-97f267ad2120 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:37.796133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c1ef3-7435-4c24-b5b2-95481b8556b5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:37.807221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcdec8-22a6-454a-8523-afa9ca125b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:37.808093 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcdec8-22a6-454a-8523-afa9ca125b2f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:37.808264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcdec8-22a6-454a-8523-afa9ca125b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:37.808540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcdec8-22a6-454a-8523-afa9ca125b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:37.809511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcdec8-22a6-454a-8523-afa9ca125b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:37.811353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcdec8-22a6-454a-8523-afa9ca125b2f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:37.817318 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3972/7937] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:37.828352 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3966/7938] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:37.831005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a30ac-a117-429d-8932-97f267ad2120 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:37.859712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a30ac-a117-429d-8932-97f267ad2120 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:37.883220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1730bd2-11f0-415e-ba5a-372d18ef03bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:37.884664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730bd2-11f0-415e-ba5a-372d18ef03bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:37.886705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730bd2-11f0-415e-ba5a-372d18ef03bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:37.888776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730bd2-11f0-415e-ba5a-372d18ef03bc admin admin] PATH_INFO: `/v3/projects/d77c90e30a854fba9f0e5d347e3cec9a/users/7237e474d65346be95b8c6298bc19b60/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:37.946073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1730bd2-11f0-415e-ba5a-372d18ef03bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77c90e30a854fba9f0e5d347e3cec9a, user_id=7237e474d65346be95b8c6298bc19b60, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:37.949896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1730bd2-11f0-415e-ba5a-372d18ef03bc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:37.995011 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3973/7939] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:37 2022] PUT /identity/v3/projects/d77c90e30a854fba9f0e5d347e3cec9a/users/7237e474d65346be95b8c6298bc19b60/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:37.995735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158b4a9-acb3-4d46-891d-72ff27ff71c0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:37.996198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158b4a9-acb3-4d46-891d-72ff27ff71c0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:37.997903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158b4a9-acb3-4d46-891d-72ff27ff71c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:38.010625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:38.050146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7158b4a9-acb3-4d46-891d-72ff27ff71c0 None None] MFA Rules not processed for user `7237e474d65346be95b8c6298bc19b60`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:38.052080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7158b4a9-acb3-4d46-891d-72ff27ff71c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:38.222118 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3967/7940] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:38.232789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1730bd2-11f0-415e-ba5a-372d18ef03bc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:38.234621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e1730bd2-11f0-415e-ba5a-372d18ef03bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:38.349094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1730bd2-11f0-415e-ba5a-372d18ef03bc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:38.353685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82e439-20b6-46e8-80e0-b580cd5ec800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:38.354495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82e439-20b6-46e8-80e0-b580cd5ec800 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:38.354780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82e439-20b6-46e8-80e0-b580cd5ec800 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:38.355232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82e439-20b6-46e8-80e0-b580cd5ec800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:38.366288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82e439-20b6-46e8-80e0-b580cd5ec800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:38.367855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82e439-20b6-46e8-80e0-b580cd5ec800 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:38.384794 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3974/7941] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:39.120421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158b4a9-acb3-4d46-891d-72ff27ff71c0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:39.123134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7158b4a9-acb3-4d46-891d-72ff27ff71c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:39.274370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158b4a9-acb3-4d46-891d-72ff27ff71c0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:39.285599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9fc17-6385-431f-b117-165f56da6c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:39.286265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9fc17-6385-431f-b117-165f56da6c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:39.286544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9fc17-6385-431f-b117-165f56da6c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:39.286818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9fc17-6385-431f-b117-165f56da6c5b admin admin] PATH_INFO: `/v3/projects/d4556172b5a74a28ae288df5b9ad9a0f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:39.296279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9fc17-6385-431f-b117-165f56da6c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4556172b5a74a28ae288df5b9ad9a0f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:39.298271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9fc17-6385-431f-b117-165f56da6c5b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:39.400471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31f9fc17-6385-431f-b117-165f56da6c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4556172b5a74a28ae288df5b9ad9a0f', 'request_id': 'req-31f9fc17-6385-431f-b117-165f56da6c5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:39.418143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31f9fc17-6385-431f-b117-165f56da6c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4556172b5a74a28ae288df5b9ad9a0f', 'request_id': 'req-31f9fc17-6385-431f-b117-165f56da6c5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:39.430725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31f9fc17-6385-431f-b117-165f56da6c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4556172b5a74a28ae288df5b9ad9a0f', 'request_id': 'req-31f9fc17-6385-431f-b117-165f56da6c5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:39.461886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31f9fc17-6385-431f-b117-165f56da6c5b admin admin] The token cache is being invalidate because project d4556172b5a74a28ae288df5b9ad9a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:39.462363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31f9fc17-6385-431f-b117-165f56da6c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:39.463175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31f9fc17-6385-431f-b117-165f56da6c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:39.464937 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3968/7942] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:39 2022] DELETE /identity/v3/projects/d4556172b5a74a28ae288df5b9ad9a0f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:39.469181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82e439-20b6-46e8-80e0-b580cd5ec800 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:39.490894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82e439-20b6-46e8-80e0-b580cd5ec800 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:39.643434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df6963-d864-4844-8650-0eb041fb568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:39.644978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df6963-d864-4844-8650-0eb041fb568e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:39.645936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df6963-d864-4844-8650-0eb041fb568e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:39.647016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df6963-d864-4844-8650-0eb041fb568e admin admin] PATH_INFO: `/v3/users/5df4afa518e34a20b63e3790e3fd9afa` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:39.650210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df6963-d864-4844-8650-0eb041fb568e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df4afa518e34a20b63e3790e3fd9afa)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:39.656138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df6963-d864-4844-8650-0eb041fb568e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:39.760709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13df6963-d864-4844-8650-0eb041fb568e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df4afa518e34a20b63e3790e3fd9afa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:39.772481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:39.779472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13df6963-d864-4844-8650-0eb041fb568e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df4afa518e34a20b63e3790e3fd9afa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:39.780753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13df6963-d864-4844-8650-0eb041fb568e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df4afa518e34a20b63e3790e3fd9afa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:39.781502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13df6963-d864-4844-8650-0eb041fb568e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df4afa518e34a20b63e3790e3fd9afa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:39.794112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13df6963-d864-4844-8650-0eb041fb568e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df4afa518e34a20b63e3790e3fd9afa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:39.811385 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3975/7943] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:39 2022] DELETE /identity/v3/users/5df4afa518e34a20b63e3790e3fd9afa => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:40.349978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9fc17-6385-431f-b117-165f56da6c5b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:40.353801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-31f9fc17-6385-431f-b117-165f56da6c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:40.394036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9fc17-6385-431f-b117-165f56da6c5b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:40.446284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:40.527369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b727015-83ac-4b60-b46c-fb8e0854aa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:40.528601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b727015-83ac-4b60-b46c-fb8e0854aa48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:40.528886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b727015-83ac-4b60-b46c-fb8e0854aa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:40.529165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b727015-83ac-4b60-b46c-fb8e0854aa48 admin admin] PATH_INFO: `/v3/projects/9d0f3288e7754bdda0038ea3e0cc81f6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:40.530942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b727015-83ac-4b60-b46c-fb8e0854aa48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d0f3288e7754bdda0038ea3e0cc81f6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:40.533625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b727015-83ac-4b60-b46c-fb8e0854aa48 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:40.641636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b727015-83ac-4b60-b46c-fb8e0854aa48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d0f3288e7754bdda0038ea3e0cc81f6', 'request_id': 'req-2b727015-83ac-4b60-b46c-fb8e0854aa48'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:40.658777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b727015-83ac-4b60-b46c-fb8e0854aa48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d0f3288e7754bdda0038ea3e0cc81f6', 'request_id': 'req-2b727015-83ac-4b60-b46c-fb8e0854aa48'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:40.673377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b727015-83ac-4b60-b46c-fb8e0854aa48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d0f3288e7754bdda0038ea3e0cc81f6', 'request_id': 'req-2b727015-83ac-4b60-b46c-fb8e0854aa48'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:40.682304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df6963-d864-4844-8650-0eb041fb568e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:40.684591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-13df6963-d864-4844-8650-0eb041fb568e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:40.724293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df6963-d864-4844-8650-0eb041fb568e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:40.743161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b727015-83ac-4b60-b46c-fb8e0854aa48 admin admin] The token cache is being invalidate because project 9d0f3288e7754bdda0038ea3e0cc81f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:40.744609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b727015-83ac-4b60-b46c-fb8e0854aa48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:40.750598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b727015-83ac-4b60-b46c-fb8e0854aa48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:40.753383 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3969/7944] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:40 2022] DELETE /identity/v3/projects/9d0f3288e7754bdda0038ea3e0cc81f6 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:54:40.759230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5acdaf-35aa-4309-a72f-add99ed2b84f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:40.759549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5acdaf-35aa-4309-a72f-add99ed2b84f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:40.759820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5acdaf-35aa-4309-a72f-add99ed2b84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:40.836519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2b5acdaf-35aa-4309-a72f-add99ed2b84f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:40.838097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b5acdaf-35aa-4309-a72f-add99ed2b84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:40.920516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729cca8-134b-48c6-91dc-be81c789368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:40.921181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729cca8-134b-48c6-91dc-be81c789368f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:40.921464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729cca8-134b-48c6-91dc-be81c789368f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:40.921742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729cca8-134b-48c6-91dc-be81c789368f admin admin] PATH_INFO: `/v3/users/30d37ada0e244d029437d592a6e8d475` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:40.926752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729cca8-134b-48c6-91dc-be81c789368f admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d37ada0e244d029437d592a6e8d475)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:40.928681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729cca8-134b-48c6-91dc-be81c789368f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:41.053392 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3729cca8-134b-48c6-91dc-be81c789368f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d37ada0e244d029437d592a6e8d475'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:41.058318 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3970/7945] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:41.062992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be54b3-f41a-4319-9d87-12ff1d8ed0e9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:41.063506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be54b3-f41a-4319-9d87-12ff1d8ed0e9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:41.063906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be54b3-f41a-4319-9d87-12ff1d8ed0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:41.102857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3729cca8-134b-48c6-91dc-be81c789368f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d37ada0e244d029437d592a6e8d475'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:41.103923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3729cca8-134b-48c6-91dc-be81c789368f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d37ada0e244d029437d592a6e8d475'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:41.104748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3729cca8-134b-48c6-91dc-be81c789368f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d37ada0e244d029437d592a6e8d475'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:41.110013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a4be54b3-f41a-4319-9d87-12ff1d8ed0e9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:41.121468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3729cca8-134b-48c6-91dc-be81c789368f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d37ada0e244d029437d592a6e8d475'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:41.127453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a4be54b3-f41a-4319-9d87-12ff1d8ed0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:41.143545 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3971/7946] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:41.148005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be54b3-f41a-4319-9d87-12ff1d8ed0e9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:41.158527 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3976/7947] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:40 2022] DELETE /identity/v3/users/30d37ada0e244d029437d592a6e8d475 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:41.163705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcb82e-ffd0-470b-8105-6d441d06769a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:41.164053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcb82e-ffd0-470b-8105-6d441d06769a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:41.164333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcb82e-ffd0-470b-8105-6d441d06769a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:41.176142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be54b3-f41a-4319-9d87-12ff1d8ed0e9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:41.219331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fdbcb82e-ffd0-470b-8105-6d441d06769a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:41.223537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fdbcb82e-ffd0-470b-8105-6d441d06769a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:41.285196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:41.310657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f22c17-f6ff-4b89-8ef9-c313baa5caa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:41.311397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f22c17-f6ff-4b89-8ef9-c313baa5caa2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:41.311680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f22c17-f6ff-4b89-8ef9-c313baa5caa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:41.311957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f22c17-f6ff-4b89-8ef9-c313baa5caa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:41.313037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f22c17-f6ff-4b89-8ef9-c313baa5caa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:41.313037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f22c17-f6ff-4b89-8ef9-c313baa5caa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:41.314593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f22c17-f6ff-4b89-8ef9-c313baa5caa2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:41.329861 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3972/7948] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:54:41.337381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f22c17-f6ff-4b89-8ef9-c313baa5caa2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:41.345335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:41.361843 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3977/7949] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:41.368077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f22c17-f6ff-4b89-8ef9-c313baa5caa2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:41.383336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcb82e-ffd0-470b-8105-6d441d06769a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:41.384202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23665f-17b0-437c-b4e1-e2d663b227d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:41.384914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23665f-17b0-437c-b4e1-e2d663b227d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:41.385201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23665f-17b0-437c-b4e1-e2d663b227d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:41.385387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fdbcb82e-ffd0-470b-8105-6d441d06769a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:41.385476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23665f-17b0-437c-b4e1-e2d663b227d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:41.386180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23665f-17b0-437c-b4e1-e2d663b227d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:41.388265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23665f-17b0-437c-b4e1-e2d663b227d7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:41.445777 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3973/7950] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:41 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:41.449704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23665f-17b0-437c-b4e1-e2d663b227d7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:41.538801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcb82e-ffd0-470b-8105-6d441d06769a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:41.603301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23665f-17b0-437c-b4e1-e2d663b227d7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:41.614832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71852a-277c-4df0-b5e4-aad5edbd0690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:41.615562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71852a-277c-4df0-b5e4-aad5edbd0690 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:41.615845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71852a-277c-4df0-b5e4-aad5edbd0690 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:41.617248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71852a-277c-4df0-b5e4-aad5edbd0690 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:41.618576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71852a-277c-4df0-b5e4-aad5edbd0690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:41.623477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71852a-277c-4df0-b5e4-aad5edbd0690 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:41.625173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03eed3-f482-4e9e-987f-8ad015d5e0e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:41.625774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03eed3-f482-4e9e-987f-8ad015d5e0e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:41.626057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03eed3-f482-4e9e-987f-8ad015d5e0e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:41.626321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03eed3-f482-4e9e-987f-8ad015d5e0e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:41.638028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03eed3-f482-4e9e-987f-8ad015d5e0e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:41.640525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03eed3-f482-4e9e-987f-8ad015d5e0e3 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:41.655369 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3978/7951] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:54:41.671041 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3974/7952] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:41 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:54:41.674988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03eed3-f482-4e9e-987f-8ad015d5e0e3 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:41.697314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03eed3-f482-4e9e-987f-8ad015d5e0e3 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:41.708367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79744ca-71af-451e-81c2-febaeadc910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:41.709180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79744ca-71af-451e-81c2-febaeadc910f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:41.709462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79744ca-71af-451e-81c2-febaeadc910f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:41.709735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79744ca-71af-451e-81c2-febaeadc910f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:41.710581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79744ca-71af-451e-81c2-febaeadc910f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:41.727504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79744ca-71af-451e-81c2-febaeadc910f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:41.753553 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3979/7953] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:41.757473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71852a-277c-4df0-b5e4-aad5edbd0690 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:41.781575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71852a-277c-4df0-b5e4-aad5edbd0690 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:41.796619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2962979-911b-4bda-9dba-9a196cccc500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:41.797268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2962979-911b-4bda-9dba-9a196cccc500 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:41.797549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2962979-911b-4bda-9dba-9a196cccc500 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:41.797825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2962979-911b-4bda-9dba-9a196cccc500 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:41.798589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2962979-911b-4bda-9dba-9a196cccc500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:41.805666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2962979-911b-4bda-9dba-9a196cccc500 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:41.833625 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3975/7954] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:54:41.835230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79744ca-71af-451e-81c2-febaeadc910f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:41.860463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79744ca-71af-451e-81c2-febaeadc910f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:41.880994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49623f72-c30e-4445-bbfb-cd87c257ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:41.882938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49623f72-c30e-4445-bbfb-cd87c257ebdf admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:41.883485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49623f72-c30e-4445-bbfb-cd87c257ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:41.883965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49623f72-c30e-4445-bbfb-cd87c257ebdf admin admin] PATH_INFO: `/v3/projects/287858b9a2b743b7bdb5c920808827ec/users/cfc1d68b5089467cb13b078067876c10/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:41.908003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49623f72-c30e-4445-bbfb-cd87c257ebdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=287858b9a2b743b7bdb5c920808827ec, user_id=cfc1d68b5089467cb13b078067876c10, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:41.911438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49623f72-c30e-4445-bbfb-cd87c257ebdf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:41.943774 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3980/7955] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:41 2022] PUT /identity/v3/projects/287858b9a2b743b7bdb5c920808827ec/users/cfc1d68b5089467cb13b078067876c10/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:41.955117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa09d19-6d2c-4756-85f1-5a788e79d4a3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:41.955484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa09d19-6d2c-4756-85f1-5a788e79d4a3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:41.956090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa09d19-6d2c-4756-85f1-5a788e79d4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:42.011927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5aa09d19-6d2c-4756-85f1-5a788e79d4a3 None None] MFA Rules not processed for user `cfc1d68b5089467cb13b078067876c10`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:42.013166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5aa09d19-6d2c-4756-85f1-5a788e79d4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:42.175766 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3976/7956] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:42.209212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49623f72-c30e-4445-bbfb-cd87c257ebdf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:42.373889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49623f72-c30e-4445-bbfb-cd87c257ebdf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:42.383035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767680a6-3eaf-4703-89ef-40dd9f70ebab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:42.383893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767680a6-3eaf-4703-89ef-40dd9f70ebab service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:42.384243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767680a6-3eaf-4703-89ef-40dd9f70ebab service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:42.384803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767680a6-3eaf-4703-89ef-40dd9f70ebab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:42.403565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767680a6-3eaf-4703-89ef-40dd9f70ebab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:42.415625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767680a6-3eaf-4703-89ef-40dd9f70ebab service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:42.429178 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3981/7957] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:54:42.430111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa09d19-6d2c-4756-85f1-5a788e79d4a3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:42.432520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5aa09d19-6d2c-4756-85f1-5a788e79d4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:42.501570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:42.572302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa09d19-6d2c-4756-85f1-5a788e79d4a3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:42.588925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31bc79-9dec-4ec4-9aec-a5334d43de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:42.589797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31bc79-9dec-4ec4-9aec-a5334d43de46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:42.590176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31bc79-9dec-4ec4-9aec-a5334d43de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:42.590570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31bc79-9dec-4ec4-9aec-a5334d43de46 admin admin] PATH_INFO: `/v3/projects/6edd5121207446ec8169cd90b4baaa40` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:42.596852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31bc79-9dec-4ec4-9aec-a5334d43de46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6edd5121207446ec8169cd90b4baaa40)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:42.607200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31bc79-9dec-4ec4-9aec-a5334d43de46 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:42.740344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac31bc79-9dec-4ec4-9aec-a5334d43de46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6edd5121207446ec8169cd90b4baaa40', 'request_id': 'req-ac31bc79-9dec-4ec4-9aec-a5334d43de46'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:42.762480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac31bc79-9dec-4ec4-9aec-a5334d43de46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6edd5121207446ec8169cd90b4baaa40', 'request_id': 'req-ac31bc79-9dec-4ec4-9aec-a5334d43de46'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:42.777606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac31bc79-9dec-4ec4-9aec-a5334d43de46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6edd5121207446ec8169cd90b4baaa40', 'request_id': 'req-ac31bc79-9dec-4ec4-9aec-a5334d43de46'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:42.803320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac31bc79-9dec-4ec4-9aec-a5334d43de46 admin admin] The token cache is being invalidate because project 6edd5121207446ec8169cd90b4baaa40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:42.803655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac31bc79-9dec-4ec4-9aec-a5334d43de46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:42.804426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac31bc79-9dec-4ec4-9aec-a5334d43de46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:42.808204 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3977/7958] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:42 2022] DELETE /identity/v3/projects/6edd5121207446ec8169cd90b4baaa40 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:43.531510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767680a6-3eaf-4703-89ef-40dd9f70ebab service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:43.560629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767680a6-3eaf-4703-89ef-40dd9f70ebab service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:43.629721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:43.709529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7448b0-114c-41af-983f-6328a7a21766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:43.710934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7448b0-114c-41af-983f-6328a7a21766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:43.711218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7448b0-114c-41af-983f-6328a7a21766 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:43.711572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7448b0-114c-41af-983f-6328a7a21766 admin admin] PATH_INFO: `/v3/users/cfc1d68b5089467cb13b078067876c10` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:43.712790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7448b0-114c-41af-983f-6328a7a21766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc1d68b5089467cb13b078067876c10)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:43.714809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7448b0-114c-41af-983f-6328a7a21766 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:43.804026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d7448b0-114c-41af-983f-6328a7a21766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc1d68b5089467cb13b078067876c10'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:43.828107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d7448b0-114c-41af-983f-6328a7a21766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc1d68b5089467cb13b078067876c10'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:43.843766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d7448b0-114c-41af-983f-6328a7a21766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc1d68b5089467cb13b078067876c10'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:43.847098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d7448b0-114c-41af-983f-6328a7a21766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc1d68b5089467cb13b078067876c10'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:43.881052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d7448b0-114c-41af-983f-6328a7a21766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc1d68b5089467cb13b078067876c10'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:43.897701 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3982/7959] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:43 2022] DELETE /identity/v3/users/cfc1d68b5089467cb13b078067876c10 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:43.902522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08435cfb-3c6e-4493-a630-2d0b4a295d0f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:43.903020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08435cfb-3c6e-4493-a630-2d0b4a295d0f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:43.903105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08435cfb-3c6e-4493-a630-2d0b4a295d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:43.950892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-08435cfb-3c6e-4493-a630-2d0b4a295d0f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:43.955164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08435cfb-3c6e-4493-a630-2d0b4a295d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:44.115594 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3978/7960] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:44.119591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7448b0-114c-41af-983f-6328a7a21766 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:44.121596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2d7448b0-114c-41af-983f-6328a7a21766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:44.248674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7448b0-114c-41af-983f-6328a7a21766 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:44.253497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab6b3d-59e8-4336-8dda-eefa67aba008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:44.254524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab6b3d-59e8-4336-8dda-eefa67aba008 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:44.255457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab6b3d-59e8-4336-8dda-eefa67aba008 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:44.255878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab6b3d-59e8-4336-8dda-eefa67aba008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:44.291882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab6b3d-59e8-4336-8dda-eefa67aba008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:44.294096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab6b3d-59e8-4336-8dda-eefa67aba008 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:44.311073 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3983/7961] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:44.482983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08435cfb-3c6e-4493-a630-2d0b4a295d0f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:44.484726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08435cfb-3c6e-4493-a630-2d0b4a295d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:44.504032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08435cfb-3c6e-4493-a630-2d0b4a295d0f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:44.519893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bc64a-0d2b-4fe6-bc4d-b7258a03152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:44.520755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bc64a-0d2b-4fe6-bc4d-b7258a03152e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:44.521129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bc64a-0d2b-4fe6-bc4d-b7258a03152e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:44.521503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bc64a-0d2b-4fe6-bc4d-b7258a03152e admin admin] PATH_INFO: `/v3/users/4dbf82f29f6b47c792b6d52228ed7fb3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:44.524791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bc64a-0d2b-4fe6-bc4d-b7258a03152e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dbf82f29f6b47c792b6d52228ed7fb3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:44.526953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bc64a-0d2b-4fe6-bc4d-b7258a03152e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:44.664647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d12bc64a-0d2b-4fe6-bc4d-b7258a03152e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbf82f29f6b47c792b6d52228ed7fb3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:44.667007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d12bc64a-0d2b-4fe6-bc4d-b7258a03152e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbf82f29f6b47c792b6d52228ed7fb3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:44.677340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:44.688758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d12bc64a-0d2b-4fe6-bc4d-b7258a03152e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbf82f29f6b47c792b6d52228ed7fb3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:44.748563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d12bc64a-0d2b-4fe6-bc4d-b7258a03152e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbf82f29f6b47c792b6d52228ed7fb3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:44.788312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d12bc64a-0d2b-4fe6-bc4d-b7258a03152e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbf82f29f6b47c792b6d52228ed7fb3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:44.812698 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3979/7962] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:44 2022] DELETE /identity/v3/users/4dbf82f29f6b47c792b6d52228ed7fb3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:44.817046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fc69a-d10d-4e98-8029-c06da159f013 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:44.817542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fc69a-d10d-4e98-8029-c06da159f013 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:44.817643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fc69a-d10d-4e98-8029-c06da159f013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:44.860429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f28fc69a-d10d-4e98-8029-c06da159f013 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:44.862221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f28fc69a-d10d-4e98-8029-c06da159f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:44.973605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:45.015316 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3984/7963] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:45.043094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bc64a-0d2b-4fe6-bc4d-b7258a03152e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:45.044755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d12bc64a-0d2b-4fe6-bc4d-b7258a03152e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:45.176709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bc64a-0d2b-4fe6-bc4d-b7258a03152e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:45.181283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dce0f-79dd-444f-b4c1-d0a105738790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:45.186321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dce0f-79dd-444f-b4c1-d0a105738790 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:45.186813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dce0f-79dd-444f-b4c1-d0a105738790 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:45.187428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dce0f-79dd-444f-b4c1-d0a105738790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:45.202405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dce0f-79dd-444f-b4c1-d0a105738790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:45.204292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dce0f-79dd-444f-b4c1-d0a105738790 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:45.233212 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3980/7964] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:45.369178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fc69a-d10d-4e98-8029-c06da159f013 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:45.370673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f28fc69a-d10d-4e98-8029-c06da159f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:45.418212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fc69a-d10d-4e98-8029-c06da159f013 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:45.447172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d31c97-d2b1-417c-ba30-761b3e9f9a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:45.447883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31c97-d2b1-417c-ba30-761b3e9f9a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:45.448166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31c97-d2b1-417c-ba30-761b3e9f9a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:45.448441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31c97-d2b1-417c-ba30-761b3e9f9a70 admin admin] PATH_INFO: `/v3/projects/287858b9a2b743b7bdb5c920808827ec` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:45.451103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d31c97-d2b1-417c-ba30-761b3e9f9a70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=287858b9a2b743b7bdb5c920808827ec)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:45.463807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d31c97-d2b1-417c-ba30-761b3e9f9a70 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:45.596790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-42d31c97-d2b1-417c-ba30-761b3e9f9a70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '287858b9a2b743b7bdb5c920808827ec', 'request_id': 'req-42d31c97-d2b1-417c-ba30-761b3e9f9a70'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:45.615197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-42d31c97-d2b1-417c-ba30-761b3e9f9a70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '287858b9a2b743b7bdb5c920808827ec', 'request_id': 'req-42d31c97-d2b1-417c-ba30-761b3e9f9a70'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:45.649712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-42d31c97-d2b1-417c-ba30-761b3e9f9a70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '287858b9a2b743b7bdb5c920808827ec', 'request_id': 'req-42d31c97-d2b1-417c-ba30-761b3e9f9a70'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:45.686981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-42d31c97-d2b1-417c-ba30-761b3e9f9a70 admin admin] The token cache is being invalidate because project 287858b9a2b743b7bdb5c920808827ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:45.687402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-42d31c97-d2b1-417c-ba30-761b3e9f9a70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:45.691814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-42d31c97-d2b1-417c-ba30-761b3e9f9a70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:45.700783 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3985/7965] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:45 2022] DELETE /identity/v3/projects/287858b9a2b743b7bdb5c920808827ec => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:45.705855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb008a-1f24-48be-8fa7-5f63c5bf87cb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:45.706088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb008a-1f24-48be-8fa7-5f63c5bf87cb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:45.706346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb008a-1f24-48be-8fa7-5f63c5bf87cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:45.776846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5fdb008a-1f24-48be-8fa7-5f63c5bf87cb None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:45.781230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5fdb008a-1f24-48be-8fa7-5f63c5bf87cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:45.976581 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3981/7966] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:45.977962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a081af-8436-47d9-8f4a-ee5406fa2f23 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:45.978628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a081af-8436-47d9-8f4a-ee5406fa2f23 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:45.978628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a081af-8436-47d9-8f4a-ee5406fa2f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:46.020573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-68a081af-8436-47d9-8f4a-ee5406fa2f23 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:46.021851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-68a081af-8436-47d9-8f4a-ee5406fa2f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:46.048827 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3986/7967] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:46.050256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb008a-1f24-48be-8fa7-5f63c5bf87cb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:46.068063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb008a-1f24-48be-8fa7-5f63c5bf87cb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:46.098337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d7075-5d68-47e1-a9e1-a554796e65d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:46.099542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d7075-5d68-47e1-a9e1-a554796e65d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:46.104297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d7075-5d68-47e1-a9e1-a554796e65d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:46.104849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d7075-5d68-47e1-a9e1-a554796e65d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:46.113508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d7075-5d68-47e1-a9e1-a554796e65d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:46.115505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d7075-5d68-47e1-a9e1-a554796e65d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:46.126492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d7075-5d68-47e1-a9e1-a554796e65d3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:46.194978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a081af-8436-47d9-8f4a-ee5406fa2f23 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:46.196238 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3982/7968] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:54:46.208762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a081af-8436-47d9-8f4a-ee5406fa2f23 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:46.230305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13939f-fe91-4324-b2cb-157d7667a053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:46.232955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13939f-fe91-4324-b2cb-157d7667a053 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:46.234287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13939f-fe91-4324-b2cb-157d7667a053 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:46.235048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13939f-fe91-4324-b2cb-157d7667a053 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:46.237097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13939f-fe91-4324-b2cb-157d7667a053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:46.239328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13939f-fe91-4324-b2cb-157d7667a053 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:46.287272 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3987/7969] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:46 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:46.293295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d7075-5d68-47e1-a9e1-a554796e65d3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:46.311175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d7075-5d68-47e1-a9e1-a554796e65d3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:46.465673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56bf4d-f5e0-4667-b4d5-ff93faf61146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:46.466315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56bf4d-f5e0-4667-b4d5-ff93faf61146 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:46.466601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56bf4d-f5e0-4667-b4d5-ff93faf61146 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:46.489404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56bf4d-f5e0-4667-b4d5-ff93faf61146 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:46.490315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56bf4d-f5e0-4667-b4d5-ff93faf61146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:46.492357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56bf4d-f5e0-4667-b4d5-ff93faf61146 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:46.502777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:46.527936 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3983/7970] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:46 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:46.531726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13939f-fe91-4324-b2cb-157d7667a053 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:46.542925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13939f-fe91-4324-b2cb-157d7667a053 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:46.555952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375bc78-9f72-4412-8698-dbc85b58447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:46.556729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375bc78-9f72-4412-8698-dbc85b58447e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:46.557119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375bc78-9f72-4412-8698-dbc85b58447e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:46.557399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375bc78-9f72-4412-8698-dbc85b58447e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:46.558076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375bc78-9f72-4412-8698-dbc85b58447e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:46.560087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375bc78-9f72-4412-8698-dbc85b58447e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:46.577161 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3988/7971] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:46.581416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56bf4d-f5e0-4667-b4d5-ff93faf61146 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:46.595049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56bf4d-f5e0-4667-b4d5-ff93faf61146 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:46.601664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192c80a-6261-4ad6-9593-d4cdde775d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:46.602304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192c80a-6261-4ad6-9593-d4cdde775d13 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:46.602585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192c80a-6261-4ad6-9593-d4cdde775d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:46.602860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192c80a-6261-4ad6-9593-d4cdde775d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:46.603726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192c80a-6261-4ad6-9593-d4cdde775d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:46.605490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192c80a-6261-4ad6-9593-d4cdde775d13 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:46.619876 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3984/7972] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:46.622780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375bc78-9f72-4412-8698-dbc85b58447e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:46.634874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375bc78-9f72-4412-8698-dbc85b58447e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:46.640287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e02ff3-7ee7-4539-bd02-bbe1219b4daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:46.641352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e02ff3-7ee7-4539-bd02-bbe1219b4daf admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:46.641843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e02ff3-7ee7-4539-bd02-bbe1219b4daf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:46.642353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e02ff3-7ee7-4539-bd02-bbe1219b4daf admin admin] PATH_INFO: `/v3/projects/fe79b49285c34ba9ba69ee1b377f3024/users/412953db3ef7488384d29339130a0483/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:46.662419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e02ff3-7ee7-4539-bd02-bbe1219b4daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe79b49285c34ba9ba69ee1b377f3024, user_id=412953db3ef7488384d29339130a0483, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:46.666467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e02ff3-7ee7-4539-bd02-bbe1219b4daf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:46.694571 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3989/7973] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:46 2022] PUT /identity/v3/projects/fe79b49285c34ba9ba69ee1b377f3024/users/412953db3ef7488384d29339130a0483/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:46.695595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b287c4-69d5-4195-9756-fb5d1148018b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:46.695947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b287c4-69d5-4195-9756-fb5d1148018b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:46.696242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b287c4-69d5-4195-9756-fb5d1148018b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:46.735353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c4b287c4-69d5-4195-9756-fb5d1148018b None None] MFA Rules not processed for user `412953db3ef7488384d29339130a0483`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:46.736663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c4b287c4-69d5-4195-9756-fb5d1148018b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:46.821101 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3985/7974] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:46.831771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e02ff3-7ee7-4539-bd02-bbe1219b4daf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:46.833704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e6e02ff3-7ee7-4539-bd02-bbe1219b4daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:46.921029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e02ff3-7ee7-4539-bd02-bbe1219b4daf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:46.925963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeec9b9-5fcd-4dad-a70b-598ab203de60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:46.926783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeec9b9-5fcd-4dad-a70b-598ab203de60 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:46.927156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeec9b9-5fcd-4dad-a70b-598ab203de60 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:46.927549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeec9b9-5fcd-4dad-a70b-598ab203de60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:46.938936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeec9b9-5fcd-4dad-a70b-598ab203de60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:46.941013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeec9b9-5fcd-4dad-a70b-598ab203de60 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:46.986960 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3990/7975] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:47.149119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b287c4-69d5-4195-9756-fb5d1148018b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:47.150700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c4b287c4-69d5-4195-9756-fb5d1148018b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:47.351056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b287c4-69d5-4195-9756-fb5d1148018b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:47.364125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38182503-781a-410a-a3e5-1195e00dde77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:47.365543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38182503-781a-410a-a3e5-1195e00dde77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:47.366608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38182503-781a-410a-a3e5-1195e00dde77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:47.367031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38182503-781a-410a-a3e5-1195e00dde77 admin admin] PATH_INFO: `/v3/projects/c061e2a2a05f4804a15e3c5c8af33afd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:47.369196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38182503-781a-410a-a3e5-1195e00dde77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c061e2a2a05f4804a15e3c5c8af33afd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:47.372274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38182503-781a-410a-a3e5-1195e00dde77 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:47.447447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38182503-781a-410a-a3e5-1195e00dde77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c061e2a2a05f4804a15e3c5c8af33afd', 'request_id': 'req-38182503-781a-410a-a3e5-1195e00dde77'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:47.458909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38182503-781a-410a-a3e5-1195e00dde77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c061e2a2a05f4804a15e3c5c8af33afd', 'request_id': 'req-38182503-781a-410a-a3e5-1195e00dde77'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:47.467474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38182503-781a-410a-a3e5-1195e00dde77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c061e2a2a05f4804a15e3c5c8af33afd', 'request_id': 'req-38182503-781a-410a-a3e5-1195e00dde77'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:47.479871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:47.485329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38182503-781a-410a-a3e5-1195e00dde77 admin admin] The token cache is being invalidate because project c061e2a2a05f4804a15e3c5c8af33afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:47.485823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38182503-781a-410a-a3e5-1195e00dde77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:47.487531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38182503-781a-410a-a3e5-1195e00dde77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:47.497010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0ccdc-d0b5-45d0-9e2f-afbab318cd02 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:47.497608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0ccdc-d0b5-45d0-9e2f-afbab318cd02 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:47.498135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0ccdc-d0b5-45d0-9e2f-afbab318cd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:47.502059 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3986/7976] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:47 2022] DELETE /identity/v3/projects/c061e2a2a05f4804a15e3c5c8af33afd => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:47.517220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:47.530113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-93a0ccdc-d0b5-45d0-9e2f-afbab318cd02 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:47.531747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-93a0ccdc-d0b5-45d0-9e2f-afbab318cd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:47.623919 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3991/7977] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:47.632198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0b01e-f31e-4cf7-8316-46f4285a1dc2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:47.632510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0b01e-f31e-4cf7-8316-46f4285a1dc2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:47.632787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0b01e-f31e-4cf7-8316-46f4285a1dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:47.657506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aff0b01e-f31e-4cf7-8316-46f4285a1dc2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:47.659023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aff0b01e-f31e-4cf7-8316-46f4285a1dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:47.669105 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3987/7978] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:47.672496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0ccdc-d0b5-45d0-9e2f-afbab318cd02 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:47.698464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0ccdc-d0b5-45d0-9e2f-afbab318cd02 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:47.720252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46437c62-bc93-4544-b6ec-dfb3f264dfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:47.720989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46437c62-bc93-4544-b6ec-dfb3f264dfce admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:47.721274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46437c62-bc93-4544-b6ec-dfb3f264dfce admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:47.721552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46437c62-bc93-4544-b6ec-dfb3f264dfce admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:47.722271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46437c62-bc93-4544-b6ec-dfb3f264dfce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:47.722578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46437c62-bc93-4544-b6ec-dfb3f264dfce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:47.727661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46437c62-bc93-4544-b6ec-dfb3f264dfce admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:47.754015 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3992/7979] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:54:47.756436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0b01e-f31e-4cf7-8316-46f4285a1dc2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:47.774750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0b01e-f31e-4cf7-8316-46f4285a1dc2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:47.786557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993c352-505d-4f91-b6fd-2e4114663cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:47.787552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993c352-505d-4f91-b6fd-2e4114663cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:47.787552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993c352-505d-4f91-b6fd-2e4114663cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:47.787761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993c352-505d-4f91-b6fd-2e4114663cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:47.790429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993c352-505d-4f91-b6fd-2e4114663cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:47.795100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993c352-505d-4f91-b6fd-2e4114663cb2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:47.862374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46437c62-bc93-4544-b6ec-dfb3f264dfce admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:47.870735 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3988/7980] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:47 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:47.875660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46437c62-bc93-4544-b6ec-dfb3f264dfce admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:47.959097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993c352-505d-4f91-b6fd-2e4114663cb2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:47.962250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8993c352-505d-4f91-b6fd-2e4114663cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:47.996949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159244c-d813-48d9-9059-20adb3daf08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:47.997793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159244c-d813-48d9-9059-20adb3daf08d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:47.998610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159244c-d813-48d9-9059-20adb3daf08d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:47.998974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159244c-d813-48d9-9059-20adb3daf08d admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:48.000467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159244c-d813-48d9-9059-20adb3daf08d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:48.003114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159244c-d813-48d9-9059-20adb3daf08d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:48.032496 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3993/7981] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:47 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:48.036164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159244c-d813-48d9-9059-20adb3daf08d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:48.039348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993c352-505d-4f91-b6fd-2e4114663cb2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:48.044876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2528e69-576c-45b2-b28f-e4e23f853450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:48.045579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2528e69-576c-45b2-b28f-e4e23f853450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:48.046396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2528e69-576c-45b2-b28f-e4e23f853450 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:48.046396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2528e69-576c-45b2-b28f-e4e23f853450 admin admin] PATH_INFO: `/v3/users/bdf74d45169e4342a566271d5d2dc1a0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:48.047377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2528e69-576c-45b2-b28f-e4e23f853450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf74d45169e4342a566271d5d2dc1a0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:48.049453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2528e69-576c-45b2-b28f-e4e23f853450 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:48.051846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159244c-d813-48d9-9059-20adb3daf08d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:48.062410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1119a-83e8-41b7-8db7-57e5b94e4ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:48.063589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1119a-83e8-41b7-8db7-57e5b94e4ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:48.064046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1119a-83e8-41b7-8db7-57e5b94e4ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:48.067269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1119a-83e8-41b7-8db7-57e5b94e4ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:48.068219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1119a-83e8-41b7-8db7-57e5b94e4ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:48.070669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1119a-83e8-41b7-8db7-57e5b94e4ea0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:48.086708 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3994/7982] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:54:48.089721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1119a-83e8-41b7-8db7-57e5b94e4ea0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:48.102645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1119a-83e8-41b7-8db7-57e5b94e4ea0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:48.110000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228f98d-b266-4d66-a72e-e835cf065622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:48.110768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228f98d-b266-4d66-a72e-e835cf065622 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:48.111381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228f98d-b266-4d66-a72e-e835cf065622 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:48.111669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228f98d-b266-4d66-a72e-e835cf065622 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:48.112477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228f98d-b266-4d66-a72e-e835cf065622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:48.116153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228f98d-b266-4d66-a72e-e835cf065622 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:48.119914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e2528e69-576c-45b2-b28f-e4e23f853450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf74d45169e4342a566271d5d2dc1a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:48.120973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e2528e69-576c-45b2-b28f-e4e23f853450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf74d45169e4342a566271d5d2dc1a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:48.131620 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3995/7983] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:48.132801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228f98d-b266-4d66-a72e-e835cf065622 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:48.133842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e2528e69-576c-45b2-b28f-e4e23f853450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf74d45169e4342a566271d5d2dc1a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:48.135480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c228f98d-b266-4d66-a72e-e835cf065622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:48.143851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e2528e69-576c-45b2-b28f-e4e23f853450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf74d45169e4342a566271d5d2dc1a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:48.156481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228f98d-b266-4d66-a72e-e835cf065622 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:48.163654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686d3c6-623c-496b-a9d8-f07553c2e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:48.165001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686d3c6-623c-496b-a9d8-f07553c2e2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:48.165342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686d3c6-623c-496b-a9d8-f07553c2e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:48.165732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686d3c6-623c-496b-a9d8-f07553c2e2bf admin admin] PATH_INFO: `/v3/projects/0e5e31e7c76c480da39020b5643b3ea2/users/8836529f06a34114ae8aa0ea4b727bd1/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:48.167409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e2528e69-576c-45b2-b28f-e4e23f853450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf74d45169e4342a566271d5d2dc1a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:48.178302 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3989/7984] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:47 2022] DELETE /identity/v3/users/bdf74d45169e4342a566271d5d2dc1a0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:48.180239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69d6dd-f155-4b11-b9c0-9d64f7f94a2c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:48.180556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69d6dd-f155-4b11-b9c0-9d64f7f94a2c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:48.180838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69d6dd-f155-4b11-b9c0-9d64f7f94a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:48.200729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686d3c6-623c-496b-a9d8-f07553c2e2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5e31e7c76c480da39020b5643b3ea2, user_id=8836529f06a34114ae8aa0ea4b727bd1, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:48.205278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686d3c6-623c-496b-a9d8-f07553c2e2bf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:48.213370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4a69d6dd-f155-4b11-b9c0-9d64f7f94a2c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:48.214735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a69d6dd-f155-4b11-b9c0-9d64f7f94a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:48.231861 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3996/7985] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:48 2022] PUT /identity/v3/projects/0e5e31e7c76c480da39020b5643b3ea2/users/8836529f06a34114ae8aa0ea4b727bd1/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:48.282404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:48.307546 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3990/7986] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:48.320295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686d3c6-623c-496b-a9d8-f07553c2e2bf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:48.331061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b686d3c6-623c-496b-a9d8-f07553c2e2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:48.356868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb996-90d2-4caa-a9a7-2d8cfc853c77 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:48.357168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb996-90d2-4caa-a9a7-2d8cfc853c77 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:48.357749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb996-90d2-4caa-a9a7-2d8cfc853c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:48.392305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-89edb996-90d2-4caa-a9a7-2d8cfc853c77 None None] MFA Rules not processed for user `8836529f06a34114ae8aa0ea4b727bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:48.393531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89edb996-90d2-4caa-a9a7-2d8cfc853c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:48.413467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:48.466211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686d3c6-623c-496b-a9d8-f07553c2e2bf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:48.474556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6698c98-4598-4f92-aaff-40e78af82cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:48.475935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6698c98-4598-4f92-aaff-40e78af82cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:48.475935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6698c98-4598-4f92-aaff-40e78af82cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:48.475935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6698c98-4598-4f92-aaff-40e78af82cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:48.501091 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3991/7987] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:48.514080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edb996-90d2-4caa-a9a7-2d8cfc853c77 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:48.515553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89edb996-90d2-4caa-a9a7-2d8cfc853c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:48.591153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6698c98-4598-4f92-aaff-40e78af82cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:48.592870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6698c98-4598-4f92-aaff-40e78af82cf5 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:48.610350 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3997/7988] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:48.616005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edb996-90d2-4caa-a9a7-2d8cfc853c77 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:48.620378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20d525-74f4-4316-9686-0f8f6e707324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:48.621750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d525-74f4-4316-9686-0f8f6e707324 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:48.622426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d525-74f4-4316-9686-0f8f6e707324 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:48.622699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d525-74f4-4316-9686-0f8f6e707324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:48.641074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20d525-74f4-4316-9686-0f8f6e707324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:48.642539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20d525-74f4-4316-9686-0f8f6e707324 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:48.655050 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3992/7989] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:49.036710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6698c98-4598-4f92-aaff-40e78af82cf5 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:49.038742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b6698c98-4598-4f92-aaff-40e78af82cf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:49.059689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6698c98-4598-4f92-aaff-40e78af82cf5 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:49.071640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7077706-6d4e-41f2-9742-6985cebedbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:49.076305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7077706-6d4e-41f2-9742-6985cebedbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:49.076674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7077706-6d4e-41f2-9742-6985cebedbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:49.077076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7077706-6d4e-41f2-9742-6985cebedbbf admin admin] PATH_INFO: `/v3/projects/44ee3e4980bf48e5a68704beb792e87a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:49.080490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7077706-6d4e-41f2-9742-6985cebedbbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=44ee3e4980bf48e5a68704beb792e87a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:49.086313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7077706-6d4e-41f2-9742-6985cebedbbf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:49.193909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f7077706-6d4e-41f2-9742-6985cebedbbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44ee3e4980bf48e5a68704beb792e87a', 'request_id': 'req-f7077706-6d4e-41f2-9742-6985cebedbbf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:49.204350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f7077706-6d4e-41f2-9742-6985cebedbbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44ee3e4980bf48e5a68704beb792e87a', 'request_id': 'req-f7077706-6d4e-41f2-9742-6985cebedbbf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:49.212483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f7077706-6d4e-41f2-9742-6985cebedbbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44ee3e4980bf48e5a68704beb792e87a', 'request_id': 'req-f7077706-6d4e-41f2-9742-6985cebedbbf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:49.233761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f7077706-6d4e-41f2-9742-6985cebedbbf admin admin] The token cache is being invalidate because project 44ee3e4980bf48e5a68704beb792e87a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:49.234227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f7077706-6d4e-41f2-9742-6985cebedbbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:49.239038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f7077706-6d4e-41f2-9742-6985cebedbbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:49.243838 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3998/7990] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:49 2022] DELETE /identity/v3/projects/44ee3e4980bf48e5a68704beb792e87a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:49.248828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1ac9e-f027-4659-be6a-b5671c1f0727 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:49.249670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1ac9e-f027-4659-be6a-b5671c1f0727 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:49.250038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1ac9e-f027-4659-be6a-b5671c1f0727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:49.293893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-06a1ac9e-f027-4659-be6a-b5671c1f0727 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:49.297095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-06a1ac9e-f027-4659-be6a-b5671c1f0727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:49.411826 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3993/7991] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:49.419535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67f14e-95c6-411c-96c1-0a70ba89cfbd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:49.419906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67f14e-95c6-411c-96c1-0a70ba89cfbd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:49.420408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67f14e-95c6-411c-96c1-0a70ba89cfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:49.451551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fb67f14e-95c6-411c-96c1-0a70ba89cfbd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:49.452876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fb67f14e-95c6-411c-96c1-0a70ba89cfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:49.495950 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3999/7992] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:49.500683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1ac9e-f027-4659-be6a-b5671c1f0727 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:49.511167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1ac9e-f027-4659-be6a-b5671c1f0727 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:49.515971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ea87b-6c0e-4547-8c30-9641b1cf0fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:49.516592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ea87b-6c0e-4547-8c30-9641b1cf0fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:49.516871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ea87b-6c0e-4547-8c30-9641b1cf0fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:49.517147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ea87b-6c0e-4547-8c30-9641b1cf0fe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:49.517808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ea87b-6c0e-4547-8c30-9641b1cf0fe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:49.518111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ea87b-6c0e-4547-8c30-9641b1cf0fe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:49.519876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ea87b-6c0e-4547-8c30-9641b1cf0fe5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:49.537465 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3994/7993] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:54:49.538527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67f14e-95c6-411c-96c1-0a70ba89cfbd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:49.549617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67f14e-95c6-411c-96c1-0a70ba89cfbd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:49.554952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07666149-b9cd-4a46-9231-02dd2f48f021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:49.555615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07666149-b9cd-4a46-9231-02dd2f48f021 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:49.555899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07666149-b9cd-4a46-9231-02dd2f48f021 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:49.556173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07666149-b9cd-4a46-9231-02dd2f48f021 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:49.556825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07666149-b9cd-4a46-9231-02dd2f48f021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:49.562614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07666149-b9cd-4a46-9231-02dd2f48f021 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:49.597771 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4000/7994] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:49 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:49.601661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ea87b-6c0e-4547-8c30-9641b1cf0fe5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:49.612643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ea87b-6c0e-4547-8c30-9641b1cf0fe5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:49.626477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:49.696796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da992df-36c2-4bb8-aa1b-9719fda46ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:49.697438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da992df-36c2-4bb8-aa1b-9719fda46ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:49.697816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da992df-36c2-4bb8-aa1b-9719fda46ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:49.698179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da992df-36c2-4bb8-aa1b-9719fda46ac0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:49.699077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da992df-36c2-4bb8-aa1b-9719fda46ac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:49.701123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da992df-36c2-4bb8-aa1b-9719fda46ac0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:49.731329 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3995/7995] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:49 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:49.733832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07666149-b9cd-4a46-9231-02dd2f48f021 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:49.747756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07666149-b9cd-4a46-9231-02dd2f48f021 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:49.753441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f73a4-fd01-4e69-ac4a-31342b80b53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:49.754008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f73a4-fd01-4e69-ac4a-31342b80b53a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:49.754621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f73a4-fd01-4e69-ac4a-31342b80b53a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:49.754621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f73a4-fd01-4e69-ac4a-31342b80b53a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:49.755665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f73a4-fd01-4e69-ac4a-31342b80b53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:49.757101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f73a4-fd01-4e69-ac4a-31342b80b53a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:49.769674 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4001/7996] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:54:49.773565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da992df-36c2-4bb8-aa1b-9719fda46ac0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:49.785470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da992df-36c2-4bb8-aa1b-9719fda46ac0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:49.791534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aebd1f-6c53-486c-82a1-896b3c4225fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:49.792445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aebd1f-6c53-486c-82a1-896b3c4225fb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:49.792878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aebd1f-6c53-486c-82a1-896b3c4225fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:49.793250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aebd1f-6c53-486c-82a1-896b3c4225fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:49.794124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aebd1f-6c53-486c-82a1-896b3c4225fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:49.796346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aebd1f-6c53-486c-82a1-896b3c4225fb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:49.812047 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3996/7997] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:54:49.813317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f73a4-fd01-4e69-ac4a-31342b80b53a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:49.824875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f73a4-fd01-4e69-ac4a-31342b80b53a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:49.829642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dbead-09da-4e79-add6-accc4321e600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:49.830388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dbead-09da-4e79-add6-accc4321e600 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:49.830768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dbead-09da-4e79-add6-accc4321e600 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:49.831331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dbead-09da-4e79-add6-accc4321e600 admin admin] PATH_INFO: `/v3/projects/da22c04e30824800bcf622c1011f5aed/users/e932e06e63cc40b8b805f4a9b92c7ee9/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:49.849724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dbead-09da-4e79-add6-accc4321e600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da22c04e30824800bcf622c1011f5aed, user_id=e932e06e63cc40b8b805f4a9b92c7ee9, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:49.852943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dbead-09da-4e79-add6-accc4321e600 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:49.882768 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4002/7998] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:49 2022] PUT /identity/v3/projects/da22c04e30824800bcf622c1011f5aed/users/e932e06e63cc40b8b805f4a9b92c7ee9/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:49.887050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbaef0-191f-45b6-b435-373a07b53351 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:49.888266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbaef0-191f-45b6-b435-373a07b53351 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:49.888866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbaef0-191f-45b6-b435-373a07b53351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:49.929276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-58dbaef0-191f-45b6-b435-373a07b53351 None None] MFA Rules not processed for user `e932e06e63cc40b8b805f4a9b92c7ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:49.930740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58dbaef0-191f-45b6-b435-373a07b53351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:50.057490 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3997/7999] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:50.074418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dbead-09da-4e79-add6-accc4321e600 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:50.081369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-630dbead-09da-4e79-add6-accc4321e600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:50.099495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:50.237017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dbead-09da-4e79-add6-accc4321e600 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:50.242299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674ac1a-8448-497d-b1b5-5acf0939a0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:50.243238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674ac1a-8448-497d-b1b5-5acf0939a0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:50.244427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674ac1a-8448-497d-b1b5-5acf0939a0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:50.244427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674ac1a-8448-497d-b1b5-5acf0939a0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:50.254847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674ac1a-8448-497d-b1b5-5acf0939a0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:50.256607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674ac1a-8448-497d-b1b5-5acf0939a0f9 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:50.276099 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4003/8000] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:53.637543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbaef0-191f-45b6-b435-373a07b53351 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:53.640018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58dbaef0-191f-45b6-b435-373a07b53351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:53.730118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbaef0-191f-45b6-b435-373a07b53351 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:53.737662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868592c2-f39f-49dc-b486-cfce353ffba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:53.738365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868592c2-f39f-49dc-b486-cfce353ffba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:53.738698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868592c2-f39f-49dc-b486-cfce353ffba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:53.742916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868592c2-f39f-49dc-b486-cfce353ffba0 admin admin] PATH_INFO: `/v3/users/8836529f06a34114ae8aa0ea4b727bd1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:53.744423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868592c2-f39f-49dc-b486-cfce353ffba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8836529f06a34114ae8aa0ea4b727bd1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:53.746947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868592c2-f39f-49dc-b486-cfce353ffba0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:53.775420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:53.824448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-868592c2-f39f-49dc-b486-cfce353ffba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8836529f06a34114ae8aa0ea4b727bd1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:53.826403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-868592c2-f39f-49dc-b486-cfce353ffba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8836529f06a34114ae8aa0ea4b727bd1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:53.839593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-868592c2-f39f-49dc-b486-cfce353ffba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8836529f06a34114ae8aa0ea4b727bd1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:53.854677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-868592c2-f39f-49dc-b486-cfce353ffba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8836529f06a34114ae8aa0ea4b727bd1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:53.875581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-868592c2-f39f-49dc-b486-cfce353ffba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8836529f06a34114ae8aa0ea4b727bd1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:53.891776 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3998/8001] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:53 2022] DELETE /identity/v3/users/8836529f06a34114ae8aa0ea4b727bd1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:53.898132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be6ee-07ab-4e49-a9e0-1a6ee8cdac0e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:53.898619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be6ee-07ab-4e49-a9e0-1a6ee8cdac0e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:53.899114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be6ee-07ab-4e49-a9e0-1a6ee8cdac0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:53.931693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-be2be6ee-07ab-4e49-a9e0-1a6ee8cdac0e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:53.935449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-be2be6ee-07ab-4e49-a9e0-1a6ee8cdac0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:54.030344 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4004/8002] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:54.055442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868592c2-f39f-49dc-b486-cfce353ffba0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:54.056974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-868592c2-f39f-49dc-b486-cfce353ffba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:54.125640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868592c2-f39f-49dc-b486-cfce353ffba0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:54.130439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482f106-4366-4173-b144-851bb3f3d9af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:54.131097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482f106-4366-4173-b144-851bb3f3d9af service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:54.131512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482f106-4366-4173-b144-851bb3f3d9af service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:54.131987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482f106-4366-4173-b144-851bb3f3d9af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:54.143816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482f106-4366-4173-b144-851bb3f3d9af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:54.145493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482f106-4366-4173-b144-851bb3f3d9af service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:54.158320 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3999/8003] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:55.129545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2be6ee-07ab-4e49-a9e0-1a6ee8cdac0e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:55.132295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-be2be6ee-07ab-4e49-a9e0-1a6ee8cdac0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:55.191867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2be6ee-07ab-4e49-a9e0-1a6ee8cdac0e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:55.210560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91013f-c343-47a3-b8a6-75125f268284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:55.211528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91013f-c343-47a3-b8a6-75125f268284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:55.212244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91013f-c343-47a3-b8a6-75125f268284 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:55.213013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91013f-c343-47a3-b8a6-75125f268284 admin admin] PATH_INFO: `/v3/projects/0e5e31e7c76c480da39020b5643b3ea2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:55.214755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91013f-c343-47a3-b8a6-75125f268284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5e31e7c76c480da39020b5643b3ea2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:55.217319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91013f-c343-47a3-b8a6-75125f268284 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:55.278717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e91013f-c343-47a3-b8a6-75125f268284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5e31e7c76c480da39020b5643b3ea2', 'request_id': 'req-3e91013f-c343-47a3-b8a6-75125f268284'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:55.290176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e91013f-c343-47a3-b8a6-75125f268284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5e31e7c76c480da39020b5643b3ea2', 'request_id': 'req-3e91013f-c343-47a3-b8a6-75125f268284'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:55.299388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e91013f-c343-47a3-b8a6-75125f268284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5e31e7c76c480da39020b5643b3ea2', 'request_id': 'req-3e91013f-c343-47a3-b8a6-75125f268284'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:55.322778 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e91013f-c343-47a3-b8a6-75125f268284 admin admin] The token cache is being invalidate because project 0e5e31e7c76c480da39020b5643b3ea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:55.322952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e91013f-c343-47a3-b8a6-75125f268284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:55.323892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e91013f-c343-47a3-b8a6-75125f268284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:55.325743 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4005/8004] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:55 2022] DELETE /identity/v3/projects/0e5e31e7c76c480da39020b5643b3ea2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:55.332816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f39fd-7e2c-4d98-9abb-93cc5573861f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:55.333493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f39fd-7e2c-4d98-9abb-93cc5573861f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:55.333493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f39fd-7e2c-4d98-9abb-93cc5573861f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:55.355293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9f6f39fd-7e2c-4d98-9abb-93cc5573861f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:55.356670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f6f39fd-7e2c-4d98-9abb-93cc5573861f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:55.443890 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4000/8005] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:55.452986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dee36-ea32-4632-9cd4-291e7350f4b5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:55.453594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dee36-ea32-4632-9cd4-291e7350f4b5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:55.453873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dee36-ea32-4632-9cd4-291e7350f4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:55.477086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a03dee36-ea32-4632-9cd4-291e7350f4b5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:55.478330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a03dee36-ea32-4632-9cd4-291e7350f4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:55.487306 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4006/8006] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:55.491939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f39fd-7e2c-4d98-9abb-93cc5573861f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:55.503202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f39fd-7e2c-4d98-9abb-93cc5573861f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:55.508057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb39c1c-da40-4f40-83e6-7ac795b06229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:55.508690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb39c1c-da40-4f40-83e6-7ac795b06229 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:55.508971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb39c1c-da40-4f40-83e6-7ac795b06229 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:55.509244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb39c1c-da40-4f40-83e6-7ac795b06229 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:55.509921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb39c1c-da40-4f40-83e6-7ac795b06229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:55.510224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb39c1c-da40-4f40-83e6-7ac795b06229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:55.511954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb39c1c-da40-4f40-83e6-7ac795b06229 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:55.525845 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4001/8007] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:54:55.530323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dee36-ea32-4632-9cd4-291e7350f4b5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:55.542902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dee36-ea32-4632-9cd4-291e7350f4b5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:55.551602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300a5ad-50a5-4206-8aae-33d3c2822cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:55.552829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300a5ad-50a5-4206-8aae-33d3c2822cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:55.553286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300a5ad-50a5-4206-8aae-33d3c2822cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:55.554177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300a5ad-50a5-4206-8aae-33d3c2822cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:55.555084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300a5ad-50a5-4206-8aae-33d3c2822cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:55.563179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300a5ad-50a5-4206-8aae-33d3c2822cb6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:55.612031 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4007/8008] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:55 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:54:55.614013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb39c1c-da40-4f40-83e6-7ac795b06229 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:55.636169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb39c1c-da40-4f40-83e6-7ac795b06229 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:55.673756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:55.733584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe304a7-284b-47d3-ab6c-6556c0d72424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:55.734453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe304a7-284b-47d3-ab6c-6556c0d72424 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:55.734798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe304a7-284b-47d3-ab6c-6556c0d72424 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:55.735177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe304a7-284b-47d3-ab6c-6556c0d72424 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:55.736685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe304a7-284b-47d3-ab6c-6556c0d72424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:55.739777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe304a7-284b-47d3-ab6c-6556c0d72424 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:55.773997 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4002/8009] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:55 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:55.778910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300a5ad-50a5-4206-8aae-33d3c2822cb6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:55.788235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:55.793036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300a5ad-50a5-4206-8aae-33d3c2822cb6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:55.800597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a17fee-6259-41d5-8c70-1b9183c41139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:55.802159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a17fee-6259-41d5-8c70-1b9183c41139 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:55.802720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a17fee-6259-41d5-8c70-1b9183c41139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:55.804170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a17fee-6259-41d5-8c70-1b9183c41139 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:55.805734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a17fee-6259-41d5-8c70-1b9183c41139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:55.808090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a17fee-6259-41d5-8c70-1b9183c41139 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:55.826156 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4008/8010] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:55.830629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe304a7-284b-47d3-ab6c-6556c0d72424 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:55.845985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe304a7-284b-47d3-ab6c-6556c0d72424 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:55.854325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b1d21-be98-4f49-8273-29cfe99db711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:55.855039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b1d21-be98-4f49-8273-29cfe99db711 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:55.856012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b1d21-be98-4f49-8273-29cfe99db711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:55.856443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b1d21-be98-4f49-8273-29cfe99db711 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:55.858360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b1d21-be98-4f49-8273-29cfe99db711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:55.860285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b1d21-be98-4f49-8273-29cfe99db711 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:55.876327 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4003/8011] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:55.880812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a17fee-6259-41d5-8c70-1b9183c41139 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:55.896835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a17fee-6259-41d5-8c70-1b9183c41139 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:55.902351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237e3a6-69ad-4091-97c0-bdfcaba62fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:55.903236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237e3a6-69ad-4091-97c0-bdfcaba62fba admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:55.903627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237e3a6-69ad-4091-97c0-bdfcaba62fba admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:55.904124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237e3a6-69ad-4091-97c0-bdfcaba62fba admin admin] PATH_INFO: `/v3/projects/26dbc23fd7a14c8bb6ea5948ff828214/users/6c93bdc93ecf470d9db54b7db06cdc64/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:55.927004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237e3a6-69ad-4091-97c0-bdfcaba62fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=26dbc23fd7a14c8bb6ea5948ff828214, user_id=6c93bdc93ecf470d9db54b7db06cdc64, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:55.930107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237e3a6-69ad-4091-97c0-bdfcaba62fba admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:55.950268 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4009/8012] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:55 2022] PUT /identity/v3/projects/26dbc23fd7a14c8bb6ea5948ff828214/users/6c93bdc93ecf470d9db54b7db06cdc64/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:55.960147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1dcb8-7e17-42cf-9e82-5e83405889d1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:55.960995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1dcb8-7e17-42cf-9e82-5e83405889d1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:55.961283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1dcb8-7e17-42cf-9e82-5e83405889d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:55.997886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-77f1dcb8-7e17-42cf-9e82-5e83405889d1 None None] MFA Rules not processed for user `6c93bdc93ecf470d9db54b7db06cdc64`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:55.998564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77f1dcb8-7e17-42cf-9e82-5e83405889d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:56.109029 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4004/8013] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:56.127067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237e3a6-69ad-4091-97c0-bdfcaba62fba admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:56.128951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3237e3a6-69ad-4091-97c0-bdfcaba62fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:56.274058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237e3a6-69ad-4091-97c0-bdfcaba62fba admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:56.281817 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543577b7-457f-4f5d-9691-e7cc4307d375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:56.283002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543577b7-457f-4f5d-9691-e7cc4307d375 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:56.283933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543577b7-457f-4f5d-9691-e7cc4307d375 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:56.284289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543577b7-457f-4f5d-9691-e7cc4307d375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:56.345322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543577b7-457f-4f5d-9691-e7cc4307d375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:56.349983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543577b7-457f-4f5d-9691-e7cc4307d375 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:56.391318 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4010/8014] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:56.565716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1dcb8-7e17-42cf-9e82-5e83405889d1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:56.577853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77f1dcb8-7e17-42cf-9e82-5e83405889d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:56.702126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1dcb8-7e17-42cf-9e82-5e83405889d1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:56.708898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec847e-cc8b-4820-9cbd-2504ee81d535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:56.709860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec847e-cc8b-4820-9cbd-2504ee81d535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:56.710322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec847e-cc8b-4820-9cbd-2504ee81d535 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:56.710812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec847e-cc8b-4820-9cbd-2504ee81d535 admin admin] PATH_INFO: `/v3/users/412953db3ef7488384d29339130a0483` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:56.713593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec847e-cc8b-4820-9cbd-2504ee81d535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=412953db3ef7488384d29339130a0483)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:56.716289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec847e-cc8b-4820-9cbd-2504ee81d535 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:56.804340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:56.816604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6dec847e-cc8b-4820-9cbd-2504ee81d535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412953db3ef7488384d29339130a0483'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:56.820979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6dec847e-cc8b-4820-9cbd-2504ee81d535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412953db3ef7488384d29339130a0483'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:56.836995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6dec847e-cc8b-4820-9cbd-2504ee81d535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412953db3ef7488384d29339130a0483'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:56.848193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6dec847e-cc8b-4820-9cbd-2504ee81d535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412953db3ef7488384d29339130a0483'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:56.868565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6dec847e-cc8b-4820-9cbd-2504ee81d535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412953db3ef7488384d29339130a0483'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:56.889044 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4005/8015] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:56 2022] DELETE /identity/v3/users/412953db3ef7488384d29339130a0483 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:56.893658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ff9cf-3ffe-4f44-9b34-ab18beb5fe80 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:56.893931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ff9cf-3ffe-4f44-9b34-ab18beb5fe80 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:56.894209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ff9cf-3ffe-4f44-9b34-ab18beb5fe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:56.929373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bf8ff9cf-3ffe-4f44-9b34-ab18beb5fe80 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:56.930628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bf8ff9cf-3ffe-4f44-9b34-ab18beb5fe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:57.098512 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4011/8016] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:57.111188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec847e-cc8b-4820-9cbd-2504ee81d535 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:57.112811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6dec847e-cc8b-4820-9cbd-2504ee81d535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:57.279767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec847e-cc8b-4820-9cbd-2504ee81d535 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:57.299310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1909952-d40c-49f8-9238-6645d9af3d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:57.300486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1909952-d40c-49f8-9238-6645d9af3d2e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:57.300818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1909952-d40c-49f8-9238-6645d9af3d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:57.302598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1909952-d40c-49f8-9238-6645d9af3d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:57.324736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1909952-d40c-49f8-9238-6645d9af3d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:57.326900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1909952-d40c-49f8-9238-6645d9af3d2e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:57.342996 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4006/8017] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:57.666186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ff9cf-3ffe-4f44-9b34-ab18beb5fe80 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:57.673763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bf8ff9cf-3ffe-4f44-9b34-ab18beb5fe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:57.698673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ff9cf-3ffe-4f44-9b34-ab18beb5fe80 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:57.708291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ede92-bace-43c9-a1f3-c866c064f832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:57.709320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ede92-bace-43c9-a1f3-c866c064f832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:57.709821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ede92-bace-43c9-a1f3-c866c064f832 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:57.710633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ede92-bace-43c9-a1f3-c866c064f832 admin admin] PATH_INFO: `/v3/projects/fe79b49285c34ba9ba69ee1b377f3024` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:57.711881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ede92-bace-43c9-a1f3-c866c064f832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe79b49285c34ba9ba69ee1b377f3024)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:57.714895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ede92-bace-43c9-a1f3-c866c064f832 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:57.842870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6e0ede92-bace-43c9-a1f3-c866c064f832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe79b49285c34ba9ba69ee1b377f3024', 'request_id': 'req-6e0ede92-bace-43c9-a1f3-c866c064f832'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:57.856719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6e0ede92-bace-43c9-a1f3-c866c064f832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe79b49285c34ba9ba69ee1b377f3024', 'request_id': 'req-6e0ede92-bace-43c9-a1f3-c866c064f832'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:57.886844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6e0ede92-bace-43c9-a1f3-c866c064f832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe79b49285c34ba9ba69ee1b377f3024', 'request_id': 'req-6e0ede92-bace-43c9-a1f3-c866c064f832'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:57.891659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:57.927682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6e0ede92-bace-43c9-a1f3-c866c064f832 admin admin] The token cache is being invalidate because project fe79b49285c34ba9ba69ee1b377f3024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:57.928270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6e0ede92-bace-43c9-a1f3-c866c064f832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:57.929183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6e0ede92-bace-43c9-a1f3-c866c064f832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:57.936577 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4012/8018] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:57 2022] DELETE /identity/v3/projects/fe79b49285c34ba9ba69ee1b377f3024 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:57.936966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ba26e-cbc9-4db1-92e7-6a6f7964d1bf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:57.937432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ba26e-cbc9-4db1-92e7-6a6f7964d1bf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:57.937519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ba26e-cbc9-4db1-92e7-6a6f7964d1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:57.988003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-678ba26e-cbc9-4db1-92e7-6a6f7964d1bf None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:57.989472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-678ba26e-cbc9-4db1-92e7-6a6f7964d1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:58.124774 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4007/8019] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:58.126821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6737b48-8e3d-4eae-afba-4088c03fd126 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:58.127208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6737b48-8e3d-4eae-afba-4088c03fd126 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:58.127676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6737b48-8e3d-4eae-afba-4088c03fd126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:58.166051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a6737b48-8e3d-4eae-afba-4088c03fd126 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:58.171769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a6737b48-8e3d-4eae-afba-4088c03fd126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:58.203099 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4013/8020] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:58.205911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ba26e-cbc9-4db1-92e7-6a6f7964d1bf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:58.229621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ba26e-cbc9-4db1-92e7-6a6f7964d1bf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:58.240120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f062b-48ba-473c-8a7d-25aa350bee88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:58.241250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f062b-48ba-473c-8a7d-25aa350bee88 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:58.241600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f062b-48ba-473c-8a7d-25aa350bee88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:58.241873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f062b-48ba-473c-8a7d-25aa350bee88 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:58.242747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f062b-48ba-473c-8a7d-25aa350bee88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:58.243072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f062b-48ba-473c-8a7d-25aa350bee88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:58.244747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f062b-48ba-473c-8a7d-25aa350bee88 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:58.268323 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4008/8021] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:54:58.268812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6737b48-8e3d-4eae-afba-4088c03fd126 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:58.316758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6737b48-8e3d-4eae-afba-4088c03fd126 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:58.322231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9ec23-eb11-46d3-a0a3-7c31539b3e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:58.322861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9ec23-eb11-46d3-a0a3-7c31539b3e36 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:58.323139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9ec23-eb11-46d3-a0a3-7c31539b3e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:58.323632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9ec23-eb11-46d3-a0a3-7c31539b3e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:58.324539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9ec23-eb11-46d3-a0a3-7c31539b3e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:58.326626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9ec23-eb11-46d3-a0a3-7c31539b3e36 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:58.365211 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4014/8022] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:58 2022] POST /identity/v3/projects => generated 401 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:54:58.367900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f062b-48ba-473c-8a7d-25aa350bee88 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:58.381451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f062b-48ba-473c-8a7d-25aa350bee88 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:58.481824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:58.509147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1929a2-d943-45d0-af85-93da132d503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:58.510687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1929a2-d943-45d0-af85-93da132d503e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:58.511111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1929a2-d943-45d0-af85-93da132d503e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:58.512651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1929a2-d943-45d0-af85-93da132d503e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:58.514037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1929a2-d943-45d0-af85-93da132d503e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:58.521852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1929a2-d943-45d0-af85-93da132d503e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:58.553165 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4009/8023] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:58 2022] POST /identity/v3/users => generated 301 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:54:58.555330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9ec23-eb11-46d3-a0a3-7c31539b3e36 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:58.576269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9ec23-eb11-46d3-a0a3-7c31539b3e36 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:58.583215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1745269-a0f5-40e0-aa74-591ff6ad83cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:58.584841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1745269-a0f5-40e0-aa74-591ff6ad83cc admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:58.586547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1745269-a0f5-40e0-aa74-591ff6ad83cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:58.587651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1745269-a0f5-40e0-aa74-591ff6ad83cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:58.589180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1745269-a0f5-40e0-aa74-591ff6ad83cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:58.591014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1745269-a0f5-40e0-aa74-591ff6ad83cc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:58.602878 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4015/8024] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:58.607589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1929a2-d943-45d0-af85-93da132d503e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:58.620193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1929a2-d943-45d0-af85-93da132d503e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:58.626754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3440c-4ce2-42ed-b4bc-3b6f04894357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:58.627577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3440c-4ce2-42ed-b4bc-3b6f04894357 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:58.627988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3440c-4ce2-42ed-b4bc-3b6f04894357 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:58.628363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3440c-4ce2-42ed-b4bc-3b6f04894357 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:58.629114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3440c-4ce2-42ed-b4bc-3b6f04894357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:58.630835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3440c-4ce2-42ed-b4bc-3b6f04894357 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:58.646326 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4010/8025] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:58.651066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1745269-a0f5-40e0-aa74-591ff6ad83cc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:58.669742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1745269-a0f5-40e0-aa74-591ff6ad83cc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:58.676107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e1bea-fda0-40a4-a274-084588de7e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:58.676916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e1bea-fda0-40a4-a274-084588de7e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:58.677354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e1bea-fda0-40a4-a274-084588de7e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:58.677785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e1bea-fda0-40a4-a274-084588de7e2b admin admin] PATH_INFO: `/v3/projects/6084936ede36490bab153996d1dc6fcf/users/c389200cc651420d8eed343fcbc4bbb6/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:58.697343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e1bea-fda0-40a4-a274-084588de7e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6084936ede36490bab153996d1dc6fcf, user_id=c389200cc651420d8eed343fcbc4bbb6, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:58.698488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e1bea-fda0-40a4-a274-084588de7e2b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:58.714236 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4016/8026] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:58 2022] PUT /identity/v3/projects/6084936ede36490bab153996d1dc6fcf/users/c389200cc651420d8eed343fcbc4bbb6/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:58.725748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee27c3-f40d-43fd-b754-f637e6c24a54 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:58.726147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee27c3-f40d-43fd-b754-f637e6c24a54 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:58.726428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee27c3-f40d-43fd-b754-f637e6c24a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:58.755870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-43ee27c3-f40d-43fd-b754-f637e6c24a54 None None] MFA Rules not processed for user `c389200cc651420d8eed343fcbc4bbb6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:58.757103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-43ee27c3-f40d-43fd-b754-f637e6c24a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:58.840724 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4011/8027] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:58 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:58.845738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e1bea-fda0-40a4-a274-084588de7e2b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:58.925649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e1bea-fda0-40a4-a274-084588de7e2b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:58.932927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dfeb0-aa78-437d-9c35-4fe56c0a83f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:58.934329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dfeb0-aa78-437d-9c35-4fe56c0a83f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:58.934743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dfeb0-aa78-437d-9c35-4fe56c0a83f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:58.935144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dfeb0-aa78-437d-9c35-4fe56c0a83f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:58.937323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dfeb0-aa78-437d-9c35-4fe56c0a83f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:58.939580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dfeb0-aa78-437d-9c35-4fe56c0a83f9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:58.976351 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4017/8028] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:58 2022] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:58.980586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee27c3-f40d-43fd-b754-f637e6c24a54 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:58.999058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee27c3-f40d-43fd-b754-f637e6c24a54 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:59.140936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e18a3-c89b-43f1-8e4b-dfd2a741ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:59.141711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e18a3-c89b-43f1-8e4b-dfd2a741ed5c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:59.142258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e18a3-c89b-43f1-8e4b-dfd2a741ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:59.142618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e18a3-c89b-43f1-8e4b-dfd2a741ed5c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:59.143442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e18a3-c89b-43f1-8e4b-dfd2a741ed5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:59.145548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e18a3-c89b-43f1-8e4b-dfd2a741ed5c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:59.178404 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4012/8029] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:58 2022] POST /identity/v3/users => generated 308 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:59.179213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dfeb0-aa78-437d-9c35-4fe56c0a83f9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:59.193251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dfeb0-aa78-437d-9c35-4fe56c0a83f9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:59.200497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d708c-07f5-4b1f-8ef2-7e14db31825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:59.201332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d708c-07f5-4b1f-8ef2-7e14db31825c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:59.202834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d708c-07f5-4b1f-8ef2-7e14db31825c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:59.203110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d708c-07f5-4b1f-8ef2-7e14db31825c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:59.203944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d708c-07f5-4b1f-8ef2-7e14db31825c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:59.205813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d708c-07f5-4b1f-8ef2-7e14db31825c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:59.219767 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4018/8030] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:54:59.224222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e18a3-c89b-43f1-8e4b-dfd2a741ed5c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:59.238914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e18a3-c89b-43f1-8e4b-dfd2a741ed5c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:59.260524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a0971-9a0f-4e94-a660-74b481414b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:59.262279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a0971-9a0f-4e94-a660-74b481414b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:59.262279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a0971-9a0f-4e94-a660-74b481414b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:59.262638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a0971-9a0f-4e94-a660-74b481414b33 admin admin] PATH_INFO: `/v3/projects/a7940d08988545a3899121d95bc339bc/users/412464b37f814cc19286c476667e7593/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:59.297169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a0971-9a0f-4e94-a660-74b481414b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7940d08988545a3899121d95bc339bc, user_id=412464b37f814cc19286c476667e7593, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:59.298426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a3fcc-ea08-46db-b096-4d019951de4a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:59.299010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a3fcc-ea08-46db-b096-4d019951de4a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:59.299489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a3fcc-ea08-46db-b096-4d019951de4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:59.300511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a0971-9a0f-4e94-a660-74b481414b33 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:59.333209 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4013/8031] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:59 2022] PUT /identity/v3/projects/a7940d08988545a3899121d95bc339bc/users/412464b37f814cc19286c476667e7593/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:59.338118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-103a3fcc-ea08-46db-b096-4d019951de4a None None] MFA Rules not processed for user `6c93bdc93ecf470d9db54b7db06cdc64`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:59.340051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-103a3fcc-ea08-46db-b096-4d019951de4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:59.351917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a0971-9a0f-4e94-a660-74b481414b33 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:59.425615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:59.472332 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4019/8032] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:59.531823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a0971-9a0f-4e94-a660-74b481414b33 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:59.561322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1020c1-7123-454c-aeba-16de3126cebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:59.562256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1020c1-7123-454c-aeba-16de3126cebb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:59.562672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1020c1-7123-454c-aeba-16de3126cebb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:59.563664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1020c1-7123-454c-aeba-16de3126cebb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:59.564547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1020c1-7123-454c-aeba-16de3126cebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:59.566464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1020c1-7123-454c-aeba-16de3126cebb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:59.579624 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4014/8033] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:59.595948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a3fcc-ea08-46db-b096-4d019951de4a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:59.619994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a3fcc-ea08-46db-b096-4d019951de4a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:59.626814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925564f7-6c33-4e61-ae4b-7811ae8f7e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:59.627645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925564f7-6c33-4e61-ae4b-7811ae8f7e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:59.627847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925564f7-6c33-4e61-ae4b-7811ae8f7e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:59.628123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925564f7-6c33-4e61-ae4b-7811ae8f7e1e admin admin] PATH_INFO: `/v3/projects/a7940d08988545a3899121d95bc339bc/users/412464b37f814cc19286c476667e7593/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:59.631044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925564f7-6c33-4e61-ae4b-7811ae8f7e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7940d08988545a3899121d95bc339bc, user_id=412464b37f814cc19286c476667e7593, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:59.645022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925564f7-6c33-4e61-ae4b-7811ae8f7e1e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:59.653827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:59.665423 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4020/8034] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:59 2022] PUT /identity/v3/projects/a7940d08988545a3899121d95bc339bc/users/412464b37f814cc19286c476667e7593/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:59.675852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515c5d5-c585-4025-8048-01cf0a2baf85 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:59.676469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515c5d5-c585-4025-8048-01cf0a2baf85 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:59.676899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515c5d5-c585-4025-8048-01cf0a2baf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:59.714512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a515c5d5-c585-4025-8048-01cf0a2baf85 None None] MFA Rules not processed for user `412464b37f814cc19286c476667e7593`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:59.716835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a515c5d5-c585-4025-8048-01cf0a2baf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:59.836880 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4015/8035] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:54:59 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:59.851159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925564f7-6c33-4e61-ae4b-7811ae8f7e1e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:59.853517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-925564f7-6c33-4e61-ae4b-7811ae8f7e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:59.945289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925564f7-6c33-4e61-ae4b-7811ae8f7e1e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:59.955694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b93977-c75e-43dd-91da-ba92b0f49cd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:59.956360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b93977-c75e-43dd-91da-ba92b0f49cd8 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:59.956637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b93977-c75e-43dd-91da-ba92b0f49cd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:59.957395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b93977-c75e-43dd-91da-ba92b0f49cd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:59.982677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b93977-c75e-43dd-91da-ba92b0f49cd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:59.985717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b93977-c75e-43dd-91da-ba92b0f49cd8 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:00.022206 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4021/8036] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:59 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:00.270133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515c5d5-c585-4025-8048-01cf0a2baf85 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:00.392906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515c5d5-c585-4025-8048-01cf0a2baf85 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:00.403237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10ad12-1b42-48c5-8f56-fef8e85099de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:00.405389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10ad12-1b42-48c5-8f56-fef8e85099de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:00.405906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10ad12-1b42-48c5-8f56-fef8e85099de admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:00.407517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10ad12-1b42-48c5-8f56-fef8e85099de admin admin] PATH_INFO: `/v3/users/c389200cc651420d8eed343fcbc4bbb6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:00.410870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10ad12-1b42-48c5-8f56-fef8e85099de admin admin] RBAC: Authorizing `identity:delete_user(user_id=c389200cc651420d8eed343fcbc4bbb6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:00.414313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10ad12-1b42-48c5-8f56-fef8e85099de admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:00.522967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:00.530097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa10ad12-1b42-48c5-8f56-fef8e85099de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c389200cc651420d8eed343fcbc4bbb6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:00.531929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa10ad12-1b42-48c5-8f56-fef8e85099de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c389200cc651420d8eed343fcbc4bbb6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:00.575774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa10ad12-1b42-48c5-8f56-fef8e85099de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c389200cc651420d8eed343fcbc4bbb6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:00.593060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa10ad12-1b42-48c5-8f56-fef8e85099de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c389200cc651420d8eed343fcbc4bbb6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:00.621347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa10ad12-1b42-48c5-8f56-fef8e85099de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c389200cc651420d8eed343fcbc4bbb6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:00.636982 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4016/8037] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:00 2022] DELETE /identity/v3/users/c389200cc651420d8eed343fcbc4bbb6 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:00.641628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f286c1-ecd1-4ebc-b706-deda928123bf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:00.641916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f286c1-ecd1-4ebc-b706-deda928123bf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:00.642241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f286c1-ecd1-4ebc-b706-deda928123bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:00.688212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-51f286c1-ecd1-4ebc-b706-deda928123bf None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:00.689712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-51f286c1-ecd1-4ebc-b706-deda928123bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:00.787913 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4022/8038] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:00.804388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10ad12-1b42-48c5-8f56-fef8e85099de admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:00.806542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa10ad12-1b42-48c5-8f56-fef8e85099de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:00.925899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10ad12-1b42-48c5-8f56-fef8e85099de admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:00.934409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27aa0f-e897-4f7b-ba5b-8fa7adeb3494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:00.938606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27aa0f-e897-4f7b-ba5b-8fa7adeb3494 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:00.938900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27aa0f-e897-4f7b-ba5b-8fa7adeb3494 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:00.939201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27aa0f-e897-4f7b-ba5b-8fa7adeb3494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:00.960452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27aa0f-e897-4f7b-ba5b-8fa7adeb3494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:00.965564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27aa0f-e897-4f7b-ba5b-8fa7adeb3494 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:00.992389 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4017/8039] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:02.075458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f286c1-ecd1-4ebc-b706-deda928123bf None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:02.080302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-51f286c1-ecd1-4ebc-b706-deda928123bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:02.123493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f286c1-ecd1-4ebc-b706-deda928123bf None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:02.149497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e6f30-ecda-4c68-950b-ff54c31de901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:02.150486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e6f30-ecda-4c68-950b-ff54c31de901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:02.151757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e6f30-ecda-4c68-950b-ff54c31de901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:02.152617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e6f30-ecda-4c68-950b-ff54c31de901 admin admin] PATH_INFO: `/v3/projects/6084936ede36490bab153996d1dc6fcf` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:02.154703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e6f30-ecda-4c68-950b-ff54c31de901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6084936ede36490bab153996d1dc6fcf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:02.160064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e6f30-ecda-4c68-950b-ff54c31de901 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:02.342645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-835e6f30-ecda-4c68-950b-ff54c31de901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6084936ede36490bab153996d1dc6fcf', 'request_id': 'req-835e6f30-ecda-4c68-950b-ff54c31de901'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:02.358763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-835e6f30-ecda-4c68-950b-ff54c31de901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6084936ede36490bab153996d1dc6fcf', 'request_id': 'req-835e6f30-ecda-4c68-950b-ff54c31de901'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:02.365867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-835e6f30-ecda-4c68-950b-ff54c31de901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6084936ede36490bab153996d1dc6fcf', 'request_id': 'req-835e6f30-ecda-4c68-950b-ff54c31de901'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:02.381659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-835e6f30-ecda-4c68-950b-ff54c31de901 admin admin] The token cache is being invalidate because project 6084936ede36490bab153996d1dc6fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:02.382200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-835e6f30-ecda-4c68-950b-ff54c31de901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:02.383048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-835e6f30-ecda-4c68-950b-ff54c31de901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:02.389561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27aa0f-e897-4f7b-ba5b-8fa7adeb3494 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:02.391744 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4023/8040] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:02 2022] DELETE /identity/v3/projects/6084936ede36490bab153996d1dc6fcf => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:02.396265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ee27aa0f-e897-4f7b-ba5b-8fa7adeb3494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:02.404410 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e6f30-ecda-4c68-950b-ff54c31de901 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:02.413193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-835e6f30-ecda-4c68-950b-ff54c31de901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:02.425751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27aa0f-e897-4f7b-ba5b-8fa7adeb3494 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:02.483154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:02.563445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184471b-4a9c-4bda-addf-13de1b4a2497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:02.564287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184471b-4a9c-4bda-addf-13de1b4a2497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:02.565157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184471b-4a9c-4bda-addf-13de1b4a2497 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:02.572891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184471b-4a9c-4bda-addf-13de1b4a2497 admin admin] PATH_INFO: `/v3/users/e932e06e63cc40b8b805f4a9b92c7ee9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:02.572891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184471b-4a9c-4bda-addf-13de1b4a2497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e932e06e63cc40b8b805f4a9b92c7ee9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:02.574318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184471b-4a9c-4bda-addf-13de1b4a2497 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:02.586783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e6f30-ecda-4c68-950b-ff54c31de901 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:02.603446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e41df5-3587-4236-b082-ed638ee494fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:02.606714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e41df5-3587-4236-b082-ed638ee494fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:02.607157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e41df5-3587-4236-b082-ed638ee494fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:02.607561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e41df5-3587-4236-b082-ed638ee494fd admin admin] PATH_INFO: `/v3/users/412464b37f814cc19286c476667e7593` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:02.611013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e41df5-3587-4236-b082-ed638ee494fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=412464b37f814cc19286c476667e7593)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:02.617750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e41df5-3587-4236-b082-ed638ee494fd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:02.690038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b184471b-4a9c-4bda-addf-13de1b4a2497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e932e06e63cc40b8b805f4a9b92c7ee9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:02.691125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b184471b-4a9c-4bda-addf-13de1b4a2497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e932e06e63cc40b8b805f4a9b92c7ee9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:02.705221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b184471b-4a9c-4bda-addf-13de1b4a2497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e932e06e63cc40b8b805f4a9b92c7ee9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:02.720152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b184471b-4a9c-4bda-addf-13de1b4a2497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e932e06e63cc40b8b805f4a9b92c7ee9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:02.723032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:02.739353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-03e41df5-3587-4236-b082-ed638ee494fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412464b37f814cc19286c476667e7593'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:02.750058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b184471b-4a9c-4bda-addf-13de1b4a2497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e932e06e63cc40b8b805f4a9b92c7ee9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:02.772839 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4018/8041] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:02 2022] DELETE /identity/v3/users/e932e06e63cc40b8b805f4a9b92c7ee9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:02.778624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddac21-afad-455d-9fe4-d42641bc032c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:02.778909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddac21-afad-455d-9fe4-d42641bc032c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:02.779186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddac21-afad-455d-9fe4-d42641bc032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:02.788134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-03e41df5-3587-4236-b082-ed638ee494fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412464b37f814cc19286c476667e7593'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:02.789253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-03e41df5-3587-4236-b082-ed638ee494fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412464b37f814cc19286c476667e7593'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:02.790788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-03e41df5-3587-4236-b082-ed638ee494fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412464b37f814cc19286c476667e7593'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:02.807530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-03e41df5-3587-4236-b082-ed638ee494fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412464b37f814cc19286c476667e7593'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:02.819931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-32ddac21-afad-455d-9fe4-d42641bc032c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:02.821818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-32ddac21-afad-455d-9fe4-d42641bc032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:02.848563 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4024/8042] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:02 2022] DELETE /identity/v3/users/412464b37f814cc19286c476667e7593 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:02.943859 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4019/8043] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:02.959269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e41df5-3587-4236-b082-ed638ee494fd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:02.960893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-03e41df5-3587-4236-b082-ed638ee494fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:03.103786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e41df5-3587-4236-b082-ed638ee494fd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:03.108888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf535e45-9e02-4d5f-b05a-95b9cfa2909d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:03.109740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf535e45-9e02-4d5f-b05a-95b9cfa2909d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:03.110076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf535e45-9e02-4d5f-b05a-95b9cfa2909d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:03.110368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf535e45-9e02-4d5f-b05a-95b9cfa2909d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:03.193190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:03.201788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf535e45-9e02-4d5f-b05a-95b9cfa2909d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:03.203345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf535e45-9e02-4d5f-b05a-95b9cfa2909d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:03.217400 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4025/8044] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:03.623022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddac21-afad-455d-9fe4-d42641bc032c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:03.624681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-32ddac21-afad-455d-9fe4-d42641bc032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:03.641651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddac21-afad-455d-9fe4-d42641bc032c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:03.660248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d7765-53dd-443a-b944-5d57c57e3f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:03.660810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d7765-53dd-443a-b944-5d57c57e3f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:03.661087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d7765-53dd-443a-b944-5d57c57e3f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:03.661555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d7765-53dd-443a-b944-5d57c57e3f4b admin admin] PATH_INFO: `/v3/projects/a7940d08988545a3899121d95bc339bc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:03.662615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d7765-53dd-443a-b944-5d57c57e3f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7940d08988545a3899121d95bc339bc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:03.665770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d7765-53dd-443a-b944-5d57c57e3f4b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:03.790243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-428d7765-53dd-443a-b944-5d57c57e3f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7940d08988545a3899121d95bc339bc', 'request_id': 'req-428d7765-53dd-443a-b944-5d57c57e3f4b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:03.803742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-428d7765-53dd-443a-b944-5d57c57e3f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7940d08988545a3899121d95bc339bc', 'request_id': 'req-428d7765-53dd-443a-b944-5d57c57e3f4b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:03.819060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-428d7765-53dd-443a-b944-5d57c57e3f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7940d08988545a3899121d95bc339bc', 'request_id': 'req-428d7765-53dd-443a-b944-5d57c57e3f4b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:03.837110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-428d7765-53dd-443a-b944-5d57c57e3f4b admin admin] The token cache is being invalidate because project a7940d08988545a3899121d95bc339bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:03.837601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-428d7765-53dd-443a-b944-5d57c57e3f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:03.838401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-428d7765-53dd-443a-b944-5d57c57e3f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:03.844195 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4020/8045] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:03 2022] DELETE /identity/v3/projects/a7940d08988545a3899121d95bc339bc => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:03.849883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c5e0e-9b04-4a18-a78b-44d7752c6293 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:03.850169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c5e0e-9b04-4a18-a78b-44d7752c6293 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:03.850446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c5e0e-9b04-4a18-a78b-44d7752c6293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:03.902291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6f9c5e0e-9b04-4a18-a78b-44d7752c6293 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:03.903660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6f9c5e0e-9b04-4a18-a78b-44d7752c6293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:04.007517 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4026/8046] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:04.016388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf943df6-1ebf-4b6a-ba9f-e1e3593b85e7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:04.016684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf943df6-1ebf-4b6a-ba9f-e1e3593b85e7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:04.017020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf943df6-1ebf-4b6a-ba9f-e1e3593b85e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:04.072722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bf943df6-1ebf-4b6a-ba9f-e1e3593b85e7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:04.074397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf943df6-1ebf-4b6a-ba9f-e1e3593b85e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:04.097911 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4021/8047] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:04.102531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c5e0e-9b04-4a18-a78b-44d7752c6293 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:04.116114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c5e0e-9b04-4a18-a78b-44d7752c6293 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:04.124486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b93e9-fdb2-4eaf-b3f4-bfc1218489a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:04.125281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b93e9-fdb2-4eaf-b3f4-bfc1218489a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:04.125823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b93e9-fdb2-4eaf-b3f4-bfc1218489a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:04.126268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b93e9-fdb2-4eaf-b3f4-bfc1218489a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:04.127330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b93e9-fdb2-4eaf-b3f4-bfc1218489a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:55:04.127898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b93e9-fdb2-4eaf-b3f4-bfc1218489a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:04.131597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b93e9-fdb2-4eaf-b3f4-bfc1218489a2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:04.155948 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4027/8048] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:55:04.160451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf943df6-1ebf-4b6a-ba9f-e1e3593b85e7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:04.174368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf943df6-1ebf-4b6a-ba9f-e1e3593b85e7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:04.189767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91803ad1-943a-4f8c-bd2c-77c5c551e8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:04.190516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91803ad1-943a-4f8c-bd2c-77c5c551e8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:04.190818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91803ad1-943a-4f8c-bd2c-77c5c551e8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:04.191200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91803ad1-943a-4f8c-bd2c-77c5c551e8a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:04.193241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91803ad1-943a-4f8c-bd2c-77c5c551e8a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:04.197865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91803ad1-943a-4f8c-bd2c-77c5c551e8a0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:04.281681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b93e9-fdb2-4eaf-b3f4-bfc1218489a2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:04.283626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d64b93e9-fdb2-4eaf-b3f4-bfc1218489a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:04.298366 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4022/8049] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:04 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:04.299733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91803ad1-943a-4f8c-bd2c-77c5c551e8a0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:04.332972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b93e9-fdb2-4eaf-b3f4-bfc1218489a2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:04.467052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:04.511979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91803ad1-943a-4f8c-bd2c-77c5c551e8a0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:04.517720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c902b-02ff-4976-adae-6949c9461dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:04.518711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c902b-02ff-4976-adae-6949c9461dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:04.519177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c902b-02ff-4976-adae-6949c9461dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:04.519670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c902b-02ff-4976-adae-6949c9461dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:04.520502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c902b-02ff-4976-adae-6949c9461dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:04.522054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07669a0-94e7-4c6b-904c-078d80573c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:04.522880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07669a0-94e7-4c6b-904c-078d80573c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:04.523404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07669a0-94e7-4c6b-904c-078d80573c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:04.523755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07669a0-94e7-4c6b-904c-078d80573c2d admin admin] PATH_INFO: `/v3/projects/da22c04e30824800bcf622c1011f5aed` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:04.524692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c902b-02ff-4976-adae-6949c9461dd7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:04.525667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07669a0-94e7-4c6b-904c-078d80573c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=da22c04e30824800bcf622c1011f5aed)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:04.527732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07669a0-94e7-4c6b-904c-078d80573c2d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:04.560071 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4023/8050] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:04 2022] POST /identity/v3/users => generated 288 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:04.564312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c902b-02ff-4976-adae-6949c9461dd7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:04.577058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c902b-02ff-4976-adae-6949c9461dd7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:04.584597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41a587-4479-470c-ba74-69640af9f121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:04.586752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41a587-4479-470c-ba74-69640af9f121 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:04.587971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41a587-4479-470c-ba74-69640af9f121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:04.588959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41a587-4479-470c-ba74-69640af9f121 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:04.590915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41a587-4479-470c-ba74-69640af9f121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:04.596616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41a587-4479-470c-ba74-69640af9f121 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:04.616977 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4024/8051] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:04.620864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41a587-4479-470c-ba74-69640af9f121 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:04.636615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41a587-4479-470c-ba74-69640af9f121 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:04.642705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c07669a0-94e7-4c6b-904c-078d80573c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da22c04e30824800bcf622c1011f5aed', 'request_id': 'req-c07669a0-94e7-4c6b-904c-078d80573c2d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:04.658077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c07669a0-94e7-4c6b-904c-078d80573c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da22c04e30824800bcf622c1011f5aed', 'request_id': 'req-c07669a0-94e7-4c6b-904c-078d80573c2d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:04.672139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c07669a0-94e7-4c6b-904c-078d80573c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da22c04e30824800bcf622c1011f5aed', 'request_id': 'req-c07669a0-94e7-4c6b-904c-078d80573c2d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:04.697650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c07669a0-94e7-4c6b-904c-078d80573c2d admin admin] The token cache is being invalidate because project da22c04e30824800bcf622c1011f5aed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:04.697990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c07669a0-94e7-4c6b-904c-078d80573c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:04.698879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c07669a0-94e7-4c6b-904c-078d80573c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:04.704427 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4028/8052] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:04 2022] DELETE /identity/v3/projects/da22c04e30824800bcf622c1011f5aed => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:55:04.708775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bba6cf-f82e-4d5d-a502-abadff55a310 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:04.709062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bba6cf-f82e-4d5d-a502-abadff55a310 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:04.709506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bba6cf-f82e-4d5d-a502-abadff55a310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:04.732069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a89b28-1cf1-40c2-b8c9-1d7ad31f5e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:04.733139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a89b28-1cf1-40c2-b8c9-1d7ad31f5e97 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:04.733589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a89b28-1cf1-40c2-b8c9-1d7ad31f5e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:04.734107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a89b28-1cf1-40c2-b8c9-1d7ad31f5e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:04.735703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a89b28-1cf1-40c2-b8c9-1d7ad31f5e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:04.737941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a89b28-1cf1-40c2-b8c9-1d7ad31f5e97 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:04.756856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f0bba6cf-f82e-4d5d-a502-abadff55a310 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:04.760646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f0bba6cf-f82e-4d5d-a502-abadff55a310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:04.763001 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4025/8053] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:55:04.766936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a89b28-1cf1-40c2-b8c9-1d7ad31f5e97 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:04.769859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-34a89b28-1cf1-40c2-b8c9-1d7ad31f5e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:04.784753 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4029/8054] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:55:04.795045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1e8dd-abe4-4bd9-bd7d-af120f7d51c7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:04.795748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1e8dd-abe4-4bd9-bd7d-af120f7d51c7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:04.797748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1e8dd-abe4-4bd9-bd7d-af120f7d51c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:04.809988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:04.810505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a89b28-1cf1-40c2-b8c9-1d7ad31f5e97 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:04.834901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a0c1e8dd-abe4-4bd9-bd7d-af120f7d51c7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:04.835718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae32a9-0303-495d-adde-bbfc48c9e83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:04.836547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae32a9-0303-495d-adde-bbfc48c9e83a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:04.836839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae32a9-0303-495d-adde-bbfc48c9e83a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:04.837133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae32a9-0303-495d-adde-bbfc48c9e83a admin admin] PATH_INFO: `/v3/projects/0364fdab0fec47588b4c41de49b50b24/users/b46929c568084a51af4e062cac3debb4/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:04.837849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a0c1e8dd-abe4-4bd9-bd7d-af120f7d51c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:04.849942 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4030/8055] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:55:04.854253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1e8dd-abe4-4bd9-bd7d-af120f7d51c7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:04.872721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1e8dd-abe4-4bd9-bd7d-af120f7d51c7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:04.889670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032dd02-a4c2-4e8c-9e89-776ccf9379ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:04.892040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032dd02-a4c2-4e8c-9e89-776ccf9379ff admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:04.900222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae32a9-0303-495d-adde-bbfc48c9e83a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0364fdab0fec47588b4c41de49b50b24, user_id=b46929c568084a51af4e062cac3debb4, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:04.900906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032dd02-a4c2-4e8c-9e89-776ccf9379ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:04.900906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032dd02-a4c2-4e8c-9e89-776ccf9379ff admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:04.900906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032dd02-a4c2-4e8c-9e89-776ccf9379ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:55:04.900906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032dd02-a4c2-4e8c-9e89-776ccf9379ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:04.901588 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae32a9-0303-495d-adde-bbfc48c9e83a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:04.902544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032dd02-a4c2-4e8c-9e89-776ccf9379ff admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:04.926026 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4031/8056] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:55:04.928167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032dd02-a4c2-4e8c-9e89-776ccf9379ff admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:04.929601 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4026/8057] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:04 2022] PUT /identity/v3/projects/0364fdab0fec47588b4c41de49b50b24/users/b46929c568084a51af4e062cac3debb4/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:55:04.940268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a325c0e-d7c4-45f9-95d0-b3cb960c82c5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:04.940575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a325c0e-d7c4-45f9-95d0-b3cb960c82c5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:04.940925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a325c0e-d7c4-45f9-95d0-b3cb960c82c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:04.954514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032dd02-a4c2-4e8c-9e89-776ccf9379ff admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:04.990668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7a325c0e-d7c4-45f9-95d0-b3cb960c82c5 None None] MFA Rules not processed for user `b46929c568084a51af4e062cac3debb4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:04.992313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a325c0e-d7c4-45f9-95d0-b3cb960c82c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:05.059362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aafe35-c71b-47dc-a320-d7dc1fb34884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:05.060563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aafe35-c71b-47dc-a320-d7dc1fb34884 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:05.061089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aafe35-c71b-47dc-a320-d7dc1fb34884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:05.061574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aafe35-c71b-47dc-a320-d7dc1fb34884 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:05.062465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aafe35-c71b-47dc-a320-d7dc1fb34884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:05.065388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aafe35-c71b-47dc-a320-d7dc1fb34884 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:05.112418 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4032/8058] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:04 2022] POST /identity/v3/projects => generated 353 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:05.122975 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4027/8059] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:05.132958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a325c0e-d7c4-45f9-95d0-b3cb960c82c5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:05.136442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aafe35-c71b-47dc-a320-d7dc1fb34884 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:05.150714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a325c0e-d7c4-45f9-95d0-b3cb960c82c5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:05.181791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:05.250775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aafe35-c71b-47dc-a320-d7dc1fb34884 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:05.256445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f12e87-1d49-4f55-bb79-36aad181d738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:05.256681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945473e-d0f2-4976-8968-6f8a404ec145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:05.257264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f12e87-1d49-4f55-bb79-36aad181d738 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:05.257415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945473e-d0f2-4976-8968-6f8a404ec145 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:05.257690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945473e-d0f2-4976-8968-6f8a404ec145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:05.257842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f12e87-1d49-4f55-bb79-36aad181d738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:05.257951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945473e-d0f2-4976-8968-6f8a404ec145 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:05.258465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f12e87-1d49-4f55-bb79-36aad181d738 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:05.259315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945473e-d0f2-4976-8968-6f8a404ec145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:05.259446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f12e87-1d49-4f55-bb79-36aad181d738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:05.260925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945473e-d0f2-4976-8968-6f8a404ec145 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:05.261047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f12e87-1d49-4f55-bb79-36aad181d738 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:05.287582 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4033/8060] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:05 2022] POST /identity/v3/users => generated 277 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:05.292193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f12e87-1d49-4f55-bb79-36aad181d738 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:05.303863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f12e87-1d49-4f55-bb79-36aad181d738 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:05.305180 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4028/8061] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:05 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:05.309747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945473e-d0f2-4976-8968-6f8a404ec145 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:05.384237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0386f4-f046-436a-85f7-15a59d0db10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:05.384973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0386f4-f046-436a-85f7-15a59d0db10d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:05.385266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0386f4-f046-436a-85f7-15a59d0db10d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:05.385764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0386f4-f046-436a-85f7-15a59d0db10d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:05.386454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0386f4-f046-436a-85f7-15a59d0db10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:05.388383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0386f4-f046-436a-85f7-15a59d0db10d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:05.390026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:05.401688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945473e-d0f2-4976-8968-6f8a404ec145 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:05.407097 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4034/8062] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:05.408792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0386f4-f046-436a-85f7-15a59d0db10d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:05.413639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14c774-906d-4d02-8a83-835710f1149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:05.414383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14c774-906d-4d02-8a83-835710f1149b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:05.415449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14c774-906d-4d02-8a83-835710f1149b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:05.416546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14c774-906d-4d02-8a83-835710f1149b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:05.417424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14c774-906d-4d02-8a83-835710f1149b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:05.419617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14c774-906d-4d02-8a83-835710f1149b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:05.420110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0386f4-f046-436a-85f7-15a59d0db10d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:05.426223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0deec-dd67-4780-835f-f34d669aec0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:05.426534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0deec-dd67-4780-835f-f34d669aec0c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:05.426802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0deec-dd67-4780-835f-f34d669aec0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:05.427221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0deec-dd67-4780-835f-f34d669aec0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:05.427906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0deec-dd67-4780-835f-f34d669aec0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:05.429512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0deec-dd67-4780-835f-f34d669aec0c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:05.446123 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4035/8063] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:05.450352 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4029/8064] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:05 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:55:05.450513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0deec-dd67-4780-835f-f34d669aec0c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:05.451886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14c774-906d-4d02-8a83-835710f1149b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:05.465851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0deec-dd67-4780-835f-f34d669aec0c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:05.467981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14c774-906d-4d02-8a83-835710f1149b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:05.475512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e32e1-d927-441a-ae65-c39f1b0b562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:05.476132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e32e1-d927-441a-ae65-c39f1b0b562d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:05.477110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e32e1-d927-441a-ae65-c39f1b0b562d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:05.477389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e32e1-d927-441a-ae65-c39f1b0b562d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:05.478937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c09eb-96dc-42eb-a727-4a97e5f92dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:05.479448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e32e1-d927-441a-ae65-c39f1b0b562d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:05.479671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c09eb-96dc-42eb-a727-4a97e5f92dae admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:05.479943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c09eb-96dc-42eb-a727-4a97e5f92dae admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:05.480212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c09eb-96dc-42eb-a727-4a97e5f92dae admin admin] PATH_INFO: `/v3/projects/2a9ab12e2d444cf09e3440b15afb97ff/users/ae4f4b6bc20f462685fd449783a695bc/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:05.486620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e32e1-d927-441a-ae65-c39f1b0b562d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:05.499196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c09eb-96dc-42eb-a727-4a97e5f92dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9ab12e2d444cf09e3440b15afb97ff, user_id=ae4f4b6bc20f462685fd449783a695bc, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:05.502397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c09eb-96dc-42eb-a727-4a97e5f92dae admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:05.510442 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4030/8065] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:55:05.514841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e32e1-d927-441a-ae65-c39f1b0b562d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:05.523300 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4036/8066] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:05 2022] PUT /identity/v3/projects/2a9ab12e2d444cf09e3440b15afb97ff/users/ae4f4b6bc20f462685fd449783a695bc/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:05.527676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e32e1-d927-441a-ae65-c39f1b0b562d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:05.532897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1d11e-9f11-4853-a4bb-0814dfb1ef96 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:05.533273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1d11e-9f11-4853-a4bb-0814dfb1ef96 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:05.533628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1d11e-9f11-4853-a4bb-0814dfb1ef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:05.577857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fca1d11e-9f11-4853-a4bb-0814dfb1ef96 None None] MFA Rules not processed for user `ae4f4b6bc20f462685fd449783a695bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:05.579109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fca1d11e-9f11-4853-a4bb-0814dfb1ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:05.625728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99218b-7d49-411a-8b77-5969b4b31afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:05.626880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99218b-7d49-411a-8b77-5969b4b31afb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:05.627162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99218b-7d49-411a-8b77-5969b4b31afb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:05.627534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99218b-7d49-411a-8b77-5969b4b31afb admin admin] PATH_INFO: `/v3/projects/0ab1722f99534e9fb270108a3cd2bb9b/users/97f149a5599445bf956cdfb0459d9939/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:05.647039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99218b-7d49-411a-8b77-5969b4b31afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab1722f99534e9fb270108a3cd2bb9b, user_id=97f149a5599445bf956cdfb0459d9939, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:05.649893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99218b-7d49-411a-8b77-5969b4b31afb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:05.664203 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4031/8067] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:05 2022] PUT /identity/v3/projects/0ab1722f99534e9fb270108a3cd2bb9b/users/97f149a5599445bf956cdfb0459d9939/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:55:05.668332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99218b-7d49-411a-8b77-5969b4b31afb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:05.674558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:05.695572 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4037/8068] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:55:05.706358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1d11e-9f11-4853-a4bb-0814dfb1ef96 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:05.708291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fca1d11e-9f11-4853-a4bb-0814dfb1ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:05.755323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99218b-7d49-411a-8b77-5969b4b31afb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:05.763740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b2940-92d4-4ca9-acaf-2e7a8d8fb876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:05.764590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b2940-92d4-4ca9-acaf-2e7a8d8fb876 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:05.765356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b2940-92d4-4ca9-acaf-2e7a8d8fb876 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:05.765564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b2940-92d4-4ca9-acaf-2e7a8d8fb876 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:05.766393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b2940-92d4-4ca9-acaf-2e7a8d8fb876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:05.768444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b2940-92d4-4ca9-acaf-2e7a8d8fb876 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:05.781542 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4032/8069] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:55:05.784818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b2940-92d4-4ca9-acaf-2e7a8d8fb876 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:05.796783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b2940-92d4-4ca9-acaf-2e7a8d8fb876 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:05.809641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29eecd-da7c-47cc-81ad-05d9cd90ce30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:05.810349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29eecd-da7c-47cc-81ad-05d9cd90ce30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:05.810630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29eecd-da7c-47cc-81ad-05d9cd90ce30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:05.810908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29eecd-da7c-47cc-81ad-05d9cd90ce30 admin admin] PATH_INFO: `/v3/projects/0ab1722f99534e9fb270108a3cd2bb9b/users/97f149a5599445bf956cdfb0459d9939/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:05.814367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29eecd-da7c-47cc-81ad-05d9cd90ce30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab1722f99534e9fb270108a3cd2bb9b, user_id=97f149a5599445bf956cdfb0459d9939, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:05.815994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1d11e-9f11-4853-a4bb-0814dfb1ef96 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:05.819088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29eecd-da7c-47cc-81ad-05d9cd90ce30 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:05.833349 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4033/8070] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:05 2022] PUT /identity/v3/projects/0ab1722f99534e9fb270108a3cd2bb9b/users/97f149a5599445bf956cdfb0459d9939/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:05.844277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b86048-ba7f-4ca7-9d1a-bb0ebc4b4fa4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:05.844596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b86048-ba7f-4ca7-9d1a-bb0ebc4b4fa4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:05.844832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b86048-ba7f-4ca7-9d1a-bb0ebc4b4fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:05.891652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfcddd-5a29-454a-8e3e-e59b7ea3fc12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:05.892094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d3b86048-ba7f-4ca7-9d1a-bb0ebc4b4fa4 None None] MFA Rules not processed for user `97f149a5599445bf956cdfb0459d9939`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:05.892714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfcddd-5a29-454a-8e3e-e59b7ea3fc12 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:05.893468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3b86048-ba7f-4ca7-9d1a-bb0ebc4b4fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:05.894186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfcddd-5a29-454a-8e3e-e59b7ea3fc12 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:05.894549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfcddd-5a29-454a-8e3e-e59b7ea3fc12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:05.917237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:05.969666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bfcddd-5a29-454a-8e3e-e59b7ea3fc12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:05.971492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bfcddd-5a29-454a-8e3e-e59b7ea3fc12 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:05.984934 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4038/8071] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:05 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:55:06.005582 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4034/8072] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:55:06.021510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfcddd-5a29-454a-8e3e-e59b7ea3fc12 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:06.026297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-84bfcddd-5a29-454a-8e3e-e59b7ea3fc12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:06.124555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfcddd-5a29-454a-8e3e-e59b7ea3fc12 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:06.193838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdebd9f-b443-4de1-b954-1fd83e96a6ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:06.195030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdebd9f-b443-4de1-b954-1fd83e96a6ca service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:06.195216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdebd9f-b443-4de1-b954-1fd83e96a6ca service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:06.195598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdebd9f-b443-4de1-b954-1fd83e96a6ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:06.282740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdebd9f-b443-4de1-b954-1fd83e96a6ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:06.284685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdebd9f-b443-4de1-b954-1fd83e96a6ca service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:06.303479 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4039/8073] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:55:07.191418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b86048-ba7f-4ca7-9d1a-bb0ebc4b4fa4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:07.192843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3b86048-ba7f-4ca7-9d1a-bb0ebc4b4fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:07.324882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b86048-ba7f-4ca7-9d1a-bb0ebc4b4fa4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:07.333003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d0deb-222b-41fd-bc95-8b96edc25852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:07.333709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d0deb-222b-41fd-bc95-8b96edc25852 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:07.333982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d0deb-222b-41fd-bc95-8b96edc25852 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:07.334303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d0deb-222b-41fd-bc95-8b96edc25852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:07.336776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-de8d0deb-222b-41fd-bc95-8b96edc25852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:07.358071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d0deb-222b-41fd-bc95-8b96edc25852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:07.360371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d0deb-222b-41fd-bc95-8b96edc25852 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:07.378282 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4035/8074] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:09.696017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdebd9f-b443-4de1-b954-1fd83e96a6ca service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:09.772807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:09.832273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdebd9f-b443-4de1-b954-1fd83e96a6ca service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:09.837703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ab0dd-cf0f-493f-b047-f8bff8957b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:09.838371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ab0dd-cf0f-493f-b047-f8bff8957b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:09.838645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ab0dd-cf0f-493f-b047-f8bff8957b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:09.839630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ab0dd-cf0f-493f-b047-f8bff8957b8e admin admin] PATH_INFO: `/v3/users/ae4f4b6bc20f462685fd449783a695bc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:09.840861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ab0dd-cf0f-493f-b047-f8bff8957b8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4f4b6bc20f462685fd449783a695bc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:09.843438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ab0dd-cf0f-493f-b047-f8bff8957b8e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:09.922708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-849ab0dd-cf0f-493f-b047-f8bff8957b8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4f4b6bc20f462685fd449783a695bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:09.938662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-849ab0dd-cf0f-493f-b047-f8bff8957b8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4f4b6bc20f462685fd449783a695bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:09.939358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-849ab0dd-cf0f-493f-b047-f8bff8957b8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4f4b6bc20f462685fd449783a695bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:09.940088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-849ab0dd-cf0f-493f-b047-f8bff8957b8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4f4b6bc20f462685fd449783a695bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:09.954117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-849ab0dd-cf0f-493f-b047-f8bff8957b8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4f4b6bc20f462685fd449783a695bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:09.975400 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4040/8075] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:09 2022] DELETE /identity/v3/users/ae4f4b6bc20f462685fd449783a695bc => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:09.976592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fada41f-11de-40ce-b8a3-dda1455a8d1e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:09.977056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fada41f-11de-40ce-b8a3-dda1455a8d1e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:09.977376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fada41f-11de-40ce-b8a3-dda1455a8d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:10.011374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1fada41f-11de-40ce-b8a3-dda1455a8d1e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:10.012765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1fada41f-11de-40ce-b8a3-dda1455a8d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:10.025840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:10.091493 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4036/8076] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:55:10.109511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ab0dd-cf0f-493f-b047-f8bff8957b8e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:10.111053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-849ab0dd-cf0f-493f-b047-f8bff8957b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:10.256180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ab0dd-cf0f-493f-b047-f8bff8957b8e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:10.261759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372d0d6-b0ca-4d3a-a0ae-5a3b6edef431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:10.262575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372d0d6-b0ca-4d3a-a0ae-5a3b6edef431 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:10.262912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372d0d6-b0ca-4d3a-a0ae-5a3b6edef431 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:10.263290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372d0d6-b0ca-4d3a-a0ae-5a3b6edef431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:10.274291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372d0d6-b0ca-4d3a-a0ae-5a3b6edef431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:10.277385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372d0d6-b0ca-4d3a-a0ae-5a3b6edef431 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:10.291966 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4041/8077] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:10.941768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fada41f-11de-40ce-b8a3-dda1455a8d1e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:10.944256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1fada41f-11de-40ce-b8a3-dda1455a8d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:10.969811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fada41f-11de-40ce-b8a3-dda1455a8d1e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:10.982098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4afe84-6aa8-4084-a3e1-8f494bc2cb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:10.982831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4afe84-6aa8-4084-a3e1-8f494bc2cb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:10.983023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4afe84-6aa8-4084-a3e1-8f494bc2cb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:10.983348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4afe84-6aa8-4084-a3e1-8f494bc2cb34 admin admin] PATH_INFO: `/v3/projects/2a9ab12e2d444cf09e3440b15afb97ff` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:10.984551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4afe84-6aa8-4084-a3e1-8f494bc2cb34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9ab12e2d444cf09e3440b15afb97ff)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:10.986553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4afe84-6aa8-4084-a3e1-8f494bc2cb34 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:11.227459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b4afe84-6aa8-4084-a3e1-8f494bc2cb34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9ab12e2d444cf09e3440b15afb97ff', 'request_id': 'req-9b4afe84-6aa8-4084-a3e1-8f494bc2cb34'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:11.240322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b4afe84-6aa8-4084-a3e1-8f494bc2cb34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9ab12e2d444cf09e3440b15afb97ff', 'request_id': 'req-9b4afe84-6aa8-4084-a3e1-8f494bc2cb34'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:11.247098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b4afe84-6aa8-4084-a3e1-8f494bc2cb34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9ab12e2d444cf09e3440b15afb97ff', 'request_id': 'req-9b4afe84-6aa8-4084-a3e1-8f494bc2cb34'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:11.270296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b4afe84-6aa8-4084-a3e1-8f494bc2cb34 admin admin] The token cache is being invalidate because project 2a9ab12e2d444cf09e3440b15afb97ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:11.270604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b4afe84-6aa8-4084-a3e1-8f494bc2cb34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:11.271491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b4afe84-6aa8-4084-a3e1-8f494bc2cb34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:11.274019 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4037/8078] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:10 2022] DELETE /identity/v3/projects/2a9ab12e2d444cf09e3440b15afb97ff => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:11.280966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9d4a0-5eac-481f-95c2-909761a71718 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:11.282837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9d4a0-5eac-481f-95c2-909761a71718 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:11.283417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9d4a0-5eac-481f-95c2-909761a71718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:11.317627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c0d9d4a0-5eac-481f-95c2-909761a71718 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:11.318878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c0d9d4a0-5eac-481f-95c2-909761a71718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:11.394231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:11.422806 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4042/8079] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:11.430411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5593c7-097a-4f5d-aa4c-55381aefc36e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:11.430696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5593c7-097a-4f5d-aa4c-55381aefc36e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:11.431007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5593c7-097a-4f5d-aa4c-55381aefc36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:11.459922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ff5593c7-097a-4f5d-aa4c-55381aefc36e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:11.461512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ff5593c7-097a-4f5d-aa4c-55381aefc36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:11.482613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9d4a0-5eac-481f-95c2-909761a71718 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:11.484633 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4038/8080] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:11.494324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9d4a0-5eac-481f-95c2-909761a71718 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:11.501063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e5e69-2e5a-4d66-8d9f-d4522c8809ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:11.501991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e5e69-2e5a-4d66-8d9f-d4522c8809ea admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:11.502369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e5e69-2e5a-4d66-8d9f-d4522c8809ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:11.502648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e5e69-2e5a-4d66-8d9f-d4522c8809ea admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:11.503756 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e5e69-2e5a-4d66-8d9f-d4522c8809ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:55:11.504066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e5e69-2e5a-4d66-8d9f-d4522c8809ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:11.505841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e5e69-2e5a-4d66-8d9f-d4522c8809ea admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:11.511187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5593c7-097a-4f5d-aa4c-55381aefc36e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:11.512958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ff5593c7-097a-4f5d-aa4c-55381aefc36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:11.532646 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4043/8081] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:55:11.534970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e5e69-2e5a-4d66-8d9f-d4522c8809ea admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:11.548914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e5e69-2e5a-4d66-8d9f-d4522c8809ea admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:11.555458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11d66d-fb27-4c2f-a76e-b95a70835548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:11.556177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11d66d-fb27-4c2f-a76e-b95a70835548 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:11.558386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11d66d-fb27-4c2f-a76e-b95a70835548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:11.560308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11d66d-fb27-4c2f-a76e-b95a70835548 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:11.561048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11d66d-fb27-4c2f-a76e-b95a70835548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:11.563901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11d66d-fb27-4c2f-a76e-b95a70835548 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:11.623503 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4044/8082] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:11 2022] POST /identity/v3/projects => generated 387 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:11.629653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5593c7-097a-4f5d-aa4c-55381aefc36e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:11.630573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11d66d-fb27-4c2f-a76e-b95a70835548 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:11.732473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11d66d-fb27-4c2f-a76e-b95a70835548 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:11.741927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2148a-0c64-4b6d-90bb-7a2c7c11b8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:11.744609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2148a-0c64-4b6d-90bb-7a2c7c11b8ad admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:11.744988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2148a-0c64-4b6d-90bb-7a2c7c11b8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:11.745333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2148a-0c64-4b6d-90bb-7a2c7c11b8ad admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:11.746059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2148a-0c64-4b6d-90bb-7a2c7c11b8ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:11.749252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2148a-0c64-4b6d-90bb-7a2c7c11b8ad admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:11.757830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:11.788813 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4045/8083] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:11 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:55:11.796642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2148a-0c64-4b6d-90bb-7a2c7c11b8ad admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:11.803427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59e80b-0927-4d51-b8cd-b249a36689fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:11.804784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59e80b-0927-4d51-b8cd-b249a36689fb service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:11.806132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59e80b-0927-4d51-b8cd-b249a36689fb service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:11.806721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59e80b-0927-4d51-b8cd-b249a36689fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:11.809439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1f59e80b-0927-4d51-b8cd-b249a36689fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:11.810946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2148a-0c64-4b6d-90bb-7a2c7c11b8ad admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:11.825570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895c787-f807-4ca2-ac14-a1a44354b89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:11.826360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895c787-f807-4ca2-ac14-a1a44354b89d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:11.826758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895c787-f807-4ca2-ac14-a1a44354b89d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:11.827133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895c787-f807-4ca2-ac14-a1a44354b89d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:11.827941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895c787-f807-4ca2-ac14-a1a44354b89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:11.837523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895c787-f807-4ca2-ac14-a1a44354b89d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:11.867661 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4046/8084] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:11.869041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895c787-f807-4ca2-ac14-a1a44354b89d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:11.882789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895c787-f807-4ca2-ac14-a1a44354b89d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:11.889922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec61856-1d87-4055-a117-343d63c55ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:11.890758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec61856-1d87-4055-a117-343d63c55ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:11.891145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec61856-1d87-4055-a117-343d63c55ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:11.891562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec61856-1d87-4055-a117-343d63c55ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:11.892316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec61856-1d87-4055-a117-343d63c55ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:11.894726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec61856-1d87-4055-a117-343d63c55ce9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:11.912239 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4047/8085] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:11.916788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec61856-1d87-4055-a117-343d63c55ce9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:11.930238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec61856-1d87-4055-a117-343d63c55ce9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:11.936305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76531a0-0254-4370-abe5-dfb42bdef86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:11.937961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76531a0-0254-4370-abe5-dfb42bdef86d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:11.938343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76531a0-0254-4370-abe5-dfb42bdef86d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:11.939052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76531a0-0254-4370-abe5-dfb42bdef86d admin admin] PATH_INFO: `/v3/projects/a2d7bd814d654c809ac769fa77679594/users/001f52817d32467e806fb37890bd7d78/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:11.939543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59e80b-0927-4d51-b8cd-b249a36689fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:11.941113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59e80b-0927-4d51-b8cd-b249a36689fb service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:11.955056 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4039/8086] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:55:11.958394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76531a0-0254-4370-abe5-dfb42bdef86d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d7bd814d654c809ac769fa77679594, user_id=001f52817d32467e806fb37890bd7d78, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:11.961500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76531a0-0254-4370-abe5-dfb42bdef86d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:11.980883 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4048/8087] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:11 2022] PUT /identity/v3/projects/a2d7bd814d654c809ac769fa77679594/users/001f52817d32467e806fb37890bd7d78/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:11.997217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027165b-1190-4704-bac9-9010623d6047 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:11.997778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027165b-1190-4704-bac9-9010623d6047 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:11.997778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027165b-1190-4704-bac9-9010623d6047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:12.028783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2027165b-1190-4704-bac9-9010623d6047 None None] MFA Rules not processed for user `001f52817d32467e806fb37890bd7d78`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:12.030349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2027165b-1190-4704-bac9-9010623d6047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:12.102279 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4040/8088] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:12.115791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76531a0-0254-4370-abe5-dfb42bdef86d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:12.217249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76531a0-0254-4370-abe5-dfb42bdef86d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:12.232733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38fc01-5e6f-4fd4-b66a-02123a49499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:12.233434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38fc01-5e6f-4fd4-b66a-02123a49499c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:12.233832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38fc01-5e6f-4fd4-b66a-02123a49499c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:12.234169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38fc01-5e6f-4fd4-b66a-02123a49499c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:12.234893 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38fc01-5e6f-4fd4-b66a-02123a49499c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:12.237118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38fc01-5e6f-4fd4-b66a-02123a49499c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:12.244423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:12.281905 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4049/8089] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:12 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:12.284876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027165b-1190-4704-bac9-9010623d6047 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:12.301777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027165b-1190-4704-bac9-9010623d6047 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:12.353345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38fc01-5e6f-4fd4-b66a-02123a49499c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:12.355758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bd38fc01-5e6f-4fd4-b66a-02123a49499c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:12.549184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fab4c3-7d2b-4e77-9879-bc2670193d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:12.550067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fab4c3-7d2b-4e77-9879-bc2670193d31 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:12.550562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fab4c3-7d2b-4e77-9879-bc2670193d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:12.551153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fab4c3-7d2b-4e77-9879-bc2670193d31 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:12.551981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fab4c3-7d2b-4e77-9879-bc2670193d31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:12.554428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fab4c3-7d2b-4e77-9879-bc2670193d31 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:12.588344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38fc01-5e6f-4fd4-b66a-02123a49499c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:12.600821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5db5c-dc76-429e-a7b3-bdaa307f228b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:12.602537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5db5c-dc76-429e-a7b3-bdaa307f228b service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:12.603125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5db5c-dc76-429e-a7b3-bdaa307f228b service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:12.603406 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4041/8090] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:12 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:12.603711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5db5c-dc76-429e-a7b3-bdaa307f228b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:12.607181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fab4c3-7d2b-4e77-9879-bc2670193d31 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:12.622900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0ef5db5c-dc76-429e-a7b3-bdaa307f228b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:12.648214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5db5c-dc76-429e-a7b3-bdaa307f228b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:12.650747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5db5c-dc76-429e-a7b3-bdaa307f228b service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:12.655795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fab4c3-7d2b-4e77-9879-bc2670193d31 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:12.672399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30225a85-9c4e-45b2-9337-cb44f10e2459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:12.673202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30225a85-9c4e-45b2-9337-cb44f10e2459 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:12.673793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30225a85-9c4e-45b2-9337-cb44f10e2459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:12.674242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30225a85-9c4e-45b2-9337-cb44f10e2459 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:12.675062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30225a85-9c4e-45b2-9337-cb44f10e2459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:12.679511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30225a85-9c4e-45b2-9337-cb44f10e2459 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:12.684557 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4050/8091] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:55:12.700472 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4042/8092] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:12.704802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5db5c-dc76-429e-a7b3-bdaa307f228b service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:12.722791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5db5c-dc76-429e-a7b3-bdaa307f228b service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:12.736299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bdc93-1277-4076-bb2a-30c6c1f462db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:12.737229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bdc93-1277-4076-bb2a-30c6c1f462db admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:12.737609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bdc93-1277-4076-bb2a-30c6c1f462db admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:12.743130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bdc93-1277-4076-bb2a-30c6c1f462db admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:12.743130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bdc93-1277-4076-bb2a-30c6c1f462db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:12.743564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bdc93-1277-4076-bb2a-30c6c1f462db admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:12.763760 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4051/8093] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:12.767896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30225a85-9c4e-45b2-9337-cb44f10e2459 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:12.779520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30225a85-9c4e-45b2-9337-cb44f10e2459 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:12.785188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82f0da-80f4-4274-bfa3-afbfb6e9af19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:12.786224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82f0da-80f4-4274-bfa3-afbfb6e9af19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:12.786645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82f0da-80f4-4274-bfa3-afbfb6e9af19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:12.787084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82f0da-80f4-4274-bfa3-afbfb6e9af19 admin admin] PATH_INFO: `/v3/projects/fafa00c1bf804b8fbcd990abd466c499/users/ad6b4a9e8b7e461a934f70f21e03cb15/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:12.790199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:12.806305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82f0da-80f4-4274-bfa3-afbfb6e9af19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fafa00c1bf804b8fbcd990abd466c499, user_id=ad6b4a9e8b7e461a934f70f21e03cb15, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:12.809938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82f0da-80f4-4274-bfa3-afbfb6e9af19 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:12.845809 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4043/8094] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:12 2022] PUT /identity/v3/projects/fafa00c1bf804b8fbcd990abd466c499/users/ad6b4a9e8b7e461a934f70f21e03cb15/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:12.856084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8de9e-e790-4483-8a5c-2359791db084 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:12.856524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8de9e-e790-4483-8a5c-2359791db084 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:12.856907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8de9e-e790-4483-8a5c-2359791db084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:12.926094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-afc8de9e-e790-4483-8a5c-2359791db084 None None] MFA Rules not processed for user `ad6b4a9e8b7e461a934f70f21e03cb15`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:12.927558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-afc8de9e-e790-4483-8a5c-2359791db084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:13.030707 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4052/8095] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:13.035163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82f0da-80f4-4274-bfa3-afbfb6e9af19 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:13.184233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82f0da-80f4-4274-bfa3-afbfb6e9af19 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:13.200180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a8ecf-9474-465f-9282-73f59f098bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:13.200794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a8ecf-9474-465f-9282-73f59f098bfc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:13.201048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a8ecf-9474-465f-9282-73f59f098bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:13.201318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a8ecf-9474-465f-9282-73f59f098bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:13.202100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a8ecf-9474-465f-9282-73f59f098bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:13.205061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a8ecf-9474-465f-9282-73f59f098bfc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:13.254229 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4044/8096] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:13 2022] POST /identity/v3/projects => generated 385 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:13.255199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8de9e-e790-4483-8a5c-2359791db084 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:13.271179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8de9e-e790-4483-8a5c-2359791db084 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:13.361885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:13.383819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a807aae-7aa1-4ae5-9342-a98ed71de048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:13.384570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807aae-7aa1-4ae5-9342-a98ed71de048 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:13.384860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807aae-7aa1-4ae5-9342-a98ed71de048 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:13.385233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807aae-7aa1-4ae5-9342-a98ed71de048 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:13.400542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a807aae-7aa1-4ae5-9342-a98ed71de048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:13.404610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a807aae-7aa1-4ae5-9342-a98ed71de048 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:13.463080 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4053/8097] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:13 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:13.465773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a8ecf-9474-465f-9282-73f59f098bfc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:13.483377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a8ecf-9474-465f-9282-73f59f098bfc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:13.502075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbd174-9054-4537-b499-638aa15324c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:13.502899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbd174-9054-4537-b499-638aa15324c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:13.503309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbd174-9054-4537-b499-638aa15324c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:13.503660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbd174-9054-4537-b499-638aa15324c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:13.504407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbd174-9054-4537-b499-638aa15324c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:13.508847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbd174-9054-4537-b499-638aa15324c5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:13.537739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a807aae-7aa1-4ae5-9342-a98ed71de048 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:13.545763 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4045/8098] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:55:13.586597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a807aae-7aa1-4ae5-9342-a98ed71de048 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:13.602272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04dbe7-037d-461a-9981-62ac5a0c739a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:13.603005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04dbe7-037d-461a-9981-62ac5a0c739a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:13.603416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04dbe7-037d-461a-9981-62ac5a0c739a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:13.603736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04dbe7-037d-461a-9981-62ac5a0c739a admin admin] PATH_INFO: `/v3/projects/959b2933bd4841ea9a31ea45040ef37f/users/a1007169ecc54204bd21e2f36743cb03/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:13.632336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04dbe7-037d-461a-9981-62ac5a0c739a admin admin] RBAC: Authorizing `identity:create_grant(project_id=959b2933bd4841ea9a31ea45040ef37f, user_id=a1007169ecc54204bd21e2f36743cb03, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:13.635128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04dbe7-037d-461a-9981-62ac5a0c739a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:13.664545 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4054/8099] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:13 2022] PUT /identity/v3/projects/959b2933bd4841ea9a31ea45040ef37f/users/a1007169ecc54204bd21e2f36743cb03/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:13.669249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbd174-9054-4537-b499-638aa15324c5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:13.686200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbd174-9054-4537-b499-638aa15324c5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:13.789772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0efeb9-d422-48e8-90f3-3dbc43bd0b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:13.790806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0efeb9-d422-48e8-90f3-3dbc43bd0b7a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:13.791388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0efeb9-d422-48e8-90f3-3dbc43bd0b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:13.791983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0efeb9-d422-48e8-90f3-3dbc43bd0b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:13.793650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0efeb9-d422-48e8-90f3-3dbc43bd0b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:13.800816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0efeb9-d422-48e8-90f3-3dbc43bd0b7a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:13.829786 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4046/8100] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:13.832093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04dbe7-037d-461a-9981-62ac5a0c739a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:13.851541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04dbe7-037d-461a-9981-62ac5a0c739a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:13.861020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc5f68-705b-42fc-9cd6-fdeff7e6b064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:13.861821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc5f68-705b-42fc-9cd6-fdeff7e6b064 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:13.862018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc5f68-705b-42fc-9cd6-fdeff7e6b064 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:13.862299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc5f68-705b-42fc-9cd6-fdeff7e6b064 admin admin] PATH_INFO: `/v3/projects/959b2933bd4841ea9a31ea45040ef37f/users/a1007169ecc54204bd21e2f36743cb03/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:13.866837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc5f68-705b-42fc-9cd6-fdeff7e6b064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=959b2933bd4841ea9a31ea45040ef37f, user_id=a1007169ecc54204bd21e2f36743cb03, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:13.869655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc5f68-705b-42fc-9cd6-fdeff7e6b064 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:13.897122 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4055/8101] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:13 2022] PUT /identity/v3/projects/959b2933bd4841ea9a31ea45040ef37f/users/a1007169ecc54204bd21e2f36743cb03/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:13.910845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826a1ac-e34b-4ea6-acaa-ac5ef6a9e6fc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:13.911325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826a1ac-e34b-4ea6-acaa-ac5ef6a9e6fc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:13.911694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826a1ac-e34b-4ea6-acaa-ac5ef6a9e6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:13.968714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b826a1ac-e34b-4ea6-acaa-ac5ef6a9e6fc None None] MFA Rules not processed for user `a1007169ecc54204bd21e2f36743cb03`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:13.970061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b826a1ac-e34b-4ea6-acaa-ac5ef6a9e6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:14.085166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:14.161995 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4047/8102] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:14.173790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc5f68-705b-42fc-9cd6-fdeff7e6b064 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:14.177343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-79fc5f68-705b-42fc-9cd6-fdeff7e6b064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:14.309625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc5f68-705b-42fc-9cd6-fdeff7e6b064 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:14.320848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9ee0d-b813-40bc-b2dd-03647ad8a49a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:14.321528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9ee0d-b813-40bc-b2dd-03647ad8a49a service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:14.321848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9ee0d-b813-40bc-b2dd-03647ad8a49a service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:14.322249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9ee0d-b813-40bc-b2dd-03647ad8a49a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:14.351133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9ee0d-b813-40bc-b2dd-03647ad8a49a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:14.357564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9ee0d-b813-40bc-b2dd-03647ad8a49a service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:14.383397 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4056/8103] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:15.536802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826a1ac-e34b-4ea6-acaa-ac5ef6a9e6fc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:15.553154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826a1ac-e34b-4ea6-acaa-ac5ef6a9e6fc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:15.572250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0326f-db2e-4780-9632-ac71744bff23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:15.575827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0326f-db2e-4780-9632-ac71744bff23 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:15.577527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0326f-db2e-4780-9632-ac71744bff23 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:15.578034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0326f-db2e-4780-9632-ac71744bff23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:15.802373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0326f-db2e-4780-9632-ac71744bff23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:15.807705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0326f-db2e-4780-9632-ac71744bff23 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:15.887773 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4048/8104] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:24.371476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=47,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:25.831456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=38 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:26.770518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9ee0d-b813-40bc-b2dd-03647ad8a49a service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:26.791179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9ee0d-b813-40bc-b2dd-03647ad8a49a service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:26.796968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b635c-eae1-4136-ae1f-dcf0858279db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:26.797572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b635c-eae1-4136-ae1f-dcf0858279db service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:26.797857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b635c-eae1-4136-ae1f-dcf0858279db service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:26.798230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b635c-eae1-4136-ae1f-dcf0858279db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:26.865445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b635c-eae1-4136-ae1f-dcf0858279db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:26.866923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b635c-eae1-4136-ae1f-dcf0858279db service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:26.878830 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4057/8105] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:28.019567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef6e17-2a9d-418e-b86c-cbf1368ed2e1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:28.020098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef6e17-2a9d-418e-b86c-cbf1368ed2e1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:28.020709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef6e17-2a9d-418e-b86c-cbf1368ed2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:28.082194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aaef6e17-2a9d-418e-b86c-cbf1368ed2e1 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:28.084928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aaef6e17-2a9d-418e-b86c-cbf1368ed2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:28.236010 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4049/8106] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:55:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:28.364954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b635c-eae1-4136-ae1f-dcf0858279db service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:28.367605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2a4b635c-eae1-4136-ae1f-dcf0858279db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:28.620228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b635c-eae1-4136-ae1f-dcf0858279db service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:28.649498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c08cdf-2ff9-45f6-9144-f050c9a516e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:28.650633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c08cdf-2ff9-45f6-9144-f050c9a516e3 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:28.651120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c08cdf-2ff9-45f6-9144-f050c9a516e3 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:28.651794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c08cdf-2ff9-45f6-9144-f050c9a516e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:28.679337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c08cdf-2ff9-45f6-9144-f050c9a516e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:28.680915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c08cdf-2ff9-45f6-9144-f050c9a516e3 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:28.695756 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4058/8107] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:55:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:55:29.738789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568c963-a6fb-4ebd-b36e-ea8f28f92284 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:29.739381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568c963-a6fb-4ebd-b36e-ea8f28f92284 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:29.739475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568c963-a6fb-4ebd-b36e-ea8f28f92284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:29.805125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1568c963-a6fb-4ebd-b36e-ea8f28f92284 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:29.806364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1568c963-a6fb-4ebd-b36e-ea8f28f92284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:29.824905 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4050/8108] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:55:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:29.842196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c08cdf-2ff9-45f6-9144-f050c9a516e3 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:29.865691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c08cdf-2ff9-45f6-9144-f050c9a516e3 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:29.872780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726ed34-3820-49ac-ad16-1d8a1ce89b39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:29.873506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726ed34-3820-49ac-ad16-1d8a1ce89b39 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:29.873788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726ed34-3820-49ac-ad16-1d8a1ce89b39 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:29.874233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726ed34-3820-49ac-ad16-1d8a1ce89b39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:29.888122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726ed34-3820-49ac-ad16-1d8a1ce89b39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:29.891019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726ed34-3820-49ac-ad16-1d8a1ce89b39 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:29.908811 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4059/8109] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:55:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:55:30.308380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bac29-5d75-43ea-946c-69a0acf3350d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:30.309689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bac29-5d75-43ea-946c-69a0acf3350d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:30.310242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bac29-5d75-43ea-946c-69a0acf3350d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:30.343159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7b3bac29-5d75-43ea-946c-69a0acf3350d None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:30.345466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7b3bac29-5d75-43ea-946c-69a0acf3350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:30.379907 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4051/8110] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 18:55:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:30.397460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726ed34-3820-49ac-ad16-1d8a1ce89b39 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:30.426531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726ed34-3820-49ac-ad16-1d8a1ce89b39 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:30.439839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fc459-94f2-423f-ba35-11a7b21af8fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:30.440474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc459-94f2-423f-ba35-11a7b21af8fc service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:30.440954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc459-94f2-423f-ba35-11a7b21af8fc service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:30.441390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc459-94f2-423f-ba35-11a7b21af8fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:30.478338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fc459-94f2-423f-ba35-11a7b21af8fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:30.482268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fc459-94f2-423f-ba35-11a7b21af8fc service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:30.531030 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4060/8111] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:55:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:55:31.170574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89f5b5-e3ff-413f-97d7-6f9d08e85e1b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:31.172098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89f5b5-e3ff-413f-97d7-6f9d08e85e1b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:31.172831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89f5b5-e3ff-413f-97d7-6f9d08e85e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:31.228604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1c89f5b5-e3ff-413f-97d7-6f9d08e85e1b None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:31.232708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c89f5b5-e3ff-413f-97d7-6f9d08e85e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:31.259923 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4052/8112] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 18:55:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:31.272478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fc459-94f2-423f-ba35-11a7b21af8fc service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:31.290104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fc459-94f2-423f-ba35-11a7b21af8fc service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:31.320338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0dcbe-36f9-417b-844a-5dfc3aaefb3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:31.320967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0dcbe-36f9-417b-844a-5dfc3aaefb3d service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:31.321421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0dcbe-36f9-417b-844a-5dfc3aaefb3d service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:31.322337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0dcbe-36f9-417b-844a-5dfc3aaefb3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:31.347838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0dcbe-36f9-417b-844a-5dfc3aaefb3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:31.349639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0dcbe-36f9-417b-844a-5dfc3aaefb3d service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:31.375363 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4061/8113] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:55:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:55:32.401160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89f5b5-e3ff-413f-97d7-6f9d08e85e1b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:32.623630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89f5b5-e3ff-413f-97d7-6f9d08e85e1b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:32.634358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff313b4-fec5-4863-9d7e-d58e90932815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:32.635438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff313b4-fec5-4863-9d7e-d58e90932815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:32.636674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff313b4-fec5-4863-9d7e-d58e90932815 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:32.637802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff313b4-fec5-4863-9d7e-d58e90932815 admin admin] PATH_INFO: `/v3/users/001f52817d32467e806fb37890bd7d78` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:32.639992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff313b4-fec5-4863-9d7e-d58e90932815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=001f52817d32467e806fb37890bd7d78)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:32.647827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff313b4-fec5-4863-9d7e-d58e90932815 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:32.804458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ff313b4-fec5-4863-9d7e-d58e90932815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001f52817d32467e806fb37890bd7d78'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:32.806621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ff313b4-fec5-4863-9d7e-d58e90932815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001f52817d32467e806fb37890bd7d78'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:32.834809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ff313b4-fec5-4863-9d7e-d58e90932815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001f52817d32467e806fb37890bd7d78'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:32.863071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ff313b4-fec5-4863-9d7e-d58e90932815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001f52817d32467e806fb37890bd7d78'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:32.909204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ff313b4-fec5-4863-9d7e-d58e90932815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001f52817d32467e806fb37890bd7d78'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:32.930862 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4053/8114] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:32 2022] DELETE /identity/v3/users/001f52817d32467e806fb37890bd7d78 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:32.934045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0072b7f-3ed0-4a0d-99e1-92b682fceab0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:32.934552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0072b7f-3ed0-4a0d-99e1-92b682fceab0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:32.937082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0072b7f-3ed0-4a0d-99e1-92b682fceab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:32.999512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f0072b7f-3ed0-4a0d-99e1-92b682fceab0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:33.000925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f0072b7f-3ed0-4a0d-99e1-92b682fceab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:33.113465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:33.173181 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4062/8115] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:33.189190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff313b4-fec5-4863-9d7e-d58e90932815 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:33.190693 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ff313b4-fec5-4863-9d7e-d58e90932815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:33.201148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:33.427426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff313b4-fec5-4863-9d7e-d58e90932815 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:33.453342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50452fa8-be19-4e09-9ac8-1838cf68a03e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:33.454166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50452fa8-be19-4e09-9ac8-1838cf68a03e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:33.458573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50452fa8-be19-4e09-9ac8-1838cf68a03e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:33.459424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50452fa8-be19-4e09-9ac8-1838cf68a03e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:33.476545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50452fa8-be19-4e09-9ac8-1838cf68a03e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:33.478895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50452fa8-be19-4e09-9ac8-1838cf68a03e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:33.491406 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4054/8116] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:34.677799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0072b7f-3ed0-4a0d-99e1-92b682fceab0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:34.679499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f0072b7f-3ed0-4a0d-99e1-92b682fceab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:34.700796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0072b7f-3ed0-4a0d-99e1-92b682fceab0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:34.715775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:34.720001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:34.720486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:34.720908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66 admin admin] PATH_INFO: `/v3/projects/a2d7bd814d654c809ac769fa77679594` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:34.728127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d7bd814d654c809ac769fa77679594)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:34.730564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:34.843830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d7bd814d654c809ac769fa77679594', 'request_id': 'req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:34.857409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d7bd814d654c809ac769fa77679594', 'request_id': 'req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:34.875340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d7bd814d654c809ac769fa77679594', 'request_id': 'req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:34.901584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66 admin admin] The token cache is being invalidate because project a2d7bd814d654c809ac769fa77679594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:34.902198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:34.903130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:34.905286 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4063/8117] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:34 2022] DELETE /identity/v3/projects/a2d7bd814d654c809ac769fa77679594 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:34.909212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50452fa8-be19-4e09-9ac8-1838cf68a03e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:34.925099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50452fa8-be19-4e09-9ac8-1838cf68a03e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:35.088373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b78cd6-c12d-4d40-a05a-d1e8a12b90f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:35.090855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b78cd6-c12d-4d40-a05a-d1e8a12b90f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:35.091396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b78cd6-c12d-4d40-a05a-d1e8a12b90f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:35.092230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b78cd6-c12d-4d40-a05a-d1e8a12b90f2 admin admin] PATH_INFO: `/v3/users/ad6b4a9e8b7e461a934f70f21e03cb15` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:35.095848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b78cd6-c12d-4d40-a05a-d1e8a12b90f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad6b4a9e8b7e461a934f70f21e03cb15)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:35.101846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b78cd6-c12d-4d40-a05a-d1e8a12b90f2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:35.208163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13b78cd6-c12d-4d40-a05a-d1e8a12b90f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad6b4a9e8b7e461a934f70f21e03cb15'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:35.211589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13b78cd6-c12d-4d40-a05a-d1e8a12b90f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad6b4a9e8b7e461a934f70f21e03cb15'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:35.230962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13b78cd6-c12d-4d40-a05a-d1e8a12b90f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad6b4a9e8b7e461a934f70f21e03cb15'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:35.267998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13b78cd6-c12d-4d40-a05a-d1e8a12b90f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad6b4a9e8b7e461a934f70f21e03cb15'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:35.341751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13b78cd6-c12d-4d40-a05a-d1e8a12b90f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad6b4a9e8b7e461a934f70f21e03cb15'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:35.367469 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4055/8118] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:34 2022] DELETE /identity/v3/users/ad6b4a9e8b7e461a934f70f21e03cb15 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:37.072066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:37.075378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:37.137083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae415836-71f2-48e4-b0f6-7dbb0e45fc66 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:37.253924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed143c8-0d28-479e-9b4c-3392e451952e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:37.254867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed143c8-0d28-479e-9b4c-3392e451952e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:37.256544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed143c8-0d28-479e-9b4c-3392e451952e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:37.256985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed143c8-0d28-479e-9b4c-3392e451952e admin admin] PATH_INFO: `/v3/projects/fafa00c1bf804b8fbcd990abd466c499` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:37.260874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed143c8-0d28-479e-9b4c-3392e451952e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fafa00c1bf804b8fbcd990abd466c499)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:37.263594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed143c8-0d28-479e-9b4c-3392e451952e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:37.354064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ed143c8-0d28-479e-9b4c-3392e451952e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fafa00c1bf804b8fbcd990abd466c499', 'request_id': 'req-0ed143c8-0d28-479e-9b4c-3392e451952e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.391651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ed143c8-0d28-479e-9b4c-3392e451952e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fafa00c1bf804b8fbcd990abd466c499', 'request_id': 'req-0ed143c8-0d28-479e-9b4c-3392e451952e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.410624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ed143c8-0d28-479e-9b4c-3392e451952e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fafa00c1bf804b8fbcd990abd466c499', 'request_id': 'req-0ed143c8-0d28-479e-9b4c-3392e451952e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.440700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ed143c8-0d28-479e-9b4c-3392e451952e admin admin] The token cache is being invalidate because project fafa00c1bf804b8fbcd990abd466c499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:37.441320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ed143c8-0d28-479e-9b4c-3392e451952e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.442724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ed143c8-0d28-479e-9b4c-3392e451952e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.445390 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4064/8119] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:37 2022] DELETE /identity/v3/projects/fafa00c1bf804b8fbcd990abd466c499 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:37.449579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b78cd6-c12d-4d40-a05a-d1e8a12b90f2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:37.451148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13b78cd6-c12d-4d40-a05a-d1e8a12b90f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:37.482329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b78cd6-c12d-4d40-a05a-d1e8a12b90f2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:37.566491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:37.653820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bef7e6-7b9c-46b3-a62d-301964392057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:37.654735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bef7e6-7b9c-46b3-a62d-301964392057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:37.656106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bef7e6-7b9c-46b3-a62d-301964392057 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:37.656601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bef7e6-7b9c-46b3-a62d-301964392057 admin admin] PATH_INFO: `/v3/users/a1007169ecc54204bd21e2f36743cb03` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:37.659725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bef7e6-7b9c-46b3-a62d-301964392057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1007169ecc54204bd21e2f36743cb03)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:37.664759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bef7e6-7b9c-46b3-a62d-301964392057 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:37.776205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22bef7e6-7b9c-46b3-a62d-301964392057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1007169ecc54204bd21e2f36743cb03'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.778122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22bef7e6-7b9c-46b3-a62d-301964392057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1007169ecc54204bd21e2f36743cb03'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.814957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22bef7e6-7b9c-46b3-a62d-301964392057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1007169ecc54204bd21e2f36743cb03'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.835869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22bef7e6-7b9c-46b3-a62d-301964392057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1007169ecc54204bd21e2f36743cb03'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.896691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22bef7e6-7b9c-46b3-a62d-301964392057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1007169ecc54204bd21e2f36743cb03'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.913079 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4056/8120] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:37 2022] DELETE /identity/v3/users/a1007169ecc54204bd21e2f36743cb03 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:39.456747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdf027-1195-4156-8fa9-b0ed1ed42611 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:39.458291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdf027-1195-4156-8fa9-b0ed1ed42611 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:39.458723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdf027-1195-4156-8fa9-b0ed1ed42611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:39.474957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:39.526887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-73fdf027-1195-4156-8fa9-b0ed1ed42611 None None] MFA Rules not processed for user `7afaa3dd70cd4a64a2b3c51e8a3b9582`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:39.532559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-73fdf027-1195-4156-8fa9-b0ed1ed42611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:39.661636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bef7e6-7b9c-46b3-a62d-301964392057 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:39.664392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-22bef7e6-7b9c-46b3-a62d-301964392057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:39.704014 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4065/8121] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:39.841597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bef7e6-7b9c-46b3-a62d-301964392057 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:39.862933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c101c-df87-4aec-9269-48a78482f9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:39.863822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c101c-df87-4aec-9269-48a78482f9e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:39.863920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c101c-df87-4aec-9269-48a78482f9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:39.864169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c101c-df87-4aec-9269-48a78482f9e4 admin admin] PATH_INFO: `/v3/projects/959b2933bd4841ea9a31ea45040ef37f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:39.868972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c101c-df87-4aec-9269-48a78482f9e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=959b2933bd4841ea9a31ea45040ef37f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:39.870939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c101c-df87-4aec-9269-48a78482f9e4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:39.907703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdf027-1195-4156-8fa9-b0ed1ed42611 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:39.909114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-73fdf027-1195-4156-8fa9-b0ed1ed42611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:39.934530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdf027-1195-4156-8fa9-b0ed1ed42611 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:39.941497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9f839-ecc4-42fd-b52b-eb5a255dd00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:39.942164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9f839-ecc4-42fd-b52b-eb5a255dd00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:39.942443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9f839-ecc4-42fd-b52b-eb5a255dd00b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:39.942718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9f839-ecc4-42fd-b52b-eb5a255dd00b admin admin] PATH_INFO: `/v3/users/6c93bdc93ecf470d9db54b7db06cdc64` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:39.944622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9f839-ecc4-42fd-b52b-eb5a255dd00b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c93bdc93ecf470d9db54b7db06cdc64)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:39.948525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9f839-ecc4-42fd-b52b-eb5a255dd00b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:40.032204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:40.049061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f69c101c-df87-4aec-9269-48a78482f9e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '959b2933bd4841ea9a31ea45040ef37f', 'request_id': 'req-f69c101c-df87-4aec-9269-48a78482f9e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:40.068479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2e9f839-ecc4-42fd-b52b-eb5a255dd00b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c93bdc93ecf470d9db54b7db06cdc64'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:40.070918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f69c101c-df87-4aec-9269-48a78482f9e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '959b2933bd4841ea9a31ea45040ef37f', 'request_id': 'req-f69c101c-df87-4aec-9269-48a78482f9e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:40.079394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f69c101c-df87-4aec-9269-48a78482f9e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '959b2933bd4841ea9a31ea45040ef37f', 'request_id': 'req-f69c101c-df87-4aec-9269-48a78482f9e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:40.108316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2e9f839-ecc4-42fd-b52b-eb5a255dd00b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c93bdc93ecf470d9db54b7db06cdc64'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:40.110189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2e9f839-ecc4-42fd-b52b-eb5a255dd00b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c93bdc93ecf470d9db54b7db06cdc64'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:40.111454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2e9f839-ecc4-42fd-b52b-eb5a255dd00b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c93bdc93ecf470d9db54b7db06cdc64'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:40.112809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f69c101c-df87-4aec-9269-48a78482f9e4 admin admin] The token cache is being invalidate because project 959b2933bd4841ea9a31ea45040ef37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:40.113490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f69c101c-df87-4aec-9269-48a78482f9e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:40.115921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f69c101c-df87-4aec-9269-48a78482f9e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:40.119838 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4057/8122] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:39 2022] DELETE /identity/v3/projects/959b2933bd4841ea9a31ea45040ef37f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:40.135422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a75e3-9694-4fbd-b47f-df98440fa351 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:40.136264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a75e3-9694-4fbd-b47f-df98440fa351 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:40.137137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a75e3-9694-4fbd-b47f-df98440fa351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:40.151295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2e9f839-ecc4-42fd-b52b-eb5a255dd00b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c93bdc93ecf470d9db54b7db06cdc64'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:40.182915 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4066/8123] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:39 2022] DELETE /identity/v3/users/6c93bdc93ecf470d9db54b7db06cdc64 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:40.191765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b242-b1d0-4fd6-8295-059c6f9adeb1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:40.192958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b242-b1d0-4fd6-8295-059c6f9adeb1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:40.193380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b242-b1d0-4fd6-8295-059c6f9adeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:40.210761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-429a75e3-9694-4fbd-b47f-df98440fa351 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:40.213525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-429a75e3-9694-4fbd-b47f-df98440fa351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:40.245804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b8f8b242-b1d0-4fd6-8295-059c6f9adeb1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:40.250757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b8f8b242-b1d0-4fd6-8295-059c6f9adeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:40.366842 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4058/8124] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:40.370816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980993c-e4a1-470b-9c59-584caf618206 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:40.370816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980993c-e4a1-470b-9c59-584caf618206 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:40.370816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980993c-e4a1-470b-9c59-584caf618206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:40.412650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5980993c-e4a1-470b-9c59-584caf618206 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:40.414181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5980993c-e4a1-470b-9c59-584caf618206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:40.418630 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4067/8125] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:40.428533 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4059/8126] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:55:40.429197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8b242-b1d0-4fd6-8295-059c6f9adeb1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:40.446464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8b242-b1d0-4fd6-8295-059c6f9adeb1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:40.455615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a84401-f0ae-47cc-88e2-9e9200219692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:40.456408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a84401-f0ae-47cc-88e2-9e9200219692 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:40.456780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a84401-f0ae-47cc-88e2-9e9200219692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:40.457336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a84401-f0ae-47cc-88e2-9e9200219692 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:40.457876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a84401-f0ae-47cc-88e2-9e9200219692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:55:40.458270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a84401-f0ae-47cc-88e2-9e9200219692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:40.460331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a84401-f0ae-47cc-88e2-9e9200219692 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:40.484309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980993c-e4a1-470b-9c59-584caf618206 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:40.491029 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4068/8127] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:55:40.497296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a84401-f0ae-47cc-88e2-9e9200219692 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:40.497898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980993c-e4a1-470b-9c59-584caf618206 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:40.501178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c6a84401-f0ae-47cc-88e2-9e9200219692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:40.512784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea062aa-2098-4bcb-976a-4dfb7e4cee73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:40.513943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea062aa-2098-4bcb-976a-4dfb7e4cee73 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:40.514320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea062aa-2098-4bcb-976a-4dfb7e4cee73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:40.514710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea062aa-2098-4bcb-976a-4dfb7e4cee73 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:40.515605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea062aa-2098-4bcb-976a-4dfb7e4cee73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:40.522679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea062aa-2098-4bcb-976a-4dfb7e4cee73 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:40.529946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:40.596770 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4060/8128] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:40 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:40.601414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea062aa-2098-4bcb-976a-4dfb7e4cee73 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:40.677322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a84401-f0ae-47cc-88e2-9e9200219692 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:40.778643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea062aa-2098-4bcb-976a-4dfb7e4cee73 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:40.793988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc1fcf-2439-495e-af43-8981c9c0772f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:40.794821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc1fcf-2439-495e-af43-8981c9c0772f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:40.795196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc1fcf-2439-495e-af43-8981c9c0772f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:40.795597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc1fcf-2439-495e-af43-8981c9c0772f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:40.796401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc1fcf-2439-495e-af43-8981c9c0772f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:40.798812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc1fcf-2439-495e-af43-8981c9c0772f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:40.808715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed661f-4173-4ac5-adb8-cbe15773ed7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:40.809489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed661f-4173-4ac5-adb8-cbe15773ed7b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:40.809875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed661f-4173-4ac5-adb8-cbe15773ed7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:40.810342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed661f-4173-4ac5-adb8-cbe15773ed7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:40.828908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed661f-4173-4ac5-adb8-cbe15773ed7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:40.831531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed661f-4173-4ac5-adb8-cbe15773ed7b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:40.846541 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4061/8129] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:40 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:40.850515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc1fcf-2439-495e-af43-8981c9c0772f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:40.862775 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4069/8130] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:40.868080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc1fcf-2439-495e-af43-8981c9c0772f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:40.873722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfc5ff-55a1-40c7-89b8-7539b4e2c1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:40.874504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfc5ff-55a1-40c7-89b8-7539b4e2c1ac admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:40.874884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfc5ff-55a1-40c7-89b8-7539b4e2c1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:40.875376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfc5ff-55a1-40c7-89b8-7539b4e2c1ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:40.876192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfc5ff-55a1-40c7-89b8-7539b4e2c1ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:40.878311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfc5ff-55a1-40c7-89b8-7539b4e2c1ac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:40.896333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed661f-4173-4ac5-adb8-cbe15773ed7b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:40.903780 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4062/8131] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:40.908544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed661f-4173-4ac5-adb8-cbe15773ed7b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:40.917615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcfedd-991a-490d-8d27-82749a40e0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:40.918395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcfedd-991a-490d-8d27-82749a40e0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:40.918771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcfedd-991a-490d-8d27-82749a40e0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:40.919144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcfedd-991a-490d-8d27-82749a40e0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:40.920075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcfedd-991a-490d-8d27-82749a40e0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:40.922054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcfedd-991a-490d-8d27-82749a40e0e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:40.942433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfc5ff-55a1-40c7-89b8-7539b4e2c1ac admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:40.950857 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4070/8132] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:40.959513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfc5ff-55a1-40c7-89b8-7539b4e2c1ac admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:40.974016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577df64-6ee4-43ca-92e0-1b8b39aca88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:40.974872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577df64-6ee4-43ca-92e0-1b8b39aca88c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:40.975507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577df64-6ee4-43ca-92e0-1b8b39aca88c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:40.975891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577df64-6ee4-43ca-92e0-1b8b39aca88c admin admin] PATH_INFO: `/v3/projects/a40df86eb96248f9a6e09f3bf3873b38/users/ca53e3f74b114c9c8bf24c7d1b792300/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:41.026390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577df64-6ee4-43ca-92e0-1b8b39aca88c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40df86eb96248f9a6e09f3bf3873b38, user_id=ca53e3f74b114c9c8bf24c7d1b792300, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:41.037601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577df64-6ee4-43ca-92e0-1b8b39aca88c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:41.071297 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4063/8133] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:40 2022] PUT /identity/v3/projects/a40df86eb96248f9a6e09f3bf3873b38/users/ca53e3f74b114c9c8bf24c7d1b792300/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:55:41.084846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad285fd-78d1-40f7-90fe-9e3ba869d249 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:41.085557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad285fd-78d1-40f7-90fe-9e3ba869d249 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:41.085803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad285fd-78d1-40f7-90fe-9e3ba869d249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:41.148040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fad285fd-78d1-40f7-90fe-9e3ba869d249 None None] MFA Rules not processed for user `ca53e3f74b114c9c8bf24c7d1b792300`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:41.149413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fad285fd-78d1-40f7-90fe-9e3ba869d249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:41.308280 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4071/8134] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:41.309564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577df64-6ee4-43ca-92e0-1b8b39aca88c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:41.315753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:41.457395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577df64-6ee4-43ca-92e0-1b8b39aca88c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:41.474058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b44e6b-78df-4e37-89eb-c1bc428159e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:41.474702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b44e6b-78df-4e37-89eb-c1bc428159e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:41.474982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b44e6b-78df-4e37-89eb-c1bc428159e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:41.475279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b44e6b-78df-4e37-89eb-c1bc428159e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:41.475926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b44e6b-78df-4e37-89eb-c1bc428159e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:41.477872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b44e6b-78df-4e37-89eb-c1bc428159e4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:41.543672 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4064/8135] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:41 2022] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:41.547490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad285fd-78d1-40f7-90fe-9e3ba869d249 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:41.571333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad285fd-78d1-40f7-90fe-9e3ba869d249 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:41.666318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:41.724305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb8e19-bb49-474e-a3d9-753ad541929f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:41.726866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb8e19-bb49-474e-a3d9-753ad541929f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:41.727157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb8e19-bb49-474e-a3d9-753ad541929f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:41.727498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb8e19-bb49-474e-a3d9-753ad541929f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:41.729954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb8e19-bb49-474e-a3d9-753ad541929f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:41.736389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb8e19-bb49-474e-a3d9-753ad541929f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:41.827989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b44e6b-78df-4e37-89eb-c1bc428159e4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:41.830492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-42b44e6b-78df-4e37-89eb-c1bc428159e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:41.832444 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4072/8136] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:41 2022] POST /identity/v3/users => generated 295 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:41.835609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb8e19-bb49-474e-a3d9-753ad541929f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:41.859893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b44e6b-78df-4e37-89eb-c1bc428159e4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:41.873918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c91a44-3a63-4ebf-905b-7c7a89be9c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:41.876335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c91a44-3a63-4ebf-905b-7c7a89be9c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:41.876729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c91a44-3a63-4ebf-905b-7c7a89be9c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:41.878149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c91a44-3a63-4ebf-905b-7c7a89be9c81 admin admin] PATH_INFO: `/v3/projects/26dbc23fd7a14c8bb6ea5948ff828214` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:41.878275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb8e19-bb49-474e-a3d9-753ad541929f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:41.879920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c91a44-3a63-4ebf-905b-7c7a89be9c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26dbc23fd7a14c8bb6ea5948ff828214)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:41.886460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c91a44-3a63-4ebf-905b-7c7a89be9c81 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:41.887787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37dda3-0f8a-4e47-a6ed-ae856b6c33cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:41.889032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37dda3-0f8a-4e47-a6ed-ae856b6c33cf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:41.889032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37dda3-0f8a-4e47-a6ed-ae856b6c33cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:41.889232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37dda3-0f8a-4e47-a6ed-ae856b6c33cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:41.889712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37dda3-0f8a-4e47-a6ed-ae856b6c33cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:41.891636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37dda3-0f8a-4e47-a6ed-ae856b6c33cf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:41.916379 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4073/8137] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:41.929634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37dda3-0f8a-4e47-a6ed-ae856b6c33cf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:41.978940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37dda3-0f8a-4e47-a6ed-ae856b6c33cf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:42.001481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6c91a44-3a63-4ebf-905b-7c7a89be9c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26dbc23fd7a14c8bb6ea5948ff828214', 'request_id': 'req-a6c91a44-3a63-4ebf-905b-7c7a89be9c81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:42.021025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6c91a44-3a63-4ebf-905b-7c7a89be9c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26dbc23fd7a14c8bb6ea5948ff828214', 'request_id': 'req-a6c91a44-3a63-4ebf-905b-7c7a89be9c81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:42.037314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6c91a44-3a63-4ebf-905b-7c7a89be9c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26dbc23fd7a14c8bb6ea5948ff828214', 'request_id': 'req-a6c91a44-3a63-4ebf-905b-7c7a89be9c81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:42.066880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6c91a44-3a63-4ebf-905b-7c7a89be9c81 admin admin] The token cache is being invalidate because project 26dbc23fd7a14c8bb6ea5948ff828214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:42.067201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6c91a44-3a63-4ebf-905b-7c7a89be9c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:42.068991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6c91a44-3a63-4ebf-905b-7c7a89be9c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:42.070541 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4065/8138] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:41 2022] DELETE /identity/v3/projects/26dbc23fd7a14c8bb6ea5948ff828214 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:42.083823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef152204-1697-4629-92d8-37f6145a3a3e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:42.084171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef152204-1697-4629-92d8-37f6145a3a3e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:42.084371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef152204-1697-4629-92d8-37f6145a3a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:42.123700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a27a8-a9f8-4dbe-8e9d-b716e716410b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:42.125404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ef152204-1697-4629-92d8-37f6145a3a3e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:42.126507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a27a8-a9f8-4dbe-8e9d-b716e716410b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:42.126842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a27a8-a9f8-4dbe-8e9d-b716e716410b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:42.127339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a27a8-a9f8-4dbe-8e9d-b716e716410b admin admin] PATH_INFO: `/v3/projects/c2f1321b489345a294c09caad66a8689/users/b1aa03de8c514c0ca5d48f00fc920568/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:42.133315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef152204-1697-4629-92d8-37f6145a3a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:42.162713 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4066/8139] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:42.165146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef152204-1697-4629-92d8-37f6145a3a3e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:42.167387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef152204-1697-4629-92d8-37f6145a3a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:42.173337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a27a8-a9f8-4dbe-8e9d-b716e716410b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f1321b489345a294c09caad66a8689, user_id=b1aa03de8c514c0ca5d48f00fc920568, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:42.176052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a27a8-a9f8-4dbe-8e9d-b716e716410b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:42.206440 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4074/8140] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:41 2022] PUT /identity/v3/projects/c2f1321b489345a294c09caad66a8689/users/b1aa03de8c514c0ca5d48f00fc920568/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:42.207967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91fab5-93a2-4a05-8a32-99400467be09 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:42.208249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91fab5-93a2-4a05-8a32-99400467be09 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:42.208519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91fab5-93a2-4a05-8a32-99400467be09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:42.274140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fb91fab5-93a2-4a05-8a32-99400467be09 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:42.275473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fb91fab5-93a2-4a05-8a32-99400467be09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:42.343402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef152204-1697-4629-92d8-37f6145a3a3e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:42.350877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:42.406830 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4075/8141] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:42.408163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91fab5-93a2-4a05-8a32-99400467be09 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:42.412940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fb91fab5-93a2-4a05-8a32-99400467be09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:42.444337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91fab5-93a2-4a05-8a32-99400467be09 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:42.466426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67463d97-9426-4907-80dc-ee6084a36e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:42.467130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67463d97-9426-4907-80dc-ee6084a36e1e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:42.467437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67463d97-9426-4907-80dc-ee6084a36e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:42.467713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67463d97-9426-4907-80dc-ee6084a36e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:42.469404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67463d97-9426-4907-80dc-ee6084a36e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:42.471188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67463d97-9426-4907-80dc-ee6084a36e1e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:42.473326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5c815-3a68-437d-886a-6b305d6f992f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:42.474132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5c815-3a68-437d-886a-6b305d6f992f service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:42.474480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5c815-3a68-437d-886a-6b305d6f992f service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:42.474823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5c815-3a68-437d-886a-6b305d6f992f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:42.485117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56d5c815-3a68-437d-886a-6b305d6f992f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:42.497106 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4076/8142] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:42.497106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67463d97-9426-4907-80dc-ee6084a36e1e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:42.512372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5c815-3a68-437d-886a-6b305d6f992f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:42.514112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5c815-3a68-437d-886a-6b305d6f992f service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:42.517038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67463d97-9426-4907-80dc-ee6084a36e1e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:42.528854 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4067/8143] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:42.529862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5c815-3a68-437d-886a-6b305d6f992f service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:42.545668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5c815-3a68-437d-886a-6b305d6f992f service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:42.547991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666a3ac-8045-4ca5-b6b8-61104692d68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:42.548635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666a3ac-8045-4ca5-b6b8-61104692d68d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:42.548919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666a3ac-8045-4ca5-b6b8-61104692d68d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:42.551782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666a3ac-8045-4ca5-b6b8-61104692d68d admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:42.552524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7dc540-94d4-43c6-a9c9-9ce4274c1105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:42.554016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666a3ac-8045-4ca5-b6b8-61104692d68d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:55:42.554343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666a3ac-8045-4ca5-b6b8-61104692d68d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:42.556054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666a3ac-8045-4ca5-b6b8-61104692d68d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:42.563997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7dc540-94d4-43c6-a9c9-9ce4274c1105 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:42.564286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7dc540-94d4-43c6-a9c9-9ce4274c1105 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:42.564569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7dc540-94d4-43c6-a9c9-9ce4274c1105 admin admin] PATH_INFO: `/v3/projects/c2f1321b489345a294c09caad66a8689/users/b1aa03de8c514c0ca5d48f00fc920568/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:42.578581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7dc540-94d4-43c6-a9c9-9ce4274c1105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f1321b489345a294c09caad66a8689, user_id=b1aa03de8c514c0ca5d48f00fc920568, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:42.581395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7dc540-94d4-43c6-a9c9-9ce4274c1105 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:42.596210 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4068/8144] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:42 2022] PUT /identity/v3/projects/c2f1321b489345a294c09caad66a8689/users/b1aa03de8c514c0ca5d48f00fc920568/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:42.613600 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4077/8145] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:55:42.620682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7dc540-94d4-43c6-a9c9-9ce4274c1105 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:42.729861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1029e-bcae-45d9-8f9b-299975cd9e4a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:42.730317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1029e-bcae-45d9-8f9b-299975cd9e4a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:42.730770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1029e-bcae-45d9-8f9b-299975cd9e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:42.796344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7dc540-94d4-43c6-a9c9-9ce4274c1105 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:42.810629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc384f-f93f-48f8-a756-1bdec3637808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:42.810629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc384f-f93f-48f8-a756-1bdec3637808 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:42.810629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc384f-f93f-48f8-a756-1bdec3637808 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:42.810629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc384f-f93f-48f8-a756-1bdec3637808 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:42.810944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc384f-f93f-48f8-a756-1bdec3637808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:42.817335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc384f-f93f-48f8-a756-1bdec3637808 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:42.827632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1bc1029e-bcae-45d9-8f9b-299975cd9e4a None None] MFA Rules not processed for user `b1aa03de8c514c0ca5d48f00fc920568`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:42.828883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1bc1029e-bcae-45d9-8f9b-299975cd9e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:42.866112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:42.926082 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4069/8146] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:42 2022] POST /identity/v3/projects => generated 381 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:42.931075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc384f-f93f-48f8-a756-1bdec3637808 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:43.068594 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4078/8147] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:55:43.082485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1029e-bcae-45d9-8f9b-299975cd9e4a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:43.083953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1bc1029e-bcae-45d9-8f9b-299975cd9e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:43.198844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1029e-bcae-45d9-8f9b-299975cd9e4a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:43.255659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc384f-f93f-48f8-a756-1bdec3637808 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:43.310096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8a00a-5645-44bb-8b11-bcee6990073c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:43.312769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8a00a-5645-44bb-8b11-bcee6990073c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:43.323877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10794124-60d4-4c53-a630-87791750fd65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:43.324524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10794124-60d4-4c53-a630-87791750fd65 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:43.327573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10794124-60d4-4c53-a630-87791750fd65 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:43.327795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8a00a-5645-44bb-8b11-bcee6990073c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:43.327894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10794124-60d4-4c53-a630-87791750fd65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:43.328148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8a00a-5645-44bb-8b11-bcee6990073c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:43.329463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8a00a-5645-44bb-8b11-bcee6990073c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:43.341114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8a00a-5645-44bb-8b11-bcee6990073c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:43.396302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:43.415745 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4070/8148] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:42 2022] POST /identity/v3/users => generated 291 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:43.417671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8a00a-5645-44bb-8b11-bcee6990073c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:43.444456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8a00a-5645-44bb-8b11-bcee6990073c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:43.456306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b2d7a-dc4c-4f15-a39c-d56e11b4f43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:43.458406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b2d7a-dc4c-4f15-a39c-d56e11b4f43d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:43.459724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b2d7a-dc4c-4f15-a39c-d56e11b4f43d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:43.461552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b2d7a-dc4c-4f15-a39c-d56e11b4f43d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:43.463683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b2d7a-dc4c-4f15-a39c-d56e11b4f43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:43.471942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b2d7a-dc4c-4f15-a39c-d56e11b4f43d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:43.491692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10794124-60d4-4c53-a630-87791750fd65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:43.493719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10794124-60d4-4c53-a630-87791750fd65 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:43.496515 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4071/8149] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:43.499055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b2d7a-dc4c-4f15-a39c-d56e11b4f43d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:43.528480 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4079/8150] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:43.551365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b2d7a-dc4c-4f15-a39c-d56e11b4f43d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:43.576276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76168e11-ae3c-4a96-b999-7137d202c5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:43.577688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76168e11-ae3c-4a96-b999-7137d202c5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:43.579837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76168e11-ae3c-4a96-b999-7137d202c5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:43.581977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76168e11-ae3c-4a96-b999-7137d202c5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:43.582920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76168e11-ae3c-4a96-b999-7137d202c5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:43.587971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76168e11-ae3c-4a96-b999-7137d202c5c8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:43.612115 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4072/8151] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:43.616213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10794124-60d4-4c53-a630-87791750fd65 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:43.630573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10794124-60d4-4c53-a630-87791750fd65 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:43.648293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a27e3a-c40a-4947-921a-c8f14651f6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:43.649058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a27e3a-c40a-4947-921a-c8f14651f6c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:43.650968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a27e3a-c40a-4947-921a-c8f14651f6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:43.651604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a27e3a-c40a-4947-921a-c8f14651f6c5 admin admin] PATH_INFO: `/v3/projects/f6e9e1fc76874e12a5719d63eb971d9e/users/87b1618e8b794f36be81dd1e26b45fbc/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:43.674677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:43.684521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a27e3a-c40a-4947-921a-c8f14651f6c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e9e1fc76874e12a5719d63eb971d9e, user_id=87b1618e8b794f36be81dd1e26b45fbc, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:43.687786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a27e3a-c40a-4947-921a-c8f14651f6c5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:43.735770 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4080/8152] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:43 2022] PUT /identity/v3/projects/f6e9e1fc76874e12a5719d63eb971d9e/users/87b1618e8b794f36be81dd1e26b45fbc/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:43.737846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b856db4-c26b-4c47-a0ea-ef90cc73ebfc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:43.738424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b856db4-c26b-4c47-a0ea-ef90cc73ebfc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:43.738840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b856db4-c26b-4c47-a0ea-ef90cc73ebfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:43.802746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9b856db4-c26b-4c47-a0ea-ef90cc73ebfc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:43.807568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9b856db4-c26b-4c47-a0ea-ef90cc73ebfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:43.974014 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4073/8153] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:43.983544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a27e3a-c40a-4947-921a-c8f14651f6c5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:43.985426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c3a27e3a-c40a-4947-921a-c8f14651f6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:44.169478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a27e3a-c40a-4947-921a-c8f14651f6c5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:44.179434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340164c1-f540-4188-ab20-e2b066abbc51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:44.183745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340164c1-f540-4188-ab20-e2b066abbc51 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:44.184150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340164c1-f540-4188-ab20-e2b066abbc51 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:44.184680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340164c1-f540-4188-ab20-e2b066abbc51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:44.215965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340164c1-f540-4188-ab20-e2b066abbc51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:44.222063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340164c1-f540-4188-ab20-e2b066abbc51 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:44.267736 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4081/8154] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:44.271521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b856db4-c26b-4c47-a0ea-ef90cc73ebfc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:44.290413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b856db4-c26b-4c47-a0ea-ef90cc73ebfc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:44.310702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115645ba-d134-4982-8885-e0b154b9aa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:44.314657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115645ba-d134-4982-8885-e0b154b9aa55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:44.315981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115645ba-d134-4982-8885-e0b154b9aa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:44.316280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115645ba-d134-4982-8885-e0b154b9aa55 admin admin] PATH_INFO: `/v3/users/ca53e3f74b114c9c8bf24c7d1b792300` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:44.319740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115645ba-d134-4982-8885-e0b154b9aa55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca53e3f74b114c9c8bf24c7d1b792300)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:44.321718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115645ba-d134-4982-8885-e0b154b9aa55 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:44.435677 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-115645ba-d134-4982-8885-e0b154b9aa55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca53e3f74b114c9c8bf24c7d1b792300'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:44.436554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-115645ba-d134-4982-8885-e0b154b9aa55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca53e3f74b114c9c8bf24c7d1b792300'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:44.471766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-115645ba-d134-4982-8885-e0b154b9aa55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca53e3f74b114c9c8bf24c7d1b792300'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:44.500630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-115645ba-d134-4982-8885-e0b154b9aa55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca53e3f74b114c9c8bf24c7d1b792300'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:44.559319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-115645ba-d134-4982-8885-e0b154b9aa55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca53e3f74b114c9c8bf24c7d1b792300'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:44.572443 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4074/8155] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:44 2022] DELETE /identity/v3/users/ca53e3f74b114c9c8bf24c7d1b792300 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:44.577176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74776b50-f7fc-4656-b42f-6684c3f4c76c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:44.577467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74776b50-f7fc-4656-b42f-6684c3f4c76c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:44.577748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74776b50-f7fc-4656-b42f-6684c3f4c76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:44.634331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-74776b50-f7fc-4656-b42f-6684c3f4c76c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:44.635795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-74776b50-f7fc-4656-b42f-6684c3f4c76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:44.770429 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4082/8156] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:44.838783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115645ba-d134-4982-8885-e0b154b9aa55 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:44.841290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-115645ba-d134-4982-8885-e0b154b9aa55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:44.992372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:45.002383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115645ba-d134-4982-8885-e0b154b9aa55 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:45.011513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e4295-ac4e-4f57-a267-7c805438893a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:45.013558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e4295-ac4e-4f57-a267-7c805438893a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:45.014173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e4295-ac4e-4f57-a267-7c805438893a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:45.014755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e4295-ac4e-4f57-a267-7c805438893a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:45.031932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e4295-ac4e-4f57-a267-7c805438893a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:45.034237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e4295-ac4e-4f57-a267-7c805438893a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:45.053559 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4075/8157] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:46.634255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74776b50-f7fc-4656-b42f-6684c3f4c76c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:46.636085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-74776b50-f7fc-4656-b42f-6684c3f4c76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:46.698900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74776b50-f7fc-4656-b42f-6684c3f4c76c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:46.713648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b41fa-3e36-4679-9d96-62a84cd2bbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:46.715832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b41fa-3e36-4679-9d96-62a84cd2bbb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:46.718862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b41fa-3e36-4679-9d96-62a84cd2bbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:46.719398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b41fa-3e36-4679-9d96-62a84cd2bbb1 admin admin] PATH_INFO: `/v3/projects/a40df86eb96248f9a6e09f3bf3873b38` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:46.721715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b41fa-3e36-4679-9d96-62a84cd2bbb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40df86eb96248f9a6e09f3bf3873b38)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:46.725600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b41fa-3e36-4679-9d96-62a84cd2bbb1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:46.834143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-826b41fa-3e36-4679-9d96-62a84cd2bbb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40df86eb96248f9a6e09f3bf3873b38', 'request_id': 'req-826b41fa-3e36-4679-9d96-62a84cd2bbb1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:46.841536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-826b41fa-3e36-4679-9d96-62a84cd2bbb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40df86eb96248f9a6e09f3bf3873b38', 'request_id': 'req-826b41fa-3e36-4679-9d96-62a84cd2bbb1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:46.849199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-826b41fa-3e36-4679-9d96-62a84cd2bbb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40df86eb96248f9a6e09f3bf3873b38', 'request_id': 'req-826b41fa-3e36-4679-9d96-62a84cd2bbb1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:46.890488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-826b41fa-3e36-4679-9d96-62a84cd2bbb1 admin admin] The token cache is being invalidate because project a40df86eb96248f9a6e09f3bf3873b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:46.890957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-826b41fa-3e36-4679-9d96-62a84cd2bbb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:46.892036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-826b41fa-3e36-4679-9d96-62a84cd2bbb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:46.894601 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4083/8158] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:46 2022] DELETE /identity/v3/projects/a40df86eb96248f9a6e09f3bf3873b38 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:46.900335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e4295-ac4e-4f57-a267-7c805438893a service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:46.920912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e4295-ac4e-4f57-a267-7c805438893a service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:47.100566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaf588-8bff-49ba-b907-181532a33b23 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:47.100851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaf588-8bff-49ba-b907-181532a33b23 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:47.101127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaf588-8bff-49ba-b907-181532a33b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:47.158882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c908c-9505-48ba-92f1-678034c7908f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:47.159489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c908c-9505-48ba-92f1-678034c7908f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:47.159769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c908c-9505-48ba-92f1-678034c7908f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:47.160043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c908c-9505-48ba-92f1-678034c7908f admin admin] PATH_INFO: `/v3/users/b1aa03de8c514c0ca5d48f00fc920568` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:47.162591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c908c-9505-48ba-92f1-678034c7908f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1aa03de8c514c0ca5d48f00fc920568)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:47.164699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c908c-9505-48ba-92f1-678034c7908f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:47.175707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d6eaf588-8bff-49ba-b907-181532a33b23 None None] MFA Rules not processed for user `87b1618e8b794f36be81dd1e26b45fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:47.177742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d6eaf588-8bff-49ba-b907-181532a33b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:47.187570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:47.295966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-644c908c-9505-48ba-92f1-678034c7908f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1aa03de8c514c0ca5d48f00fc920568'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:47.296717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-644c908c-9505-48ba-92f1-678034c7908f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1aa03de8c514c0ca5d48f00fc920568'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:47.309059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-644c908c-9505-48ba-92f1-678034c7908f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1aa03de8c514c0ca5d48f00fc920568'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:47.322773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-644c908c-9505-48ba-92f1-678034c7908f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1aa03de8c514c0ca5d48f00fc920568'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:47.331074 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4084/8159] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:47.338995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaf588-8bff-49ba-b907-181532a33b23 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:47.340471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d6eaf588-8bff-49ba-b907-181532a33b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:47.344461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-644c908c-9505-48ba-92f1-678034c7908f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1aa03de8c514c0ca5d48f00fc920568'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:47.361113 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4076/8160] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:46 2022] DELETE /identity/v3/users/b1aa03de8c514c0ca5d48f00fc920568 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:47.516503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaf588-8bff-49ba-b907-181532a33b23 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:47.718970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93bb81b-3ebc-41bd-8850-24446427a296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:47.719704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bb81b-3ebc-41bd-8850-24446427a296 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:47.720023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bb81b-3ebc-41bd-8850-24446427a296 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:47.720159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bb81b-3ebc-41bd-8850-24446427a296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:47.739133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c93bb81b-3ebc-41bd-8850-24446427a296 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:47.924281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93bb81b-3ebc-41bd-8850-24446427a296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:47.925765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93bb81b-3ebc-41bd-8850-24446427a296 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:47.945611 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4085/8161] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:55:48.314953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c908c-9505-48ba-92f1-678034c7908f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:48.316718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-644c908c-9505-48ba-92f1-678034c7908f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:48.589518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d8ef5-6517-46c5-b7e8-8c7bcbcd163f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:48.589805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d8ef5-6517-46c5-b7e8-8c7bcbcd163f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:48.590086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d8ef5-6517-46c5-b7e8-8c7bcbcd163f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:48.628699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c908c-9505-48ba-92f1-678034c7908f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:48.650506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fd3d8ef5-6517-46c5-b7e8-8c7bcbcd163f None None] MFA Rules not processed for user `c2eb2f3c887947d5978d6bebd51c5b72`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:48.657117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fd3d8ef5-6517-46c5-b7e8-8c7bcbcd163f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:48.660181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277c584-4585-4b9e-b9bd-d53024973aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:48.661036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277c584-4585-4b9e-b9bd-d53024973aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:48.661459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277c584-4585-4b9e-b9bd-d53024973aee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:48.661876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277c584-4585-4b9e-b9bd-d53024973aee admin admin] PATH_INFO: `/v3/projects/c2f1321b489345a294c09caad66a8689` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:48.665049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277c584-4585-4b9e-b9bd-d53024973aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2f1321b489345a294c09caad66a8689)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:48.674467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277c584-4585-4b9e-b9bd-d53024973aee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:48.683997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:48.719466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:48.821033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a277c584-4585-4b9e-b9bd-d53024973aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2f1321b489345a294c09caad66a8689', 'request_id': 'req-a277c584-4585-4b9e-b9bd-d53024973aee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:48.839543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a277c584-4585-4b9e-b9bd-d53024973aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2f1321b489345a294c09caad66a8689', 'request_id': 'req-a277c584-4585-4b9e-b9bd-d53024973aee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:48.847885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a277c584-4585-4b9e-b9bd-d53024973aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2f1321b489345a294c09caad66a8689', 'request_id': 'req-a277c584-4585-4b9e-b9bd-d53024973aee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:48.877231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a277c584-4585-4b9e-b9bd-d53024973aee admin admin] The token cache is being invalidate because project c2f1321b489345a294c09caad66a8689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:48.877530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a277c584-4585-4b9e-b9bd-d53024973aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:48.878207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a277c584-4585-4b9e-b9bd-d53024973aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:48.883392 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4077/8162] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:48 2022] DELETE /identity/v3/projects/c2f1321b489345a294c09caad66a8689 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:48.884973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78472ce8-11a9-4a93-8f9f-7dd586aaccef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:48.885254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78472ce8-11a9-4a93-8f9f-7dd586aaccef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:48.885528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78472ce8-11a9-4a93-8f9f-7dd586aaccef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:48.887355 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4086/8163] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:48.946123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-78472ce8-11a9-4a93-8f9f-7dd586aaccef None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:48.947497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-78472ce8-11a9-4a93-8f9f-7dd586aaccef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:49.113474 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4078/8164] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:55:49.121572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184db48b-6123-44b7-b8a6-d5ff7fe26aeb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:49.121860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184db48b-6123-44b7-b8a6-d5ff7fe26aeb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:49.122139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184db48b-6123-44b7-b8a6-d5ff7fe26aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:49.180613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-184db48b-6123-44b7-b8a6-d5ff7fe26aeb None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:49.182691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-184db48b-6123-44b7-b8a6-d5ff7fe26aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:49.225428 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4087/8165] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:49.230157 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78472ce8-11a9-4a93-8f9f-7dd586aaccef None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:49.249104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78472ce8-11a9-4a93-8f9f-7dd586aaccef None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:49.270482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0ac13-e293-41ce-8720-796a867023b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:49.271139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0ac13-e293-41ce-8720-796a867023b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:49.271459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0ac13-e293-41ce-8720-796a867023b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:49.271741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0ac13-e293-41ce-8720-796a867023b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:49.272433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0ac13-e293-41ce-8720-796a867023b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:55:49.272724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0ac13-e293-41ce-8720-796a867023b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:49.279748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0ac13-e293-41ce-8720-796a867023b3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:49.318329 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4079/8166] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:55:49.326632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184db48b-6123-44b7-b8a6-d5ff7fe26aeb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:49.340357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184db48b-6123-44b7-b8a6-d5ff7fe26aeb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:49.353487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cca33-861b-469b-bdc3-8a8c5f78794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:49.354459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cca33-861b-469b-bdc3-8a8c5f78794b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:49.354917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cca33-861b-469b-bdc3-8a8c5f78794b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:49.356345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cca33-861b-469b-bdc3-8a8c5f78794b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:49.357166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cca33-861b-469b-bdc3-8a8c5f78794b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:49.360151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cca33-861b-469b-bdc3-8a8c5f78794b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:49.444123 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4088/8167] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:49 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:49.446674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0ac13-e293-41ce-8720-796a867023b3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:49.463405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0ac13-e293-41ce-8720-796a867023b3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:49.634281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d182f-00e8-4933-a9ba-96f99f56af8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:49.634916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d182f-00e8-4933-a9ba-96f99f56af8b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:49.635192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d182f-00e8-4933-a9ba-96f99f56af8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:49.639124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d182f-00e8-4933-a9ba-96f99f56af8b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:49.640003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d182f-00e8-4933-a9ba-96f99f56af8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:49.643674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d182f-00e8-4933-a9ba-96f99f56af8b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:49.691114 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4080/8168] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:49 2022] POST /identity/v3/users => generated 291 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:49.695905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cca33-861b-469b-bdc3-8a8c5f78794b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:49.716810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cca33-861b-469b-bdc3-8a8c5f78794b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:49.722818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813a6c3-a0c7-4fc5-8d31-46ba34edec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:49.724064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813a6c3-a0c7-4fc5-8d31-46ba34edec04 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:49.724597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813a6c3-a0c7-4fc5-8d31-46ba34edec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:49.725088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813a6c3-a0c7-4fc5-8d31-46ba34edec04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:49.726098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813a6c3-a0c7-4fc5-8d31-46ba34edec04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:49.729548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813a6c3-a0c7-4fc5-8d31-46ba34edec04 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:49.747845 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4089/8169] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:49.748317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d182f-00e8-4933-a9ba-96f99f56af8b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:49.766454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d182f-00e8-4933-a9ba-96f99f56af8b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:49.773513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21701717-06c5-4b35-9f24-04b0546097d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:49.775360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21701717-06c5-4b35-9f24-04b0546097d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:49.776700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21701717-06c5-4b35-9f24-04b0546097d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:49.777178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21701717-06c5-4b35-9f24-04b0546097d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:49.778395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21701717-06c5-4b35-9f24-04b0546097d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:49.781517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21701717-06c5-4b35-9f24-04b0546097d5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:49.820972 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4081/8170] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:55:49.822219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813a6c3-a0c7-4fc5-8d31-46ba34edec04 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:49.848400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813a6c3-a0c7-4fc5-8d31-46ba34edec04 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:49.869468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba0bdf-465e-4f61-b17f-1d245b0cff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:49.870048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba0bdf-465e-4f61-b17f-1d245b0cff85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:49.870330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba0bdf-465e-4f61-b17f-1d245b0cff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:49.870603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba0bdf-465e-4f61-b17f-1d245b0cff85 admin admin] PATH_INFO: `/v3/projects/c15789d520f7437aa4143b2d3b715b41/users/776e943efdc14eedb39e708acfd140b9/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:49.897688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba0bdf-465e-4f61-b17f-1d245b0cff85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15789d520f7437aa4143b2d3b715b41, user_id=776e943efdc14eedb39e708acfd140b9, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:49.900506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba0bdf-465e-4f61-b17f-1d245b0cff85 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:49.939992 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4090/8171] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:49 2022] PUT /identity/v3/projects/c15789d520f7437aa4143b2d3b715b41/users/776e943efdc14eedb39e708acfd140b9/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:49.964827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ce21b-a998-4e92-9deb-7739253dbd58 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:49.965358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ce21b-a998-4e92-9deb-7739253dbd58 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:49.965738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ce21b-a998-4e92-9deb-7739253dbd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:49.995069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:50.032682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a71ce21b-a998-4e92-9deb-7739253dbd58 None None] MFA Rules not processed for user `776e943efdc14eedb39e708acfd140b9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:50.034234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a71ce21b-a998-4e92-9deb-7739253dbd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:50.180566 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4082/8172] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:50.185660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba0bdf-465e-4f61-b17f-1d245b0cff85 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:50.332133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba0bdf-465e-4f61-b17f-1d245b0cff85 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:50.346459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b2c63-2a82-44d5-8b42-909ce4f3f4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:50.347237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b2c63-2a82-44d5-8b42-909ce4f3f4bb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:50.347661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b2c63-2a82-44d5-8b42-909ce4f3f4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:50.348045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b2c63-2a82-44d5-8b42-909ce4f3f4bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:50.348802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b2c63-2a82-44d5-8b42-909ce4f3f4bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:50.353853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b2c63-2a82-44d5-8b42-909ce4f3f4bb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:50.413726 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4091/8173] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:50 2022] POST /identity/v3/projects => generated 381 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:50.417924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ce21b-a998-4e92-9deb-7739253dbd58 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:50.433310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ce21b-a998-4e92-9deb-7739253dbd58 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:50.578198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5905834-d2d6-4ff3-b429-dc9a29054316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:50.579126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5905834-d2d6-4ff3-b429-dc9a29054316 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:50.579647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5905834-d2d6-4ff3-b429-dc9a29054316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:50.580129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5905834-d2d6-4ff3-b429-dc9a29054316 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:50.581061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5905834-d2d6-4ff3-b429-dc9a29054316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:50.583332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5905834-d2d6-4ff3-b429-dc9a29054316 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:50.616521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b2c63-2a82-44d5-8b42-909ce4f3f4bb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:50.624554 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4083/8174] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:50 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:50.631865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b2c63-2a82-44d5-8b42-909ce4f3f4bb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:50.639862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b4400-ed9c-4656-a7ca-e5850b114eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:50.640944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b4400-ed9c-4656-a7ca-e5850b114eff admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:50.641803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b4400-ed9c-4656-a7ca-e5850b114eff admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:50.642288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b4400-ed9c-4656-a7ca-e5850b114eff admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:50.643803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b4400-ed9c-4656-a7ca-e5850b114eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:50.648548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b4400-ed9c-4656-a7ca-e5850b114eff admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:50.667522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5905834-d2d6-4ff3-b429-dc9a29054316 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:50.676680 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4092/8175] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:50.686561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5905834-d2d6-4ff3-b429-dc9a29054316 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:50.704141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de91a30-4e60-42a7-9029-9eca4a9b9275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:50.705326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de91a30-4e60-42a7-9029-9eca4a9b9275 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:50.705716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de91a30-4e60-42a7-9029-9eca4a9b9275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:50.706238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de91a30-4e60-42a7-9029-9eca4a9b9275 admin admin] PATH_INFO: `/v3/projects/e7fcaa7287094350be9483e3b6bc6103/users/f66e6dab2d5d49888be2c592761460fe/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:50.731982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de91a30-4e60-42a7-9029-9eca4a9b9275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7fcaa7287094350be9483e3b6bc6103, user_id=f66e6dab2d5d49888be2c592761460fe, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:50.737659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de91a30-4e60-42a7-9029-9eca4a9b9275 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:50.772005 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4084/8176] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:50 2022] PUT /identity/v3/projects/e7fcaa7287094350be9483e3b6bc6103/users/f66e6dab2d5d49888be2c592761460fe/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:50.777096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b4400-ed9c-4656-a7ca-e5850b114eff admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:50.794688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b4400-ed9c-4656-a7ca-e5850b114eff admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:50.884258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:50.952794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04d61a-d7b7-459e-b45a-a61908a82b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:50.953767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04d61a-d7b7-459e-b45a-a61908a82b6f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:50.954056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04d61a-d7b7-459e-b45a-a61908a82b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:50.954449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04d61a-d7b7-459e-b45a-a61908a82b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:50.955119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04d61a-d7b7-459e-b45a-a61908a82b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:50.957084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04d61a-d7b7-459e-b45a-a61908a82b6f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:50.969268 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4093/8177] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:50.973272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de91a30-4e60-42a7-9029-9eca4a9b9275 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:50.990973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de91a30-4e60-42a7-9029-9eca4a9b9275 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:51.019080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776d1d1-813e-4051-8195-f3b9759e2460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:51.020176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776d1d1-813e-4051-8195-f3b9759e2460 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:51.020461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776d1d1-813e-4051-8195-f3b9759e2460 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:51.020743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776d1d1-813e-4051-8195-f3b9759e2460 admin admin] PATH_INFO: `/v3/projects/e7fcaa7287094350be9483e3b6bc6103/users/f66e6dab2d5d49888be2c592761460fe/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:51.032224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776d1d1-813e-4051-8195-f3b9759e2460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7fcaa7287094350be9483e3b6bc6103, user_id=f66e6dab2d5d49888be2c592761460fe, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:51.034946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776d1d1-813e-4051-8195-f3b9759e2460 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:51.082319 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4085/8178] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:50 2022] PUT /identity/v3/projects/e7fcaa7287094350be9483e3b6bc6103/users/f66e6dab2d5d49888be2c592761460fe/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:51.084367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5d5ef-7df6-4c8f-bff6-5be5f7fea7e2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:51.085888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5d5ef-7df6-4c8f-bff6-5be5f7fea7e2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:51.086011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5d5ef-7df6-4c8f-bff6-5be5f7fea7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:51.124535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1ed5d5ef-7df6-4c8f-bff6-5be5f7fea7e2 None None] MFA Rules not processed for user `f66e6dab2d5d49888be2c592761460fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:51.126029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1ed5d5ef-7df6-4c8f-bff6-5be5f7fea7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:51.243051 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4094/8179] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:51.254503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776d1d1-813e-4051-8195-f3b9759e2460 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:51.256384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5776d1d1-813e-4051-8195-f3b9759e2460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:51.377636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:51.382944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776d1d1-813e-4051-8195-f3b9759e2460 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:51.404255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3dc0f6-f337-4770-aa4d-feb86271f774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:51.404891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dc0f6-f337-4770-aa4d-feb86271f774 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:51.405174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dc0f6-f337-4770-aa4d-feb86271f774 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:51.405448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dc0f6-f337-4770-aa4d-feb86271f774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:51.508652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3dc0f6-f337-4770-aa4d-feb86271f774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:51.513805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3dc0f6-f337-4770-aa4d-feb86271f774 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:51.532467 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4086/8180] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:52.924521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5d5ef-7df6-4c8f-bff6-5be5f7fea7e2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:52.927641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1ed5d5ef-7df6-4c8f-bff6-5be5f7fea7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:53.007639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5d5ef-7df6-4c8f-bff6-5be5f7fea7e2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:53.012944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b75d78-ef54-4bd7-816a-a8967542d971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:53.013763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b75d78-ef54-4bd7-816a-a8967542d971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:53.014318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b75d78-ef54-4bd7-816a-a8967542d971 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:53.014737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b75d78-ef54-4bd7-816a-a8967542d971 admin admin] PATH_INFO: `/v3/users/b46929c568084a51af4e062cac3debb4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:53.016334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b75d78-ef54-4bd7-816a-a8967542d971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46929c568084a51af4e062cac3debb4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:53.018607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b75d78-ef54-4bd7-816a-a8967542d971 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:53.083157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a6b75d78-ef54-4bd7-816a-a8967542d971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46929c568084a51af4e062cac3debb4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:53.091809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:53.104120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a6b75d78-ef54-4bd7-816a-a8967542d971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46929c568084a51af4e062cac3debb4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:53.105234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a6b75d78-ef54-4bd7-816a-a8967542d971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46929c568084a51af4e062cac3debb4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:53.106123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a6b75d78-ef54-4bd7-816a-a8967542d971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46929c568084a51af4e062cac3debb4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:53.118800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a6b75d78-ef54-4bd7-816a-a8967542d971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46929c568084a51af4e062cac3debb4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:53.135442 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4095/8181] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:52 2022] DELETE /identity/v3/users/b46929c568084a51af4e062cac3debb4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:53.139668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c171-2f79-49b6-bea1-741e95ca0797 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:53.140700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c171-2f79-49b6-bea1-741e95ca0797 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:53.141261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c171-2f79-49b6-bea1-741e95ca0797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:53.164474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4294c171-2f79-49b6-bea1-741e95ca0797 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:53.166043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4294c171-2f79-49b6-bea1-741e95ca0797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:53.241262 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4087/8182] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:55:53.251814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b75d78-ef54-4bd7-816a-a8967542d971 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:53.253644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a6b75d78-ef54-4bd7-816a-a8967542d971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:53.416568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b75d78-ef54-4bd7-816a-a8967542d971 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:53.455222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3965cc-3043-4e83-ae5e-094f3ff3088b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:53.455222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3965cc-3043-4e83-ae5e-094f3ff3088b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:53.455222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3965cc-3043-4e83-ae5e-094f3ff3088b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:53.455222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3965cc-3043-4e83-ae5e-094f3ff3088b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:53.516203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3965cc-3043-4e83-ae5e-094f3ff3088b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:53.519207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3965cc-3043-4e83-ae5e-094f3ff3088b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:53.546331 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4096/8183] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:55:54.121892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294c171-2f79-49b6-bea1-741e95ca0797 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:54.123443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4294c171-2f79-49b6-bea1-741e95ca0797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:54.150990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294c171-2f79-49b6-bea1-741e95ca0797 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:54.168871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53323fa-81e5-46d2-b45a-35486d0c12f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:54.169926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53323fa-81e5-46d2-b45a-35486d0c12f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:54.170456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53323fa-81e5-46d2-b45a-35486d0c12f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:54.170947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53323fa-81e5-46d2-b45a-35486d0c12f2 admin admin] PATH_INFO: `/v3/projects/0364fdab0fec47588b4c41de49b50b24` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:54.172440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53323fa-81e5-46d2-b45a-35486d0c12f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0364fdab0fec47588b4c41de49b50b24)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:54.175386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53323fa-81e5-46d2-b45a-35486d0c12f2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:54.288645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a53323fa-81e5-46d2-b45a-35486d0c12f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0364fdab0fec47588b4c41de49b50b24', 'request_id': 'req-a53323fa-81e5-46d2-b45a-35486d0c12f2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:54.302522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a53323fa-81e5-46d2-b45a-35486d0c12f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0364fdab0fec47588b4c41de49b50b24', 'request_id': 'req-a53323fa-81e5-46d2-b45a-35486d0c12f2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:54.315088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a53323fa-81e5-46d2-b45a-35486d0c12f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0364fdab0fec47588b4c41de49b50b24', 'request_id': 'req-a53323fa-81e5-46d2-b45a-35486d0c12f2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:54.344281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a53323fa-81e5-46d2-b45a-35486d0c12f2 admin admin] The token cache is being invalidate because project 0364fdab0fec47588b4c41de49b50b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:54.344712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a53323fa-81e5-46d2-b45a-35486d0c12f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:54.345494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a53323fa-81e5-46d2-b45a-35486d0c12f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:54.349956 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4088/8184] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:54 2022] DELETE /identity/v3/projects/0364fdab0fec47588b4c41de49b50b24 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:54.351215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3965cc-3043-4e83-ae5e-094f3ff3088b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:54.365260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3965cc-3043-4e83-ae5e-094f3ff3088b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:54.487350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cf4cd-0ca3-44dc-879e-6ad96b8ca7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:54.491387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cf4cd-0ca3-44dc-879e-6ad96b8ca7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:54.491685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cf4cd-0ca3-44dc-879e-6ad96b8ca7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:54.491962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cf4cd-0ca3-44dc-879e-6ad96b8ca7b8 admin admin] PATH_INFO: `/v3/users/97f149a5599445bf956cdfb0459d9939` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:54.494285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cf4cd-0ca3-44dc-879e-6ad96b8ca7b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f149a5599445bf956cdfb0459d9939)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:54.497081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cf4cd-0ca3-44dc-879e-6ad96b8ca7b8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:54.623979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c3cf4cd-0ca3-44dc-879e-6ad96b8ca7b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f149a5599445bf956cdfb0459d9939'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:54.651028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c3cf4cd-0ca3-44dc-879e-6ad96b8ca7b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f149a5599445bf956cdfb0459d9939'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:54.651833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c3cf4cd-0ca3-44dc-879e-6ad96b8ca7b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f149a5599445bf956cdfb0459d9939'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:54.652495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c3cf4cd-0ca3-44dc-879e-6ad96b8ca7b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f149a5599445bf956cdfb0459d9939'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:54.680673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c3cf4cd-0ca3-44dc-879e-6ad96b8ca7b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f149a5599445bf956cdfb0459d9939'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:54.687280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:54.701429 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4097/8185] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:54 2022] DELETE /identity/v3/users/97f149a5599445bf956cdfb0459d9939 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:55.687079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53323fa-81e5-46d2-b45a-35486d0c12f2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:55.689300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a53323fa-81e5-46d2-b45a-35486d0c12f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:55.724450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53323fa-81e5-46d2-b45a-35486d0c12f2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:55.796477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:55.876244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961645b-6aa6-40bf-8f0b-03d7f4918d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:55.877603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961645b-6aa6-40bf-8f0b-03d7f4918d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:55.878107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961645b-6aa6-40bf-8f0b-03d7f4918d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:55.879831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961645b-6aa6-40bf-8f0b-03d7f4918d66 admin admin] PATH_INFO: `/v3/projects/0ab1722f99534e9fb270108a3cd2bb9b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:55.907166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961645b-6aa6-40bf-8f0b-03d7f4918d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab1722f99534e9fb270108a3cd2bb9b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:55.915394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961645b-6aa6-40bf-8f0b-03d7f4918d66 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:56.049130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b961645b-6aa6-40bf-8f0b-03d7f4918d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab1722f99534e9fb270108a3cd2bb9b', 'request_id': 'req-b961645b-6aa6-40bf-8f0b-03d7f4918d66'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:56.066821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b961645b-6aa6-40bf-8f0b-03d7f4918d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab1722f99534e9fb270108a3cd2bb9b', 'request_id': 'req-b961645b-6aa6-40bf-8f0b-03d7f4918d66'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:56.076850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b961645b-6aa6-40bf-8f0b-03d7f4918d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab1722f99534e9fb270108a3cd2bb9b', 'request_id': 'req-b961645b-6aa6-40bf-8f0b-03d7f4918d66'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:56.122226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b961645b-6aa6-40bf-8f0b-03d7f4918d66 admin admin] The token cache is being invalidate because project 0ab1722f99534e9fb270108a3cd2bb9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:56.123635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b961645b-6aa6-40bf-8f0b-03d7f4918d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:56.125429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b961645b-6aa6-40bf-8f0b-03d7f4918d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:56.129796 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4089/8186] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:55 2022] DELETE /identity/v3/projects/0ab1722f99534e9fb270108a3cd2bb9b => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:56.136935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fed9a-4420-425b-909e-97cf12cad5df None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:56.137463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fed9a-4420-425b-909e-97cf12cad5df None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:56.137711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fed9a-4420-425b-909e-97cf12cad5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:56.179462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-144fed9a-4420-425b-909e-97cf12cad5df None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:56.180728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-144fed9a-4420-425b-909e-97cf12cad5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:56.352831 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4098/8187] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:56.372023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f82950-d7e9-4376-8a31-0048408e5de0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:56.372403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f82950-d7e9-4376-8a31-0048408e5de0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:56.372757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f82950-d7e9-4376-8a31-0048408e5de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:56.419710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c1f82950-d7e9-4376-8a31-0048408e5de0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:56.430020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c1f82950-d7e9-4376-8a31-0048408e5de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:56.454071 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4090/8188] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:56.458972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fed9a-4420-425b-909e-97cf12cad5df None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:56.470114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fed9a-4420-425b-909e-97cf12cad5df None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:56.476297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49ad5b-0b78-45b1-ba84-e403ea67830e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:56.477190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49ad5b-0b78-45b1-ba84-e403ea67830e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:56.477469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49ad5b-0b78-45b1-ba84-e403ea67830e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:56.478389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49ad5b-0b78-45b1-ba84-e403ea67830e admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:56.479114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49ad5b-0b78-45b1-ba84-e403ea67830e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:55:56.479455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49ad5b-0b78-45b1-ba84-e403ea67830e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:56.481124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49ad5b-0b78-45b1-ba84-e403ea67830e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:56.502842 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4099/8189] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:55:56.507240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f82950-d7e9-4376-8a31-0048408e5de0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:56.518791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f82950-d7e9-4376-8a31-0048408e5de0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:56.525422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63337a60-6a16-4af0-b641-480afbfbaa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:56.526304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337a60-6a16-4af0-b641-480afbfbaa76 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:56.526790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337a60-6a16-4af0-b641-480afbfbaa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:56.527243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337a60-6a16-4af0-b641-480afbfbaa76 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:56.528101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63337a60-6a16-4af0-b641-480afbfbaa76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:56.531398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63337a60-6a16-4af0-b641-480afbfbaa76 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:56.584790 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4091/8190] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:56 2022] POST /identity/v3/projects => generated 365 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:56.586022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49ad5b-0b78-45b1-ba84-e403ea67830e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:56.601335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49ad5b-0b78-45b1-ba84-e403ea67830e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:56.673313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0c7b9-c78b-4316-b571-0cc40727f1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:56.673935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0c7b9-c78b-4316-b571-0cc40727f1bf admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:56.674212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0c7b9-c78b-4316-b571-0cc40727f1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:56.674479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0c7b9-c78b-4316-b571-0cc40727f1bf admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:56.675117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0c7b9-c78b-4316-b571-0cc40727f1bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:56.677539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0c7b9-c78b-4316-b571-0cc40727f1bf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:56.707174 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4100/8191] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:56 2022] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:56.708673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63337a60-6a16-4af0-b641-480afbfbaa76 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:56.738508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63337a60-6a16-4af0-b641-480afbfbaa76 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:56.744022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727c2bb-cf63-42f1-a2c9-6b6f351fc9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:56.744653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727c2bb-cf63-42f1-a2c9-6b6f351fc9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:56.745120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727c2bb-cf63-42f1-a2c9-6b6f351fc9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:56.745403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727c2bb-cf63-42f1-a2c9-6b6f351fc9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:56.746057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727c2bb-cf63-42f1-a2c9-6b6f351fc9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:56.747925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727c2bb-cf63-42f1-a2c9-6b6f351fc9e4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:56.760997 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4092/8192] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:56.765237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0c7b9-c78b-4316-b571-0cc40727f1bf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:56.784517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0c7b9-c78b-4316-b571-0cc40727f1bf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:56.805080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f442c2-08cd-40bb-b3fb-d6093f37be8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:56.805520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f442c2-08cd-40bb-b3fb-d6093f37be8e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:56.805818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f442c2-08cd-40bb-b3fb-d6093f37be8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:56.806095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f442c2-08cd-40bb-b3fb-d6093f37be8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:56.807208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f442c2-08cd-40bb-b3fb-d6093f37be8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:56.808882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f442c2-08cd-40bb-b3fb-d6093f37be8e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:56.834663 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4101/8193] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:56.840405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727c2bb-cf63-42f1-a2c9-6b6f351fc9e4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:56.855578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727c2bb-cf63-42f1-a2c9-6b6f351fc9e4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:56.866836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf6b5b-b257-4f49-9992-332e728af3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:56.867826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf6b5b-b257-4f49-9992-332e728af3ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:56.868293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf6b5b-b257-4f49-9992-332e728af3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:56.868744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf6b5b-b257-4f49-9992-332e728af3ee admin admin] PATH_INFO: `/v3/projects/8f4175915f7b467d90738faefa172b16/users/2c2566c12ea6411da517937433c0e465/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:56.893401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf6b5b-b257-4f49-9992-332e728af3ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4175915f7b467d90738faefa172b16, user_id=2c2566c12ea6411da517937433c0e465, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:56.896803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf6b5b-b257-4f49-9992-332e728af3ee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:56.934994 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4093/8194] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:56 2022] PUT /identity/v3/projects/8f4175915f7b467d90738faefa172b16/users/2c2566c12ea6411da517937433c0e465/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:56.945543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c77f0f-b125-474c-86af-3773ff3ade52 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:56.945859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c77f0f-b125-474c-86af-3773ff3ade52 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:56.946140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c77f0f-b125-474c-86af-3773ff3ade52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:56.985520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-87c77f0f-b125-474c-86af-3773ff3ade52 None None] MFA Rules not processed for user `2c2566c12ea6411da517937433c0e465`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:56.986734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-87c77f0f-b125-474c-86af-3773ff3ade52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:57.101783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:57.152658 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4102/8195] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:57.154405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf6b5b-b257-4f49-9992-332e728af3ee admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:57.272934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:57.294542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf6b5b-b257-4f49-9992-332e728af3ee admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:57.304332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e5d16-f714-45bd-be99-0cdc8948575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:57.305441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e5d16-f714-45bd-be99-0cdc8948575b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:57.306894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e5d16-f714-45bd-be99-0cdc8948575b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:57.307211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e5d16-f714-45bd-be99-0cdc8948575b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:57.308082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e5d16-f714-45bd-be99-0cdc8948575b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:57.310379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e5d16-f714-45bd-be99-0cdc8948575b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:57.365967 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4094/8196] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:57 2022] POST /identity/v3/projects => generated 365 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:55:57.375604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c77f0f-b125-474c-86af-3773ff3ade52 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:57.392530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c77f0f-b125-474c-86af-3773ff3ade52 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:57.534850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4aea4-672b-496d-a7f4-9f389cc0cdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:57.535630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4aea4-672b-496d-a7f4-9f389cc0cdb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:57.536008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4aea4-672b-496d-a7f4-9f389cc0cdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:57.537087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4aea4-672b-496d-a7f4-9f389cc0cdb1 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:57.537868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4aea4-672b-496d-a7f4-9f389cc0cdb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:57.541872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4aea4-672b-496d-a7f4-9f389cc0cdb1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:57.617688 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4103/8197] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:57 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:57.622577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e5d16-f714-45bd-be99-0cdc8948575b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:57.633999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e5d16-f714-45bd-be99-0cdc8948575b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:57.652297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae41120-84b1-4b23-80b9-d44dac244205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:57.652948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae41120-84b1-4b23-80b9-d44dac244205 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:57.653248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae41120-84b1-4b23-80b9-d44dac244205 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:57.653508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae41120-84b1-4b23-80b9-d44dac244205 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:57.654180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae41120-84b1-4b23-80b9-d44dac244205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:57.655968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae41120-84b1-4b23-80b9-d44dac244205 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:57.686577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4aea4-672b-496d-a7f4-9f389cc0cdb1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:57.687336 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4095/8198] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:57.703501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4aea4-672b-496d-a7f4-9f389cc0cdb1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:57.728498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a62a7-9450-433e-8038-638bd6c6798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:57.729531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a62a7-9450-433e-8038-638bd6c6798f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:57.731678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a62a7-9450-433e-8038-638bd6c6798f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:57.732347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a62a7-9450-433e-8038-638bd6c6798f admin admin] PATH_INFO: `/v3/projects/66fbe59255e548799eec97b0c86b08c7/users/0641b94163d2432da5b02ea874e94582/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:57.794665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a62a7-9450-433e-8038-638bd6c6798f admin admin] RBAC: Authorizing `identity:create_grant(project_id=66fbe59255e548799eec97b0c86b08c7, user_id=0641b94163d2432da5b02ea874e94582, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:57.810690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a62a7-9450-433e-8038-638bd6c6798f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:57.853999 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4104/8199] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:57 2022] PUT /identity/v3/projects/66fbe59255e548799eec97b0c86b08c7/users/0641b94163d2432da5b02ea874e94582/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:55:57.858240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae41120-84b1-4b23-80b9-d44dac244205 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:57.869785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae41120-84b1-4b23-80b9-d44dac244205 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:57.942036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce82a84-02cf-4f01-9b5d-b024c0826f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:57.943073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce82a84-02cf-4f01-9b5d-b024c0826f47 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:57.943810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce82a84-02cf-4f01-9b5d-b024c0826f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:57.944293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce82a84-02cf-4f01-9b5d-b024c0826f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:57.945141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce82a84-02cf-4f01-9b5d-b024c0826f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:57.946984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce82a84-02cf-4f01-9b5d-b024c0826f47 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:57.973940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a62a7-9450-433e-8038-638bd6c6798f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:57.976458 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4096/8200] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:57.987872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a62a7-9450-433e-8038-638bd6c6798f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:57.993670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889248d6-3429-40f8-99d6-255d2e827a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:57.994493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889248d6-3429-40f8-99d6-255d2e827a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:57.994872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889248d6-3429-40f8-99d6-255d2e827a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:57.995246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889248d6-3429-40f8-99d6-255d2e827a84 admin admin] PATH_INFO: `/v3/projects/66fbe59255e548799eec97b0c86b08c7/users/0641b94163d2432da5b02ea874e94582/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:57.998315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889248d6-3429-40f8-99d6-255d2e827a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66fbe59255e548799eec97b0c86b08c7, user_id=0641b94163d2432da5b02ea874e94582, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:58.001374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889248d6-3429-40f8-99d6-255d2e827a84 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:58.021585 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4105/8201] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:57 2022] PUT /identity/v3/projects/66fbe59255e548799eec97b0c86b08c7/users/0641b94163d2432da5b02ea874e94582/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:55:58.032955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313770d-0287-4142-9f0a-3f8e37a1f073 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:58.033362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313770d-0287-4142-9f0a-3f8e37a1f073 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:58.033648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313770d-0287-4142-9f0a-3f8e37a1f073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:58.109108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7313770d-0287-4142-9f0a-3f8e37a1f073 None None] MFA Rules not processed for user `0641b94163d2432da5b02ea874e94582`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:58.113830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7313770d-0287-4142-9f0a-3f8e37a1f073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:58.258649 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4097/8202] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:55:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:58.271019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889248d6-3429-40f8-99d6-255d2e827a84 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:58.272927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-889248d6-3429-40f8-99d6-255d2e827a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:58.352565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889248d6-3429-40f8-99d6-255d2e827a84 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:58.356844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b7795-234e-4e48-a2be-bb954ac2f399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:58.357478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b7795-234e-4e48-a2be-bb954ac2f399 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:58.357760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b7795-234e-4e48-a2be-bb954ac2f399 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:58.358032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b7795-234e-4e48-a2be-bb954ac2f399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:58.371314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b7795-234e-4e48-a2be-bb954ac2f399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:58.373221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b7795-234e-4e48-a2be-bb954ac2f399 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:58.387274 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4106/8203] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:58.515088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313770d-0287-4142-9f0a-3f8e37a1f073 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:58.533710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313770d-0287-4142-9f0a-3f8e37a1f073 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:58.538593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992215f-5c3e-4833-9141-3033b28c5fd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:58.539657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992215f-5c3e-4833-9141-3033b28c5fd7 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:58.541492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992215f-5c3e-4833-9141-3033b28c5fd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:58.541774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992215f-5c3e-4833-9141-3033b28c5fd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:58.623845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:58.641596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992215f-5c3e-4833-9141-3033b28c5fd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:58.643698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992215f-5c3e-4833-9141-3033b28c5fd7 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:58.658676 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4098/8204] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:05.260837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b7795-234e-4e48-a2be-bb954ac2f399 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:05.262901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d7b7795-234e-4e48-a2be-bb954ac2f399 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:05.406466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:05.468627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b7795-234e-4e48-a2be-bb954ac2f399 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:05.475765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366160d6-7740-4076-8bc4-12ef150e2ca1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:05.476894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366160d6-7740-4076-8bc4-12ef150e2ca1 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:05.477388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366160d6-7740-4076-8bc4-12ef150e2ca1 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:05.477875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366160d6-7740-4076-8bc4-12ef150e2ca1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:05.480027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-366160d6-7740-4076-8bc4-12ef150e2ca1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:05.707834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366160d6-7740-4076-8bc4-12ef150e2ca1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:05.711467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366160d6-7740-4076-8bc4-12ef150e2ca1 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:05.756918 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4107/8205] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:56:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:56:08.654873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:10.306434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992215f-5c3e-4833-9141-3033b28c5fd7 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:10.511424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992215f-5c3e-4833-9141-3033b28c5fd7 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:10.524601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66baa8cc-3f5c-4f11-b345-d355e98cb0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:10.525647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baa8cc-3f5c-4f11-b345-d355e98cb0c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:10.525981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baa8cc-3f5c-4f11-b345-d355e98cb0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:10.526398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baa8cc-3f5c-4f11-b345-d355e98cb0c7 admin admin] PATH_INFO: `/v3/users/2c2566c12ea6411da517937433c0e465` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:10.532464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66baa8cc-3f5c-4f11-b345-d355e98cb0c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c2566c12ea6411da517937433c0e465)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:10.534460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66baa8cc-3f5c-4f11-b345-d355e98cb0c7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:10.671539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66baa8cc-3f5c-4f11-b345-d355e98cb0c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2566c12ea6411da517937433c0e465'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:10.673459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66baa8cc-3f5c-4f11-b345-d355e98cb0c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2566c12ea6411da517937433c0e465'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:10.692419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66baa8cc-3f5c-4f11-b345-d355e98cb0c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2566c12ea6411da517937433c0e465'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:10.715636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66baa8cc-3f5c-4f11-b345-d355e98cb0c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2566c12ea6411da517937433c0e465'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:10.760124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66baa8cc-3f5c-4f11-b345-d355e98cb0c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2566c12ea6411da517937433c0e465'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:10.796679 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4099/8206] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:56:10 2022] DELETE /identity/v3/users/2c2566c12ea6411da517937433c0e465 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:10.799484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410deef-81ca-4afa-9c00-d22e3ef3d55d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:10.799957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410deef-81ca-4afa-9c00-d22e3ef3d55d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:10.800259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410deef-81ca-4afa-9c00-d22e3ef3d55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:10.837075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5410deef-81ca-4afa-9c00-d22e3ef3d55d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:10.843440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5410deef-81ca-4afa-9c00-d22e3ef3d55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:11.041289 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4108/8207] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:11.049339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66baa8cc-3f5c-4f11-b345-d355e98cb0c7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:11.051033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-66baa8cc-3f5c-4f11-b345-d355e98cb0c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:11.210892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66baa8cc-3f5c-4f11-b345-d355e98cb0c7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:11.232468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35cbb0-d0a0-4970-97ed-9a14337da23a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:11.233609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35cbb0-d0a0-4970-97ed-9a14337da23a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:11.233609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35cbb0-d0a0-4970-97ed-9a14337da23a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:11.233816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35cbb0-d0a0-4970-97ed-9a14337da23a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:11.280563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35cbb0-d0a0-4970-97ed-9a14337da23a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:11.282098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35cbb0-d0a0-4970-97ed-9a14337da23a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:11.316895 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4100/8208] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:11.998448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410deef-81ca-4afa-9c00-d22e3ef3d55d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:12.001477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5410deef-81ca-4afa-9c00-d22e3ef3d55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:12.019026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410deef-81ca-4afa-9c00-d22e3ef3d55d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:12.034681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86b6d8-6260-46fe-8ff1-0d537683ca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:12.035745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86b6d8-6260-46fe-8ff1-0d537683ca42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:12.036171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86b6d8-6260-46fe-8ff1-0d537683ca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:12.036610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86b6d8-6260-46fe-8ff1-0d537683ca42 admin admin] PATH_INFO: `/v3/projects/8f4175915f7b467d90738faefa172b16` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:12.038441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86b6d8-6260-46fe-8ff1-0d537683ca42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f4175915f7b467d90738faefa172b16)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:12.040799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86b6d8-6260-46fe-8ff1-0d537683ca42 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:12.187823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e86b6d8-6260-46fe-8ff1-0d537683ca42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f4175915f7b467d90738faefa172b16', 'request_id': 'req-3e86b6d8-6260-46fe-8ff1-0d537683ca42'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:12.195641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e86b6d8-6260-46fe-8ff1-0d537683ca42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f4175915f7b467d90738faefa172b16', 'request_id': 'req-3e86b6d8-6260-46fe-8ff1-0d537683ca42'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:12.220941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e86b6d8-6260-46fe-8ff1-0d537683ca42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f4175915f7b467d90738faefa172b16', 'request_id': 'req-3e86b6d8-6260-46fe-8ff1-0d537683ca42'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:12.264086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e86b6d8-6260-46fe-8ff1-0d537683ca42 admin admin] The token cache is being invalidate because project 8f4175915f7b467d90738faefa172b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:56:12.264560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e86b6d8-6260-46fe-8ff1-0d537683ca42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:12.265547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e86b6d8-6260-46fe-8ff1-0d537683ca42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:12.267771 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4109/8209] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:56:11 2022] DELETE /identity/v3/projects/8f4175915f7b467d90738faefa172b16 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:12.272040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35cbb0-d0a0-4970-97ed-9a14337da23a service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:12.291315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35cbb0-d0a0-4970-97ed-9a14337da23a service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:12.319363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:12.402967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243074d-4470-41ef-88c1-b13862ed9390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:12.405585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243074d-4470-41ef-88c1-b13862ed9390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:12.406170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243074d-4470-41ef-88c1-b13862ed9390 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:12.408451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243074d-4470-41ef-88c1-b13862ed9390 admin admin] PATH_INFO: `/v3/users/0641b94163d2432da5b02ea874e94582` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:12.425194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243074d-4470-41ef-88c1-b13862ed9390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0641b94163d2432da5b02ea874e94582)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:12.427248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243074d-4470-41ef-88c1-b13862ed9390 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:12.592903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a243074d-4470-41ef-88c1-b13862ed9390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0641b94163d2432da5b02ea874e94582'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:12.593666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a243074d-4470-41ef-88c1-b13862ed9390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0641b94163d2432da5b02ea874e94582'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:12.604763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a243074d-4470-41ef-88c1-b13862ed9390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0641b94163d2432da5b02ea874e94582'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:12.629822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a243074d-4470-41ef-88c1-b13862ed9390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0641b94163d2432da5b02ea874e94582'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:12.661737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a243074d-4470-41ef-88c1-b13862ed9390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0641b94163d2432da5b02ea874e94582'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:12.690616 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4101/8210] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:56:12 2022] DELETE /identity/v3/users/0641b94163d2432da5b02ea874e94582 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:13.923570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86b6d8-6260-46fe-8ff1-0d537683ca42 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:13.924131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3e86b6d8-6260-46fe-8ff1-0d537683ca42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:13.940858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86b6d8-6260-46fe-8ff1-0d537683ca42 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:13.952502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:14.142850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7499a57-04d4-4bce-b08e-44167bf6852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:14.145231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7499a57-04d4-4bce-b08e-44167bf6852d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:14.145816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7499a57-04d4-4bce-b08e-44167bf6852d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:14.146242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7499a57-04d4-4bce-b08e-44167bf6852d admin admin] PATH_INFO: `/v3/projects/66fbe59255e548799eec97b0c86b08c7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:14.149010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7499a57-04d4-4bce-b08e-44167bf6852d admin admin] RBAC: Authorizing `identity:delete_project(project_id=66fbe59255e548799eec97b0c86b08c7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:14.152072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7499a57-04d4-4bce-b08e-44167bf6852d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:14.307068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7499a57-04d4-4bce-b08e-44167bf6852d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66fbe59255e548799eec97b0c86b08c7', 'request_id': 'req-b7499a57-04d4-4bce-b08e-44167bf6852d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:14.325089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7499a57-04d4-4bce-b08e-44167bf6852d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66fbe59255e548799eec97b0c86b08c7', 'request_id': 'req-b7499a57-04d4-4bce-b08e-44167bf6852d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:14.342363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7499a57-04d4-4bce-b08e-44167bf6852d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66fbe59255e548799eec97b0c86b08c7', 'request_id': 'req-b7499a57-04d4-4bce-b08e-44167bf6852d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:14.374740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7499a57-04d4-4bce-b08e-44167bf6852d admin admin] The token cache is being invalidate because project 66fbe59255e548799eec97b0c86b08c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:56:14.375297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7499a57-04d4-4bce-b08e-44167bf6852d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:14.376168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7499a57-04d4-4bce-b08e-44167bf6852d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:14.382667 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4110/8211] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:56:13 2022] DELETE /identity/v3/projects/66fbe59255e548799eec97b0c86b08c7 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:14.384621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79965452-3581-4184-b04a-7f9420c32f66 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:14.385109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79965452-3581-4184-b04a-7f9420c32f66 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:14.385347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79965452-3581-4184-b04a-7f9420c32f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:14.426721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-79965452-3581-4184-b04a-7f9420c32f66 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:14.429415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79965452-3581-4184-b04a-7f9420c32f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:14.661685 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4102/8212] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:14.669559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a7f8b-0ed7-4699-a143-c78d9179b644 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:14.669838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a7f8b-0ed7-4699-a143-c78d9179b644 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:14.670121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a7f8b-0ed7-4699-a143-c78d9179b644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:14.713714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a35a7f8b-0ed7-4699-a143-c78d9179b644 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:14.715909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a35a7f8b-0ed7-4699-a143-c78d9179b644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:14.739681 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4111/8213] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:14.743774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79965452-3581-4184-b04a-7f9420c32f66 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:14.755965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79965452-3581-4184-b04a-7f9420c32f66 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:14.767789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b40e93-b5c9-40ca-96db-392fc30d7bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:14.768638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b40e93-b5c9-40ca-96db-392fc30d7bbe admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:14.769056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b40e93-b5c9-40ca-96db-392fc30d7bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:14.769304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b40e93-b5c9-40ca-96db-392fc30d7bbe admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:14.770028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b40e93-b5c9-40ca-96db-392fc30d7bbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:56:14.770391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b40e93-b5c9-40ca-96db-392fc30d7bbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:14.774886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b40e93-b5c9-40ca-96db-392fc30d7bbe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:14.802912 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4103/8214] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:56:14.807522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a7f8b-0ed7-4699-a143-c78d9179b644 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:14.827366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a7f8b-0ed7-4699-a143-c78d9179b644 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:14.833023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d49e7-4b31-4498-97de-60e7513a9f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:14.833643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d49e7-4b31-4498-97de-60e7513a9f54 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:14.833918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d49e7-4b31-4498-97de-60e7513a9f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:14.834188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d49e7-4b31-4498-97de-60e7513a9f54 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:14.834808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d49e7-4b31-4498-97de-60e7513a9f54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:14.836701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d49e7-4b31-4498-97de-60e7513a9f54 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:14.942409 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4112/8215] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:56:14 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:14.946323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b40e93-b5c9-40ca-96db-392fc30d7bbe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:14.962995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b40e93-b5c9-40ca-96db-392fc30d7bbe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:15.043196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:15.125382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bab2b-2ab6-48e5-b12e-f81f661e3eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:15.126099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bab2b-2ab6-48e5-b12e-f81f661e3eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:15.126380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bab2b-2ab6-48e5-b12e-f81f661e3eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:15.126652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bab2b-2ab6-48e5-b12e-f81f661e3eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:15.128069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bab2b-2ab6-48e5-b12e-f81f661e3eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:15.130299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bab2b-2ab6-48e5-b12e-f81f661e3eb6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:15.242131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d49e7-4b31-4498-97de-60e7513a9f54 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:15.242741 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4104/8216] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:56:14 2022] POST /identity/v3/users => generated 288 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:56:15.253645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d49e7-4b31-4498-97de-60e7513a9f54 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:15.274834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710e966-7c56-4cb2-85dc-df347172b97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:15.275897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710e966-7c56-4cb2-85dc-df347172b97e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:15.276318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710e966-7c56-4cb2-85dc-df347172b97e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:15.276720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710e966-7c56-4cb2-85dc-df347172b97e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:15.277515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710e966-7c56-4cb2-85dc-df347172b97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:15.279331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710e966-7c56-4cb2-85dc-df347172b97e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:15.303308 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4113/8217] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:15.308995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bab2b-2ab6-48e5-b12e-f81f661e3eb6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:15.323674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bab2b-2ab6-48e5-b12e-f81f661e3eb6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:15.345907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b7a2f-c737-465e-9a61-a6e111c9ef9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:15.346557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b7a2f-c737-465e-9a61-a6e111c9ef9a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:15.346837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b7a2f-c737-465e-9a61-a6e111c9ef9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:15.347112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b7a2f-c737-465e-9a61-a6e111c9ef9a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:15.347848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b7a2f-c737-465e-9a61-a6e111c9ef9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:15.352086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b7a2f-c737-465e-9a61-a6e111c9ef9a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:15.386531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710e966-7c56-4cb2-85dc-df347172b97e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:15.393864 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4105/8218] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:56:15.407923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710e966-7c56-4cb2-85dc-df347172b97e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:15.426877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb2fb1-ffe7-4c70-8f4d-676a021eb3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:15.432438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb2fb1-ffe7-4c70-8f4d-676a021eb3d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:15.435478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb2fb1-ffe7-4c70-8f4d-676a021eb3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:15.435780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb2fb1-ffe7-4c70-8f4d-676a021eb3d0 admin admin] PATH_INFO: `/v3/projects/f24536b9a2694befb741534c20f1e7ff/users/5c19aa9f572a46fd9a509b23990f1986/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:15.498726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb2fb1-ffe7-4c70-8f4d-676a021eb3d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f24536b9a2694befb741534c20f1e7ff, user_id=5c19aa9f572a46fd9a509b23990f1986, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:15.506781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb2fb1-ffe7-4c70-8f4d-676a021eb3d0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:15.551818 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4114/8219] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:56:15 2022] PUT /identity/v3/projects/f24536b9a2694befb741534c20f1e7ff/users/5c19aa9f572a46fd9a509b23990f1986/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:56:15.564212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd81a4-f321-4799-9b2a-4fba917a47d7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:15.564708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd81a4-f321-4799-9b2a-4fba917a47d7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:15.565160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd81a4-f321-4799-9b2a-4fba917a47d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:15.679575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d7dd81a4-f321-4799-9b2a-4fba917a47d7 None None] MFA Rules not processed for user `5c19aa9f572a46fd9a509b23990f1986`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:15.689590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d7dd81a4-f321-4799-9b2a-4fba917a47d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:15.913881 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4106/8220] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:15.921988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb2fb1-ffe7-4c70-8f4d-676a021eb3d0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:15.924368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-55cb2fb1-ffe7-4c70-8f4d-676a021eb3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:16.014362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:16.067048 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb2fb1-ffe7-4c70-8f4d-676a021eb3d0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:16.079309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2762294-bffb-4639-9661-56a7e01a59ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:16.080197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2762294-bffb-4639-9661-56a7e01a59ea service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:16.081881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2762294-bffb-4639-9661-56a7e01a59ea service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:16.086424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2762294-bffb-4639-9661-56a7e01a59ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:16.107349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2762294-bffb-4639-9661-56a7e01a59ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:16.109230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2762294-bffb-4639-9661-56a7e01a59ea service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:16.135582 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4115/8221] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:22.363912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd81a4-f321-4799-9b2a-4fba917a47d7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:22.366094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d7dd81a4-f321-4799-9b2a-4fba917a47d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:22.557714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd81a4-f321-4799-9b2a-4fba917a47d7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:22.576776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d7a0a-0a23-4284-bf9b-a1225f297e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:22.577429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d7a0a-0a23-4284-bf9b-a1225f297e25 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:22.577957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d7a0a-0a23-4284-bf9b-a1225f297e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:22.578239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d7a0a-0a23-4284-bf9b-a1225f297e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:22.580433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d2d7a0a-0a23-4284-bf9b-a1225f297e25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:22.675542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:22.689917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d7a0a-0a23-4284-bf9b-a1225f297e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:22.691841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d7a0a-0a23-4284-bf9b-a1225f297e25 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:22.703440 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4107/8222] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:22.911407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2762294-bffb-4639-9661-56a7e01a59ea service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:22.913541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b2762294-bffb-4639-9661-56a7e01a59ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:23.043026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2762294-bffb-4639-9661-56a7e01a59ea service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:23.051517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cb43f-dc0d-47a5-8ed3-bf155d396111 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:23.052625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cb43f-dc0d-47a5-8ed3-bf155d396111 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:23.053217 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cb43f-dc0d-47a5-8ed3-bf155d396111 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:23.053959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cb43f-dc0d-47a5-8ed3-bf155d396111 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:23.058676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-647cb43f-dc0d-47a5-8ed3-bf155d396111 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:23.232981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647cb43f-dc0d-47a5-8ed3-bf155d396111 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:23.236679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647cb43f-dc0d-47a5-8ed3-bf155d396111 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:23.256345 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4116/8223] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:56:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:56:26.224448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d7a0a-0a23-4284-bf9b-a1225f297e25 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:26.374685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d7a0a-0a23-4284-bf9b-a1225f297e25 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:26.380897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5014a03-1b5b-4ba6-a976-8b117bb8328f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:26.381561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5014a03-1b5b-4ba6-a976-8b117bb8328f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:26.381838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5014a03-1b5b-4ba6-a976-8b117bb8328f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:26.382108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5014a03-1b5b-4ba6-a976-8b117bb8328f admin admin] PATH_INFO: `/v3/users/5c19aa9f572a46fd9a509b23990f1986` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:26.391197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5014a03-1b5b-4ba6-a976-8b117bb8328f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c19aa9f572a46fd9a509b23990f1986)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:26.393441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5014a03-1b5b-4ba6-a976-8b117bb8328f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:26.558626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5014a03-1b5b-4ba6-a976-8b117bb8328f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c19aa9f572a46fd9a509b23990f1986'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:26.559929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5014a03-1b5b-4ba6-a976-8b117bb8328f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c19aa9f572a46fd9a509b23990f1986'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:26.577375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5014a03-1b5b-4ba6-a976-8b117bb8328f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c19aa9f572a46fd9a509b23990f1986'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:26.590187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5014a03-1b5b-4ba6-a976-8b117bb8328f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c19aa9f572a46fd9a509b23990f1986'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:26.622037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5014a03-1b5b-4ba6-a976-8b117bb8328f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c19aa9f572a46fd9a509b23990f1986'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:26.678501 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4108/8224] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:56:26 2022] DELETE /identity/v3/users/5c19aa9f572a46fd9a509b23990f1986 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:26.680445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cc2ff-6e9a-471c-bc81-be92fe94b727 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:26.681222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cc2ff-6e9a-471c-bc81-be92fe94b727 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:26.681222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cc2ff-6e9a-471c-bc81-be92fe94b727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:26.735574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-184cc2ff-6e9a-471c-bc81-be92fe94b727 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:26.744711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-184cc2ff-6e9a-471c-bc81-be92fe94b727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:26.905072 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4117/8225] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:26.912738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5014a03-1b5b-4ba6-a976-8b117bb8328f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:26.916627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5014a03-1b5b-4ba6-a976-8b117bb8328f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:27.086362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5014a03-1b5b-4ba6-a976-8b117bb8328f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:27.096005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c32e46-5c97-4478-b734-a20e05e286af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:27.096813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c32e46-5c97-4478-b734-a20e05e286af service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:27.097250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c32e46-5c97-4478-b734-a20e05e286af service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:27.097668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c32e46-5c97-4478-b734-a20e05e286af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:27.118035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c32e46-5c97-4478-b734-a20e05e286af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:27.119914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c32e46-5c97-4478-b734-a20e05e286af service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:27.144463 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4109/8226] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:27.677510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cc2ff-6e9a-471c-bc81-be92fe94b727 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:27.679704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-184cc2ff-6e9a-471c-bc81-be92fe94b727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:27.731968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cc2ff-6e9a-471c-bc81-be92fe94b727 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:27.744105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7570bb-fbf0-4f3c-98dd-98ab609849a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:27.744791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7570bb-fbf0-4f3c-98dd-98ab609849a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:27.745330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7570bb-fbf0-4f3c-98dd-98ab609849a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:27.745617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7570bb-fbf0-4f3c-98dd-98ab609849a4 admin admin] PATH_INFO: `/v3/projects/f24536b9a2694befb741534c20f1e7ff` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:27.768461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7570bb-fbf0-4f3c-98dd-98ab609849a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f24536b9a2694befb741534c20f1e7ff)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:27.772458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7570bb-fbf0-4f3c-98dd-98ab609849a4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:27.800423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:27.873891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db7570bb-fbf0-4f3c-98dd-98ab609849a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f24536b9a2694befb741534c20f1e7ff', 'request_id': 'req-db7570bb-fbf0-4f3c-98dd-98ab609849a4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:27.881255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db7570bb-fbf0-4f3c-98dd-98ab609849a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f24536b9a2694befb741534c20f1e7ff', 'request_id': 'req-db7570bb-fbf0-4f3c-98dd-98ab609849a4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:27.888874 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db7570bb-fbf0-4f3c-98dd-98ab609849a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f24536b9a2694befb741534c20f1e7ff', 'request_id': 'req-db7570bb-fbf0-4f3c-98dd-98ab609849a4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:27.910770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db7570bb-fbf0-4f3c-98dd-98ab609849a4 admin admin] The token cache is being invalidate because project f24536b9a2694befb741534c20f1e7ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:56:27.911111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db7570bb-fbf0-4f3c-98dd-98ab609849a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:27.918313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db7570bb-fbf0-4f3c-98dd-98ab609849a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:27.926180 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4118/8227] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:56:27 2022] DELETE /identity/v3/projects/f24536b9a2694befb741534c20f1e7ff => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:27.930404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315f5c4-02f8-4d2d-99e0-2cb2bf09d7ae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:27.930404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315f5c4-02f8-4d2d-99e0-2cb2bf09d7ae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:27.930404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315f5c4-02f8-4d2d-99e0-2cb2bf09d7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:27.999178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8315f5c4-02f8-4d2d-99e0-2cb2bf09d7ae None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:28.000663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8315f5c4-02f8-4d2d-99e0-2cb2bf09d7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:28.023921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:28.120175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ac48-6c4d-4d7d-951e-5a8e2d4e961a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:28.120487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ac48-6c4d-4d7d-951e-5a8e2d4e961a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:28.120587 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4110/8228] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:28.120766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ac48-6c4d-4d7d-951e-5a8e2d4e961a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:28.141597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ef99ac48-6c4d-4d7d-951e-5a8e2d4e961a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:28.142885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ef99ac48-6c4d-4d7d-951e-5a8e2d4e961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:28.151988 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4119/8229] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:56:28.156477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315f5c4-02f8-4d2d-99e0-2cb2bf09d7ae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:28.181886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315f5c4-02f8-4d2d-99e0-2cb2bf09d7ae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:28.193017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d0ccb-4f2a-4cb9-a15d-7606a8c1e7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:28.193761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d0ccb-4f2a-4cb9-a15d-7606a8c1e7ed admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:28.194285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d0ccb-4f2a-4cb9-a15d-7606a8c1e7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:28.194656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d0ccb-4f2a-4cb9-a15d-7606a8c1e7ed admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:28.195466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d0ccb-4f2a-4cb9-a15d-7606a8c1e7ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:56:28.195992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d0ccb-4f2a-4cb9-a15d-7606a8c1e7ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:28.197757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d0ccb-4f2a-4cb9-a15d-7606a8c1e7ed admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:28.220016 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4111/8230] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:56:28.221497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ac48-6c4d-4d7d-951e-5a8e2d4e961a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:28.236471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ac48-6c4d-4d7d-951e-5a8e2d4e961a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:28.244128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9712da-6d3e-4397-9ee8-b9d8e31169cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:28.244753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9712da-6d3e-4397-9ee8-b9d8e31169cd admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:28.245158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9712da-6d3e-4397-9ee8-b9d8e31169cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:28.245502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9712da-6d3e-4397-9ee8-b9d8e31169cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:28.246193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9712da-6d3e-4397-9ee8-b9d8e31169cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:28.250115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9712da-6d3e-4397-9ee8-b9d8e31169cd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:28.304071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d0ccb-4f2a-4cb9-a15d-7606a8c1e7ed admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:28.311782 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4120/8231] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:56:28 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:28.325450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d0ccb-4f2a-4cb9-a15d-7606a8c1e7ed admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:28.428920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729662ee-703d-4f3b-9184-76cc452fcd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:28.429641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729662ee-703d-4f3b-9184-76cc452fcd85 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:28.429921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729662ee-703d-4f3b-9184-76cc452fcd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:28.430194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729662ee-703d-4f3b-9184-76cc452fcd85 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:28.431156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729662ee-703d-4f3b-9184-76cc452fcd85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:28.435286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729662ee-703d-4f3b-9184-76cc452fcd85 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:28.490077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9712da-6d3e-4397-9ee8-b9d8e31169cd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:28.496593 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4112/8232] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:56:28 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:28.512542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9712da-6d3e-4397-9ee8-b9d8e31169cd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:28.528330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050a5b5-ba19-4aeb-a5c7-b4a30cd5431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:28.529632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050a5b5-ba19-4aeb-a5c7-b4a30cd5431a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:28.529989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050a5b5-ba19-4aeb-a5c7-b4a30cd5431a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:28.530652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050a5b5-ba19-4aeb-a5c7-b4a30cd5431a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:28.532012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050a5b5-ba19-4aeb-a5c7-b4a30cd5431a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:28.533936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050a5b5-ba19-4aeb-a5c7-b4a30cd5431a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:28.581218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729662ee-703d-4f3b-9184-76cc452fcd85 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:28.586917 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4121/8233] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:28.594090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729662ee-703d-4f3b-9184-76cc452fcd85 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:28.615488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5eabea-7560-4010-a1d7-b7505b828a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:28.616259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5eabea-7560-4010-a1d7-b7505b828a00 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:28.616619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5eabea-7560-4010-a1d7-b7505b828a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:28.616972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5eabea-7560-4010-a1d7-b7505b828a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:28.617719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5eabea-7560-4010-a1d7-b7505b828a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:28.619515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5eabea-7560-4010-a1d7-b7505b828a00 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:28.646641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050a5b5-ba19-4aeb-a5c7-b4a30cd5431a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:28.647096 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4113/8234] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:56:28.670716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050a5b5-ba19-4aeb-a5c7-b4a30cd5431a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:28.680989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2ad1a-3ad4-4ad4-85da-459e1dfb8c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:28.684022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2ad1a-3ad4-4ad4-85da-459e1dfb8c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:28.684362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2ad1a-3ad4-4ad4-85da-459e1dfb8c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:28.689844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2ad1a-3ad4-4ad4-85da-459e1dfb8c10 admin admin] PATH_INFO: `/v3/projects/7c6100296ad14ace84397a924069b005/users/b5ea65462d47423cbe08b676b6c645ec/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:28.715088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2ad1a-3ad4-4ad4-85da-459e1dfb8c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6100296ad14ace84397a924069b005, user_id=b5ea65462d47423cbe08b676b6c645ec, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:28.718041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2ad1a-3ad4-4ad4-85da-459e1dfb8c10 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:28.753055 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4122/8235] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:56:28 2022] PUT /identity/v3/projects/7c6100296ad14ace84397a924069b005/users/b5ea65462d47423cbe08b676b6c645ec/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:56:28.765142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7389a-08cd-4bc1-b6c4-4cb1ee247cf2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:28.765930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7389a-08cd-4bc1-b6c4-4cb1ee247cf2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:28.766302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7389a-08cd-4bc1-b6c4-4cb1ee247cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:28.826712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7fb7389a-08cd-4bc1-b6c4-4cb1ee247cf2 None None] MFA Rules not processed for user `b5ea65462d47423cbe08b676b6c645ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:28.828069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7fb7389a-08cd-4bc1-b6c4-4cb1ee247cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:28.979562 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4114/8236] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:28.983918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2ad1a-3ad4-4ad4-85da-459e1dfb8c10 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:29.059519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2ad1a-3ad4-4ad4-85da-459e1dfb8c10 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:29.065175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0b23a-e256-405e-b364-1b747e6e9c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:29.065926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0b23a-e256-405e-b364-1b747e6e9c65 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:29.066308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0b23a-e256-405e-b364-1b747e6e9c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:29.066814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0b23a-e256-405e-b364-1b747e6e9c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:29.067706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0b23a-e256-405e-b364-1b747e6e9c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:29.070338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0b23a-e256-405e-b364-1b747e6e9c65 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:29.109007 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4123/8237] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:56:28 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:56:29.110172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7389a-08cd-4bc1-b6c4-4cb1ee247cf2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:29.126581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7389a-08cd-4bc1-b6c4-4cb1ee247cf2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:29.133583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:29.232568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff1ec8-5b50-4dd6-8328-72daa2a9eec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:29.234107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff1ec8-5b50-4dd6-8328-72daa2a9eec7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:29.234461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff1ec8-5b50-4dd6-8328-72daa2a9eec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:29.234811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff1ec8-5b50-4dd6-8328-72daa2a9eec7 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:29.235591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff1ec8-5b50-4dd6-8328-72daa2a9eec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:29.238052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff1ec8-5b50-4dd6-8328-72daa2a9eec7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:29.279916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0b23a-e256-405e-b364-1b747e6e9c65 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:29.293961 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4115/8238] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:56:29 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:29.327211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0b23a-e256-405e-b364-1b747e6e9c65 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:29.354702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b8667-2a56-42b7-adb9-531ce4b73a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:29.355731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b8667-2a56-42b7-adb9-531ce4b73a64 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:29.356224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b8667-2a56-42b7-adb9-531ce4b73a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:29.356688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b8667-2a56-42b7-adb9-531ce4b73a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:29.357614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b8667-2a56-42b7-adb9-531ce4b73a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:29.359567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b8667-2a56-42b7-adb9-531ce4b73a64 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:29.377714 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4124/8239] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:29.379505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff1ec8-5b50-4dd6-8328-72daa2a9eec7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:29.391593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff1ec8-5b50-4dd6-8328-72daa2a9eec7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:29.396829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571916b-b1d9-4be0-b7d7-fa062c5be27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:29.397871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571916b-b1d9-4be0-b7d7-fa062c5be27d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:29.398161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571916b-b1d9-4be0-b7d7-fa062c5be27d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:29.398436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571916b-b1d9-4be0-b7d7-fa062c5be27d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:29.399393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571916b-b1d9-4be0-b7d7-fa062c5be27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:29.401138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571916b-b1d9-4be0-b7d7-fa062c5be27d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:29.417986 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4116/8240] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:29.418812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b8667-2a56-42b7-adb9-531ce4b73a64 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:29.433441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b8667-2a56-42b7-adb9-531ce4b73a64 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:29.440112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab67e4-fc76-4420-8bbe-74cc942a8152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:29.440873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab67e4-fc76-4420-8bbe-74cc942a8152 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:29.441243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab67e4-fc76-4420-8bbe-74cc942a8152 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:29.441601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab67e4-fc76-4420-8bbe-74cc942a8152 admin admin] PATH_INFO: `/v3/projects/7d5d6e20be4842979027500de2be983e/users/6a5ee499930d4d43ad577a879c52a7a4/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:29.458149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:29.459933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab67e4-fc76-4420-8bbe-74cc942a8152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5d6e20be4842979027500de2be983e, user_id=6a5ee499930d4d43ad577a879c52a7a4, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:29.462552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab67e4-fc76-4420-8bbe-74cc942a8152 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:29.486542 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4125/8241] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:56:29 2022] PUT /identity/v3/projects/7d5d6e20be4842979027500de2be983e/users/6a5ee499930d4d43ad577a879c52a7a4/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:56:29.496140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeec836-ca97-44a0-a086-6e8ee55d1192 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:29.496579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeec836-ca97-44a0-a086-6e8ee55d1192 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:29.497584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeec836-ca97-44a0-a086-6e8ee55d1192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:29.554990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6aeec836-ca97-44a0-a086-6e8ee55d1192 None None] MFA Rules not processed for user `6a5ee499930d4d43ad577a879c52a7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:29.558714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6aeec836-ca97-44a0-a086-6e8ee55d1192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:29.696088 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4117/8242] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:56:29.715733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab67e4-fc76-4420-8bbe-74cc942a8152 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:29.856794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab67e4-fc76-4420-8bbe-74cc942a8152 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:29.863366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6c76b-a32b-42e2-9ba4-2f6bbaf7872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:29.864206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6c76b-a32b-42e2-9ba4-2f6bbaf7872e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:29.864697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6c76b-a32b-42e2-9ba4-2f6bbaf7872e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:29.865148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6c76b-a32b-42e2-9ba4-2f6bbaf7872e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:29.865971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6c76b-a32b-42e2-9ba4-2f6bbaf7872e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:29.868214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6c76b-a32b-42e2-9ba4-2f6bbaf7872e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:29.923958 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4126/8243] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:56:29 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:29.926880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeec836-ca97-44a0-a086-6e8ee55d1192 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:29.946178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeec836-ca97-44a0-a086-6e8ee55d1192 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:30.073598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93f4bf-77ae-49e7-aa1f-70743cff77cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:30.074264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93f4bf-77ae-49e7-aa1f-70743cff77cd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:30.074507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93f4bf-77ae-49e7-aa1f-70743cff77cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:30.074785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93f4bf-77ae-49e7-aa1f-70743cff77cd admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:30.076172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93f4bf-77ae-49e7-aa1f-70743cff77cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:30.078615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93f4bf-77ae-49e7-aa1f-70743cff77cd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:30.117298 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4118/8244] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:56:29 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:30.118325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6c76b-a32b-42e2-9ba4-2f6bbaf7872e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:30.132579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6c76b-a32b-42e2-9ba4-2f6bbaf7872e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:30.138732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dd8ca-323c-4936-af90-b89ca393f4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:30.140014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dd8ca-323c-4936-af90-b89ca393f4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:30.140302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dd8ca-323c-4936-af90-b89ca393f4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:30.140583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dd8ca-323c-4936-af90-b89ca393f4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:30.141400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dd8ca-323c-4936-af90-b89ca393f4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:30.143045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dd8ca-323c-4936-af90-b89ca393f4a0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:30.164209 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4127/8245] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:56:30.166178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93f4bf-77ae-49e7-aa1f-70743cff77cd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:30.189344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93f4bf-77ae-49e7-aa1f-70743cff77cd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:30.194612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011078b7-4031-42ef-8b1c-2325fbf11325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:30.195094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011078b7-4031-42ef-8b1c-2325fbf11325 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:30.195429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011078b7-4031-42ef-8b1c-2325fbf11325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:30.195707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011078b7-4031-42ef-8b1c-2325fbf11325 admin admin] PATH_INFO: `/v3/projects/e10fa183ba8c4a0bbe1cb4c6fee887f6/users/797d9693552d49c4902b936822949c0d/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:30.198319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:30.220482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011078b7-4031-42ef-8b1c-2325fbf11325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10fa183ba8c4a0bbe1cb4c6fee887f6, user_id=797d9693552d49c4902b936822949c0d, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:30.223590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011078b7-4031-42ef-8b1c-2325fbf11325 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:30.273417 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4119/8246] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:56:30 2022] PUT /identity/v3/projects/e10fa183ba8c4a0bbe1cb4c6fee887f6/users/797d9693552d49c4902b936822949c0d/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:30.274621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dd8ca-323c-4936-af90-b89ca393f4a0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:30.285446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dd8ca-323c-4936-af90-b89ca393f4a0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:30.428140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7081c34-efb3-485b-b76f-d562bf8b3d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:30.428766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7081c34-efb3-485b-b76f-d562bf8b3d99 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:30.429097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7081c34-efb3-485b-b76f-d562bf8b3d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:30.429819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7081c34-efb3-485b-b76f-d562bf8b3d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:30.430029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7081c34-efb3-485b-b76f-d562bf8b3d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:30.433830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7081c34-efb3-485b-b76f-d562bf8b3d99 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:30.454834 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4128/8247] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:30.459153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011078b7-4031-42ef-8b1c-2325fbf11325 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:30.478606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011078b7-4031-42ef-8b1c-2325fbf11325 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:30.485030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd6d67-6851-4e35-97be-d4662fb44c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:30.485448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd6d67-6851-4e35-97be-d4662fb44c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:30.488941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd6d67-6851-4e35-97be-d4662fb44c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:30.489354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd6d67-6851-4e35-97be-d4662fb44c28 admin admin] PATH_INFO: `/v3/projects/e10fa183ba8c4a0bbe1cb4c6fee887f6/users/797d9693552d49c4902b936822949c0d/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:30.492049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd6d67-6851-4e35-97be-d4662fb44c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10fa183ba8c4a0bbe1cb4c6fee887f6, user_id=797d9693552d49c4902b936822949c0d, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:30.495236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd6d67-6851-4e35-97be-d4662fb44c28 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:30.551676 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4120/8248] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:56:30 2022] PUT /identity/v3/projects/e10fa183ba8c4a0bbe1cb4c6fee887f6/users/797d9693552d49c4902b936822949c0d/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:30.559312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895492f4-42e6-4e01-9cf9-bd7c8abee160 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:30.559312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895492f4-42e6-4e01-9cf9-bd7c8abee160 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:30.559312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895492f4-42e6-4e01-9cf9-bd7c8abee160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:30.592331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-895492f4-42e6-4e01-9cf9-bd7c8abee160 None None] MFA Rules not processed for user `797d9693552d49c4902b936822949c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:30.593932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-895492f4-42e6-4e01-9cf9-bd7c8abee160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:30.683807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:30.730362 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4129/8249] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:56:30.751707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd6d67-6851-4e35-97be-d4662fb44c28 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:30.754495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e6bd6d67-6851-4e35-97be-d4662fb44c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:30.880908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd6d67-6851-4e35-97be-d4662fb44c28 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:30.887467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91685f92-1ae2-4833-b536-d175ebfba0c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:30.888011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91685f92-1ae2-4833-b536-d175ebfba0c3 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:30.888327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91685f92-1ae2-4833-b536-d175ebfba0c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:30.888601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91685f92-1ae2-4833-b536-d175ebfba0c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:30.990528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91685f92-1ae2-4833-b536-d175ebfba0c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:30.992187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91685f92-1ae2-4833-b536-d175ebfba0c3 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:31.002464 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4121/8250] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:34.052712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895492f4-42e6-4e01-9cf9-bd7c8abee160 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:34.054319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-895492f4-42e6-4e01-9cf9-bd7c8abee160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:34.098613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895492f4-42e6-4e01-9cf9-bd7c8abee160 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:34.112319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b866a-c08b-4b23-9b68-2179a1fd7e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:34.113252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b866a-c08b-4b23-9b68-2179a1fd7e16 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:34.113976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b866a-c08b-4b23-9b68-2179a1fd7e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:34.114661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b866a-c08b-4b23-9b68-2179a1fd7e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:34.228386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b866a-c08b-4b23-9b68-2179a1fd7e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:34.230277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b866a-c08b-4b23-9b68-2179a1fd7e16 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:34.302466 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4130/8251] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:56:35.405053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91685f92-1ae2-4833-b536-d175ebfba0c3 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:35.418917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91685f92-1ae2-4833-b536-d175ebfba0c3 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:35.423007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88365e-1c57-4b30-83d1-5341508eaf9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:35.424447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88365e-1c57-4b30-83d1-5341508eaf9d service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:35.424879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88365e-1c57-4b30-83d1-5341508eaf9d service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:35.425898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88365e-1c57-4b30-83d1-5341508eaf9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:35.440835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88365e-1c57-4b30-83d1-5341508eaf9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:35.442543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88365e-1c57-4b30-83d1-5341508eaf9d service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:35.455606 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4122/8252] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:37.224360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b866a-c08b-4b23-9b68-2179a1fd7e16 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:37.226015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-395b866a-c08b-4b23-9b68-2179a1fd7e16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:37.385329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b866a-c08b-4b23-9b68-2179a1fd7e16 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:37.392299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130307b7-a753-422c-971c-ab2a6073b237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:37.393246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130307b7-a753-422c-971c-ab2a6073b237 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:37.393702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130307b7-a753-422c-971c-ab2a6073b237 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:37.394064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130307b7-a753-422c-971c-ab2a6073b237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:37.396119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-130307b7-a753-422c-971c-ab2a6073b237 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:37.475808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130307b7-a753-422c-971c-ab2a6073b237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:37.477699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130307b7-a753-422c-971c-ab2a6073b237 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:37.491341 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4131/8253] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:45.450347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=66,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:45.891689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88365e-1c57-4b30-83d1-5341508eaf9d service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:46.008936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88365e-1c57-4b30-83d1-5341508eaf9d service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:46.016542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba93efa-302e-43d3-94f5-8a20d2f760d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:46.017905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93efa-302e-43d3-94f5-8a20d2f760d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:46.018405 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93efa-302e-43d3-94f5-8a20d2f760d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:46.019110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93efa-302e-43d3-94f5-8a20d2f760d8 admin admin] PATH_INFO: `/v3/users/b5ea65462d47423cbe08b676b6c645ec` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:46.022019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba93efa-302e-43d3-94f5-8a20d2f760d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5ea65462d47423cbe08b676b6c645ec)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:46.024996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba93efa-302e-43d3-94f5-8a20d2f760d8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:46.102332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ba93efa-302e-43d3-94f5-8a20d2f760d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ea65462d47423cbe08b676b6c645ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:46.103184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ba93efa-302e-43d3-94f5-8a20d2f760d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ea65462d47423cbe08b676b6c645ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:46.112553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ba93efa-302e-43d3-94f5-8a20d2f760d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ea65462d47423cbe08b676b6c645ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:46.124829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ba93efa-302e-43d3-94f5-8a20d2f760d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ea65462d47423cbe08b676b6c645ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:46.144104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ba93efa-302e-43d3-94f5-8a20d2f760d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ea65462d47423cbe08b676b6c645ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:46.172577 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4123/8254] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:56:45 2022] DELETE /identity/v3/users/b5ea65462d47423cbe08b676b6c645ec => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:46.175357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d29d0-2cd5-4384-b440-249d76716911 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:46.175357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d29d0-2cd5-4384-b440-249d76716911 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:46.175357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d29d0-2cd5-4384-b440-249d76716911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:46.210674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b24d29d0-2cd5-4384-b440-249d76716911 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:46.212787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b24d29d0-2cd5-4384-b440-249d76716911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:46.231505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:46.305939 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4132/8255] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:46.307019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba93efa-302e-43d3-94f5-8a20d2f760d8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:46.308494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2ba93efa-302e-43d3-94f5-8a20d2f760d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:46.468757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba93efa-302e-43d3-94f5-8a20d2f760d8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:46.475027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adabb7e-8b6d-4c35-8432-cd85e69ac472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:46.475747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adabb7e-8b6d-4c35-8432-cd85e69ac472 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:46.476021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adabb7e-8b6d-4c35-8432-cd85e69ac472 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:46.476292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adabb7e-8b6d-4c35-8432-cd85e69ac472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:46.487836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adabb7e-8b6d-4c35-8432-cd85e69ac472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:46.489456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adabb7e-8b6d-4c35-8432-cd85e69ac472 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:46.502492 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4124/8256] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:47.229504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d29d0-2cd5-4384-b440-249d76716911 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:47.231568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b24d29d0-2cd5-4384-b440-249d76716911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:47.247535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d29d0-2cd5-4384-b440-249d76716911 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:47.254339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b5438-7658-4ae4-9432-332e9595c1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:47.255530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b5438-7658-4ae4-9432-332e9595c1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:47.256724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b5438-7658-4ae4-9432-332e9595c1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:47.257190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b5438-7658-4ae4-9432-332e9595c1bf admin admin] PATH_INFO: `/v3/projects/7c6100296ad14ace84397a924069b005` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:47.258891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b5438-7658-4ae4-9432-332e9595c1bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6100296ad14ace84397a924069b005)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:47.261317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b5438-7658-4ae4-9432-332e9595c1bf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:47.347053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c61b5438-7658-4ae4-9432-332e9595c1bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6100296ad14ace84397a924069b005', 'request_id': 'req-c61b5438-7658-4ae4-9432-332e9595c1bf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:47.355492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c61b5438-7658-4ae4-9432-332e9595c1bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6100296ad14ace84397a924069b005', 'request_id': 'req-c61b5438-7658-4ae4-9432-332e9595c1bf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:47.362399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c61b5438-7658-4ae4-9432-332e9595c1bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6100296ad14ace84397a924069b005', 'request_id': 'req-c61b5438-7658-4ae4-9432-332e9595c1bf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:47.384801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c61b5438-7658-4ae4-9432-332e9595c1bf admin admin] The token cache is being invalidate because project 7c6100296ad14ace84397a924069b005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:56:47.385317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c61b5438-7658-4ae4-9432-332e9595c1bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:47.386288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c61b5438-7658-4ae4-9432-332e9595c1bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:47.389602 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4133/8257] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:56:47 2022] DELETE /identity/v3/projects/7c6100296ad14ace84397a924069b005 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:47.393682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adabb7e-8b6d-4c35-8432-cd85e69ac472 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:47.421256 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:47.427794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adabb7e-8b6d-4c35-8432-cd85e69ac472 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:47.530239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7026c-4a64-441a-99b2-e1ed6b667955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:47.531057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7026c-4a64-441a-99b2-e1ed6b667955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:47.531616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7026c-4a64-441a-99b2-e1ed6b667955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:47.532085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7026c-4a64-441a-99b2-e1ed6b667955 admin admin] PATH_INFO: `/v3/users/6a5ee499930d4d43ad577a879c52a7a4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:47.533725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7026c-4a64-441a-99b2-e1ed6b667955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a5ee499930d4d43ad577a879c52a7a4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:47.538353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7026c-4a64-441a-99b2-e1ed6b667955 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:47.611447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9dd7026c-4a64-441a-99b2-e1ed6b667955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5ee499930d4d43ad577a879c52a7a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:47.615097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9dd7026c-4a64-441a-99b2-e1ed6b667955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5ee499930d4d43ad577a879c52a7a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:47.658783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9dd7026c-4a64-441a-99b2-e1ed6b667955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5ee499930d4d43ad577a879c52a7a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:47.668896 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9dd7026c-4a64-441a-99b2-e1ed6b667955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5ee499930d4d43ad577a879c52a7a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:47.685299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9dd7026c-4a64-441a-99b2-e1ed6b667955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5ee499930d4d43ad577a879c52a7a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:47.693096 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4125/8258] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:56:47 2022] DELETE /identity/v3/users/6a5ee499930d4d43ad577a879c52a7a4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:56:48.332585 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b5438-7658-4ae4-9432-332e9595c1bf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:48.334176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c61b5438-7658-4ae4-9432-332e9595c1bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:48.357291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7026c-4a64-441a-99b2-e1ed6b667955 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:48.358801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9dd7026c-4a64-441a-99b2-e1ed6b667955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:48.379157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b5438-7658-4ae4-9432-332e9595c1bf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:48.500087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7026c-4a64-441a-99b2-e1ed6b667955 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:48.506191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37860f92-4cfd-4775-a307-91963002c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:48.506927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37860f92-4cfd-4775-a307-91963002c91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:48.507278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37860f92-4cfd-4775-a307-91963002c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:48.507634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37860f92-4cfd-4775-a307-91963002c91f admin admin] PATH_INFO: `/v3/users/7237e474d65346be95b8c6298bc19b60` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:48.509005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37860f92-4cfd-4775-a307-91963002c91f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7237e474d65346be95b8c6298bc19b60)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:48.511056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37860f92-4cfd-4775-a307-91963002c91f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:48.558722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:48.589338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-37860f92-4cfd-4775-a307-91963002c91f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7237e474d65346be95b8c6298bc19b60'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:48.590622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-37860f92-4cfd-4775-a307-91963002c91f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7237e474d65346be95b8c6298bc19b60'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:48.600698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-37860f92-4cfd-4775-a307-91963002c91f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7237e474d65346be95b8c6298bc19b60'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:48.613076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-37860f92-4cfd-4775-a307-91963002c91f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7237e474d65346be95b8c6298bc19b60'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:48.629110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-37860f92-4cfd-4775-a307-91963002c91f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7237e474d65346be95b8c6298bc19b60'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:48.636561 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4126/8259] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:56:48 2022] DELETE /identity/v3/users/7237e474d65346be95b8c6298bc19b60 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:48.640925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067b90f-e761-472a-8d43-8e0de36c9d6d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:48.641213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067b90f-e761-472a-8d43-8e0de36c9d6d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:48.641486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067b90f-e761-472a-8d43-8e0de36c9d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:48.661340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b067b90f-e761-472a-8d43-8e0de36c9d6d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:48.662557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b067b90f-e761-472a-8d43-8e0de36c9d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:48.674787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:48.675837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:48.676395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:48.676864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616 admin admin] PATH_INFO: `/v3/projects/7d5d6e20be4842979027500de2be983e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:48.678199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5d6e20be4842979027500de2be983e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:48.680745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:48.734221 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4127/8260] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:48.744260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067b90f-e761-472a-8d43-8e0de36c9d6d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:48.745728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b067b90f-e761-472a-8d43-8e0de36c9d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:48.754433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:48.759663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5d6e20be4842979027500de2be983e', 'request_id': 'req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:48.771484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5d6e20be4842979027500de2be983e', 'request_id': 'req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:48.789232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5d6e20be4842979027500de2be983e', 'request_id': 'req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:48.807816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616 admin admin] The token cache is being invalidate because project 7d5d6e20be4842979027500de2be983e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:56:48.808540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:48.810427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:48.815199 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4134/8261] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:56:48 2022] DELETE /identity/v3/projects/7d5d6e20be4842979027500de2be983e => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:48.817463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:48.820095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:48.843487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067b90f-e761-472a-8d43-8e0de36c9d6d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:48.923016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abcd60-d967-42ad-9af7-010d1006eabf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:48.923788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abcd60-d967-42ad-9af7-010d1006eabf service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:48.924373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abcd60-d967-42ad-9af7-010d1006eabf service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:48.924647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abcd60-d967-42ad-9af7-010d1006eabf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:48.927079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98abcd60-d967-42ad-9af7-010d1006eabf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:48.942578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca3e0d-0f4a-4aff-95aa-574fe6d5f616 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:48.947761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d7f25-11ef-4e19-912a-4bfc2ab710a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:48.948311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d7f25-11ef-4e19-912a-4bfc2ab710a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:48.948676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d7f25-11ef-4e19-912a-4bfc2ab710a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:48.949042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d7f25-11ef-4e19-912a-4bfc2ab710a8 admin admin] PATH_INFO: `/v3/users/797d9693552d49c4902b936822949c0d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:48.950311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d7f25-11ef-4e19-912a-4bfc2ab710a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=797d9693552d49c4902b936822949c0d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:48.951680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:48.952595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d7f25-11ef-4e19-912a-4bfc2ab710a8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:49.009974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-376d7f25-11ef-4e19-912a-4bfc2ab710a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '797d9693552d49c4902b936822949c0d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:49.024966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abcd60-d967-42ad-9af7-010d1006eabf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:49.026598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abcd60-d967-42ad-9af7-010d1006eabf service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:49.033964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-376d7f25-11ef-4e19-912a-4bfc2ab710a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '797d9693552d49c4902b936822949c0d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:49.034977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-376d7f25-11ef-4e19-912a-4bfc2ab710a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '797d9693552d49c4902b936822949c0d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:49.035752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-376d7f25-11ef-4e19-912a-4bfc2ab710a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '797d9693552d49c4902b936822949c0d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:49.038795 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4128/8262] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:56:49.045592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-376d7f25-11ef-4e19-912a-4bfc2ab710a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '797d9693552d49c4902b936822949c0d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:49.063745 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4135/8263] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:56:48 2022] DELETE /identity/v3/users/797d9693552d49c4902b936822949c0d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:56:49.371279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abcd60-d967-42ad-9af7-010d1006eabf service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:49.372879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98abcd60-d967-42ad-9af7-010d1006eabf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:49.400931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abcd60-d967-42ad-9af7-010d1006eabf service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:49.506752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d7f25-11ef-4e19-912a-4bfc2ab710a8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:49.512535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-376d7f25-11ef-4e19-912a-4bfc2ab710a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:49.549917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d000af6-77cd-4bff-902a-ce4356aa5ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:49.550551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d000af6-77cd-4bff-902a-ce4356aa5ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:49.550825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d000af6-77cd-4bff-902a-ce4356aa5ace admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:49.551132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d000af6-77cd-4bff-902a-ce4356aa5ace admin admin] PATH_INFO: `/v3/projects/d77c90e30a854fba9f0e5d347e3cec9a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:49.553010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d000af6-77cd-4bff-902a-ce4356aa5ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=d77c90e30a854fba9f0e5d347e3cec9a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:49.564948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d000af6-77cd-4bff-902a-ce4356aa5ace admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:49.619183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:49.632418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d7f25-11ef-4e19-912a-4bfc2ab710a8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:49.645796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f5bad-532a-4cf3-a71f-de031279d97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:49.648487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f5bad-532a-4cf3-a71f-de031279d97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:49.649099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f5bad-532a-4cf3-a71f-de031279d97e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:49.649582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f5bad-532a-4cf3-a71f-de031279d97e admin admin] PATH_INFO: `/v3/projects/e10fa183ba8c4a0bbe1cb4c6fee887f6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:49.652449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f5bad-532a-4cf3-a71f-de031279d97e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e10fa183ba8c4a0bbe1cb4c6fee887f6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:49.655465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f5bad-532a-4cf3-a71f-de031279d97e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:49.688347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d000af6-77cd-4bff-902a-ce4356aa5ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd77c90e30a854fba9f0e5d347e3cec9a', 'request_id': 'req-3d000af6-77cd-4bff-902a-ce4356aa5ace'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:49.700267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d000af6-77cd-4bff-902a-ce4356aa5ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd77c90e30a854fba9f0e5d347e3cec9a', 'request_id': 'req-3d000af6-77cd-4bff-902a-ce4356aa5ace'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:49.708367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d000af6-77cd-4bff-902a-ce4356aa5ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd77c90e30a854fba9f0e5d347e3cec9a', 'request_id': 'req-3d000af6-77cd-4bff-902a-ce4356aa5ace'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:49.716835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d19f5bad-532a-4cf3-a71f-de031279d97e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10fa183ba8c4a0bbe1cb4c6fee887f6', 'request_id': 'req-d19f5bad-532a-4cf3-a71f-de031279d97e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:49.723608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d000af6-77cd-4bff-902a-ce4356aa5ace admin admin] The token cache is being invalidate because project d77c90e30a854fba9f0e5d347e3cec9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:56:49.723811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d19f5bad-532a-4cf3-a71f-de031279d97e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10fa183ba8c4a0bbe1cb4c6fee887f6', 'request_id': 'req-d19f5bad-532a-4cf3-a71f-de031279d97e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:49.724269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d000af6-77cd-4bff-902a-ce4356aa5ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:49.725117 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d000af6-77cd-4bff-902a-ce4356aa5ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:49.730691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d19f5bad-532a-4cf3-a71f-de031279d97e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10fa183ba8c4a0bbe1cb4c6fee887f6', 'request_id': 'req-d19f5bad-532a-4cf3-a71f-de031279d97e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:49.732088 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4129/8264] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:56:49 2022] DELETE /identity/v3/projects/d77c90e30a854fba9f0e5d347e3cec9a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:49.733536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042227b-fb58-402a-86b2-9a4170649c99 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:49.733830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042227b-fb58-402a-86b2-9a4170649c99 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:49.734122 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042227b-fb58-402a-86b2-9a4170649c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:49.749548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d19f5bad-532a-4cf3-a71f-de031279d97e admin admin] The token cache is being invalidate because project e10fa183ba8c4a0bbe1cb4c6fee887f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:56:49.750149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d19f5bad-532a-4cf3-a71f-de031279d97e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:49.750948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d19f5bad-532a-4cf3-a71f-de031279d97e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:49.753317 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4136/8265] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:56:49 2022] DELETE /identity/v3/projects/e10fa183ba8c4a0bbe1cb4c6fee887f6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:49.758289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bc988-d1ab-42e4-942b-3a18975f706f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:49.758792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bc988-d1ab-42e4-942b-3a18975f706f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:49.759228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bc988-d1ab-42e4-942b-3a18975f706f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:49.764679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f042227b-fb58-402a-86b2-9a4170649c99 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:49.765982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f042227b-fb58-402a-86b2-9a4170649c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:49.781856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dc7bc988-d1ab-42e4-942b-3a18975f706f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:49.784387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dc7bc988-d1ab-42e4-942b-3a18975f706f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:49.814055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:49.857633 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4130/8266] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:49.866759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab4c3-88e8-4891-b113-37836c765848 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:49.867131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab4c3-88e8-4891-b113-37836c765848 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:49.867555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab4c3-88e8-4891-b113-37836c765848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:49.902924 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4137/8267] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:56:49.904090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-756ab4c3-88e8-4891-b113-37836c765848 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:49.905440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-756ab4c3-88e8-4891-b113-37836c765848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:49.914299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df406b-4c38-46f0-9ea8-95ffb1109543 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:49.914718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df406b-4c38-46f0-9ea8-95ffb1109543 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:49.914866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df406b-4c38-46f0-9ea8-95ffb1109543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:49.921883 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4131/8268] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:49.929222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ab4c3-88e8-4891-b113-37836c765848 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:49.939065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-76df406b-4c38-46f0-9ea8-95ffb1109543 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:49.940385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-76df406b-4c38-46f0-9ea8-95ffb1109543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:49.941287 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ab4c3-88e8-4891-b113-37836c765848 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:49.946777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c7be2-071d-4990-a38a-9b7bf5c3309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:49.947707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c7be2-071d-4990-a38a-9b7bf5c3309a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:49.947989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c7be2-071d-4990-a38a-9b7bf5c3309a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:49.948268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c7be2-071d-4990-a38a-9b7bf5c3309a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:49.948945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c7be2-071d-4990-a38a-9b7bf5c3309a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:56:49.949253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c7be2-071d-4990-a38a-9b7bf5c3309a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:49.953486 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4138/8269] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:56:49.953644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c7be2-071d-4990-a38a-9b7bf5c3309a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:49.962174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df406b-4c38-46f0-9ea8-95ffb1109543 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:49.973864 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4132/8270] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:56:49.974254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df406b-4c38-46f0-9ea8-95ffb1109543 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:49.978952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c7be2-071d-4990-a38a-9b7bf5c3309a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:49.981996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5de71-3f0a-49a6-a5a8-c244cde20fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:49.982690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5de71-3f0a-49a6-a5a8-c244cde20fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:49.983036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5de71-3f0a-49a6-a5a8-c244cde20fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:49.983405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5de71-3f0a-49a6-a5a8-c244cde20fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:49.984127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5de71-3f0a-49a6-a5a8-c244cde20fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:56:49.984488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5de71-3f0a-49a6-a5a8-c244cde20fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:49.986513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5de71-3f0a-49a6-a5a8-c244cde20fa5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:49.991990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c7be2-071d-4990-a38a-9b7bf5c3309a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:49.997546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e21464-6807-43ac-9d97-e5fb1877b73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:49.998522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e21464-6807-43ac-9d97-e5fb1877b73f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:49.998709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e21464-6807-43ac-9d97-e5fb1877b73f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:49.999085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e21464-6807-43ac-9d97-e5fb1877b73f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:49.999663 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e21464-6807-43ac-9d97-e5fb1877b73f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:50.004820 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4139/8271] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:56:50.004974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e21464-6807-43ac-9d97-e5fb1877b73f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:50.005970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5de71-3f0a-49a6-a5a8-c244cde20fa5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:50.019894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5de71-3f0a-49a6-a5a8-c244cde20fa5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:50.027056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccafef-6047-442e-9d06-58a89b3cf9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:50.028350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccafef-6047-442e-9d06-58a89b3cf9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:50.028907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccafef-6047-442e-9d06-58a89b3cf9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:50.029218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccafef-6047-442e-9d06-58a89b3cf9a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:50.030310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccafef-6047-442e-9d06-58a89b3cf9a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:50.032848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccafef-6047-442e-9d06-58a89b3cf9a5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:50.046158 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4133/8272] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:56:49 2022] POST /identity/v3/projects => generated 359 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:50.050420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e21464-6807-43ac-9d97-e5fb1877b73f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:50.079863 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4140/8273] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:56:50 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:50.080810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccafef-6047-442e-9d06-58a89b3cf9a5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:50.125373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e21464-6807-43ac-9d97-e5fb1877b73f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:50.153382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:50.178172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccafef-6047-442e-9d06-58a89b3cf9a5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:50.185934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86811d-d663-434e-8002-f1aed0501e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:50.186655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86811d-d663-434e-8002-f1aed0501e2a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:50.187021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86811d-d663-434e-8002-f1aed0501e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:50.187329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86811d-d663-434e-8002-f1aed0501e2a admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:50.188609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86811d-d663-434e-8002-f1aed0501e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:50.190877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86811d-d663-434e-8002-f1aed0501e2a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:50.218478 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4141/8274] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:56:50 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:50.224328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86811d-d663-434e-8002-f1aed0501e2a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:50.225720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94dd53-8b57-4a07-b047-3c818f34ff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:50.226544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94dd53-8b57-4a07-b047-3c818f34ff2c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:50.226972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94dd53-8b57-4a07-b047-3c818f34ff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:50.227349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94dd53-8b57-4a07-b047-3c818f34ff2c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:50.228139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94dd53-8b57-4a07-b047-3c818f34ff2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:50.230513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94dd53-8b57-4a07-b047-3c818f34ff2c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:50.243317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86811d-d663-434e-8002-f1aed0501e2a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:50.243768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29c9f3-6c9b-4b1f-88bd-225d4f747e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:50.245774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29c9f3-6c9b-4b1f-88bd-225d4f747e7a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:50.247033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29c9f3-6c9b-4b1f-88bd-225d4f747e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:50.247502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29c9f3-6c9b-4b1f-88bd-225d4f747e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:50.248999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29c9f3-6c9b-4b1f-88bd-225d4f747e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:50.251528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29c9f3-6c9b-4b1f-88bd-225d4f747e7a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:50.272112 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4134/8275] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:56:50 2022] POST /identity/v3/users => generated 280 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:56:50.279676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94dd53-8b57-4a07-b047-3c818f34ff2c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:50.293349 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4142/8276] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:56:50.295660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94dd53-8b57-4a07-b047-3c818f34ff2c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:50.297375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29c9f3-6c9b-4b1f-88bd-225d4f747e7a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:50.311735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29c9f3-6c9b-4b1f-88bd-225d4f747e7a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:50.315783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d108a-a424-4279-8576-37feb6344579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:50.316273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d108a-a424-4279-8576-37feb6344579 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:50.316583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d108a-a424-4279-8576-37feb6344579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:50.316882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d108a-a424-4279-8576-37feb6344579 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:50.317722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d108a-a424-4279-8576-37feb6344579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:50.320223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035ae2b-fdda-4304-9f31-e2d1c2137d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:50.321130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035ae2b-fdda-4304-9f31-e2d1c2137d09 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:50.321694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035ae2b-fdda-4304-9f31-e2d1c2137d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:50.322181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035ae2b-fdda-4304-9f31-e2d1c2137d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:50.323049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035ae2b-fdda-4304-9f31-e2d1c2137d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:50.325627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035ae2b-fdda-4304-9f31-e2d1c2137d09 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:50.325751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d108a-a424-4279-8576-37feb6344579 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:50.339586 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4143/8277] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:50.343586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035ae2b-fdda-4304-9f31-e2d1c2137d09 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:50.348780 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4135/8278] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:50.349951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d108a-a424-4279-8576-37feb6344579 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:50.358819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035ae2b-fdda-4304-9f31-e2d1c2137d09 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:50.363950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d108a-a424-4279-8576-37feb6344579 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:50.364187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f8c75-c5bb-4748-aaae-0e6061008ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:50.364863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f8c75-c5bb-4748-aaae-0e6061008ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:50.365173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f8c75-c5bb-4748-aaae-0e6061008ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:50.365409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f8c75-c5bb-4748-aaae-0e6061008ec5 admin admin] PATH_INFO: `/v3/projects/119200c8edad4aa5ab036643ab32049c/users/be65e9be19d1490eb9ec87f5e45a6d17/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:50.369981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc555c-0286-4531-a2de-213ac35b0e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:50.370861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc555c-0286-4531-a2de-213ac35b0e4d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:50.371324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc555c-0286-4531-a2de-213ac35b0e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:50.371817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc555c-0286-4531-a2de-213ac35b0e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:50.372793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc555c-0286-4531-a2de-213ac35b0e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:50.374829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc555c-0286-4531-a2de-213ac35b0e4d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:50.386843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f8c75-c5bb-4748-aaae-0e6061008ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=119200c8edad4aa5ab036643ab32049c, user_id=be65e9be19d1490eb9ec87f5e45a6d17, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:50.390691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f8c75-c5bb-4748-aaae-0e6061008ec5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:50.404678 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4136/8279] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:50.405638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc555c-0286-4531-a2de-213ac35b0e4d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:50.411393 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4144/8280] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:56:50 2022] PUT /identity/v3/projects/119200c8edad4aa5ab036643ab32049c/users/be65e9be19d1490eb9ec87f5e45a6d17/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:50.417083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc555c-0286-4531-a2de-213ac35b0e4d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:50.420529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eff24-4ebc-4a47-a983-61b2f3e2e550 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:50.420973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eff24-4ebc-4a47-a983-61b2f3e2e550 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:50.421386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eff24-4ebc-4a47-a983-61b2f3e2e550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:50.427234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:50.465909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-437eff24-4ebc-4a47-a983-61b2f3e2e550 None None] MFA Rules not processed for user `be65e9be19d1490eb9ec87f5e45a6d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:50.467904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-437eff24-4ebc-4a47-a983-61b2f3e2e550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:50.484968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9ee18-f619-4be8-b8a6-cd629a3001b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:50.485652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9ee18-f619-4be8-b8a6-cd629a3001b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:50.485936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9ee18-f619-4be8-b8a6-cd629a3001b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:50.486238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9ee18-f619-4be8-b8a6-cd629a3001b4 admin admin] PATH_INFO: `/v3/projects/9c5dfe7182c0435ca1121834de3ee075/users/cb8ace6dbe7d4966bc0cde77250cd7de/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:50.510186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9ee18-f619-4be8-b8a6-cd629a3001b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c5dfe7182c0435ca1121834de3ee075, user_id=cb8ace6dbe7d4966bc0cde77250cd7de, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:50.514695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9ee18-f619-4be8-b8a6-cd629a3001b4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:50.554611 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4137/8281] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:56:50 2022] PUT /identity/v3/projects/9c5dfe7182c0435ca1121834de3ee075/users/cb8ace6dbe7d4966bc0cde77250cd7de/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:50.568767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb70acf-707b-4ac8-ab71-4205ce76ea39 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:50.569570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb70acf-707b-4ac8-ab71-4205ce76ea39 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:50.569570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb70acf-707b-4ac8-ab71-4205ce76ea39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:50.593320 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4145/8282] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:56:50.598157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437eff24-4ebc-4a47-a983-61b2f3e2e550 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:50.615880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-feb70acf-707b-4ac8-ab71-4205ce76ea39 None None] MFA Rules not processed for user `cb8ace6dbe7d4966bc0cde77250cd7de`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:50.617576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-feb70acf-707b-4ac8-ab71-4205ce76ea39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:50.645251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437eff24-4ebc-4a47-a983-61b2f3e2e550 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:50.709284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf6dce-028d-4cc3-ad37-768986525692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:50.709935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf6dce-028d-4cc3-ad37-768986525692 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:50.710221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf6dce-028d-4cc3-ad37-768986525692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:50.710496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf6dce-028d-4cc3-ad37-768986525692 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:50.711143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf6dce-028d-4cc3-ad37-768986525692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:50.713083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf6dce-028d-4cc3-ad37-768986525692 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:50.724612 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4138/8283] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:50.735308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb70acf-707b-4ac8-ab71-4205ce76ea39 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:50.738365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-feb70acf-707b-4ac8-ab71-4205ce76ea39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:50.741982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:50.757756 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4146/8284] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:56:50 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:50.762241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf6dce-028d-4cc3-ad37-768986525692 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:50.852425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb70acf-707b-4ac8-ab71-4205ce76ea39 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:50.873402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf6dce-028d-4cc3-ad37-768986525692 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:50.881609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94e058-0709-4791-813d-30dbe8237669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:50.882739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94e058-0709-4791-813d-30dbe8237669 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:50.883344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94e058-0709-4791-813d-30dbe8237669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:50.883908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94e058-0709-4791-813d-30dbe8237669 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:50.885162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94e058-0709-4791-813d-30dbe8237669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:50.889501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94e058-0709-4791-813d-30dbe8237669 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:50.908700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:50.921288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b985d80-5592-45fb-836a-15f39e8388ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:50.922098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b985d80-5592-45fb-836a-15f39e8388ab service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:50.922486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b985d80-5592-45fb-836a-15f39e8388ab service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:50.922759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b985d80-5592-45fb-836a-15f39e8388ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:50.933021 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4147/8285] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:56:50 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:50.941663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94e058-0709-4791-813d-30dbe8237669 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:50.958758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94e058-0709-4791-813d-30dbe8237669 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:50.972083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904034fb-3b7a-4535-a4a8-875e5e6274e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:50.972735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904034fb-3b7a-4535-a4a8-875e5e6274e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:50.973143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904034fb-3b7a-4535-a4a8-875e5e6274e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:50.973431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904034fb-3b7a-4535-a4a8-875e5e6274e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:50.974085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904034fb-3b7a-4535-a4a8-875e5e6274e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:50.975732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904034fb-3b7a-4535-a4a8-875e5e6274e8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:50.988030 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4148/8286] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:56:50.991647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904034fb-3b7a-4535-a4a8-875e5e6274e8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:51.003385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904034fb-3b7a-4535-a4a8-875e5e6274e8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:51.009486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b71be-e033-4c5a-ad79-d4132b947177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:51.010178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b71be-e033-4c5a-ad79-d4132b947177 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:51.010516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b71be-e033-4c5a-ad79-d4132b947177 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:51.010861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b71be-e033-4c5a-ad79-d4132b947177 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:51.011643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b71be-e033-4c5a-ad79-d4132b947177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:51.013536 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b71be-e033-4c5a-ad79-d4132b947177 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:51.018447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b985d80-5592-45fb-836a-15f39e8388ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:51.020246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b985d80-5592-45fb-836a-15f39e8388ab service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:51.047896 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4149/8287] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:56:51.052485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b71be-e033-4c5a-ad79-d4132b947177 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:51.055797 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4139/8288] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:56:51.066240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b71be-e033-4c5a-ad79-d4132b947177 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:51.071163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3f79d-e36e-441c-bd34-72e70402767d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:51.071877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f79d-e36e-441c-bd34-72e70402767d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:51.072152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f79d-e36e-441c-bd34-72e70402767d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:51.072422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f79d-e36e-441c-bd34-72e70402767d admin admin] PATH_INFO: `/v3/projects/be4e8d14231c43baa1bbb493151981d7/users/0e44504d8fce44a5b4cb0537547ada36/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:51.091475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3f79d-e36e-441c-bd34-72e70402767d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4e8d14231c43baa1bbb493151981d7, user_id=0e44504d8fce44a5b4cb0537547ada36, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:51.094415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3f79d-e36e-441c-bd34-72e70402767d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:51.121717 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4150/8289] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:56:51 2022] PUT /identity/v3/projects/be4e8d14231c43baa1bbb493151981d7/users/0e44504d8fce44a5b4cb0537547ada36/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:56:51.125514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c9560-eab8-4cf2-b49e-248f0d9a61e2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:51.125911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c9560-eab8-4cf2-b49e-248f0d9a61e2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:51.126245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c9560-eab8-4cf2-b49e-248f0d9a61e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:51.163638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1e8c9560-eab8-4cf2-b49e-248f0d9a61e2 None None] MFA Rules not processed for user `0e44504d8fce44a5b4cb0537547ada36`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:51.165064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e8c9560-eab8-4cf2-b49e-248f0d9a61e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:51.268229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3f79d-e36e-441c-bd34-72e70402767d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:51.275881 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4140/8290] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:51.353896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3f79d-e36e-441c-bd34-72e70402767d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:51.360337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a654e4f-31af-4558-b1fd-5172b56281d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:51.361137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a654e4f-31af-4558-b1fd-5172b56281d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:51.361497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a654e4f-31af-4558-b1fd-5172b56281d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:51.362239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a654e4f-31af-4558-b1fd-5172b56281d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:51.363178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a654e4f-31af-4558-b1fd-5172b56281d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:51.376113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a654e4f-31af-4558-b1fd-5172b56281d4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:51.455136 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4151/8291] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:56:51 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:51.473855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c9560-eab8-4cf2-b49e-248f0d9a61e2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:51.511700 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c9560-eab8-4cf2-b49e-248f0d9a61e2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:51.626161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd984120-0dd4-4d8e-a739-be3975be284d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:51.627225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984120-0dd4-4d8e-a739-be3975be284d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:51.627225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984120-0dd4-4d8e-a739-be3975be284d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:51.627520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984120-0dd4-4d8e-a739-be3975be284d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:51.628319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd984120-0dd4-4d8e-a739-be3975be284d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:51.630395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd984120-0dd4-4d8e-a739-be3975be284d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:51.658443 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4141/8292] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:56:51 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:56:51.662245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a654e4f-31af-4558-b1fd-5172b56281d4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:51.675806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a654e4f-31af-4558-b1fd-5172b56281d4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:51.681393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf72658-853f-491f-9e55-409a67b401ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:51.682093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf72658-853f-491f-9e55-409a67b401ef admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:51.682709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf72658-853f-491f-9e55-409a67b401ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:51.683653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf72658-853f-491f-9e55-409a67b401ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:51.684558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf72658-853f-491f-9e55-409a67b401ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:51.686625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf72658-853f-491f-9e55-409a67b401ef admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:51.706864 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4152/8293] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:51.711911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd984120-0dd4-4d8e-a739-be3975be284d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:51.726258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd984120-0dd4-4d8e-a739-be3975be284d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:51.734119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f9adc-037e-41e2-b23a-0ea82cf7210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:51.735516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f9adc-037e-41e2-b23a-0ea82cf7210a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:51.736226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f9adc-037e-41e2-b23a-0ea82cf7210a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:51.736679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f9adc-037e-41e2-b23a-0ea82cf7210a admin admin] PATH_INFO: `/v3/projects/e7cbb5c69cc74380ab6451807b11fc1a/users/ffa5e022ad734658b13da47c3332ea62/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:51.757507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:51.764659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f9adc-037e-41e2-b23a-0ea82cf7210a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7cbb5c69cc74380ab6451807b11fc1a, user_id=ffa5e022ad734658b13da47c3332ea62, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:51.768424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f9adc-037e-41e2-b23a-0ea82cf7210a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:51.798721 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4142/8294] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:56:51 2022] PUT /identity/v3/projects/e7cbb5c69cc74380ab6451807b11fc1a/users/ffa5e022ad734658b13da47c3332ea62/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:56:51.799963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf72658-853f-491f-9e55-409a67b401ef admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:51.811489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf72658-853f-491f-9e55-409a67b401ef admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:51.832133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:51.891457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ed278-53d2-4e69-b8d8-93232e7d04bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:51.892330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ed278-53d2-4e69-b8d8-93232e7d04bd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:51.892793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ed278-53d2-4e69-b8d8-93232e7d04bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:51.893246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ed278-53d2-4e69-b8d8-93232e7d04bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:51.894171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ed278-53d2-4e69-b8d8-93232e7d04bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:51.896834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ed278-53d2-4e69-b8d8-93232e7d04bd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:51.912568 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4153/8295] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:51.917084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f9adc-037e-41e2-b23a-0ea82cf7210a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:51.932546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f9adc-037e-41e2-b23a-0ea82cf7210a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:51.938764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbc477-61ba-49ca-923e-977be2c1f244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:51.940749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbc477-61ba-49ca-923e-977be2c1f244 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:51.941249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbc477-61ba-49ca-923e-977be2c1f244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:51.941704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbc477-61ba-49ca-923e-977be2c1f244 admin admin] PATH_INFO: `/v3/projects/e7cbb5c69cc74380ab6451807b11fc1a/users/ffa5e022ad734658b13da47c3332ea62/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:51.944058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbc477-61ba-49ca-923e-977be2c1f244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7cbb5c69cc74380ab6451807b11fc1a, user_id=ffa5e022ad734658b13da47c3332ea62, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:51.948031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbc477-61ba-49ca-923e-977be2c1f244 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:51.972670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da62e9-ce96-4c50-acb8-d60ea2b46f98 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:51.972869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da62e9-ce96-4c50-acb8-d60ea2b46f98 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:51.973576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da62e9-ce96-4c50-acb8-d60ea2b46f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:51.973778 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4143/8296] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:56:51 2022] PUT /identity/v3/projects/e7cbb5c69cc74380ab6451807b11fc1a/users/ffa5e022ad734658b13da47c3332ea62/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:52.024429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-75da62e9-ce96-4c50-acb8-d60ea2b46f98 None None] MFA Rules not processed for user `ffa5e022ad734658b13da47c3332ea62`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:52.025792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-75da62e9-ce96-4c50-acb8-d60ea2b46f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:52.119854 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4154/8297] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:56:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:52.131988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbc477-61ba-49ca-923e-977be2c1f244 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:52.134066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bbfbc477-61ba-49ca-923e-977be2c1f244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:52.258153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbc477-61ba-49ca-923e-977be2c1f244 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:52.271173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5bfa1-6750-4fb8-86f5-da78c68c44da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:52.272478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5bfa1-6750-4fb8-86f5-da78c68c44da service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:52.272914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5bfa1-6750-4fb8-86f5-da78c68c44da service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:52.273352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5bfa1-6750-4fb8-86f5-da78c68c44da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:52.369452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5bfa1-6750-4fb8-86f5-da78c68c44da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:52.371048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5bfa1-6750-4fb8-86f5-da78c68c44da service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:52.388726 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4144/8298] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:55.438042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da62e9-ce96-4c50-acb8-d60ea2b46f98 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:55.456341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da62e9-ce96-4c50-acb8-d60ea2b46f98 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:55.461698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3c9e5-0b54-47b7-aa3d-c6afdb9ab3be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:55.462569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3c9e5-0b54-47b7-aa3d-c6afdb9ab3be service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:55.463071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3c9e5-0b54-47b7-aa3d-c6afdb9ab3be service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:55.463549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3c9e5-0b54-47b7-aa3d-c6afdb9ab3be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:55.610640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3c9e5-0b54-47b7-aa3d-c6afdb9ab3be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:55.615586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3c9e5-0b54-47b7-aa3d-c6afdb9ab3be service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:55.638346 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4155/8299] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:56.868989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5bfa1-6750-4fb8-86f5-da78c68c44da service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:56.871817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a0f5bfa1-6750-4fb8-86f5-da78c68c44da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:56.907038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5bfa1-6750-4fb8-86f5-da78c68c44da service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:56.932683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9a021-0826-4a36-ba01-b32622f26574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:56.936736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9a021-0826-4a36-ba01-b32622f26574 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:56.937141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9a021-0826-4a36-ba01-b32622f26574 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:56.937521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9a021-0826-4a36-ba01-b32622f26574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:56.964499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9a021-0826-4a36-ba01-b32622f26574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:56.966220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9a021-0826-4a36-ba01-b32622f26574 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:57.002625 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4145/8300] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:59.841483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3c9e5-0b54-47b7-aa3d-c6afdb9ab3be service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:59.874898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3c9e5-0b54-47b7-aa3d-c6afdb9ab3be service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:59.881496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3f60f-e01e-49fb-91ab-89a789ac0870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:59.882126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3f60f-e01e-49fb-91ab-89a789ac0870 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:59.882403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3f60f-e01e-49fb-91ab-89a789ac0870 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:59.882676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3f60f-e01e-49fb-91ab-89a789ac0870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:59.884665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8ab3f60f-e01e-49fb-91ab-89a789ac0870 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:59.962124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:00.019231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3f60f-e01e-49fb-91ab-89a789ac0870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:00.022544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3f60f-e01e-49fb-91ab-89a789ac0870 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:00.057275 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4156/8301] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:06.986375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=66,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:07.053714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9a021-0826-4a36-ba01-b32622f26574 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:07.128317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9a021-0826-4a36-ba01-b32622f26574 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:07.133464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757d820-f5d8-4efb-a10e-d695a1e30b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:07.134245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757d820-f5d8-4efb-a10e-d695a1e30b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:07.134587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757d820-f5d8-4efb-a10e-d695a1e30b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:07.134941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757d820-f5d8-4efb-a10e-d695a1e30b62 admin admin] PATH_INFO: `/v3/users/be65e9be19d1490eb9ec87f5e45a6d17` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:07.136254 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757d820-f5d8-4efb-a10e-d695a1e30b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be65e9be19d1490eb9ec87f5e45a6d17)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:07.138267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757d820-f5d8-4efb-a10e-d695a1e30b62 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:07.204393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2757d820-f5d8-4efb-a10e-d695a1e30b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be65e9be19d1490eb9ec87f5e45a6d17'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:07.206260 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2757d820-f5d8-4efb-a10e-d695a1e30b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be65e9be19d1490eb9ec87f5e45a6d17'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:07.217472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2757d820-f5d8-4efb-a10e-d695a1e30b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be65e9be19d1490eb9ec87f5e45a6d17'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:07.229711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2757d820-f5d8-4efb-a10e-d695a1e30b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be65e9be19d1490eb9ec87f5e45a6d17'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:07.261171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2757d820-f5d8-4efb-a10e-d695a1e30b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be65e9be19d1490eb9ec87f5e45a6d17'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:07.271593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3f60f-e01e-49fb-91ab-89a789ac0870 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:07.273130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8ab3f60f-e01e-49fb-91ab-89a789ac0870 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:07.274592 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4146/8302] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:57:07 2022] DELETE /identity/v3/users/be65e9be19d1490eb9ec87f5e45a6d17 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:07.276169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789ebff-286e-4dfb-9fe6-7b09d21d0237 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:07.276457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789ebff-286e-4dfb-9fe6-7b09d21d0237 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:07.276773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789ebff-286e-4dfb-9fe6-7b09d21d0237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:07.316833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c789ebff-286e-4dfb-9fe6-7b09d21d0237 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:07.318088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c789ebff-286e-4dfb-9fe6-7b09d21d0237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:07.453782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:07.494899 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4147/8303] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:07.505740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789ebff-286e-4dfb-9fe6-7b09d21d0237 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:07.507402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c789ebff-286e-4dfb-9fe6-7b09d21d0237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:07.550235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3f60f-e01e-49fb-91ab-89a789ac0870 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:07.668737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789ebff-286e-4dfb-9fe6-7b09d21d0237 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:07.674265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3f0cd-80f7-49d9-b063-ee9a9e34ae70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:07.674839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3f0cd-80f7-49d9-b063-ee9a9e34ae70 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:07.675120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3f0cd-80f7-49d9-b063-ee9a9e34ae70 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:07.675425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3f0cd-80f7-49d9-b063-ee9a9e34ae70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:07.701782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3f0cd-80f7-49d9-b063-ee9a9e34ae70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:07.703313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3f0cd-80f7-49d9-b063-ee9a9e34ae70 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:07.719440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3ab0a-aeaa-43ce-a14a-6970447cd9d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:07.720364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ab0a-aeaa-43ce-a14a-6970447cd9d5 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:07.720715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ab0a-aeaa-43ce-a14a-6970447cd9d5 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:07.721081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ab0a-aeaa-43ce-a14a-6970447cd9d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:07.724365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-90f3ab0a-aeaa-43ce-a14a-6970447cd9d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:07.725772 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4148/8304] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:57:07.787092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3ab0a-aeaa-43ce-a14a-6970447cd9d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:07.788788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3ab0a-aeaa-43ce-a14a-6970447cd9d5 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:07.809900 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4157/8305] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:57:08.302475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3f0cd-80f7-49d9-b063-ee9a9e34ae70 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:08.305255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-12c3f0cd-80f7-49d9-b063-ee9a9e34ae70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:08.325796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3f0cd-80f7-49d9-b063-ee9a9e34ae70 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:08.331504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddf0dd-0ca6-47a1-be25-e1a756919b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:08.332701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddf0dd-0ca6-47a1-be25-e1a756919b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:08.333247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddf0dd-0ca6-47a1-be25-e1a756919b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:08.333742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddf0dd-0ca6-47a1-be25-e1a756919b41 admin admin] PATH_INFO: `/v3/projects/119200c8edad4aa5ab036643ab32049c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:08.335829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddf0dd-0ca6-47a1-be25-e1a756919b41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=119200c8edad4aa5ab036643ab32049c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:08.338214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddf0dd-0ca6-47a1-be25-e1a756919b41 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:08.418626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eaddf0dd-0ca6-47a1-be25-e1a756919b41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119200c8edad4aa5ab036643ab32049c', 'request_id': 'req-eaddf0dd-0ca6-47a1-be25-e1a756919b41'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:08.432233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eaddf0dd-0ca6-47a1-be25-e1a756919b41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119200c8edad4aa5ab036643ab32049c', 'request_id': 'req-eaddf0dd-0ca6-47a1-be25-e1a756919b41'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:08.443637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eaddf0dd-0ca6-47a1-be25-e1a756919b41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119200c8edad4aa5ab036643ab32049c', 'request_id': 'req-eaddf0dd-0ca6-47a1-be25-e1a756919b41'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:08.466995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eaddf0dd-0ca6-47a1-be25-e1a756919b41 admin admin] The token cache is being invalidate because project 119200c8edad4aa5ab036643ab32049c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:57:08.467445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eaddf0dd-0ca6-47a1-be25-e1a756919b41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:08.468204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eaddf0dd-0ca6-47a1-be25-e1a756919b41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:08.474951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3ab0a-aeaa-43ce-a14a-6970447cd9d5 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:08.476110 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4149/8306] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:57:08 2022] DELETE /identity/v3/projects/119200c8edad4aa5ab036643ab32049c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:08.489250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3ab0a-aeaa-43ce-a14a-6970447cd9d5 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:08.516433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:08.580054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d336d-3662-4d9e-9443-659041be2d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:08.582470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d336d-3662-4d9e-9443-659041be2d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:08.583108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d336d-3662-4d9e-9443-659041be2d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:08.583627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d336d-3662-4d9e-9443-659041be2d8b admin admin] PATH_INFO: `/v3/users/0e44504d8fce44a5b4cb0537547ada36` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:08.585241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d336d-3662-4d9e-9443-659041be2d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e44504d8fce44a5b4cb0537547ada36)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:08.587957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d336d-3662-4d9e-9443-659041be2d8b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:08.693286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b54d336d-3662-4d9e-9443-659041be2d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e44504d8fce44a5b4cb0537547ada36'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:08.723593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b54d336d-3662-4d9e-9443-659041be2d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e44504d8fce44a5b4cb0537547ada36'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:08.724552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b54d336d-3662-4d9e-9443-659041be2d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e44504d8fce44a5b4cb0537547ada36'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:08.725223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b54d336d-3662-4d9e-9443-659041be2d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e44504d8fce44a5b4cb0537547ada36'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:08.739712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b54d336d-3662-4d9e-9443-659041be2d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e44504d8fce44a5b4cb0537547ada36'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:08.763350 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4158/8307] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:57:08 2022] DELETE /identity/v3/users/0e44504d8fce44a5b4cb0537547ada36 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:57:09.129623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddf0dd-0ca6-47a1-be25-e1a756919b41 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:09.131581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eaddf0dd-0ca6-47a1-be25-e1a756919b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:09.151000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddf0dd-0ca6-47a1-be25-e1a756919b41 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:09.242625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce012b0-3691-479e-aef6-6105f436c9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:09.243584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce012b0-3691-479e-aef6-6105f436c9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:09.243866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce012b0-3691-479e-aef6-6105f436c9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:09.244142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce012b0-3691-479e-aef6-6105f436c9b3 admin admin] PATH_INFO: `/v3/projects/be4e8d14231c43baa1bbb493151981d7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:09.245670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce012b0-3691-479e-aef6-6105f436c9b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be4e8d14231c43baa1bbb493151981d7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:09.249688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce012b0-3691-479e-aef6-6105f436c9b3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:09.289915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:09.358392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dce012b0-3691-479e-aef6-6105f436c9b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be4e8d14231c43baa1bbb493151981d7', 'request_id': 'req-dce012b0-3691-479e-aef6-6105f436c9b3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:09.371877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dce012b0-3691-479e-aef6-6105f436c9b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be4e8d14231c43baa1bbb493151981d7', 'request_id': 'req-dce012b0-3691-479e-aef6-6105f436c9b3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:09.381770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dce012b0-3691-479e-aef6-6105f436c9b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be4e8d14231c43baa1bbb493151981d7', 'request_id': 'req-dce012b0-3691-479e-aef6-6105f436c9b3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:09.399869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dce012b0-3691-479e-aef6-6105f436c9b3 admin admin] The token cache is being invalidate because project be4e8d14231c43baa1bbb493151981d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:57:09.401434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dce012b0-3691-479e-aef6-6105f436c9b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:09.403044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dce012b0-3691-479e-aef6-6105f436c9b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:09.405702 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4150/8308] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:57:09 2022] DELETE /identity/v3/projects/be4e8d14231c43baa1bbb493151981d7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:09.410391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d336d-3662-4d9e-9443-659041be2d8b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:09.412860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b54d336d-3662-4d9e-9443-659041be2d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:09.429508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d336d-3662-4d9e-9443-659041be2d8b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:09.621912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ec9a3-9133-4843-8931-7dfe37a33ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:09.622887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ec9a3-9133-4843-8931-7dfe37a33ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:09.623176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ec9a3-9133-4843-8931-7dfe37a33ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:09.623609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ec9a3-9133-4843-8931-7dfe37a33ff6 admin admin] PATH_INFO: `/v3/users/ffa5e022ad734658b13da47c3332ea62` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:09.625292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ec9a3-9133-4843-8931-7dfe37a33ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffa5e022ad734658b13da47c3332ea62)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:09.627613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ec9a3-9133-4843-8931-7dfe37a33ff6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:09.718592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:09.738886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e61ec9a3-9133-4843-8931-7dfe37a33ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffa5e022ad734658b13da47c3332ea62'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:09.762177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e61ec9a3-9133-4843-8931-7dfe37a33ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffa5e022ad734658b13da47c3332ea62'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:09.763108 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e61ec9a3-9133-4843-8931-7dfe37a33ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffa5e022ad734658b13da47c3332ea62'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:09.763781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e61ec9a3-9133-4843-8931-7dfe37a33ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffa5e022ad734658b13da47c3332ea62'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:09.783476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e61ec9a3-9133-4843-8931-7dfe37a33ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffa5e022ad734658b13da47c3332ea62'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:09.830058 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4159/8309] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:57:09 2022] DELETE /identity/v3/users/ffa5e022ad734658b13da47c3332ea62 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:10.247778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce012b0-3691-479e-aef6-6105f436c9b3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:10.249680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dce012b0-3691-479e-aef6-6105f436c9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:10.288292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce012b0-3691-479e-aef6-6105f436c9b3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:10.449881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34098b1-cdbc-4971-9b11-81a876cb200e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:10.451049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34098b1-cdbc-4971-9b11-81a876cb200e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:10.451838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34098b1-cdbc-4971-9b11-81a876cb200e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:10.452517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34098b1-cdbc-4971-9b11-81a876cb200e admin admin] PATH_INFO: `/v3/projects/e7cbb5c69cc74380ab6451807b11fc1a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:10.454936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34098b1-cdbc-4971-9b11-81a876cb200e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7cbb5c69cc74380ab6451807b11fc1a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:10.459670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34098b1-cdbc-4971-9b11-81a876cb200e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:10.549159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a34098b1-cdbc-4971-9b11-81a876cb200e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7cbb5c69cc74380ab6451807b11fc1a', 'request_id': 'req-a34098b1-cdbc-4971-9b11-81a876cb200e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:10.596017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a34098b1-cdbc-4971-9b11-81a876cb200e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7cbb5c69cc74380ab6451807b11fc1a', 'request_id': 'req-a34098b1-cdbc-4971-9b11-81a876cb200e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:10.608358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a34098b1-cdbc-4971-9b11-81a876cb200e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7cbb5c69cc74380ab6451807b11fc1a', 'request_id': 'req-a34098b1-cdbc-4971-9b11-81a876cb200e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:10.623866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a34098b1-cdbc-4971-9b11-81a876cb200e admin admin] The token cache is being invalidate because project e7cbb5c69cc74380ab6451807b11fc1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:57:10.624162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a34098b1-cdbc-4971-9b11-81a876cb200e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:10.624842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a34098b1-cdbc-4971-9b11-81a876cb200e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:10.630359 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4151/8310] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:57:10 2022] DELETE /identity/v3/projects/e7cbb5c69cc74380ab6451807b11fc1a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:57:10.631794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fb11c-2ece-468e-b8a5-821651244c6f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:10.632487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fb11c-2ece-468e-b8a5-821651244c6f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:10.632645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fb11c-2ece-468e-b8a5-821651244c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:10.662654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ee6fb11c-2ece-468e-b8a5-821651244c6f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:10.664998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ee6fb11c-2ece-468e-b8a5-821651244c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:10.799965 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4160/8311] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:57:10.807993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903bc33-4da7-4295-95ff-2663040947d6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:10.808289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903bc33-4da7-4295-95ff-2663040947d6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:10.808546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903bc33-4da7-4295-95ff-2663040947d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:10.834296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a903bc33-4da7-4295-95ff-2663040947d6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:10.835592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a903bc33-4da7-4295-95ff-2663040947d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:10.847289 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4152/8312] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:10.852617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fb11c-2ece-468e-b8a5-821651244c6f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:10.887547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fb11c-2ece-468e-b8a5-821651244c6f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:10.915692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f08fe6-c5cf-4d43-87ea-dbe63f826593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:10.917807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f08fe6-c5cf-4d43-87ea-dbe63f826593 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:10.917807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f08fe6-c5cf-4d43-87ea-dbe63f826593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:10.918106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f08fe6-c5cf-4d43-87ea-dbe63f826593 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:10.918901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f08fe6-c5cf-4d43-87ea-dbe63f826593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:57:10.924060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f08fe6-c5cf-4d43-87ea-dbe63f826593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:10.926320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f08fe6-c5cf-4d43-87ea-dbe63f826593 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:10.962291 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4161/8313] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:57:10.967149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903bc33-4da7-4295-95ff-2663040947d6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:10.987351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903bc33-4da7-4295-95ff-2663040947d6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:10.998936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88be21-7ddf-4f44-bd4c-149266462c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:10.999994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88be21-7ddf-4f44-bd4c-149266462c15 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:11.000143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88be21-7ddf-4f44-bd4c-149266462c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:11.000440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88be21-7ddf-4f44-bd4c-149266462c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:11.001153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88be21-7ddf-4f44-bd4c-149266462c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:11.003515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88be21-7ddf-4f44-bd4c-149266462c15 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:11.064804 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4153/8314] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:57:10 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:57:11.068967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f08fe6-c5cf-4d43-87ea-dbe63f826593 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:11.082806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f08fe6-c5cf-4d43-87ea-dbe63f826593 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:11.171137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5158a14-9e9b-4d83-9ff4-d3aa2d35f84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:11.172289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5158a14-9e9b-4d83-9ff4-d3aa2d35f84d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:11.172712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5158a14-9e9b-4d83-9ff4-d3aa2d35f84d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:11.173264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5158a14-9e9b-4d83-9ff4-d3aa2d35f84d admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:11.174470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5158a14-9e9b-4d83-9ff4-d3aa2d35f84d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:11.177819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5158a14-9e9b-4d83-9ff4-d3aa2d35f84d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:11.215646 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4162/8315] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:57:11 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:57:11.219652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88be21-7ddf-4f44-bd4c-149266462c15 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:11.229761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:11.235867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88be21-7ddf-4f44-bd4c-149266462c15 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:11.244757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4178eb9-5147-4627-9ed8-bd4c57e0733b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:11.245897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4178eb9-5147-4627-9ed8-bd4c57e0733b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:11.246431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4178eb9-5147-4627-9ed8-bd4c57e0733b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:11.246994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4178eb9-5147-4627-9ed8-bd4c57e0733b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:11.247897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4178eb9-5147-4627-9ed8-bd4c57e0733b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:11.249942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4178eb9-5147-4627-9ed8-bd4c57e0733b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:11.284615 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4154/8316] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:11.288264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5158a14-9e9b-4d83-9ff4-d3aa2d35f84d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:11.304569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5158a14-9e9b-4d83-9ff4-d3aa2d35f84d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:11.317439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adad653-52db-4017-a4e1-a326b9438872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:11.318842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adad653-52db-4017-a4e1-a326b9438872 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:11.319232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adad653-52db-4017-a4e1-a326b9438872 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:11.319593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adad653-52db-4017-a4e1-a326b9438872 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:11.320886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adad653-52db-4017-a4e1-a326b9438872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:11.324404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adad653-52db-4017-a4e1-a326b9438872 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:11.342671 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4163/8317] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:11.347037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4178eb9-5147-4627-9ed8-bd4c57e0733b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:11.361869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4178eb9-5147-4627-9ed8-bd4c57e0733b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:11.367757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c99821-a383-4e60-b114-7060d03d10e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:11.368872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c99821-a383-4e60-b114-7060d03d10e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:11.369378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c99821-a383-4e60-b114-7060d03d10e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:11.369872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c99821-a383-4e60-b114-7060d03d10e2 admin admin] PATH_INFO: `/v3/projects/1ee9871cd3c142a49f5f01bcf1ce0cb9/users/5c3a1008f04b4e75a835f94703ba57dc/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:11.389719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c99821-a383-4e60-b114-7060d03d10e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee9871cd3c142a49f5f01bcf1ce0cb9, user_id=5c3a1008f04b4e75a835f94703ba57dc, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:11.395373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c99821-a383-4e60-b114-7060d03d10e2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:11.413491 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4155/8318] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:57:11 2022] PUT /identity/v3/projects/1ee9871cd3c142a49f5f01bcf1ce0cb9/users/5c3a1008f04b4e75a835f94703ba57dc/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:11.418331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affbf26-8682-47ba-8547-18a9b8582136 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:11.418619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affbf26-8682-47ba-8547-18a9b8582136 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:11.418901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affbf26-8682-47ba-8547-18a9b8582136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:11.442819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1affbf26-8682-47ba-8547-18a9b8582136 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:11.444411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1affbf26-8682-47ba-8547-18a9b8582136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:11.475946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:11.542640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c99821-a383-4e60-b114-7060d03d10e2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:11.545607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a2c99821-a383-4e60-b114-7060d03d10e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:11.547227 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4164/8319] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:57:11.679735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c99821-a383-4e60-b114-7060d03d10e2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:11.688584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425eeca1-1b50-4ec7-853a-b77ea71cf6e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:11.689474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eeca1-1b50-4ec7-853a-b77ea71cf6e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:11.689759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eeca1-1b50-4ec7-853a-b77ea71cf6e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:11.690037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eeca1-1b50-4ec7-853a-b77ea71cf6e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:11.701954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425eeca1-1b50-4ec7-853a-b77ea71cf6e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:11.703586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425eeca1-1b50-4ec7-853a-b77ea71cf6e4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:11.729492 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4156/8320] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:16.409583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affbf26-8682-47ba-8547-18a9b8582136 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:16.409583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1affbf26-8682-47ba-8547-18a9b8582136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:16.563518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affbf26-8682-47ba-8547-18a9b8582136 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:16.575677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b4309-01ab-4210-b5a3-b7bb2f1b48ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:16.576438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b4309-01ab-4210-b5a3-b7bb2f1b48ec service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:16.576786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b4309-01ab-4210-b5a3-b7bb2f1b48ec service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:16.577124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b4309-01ab-4210-b5a3-b7bb2f1b48ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:16.579763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c91b4309-01ab-4210-b5a3-b7bb2f1b48ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:16.767479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b4309-01ab-4210-b5a3-b7bb2f1b48ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:16.772069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b4309-01ab-4210-b5a3-b7bb2f1b48ec service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:16.797679 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4165/8321] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:16 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:20.017335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425eeca1-1b50-4ec7-853a-b77ea71cf6e4 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:20.034866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425eeca1-1b50-4ec7-853a-b77ea71cf6e4 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:20.041087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf11c1-40d2-469d-91b9-778856cdbb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:20.041998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf11c1-40d2-469d-91b9-778856cdbb4e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:20.042679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf11c1-40d2-469d-91b9-778856cdbb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:20.043357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf11c1-40d2-469d-91b9-778856cdbb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:20.048686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4eaf11c1-40d2-469d-91b9-778856cdbb4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:20.076662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf11c1-40d2-469d-91b9-778856cdbb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:20.078156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf11c1-40d2-469d-91b9-778856cdbb4e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:20.098244 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4157/8322] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:20.184199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b4309-01ab-4210-b5a3-b7bb2f1b48ec service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:20.189529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c91b4309-01ab-4210-b5a3-b7bb2f1b48ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:20.516706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:20.646750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b4309-01ab-4210-b5a3-b7bb2f1b48ec service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:20.654920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbf366-efa8-4bb2-9135-90c9ce65a3dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:20.655928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbf366-efa8-4bb2-9135-90c9ce65a3dc service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:20.656470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbf366-efa8-4bb2-9135-90c9ce65a3dc service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:20.656932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbf366-efa8-4bb2-9135-90c9ce65a3dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:20.659427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dbdbf366-efa8-4bb2-9135-90c9ce65a3dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:20.691171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbf366-efa8-4bb2-9135-90c9ce65a3dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:20.700680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbf366-efa8-4bb2-9135-90c9ce65a3dc service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:20.749087 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4166/8323] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:22.390232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf11c1-40d2-469d-91b9-778856cdbb4e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:22.397824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4eaf11c1-40d2-469d-91b9-778856cdbb4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:22.418978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf11c1-40d2-469d-91b9-778856cdbb4e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:22.425670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296e73a-a501-4de8-895e-acc95e40a081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:22.427051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296e73a-a501-4de8-895e-acc95e40a081 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:22.427984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296e73a-a501-4de8-895e-acc95e40a081 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:22.431868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296e73a-a501-4de8-895e-acc95e40a081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:22.435496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b296e73a-a501-4de8-895e-acc95e40a081 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:22.471871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296e73a-a501-4de8-895e-acc95e40a081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:22.473952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296e73a-a501-4de8-895e-acc95e40a081 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:22.492456 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4158/8324] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:23.454340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbf366-efa8-4bb2-9135-90c9ce65a3dc service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:23.467189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbf366-efa8-4bb2-9135-90c9ce65a3dc service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:23.472856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c073cd-e422-4ee1-a7c2-ea5b1f427fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:23.473760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c073cd-e422-4ee1-a7c2-ea5b1f427fef service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:23.475050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c073cd-e422-4ee1-a7c2-ea5b1f427fef service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:23.475568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c073cd-e422-4ee1-a7c2-ea5b1f427fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:23.478849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d4c073cd-e422-4ee1-a7c2-ea5b1f427fef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:23.512523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c073cd-e422-4ee1-a7c2-ea5b1f427fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:23.514005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c073cd-e422-4ee1-a7c2-ea5b1f427fef service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:23.544992 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4167/8325] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:23.553184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad51d5f-8608-4675-b90a-49b57315476b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:23.553632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad51d5f-8608-4675-b90a-49b57315476b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:23.554274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad51d5f-8608-4675-b90a-49b57315476b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:23.608404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5ad51d5f-8608-4675-b90a-49b57315476b None None] MFA Rules not processed for user `87b1618e8b794f36be81dd1e26b45fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:23.612842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ad51d5f-8608-4675-b90a-49b57315476b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:23.715459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34b0af-2a86-4399-a598-5965bdfd993f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:23.716141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34b0af-2a86-4399-a598-5965bdfd993f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:23.716589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34b0af-2a86-4399-a598-5965bdfd993f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:23.781916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1b34b0af-2a86-4399-a598-5965bdfd993f None None] MFA Rules not processed for user `5c3a1008f04b4e75a835f94703ba57dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:23.784832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1b34b0af-2a86-4399-a598-5965bdfd993f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:23.792179 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4159/8326] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:57:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:23.946716 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4168/8327] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:57:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:57:23.948712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad51d5f-8608-4675-b90a-49b57315476b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:23.989313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad51d5f-8608-4675-b90a-49b57315476b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:24.010105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17a660-b6f7-4447-95fa-2360c73fff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:24.011094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17a660-b6f7-4447-95fa-2360c73fff0d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:24.011893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17a660-b6f7-4447-95fa-2360c73fff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:24.012310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17a660-b6f7-4447-95fa-2360c73fff0d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:24.013103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17a660-b6f7-4447-95fa-2360c73fff0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:24.023825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17a660-b6f7-4447-95fa-2360c73fff0d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:24.079310 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4160/8328] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:57:23 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:57:24.085255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34b0af-2a86-4399-a598-5965bdfd993f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:24.101327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34b0af-2a86-4399-a598-5965bdfd993f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:24.306098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796c66d-7aa6-48a5-9385-76a414c1eef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:24.307785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796c66d-7aa6-48a5-9385-76a414c1eef2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:24.311071 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796c66d-7aa6-48a5-9385-76a414c1eef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:24.314279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796c66d-7aa6-48a5-9385-76a414c1eef2 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:24.315232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796c66d-7aa6-48a5-9385-76a414c1eef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:24.320659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796c66d-7aa6-48a5-9385-76a414c1eef2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:24.424186 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4169/8329] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:57:24 2022] POST /identity/v3/users => generated 294 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:57:24.425034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17a660-b6f7-4447-95fa-2360c73fff0d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:24.444979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17a660-b6f7-4447-95fa-2360c73fff0d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:24.471653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fcd61-6492-4293-8e62-648f4f41749f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:24.472205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fcd61-6492-4293-8e62-648f4f41749f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:24.472482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fcd61-6492-4293-8e62-648f4f41749f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:24.472755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fcd61-6492-4293-8e62-648f4f41749f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:24.473421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fcd61-6492-4293-8e62-648f4f41749f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:24.479169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fcd61-6492-4293-8e62-648f4f41749f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:24.521154 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4161/8330] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:24.524705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796c66d-7aa6-48a5-9385-76a414c1eef2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:24.541474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796c66d-7aa6-48a5-9385-76a414c1eef2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:24.554364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e1db5-bdd2-4c3c-b7fa-8ee5f669d786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:24.555363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e1db5-bdd2-4c3c-b7fa-8ee5f669d786 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:24.555793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e1db5-bdd2-4c3c-b7fa-8ee5f669d786 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:24.556232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e1db5-bdd2-4c3c-b7fa-8ee5f669d786 admin admin] PATH_INFO: `/v3/projects/1a973e2300d54754995c021d0ae71198/users/64907078a5494cf3aec118a04a9bfeef/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:24.627503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e1db5-bdd2-4c3c-b7fa-8ee5f669d786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a973e2300d54754995c021d0ae71198, user_id=64907078a5494cf3aec118a04a9bfeef, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:24.635758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e1db5-bdd2-4c3c-b7fa-8ee5f669d786 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:24.679102 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4170/8331] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:57:24 2022] PUT /identity/v3/projects/1a973e2300d54754995c021d0ae71198/users/64907078a5494cf3aec118a04a9bfeef/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:24.680485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fcd61-6492-4293-8e62-648f4f41749f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:24.691999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fcd61-6492-4293-8e62-648f4f41749f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:24.710796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:24.844097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dd0f5-cbbf-4363-9ed5-da3222fd01a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:24.844753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dd0f5-cbbf-4363-9ed5-da3222fd01a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:24.845036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dd0f5-cbbf-4363-9ed5-da3222fd01a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:24.845460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dd0f5-cbbf-4363-9ed5-da3222fd01a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:24.846126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dd0f5-cbbf-4363-9ed5-da3222fd01a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:24.850487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dd0f5-cbbf-4363-9ed5-da3222fd01a3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:24.880955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e1db5-bdd2-4c3c-b7fa-8ee5f669d786 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:24.881386 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4162/8332] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:24.887133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:24.897198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e1db5-bdd2-4c3c-b7fa-8ee5f669d786 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:24.914577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f140a4f-928f-48e4-85bf-67bae117e9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:24.915713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f140a4f-928f-48e4-85bf-67bae117e9f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:24.916300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f140a4f-928f-48e4-85bf-67bae117e9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:24.916791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f140a4f-928f-48e4-85bf-67bae117e9f5 admin admin] PATH_INFO: `/v3/projects/1a973e2300d54754995c021d0ae71198/users/64907078a5494cf3aec118a04a9bfeef/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:24.922862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f140a4f-928f-48e4-85bf-67bae117e9f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a973e2300d54754995c021d0ae71198, user_id=64907078a5494cf3aec118a04a9bfeef, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:24.925691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f140a4f-928f-48e4-85bf-67bae117e9f5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:24.999697 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4171/8333] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:57:24 2022] PUT /identity/v3/projects/1a973e2300d54754995c021d0ae71198/users/64907078a5494cf3aec118a04a9bfeef/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:25.798397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dd0f5-cbbf-4363-9ed5-da3222fd01a3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:25.805209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7c8dd0f5-cbbf-4363-9ed5-da3222fd01a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:25.988857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dd0f5-cbbf-4363-9ed5-da3222fd01a3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:26.190099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8130bf-5987-4563-9452-780d97ee5497 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:26.190763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8130bf-5987-4563-9452-780d97ee5497 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:26.191040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8130bf-5987-4563-9452-780d97ee5497 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:26.191527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8130bf-5987-4563-9452-780d97ee5497 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:26.194691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef8130bf-5987-4563-9452-780d97ee5497 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:26.236950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8130bf-5987-4563-9452-780d97ee5497 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:26.240024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8130bf-5987-4563-9452-780d97ee5497 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:26.274317 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4163/8334] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:33.323028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f140a4f-928f-48e4-85bf-67bae117e9f5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:33.353391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f140a4f-928f-48e4-85bf-67bae117e9f5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:33.360391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b80c1-895b-4ecd-ae75-7d97c5a97a4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:33.361213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b80c1-895b-4ecd-ae75-7d97c5a97a4c service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:33.361494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b80c1-895b-4ecd-ae75-7d97c5a97a4c service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:33.361949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b80c1-895b-4ecd-ae75-7d97c5a97a4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:33.363964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5f4b80c1-895b-4ecd-ae75-7d97c5a97a4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:33.382273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b80c1-895b-4ecd-ae75-7d97c5a97a4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:33.384370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b80c1-895b-4ecd-ae75-7d97c5a97a4c service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:33.401914 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4172/8335] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:33.938551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8130bf-5987-4563-9452-780d97ee5497 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:34.034447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:34.120563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8130bf-5987-4563-9452-780d97ee5497 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:34.136065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee3742-967c-4fcf-971c-f97cc7d46d79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:34.136980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3742-967c-4fcf-971c-f97cc7d46d79 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:34.137353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3742-967c-4fcf-971c-f97cc7d46d79 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:34.138262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3742-967c-4fcf-971c-f97cc7d46d79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:34.140420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e9ee3742-967c-4fcf-971c-f97cc7d46d79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:34.161761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee3742-967c-4fcf-971c-f97cc7d46d79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:34.164969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee3742-967c-4fcf-971c-f97cc7d46d79 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:34.199680 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4164/8336] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:57:38.145328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a93f0-99aa-4bcc-940d-1baaaae7e6c3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:38.146100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a93f0-99aa-4bcc-940d-1baaaae7e6c3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:38.146543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a93f0-99aa-4bcc-940d-1baaaae7e6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:38.225089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d06a93f0-99aa-4bcc-940d-1baaaae7e6c3 None None] MFA Rules not processed for user `64907078a5494cf3aec118a04a9bfeef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:38.226528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d06a93f0-99aa-4bcc-940d-1baaaae7e6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:38.498167 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4173/8337] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:57:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:38.512595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee3742-967c-4fcf-971c-f97cc7d46d79 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:38.514888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e9ee3742-967c-4fcf-971c-f97cc7d46d79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:38.598887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee3742-967c-4fcf-971c-f97cc7d46d79 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:38.624451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99fd0f-c78c-4997-b478-6b592a782911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:38.625568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99fd0f-c78c-4997-b478-6b592a782911 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:38.626056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99fd0f-c78c-4997-b478-6b592a782911 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:38.626539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99fd0f-c78c-4997-b478-6b592a782911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:38.665155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99fd0f-c78c-4997-b478-6b592a782911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:38.668652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99fd0f-c78c-4997-b478-6b592a782911 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:38.706304 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4165/8338] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:57:38.819006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8ad11-cfd8-4fe2-aaf0-c3a357fe97c8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:38.819947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8ad11-cfd8-4fe2-aaf0-c3a357fe97c8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:38.820649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8ad11-cfd8-4fe2-aaf0-c3a357fe97c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:38.902234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b4f8ad11-cfd8-4fe2-aaf0-c3a357fe97c8 None None] MFA Rules not processed for user `5c3a1008f04b4e75a835f94703ba57dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:38.905494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b4f8ad11-cfd8-4fe2-aaf0-c3a357fe97c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:39.052010 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4174/8339] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:57:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:40.346376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99fd0f-c78c-4997-b478-6b592a782911 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:40.538385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99fd0f-c78c-4997-b478-6b592a782911 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:40.563887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f6731-f371-4e49-bef9-9d2a2d9c2f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:40.564261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f6731-f371-4e49-bef9-9d2a2d9c2f2f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:40.564643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f6731-f371-4e49-bef9-9d2a2d9c2f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:40.565019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f6731-f371-4e49-bef9-9d2a2d9c2f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:40.580483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d5f6731-f371-4e49-bef9-9d2a2d9c2f2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:40.608544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f6731-f371-4e49-bef9-9d2a2d9c2f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:40.611052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f6731-f371-4e49-bef9-9d2a2d9c2f2f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:40.626266 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4166/8340] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:42.934542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8ad11-cfd8-4fe2-aaf0-c3a357fe97c8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:42.935046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b4f8ad11-cfd8-4fe2-aaf0-c3a357fe97c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:43.104561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8ad11-cfd8-4fe2-aaf0-c3a357fe97c8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:43.120078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccb679-0ffc-4798-831b-11f7f392810d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:43.124279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccb679-0ffc-4798-831b-11f7f392810d service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:43.126063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccb679-0ffc-4798-831b-11f7f392810d service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:43.128739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccb679-0ffc-4798-831b-11f7f392810d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:43.136724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-92ccb679-0ffc-4798-831b-11f7f392810d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:43.158493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:43.303543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccb679-0ffc-4798-831b-11f7f392810d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:43.305316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccb679-0ffc-4798-831b-11f7f392810d service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:43.320101 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4175/8341] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:57:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 734 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:57:43.926525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f6731-f371-4e49-bef9-9d2a2d9c2f2f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:43.961644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f6731-f371-4e49-bef9-9d2a2d9c2f2f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:43.978650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a44b8-c7bb-4685-91ee-f206fb78ae82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:43.979348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a44b8-c7bb-4685-91ee-f206fb78ae82 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:43.979610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a44b8-c7bb-4685-91ee-f206fb78ae82 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:43.979891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a44b8-c7bb-4685-91ee-f206fb78ae82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:43.989784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a81a44b8-c7bb-4685-91ee-f206fb78ae82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:44.031005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a44b8-c7bb-4685-91ee-f206fb78ae82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:44.034180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a44b8-c7bb-4685-91ee-f206fb78ae82 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:44.075819 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4167/8342] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:51.683025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccb679-0ffc-4798-831b-11f7f392810d service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:51.705212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccb679-0ffc-4798-831b-11f7f392810d service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:51.719178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7917fd5-6847-40ca-80f4-42197bac191f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:51.719831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7917fd5-6847-40ca-80f4-42197bac191f service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:51.720112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7917fd5-6847-40ca-80f4-42197bac191f service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:51.720423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7917fd5-6847-40ca-80f4-42197bac191f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:51.727009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c7917fd5-6847-40ca-80f4-42197bac191f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:51.745677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7917fd5-6847-40ca-80f4-42197bac191f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:51.747894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7917fd5-6847-40ca-80f4-42197bac191f service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:51.767314 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4176/8343] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:51.848274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a44b8-c7bb-4685-91ee-f206fb78ae82 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:51.850318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a81a44b8-c7bb-4685-91ee-f206fb78ae82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:52.033511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a44b8-c7bb-4685-91ee-f206fb78ae82 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:52.040640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece2183-a308-4c00-9632-8b8dc238e3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:52.041390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece2183-a308-4c00-9632-8b8dc238e3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:52.041733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece2183-a308-4c00-9632-8b8dc238e3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:52.042067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece2183-a308-4c00-9632-8b8dc238e3bb admin admin] PATH_INFO: `/v3/users/c2eb2f3c887947d5978d6bebd51c5b72` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:52.043710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece2183-a308-4c00-9632-8b8dc238e3bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2eb2f3c887947d5978d6bebd51c5b72)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:52.048737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece2183-a308-4c00-9632-8b8dc238e3bb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:52.080585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:52.119967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ece2183-a308-4c00-9632-8b8dc238e3bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2eb2f3c887947d5978d6bebd51c5b72'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:52.121768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ece2183-a308-4c00-9632-8b8dc238e3bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2eb2f3c887947d5978d6bebd51c5b72'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:52.141685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ece2183-a308-4c00-9632-8b8dc238e3bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2eb2f3c887947d5978d6bebd51c5b72'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:52.156086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ece2183-a308-4c00-9632-8b8dc238e3bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2eb2f3c887947d5978d6bebd51c5b72'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:52.200337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ece2183-a308-4c00-9632-8b8dc238e3bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2eb2f3c887947d5978d6bebd51c5b72'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:52.214303 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4168/8344] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:57:51 2022] DELETE /identity/v3/users/c2eb2f3c887947d5978d6bebd51c5b72 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:52.218779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc67e0-9868-43d9-97d4-34bdc8c59809 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:52.219247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc67e0-9868-43d9-97d4-34bdc8c59809 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:52.219701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc67e0-9868-43d9-97d4-34bdc8c59809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:52.273041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-76bc67e0-9868-43d9-97d4-34bdc8c59809 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:52.274722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-76bc67e0-9868-43d9-97d4-34bdc8c59809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:52.432546 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4177/8345] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:52.463761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece2183-a308-4c00-9632-8b8dc238e3bb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:52.465445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1ece2183-a308-4c00-9632-8b8dc238e3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:52.604385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece2183-a308-4c00-9632-8b8dc238e3bb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:52.617714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a52ecd-02b7-4b38-8be1-9ddb2409c869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:52.618381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a52ecd-02b7-4b38-8be1-9ddb2409c869 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:52.618694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a52ecd-02b7-4b38-8be1-9ddb2409c869 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:52.619146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a52ecd-02b7-4b38-8be1-9ddb2409c869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:52.653250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a52ecd-02b7-4b38-8be1-9ddb2409c869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:52.658711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a52ecd-02b7-4b38-8be1-9ddb2409c869 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:52.692038 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4169/8346] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:54.436848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc67e0-9868-43d9-97d4-34bdc8c59809 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:54.438311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-76bc67e0-9868-43d9-97d4-34bdc8c59809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:54.461684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc67e0-9868-43d9-97d4-34bdc8c59809 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:54.468963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b672acf-c887-4486-a1ad-1119723d8f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:54.469629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b672acf-c887-4486-a1ad-1119723d8f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:54.469916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b672acf-c887-4486-a1ad-1119723d8f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:54.470184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b672acf-c887-4486-a1ad-1119723d8f50 admin admin] PATH_INFO: `/v3/projects/cafa7fa7ca3f45369b2dbb26772217fd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:54.480265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b672acf-c887-4486-a1ad-1119723d8f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cafa7fa7ca3f45369b2dbb26772217fd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:54.482241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b672acf-c887-4486-a1ad-1119723d8f50 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:54.570097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5b672acf-c887-4486-a1ad-1119723d8f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cafa7fa7ca3f45369b2dbb26772217fd', 'request_id': 'req-5b672acf-c887-4486-a1ad-1119723d8f50'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:54.579694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5b672acf-c887-4486-a1ad-1119723d8f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cafa7fa7ca3f45369b2dbb26772217fd', 'request_id': 'req-5b672acf-c887-4486-a1ad-1119723d8f50'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:54.588305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5b672acf-c887-4486-a1ad-1119723d8f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cafa7fa7ca3f45369b2dbb26772217fd', 'request_id': 'req-5b672acf-c887-4486-a1ad-1119723d8f50'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:54.618054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5b672acf-c887-4486-a1ad-1119723d8f50 admin admin] The token cache is being invalidate because project cafa7fa7ca3f45369b2dbb26772217fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:57:54.635912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5b672acf-c887-4486-a1ad-1119723d8f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:54.639741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5b672acf-c887-4486-a1ad-1119723d8f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:54.642921 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4178/8347] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:57:54 2022] DELETE /identity/v3/projects/cafa7fa7ca3f45369b2dbb26772217fd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:54.647044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a52ecd-02b7-4b38-8be1-9ddb2409c869 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:54.662831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a52ecd-02b7-4b38-8be1-9ddb2409c869 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:54.755472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294a691-4b4b-4ce5-8955-5fa4dfbe3150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:54.756696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a691-4b4b-4ce5-8955-5fa4dfbe3150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:54.757135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a691-4b4b-4ce5-8955-5fa4dfbe3150 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:54.757759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a691-4b4b-4ce5-8955-5fa4dfbe3150 admin admin] PATH_INFO: `/v3/users/dc6fc646ae294d55b5d0ef31da75f153` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:54.759362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294a691-4b4b-4ce5-8955-5fa4dfbe3150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc6fc646ae294d55b5d0ef31da75f153)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:54.761829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294a691-4b4b-4ce5-8955-5fa4dfbe3150 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:54.875096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a294a691-4b4b-4ce5-8955-5fa4dfbe3150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc6fc646ae294d55b5d0ef31da75f153'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:54.876027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:54.876893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a294a691-4b4b-4ce5-8955-5fa4dfbe3150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc6fc646ae294d55b5d0ef31da75f153'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:54.894037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a294a691-4b4b-4ce5-8955-5fa4dfbe3150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc6fc646ae294d55b5d0ef31da75f153'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:54.919166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a294a691-4b4b-4ce5-8955-5fa4dfbe3150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc6fc646ae294d55b5d0ef31da75f153'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:54.956852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a294a691-4b4b-4ce5-8955-5fa4dfbe3150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc6fc646ae294d55b5d0ef31da75f153'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:54.969889 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4170/8348] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:57:54 2022] DELETE /identity/v3/users/dc6fc646ae294d55b5d0ef31da75f153 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:55.638364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b672acf-c887-4486-a1ad-1119723d8f50 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:55.640885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5b672acf-c887-4486-a1ad-1119723d8f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:55.684650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b672acf-c887-4486-a1ad-1119723d8f50 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:55.703975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:55.834801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87712a2-ce72-493c-9609-915f2603abbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:55.835744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87712a2-ce72-493c-9609-915f2603abbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:55.836081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87712a2-ce72-493c-9609-915f2603abbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:55.837020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87712a2-ce72-493c-9609-915f2603abbe admin admin] PATH_INFO: `/v3/projects/da1686b8ac814944aace0dea9ac471b6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:55.841389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87712a2-ce72-493c-9609-915f2603abbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1686b8ac814944aace0dea9ac471b6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:55.844099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87712a2-ce72-493c-9609-915f2603abbe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:55.985830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b87712a2-ce72-493c-9609-915f2603abbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1686b8ac814944aace0dea9ac471b6', 'request_id': 'req-b87712a2-ce72-493c-9609-915f2603abbe'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:55.994204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b87712a2-ce72-493c-9609-915f2603abbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1686b8ac814944aace0dea9ac471b6', 'request_id': 'req-b87712a2-ce72-493c-9609-915f2603abbe'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:56.003390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b87712a2-ce72-493c-9609-915f2603abbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1686b8ac814944aace0dea9ac471b6', 'request_id': 'req-b87712a2-ce72-493c-9609-915f2603abbe'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:56.027930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b87712a2-ce72-493c-9609-915f2603abbe admin admin] The token cache is being invalidate because project da1686b8ac814944aace0dea9ac471b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:57:56.028570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b87712a2-ce72-493c-9609-915f2603abbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:56.029399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b87712a2-ce72-493c-9609-915f2603abbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:56.032690 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4179/8349] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:57:55 2022] DELETE /identity/v3/projects/da1686b8ac814944aace0dea9ac471b6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:56.040111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1580c9-7bd9-4095-b500-0ae3a8393b76 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:56.041395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1580c9-7bd9-4095-b500-0ae3a8393b76 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:56.041879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1580c9-7bd9-4095-b500-0ae3a8393b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:56.155773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0d1580c9-7bd9-4095-b500-0ae3a8393b76 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:56.157528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d1580c9-7bd9-4095-b500-0ae3a8393b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:56.275047 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4171/8350] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:57:56.278116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cabd8-77db-46c6-8c25-8ea9887e7d47 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:56.278336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cabd8-77db-46c6-8c25-8ea9887e7d47 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:56.278627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cabd8-77db-46c6-8c25-8ea9887e7d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:56.311163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-674cabd8-77db-46c6-8c25-8ea9887e7d47 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:56.315151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-674cabd8-77db-46c6-8c25-8ea9887e7d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:56.353958 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4180/8351] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:56.358275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1580c9-7bd9-4095-b500-0ae3a8393b76 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:56.377649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1580c9-7bd9-4095-b500-0ae3a8393b76 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:56.396017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c2053-6f5b-45a5-aae2-9c7340f5be5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:56.397418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c2053-6f5b-45a5-aae2-9c7340f5be5d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:56.397917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c2053-6f5b-45a5-aae2-9c7340f5be5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:56.398417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c2053-6f5b-45a5-aae2-9c7340f5be5d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:56.400245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c2053-6f5b-45a5-aae2-9c7340f5be5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:57:56.400783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c2053-6f5b-45a5-aae2-9c7340f5be5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:56.404350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c2053-6f5b-45a5-aae2-9c7340f5be5d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:56.467034 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4172/8352] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:57:56.471980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cabd8-77db-46c6-8c25-8ea9887e7d47 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:56.487668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cabd8-77db-46c6-8c25-8ea9887e7d47 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:56.496121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6df70-77ed-46e8-b64f-814dfcb25427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:56.496793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6df70-77ed-46e8-b64f-814dfcb25427 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:56.497067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6df70-77ed-46e8-b64f-814dfcb25427 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:56.497338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6df70-77ed-46e8-b64f-814dfcb25427 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:56.497998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6df70-77ed-46e8-b64f-814dfcb25427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:56.500011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6df70-77ed-46e8-b64f-814dfcb25427 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:56.580337 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4181/8353] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:57:56 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:57:56.584757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c2053-6f5b-45a5-aae2-9c7340f5be5d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:56.614115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c2053-6f5b-45a5-aae2-9c7340f5be5d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:56.805644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb769d-3c79-4057-893f-65e52253bd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:56.806322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb769d-3c79-4057-893f-65e52253bd0e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:56.807421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb769d-3c79-4057-893f-65e52253bd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:56.807701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb769d-3c79-4057-893f-65e52253bd0e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:56.808346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb769d-3c79-4057-893f-65e52253bd0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:56.820612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb769d-3c79-4057-893f-65e52253bd0e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:56.911404 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4173/8354] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:57:56 2022] POST /identity/v3/users => generated 291 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:57:56.912287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6df70-77ed-46e8-b64f-814dfcb25427 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:56.931969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6df70-77ed-46e8-b64f-814dfcb25427 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:56.951942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b63f8a-48a5-4850-ad8e-95971a17a4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:56.952665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b63f8a-48a5-4850-ad8e-95971a17a4fa admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:56.958666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b63f8a-48a5-4850-ad8e-95971a17a4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:56.958973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b63f8a-48a5-4850-ad8e-95971a17a4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:56.959746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b63f8a-48a5-4850-ad8e-95971a17a4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:56.961303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b63f8a-48a5-4850-ad8e-95971a17a4fa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:56.987278 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4182/8355] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:56.989798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb769d-3c79-4057-893f-65e52253bd0e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:57.005107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb769d-3c79-4057-893f-65e52253bd0e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:57.011750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c40528-0b29-4545-ad1b-4f5aafa2f326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:57.012388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c40528-0b29-4545-ad1b-4f5aafa2f326 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:57.012659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c40528-0b29-4545-ad1b-4f5aafa2f326 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:57.012933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c40528-0b29-4545-ad1b-4f5aafa2f326 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:57.013770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c40528-0b29-4545-ad1b-4f5aafa2f326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:57.016565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c40528-0b29-4545-ad1b-4f5aafa2f326 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:57.035179 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4174/8356] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:57.041125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b63f8a-48a5-4850-ad8e-95971a17a4fa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:57.054066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b63f8a-48a5-4850-ad8e-95971a17a4fa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:57.060076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67b99e-c4fb-4eb7-ac0f-6f05cf09fceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:57.060757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67b99e-c4fb-4eb7-ac0f-6f05cf09fceb admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:57.061039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67b99e-c4fb-4eb7-ac0f-6f05cf09fceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:57.061468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67b99e-c4fb-4eb7-ac0f-6f05cf09fceb admin admin] PATH_INFO: `/v3/projects/7e0a82594c6a4405a424af68436190e9/users/ce13155820524da2b6d8cc5c23373953/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:57.084002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67b99e-c4fb-4eb7-ac0f-6f05cf09fceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0a82594c6a4405a424af68436190e9, user_id=ce13155820524da2b6d8cc5c23373953, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:57.086219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67b99e-c4fb-4eb7-ac0f-6f05cf09fceb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:57.111206 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4183/8357] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:57:57 2022] PUT /identity/v3/projects/7e0a82594c6a4405a424af68436190e9/users/ce13155820524da2b6d8cc5c23373953/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:57.116281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c53bb-17bf-42aa-81ec-c873b8d9097d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:57.117128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c53bb-17bf-42aa-81ec-c873b8d9097d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:57.117553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c53bb-17bf-42aa-81ec-c873b8d9097d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:57.128604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:57.150627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b43c53bb-17bf-42aa-81ec-c873b8d9097d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:57.153082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b43c53bb-17bf-42aa-81ec-c873b8d9097d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:57.243852 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4175/8358] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:57:57.256166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67b99e-c4fb-4eb7-ac0f-6f05cf09fceb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:57.258015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5a67b99e-c4fb-4eb7-ac0f-6f05cf09fceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:57.323116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:57.397645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67b99e-c4fb-4eb7-ac0f-6f05cf09fceb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:57.402230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace4dc1-814a-4432-9f54-162fa3c25b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:57.402870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4dc1-814a-4432-9f54-162fa3c25b71 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:57.403157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4dc1-814a-4432-9f54-162fa3c25b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:57.403459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4dc1-814a-4432-9f54-162fa3c25b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:57.426865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace4dc1-814a-4432-9f54-162fa3c25b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:57.430594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace4dc1-814a-4432-9f54-162fa3c25b71 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:57.456117 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4184/8359] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:58:07.233598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=25 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:07.402599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493072-b5cf-416d-a43e-93b12548a8b1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:07.402831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493072-b5cf-416d-a43e-93b12548a8b1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:07.403107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493072-b5cf-416d-a43e-93b12548a8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:07.451521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=11 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:07.454083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-df493072-b5cf-416d-a43e-93b12548a8b1 None None] MFA Rules not processed for user `5c3a1008f04b4e75a835f94703ba57dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:07.455343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-df493072-b5cf-416d-a43e-93b12548a8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:07.639853 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4176/8360] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:58:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:14.354394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d4a2b-e3cf-451f-b281-ce2dab1135b7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:14.354815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d4a2b-e3cf-451f-b281-ce2dab1135b7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:14.354982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d4a2b-e3cf-451f-b281-ce2dab1135b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:14.410853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-408d4a2b-e3cf-451f-b281-ce2dab1135b7 None None] MFA Rules not processed for user `ce13155820524da2b6d8cc5c23373953`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:14.412141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-408d4a2b-e3cf-451f-b281-ce2dab1135b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:14.588944 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4185/8361] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:58:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:14.590243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df493072-b5cf-416d-a43e-93b12548a8b1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:14.610819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df493072-b5cf-416d-a43e-93b12548a8b1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:14.616013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27445a-5fc6-4608-b5ab-cc6ee9f5cb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:14.616918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27445a-5fc6-4608-b5ab-cc6ee9f5cb88 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:14.617352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27445a-5fc6-4608-b5ab-cc6ee9f5cb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:14.618203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27445a-5fc6-4608-b5ab-cc6ee9f5cb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:14.619004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27445a-5fc6-4608-b5ab-cc6ee9f5cb88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:14.628850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27445a-5fc6-4608-b5ab-cc6ee9f5cb88 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:14.692942 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4177/8362] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:58:14 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:58:14.698519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d4a2b-e3cf-451f-b281-ce2dab1135b7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:14.731321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d4a2b-e3cf-451f-b281-ce2dab1135b7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:14.898111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898af43-e80d-421e-9684-03c9038d5ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:14.898890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898af43-e80d-421e-9684-03c9038d5ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:14.904140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898af43-e80d-421e-9684-03c9038d5ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:14.904777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898af43-e80d-421e-9684-03c9038d5ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:14.905609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898af43-e80d-421e-9684-03c9038d5ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:14.908353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898af43-e80d-421e-9684-03c9038d5ea1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:14.979520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27445a-5fc6-4608-b5ab-cc6ee9f5cb88 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:14.980818 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4186/8363] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:58:14 2022] POST /identity/v3/users => generated 298 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:58:14.996619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27445a-5fc6-4608-b5ab-cc6ee9f5cb88 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:15.009838 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5834b97-c6af-46df-84ee-3de72e136068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:15.011095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5834b97-c6af-46df-84ee-3de72e136068 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:15.012480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5834b97-c6af-46df-84ee-3de72e136068 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:15.013487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5834b97-c6af-46df-84ee-3de72e136068 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:15.016026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5834b97-c6af-46df-84ee-3de72e136068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:15.019917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5834b97-c6af-46df-84ee-3de72e136068 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:15.037286 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4178/8364] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:58:15.041236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898af43-e80d-421e-9684-03c9038d5ea1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:15.060829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898af43-e80d-421e-9684-03c9038d5ea1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:15.080212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b0020-ab5a-4cfb-8bca-311219481a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:15.082374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b0020-ab5a-4cfb-8bca-311219481a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:15.083619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b0020-ab5a-4cfb-8bca-311219481a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:15.084156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b0020-ab5a-4cfb-8bca-311219481a1b admin admin] PATH_INFO: `/v3/projects/510ef1b781de4b8ea5e3d0a07056a1f5/users/450037f4e0dc4452813c727462bd7052/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:15.124345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b0020-ab5a-4cfb-8bca-311219481a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=510ef1b781de4b8ea5e3d0a07056a1f5, user_id=450037f4e0dc4452813c727462bd7052, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:15.135983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b0020-ab5a-4cfb-8bca-311219481a1b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:15.163721 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4187/8365] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:58:15 2022] PUT /identity/v3/projects/510ef1b781de4b8ea5e3d0a07056a1f5/users/450037f4e0dc4452813c727462bd7052/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:58:15.164950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5834b97-c6af-46df-84ee-3de72e136068 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:15.183192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5834b97-c6af-46df-84ee-3de72e136068 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:15.268291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe86fe4-6f33-40a5-b579-ebe2fa47983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:15.269226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe86fe4-6f33-40a5-b579-ebe2fa47983a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:15.269618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe86fe4-6f33-40a5-b579-ebe2fa47983a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:15.270047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe86fe4-6f33-40a5-b579-ebe2fa47983a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:15.270820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe86fe4-6f33-40a5-b579-ebe2fa47983a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:15.272795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe86fe4-6f33-40a5-b579-ebe2fa47983a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:15.296789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b0020-ab5a-4cfb-8bca-311219481a1b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:15.300640 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4179/8366] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:58:15.320805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b0020-ab5a-4cfb-8bca-311219481a1b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:15.335036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb180efc-be4b-47b2-979e-6e28b7c8a9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:15.335814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb180efc-be4b-47b2-979e-6e28b7c8a9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:15.336126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb180efc-be4b-47b2-979e-6e28b7c8a9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:15.338607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb180efc-be4b-47b2-979e-6e28b7c8a9e8 admin admin] PATH_INFO: `/v3/projects/510ef1b781de4b8ea5e3d0a07056a1f5/users/450037f4e0dc4452813c727462bd7052/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:15.345053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb180efc-be4b-47b2-979e-6e28b7c8a9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=510ef1b781de4b8ea5e3d0a07056a1f5, user_id=450037f4e0dc4452813c727462bd7052, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:15.347787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb180efc-be4b-47b2-979e-6e28b7c8a9e8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:15.379096 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4188/8367] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:58:15 2022] PUT /identity/v3/projects/510ef1b781de4b8ea5e3d0a07056a1f5/users/450037f4e0dc4452813c727462bd7052/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:58:25.281129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=68,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:25.366682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=76,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:30.861040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5911078-ca3e-4355-9beb-6fb90e082e06 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:30.861040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5911078-ca3e-4355-9beb-6fb90e082e06 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:30.861040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5911078-ca3e-4355-9beb-6fb90e082e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:30.918343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d5911078-ca3e-4355-9beb-6fb90e082e06 None None] MFA Rules not processed for user `450037f4e0dc4452813c727462bd7052`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:30.922132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5911078-ca3e-4355-9beb-6fb90e082e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:31.136466 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4180/8368] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:58:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:31.144035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb180efc-be4b-47b2-979e-6e28b7c8a9e8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:31.145814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cb180efc-be4b-47b2-979e-6e28b7c8a9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:31.363147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb180efc-be4b-47b2-979e-6e28b7c8a9e8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:31.367727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6047fd-1aba-4bf2-9e2b-786242772a2c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:31.368603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6047fd-1aba-4bf2-9e2b-786242772a2c service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:31.369042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6047fd-1aba-4bf2-9e2b-786242772a2c service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:31.369507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6047fd-1aba-4bf2-9e2b-786242772a2c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:31.508498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6047fd-1aba-4bf2-9e2b-786242772a2c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:31.509983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6047fd-1aba-4bf2-9e2b-786242772a2c service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:31.545979 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4189/8369] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:58:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:58:41.123733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=34 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:41.521679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=52 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:00.225865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5911078-ca3e-4355-9beb-6fb90e082e06 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:00.227649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5911078-ca3e-4355-9beb-6fb90e082e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:00.412350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5911078-ca3e-4355-9beb-6fb90e082e06 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:00.427875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7fb32-f2fa-48ee-b861-907d7a44a7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:00.429500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7fb32-f2fa-48ee-b861-907d7a44a7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:00.430026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7fb32-f2fa-48ee-b861-907d7a44a7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:00.430534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7fb32-f2fa-48ee-b861-907d7a44a7a9 admin admin] PATH_INFO: `/v3/users/5c3a1008f04b4e75a835f94703ba57dc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:00.434836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7fb32-f2fa-48ee-b861-907d7a44a7a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3a1008f04b4e75a835f94703ba57dc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:00.438535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7fb32-f2fa-48ee-b861-907d7a44a7a9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:00.566755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bbf7fb32-f2fa-48ee-b861-907d7a44a7a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3a1008f04b4e75a835f94703ba57dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:00.576135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bbf7fb32-f2fa-48ee-b861-907d7a44a7a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3a1008f04b4e75a835f94703ba57dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:00.605705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bbf7fb32-f2fa-48ee-b861-907d7a44a7a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3a1008f04b4e75a835f94703ba57dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:00.624760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bbf7fb32-f2fa-48ee-b861-907d7a44a7a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3a1008f04b4e75a835f94703ba57dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:00.642928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bbf7fb32-f2fa-48ee-b861-907d7a44a7a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3a1008f04b4e75a835f94703ba57dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:00.655479 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4181/8370] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:59:00 2022] DELETE /identity/v3/users/5c3a1008f04b4e75a835f94703ba57dc => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:01.116580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6047fd-1aba-4bf2-9e2b-786242772a2c service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:01.134609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6047fd-1aba-4bf2-9e2b-786242772a2c service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:01.317726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99862301-fcde-40d5-ba77-cd67a82a6be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:01.323138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99862301-fcde-40d5-ba77-cd67a82a6be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:01.323802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99862301-fcde-40d5-ba77-cd67a82a6be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:01.324326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99862301-fcde-40d5-ba77-cd67a82a6be5 admin admin] PATH_INFO: `/v3/projects/1ee9871cd3c142a49f5f01bcf1ce0cb9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:01.333200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99862301-fcde-40d5-ba77-cd67a82a6be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee9871cd3c142a49f5f01bcf1ce0cb9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:01.338003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99862301-fcde-40d5-ba77-cd67a82a6be5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:01.547922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99862301-fcde-40d5-ba77-cd67a82a6be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee9871cd3c142a49f5f01bcf1ce0cb9', 'request_id': 'req-99862301-fcde-40d5-ba77-cd67a82a6be5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:01.580315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99862301-fcde-40d5-ba77-cd67a82a6be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee9871cd3c142a49f5f01bcf1ce0cb9', 'request_id': 'req-99862301-fcde-40d5-ba77-cd67a82a6be5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:01.606489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99862301-fcde-40d5-ba77-cd67a82a6be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee9871cd3c142a49f5f01bcf1ce0cb9', 'request_id': 'req-99862301-fcde-40d5-ba77-cd67a82a6be5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:01.654434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99862301-fcde-40d5-ba77-cd67a82a6be5 admin admin] The token cache is being invalidate because project 1ee9871cd3c142a49f5f01bcf1ce0cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:59:01.655818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99862301-fcde-40d5-ba77-cd67a82a6be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:01.657759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99862301-fcde-40d5-ba77-cd67a82a6be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:01.660717 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4190/8371] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:59:01 2022] DELETE /identity/v3/projects/1ee9871cd3c142a49f5f01bcf1ce0cb9 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:01.666174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7fb32-f2fa-48ee-b861-907d7a44a7a9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:01.668826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bbf7fb32-f2fa-48ee-b861-907d7a44a7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:01.693113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7fb32-f2fa-48ee-b861-907d7a44a7a9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:01.808741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6250d99-1f76-4a4c-9c54-23fa914f8b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:01.812031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6250d99-1f76-4a4c-9c54-23fa914f8b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:01.812351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6250d99-1f76-4a4c-9c54-23fa914f8b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:01.812593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6250d99-1f76-4a4c-9c54-23fa914f8b11 admin admin] PATH_INFO: `/v3/users/64907078a5494cf3aec118a04a9bfeef` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:01.814753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6250d99-1f76-4a4c-9c54-23fa914f8b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64907078a5494cf3aec118a04a9bfeef)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:01.817186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6250d99-1f76-4a4c-9c54-23fa914f8b11 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:01.861654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:01.973012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d6250d99-1f76-4a4c-9c54-23fa914f8b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64907078a5494cf3aec118a04a9bfeef'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:01.978151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d6250d99-1f76-4a4c-9c54-23fa914f8b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64907078a5494cf3aec118a04a9bfeef'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:02.010942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d6250d99-1f76-4a4c-9c54-23fa914f8b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64907078a5494cf3aec118a04a9bfeef'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:02.030318 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d6250d99-1f76-4a4c-9c54-23fa914f8b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64907078a5494cf3aec118a04a9bfeef'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:02.084963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d6250d99-1f76-4a4c-9c54-23fa914f8b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64907078a5494cf3aec118a04a9bfeef'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:02.125366 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4182/8372] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:59:01 2022] DELETE /identity/v3/users/64907078a5494cf3aec118a04a9bfeef => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:02.331670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99862301-fcde-40d5-ba77-cd67a82a6be5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:02.334080 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-99862301-fcde-40d5-ba77-cd67a82a6be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:02.351858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99862301-fcde-40d5-ba77-cd67a82a6be5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:02.548425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be895aae-347f-48be-b24e-eb2f73f95621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:02.550065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be895aae-347f-48be-b24e-eb2f73f95621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:02.553226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be895aae-347f-48be-b24e-eb2f73f95621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:02.562888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be895aae-347f-48be-b24e-eb2f73f95621 admin admin] PATH_INFO: `/v3/users/cb8ace6dbe7d4966bc0cde77250cd7de` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:02.568659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be895aae-347f-48be-b24e-eb2f73f95621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb8ace6dbe7d4966bc0cde77250cd7de)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:02.571040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be895aae-347f-48be-b24e-eb2f73f95621 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:02.622913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6250d99-1f76-4a4c-9c54-23fa914f8b11 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:02.629289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6250d99-1f76-4a4c-9c54-23fa914f8b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:02.656654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:02.689460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-be895aae-347f-48be-b24e-eb2f73f95621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb8ace6dbe7d4966bc0cde77250cd7de'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:02.711296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6250d99-1f76-4a4c-9c54-23fa914f8b11 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:02.730546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-be895aae-347f-48be-b24e-eb2f73f95621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb8ace6dbe7d4966bc0cde77250cd7de'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:02.732389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-be895aae-347f-48be-b24e-eb2f73f95621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb8ace6dbe7d4966bc0cde77250cd7de'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:02.734188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-be895aae-347f-48be-b24e-eb2f73f95621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb8ace6dbe7d4966bc0cde77250cd7de'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:02.739793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:02.748223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:02.748862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:02.749670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec admin admin] PATH_INFO: `/v3/projects/1a973e2300d54754995c021d0ae71198` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:02.754823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a973e2300d54754995c021d0ae71198)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:02.755965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-be895aae-347f-48be-b24e-eb2f73f95621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb8ace6dbe7d4966bc0cde77250cd7de'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:02.768441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:02.780884 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4191/8373] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:59:02 2022] DELETE /identity/v3/users/cb8ace6dbe7d4966bc0cde77250cd7de => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:59:02.788409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc610474-8d1a-4923-8acd-dd2ad1b6d241 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:02.789082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc610474-8d1a-4923-8acd-dd2ad1b6d241 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:02.789621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc610474-8d1a-4923-8acd-dd2ad1b6d241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:02.825401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dc610474-8d1a-4923-8acd-dd2ad1b6d241 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:02.828208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dc610474-8d1a-4923-8acd-dd2ad1b6d241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:02.878386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a973e2300d54754995c021d0ae71198', 'request_id': 'req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:02.895836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a973e2300d54754995c021d0ae71198', 'request_id': 'req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:02.911394 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a973e2300d54754995c021d0ae71198', 'request_id': 'req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:02.942808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec admin admin] The token cache is being invalidate because project 1a973e2300d54754995c021d0ae71198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:59:02.943636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:02.945243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:02.948109 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4183/8374] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:59:02 2022] DELETE /identity/v3/projects/1a973e2300d54754995c021d0ae71198 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:02.973184 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4192/8375] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:02.990357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:02.993947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:03.159988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc19278-baa0-4dcd-b3b2-ab68c1d2dfec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:03.173999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13f1d4-6f94-4779-8561-01a38c7e7989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:03.174959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13f1d4-6f94-4779-8561-01a38c7e7989 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:03.176835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13f1d4-6f94-4779-8561-01a38c7e7989 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:03.177442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13f1d4-6f94-4779-8561-01a38c7e7989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:03.259107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:03.327100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13f1d4-6f94-4779-8561-01a38c7e7989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:03.330234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13f1d4-6f94-4779-8561-01a38c7e7989 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:03.353317 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4184/8376] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:03.698148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc610474-8d1a-4923-8acd-dd2ad1b6d241 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:03.702542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dc610474-8d1a-4923-8acd-dd2ad1b6d241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:03.735203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc610474-8d1a-4923-8acd-dd2ad1b6d241 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:03.744349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9536e2-ecd8-49c7-894e-b682cafa7380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:03.745186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9536e2-ecd8-49c7-894e-b682cafa7380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:03.745637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9536e2-ecd8-49c7-894e-b682cafa7380 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:03.746103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9536e2-ecd8-49c7-894e-b682cafa7380 admin admin] PATH_INFO: `/v3/projects/9c5dfe7182c0435ca1121834de3ee075` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:03.747545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9536e2-ecd8-49c7-894e-b682cafa7380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c5dfe7182c0435ca1121834de3ee075)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:03.750445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9536e2-ecd8-49c7-894e-b682cafa7380 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:03.832226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fc9536e2-ecd8-49c7-894e-b682cafa7380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c5dfe7182c0435ca1121834de3ee075', 'request_id': 'req-fc9536e2-ecd8-49c7-894e-b682cafa7380'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:03.839697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fc9536e2-ecd8-49c7-894e-b682cafa7380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c5dfe7182c0435ca1121834de3ee075', 'request_id': 'req-fc9536e2-ecd8-49c7-894e-b682cafa7380'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:03.846754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fc9536e2-ecd8-49c7-894e-b682cafa7380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c5dfe7182c0435ca1121834de3ee075', 'request_id': 'req-fc9536e2-ecd8-49c7-894e-b682cafa7380'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:03.865049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fc9536e2-ecd8-49c7-894e-b682cafa7380 admin admin] The token cache is being invalidate because project 9c5dfe7182c0435ca1121834de3ee075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:59:03.865443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fc9536e2-ecd8-49c7-894e-b682cafa7380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:03.866181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fc9536e2-ecd8-49c7-894e-b682cafa7380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:03.868022 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4193/8377] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:59:03 2022] DELETE /identity/v3/projects/9c5dfe7182c0435ca1121834de3ee075 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:03.877554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0b9cf-fcd4-48b5-9206-22ba460bd4cc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:03.878090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0b9cf-fcd4-48b5-9206-22ba460bd4cc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:03.878192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0b9cf-fcd4-48b5-9206-22ba460bd4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:03.912784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f8c0b9cf-fcd4-48b5-9206-22ba460bd4cc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:03.915106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f8c0b9cf-fcd4-48b5-9206-22ba460bd4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:04.019455 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4185/8378] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:04.030171 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3094574-a73e-4c49-823a-f9ba1e3be236 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:04.033282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3094574-a73e-4c49-823a-f9ba1e3be236 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:04.033567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3094574-a73e-4c49-823a-f9ba1e3be236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:04.071537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e3094574-a73e-4c49-823a-f9ba1e3be236 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:04.073864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e3094574-a73e-4c49-823a-f9ba1e3be236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:04.087291 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4194/8379] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:04.089315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0b9cf-fcd4-48b5-9206-22ba460bd4cc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:04.103533 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0b9cf-fcd4-48b5-9206-22ba460bd4cc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:04.115301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c86cfc-2e42-4118-89a6-1505178095d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:04.115949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c86cfc-2e42-4118-89a6-1505178095d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:04.116250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c86cfc-2e42-4118-89a6-1505178095d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:04.116518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c86cfc-2e42-4118-89a6-1505178095d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:04.117187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c86cfc-2e42-4118-89a6-1505178095d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:59:04.117621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c86cfc-2e42-4118-89a6-1505178095d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:04.119295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c86cfc-2e42-4118-89a6-1505178095d4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:04.137454 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4186/8380] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:59:04.142615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3094574-a73e-4c49-823a-f9ba1e3be236 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:04.161290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3094574-a73e-4c49-823a-f9ba1e3be236 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:04.170342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dd946-9828-4f8a-9e59-0f372e49e326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:04.171566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dd946-9828-4f8a-9e59-0f372e49e326 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:04.172031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dd946-9828-4f8a-9e59-0f372e49e326 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:04.172610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dd946-9828-4f8a-9e59-0f372e49e326 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:04.173646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82dd946-9828-4f8a-9e59-0f372e49e326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:04.177728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82dd946-9828-4f8a-9e59-0f372e49e326 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:04.220141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:04.243837 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4195/8381] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:59:04 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:04.248571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c86cfc-2e42-4118-89a6-1505178095d4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:04.268917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c86cfc-2e42-4118-89a6-1505178095d4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:04.382323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e523b2-75aa-4235-8603-503a7460b845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:04.383629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e523b2-75aa-4235-8603-503a7460b845 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:04.384370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e523b2-75aa-4235-8603-503a7460b845 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:04.386337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e523b2-75aa-4235-8603-503a7460b845 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:04.386337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e523b2-75aa-4235-8603-503a7460b845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:04.388796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e523b2-75aa-4235-8603-503a7460b845 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:04.433310 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4187/8382] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:59:04 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:04.437744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dd946-9828-4f8a-9e59-0f372e49e326 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:04.465759 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dd946-9828-4f8a-9e59-0f372e49e326 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:04.474545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d5547-675d-44ab-9a4d-76c89bc0fa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:04.475591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d5547-675d-44ab-9a4d-76c89bc0fa9d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:04.476009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d5547-675d-44ab-9a4d-76c89bc0fa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:04.476802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d5547-675d-44ab-9a4d-76c89bc0fa9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:04.477603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d5547-675d-44ab-9a4d-76c89bc0fa9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:04.480228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d5547-675d-44ab-9a4d-76c89bc0fa9d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:04.499671 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4196/8383] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:04.504997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e523b2-75aa-4235-8603-503a7460b845 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:04.526750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e523b2-75aa-4235-8603-503a7460b845 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:04.535547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3430bc3-bee2-4d0d-aeb1-36e837a1662c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:04.536661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3430bc3-bee2-4d0d-aeb1-36e837a1662c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:04.537163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3430bc3-bee2-4d0d-aeb1-36e837a1662c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:04.537626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3430bc3-bee2-4d0d-aeb1-36e837a1662c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:04.538873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3430bc3-bee2-4d0d-aeb1-36e837a1662c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:04.541644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3430bc3-bee2-4d0d-aeb1-36e837a1662c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:04.581491 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4188/8384] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:04.586611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d5547-675d-44ab-9a4d-76c89bc0fa9d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:04.605167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d5547-675d-44ab-9a4d-76c89bc0fa9d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:04.613649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af7aa8-5965-44ee-b9ab-a4758e68c70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:04.614847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af7aa8-5965-44ee-b9ab-a4758e68c70b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:04.615202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af7aa8-5965-44ee-b9ab-a4758e68c70b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:04.615597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af7aa8-5965-44ee-b9ab-a4758e68c70b admin admin] PATH_INFO: `/v3/projects/96f5a00a726e4cc8a76f96f0cf79b332/users/531cff6319fd4ea08cf27777bae6d94b/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:04.647452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af7aa8-5965-44ee-b9ab-a4758e68c70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f5a00a726e4cc8a76f96f0cf79b332, user_id=531cff6319fd4ea08cf27777bae6d94b, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:04.652833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af7aa8-5965-44ee-b9ab-a4758e68c70b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:04.681093 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4197/8385] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:59:04 2022] PUT /identity/v3/projects/96f5a00a726e4cc8a76f96f0cf79b332/users/531cff6319fd4ea08cf27777bae6d94b/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:04.701051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efe261-db57-451e-942c-ed7d963ef765 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:04.701490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efe261-db57-451e-942c-ed7d963ef765 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:04.701921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efe261-db57-451e-942c-ed7d963ef765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:04.758979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-46efe261-db57-451e-942c-ed7d963ef765 None None] MFA Rules not processed for user `531cff6319fd4ea08cf27777bae6d94b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:04.772382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-46efe261-db57-451e-942c-ed7d963ef765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:04.804772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:04.911750 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4189/8386] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:59:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:59:04.920966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af7aa8-5965-44ee-b9ab-a4758e68c70b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:04.924086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a5af7aa8-5965-44ee-b9ab-a4758e68c70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:05.012844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af7aa8-5965-44ee-b9ab-a4758e68c70b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:05.024547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb419f44-c965-4d6f-abc2-2ef77c3dd550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:05.025707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb419f44-c965-4d6f-abc2-2ef77c3dd550 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:05.026227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb419f44-c965-4d6f-abc2-2ef77c3dd550 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:05.026804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb419f44-c965-4d6f-abc2-2ef77c3dd550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:05.047022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb419f44-c965-4d6f-abc2-2ef77c3dd550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:05.051135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb419f44-c965-4d6f-abc2-2ef77c3dd550 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:05.065395 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4198/8387] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:05.996000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efe261-db57-451e-942c-ed7d963ef765 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:05.998241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-46efe261-db57-451e-942c-ed7d963ef765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:06.118498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efe261-db57-451e-942c-ed7d963ef765 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:06.126546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f70cfb-b8cf-4105-a377-c0cea63da39a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:06.127990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f70cfb-b8cf-4105-a377-c0cea63da39a service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:06.128712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f70cfb-b8cf-4105-a377-c0cea63da39a service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:06.129415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f70cfb-b8cf-4105-a377-c0cea63da39a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:06.133801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d7f70cfb-b8cf-4105-a377-c0cea63da39a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:06.363551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f70cfb-b8cf-4105-a377-c0cea63da39a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:06.365397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f70cfb-b8cf-4105-a377-c0cea63da39a service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:06.386598 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4190/8388] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:59:15.059767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:16.374285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:18.728340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb419f44-c965-4d6f-abc2-2ef77c3dd550 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:18.729797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bb419f44-c965-4d6f-abc2-2ef77c3dd550 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:18.756978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb419f44-c965-4d6f-abc2-2ef77c3dd550 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:18.763872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c44435-d243-4fca-ac98-1133c8a4953d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:18.765548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c44435-d243-4fca-ac98-1133c8a4953d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:18.765944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c44435-d243-4fca-ac98-1133c8a4953d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:18.766781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c44435-d243-4fca-ac98-1133c8a4953d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:18.770532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-48c44435-d243-4fca-ac98-1133c8a4953d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:18.796655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c44435-d243-4fca-ac98-1133c8a4953d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:18.799185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c44435-d243-4fca-ac98-1133c8a4953d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:18.821828 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4199/8389] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:21.792625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f70cfb-b8cf-4105-a377-c0cea63da39a service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:21.795051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d7f70cfb-b8cf-4105-a377-c0cea63da39a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:22.006458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f70cfb-b8cf-4105-a377-c0cea63da39a service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:22.026341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaf71b-6efe-4274-97fa-d133f57b66c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:22.030102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaf71b-6efe-4274-97fa-d133f57b66c1 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:22.030840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaf71b-6efe-4274-97fa-d133f57b66c1 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:22.032079 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaf71b-6efe-4274-97fa-d133f57b66c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:22.039234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5cbaf71b-6efe-4274-97fa-d133f57b66c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:22.198048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbaf71b-6efe-4274-97fa-d133f57b66c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:22.201314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbaf71b-6efe-4274-97fa-d133f57b66c1 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:22.222042 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4191/8390] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 18:59:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:59:28.810300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:32.213867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=54 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:32.761003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c44435-d243-4fca-ac98-1133c8a4953d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:32.885284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c44435-d243-4fca-ac98-1133c8a4953d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:32.901733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741da4ff-1ed6-4c61-b9de-4e8751cb2d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:32.902401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741da4ff-1ed6-4c61-b9de-4e8751cb2d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:32.902681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741da4ff-1ed6-4c61-b9de-4e8751cb2d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:32.902955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741da4ff-1ed6-4c61-b9de-4e8751cb2d6b admin admin] PATH_INFO: `/v3/users/531cff6319fd4ea08cf27777bae6d94b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:32.904243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741da4ff-1ed6-4c61-b9de-4e8751cb2d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=531cff6319fd4ea08cf27777bae6d94b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:32.906278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741da4ff-1ed6-4c61-b9de-4e8751cb2d6b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:33.030170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-741da4ff-1ed6-4c61-b9de-4e8751cb2d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '531cff6319fd4ea08cf27777bae6d94b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:33.074135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-741da4ff-1ed6-4c61-b9de-4e8751cb2d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '531cff6319fd4ea08cf27777bae6d94b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:33.081063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-741da4ff-1ed6-4c61-b9de-4e8751cb2d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '531cff6319fd4ea08cf27777bae6d94b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:33.082908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-741da4ff-1ed6-4c61-b9de-4e8751cb2d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '531cff6319fd4ea08cf27777bae6d94b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:33.107983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-741da4ff-1ed6-4c61-b9de-4e8751cb2d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '531cff6319fd4ea08cf27777bae6d94b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:33.141439 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4200/8391] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:59:32 2022] DELETE /identity/v3/users/531cff6319fd4ea08cf27777bae6d94b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:33.149518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5e2ad-96d8-444b-915f-2c9e902a2c08 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:33.150085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5e2ad-96d8-444b-915f-2c9e902a2c08 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:33.150711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5e2ad-96d8-444b-915f-2c9e902a2c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:33.212761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-75c5e2ad-96d8-444b-915f-2c9e902a2c08 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:33.214601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-75c5e2ad-96d8-444b-915f-2c9e902a2c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:33.397080 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4192/8392] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:59:33.408832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741da4ff-1ed6-4c61-b9de-4e8751cb2d6b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:33.411185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-741da4ff-1ed6-4c61-b9de-4e8751cb2d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:33.576604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741da4ff-1ed6-4c61-b9de-4e8751cb2d6b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:33.582103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f92c2a-78e6-4703-90e9-ea69934d72a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:33.583124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f92c2a-78e6-4703-90e9-ea69934d72a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:33.583713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f92c2a-78e6-4703-90e9-ea69934d72a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:33.584251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f92c2a-78e6-4703-90e9-ea69934d72a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:33.615541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f92c2a-78e6-4703-90e9-ea69934d72a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:33.617052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f92c2a-78e6-4703-90e9-ea69934d72a1 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:33.648211 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4201/8393] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:33.762836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5e2ad-96d8-444b-915f-2c9e902a2c08 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:33.765428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-75c5e2ad-96d8-444b-915f-2c9e902a2c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:33.811417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5e2ad-96d8-444b-915f-2c9e902a2c08 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:33.829078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5b0ac-30da-4168-9d9f-150f89759787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:33.830735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5b0ac-30da-4168-9d9f-150f89759787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:33.831185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5b0ac-30da-4168-9d9f-150f89759787 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:33.850703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5b0ac-30da-4168-9d9f-150f89759787 admin admin] PATH_INFO: `/v3/users/776e943efdc14eedb39e708acfd140b9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:33.861103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5b0ac-30da-4168-9d9f-150f89759787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=776e943efdc14eedb39e708acfd140b9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:33.864320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5b0ac-30da-4168-9d9f-150f89759787 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:33.980343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d5f5b0ac-30da-4168-9d9f-150f89759787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '776e943efdc14eedb39e708acfd140b9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:33.981034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d5f5b0ac-30da-4168-9d9f-150f89759787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '776e943efdc14eedb39e708acfd140b9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:34.012701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d5f5b0ac-30da-4168-9d9f-150f89759787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '776e943efdc14eedb39e708acfd140b9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:34.032181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d5f5b0ac-30da-4168-9d9f-150f89759787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '776e943efdc14eedb39e708acfd140b9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:34.116352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d5f5b0ac-30da-4168-9d9f-150f89759787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '776e943efdc14eedb39e708acfd140b9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:34.142868 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4193/8394] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:59:33 2022] DELETE /identity/v3/users/776e943efdc14eedb39e708acfd140b9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:34.149167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80431375-ae5b-4c54-a6b8-cefb01fb9542 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:34.149754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80431375-ae5b-4c54-a6b8-cefb01fb9542 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:34.149900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80431375-ae5b-4c54-a6b8-cefb01fb9542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:34.196304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-80431375-ae5b-4c54-a6b8-cefb01fb9542 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:34.197609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-80431375-ae5b-4c54-a6b8-cefb01fb9542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:34.246375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:34.413427 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4202/8395] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:34.456836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5b0ac-30da-4168-9d9f-150f89759787 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:34.459504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5f5b0ac-30da-4168-9d9f-150f89759787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:34.520999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80431375-ae5b-4c54-a6b8-cefb01fb9542 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:34.529095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-80431375-ae5b-4c54-a6b8-cefb01fb9542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:34.578839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80431375-ae5b-4c54-a6b8-cefb01fb9542 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:34.595794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b9f37-66d8-4a2f-816e-0bce0435c61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:34.596570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b9f37-66d8-4a2f-816e-0bce0435c61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:34.596898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b9f37-66d8-4a2f-816e-0bce0435c61e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:34.597248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b9f37-66d8-4a2f-816e-0bce0435c61e admin admin] PATH_INFO: `/v3/projects/96f5a00a726e4cc8a76f96f0cf79b332` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:34.602463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b9f37-66d8-4a2f-816e-0bce0435c61e admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f5a00a726e4cc8a76f96f0cf79b332)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:34.604976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b9f37-66d8-4a2f-816e-0bce0435c61e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:34.676680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5b0ac-30da-4168-9d9f-150f89759787 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:34.686558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919156c7-1642-44be-8eb5-13c4fc2f92c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:34.687492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919156c7-1642-44be-8eb5-13c4fc2f92c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:34.687664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919156c7-1642-44be-8eb5-13c4fc2f92c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:34.688019 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919156c7-1642-44be-8eb5-13c4fc2f92c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:34.706033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919156c7-1642-44be-8eb5-13c4fc2f92c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:34.712174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919156c7-1642-44be-8eb5-13c4fc2f92c3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:34.731502 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4194/8396] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:34.781221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d3b9f37-66d8-4a2f-816e-0bce0435c61e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f5a00a726e4cc8a76f96f0cf79b332', 'request_id': 'req-8d3b9f37-66d8-4a2f-816e-0bce0435c61e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:34.802771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d3b9f37-66d8-4a2f-816e-0bce0435c61e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f5a00a726e4cc8a76f96f0cf79b332', 'request_id': 'req-8d3b9f37-66d8-4a2f-816e-0bce0435c61e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:34.826473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d3b9f37-66d8-4a2f-816e-0bce0435c61e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f5a00a726e4cc8a76f96f0cf79b332', 'request_id': 'req-8d3b9f37-66d8-4a2f-816e-0bce0435c61e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:34.863468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d3b9f37-66d8-4a2f-816e-0bce0435c61e admin admin] The token cache is being invalidate because project 96f5a00a726e4cc8a76f96f0cf79b332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:59:34.863993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d3b9f37-66d8-4a2f-816e-0bce0435c61e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:34.868121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d3b9f37-66d8-4a2f-816e-0bce0435c61e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:34.877479 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4203/8397] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:59:34 2022] DELETE /identity/v3/projects/96f5a00a726e4cc8a76f96f0cf79b332 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:59:34.881013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275795c0-ab0c-4096-a254-2a555925b6a1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:34.881547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275795c0-ab0c-4096-a254-2a555925b6a1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:34.882385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275795c0-ab0c-4096-a254-2a555925b6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:34.941006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-275795c0-ab0c-4096-a254-2a555925b6a1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:34.945507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-275795c0-ab0c-4096-a254-2a555925b6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:35.012524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:35.157454 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4195/8398] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:35.175696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50aad5-7440-42f6-846f-2d3fac98676c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:35.176504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50aad5-7440-42f6-846f-2d3fac98676c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:35.176504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50aad5-7440-42f6-846f-2d3fac98676c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:35.205954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-de50aad5-7440-42f6-846f-2d3fac98676c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:35.208433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-de50aad5-7440-42f6-846f-2d3fac98676c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:35.222788 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4204/8399] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:35.229470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275795c0-ab0c-4096-a254-2a555925b6a1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:35.246983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275795c0-ab0c-4096-a254-2a555925b6a1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:35.270248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187975f-4ce9-4113-ab78-263e2c6c6e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:35.270979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187975f-4ce9-4113-ab78-263e2c6c6e85 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:35.271296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187975f-4ce9-4113-ab78-263e2c6c6e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:35.271681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187975f-4ce9-4113-ab78-263e2c6c6e85 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:35.273443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187975f-4ce9-4113-ab78-263e2c6c6e85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:59:35.274637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187975f-4ce9-4113-ab78-263e2c6c6e85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:35.277239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187975f-4ce9-4113-ab78-263e2c6c6e85 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:35.316684 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4196/8400] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:59:35.319233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50aad5-7440-42f6-846f-2d3fac98676c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:35.332956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50aad5-7440-42f6-846f-2d3fac98676c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:35.341564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b89182-15c0-4106-9645-b3f364070305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:35.342468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b89182-15c0-4106-9645-b3f364070305 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:35.343284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b89182-15c0-4106-9645-b3f364070305 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:35.344184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b89182-15c0-4106-9645-b3f364070305 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:35.345649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b89182-15c0-4106-9645-b3f364070305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:35.349404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b89182-15c0-4106-9645-b3f364070305 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:35.406214 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4205/8401] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:59:35 2022] POST /identity/v3/projects => generated 363 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:35.412039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187975f-4ce9-4113-ab78-263e2c6c6e85 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:35.437155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187975f-4ce9-4113-ab78-263e2c6c6e85 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:35.622227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a3b21-1e3c-4ab8-840a-9d0ff6dc9392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:35.623882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a3b21-1e3c-4ab8-840a-9d0ff6dc9392 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:35.625530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a3b21-1e3c-4ab8-840a-9d0ff6dc9392 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:35.625976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a3b21-1e3c-4ab8-840a-9d0ff6dc9392 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:35.626783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a3b21-1e3c-4ab8-840a-9d0ff6dc9392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:35.632462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a3b21-1e3c-4ab8-840a-9d0ff6dc9392 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:35.686331 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4197/8402] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:59:35 2022] POST /identity/v3/users => generated 282 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:59:35.690454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b89182-15c0-4106-9645-b3f364070305 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:35.738546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b89182-15c0-4106-9645-b3f364070305 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:35.760743 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5051adc-105e-44db-8556-2cb07131225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:35.761726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5051adc-105e-44db-8556-2cb07131225b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:35.762578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5051adc-105e-44db-8556-2cb07131225b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:35.763306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5051adc-105e-44db-8556-2cb07131225b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:35.765769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5051adc-105e-44db-8556-2cb07131225b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:35.768214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5051adc-105e-44db-8556-2cb07131225b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:35.791512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a3b21-1e3c-4ab8-840a-9d0ff6dc9392 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:35.792641 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4206/8403] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:35.807705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a3b21-1e3c-4ab8-840a-9d0ff6dc9392 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:35.816271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c5134-86c2-4ab5-a4ca-30c47cb448d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:35.817382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c5134-86c2-4ab5-a4ca-30c47cb448d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:35.817877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c5134-86c2-4ab5-a4ca-30c47cb448d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:35.818547 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c5134-86c2-4ab5-a4ca-30c47cb448d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:35.820347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c5134-86c2-4ab5-a4ca-30c47cb448d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:35.822592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c5134-86c2-4ab5-a4ca-30c47cb448d3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:35.855485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5051adc-105e-44db-8556-2cb07131225b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:35.855886 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4198/8404] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:35.884543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5051adc-105e-44db-8556-2cb07131225b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:35.916807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2042fc2-0bf2-4906-9e19-16ba3ee8ccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:35.917169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2042fc2-0bf2-4906-9e19-16ba3ee8ccd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:35.918523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2042fc2-0bf2-4906-9e19-16ba3ee8ccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:35.918913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2042fc2-0bf2-4906-9e19-16ba3ee8ccd6 admin admin] PATH_INFO: `/v3/projects/1a1a26aba37643a98fa80a867190e751/users/bc691da19fb341ad8386ef06f1457c57/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:35.946228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2042fc2-0bf2-4906-9e19-16ba3ee8ccd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1a26aba37643a98fa80a867190e751, user_id=bc691da19fb341ad8386ef06f1457c57, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:35.953303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2042fc2-0bf2-4906-9e19-16ba3ee8ccd6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:35.990508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e229c-5385-4e30-8948-abd9a154cb4e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:35.990865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e229c-5385-4e30-8948-abd9a154cb4e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:35.991223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e229c-5385-4e30-8948-abd9a154cb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:36.000678 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4207/8405] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:59:35 2022] PUT /identity/v3/projects/1a1a26aba37643a98fa80a867190e751/users/bc691da19fb341ad8386ef06f1457c57/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:36.071003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e66e229c-5385-4e30-8948-abd9a154cb4e None None] MFA Rules not processed for user `bc691da19fb341ad8386ef06f1457c57`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:36.073382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e66e229c-5385-4e30-8948-abd9a154cb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:36.086508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2042fc2-0bf2-4906-9e19-16ba3ee8ccd6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:36.089139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e2042fc2-0bf2-4906-9e19-16ba3ee8ccd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:36.209413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:36.246148 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2042fc2-0bf2-4906-9e19-16ba3ee8ccd6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:36.269116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:36.270012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:36.270528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:36.271036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0 admin admin] PATH_INFO: `/v3/projects/c15789d520f7437aa4143b2d3b715b41` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:36.277633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15789d520f7437aa4143b2d3b715b41)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:36.280194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:36.289188 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4199/8406] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:59:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:36.296300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e229c-5385-4e30-8948-abd9a154cb4e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:36.324006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e229c-5385-4e30-8948-abd9a154cb4e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:36.354862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d5e7e-7e1a-4f2d-9811-ff763e4e674a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:36.355643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d5e7e-7e1a-4f2d-9811-ff763e4e674a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:36.355992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d5e7e-7e1a-4f2d-9811-ff763e4e674a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:36.356285 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d5e7e-7e1a-4f2d-9811-ff763e4e674a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:36.360372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d5e7e-7e1a-4f2d-9811-ff763e4e674a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:36.362999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d5e7e-7e1a-4f2d-9811-ff763e4e674a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:36.389732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:36.390062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15789d520f7437aa4143b2d3b715b41', 'request_id': 'req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:36.407890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15789d520f7437aa4143b2d3b715b41', 'request_id': 'req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:36.439383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15789d520f7437aa4143b2d3b715b41', 'request_id': 'req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:36.458730 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4200/8407] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:59:36 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:36.460406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d5e7e-7e1a-4f2d-9811-ff763e4e674a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:36.482824 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0 admin admin] The token cache is being invalidate because project c15789d520f7437aa4143b2d3b715b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:59:36.483136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:36.487420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:36.500528 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4208/8408] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:59:36 2022] DELETE /identity/v3/projects/c15789d520f7437aa4143b2d3b715b41 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:59:36.501695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:36.521765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:36.695514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d5e7e-7e1a-4f2d-9811-ff763e4e674a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:36.714299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c086a-67af-44da-a6b7-c13f879003c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:36.715875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c086a-67af-44da-a6b7-c13f879003c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:36.717607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c086a-67af-44da-a6b7-c13f879003c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:36.718242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c086a-67af-44da-a6b7-c13f879003c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:36.719709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c086a-67af-44da-a6b7-c13f879003c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:36.725549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c086a-67af-44da-a6b7-c13f879003c8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:36.761370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7e7f2-8cd5-4556-a0e6-ccc1c99235f0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:36.765991 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4201/8409] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:59:36 2022] POST /identity/v3/users => generated 289 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:36.772022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c086a-67af-44da-a6b7-c13f879003c8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:36.775831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b71c086a-67af-44da-a6b7-c13f879003c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:36.796721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707c2b9-1117-4abd-833c-a2cb2177a032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:36.798557 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707c2b9-1117-4abd-833c-a2cb2177a032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:36.799563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707c2b9-1117-4abd-833c-a2cb2177a032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:36.800067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707c2b9-1117-4abd-833c-a2cb2177a032 admin admin] PATH_INFO: `/v3/users/f66e6dab2d5d49888be2c592761460fe` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:36.804077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707c2b9-1117-4abd-833c-a2cb2177a032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f66e6dab2d5d49888be2c592761460fe)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:36.804703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c086a-67af-44da-a6b7-c13f879003c8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:36.811741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d752f5b-5597-466d-a15d-8813da737b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:36.812362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707c2b9-1117-4abd-833c-a2cb2177a032 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:36.812483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d752f5b-5597-466d-a15d-8813da737b50 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:36.812694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d752f5b-5597-466d-a15d-8813da737b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:36.813006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d752f5b-5597-466d-a15d-8813da737b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:36.814270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d752f5b-5597-466d-a15d-8813da737b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:36.818472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d752f5b-5597-466d-a15d-8813da737b50 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:36.841371 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4202/8410] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:36.846678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d752f5b-5597-466d-a15d-8813da737b50 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:36.872324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d752f5b-5597-466d-a15d-8813da737b50 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:36.882508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d6822-5ce4-431d-8145-8e269ca77adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:36.883204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d6822-5ce4-431d-8145-8e269ca77adb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:36.883581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d6822-5ce4-431d-8145-8e269ca77adb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:36.884047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d6822-5ce4-431d-8145-8e269ca77adb admin admin] PATH_INFO: `/v3/projects/7c5b0a3eda554d41b5dad129f47c7e10/users/ad83eb91e56f4c08ae1539b4ed3e1218/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:36.924504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0707c2b9-1117-4abd-833c-a2cb2177a032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f66e6dab2d5d49888be2c592761460fe'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:36.931016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d6822-5ce4-431d-8145-8e269ca77adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5b0a3eda554d41b5dad129f47c7e10, user_id=ad83eb91e56f4c08ae1539b4ed3e1218, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:36.939871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d6822-5ce4-431d-8145-8e269ca77adb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:36.952085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0707c2b9-1117-4abd-833c-a2cb2177a032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f66e6dab2d5d49888be2c592761460fe'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:36.952891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0707c2b9-1117-4abd-833c-a2cb2177a032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f66e6dab2d5d49888be2c592761460fe'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:36.953616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0707c2b9-1117-4abd-833c-a2cb2177a032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f66e6dab2d5d49888be2c592761460fe'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:36.970771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0707c2b9-1117-4abd-833c-a2cb2177a032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f66e6dab2d5d49888be2c592761460fe'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:36.973748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:36.982890 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4203/8411] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:59:36 2022] PUT /identity/v3/projects/7c5b0a3eda554d41b5dad129f47c7e10/users/ad83eb91e56f4c08ae1539b4ed3e1218/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:36.988601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d6822-5ce4-431d-8145-8e269ca77adb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:36.994961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5c6d6822-5ce4-431d-8145-8e269ca77adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:36.995509 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4209/8412] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 18:59:36 2022] DELETE /identity/v3/users/f66e6dab2d5d49888be2c592761460fe => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:37.220113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d6822-5ce4-431d-8145-8e269ca77adb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:37.313244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:37.329388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977fe3c-df18-4a51-8522-d0cdb79f90ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:37.330385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977fe3c-df18-4a51-8522-d0cdb79f90ac admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:37.330817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977fe3c-df18-4a51-8522-d0cdb79f90ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:37.331193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977fe3c-df18-4a51-8522-d0cdb79f90ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:37.332101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977fe3c-df18-4a51-8522-d0cdb79f90ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:37.334036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977fe3c-df18-4a51-8522-d0cdb79f90ac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:37.351792 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4204/8413] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:37.353361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707c2b9-1117-4abd-833c-a2cb2177a032 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:37.370138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707c2b9-1117-4abd-833c-a2cb2177a032 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:37.384057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14049a1b-9ff1-45bc-957c-25c4c7eac13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:37.384805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14049a1b-9ff1-45bc-957c-25c4c7eac13c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:37.385134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14049a1b-9ff1-45bc-957c-25c4c7eac13c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:37.385503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14049a1b-9ff1-45bc-957c-25c4c7eac13c admin admin] PATH_INFO: `/v3/projects/7c5b0a3eda554d41b5dad129f47c7e10/users/ad83eb91e56f4c08ae1539b4ed3e1218/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:37.390193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14049a1b-9ff1-45bc-957c-25c4c7eac13c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5b0a3eda554d41b5dad129f47c7e10, user_id=ad83eb91e56f4c08ae1539b4ed3e1218, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:37.409721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14049a1b-9ff1-45bc-957c-25c4c7eac13c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:37.430624 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4210/8414] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:59:37 2022] PUT /identity/v3/projects/7c5b0a3eda554d41b5dad129f47c7e10/users/ad83eb91e56f4c08ae1539b4ed3e1218/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:59:37.447506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b17843-c5ad-4025-bb2c-5907c1a548b2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:37.447825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b17843-c5ad-4025-bb2c-5907c1a548b2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:37.448113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b17843-c5ad-4025-bb2c-5907c1a548b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:37.512754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-94b17843-c5ad-4025-bb2c-5907c1a548b2 None None] MFA Rules not processed for user `ad83eb91e56f4c08ae1539b4ed3e1218`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:37.514816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94b17843-c5ad-4025-bb2c-5907c1a548b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:37.677452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14049a1b-9ff1-45bc-957c-25c4c7eac13c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:37.680432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-14049a1b-9ff1-45bc-957c-25c4c7eac13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:37.817477 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4205/8415] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:59:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:37.844977 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b17843-c5ad-4025-bb2c-5907c1a548b2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:37.853476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94b17843-c5ad-4025-bb2c-5907c1a548b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:37.897438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14049a1b-9ff1-45bc-957c-25c4c7eac13c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:37.913209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034e6aa-247e-41f0-a7a2-e4da4cbc5895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:37.913718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034e6aa-247e-41f0-a7a2-e4da4cbc5895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:37.913992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034e6aa-247e-41f0-a7a2-e4da4cbc5895 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:37.914263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034e6aa-247e-41f0-a7a2-e4da4cbc5895 admin admin] PATH_INFO: `/v3/projects/e7fcaa7287094350be9483e3b6bc6103` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:37.917901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034e6aa-247e-41f0-a7a2-e4da4cbc5895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7fcaa7287094350be9483e3b6bc6103)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:37.920294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034e6aa-247e-41f0-a7a2-e4da4cbc5895 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:38.036134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b17843-c5ad-4025-bb2c-5907c1a548b2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:38.113821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c034e6aa-247e-41f0-a7a2-e4da4cbc5895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7fcaa7287094350be9483e3b6bc6103', 'request_id': 'req-c034e6aa-247e-41f0-a7a2-e4da4cbc5895'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:38.128257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c034e6aa-247e-41f0-a7a2-e4da4cbc5895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7fcaa7287094350be9483e3b6bc6103', 'request_id': 'req-c034e6aa-247e-41f0-a7a2-e4da4cbc5895'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:38.137168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c034e6aa-247e-41f0-a7a2-e4da4cbc5895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7fcaa7287094350be9483e3b6bc6103', 'request_id': 'req-c034e6aa-247e-41f0-a7a2-e4da4cbc5895'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:38.213962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c034e6aa-247e-41f0-a7a2-e4da4cbc5895 admin admin] The token cache is being invalidate because project e7fcaa7287094350be9483e3b6bc6103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:59:38.218082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c034e6aa-247e-41f0-a7a2-e4da4cbc5895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:38.222058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c034e6aa-247e-41f0-a7a2-e4da4cbc5895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:38.224042 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4211/8416] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 18:59:37 2022] DELETE /identity/v3/projects/e7fcaa7287094350be9483e3b6bc6103 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:59:38.229329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78a783-44dc-45b3-a1be-722eea24bc95 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:38.229599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78a783-44dc-45b3-a1be-722eea24bc95 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:38.229977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78a783-44dc-45b3-a1be-722eea24bc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:38.268176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dd78a783-44dc-45b3-a1be-722eea24bc95 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:38.269843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dd78a783-44dc-45b3-a1be-722eea24bc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:38.365109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68707963-c857-42a6-a6c2-425374d298fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:38.366145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68707963-c857-42a6-a6c2-425374d298fa service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:38.366694 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68707963-c857-42a6-a6c2-425374d298fa service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:38.367209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68707963-c857-42a6-a6c2-425374d298fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:38.370262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68707963-c857-42a6-a6c2-425374d298fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:38.396538 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4212/8417] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:38.410627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53868d1d-5bdc-441c-9e2a-098ad911f88e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:38.412495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53868d1d-5bdc-441c-9e2a-098ad911f88e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:38.413119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53868d1d-5bdc-441c-9e2a-098ad911f88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:38.449956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:38.454690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-53868d1d-5bdc-441c-9e2a-098ad911f88e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:38.456420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-53868d1d-5bdc-441c-9e2a-098ad911f88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:38.472939 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4213/8418] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:38.475947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53868d1d-5bdc-441c-9e2a-098ad911f88e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:38.485170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:38.496258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53868d1d-5bdc-441c-9e2a-098ad911f88e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:38.500042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68707963-c857-42a6-a6c2-425374d298fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:38.516073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fdb51-fafc-40d4-94f9-486f0a806f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:38.516739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fdb51-fafc-40d4-94f9-486f0a806f70 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:38.517012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fdb51-fafc-40d4-94f9-486f0a806f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:38.517361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fdb51-fafc-40d4-94f9-486f0a806f70 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:38.519001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68707963-c857-42a6-a6c2-425374d298fa service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:38.519348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fdb51-fafc-40d4-94f9-486f0a806f70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:59:38.520142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fdb51-fafc-40d4-94f9-486f0a806f70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:38.525304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fdb51-fafc-40d4-94f9-486f0a806f70 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:38.534979 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4206/8419] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:38.546355 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4214/8420] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 18:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:59:38.552947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68707963-c857-42a6-a6c2-425374d298fa service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:38.573584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68707963-c857-42a6-a6c2-425374d298fa service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:38.593155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf983062-b169-4655-b226-574df6368e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:38.593799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf983062-b169-4655-b226-574df6368e81 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:38.594096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf983062-b169-4655-b226-574df6368e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:38.594419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf983062-b169-4655-b226-574df6368e81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:38.595110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf983062-b169-4655-b226-574df6368e81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:38.599901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf983062-b169-4655-b226-574df6368e81 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:38.666350 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4207/8421] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 18:59:38 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:38.674381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fdb51-fafc-40d4-94f9-486f0a806f70 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:38.683957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf983062-b169-4655-b226-574df6368e81 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:38.696610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf983062-b169-4655-b226-574df6368e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:38.699962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fdb51-fafc-40d4-94f9-486f0a806f70 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:38.815685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c5d20-3a4b-4142-8462-9afe9e266013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:38.816772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c5d20-3a4b-4142-8462-9afe9e266013 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:38.817053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c5d20-3a4b-4142-8462-9afe9e266013 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:38.817331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c5d20-3a4b-4142-8462-9afe9e266013 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:38.817984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c5d20-3a4b-4142-8462-9afe9e266013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:38.820593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c5d20-3a4b-4142-8462-9afe9e266013 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:38.827834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf983062-b169-4655-b226-574df6368e81 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:38.834777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942c95c-5740-4c1c-9175-7d6847503e46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:38.835649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942c95c-5740-4c1c-9175-7d6847503e46 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:38.835810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942c95c-5740-4c1c-9175-7d6847503e46 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:38.836593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942c95c-5740-4c1c-9175-7d6847503e46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:38.840593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2942c95c-5740-4c1c-9175-7d6847503e46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:38.872439 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4215/8422] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 18:59:38 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:38.874771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c5d20-3a4b-4142-8462-9afe9e266013 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:38.895540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c5d20-3a4b-4142-8462-9afe9e266013 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:38.903616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10ae52-a0c8-40c4-bbde-c7077c2298e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:38.904257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10ae52-a0c8-40c4-bbde-c7077c2298e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:38.905189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10ae52-a0c8-40c4-bbde-c7077c2298e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:38.905595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10ae52-a0c8-40c4-bbde-c7077c2298e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:38.906506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10ae52-a0c8-40c4-bbde-c7077c2298e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:38.909082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10ae52-a0c8-40c4-bbde-c7077c2298e8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:38.934472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942c95c-5740-4c1c-9175-7d6847503e46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:38.936025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942c95c-5740-4c1c-9175-7d6847503e46 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:38.940225 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4216/8423] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:38.944667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10ae52-a0c8-40c4-bbde-c7077c2298e8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:38.949930 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4208/8424] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:38.982708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10ae52-a0c8-40c4-bbde-c7077c2298e8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:38.996738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95236d-c813-430a-ae64-2cd4f9566ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:38.998873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95236d-c813-430a-ae64-2cd4f9566ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:39.000068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ac4ec-ebe8-44c1-8702-0947f451a6ef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:39.000246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95236d-c813-430a-ae64-2cd4f9566ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:39.000412 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ac4ec-ebe8-44c1-8702-0947f451a6ef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:39.000552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95236d-c813-430a-ae64-2cd4f9566ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:39.000688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ac4ec-ebe8-44c1-8702-0947f451a6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:39.003431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95236d-c813-430a-ae64-2cd4f9566ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:39.006140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95236d-c813-430a-ae64-2cd4f9566ee8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:39.041718 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4217/8425] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:39.046275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95236d-c813-430a-ae64-2cd4f9566ee8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:39.046749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-494ac4ec-ebe8-44c1-8702-0947f451a6ef None None] MFA Rules not processed for user `87b1618e8b794f36be81dd1e26b45fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:39.049459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-494ac4ec-ebe8-44c1-8702-0947f451a6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:39.074967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95236d-c813-430a-ae64-2cd4f9566ee8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:39.085125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd522b6a-30f9-47dd-893f-c245632098b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:39.088473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522b6a-30f9-47dd-893f-c245632098b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:39.096241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522b6a-30f9-47dd-893f-c245632098b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:39.097248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522b6a-30f9-47dd-893f-c245632098b0 admin admin] PATH_INFO: `/v3/projects/a29a0c88f3584c72b65de90045354938/users/d0c83db94a084371807e8bedbd8ff21d/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:39.162095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd522b6a-30f9-47dd-893f-c245632098b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29a0c88f3584c72b65de90045354938, user_id=d0c83db94a084371807e8bedbd8ff21d, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:39.169478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd522b6a-30f9-47dd-893f-c245632098b0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:39.209185 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4218/8426] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 18:59:39 2022] PUT /identity/v3/projects/a29a0c88f3584c72b65de90045354938/users/d0c83db94a084371807e8bedbd8ff21d/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:59:39.222377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360d3e8-59fe-40e7-a9e4-7199225cf519 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:39.223129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360d3e8-59fe-40e7-a9e4-7199225cf519 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:39.224036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360d3e8-59fe-40e7-a9e4-7199225cf519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:39.248478 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4209/8427] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:59:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:59:39.329488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9360d3e8-59fe-40e7-a9e4-7199225cf519 None None] MFA Rules not processed for user `d0c83db94a084371807e8bedbd8ff21d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:39.331900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9360d3e8-59fe-40e7-a9e4-7199225cf519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:39.449764 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4219/8428] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:59:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:39.466952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ac4ec-ebe8-44c1-8702-0947f451a6ef None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:39.469542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-494ac4ec-ebe8-44c1-8702-0947f451a6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:39.495380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:39.593873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ac4ec-ebe8-44c1-8702-0947f451a6ef None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:39.702388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b698e3-0ab7-4cad-9c80-45a6a6a52b5d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:39.703197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b698e3-0ab7-4cad-9c80-45a6a6a52b5d service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:39.703720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b698e3-0ab7-4cad-9c80-45a6a6a52b5d service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:39.704101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b698e3-0ab7-4cad-9c80-45a6a6a52b5d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:39.722014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b698e3-0ab7-4cad-9c80-45a6a6a52b5d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:39.725582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b698e3-0ab7-4cad-9c80-45a6a6a52b5d service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:39.746719 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4210/8429] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:59:49.444587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:49.737200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=39 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:53.419236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02c5c2-d78a-4043-8e21-959b53f88d9b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:53.419811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02c5c2-d78a-4043-8e21-959b53f88d9b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:53.420010 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02c5c2-d78a-4043-8e21-959b53f88d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:53.476204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0e02c5c2-d78a-4043-8e21-959b53f88d9b None None] MFA Rules not processed for user `7afaa3dd70cd4a64a2b3c51e8a3b9582`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:53.478515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0e02c5c2-d78a-4043-8e21-959b53f88d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:53.696126 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4220/8430] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 18:59:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:01.587096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b698e3-0ab7-4cad-9c80-45a6a6a52b5d service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:01.599980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e8b698e3-0ab7-4cad-9c80-45a6a6a52b5d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:01.934718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b698e3-0ab7-4cad-9c80-45a6a6a52b5d service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:01.946607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d73793-5c14-48d9-a8cd-e41543a64511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:01.947563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d73793-5c14-48d9-a8cd-e41543a64511 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:01.947865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d73793-5c14-48d9-a8cd-e41543a64511 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:01.948147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d73793-5c14-48d9-a8cd-e41543a64511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:01.951926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-44d73793-5c14-48d9-a8cd-e41543a64511 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:01.985388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d73793-5c14-48d9-a8cd-e41543a64511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:01.989201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d73793-5c14-48d9-a8cd-e41543a64511 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:02.014860 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4211/8431] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:03.672307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=25 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:11.999612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=26 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:18.067370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02c5c2-d78a-4043-8e21-959b53f88d9b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:18.068947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0e02c5c2-d78a-4043-8e21-959b53f88d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:18.228973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02c5c2-d78a-4043-8e21-959b53f88d9b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:18.234609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4eb58-e8b2-4a8e-99d9-01c4e47dd16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:18.235310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4eb58-e8b2-4a8e-99d9-01c4e47dd16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:18.235863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4eb58-e8b2-4a8e-99d9-01c4e47dd16c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:18.236229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4eb58-e8b2-4a8e-99d9-01c4e47dd16c admin admin] PATH_INFO: `/v3/users/bc691da19fb341ad8386ef06f1457c57` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:18.237747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4eb58-e8b2-4a8e-99d9-01c4e47dd16c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc691da19fb341ad8386ef06f1457c57)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:18.239937 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4eb58-e8b2-4a8e-99d9-01c4e47dd16c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:18.304698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bdd4eb58-e8b2-4a8e-99d9-01c4e47dd16c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc691da19fb341ad8386ef06f1457c57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:18.320073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bdd4eb58-e8b2-4a8e-99d9-01c4e47dd16c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc691da19fb341ad8386ef06f1457c57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:18.320916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bdd4eb58-e8b2-4a8e-99d9-01c4e47dd16c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc691da19fb341ad8386ef06f1457c57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:18.321679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bdd4eb58-e8b2-4a8e-99d9-01c4e47dd16c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc691da19fb341ad8386ef06f1457c57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:18.346251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bdd4eb58-e8b2-4a8e-99d9-01c4e47dd16c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc691da19fb341ad8386ef06f1457c57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:18.379696 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4221/8432] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:00:18 2022] DELETE /identity/v3/users/bc691da19fb341ad8386ef06f1457c57 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:00:18.386634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234f2f0-9a98-425c-b507-3373aaa14ad8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:18.387477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234f2f0-9a98-425c-b507-3373aaa14ad8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:18.387657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234f2f0-9a98-425c-b507-3373aaa14ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:18.442849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8234f2f0-9a98-425c-b507-3373aaa14ad8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:18.446316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8234f2f0-9a98-425c-b507-3373aaa14ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:18.620391 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4212/8433] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:18.634232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4eb58-e8b2-4a8e-99d9-01c4e47dd16c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:18.641305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bdd4eb58-e8b2-4a8e-99d9-01c4e47dd16c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:18.825934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4eb58-e8b2-4a8e-99d9-01c4e47dd16c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:18.833970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e4167-3ae1-44cd-961b-f17a4392f749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:18.839655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e4167-3ae1-44cd-961b-f17a4392f749 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:18.839655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e4167-3ae1-44cd-961b-f17a4392f749 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:18.839655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e4167-3ae1-44cd-961b-f17a4392f749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:18.866278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e4167-3ae1-44cd-961b-f17a4392f749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:18.871379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e4167-3ae1-44cd-961b-f17a4392f749 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:18.905804 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4222/8434] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:00:19.750850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234f2f0-9a98-425c-b507-3373aaa14ad8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:19.754094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8234f2f0-9a98-425c-b507-3373aaa14ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:19.805465 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234f2f0-9a98-425c-b507-3373aaa14ad8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:19.829395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:19.830502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:19.830905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:19.832041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e admin admin] PATH_INFO: `/v3/projects/1a1a26aba37643a98fa80a867190e751` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:19.835236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1a26aba37643a98fa80a867190e751)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:19.839306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:20.080620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1a26aba37643a98fa80a867190e751', 'request_id': 'req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:20.122253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1a26aba37643a98fa80a867190e751', 'request_id': 'req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:20.155226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1a26aba37643a98fa80a867190e751', 'request_id': 'req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:20.218983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e admin admin] The token cache is being invalidate because project 1a1a26aba37643a98fa80a867190e751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:00:20.225222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:20.227051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:20.230989 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4213/8435] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:00:19 2022] DELETE /identity/v3/projects/1a1a26aba37643a98fa80a867190e751 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:20.234389 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e4167-3ae1-44cd-961b-f17a4392f749 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:20.260659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e4167-3ae1-44cd-961b-f17a4392f749 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:20.350879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:20.487634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a43a54-72c8-4189-87ee-ed1393ac44d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:20.488898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a43a54-72c8-4189-87ee-ed1393ac44d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:20.489596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a43a54-72c8-4189-87ee-ed1393ac44d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:20.490212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a43a54-72c8-4189-87ee-ed1393ac44d6 admin admin] PATH_INFO: `/v3/users/ad83eb91e56f4c08ae1539b4ed3e1218` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:20.496457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a43a54-72c8-4189-87ee-ed1393ac44d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad83eb91e56f4c08ae1539b4ed3e1218)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:20.521016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a43a54-72c8-4189-87ee-ed1393ac44d6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:20.672984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a4a43a54-72c8-4189-87ee-ed1393ac44d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad83eb91e56f4c08ae1539b4ed3e1218'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:20.701533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a4a43a54-72c8-4189-87ee-ed1393ac44d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad83eb91e56f4c08ae1539b4ed3e1218'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:20.703367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a4a43a54-72c8-4189-87ee-ed1393ac44d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad83eb91e56f4c08ae1539b4ed3e1218'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:20.717559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a4a43a54-72c8-4189-87ee-ed1393ac44d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad83eb91e56f4c08ae1539b4ed3e1218'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:20.743446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a4a43a54-72c8-4189-87ee-ed1393ac44d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad83eb91e56f4c08ae1539b4ed3e1218'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:20.791565 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4223/8436] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:00:20 2022] DELETE /identity/v3/users/ad83eb91e56f4c08ae1539b4ed3e1218 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:21.287162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:21.290867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:21.348504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c3b2a-3eb0-46ca-9994-242ec884bb9e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:21.508503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427a3ae-be9a-4da2-b8a6-fecdb8da6a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:21.509166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427a3ae-be9a-4da2-b8a6-fecdb8da6a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:21.509445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427a3ae-be9a-4da2-b8a6-fecdb8da6a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:21.509773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427a3ae-be9a-4da2-b8a6-fecdb8da6a1e admin admin] PATH_INFO: `/v3/projects/7c5b0a3eda554d41b5dad129f47c7e10` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:21.510971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427a3ae-be9a-4da2-b8a6-fecdb8da6a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c5b0a3eda554d41b5dad129f47c7e10)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:21.513746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427a3ae-be9a-4da2-b8a6-fecdb8da6a1e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:21.608131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:21.645246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8427a3ae-be9a-4da2-b8a6-fecdb8da6a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c5b0a3eda554d41b5dad129f47c7e10', 'request_id': 'req-8427a3ae-be9a-4da2-b8a6-fecdb8da6a1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:21.661187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8427a3ae-be9a-4da2-b8a6-fecdb8da6a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c5b0a3eda554d41b5dad129f47c7e10', 'request_id': 'req-8427a3ae-be9a-4da2-b8a6-fecdb8da6a1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:21.669439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8427a3ae-be9a-4da2-b8a6-fecdb8da6a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c5b0a3eda554d41b5dad129f47c7e10', 'request_id': 'req-8427a3ae-be9a-4da2-b8a6-fecdb8da6a1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:21.689470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8427a3ae-be9a-4da2-b8a6-fecdb8da6a1e admin admin] The token cache is being invalidate because project 7c5b0a3eda554d41b5dad129f47c7e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:00:21.689778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8427a3ae-be9a-4da2-b8a6-fecdb8da6a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:21.690523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8427a3ae-be9a-4da2-b8a6-fecdb8da6a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:21.695687 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4214/8437] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:00:21 2022] DELETE /identity/v3/projects/7c5b0a3eda554d41b5dad129f47c7e10 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:21.698514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80cf4-5667-468c-9b73-6ac062ece7da None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:21.699464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80cf4-5667-468c-9b73-6ac062ece7da None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:21.699464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80cf4-5667-468c-9b73-6ac062ece7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:21.725334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4ed80cf4-5667-468c-9b73-6ac062ece7da None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:21.728112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4ed80cf4-5667-468c-9b73-6ac062ece7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:21.819922 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4224/8438] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:00:21.822597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186b2d6-03f0-4b18-a07a-ab5b3b778c31 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:21.823310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186b2d6-03f0-4b18-a07a-ab5b3b778c31 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:21.823890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186b2d6-03f0-4b18-a07a-ab5b3b778c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:21.876504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d186b2d6-03f0-4b18-a07a-ab5b3b778c31 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:21.878073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d186b2d6-03f0-4b18-a07a-ab5b3b778c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:21.920571 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4215/8439] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:21.925948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed80cf4-5667-468c-9b73-6ac062ece7da None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:21.941094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed80cf4-5667-468c-9b73-6ac062ece7da None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:21.958935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8ab07-d9aa-473b-9b9a-2e96aed93b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:21.960320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8ab07-d9aa-473b-9b9a-2e96aed93b5b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:21.961014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8ab07-d9aa-473b-9b9a-2e96aed93b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:21.961524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8ab07-d9aa-473b-9b9a-2e96aed93b5b admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:21.962452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8ab07-d9aa-473b-9b9a-2e96aed93b5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:00:21.963077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8ab07-d9aa-473b-9b9a-2e96aed93b5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:21.965097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8ab07-d9aa-473b-9b9a-2e96aed93b5b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:22.001051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186b2d6-03f0-4b18-a07a-ab5b3b778c31 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:22.007424 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4225/8440] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:00:22.014226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186b2d6-03f0-4b18-a07a-ab5b3b778c31 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:22.020916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dbf07-c460-4490-8fa6-e69ce4550bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:22.021814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dbf07-c460-4490-8fa6-e69ce4550bff admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:22.022215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dbf07-c460-4490-8fa6-e69ce4550bff admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:22.022590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dbf07-c460-4490-8fa6-e69ce4550bff admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:22.023484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2dbf07-c460-4490-8fa6-e69ce4550bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:22.025638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2dbf07-c460-4490-8fa6-e69ce4550bff admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:22.085452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8ab07-d9aa-473b-9b9a-2e96aed93b5b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:22.086458 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4216/8441] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:00:21 2022] POST /identity/v3/projects => generated 363 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:00:22.109110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8ab07-d9aa-473b-9b9a-2e96aed93b5b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:22.199032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:22.324274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8254a10-d041-47cf-9670-d7f5fb4a00e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:22.324927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8254a10-d041-47cf-9670-d7f5fb4a00e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:22.325214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8254a10-d041-47cf-9670-d7f5fb4a00e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:22.325498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8254a10-d041-47cf-9670-d7f5fb4a00e0 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:22.326159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8254a10-d041-47cf-9670-d7f5fb4a00e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:22.333598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8254a10-d041-47cf-9670-d7f5fb4a00e0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:22.429184 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4226/8442] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:00:22 2022] POST /identity/v3/users => generated 282 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:00:22.433175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dbf07-c460-4490-8fa6-e69ce4550bff admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:22.450049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dbf07-c460-4490-8fa6-e69ce4550bff admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:22.459343 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38605f-db5d-4260-8320-a1598a7d0cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:22.461791 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38605f-db5d-4260-8320-a1598a7d0cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:22.467135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38605f-db5d-4260-8320-a1598a7d0cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:22.468457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38605f-db5d-4260-8320-a1598a7d0cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:22.469320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38605f-db5d-4260-8320-a1598a7d0cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:22.471851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38605f-db5d-4260-8320-a1598a7d0cc6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:22.489239 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4217/8443] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:22.494681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8254a10-d041-47cf-9670-d7f5fb4a00e0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:22.513482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8254a10-d041-47cf-9670-d7f5fb4a00e0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:22.521526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3eae4-41b9-4708-b030-6151be10e2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:22.522509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3eae4-41b9-4708-b030-6151be10e2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:22.523502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3eae4-41b9-4708-b030-6151be10e2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:22.523993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3eae4-41b9-4708-b030-6151be10e2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:22.525289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3eae4-41b9-4708-b030-6151be10e2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:22.527483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3eae4-41b9-4708-b030-6151be10e2e4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:22.542804 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4227/8444] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:22.549284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38605f-db5d-4260-8320-a1598a7d0cc6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:22.587612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38605f-db5d-4260-8320-a1598a7d0cc6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:22.602808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564c659-dc8a-4d16-abcb-79837a9c4f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:22.604237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564c659-dc8a-4d16-abcb-79837a9c4f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:22.605123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564c659-dc8a-4d16-abcb-79837a9c4f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:22.605653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564c659-dc8a-4d16-abcb-79837a9c4f6c admin admin] PATH_INFO: `/v3/projects/318d7a05643b499ebc87b3434beb257b/users/68cc015320b643fb803eb001c405f957/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:22.637039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564c659-dc8a-4d16-abcb-79837a9c4f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=318d7a05643b499ebc87b3434beb257b, user_id=68cc015320b643fb803eb001c405f957, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:22.642532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564c659-dc8a-4d16-abcb-79837a9c4f6c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:22.672049 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4218/8445] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:00:22 2022] PUT /identity/v3/projects/318d7a05643b499ebc87b3434beb257b/users/68cc015320b643fb803eb001c405f957/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:22.681920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8af30-853b-4a1a-b4db-804811144784 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:22.682376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8af30-853b-4a1a-b4db-804811144784 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:22.682846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8af30-853b-4a1a-b4db-804811144784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:22.764236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bae8af30-853b-4a1a-b4db-804811144784 None None] MFA Rules not processed for user `68cc015320b643fb803eb001c405f957`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:22.767898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bae8af30-853b-4a1a-b4db-804811144784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:22.919726 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4228/8446] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:00:22.925450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564c659-dc8a-4d16-abcb-79837a9c4f6c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:23.053836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564c659-dc8a-4d16-abcb-79837a9c4f6c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:23.060398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd2c0c-fec8-4dd9-b7ea-211fb78beb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:23.061431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd2c0c-fec8-4dd9-b7ea-211fb78beb43 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:23.061662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd2c0c-fec8-4dd9-b7ea-211fb78beb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:23.062180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd2c0c-fec8-4dd9-b7ea-211fb78beb43 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:23.063129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd2c0c-fec8-4dd9-b7ea-211fb78beb43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:23.066076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd2c0c-fec8-4dd9-b7ea-211fb78beb43 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:23.105551 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4219/8447] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:00:22 2022] POST /identity/v3/projects => generated 363 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:00:23.110936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8af30-853b-4a1a-b4db-804811144784 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:23.129765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8af30-853b-4a1a-b4db-804811144784 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:23.274932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f2298-3006-4a79-9092-7a4a98fd30f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:23.277436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f2298-3006-4a79-9092-7a4a98fd30f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:23.277911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f2298-3006-4a79-9092-7a4a98fd30f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:23.278383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f2298-3006-4a79-9092-7a4a98fd30f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:23.279607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f2298-3006-4a79-9092-7a4a98fd30f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:23.284222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f2298-3006-4a79-9092-7a4a98fd30f6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:23.334651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd2c0c-fec8-4dd9-b7ea-211fb78beb43 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:23.336841 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4229/8448] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:00:23 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:00:23.355830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd2c0c-fec8-4dd9-b7ea-211fb78beb43 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:23.368303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0a1ee-9333-48c8-a16f-ef35de0cf999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:23.368943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0a1ee-9333-48c8-a16f-ef35de0cf999 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:23.369228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0a1ee-9333-48c8-a16f-ef35de0cf999 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:23.369500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0a1ee-9333-48c8-a16f-ef35de0cf999 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:23.372790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0a1ee-9333-48c8-a16f-ef35de0cf999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:23.375292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0a1ee-9333-48c8-a16f-ef35de0cf999 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:23.422641 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4220/8449] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:23.423631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f2298-3006-4a79-9092-7a4a98fd30f6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:23.449037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f2298-3006-4a79-9092-7a4a98fd30f6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:23.456945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4885bf1-2e4c-4e88-a6e5-a42c7015312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:23.458942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4885bf1-2e4c-4e88-a6e5-a42c7015312c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:23.460731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4885bf1-2e4c-4e88-a6e5-a42c7015312c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:23.461581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4885bf1-2e4c-4e88-a6e5-a42c7015312c admin admin] PATH_INFO: `/v3/projects/5c04f637dedc4d47950d66d18d79f284/users/edd954f2e206475e84c618e0eadf40e7/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:23.486726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4885bf1-2e4c-4e88-a6e5-a42c7015312c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c04f637dedc4d47950d66d18d79f284, user_id=edd954f2e206475e84c618e0eadf40e7, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:23.490304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4885bf1-2e4c-4e88-a6e5-a42c7015312c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:23.523396 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4230/8450] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:00:23 2022] PUT /identity/v3/projects/5c04f637dedc4d47950d66d18d79f284/users/edd954f2e206475e84c618e0eadf40e7/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:23.533678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0a1ee-9333-48c8-a16f-ef35de0cf999 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:23.551726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0a1ee-9333-48c8-a16f-ef35de0cf999 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:23.644309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:23.715337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ccb31-5d0e-45cd-8c47-9c3ce06133a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:23.716264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ccb31-5d0e-45cd-8c47-9c3ce06133a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:23.717471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ccb31-5d0e-45cd-8c47-9c3ce06133a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:23.718596 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ccb31-5d0e-45cd-8c47-9c3ce06133a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:23.719648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ccb31-5d0e-45cd-8c47-9c3ce06133a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:23.721414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ccb31-5d0e-45cd-8c47-9c3ce06133a0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:23.733999 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4221/8451] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:23.740747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4885bf1-2e4c-4e88-a6e5-a42c7015312c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:23.750199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:23.765815 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4885bf1-2e4c-4e88-a6e5-a42c7015312c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:23.775517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e3ecc-e975-45a2-9310-e1351aa39318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:23.777194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e3ecc-e975-45a2-9310-e1351aa39318 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:23.777932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e3ecc-e975-45a2-9310-e1351aa39318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:23.778728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e3ecc-e975-45a2-9310-e1351aa39318 admin admin] PATH_INFO: `/v3/projects/5c04f637dedc4d47950d66d18d79f284/users/edd954f2e206475e84c618e0eadf40e7/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:23.782885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e3ecc-e975-45a2-9310-e1351aa39318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c04f637dedc4d47950d66d18d79f284, user_id=edd954f2e206475e84c618e0eadf40e7, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:23.788520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e3ecc-e975-45a2-9310-e1351aa39318 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:23.826481 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4231/8452] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:00:23 2022] PUT /identity/v3/projects/5c04f637dedc4d47950d66d18d79f284/users/edd954f2e206475e84c618e0eadf40e7/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:00:23.827443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3610ec-c730-4cc0-beeb-87f4aadb21c2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:23.827831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3610ec-c730-4cc0-beeb-87f4aadb21c2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:23.828211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3610ec-c730-4cc0-beeb-87f4aadb21c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:23.862335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8b3610ec-c730-4cc0-beeb-87f4aadb21c2 None None] MFA Rules not processed for user `edd954f2e206475e84c618e0eadf40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:23.864582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8b3610ec-c730-4cc0-beeb-87f4aadb21c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:23.985064 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4222/8453] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:23.995465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e3ecc-e975-45a2-9310-e1351aa39318 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:23.997463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-623e3ecc-e975-45a2-9310-e1351aa39318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:24.087304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e3ecc-e975-45a2-9310-e1351aa39318 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:24.092249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21a921-59ee-4472-86c7-fe1866a71c49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:24.093061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21a921-59ee-4472-86c7-fe1866a71c49 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:24.093438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21a921-59ee-4472-86c7-fe1866a71c49 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:24.093766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21a921-59ee-4472-86c7-fe1866a71c49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:24.107131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21a921-59ee-4472-86c7-fe1866a71c49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:24.109007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21a921-59ee-4472-86c7-fe1866a71c49 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:24.123794 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4232/8454] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:24.282717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3610ec-c730-4cc0-beeb-87f4aadb21c2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:24.285210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8b3610ec-c730-4cc0-beeb-87f4aadb21c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:24.319735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3610ec-c730-4cc0-beeb-87f4aadb21c2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:24.387121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54048d-e108-4506-bfe3-23bab4128f2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:24.388060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54048d-e108-4506-bfe3-23bab4128f2a service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:24.392471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54048d-e108-4506-bfe3-23bab4128f2a service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:24.392727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54048d-e108-4506-bfe3-23bab4128f2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:24.491164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54048d-e108-4506-bfe3-23bab4128f2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:24.492912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54048d-e108-4506-bfe3-23bab4128f2a service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:24.522207 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4223/8455] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:00:27.867126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21a921-59ee-4472-86c7-fe1866a71c49 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:28.078182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21a921-59ee-4472-86c7-fe1866a71c49 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:28.096025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccab21-4b08-48dc-838e-0c61fea711fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:28.099338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccab21-4b08-48dc-838e-0c61fea711fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:28.099338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccab21-4b08-48dc-838e-0c61fea711fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:28.099338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccab21-4b08-48dc-838e-0c61fea711fe admin admin] PATH_INFO: `/v3/users/68cc015320b643fb803eb001c405f957` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:28.105987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccab21-4b08-48dc-838e-0c61fea711fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=68cc015320b643fb803eb001c405f957)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:28.154640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccab21-4b08-48dc-838e-0c61fea711fe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:28.310608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2ccab21-4b08-48dc-838e-0c61fea711fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68cc015320b643fb803eb001c405f957'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:28.378994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2ccab21-4b08-48dc-838e-0c61fea711fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68cc015320b643fb803eb001c405f957'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:28.380419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2ccab21-4b08-48dc-838e-0c61fea711fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68cc015320b643fb803eb001c405f957'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:28.381476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2ccab21-4b08-48dc-838e-0c61fea711fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68cc015320b643fb803eb001c405f957'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:28.405636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2ccab21-4b08-48dc-838e-0c61fea711fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68cc015320b643fb803eb001c405f957'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:28.429872 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4233/8456] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:00:27 2022] DELETE /identity/v3/users/68cc015320b643fb803eb001c405f957 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:28.435775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54993e5-aee8-4c38-a6e8-c8e5d5f65b8c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:28.436698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54993e5-aee8-4c38-a6e8-c8e5d5f65b8c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:28.437084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54993e5-aee8-4c38-a6e8-c8e5d5f65b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:28.471094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a54993e5-aee8-4c38-a6e8-c8e5d5f65b8c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:28.473539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a54993e5-aee8-4c38-a6e8-c8e5d5f65b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:28.562982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:28.605724 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4224/8457] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:00:28.615899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccab21-4b08-48dc-838e-0c61fea711fe admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:28.618024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f2ccab21-4b08-48dc-838e-0c61fea711fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:28.651330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:28.742367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccab21-4b08-48dc-838e-0c61fea711fe admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:28.746531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b502f36-e7be-4326-92b2-6f4e9df193b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:28.747446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b502f36-e7be-4326-92b2-6f4e9df193b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:28.747901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b502f36-e7be-4326-92b2-6f4e9df193b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:28.748334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b502f36-e7be-4326-92b2-6f4e9df193b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:28.759358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b502f36-e7be-4326-92b2-6f4e9df193b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:28.761097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b502f36-e7be-4326-92b2-6f4e9df193b5 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:28.772649 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4234/8458] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:29.387393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54993e5-aee8-4c38-a6e8-c8e5d5f65b8c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:29.391656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a54993e5-aee8-4c38-a6e8-c8e5d5f65b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:29.425388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54993e5-aee8-4c38-a6e8-c8e5d5f65b8c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:29.437408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e04257-397b-4e2e-ace3-658ad7b421f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:29.438230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e04257-397b-4e2e-ace3-658ad7b421f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:29.438605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e04257-397b-4e2e-ace3-658ad7b421f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:29.439185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e04257-397b-4e2e-ace3-658ad7b421f6 admin admin] PATH_INFO: `/v3/projects/318d7a05643b499ebc87b3434beb257b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:29.440767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e04257-397b-4e2e-ace3-658ad7b421f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=318d7a05643b499ebc87b3434beb257b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:29.444012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e04257-397b-4e2e-ace3-658ad7b421f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:29.526290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17e04257-397b-4e2e-ace3-658ad7b421f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '318d7a05643b499ebc87b3434beb257b', 'request_id': 'req-17e04257-397b-4e2e-ace3-658ad7b421f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:29.537059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17e04257-397b-4e2e-ace3-658ad7b421f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '318d7a05643b499ebc87b3434beb257b', 'request_id': 'req-17e04257-397b-4e2e-ace3-658ad7b421f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:29.546487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17e04257-397b-4e2e-ace3-658ad7b421f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '318d7a05643b499ebc87b3434beb257b', 'request_id': 'req-17e04257-397b-4e2e-ace3-658ad7b421f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:29.567683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17e04257-397b-4e2e-ace3-658ad7b421f6 admin admin] The token cache is being invalidate because project 318d7a05643b499ebc87b3434beb257b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:00:29.568516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17e04257-397b-4e2e-ace3-658ad7b421f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:29.569743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17e04257-397b-4e2e-ace3-658ad7b421f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:29.572065 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4225/8459] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:00:29 2022] DELETE /identity/v3/projects/318d7a05643b499ebc87b3434beb257b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:29.577187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b502f36-e7be-4326-92b2-6f4e9df193b5 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:29.592218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b502f36-e7be-4326-92b2-6f4e9df193b5 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:29.708555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c72596-55ca-4a99-8985-fa52f02e2511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:29.709428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c72596-55ca-4a99-8985-fa52f02e2511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:29.710336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c72596-55ca-4a99-8985-fa52f02e2511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:29.710678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c72596-55ca-4a99-8985-fa52f02e2511 admin admin] PATH_INFO: `/v3/users/edd954f2e206475e84c618e0eadf40e7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:29.712188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c72596-55ca-4a99-8985-fa52f02e2511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd954f2e206475e84c618e0eadf40e7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:29.714335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c72596-55ca-4a99-8985-fa52f02e2511 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:29.785183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-38c72596-55ca-4a99-8985-fa52f02e2511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd954f2e206475e84c618e0eadf40e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:29.802436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-38c72596-55ca-4a99-8985-fa52f02e2511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd954f2e206475e84c618e0eadf40e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:29.803806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-38c72596-55ca-4a99-8985-fa52f02e2511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd954f2e206475e84c618e0eadf40e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:29.806022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-38c72596-55ca-4a99-8985-fa52f02e2511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd954f2e206475e84c618e0eadf40e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:29.819169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-38c72596-55ca-4a99-8985-fa52f02e2511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd954f2e206475e84c618e0eadf40e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:29.841735 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4235/8460] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:00:29 2022] DELETE /identity/v3/users/edd954f2e206475e84c618e0eadf40e7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:00:30.251577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e04257-397b-4e2e-ace3-658ad7b421f6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:30.253142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17e04257-397b-4e2e-ace3-658ad7b421f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:30.278344 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e04257-397b-4e2e-ace3-658ad7b421f6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:30.407742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc01ad-d54c-4b0a-bb61-a434d7010e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:30.408415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc01ad-d54c-4b0a-bb61-a434d7010e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:30.408936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc01ad-d54c-4b0a-bb61-a434d7010e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:30.409224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc01ad-d54c-4b0a-bb61-a434d7010e7b admin admin] PATH_INFO: `/v3/projects/5c04f637dedc4d47950d66d18d79f284` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:30.416316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc01ad-d54c-4b0a-bb61-a434d7010e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c04f637dedc4d47950d66d18d79f284)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:30.420198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc01ad-d54c-4b0a-bb61-a434d7010e7b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:30.520787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07bc01ad-d54c-4b0a-bb61-a434d7010e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c04f637dedc4d47950d66d18d79f284', 'request_id': 'req-07bc01ad-d54c-4b0a-bb61-a434d7010e7b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:30.542061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07bc01ad-d54c-4b0a-bb61-a434d7010e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c04f637dedc4d47950d66d18d79f284', 'request_id': 'req-07bc01ad-d54c-4b0a-bb61-a434d7010e7b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:30.576314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07bc01ad-d54c-4b0a-bb61-a434d7010e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c04f637dedc4d47950d66d18d79f284', 'request_id': 'req-07bc01ad-d54c-4b0a-bb61-a434d7010e7b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:30.588461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:30.594164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07bc01ad-d54c-4b0a-bb61-a434d7010e7b admin admin] The token cache is being invalidate because project 5c04f637dedc4d47950d66d18d79f284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:00:30.594778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07bc01ad-d54c-4b0a-bb61-a434d7010e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:30.595541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07bc01ad-d54c-4b0a-bb61-a434d7010e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:30.597766 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4226/8461] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:00:30 2022] DELETE /identity/v3/projects/5c04f637dedc4d47950d66d18d79f284 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:30.604755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f1bef-2667-437e-b593-cf27e3201751 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:30.606130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f1bef-2667-437e-b593-cf27e3201751 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:30.606505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f1bef-2667-437e-b593-cf27e3201751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:30.639478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0b7f1bef-2667-437e-b593-cf27e3201751 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:30.641479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0b7f1bef-2667-437e-b593-cf27e3201751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:30.734564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:30.806414 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4236/8462] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:30.808942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455ab3d-d1f4-4a33-921c-83969c1b3edd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:30.809228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455ab3d-d1f4-4a33-921c-83969c1b3edd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:30.809502 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455ab3d-d1f4-4a33-921c-83969c1b3edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:30.846275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6455ab3d-d1f4-4a33-921c-83969c1b3edd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:30.847545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6455ab3d-d1f4-4a33-921c-83969c1b3edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:30.861999 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4227/8463] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:30.864258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f1bef-2667-437e-b593-cf27e3201751 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:30.882482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f1bef-2667-437e-b593-cf27e3201751 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:30.890120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c74bbc-7e7d-4df4-9f6a-bc89c65098b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:30.891164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c74bbc-7e7d-4df4-9f6a-bc89c65098b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:30.891858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c74bbc-7e7d-4df4-9f6a-bc89c65098b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:30.892327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c74bbc-7e7d-4df4-9f6a-bc89c65098b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:30.894288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c74bbc-7e7d-4df4-9f6a-bc89c65098b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:00:30.894806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c74bbc-7e7d-4df4-9f6a-bc89c65098b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:30.898400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c74bbc-7e7d-4df4-9f6a-bc89c65098b1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:30.922599 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4237/8464] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:00:30.924217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455ab3d-d1f4-4a33-921c-83969c1b3edd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:30.941857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455ab3d-d1f4-4a33-921c-83969c1b3edd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:30.954521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b7a98-75a3-489f-a032-a6d84595e7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:30.955156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b7a98-75a3-489f-a032-a6d84595e7fa admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:30.955469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b7a98-75a3-489f-a032-a6d84595e7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:30.955747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b7a98-75a3-489f-a032-a6d84595e7fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:30.956411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b7a98-75a3-489f-a032-a6d84595e7fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:30.958354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b7a98-75a3-489f-a032-a6d84595e7fa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:31.013985 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4228/8465] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:00:30 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:00:31.015563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c74bbc-7e7d-4df4-9f6a-bc89c65098b1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:31.035952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c74bbc-7e7d-4df4-9f6a-bc89c65098b1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:31.140932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7dca4e-4ad1-459f-a0a1-180cb82e9db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:31.142960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dca4e-4ad1-459f-a0a1-180cb82e9db5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:31.143499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dca4e-4ad1-459f-a0a1-180cb82e9db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:31.143956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dca4e-4ad1-459f-a0a1-180cb82e9db5 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:31.145076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7dca4e-4ad1-459f-a0a1-180cb82e9db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:31.149000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7dca4e-4ad1-459f-a0a1-180cb82e9db5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:31.187398 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4238/8466] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:00:31 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:00:31.189404 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b7a98-75a3-489f-a032-a6d84595e7fa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:31.200683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b7a98-75a3-489f-a032-a6d84595e7fa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:31.205827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc70a33-a6ee-40be-ab2a-7c0e3e7c734f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:31.206471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc70a33-a6ee-40be-ab2a-7c0e3e7c734f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:31.206739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc70a33-a6ee-40be-ab2a-7c0e3e7c734f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:31.207008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc70a33-a6ee-40be-ab2a-7c0e3e7c734f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:31.207720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc70a33-a6ee-40be-ab2a-7c0e3e7c734f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:31.209363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc70a33-a6ee-40be-ab2a-7c0e3e7c734f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:31.257101 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4229/8467] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:31.262046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7dca4e-4ad1-459f-a0a1-180cb82e9db5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:31.275213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7dca4e-4ad1-459f-a0a1-180cb82e9db5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:31.285135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3e756-5cef-4cb9-b719-c15fc6fed6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:31.286159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3e756-5cef-4cb9-b719-c15fc6fed6ae admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:31.286671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3e756-5cef-4cb9-b719-c15fc6fed6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:31.287113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3e756-5cef-4cb9-b719-c15fc6fed6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:31.288155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3e756-5cef-4cb9-b719-c15fc6fed6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:31.290150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3e756-5cef-4cb9-b719-c15fc6fed6ae admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:31.306319 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4239/8468] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:31.313349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc70a33-a6ee-40be-ab2a-7c0e3e7c734f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:31.328534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc70a33-a6ee-40be-ab2a-7c0e3e7c734f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:31.336295 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf46fc-c16f-4b1e-8eeb-ed31cf3529ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:31.337352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf46fc-c16f-4b1e-8eeb-ed31cf3529ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:31.337807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf46fc-c16f-4b1e-8eeb-ed31cf3529ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:31.338252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf46fc-c16f-4b1e-8eeb-ed31cf3529ab admin admin] PATH_INFO: `/v3/projects/0b1d0fee883d45b483a21e65998a6b41/users/acc131b9c03d4823879874346119713f/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:31.361150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf46fc-c16f-4b1e-8eeb-ed31cf3529ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1d0fee883d45b483a21e65998a6b41, user_id=acc131b9c03d4823879874346119713f, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:31.366137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf46fc-c16f-4b1e-8eeb-ed31cf3529ab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:31.399797 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4230/8469] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:00:31 2022] PUT /identity/v3/projects/0b1d0fee883d45b483a21e65998a6b41/users/acc131b9c03d4823879874346119713f/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:31.412570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df51480-064f-485a-9d20-ef6b08d7b55d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:31.413128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df51480-064f-485a-9d20-ef6b08d7b55d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:31.414821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df51480-064f-485a-9d20-ef6b08d7b55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:31.510403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3df51480-064f-485a-9d20-ef6b08d7b55d None None] MFA Rules not processed for user `acc131b9c03d4823879874346119713f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:31.511836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3df51480-064f-485a-9d20-ef6b08d7b55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:31.665729 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4240/8470] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:31.670584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf46fc-c16f-4b1e-8eeb-ed31cf3529ab admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:31.807778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf46fc-c16f-4b1e-8eeb-ed31cf3529ab admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:31.832269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ab0cf-b3fd-4476-a411-37aa84d5297c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:31.833602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ab0cf-b3fd-4476-a411-37aa84d5297c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:31.834152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ab0cf-b3fd-4476-a411-37aa84d5297c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:31.834939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ab0cf-b3fd-4476-a411-37aa84d5297c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:31.835882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ab0cf-b3fd-4476-a411-37aa84d5297c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:31.838883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ab0cf-b3fd-4476-a411-37aa84d5297c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:31.955707 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4231/8471] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:00:31 2022] POST /identity/v3/projects => generated 377 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:00:31.962930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df51480-064f-485a-9d20-ef6b08d7b55d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:31.992280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df51480-064f-485a-9d20-ef6b08d7b55d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:32.056165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:32.128716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7961f31-b8fe-4ca3-88e9-856e9d857711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:32.129596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7961f31-b8fe-4ca3-88e9-856e9d857711 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:32.129943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7961f31-b8fe-4ca3-88e9-856e9d857711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:32.130291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7961f31-b8fe-4ca3-88e9-856e9d857711 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:32.131026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7961f31-b8fe-4ca3-88e9-856e9d857711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:32.133292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7961f31-b8fe-4ca3-88e9-856e9d857711 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:32.175534 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4241/8472] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:00:31 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:00:32.183206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ab0cf-b3fd-4476-a411-37aa84d5297c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:32.202658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ab0cf-b3fd-4476-a411-37aa84d5297c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:32.211924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597ee69-1ec8-4a29-b3f6-20db918ee2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:32.212874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597ee69-1ec8-4a29-b3f6-20db918ee2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:32.213331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597ee69-1ec8-4a29-b3f6-20db918ee2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:32.214068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597ee69-1ec8-4a29-b3f6-20db918ee2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:32.215767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597ee69-1ec8-4a29-b3f6-20db918ee2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:32.218874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597ee69-1ec8-4a29-b3f6-20db918ee2d7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:32.247280 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4232/8473] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:32.252950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7961f31-b8fe-4ca3-88e9-856e9d857711 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:32.275006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7961f31-b8fe-4ca3-88e9-856e9d857711 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:32.282612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbc1d9-dd5a-4423-9f64-40b56d4d59eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:32.283693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbc1d9-dd5a-4423-9f64-40b56d4d59eb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:32.284002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbc1d9-dd5a-4423-9f64-40b56d4d59eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:32.284327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbc1d9-dd5a-4423-9f64-40b56d4d59eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:32.285139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbc1d9-dd5a-4423-9f64-40b56d4d59eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:32.287935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbc1d9-dd5a-4423-9f64-40b56d4d59eb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:32.305524 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4242/8474] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:00:32.307052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597ee69-1ec8-4a29-b3f6-20db918ee2d7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:32.324600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597ee69-1ec8-4a29-b3f6-20db918ee2d7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:32.330185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db500e-13c3-4564-8fb7-082b0a176250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:32.330974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db500e-13c3-4564-8fb7-082b0a176250 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:32.331372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db500e-13c3-4564-8fb7-082b0a176250 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:32.331709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db500e-13c3-4564-8fb7-082b0a176250 admin admin] PATH_INFO: `/v3/projects/61f0c3bf45ae4224b50251da0411aa0a/users/ffc47debea7f42419c2920375b4e2403/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:32.367577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db500e-13c3-4564-8fb7-082b0a176250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f0c3bf45ae4224b50251da0411aa0a, user_id=ffc47debea7f42419c2920375b4e2403, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:32.373409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db500e-13c3-4564-8fb7-082b0a176250 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:32.409369 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4233/8475] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:00:32 2022] PUT /identity/v3/projects/61f0c3bf45ae4224b50251da0411aa0a/users/ffc47debea7f42419c2920375b4e2403/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:32.413033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd179edf-4217-4b2c-ad4f-38472dc7abfa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:32.413729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd179edf-4217-4b2c-ad4f-38472dc7abfa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:32.414208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd179edf-4217-4b2c-ad4f-38472dc7abfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:32.469237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fd179edf-4217-4b2c-ad4f-38472dc7abfa None None] MFA Rules not processed for user `ffc47debea7f42419c2920375b4e2403`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:32.471115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fd179edf-4217-4b2c-ad4f-38472dc7abfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:32.636293 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4243/8476] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:32.642713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db500e-13c3-4564-8fb7-082b0a176250 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:32.737613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:32.773054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db500e-13c3-4564-8fb7-082b0a176250 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:32.782843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5faf532-7f36-4f4c-9757-bbdbfcc6b415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:32.783949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faf532-7f36-4f4c-9757-bbdbfcc6b415 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:32.784432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faf532-7f36-4f4c-9757-bbdbfcc6b415 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:32.784991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faf532-7f36-4f4c-9757-bbdbfcc6b415 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:32.786162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5faf532-7f36-4f4c-9757-bbdbfcc6b415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:32.790147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5faf532-7f36-4f4c-9757-bbdbfcc6b415 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:32.851172 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4234/8477] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:00:32 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:00:32.852511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd179edf-4217-4b2c-ad4f-38472dc7abfa None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:32.869397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd179edf-4217-4b2c-ad4f-38472dc7abfa None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:32.999286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ff574-7612-4c8a-a09e-998e6a3715ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:33.000304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ff574-7612-4c8a-a09e-998e6a3715ee admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:33.000871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ff574-7612-4c8a-a09e-998e6a3715ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:33.001400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ff574-7612-4c8a-a09e-998e6a3715ee admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:33.002306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ff574-7612-4c8a-a09e-998e6a3715ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:33.004926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ff574-7612-4c8a-a09e-998e6a3715ee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:33.042254 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4244/8478] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:00:32 2022] POST /identity/v3/users => generated 296 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:00:33.043805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5faf532-7f36-4f4c-9757-bbdbfcc6b415 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:33.060718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5faf532-7f36-4f4c-9757-bbdbfcc6b415 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:33.069985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de80ed-39d6-4c8a-838b-b82e2024bfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:33.070867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de80ed-39d6-4c8a-838b-b82e2024bfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:33.071248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de80ed-39d6-4c8a-838b-b82e2024bfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:33.071924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de80ed-39d6-4c8a-838b-b82e2024bfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:33.072439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de80ed-39d6-4c8a-838b-b82e2024bfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:33.074812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de80ed-39d6-4c8a-838b-b82e2024bfd2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:33.092048 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4235/8479] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:00:33.097355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ff574-7612-4c8a-a09e-998e6a3715ee admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:33.112771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ff574-7612-4c8a-a09e-998e6a3715ee admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:33.118570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cf5ad-2ce8-4a88-b663-da9e99f0b5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:33.119302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cf5ad-2ce8-4a88-b663-da9e99f0b5de admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:33.119727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cf5ad-2ce8-4a88-b663-da9e99f0b5de admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:33.120003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cf5ad-2ce8-4a88-b663-da9e99f0b5de admin admin] PATH_INFO: `/v3/projects/143d4c5e654b4267b33efc64fff5ef36/users/7ea5c98d871b43e6b6386112ef148c5e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:33.140929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cf5ad-2ce8-4a88-b663-da9e99f0b5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=143d4c5e654b4267b33efc64fff5ef36, user_id=7ea5c98d871b43e6b6386112ef148c5e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:33.143955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cf5ad-2ce8-4a88-b663-da9e99f0b5de admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:33.173976 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4245/8480] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:00:33 2022] PUT /identity/v3/projects/143d4c5e654b4267b33efc64fff5ef36/users/7ea5c98d871b43e6b6386112ef148c5e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:33.177797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de80ed-39d6-4c8a-838b-b82e2024bfd2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:33.191585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de80ed-39d6-4c8a-838b-b82e2024bfd2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:33.285507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e6805-8da5-4dc5-9202-050c360d7a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:33.286433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e6805-8da5-4dc5-9202-050c360d7a45 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:33.286984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e6805-8da5-4dc5-9202-050c360d7a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:33.287447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e6805-8da5-4dc5-9202-050c360d7a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:33.288552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e6805-8da5-4dc5-9202-050c360d7a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:33.291493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e6805-8da5-4dc5-9202-050c360d7a45 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:33.315137 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4236/8481] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:00:33.315901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cf5ad-2ce8-4a88-b663-da9e99f0b5de admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:33.325515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:33.338470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cf5ad-2ce8-4a88-b663-da9e99f0b5de admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:33.348866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ecff4-2c39-4f3d-89d0-a86ace2b24d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:33.351834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ecff4-2c39-4f3d-89d0-a86ace2b24d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:33.352621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ecff4-2c39-4f3d-89d0-a86ace2b24d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:33.353475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ecff4-2c39-4f3d-89d0-a86ace2b24d0 admin admin] PATH_INFO: `/v3/projects/143d4c5e654b4267b33efc64fff5ef36/users/7ea5c98d871b43e6b6386112ef148c5e/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:33.357616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ecff4-2c39-4f3d-89d0-a86ace2b24d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=143d4c5e654b4267b33efc64fff5ef36, user_id=7ea5c98d871b43e6b6386112ef148c5e, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:33.363826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ecff4-2c39-4f3d-89d0-a86ace2b24d0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:33.382653 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4246/8482] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:00:33 2022] PUT /identity/v3/projects/143d4c5e654b4267b33efc64fff5ef36/users/7ea5c98d871b43e6b6386112ef148c5e/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:00:33.401994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9550e-d67a-4113-98ad-3b3fc1c020c5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:33.402599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9550e-d67a-4113-98ad-3b3fc1c020c5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:33.403106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9550e-d67a-4113-98ad-3b3fc1c020c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:33.442718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d3d9550e-d67a-4113-98ad-3b3fc1c020c5 None None] MFA Rules not processed for user `7ea5c98d871b43e6b6386112ef148c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:33.444160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3d9550e-d67a-4113-98ad-3b3fc1c020c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:33.556118 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4237/8483] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:33.584473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ecff4-2c39-4f3d-89d0-a86ace2b24d0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:33.586752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-093ecff4-2c39-4f3d-89d0-a86ace2b24d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:33.712828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ecff4-2c39-4f3d-89d0-a86ace2b24d0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:33.718060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b3a6a-ab0f-4754-bb61-ce24ef999d30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:33.718838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b3a6a-ab0f-4754-bb61-ce24ef999d30 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:33.719450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b3a6a-ab0f-4754-bb61-ce24ef999d30 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:33.720516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b3a6a-ab0f-4754-bb61-ce24ef999d30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:33.743942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b3a6a-ab0f-4754-bb61-ce24ef999d30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:33.746948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b3a6a-ab0f-4754-bb61-ce24ef999d30 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:33.761651 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4247/8484] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:33.845183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9550e-d67a-4113-98ad-3b3fc1c020c5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:33.846751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3d9550e-d67a-4113-98ad-3b3fc1c020c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:33.868152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9550e-d67a-4113-98ad-3b3fc1c020c5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:33.873549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12d938-f592-43ed-9e7f-db4d09f23e04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:33.874555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12d938-f592-43ed-9e7f-db4d09f23e04 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:33.875057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12d938-f592-43ed-9e7f-db4d09f23e04 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:33.875559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12d938-f592-43ed-9e7f-db4d09f23e04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:33.928506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:33.957387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12d938-f592-43ed-9e7f-db4d09f23e04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:33.959165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12d938-f592-43ed-9e7f-db4d09f23e04 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:34.006172 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4238/8485] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:41.060020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b3a6a-ab0f-4754-bb61-ce24ef999d30 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:41.240624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b3a6a-ab0f-4754-bb61-ce24ef999d30 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:41.253408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b0b72-27a0-4162-a3b5-efc34e1411f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:41.254266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b0b72-27a0-4162-a3b5-efc34e1411f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:41.255565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b0b72-27a0-4162-a3b5-efc34e1411f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:41.256187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b0b72-27a0-4162-a3b5-efc34e1411f3 admin admin] PATH_INFO: `/v3/users/acc131b9c03d4823879874346119713f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:41.262740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b0b72-27a0-4162-a3b5-efc34e1411f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acc131b9c03d4823879874346119713f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:41.265170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b0b72-27a0-4162-a3b5-efc34e1411f3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:41.375457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c47b0b72-27a0-4162-a3b5-efc34e1411f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acc131b9c03d4823879874346119713f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:41.403326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c47b0b72-27a0-4162-a3b5-efc34e1411f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acc131b9c03d4823879874346119713f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:41.405006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c47b0b72-27a0-4162-a3b5-efc34e1411f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acc131b9c03d4823879874346119713f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:41.406678 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c47b0b72-27a0-4162-a3b5-efc34e1411f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acc131b9c03d4823879874346119713f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:41.421437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c47b0b72-27a0-4162-a3b5-efc34e1411f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acc131b9c03d4823879874346119713f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:41.459321 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4248/8486] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:00:41 2022] DELETE /identity/v3/users/acc131b9c03d4823879874346119713f => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:41.460253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df947f1-fd45-4b80-a29c-a06c2edb3bd2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:41.460899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df947f1-fd45-4b80-a29c-a06c2edb3bd2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:41.460899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df947f1-fd45-4b80-a29c-a06c2edb3bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:41.488247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8df947f1-fd45-4b80-a29c-a06c2edb3bd2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:41.489503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8df947f1-fd45-4b80-a29c-a06c2edb3bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:41.580561 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4239/8487] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:00:41.590826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b0b72-27a0-4162-a3b5-efc34e1411f3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:41.592420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c47b0b72-27a0-4162-a3b5-efc34e1411f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:41.624429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:41.805514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b0b72-27a0-4162-a3b5-efc34e1411f3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:41.815162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e949fc5-5a7d-41bb-82c6-c23e4a27c1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:41.815748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e949fc5-5a7d-41bb-82c6-c23e4a27c1ed service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:41.817092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e949fc5-5a7d-41bb-82c6-c23e4a27c1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:41.817606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e949fc5-5a7d-41bb-82c6-c23e4a27c1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:41.843825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e949fc5-5a7d-41bb-82c6-c23e4a27c1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:41.846553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e949fc5-5a7d-41bb-82c6-c23e4a27c1ed service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:41.899296 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4249/8488] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:42.481182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df947f1-fd45-4b80-a29c-a06c2edb3bd2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:42.483605 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8df947f1-fd45-4b80-a29c-a06c2edb3bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:42.575569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df947f1-fd45-4b80-a29c-a06c2edb3bd2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:42.598615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da66f1e-827d-49f8-89d3-153e50017d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:42.599746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da66f1e-827d-49f8-89d3-153e50017d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:42.600218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da66f1e-827d-49f8-89d3-153e50017d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:42.602859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da66f1e-827d-49f8-89d3-153e50017d77 admin admin] PATH_INFO: `/v3/projects/0b1d0fee883d45b483a21e65998a6b41` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:42.607884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da66f1e-827d-49f8-89d3-153e50017d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1d0fee883d45b483a21e65998a6b41)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:42.611924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da66f1e-827d-49f8-89d3-153e50017d77 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:42.689429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1da66f1e-827d-49f8-89d3-153e50017d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1d0fee883d45b483a21e65998a6b41', 'request_id': 'req-1da66f1e-827d-49f8-89d3-153e50017d77'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:42.699939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1da66f1e-827d-49f8-89d3-153e50017d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1d0fee883d45b483a21e65998a6b41', 'request_id': 'req-1da66f1e-827d-49f8-89d3-153e50017d77'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:42.710970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1da66f1e-827d-49f8-89d3-153e50017d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1d0fee883d45b483a21e65998a6b41', 'request_id': 'req-1da66f1e-827d-49f8-89d3-153e50017d77'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:42.726685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1da66f1e-827d-49f8-89d3-153e50017d77 admin admin] The token cache is being invalidate because project 0b1d0fee883d45b483a21e65998a6b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:00:42.727123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1da66f1e-827d-49f8-89d3-153e50017d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:42.727997 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1da66f1e-827d-49f8-89d3-153e50017d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:42.730489 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4240/8489] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:00:42 2022] DELETE /identity/v3/projects/0b1d0fee883d45b483a21e65998a6b41 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:42.735751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e949fc5-5a7d-41bb-82c6-c23e4a27c1ed service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:42.754687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e949fc5-5a7d-41bb-82c6-c23e4a27c1ed service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:42.899458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03b094-70da-4a09-a3b3-a7c682f2afa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:42.900479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03b094-70da-4a09-a3b3-a7c682f2afa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:42.900969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03b094-70da-4a09-a3b3-a7c682f2afa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:42.901450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03b094-70da-4a09-a3b3-a7c682f2afa5 admin admin] PATH_INFO: `/v3/users/ffc47debea7f42419c2920375b4e2403` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:42.903525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03b094-70da-4a09-a3b3-a7c682f2afa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc47debea7f42419c2920375b4e2403)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:42.907550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03b094-70da-4a09-a3b3-a7c682f2afa5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:43.021766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f03b094-70da-4a09-a3b3-a7c682f2afa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc47debea7f42419c2920375b4e2403'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:43.063819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f03b094-70da-4a09-a3b3-a7c682f2afa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc47debea7f42419c2920375b4e2403'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:43.065011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f03b094-70da-4a09-a3b3-a7c682f2afa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc47debea7f42419c2920375b4e2403'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:43.066027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f03b094-70da-4a09-a3b3-a7c682f2afa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc47debea7f42419c2920375b4e2403'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:43.083025 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f03b094-70da-4a09-a3b3-a7c682f2afa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc47debea7f42419c2920375b4e2403'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:43.129098 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4250/8490] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:00:42 2022] DELETE /identity/v3/users/ffc47debea7f42419c2920375b4e2403 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:43.709086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da66f1e-827d-49f8-89d3-153e50017d77 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:43.712279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1da66f1e-827d-49f8-89d3-153e50017d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:43.760134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da66f1e-827d-49f8-89d3-153e50017d77 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:43.903690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28590c1-126b-4c52-a1ad-d003cc49f3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:43.904777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28590c1-126b-4c52-a1ad-d003cc49f3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:43.905282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28590c1-126b-4c52-a1ad-d003cc49f3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:43.905711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28590c1-126b-4c52-a1ad-d003cc49f3dd admin admin] PATH_INFO: `/v3/projects/61f0c3bf45ae4224b50251da0411aa0a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:43.907861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28590c1-126b-4c52-a1ad-d003cc49f3dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f0c3bf45ae4224b50251da0411aa0a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:43.911515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28590c1-126b-4c52-a1ad-d003cc49f3dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:43.937836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:44.022629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d28590c1-126b-4c52-a1ad-d003cc49f3dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f0c3bf45ae4224b50251da0411aa0a', 'request_id': 'req-d28590c1-126b-4c52-a1ad-d003cc49f3dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:44.033038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d28590c1-126b-4c52-a1ad-d003cc49f3dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f0c3bf45ae4224b50251da0411aa0a', 'request_id': 'req-d28590c1-126b-4c52-a1ad-d003cc49f3dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:44.044010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d28590c1-126b-4c52-a1ad-d003cc49f3dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f0c3bf45ae4224b50251da0411aa0a', 'request_id': 'req-d28590c1-126b-4c52-a1ad-d003cc49f3dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:44.059989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d28590c1-126b-4c52-a1ad-d003cc49f3dd admin admin] The token cache is being invalidate because project 61f0c3bf45ae4224b50251da0411aa0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:00:44.060320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d28590c1-126b-4c52-a1ad-d003cc49f3dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:44.061066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d28590c1-126b-4c52-a1ad-d003cc49f3dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:44.066323 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4241/8491] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:00:43 2022] DELETE /identity/v3/projects/61f0c3bf45ae4224b50251da0411aa0a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:00:44.068024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03b094-70da-4a09-a3b3-a7c682f2afa5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:44.070072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3f03b094-70da-4a09-a3b3-a7c682f2afa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:44.106422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03b094-70da-4a09-a3b3-a7c682f2afa5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:44.166736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:44.209081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8eaedd-79a5-4045-b376-bc7b8ffd5c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:44.209761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eaedd-79a5-4045-b376-bc7b8ffd5c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:44.210045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eaedd-79a5-4045-b376-bc7b8ffd5c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:44.210323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eaedd-79a5-4045-b376-bc7b8ffd5c91 admin admin] PATH_INFO: `/v3/users/7ea5c98d871b43e6b6386112ef148c5e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:44.211643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8eaedd-79a5-4045-b376-bc7b8ffd5c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea5c98d871b43e6b6386112ef148c5e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:44.213864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8eaedd-79a5-4045-b376-bc7b8ffd5c91 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:44.329133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f8eaedd-79a5-4045-b376-bc7b8ffd5c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea5c98d871b43e6b6386112ef148c5e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:44.346251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f8eaedd-79a5-4045-b376-bc7b8ffd5c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea5c98d871b43e6b6386112ef148c5e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:44.347590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f8eaedd-79a5-4045-b376-bc7b8ffd5c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea5c98d871b43e6b6386112ef148c5e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:44.348954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f8eaedd-79a5-4045-b376-bc7b8ffd5c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea5c98d871b43e6b6386112ef148c5e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:44.360434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f8eaedd-79a5-4045-b376-bc7b8ffd5c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea5c98d871b43e6b6386112ef148c5e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:44.379817 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4251/8492] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:00:44 2022] DELETE /identity/v3/users/7ea5c98d871b43e6b6386112ef148c5e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:44.787216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28590c1-126b-4c52-a1ad-d003cc49f3dd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:44.790233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d28590c1-126b-4c52-a1ad-d003cc49f3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:44.796973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8eaedd-79a5-4045-b376-bc7b8ffd5c91 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:44.800275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2f8eaedd-79a5-4045-b376-bc7b8ffd5c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:44.839417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28590c1-126b-4c52-a1ad-d003cc49f3dd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:44.934966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f267560-fd00-4ede-990d-021428f2f60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:44.936132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f267560-fd00-4ede-990d-021428f2f60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:44.936625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f267560-fd00-4ede-990d-021428f2f60d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:44.937435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f267560-fd00-4ede-990d-021428f2f60d admin admin] PATH_INFO: `/v3/users/d0c83db94a084371807e8bedbd8ff21d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:44.939249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f267560-fd00-4ede-990d-021428f2f60d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c83db94a084371807e8bedbd8ff21d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:44.941683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f267560-fd00-4ede-990d-021428f2f60d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:44.942846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8eaedd-79a5-4045-b376-bc7b8ffd5c91 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:44.956814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bcd12-2e8b-4b2a-b30e-be988259cdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:44.958138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bcd12-2e8b-4b2a-b30e-be988259cdf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:44.958530 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bcd12-2e8b-4b2a-b30e-be988259cdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:44.958822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bcd12-2e8b-4b2a-b30e-be988259cdf9 admin admin] PATH_INFO: `/v3/projects/143d4c5e654b4267b33efc64fff5ef36` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:44.961113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bcd12-2e8b-4b2a-b30e-be988259cdf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=143d4c5e654b4267b33efc64fff5ef36)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:44.963968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bcd12-2e8b-4b2a-b30e-be988259cdf9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:45.028669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f267560-fd00-4ede-990d-021428f2f60d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c83db94a084371807e8bedbd8ff21d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:45.029904 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f267560-fd00-4ede-990d-021428f2f60d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c83db94a084371807e8bedbd8ff21d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:45.032379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d0bcd12-2e8b-4b2a-b30e-be988259cdf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '143d4c5e654b4267b33efc64fff5ef36', 'request_id': 'req-4d0bcd12-2e8b-4b2a-b30e-be988259cdf9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:45.041443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d0bcd12-2e8b-4b2a-b30e-be988259cdf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '143d4c5e654b4267b33efc64fff5ef36', 'request_id': 'req-4d0bcd12-2e8b-4b2a-b30e-be988259cdf9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:45.043417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:45.053060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d0bcd12-2e8b-4b2a-b30e-be988259cdf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '143d4c5e654b4267b33efc64fff5ef36', 'request_id': 'req-4d0bcd12-2e8b-4b2a-b30e-be988259cdf9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:45.059534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f267560-fd00-4ede-990d-021428f2f60d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c83db94a084371807e8bedbd8ff21d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:45.078774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f267560-fd00-4ede-990d-021428f2f60d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c83db94a084371807e8bedbd8ff21d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:45.087524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d0bcd12-2e8b-4b2a-b30e-be988259cdf9 admin admin] The token cache is being invalidate because project 143d4c5e654b4267b33efc64fff5ef36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:00:45.088046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d0bcd12-2e8b-4b2a-b30e-be988259cdf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:45.089242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d0bcd12-2e8b-4b2a-b30e-be988259cdf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:45.108916 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4252/8493] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:00:44 2022] DELETE /identity/v3/projects/143d4c5e654b4267b33efc64fff5ef36 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:45.108916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96142c13-749d-4a5a-8954-cd41786d21a7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:45.108916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96142c13-749d-4a5a-8954-cd41786d21a7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:45.108916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96142c13-749d-4a5a-8954-cd41786d21a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:45.121860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f267560-fd00-4ede-990d-021428f2f60d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c83db94a084371807e8bedbd8ff21d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:45.135495 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4242/8494] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:00:44 2022] DELETE /identity/v3/users/d0c83db94a084371807e8bedbd8ff21d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:45.137068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a7d56-bcad-4bb0-82fc-8884e2e6493d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:45.142209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-96142c13-749d-4a5a-8954-cd41786d21a7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:45.142435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a7d56-bcad-4bb0-82fc-8884e2e6493d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:45.142748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a7d56-bcad-4bb0-82fc-8884e2e6493d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:45.145202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-96142c13-749d-4a5a-8954-cd41786d21a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:45.186142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-609a7d56-bcad-4bb0-82fc-8884e2e6493d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:45.188049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-609a7d56-bcad-4bb0-82fc-8884e2e6493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:45.200994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:45.359654 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4243/8495] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:45.382210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a7d56-bcad-4bb0-82fc-8884e2e6493d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:45.384543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-609a7d56-bcad-4bb0-82fc-8884e2e6493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:45.389658 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4253/8496] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:45.391606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4c7a7-c5e0-49d7-abf6-d8c159e9d9b2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:45.391942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4c7a7-c5e0-49d7-abf6-d8c159e9d9b2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:45.392291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4c7a7-c5e0-49d7-abf6-d8c159e9d9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:45.425287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1fa4c7a7-c5e0-49d7-abf6-d8c159e9d9b2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:45.426820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1fa4c7a7-c5e0-49d7-abf6-d8c159e9d9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:45.446244 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4254/8497] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:45.450922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4c7a7-c5e0-49d7-abf6-d8c159e9d9b2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:45.471686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4c7a7-c5e0-49d7-abf6-d8c159e9d9b2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:45.481416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b02808-e1e5-441d-bd30-2b1096bbd362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:45.482453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b02808-e1e5-441d-bd30-2b1096bbd362 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:45.483374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b02808-e1e5-441d-bd30-2b1096bbd362 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:45.483726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b02808-e1e5-441d-bd30-2b1096bbd362 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:45.484920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b02808-e1e5-441d-bd30-2b1096bbd362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:00:45.485315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b02808-e1e5-441d-bd30-2b1096bbd362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:45.487561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b02808-e1e5-441d-bd30-2b1096bbd362 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:45.503583 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4255/8498] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:00:45.510653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b02808-e1e5-441d-bd30-2b1096bbd362 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:45.518960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a7d56-bcad-4bb0-82fc-8884e2e6493d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:45.524720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aecd4d-bf83-47db-b8f4-19bcd2ad0c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:45.525793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aecd4d-bf83-47db-b8f4-19bcd2ad0c59 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:45.526156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aecd4d-bf83-47db-b8f4-19bcd2ad0c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:45.526480 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aecd4d-bf83-47db-b8f4-19bcd2ad0c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:45.533159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b02808-e1e5-441d-bd30-2b1096bbd362 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:45.544016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aecd4d-bf83-47db-b8f4-19bcd2ad0c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:45.546689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aecd4d-bf83-47db-b8f4-19bcd2ad0c59 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:45.554305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842349e8-89a8-45d7-a409-267018657be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:45.555141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842349e8-89a8-45d7-a409-267018657be9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:45.555674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842349e8-89a8-45d7-a409-267018657be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:45.556046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842349e8-89a8-45d7-a409-267018657be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:45.556975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842349e8-89a8-45d7-a409-267018657be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:45.564591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842349e8-89a8-45d7-a409-267018657be9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:45.598006 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4244/8499] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:00:45.620247 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4256/8500] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:00:45 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:00:45.621843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aecd4d-bf83-47db-b8f4-19bcd2ad0c59 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:45.633421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aecd4d-bf83-47db-b8f4-19bcd2ad0c59 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:45.754674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec56567-53fd-4139-a770-8bd3d2c28b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:45.755479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56567-53fd-4139-a770-8bd3d2c28b3f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:45.755778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56567-53fd-4139-a770-8bd3d2c28b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:45.756166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56567-53fd-4139-a770-8bd3d2c28b3f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:45.757038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec56567-53fd-4139-a770-8bd3d2c28b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:45.759276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec56567-53fd-4139-a770-8bd3d2c28b3f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:45.789419 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4245/8501] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:00:45 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:00:45.793521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842349e8-89a8-45d7-a409-267018657be9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:45.806571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842349e8-89a8-45d7-a409-267018657be9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:45.812782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df429839-00f9-44d4-924e-2ed01d7293e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:45.813415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df429839-00f9-44d4-924e-2ed01d7293e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:45.813693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df429839-00f9-44d4-924e-2ed01d7293e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:45.813962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df429839-00f9-44d4-924e-2ed01d7293e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:45.814710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df429839-00f9-44d4-924e-2ed01d7293e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:45.816345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df429839-00f9-44d4-924e-2ed01d7293e3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:45.829706 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4257/8502] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:45.842487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec56567-53fd-4139-a770-8bd3d2c28b3f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:45.869829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec56567-53fd-4139-a770-8bd3d2c28b3f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:45.879461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce43cae-c03d-49e1-87eb-9efa7d8058ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:45.880199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce43cae-c03d-49e1-87eb-9efa7d8058ae admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:45.880635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce43cae-c03d-49e1-87eb-9efa7d8058ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:45.880918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce43cae-c03d-49e1-87eb-9efa7d8058ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:45.881590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce43cae-c03d-49e1-87eb-9efa7d8058ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:45.883697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce43cae-c03d-49e1-87eb-9efa7d8058ae admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:45.900784 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4246/8503] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:45.906343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df429839-00f9-44d4-924e-2ed01d7293e3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:45.919561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df429839-00f9-44d4-924e-2ed01d7293e3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:45.927220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09cb60-ca34-4a5d-838c-e444dc6a2693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:45.928369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09cb60-ca34-4a5d-838c-e444dc6a2693 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:45.928859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09cb60-ca34-4a5d-838c-e444dc6a2693 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:45.929379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09cb60-ca34-4a5d-838c-e444dc6a2693 admin admin] PATH_INFO: `/v3/projects/b20e0464518f41a99d964ce032c08633/users/ac670c5c225a49a5a678efb6407eea15/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:45.963014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09cb60-ca34-4a5d-838c-e444dc6a2693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20e0464518f41a99d964ce032c08633, user_id=ac670c5c225a49a5a678efb6407eea15, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:45.970685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09cb60-ca34-4a5d-838c-e444dc6a2693 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:46.003724 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4258/8504] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:00:45 2022] PUT /identity/v3/projects/b20e0464518f41a99d964ce032c08633/users/ac670c5c225a49a5a678efb6407eea15/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:46.018299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e516077-adc8-42c4-94ca-5e195ad86289 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:46.019294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e516077-adc8-42c4-94ca-5e195ad86289 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:46.019799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e516077-adc8-42c4-94ca-5e195ad86289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:46.062661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5e516077-adc8-42c4-94ca-5e195ad86289 None None] MFA Rules not processed for user `ac670c5c225a49a5a678efb6407eea15`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:46.065167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e516077-adc8-42c4-94ca-5e195ad86289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:46.072882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09cb60-ca34-4a5d-838c-e444dc6a2693 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:46.076261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4a09cb60-ca34-4a5d-838c-e444dc6a2693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:46.120037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:46.211111 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4247/8505] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:46.225064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e516077-adc8-42c4-94ca-5e195ad86289 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:46.235204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e516077-adc8-42c4-94ca-5e195ad86289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:46.235443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09cb60-ca34-4a5d-838c-e444dc6a2693 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:46.244859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e08047-c38b-41a6-b6b5-992fe27dfac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:46.245859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08047-c38b-41a6-b6b5-992fe27dfac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:46.246286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08047-c38b-41a6-b6b5-992fe27dfac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:46.246710 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08047-c38b-41a6-b6b5-992fe27dfac5 admin admin] PATH_INFO: `/v3/projects/a29a0c88f3584c72b65de90045354938` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:46.249186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e08047-c38b-41a6-b6b5-992fe27dfac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a29a0c88f3584c72b65de90045354938)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:46.256767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e08047-c38b-41a6-b6b5-992fe27dfac5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:46.262159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:46.329898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3e08047-c38b-41a6-b6b5-992fe27dfac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a29a0c88f3584c72b65de90045354938', 'request_id': 'req-f3e08047-c38b-41a6-b6b5-992fe27dfac5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:46.344470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3e08047-c38b-41a6-b6b5-992fe27dfac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a29a0c88f3584c72b65de90045354938', 'request_id': 'req-f3e08047-c38b-41a6-b6b5-992fe27dfac5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:46.360335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3e08047-c38b-41a6-b6b5-992fe27dfac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a29a0c88f3584c72b65de90045354938', 'request_id': 'req-f3e08047-c38b-41a6-b6b5-992fe27dfac5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:46.391436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3e08047-c38b-41a6-b6b5-992fe27dfac5 admin admin] The token cache is being invalidate because project a29a0c88f3584c72b65de90045354938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:00:46.391829 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3e08047-c38b-41a6-b6b5-992fe27dfac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:46.392659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3e08047-c38b-41a6-b6b5-992fe27dfac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:46.394023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e516077-adc8-42c4-94ca-5e195ad86289 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:46.394972 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4259/8506] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:00:46 2022] DELETE /identity/v3/projects/a29a0c88f3584c72b65de90045354938 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:46.402651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee31bfd-76bc-45db-a933-e6202758b4d4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:46.403243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee31bfd-76bc-45db-a933-e6202758b4d4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:46.404460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee31bfd-76bc-45db-a933-e6202758b4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:46.427572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7ee31bfd-76bc-45db-a933-e6202758b4d4 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:46.428825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7ee31bfd-76bc-45db-a933-e6202758b4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:46.472920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66328f7-cc33-4fda-ba5f-94fb94b935ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:46.473844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66328f7-cc33-4fda-ba5f-94fb94b935ca service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:46.474265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66328f7-cc33-4fda-ba5f-94fb94b935ca service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:46.474730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66328f7-cc33-4fda-ba5f-94fb94b935ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:46.478232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b66328f7-cc33-4fda-ba5f-94fb94b935ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:46.514912 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4260/8507] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:46.524667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4c06c-a521-47af-a47f-45d323a6a090 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:46.525101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4c06c-a521-47af-a47f-45d323a6a090 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:46.525473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4c06c-a521-47af-a47f-45d323a6a090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:46.558844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a6a4c06c-a521-47af-a47f-45d323a6a090 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:46.561942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a6a4c06c-a521-47af-a47f-45d323a6a090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:46.570682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66328f7-cc33-4fda-ba5f-94fb94b935ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:46.572569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66328f7-cc33-4fda-ba5f-94fb94b935ca service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:46.588071 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4248/8508] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:46.594400 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4261/8509] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:00:46.611514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66328f7-cc33-4fda-ba5f-94fb94b935ca service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:46.616653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4c06c-a521-47af-a47f-45d323a6a090 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:46.618251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a6a4c06c-a521-47af-a47f-45d323a6a090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:46.619761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66328f7-cc33-4fda-ba5f-94fb94b935ca service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:46.626767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc33f0-3e84-4bfb-8762-44ac13a42725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:46.627940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc33f0-3e84-4bfb-8762-44ac13a42725 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:46.628378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc33f0-3e84-4bfb-8762-44ac13a42725 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:46.628832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc33f0-3e84-4bfb-8762-44ac13a42725 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:46.630181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc33f0-3e84-4bfb-8762-44ac13a42725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:00:46.630494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc33f0-3e84-4bfb-8762-44ac13a42725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:46.632464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc33f0-3e84-4bfb-8762-44ac13a42725 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:46.633286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4c06c-a521-47af-a47f-45d323a6a090 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:46.642061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8ea3f-9314-40da-a1ff-f6203c52e5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:46.643515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8ea3f-9314-40da-a1ff-f6203c52e5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:46.644178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8ea3f-9314-40da-a1ff-f6203c52e5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:46.644906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8ea3f-9314-40da-a1ff-f6203c52e5f3 admin admin] PATH_INFO: `/v3/users/ac670c5c225a49a5a678efb6407eea15` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:46.646496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8ea3f-9314-40da-a1ff-f6203c52e5f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac670c5c225a49a5a678efb6407eea15)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:46.650306 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4249/8510] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:00:46.651352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc33f0-3e84-4bfb-8762-44ac13a42725 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:46.652859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8ea3f-9314-40da-a1ff-f6203c52e5f3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:46.668150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc33f0-3e84-4bfb-8762-44ac13a42725 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:46.674491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadf08d-a514-47a8-a688-260efe9525cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:46.675153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadf08d-a514-47a8-a688-260efe9525cc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:46.675492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadf08d-a514-47a8-a688-260efe9525cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:46.675735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadf08d-a514-47a8-a688-260efe9525cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:46.676435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadf08d-a514-47a8-a688-260efe9525cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:46.680706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadf08d-a514-47a8-a688-260efe9525cc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:46.686801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:46.718939 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4250/8511] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:00:46 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:00:46.723867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadf08d-a514-47a8-a688-260efe9525cc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:46.755955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6f8ea3f-9314-40da-a1ff-f6203c52e5f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac670c5c225a49a5a678efb6407eea15'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:46.800958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6f8ea3f-9314-40da-a1ff-f6203c52e5f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac670c5c225a49a5a678efb6407eea15'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:46.802460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6f8ea3f-9314-40da-a1ff-f6203c52e5f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac670c5c225a49a5a678efb6407eea15'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:46.803303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6f8ea3f-9314-40da-a1ff-f6203c52e5f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac670c5c225a49a5a678efb6407eea15'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:46.814944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6f8ea3f-9314-40da-a1ff-f6203c52e5f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac670c5c225a49a5a678efb6407eea15'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:46.841540 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4262/8512] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:00:46 2022] DELETE /identity/v3/users/ac670c5c225a49a5a678efb6407eea15 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:46.845211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586ce6b-26ac-43d8-997e-7bc167c296e2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:46.846050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586ce6b-26ac-43d8-997e-7bc167c296e2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:46.846697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586ce6b-26ac-43d8-997e-7bc167c296e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:46.861938 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadf08d-a514-47a8-a688-260efe9525cc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:46.866907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:46.894515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d586ce6b-26ac-43d8-997e-7bc167c296e2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:46.896166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d586ce6b-26ac-43d8-997e-7bc167c296e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:46.952736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b910665-220e-405e-bd26-9dc16c84226e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:46.954105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b910665-220e-405e-bd26-9dc16c84226e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:46.955063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b910665-220e-405e-bd26-9dc16c84226e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:46.955283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b910665-220e-405e-bd26-9dc16c84226e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:46.956411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b910665-220e-405e-bd26-9dc16c84226e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:46.959973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b910665-220e-405e-bd26-9dc16c84226e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:46.991923 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4251/8513] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:00:46 2022] POST /identity/v3/users => generated 295 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:00:46.996288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b910665-220e-405e-bd26-9dc16c84226e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:46.998188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b910665-220e-405e-bd26-9dc16c84226e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:46.999475 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4263/8514] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:00:47.009945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586ce6b-26ac-43d8-997e-7bc167c296e2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:47.012282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d586ce6b-26ac-43d8-997e-7bc167c296e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:47.017814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b910665-220e-405e-bd26-9dc16c84226e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:47.023030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74565675-b24a-4b82-ae10-b0c33f0b5829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:47.024788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74565675-b24a-4b82-ae10-b0c33f0b5829 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:47.025075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74565675-b24a-4b82-ae10-b0c33f0b5829 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:47.025352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74565675-b24a-4b82-ae10-b0c33f0b5829 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:47.026266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74565675-b24a-4b82-ae10-b0c33f0b5829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:47.028672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74565675-b24a-4b82-ae10-b0c33f0b5829 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:47.041868 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4252/8515] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:00:47.046075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74565675-b24a-4b82-ae10-b0c33f0b5829 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:47.058246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74565675-b24a-4b82-ae10-b0c33f0b5829 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:47.063958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41047a3b-1f4a-4efb-89bd-10358a4bbcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:47.064586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41047a3b-1f4a-4efb-89bd-10358a4bbcdf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:47.064874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41047a3b-1f4a-4efb-89bd-10358a4bbcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:47.065154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41047a3b-1f4a-4efb-89bd-10358a4bbcdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:47.065845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41047a3b-1f4a-4efb-89bd-10358a4bbcdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:47.067503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41047a3b-1f4a-4efb-89bd-10358a4bbcdf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:47.088165 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4253/8516] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:47.093330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41047a3b-1f4a-4efb-89bd-10358a4bbcdf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:47.110772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41047a3b-1f4a-4efb-89bd-10358a4bbcdf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:47.118556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81e0a9-7a49-4a89-8d28-7b14ff01b021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:47.119247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586ce6b-26ac-43d8-997e-7bc167c296e2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:47.119427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81e0a9-7a49-4a89-8d28-7b14ff01b021 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:47.119578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81e0a9-7a49-4a89-8d28-7b14ff01b021 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:47.119828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81e0a9-7a49-4a89-8d28-7b14ff01b021 admin admin] PATH_INFO: `/v3/projects/14250d6be640465986b12c31a4b72835/users/5ee3f7fbf4684fb3b479fc2d9526a04f/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:47.125259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d618c-736a-4c58-ba3d-efc5c78b64be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:47.125889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d618c-736a-4c58-ba3d-efc5c78b64be service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:47.126176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d618c-736a-4c58-ba3d-efc5c78b64be service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:47.126454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d618c-736a-4c58-ba3d-efc5c78b64be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:47.137336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d618c-736a-4c58-ba3d-efc5c78b64be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:47.138802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d618c-736a-4c58-ba3d-efc5c78b64be service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:47.143481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81e0a9-7a49-4a89-8d28-7b14ff01b021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14250d6be640465986b12c31a4b72835, user_id=5ee3f7fbf4684fb3b479fc2d9526a04f, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:47.147189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81e0a9-7a49-4a89-8d28-7b14ff01b021 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:47.155561 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4264/8517] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:47.164974 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4254/8518] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:00:47 2022] PUT /identity/v3/projects/14250d6be640465986b12c31a4b72835/users/5ee3f7fbf4684fb3b479fc2d9526a04f/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:47.177416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cf430-4966-48c7-9339-17f3e6ef670d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:47.177716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cf430-4966-48c7-9339-17f3e6ef670d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:47.178506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cf430-4966-48c7-9339-17f3e6ef670d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:47.224551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-989cf430-4966-48c7-9339-17f3e6ef670d None None] MFA Rules not processed for user `5ee3f7fbf4684fb3b479fc2d9526a04f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:47.227015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-989cf430-4966-48c7-9339-17f3e6ef670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:47.332303 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4265/8519] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:47.341021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81e0a9-7a49-4a89-8d28-7b14ff01b021 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:47.343232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e81e0a9-7a49-4a89-8d28-7b14ff01b021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:47.451595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:47.482461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81e0a9-7a49-4a89-8d28-7b14ff01b021 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:47.487580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9263d1-9967-4fd0-84b7-540857e3f4ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:47.488468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9263d1-9967-4fd0-84b7-540857e3f4ff service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:47.489054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9263d1-9967-4fd0-84b7-540857e3f4ff service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:47.489242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9263d1-9967-4fd0-84b7-540857e3f4ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:47.502542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9263d1-9967-4fd0-84b7-540857e3f4ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:47.504886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9263d1-9967-4fd0-84b7-540857e3f4ff service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:47.519120 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4255/8520] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:47.553515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cf430-4966-48c7-9339-17f3e6ef670d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:47.563978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9263d1-9967-4fd0-84b7-540857e3f4ff service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:47.566051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc9263d1-9967-4fd0-84b7-540857e3f4ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:47.678500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:47.716872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cf430-4966-48c7-9339-17f3e6ef670d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:47.721481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5151870-7f38-4538-aa13-d8f5805dcd52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:47.722807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9263d1-9967-4fd0-84b7-540857e3f4ff service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:47.723038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5151870-7f38-4538-aa13-d8f5805dcd52 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:47.723589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5151870-7f38-4538-aa13-d8f5805dcd52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:47.724022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5151870-7f38-4538-aa13-d8f5805dcd52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:47.728486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c419e5d-0231-4fc7-9c76-f8e8f6c330d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:47.730403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c419e5d-0231-4fc7-9c76-f8e8f6c330d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:47.730403 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c419e5d-0231-4fc7-9c76-f8e8f6c330d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:47.731362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c419e5d-0231-4fc7-9c76-f8e8f6c330d0 admin admin] PATH_INFO: `/v3/projects/b20e0464518f41a99d964ce032c08633` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:47.732582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c419e5d-0231-4fc7-9c76-f8e8f6c330d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b20e0464518f41a99d964ce032c08633)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:47.733318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a5151870-7f38-4538-aa13-d8f5805dcd52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:47.734898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c419e5d-0231-4fc7-9c76-f8e8f6c330d0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:47.827826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c419e5d-0231-4fc7-9c76-f8e8f6c330d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b20e0464518f41a99d964ce032c08633', 'request_id': 'req-4c419e5d-0231-4fc7-9c76-f8e8f6c330d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:47.839309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c419e5d-0231-4fc7-9c76-f8e8f6c330d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b20e0464518f41a99d964ce032c08633', 'request_id': 'req-4c419e5d-0231-4fc7-9c76-f8e8f6c330d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:47.852058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c419e5d-0231-4fc7-9c76-f8e8f6c330d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b20e0464518f41a99d964ce032c08633', 'request_id': 'req-4c419e5d-0231-4fc7-9c76-f8e8f6c330d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:47.868523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5151870-7f38-4538-aa13-d8f5805dcd52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:47.871899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5151870-7f38-4538-aa13-d8f5805dcd52 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:47.872915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c419e5d-0231-4fc7-9c76-f8e8f6c330d0 admin admin] The token cache is being invalidate because project b20e0464518f41a99d964ce032c08633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:00:47.873458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c419e5d-0231-4fc7-9c76-f8e8f6c330d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:47.874587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c419e5d-0231-4fc7-9c76-f8e8f6c330d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:47.881437 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4256/8521] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:00:47 2022] DELETE /identity/v3/projects/b20e0464518f41a99d964ce032c08633 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:47.890220 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4266/8522] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:47.896899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff85ca-f52b-4546-8de7-7f5634669cb8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:47.897188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff85ca-f52b-4546-8de7-7f5634669cb8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:47.897472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff85ca-f52b-4546-8de7-7f5634669cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:47.900570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5151870-7f38-4538-aa13-d8f5805dcd52 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:47.905503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a5151870-7f38-4538-aa13-d8f5805dcd52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:47.929249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f4ff85ca-f52b-4546-8de7-7f5634669cb8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:47.931467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4ff85ca-f52b-4546-8de7-7f5634669cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:48.051436 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4257/8523] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:48.056317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad882c-57a7-42c0-a7f2-1b24bf9914b9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:48.056602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad882c-57a7-42c0-a7f2-1b24bf9914b9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:48.056887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad882c-57a7-42c0-a7f2-1b24bf9914b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:48.096258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e9ad882c-57a7-42c0-a7f2-1b24bf9914b9 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:48.097529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e9ad882c-57a7-42c0-a7f2-1b24bf9914b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:48.139134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5151870-7f38-4538-aa13-d8f5805dcd52 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:48.141140 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4258/8524] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:48.157980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad882c-57a7-42c0-a7f2-1b24bf9914b9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:48.180325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:48.234930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad882c-57a7-42c0-a7f2-1b24bf9914b9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:48.250926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871149f-57b2-407e-a0cc-2ec184e0f0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:48.251979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871149f-57b2-407e-a0cc-2ec184e0f0fe admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:48.252445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871149f-57b2-407e-a0cc-2ec184e0f0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:48.253025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871149f-57b2-407e-a0cc-2ec184e0f0fe admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:48.253746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871149f-57b2-407e-a0cc-2ec184e0f0fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:00:48.254156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871149f-57b2-407e-a0cc-2ec184e0f0fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:48.257884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871149f-57b2-407e-a0cc-2ec184e0f0fe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:48.287166 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4259/8525] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:00:48.288611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871149f-57b2-407e-a0cc-2ec184e0f0fe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:48.300873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871149f-57b2-407e-a0cc-2ec184e0f0fe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:48.310941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6aa3e-004b-470c-834f-126c1bcffe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:48.312150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6aa3e-004b-470c-834f-126c1bcffe57 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:48.312494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6aa3e-004b-470c-834f-126c1bcffe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:48.313140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6aa3e-004b-470c-834f-126c1bcffe57 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:48.313848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6aa3e-004b-470c-834f-126c1bcffe57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:48.315918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6aa3e-004b-470c-834f-126c1bcffe57 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:48.319189 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7e5f6-2e9c-449b-8422-68195fca8a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:48.319879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7e5f6-2e9c-449b-8422-68195fca8a1a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:48.320326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7e5f6-2e9c-449b-8422-68195fca8a1a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:48.320797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7e5f6-2e9c-449b-8422-68195fca8a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:48.324790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0cd7e5f6-2e9c-449b-8422-68195fca8a1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:48.359924 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4260/8526] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:00:48 2022] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:00:48.366241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6aa3e-004b-470c-834f-126c1bcffe57 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:48.425803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:48.475053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6aa3e-004b-470c-834f-126c1bcffe57 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:48.482310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cc4c8-4904-474a-8e6b-6355bc35f2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:48.483592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cc4c8-4904-474a-8e6b-6355bc35f2ae admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:48.484027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cc4c8-4904-474a-8e6b-6355bc35f2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:48.484452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cc4c8-4904-474a-8e6b-6355bc35f2ae admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:48.485305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5cc4c8-4904-474a-8e6b-6355bc35f2ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:48.487659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5cc4c8-4904-474a-8e6b-6355bc35f2ae admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:48.508608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7e5f6-2e9c-449b-8422-68195fca8a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:48.511312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7e5f6-2e9c-449b-8422-68195fca8a1a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:48.515825 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4261/8527] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:00:48 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:00:48.522786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cc4c8-4904-474a-8e6b-6355bc35f2ae admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:48.525533 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4267/8528] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:48.549602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cc4c8-4904-474a-8e6b-6355bc35f2ae admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:48.558990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2769276-3353-4464-bc91-9643aca542a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:48.559918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2769276-3353-4464-bc91-9643aca542a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:48.560293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2769276-3353-4464-bc91-9643aca542a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:48.560868 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2769276-3353-4464-bc91-9643aca542a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:48.561755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2769276-3353-4464-bc91-9643aca542a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:48.569562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2769276-3353-4464-bc91-9643aca542a9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:48.587708 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4262/8529] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:48.591581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7e5f6-2e9c-449b-8422-68195fca8a1a service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:48.623604 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7e5f6-2e9c-449b-8422-68195fca8a1a service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:48.646771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e54981-0523-4064-a64b-41c7bb8a7aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:48.647884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e54981-0523-4064-a64b-41c7bb8a7aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:48.648315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e54981-0523-4064-a64b-41c7bb8a7aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:48.648831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e54981-0523-4064-a64b-41c7bb8a7aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:48.649770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e54981-0523-4064-a64b-41c7bb8a7aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:48.652143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e54981-0523-4064-a64b-41c7bb8a7aa0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:48.699984 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4268/8530] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:00:48.704612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2769276-3353-4464-bc91-9643aca542a9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:48.734740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2769276-3353-4464-bc91-9643aca542a9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:48.764568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b645ae-e38b-4111-b353-366c43a60f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:48.767708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b645ae-e38b-4111-b353-366c43a60f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:48.768911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b645ae-e38b-4111-b353-366c43a60f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:48.769517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b645ae-e38b-4111-b353-366c43a60f53 admin admin] PATH_INFO: `/v3/projects/276b79c5bff341a3a2f22a8d95df60c3/users/4486e383f6964303a10e7a28dd0b016d/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:48.794627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b645ae-e38b-4111-b353-366c43a60f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276b79c5bff341a3a2f22a8d95df60c3, user_id=4486e383f6964303a10e7a28dd0b016d, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:48.798385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b645ae-e38b-4111-b353-366c43a60f53 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:48.826748 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4263/8531] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:00:48 2022] PUT /identity/v3/projects/276b79c5bff341a3a2f22a8d95df60c3/users/4486e383f6964303a10e7a28dd0b016d/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:48.846272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02054909-c802-49db-8153-159fc2e65c81 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:48.846504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02054909-c802-49db-8153-159fc2e65c81 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:48.846807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02054909-c802-49db-8153-159fc2e65c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:48.880708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b645ae-e38b-4111-b353-366c43a60f53 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:48.882675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9b645ae-e38b-4111-b353-366c43a60f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:48.904093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-02054909-c802-49db-8153-159fc2e65c81 None None] MFA Rules not processed for user `4486e383f6964303a10e7a28dd0b016d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:48.906280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-02054909-c802-49db-8153-159fc2e65c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:49.036153 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4269/8532] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:49.042142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02054909-c802-49db-8153-159fc2e65c81 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:49.066658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b645ae-e38b-4111-b353-366c43a60f53 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:49.078752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab739c05-d098-4bb5-90fe-12bf9338be38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:49.079545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab739c05-d098-4bb5-90fe-12bf9338be38 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:49.079741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab739c05-d098-4bb5-90fe-12bf9338be38 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:49.080170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab739c05-d098-4bb5-90fe-12bf9338be38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:49.082703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab739c05-d098-4bb5-90fe-12bf9338be38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:49.114768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab739c05-d098-4bb5-90fe-12bf9338be38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:49.116937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab739c05-d098-4bb5-90fe-12bf9338be38 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:49.191237 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4264/8533] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:00:49.205011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02054909-c802-49db-8153-159fc2e65c81 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:49.210660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd1dfe-8889-442c-aef7-4dc1337005f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:49.211322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd1dfe-8889-442c-aef7-4dc1337005f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:49.211612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd1dfe-8889-442c-aef7-4dc1337005f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:49.211891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd1dfe-8889-442c-aef7-4dc1337005f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:49.212540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd1dfe-8889-442c-aef7-4dc1337005f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:49.218821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd1dfe-8889-442c-aef7-4dc1337005f9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:49.304163 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4270/8534] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:00:49 2022] POST /identity/v3/projects => generated 389 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:00:49.305664 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab739c05-d098-4bb5-90fe-12bf9338be38 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:49.338138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab739c05-d098-4bb5-90fe-12bf9338be38 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:49.348012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:49.466442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207ccb7-6ef4-4c5d-9190-9ac6a51cff5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:49.467418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207ccb7-6ef4-4c5d-9190-9ac6a51cff5a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:49.467980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207ccb7-6ef4-4c5d-9190-9ac6a51cff5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:49.468492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207ccb7-6ef4-4c5d-9190-9ac6a51cff5a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:49.469710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207ccb7-6ef4-4c5d-9190-9ac6a51cff5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:49.473253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207ccb7-6ef4-4c5d-9190-9ac6a51cff5a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:49.509994 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4265/8535] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:00:49 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:00:49.511945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd1dfe-8889-442c-aef7-4dc1337005f9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:49.546503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd1dfe-8889-442c-aef7-4dc1337005f9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:49.567006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb6842-f5df-4c46-9d76-71cc6ba9760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:49.568732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb6842-f5df-4c46-9d76-71cc6ba9760b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:49.569954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb6842-f5df-4c46-9d76-71cc6ba9760b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:49.570206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb6842-f5df-4c46-9d76-71cc6ba9760b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:49.571748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb6842-f5df-4c46-9d76-71cc6ba9760b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:49.576472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb6842-f5df-4c46-9d76-71cc6ba9760b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:49.592477 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4271/8536] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:00:49.598229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207ccb7-6ef4-4c5d-9190-9ac6a51cff5a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:49.610233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207ccb7-6ef4-4c5d-9190-9ac6a51cff5a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:49.615377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e84ce9-2d44-4a1b-925e-54e1d20f416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:49.616002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e84ce9-2d44-4a1b-925e-54e1d20f416a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:49.616278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e84ce9-2d44-4a1b-925e-54e1d20f416a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:49.616704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e84ce9-2d44-4a1b-925e-54e1d20f416a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:49.617361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e84ce9-2d44-4a1b-925e-54e1d20f416a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:49.619078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e84ce9-2d44-4a1b-925e-54e1d20f416a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:49.637209 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4266/8537] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:49.644143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb6842-f5df-4c46-9d76-71cc6ba9760b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:49.657522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb6842-f5df-4c46-9d76-71cc6ba9760b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:49.667538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704d476-2408-4e35-860c-620e843a7d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:49.668224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704d476-2408-4e35-860c-620e843a7d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:49.668789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704d476-2408-4e35-860c-620e843a7d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:49.669268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704d476-2408-4e35-860c-620e843a7d06 admin admin] PATH_INFO: `/v3/projects/a98be1de69154810ace4156a369946d0/users/a57d32b420da45f09e2d3762b6071b7c/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:49.688186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704d476-2408-4e35-860c-620e843a7d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98be1de69154810ace4156a369946d0, user_id=a57d32b420da45f09e2d3762b6071b7c, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:49.690837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704d476-2408-4e35-860c-620e843a7d06 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:49.693643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:49.715316 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4272/8538] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:00:49 2022] PUT /identity/v3/projects/a98be1de69154810ace4156a369946d0/users/a57d32b420da45f09e2d3762b6071b7c/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:49.728842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15be3d-ec75-4ef0-8e36-37fb9123878d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:49.729110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15be3d-ec75-4ef0-8e36-37fb9123878d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:49.729496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15be3d-ec75-4ef0-8e36-37fb9123878d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:49.776673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3c15be3d-ec75-4ef0-8e36-37fb9123878d None None] MFA Rules not processed for user `a57d32b420da45f09e2d3762b6071b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:49.778510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3c15be3d-ec75-4ef0-8e36-37fb9123878d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:49.896400 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4267/8539] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:49.898706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704d476-2408-4e35-860c-620e843a7d06 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:50.035750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704d476-2408-4e35-860c-620e843a7d06 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:50.045141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf8a9c-8114-43bc-9341-d369b356a45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:50.046127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf8a9c-8114-43bc-9341-d369b356a45a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:50.046509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf8a9c-8114-43bc-9341-d369b356a45a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:50.048204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf8a9c-8114-43bc-9341-d369b356a45a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:50.048204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf8a9c-8114-43bc-9341-d369b356a45a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:50.050580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf8a9c-8114-43bc-9341-d369b356a45a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:50.100883 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4273/8540] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:00:49 2022] POST /identity/v3/projects => generated 389 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:00:50.105682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15be3d-ec75-4ef0-8e36-37fb9123878d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:50.130011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15be3d-ec75-4ef0-8e36-37fb9123878d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:50.219568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d21a30-e79b-4798-acbc-ee985b7a53db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:50.220342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d21a30-e79b-4798-acbc-ee985b7a53db admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:50.221456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d21a30-e79b-4798-acbc-ee985b7a53db admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:50.221763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d21a30-e79b-4798-acbc-ee985b7a53db admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:50.222448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d21a30-e79b-4798-acbc-ee985b7a53db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:50.227207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d21a30-e79b-4798-acbc-ee985b7a53db admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:50.275695 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4268/8541] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:00:50 2022] POST /identity/v3/users => generated 301 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:00:50.279791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf8a9c-8114-43bc-9341-d369b356a45a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:50.293316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf8a9c-8114-43bc-9341-d369b356a45a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:50.298981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda1f11-aba1-4a35-868c-b39c6b9721e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:50.299958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda1f11-aba1-4a35-868c-b39c6b9721e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:50.300348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda1f11-aba1-4a35-868c-b39c6b9721e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:50.300752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda1f11-aba1-4a35-868c-b39c6b9721e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:50.301528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda1f11-aba1-4a35-868c-b39c6b9721e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:50.303347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda1f11-aba1-4a35-868c-b39c6b9721e1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:50.321326 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4274/8542] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:00:50.322532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d21a30-e79b-4798-acbc-ee985b7a53db admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:50.347650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d21a30-e79b-4798-acbc-ee985b7a53db admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:50.356151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47ca7a-fd22-4d82-8384-b5ca772c10a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:50.357424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47ca7a-fd22-4d82-8384-b5ca772c10a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:50.357721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47ca7a-fd22-4d82-8384-b5ca772c10a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:50.358522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47ca7a-fd22-4d82-8384-b5ca772c10a6 admin admin] PATH_INFO: `/v3/projects/af54123d031043ef928e4fa046f30367/users/e9e2ceb7be5244488f014f7f3b8b5fa5/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:50.363574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:50.408054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47ca7a-fd22-4d82-8384-b5ca772c10a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af54123d031043ef928e4fa046f30367, user_id=e9e2ceb7be5244488f014f7f3b8b5fa5, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:50.412452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47ca7a-fd22-4d82-8384-b5ca772c10a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:50.441319 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4269/8543] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:00:50 2022] PUT /identity/v3/projects/af54123d031043ef928e4fa046f30367/users/e9e2ceb7be5244488f014f7f3b8b5fa5/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:50.442632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda1f11-aba1-4a35-868c-b39c6b9721e1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:50.460225 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda1f11-aba1-4a35-868c-b39c6b9721e1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:50.603908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d394275-fcb6-47b4-b91c-c8317ce5966b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:50.605423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d394275-fcb6-47b4-b91c-c8317ce5966b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:50.609859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d394275-fcb6-47b4-b91c-c8317ce5966b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:50.609859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d394275-fcb6-47b4-b91c-c8317ce5966b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:50.611285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d394275-fcb6-47b4-b91c-c8317ce5966b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:50.615979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d394275-fcb6-47b4-b91c-c8317ce5966b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:50.635406 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4275/8544] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:50.637039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47ca7a-fd22-4d82-8384-b5ca772c10a6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:50.655682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47ca7a-fd22-4d82-8384-b5ca772c10a6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:50.666181 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc92f5-853c-49b7-8cd2-102f9547400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:50.666824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc92f5-853c-49b7-8cd2-102f9547400f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:50.667106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc92f5-853c-49b7-8cd2-102f9547400f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:50.667421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc92f5-853c-49b7-8cd2-102f9547400f admin admin] PATH_INFO: `/v3/projects/af54123d031043ef928e4fa046f30367/users/e9e2ceb7be5244488f014f7f3b8b5fa5/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:50.669474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc92f5-853c-49b7-8cd2-102f9547400f admin admin] RBAC: Authorizing `identity:create_grant(project_id=af54123d031043ef928e4fa046f30367, user_id=e9e2ceb7be5244488f014f7f3b8b5fa5, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:50.672730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc92f5-853c-49b7-8cd2-102f9547400f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:50.720194 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4270/8545] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:00:50 2022] PUT /identity/v3/projects/af54123d031043ef928e4fa046f30367/users/e9e2ceb7be5244488f014f7f3b8b5fa5/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:50.721671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b1ff8-1a16-4192-b061-a7d58a6ad137 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:50.721963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b1ff8-1a16-4192-b061-a7d58a6ad137 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:50.722246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b1ff8-1a16-4192-b061-a7d58a6ad137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:50.791847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-397b1ff8-1a16-4192-b061-a7d58a6ad137 None None] MFA Rules not processed for user `e9e2ceb7be5244488f014f7f3b8b5fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:50.796019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-397b1ff8-1a16-4192-b061-a7d58a6ad137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:50.890523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:50.921099 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4276/8546] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:00:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:00:50.937175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc92f5-853c-49b7-8cd2-102f9547400f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:51.050246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc92f5-853c-49b7-8cd2-102f9547400f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:51.061359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c072b72-eda4-4ed6-8ff6-6a91a31e8409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:51.062378 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c072b72-eda4-4ed6-8ff6-6a91a31e8409 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:51.062870 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c072b72-eda4-4ed6-8ff6-6a91a31e8409 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:51.063631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c072b72-eda4-4ed6-8ff6-6a91a31e8409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:51.135649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c072b72-eda4-4ed6-8ff6-6a91a31e8409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:51.137272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c072b72-eda4-4ed6-8ff6-6a91a31e8409 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:51.158798 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4271/8547] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:53.710160 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b1ff8-1a16-4192-b061-a7d58a6ad137 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:53.711739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-397b1ff8-1a16-4192-b061-a7d58a6ad137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:53.802581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b1ff8-1a16-4192-b061-a7d58a6ad137 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:53.806945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91f8fa-dfbc-4d09-85fb-fd753c4650ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:53.807953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91f8fa-dfbc-4d09-85fb-fd753c4650ff service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:53.808447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91f8fa-dfbc-4d09-85fb-fd753c4650ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:53.808952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91f8fa-dfbc-4d09-85fb-fd753c4650ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:53.820974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91f8fa-dfbc-4d09-85fb-fd753c4650ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:53.822830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91f8fa-dfbc-4d09-85fb-fd753c4650ff service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:53.838146 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4277/8548] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:53 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:00.027761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c132aed-14f3-4c69-80ac-9cc5fc7109b7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:00.028333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c132aed-14f3-4c69-80ac-9cc5fc7109b7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:00.028333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c132aed-14f3-4c69-80ac-9cc5fc7109b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:00.055234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0c132aed-14f3-4c69-80ac-9cc5fc7109b7 None None] MFA Rules not processed for user `4486e383f6964303a10e7a28dd0b016d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:00.056774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0c132aed-14f3-4c69-80ac-9cc5fc7109b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:00.066227 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4272/8549] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:01:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:01.185497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91f8fa-dfbc-4d09-85fb-fd753c4650ff service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:01.187453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cc91f8fa-dfbc-4d09-85fb-fd753c4650ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:01.345043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91f8fa-dfbc-4d09-85fb-fd753c4650ff service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:01.351167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66454f-7bfb-4b41-9f34-64e77c1d1564 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:01.364070 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66454f-7bfb-4b41-9f34-64e77c1d1564 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:01.364563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66454f-7bfb-4b41-9f34-64e77c1d1564 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:01.365014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66454f-7bfb-4b41-9f34-64e77c1d1564 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:01.367729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0a66454f-7bfb-4b41-9f34-64e77c1d1564 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:01.400483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66454f-7bfb-4b41-9f34-64e77c1d1564 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:01.402506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66454f-7bfb-4b41-9f34-64e77c1d1564 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:01.433843 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4278/8550] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:05.302462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c132aed-14f3-4c69-80ac-9cc5fc7109b7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:05.318069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c132aed-14f3-4c69-80ac-9cc5fc7109b7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:05.322892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52527608-da17-46a8-a847-d31b98f45170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:05.323800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52527608-da17-46a8-a847-d31b98f45170 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:05.324390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52527608-da17-46a8-a847-d31b98f45170 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:05.324958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52527608-da17-46a8-a847-d31b98f45170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:05.327115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52527608-da17-46a8-a847-d31b98f45170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:05.344625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52527608-da17-46a8-a847-d31b98f45170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:05.346675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52527608-da17-46a8-a847-d31b98f45170 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:05.363182 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4273/8551] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:11.420413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=63 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:13.398976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66454f-7bfb-4b41-9f34-64e77c1d1564 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:13.400520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0a66454f-7bfb-4b41-9f34-64e77c1d1564 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:13.540208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66454f-7bfb-4b41-9f34-64e77c1d1564 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:13.550945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49038ca5-8fa3-42aa-92fa-e3ac65968bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:13.553005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49038ca5-8fa3-42aa-92fa-e3ac65968bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:13.553643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49038ca5-8fa3-42aa-92fa-e3ac65968bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:13.554209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49038ca5-8fa3-42aa-92fa-e3ac65968bb7 admin admin] PATH_INFO: `/v3/users/5ee3f7fbf4684fb3b479fc2d9526a04f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:13.556791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49038ca5-8fa3-42aa-92fa-e3ac65968bb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee3f7fbf4684fb3b479fc2d9526a04f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:13.563731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49038ca5-8fa3-42aa-92fa-e3ac65968bb7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:13.657468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49038ca5-8fa3-42aa-92fa-e3ac65968bb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee3f7fbf4684fb3b479fc2d9526a04f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:13.673437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49038ca5-8fa3-42aa-92fa-e3ac65968bb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee3f7fbf4684fb3b479fc2d9526a04f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:13.674662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49038ca5-8fa3-42aa-92fa-e3ac65968bb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee3f7fbf4684fb3b479fc2d9526a04f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:13.675336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49038ca5-8fa3-42aa-92fa-e3ac65968bb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee3f7fbf4684fb3b479fc2d9526a04f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:13.686631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49038ca5-8fa3-42aa-92fa-e3ac65968bb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee3f7fbf4684fb3b479fc2d9526a04f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:13.713514 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4279/8552] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:01:13 2022] DELETE /identity/v3/users/5ee3f7fbf4684fb3b479fc2d9526a04f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:13.718435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57a72b-2b07-4b55-bddd-770f805c21b8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:13.719088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57a72b-2b07-4b55-bddd-770f805c21b8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:13.719088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57a72b-2b07-4b55-bddd-770f805c21b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:13.746466 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3c57a72b-2b07-4b55-bddd-770f805c21b8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:13.748065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3c57a72b-2b07-4b55-bddd-770f805c21b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:13.809347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:13.839349 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4274/8553] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:13.848763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49038ca5-8fa3-42aa-92fa-e3ac65968bb7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:13.852606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-49038ca5-8fa3-42aa-92fa-e3ac65968bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:13.921254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49038ca5-8fa3-42aa-92fa-e3ac65968bb7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:13.928404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b1293-2c21-4cd4-a149-5a341bc19d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:13.929489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1293-2c21-4cd4-a149-5a341bc19d68 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:13.929940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1293-2c21-4cd4-a149-5a341bc19d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:13.930537 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1293-2c21-4cd4-a149-5a341bc19d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:13.944059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b1293-2c21-4cd4-a149-5a341bc19d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:13.947339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b1293-2c21-4cd4-a149-5a341bc19d68 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:13.964103 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4280/8554] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:14.532178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57a72b-2b07-4b55-bddd-770f805c21b8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:14.535786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3c57a72b-2b07-4b55-bddd-770f805c21b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:14.596517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57a72b-2b07-4b55-bddd-770f805c21b8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:14.609581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df56d3-08f1-4365-859f-5f79b38d1480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:14.610895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df56d3-08f1-4365-859f-5f79b38d1480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:14.613047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df56d3-08f1-4365-859f-5f79b38d1480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:14.615889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df56d3-08f1-4365-859f-5f79b38d1480 admin admin] PATH_INFO: `/v3/projects/14250d6be640465986b12c31a4b72835` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:14.621241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df56d3-08f1-4365-859f-5f79b38d1480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14250d6be640465986b12c31a4b72835)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:14.635372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df56d3-08f1-4365-859f-5f79b38d1480 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:14.787495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1df56d3-08f1-4365-859f-5f79b38d1480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14250d6be640465986b12c31a4b72835', 'request_id': 'req-e1df56d3-08f1-4365-859f-5f79b38d1480'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:14.808981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1df56d3-08f1-4365-859f-5f79b38d1480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14250d6be640465986b12c31a4b72835', 'request_id': 'req-e1df56d3-08f1-4365-859f-5f79b38d1480'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:14.826470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1df56d3-08f1-4365-859f-5f79b38d1480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14250d6be640465986b12c31a4b72835', 'request_id': 'req-e1df56d3-08f1-4365-859f-5f79b38d1480'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:14.854573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1df56d3-08f1-4365-859f-5f79b38d1480 admin admin] The token cache is being invalidate because project 14250d6be640465986b12c31a4b72835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:01:14.855028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1df56d3-08f1-4365-859f-5f79b38d1480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:14.855809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1df56d3-08f1-4365-859f-5f79b38d1480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:14.857646 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4275/8555] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:01:14 2022] DELETE /identity/v3/projects/14250d6be640465986b12c31a4b72835 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:14.863207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7685a7d-49c1-4662-ada9-20a1bacbf69d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:14.863754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7685a7d-49c1-4662-ada9-20a1bacbf69d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:14.863754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7685a7d-49c1-4662-ada9-20a1bacbf69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:14.886119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a7685a7d-49c1-4662-ada9-20a1bacbf69d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:14.887446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a7685a7d-49c1-4662-ada9-20a1bacbf69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:14.909621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:14.998914 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4281/8556] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:15.011185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f46f5-18e3-4119-876e-e9585a6be869 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:15.011573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f46f5-18e3-4119-876e-e9585a6be869 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:15.012087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f46f5-18e3-4119-876e-e9585a6be869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:15.045356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-600f46f5-18e3-4119-876e-e9585a6be869 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:15.046697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-600f46f5-18e3-4119-876e-e9585a6be869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:15.056971 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4276/8557] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:15.061252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7685a7d-49c1-4662-ada9-20a1bacbf69d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:15.073030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7685a7d-49c1-4662-ada9-20a1bacbf69d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:15.078097 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c78fb6-6a3c-4fe0-8077-ba04a9dc894c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:15.078811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c78fb6-6a3c-4fe0-8077-ba04a9dc894c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:15.079873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c78fb6-6a3c-4fe0-8077-ba04a9dc894c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:15.079873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c78fb6-6a3c-4fe0-8077-ba04a9dc894c admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:15.080739 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c78fb6-6a3c-4fe0-8077-ba04a9dc894c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:01:15.080940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c78fb6-6a3c-4fe0-8077-ba04a9dc894c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:15.082689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c78fb6-6a3c-4fe0-8077-ba04a9dc894c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:15.106887 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4282/8558] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:15.107830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f46f5-18e3-4119-876e-e9585a6be869 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:15.119367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f46f5-18e3-4119-876e-e9585a6be869 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:15.124608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d4efa-46b5-49fa-bc47-53036ecae735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:15.125593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d4efa-46b5-49fa-bc47-53036ecae735 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:15.125939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d4efa-46b5-49fa-bc47-53036ecae735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:15.126286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d4efa-46b5-49fa-bc47-53036ecae735 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:15.128843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d4efa-46b5-49fa-bc47-53036ecae735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:15.129221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d4efa-46b5-49fa-bc47-53036ecae735 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:15.178577 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4277/8559] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:01:15 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:15.184231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c78fb6-6a3c-4fe0-8077-ba04a9dc894c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:15.196790 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c78fb6-6a3c-4fe0-8077-ba04a9dc894c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:15.274735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef8c61-3409-49b2-b926-e4fe893bf2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:15.275416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef8c61-3409-49b2-b926-e4fe893bf2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:15.275734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef8c61-3409-49b2-b926-e4fe893bf2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:15.275999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef8c61-3409-49b2-b926-e4fe893bf2e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:15.276667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef8c61-3409-49b2-b926-e4fe893bf2e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:15.278770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef8c61-3409-49b2-b926-e4fe893bf2e7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:15.306277 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4283/8560] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:01:15 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:15.311084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d4efa-46b5-49fa-bc47-53036ecae735 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:15.330794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d4efa-46b5-49fa-bc47-53036ecae735 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:15.340951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27917028-4624-462a-b9ac-5bafe6ce4b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:15.341790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27917028-4624-462a-b9ac-5bafe6ce4b25 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:15.342180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27917028-4624-462a-b9ac-5bafe6ce4b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:15.342957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27917028-4624-462a-b9ac-5bafe6ce4b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:15.344171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27917028-4624-462a-b9ac-5bafe6ce4b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:15.346334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27917028-4624-462a-b9ac-5bafe6ce4b25 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:15.371077 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4278/8561] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:15.373723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef8c61-3409-49b2-b926-e4fe893bf2e7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:15.393857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef8c61-3409-49b2-b926-e4fe893bf2e7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:15.399668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd0753-f4e9-476b-bcb0-168297a4d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:15.400399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd0753-f4e9-476b-bcb0-168297a4d23a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:15.400748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd0753-f4e9-476b-bcb0-168297a4d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:15.401094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd0753-f4e9-476b-bcb0-168297a4d23a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:15.401842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd0753-f4e9-476b-bcb0-168297a4d23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:15.403649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd0753-f4e9-476b-bcb0-168297a4d23a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:15.419599 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4284/8562] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:15.421216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27917028-4624-462a-b9ac-5bafe6ce4b25 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:15.435311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27917028-4624-462a-b9ac-5bafe6ce4b25 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:15.440551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597475e5-980d-4391-85ff-363d4ca8fc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:15.441341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597475e5-980d-4391-85ff-363d4ca8fc19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:15.442175 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597475e5-980d-4391-85ff-363d4ca8fc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:15.442639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597475e5-980d-4391-85ff-363d4ca8fc19 admin admin] PATH_INFO: `/v3/projects/28a1271a4d1f4ef18dd94af077428097/users/46b25b59dad6494489035bbe105973cf/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:15.461133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597475e5-980d-4391-85ff-363d4ca8fc19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a1271a4d1f4ef18dd94af077428097, user_id=46b25b59dad6494489035bbe105973cf, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:15.464953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597475e5-980d-4391-85ff-363d4ca8fc19 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:15.487652 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4279/8563] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:01:15 2022] PUT /identity/v3/projects/28a1271a4d1f4ef18dd94af077428097/users/46b25b59dad6494489035bbe105973cf/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:15.490499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d07406-ba83-49b8-8078-97fec63e57b5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:15.491020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d07406-ba83-49b8-8078-97fec63e57b5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:15.491499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d07406-ba83-49b8-8078-97fec63e57b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:15.518476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-83d07406-ba83-49b8-8078-97fec63e57b5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:15.519972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-83d07406-ba83-49b8-8078-97fec63e57b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:15.611922 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4285/8564] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:15.623305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597475e5-980d-4391-85ff-363d4ca8fc19 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:15.625585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-597475e5-980d-4391-85ff-363d4ca8fc19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:15.730360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597475e5-980d-4391-85ff-363d4ca8fc19 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:15.737339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1612f-1897-43c0-846d-d99f026c9d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:15.738447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1612f-1897-43c0-846d-d99f026c9d2c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:15.738799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1612f-1897-43c0-846d-d99f026c9d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:15.739146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1612f-1897-43c0-846d-d99f026c9d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:15.753453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1612f-1897-43c0-846d-d99f026c9d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:15.755817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1612f-1897-43c0-846d-d99f026c9d2c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:15.767717 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4280/8565] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:17.055175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f318bf-9c49-48dd-8125-4e94373b16a2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:17.056054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f318bf-9c49-48dd-8125-4e94373b16a2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:17.056054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f318bf-9c49-48dd-8125-4e94373b16a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:17.103497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f8f318bf-9c49-48dd-8125-4e94373b16a2 None None] MFA Rules not processed for user `46b25b59dad6494489035bbe105973cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:17.105807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f8f318bf-9c49-48dd-8125-4e94373b16a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:17.131892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:17.248075 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4286/8566] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:01:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:17.254147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1612f-1897-43c0-846d-d99f026c9d2c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:17.270347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1612f-1897-43c0-846d-d99f026c9d2c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:17.276877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7d8f2-5e5a-4f52-8955-c964deeae925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:17.277841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7d8f2-5e5a-4f52-8955-c964deeae925 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:17.278213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7d8f2-5e5a-4f52-8955-c964deeae925 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:17.278590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7d8f2-5e5a-4f52-8955-c964deeae925 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:17.279311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7d8f2-5e5a-4f52-8955-c964deeae925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:17.281401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7d8f2-5e5a-4f52-8955-c964deeae925 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:17.288846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:17.319291 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4281/8567] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:01:17 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:17.323864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f318bf-9c49-48dd-8125-4e94373b16a2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:17.337869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f318bf-9c49-48dd-8125-4e94373b16a2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:17.409862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fd80b-f581-45a0-a43e-4c9b0b1c7310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:17.410620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fd80b-f581-45a0-a43e-4c9b0b1c7310 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:17.411041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fd80b-f581-45a0-a43e-4c9b0b1c7310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:17.411564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fd80b-f581-45a0-a43e-4c9b0b1c7310 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:17.412281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fd80b-f581-45a0-a43e-4c9b0b1c7310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:17.414428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fd80b-f581-45a0-a43e-4c9b0b1c7310 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:17.440586 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4287/8568] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:01:17 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:01:17.446362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7d8f2-5e5a-4f52-8955-c964deeae925 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:17.459909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7d8f2-5e5a-4f52-8955-c964deeae925 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:17.465903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421fda3-49e4-47fb-a1c1-476a96528a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:17.466757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421fda3-49e4-47fb-a1c1-476a96528a47 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:17.467051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421fda3-49e4-47fb-a1c1-476a96528a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:17.467473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421fda3-49e4-47fb-a1c1-476a96528a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:17.468515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421fda3-49e4-47fb-a1c1-476a96528a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:17.470573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421fda3-49e4-47fb-a1c1-476a96528a47 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:17.484331 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4282/8569] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:17.489120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fd80b-f581-45a0-a43e-4c9b0b1c7310 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:17.511169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fd80b-f581-45a0-a43e-4c9b0b1c7310 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:17.517636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e1623-1377-4cf7-80cf-83481b90890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:17.518459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e1623-1377-4cf7-80cf-83481b90890d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:17.518771 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e1623-1377-4cf7-80cf-83481b90890d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:17.519053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e1623-1377-4cf7-80cf-83481b90890d admin admin] PATH_INFO: `/v3/projects/f3de294ad307429f87c6bf80e17a503a/users/161006384b8343658ff1f9af8c8acae5/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:17.537416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e1623-1377-4cf7-80cf-83481b90890d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3de294ad307429f87c6bf80e17a503a, user_id=161006384b8343658ff1f9af8c8acae5, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:17.540182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e1623-1377-4cf7-80cf-83481b90890d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:17.556568 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4288/8570] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:01:17 2022] PUT /identity/v3/projects/f3de294ad307429f87c6bf80e17a503a/users/161006384b8343658ff1f9af8c8acae5/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:17.560517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421fda3-49e4-47fb-a1c1-476a96528a47 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:17.579845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421fda3-49e4-47fb-a1c1-476a96528a47 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:17.651746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af1744-1362-42c7-b4d5-c1c4704c3bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:17.652753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af1744-1362-42c7-b4d5-c1c4704c3bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:17.653958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af1744-1362-42c7-b4d5-c1c4704c3bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:17.653958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af1744-1362-42c7-b4d5-c1c4704c3bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:17.654965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af1744-1362-42c7-b4d5-c1c4704c3bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:17.658002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af1744-1362-42c7-b4d5-c1c4704c3bc4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:17.672742 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4283/8571] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:17.677494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e1623-1377-4cf7-80cf-83481b90890d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:17.689634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e1623-1377-4cf7-80cf-83481b90890d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:17.695592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1628a-7a87-4fed-b1c2-7e98f5fd5bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:17.696267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1628a-7a87-4fed-b1c2-7e98f5fd5bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:17.696598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1628a-7a87-4fed-b1c2-7e98f5fd5bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:17.696844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1628a-7a87-4fed-b1c2-7e98f5fd5bd8 admin admin] PATH_INFO: `/v3/projects/f3de294ad307429f87c6bf80e17a503a/users/161006384b8343658ff1f9af8c8acae5/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:17.698843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1628a-7a87-4fed-b1c2-7e98f5fd5bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3de294ad307429f87c6bf80e17a503a, user_id=161006384b8343658ff1f9af8c8acae5, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:17.701895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1628a-7a87-4fed-b1c2-7e98f5fd5bd8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:17.716635 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4289/8572] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:01:17 2022] PUT /identity/v3/projects/f3de294ad307429f87c6bf80e17a503a/users/161006384b8343658ff1f9af8c8acae5/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:19.133946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ed097-a83a-451f-9234-fbe4dcbe8f4f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:19.134850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ed097-a83a-451f-9234-fbe4dcbe8f4f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:19.135321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ed097-a83a-451f-9234-fbe4dcbe8f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:19.172600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ee1ed097-a83a-451f-9234-fbe4dcbe8f4f None None] MFA Rules not processed for user `161006384b8343658ff1f9af8c8acae5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:19.174897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ee1ed097-a83a-451f-9234-fbe4dcbe8f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:19.311497 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4284/8573] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:01:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:19.323495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9e224-9857-4ef9-8806-e0b9dfe3098f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:19.325332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9e224-9857-4ef9-8806-e0b9dfe3098f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:19.325966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9e224-9857-4ef9-8806-e0b9dfe3098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:19.368889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5ec9e224-9857-4ef9-8806-e0b9dfe3098f None None] MFA Rules not processed for user `46b25b59dad6494489035bbe105973cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:19.372123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5ec9e224-9857-4ef9-8806-e0b9dfe3098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:19.538724 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4290/8574] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:01:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:19.554059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ed097-a83a-451f-9234-fbe4dcbe8f4f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:19.556379 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ee1ed097-a83a-451f-9234-fbe4dcbe8f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:19.668433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:19.718450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ed097-a83a-451f-9234-fbe4dcbe8f4f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:19.719029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c346d34-a112-4200-a19a-b788ff120b41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:19.720052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c346d34-a112-4200-a19a-b788ff120b41 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:19.720399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c346d34-a112-4200-a19a-b788ff120b41 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:19.720781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c346d34-a112-4200-a19a-b788ff120b41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:19.730739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c346d34-a112-4200-a19a-b788ff120b41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:19.732626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c346d34-a112-4200-a19a-b788ff120b41 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:19.743903 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4285/8575] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:29.529936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:29.738756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:37.946963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9e224-9857-4ef9-8806-e0b9dfe3098f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:37.949135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5ec9e224-9857-4ef9-8806-e0b9dfe3098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:37.983905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9e224-9857-4ef9-8806-e0b9dfe3098f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:37.992774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85282467-fd07-4359-b3b4-2df9f52a7291 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:37.994110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282467-fd07-4359-b3b4-2df9f52a7291 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:37.994654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282467-fd07-4359-b3b4-2df9f52a7291 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:37.995050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282467-fd07-4359-b3b4-2df9f52a7291 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:37.997647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-85282467-fd07-4359-b3b4-2df9f52a7291 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:38.157551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85282467-fd07-4359-b3b4-2df9f52a7291 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:38.161697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85282467-fd07-4359-b3b4-2df9f52a7291 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:38.215721 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4291/8576] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:39.617818 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c346d34-a112-4200-a19a-b788ff120b41 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:39.619431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8c346d34-a112-4200-a19a-b788ff120b41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:39.735510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c346d34-a112-4200-a19a-b788ff120b41 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:39.744241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775fc41-8423-4caf-b7e0-e4b9c8c478b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:39.745274 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775fc41-8423-4caf-b7e0-e4b9c8c478b6 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:39.745776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775fc41-8423-4caf-b7e0-e4b9c8c478b6 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:39.746187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775fc41-8423-4caf-b7e0-e4b9c8c478b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:39.749227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5775fc41-8423-4caf-b7e0-e4b9c8c478b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:39.769854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775fc41-8423-4caf-b7e0-e4b9c8c478b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:39.771882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775fc41-8423-4caf-b7e0-e4b9c8c478b6 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:39.791635 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4286/8577] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:43.673337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc647e-d1a4-4def-9ea7-d90d00ed08b3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:43.674488 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc647e-d1a4-4def-9ea7-d90d00ed08b3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:43.675008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc647e-d1a4-4def-9ea7-d90d00ed08b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:43.703631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dacc647e-d1a4-4def-9ea7-d90d00ed08b3 None None] MFA Rules not processed for user `ce13155820524da2b6d8cc5c23373953`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:43.704839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dacc647e-d1a4-4def-9ea7-d90d00ed08b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:43.796699 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4292/8578] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:01:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:49.784332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=32 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:50.711428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775fc41-8423-4caf-b7e0-e4b9c8c478b6 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:50.818893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775fc41-8423-4caf-b7e0-e4b9c8c478b6 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:50.825009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d2b4e-c3b3-4975-80d2-704810df183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:50.826180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d2b4e-c3b3-4975-80d2-704810df183f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:50.826845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d2b4e-c3b3-4975-80d2-704810df183f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:50.827451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d2b4e-c3b3-4975-80d2-704810df183f admin admin] PATH_INFO: `/v3/users/46b25b59dad6494489035bbe105973cf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:50.829046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d2b4e-c3b3-4975-80d2-704810df183f admin admin] RBAC: Authorizing `identity:delete_user(user_id=46b25b59dad6494489035bbe105973cf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:50.832636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d2b4e-c3b3-4975-80d2-704810df183f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:50.929916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-758d2b4e-c3b3-4975-80d2-704810df183f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46b25b59dad6494489035bbe105973cf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:50.933029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-758d2b4e-c3b3-4975-80d2-704810df183f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46b25b59dad6494489035bbe105973cf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:50.951281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-758d2b4e-c3b3-4975-80d2-704810df183f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46b25b59dad6494489035bbe105973cf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:50.969326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-758d2b4e-c3b3-4975-80d2-704810df183f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46b25b59dad6494489035bbe105973cf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:51.003306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-758d2b4e-c3b3-4975-80d2-704810df183f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46b25b59dad6494489035bbe105973cf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:51.016337 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4287/8579] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:01:50 2022] DELETE /identity/v3/users/46b25b59dad6494489035bbe105973cf => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:51.495922 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc647e-d1a4-4def-9ea7-d90d00ed08b3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:51.514114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc647e-d1a4-4def-9ea7-d90d00ed08b3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:51.619989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bf149-2879-44db-9987-a8c746c9c15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:51.620871 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bf149-2879-44db-9987-a8c746c9c15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:51.621395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bf149-2879-44db-9987-a8c746c9c15a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:51.621973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bf149-2879-44db-9987-a8c746c9c15a admin admin] PATH_INFO: `/v3/projects/28a1271a4d1f4ef18dd94af077428097` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:51.624125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bf149-2879-44db-9987-a8c746c9c15a admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a1271a4d1f4ef18dd94af077428097)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:51.627879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bf149-2879-44db-9987-a8c746c9c15a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:51.660881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:51.714106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-675bf149-2879-44db-9987-a8c746c9c15a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a1271a4d1f4ef18dd94af077428097', 'request_id': 'req-675bf149-2879-44db-9987-a8c746c9c15a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:51.723879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-675bf149-2879-44db-9987-a8c746c9c15a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a1271a4d1f4ef18dd94af077428097', 'request_id': 'req-675bf149-2879-44db-9987-a8c746c9c15a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:51.730170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-675bf149-2879-44db-9987-a8c746c9c15a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a1271a4d1f4ef18dd94af077428097', 'request_id': 'req-675bf149-2879-44db-9987-a8c746c9c15a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:51.747699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-675bf149-2879-44db-9987-a8c746c9c15a admin admin] The token cache is being invalidate because project 28a1271a4d1f4ef18dd94af077428097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:01:51.748195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-675bf149-2879-44db-9987-a8c746c9c15a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:51.749238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-675bf149-2879-44db-9987-a8c746c9c15a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:51.751522 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4293/8580] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:01:51 2022] DELETE /identity/v3/projects/28a1271a4d1f4ef18dd94af077428097 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:51.756365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d2b4e-c3b3-4975-80d2-704810df183f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:51.758352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-758d2b4e-c3b3-4975-80d2-704810df183f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:51.777593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d2b4e-c3b3-4975-80d2-704810df183f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:51.863454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a10a2-c88b-465f-bb91-f563f58e55a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:51.864473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a10a2-c88b-465f-bb91-f563f58e55a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:51.864473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a10a2-c88b-465f-bb91-f563f58e55a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:51.864695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a10a2-c88b-465f-bb91-f563f58e55a0 admin admin] PATH_INFO: `/v3/users/161006384b8343658ff1f9af8c8acae5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:51.866266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a10a2-c88b-465f-bb91-f563f58e55a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=161006384b8343658ff1f9af8c8acae5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:51.868373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a10a2-c88b-465f-bb91-f563f58e55a0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:51.896445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:51.934432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb2a10a2-c88b-465f-bb91-f563f58e55a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '161006384b8343658ff1f9af8c8acae5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:51.941767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb2a10a2-c88b-465f-bb91-f563f58e55a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '161006384b8343658ff1f9af8c8acae5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:51.955098 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb2a10a2-c88b-465f-bb91-f563f58e55a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '161006384b8343658ff1f9af8c8acae5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:51.965679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb2a10a2-c88b-465f-bb91-f563f58e55a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '161006384b8343658ff1f9af8c8acae5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:51.980980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb2a10a2-c88b-465f-bb91-f563f58e55a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '161006384b8343658ff1f9af8c8acae5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:51.988159 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4288/8581] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:01:51 2022] DELETE /identity/v3/users/161006384b8343658ff1f9af8c8acae5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:52.225698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bf149-2879-44db-9987-a8c746c9c15a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:52.237223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-675bf149-2879-44db-9987-a8c746c9c15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:52.254227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bf149-2879-44db-9987-a8c746c9c15a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:52.353032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e283e-79fa-42de-a966-b924fcf3bfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:52.354152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e283e-79fa-42de-a966-b924fcf3bfc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:52.354611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e283e-79fa-42de-a966-b924fcf3bfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:52.354882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e283e-79fa-42de-a966-b924fcf3bfc4 admin admin] PATH_INFO: `/v3/projects/f3de294ad307429f87c6bf80e17a503a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:52.356287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e283e-79fa-42de-a966-b924fcf3bfc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3de294ad307429f87c6bf80e17a503a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:52.358559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e283e-79fa-42de-a966-b924fcf3bfc4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:52.446508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f73e283e-79fa-42de-a966-b924fcf3bfc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3de294ad307429f87c6bf80e17a503a', 'request_id': 'req-f73e283e-79fa-42de-a966-b924fcf3bfc4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.457707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f73e283e-79fa-42de-a966-b924fcf3bfc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3de294ad307429f87c6bf80e17a503a', 'request_id': 'req-f73e283e-79fa-42de-a966-b924fcf3bfc4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.466691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f73e283e-79fa-42de-a966-b924fcf3bfc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3de294ad307429f87c6bf80e17a503a', 'request_id': 'req-f73e283e-79fa-42de-a966-b924fcf3bfc4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.484832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f73e283e-79fa-42de-a966-b924fcf3bfc4 admin admin] The token cache is being invalidate because project f3de294ad307429f87c6bf80e17a503a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:01:52.485677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f73e283e-79fa-42de-a966-b924fcf3bfc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.486559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f73e283e-79fa-42de-a966-b924fcf3bfc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.499325 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4294/8582] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:01:52 2022] DELETE /identity/v3/projects/f3de294ad307429f87c6bf80e17a503a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:52.500288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57a151-6896-486f-b04d-a48595543eb2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:52.500288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57a151-6896-486f-b04d-a48595543eb2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:52.500288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57a151-6896-486f-b04d-a48595543eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:52.527506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cf57a151-6896-486f-b04d-a48595543eb2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:52.529193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf57a151-6896-486f-b04d-a48595543eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:52.663817 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4289/8583] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:01:52.671995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7dd60-606e-4882-a891-fa10c6807fde None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:52.672300 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7dd60-606e-4882-a891-fa10c6807fde None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:52.672554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7dd60-606e-4882-a891-fa10c6807fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:52.699674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5bb7dd60-606e-4882-a891-fa10c6807fde None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:52.701243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5bb7dd60-606e-4882-a891-fa10c6807fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:52.714923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57a151-6896-486f-b04d-a48595543eb2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:52.726319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57a151-6896-486f-b04d-a48595543eb2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:52.727359 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4295/8584] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:52.732536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5ad64-c775-4d3b-89d5-493324c1770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:52.733158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5ad64-c775-4d3b-89d5-493324c1770a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:52.733774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5ad64-c775-4d3b-89d5-493324c1770a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:52.734054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5ad64-c775-4d3b-89d5-493324c1770a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:52.734770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5ad64-c775-4d3b-89d5-493324c1770a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:01:52.735073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5ad64-c775-4d3b-89d5-493324c1770a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:52.736731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5ad64-c775-4d3b-89d5-493324c1770a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:52.756045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7dd60-606e-4882-a891-fa10c6807fde None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:52.767325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7dd60-606e-4882-a891-fa10c6807fde None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:52.768323 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4290/8585] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:52.772953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8451b-dad2-4c69-bb4f-2ddf2d7f51fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:52.773399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8451b-dad2-4c69-bb4f-2ddf2d7f51fc admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:52.773675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8451b-dad2-4c69-bb4f-2ddf2d7f51fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:52.773947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8451b-dad2-4c69-bb4f-2ddf2d7f51fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:52.774696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8451b-dad2-4c69-bb4f-2ddf2d7f51fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:52.777487 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8451b-dad2-4c69-bb4f-2ddf2d7f51fc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:52.821704 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4296/8586] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:01:52 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:52.826395 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5ad64-c775-4d3b-89d5-493324c1770a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:52.838551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5ad64-c775-4d3b-89d5-493324c1770a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:52.926476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473680be-8beb-4e77-a7a1-bb9df3dd81d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:52.927454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473680be-8beb-4e77-a7a1-bb9df3dd81d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:52.927856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473680be-8beb-4e77-a7a1-bb9df3dd81d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:52.928336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473680be-8beb-4e77-a7a1-bb9df3dd81d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:52.929534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473680be-8beb-4e77-a7a1-bb9df3dd81d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:52.932360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473680be-8beb-4e77-a7a1-bb9df3dd81d5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:52.972212 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4291/8587] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:01:52 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:52.976666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8451b-dad2-4c69-bb4f-2ddf2d7f51fc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:52.988959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8451b-dad2-4c69-bb4f-2ddf2d7f51fc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:52.994740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0436377-b013-4875-8efc-fc225b0e111a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:52.995445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0436377-b013-4875-8efc-fc225b0e111a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:52.995946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0436377-b013-4875-8efc-fc225b0e111a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:52.996234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0436377-b013-4875-8efc-fc225b0e111a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:52.997039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0436377-b013-4875-8efc-fc225b0e111a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:52.998695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0436377-b013-4875-8efc-fc225b0e111a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:53.000303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:53.021523 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4297/8588] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:53.023473 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473680be-8beb-4e77-a7a1-bb9df3dd81d5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:53.040153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473680be-8beb-4e77-a7a1-bb9df3dd81d5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:53.047774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce41f6-c95a-4604-9d66-398a58b7676f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:53.048706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce41f6-c95a-4604-9d66-398a58b7676f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:53.049094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce41f6-c95a-4604-9d66-398a58b7676f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:53.049530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce41f6-c95a-4604-9d66-398a58b7676f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:53.050488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce41f6-c95a-4604-9d66-398a58b7676f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:53.053491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce41f6-c95a-4604-9d66-398a58b7676f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:53.075592 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4292/8589] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:53.081202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0436377-b013-4875-8efc-fc225b0e111a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:53.092145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0436377-b013-4875-8efc-fc225b0e111a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:53.098734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaadf4d-28f6-4969-b39e-bfd1423cfd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:53.100063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaadf4d-28f6-4969-b39e-bfd1423cfd4f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:53.100063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaadf4d-28f6-4969-b39e-bfd1423cfd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:53.100063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaadf4d-28f6-4969-b39e-bfd1423cfd4f admin admin] PATH_INFO: `/v3/projects/91c6a0602b2f433ea5c62ce6ebd52028/users/2aa7d94090504881bb0ffd560ba90378/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:53.125560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaadf4d-28f6-4969-b39e-bfd1423cfd4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c6a0602b2f433ea5c62ce6ebd52028, user_id=2aa7d94090504881bb0ffd560ba90378, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:53.128718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaadf4d-28f6-4969-b39e-bfd1423cfd4f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:53.149542 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4298/8590] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:01:53 2022] PUT /identity/v3/projects/91c6a0602b2f433ea5c62ce6ebd52028/users/2aa7d94090504881bb0ffd560ba90378/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:01:53.157436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825e40c-b2e3-47ac-809f-97e991e2eeb7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:53.158139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825e40c-b2e3-47ac-809f-97e991e2eeb7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:53.158781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825e40c-b2e3-47ac-809f-97e991e2eeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:53.172728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:53.186493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0825e40c-b2e3-47ac-809f-97e991e2eeb7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:53.188682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0825e40c-b2e3-47ac-809f-97e991e2eeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:53.287110 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4293/8591] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:01:53.299590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaadf4d-28f6-4969-b39e-bfd1423cfd4f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:53.303066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0eaadf4d-28f6-4969-b39e-bfd1423cfd4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:53.400902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaadf4d-28f6-4969-b39e-bfd1423cfd4f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:53.405240 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2aa7f-79fe-459f-8a3b-1efcbd75594f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:53.405867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2aa7f-79fe-459f-8a3b-1efcbd75594f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:53.406150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2aa7f-79fe-459f-8a3b-1efcbd75594f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:53.406577 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2aa7f-79fe-459f-8a3b-1efcbd75594f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:53.420278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2aa7f-79fe-459f-8a3b-1efcbd75594f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:53.422208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2aa7f-79fe-459f-8a3b-1efcbd75594f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:53.435422 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4299/8592] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:54.869645 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825e40c-b2e3-47ac-809f-97e991e2eeb7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:54.871778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0825e40c-b2e3-47ac-809f-97e991e2eeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:54.904082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825e40c-b2e3-47ac-809f-97e991e2eeb7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:54.910985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b87d7e-dc8b-4690-a592-1e0d8216d84e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:54.913292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b87d7e-dc8b-4690-a592-1e0d8216d84e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:54.914057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b87d7e-dc8b-4690-a592-1e0d8216d84e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:54.915083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b87d7e-dc8b-4690-a592-1e0d8216d84e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:54.922398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-60b87d7e-dc8b-4690-a592-1e0d8216d84e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:54.951294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b87d7e-dc8b-4690-a592-1e0d8216d84e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:54.954382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b87d7e-dc8b-4690-a592-1e0d8216d84e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:54.987873 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4294/8593] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:56.483366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2aa7f-79fe-459f-8a3b-1efcbd75594f service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:56.485626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d3f2aa7f-79fe-459f-8a3b-1efcbd75594f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:56.563807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2aa7f-79fe-459f-8a3b-1efcbd75594f service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:56.580170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cde38-0a74-4392-9479-6e59ae0c1136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:56.581684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cde38-0a74-4392-9479-6e59ae0c1136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:56.582469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cde38-0a74-4392-9479-6e59ae0c1136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:56.582933 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cde38-0a74-4392-9479-6e59ae0c1136 admin admin] PATH_INFO: `/v3/users/87b1618e8b794f36be81dd1e26b45fbc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:56.586195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cde38-0a74-4392-9479-6e59ae0c1136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b1618e8b794f36be81dd1e26b45fbc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:56.591051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cde38-0a74-4392-9479-6e59ae0c1136 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:56.766484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b0cde38-0a74-4392-9479-6e59ae0c1136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b1618e8b794f36be81dd1e26b45fbc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:56.800780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b0cde38-0a74-4392-9479-6e59ae0c1136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b1618e8b794f36be81dd1e26b45fbc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:56.802432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b0cde38-0a74-4392-9479-6e59ae0c1136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b1618e8b794f36be81dd1e26b45fbc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:56.805323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b0cde38-0a74-4392-9479-6e59ae0c1136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b1618e8b794f36be81dd1e26b45fbc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:56.820286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b0cde38-0a74-4392-9479-6e59ae0c1136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b1618e8b794f36be81dd1e26b45fbc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:56.857473 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4300/8594] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:01:56 2022] DELETE /identity/v3/users/87b1618e8b794f36be81dd1e26b45fbc => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:57.280722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b87d7e-dc8b-4690-a592-1e0d8216d84e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:57.310535 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b87d7e-dc8b-4690-a592-1e0d8216d84e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:57.440558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db3c10-8776-45a6-87a6-508ba28f0a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:57.441877 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db3c10-8776-45a6-87a6-508ba28f0a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:57.442400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db3c10-8776-45a6-87a6-508ba28f0a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:57.442855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db3c10-8776-45a6-87a6-508ba28f0a38 admin admin] PATH_INFO: `/v3/projects/f6e9e1fc76874e12a5719d63eb971d9e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:57.444495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db3c10-8776-45a6-87a6-508ba28f0a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e9e1fc76874e12a5719d63eb971d9e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:57.449505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db3c10-8776-45a6-87a6-508ba28f0a38 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:57.592691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80db3c10-8776-45a6-87a6-508ba28f0a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e9e1fc76874e12a5719d63eb971d9e', 'request_id': 'req-80db3c10-8776-45a6-87a6-508ba28f0a38'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:57.609768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80db3c10-8776-45a6-87a6-508ba28f0a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e9e1fc76874e12a5719d63eb971d9e', 'request_id': 'req-80db3c10-8776-45a6-87a6-508ba28f0a38'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:57.634802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80db3c10-8776-45a6-87a6-508ba28f0a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e9e1fc76874e12a5719d63eb971d9e', 'request_id': 'req-80db3c10-8776-45a6-87a6-508ba28f0a38'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:57.671131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80db3c10-8776-45a6-87a6-508ba28f0a38 admin admin] The token cache is being invalidate because project f6e9e1fc76874e12a5719d63eb971d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:01:57.671996 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80db3c10-8776-45a6-87a6-508ba28f0a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:57.673265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80db3c10-8776-45a6-87a6-508ba28f0a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:57.677591 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4295/8595] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:01:57 2022] DELETE /identity/v3/projects/f6e9e1fc76874e12a5719d63eb971d9e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:57.683318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20468ae-25ab-40b5-a2e9-8b75e34d850c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:57.684775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20468ae-25ab-40b5-a2e9-8b75e34d850c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:57.685393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20468ae-25ab-40b5-a2e9-8b75e34d850c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:57.719707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b20468ae-25ab-40b5-a2e9-8b75e34d850c None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:57.721061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b20468ae-25ab-40b5-a2e9-8b75e34d850c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:57.794009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:57.833083 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4301/8596] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:57.846774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb412d-1734-44d6-a1d4-52b1133a32f1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:57.847309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb412d-1734-44d6-a1d4-52b1133a32f1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:57.847687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb412d-1734-44d6-a1d4-52b1133a32f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:57.897738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3afb412d-1734-44d6-a1d4-52b1133a32f1 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:57.900959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3afb412d-1734-44d6-a1d4-52b1133a32f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:57.937581 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4296/8597] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:57.943549 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20468ae-25ab-40b5-a2e9-8b75e34d850c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:57.959198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20468ae-25ab-40b5-a2e9-8b75e34d850c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:57.967190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c1806-73df-43a3-ad6f-704ae8f108aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:57.968668 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c1806-73df-43a3-ad6f-704ae8f108aa admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:57.969319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c1806-73df-43a3-ad6f-704ae8f108aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:57.970174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c1806-73df-43a3-ad6f-704ae8f108aa admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:57.971938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c1806-73df-43a3-ad6f-704ae8f108aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:01:57.972777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c1806-73df-43a3-ad6f-704ae8f108aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:57.976994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c1806-73df-43a3-ad6f-704ae8f108aa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:58.005573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb412d-1734-44d6-a1d4-52b1133a32f1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:58.007715 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4302/8598] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:58.020326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb412d-1734-44d6-a1d4-52b1133a32f1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:58.028492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532dc97-c4b6-46ca-bfd3-37117577fff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:58.029633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532dc97-c4b6-46ca-bfd3-37117577fff5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:58.030113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532dc97-c4b6-46ca-bfd3-37117577fff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:58.030640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532dc97-c4b6-46ca-bfd3-37117577fff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:58.032446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532dc97-c4b6-46ca-bfd3-37117577fff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:58.036634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532dc97-c4b6-46ca-bfd3-37117577fff5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:58.060202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:58.090613 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4297/8599] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:01:58 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:58.091206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c1806-73df-43a3-ad6f-704ae8f108aa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:58.103003 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c1806-73df-43a3-ad6f-704ae8f108aa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:58.233822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d31cf-9842-4ab0-8db9-6d5e7edd3c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:58.234749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d31cf-9842-4ab0-8db9-6d5e7edd3c60 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:58.235307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d31cf-9842-4ab0-8db9-6d5e7edd3c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:58.235744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d31cf-9842-4ab0-8db9-6d5e7edd3c60 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:58.236650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d31cf-9842-4ab0-8db9-6d5e7edd3c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:58.238915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d31cf-9842-4ab0-8db9-6d5e7edd3c60 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:58.274204 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4303/8600] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:01:58 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:01:58.276431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532dc97-c4b6-46ca-bfd3-37117577fff5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:58.297952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532dc97-c4b6-46ca-bfd3-37117577fff5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:58.305578 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54f8aa-eb20-4141-be8e-fb090da06d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:58.306391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54f8aa-eb20-4141-be8e-fb090da06d84 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:58.306674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54f8aa-eb20-4141-be8e-fb090da06d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:58.306954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54f8aa-eb20-4141-be8e-fb090da06d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:58.307668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54f8aa-eb20-4141-be8e-fb090da06d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:58.309297 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54f8aa-eb20-4141-be8e-fb090da06d84 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:58.342945 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4298/8601] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:58.350926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d31cf-9842-4ab0-8db9-6d5e7edd3c60 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:58.380127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d31cf-9842-4ab0-8db9-6d5e7edd3c60 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:58.397109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a46f90-07a2-483e-b858-f7dd8f815e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:58.398646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a46f90-07a2-483e-b858-f7dd8f815e86 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:58.401130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a46f90-07a2-483e-b858-f7dd8f815e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:58.402838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a46f90-07a2-483e-b858-f7dd8f815e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:58.403664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a46f90-07a2-483e-b858-f7dd8f815e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:58.414044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a46f90-07a2-483e-b858-f7dd8f815e86 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:58.454644 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4304/8602] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:58.456345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54f8aa-eb20-4141-be8e-fb090da06d84 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:58.470790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54f8aa-eb20-4141-be8e-fb090da06d84 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:58.478071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfd078-b992-4257-a165-9bb43080d575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:58.478968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd078-b992-4257-a165-9bb43080d575 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:58.479315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd078-b992-4257-a165-9bb43080d575 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:58.479600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd078-b992-4257-a165-9bb43080d575 admin admin] PATH_INFO: `/v3/projects/b28649561c1a4f37943917f8f732a326/users/cd3aa33b2f1340738f24f5e3e335019e/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:58.508015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfd078-b992-4257-a165-9bb43080d575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28649561c1a4f37943917f8f732a326, user_id=cd3aa33b2f1340738f24f5e3e335019e, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:58.518651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfd078-b992-4257-a165-9bb43080d575 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:58.543151 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4299/8603] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:01:58 2022] PUT /identity/v3/projects/b28649561c1a4f37943917f8f732a326/users/cd3aa33b2f1340738f24f5e3e335019e/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:58.547146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2083f-248f-4c11-b7ce-2d12a75d1828 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:58.547146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2083f-248f-4c11-b7ce-2d12a75d1828 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:58.547146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2083f-248f-4c11-b7ce-2d12a75d1828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:58.581855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cab2083f-248f-4c11-b7ce-2d12a75d1828 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:58.583246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cab2083f-248f-4c11-b7ce-2d12a75d1828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:58.729932 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4305/8604] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:58.761862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfd078-b992-4257-a165-9bb43080d575 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:58.764179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77dfd078-b992-4257-a165-9bb43080d575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:58.885724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfd078-b992-4257-a165-9bb43080d575 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:58.895165 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e60ab-6137-47cc-a4e5-78cefe6c4530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:58.895856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e60ab-6137-47cc-a4e5-78cefe6c4530 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:58.896136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e60ab-6137-47cc-a4e5-78cefe6c4530 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:58.896414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e60ab-6137-47cc-a4e5-78cefe6c4530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:58.922770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e60ab-6137-47cc-a4e5-78cefe6c4530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:58.924375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e60ab-6137-47cc-a4e5-78cefe6c4530 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:58.952397 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4300/8605] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:02.224761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e9f82-0a1c-4caf-a0de-fb08fdc6cf28 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:02.237473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e9f82-0a1c-4caf-a0de-fb08fdc6cf28 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:02.239924 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e9f82-0a1c-4caf-a0de-fb08fdc6cf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:02.365442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a32e9f82-0a1c-4caf-a0de-fb08fdc6cf28 None None] MFA Rules not processed for user `2aa7d94090504881bb0ffd560ba90378`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:02.373336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a32e9f82-0a1c-4caf-a0de-fb08fdc6cf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:02.477158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:02.547179 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4306/8606] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:02:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:02.550760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e60ab-6137-47cc-a4e5-78cefe6c4530 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:02.586005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-701e60ab-6137-47cc-a4e5-78cefe6c4530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:02.679800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e60ab-6137-47cc-a4e5-78cefe6c4530 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:02.700369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94418d-d1df-4895-9d9b-2f4a7f607b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:02.702912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94418d-d1df-4895-9d9b-2f4a7f607b39 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:02.704128 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94418d-d1df-4895-9d9b-2f4a7f607b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:02.704662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94418d-d1df-4895-9d9b-2f4a7f607b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:02.705891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94418d-d1df-4895-9d9b-2f4a7f607b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:02.708282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94418d-d1df-4895-9d9b-2f4a7f607b39 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:02.781649 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4301/8607] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:02:02 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:02.783322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e9f82-0a1c-4caf-a0de-fb08fdc6cf28 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:02.807083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e9f82-0a1c-4caf-a0de-fb08fdc6cf28 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:02.986237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41a253-1f99-453f-8f1e-67b1309e3f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:02.987229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41a253-1f99-453f-8f1e-67b1309e3f5e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:02.987811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41a253-1f99-453f-8f1e-67b1309e3f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:02.988288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41a253-1f99-453f-8f1e-67b1309e3f5e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:02.989431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41a253-1f99-453f-8f1e-67b1309e3f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:02.993134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41a253-1f99-453f-8f1e-67b1309e3f5e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:03.033870 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4307/8608] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:02:02 2022] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:03.039609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94418d-d1df-4895-9d9b-2f4a7f607b39 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:03.058682 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94418d-d1df-4895-9d9b-2f4a7f607b39 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:03.069380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6868794-9b67-444e-9f48-56c6401045cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:03.070118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6868794-9b67-444e-9f48-56c6401045cd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:03.070400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6868794-9b67-444e-9f48-56c6401045cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:03.070754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6868794-9b67-444e-9f48-56c6401045cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:03.072089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6868794-9b67-444e-9f48-56c6401045cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:03.073236 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6868794-9b67-444e-9f48-56c6401045cd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:03.095469 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4302/8609] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:03.101416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41a253-1f99-453f-8f1e-67b1309e3f5e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:03.118165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41a253-1f99-453f-8f1e-67b1309e3f5e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:03.126765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef85d3d-9912-46a4-87ff-98538bb7608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:03.127551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef85d3d-9912-46a4-87ff-98538bb7608c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:03.128001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef85d3d-9912-46a4-87ff-98538bb7608c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:03.128330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef85d3d-9912-46a4-87ff-98538bb7608c admin admin] PATH_INFO: `/v3/projects/c9b473f425244882893df5af513585bd/users/c6ea697aed7e48ef8a62116266e8d164/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:03.167538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef85d3d-9912-46a4-87ff-98538bb7608c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b473f425244882893df5af513585bd, user_id=c6ea697aed7e48ef8a62116266e8d164, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:03.170582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef85d3d-9912-46a4-87ff-98538bb7608c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:03.197085 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4308/8610] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:02:03 2022] PUT /identity/v3/projects/c9b473f425244882893df5af513585bd/users/c6ea697aed7e48ef8a62116266e8d164/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:03.204154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6868794-9b67-444e-9f48-56c6401045cd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:03.218853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6868794-9b67-444e-9f48-56c6401045cd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:03.398462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee7e0b-dc6e-423d-aed3-b28092ec4c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:03.400033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee7e0b-dc6e-423d-aed3-b28092ec4c1b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:03.400812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee7e0b-dc6e-423d-aed3-b28092ec4c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:03.401290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee7e0b-dc6e-423d-aed3-b28092ec4c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:03.402545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee7e0b-dc6e-423d-aed3-b28092ec4c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:03.407637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee7e0b-dc6e-423d-aed3-b28092ec4c1b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:03.426193 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4303/8611] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:03.432246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef85d3d-9912-46a4-87ff-98538bb7608c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:03.452661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef85d3d-9912-46a4-87ff-98538bb7608c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:03.460903 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55835137-89af-44e8-822e-90fa68403174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:03.462382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55835137-89af-44e8-822e-90fa68403174 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:03.463000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55835137-89af-44e8-822e-90fa68403174 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:03.463580 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55835137-89af-44e8-822e-90fa68403174 admin admin] PATH_INFO: `/v3/projects/c9b473f425244882893df5af513585bd/users/c6ea697aed7e48ef8a62116266e8d164/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:03.467602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55835137-89af-44e8-822e-90fa68403174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b473f425244882893df5af513585bd, user_id=c6ea697aed7e48ef8a62116266e8d164, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:03.472391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55835137-89af-44e8-822e-90fa68403174 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:03.507073 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4309/8612] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:02:03 2022] PUT /identity/v3/projects/c9b473f425244882893df5af513585bd/users/c6ea697aed7e48ef8a62116266e8d164/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:07.246439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee7e0b-dc6e-423d-aed3-b28092ec4c1b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:07.249423 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-28ee7e0b-dc6e-423d-aed3-b28092ec4c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:07.323727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:07.442982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee7e0b-dc6e-423d-aed3-b28092ec4c1b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:07.629477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a40125-924f-4983-b9f3-7e42d24df406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:07.630552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a40125-924f-4983-b9f3-7e42d24df406 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:07.631154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a40125-924f-4983-b9f3-7e42d24df406 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:07.631729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a40125-924f-4983-b9f3-7e42d24df406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:07.637060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80a40125-924f-4983-b9f3-7e42d24df406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:07.920742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a40125-924f-4983-b9f3-7e42d24df406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:07.927401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a40125-924f-4983-b9f3-7e42d24df406 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:07.999931 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4304/8613] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:08.959186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dab1d-6e6c-4808-b6ad-c72e462368f7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:08.960649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dab1d-6e6c-4808-b6ad-c72e462368f7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:08.961126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dab1d-6e6c-4808-b6ad-c72e462368f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:09.075470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2b2dab1d-6e6c-4808-b6ad-c72e462368f7 None None] MFA Rules not processed for user `cd3aa33b2f1340738f24f5e3e335019e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:09.080644 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2b2dab1d-6e6c-4808-b6ad-c72e462368f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:09.432375 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4310/8614] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:02:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:09.436053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a40125-924f-4983-b9f3-7e42d24df406 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:09.637227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a40125-924f-4983-b9f3-7e42d24df406 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:09.660456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5aa00-badf-4fc3-a89b-30356da9d3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:09.668183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5aa00-badf-4fc3-a89b-30356da9d3af admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:09.669123 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5aa00-badf-4fc3-a89b-30356da9d3af admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:09.669761 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5aa00-badf-4fc3-a89b-30356da9d3af admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:09.670807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5aa00-badf-4fc3-a89b-30356da9d3af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:09.674602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5aa00-badf-4fc3-a89b-30356da9d3af admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:09.743067 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4305/8615] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:02:09 2022] POST /identity/v3/projects => generated 379 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:09.749573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dab1d-6e6c-4808-b6ad-c72e462368f7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:09.792520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dab1d-6e6c-4808-b6ad-c72e462368f7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:09.917146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:10.058584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0eeb04-499c-4280-b3e0-ddf57c11a08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:10.066339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eeb04-499c-4280-b3e0-ddf57c11a08f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:10.066940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eeb04-499c-4280-b3e0-ddf57c11a08f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:10.067441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eeb04-499c-4280-b3e0-ddf57c11a08f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:10.078943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0eeb04-499c-4280-b3e0-ddf57c11a08f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:10.087816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0eeb04-499c-4280-b3e0-ddf57c11a08f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:10.146465 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4311/8616] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:02:09 2022] POST /identity/v3/users => generated 296 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:10.151383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5aa00-badf-4fc3-a89b-30356da9d3af admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:10.178723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5aa00-badf-4fc3-a89b-30356da9d3af admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:10.189884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34b109-e356-48ef-b7c0-6d892ecfc246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:10.191484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34b109-e356-48ef-b7c0-6d892ecfc246 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:10.191484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34b109-e356-48ef-b7c0-6d892ecfc246 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:10.191484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34b109-e356-48ef-b7c0-6d892ecfc246 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:10.192786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34b109-e356-48ef-b7c0-6d892ecfc246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:10.195288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34b109-e356-48ef-b7c0-6d892ecfc246 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:10.231767 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4306/8617] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:10.234077 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0eeb04-499c-4280-b3e0-ddf57c11a08f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:10.254083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0eeb04-499c-4280-b3e0-ddf57c11a08f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:10.260243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dc706-b988-4752-99b4-82fc38707009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:10.261235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dc706-b988-4752-99b4-82fc38707009 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:10.261713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dc706-b988-4752-99b4-82fc38707009 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:10.262158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dc706-b988-4752-99b4-82fc38707009 admin admin] PATH_INFO: `/v3/projects/51e38c13ac024ffda901fa9434bdb6bf/users/03605bdb0138450aaa1168839c04411f/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:10.313708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dc706-b988-4752-99b4-82fc38707009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e38c13ac024ffda901fa9434bdb6bf, user_id=03605bdb0138450aaa1168839c04411f, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:10.324687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dc706-b988-4752-99b4-82fc38707009 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:10.366719 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4312/8618] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:02:10 2022] PUT /identity/v3/projects/51e38c13ac024ffda901fa9434bdb6bf/users/03605bdb0138450aaa1168839c04411f/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:10.372239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34b109-e356-48ef-b7c0-6d892ecfc246 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:10.388569 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:10.394630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34b109-e356-48ef-b7c0-6d892ecfc246 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:10.510262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3697bb7-9452-4cc0-aa0f-520abdb60722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:10.511684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3697bb7-9452-4cc0-aa0f-520abdb60722 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:10.512169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3697bb7-9452-4cc0-aa0f-520abdb60722 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:10.512692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3697bb7-9452-4cc0-aa0f-520abdb60722 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:10.513541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3697bb7-9452-4cc0-aa0f-520abdb60722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:10.515943 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3697bb7-9452-4cc0-aa0f-520abdb60722 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:10.530259 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4307/8619] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:10.534905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dc706-b988-4752-99b4-82fc38707009 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:10.549964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dc706-b988-4752-99b4-82fc38707009 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:10.579547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3971e-1983-45a8-abaa-9bd570fe2923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:10.580559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3971e-1983-45a8-abaa-9bd570fe2923 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:10.581034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3971e-1983-45a8-abaa-9bd570fe2923 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:10.581474 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3971e-1983-45a8-abaa-9bd570fe2923 admin admin] PATH_INFO: `/v3/projects/51e38c13ac024ffda901fa9434bdb6bf/users/03605bdb0138450aaa1168839c04411f/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:10.583974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3971e-1983-45a8-abaa-9bd570fe2923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e38c13ac024ffda901fa9434bdb6bf, user_id=03605bdb0138450aaa1168839c04411f, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:10.587340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3971e-1983-45a8-abaa-9bd570fe2923 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:10.605646 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4313/8620] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:02:10 2022] PUT /identity/v3/projects/51e38c13ac024ffda901fa9434bdb6bf/users/03605bdb0138450aaa1168839c04411f/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:02:18.533719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb82b32-bff2-4b26-a858-314d0efbb149 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:18.535305 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb82b32-bff2-4b26-a858-314d0efbb149 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:18.536022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb82b32-bff2-4b26-a858-314d0efbb149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:18.643667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-afb82b32-bff2-4b26-a858-314d0efbb149 None None] MFA Rules not processed for user `c6ea697aed7e48ef8a62116266e8d164`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:18.645105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-afb82b32-bff2-4b26-a858-314d0efbb149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:18.838982 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4308/8621] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:02:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:18.860353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3971e-1983-45a8-abaa-9bd570fe2923 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:18.864156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2bc3971e-1983-45a8-abaa-9bd570fe2923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:19.116221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3971e-1983-45a8-abaa-9bd570fe2923 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:19.130176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ee39c-4ed1-4caf-a9d0-75f4770be1c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:19.131302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ee39c-4ed1-4caf-a9d0-75f4770be1c8 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:19.131865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ee39c-4ed1-4caf-a9d0-75f4770be1c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:19.132427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ee39c-4ed1-4caf-a9d0-75f4770be1c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:19.180797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ee39c-4ed1-4caf-a9d0-75f4770be1c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:19.187690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ee39c-4ed1-4caf-a9d0-75f4770be1c8 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:19.249468 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4314/8622] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:19.416630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb82b32-bff2-4b26-a858-314d0efbb149 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:19.442821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb82b32-bff2-4b26-a858-314d0efbb149 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:19.452634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0366386-5505-4827-a761-c12d54de0658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:19.453276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0366386-5505-4827-a761-c12d54de0658 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:19.453553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0366386-5505-4827-a761-c12d54de0658 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:19.453827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0366386-5505-4827-a761-c12d54de0658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:19.602105 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0366386-5505-4827-a761-c12d54de0658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:19.603873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0366386-5505-4827-a761-c12d54de0658 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:19.654829 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4309/8623] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:23.936972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dbf45-b754-497c-b504-633d3ba1f058 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:23.937859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dbf45-b754-497c-b504-633d3ba1f058 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:23.937859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dbf45-b754-497c-b504-633d3ba1f058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:23.977133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7e0dbf45-b754-497c-b504-633d3ba1f058 None None] MFA Rules not processed for user `2aa7d94090504881bb0ffd560ba90378`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:23.979795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7e0dbf45-b754-497c-b504-633d3ba1f058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:24.003498 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4315/8624] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:02:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:24.251212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd9ec2-dcbe-4a35-b4a4-3c3c8ea4e5ec None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:24.252487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd9ec2-dcbe-4a35-b4a4-3c3c8ea4e5ec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:24.252983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd9ec2-dcbe-4a35-b4a4-3c3c8ea4e5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:24.363806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9edd9ec2-dcbe-4a35-b4a4-3c3c8ea4e5ec None None] MFA Rules not processed for user `03605bdb0138450aaa1168839c04411f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:24.367084 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9edd9ec2-dcbe-4a35-b4a4-3c3c8ea4e5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:24.404566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:24.585962 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4310/8625] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:02:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:24.598904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dbf45-b754-497c-b504-633d3ba1f058 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:24.601320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7e0dbf45-b754-497c-b504-633d3ba1f058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:24.839545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dbf45-b754-497c-b504-633d3ba1f058 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:24.853121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caaf95-672f-4003-a1f3-f655b883c70b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:24.854101 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caaf95-672f-4003-a1f3-f655b883c70b service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:24.867904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caaf95-672f-4003-a1f3-f655b883c70b service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:24.868456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caaf95-672f-4003-a1f3-f655b883c70b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:24.880582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caaf95-672f-4003-a1f3-f655b883c70b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:24.882481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caaf95-672f-4003-a1f3-f655b883c70b service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:24.889509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:24.904802 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4316/8626] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:25.322389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd9ec2-dcbe-4a35-b4a4-3c3c8ea4e5ec None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:25.324433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9edd9ec2-dcbe-4a35-b4a4-3c3c8ea4e5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:25.574061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caaf95-672f-4003-a1f3-f655b883c70b service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:25.638310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd9ec2-dcbe-4a35-b4a4-3c3c8ea4e5ec None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:25.656432 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751a80f-776e-40cc-8ef4-9a81f74495ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:25.680524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751a80f-776e-40cc-8ef4-9a81f74495ee service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:25.681025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751a80f-776e-40cc-8ef4-9a81f74495ee service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:25.683945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751a80f-776e-40cc-8ef4-9a81f74495ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:25.690067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2751a80f-776e-40cc-8ef4-9a81f74495ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:25.706305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caaf95-672f-4003-a1f3-f655b883c70b service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:25.714220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f06d51-68b6-47f7-b978-0d5599174f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:25.716264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f06d51-68b6-47f7-b978-0d5599174f59 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:25.716990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f06d51-68b6-47f7-b978-0d5599174f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:25.717685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f06d51-68b6-47f7-b978-0d5599174f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:25.721974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-63f06d51-68b6-47f7-b978-0d5599174f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:25.739513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f06d51-68b6-47f7-b978-0d5599174f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:25.740624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751a80f-776e-40cc-8ef4-9a81f74495ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:25.742091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f06d51-68b6-47f7-b978-0d5599174f59 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:25.742726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751a80f-776e-40cc-8ef4-9a81f74495ee service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:25.759789 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4317/8627] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:25.841190 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4311/8628] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:30.081926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f06d51-68b6-47f7-b978-0d5599174f59 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:30.104912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f06d51-68b6-47f7-b978-0d5599174f59 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:30.113339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77a205-adf3-48de-b0ae-822e713d1bc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:30.114328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77a205-adf3-48de-b0ae-822e713d1bc5 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:30.114797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77a205-adf3-48de-b0ae-822e713d1bc5 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:30.115320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77a205-adf3-48de-b0ae-822e713d1bc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:30.118313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5b77a205-adf3-48de-b0ae-822e713d1bc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:30.156429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77a205-adf3-48de-b0ae-822e713d1bc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:30.158109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77a205-adf3-48de-b0ae-822e713d1bc5 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:30.196752 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4318/8629] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:31.737369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751a80f-776e-40cc-8ef4-9a81f74495ee service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:31.759124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751a80f-776e-40cc-8ef4-9a81f74495ee service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:31.767076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082331b-406d-40e8-9109-18380f3bec49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:31.767758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082331b-406d-40e8-9109-18380f3bec49 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:31.768090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082331b-406d-40e8-9109-18380f3bec49 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:31.768367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082331b-406d-40e8-9109-18380f3bec49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:31.774482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7082331b-406d-40e8-9109-18380f3bec49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:31.953975 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082331b-406d-40e8-9109-18380f3bec49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:31.955958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082331b-406d-40e8-9109-18380f3bec49 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:31.997624 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4312/8630] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:31 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:02:38.266751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77a205-adf3-48de-b0ae-822e713d1bc5 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:38.295959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77a205-adf3-48de-b0ae-822e713d1bc5 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:38.326137 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bcd66-a8b5-4644-ac6a-896e152b7e72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:38.327422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bcd66-a8b5-4644-ac6a-896e152b7e72 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:38.327909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bcd66-a8b5-4644-ac6a-896e152b7e72 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:38.330439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bcd66-a8b5-4644-ac6a-896e152b7e72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:38.334754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0c4bcd66-a8b5-4644-ac6a-896e152b7e72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:38.358069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bcd66-a8b5-4644-ac6a-896e152b7e72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:38.360026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bcd66-a8b5-4644-ac6a-896e152b7e72 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:38.377899 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4319/8631] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:38.974151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a537507-6ff5-46d4-aa3f-e76bc26a0fd9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:38.974715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a537507-6ff5-46d4-aa3f-e76bc26a0fd9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:38.974715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a537507-6ff5-46d4-aa3f-e76bc26a0fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:38.994499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:39.041893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3a537507-6ff5-46d4-aa3f-e76bc26a0fd9 None None] MFA Rules not processed for user `7afaa3dd70cd4a64a2b3c51e8a3b9582`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:39.043179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3a537507-6ff5-46d4-aa3f-e76bc26a0fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:39.166700 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4313/8632] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:02:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:39.807846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bcd66-a8b5-4644-ac6a-896e152b7e72 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:39.824916 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bcd66-a8b5-4644-ac6a-896e152b7e72 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:39.834296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4c228-084e-4e28-890d-164380dde351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:39.835202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4c228-084e-4e28-890d-164380dde351 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:39.835768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4c228-084e-4e28-890d-164380dde351 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:39.836251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4c228-084e-4e28-890d-164380dde351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:39.839651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-77e4c228-084e-4e28-890d-164380dde351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:39.859956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4c228-084e-4e28-890d-164380dde351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:39.861767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4c228-084e-4e28-890d-164380dde351 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:39.882704 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4320/8633] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:43.726326 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a537507-6ff5-46d4-aa3f-e76bc26a0fd9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:43.728847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3a537507-6ff5-46d4-aa3f-e76bc26a0fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:43.759522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a537507-6ff5-46d4-aa3f-e76bc26a0fd9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:43.773727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b8c58-88b7-47b4-b040-e7e84ec21caa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:43.774820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b8c58-88b7-47b4-b040-e7e84ec21caa service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:43.777597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b8c58-88b7-47b4-b040-e7e84ec21caa service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:43.778382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b8c58-88b7-47b4-b040-e7e84ec21caa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:43.782999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-466b8c58-88b7-47b4-b040-e7e84ec21caa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:43.855076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b8c58-88b7-47b4-b040-e7e84ec21caa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:43.863660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b8c58-88b7-47b4-b040-e7e84ec21caa service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:43.888674 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4314/8634] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:43.905164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4c228-084e-4e28-890d-164380dde351 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:44.010406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4c228-084e-4e28-890d-164380dde351 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:44.016337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95341f-db69-4106-9257-758e35000ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:44.017146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95341f-db69-4106-9257-758e35000ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:44.017527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95341f-db69-4106-9257-758e35000ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:44.017905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95341f-db69-4106-9257-758e35000ddd admin admin] PATH_INFO: `/v3/users/cd3aa33b2f1340738f24f5e3e335019e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:44.019387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95341f-db69-4106-9257-758e35000ddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3aa33b2f1340738f24f5e3e335019e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:44.021917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95341f-db69-4106-9257-758e35000ddd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:44.108870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d95341f-db69-4106-9257-758e35000ddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3aa33b2f1340738f24f5e3e335019e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:44.138461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:44.142834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d95341f-db69-4106-9257-758e35000ddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3aa33b2f1340738f24f5e3e335019e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:44.144413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d95341f-db69-4106-9257-758e35000ddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3aa33b2f1340738f24f5e3e335019e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:44.145616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d95341f-db69-4106-9257-758e35000ddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3aa33b2f1340738f24f5e3e335019e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:44.161957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d95341f-db69-4106-9257-758e35000ddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3aa33b2f1340738f24f5e3e335019e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:44.192269 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4321/8635] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:02:43 2022] DELETE /identity/v3/users/cd3aa33b2f1340738f24f5e3e335019e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:44.701315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b8c58-88b7-47b4-b040-e7e84ec21caa service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:44.763946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b8c58-88b7-47b4-b040-e7e84ec21caa service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:44.925101 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:44.925966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:44.926414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:44.926846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178 admin admin] PATH_INFO: `/v3/projects/b28649561c1a4f37943917f8f732a326` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:44.928361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28649561c1a4f37943917f8f732a326)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:44.932457 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:45.032040 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28649561c1a4f37943917f8f732a326', 'request_id': 'req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:45.045012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28649561c1a4f37943917f8f732a326', 'request_id': 'req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:45.054895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28649561c1a4f37943917f8f732a326', 'request_id': 'req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:45.093243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178 admin admin] The token cache is being invalidate because project b28649561c1a4f37943917f8f732a326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:02:45.093958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:45.096150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:45.098359 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4315/8636] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:02:44 2022] DELETE /identity/v3/projects/b28649561c1a4f37943917f8f732a326 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:45.102729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95341f-db69-4106-9257-758e35000ddd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:45.105906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9d95341f-db69-4106-9257-758e35000ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:45.124362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95341f-db69-4106-9257-758e35000ddd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:45.214027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4d8b9-33e5-4014-a6ee-dc3312101aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:45.214733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4d8b9-33e5-4014-a6ee-dc3312101aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:45.215109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4d8b9-33e5-4014-a6ee-dc3312101aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:45.215302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4d8b9-33e5-4014-a6ee-dc3312101aeb admin admin] PATH_INFO: `/v3/users/03605bdb0138450aaa1168839c04411f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:45.216640 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4d8b9-33e5-4014-a6ee-dc3312101aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=03605bdb0138450aaa1168839c04411f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:45.219168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4d8b9-33e5-4014-a6ee-dc3312101aeb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:45.324723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cff4d8b9-33e5-4014-a6ee-dc3312101aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03605bdb0138450aaa1168839c04411f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:45.373543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cff4d8b9-33e5-4014-a6ee-dc3312101aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03605bdb0138450aaa1168839c04411f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:45.374503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cff4d8b9-33e5-4014-a6ee-dc3312101aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03605bdb0138450aaa1168839c04411f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:45.375129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cff4d8b9-33e5-4014-a6ee-dc3312101aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03605bdb0138450aaa1168839c04411f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:45.409273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cff4d8b9-33e5-4014-a6ee-dc3312101aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03605bdb0138450aaa1168839c04411f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:45.427823 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4322/8637] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:02:45 2022] DELETE /identity/v3/users/03605bdb0138450aaa1168839c04411f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:45.955999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:45.958264 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:45.977027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd6fb2-a226-4e2a-96df-aa52fc3c7178 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:46.054576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:46.163989 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdf7b7-f70c-4589-9089-34f9083d3f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:46.165001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdf7b7-f70c-4589-9089-34f9083d3f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:46.165550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdf7b7-f70c-4589-9089-34f9083d3f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:46.167167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdf7b7-f70c-4589-9089-34f9083d3f4d admin admin] PATH_INFO: `/v3/projects/51e38c13ac024ffda901fa9434bdb6bf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:46.172023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdf7b7-f70c-4589-9089-34f9083d3f4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=51e38c13ac024ffda901fa9434bdb6bf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:46.176361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdf7b7-f70c-4589-9089-34f9083d3f4d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:46.312056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5acdf7b7-f70c-4589-9089-34f9083d3f4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51e38c13ac024ffda901fa9434bdb6bf', 'request_id': 'req-5acdf7b7-f70c-4589-9089-34f9083d3f4d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:46.323418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5acdf7b7-f70c-4589-9089-34f9083d3f4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51e38c13ac024ffda901fa9434bdb6bf', 'request_id': 'req-5acdf7b7-f70c-4589-9089-34f9083d3f4d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:46.339687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5acdf7b7-f70c-4589-9089-34f9083d3f4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51e38c13ac024ffda901fa9434bdb6bf', 'request_id': 'req-5acdf7b7-f70c-4589-9089-34f9083d3f4d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:46.362703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5acdf7b7-f70c-4589-9089-34f9083d3f4d admin admin] The token cache is being invalidate because project 51e38c13ac024ffda901fa9434bdb6bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:02:46.362998 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5acdf7b7-f70c-4589-9089-34f9083d3f4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:46.363731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5acdf7b7-f70c-4589-9089-34f9083d3f4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:46.370242 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4316/8638] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:02:45 2022] DELETE /identity/v3/projects/51e38c13ac024ffda901fa9434bdb6bf => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:46.375310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d9a97-e294-4d01-b61f-3c34f48daa61 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:46.375882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d9a97-e294-4d01-b61f-3c34f48daa61 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:46.376181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d9a97-e294-4d01-b61f-3c34f48daa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:46.411401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e94d9a97-e294-4d01-b61f-3c34f48daa61 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:46.414095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e94d9a97-e294-4d01-b61f-3c34f48daa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:46.512313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:46.545022 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8d5a1-9af8-4262-afb5-9f195f7aa46d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:46.545302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8d5a1-9af8-4262-afb5-9f195f7aa46d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:46.545576 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8d5a1-9af8-4262-afb5-9f195f7aa46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:46.574696 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4323/8639] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:46.587621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2cf8d5a1-9af8-4262-afb5-9f195f7aa46d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:46.595346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2cf8d5a1-9af8-4262-afb5-9f195f7aa46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:46.625261 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4317/8640] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:46.626626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d9a97-e294-4d01-b61f-3c34f48daa61 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:46.654821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d9a97-e294-4d01-b61f-3c34f48daa61 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:46.660446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614771d2-bd23-4148-b278-090df2770151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:46.662385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614771d2-bd23-4148-b278-090df2770151 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:46.662751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614771d2-bd23-4148-b278-090df2770151 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:46.663020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614771d2-bd23-4148-b278-090df2770151 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:46.663755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614771d2-bd23-4148-b278-090df2770151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:02:46.664060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614771d2-bd23-4148-b278-090df2770151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:46.665679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614771d2-bd23-4148-b278-090df2770151 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:46.696657 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4324/8641] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:02:46.701039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8d5a1-9af8-4262-afb5-9f195f7aa46d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:46.719435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8d5a1-9af8-4262-afb5-9f195f7aa46d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:46.726495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36784dd4-bda2-433f-95b5-2eebf47383a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:46.727824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36784dd4-bda2-433f-95b5-2eebf47383a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:46.728298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36784dd4-bda2-433f-95b5-2eebf47383a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:46.728727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36784dd4-bda2-433f-95b5-2eebf47383a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:46.729759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36784dd4-bda2-433f-95b5-2eebf47383a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:46.733000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36784dd4-bda2-433f-95b5-2eebf47383a2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:46.784250 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4318/8642] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:02:46 2022] POST /identity/v3/projects => generated 363 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:02:46.785958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614771d2-bd23-4148-b278-090df2770151 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:46.797950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614771d2-bd23-4148-b278-090df2770151 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:46.893470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7e6e3-1979-4321-b3cb-af30d875cb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:46.894252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e6e3-1979-4321-b3cb-af30d875cb57 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:46.894597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e6e3-1979-4321-b3cb-af30d875cb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:46.894931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e6e3-1979-4321-b3cb-af30d875cb57 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:46.896058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7e6e3-1979-4321-b3cb-af30d875cb57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:46.897831 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7e6e3-1979-4321-b3cb-af30d875cb57 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:46.928836 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4325/8643] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:02:46 2022] POST /identity/v3/users => generated 282 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:46.933474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36784dd4-bda2-433f-95b5-2eebf47383a2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:46.948954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36784dd4-bda2-433f-95b5-2eebf47383a2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:46.955153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb9a1e-ed3c-4d8f-9f25-079e82a3907c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:46.955968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb9a1e-ed3c-4d8f-9f25-079e82a3907c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:46.956346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb9a1e-ed3c-4d8f-9f25-079e82a3907c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:46.956971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb9a1e-ed3c-4d8f-9f25-079e82a3907c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:46.957835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb9a1e-ed3c-4d8f-9f25-079e82a3907c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:46.959610 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb9a1e-ed3c-4d8f-9f25-079e82a3907c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:46.973315 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4319/8644] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:46.977931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7e6e3-1979-4321-b3cb-af30d875cb57 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:46.989540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7e6e3-1979-4321-b3cb-af30d875cb57 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:46.994681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf056d63-85ff-482f-85d2-a6a3d1bc87fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:46.995479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf056d63-85ff-482f-85d2-a6a3d1bc87fe admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:46.995856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf056d63-85ff-482f-85d2-a6a3d1bc87fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:46.996228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf056d63-85ff-482f-85d2-a6a3d1bc87fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:46.997074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf056d63-85ff-482f-85d2-a6a3d1bc87fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:46.999343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf056d63-85ff-482f-85d2-a6a3d1bc87fe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:47.015444 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4326/8645] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:47.017355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb9a1e-ed3c-4d8f-9f25-079e82a3907c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:47.035889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb9a1e-ed3c-4d8f-9f25-079e82a3907c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:47.041353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d746e2-33f3-4c7f-be12-ef74b765412a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:47.042114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d746e2-33f3-4c7f-be12-ef74b765412a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:47.042426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d746e2-33f3-4c7f-be12-ef74b765412a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:47.042708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d746e2-33f3-4c7f-be12-ef74b765412a admin admin] PATH_INFO: `/v3/projects/d615482d586b4d36b4cb034d56a4fa81/users/20a7a14c383c406c8aa492304d59c72a/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:47.060766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d746e2-33f3-4c7f-be12-ef74b765412a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d615482d586b4d36b4cb034d56a4fa81, user_id=20a7a14c383c406c8aa492304d59c72a, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:47.064085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d746e2-33f3-4c7f-be12-ef74b765412a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:47.085457 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4320/8646] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:02:47 2022] PUT /identity/v3/projects/d615482d586b4d36b4cb034d56a4fa81/users/20a7a14c383c406c8aa492304d59c72a/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:47.090905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2273a-4763-447b-96a0-94c9a6306c5e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:47.091289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2273a-4763-447b-96a0-94c9a6306c5e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:47.091553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2273a-4763-447b-96a0-94c9a6306c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:47.117356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b0b2273a-4763-447b-96a0-94c9a6306c5e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:47.118371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b0b2273a-4763-447b-96a0-94c9a6306c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:47.191207 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4327/8647] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:47.202802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d746e2-33f3-4c7f-be12-ef74b765412a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:47.205360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d8d746e2-33f3-4c7f-be12-ef74b765412a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:47.294028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:47.307867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d746e2-33f3-4c7f-be12-ef74b765412a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:47.318894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233241d-04af-447b-911d-974bc44124da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:47.319730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233241d-04af-447b-911d-974bc44124da service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:47.320021 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233241d-04af-447b-911d-974bc44124da service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:47.321354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233241d-04af-447b-911d-974bc44124da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:47.340636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233241d-04af-447b-911d-974bc44124da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:47.343147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233241d-04af-447b-911d-974bc44124da service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:47.362360 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4321/8648] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:48.990673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9ceff-9c54-441f-af04-95f8da34f5a9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:48.991777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9ceff-9c54-441f-af04-95f8da34f5a9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:48.992221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9ceff-9c54-441f-af04-95f8da34f5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:49.024722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cee9ceff-9c54-441f-af04-95f8da34f5a9 None None] MFA Rules not processed for user `4486e383f6964303a10e7a28dd0b016d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:49.026267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cee9ceff-9c54-441f-af04-95f8da34f5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:49.122899 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4328/8649] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:02:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:50.300144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233241d-04af-447b-911d-974bc44124da service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:50.301916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9233241d-04af-447b-911d-974bc44124da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:50.446399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233241d-04af-447b-911d-974bc44124da service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:50.460225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064f234-4c9c-4959-a824-2a2031235887 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:50.461675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064f234-4c9c-4959-a824-2a2031235887 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:50.462425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064f234-4c9c-4959-a824-2a2031235887 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:50.463054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064f234-4c9c-4959-a824-2a2031235887 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:50.471727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e064f234-4c9c-4959-a824-2a2031235887 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:50.501979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064f234-4c9c-4959-a824-2a2031235887 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:50.504611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064f234-4c9c-4959-a824-2a2031235887 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:50.524982 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4322/8650] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:02:56.697358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9ceff-9c54-441f-af04-95f8da34f5a9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:56.700073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cee9ceff-9c54-441f-af04-95f8da34f5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:56.737639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9ceff-9c54-441f-af04-95f8da34f5a9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:56.744993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061c2cd-3460-4a52-950e-d0e66848eec7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:56.745932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061c2cd-3460-4a52-950e-d0e66848eec7 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:56.746219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061c2cd-3460-4a52-950e-d0e66848eec7 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:56.746492 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061c2cd-3460-4a52-950e-d0e66848eec7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:56.748613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0061c2cd-3460-4a52-950e-d0e66848eec7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:56.770951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061c2cd-3460-4a52-950e-d0e66848eec7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:56.775548 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061c2cd-3460-4a52-950e-d0e66848eec7 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:56.782998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:56.799459 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4329/8651] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:57.276279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c4eb0-d0bd-4bcc-8229-57fbc7806051 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:57.278279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c4eb0-d0bd-4bcc-8229-57fbc7806051 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:57.278726 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c4eb0-d0bd-4bcc-8229-57fbc7806051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:57.328474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1c6c4eb0-d0bd-4bcc-8229-57fbc7806051 None None] MFA Rules not processed for user `20a7a14c383c406c8aa492304d59c72a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:57.344281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c6c4eb0-d0bd-4bcc-8229-57fbc7806051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:57.459877 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4323/8652] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:02:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:57.465975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061c2cd-3460-4a52-950e-d0e66848eec7 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:57.478911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061c2cd-3460-4a52-950e-d0e66848eec7 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:57.484655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e7a82-d876-40b1-9779-62456df280e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:57.485372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e7a82-d876-40b1-9779-62456df280e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:57.485715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e7a82-d876-40b1-9779-62456df280e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:57.486051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e7a82-d876-40b1-9779-62456df280e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:57.486760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e7a82-d876-40b1-9779-62456df280e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:57.489285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e7a82-d876-40b1-9779-62456df280e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:57.529351 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4330/8653] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:02:57 2022] POST /identity/v3/users => generated 287 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:02:57.533914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c4eb0-d0bd-4bcc-8229-57fbc7806051 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:57.552887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c4eb0-d0bd-4bcc-8229-57fbc7806051 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:57.579018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81344c-b510-4d3d-9883-cdedcc399888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:57.580110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81344c-b510-4d3d-9883-cdedcc399888 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:57.580495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81344c-b510-4d3d-9883-cdedcc399888 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:57.580796 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81344c-b510-4d3d-9883-cdedcc399888 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:57.582294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81344c-b510-4d3d-9883-cdedcc399888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:57.584551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81344c-b510-4d3d-9883-cdedcc399888 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:57.597687 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4324/8654] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:57.601789 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e7a82-d876-40b1-9779-62456df280e2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:57.613629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e7a82-d876-40b1-9779-62456df280e2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:57.620989 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccde50-aaa8-4d74-a58b-e134e18f2497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:57.621745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccde50-aaa8-4d74-a58b-e134e18f2497 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:57.622132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccde50-aaa8-4d74-a58b-e134e18f2497 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:57.623000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccde50-aaa8-4d74-a58b-e134e18f2497 admin admin] PATH_INFO: `/v3/system/users/2a81dfe3e01a4e759909922d71edfaf7/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:57.643532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccde50-aaa8-4d74-a58b-e134e18f2497 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2a81dfe3e01a4e759909922d71edfaf7, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:57.644806 n-d-850468-20 devstack@keystone.service[82160]: WARNING py.warnings [None req-b6ccde50-aaa8-4d74-a58b-e134e18f2497 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:02:57.644806 n-d-850468-20 devstack@keystone.service[82160]: warnings.warn(msg) Aug 28 19:02:57.644806 n-d-850468-20 devstack@keystone.service[82160]: Aug 28 19:02:57.646087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccde50-aaa8-4d74-a58b-e134e18f2497 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:57.663462 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4331/8655] 10.222.0.27 () {60 vars in 1378 bytes} [Sun Aug 28 19:02:57 2022] PUT /identity/v3/system/users/2a81dfe3e01a4e759909922d71edfaf7/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:57.671088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d17e5-03bb-4e3d-9b19-4ec39da07adf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:57.671409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d17e5-03bb-4e3d-9b19-4ec39da07adf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:57.671690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d17e5-03bb-4e3d-9b19-4ec39da07adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:57.709670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-276d17e5-03bb-4e3d-9b19-4ec39da07adf None None] MFA Rules not processed for user `2a81dfe3e01a4e759909922d71edfaf7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:57.710892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-276d17e5-03bb-4e3d-9b19-4ec39da07adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:57.761944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:57.842882 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4325/8656] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:02:57 2022] POST /identity/v3/auth/tokens => generated 2414 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 19:02:57.846949 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccde50-aaa8-4d74-a58b-e134e18f2497 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:58.034465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccde50-aaa8-4d74-a58b-e134e18f2497 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:58.105478 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bafabb-dce7-4d1d-b175-b6fb4536bae8 None tempest-ImageQuotaTest-586485214-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a81dfe3e01a4e759909922d71edfaf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:58.119607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bafabb-dce7-4d1d-b175-b6fb4536bae8 None tempest-ImageQuotaTest-586485214-system-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:58.119971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bafabb-dce7-4d1d-b175-b6fb4536bae8 None tempest-ImageQuotaTest-586485214-system-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:58.120262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bafabb-dce7-4d1d-b175-b6fb4536bae8 None tempest-ImageQuotaTest-586485214-system-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:58.120948 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bafabb-dce7-4d1d-b175-b6fb4536bae8 None tempest-ImageQuotaTest-586485214-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:58.122363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bafabb-dce7-4d1d-b175-b6fb4536bae8 None tempest-ImageQuotaTest-586485214-system-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:58.135064 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4332/8657] 10.222.0.27 () {58 vars in 1110 bytes} [Sun Aug 28 19:02:57 2022] GET /identity/v3/services => generated 2191 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:58.140910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d17e5-03bb-4e3d-9b19-4ec39da07adf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:58.475350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d17e5-03bb-4e3d-9b19-4ec39da07adf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:58.546912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54542ff-c69a-413f-87ac-a2959d75dfa3 None tempest-ImageQuotaTest-586485214-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a81dfe3e01a4e759909922d71edfaf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:58.547606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54542ff-c69a-413f-87ac-a2959d75dfa3 None tempest-ImageQuotaTest-586485214-system-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:58.547912 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54542ff-c69a-413f-87ac-a2959d75dfa3 None tempest-ImageQuotaTest-586485214-system-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:58.548760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54542ff-c69a-413f-87ac-a2959d75dfa3 None tempest-ImageQuotaTest-586485214-system-admin] PATH_INFO: `/v3/limits` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:58.549471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54542ff-c69a-413f-87ac-a2959d75dfa3 None tempest-ImageQuotaTest-586485214-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:58.550803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54542ff-c69a-413f-87ac-a2959d75dfa3 None tempest-ImageQuotaTest-586485214-system-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:58.635164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b54542ff-c69a-413f-87ac-a2959d75dfa3 None tempest-ImageQuotaTest-586485214-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 28 19:02:58.635164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:02:58.635164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:02:58.635164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:02:58.635164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:02:58.635164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:02:58.635164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:02:58.635164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:02:58.635164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:02:58.635164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:02:58.635164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:02:58.635164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:02:58.635164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Aug 28 19:02:58.635164 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Aug 28 19:02:58.636514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:02:58.636514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:02:58.636514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Aug 28 19:02:58.636514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Aug 28 19:02:58.636514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 19:02:58.636514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 19:02:58.636514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Aug 28 19:02:58.636514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Aug 28 19:02:58.636514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Aug 28 19:02:58.636514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.NoLimitReference Aug 28 19:02:58.636514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 28 19:02:58.636514 n-d-850468-20 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Aug 28 19:02:58.638920 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4326/8658] 10.222.0.27 () {60 vars in 1126 bytes} [Sun Aug 28 19:02:58 2022] POST /identity/v3/limits => generated 124 bytes in 499 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Aug 28 19:02:58.644928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bafabb-dce7-4d1d-b175-b6fb4536bae8 None tempest-ImageQuotaTest-586485214-system-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:58.722000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:58.894051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bafabb-dce7-4d1d-b175-b6fb4536bae8 None tempest-ImageQuotaTest-586485214-system-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:58.962766 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b61066-8ceb-478a-be93-591a78e93674 None tempest-ImageQuotaTest-586485214-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a81dfe3e01a4e759909922d71edfaf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:58.963149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b61066-8ceb-478a-be93-591a78e93674 None tempest-ImageQuotaTest-586485214-system-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:58.963409 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b61066-8ceb-478a-be93-591a78e93674 None tempest-ImageQuotaTest-586485214-system-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:58.963685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b61066-8ceb-478a-be93-591a78e93674 None tempest-ImageQuotaTest-586485214-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:58.964336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b61066-8ceb-478a-be93-591a78e93674 None tempest-ImageQuotaTest-586485214-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:58.966379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b61066-8ceb-478a-be93-591a78e93674 None tempest-ImageQuotaTest-586485214-system-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:58.975801 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4333/8659] 10.222.0.27 () {58 vars in 1137 bytes} [Sun Aug 28 19:02:58 2022] GET /identity/v3/registered_limits => generated 129 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:02:58.982325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54542ff-c69a-413f-87ac-a2959d75dfa3 None tempest-ImageQuotaTest-586485214-system-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:59.045948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:59.207354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54542ff-c69a-413f-87ac-a2959d75dfa3 None tempest-ImageQuotaTest-586485214-system-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:59.251469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa1546-d360-477a-aa12-4e7a6f6d465c None tempest-ImageQuotaTest-586485214-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a81dfe3e01a4e759909922d71edfaf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:59.252691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa1546-d360-477a-aa12-4e7a6f6d465c None tempest-ImageQuotaTest-586485214-system-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:59.252691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa1546-d360-477a-aa12-4e7a6f6d465c None tempest-ImageQuotaTest-586485214-system-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:59.253837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa1546-d360-477a-aa12-4e7a6f6d465c None tempest-ImageQuotaTest-586485214-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:59.253837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa1546-d360-477a-aa12-4e7a6f6d465c None tempest-ImageQuotaTest-586485214-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:59.255178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa1546-d360-477a-aa12-4e7a6f6d465c None tempest-ImageQuotaTest-586485214-system-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:59.262328 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4327/8660] 10.222.0.27 () {58 vars in 1137 bytes} [Sun Aug 28 19:02:58 2022] GET /identity/v3/registered_limits => generated 129 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:06.537991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b61066-8ceb-478a-be93-591a78e93674 None tempest-ImageQuotaTest-586485214-system-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:06.539986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-68b61066-8ceb-478a-be93-591a78e93674 None tempest-ImageQuotaTest-586485214-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:06.673542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b61066-8ceb-478a-be93-591a78e93674 None tempest-ImageQuotaTest-586485214-system-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:06.683161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcef06-008e-413f-866a-0cfacc3e7d98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:06.684720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcef06-008e-413f-866a-0cfacc3e7d98 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:06.685347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcef06-008e-413f-866a-0cfacc3e7d98 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:06.686062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcef06-008e-413f-866a-0cfacc3e7d98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:06.690182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-86bcef06-008e-413f-866a-0cfacc3e7d98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:06.728274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcef06-008e-413f-866a-0cfacc3e7d98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:06.730259 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcef06-008e-413f-866a-0cfacc3e7d98 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:06.777852 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4334/8661] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:06.789833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa1546-d360-477a-aa12-4e7a6f6d465c None tempest-ImageQuotaTest-586485214-system-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:06.807336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa1546-d360-477a-aa12-4e7a6f6d465c None tempest-ImageQuotaTest-586485214-system-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:06.813029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e52552-57d1-4e3e-92bc-24e4551350a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:06.814068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e52552-57d1-4e3e-92bc-24e4551350a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:06.814930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e52552-57d1-4e3e-92bc-24e4551350a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:06.815365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e52552-57d1-4e3e-92bc-24e4551350a2 admin admin] PATH_INFO: `/v3/users/20a7a14c383c406c8aa492304d59c72a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:06.817070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e52552-57d1-4e3e-92bc-24e4551350a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20a7a14c383c406c8aa492304d59c72a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:06.820604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e52552-57d1-4e3e-92bc-24e4551350a2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:06.912337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-90e52552-57d1-4e3e-92bc-24e4551350a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a7a14c383c406c8aa492304d59c72a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.913716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-90e52552-57d1-4e3e-92bc-24e4551350a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a7a14c383c406c8aa492304d59c72a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.935089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-90e52552-57d1-4e3e-92bc-24e4551350a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a7a14c383c406c8aa492304d59c72a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.948477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-90e52552-57d1-4e3e-92bc-24e4551350a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a7a14c383c406c8aa492304d59c72a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.969225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-90e52552-57d1-4e3e-92bc-24e4551350a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a7a14c383c406c8aa492304d59c72a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.977462 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4328/8662] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:06 2022] DELETE /identity/v3/users/20a7a14c383c406c8aa492304d59c72a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:07.203683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcef06-008e-413f-866a-0cfacc3e7d98 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:07.226094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcef06-008e-413f-866a-0cfacc3e7d98 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:07.281251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:07.326567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb61792-d005-47e8-ab8c-a39bbd37f582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:07.327237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb61792-d005-47e8-ab8c-a39bbd37f582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:07.327607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb61792-d005-47e8-ab8c-a39bbd37f582 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:07.327889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb61792-d005-47e8-ab8c-a39bbd37f582 admin admin] PATH_INFO: `/v3/projects/d615482d586b4d36b4cb034d56a4fa81` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:07.329031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb61792-d005-47e8-ab8c-a39bbd37f582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d615482d586b4d36b4cb034d56a4fa81)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:07.331632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb61792-d005-47e8-ab8c-a39bbd37f582 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:07.395935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0cb61792-d005-47e8-ab8c-a39bbd37f582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd615482d586b4d36b4cb034d56a4fa81', 'request_id': 'req-0cb61792-d005-47e8-ab8c-a39bbd37f582'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:07.403660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0cb61792-d005-47e8-ab8c-a39bbd37f582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd615482d586b4d36b4cb034d56a4fa81', 'request_id': 'req-0cb61792-d005-47e8-ab8c-a39bbd37f582'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:07.411968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0cb61792-d005-47e8-ab8c-a39bbd37f582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd615482d586b4d36b4cb034d56a4fa81', 'request_id': 'req-0cb61792-d005-47e8-ab8c-a39bbd37f582'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:07.428044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0cb61792-d005-47e8-ab8c-a39bbd37f582 admin admin] The token cache is being invalidate because project d615482d586b4d36b4cb034d56a4fa81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:07.428421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0cb61792-d005-47e8-ab8c-a39bbd37f582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:07.429037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0cb61792-d005-47e8-ab8c-a39bbd37f582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:07.430775 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4335/8663] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:07 2022] DELETE /identity/v3/projects/d615482d586b4d36b4cb034d56a4fa81 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:07.434733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e52552-57d1-4e3e-92bc-24e4551350a2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:07.436234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-90e52552-57d1-4e3e-92bc-24e4551350a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:07.456792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e52552-57d1-4e3e-92bc-24e4551350a2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:07.463505 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:07.539971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d71fa-b615-4c14-b4d2-7b543f86e639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:07.540832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d71fa-b615-4c14-b4d2-7b543f86e639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:07.541121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d71fa-b615-4c14-b4d2-7b543f86e639 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:07.541398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d71fa-b615-4c14-b4d2-7b543f86e639 admin admin] PATH_INFO: `/v3/users/2a81dfe3e01a4e759909922d71edfaf7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:07.543371 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d71fa-b615-4c14-b4d2-7b543f86e639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a81dfe3e01a4e759909922d71edfaf7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:07.547520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d71fa-b615-4c14-b4d2-7b543f86e639 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:07.635421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f82d71fa-b615-4c14-b4d2-7b543f86e639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a81dfe3e01a4e759909922d71edfaf7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:07.636391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f82d71fa-b615-4c14-b4d2-7b543f86e639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a81dfe3e01a4e759909922d71edfaf7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:07.652586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f82d71fa-b615-4c14-b4d2-7b543f86e639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a81dfe3e01a4e759909922d71edfaf7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:07.668923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f82d71fa-b615-4c14-b4d2-7b543f86e639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a81dfe3e01a4e759909922d71edfaf7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:07.713839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f82d71fa-b615-4c14-b4d2-7b543f86e639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a81dfe3e01a4e759909922d71edfaf7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:07.729282 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4329/8664] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:07 2022] DELETE /identity/v3/users/2a81dfe3e01a4e759909922d71edfaf7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:08.150338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb61792-d005-47e8-ab8c-a39bbd37f582 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:08.152072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0cb61792-d005-47e8-ab8c-a39bbd37f582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:08.169615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb61792-d005-47e8-ab8c-a39bbd37f582 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:08.270860 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243131d-f174-48d5-982a-7970d636fd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:08.271980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243131d-f174-48d5-982a-7970d636fd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:08.272486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243131d-f174-48d5-982a-7970d636fd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:08.272687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243131d-f174-48d5-982a-7970d636fd05 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:08.282262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243131d-f174-48d5-982a-7970d636fd05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:08.284513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243131d-f174-48d5-982a-7970d636fd05 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:08.309180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-7243131d-f174-48d5-982a-7970d636fd05 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Aug 28 19:03:08.309180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:08.309180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:03:08.309180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:03:08.309180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:03:08.309180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:03:08.309180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:03:08.309180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:03:08.309180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:03:08.309180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:03:08.309180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:03:08.309180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:03:08.309180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 28 19:03:08.309180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 28 19:03:08.309180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:03:08.309180 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:03:08.310582 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 28 19:03:08.310582 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 28 19:03:08.310582 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:03:08.310582 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:03:08.310582 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:03:08.310582 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:03:08.310582 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Aug 28 19:03:08.310582 n-d-850468-20 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Aug 28 19:03:08.310582 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4336/8665] 10.222.0.27 () {58 vars in 1149 bytes} [Sun Aug 28 19:03:08 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:03:17.721790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=53,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:18.230255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bd6ab-8fa2-4a4f-b320-ee684bdd7c47 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:18.230255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bd6ab-8fa2-4a4f-b320-ee684bdd7c47 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:18.230460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bd6ab-8fa2-4a4f-b320-ee684bdd7c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:18.265565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bf6bd6ab-8fa2-4a4f-b320-ee684bdd7c47 None None] MFA Rules not processed for user `2aa7d94090504881bb0ffd560ba90378`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:18.266843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf6bd6ab-8fa2-4a4f-b320-ee684bdd7c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:18.289068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=67,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:18.363930 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4330/8666] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:03:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:20.097692 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243131d-f174-48d5-982a-7970d636fd05 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:20.101288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7243131d-f174-48d5-982a-7970d636fd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:20.205841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243131d-f174-48d5-982a-7970d636fd05 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:20.216405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a05b0-c236-4c5a-9e0b-31d9b76c430d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:20.219382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a05b0-c236-4c5a-9e0b-31d9b76c430d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:20.220114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a05b0-c236-4c5a-9e0b-31d9b76c430d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:20.220819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a05b0-c236-4c5a-9e0b-31d9b76c430d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:20.224416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ab0a05b0-c236-4c5a-9e0b-31d9b76c430d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:20.247499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a05b0-c236-4c5a-9e0b-31d9b76c430d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:20.249827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a05b0-c236-4c5a-9e0b-31d9b76c430d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:20.279880 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4337/8667] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:28.348242 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=25 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:30.258004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=26 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:32.310300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bd6ab-8fa2-4a4f-b320-ee684bdd7c47 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:32.312655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf6bd6ab-8fa2-4a4f-b320-ee684bdd7c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:32.332597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bd6ab-8fa2-4a4f-b320-ee684bdd7c47 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:32.343640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee56ab-5997-44c3-9d2d-e6571c2cc97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:32.344712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee56ab-5997-44c3-9d2d-e6571c2cc97c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:32.345192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee56ab-5997-44c3-9d2d-e6571c2cc97c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:32.345722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee56ab-5997-44c3-9d2d-e6571c2cc97c admin admin] PATH_INFO: `/v3/users/4486e383f6964303a10e7a28dd0b016d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:32.350402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee56ab-5997-44c3-9d2d-e6571c2cc97c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4486e383f6964303a10e7a28dd0b016d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:32.352704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee56ab-5997-44c3-9d2d-e6571c2cc97c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:32.447337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcee56ab-5997-44c3-9d2d-e6571c2cc97c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4486e383f6964303a10e7a28dd0b016d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:32.452969 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcee56ab-5997-44c3-9d2d-e6571c2cc97c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4486e383f6964303a10e7a28dd0b016d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:32.463545 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcee56ab-5997-44c3-9d2d-e6571c2cc97c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4486e383f6964303a10e7a28dd0b016d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:32.479801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcee56ab-5997-44c3-9d2d-e6571c2cc97c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4486e383f6964303a10e7a28dd0b016d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:32.508045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcee56ab-5997-44c3-9d2d-e6571c2cc97c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4486e383f6964303a10e7a28dd0b016d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:32.521930 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4331/8668] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:32 2022] DELETE /identity/v3/users/4486e383f6964303a10e7a28dd0b016d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:32.527204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b08f36-fd19-4ce0-bd16-20a29849c348 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:32.528344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b08f36-fd19-4ce0-bd16-20a29849c348 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:32.528765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b08f36-fd19-4ce0-bd16-20a29849c348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:32.584800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-00b08f36-fd19-4ce0-bd16-20a29849c348 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:32.587481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00b08f36-fd19-4ce0-bd16-20a29849c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:32.704949 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4338/8669] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:32.719639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee56ab-5997-44c3-9d2d-e6571c2cc97c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:32.721253 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fcee56ab-5997-44c3-9d2d-e6571c2cc97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:32.802899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee56ab-5997-44c3-9d2d-e6571c2cc97c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:32.808706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a663a-34fa-4f49-9f58-c0a7090c19b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:32.809688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a663a-34fa-4f49-9f58-c0a7090c19b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:32.810036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a663a-34fa-4f49-9f58-c0a7090c19b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:32.810384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a663a-34fa-4f49-9f58-c0a7090c19b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:32.826173 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a663a-34fa-4f49-9f58-c0a7090c19b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:32.826765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a663a-34fa-4f49-9f58-c0a7090c19b0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:32.843301 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4332/8670] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:33.220413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b08f36-fd19-4ce0-bd16-20a29849c348 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:33.222210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00b08f36-fd19-4ce0-bd16-20a29849c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:33.248930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b08f36-fd19-4ce0-bd16-20a29849c348 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:33.256357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:33.257029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:33.257308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:33.257582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17 admin admin] PATH_INFO: `/v3/projects/276b79c5bff341a3a2f22a8d95df60c3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:33.258827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=276b79c5bff341a3a2f22a8d95df60c3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:33.264900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:33.353627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276b79c5bff341a3a2f22a8d95df60c3', 'request_id': 'req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:33.361905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276b79c5bff341a3a2f22a8d95df60c3', 'request_id': 'req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:33.372168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276b79c5bff341a3a2f22a8d95df60c3', 'request_id': 'req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:33.396497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17 admin admin] The token cache is being invalidate because project 276b79c5bff341a3a2f22a8d95df60c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:33.396798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:33.397521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:33.399711 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4339/8671] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:33 2022] DELETE /identity/v3/projects/276b79c5bff341a3a2f22a8d95df60c3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:33.405449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a663a-34fa-4f49-9f58-c0a7090c19b0 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:33.422445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a663a-34fa-4f49-9f58-c0a7090c19b0 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:33.523768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0339e4-3b0f-4a12-a593-0c7e0eaa4901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:33.524491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0339e4-3b0f-4a12-a593-0c7e0eaa4901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:33.524911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0339e4-3b0f-4a12-a593-0c7e0eaa4901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:33.525252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0339e4-3b0f-4a12-a593-0c7e0eaa4901 admin admin] PATH_INFO: `/v3/users/a57d32b420da45f09e2d3762b6071b7c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:33.526888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0339e4-3b0f-4a12-a593-0c7e0eaa4901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57d32b420da45f09e2d3762b6071b7c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:33.529204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0339e4-3b0f-4a12-a593-0c7e0eaa4901 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:33.560721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:33.618386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fe0339e4-3b0f-4a12-a593-0c7e0eaa4901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57d32b420da45f09e2d3762b6071b7c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:33.619179 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fe0339e4-3b0f-4a12-a593-0c7e0eaa4901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57d32b420da45f09e2d3762b6071b7c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:33.629111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fe0339e4-3b0f-4a12-a593-0c7e0eaa4901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57d32b420da45f09e2d3762b6071b7c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:33.641999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fe0339e4-3b0f-4a12-a593-0c7e0eaa4901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57d32b420da45f09e2d3762b6071b7c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:33.675306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fe0339e4-3b0f-4a12-a593-0c7e0eaa4901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57d32b420da45f09e2d3762b6071b7c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:33.684176 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4333/8672] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:33 2022] DELETE /identity/v3/users/a57d32b420da45f09e2d3762b6071b7c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:34.374564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:34.388876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:34.413803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0b9fb-22d7-4602-a311-6c3f41d8ee17 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:34.572236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5a33d-df07-4c7c-aa03-80ddb9617740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:34.573216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5a33d-df07-4c7c-aa03-80ddb9617740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:34.573681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5a33d-df07-4c7c-aa03-80ddb9617740 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:34.574136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5a33d-df07-4c7c-aa03-80ddb9617740 admin admin] PATH_INFO: `/v3/projects/a98be1de69154810ace4156a369946d0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:34.577136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5a33d-df07-4c7c-aa03-80ddb9617740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98be1de69154810ace4156a369946d0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:34.580261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5a33d-df07-4c7c-aa03-80ddb9617740 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:34.656792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:34.693657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9bd5a33d-df07-4c7c-aa03-80ddb9617740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98be1de69154810ace4156a369946d0', 'request_id': 'req-9bd5a33d-df07-4c7c-aa03-80ddb9617740'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:34.706576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9bd5a33d-df07-4c7c-aa03-80ddb9617740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98be1de69154810ace4156a369946d0', 'request_id': 'req-9bd5a33d-df07-4c7c-aa03-80ddb9617740'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:34.723360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9bd5a33d-df07-4c7c-aa03-80ddb9617740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98be1de69154810ace4156a369946d0', 'request_id': 'req-9bd5a33d-df07-4c7c-aa03-80ddb9617740'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:34.748247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9bd5a33d-df07-4c7c-aa03-80ddb9617740 admin admin] The token cache is being invalidate because project a98be1de69154810ace4156a369946d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:34.748608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9bd5a33d-df07-4c7c-aa03-80ddb9617740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:34.749450 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9bd5a33d-df07-4c7c-aa03-80ddb9617740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:34.752765 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4340/8673] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:34 2022] DELETE /identity/v3/projects/a98be1de69154810ace4156a369946d0 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:34.756982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0339e4-3b0f-4a12-a593-0c7e0eaa4901 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:34.758530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe0339e4-3b0f-4a12-a593-0c7e0eaa4901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:34.773134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0339e4-3b0f-4a12-a593-0c7e0eaa4901 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:34.859698 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0169907-045b-4100-beae-d879dab70c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:34.860388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0169907-045b-4100-beae-d879dab70c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:34.860665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0169907-045b-4100-beae-d879dab70c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:34.860935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0169907-045b-4100-beae-d879dab70c6d admin admin] PATH_INFO: `/v3/users/e9e2ceb7be5244488f014f7f3b8b5fa5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:34.862498 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0169907-045b-4100-beae-d879dab70c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e2ceb7be5244488f014f7f3b8b5fa5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:34.865477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0169907-045b-4100-beae-d879dab70c6d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:34.934158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a0169907-045b-4100-beae-d879dab70c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e2ceb7be5244488f014f7f3b8b5fa5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:34.934889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a0169907-045b-4100-beae-d879dab70c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e2ceb7be5244488f014f7f3b8b5fa5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:34.943696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a0169907-045b-4100-beae-d879dab70c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e2ceb7be5244488f014f7f3b8b5fa5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:34.956337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a0169907-045b-4100-beae-d879dab70c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e2ceb7be5244488f014f7f3b8b5fa5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:34.973709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a0169907-045b-4100-beae-d879dab70c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e2ceb7be5244488f014f7f3b8b5fa5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:34.981278 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4334/8674] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:34 2022] DELETE /identity/v3/users/e9e2ceb7be5244488f014f7f3b8b5fa5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:35.305443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5a33d-df07-4c7c-aa03-80ddb9617740 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:35.307082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9bd5a33d-df07-4c7c-aa03-80ddb9617740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:35.322991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5a33d-df07-4c7c-aa03-80ddb9617740 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:35.344890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0169907-045b-4100-beae-d879dab70c6d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:35.347057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a0169907-045b-4100-beae-d879dab70c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:35.374837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:35.412255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e947d-cc18-43b7-98f7-20a2d00bbcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:35.412881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e947d-cc18-43b7-98f7-20a2d00bbcc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:35.413153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e947d-cc18-43b7-98f7-20a2d00bbcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:35.413449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e947d-cc18-43b7-98f7-20a2d00bbcc3 admin admin] PATH_INFO: `/v3/users/ce13155820524da2b6d8cc5c23373953` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:35.414581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e947d-cc18-43b7-98f7-20a2d00bbcc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce13155820524da2b6d8cc5c23373953)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:35.416806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e947d-cc18-43b7-98f7-20a2d00bbcc3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:35.442931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0169907-045b-4100-beae-d879dab70c6d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:35.448368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeda416-9b1f-4b00-aeca-06ecfea57b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:35.449130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeda416-9b1f-4b00-aeca-06ecfea57b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:35.449415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeda416-9b1f-4b00-aeca-06ecfea57b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:35.449721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeda416-9b1f-4b00-aeca-06ecfea57b01 admin admin] PATH_INFO: `/v3/projects/af54123d031043ef928e4fa046f30367` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:35.450994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeda416-9b1f-4b00-aeca-06ecfea57b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af54123d031043ef928e4fa046f30367)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:35.453244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeda416-9b1f-4b00-aeca-06ecfea57b01 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:35.471865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f76e947d-cc18-43b7-98f7-20a2d00bbcc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce13155820524da2b6d8cc5c23373953'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:35.486338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f76e947d-cc18-43b7-98f7-20a2d00bbcc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce13155820524da2b6d8cc5c23373953'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:35.487360 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f76e947d-cc18-43b7-98f7-20a2d00bbcc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce13155820524da2b6d8cc5c23373953'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:35.488009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f76e947d-cc18-43b7-98f7-20a2d00bbcc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce13155820524da2b6d8cc5c23373953'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:35.497349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f76e947d-cc18-43b7-98f7-20a2d00bbcc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce13155820524da2b6d8cc5c23373953'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:35.508206 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bfeda416-9b1f-4b00-aeca-06ecfea57b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af54123d031043ef928e4fa046f30367', 'request_id': 'req-bfeda416-9b1f-4b00-aeca-06ecfea57b01'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:35.512226 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4341/8675] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:35 2022] DELETE /identity/v3/users/ce13155820524da2b6d8cc5c23373953 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:35.517495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bfeda416-9b1f-4b00-aeca-06ecfea57b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af54123d031043ef928e4fa046f30367', 'request_id': 'req-bfeda416-9b1f-4b00-aeca-06ecfea57b01'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:35.530032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bfeda416-9b1f-4b00-aeca-06ecfea57b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af54123d031043ef928e4fa046f30367', 'request_id': 'req-bfeda416-9b1f-4b00-aeca-06ecfea57b01'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:35.544314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bfeda416-9b1f-4b00-aeca-06ecfea57b01 admin admin] The token cache is being invalidate because project af54123d031043ef928e4fa046f30367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:35.544793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bfeda416-9b1f-4b00-aeca-06ecfea57b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:35.545910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bfeda416-9b1f-4b00-aeca-06ecfea57b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:35.548137 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4335/8676] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:35 2022] DELETE /identity/v3/projects/af54123d031043ef928e4fa046f30367 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:03:35.554837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df675f-c473-4fa1-b42a-5812a3236a59 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:35.555350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df675f-c473-4fa1-b42a-5812a3236a59 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:35.555804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df675f-c473-4fa1-b42a-5812a3236a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:35.589955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-96df675f-c473-4fa1-b42a-5812a3236a59 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:35.592041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-96df675f-c473-4fa1-b42a-5812a3236a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:35.643466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:35.682137 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4342/8677] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:03:35.690970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47acf4-32ba-44bf-ac59-c7a3f724f118 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:35.691270 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47acf4-32ba-44bf-ac59-c7a3f724f118 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:35.691564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47acf4-32ba-44bf-ac59-c7a3f724f118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:35.715039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6c47acf4-32ba-44bf-ac59-c7a3f724f118 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:35.716484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6c47acf4-32ba-44bf-ac59-c7a3f724f118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:35.725453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df675f-c473-4fa1-b42a-5812a3236a59 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:35.725779 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4336/8678] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:35.729222 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-96df675f-c473-4fa1-b42a-5812a3236a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:35.730240 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47acf4-32ba-44bf-ac59-c7a3f724f118 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:35.740874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47acf4-32ba-44bf-ac59-c7a3f724f118 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:35.742897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df675f-c473-4fa1-b42a-5812a3236a59 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:35.746025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fe321-fbbe-4fdf-a8d5-3f9957464b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:35.746652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fe321-fbbe-4fdf-a8d5-3f9957464b80 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:35.746932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fe321-fbbe-4fdf-a8d5-3f9957464b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:35.747209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fe321-fbbe-4fdf-a8d5-3f9957464b80 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:35.747939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fe321-fbbe-4fdf-a8d5-3f9957464b80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:03:35.748203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fe321-fbbe-4fdf-a8d5-3f9957464b80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:35.749290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:35.749902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fe321-fbbe-4fdf-a8d5-3f9957464b80 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:35.750038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:35.750358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:35.750729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb admin admin] PATH_INFO: `/v3/projects/7e0a82594c6a4405a424af68436190e9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:35.751977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0a82594c6a4405a424af68436190e9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:35.753973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:35.765917 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4337/8679] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:35.766925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fe321-fbbe-4fdf-a8d5-3f9957464b80 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:35.777850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fe321-fbbe-4fdf-a8d5-3f9957464b80 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:35.782637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e0ef0-bb5b-4ac6-a077-ef905812dd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:35.783321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e0ef0-bb5b-4ac6-a077-ef905812dd76 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:35.783595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e0ef0-bb5b-4ac6-a077-ef905812dd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:35.783876 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e0ef0-bb5b-4ac6-a077-ef905812dd76 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:35.784513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e0ef0-bb5b-4ac6-a077-ef905812dd76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:35.786436 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e0ef0-bb5b-4ac6-a077-ef905812dd76 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:35.810928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0a82594c6a4405a424af68436190e9', 'request_id': 'req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:35.815960 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4338/8680] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:03:35 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:03:35.819333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0a82594c6a4405a424af68436190e9', 'request_id': 'req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:35.820450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e0ef0-bb5b-4ac6-a077-ef905812dd76 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:35.827156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0a82594c6a4405a424af68436190e9', 'request_id': 'req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:35.842303 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb admin admin] The token cache is being invalidate because project 7e0a82594c6a4405a424af68436190e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:35.842595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:35.843591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:35.845133 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4343/8681] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:35 2022] DELETE /identity/v3/projects/7e0a82594c6a4405a424af68436190e9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:35.849284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:35.850606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:35.889490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e0ef0-bb5b-4ac6-a077-ef905812dd76 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:35.895109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838710e3-1d48-4266-9a9d-a377b448fd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:35.895809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838710e3-1d48-4266-9a9d-a377b448fd9f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:35.896075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838710e3-1d48-4266-9a9d-a377b448fd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:35.896370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838710e3-1d48-4266-9a9d-a377b448fd9f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:35.897014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838710e3-1d48-4266-9a9d-a377b448fd9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:35.899050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838710e3-1d48-4266-9a9d-a377b448fd9f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:35.909267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:35.931945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85c4b2-6c71-43ab-b8d2-9224363cc5cb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:35.939688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3595989-8204-45c3-9278-d597be437348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:35.940397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3595989-8204-45c3-9278-d597be437348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:35.940682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3595989-8204-45c3-9278-d597be437348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:35.940964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3595989-8204-45c3-9278-d597be437348 admin admin] PATH_INFO: `/v3/users/450037f4e0dc4452813c727462bd7052` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:35.942839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3595989-8204-45c3-9278-d597be437348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=450037f4e0dc4452813c727462bd7052)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:35.944956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3595989-8204-45c3-9278-d597be437348 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:35.948353 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4339/8682] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:03:35 2022] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:03:35.952970 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838710e3-1d48-4266-9a9d-a377b448fd9f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:35.968600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-838710e3-1d48-4266-9a9d-a377b448fd9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:35.986742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838710e3-1d48-4266-9a9d-a377b448fd9f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:35.992740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6290f-c52f-483f-9102-d151f19e47bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:35.993365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6290f-c52f-483f-9102-d151f19e47bb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:35.993643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6290f-c52f-483f-9102-d151f19e47bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:35.993916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6290f-c52f-483f-9102-d151f19e47bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:35.994558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6290f-c52f-483f-9102-d151f19e47bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:35.996210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6290f-c52f-483f-9102-d151f19e47bb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:36.006064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b3595989-8204-45c3-9278-d597be437348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '450037f4e0dc4452813c727462bd7052'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:36.010658 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4340/8683] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:03:36.014805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6290f-c52f-483f-9102-d151f19e47bb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:36.016722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:36.023553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b3595989-8204-45c3-9278-d597be437348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '450037f4e0dc4452813c727462bd7052'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:36.024638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b3595989-8204-45c3-9278-d597be437348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '450037f4e0dc4452813c727462bd7052'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:36.025573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b3595989-8204-45c3-9278-d597be437348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '450037f4e0dc4452813c727462bd7052'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:36.026145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6290f-c52f-483f-9102-d151f19e47bb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:36.032775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165651b-57a5-4f35-8ff6-1df27b4c7127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:36.033652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165651b-57a5-4f35-8ff6-1df27b4c7127 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:36.033948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165651b-57a5-4f35-8ff6-1df27b4c7127 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:36.034210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165651b-57a5-4f35-8ff6-1df27b4c7127 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:36.035046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165651b-57a5-4f35-8ff6-1df27b4c7127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:36.036340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b3595989-8204-45c3-9278-d597be437348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '450037f4e0dc4452813c727462bd7052'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:36.037012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165651b-57a5-4f35-8ff6-1df27b4c7127 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:36.048716 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4341/8684] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:03:36.050930 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4344/8685] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:35 2022] DELETE /identity/v3/users/450037f4e0dc4452813c727462bd7052 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:03:36.055491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165651b-57a5-4f35-8ff6-1df27b4c7127 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:36.058258 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b165651b-57a5-4f35-8ff6-1df27b4c7127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:36.080793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165651b-57a5-4f35-8ff6-1df27b4c7127 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:36.152864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd589b-3d62-4bbd-8a19-e0cf7c5a898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:36.153435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd589b-3d62-4bbd-8a19-e0cf7c5a898c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:36.153751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd589b-3d62-4bbd-8a19-e0cf7c5a898c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:36.154042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd589b-3d62-4bbd-8a19-e0cf7c5a898c admin admin] PATH_INFO: `/v3/projects/93d09a810ce04391bb2c3339955bad6a/users/87bbe66c85d94dae93e9f5422346c11c/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:36.171334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd589b-3d62-4bbd-8a19-e0cf7c5a898c admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d09a810ce04391bb2c3339955bad6a, user_id=87bbe66c85d94dae93e9f5422346c11c, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:36.174269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd589b-3d62-4bbd-8a19-e0cf7c5a898c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:36.193348 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4342/8686] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:03:36 2022] PUT /identity/v3/projects/93d09a810ce04391bb2c3339955bad6a/users/87bbe66c85d94dae93e9f5422346c11c/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:36.198415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157230b-eab6-4b76-9fd1-60681eba0f13 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:36.198786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157230b-eab6-4b76-9fd1-60681eba0f13 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:36.199142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157230b-eab6-4b76-9fd1-60681eba0f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:36.219826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6157230b-eab6-4b76-9fd1-60681eba0f13 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:36.221203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6157230b-eab6-4b76-9fd1-60681eba0f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:36.288526 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd589b-3d62-4bbd-8a19-e0cf7c5a898c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:36.290816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1cd589b-3d62-4bbd-8a19-e0cf7c5a898c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:36.331300 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4345/8687] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:36.341619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157230b-eab6-4b76-9fd1-60681eba0f13 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:36.343294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6157230b-eab6-4b76-9fd1-60681eba0f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:36.420388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157230b-eab6-4b76-9fd1-60681eba0f13 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:36.422365 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd589b-3d62-4bbd-8a19-e0cf7c5a898c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:36.430406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1297e0d-3ae0-40da-9b1d-bb161d352ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:36.430692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:36.431534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:36.431942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:36.432057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1297e0d-3ae0-40da-9b1d-bb161d352ecb service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:36.432223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157 admin admin] PATH_INFO: `/v3/projects/510ef1b781de4b8ea5e3d0a07056a1f5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:36.432861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1297e0d-3ae0-40da-9b1d-bb161d352ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:36.433409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=510ef1b781de4b8ea5e3d0a07056a1f5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:36.433517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1297e0d-3ae0-40da-9b1d-bb161d352ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:36.435549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:36.452175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1297e0d-3ae0-40da-9b1d-bb161d352ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:36.455541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1297e0d-3ae0-40da-9b1d-bb161d352ecb service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:36.472315 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4346/8688] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:03:36.493313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510ef1b781de4b8ea5e3d0a07056a1f5', 'request_id': 'req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:36.498887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:36.504762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510ef1b781de4b8ea5e3d0a07056a1f5', 'request_id': 'req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:36.513374 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510ef1b781de4b8ea5e3d0a07056a1f5', 'request_id': 'req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:36.526092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157 admin admin] The token cache is being invalidate because project 510ef1b781de4b8ea5e3d0a07056a1f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:36.526608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:36.527336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:36.528977 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4343/8689] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:36 2022] DELETE /identity/v3/projects/510ef1b781de4b8ea5e3d0a07056a1f5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:41.187899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbf46e-359e-4156-b9e3-e68677e09de2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:41.188485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbf46e-359e-4156-b9e3-e68677e09de2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:41.188485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbf46e-359e-4156-b9e3-e68677e09de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:41.222200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bccbf46e-359e-4156-b9e3-e68677e09de2 None None] MFA Rules not processed for user `87bbe66c85d94dae93e9f5422346c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:41.223461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bccbf46e-359e-4156-b9e3-e68677e09de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:41.326175 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4347/8690] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:03:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:03:41.332854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:41.334384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:41.434893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ac3e8-49bf-4b21-a3dd-6f5ba40ec157 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:41.441428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5bb56-a446-453a-8266-2809771ddf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:41.442060 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5bb56-a446-453a-8266-2809771ddf42 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:41.442342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5bb56-a446-453a-8266-2809771ddf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:41.442614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5bb56-a446-453a-8266-2809771ddf42 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:41.443281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5bb56-a446-453a-8266-2809771ddf42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:41.445229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5bb56-a446-453a-8266-2809771ddf42 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:41.508855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbf46e-359e-4156-b9e3-e68677e09de2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:41.510083 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4344/8691] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:03:41 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:41.522612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbf46e-359e-4156-b9e3-e68677e09de2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:41.528454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:41.615373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103a829-e995-4548-9908-d76cace59916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:41.615373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103a829-e995-4548-9908-d76cace59916 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:41.615373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103a829-e995-4548-9908-d76cace59916 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:41.615373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103a829-e995-4548-9908-d76cace59916 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:41.615931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103a829-e995-4548-9908-d76cace59916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:41.616223 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103a829-e995-4548-9908-d76cace59916 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:41.645782 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4348/8692] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:03:41 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:03:41.651053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5bb56-a446-453a-8266-2809771ddf42 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:41.669107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5bb56-a446-453a-8266-2809771ddf42 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:41.677225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eed7b0-81e3-4968-8884-fb89438a2b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:41.677872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eed7b0-81e3-4968-8884-fb89438a2b59 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:41.678153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eed7b0-81e3-4968-8884-fb89438a2b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:41.678429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eed7b0-81e3-4968-8884-fb89438a2b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:41.679092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eed7b0-81e3-4968-8884-fb89438a2b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:41.680800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eed7b0-81e3-4968-8884-fb89438a2b59 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:41.693115 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4345/8693] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:03:41.697510 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103a829-e995-4548-9908-d76cace59916 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:41.708635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103a829-e995-4548-9908-d76cace59916 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:41.714423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f0752-0e32-47e6-8b74-1ce919de8f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:41.715145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f0752-0e32-47e6-8b74-1ce919de8f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:41.715469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f0752-0e32-47e6-8b74-1ce919de8f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:41.715794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f0752-0e32-47e6-8b74-1ce919de8f52 admin admin] PATH_INFO: `/v3/projects/65d725d9f6b34e1a81012fd2e6e440da/users/81599b9943af418f98ebb1926f1ca10d/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:41.736247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f0752-0e32-47e6-8b74-1ce919de8f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d725d9f6b34e1a81012fd2e6e440da, user_id=81599b9943af418f98ebb1926f1ca10d, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:41.740862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f0752-0e32-47e6-8b74-1ce919de8f52 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:41.758590 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4349/8694] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:03:41 2022] PUT /identity/v3/projects/65d725d9f6b34e1a81012fd2e6e440da/users/81599b9943af418f98ebb1926f1ca10d/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:03:41.764006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eed7b0-81e3-4968-8884-fb89438a2b59 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:41.775683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eed7b0-81e3-4968-8884-fb89438a2b59 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:41.850800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1379dc-de4e-4ba6-a581-43d21e85233b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:41.851499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1379dc-de4e-4ba6-a581-43d21e85233b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:41.851887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1379dc-de4e-4ba6-a581-43d21e85233b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:41.852162 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1379dc-de4e-4ba6-a581-43d21e85233b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:41.852920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1379dc-de4e-4ba6-a581-43d21e85233b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:41.855050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1379dc-de4e-4ba6-a581-43d21e85233b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:41.877312 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4346/8695] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:03:41.881224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f0752-0e32-47e6-8b74-1ce919de8f52 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:41.894073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f0752-0e32-47e6-8b74-1ce919de8f52 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:41.899740 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a3947-af68-4de4-b80a-004bca86f0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:41.900458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a3947-af68-4de4-b80a-004bca86f0b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:41.900733 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a3947-af68-4de4-b80a-004bca86f0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:41.901005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a3947-af68-4de4-b80a-004bca86f0b6 admin admin] PATH_INFO: `/v3/projects/65d725d9f6b34e1a81012fd2e6e440da/users/81599b9943af418f98ebb1926f1ca10d/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:41.903129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a3947-af68-4de4-b80a-004bca86f0b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d725d9f6b34e1a81012fd2e6e440da, user_id=81599b9943af418f98ebb1926f1ca10d, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:41.906629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a3947-af68-4de4-b80a-004bca86f0b6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:41.923406 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4350/8696] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:03:41 2022] PUT /identity/v3/projects/65d725d9f6b34e1a81012fd2e6e440da/users/81599b9943af418f98ebb1926f1ca10d/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:03:47.441467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71568fb-3aa8-4366-96d5-0168ffc83d62 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:47.442512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71568fb-3aa8-4366-96d5-0168ffc83d62 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:47.443017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71568fb-3aa8-4366-96d5-0168ffc83d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:47.485650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b71568fb-3aa8-4366-96d5-0168ffc83d62 None None] MFA Rules not processed for user `81599b9943af418f98ebb1926f1ca10d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:47.486914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b71568fb-3aa8-4366-96d5-0168ffc83d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:47.539399 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:47.588920 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4347/8697] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:03:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:47.607554 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a3947-af68-4de4-b80a-004bca86f0b6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:47.609662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-534a3947-af68-4de4-b80a-004bca86f0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:47.730531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a3947-af68-4de4-b80a-004bca86f0b6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:47.739674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8bd19-e8c5-4a4c-abd1-b52b37e04757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:47.741060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8bd19-e8c5-4a4c-abd1-b52b37e04757 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:47.741649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8bd19-e8c5-4a4c-abd1-b52b37e04757 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:47.742282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8bd19-e8c5-4a4c-abd1-b52b37e04757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:47.837816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8bd19-e8c5-4a4c-abd1-b52b37e04757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:47.841019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8bd19-e8c5-4a4c-abd1-b52b37e04757 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:47.848995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:47.863134 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4351/8698] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:49.347728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8864b30-fa7e-4d8c-9ba5-d2b6bb35556c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:49.348564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8864b30-fa7e-4d8c-9ba5-d2b6bb35556c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:49.349049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8864b30-fa7e-4d8c-9ba5-d2b6bb35556c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:49.375196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c8864b30-fa7e-4d8c-9ba5-d2b6bb35556c None None] MFA Rules not processed for user `87bbe66c85d94dae93e9f5422346c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:49.377010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c8864b30-fa7e-4d8c-9ba5-d2b6bb35556c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:49.386455 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4348/8699] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:03:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:03:57.862398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:59.369380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=13 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:04.725132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8bd19-e8c5-4a4c-abd1-b52b37e04757 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:04.726812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4eb8bd19-e8c5-4a4c-abd1-b52b37e04757 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:04.813611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8bd19-e8c5-4a4c-abd1-b52b37e04757 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:04.817777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844aa19-9829-46f0-a8b4-08318e922c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:04.818437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844aa19-9829-46f0-a8b4-08318e922c2c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:04.818781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844aa19-9829-46f0-a8b4-08318e922c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:04.819047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844aa19-9829-46f0-a8b4-08318e922c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:04.829527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844aa19-9829-46f0-a8b4-08318e922c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:04.830977 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844aa19-9829-46f0-a8b4-08318e922c2c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:04.842166 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4352/8700] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:14.837116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=26 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:17.137141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83fa25-11fb-49a7-85ed-3b6f526eec55 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:17.137727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83fa25-11fb-49a7-85ed-3b6f526eec55 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:17.137727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83fa25-11fb-49a7-85ed-3b6f526eec55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:17.158511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0c83fa25-11fb-49a7-85ed-3b6f526eec55 None None] MFA Rules not processed for user `2aa7d94090504881bb0ffd560ba90378`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:17.159806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0c83fa25-11fb-49a7-85ed-3b6f526eec55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:17.230957 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4349/8701] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:04:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:04:17.831014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844aa19-9829-46f0-a8b4-08318e922c2c service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:17.833044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9844aa19-9829-46f0-a8b4-08318e922c2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:17.914143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844aa19-9829-46f0-a8b4-08318e922c2c service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:17.918754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cedd59-f120-4189-86a6-b3bc712b3e26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:17.919543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cedd59-f120-4189-86a6-b3bc712b3e26 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:17.919952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cedd59-f120-4189-86a6-b3bc712b3e26 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:17.920358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cedd59-f120-4189-86a6-b3bc712b3e26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:17.922358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-64cedd59-f120-4189-86a6-b3bc712b3e26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:17.942016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cedd59-f120-4189-86a6-b3bc712b3e26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:17.944865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cedd59-f120-4189-86a6-b3bc712b3e26 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:17.960907 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4353/8702] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:18.083725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83fa25-11fb-49a7-85ed-3b6f526eec55 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:18.087384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0c83fa25-11fb-49a7-85ed-3b6f526eec55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:18.104808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83fa25-11fb-49a7-85ed-3b6f526eec55 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:18.111706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b6a5a-c983-4e99-b57b-f954bb206f10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:18.112965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b6a5a-c983-4e99-b57b-f954bb206f10 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:18.113352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b6a5a-c983-4e99-b57b-f954bb206f10 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:18.113711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b6a5a-c983-4e99-b57b-f954bb206f10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:18.115933 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-976b6a5a-c983-4e99-b57b-f954bb206f10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:18.134595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b6a5a-c983-4e99-b57b-f954bb206f10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:18.136085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b6a5a-c983-4e99-b57b-f954bb206f10 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:18.151432 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4350/8703] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:27.952773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=26 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:28.142891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=31 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:19.642587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afd893-b18d-4c86-a55b-5467192e5ba1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:19.643446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afd893-b18d-4c86-a55b-5467192e5ba1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:19.643446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afd893-b18d-4c86-a55b-5467192e5ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:19.668157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b3afd893-b18d-4c86-a55b-5467192e5ba1 None None] MFA Rules not processed for user `2aa7d94090504881bb0ffd560ba90378`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:19.669387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b3afd893-b18d-4c86-a55b-5467192e5ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:19.677310 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4354/8704] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:05:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:22.361121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b6a5a-c983-4e99-b57b-f954bb206f10 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:22.373537 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b6a5a-c983-4e99-b57b-f954bb206f10 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:22.377519 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f8de8-27e8-4343-a9a6-bd7dff026771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:22.378145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f8de8-27e8-4343-a9a6-bd7dff026771 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:22.378429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f8de8-27e8-4343-a9a6-bd7dff026771 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:22.378707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f8de8-27e8-4343-a9a6-bd7dff026771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:22.380629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-855f8de8-27e8-4343-a9a6-bd7dff026771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:22.398255 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f8de8-27e8-4343-a9a6-bd7dff026771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:22.399979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f8de8-27e8-4343-a9a6-bd7dff026771 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:22.413179 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4351/8705] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:05:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:05:29.662545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:32.405373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:37.933416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afd893-b18d-4c86-a55b-5467192e5ba1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:37.946838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afd893-b18d-4c86-a55b-5467192e5ba1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:37.950528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851df2f7-8b35-4f9b-a769-ea96c90e2675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:37.951154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851df2f7-8b35-4f9b-a769-ea96c90e2675 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:37.951483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851df2f7-8b35-4f9b-a769-ea96c90e2675 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:37.951753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851df2f7-8b35-4f9b-a769-ea96c90e2675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:37.953652 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-851df2f7-8b35-4f9b-a769-ea96c90e2675 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:37.966657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851df2f7-8b35-4f9b-a769-ea96c90e2675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:37.968198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851df2f7-8b35-4f9b-a769-ea96c90e2675 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:37.980008 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4355/8706] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:05:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:05:41.891384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a3a60-b6d9-4143-a8e9-cac06fbd6f26 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:41.892030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a3a60-b6d9-4143-a8e9-cac06fbd6f26 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:41.892882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a3a60-b6d9-4143-a8e9-cac06fbd6f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:41.970070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-497a3a60-b6d9-4143-a8e9-cac06fbd6f26 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:41.971372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-497a3a60-b6d9-4143-a8e9-cac06fbd6f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:42.057136 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4352/8707] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 19:05:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:05:42.116573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851df2f7-8b35-4f9b-a769-ea96c90e2675 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:42.118042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-851df2f7-8b35-4f9b-a769-ea96c90e2675 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:42.224820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851df2f7-8b35-4f9b-a769-ea96c90e2675 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:42.230936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6f001-d091-4bfc-bf4f-9f08abc2e147 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:42.231674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6f001-d091-4bfc-bf4f-9f08abc2e147 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:42.231982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6f001-d091-4bfc-bf4f-9f08abc2e147 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:42.232226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6f001-d091-4bfc-bf4f-9f08abc2e147 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:42.241721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6f001-d091-4bfc-bf4f-9f08abc2e147 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:42.243428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6f001-d091-4bfc-bf4f-9f08abc2e147 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:42.252489 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4356/8708] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 19:05:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:05:43.598854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51f7d4-3f36-4fc4-99e3-d82d2abd6599 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:43.599484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51f7d4-3f36-4fc4-99e3-d82d2abd6599 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:43.599484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51f7d4-3f36-4fc4-99e3-d82d2abd6599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:43.623055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bd51f7d4-3f36-4fc4-99e3-d82d2abd6599 None None] MFA Rules not processed for user `2aa7d94090504881bb0ffd560ba90378`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:43.624376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bd51f7d4-3f36-4fc4-99e3-d82d2abd6599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:43.633985 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4353/8709] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:05:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:52.248981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=47 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:53.616683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=47 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:13.401388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6f001-d091-4bfc-bf4f-9f08abc2e147 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:13.428328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6f001-d091-4bfc-bf4f-9f08abc2e147 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:13.435626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c547232-c64c-41ff-999c-ddc44fc4861d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:13.436354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c547232-c64c-41ff-999c-ddc44fc4861d service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:13.436753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c547232-c64c-41ff-999c-ddc44fc4861d service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:13.437139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c547232-c64c-41ff-999c-ddc44fc4861d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:13.439343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7c547232-c64c-41ff-999c-ddc44fc4861d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:13.460509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c547232-c64c-41ff-999c-ddc44fc4861d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:13.462345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c547232-c64c-41ff-999c-ddc44fc4861d service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:13.490349 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4357/8710] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:14.934956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51f7d4-3f36-4fc4-99e3-d82d2abd6599 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:14.952023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51f7d4-3f36-4fc4-99e3-d82d2abd6599 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:14.956887 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a829907-9109-4ed7-a0a5-0245db9dbfe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:14.957549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a829907-9109-4ed7-a0a5-0245db9dbfe0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:14.957949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a829907-9109-4ed7-a0a5-0245db9dbfe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:14.958192 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a829907-9109-4ed7-a0a5-0245db9dbfe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:14.960724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3a829907-9109-4ed7-a0a5-0245db9dbfe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:14.985029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a829907-9109-4ed7-a0a5-0245db9dbfe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:14.988340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a829907-9109-4ed7-a0a5-0245db9dbfe0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:15.009439 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4354/8711] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:06:22.180961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c547232-c64c-41ff-999c-ddc44fc4861d service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:22.182988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7c547232-c64c-41ff-999c-ddc44fc4861d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:22.327600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c547232-c64c-41ff-999c-ddc44fc4861d service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:22.332787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784c8de-6af4-4f8c-acf6-ae7f476e96a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:22.333447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784c8de-6af4-4f8c-acf6-ae7f476e96a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:22.333725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784c8de-6af4-4f8c-acf6-ae7f476e96a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:22.333999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784c8de-6af4-4f8c-acf6-ae7f476e96a5 admin admin] PATH_INFO: `/v3/users/7afaa3dd70cd4a64a2b3c51e8a3b9582` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:22.335220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784c8de-6af4-4f8c-acf6-ae7f476e96a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7afaa3dd70cd4a64a2b3c51e8a3b9582)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:22.337233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784c8de-6af4-4f8c-acf6-ae7f476e96a5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:22.402589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d784c8de-6af4-4f8c-acf6-ae7f476e96a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7afaa3dd70cd4a64a2b3c51e8a3b9582'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:22.415637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d784c8de-6af4-4f8c-acf6-ae7f476e96a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7afaa3dd70cd4a64a2b3c51e8a3b9582'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:22.416411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d784c8de-6af4-4f8c-acf6-ae7f476e96a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7afaa3dd70cd4a64a2b3c51e8a3b9582'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:22.417282 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d784c8de-6af4-4f8c-acf6-ae7f476e96a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7afaa3dd70cd4a64a2b3c51e8a3b9582'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:22.426368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d784c8de-6af4-4f8c-acf6-ae7f476e96a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7afaa3dd70cd4a64a2b3c51e8a3b9582'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:22.449158 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4358/8712] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:06:22 2022] DELETE /identity/v3/users/7afaa3dd70cd4a64a2b3c51e8a3b9582 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:22.456407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580955c4-e5da-4f42-97a4-8d65a3f4f7c0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:22.456407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580955c4-e5da-4f42-97a4-8d65a3f4f7c0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:22.456407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580955c4-e5da-4f42-97a4-8d65a3f4f7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:22.481174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-580955c4-e5da-4f42-97a4-8d65a3f4f7c0 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:22.482356 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-580955c4-e5da-4f42-97a4-8d65a3f4f7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:22.607410 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4355/8713] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:22.621229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784c8de-6af4-4f8c-acf6-ae7f476e96a5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:22.623800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d784c8de-6af4-4f8c-acf6-ae7f476e96a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:22.709495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784c8de-6af4-4f8c-acf6-ae7f476e96a5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:22.713284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024d065-2c15-4384-a713-449f40a3c3e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:22.714168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024d065-2c15-4384-a713-449f40a3c3e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:22.714782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024d065-2c15-4384-a713-449f40a3c3e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:22.715190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024d065-2c15-4384-a713-449f40a3c3e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:22.731503 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024d065-2c15-4384-a713-449f40a3c3e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:22.733351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024d065-2c15-4384-a713-449f40a3c3e2 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:22.745772 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4359/8714] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:23.037303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580955c4-e5da-4f42-97a4-8d65a3f4f7c0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:23.040259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-580955c4-e5da-4f42-97a4-8d65a3f4f7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:23.067617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580955c4-e5da-4f42-97a4-8d65a3f4f7c0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:23.078387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b5752-9e07-4b87-b0a0-266e9d6fd775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:23.079622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b5752-9e07-4b87-b0a0-266e9d6fd775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:23.080094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b5752-9e07-4b87-b0a0-266e9d6fd775 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:23.080548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b5752-9e07-4b87-b0a0-266e9d6fd775 admin admin] PATH_INFO: `/v3/projects/96cc707a4a6044f99f9264160618b739` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:23.083845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b5752-9e07-4b87-b0a0-266e9d6fd775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96cc707a4a6044f99f9264160618b739)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:23.085711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b5752-9e07-4b87-b0a0-266e9d6fd775 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:23.166894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-057b5752-9e07-4b87-b0a0-266e9d6fd775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96cc707a4a6044f99f9264160618b739', 'request_id': 'req-057b5752-9e07-4b87-b0a0-266e9d6fd775'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:23.178467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-057b5752-9e07-4b87-b0a0-266e9d6fd775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96cc707a4a6044f99f9264160618b739', 'request_id': 'req-057b5752-9e07-4b87-b0a0-266e9d6fd775'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:23.187047 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-057b5752-9e07-4b87-b0a0-266e9d6fd775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96cc707a4a6044f99f9264160618b739', 'request_id': 'req-057b5752-9e07-4b87-b0a0-266e9d6fd775'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:23.209706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-057b5752-9e07-4b87-b0a0-266e9d6fd775 admin admin] The token cache is being invalidate because project 96cc707a4a6044f99f9264160618b739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:23.210207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-057b5752-9e07-4b87-b0a0-266e9d6fd775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:23.211016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-057b5752-9e07-4b87-b0a0-266e9d6fd775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:23.212926 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4356/8715] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:23 2022] DELETE /identity/v3/projects/96cc707a4a6044f99f9264160618b739 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:23.217520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024d065-2c15-4384-a713-449f40a3c3e2 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:23.230734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024d065-2c15-4384-a713-449f40a3c3e2 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:23.236672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:23.305147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718425b6-fe50-48b3-a7f2-67b1022ab521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:23.305795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718425b6-fe50-48b3-a7f2-67b1022ab521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:23.306232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718425b6-fe50-48b3-a7f2-67b1022ab521 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:23.306664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718425b6-fe50-48b3-a7f2-67b1022ab521 admin admin] PATH_INFO: `/v3/users/f416e77bae98497282e4a561bcc64eef` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:23.308121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718425b6-fe50-48b3-a7f2-67b1022ab521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f416e77bae98497282e4a561bcc64eef)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:23.311147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718425b6-fe50-48b3-a7f2-67b1022ab521 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:23.384648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-718425b6-fe50-48b3-a7f2-67b1022ab521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f416e77bae98497282e4a561bcc64eef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:23.412882 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-718425b6-fe50-48b3-a7f2-67b1022ab521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f416e77bae98497282e4a561bcc64eef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:23.413672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-718425b6-fe50-48b3-a7f2-67b1022ab521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f416e77bae98497282e4a561bcc64eef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:23.414278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-718425b6-fe50-48b3-a7f2-67b1022ab521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f416e77bae98497282e4a561bcc64eef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:23.425827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-718425b6-fe50-48b3-a7f2-67b1022ab521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f416e77bae98497282e4a561bcc64eef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:23.441033 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4360/8716] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:06:23 2022] DELETE /identity/v3/users/f416e77bae98497282e4a561bcc64eef => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:06:23.671486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b5752-9e07-4b87-b0a0-266e9d6fd775 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:23.673559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-057b5752-9e07-4b87-b0a0-266e9d6fd775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:23.693422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b5752-9e07-4b87-b0a0-266e9d6fd775 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:23.773798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bda58-14dd-4536-b837-64a839736170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:23.774553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bda58-14dd-4536-b837-64a839736170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:23.774863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bda58-14dd-4536-b837-64a839736170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:23.775133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bda58-14dd-4536-b837-64a839736170 admin admin] PATH_INFO: `/v3/projects/876c21d6965e41ccbabd230baee3f1dc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:23.776582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bda58-14dd-4536-b837-64a839736170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=876c21d6965e41ccbabd230baee3f1dc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:23.778717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bda58-14dd-4536-b837-64a839736170 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:23.799213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:23.861556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc5bda58-14dd-4536-b837-64a839736170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '876c21d6965e41ccbabd230baee3f1dc', 'request_id': 'req-cc5bda58-14dd-4536-b837-64a839736170'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:23.871786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc5bda58-14dd-4536-b837-64a839736170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '876c21d6965e41ccbabd230baee3f1dc', 'request_id': 'req-cc5bda58-14dd-4536-b837-64a839736170'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:23.879438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc5bda58-14dd-4536-b837-64a839736170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '876c21d6965e41ccbabd230baee3f1dc', 'request_id': 'req-cc5bda58-14dd-4536-b837-64a839736170'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:23.900937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc5bda58-14dd-4536-b837-64a839736170 admin admin] The token cache is being invalidate because project 876c21d6965e41ccbabd230baee3f1dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:23.902477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc5bda58-14dd-4536-b837-64a839736170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:23.903753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc5bda58-14dd-4536-b837-64a839736170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:23.906422 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4357/8717] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:23 2022] DELETE /identity/v3/projects/876c21d6965e41ccbabd230baee3f1dc => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:06:23.913072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad699a-317a-489f-90d5-8eb7dbf6d291 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:23.913682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad699a-317a-489f-90d5-8eb7dbf6d291 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:23.914124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad699a-317a-489f-90d5-8eb7dbf6d291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:23.939516 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-95ad699a-317a-489f-90d5-8eb7dbf6d291 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:23.940955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-95ad699a-317a-489f-90d5-8eb7dbf6d291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:24.033225 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4361/8718] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:24.044612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8e7f3-f01e-4910-a1b0-f09424a4c83f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:24.045223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8e7f3-f01e-4910-a1b0-f09424a4c83f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:24.046800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8e7f3-f01e-4910-a1b0-f09424a4c83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:24.075369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3df8e7f3-f01e-4910-a1b0-f09424a4c83f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:24.077539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3df8e7f3-f01e-4910-a1b0-f09424a4c83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:24.093813 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4358/8719] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:24.102726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad699a-317a-489f-90d5-8eb7dbf6d291 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:24.123907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad699a-317a-489f-90d5-8eb7dbf6d291 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:24.132323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a92520-a283-44e7-83e5-844642024e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:24.133188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a92520-a283-44e7-83e5-844642024e7a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:24.133500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a92520-a283-44e7-83e5-844642024e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:24.133753 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a92520-a283-44e7-83e5-844642024e7a admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:24.134599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a92520-a283-44e7-83e5-844642024e7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:06:24.135059 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a92520-a283-44e7-83e5-844642024e7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:24.137635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a92520-a283-44e7-83e5-844642024e7a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:24.159333 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4362/8720] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:06:24.165300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8e7f3-f01e-4910-a1b0-f09424a4c83f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:24.190613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8e7f3-f01e-4910-a1b0-f09424a4c83f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:24.198860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da65ad-67cf-45cf-8fef-bcd16aab6593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:24.199851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da65ad-67cf-45cf-8fef-bcd16aab6593 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:24.200280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da65ad-67cf-45cf-8fef-bcd16aab6593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:24.203419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da65ad-67cf-45cf-8fef-bcd16aab6593 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:24.204156 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da65ad-67cf-45cf-8fef-bcd16aab6593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:24.206252 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da65ad-67cf-45cf-8fef-bcd16aab6593 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:24.251326 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4359/8721] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:06:24 2022] POST /identity/v3/projects => generated 387 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:24.256397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a92520-a283-44e7-83e5-844642024e7a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:24.271735 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a92520-a283-44e7-83e5-844642024e7a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:24.291149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:24.383022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9430858-bff2-43bd-af74-55a729065f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:24.384654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9430858-bff2-43bd-af74-55a729065f2d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:24.385323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9430858-bff2-43bd-af74-55a729065f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:24.385684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9430858-bff2-43bd-af74-55a729065f2d admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:24.386798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9430858-bff2-43bd-af74-55a729065f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:24.390218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9430858-bff2-43bd-af74-55a729065f2d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:24.422243 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4363/8722] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:06:24 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:24.427776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da65ad-67cf-45cf-8fef-bcd16aab6593 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:24.446171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da65ad-67cf-45cf-8fef-bcd16aab6593 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:24.453717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec443e8-8278-4e98-a6d5-c01cc2a4c85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:24.454676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec443e8-8278-4e98-a6d5-c01cc2a4c85b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:24.457440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec443e8-8278-4e98-a6d5-c01cc2a4c85b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:24.457440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec443e8-8278-4e98-a6d5-c01cc2a4c85b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:24.457440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec443e8-8278-4e98-a6d5-c01cc2a4c85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:24.458956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec443e8-8278-4e98-a6d5-c01cc2a4c85b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:24.482298 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4360/8723] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:24.483757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9430858-bff2-43bd-af74-55a729065f2d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:24.497220 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9430858-bff2-43bd-af74-55a729065f2d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:24.504305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547a401-f288-401b-8d31-f0452f454a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:24.505421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547a401-f288-401b-8d31-f0452f454a9c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:24.505820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547a401-f288-401b-8d31-f0452f454a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:24.506288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547a401-f288-401b-8d31-f0452f454a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:24.507332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547a401-f288-401b-8d31-f0452f454a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:24.509206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547a401-f288-401b-8d31-f0452f454a9c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:24.530472 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4364/8724] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:24.533095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec443e8-8278-4e98-a6d5-c01cc2a4c85b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:24.550607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec443e8-8278-4e98-a6d5-c01cc2a4c85b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:24.562059 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52440059-843a-4859-9b81-82f13c9b9075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:24.566299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52440059-843a-4859-9b81-82f13c9b9075 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:24.566621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52440059-843a-4859-9b81-82f13c9b9075 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:24.567176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52440059-843a-4859-9b81-82f13c9b9075 admin admin] PATH_INFO: `/v3/projects/be8539ca78a449b3a4800e68747a495e/users/27eb46c81b9443d5955a2da796382e49/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:24.596862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52440059-843a-4859-9b81-82f13c9b9075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8539ca78a449b3a4800e68747a495e, user_id=27eb46c81b9443d5955a2da796382e49, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:24.600675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52440059-843a-4859-9b81-82f13c9b9075 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:24.624974 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4361/8725] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:24 2022] PUT /identity/v3/projects/be8539ca78a449b3a4800e68747a495e/users/27eb46c81b9443d5955a2da796382e49/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:24.771955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ca167-6093-4214-a73e-5d04df72e269 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:24.772517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ca167-6093-4214-a73e-5d04df72e269 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:24.772517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ca167-6093-4214-a73e-5d04df72e269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:24.806343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d46ca167-6093-4214-a73e-5d04df72e269 None None] MFA Rules not processed for user `27eb46c81b9443d5955a2da796382e49`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:24.807757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d46ca167-6093-4214-a73e-5d04df72e269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:24.912875 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4365/8726] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:06:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:24.918286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52440059-843a-4859-9b81-82f13c9b9075 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:25.074380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52440059-843a-4859-9b81-82f13c9b9075 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:25.081440 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f9618-4aa3-494e-95e1-269f64fb336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:25.082748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f9618-4aa3-494e-95e1-269f64fb336d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:25.083139 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f9618-4aa3-494e-95e1-269f64fb336d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:25.083573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f9618-4aa3-494e-95e1-269f64fb336d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:25.084566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f9618-4aa3-494e-95e1-269f64fb336d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:25.087045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f9618-4aa3-494e-95e1-269f64fb336d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:25.127903 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4362/8727] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:06:24 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:25.132813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ca167-6093-4214-a73e-5d04df72e269 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:25.145197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ca167-6093-4214-a73e-5d04df72e269 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:25.225100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106caf8-7f91-4b36-84aa-a9dd913b1316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:25.225720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106caf8-7f91-4b36-84aa-a9dd913b1316 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:25.226008 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106caf8-7f91-4b36-84aa-a9dd913b1316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:25.226370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106caf8-7f91-4b36-84aa-a9dd913b1316 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:25.227427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106caf8-7f91-4b36-84aa-a9dd913b1316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:25.229676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106caf8-7f91-4b36-84aa-a9dd913b1316 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:25.263591 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4366/8728] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:06:25 2022] POST /identity/v3/users => generated 301 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:25.266742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f9618-4aa3-494e-95e1-269f64fb336d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:25.282764 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f9618-4aa3-494e-95e1-269f64fb336d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:25.291549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba811d-63ff-4398-8bbd-36bd3111c1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:25.292890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba811d-63ff-4398-8bbd-36bd3111c1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:25.293561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba811d-63ff-4398-8bbd-36bd3111c1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:25.294160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba811d-63ff-4398-8bbd-36bd3111c1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:25.295637 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba811d-63ff-4398-8bbd-36bd3111c1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:25.298915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba811d-63ff-4398-8bbd-36bd3111c1b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:25.321330 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4363/8729] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:25.322660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106caf8-7f91-4b36-84aa-a9dd913b1316 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:25.336165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106caf8-7f91-4b36-84aa-a9dd913b1316 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:25.344058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fde0f7-0c23-4827-8c99-740fab14df97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:25.345253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fde0f7-0c23-4827-8c99-740fab14df97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:25.345682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fde0f7-0c23-4827-8c99-740fab14df97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:25.346141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fde0f7-0c23-4827-8c99-740fab14df97 admin admin] PATH_INFO: `/v3/projects/3298ce79ea0242ac8451ded6d3f9de2b/users/e29d37fda0804a2eae49cd48f5b31294/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:25.361784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:25.369511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fde0f7-0c23-4827-8c99-740fab14df97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3298ce79ea0242ac8451ded6d3f9de2b, user_id=e29d37fda0804a2eae49cd48f5b31294, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:25.374872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fde0f7-0c23-4827-8c99-740fab14df97 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:25.415646 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4367/8730] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:25 2022] PUT /identity/v3/projects/3298ce79ea0242ac8451ded6d3f9de2b/users/e29d37fda0804a2eae49cd48f5b31294/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:25.422538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adb3d2-af40-4474-8d24-18f3726e2b7e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:25.426400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adb3d2-af40-4474-8d24-18f3726e2b7e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:25.426400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adb3d2-af40-4474-8d24-18f3726e2b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:25.470652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:25.499217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-71adb3d2-af40-4474-8d24-18f3726e2b7e None None] MFA Rules not processed for user `e29d37fda0804a2eae49cd48f5b31294`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:25.502646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-71adb3d2-af40-4474-8d24-18f3726e2b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:25.673503 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4364/8731] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:06:25 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:25.717291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fde0f7-0c23-4827-8c99-740fab14df97 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:25.719311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-94fde0f7-0c23-4827-8c99-740fab14df97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:25.839268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fde0f7-0c23-4827-8c99-740fab14df97 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:25.849434 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d7585-4d44-4eef-b79f-7f82b8c0c22d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:25.851040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d7585-4d44-4eef-b79f-7f82b8c0c22d service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:25.851382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d7585-4d44-4eef-b79f-7f82b8c0c22d service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:25.851938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d7585-4d44-4eef-b79f-7f82b8c0c22d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:25.867192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d7585-4d44-4eef-b79f-7f82b8c0c22d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:25.869204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d7585-4d44-4eef-b79f-7f82b8c0c22d service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:25.880806 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4368/8732] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 19:06:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:06:26.780332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adb3d2-af40-4474-8d24-18f3726e2b7e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:26.853575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adb3d2-af40-4474-8d24-18f3726e2b7e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:26.858514 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706304b-2cac-48ca-ad7d-46b421fbff4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:26.859433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706304b-2cac-48ca-ad7d-46b421fbff4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:26.859803 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706304b-2cac-48ca-ad7d-46b421fbff4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:26.860166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706304b-2cac-48ca-ad7d-46b421fbff4c admin admin] PATH_INFO: `/v3/users/27eb46c81b9443d5955a2da796382e49` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:26.861481 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706304b-2cac-48ca-ad7d-46b421fbff4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=27eb46c81b9443d5955a2da796382e49)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:26.863701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706304b-2cac-48ca-ad7d-46b421fbff4c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:26.940052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7706304b-2cac-48ca-ad7d-46b421fbff4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27eb46c81b9443d5955a2da796382e49'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:26.940781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7706304b-2cac-48ca-ad7d-46b421fbff4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27eb46c81b9443d5955a2da796382e49'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:26.949001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7706304b-2cac-48ca-ad7d-46b421fbff4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27eb46c81b9443d5955a2da796382e49'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:26.960949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7706304b-2cac-48ca-ad7d-46b421fbff4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27eb46c81b9443d5955a2da796382e49'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:26.981985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7706304b-2cac-48ca-ad7d-46b421fbff4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27eb46c81b9443d5955a2da796382e49'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:26.988495 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4365/8733] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:06:26 2022] DELETE /identity/v3/users/27eb46c81b9443d5955a2da796382e49 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:26.994224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e7419-c298-4d5f-9e0f-d0e51ef6cd82 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:26.994755 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e7419-c298-4d5f-9e0f-d0e51ef6cd82 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:26.995131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e7419-c298-4d5f-9e0f-d0e51ef6cd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:27.024453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3a7e7419-c298-4d5f-9e0f-d0e51ef6cd82 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:27.026254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a7e7419-c298-4d5f-9e0f-d0e51ef6cd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:27.113358 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4369/8734] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:06:27.126296 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706304b-2cac-48ca-ad7d-46b421fbff4c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:27.128053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7706304b-2cac-48ca-ad7d-46b421fbff4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:27.151730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:27.194669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706304b-2cac-48ca-ad7d-46b421fbff4c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:27.198649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf1495-46f8-4975-8ca0-1542c1d9fdf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:27.199290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf1495-46f8-4975-8ca0-1542c1d9fdf9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:27.199581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf1495-46f8-4975-8ca0-1542c1d9fdf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:27.199857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf1495-46f8-4975-8ca0-1542c1d9fdf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:27.209703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf1495-46f8-4975-8ca0-1542c1d9fdf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:27.211172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf1495-46f8-4975-8ca0-1542c1d9fdf9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:27.222060 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4366/8735] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:27.530561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e7419-c298-4d5f-9e0f-d0e51ef6cd82 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:27.532113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a7e7419-c298-4d5f-9e0f-d0e51ef6cd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:27.552114 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e7419-c298-4d5f-9e0f-d0e51ef6cd82 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:27.559091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75400bbc-b85c-4096-ba0d-b92b92936cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:27.560109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75400bbc-b85c-4096-ba0d-b92b92936cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:27.573660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75400bbc-b85c-4096-ba0d-b92b92936cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:27.574378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75400bbc-b85c-4096-ba0d-b92b92936cb3 admin admin] PATH_INFO: `/v3/projects/be8539ca78a449b3a4800e68747a495e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:27.579168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75400bbc-b85c-4096-ba0d-b92b92936cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8539ca78a449b3a4800e68747a495e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:27.582485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75400bbc-b85c-4096-ba0d-b92b92936cb3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:27.648565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-75400bbc-b85c-4096-ba0d-b92b92936cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8539ca78a449b3a4800e68747a495e', 'request_id': 'req-75400bbc-b85c-4096-ba0d-b92b92936cb3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:27.657464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-75400bbc-b85c-4096-ba0d-b92b92936cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8539ca78a449b3a4800e68747a495e', 'request_id': 'req-75400bbc-b85c-4096-ba0d-b92b92936cb3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:27.665334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-75400bbc-b85c-4096-ba0d-b92b92936cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8539ca78a449b3a4800e68747a495e', 'request_id': 'req-75400bbc-b85c-4096-ba0d-b92b92936cb3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:27.691380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-75400bbc-b85c-4096-ba0d-b92b92936cb3 admin admin] The token cache is being invalidate because project be8539ca78a449b3a4800e68747a495e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:27.691380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-75400bbc-b85c-4096-ba0d-b92b92936cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:27.691380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-75400bbc-b85c-4096-ba0d-b92b92936cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:27.691380 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4370/8736] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:27 2022] DELETE /identity/v3/projects/be8539ca78a449b3a4800e68747a495e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:27.691765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf1495-46f8-4975-8ca0-1542c1d9fdf9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:27.701946 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf1495-46f8-4975-8ca0-1542c1d9fdf9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:27.766470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e469e-4e1a-4418-93af-122e8f342a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:27.767307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e469e-4e1a-4418-93af-122e8f342a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:27.767697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e469e-4e1a-4418-93af-122e8f342a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:27.768131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e469e-4e1a-4418-93af-122e8f342a68 admin admin] PATH_INFO: `/v3/users/e29d37fda0804a2eae49cd48f5b31294` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:27.769350 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e469e-4e1a-4418-93af-122e8f342a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e29d37fda0804a2eae49cd48f5b31294)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:27.771339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e469e-4e1a-4418-93af-122e8f342a68 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:27.829470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-876e469e-4e1a-4418-93af-122e8f342a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e29d37fda0804a2eae49cd48f5b31294'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:27.830331 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-876e469e-4e1a-4418-93af-122e8f342a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e29d37fda0804a2eae49cd48f5b31294'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:27.838058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-876e469e-4e1a-4418-93af-122e8f342a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e29d37fda0804a2eae49cd48f5b31294'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:27.848018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-876e469e-4e1a-4418-93af-122e8f342a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e29d37fda0804a2eae49cd48f5b31294'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:27.873629 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-876e469e-4e1a-4418-93af-122e8f342a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e29d37fda0804a2eae49cd48f5b31294'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:27.879975 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4367/8737] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:06:27 2022] DELETE /identity/v3/users/e29d37fda0804a2eae49cd48f5b31294 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:28.621627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75400bbc-b85c-4096-ba0d-b92b92936cb3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:28.623800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-75400bbc-b85c-4096-ba0d-b92b92936cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:28.639823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:28.648273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75400bbc-b85c-4096-ba0d-b92b92936cb3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:28.744879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:28.745915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:28.746399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:28.746944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8 admin admin] PATH_INFO: `/v3/projects/3298ce79ea0242ac8451ded6d3f9de2b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:28.748625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3298ce79ea0242ac8451ded6d3f9de2b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:28.751053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:28.835587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3298ce79ea0242ac8451ded6d3f9de2b', 'request_id': 'req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:28.848075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3298ce79ea0242ac8451ded6d3f9de2b', 'request_id': 'req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:28.859079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3298ce79ea0242ac8451ded6d3f9de2b', 'request_id': 'req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:28.903674 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8 admin admin] The token cache is being invalidate because project 3298ce79ea0242ac8451ded6d3f9de2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:28.904164 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:28.907606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:28.924168 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4371/8738] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:28 2022] DELETE /identity/v3/projects/3298ce79ea0242ac8451ded6d3f9de2b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:37.876571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=70,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:38.879563 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:41.505218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fb489-97e1-4b43-9147-2ca396d39e82 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:41.505972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fb489-97e1-4b43-9147-2ca396d39e82 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:41.506171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fb489-97e1-4b43-9147-2ca396d39e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:41.539603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-306fb489-97e1-4b43-9147-2ca396d39e82 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:41.541579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-306fb489-97e1-4b43-9147-2ca396d39e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:41.604528 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4368/8739] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 19:06:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:41.617807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:41.619642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:41.716270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211b1e3-a3f0-499c-ab0a-79fadf708ee8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:41.724123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e2844-40c1-4eae-be4d-b9a266052613 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:41.724820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e2844-40c1-4eae-be4d-b9a266052613 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:41.726091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e2844-40c1-4eae-be4d-b9a266052613 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:41.726091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e2844-40c1-4eae-be4d-b9a266052613 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:41.739031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e2844-40c1-4eae-be4d-b9a266052613 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:41.741000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e2844-40c1-4eae-be4d-b9a266052613 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:41.751386 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4372/8740] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 19:06:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:06:51.596947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=25 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:51.746702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=32 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:59.656814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa22e8b-31d9-4dbc-908d-0c3903f1cebe None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:59.657418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa22e8b-31d9-4dbc-908d-0c3903f1cebe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:59.657418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa22e8b-31d9-4dbc-908d-0c3903f1cebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:59.677940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3fa22e8b-31d9-4dbc-908d-0c3903f1cebe None None] MFA Rules not processed for user `2aa7d94090504881bb0ffd560ba90378`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:59.679407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3fa22e8b-31d9-4dbc-908d-0c3903f1cebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:59.738814 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4369/8741] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:06:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:00.523364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e2844-40c1-4eae-be4d-b9a266052613 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:00.525000 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8c1e2844-40c1-4eae-be4d-b9a266052613 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:00.607835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e2844-40c1-4eae-be4d-b9a266052613 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:00.613295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d50ea4-161a-4363-b566-9359229dcc62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:00.613954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d50ea4-161a-4363-b566-9359229dcc62 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:00.614235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d50ea4-161a-4363-b566-9359229dcc62 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:00.614512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d50ea4-161a-4363-b566-9359229dcc62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:00.616467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b7d50ea4-161a-4363-b566-9359229dcc62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:00.631915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d50ea4-161a-4363-b566-9359229dcc62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:00.633502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d50ea4-161a-4363-b566-9359229dcc62 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:00.646689 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4373/8742] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:07:09.731640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=25 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:10.639722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=32 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:19.818208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa22e8b-31d9-4dbc-908d-0c3903f1cebe None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:19.819783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3fa22e8b-31d9-4dbc-908d-0c3903f1cebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:19.972509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa22e8b-31d9-4dbc-908d-0c3903f1cebe None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:19.978227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730dfe2c-404d-48fc-b1c1-122ccef4f863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:19.978907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dfe2c-404d-48fc-b1c1-122ccef4f863 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:19.979194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dfe2c-404d-48fc-b1c1-122ccef4f863 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:19.979572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dfe2c-404d-48fc-b1c1-122ccef4f863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:19.981883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-730dfe2c-404d-48fc-b1c1-122ccef4f863 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:19.993793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730dfe2c-404d-48fc-b1c1-122ccef4f863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:19.995706 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730dfe2c-404d-48fc-b1c1-122ccef4f863 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:20.009383 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4370/8743] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:07:21.633639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b71905-54c4-495c-bc14-44a7b5c4696c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:21.634245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b71905-54c4-495c-bc14-44a7b5c4696c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:21.634245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b71905-54c4-495c-bc14-44a7b5c4696c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:21.678620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-46b71905-54c4-495c-bc14-44a7b5c4696c None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:21.679895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-46b71905-54c4-495c-bc14-44a7b5c4696c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:21.750969 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4374/8744] 10.222.0.27 () {58 vars in 1062 bytes} [Sun Aug 28 19:07:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:07:21.757994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730dfe2c-404d-48fc-b1c1-122ccef4f863 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:21.768716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730dfe2c-404d-48fc-b1c1-122ccef4f863 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:21.772819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d630a1e-20b0-437d-8b55-fbc217a865f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:21.773443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d630a1e-20b0-437d-8b55-fbc217a865f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:21.773747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d630a1e-20b0-437d-8b55-fbc217a865f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:21.774017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d630a1e-20b0-437d-8b55-fbc217a865f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:21.775853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d630a1e-20b0-437d-8b55-fbc217a865f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:21.847232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d630a1e-20b0-437d-8b55-fbc217a865f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:21.848757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d630a1e-20b0-437d-8b55-fbc217a865f9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:21.859961 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4371/8745] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:07:30.656026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b71905-54c4-495c-bc14-44a7b5c4696c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:30.683050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b71905-54c4-495c-bc14-44a7b5c4696c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:30.689163 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cfee2-84ab-41b6-a206-eba503946900 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:30.689782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cfee2-84ab-41b6-a206-eba503946900 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:30.690060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cfee2-84ab-41b6-a206-eba503946900 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:30.690335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cfee2-84ab-41b6-a206-eba503946900 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:30.692373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-465cfee2-84ab-41b6-a206-eba503946900 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:30.722218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cfee2-84ab-41b6-a206-eba503946900 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:30.723868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cfee2-84ab-41b6-a206-eba503946900 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:30.737704 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4375/8746] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:07:31.855126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:40.730231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=48 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:41.285660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d630a1e-20b0-437d-8b55-fbc217a865f9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:41.288144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d630a1e-20b0-437d-8b55-fbc217a865f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:41.309324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d630a1e-20b0-437d-8b55-fbc217a865f9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:41.314789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdfc2a-05bd-481b-b8df-f435f34bb6bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:41.315452 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdfc2a-05bd-481b-b8df-f435f34bb6bb service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:41.315730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdfc2a-05bd-481b-b8df-f435f34bb6bb service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:41.316002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdfc2a-05bd-481b-b8df-f435f34bb6bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:41.318266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-71bdfc2a-05bd-481b-b8df-f435f34bb6bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:41.332959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdfc2a-05bd-481b-b8df-f435f34bb6bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:41.334639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdfc2a-05bd-481b-b8df-f435f34bb6bb service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:41.347648 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4372/8747] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:07:51.340669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:21.628681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cfee2-84ab-41b6-a206-eba503946900 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:21.638930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cfee2-84ab-41b6-a206-eba503946900 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:21.643452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557b950-2c32-4da3-8017-01f97bfe1dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:21.644066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557b950-2c32-4da3-8017-01f97bfe1dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:21.644345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557b950-2c32-4da3-8017-01f97bfe1dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:21.644619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557b950-2c32-4da3-8017-01f97bfe1dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:21.646544 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8557b950-2c32-4da3-8017-01f97bfe1dc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:21.683361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557b950-2c32-4da3-8017-01f97bfe1dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:21.684719 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557b950-2c32-4da3-8017-01f97bfe1dc1 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:21.700680 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4376/8748] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:22.900855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdfc2a-05bd-481b-b8df-f435f34bb6bb service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:22.910799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdfc2a-05bd-481b-b8df-f435f34bb6bb service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:22.914804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef610e9-b6d5-433f-b85f-2036b848d9d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:22.915469 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef610e9-b6d5-433f-b85f-2036b848d9d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:22.915752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef610e9-b6d5-433f-b85f-2036b848d9d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:22.916028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef610e9-b6d5-433f-b85f-2036b848d9d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:22.917880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ef610e9-b6d5-433f-b85f-2036b848d9d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:22.934826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef610e9-b6d5-433f-b85f-2036b848d9d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:22.936671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef610e9-b6d5-433f-b85f-2036b848d9d4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:22.950582 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4373/8749] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:24.491342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557b950-2c32-4da3-8017-01f97bfe1dc1 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:24.508464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557b950-2c32-4da3-8017-01f97bfe1dc1 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:24.514727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad6770-91be-4e9a-96c5-51b00151aed6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:24.515742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad6770-91be-4e9a-96c5-51b00151aed6 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:24.516181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad6770-91be-4e9a-96c5-51b00151aed6 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:24.516608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad6770-91be-4e9a-96c5-51b00151aed6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:24.518618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f5ad6770-91be-4e9a-96c5-51b00151aed6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:24.539168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad6770-91be-4e9a-96c5-51b00151aed6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:24.541133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad6770-91be-4e9a-96c5-51b00151aed6 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:24.580510 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4377/8750] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:29.765767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02db322-0515-42e9-9f33-055f5a779ba4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:29.766357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02db322-0515-42e9-9f33-055f5a779ba4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:29.766357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02db322-0515-42e9-9f33-055f5a779ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:29.785570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d02db322-0515-42e9-9f33-055f5a779ba4 None None] MFA Rules not processed for user `2aa7d94090504881bb0ffd560ba90378`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:29.786778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d02db322-0515-42e9-9f33-055f5a779ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:29.794069 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4374/8751] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:09:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:30.127953 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad6770-91be-4e9a-96c5-51b00151aed6 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:30.137809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad6770-91be-4e9a-96c5-51b00151aed6 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:30.141532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62242a8e-5722-4d77-884b-26541b0c5fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:30.142136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62242a8e-5722-4d77-884b-26541b0c5fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:30.142417 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62242a8e-5722-4d77-884b-26541b0c5fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:30.142698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62242a8e-5722-4d77-884b-26541b0c5fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:30.144938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-62242a8e-5722-4d77-884b-26541b0c5fd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:30.172419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62242a8e-5722-4d77-884b-26541b0c5fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:30.173867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62242a8e-5722-4d77-884b-26541b0c5fd1 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:30.184802 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4378/8752] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:30.668679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1daf0-5b68-4849-81f6-73e2565a465f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:30.669048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1daf0-5b68-4849-81f6-73e2565a465f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:30.669227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1daf0-5b68-4849-81f6-73e2565a465f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:30.732386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2ab1daf0-5b68-4849-81f6-73e2565a465f None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:30.734149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2ab1daf0-5b68-4849-81f6-73e2565a465f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:30.745743 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4375/8753] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 19:09:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:30.757961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62242a8e-5722-4d77-884b-26541b0c5fd1 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:30.773107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62242a8e-5722-4d77-884b-26541b0c5fd1 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:30.778281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb2581-4eff-49a2-bba3-7956d5a81ad3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:30.778928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb2581-4eff-49a2-bba3-7956d5a81ad3 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:30.779208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb2581-4eff-49a2-bba3-7956d5a81ad3 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:30.779511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb2581-4eff-49a2-bba3-7956d5a81ad3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:30.788891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb2581-4eff-49a2-bba3-7956d5a81ad3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:30.790472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb2581-4eff-49a2-bba3-7956d5a81ad3 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:30.801225 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4379/8754] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:40.728979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=22 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:40.796724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=37 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:42.679735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1daf0-5b68-4849-81f6-73e2565a465f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:42.696369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1daf0-5b68-4849-81f6-73e2565a465f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:42.702992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ec586-f988-424f-827e-96fa2bce489c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:42.703685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ec586-f988-424f-827e-96fa2bce489c service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:42.703964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ec586-f988-424f-827e-96fa2bce489c service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:42.704247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ec586-f988-424f-827e-96fa2bce489c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:42.706328 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e8ec586-f988-424f-827e-96fa2bce489c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:42.792671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ec586-f988-424f-827e-96fa2bce489c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:42.794340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ec586-f988-424f-827e-96fa2bce489c service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:42.804517 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4376/8755] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:47.278040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb2581-4eff-49a2-bba3-7956d5a81ad3 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:47.279721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-19eb2581-4eff-49a2-bba3-7956d5a81ad3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:47.317646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb2581-4eff-49a2-bba3-7956d5a81ad3 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:47.327121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d1dae-a66e-4fc3-ae49-a51bc89082b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:47.328251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d1dae-a66e-4fc3-ae49-a51bc89082b6 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:47.328760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d1dae-a66e-4fc3-ae49-a51bc89082b6 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:47.329257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d1dae-a66e-4fc3-ae49-a51bc89082b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:47.332443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-635d1dae-a66e-4fc3-ae49-a51bc89082b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:47.360027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d1dae-a66e-4fc3-ae49-a51bc89082b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:47.363123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d1dae-a66e-4fc3-ae49-a51bc89082b6 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:47.385003 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4380/8756] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:48.508618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea141b70-b303-41a1-9b8c-36d4839ebefd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:48.509416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea141b70-b303-41a1-9b8c-36d4839ebefd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:48.509416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea141b70-b303-41a1-9b8c-36d4839ebefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:48.530263 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ea141b70-b303-41a1-9b8c-36d4839ebefd None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:48.531568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea141b70-b303-41a1-9b8c-36d4839ebefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:48.540400 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4377/8757] 10.222.0.27 () {58 vars in 1062 bytes} [Sun Aug 28 19:09:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:48.548146 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d1dae-a66e-4fc3-ae49-a51bc89082b6 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:48.558214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d1dae-a66e-4fc3-ae49-a51bc89082b6 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:48.562887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef5d59-74b3-4d6a-a0f7-c7c783943ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:48.563754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef5d59-74b3-4d6a-a0f7-c7c783943ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:48.564067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef5d59-74b3-4d6a-a0f7-c7c783943ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:48.564482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef5d59-74b3-4d6a-a0f7-c7c783943ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:48.567078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b0ef5d59-74b3-4d6a-a0f7-c7c783943ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:48.675957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef5d59-74b3-4d6a-a0f7-c7c783943ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:48.677463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef5d59-74b3-4d6a-a0f7-c7c783943ff0 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:48.698764 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4381/8758] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:52.083204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea141b70-b303-41a1-9b8c-36d4839ebefd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:52.102160 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea141b70-b303-41a1-9b8c-36d4839ebefd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:52.109574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4f58d-6146-44d8-a42e-f68d71f5bc2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:52.110396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4f58d-6146-44d8-a42e-f68d71f5bc2c service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:52.110691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4f58d-6146-44d8-a42e-f68d71f5bc2c service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:52.111772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4f58d-6146-44d8-a42e-f68d71f5bc2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:52.113832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-84c4f58d-6146-44d8-a42e-f68d71f5bc2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:52.139129 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4f58d-6146-44d8-a42e-f68d71f5bc2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:52.141195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4f58d-6146-44d8-a42e-f68d71f5bc2c service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:52.170525 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4378/8759] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:56.578281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef5d59-74b3-4d6a-a0f7-c7c783943ff0 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:56.595284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef5d59-74b3-4d6a-a0f7-c7c783943ff0 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:56.601591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554191d-dbd2-401c-a4fa-c289a31f316c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:56.602227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554191d-dbd2-401c-a4fa-c289a31f316c service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:56.602508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554191d-dbd2-401c-a4fa-c289a31f316c service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:56.602776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554191d-dbd2-401c-a4fa-c289a31f316c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:56.604828 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c554191d-dbd2-401c-a4fa-c289a31f316c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:56.624016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554191d-dbd2-401c-a4fa-c289a31f316c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:56.625682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554191d-dbd2-401c-a4fa-c289a31f316c service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:56.649294 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4382/8760] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:56.659939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4f58d-6146-44d8-a42e-f68d71f5bc2c service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:56.662859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-84c4f58d-6146-44d8-a42e-f68d71f5bc2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:56.679941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4f58d-6146-44d8-a42e-f68d71f5bc2c service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:56.685922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67609e-f81c-4d0c-9629-6d0bf941cbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:56.686635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67609e-f81c-4d0c-9629-6d0bf941cbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:56.687243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67609e-f81c-4d0c-9629-6d0bf941cbee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:56.687589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67609e-f81c-4d0c-9629-6d0bf941cbee admin admin] PATH_INFO: `/v3/users/87bbe66c85d94dae93e9f5422346c11c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:56.688892 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67609e-f81c-4d0c-9629-6d0bf941cbee admin admin] RBAC: Authorizing `identity:delete_user(user_id=87bbe66c85d94dae93e9f5422346c11c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:56.691052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67609e-f81c-4d0c-9629-6d0bf941cbee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:56.745890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a67609e-f81c-4d0c-9629-6d0bf941cbee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87bbe66c85d94dae93e9f5422346c11c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:56.746595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a67609e-f81c-4d0c-9629-6d0bf941cbee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87bbe66c85d94dae93e9f5422346c11c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:56.756410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a67609e-f81c-4d0c-9629-6d0bf941cbee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87bbe66c85d94dae93e9f5422346c11c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:56.768932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a67609e-f81c-4d0c-9629-6d0bf941cbee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87bbe66c85d94dae93e9f5422346c11c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:56.784332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a67609e-f81c-4d0c-9629-6d0bf941cbee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87bbe66c85d94dae93e9f5422346c11c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:56.790999 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4379/8761] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:09:56 2022] DELETE /identity/v3/users/87bbe66c85d94dae93e9f5422346c11c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:56.995573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554191d-dbd2-401c-a4fa-c289a31f316c service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:57.008566 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554191d-dbd2-401c-a4fa-c289a31f316c service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:57.091940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e198b-8add-4fcf-aaa4-477aedb2414e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:57.092618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e198b-8add-4fcf-aaa4-477aedb2414e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:57.092900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e198b-8add-4fcf-aaa4-477aedb2414e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:57.093178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e198b-8add-4fcf-aaa4-477aedb2414e admin admin] PATH_INFO: `/v3/projects/93d09a810ce04391bb2c3339955bad6a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:57.094340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e198b-8add-4fcf-aaa4-477aedb2414e admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d09a810ce04391bb2c3339955bad6a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:57.096315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e198b-8add-4fcf-aaa4-477aedb2414e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:57.141161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:57.149117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a5e198b-8add-4fcf-aaa4-477aedb2414e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d09a810ce04391bb2c3339955bad6a', 'request_id': 'req-1a5e198b-8add-4fcf-aaa4-477aedb2414e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:57.156877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a5e198b-8add-4fcf-aaa4-477aedb2414e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d09a810ce04391bb2c3339955bad6a', 'request_id': 'req-1a5e198b-8add-4fcf-aaa4-477aedb2414e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:57.164511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a5e198b-8add-4fcf-aaa4-477aedb2414e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d09a810ce04391bb2c3339955bad6a', 'request_id': 'req-1a5e198b-8add-4fcf-aaa4-477aedb2414e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:57.179208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a5e198b-8add-4fcf-aaa4-477aedb2414e admin admin] The token cache is being invalidate because project 93d09a810ce04391bb2c3339955bad6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:09:57.179448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a5e198b-8add-4fcf-aaa4-477aedb2414e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:57.180095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a5e198b-8add-4fcf-aaa4-477aedb2414e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:57.181617 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4383/8762] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:09:56 2022] DELETE /identity/v3/projects/93d09a810ce04391bb2c3339955bad6a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:57.185833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67609e-f81c-4d0c-9629-6d0bf941cbee admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:57.187280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a67609e-f81c-4d0c-9629-6d0bf941cbee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:57.201136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67609e-f81c-4d0c-9629-6d0bf941cbee admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:57.251867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:57.264298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bfb27-8eec-4fd6-84bf-dcd58cfa2e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:57.265089 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bfb27-8eec-4fd6-84bf-dcd58cfa2e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:57.265454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bfb27-8eec-4fd6-84bf-dcd58cfa2e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:57.265808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bfb27-8eec-4fd6-84bf-dcd58cfa2e18 admin admin] PATH_INFO: `/v3/users/81599b9943af418f98ebb1926f1ca10d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:57.267241 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bfb27-8eec-4fd6-84bf-dcd58cfa2e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81599b9943af418f98ebb1926f1ca10d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:57.269291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bfb27-8eec-4fd6-84bf-dcd58cfa2e18 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:57.320804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c6bfb27-8eec-4fd6-84bf-dcd58cfa2e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81599b9943af418f98ebb1926f1ca10d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:57.321460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c6bfb27-8eec-4fd6-84bf-dcd58cfa2e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81599b9943af418f98ebb1926f1ca10d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:57.328900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c6bfb27-8eec-4fd6-84bf-dcd58cfa2e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81599b9943af418f98ebb1926f1ca10d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:57.337814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c6bfb27-8eec-4fd6-84bf-dcd58cfa2e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81599b9943af418f98ebb1926f1ca10d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:57.351016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c6bfb27-8eec-4fd6-84bf-dcd58cfa2e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81599b9943af418f98ebb1926f1ca10d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:57.357405 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4380/8763] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:09:57 2022] DELETE /identity/v3/users/81599b9943af418f98ebb1926f1ca10d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:57.541852 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e198b-8add-4fcf-aaa4-477aedb2414e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:57.543617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1a5e198b-8add-4fcf-aaa4-477aedb2414e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:57.566142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e198b-8add-4fcf-aaa4-477aedb2414e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:57.627560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5e755-7d7f-45ac-b2f6-f8453f90cf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:57.628380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5e755-7d7f-45ac-b2f6-f8453f90cf06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:57.628472 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5e755-7d7f-45ac-b2f6-f8453f90cf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:57.628727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5e755-7d7f-45ac-b2f6-f8453f90cf06 admin admin] PATH_INFO: `/v3/projects/65d725d9f6b34e1a81012fd2e6e440da` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:57.629912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5e755-7d7f-45ac-b2f6-f8453f90cf06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d725d9f6b34e1a81012fd2e6e440da)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:57.631955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5e755-7d7f-45ac-b2f6-f8453f90cf06 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:57.684741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30b5e755-7d7f-45ac-b2f6-f8453f90cf06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d725d9f6b34e1a81012fd2e6e440da', 'request_id': 'req-30b5e755-7d7f-45ac-b2f6-f8453f90cf06'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:57.695721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30b5e755-7d7f-45ac-b2f6-f8453f90cf06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d725d9f6b34e1a81012fd2e6e440da', 'request_id': 'req-30b5e755-7d7f-45ac-b2f6-f8453f90cf06'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:57.702443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30b5e755-7d7f-45ac-b2f6-f8453f90cf06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d725d9f6b34e1a81012fd2e6e440da', 'request_id': 'req-30b5e755-7d7f-45ac-b2f6-f8453f90cf06'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:57.719589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30b5e755-7d7f-45ac-b2f6-f8453f90cf06 admin admin] The token cache is being invalidate because project 65d725d9f6b34e1a81012fd2e6e440da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:09:57.719806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30b5e755-7d7f-45ac-b2f6-f8453f90cf06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:57.720506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30b5e755-7d7f-45ac-b2f6-f8453f90cf06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:57.722289 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4384/8764] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:09:57 2022] DELETE /identity/v3/projects/65d725d9f6b34e1a81012fd2e6e440da => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:07.353528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=30,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:07.715179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=60,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:32.965538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bfb27-8eec-4fd6-84bf-dcd58cfa2e18 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:32.967137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5c6bfb27-8eec-4fd6-84bf-dcd58cfa2e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:33.034346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bfb27-8eec-4fd6-84bf-dcd58cfa2e18 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:33.089581 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744885a-f119-4cc1-bac8-f6f0c25ec0b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:33.090199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744885a-f119-4cc1-bac8-f6f0c25ec0b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:33.090476 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744885a-f119-4cc1-bac8-f6f0c25ec0b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:33.090779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744885a-f119-4cc1-bac8-f6f0c25ec0b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:33.092731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3744885a-f119-4cc1-bac8-f6f0c25ec0b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:33.105801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744885a-f119-4cc1-bac8-f6f0c25ec0b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:33.107408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744885a-f119-4cc1-bac8-f6f0c25ec0b5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:33.119244 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4381/8765] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:10:43.112276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=46 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:41.633433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a6133-80be-4e9e-b526-3d0ae5d1cbe9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:41.633979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a6133-80be-4e9e-b526-3d0ae5d1cbe9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:41.633979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a6133-80be-4e9e-b526-3d0ae5d1cbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:41.655718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-399a6133-80be-4e9e-b526-3d0ae5d1cbe9 None None] MFA Rules not processed for user `2aa7d94090504881bb0ffd560ba90378`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:41.656945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-399a6133-80be-4e9e-b526-3d0ae5d1cbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:41.717176 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4385/8766] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:11:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:42.073102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744885a-f119-4cc1-bac8-f6f0c25ec0b5 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:42.074907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3744885a-f119-4cc1-bac8-f6f0c25ec0b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:42.086269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744885a-f119-4cc1-bac8-f6f0c25ec0b5 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:42.090717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fa708-38e9-43b2-85bd-ba293c8d72f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:42.091357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fa708-38e9-43b2-85bd-ba293c8d72f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:42.091636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fa708-38e9-43b2-85bd-ba293c8d72f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:42.091909 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fa708-38e9-43b2-85bd-ba293c8d72f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:42.094135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-017fa708-38e9-43b2-85bd-ba293c8d72f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:42.107135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fa708-38e9-43b2-85bd-ba293c8d72f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:42.108595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fa708-38e9-43b2-85bd-ba293c8d72f8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:42.119487 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4382/8767] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:11:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:11:42.974345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cbcbd-d4f6-45bc-a1c8-1ebf5d60893b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:42.974839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cbcbd-d4f6-45bc-a1c8-1ebf5d60893b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:42.974957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cbcbd-d4f6-45bc-a1c8-1ebf5d60893b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:42.995612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e86cbcbd-d4f6-45bc-a1c8-1ebf5d60893b None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:42.997242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e86cbcbd-d4f6-45bc-a1c8-1ebf5d60893b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:43.066097 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4386/8768] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 19:11:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:11:43.077683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fa708-38e9-43b2-85bd-ba293c8d72f8 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:43.079542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-017fa708-38e9-43b2-85bd-ba293c8d72f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:43.100007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fa708-38e9-43b2-85bd-ba293c8d72f8 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:43.105836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fb2a8-cf14-46f0-a09d-ae81118c5039 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:43.106449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fb2a8-cf14-46f0-a09d-ae81118c5039 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:43.106730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fb2a8-cf14-46f0-a09d-ae81118c5039 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:43.107006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fb2a8-cf14-46f0-a09d-ae81118c5039 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:43.115900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fb2a8-cf14-46f0-a09d-ae81118c5039 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:43.117485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fb2a8-cf14-46f0-a09d-ae81118c5039 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:43.127823 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4383/8769] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:11:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:11:45.203023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cbcbd-d4f6-45bc-a1c8-1ebf5d60893b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:45.214877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cbcbd-d4f6-45bc-a1c8-1ebf5d60893b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:45.219186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff479026-3581-49b6-90e5-1459ef5cc81e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:45.220106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff479026-3581-49b6-90e5-1459ef5cc81e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:45.220782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff479026-3581-49b6-90e5-1459ef5cc81e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:45.221442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff479026-3581-49b6-90e5-1459ef5cc81e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:45.223636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ff479026-3581-49b6-90e5-1459ef5cc81e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:45.243894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff479026-3581-49b6-90e5-1459ef5cc81e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:45.245654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff479026-3581-49b6-90e5-1459ef5cc81e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:45.261278 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4387/8770] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:11:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:11:53.123673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=12 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:55.252900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=60 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:05.426237 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fb2a8-cf14-46f0-a09d-ae81118c5039 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:05.428815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d26fb2a8-cf14-46f0-a09d-ae81118c5039 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:05.510049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fb2a8-cf14-46f0-a09d-ae81118c5039 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:05.516053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551433f-2932-49b6-b354-3923b59786d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:05.516675 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551433f-2932-49b6-b354-3923b59786d7 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:05.516950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551433f-2932-49b6-b354-3923b59786d7 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:05.517223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551433f-2932-49b6-b354-3923b59786d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:05.519340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8551433f-2932-49b6-b354-3923b59786d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:05.534530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551433f-2932-49b6-b354-3923b59786d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:05.536155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551433f-2932-49b6-b354-3923b59786d7 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:05.549770 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4384/8771] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:12:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:12:15.542666 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=34 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:36.665441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff479026-3581-49b6-90e5-1459ef5cc81e service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:36.685718 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff479026-3581-49b6-90e5-1459ef5cc81e service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:36.691421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd395794-f30b-4c54-99f8-6fe3662702ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:36.692044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd395794-f30b-4c54-99f8-6fe3662702ef service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:36.692323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd395794-f30b-4c54-99f8-6fe3662702ef service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:36.692617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd395794-f30b-4c54-99f8-6fe3662702ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:36.694464 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bd395794-f30b-4c54-99f8-6fe3662702ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:36.711194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd395794-f30b-4c54-99f8-6fe3662702ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:36.712352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd395794-f30b-4c54-99f8-6fe3662702ef service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:36.726413 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4388/8772] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:12:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:12:42.262915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551433f-2932-49b6-b354-3923b59786d7 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:42.264793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8551433f-2932-49b6-b354-3923b59786d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:42.285226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551433f-2932-49b6-b354-3923b59786d7 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:42.292324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a2e20-264d-4026-bf68-176b343f21fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:42.292939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a2e20-264d-4026-bf68-176b343f21fd service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:42.293216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a2e20-264d-4026-bf68-176b343f21fd service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:42.293487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a2e20-264d-4026-bf68-176b343f21fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:42.295543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f9a2e20-264d-4026-bf68-176b343f21fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:42.311140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a2e20-264d-4026-bf68-176b343f21fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:42.312890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a2e20-264d-4026-bf68-176b343f21fd service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:42.328180 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4385/8773] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:12:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:12:46.718570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:52.319103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:47.634993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd395794-f30b-4c54-99f8-6fe3662702ef service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:47.645451 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd395794-f30b-4c54-99f8-6fe3662702ef service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:47.649624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0b09f-a7cc-410f-a443-02d687039444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:47.650248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0b09f-a7cc-410f-a443-02d687039444 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:47.650524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0b09f-a7cc-410f-a443-02d687039444 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:47.650821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0b09f-a7cc-410f-a443-02d687039444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:47.652772 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e1c0b09f-a7cc-410f-a443-02d687039444 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:47.689708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0b09f-a7cc-410f-a443-02d687039444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:47.691157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0b09f-a7cc-410f-a443-02d687039444 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:47.711596 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4389/8774] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:13:57.708648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=19 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:16.102499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a2e20-264d-4026-bf68-176b343f21fd service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:16.105041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f9a2e20-264d-4026-bf68-176b343f21fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:16.119158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a2e20-264d-4026-bf68-176b343f21fd service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:16.123348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7b560-a8a2-4283-963a-c6eed78ef382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:16.123976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b560-a8a2-4283-963a-c6eed78ef382 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:16.124257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b560-a8a2-4283-963a-c6eed78ef382 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:16.124649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b560-a8a2-4283-963a-c6eed78ef382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:16.126529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fab7b560-a8a2-4283-963a-c6eed78ef382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:16.198531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7b560-a8a2-4283-963a-c6eed78ef382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:16.200055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7b560-a8a2-4283-963a-c6eed78ef382 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:16.211805 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4386/8775] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:23.329351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0b09f-a7cc-410f-a443-02d687039444 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:23.330911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e1c0b09f-a7cc-410f-a443-02d687039444 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:23.346842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0b09f-a7cc-410f-a443-02d687039444 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:23.353194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a9dbc-525a-4608-a1ad-ba81ead06efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:23.353868 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a9dbc-525a-4608-a1ad-ba81ead06efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:23.354193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a9dbc-525a-4608-a1ad-ba81ead06efb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:23.354512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a9dbc-525a-4608-a1ad-ba81ead06efb admin admin] PATH_INFO: `/v3/users/2aa7d94090504881bb0ffd560ba90378` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:23.355820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a9dbc-525a-4608-a1ad-ba81ead06efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa7d94090504881bb0ffd560ba90378)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:23.358468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a9dbc-525a-4608-a1ad-ba81ead06efb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:23.414962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7b2a9dbc-525a-4608-a1ad-ba81ead06efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa7d94090504881bb0ffd560ba90378'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:23.429592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7b2a9dbc-525a-4608-a1ad-ba81ead06efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa7d94090504881bb0ffd560ba90378'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:23.430350 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7b2a9dbc-525a-4608-a1ad-ba81ead06efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa7d94090504881bb0ffd560ba90378'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:23.431035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7b2a9dbc-525a-4608-a1ad-ba81ead06efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa7d94090504881bb0ffd560ba90378'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:23.440121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7b2a9dbc-525a-4608-a1ad-ba81ead06efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa7d94090504881bb0ffd560ba90378'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:23.454844 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4390/8776] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:14:23 2022] DELETE /identity/v3/users/2aa7d94090504881bb0ffd560ba90378 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:23.655749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7b560-a8a2-4283-963a-c6eed78ef382 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:23.667083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7b560-a8a2-4283-963a-c6eed78ef382 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:23.734731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fef0d-fdbc-425d-8778-3ac49d926a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:23.735422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fef0d-fdbc-425d-8778-3ac49d926a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:23.735691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fef0d-fdbc-425d-8778-3ac49d926a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:23.735971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fef0d-fdbc-425d-8778-3ac49d926a35 admin admin] PATH_INFO: `/v3/projects/91c6a0602b2f433ea5c62ce6ebd52028` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:23.737643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fef0d-fdbc-425d-8778-3ac49d926a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c6a0602b2f433ea5c62ce6ebd52028)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:23.739718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fef0d-fdbc-425d-8778-3ac49d926a35 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:23.801515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b64fef0d-fdbc-425d-8778-3ac49d926a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c6a0602b2f433ea5c62ce6ebd52028', 'request_id': 'req-b64fef0d-fdbc-425d-8778-3ac49d926a35'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:23.810846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b64fef0d-fdbc-425d-8778-3ac49d926a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c6a0602b2f433ea5c62ce6ebd52028', 'request_id': 'req-b64fef0d-fdbc-425d-8778-3ac49d926a35'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:23.817994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b64fef0d-fdbc-425d-8778-3ac49d926a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c6a0602b2f433ea5c62ce6ebd52028', 'request_id': 'req-b64fef0d-fdbc-425d-8778-3ac49d926a35'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:23.831488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b64fef0d-fdbc-425d-8778-3ac49d926a35 admin admin] The token cache is being invalidate because project 91c6a0602b2f433ea5c62ce6ebd52028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:14:23.831769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b64fef0d-fdbc-425d-8778-3ac49d926a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:23.832561 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b64fef0d-fdbc-425d-8778-3ac49d926a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:23.834149 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4387/8777] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:14:23 2022] DELETE /identity/v3/projects/91c6a0602b2f433ea5c62ce6ebd52028 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:23.838639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a9dbc-525a-4608-a1ad-ba81ead06efb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:23.840216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7b2a9dbc-525a-4608-a1ad-ba81ead06efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:23.854947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a9dbc-525a-4608-a1ad-ba81ead06efb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:23.923955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abd048-8597-48d3-a404-3c894ef961ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:23.924609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abd048-8597-48d3-a404-3c894ef961ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:23.924981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abd048-8597-48d3-a404-3c894ef961ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:23.925125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abd048-8597-48d3-a404-3c894ef961ae admin admin] PATH_INFO: `/v3/users/c6ea697aed7e48ef8a62116266e8d164` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:23.940945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abd048-8597-48d3-a404-3c894ef961ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ea697aed7e48ef8a62116266e8d164)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:23.943054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abd048-8597-48d3-a404-3c894ef961ae admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:24.003711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99abd048-8597-48d3-a404-3c894ef961ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ea697aed7e48ef8a62116266e8d164'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:24.017562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:24.018722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99abd048-8597-48d3-a404-3c894ef961ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ea697aed7e48ef8a62116266e8d164'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:24.019907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99abd048-8597-48d3-a404-3c894ef961ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ea697aed7e48ef8a62116266e8d164'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:24.020945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99abd048-8597-48d3-a404-3c894ef961ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ea697aed7e48ef8a62116266e8d164'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:24.033669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99abd048-8597-48d3-a404-3c894ef961ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ea697aed7e48ef8a62116266e8d164'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:24.049144 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4391/8778] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:14:23 2022] DELETE /identity/v3/users/c6ea697aed7e48ef8a62116266e8d164 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:24.242542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fef0d-fdbc-425d-8778-3ac49d926a35 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:24.244095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b64fef0d-fdbc-425d-8778-3ac49d926a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:24.263037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fef0d-fdbc-425d-8778-3ac49d926a35 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:24.289213 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:24.333152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb5794-dedb-4e3e-b90c-d9246530fd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:24.333928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb5794-dedb-4e3e-b90c-d9246530fd9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:24.334244 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb5794-dedb-4e3e-b90c-d9246530fd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:24.334592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb5794-dedb-4e3e-b90c-d9246530fd9c admin admin] PATH_INFO: `/v3/projects/c9b473f425244882893df5af513585bd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:24.350042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb5794-dedb-4e3e-b90c-d9246530fd9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b473f425244882893df5af513585bd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:24.352055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb5794-dedb-4e3e-b90c-d9246530fd9c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:24.404434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42bb5794-dedb-4e3e-b90c-d9246530fd9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b473f425244882893df5af513585bd', 'request_id': 'req-42bb5794-dedb-4e3e-b90c-d9246530fd9c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:24.414444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42bb5794-dedb-4e3e-b90c-d9246530fd9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b473f425244882893df5af513585bd', 'request_id': 'req-42bb5794-dedb-4e3e-b90c-d9246530fd9c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:24.422736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42bb5794-dedb-4e3e-b90c-d9246530fd9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b473f425244882893df5af513585bd', 'request_id': 'req-42bb5794-dedb-4e3e-b90c-d9246530fd9c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:24.439086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42bb5794-dedb-4e3e-b90c-d9246530fd9c admin admin] The token cache is being invalidate because project c9b473f425244882893df5af513585bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:14:24.439419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42bb5794-dedb-4e3e-b90c-d9246530fd9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:24.440186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42bb5794-dedb-4e3e-b90c-d9246530fd9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:24.441831 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4388/8779] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:14:24 2022] DELETE /identity/v3/projects/c9b473f425244882893df5af513585bd => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:34.039689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c0e7a-72ed-4aaf-9db2-4153eaac008a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:34.040274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c0e7a-72ed-4aaf-9db2-4153eaac008a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:34.040274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c0e7a-72ed-4aaf-9db2-4153eaac008a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:34.093428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d83c0e7a-72ed-4aaf-9db2-4153eaac008a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:34.094649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d83c0e7a-72ed-4aaf-9db2-4153eaac008a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:34.164748 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4392/8780] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:34.174864 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c8254-146e-4c9a-b356-8a6e01e739aa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:34.175659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c8254-146e-4c9a-b356-8a6e01e739aa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:34.175659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c8254-146e-4c9a-b356-8a6e01e739aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:34.198074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8d1c8254-146e-4c9a-b356-8a6e01e739aa None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:34.199362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d1c8254-146e-4c9a-b356-8a6e01e739aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:34.212887 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4389/8781] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:34.218183 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c0e7a-72ed-4aaf-9db2-4153eaac008a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:34.228951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c0e7a-72ed-4aaf-9db2-4153eaac008a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:34.233885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703b902-1edf-4e20-bfcd-d644b4046e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:34.235006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703b902-1edf-4e20-bfcd-d644b4046e86 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:34.235006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703b902-1edf-4e20-bfcd-d644b4046e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:34.235006 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703b902-1edf-4e20-bfcd-d644b4046e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:34.235728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703b902-1edf-4e20-bfcd-d644b4046e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:14:34.236030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703b902-1edf-4e20-bfcd-d644b4046e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:34.237646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703b902-1edf-4e20-bfcd-d644b4046e86 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:34.250951 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4393/8782] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:14:34.264509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c8254-146e-4c9a-b356-8a6e01e739aa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:34.276317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c8254-146e-4c9a-b356-8a6e01e739aa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:34.281869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e151f-e6ba-4449-a2d2-b8c2c6894c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:34.282492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e151f-e6ba-4449-a2d2-b8c2c6894c2f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:34.282774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e151f-e6ba-4449-a2d2-b8c2c6894c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:34.283038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e151f-e6ba-4449-a2d2-b8c2c6894c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:34.283722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e151f-e6ba-4449-a2d2-b8c2c6894c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:34.285792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e151f-e6ba-4449-a2d2-b8c2c6894c2f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:34.337906 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4390/8783] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:14:34 2022] POST /identity/v3/projects => generated 391 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:14:34.343677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703b902-1edf-4e20-bfcd-d644b4046e86 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:34.359875 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703b902-1edf-4e20-bfcd-d644b4046e86 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:34.421134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f7b86-b3d6-4610-bde5-1a0e448324d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:34.421754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f7b86-b3d6-4610-bde5-1a0e448324d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:34.422033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f7b86-b3d6-4610-bde5-1a0e448324d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:34.422306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f7b86-b3d6-4610-bde5-1a0e448324d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:34.422951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f7b86-b3d6-4610-bde5-1a0e448324d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:34.424934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f7b86-b3d6-4610-bde5-1a0e448324d2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:34.451841 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4394/8784] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:14:34 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:14:34.456748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e151f-e6ba-4449-a2d2-b8c2c6894c2f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:34.469494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e151f-e6ba-4449-a2d2-b8c2c6894c2f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:34.475126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075b7b6-c4a4-43f6-9be2-f71fccef9aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:34.475807 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075b7b6-c4a4-43f6-9be2-f71fccef9aea admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:34.476077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075b7b6-c4a4-43f6-9be2-f71fccef9aea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:34.476352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075b7b6-c4a4-43f6-9be2-f71fccef9aea admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:34.477009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075b7b6-c4a4-43f6-9be2-f71fccef9aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:34.478651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075b7b6-c4a4-43f6-9be2-f71fccef9aea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:34.490063 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4391/8785] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:14:34.495190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f7b86-b3d6-4610-bde5-1a0e448324d2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:34.510244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f7b86-b3d6-4610-bde5-1a0e448324d2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:34.518935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f0c47-0508-4967-88ee-3b7dfb1311d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:34.519851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f0c47-0508-4967-88ee-3b7dfb1311d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:34.520197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f0c47-0508-4967-88ee-3b7dfb1311d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:34.520525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f0c47-0508-4967-88ee-3b7dfb1311d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:34.521213 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f0c47-0508-4967-88ee-3b7dfb1311d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:34.523736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f0c47-0508-4967-88ee-3b7dfb1311d3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:34.537983 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4395/8786] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:14:34.542961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075b7b6-c4a4-43f6-9be2-f71fccef9aea admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:34.554652 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075b7b6-c4a4-43f6-9be2-f71fccef9aea admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:34.560908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397eccdd-8930-42cd-8017-78b007365366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:34.561532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397eccdd-8930-42cd-8017-78b007365366 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:34.561808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397eccdd-8930-42cd-8017-78b007365366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:34.562080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397eccdd-8930-42cd-8017-78b007365366 admin admin] PATH_INFO: `/v3/projects/0a44e24873db4fa3adf1ea5fb0d7adb3/users/0a238d5dddf443f0a89a1a21604e80d6/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:34.579294 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397eccdd-8930-42cd-8017-78b007365366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a44e24873db4fa3adf1ea5fb0d7adb3, user_id=0a238d5dddf443f0a89a1a21604e80d6, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:34.581995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397eccdd-8930-42cd-8017-78b007365366 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:34.598157 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4392/8787] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:14:34 2022] PUT /identity/v3/projects/0a44e24873db4fa3adf1ea5fb0d7adb3/users/0a238d5dddf443f0a89a1a21604e80d6/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:34.613260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a0c69-5f44-4d96-97f4-f42d6ee51715 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:34.613542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a0c69-5f44-4d96-97f4-f42d6ee51715 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:34.613821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a0c69-5f44-4d96-97f4-f42d6ee51715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:34.649612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9b6a0c69-5f44-4d96-97f4-f42d6ee51715 None None] MFA Rules not processed for user `0a238d5dddf443f0a89a1a21604e80d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:34.651368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9b6a0c69-5f44-4d96-97f4-f42d6ee51715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:34.667476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:34.725700 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4396/8788] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:14:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:34.730586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397eccdd-8930-42cd-8017-78b007365366 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:34.770170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:34.801881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397eccdd-8930-42cd-8017-78b007365366 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:34.807609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a2ecc-6534-4fd8-b144-f2965a7141ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:34.808233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a2ecc-6534-4fd8-b144-f2965a7141ab admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:34.808511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a2ecc-6534-4fd8-b144-f2965a7141ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:34.808776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a2ecc-6534-4fd8-b144-f2965a7141ab admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:34.809422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a2ecc-6534-4fd8-b144-f2965a7141ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:34.811376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a2ecc-6534-4fd8-b144-f2965a7141ab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:34.842673 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4393/8789] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:14:34 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:14:34.846930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a0c69-5f44-4d96-97f4-f42d6ee51715 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:34.858065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a0c69-5f44-4d96-97f4-f42d6ee51715 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:34.916859 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d15d2-d849-4123-918c-1b9285053cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:34.917453 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d15d2-d849-4123-918c-1b9285053cbe admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:34.917736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d15d2-d849-4123-918c-1b9285053cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:34.918009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d15d2-d849-4123-918c-1b9285053cbe admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:34.918638 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d15d2-d849-4123-918c-1b9285053cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:34.920600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d15d2-d849-4123-918c-1b9285053cbe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:34.945465 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4397/8790] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:14:34 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:14:34.950203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a2ecc-6534-4fd8-b144-f2965a7141ab admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:34.963009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a2ecc-6534-4fd8-b144-f2965a7141ab admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:34.968409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1e6c8-0660-44b8-acc3-ad0a7d681538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:34.969065 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1e6c8-0660-44b8-acc3-ad0a7d681538 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:34.969354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1e6c8-0660-44b8-acc3-ad0a7d681538 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:34.969625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1e6c8-0660-44b8-acc3-ad0a7d681538 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:34.970290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1e6c8-0660-44b8-acc3-ad0a7d681538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:34.972000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1e6c8-0660-44b8-acc3-ad0a7d681538 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:34.983160 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4394/8791] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:14:34.987647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d15d2-d849-4123-918c-1b9285053cbe admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:34.998794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d15d2-d849-4123-918c-1b9285053cbe admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:35.004912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf186d-007e-4ea4-9dfb-c5d452de4553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:35.005564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf186d-007e-4ea4-9dfb-c5d452de4553 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:35.005854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf186d-007e-4ea4-9dfb-c5d452de4553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:35.006130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf186d-007e-4ea4-9dfb-c5d452de4553 admin admin] PATH_INFO: `/v3/projects/91f38245e7724e6a9e83aafa44a61d4a/users/0ebf39a2f8544408a4a064a339ec6efa/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:35.027441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf186d-007e-4ea4-9dfb-c5d452de4553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f38245e7724e6a9e83aafa44a61d4a, user_id=0ebf39a2f8544408a4a064a339ec6efa, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:35.030184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf186d-007e-4ea4-9dfb-c5d452de4553 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:35.047191 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4398/8792] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:14:34 2022] PUT /identity/v3/projects/91f38245e7724e6a9e83aafa44a61d4a/users/0ebf39a2f8544408a4a064a339ec6efa/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:35.051503 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1e6c8-0660-44b8-acc3-ad0a7d681538 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:35.062216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1e6c8-0660-44b8-acc3-ad0a7d681538 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:35.129898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed15076-6e58-41f9-973f-07d9c8ec54cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:35.130571 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed15076-6e58-41f9-973f-07d9c8ec54cc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:35.131018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed15076-6e58-41f9-973f-07d9c8ec54cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:35.131381 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed15076-6e58-41f9-973f-07d9c8ec54cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:35.132248 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed15076-6e58-41f9-973f-07d9c8ec54cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:35.134888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed15076-6e58-41f9-973f-07d9c8ec54cc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:35.150008 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4395/8793] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:14:35.154354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf186d-007e-4ea4-9dfb-c5d452de4553 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:35.165283 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf186d-007e-4ea4-9dfb-c5d452de4553 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:35.170021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8830f-b09f-48fe-a449-e66d8a654e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:35.170691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8830f-b09f-48fe-a449-e66d8a654e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:35.170964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8830f-b09f-48fe-a449-e66d8a654e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:35.171247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8830f-b09f-48fe-a449-e66d8a654e91 admin admin] PATH_INFO: `/v3/projects/91f38245e7724e6a9e83aafa44a61d4a/users/0ebf39a2f8544408a4a064a339ec6efa/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:35.173260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8830f-b09f-48fe-a449-e66d8a654e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f38245e7724e6a9e83aafa44a61d4a, user_id=0ebf39a2f8544408a4a064a339ec6efa, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:35.175987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8830f-b09f-48fe-a449-e66d8a654e91 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:35.187309 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4399/8794] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:14:35 2022] PUT /identity/v3/projects/91f38245e7724e6a9e83aafa44a61d4a/users/0ebf39a2f8544408a4a064a339ec6efa/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:35.198291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f62be-3b29-48ae-960d-8c8d1d4fbabe None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:35.198829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f62be-3b29-48ae-960d-8c8d1d4fbabe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:35.198945 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f62be-3b29-48ae-960d-8c8d1d4fbabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:35.229620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8b4f62be-3b29-48ae-960d-8c8d1d4fbabe None None] MFA Rules not processed for user `0ebf39a2f8544408a4a064a339ec6efa`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:35.230827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8b4f62be-3b29-48ae-960d-8c8d1d4fbabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:35.309208 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4396/8795] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:14:35 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:35.323007 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb9e65-b5f0-4fc6-9ced-294b32d4ef3e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:35.323340 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb9e65-b5f0-4fc6-9ced-294b32d4ef3e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:35.323619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb9e65-b5f0-4fc6-9ced-294b32d4ef3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:35.345274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b9eb9e65-b5f0-4fc6-9ced-294b32d4ef3e None None] MFA Rules not processed for user `0a238d5dddf443f0a89a1a21604e80d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:35.346490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b9eb9e65-b5f0-4fc6-9ced-294b32d4ef3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:35.408282 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4400/8796] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:14:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:35.424742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f62be-3b29-48ae-960d-8c8d1d4fbabe None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:35.426659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8b4f62be-3b29-48ae-960d-8c8d1d4fbabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:35.462359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:35.509215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f62be-3b29-48ae-960d-8c8d1d4fbabe None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:35.515216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215023a8-d480-4c6d-b10f-7424951fc581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:35.515878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215023a8-d480-4c6d-b10f-7424951fc581 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:35.516169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215023a8-d480-4c6d-b10f-7424951fc581 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:35.516428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215023a8-d480-4c6d-b10f-7424951fc581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:35.526300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215023a8-d480-4c6d-b10f-7424951fc581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:35.528486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215023a8-d480-4c6d-b10f-7424951fc581 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:35.541439 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4397/8797] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:35.572385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c241b-bafc-4c03-bd4f-9bd20cf28f99 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:35.572671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c241b-bafc-4c03-bd4f-9bd20cf28f99 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:35.572972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c241b-bafc-4c03-bd4f-9bd20cf28f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:35.594808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:35.632784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f64c241b-bafc-4c03-bd4f-9bd20cf28f99 None None] MFA Rules not processed for user `cfed720323bd42329feb7574963f744a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:35.633996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f64c241b-bafc-4c03-bd4f-9bd20cf28f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:35.699691 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4401/8798] 10.222.0.27 () {58 vars in 1064 bytes} [Sun Aug 28 19:14:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:35.705937 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215023a8-d480-4c6d-b10f-7424951fc581 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:35.716479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215023a8-d480-4c6d-b10f-7424951fc581 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:35.721360 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8c324-212e-4882-9f7c-281702d3d899 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:35.721951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8c324-212e-4882-9f7c-281702d3d899 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:35.722228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8c324-212e-4882-9f7c-281702d3d899 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:35.722496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8c324-212e-4882-9f7c-281702d3d899 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:35.724833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-76c8c324-212e-4882-9f7c-281702d3d899 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:35.743721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8c324-212e-4882-9f7c-281702d3d899 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:35.745171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8c324-212e-4882-9f7c-281702d3d899 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:35.760588 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4398/8799] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:36.240292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c241b-bafc-4c03-bd4f-9bd20cf28f99 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:36.241938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f64c241b-bafc-4c03-bd4f-9bd20cf28f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:36.251427 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8c324-212e-4882-9f7c-281702d3d899 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:36.253251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-76c8c324-212e-4882-9f7c-281702d3d899 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:36.317780 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8c324-212e-4882-9f7c-281702d3d899 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:36.317990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c241b-bafc-4c03-bd4f-9bd20cf28f99 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:36.321488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e123fd-98d3-499e-bfae-3ec9cb1941be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:36.322112 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e123fd-98d3-499e-bfae-3ec9cb1941be service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:36.322392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e123fd-98d3-499e-bfae-3ec9cb1941be service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:36.322692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e123fd-98d3-499e-bfae-3ec9cb1941be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:36.323118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e44794-2f16-4c85-9a8c-daaba2295cbb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:36.323795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e44794-2f16-4c85-9a8c-daaba2295cbb service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:36.324076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e44794-2f16-4c85-9a8c-daaba2295cbb service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:36.324351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e44794-2f16-4c85-9a8c-daaba2295cbb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:36.324509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-11e123fd-98d3-499e-bfae-3ec9cb1941be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:36.326083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a4e44794-2f16-4c85-9a8c-daaba2295cbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:36.338271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e44794-2f16-4c85-9a8c-daaba2295cbb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:36.339891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e44794-2f16-4c85-9a8c-daaba2295cbb service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:36.341163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e123fd-98d3-499e-bfae-3ec9cb1941be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:36.342624 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e123fd-98d3-499e-bfae-3ec9cb1941be service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:36.349924 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4402/8800] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:36.357264 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4399/8801] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:14:39.814663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e44794-2f16-4c85-9a8c-daaba2295cbb service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:39.816254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a4e44794-2f16-4c85-9a8c-daaba2295cbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:39.835418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e44794-2f16-4c85-9a8c-daaba2295cbb service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:39.841626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09d0fa-8a96-4f31-af2a-7a417c17073a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:39.842245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09d0fa-8a96-4f31-af2a-7a417c17073a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:39.842527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09d0fa-8a96-4f31-af2a-7a417c17073a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:39.842805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09d0fa-8a96-4f31-af2a-7a417c17073a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:39.844746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5f09d0fa-8a96-4f31-af2a-7a417c17073a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:39.863067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09d0fa-8a96-4f31-af2a-7a417c17073a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:39.865600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09d0fa-8a96-4f31-af2a-7a417c17073a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:39.881452 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4403/8802] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:46.351532 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=53 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:49.491043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e123fd-98d3-499e-bfae-3ec9cb1941be service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:49.507511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e123fd-98d3-499e-bfae-3ec9cb1941be service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:49.515591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dac15c-ab3c-4caa-9a7f-e38a1c965d23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:49.516223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dac15c-ab3c-4caa-9a7f-e38a1c965d23 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:49.516497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dac15c-ab3c-4caa-9a7f-e38a1c965d23 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:49.516766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dac15c-ab3c-4caa-9a7f-e38a1c965d23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:49.526680 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dac15c-ab3c-4caa-9a7f-e38a1c965d23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:49.528497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dac15c-ab3c-4caa-9a7f-e38a1c965d23 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:49.538989 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4400/8803] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:49 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:49.554425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d11d74-4b04-4689-86ac-c25cd9ea06f2 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:49.554921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d11d74-4b04-4689-86ac-c25cd9ea06f2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:49.555018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d11d74-4b04-4689-86ac-c25cd9ea06f2 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:49.556492 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4404/8804] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 19:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:14:49.561415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dac15c-ab3c-4caa-9a7f-e38a1c965d23 service nova] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:14:49.576478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dac15c-ab3c-4caa-9a7f-e38a1c965d23 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:49.585367 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dac15c-ab3c-4caa-9a7f-e38a1c965d23 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:49.591444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a1c94-9b6d-4acb-b9fc-933694ab935a tempest-ServersAdminNegativeTestJSON-240108657 tempest-ServersAdminNegativeTestJSON-240108657-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebf39a2f8544408a4a064a339ec6efa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91f38245e7724e6a9e83aafa44a61d4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:49.592094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a1c94-9b6d-4acb-b9fc-933694ab935a tempest-ServersAdminNegativeTestJSON-240108657 tempest-ServersAdminNegativeTestJSON-240108657-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:49.592375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a1c94-9b6d-4acb-b9fc-933694ab935a tempest-ServersAdminNegativeTestJSON-240108657 tempest-ServersAdminNegativeTestJSON-240108657-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:49.592650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a1c94-9b6d-4acb-b9fc-933694ab935a tempest-ServersAdminNegativeTestJSON-240108657 tempest-ServersAdminNegativeTestJSON-240108657-project-admin] PATH_INFO: `/v3/projects/91f38245e7724e6a9e83aafa44a61d4a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:49.593954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a1c94-9b6d-4acb-b9fc-933694ab935a tempest-ServersAdminNegativeTestJSON-240108657 tempest-ServersAdminNegativeTestJSON-240108657-project-admin] RBAC: Authorizing `identity:get_project(project_id=91f38245e7724e6a9e83aafa44a61d4a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:49.595829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a1c94-9b6d-4acb-b9fc-933694ab935a tempest-ServersAdminNegativeTestJSON-240108657 tempest-ServersAdminNegativeTestJSON-240108657-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:49.597531 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4401/8805] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 19:14:49 2022] GET /identity/v3/projects/91f38245e7724e6a9e83aafa44a61d4a => generated 391 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:14:49.872559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=71 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:49.919211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c514126-79f3-46fd-912b-a621fa08f2f4 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:49.919526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c514126-79f3-46fd-912b-a621fa08f2f4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:49.919803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c514126-79f3-46fd-912b-a621fa08f2f4 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:49.921243 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4405/8806] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 19:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:14:49.926027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a1c94-9b6d-4acb-b9fc-933694ab935a tempest-ServersAdminNegativeTestJSON-240108657 tempest-ServersAdminNegativeTestJSON-240108657-project-admin] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:14:49.942441 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a1c94-9b6d-4acb-b9fc-933694ab935a tempest-ServersAdminNegativeTestJSON-240108657 tempest-ServersAdminNegativeTestJSON-240108657-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:49.951531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a1c94-9b6d-4acb-b9fc-933694ab935a tempest-ServersAdminNegativeTestJSON-240108657 tempest-ServersAdminNegativeTestJSON-240108657-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:49.956721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e23c7-54b0-4df5-994d-c82a3f4ab199 tempest-ServersAdminNegativeTestJSON-240108657 tempest-ServersAdminNegativeTestJSON-240108657-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebf39a2f8544408a4a064a339ec6efa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91f38245e7724e6a9e83aafa44a61d4a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:49.957389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e23c7-54b0-4df5-994d-c82a3f4ab199 tempest-ServersAdminNegativeTestJSON-240108657 tempest-ServersAdminNegativeTestJSON-240108657-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:49.957699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e23c7-54b0-4df5-994d-c82a3f4ab199 tempest-ServersAdminNegativeTestJSON-240108657 tempest-ServersAdminNegativeTestJSON-240108657-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:49.958011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e23c7-54b0-4df5-994d-c82a3f4ab199 tempest-ServersAdminNegativeTestJSON-240108657 tempest-ServersAdminNegativeTestJSON-240108657-project-admin] PATH_INFO: `/v3/projects/91f38245e7724e6a9e83aafa44a61d4a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:49.959177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e23c7-54b0-4df5-994d-c82a3f4ab199 tempest-ServersAdminNegativeTestJSON-240108657 tempest-ServersAdminNegativeTestJSON-240108657-project-admin] RBAC: Authorizing `identity:get_project(project_id=91f38245e7724e6a9e83aafa44a61d4a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:49.961056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e23c7-54b0-4df5-994d-c82a3f4ab199 tempest-ServersAdminNegativeTestJSON-240108657 tempest-ServersAdminNegativeTestJSON-240108657-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:49.962913 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4402/8807] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Aug 28 19:14:49 2022] GET /identity/v3/projects/91f38245e7724e6a9e83aafa44a61d4a => generated 391 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:14:50.125396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c514126-79f3-46fd-912b-a621fa08f2f4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:50.138088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c514126-79f3-46fd-912b-a621fa08f2f4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:50.142748 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd7619-f293-40bd-9575-403d0942b8dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:50.143381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd7619-f293-40bd-9575-403d0942b8dc service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:50.143659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd7619-f293-40bd-9575-403d0942b8dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:50.143928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd7619-f293-40bd-9575-403d0942b8dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:50.145914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-18fd7619-f293-40bd-9575-403d0942b8dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:50.159658 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd7619-f293-40bd-9575-403d0942b8dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:50.161094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd7619-f293-40bd-9575-403d0942b8dc service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:50.172468 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4406/8808] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:53.101292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589f9b1-e77f-4205-b714-1c495b013e2f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:53.101882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589f9b1-e77f-4205-b714-1c495b013e2f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:53.101987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589f9b1-e77f-4205-b714-1c495b013e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:53.123634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a589f9b1-e77f-4205-b714-1c495b013e2f None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:53.124752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a589f9b1-e77f-4205-b714-1c495b013e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:53.134984 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4403/8809] 10.222.0.45 () {58 vars in 1015 bytes} [Sun Aug 28 19:14:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:14:53.149669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd7619-f293-40bd-9575-403d0942b8dc service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:53.152269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-18fd7619-f293-40bd-9575-403d0942b8dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:53.173856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd7619-f293-40bd-9575-403d0942b8dc service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:53.180506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e594c-feab-4458-8c3c-cf1c1961bcda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:53.181126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e594c-feab-4458-8c3c-cf1c1961bcda service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:53.181500 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e594c-feab-4458-8c3c-cf1c1961bcda service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:53.181776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e594c-feab-4458-8c3c-cf1c1961bcda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:53.190991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e594c-feab-4458-8c3c-cf1c1961bcda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:53.192672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e594c-feab-4458-8c3c-cf1c1961bcda service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:53.203077 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4407/8810] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:54.018925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589f9b1-e77f-4205-b714-1c495b013e2f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:54.085494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589f9b1-e77f-4205-b714-1c495b013e2f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:54.090560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c0726-5007-4140-99a6-b71d54b9b73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:54.091205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c0726-5007-4140-99a6-b71d54b9b73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:54.091516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c0726-5007-4140-99a6-b71d54b9b73a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:54.091795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c0726-5007-4140-99a6-b71d54b9b73a admin admin] PATH_INFO: `/v3/users/0a238d5dddf443f0a89a1a21604e80d6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:54.092953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c0726-5007-4140-99a6-b71d54b9b73a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a238d5dddf443f0a89a1a21604e80d6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:54.094899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c0726-5007-4140-99a6-b71d54b9b73a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:54.151011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c2c0726-5007-4140-99a6-b71d54b9b73a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a238d5dddf443f0a89a1a21604e80d6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:54.151801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c2c0726-5007-4140-99a6-b71d54b9b73a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a238d5dddf443f0a89a1a21604e80d6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:54.159359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c2c0726-5007-4140-99a6-b71d54b9b73a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a238d5dddf443f0a89a1a21604e80d6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:54.169013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c2c0726-5007-4140-99a6-b71d54b9b73a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a238d5dddf443f0a89a1a21604e80d6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:54.185595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c2c0726-5007-4140-99a6-b71d54b9b73a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a238d5dddf443f0a89a1a21604e80d6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:54.192681 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4404/8811] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:14:54 2022] DELETE /identity/v3/users/0a238d5dddf443f0a89a1a21604e80d6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:54.197811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168fed1-f254-4269-908d-f4ab9c49722d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:54.198330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168fed1-f254-4269-908d-f4ab9c49722d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:54.198330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168fed1-f254-4269-908d-f4ab9c49722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:54.218967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8168fed1-f254-4269-908d-f4ab9c49722d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:54.220325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8168fed1-f254-4269-908d-f4ab9c49722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:54.287617 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4408/8812] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:54.298493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c0726-5007-4140-99a6-b71d54b9b73a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:54.300434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2c2c0726-5007-4140-99a6-b71d54b9b73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:54.353043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:54.368049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c0726-5007-4140-99a6-b71d54b9b73a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:54.371899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abf083-021c-4abe-8536-6c81866c4ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:54.372549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf083-021c-4abe-8536-6c81866c4ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:54.372824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf083-021c-4abe-8536-6c81866c4ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:54.373097 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf083-021c-4abe-8536-6c81866c4ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:54.384763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abf083-021c-4abe-8536-6c81866c4ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:54.386234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abf083-021c-4abe-8536-6c81866c4ee0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:54.397746 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4405/8813] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:54.593046 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168fed1-f254-4269-908d-f4ab9c49722d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:54.596531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8168fed1-f254-4269-908d-f4ab9c49722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:54.617072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168fed1-f254-4269-908d-f4ab9c49722d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:54.622122 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09258f99-4402-4714-99f6-8a2402bfb527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:54.622777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09258f99-4402-4714-99f6-8a2402bfb527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:54.623052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09258f99-4402-4714-99f6-8a2402bfb527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:54.623469 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09258f99-4402-4714-99f6-8a2402bfb527 admin admin] PATH_INFO: `/v3/projects/0a44e24873db4fa3adf1ea5fb0d7adb3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:54.624618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09258f99-4402-4714-99f6-8a2402bfb527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a44e24873db4fa3adf1ea5fb0d7adb3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:54.627921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09258f99-4402-4714-99f6-8a2402bfb527 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:54.678333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09258f99-4402-4714-99f6-8a2402bfb527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a44e24873db4fa3adf1ea5fb0d7adb3', 'request_id': 'req-09258f99-4402-4714-99f6-8a2402bfb527'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:54.684918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09258f99-4402-4714-99f6-8a2402bfb527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a44e24873db4fa3adf1ea5fb0d7adb3', 'request_id': 'req-09258f99-4402-4714-99f6-8a2402bfb527'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:54.691115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09258f99-4402-4714-99f6-8a2402bfb527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a44e24873db4fa3adf1ea5fb0d7adb3', 'request_id': 'req-09258f99-4402-4714-99f6-8a2402bfb527'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:54.706679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09258f99-4402-4714-99f6-8a2402bfb527 admin admin] The token cache is being invalidate because project 0a44e24873db4fa3adf1ea5fb0d7adb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:14:54.707066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09258f99-4402-4714-99f6-8a2402bfb527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:54.707890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09258f99-4402-4714-99f6-8a2402bfb527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:54.709758 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4409/8814] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:14:54 2022] DELETE /identity/v3/projects/0a44e24873db4fa3adf1ea5fb0d7adb3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:54.714357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abf083-021c-4abe-8536-6c81866c4ee0 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:54.724765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abf083-021c-4abe-8536-6c81866c4ee0 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:54.787288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60015145-a116-4e14-8af1-c4d9d14b775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:54.788038 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60015145-a116-4e14-8af1-c4d9d14b775d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:54.788319 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60015145-a116-4e14-8af1-c4d9d14b775d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:54.788594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60015145-a116-4e14-8af1-c4d9d14b775d admin admin] PATH_INFO: `/v3/users/0ebf39a2f8544408a4a064a339ec6efa` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:54.789793 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60015145-a116-4e14-8af1-c4d9d14b775d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ebf39a2f8544408a4a064a339ec6efa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:54.791942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60015145-a116-4e14-8af1-c4d9d14b775d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:54.846363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60015145-a116-4e14-8af1-c4d9d14b775d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ebf39a2f8544408a4a064a339ec6efa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:54.847446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60015145-a116-4e14-8af1-c4d9d14b775d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ebf39a2f8544408a4a064a339ec6efa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:54.857309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60015145-a116-4e14-8af1-c4d9d14b775d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ebf39a2f8544408a4a064a339ec6efa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:54.868506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60015145-a116-4e14-8af1-c4d9d14b775d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ebf39a2f8544408a4a064a339ec6efa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:54.887883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60015145-a116-4e14-8af1-c4d9d14b775d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ebf39a2f8544408a4a064a339ec6efa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:54.894495 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4406/8815] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:14:54 2022] DELETE /identity/v3/users/0ebf39a2f8544408a4a064a339ec6efa => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:14:55.186570 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09258f99-4402-4714-99f6-8a2402bfb527 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:55.187746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-09258f99-4402-4714-99f6-8a2402bfb527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:55.210346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09258f99-4402-4714-99f6-8a2402bfb527 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:55.290864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:55.298248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974b83d-5345-43d2-9d7c-2f1cc6a2118a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:55.298926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974b83d-5345-43d2-9d7c-2f1cc6a2118a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:55.299214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974b83d-5345-43d2-9d7c-2f1cc6a2118a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:55.299527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974b83d-5345-43d2-9d7c-2f1cc6a2118a admin admin] PATH_INFO: `/v3/projects/91f38245e7724e6a9e83aafa44a61d4a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:55.304781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974b83d-5345-43d2-9d7c-2f1cc6a2118a admin admin] RBAC: Authorizing `identity:delete_project(project_id=91f38245e7724e6a9e83aafa44a61d4a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:55.306901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974b83d-5345-43d2-9d7c-2f1cc6a2118a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:55.370284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a974b83d-5345-43d2-9d7c-2f1cc6a2118a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91f38245e7724e6a9e83aafa44a61d4a', 'request_id': 'req-a974b83d-5345-43d2-9d7c-2f1cc6a2118a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:55.380203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a974b83d-5345-43d2-9d7c-2f1cc6a2118a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91f38245e7724e6a9e83aafa44a61d4a', 'request_id': 'req-a974b83d-5345-43d2-9d7c-2f1cc6a2118a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:55.390567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a974b83d-5345-43d2-9d7c-2f1cc6a2118a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91f38245e7724e6a9e83aafa44a61d4a', 'request_id': 'req-a974b83d-5345-43d2-9d7c-2f1cc6a2118a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:55.406950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a974b83d-5345-43d2-9d7c-2f1cc6a2118a admin admin] The token cache is being invalidate because project 91f38245e7724e6a9e83aafa44a61d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:14:55.407611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a974b83d-5345-43d2-9d7c-2f1cc6a2118a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:55.408294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a974b83d-5345-43d2-9d7c-2f1cc6a2118a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:55.409899 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4410/8816] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:14:55 2022] DELETE /identity/v3/projects/91f38245e7724e6a9e83aafa44a61d4a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:55.416500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ff1fb-88e5-460a-b6bd-fca5eac2d31e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:55.417057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ff1fb-88e5-460a-b6bd-fca5eac2d31e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:55.417057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ff1fb-88e5-460a-b6bd-fca5eac2d31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:55.439442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0d6ff1fb-88e5-460a-b6bd-fca5eac2d31e None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:55.440802 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d6ff1fb-88e5-460a-b6bd-fca5eac2d31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:55.516699 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4407/8817] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:14:55.525749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adba1d4-21b5-4816-b9e6-7378f9d400c5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:55.526039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adba1d4-21b5-4816-b9e6-7378f9d400c5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:55.526325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adba1d4-21b5-4816-b9e6-7378f9d400c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:55.547274 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8adba1d4-21b5-4816-b9e6-7378f9d400c5 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:55.548520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8adba1d4-21b5-4816-b9e6-7378f9d400c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:55.557989 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4411/8818] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:55.564608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ff1fb-88e5-460a-b6bd-fca5eac2d31e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:55.574408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:55.578931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ff1fb-88e5-460a-b6bd-fca5eac2d31e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:55.584735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af691b-4992-4350-856f-24ae2bb1f1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:55.585376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af691b-4992-4350-856f-24ae2bb1f1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:55.585775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af691b-4992-4350-856f-24ae2bb1f1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:55.586425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af691b-4992-4350-856f-24ae2bb1f1b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:55.587170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af691b-4992-4350-856f-24ae2bb1f1b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:14:55.587525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af691b-4992-4350-856f-24ae2bb1f1b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:55.589219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af691b-4992-4350-856f-24ae2bb1f1b5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:55.604418 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4408/8819] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:14:55.609927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adba1d4-21b5-4816-b9e6-7378f9d400c5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:55.626571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adba1d4-21b5-4816-b9e6-7378f9d400c5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:55.635440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc6c7b-11db-468c-aa05-0ef3a1062afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:55.636073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc6c7b-11db-468c-aa05-0ef3a1062afd admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:55.636351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc6c7b-11db-468c-aa05-0ef3a1062afd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:55.636630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc6c7b-11db-468c-aa05-0ef3a1062afd admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:55.637258 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc6c7b-11db-468c-aa05-0ef3a1062afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:55.639191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc6c7b-11db-468c-aa05-0ef3a1062afd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:55.676485 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4412/8820] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:14:55 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:14:55.680995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af691b-4992-4350-856f-24ae2bb1f1b5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:55.691542 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af691b-4992-4350-856f-24ae2bb1f1b5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:55.752234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536398c-0efb-4529-a64a-cc414da5cb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:55.752860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536398c-0efb-4529-a64a-cc414da5cb57 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:55.753132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536398c-0efb-4529-a64a-cc414da5cb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:55.753754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536398c-0efb-4529-a64a-cc414da5cb57 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:55.754422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536398c-0efb-4529-a64a-cc414da5cb57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:55.756402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536398c-0efb-4529-a64a-cc414da5cb57 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:55.787017 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4409/8821] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:14:55 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:14:55.791717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc6c7b-11db-468c-aa05-0ef3a1062afd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:55.803458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc6c7b-11db-468c-aa05-0ef3a1062afd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:55.809613 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661e634-2e3f-46f9-9c64-6010fff3fffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:55.810244 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661e634-2e3f-46f9-9c64-6010fff3fffd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:55.810529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661e634-2e3f-46f9-9c64-6010fff3fffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:55.810791 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661e634-2e3f-46f9-9c64-6010fff3fffd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:55.811504 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661e634-2e3f-46f9-9c64-6010fff3fffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:55.813310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661e634-2e3f-46f9-9c64-6010fff3fffd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:55.827400 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4413/8822] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:14:55.832322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536398c-0efb-4529-a64a-cc414da5cb57 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:55.846819 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536398c-0efb-4529-a64a-cc414da5cb57 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:55.852659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811732cf-1f43-4a41-b16e-d3ebe9ffe9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:55.853347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811732cf-1f43-4a41-b16e-d3ebe9ffe9ee admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:55.853626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811732cf-1f43-4a41-b16e-d3ebe9ffe9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:55.853898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811732cf-1f43-4a41-b16e-d3ebe9ffe9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:55.854591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811732cf-1f43-4a41-b16e-d3ebe9ffe9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:55.856292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811732cf-1f43-4a41-b16e-d3ebe9ffe9ee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:55.867986 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4410/8823] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:14:55.872457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661e634-2e3f-46f9-9c64-6010fff3fffd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:55.884268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661e634-2e3f-46f9-9c64-6010fff3fffd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:55.889168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301d889-bf08-41aa-b21d-92fc28ff074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:55.889816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301d889-bf08-41aa-b21d-92fc28ff074a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:55.890094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301d889-bf08-41aa-b21d-92fc28ff074a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:55.890345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301d889-bf08-41aa-b21d-92fc28ff074a admin admin] PATH_INFO: `/v3/projects/adba7b27f628426694fa913bac058e02/users/ce60397c6acc4175800b81fd62ee4977/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:55.906139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301d889-bf08-41aa-b21d-92fc28ff074a admin admin] RBAC: Authorizing `identity:create_grant(project_id=adba7b27f628426694fa913bac058e02, user_id=ce60397c6acc4175800b81fd62ee4977, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:55.908842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301d889-bf08-41aa-b21d-92fc28ff074a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:55.923479 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4414/8824] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:14:55 2022] PUT /identity/v3/projects/adba7b27f628426694fa913bac058e02/users/ce60397c6acc4175800b81fd62ee4977/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:14:55.929051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81fe16-23a2-4a03-a6a8-5fa3ff214a0d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:55.929336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81fe16-23a2-4a03-a6a8-5fa3ff214a0d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:55.929609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81fe16-23a2-4a03-a6a8-5fa3ff214a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:55.953050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8d81fe16-23a2-4a03-a6a8-5fa3ff214a0d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:55.954306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d81fe16-23a2-4a03-a6a8-5fa3ff214a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:56.021310 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4411/8825] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:56.033121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301d889-bf08-41aa-b21d-92fc28ff074a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:56.035091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e301d889-bf08-41aa-b21d-92fc28ff074a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:56.099873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301d889-bf08-41aa-b21d-92fc28ff074a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:56.104207 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb098aa4-6edc-41ec-9933-905facdbbe91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:56.104827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb098aa4-6edc-41ec-9933-905facdbbe91 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:56.105104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb098aa4-6edc-41ec-9933-905facdbbe91 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:56.105374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb098aa4-6edc-41ec-9933-905facdbbe91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:56.115798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb098aa4-6edc-41ec-9933-905facdbbe91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:56.117238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb098aa4-6edc-41ec-9933-905facdbbe91 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:56.127812 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4415/8826] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:00.545163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ecedb-3779-4293-96ca-134c7c6227cc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:00.545770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ecedb-3779-4293-96ca-134c7c6227cc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:00.545770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ecedb-3779-4293-96ca-134c7c6227cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:00.582590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-406ecedb-3779-4293-96ca-134c7c6227cc None None] MFA Rules not processed for user `ce60397c6acc4175800b81fd62ee4977`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:00.584044 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-406ecedb-3779-4293-96ca-134c7c6227cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:00.659222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:00.674345 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4412/8827] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:15:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:00.676047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8069-eb67-4d3a-959d-f3b7e4d71bec None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:00.676506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8069-eb67-4d3a-959d-f3b7e4d71bec None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:00.676579 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8069-eb67-4d3a-959d-f3b7e4d71bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:00.699757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-654d8069-eb67-4d3a-959d-f3b7e4d71bec None None] MFA Rules not processed for user `ce60397c6acc4175800b81fd62ee4977`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:00.700988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-654d8069-eb67-4d3a-959d-f3b7e4d71bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:00.711819 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4416/8828] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:15:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:00.727852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ecedb-3779-4293-96ca-134c7c6227cc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:00.729611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-406ecedb-3779-4293-96ca-134c7c6227cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:00.822710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ecedb-3779-4293-96ca-134c7c6227cc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:00.828643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4b636-75a8-4453-af82-7be4c2bfe4ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:00.829262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4b636-75a8-4453-af82-7be4c2bfe4ee service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:00.829579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4b636-75a8-4453-af82-7be4c2bfe4ee service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:00.829848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4b636-75a8-4453-af82-7be4c2bfe4ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:00.838948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4b636-75a8-4453-af82-7be4c2bfe4ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:00.840783 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4b636-75a8-4453-af82-7be4c2bfe4ee service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:00.850675 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4413/8829] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:10.693412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:10.846723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=34 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:11.118621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d8069-eb67-4d3a-959d-f3b7e4d71bec None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:11.120636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-654d8069-eb67-4d3a-959d-f3b7e4d71bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:11.143310 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d8069-eb67-4d3a-959d-f3b7e4d71bec None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:11.149534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfafb7-11b3-4c52-b6e1-b1f2756518f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:11.150347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfafb7-11b3-4c52-b6e1-b1f2756518f8 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:11.150637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfafb7-11b3-4c52-b6e1-b1f2756518f8 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:11.150913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfafb7-11b3-4c52-b6e1-b1f2756518f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:11.153089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-93dfafb7-11b3-4c52-b6e1-b1f2756518f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:11.179345 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfafb7-11b3-4c52-b6e1-b1f2756518f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:11.181123 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfafb7-11b3-4c52-b6e1-b1f2756518f8 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:11.198369 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4417/8830] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:13.847071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4b636-75a8-4453-af82-7be4c2bfe4ee service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:13.849104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f8e4b636-75a8-4453-af82-7be4c2bfe4ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:13.864778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4b636-75a8-4453-af82-7be4c2bfe4ee service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:13.868716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ef61b-ece9-4471-bd77-797b1ce5d27e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:13.869364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ef61b-ece9-4471-bd77-797b1ce5d27e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:13.869704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ef61b-ece9-4471-bd77-797b1ce5d27e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:13.869987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ef61b-ece9-4471-bd77-797b1ce5d27e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:13.871965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-223ef61b-ece9-4471-bd77-797b1ce5d27e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:13.887494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ef61b-ece9-4471-bd77-797b1ce5d27e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:13.889384 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ef61b-ece9-4471-bd77-797b1ce5d27e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:13.906889 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4414/8831] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:14.008437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aa3a0-74ea-4fc9-9dd5-464f696327b5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:14.009075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aa3a0-74ea-4fc9-9dd5-464f696327b5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:14.009397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aa3a0-74ea-4fc9-9dd5-464f696327b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:14.033231 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8d1aa3a0-74ea-4fc9-9dd5-464f696327b5 None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:14.034493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8d1aa3a0-74ea-4fc9-9dd5-464f696327b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:14.108994 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4418/8832] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 19:15:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:14.121930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b70c44-ee95-499e-97a3-405d3b5c0066 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:14.122226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b70c44-ee95-499e-97a3-405d3b5c0066 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:14.122500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b70c44-ee95-499e-97a3-405d3b5c0066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:14.145705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-42b70c44-ee95-499e-97a3-405d3b5c0066 None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:14.146952 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-42b70c44-ee95-499e-97a3-405d3b5c0066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:14.156174 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4415/8833] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Aug 28 19:15:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:14.164473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1aa3a0-74ea-4fc9-9dd5-464f696327b5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:14.175535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1aa3a0-74ea-4fc9-9dd5-464f696327b5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:14.181034 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80838c0-7689-4e10-a659-8284aabc478d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:14.181656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80838c0-7689-4e10-a659-8284aabc478d service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:14.181946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80838c0-7689-4e10-a659-8284aabc478d service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:14.182224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80838c0-7689-4e10-a659-8284aabc478d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:14.191628 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80838c0-7689-4e10-a659-8284aabc478d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:14.193242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80838c0-7689-4e10-a659-8284aabc478d service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:14.205233 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4419/8834] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:15:14.400339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b70c44-ee95-499e-97a3-405d3b5c0066 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:14.414261 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b70c44-ee95-499e-97a3-405d3b5c0066 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:14.418058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97582e3c-5cb2-4a7e-9993-732af6b5537e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:14.418681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97582e3c-5cb2-4a7e-9993-732af6b5537e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:14.418957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97582e3c-5cb2-4a7e-9993-732af6b5537e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:14.419229 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97582e3c-5cb2-4a7e-9993-732af6b5537e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:14.421191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97582e3c-5cb2-4a7e-9993-732af6b5537e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:14.440131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97582e3c-5cb2-4a7e-9993-732af6b5537e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:14.441670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97582e3c-5cb2-4a7e-9993-732af6b5537e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:14.457784 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4416/8835] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:14.915744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b58937-85c3-4958-a117-b17dbd748941 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:14.915988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b58937-85c3-4958-a117-b17dbd748941 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:14.916349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b58937-85c3-4958-a117-b17dbd748941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:14.940543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-18b58937-85c3-4958-a117-b17dbd748941 None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:14.941908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-18b58937-85c3-4958-a117-b17dbd748941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:14.951850 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4420/8836] 10.222.0.42 () {58 vars in 1015 bytes} [Sun Aug 28 19:15:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:14.963810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae7875-c07a-4549-882b-7a9cbf9edaba None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:14.964351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae7875-c07a-4549-882b-7a9cbf9edaba None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:14.964351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae7875-c07a-4549-882b-7a9cbf9edaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:14.985696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-48ae7875-c07a-4549-882b-7a9cbf9edaba None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:14.986974 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48ae7875-c07a-4549-882b-7a9cbf9edaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:14.997581 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4417/8837] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Aug 28 19:15:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:15:15.004424 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b58937-85c3-4958-a117-b17dbd748941 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:15.016747 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b58937-85c3-4958-a117-b17dbd748941 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:15.025366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786593f-a3d3-4073-9cab-464dca21e503 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:15.026391 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786593f-a3d3-4073-9cab-464dca21e503 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:15.026840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786593f-a3d3-4073-9cab-464dca21e503 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:15.027335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786593f-a3d3-4073-9cab-464dca21e503 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:15.042147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786593f-a3d3-4073-9cab-464dca21e503 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:15.043864 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786593f-a3d3-4073-9cab-464dca21e503 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:15.055116 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4421/8838] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:15:24.980330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=18 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:25.050745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=50 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:49.021949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae7875-c07a-4549-882b-7a9cbf9edaba None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:49.036276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae7875-c07a-4549-882b-7a9cbf9edaba None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:49.040738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc1809-6aac-4360-84e6-e795aff6bdae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:49.041393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc1809-6aac-4360-84e6-e795aff6bdae service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:49.041667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc1809-6aac-4360-84e6-e795aff6bdae service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:49.041924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc1809-6aac-4360-84e6-e795aff6bdae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:49.043753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-46fc1809-6aac-4360-84e6-e795aff6bdae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:49.057609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc1809-6aac-4360-84e6-e795aff6bdae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:49.059083 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc1809-6aac-4360-84e6-e795aff6bdae service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:49.070834 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4418/8839] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:59.064069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:02.643408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786593f-a3d3-4073-9cab-464dca21e503 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:02.654622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786593f-a3d3-4073-9cab-464dca21e503 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:02.660471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee8fb6-b3d6-4364-b907-a2bdb6cc15a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:02.661319 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee8fb6-b3d6-4364-b907-a2bdb6cc15a6 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:02.661690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee8fb6-b3d6-4364-b907-a2bdb6cc15a6 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:02.662052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee8fb6-b3d6-4364-b907-a2bdb6cc15a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:02.664264 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-33ee8fb6-b3d6-4364-b907-a2bdb6cc15a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:02.679543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee8fb6-b3d6-4364-b907-a2bdb6cc15a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:02.681463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee8fb6-b3d6-4364-b907-a2bdb6cc15a6 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:02.706043 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4422/8840] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:02.713062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc1809-6aac-4360-84e6-e795aff6bdae service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:02.729210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc1809-6aac-4360-84e6-e795aff6bdae service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:02.735411 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8f6fa-eb3d-4fdc-8d3f-17716c32c602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:02.736074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8f6fa-eb3d-4fdc-8d3f-17716c32c602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:02.736349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8f6fa-eb3d-4fdc-8d3f-17716c32c602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:02.736650 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8f6fa-eb3d-4fdc-8d3f-17716c32c602 admin admin] PATH_INFO: `/v3/users/ce60397c6acc4175800b81fd62ee4977` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:02.738172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8f6fa-eb3d-4fdc-8d3f-17716c32c602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce60397c6acc4175800b81fd62ee4977)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:02.740651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8f6fa-eb3d-4fdc-8d3f-17716c32c602 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:02.798313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-65c8f6fa-eb3d-4fdc-8d3f-17716c32c602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce60397c6acc4175800b81fd62ee4977'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:02.799659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-65c8f6fa-eb3d-4fdc-8d3f-17716c32c602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce60397c6acc4175800b81fd62ee4977'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:02.809958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-65c8f6fa-eb3d-4fdc-8d3f-17716c32c602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce60397c6acc4175800b81fd62ee4977'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:02.819953 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-65c8f6fa-eb3d-4fdc-8d3f-17716c32c602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce60397c6acc4175800b81fd62ee4977'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:02.833622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-65c8f6fa-eb3d-4fdc-8d3f-17716c32c602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce60397c6acc4175800b81fd62ee4977'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:02.840478 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4419/8841] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:02 2022] DELETE /identity/v3/users/ce60397c6acc4175800b81fd62ee4977 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:03.047984 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee8fb6-b3d6-4364-b907-a2bdb6cc15a6 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:03.059906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee8fb6-b3d6-4364-b907-a2bdb6cc15a6 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:03.128339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb832deb-e0a3-4887-ae6a-7860b1b285cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:03.128889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb832deb-e0a3-4887-ae6a-7860b1b285cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:03.129153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb832deb-e0a3-4887-ae6a-7860b1b285cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:03.129454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb832deb-e0a3-4887-ae6a-7860b1b285cb admin admin] PATH_INFO: `/v3/projects/adba7b27f628426694fa913bac058e02` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:03.131002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb832deb-e0a3-4887-ae6a-7860b1b285cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=adba7b27f628426694fa913bac058e02)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:03.133016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb832deb-e0a3-4887-ae6a-7860b1b285cb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:03.186540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb832deb-e0a3-4887-ae6a-7860b1b285cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adba7b27f628426694fa913bac058e02', 'request_id': 'req-bb832deb-e0a3-4887-ae6a-7860b1b285cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:03.194099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb832deb-e0a3-4887-ae6a-7860b1b285cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adba7b27f628426694fa913bac058e02', 'request_id': 'req-bb832deb-e0a3-4887-ae6a-7860b1b285cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:03.202057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb832deb-e0a3-4887-ae6a-7860b1b285cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adba7b27f628426694fa913bac058e02', 'request_id': 'req-bb832deb-e0a3-4887-ae6a-7860b1b285cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:03.219842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb832deb-e0a3-4887-ae6a-7860b1b285cb admin admin] The token cache is being invalidate because project adba7b27f628426694fa913bac058e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:03.220131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb832deb-e0a3-4887-ae6a-7860b1b285cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:03.220802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb832deb-e0a3-4887-ae6a-7860b1b285cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:03.222337 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4423/8842] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:03 2022] DELETE /identity/v3/projects/adba7b27f628426694fa913bac058e02 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:03.229439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d98c5-850c-4efa-8bd0-47943e24ff03 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:03.229723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d98c5-850c-4efa-8bd0-47943e24ff03 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:03.230000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d98c5-850c-4efa-8bd0-47943e24ff03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:03.250753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-eb3d98c5-850c-4efa-8bd0-47943e24ff03 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:03.252032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eb3d98c5-850c-4efa-8bd0-47943e24ff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:03.318596 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4420/8843] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:03.327614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90ff1d-7f5e-4730-a873-d585ecdf1a9a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:03.327897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90ff1d-7f5e-4730-a873-d585ecdf1a9a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:03.328166 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90ff1d-7f5e-4730-a873-d585ecdf1a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:03.348717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2e90ff1d-7f5e-4730-a873-d585ecdf1a9a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:03.349966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2e90ff1d-7f5e-4730-a873-d585ecdf1a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:03.359340 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4424/8844] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:03.364076 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d98c5-850c-4efa-8bd0-47943e24ff03 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:03.374493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d98c5-850c-4efa-8bd0-47943e24ff03 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:03.381066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bab9c-0c14-46f3-8b92-13cbaa3c57d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:03.381066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bab9c-0c14-46f3-8b92-13cbaa3c57d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:03.381066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bab9c-0c14-46f3-8b92-13cbaa3c57d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:03.381811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bab9c-0c14-46f3-8b92-13cbaa3c57d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:03.381923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bab9c-0c14-46f3-8b92-13cbaa3c57d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:03.382224 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bab9c-0c14-46f3-8b92-13cbaa3c57d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:03.384247 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bab9c-0c14-46f3-8b92-13cbaa3c57d9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:03.397677 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4421/8845] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:03.402621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90ff1d-7f5e-4730-a873-d585ecdf1a9a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:03.412912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90ff1d-7f5e-4730-a873-d585ecdf1a9a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:03.418848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8daacb-4652-4239-9f14-e1ae8c48471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:03.419505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8daacb-4652-4239-9f14-e1ae8c48471b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:03.419788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8daacb-4652-4239-9f14-e1ae8c48471b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:03.420066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8daacb-4652-4239-9f14-e1ae8c48471b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:03.420721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8daacb-4652-4239-9f14-e1ae8c48471b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:03.422655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8daacb-4652-4239-9f14-e1ae8c48471b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:03.454557 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4425/8846] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:03 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:03.459106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bab9c-0c14-46f3-8b92-13cbaa3c57d9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:03.469808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bab9c-0c14-46f3-8b92-13cbaa3c57d9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:03.531146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cb349-a6e4-4596-8646-f2a761d7d4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:03.531806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cb349-a6e4-4596-8646-f2a761d7d4bb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:03.532086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cb349-a6e4-4596-8646-f2a761d7d4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:03.532361 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cb349-a6e4-4596-8646-f2a761d7d4bb admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:03.533007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cb349-a6e4-4596-8646-f2a761d7d4bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:03.534988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cb349-a6e4-4596-8646-f2a761d7d4bb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:03.543608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:03.559206 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4422/8847] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:03 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:03.563888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8daacb-4652-4239-9f14-e1ae8c48471b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:03.576485 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8daacb-4652-4239-9f14-e1ae8c48471b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:03.582297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf67f44-eb95-4f92-bb07-96163a5db1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:03.582928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67f44-eb95-4f92-bb07-96163a5db1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:03.583210 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67f44-eb95-4f92-bb07-96163a5db1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:03.583524 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67f44-eb95-4f92-bb07-96163a5db1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:03.584194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf67f44-eb95-4f92-bb07-96163a5db1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:03.585839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf67f44-eb95-4f92-bb07-96163a5db1f6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:03.597619 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4426/8848] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:03.602064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cb349-a6e4-4596-8646-f2a761d7d4bb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:03.612776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cb349-a6e4-4596-8646-f2a761d7d4bb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:03.620246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0e49e-eaaa-484b-acd9-77f1618ace8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:03.621099 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0e49e-eaaa-484b-acd9-77f1618ace8a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:03.621376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0e49e-eaaa-484b-acd9-77f1618ace8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:03.621646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0e49e-eaaa-484b-acd9-77f1618ace8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:03.622307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0e49e-eaaa-484b-acd9-77f1618ace8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:03.624018 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0e49e-eaaa-484b-acd9-77f1618ace8a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:03.636821 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4423/8849] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:03.641124 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf67f44-eb95-4f92-bb07-96163a5db1f6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:03.654456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf67f44-eb95-4f92-bb07-96163a5db1f6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:03.661426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc2a49-447a-4b6d-9064-cb263f6b785a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:03.662102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc2a49-447a-4b6d-9064-cb263f6b785a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:03.662403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc2a49-447a-4b6d-9064-cb263f6b785a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:03.662706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc2a49-447a-4b6d-9064-cb263f6b785a admin admin] PATH_INFO: `/v3/projects/28a843aadd6b40acb94d4008ab9c898a/users/fbe5e501574245ceb49d44ea056d1751/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:03.678588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc2a49-447a-4b6d-9064-cb263f6b785a admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a843aadd6b40acb94d4008ab9c898a, user_id=fbe5e501574245ceb49d44ea056d1751, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:03.681302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc2a49-447a-4b6d-9064-cb263f6b785a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:03.700868 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4427/8850] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:03 2022] PUT /identity/v3/projects/28a843aadd6b40acb94d4008ab9c898a/users/fbe5e501574245ceb49d44ea056d1751/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:03.708826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159c20f-d76e-445f-bae5-e8f3d2e16ffd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:03.709447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159c20f-d76e-445f-bae5-e8f3d2e16ffd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:03.709924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159c20f-d76e-445f-bae5-e8f3d2e16ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:03.732619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3159c20f-d76e-445f-bae5-e8f3d2e16ffd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:03.733851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3159c20f-d76e-445f-bae5-e8f3d2e16ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:03.801986 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4424/8851] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:03.812890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc2a49-447a-4b6d-9064-cb263f6b785a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:03.814675 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9dcc2a49-447a-4b6d-9064-cb263f6b785a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:03.831362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:03.880974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc2a49-447a-4b6d-9064-cb263f6b785a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:03.885133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef595a2-a96f-4394-b383-2a9eab58a894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:03.885749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef595a2-a96f-4394-b383-2a9eab58a894 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:03.886030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef595a2-a96f-4394-b383-2a9eab58a894 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:03.886306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef595a2-a96f-4394-b383-2a9eab58a894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:03.896664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef595a2-a96f-4394-b383-2a9eab58a894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:03.898043 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef595a2-a96f-4394-b383-2a9eab58a894 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:03.908139 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4428/8852] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:07.865848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b2eec-3c7a-4fc7-9edd-bc44f5c30471 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:07.866373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b2eec-3c7a-4fc7-9edd-bc44f5c30471 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:07.866373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b2eec-3c7a-4fc7-9edd-bc44f5c30471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:07.895681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0c9b2eec-3c7a-4fc7-9edd-bc44f5c30471 None None] MFA Rules not processed for user `fbe5e501574245ceb49d44ea056d1751`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:07.896824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0c9b2eec-3c7a-4fc7-9edd-bc44f5c30471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:07.965832 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4425/8853] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:16:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:07.977090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf8572-cff5-44c9-b68d-f61275f034aa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:07.977622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf8572-cff5-44c9-b68d-f61275f034aa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:07.977622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf8572-cff5-44c9-b68d-f61275f034aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:08.000446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d0cf8572-cff5-44c9-b68d-f61275f034aa None None] MFA Rules not processed for user `fbe5e501574245ceb49d44ea056d1751`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:08.001683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d0cf8572-cff5-44c9-b68d-f61275f034aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:08.009371 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4429/8854] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:16:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:08.021362 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b2eec-3c7a-4fc7-9edd-bc44f5c30471 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:08.022862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0c9b2eec-3c7a-4fc7-9edd-bc44f5c30471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:08.107392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b2eec-3c7a-4fc7-9edd-bc44f5c30471 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:08.114227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647e0ca-f51e-49c7-8a81-1ac725a4b594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:08.114859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647e0ca-f51e-49c7-8a81-1ac725a4b594 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:08.115135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647e0ca-f51e-49c7-8a81-1ac725a4b594 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:08.115458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647e0ca-f51e-49c7-8a81-1ac725a4b594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:08.121009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:08.125688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647e0ca-f51e-49c7-8a81-1ac725a4b594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:08.127433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647e0ca-f51e-49c7-8a81-1ac725a4b594 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:08.137990 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4426/8855] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:17.995040 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=23 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:18.133862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:51.484973 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf8572-cff5-44c9-b68d-f61275f034aa None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:51.486792 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d0cf8572-cff5-44c9-b68d-f61275f034aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:51.501448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf8572-cff5-44c9-b68d-f61275f034aa None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:51.506273 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da323103-6042-402a-b34e-a67269405a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:51.507455 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da323103-6042-402a-b34e-a67269405a6f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:51.507729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da323103-6042-402a-b34e-a67269405a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:51.507998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da323103-6042-402a-b34e-a67269405a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:51.510138 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-da323103-6042-402a-b34e-a67269405a6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:51.523490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da323103-6042-402a-b34e-a67269405a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:51.524982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da323103-6042-402a-b34e-a67269405a6f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:51.542681 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4430/8856] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:16:53.241636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1833aec-718a-4786-936d-0978d12e7060 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:53.242225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1833aec-718a-4786-936d-0978d12e7060 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:53.242225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1833aec-718a-4786-936d-0978d12e7060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:53.295884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e1833aec-718a-4786-936d-0978d12e7060 None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:53.297622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1833aec-718a-4786-936d-0978d12e7060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:53.309840 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4427/8857] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Aug 28 19:16:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:55.769645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ce7f1-8b23-4545-aba3-0a1a23b9f706 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:55.770254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ce7f1-8b23-4545-aba3-0a1a23b9f706 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:55.770254 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ce7f1-8b23-4545-aba3-0a1a23b9f706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:55.791442 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-432ce7f1-8b23-4545-aba3-0a1a23b9f706 None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:55.792661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-432ce7f1-8b23-4545-aba3-0a1a23b9f706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:55.802784 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4431/8858] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Aug 28 19:16:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:00.189659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc864ff-eb2f-46fb-a3b8-fd2bc3f5bc44 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.190355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc864ff-eb2f-46fb-a3b8-fd2bc3f5bc44 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.190355 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc864ff-eb2f-46fb-a3b8-fd2bc3f5bc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:00.218801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8bc864ff-eb2f-46fb-a3b8-fd2bc3f5bc44 None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:00.220220 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8bc864ff-eb2f-46fb-a3b8-fd2bc3f5bc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:00.231482 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4428/8859] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 19:17:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:00.243742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ce7f1-8b23-4545-aba3-0a1a23b9f706 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:00.255482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ce7f1-8b23-4545-aba3-0a1a23b9f706 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:00.262049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10e9c4-80dc-4a2c-b00c-b0e4a7a255e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:00.263182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10e9c4-80dc-4a2c-b00c-b0e4a7a255e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.263769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10e9c4-80dc-4a2c-b00c-b0e4a7a255e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.264221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10e9c4-80dc-4a2c-b00c-b0e4a7a255e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:00.281457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10e9c4-80dc-4a2c-b00c-b0e4a7a255e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:00.283079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10e9c4-80dc-4a2c-b00c-b0e4a7a255e5 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:00.296089 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4432/8860] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:00.509815 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096209a-efcd-47e9-ba6f-6ed1f33f4534 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.510221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096209a-efcd-47e9-ba6f-6ed1f33f4534 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.510508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096209a-efcd-47e9-ba6f-6ed1f33f4534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:00.531604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b096209a-efcd-47e9-ba6f-6ed1f33f4534 None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:00.532845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b096209a-efcd-47e9-ba6f-6ed1f33f4534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:00.543947 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4429/8861] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 19:17:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:00.555590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10e9c4-80dc-4a2c-b00c-b0e4a7a255e5 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:00.566625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10e9c4-80dc-4a2c-b00c-b0e4a7a255e5 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:00.571840 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5074c-9e4a-4842-8e64-e835e4598928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:00.572729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5074c-9e4a-4842-8e64-e835e4598928 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.573052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5074c-9e4a-4842-8e64-e835e4598928 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.573321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5074c-9e4a-4842-8e64-e835e4598928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:00.586384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5074c-9e4a-4842-8e64-e835e4598928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:00.588545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5074c-9e4a-4842-8e64-e835e4598928 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:00.600788 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4433/8862] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:03.704147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746037a-55d8-40db-a49d-9e56fde52dd9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:03.704804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746037a-55d8-40db-a49d-9e56fde52dd9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:03.704804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746037a-55d8-40db-a49d-9e56fde52dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:03.734907 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0746037a-55d8-40db-a49d-9e56fde52dd9 None None] MFA Rules not processed for user `fbe5e501574245ceb49d44ea056d1751`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:03.736730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0746037a-55d8-40db-a49d-9e56fde52dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:03.744983 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4430/8863] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:17:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:04.010884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5074c-9e4a-4842-8e64-e835e4598928 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:04.019994 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5074c-9e4a-4842-8e64-e835e4598928 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:04.024722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac1708-8c4a-4db6-9329-4069a3a3c412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:04.025426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac1708-8c4a-4db6-9329-4069a3a3c412 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:04.025714 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac1708-8c4a-4db6-9329-4069a3a3c412 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:04.026045 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac1708-8c4a-4db6-9329-4069a3a3c412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:04.028288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-65ac1708-8c4a-4db6-9329-4069a3a3c412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:04.041359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac1708-8c4a-4db6-9329-4069a3a3c412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:04.042808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac1708-8c4a-4db6-9329-4069a3a3c412 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:04.053640 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4434/8864] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:04.404976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746037a-55d8-40db-a49d-9e56fde52dd9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:04.406525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0746037a-55d8-40db-a49d-9e56fde52dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:04.478589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746037a-55d8-40db-a49d-9e56fde52dd9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:04.483723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e01d5-fec7-4295-9278-11084ef4ea35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:04.484348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e01d5-fec7-4295-9278-11084ef4ea35 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:04.484632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e01d5-fec7-4295-9278-11084ef4ea35 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:04.484906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e01d5-fec7-4295-9278-11084ef4ea35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:04.486641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-752e01d5-fec7-4295-9278-11084ef4ea35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:04.498510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e01d5-fec7-4295-9278-11084ef4ea35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:04.500138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e01d5-fec7-4295-9278-11084ef4ea35 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:04.510219 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4431/8865] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:07.693690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac1708-8c4a-4db6-9329-4069a3a3c412 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:07.709906 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac1708-8c4a-4db6-9329-4069a3a3c412 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:07.716041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18b33e-8ff2-4a62-9242-15f564d25651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:07.716657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18b33e-8ff2-4a62-9242-15f564d25651 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.716936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18b33e-8ff2-4a62-9242-15f564d25651 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.717247 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18b33e-8ff2-4a62-9242-15f564d25651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.719095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9f18b33e-8ff2-4a62-9242-15f564d25651 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:07.746039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18b33e-8ff2-4a62-9242-15f564d25651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:07.747708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18b33e-8ff2-4a62-9242-15f564d25651 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:07.766389 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4435/8866] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:14.505832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=54 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:17.754317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=33 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:18.120414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bee38e-e889-402a-9e04-88f23045dab4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:18.121087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bee38e-e889-402a-9e04-88f23045dab4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:18.121087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bee38e-e889-402a-9e04-88f23045dab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:18.142884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-95bee38e-e889-402a-9e04-88f23045dab4 None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:18.144141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-95bee38e-e889-402a-9e04-88f23045dab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:18.152251 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4432/8867] 10.222.0.45 () {58 vars in 1015 bytes} [Sun Aug 28 19:17:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:18.164269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18b33e-8ff2-4a62-9242-15f564d25651 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:18.174858 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18b33e-8ff2-4a62-9242-15f564d25651 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:18.179493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def1ea2-9b67-4b40-a788-ed85b906310a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:18.180136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def1ea2-9b67-4b40-a788-ed85b906310a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:18.180414 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def1ea2-9b67-4b40-a788-ed85b906310a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:18.180684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def1ea2-9b67-4b40-a788-ed85b906310a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:18.189140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def1ea2-9b67-4b40-a788-ed85b906310a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:18.190587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def1ea2-9b67-4b40-a788-ed85b906310a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:18.199068 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4436/8868] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:28.137658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:28.195476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:46.387178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf1c3d-bb72-4155-be85-e87098b760ca None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:46.387839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf1c3d-bb72-4155-be85-e87098b760ca None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:46.387839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf1c3d-bb72-4155-be85-e87098b760ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:46.439661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-13bf1c3d-bb72-4155-be85-e87098b760ca None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:46.440869 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13bf1c3d-bb72-4155-be85-e87098b760ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:46.479473 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4433/8869] 10.222.0.42 () {58 vars in 1015 bytes} [Sun Aug 28 19:17:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:46.516965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def1ea2-9b67-4b40-a788-ed85b906310a service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:46.550462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def1ea2-9b67-4b40-a788-ed85b906310a service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:46.559445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77991c8a-be7d-45f7-acb9-e457988b86cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:46.559863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77991c8a-be7d-45f7-acb9-e457988b86cd service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:46.560141 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77991c8a-be7d-45f7-acb9-e457988b86cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:46.560398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77991c8a-be7d-45f7-acb9-e457988b86cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:46.570673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77991c8a-be7d-45f7-acb9-e457988b86cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:46.572486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77991c8a-be7d-45f7-acb9-e457988b86cd service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:46.583211 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4437/8870] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:47.026521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037e5d-a707-46ca-b018-87244ba0caa7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:47.026916 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037e5d-a707-46ca-b018-87244ba0caa7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:47.027214 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037e5d-a707-46ca-b018-87244ba0caa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:47.050613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-06037e5d-a707-46ca-b018-87244ba0caa7 None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:47.052012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-06037e5d-a707-46ca-b018-87244ba0caa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:47.095839 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4434/8871] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 19:17:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:47.133236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77991c8a-be7d-45f7-acb9-e457988b86cd service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:47.148633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77991c8a-be7d-45f7-acb9-e457988b86cd service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:47.155588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef228cf-b583-40b1-b500-2db6cce92300 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:47.156209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef228cf-b583-40b1-b500-2db6cce92300 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:47.156483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef228cf-b583-40b1-b500-2db6cce92300 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:47.156891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef228cf-b583-40b1-b500-2db6cce92300 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:47.168092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef228cf-b583-40b1-b500-2db6cce92300 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:47.169888 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef228cf-b583-40b1-b500-2db6cce92300 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:47.181275 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4438/8872] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:53.424087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c97a29-973f-41e1-b297-a31a3ff53200 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:53.424658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c97a29-973f-41e1-b297-a31a3ff53200 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:53.424884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c97a29-973f-41e1-b297-a31a3ff53200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:53.450733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-86c97a29-973f-41e1-b297-a31a3ff53200 None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:53.452008 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-86c97a29-973f-41e1-b297-a31a3ff53200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:53.464166 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4435/8873] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 19:17:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:53.482813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef228cf-b583-40b1-b500-2db6cce92300 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:53.505972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef228cf-b583-40b1-b500-2db6cce92300 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:53.512014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92630ae8-8284-402f-85ff-bd1cc9e3c005 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:53.512629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92630ae8-8284-402f-85ff-bd1cc9e3c005 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:53.512969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92630ae8-8284-402f-85ff-bd1cc9e3c005 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:53.513242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92630ae8-8284-402f-85ff-bd1cc9e3c005 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:53.523398 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92630ae8-8284-402f-85ff-bd1cc9e3c005 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:53.525212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92630ae8-8284-402f-85ff-bd1cc9e3c005 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:53.536536 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4439/8874] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:18:03.445684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=45 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:03.531870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=27 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:04.023464 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04fbd-e445-44ba-8b78-d5ad85597fce None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:04.023874 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04fbd-e445-44ba-8b78-d5ad85597fce None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:04.024357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04fbd-e445-44ba-8b78-d5ad85597fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:04.059577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e6a04fbd-e445-44ba-8b78-d5ad85597fce None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:04.061068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e6a04fbd-e445-44ba-8b78-d5ad85597fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:04.083890 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4436/8875] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 19:18:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:04.087224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92630ae8-8284-402f-85ff-bd1cc9e3c005 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:04.099019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92630ae8-8284-402f-85ff-bd1cc9e3c005 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:04.101130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04fbd-e445-44ba-8b78-d5ad85597fce None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:04.104311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7eb59a-4e2f-46e5-9c9e-d03514c44e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:04.104956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eb59a-4e2f-46e5-9c9e-d03514c44e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:04.105314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eb59a-4e2f-46e5-9c9e-d03514c44e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:04.105588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eb59a-4e2f-46e5-9c9e-d03514c44e37 admin admin] PATH_INFO: `/v3/users/fbe5e501574245ceb49d44ea056d1751` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:04.106783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7eb59a-4e2f-46e5-9c9e-d03514c44e37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe5e501574245ceb49d44ea056d1751)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:04.108951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7eb59a-4e2f-46e5-9c9e-d03514c44e37 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:04.112861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04fbd-e445-44ba-8b78-d5ad85597fce None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:04.118468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf672c97-f151-4270-b57e-9c07f3820f4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:04.119037 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf672c97-f151-4270-b57e-9c07f3820f4f service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:04.119352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf672c97-f151-4270-b57e-9c07f3820f4f service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:04.119634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf672c97-f151-4270-b57e-9c07f3820f4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:04.128823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf672c97-f151-4270-b57e-9c07f3820f4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:04.130446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf672c97-f151-4270-b57e-9c07f3820f4f service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:04.140809 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4437/8876] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:18:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:18:04.168598 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf7eb59a-4e2f-46e5-9c9e-d03514c44e37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe5e501574245ceb49d44ea056d1751'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:04.183187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf7eb59a-4e2f-46e5-9c9e-d03514c44e37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe5e501574245ceb49d44ea056d1751'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:04.183966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf7eb59a-4e2f-46e5-9c9e-d03514c44e37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe5e501574245ceb49d44ea056d1751'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:04.184561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf7eb59a-4e2f-46e5-9c9e-d03514c44e37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe5e501574245ceb49d44ea056d1751'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:04.194170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf7eb59a-4e2f-46e5-9c9e-d03514c44e37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe5e501574245ceb49d44ea056d1751'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:04.206749 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4440/8877] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:18:04 2022] DELETE /identity/v3/users/fbe5e501574245ceb49d44ea056d1751 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:18:04.408633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf672c97-f151-4270-b57e-9c07f3820f4f service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:04.429069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf672c97-f151-4270-b57e-9c07f3820f4f service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:04.487823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c023083-555e-405b-ba76-f6d7bcd8ade2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:04.488497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c023083-555e-405b-ba76-f6d7bcd8ade2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:04.488739 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c023083-555e-405b-ba76-f6d7bcd8ade2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:04.489015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c023083-555e-405b-ba76-f6d7bcd8ade2 admin admin] PATH_INFO: `/v3/projects/28a843aadd6b40acb94d4008ab9c898a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:04.490202 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c023083-555e-405b-ba76-f6d7bcd8ade2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a843aadd6b40acb94d4008ab9c898a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:04.492226 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c023083-555e-405b-ba76-f6d7bcd8ade2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:04.541489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c023083-555e-405b-ba76-f6d7bcd8ade2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a843aadd6b40acb94d4008ab9c898a', 'request_id': 'req-3c023083-555e-405b-ba76-f6d7bcd8ade2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:04.550857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c023083-555e-405b-ba76-f6d7bcd8ade2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a843aadd6b40acb94d4008ab9c898a', 'request_id': 'req-3c023083-555e-405b-ba76-f6d7bcd8ade2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:04.557568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c023083-555e-405b-ba76-f6d7bcd8ade2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a843aadd6b40acb94d4008ab9c898a', 'request_id': 'req-3c023083-555e-405b-ba76-f6d7bcd8ade2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:04.569794 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c023083-555e-405b-ba76-f6d7bcd8ade2 admin admin] The token cache is being invalidate because project 28a843aadd6b40acb94d4008ab9c898a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:18:04.570081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c023083-555e-405b-ba76-f6d7bcd8ade2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:04.570957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c023083-555e-405b-ba76-f6d7bcd8ade2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:04.572720 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4438/8878] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:18:04 2022] DELETE /identity/v3/projects/28a843aadd6b40acb94d4008ab9c898a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:18:04.579619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f9f31-70cd-469e-9d70-23358a7d7175 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:04.580116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f9f31-70cd-469e-9d70-23358a7d7175 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:04.580116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f9f31-70cd-469e-9d70-23358a7d7175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:04.602744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2c4f9f31-70cd-469e-9d70-23358a7d7175 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:04.604024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2c4f9f31-70cd-469e-9d70-23358a7d7175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:04.678488 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4441/8879] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:18:04.688335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc87ba7-94b3-4912-bdfe-313851532106 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:04.688618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc87ba7-94b3-4912-bdfe-313851532106 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:04.688921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc87ba7-94b3-4912-bdfe-313851532106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:04.713648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dbc87ba7-94b3-4912-bdfe-313851532106 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:04.714911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dbc87ba7-94b3-4912-bdfe-313851532106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:04.725012 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4439/8880] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:04.730393 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f9f31-70cd-469e-9d70-23358a7d7175 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:04.747088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f9f31-70cd-469e-9d70-23358a7d7175 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:04.753845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9489c5-f346-48a7-83df-c69bc7819152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:04.754662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9489c5-f346-48a7-83df-c69bc7819152 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:04.754807 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9489c5-f346-48a7-83df-c69bc7819152 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:04.755054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9489c5-f346-48a7-83df-c69bc7819152 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:04.755708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9489c5-f346-48a7-83df-c69bc7819152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:18:04.756038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9489c5-f346-48a7-83df-c69bc7819152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:04.757808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9489c5-f346-48a7-83df-c69bc7819152 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:04.776080 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4442/8881] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:18:04.777020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc87ba7-94b3-4912-bdfe-313851532106 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:04.788431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc87ba7-94b3-4912-bdfe-313851532106 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:04.794583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d09d0-d415-45e9-a691-9d7a6573f8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:04.795265 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d09d0-d415-45e9-a691-9d7a6573f8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:04.795573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d09d0-d415-45e9-a691-9d7a6573f8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:04.795845 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d09d0-d415-45e9-a691-9d7a6573f8c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:04.796504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d09d0-d415-45e9-a691-9d7a6573f8c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:04.798574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d09d0-d415-45e9-a691-9d7a6573f8c2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:04.829479 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4440/8882] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:18:04 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:18:04.834016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9489c5-f346-48a7-83df-c69bc7819152 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:04.845870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9489c5-f346-48a7-83df-c69bc7819152 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:04.912964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fa0e1-016a-4cfe-8f14-c4eaf4f35dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:04.913590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fa0e1-016a-4cfe-8f14-c4eaf4f35dda admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:04.913866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fa0e1-016a-4cfe-8f14-c4eaf4f35dda admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:04.914136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fa0e1-016a-4cfe-8f14-c4eaf4f35dda admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:04.914788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fa0e1-016a-4cfe-8f14-c4eaf4f35dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:04.916890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fa0e1-016a-4cfe-8f14-c4eaf4f35dda admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:04.925265 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:04.944403 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4443/8883] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:18:04 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:18:04.945741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d09d0-d415-45e9-a691-9d7a6573f8c2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:04.957185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d09d0-d415-45e9-a691-9d7a6573f8c2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:04.962420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272875fe-fae1-4fd7-ae65-121e19e7da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:04.963046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272875fe-fae1-4fd7-ae65-121e19e7da99 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:04.963391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272875fe-fae1-4fd7-ae65-121e19e7da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:04.963665 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272875fe-fae1-4fd7-ae65-121e19e7da99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:04.964311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272875fe-fae1-4fd7-ae65-121e19e7da99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:04.965931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272875fe-fae1-4fd7-ae65-121e19e7da99 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:04.977067 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4441/8884] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:18:04.981325 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fa0e1-016a-4cfe-8f14-c4eaf4f35dda admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:04.992335 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fa0e1-016a-4cfe-8f14-c4eaf4f35dda admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:04.998016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae391dd-7a46-4381-9269-6820414be198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:04.998625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae391dd-7a46-4381-9269-6820414be198 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:04.998904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae391dd-7a46-4381-9269-6820414be198 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:04.999180 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae391dd-7a46-4381-9269-6820414be198 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:04.999850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae391dd-7a46-4381-9269-6820414be198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:05.001489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae391dd-7a46-4381-9269-6820414be198 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:05.013801 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4444/8885] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:18:05.018325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272875fe-fae1-4fd7-ae65-121e19e7da99 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:05.029190 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272875fe-fae1-4fd7-ae65-121e19e7da99 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:05.035164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45abe55-26af-492d-9dab-1e7e0b8121ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:05.035905 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45abe55-26af-492d-9dab-1e7e0b8121ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:05.036185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45abe55-26af-492d-9dab-1e7e0b8121ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:05.036458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45abe55-26af-492d-9dab-1e7e0b8121ad admin admin] PATH_INFO: `/v3/projects/febf6fc2e7394d788e55be6abcc5a01d/users/4ddd917cf4f74478892d020eb54a4990/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:05.045630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:05.054239 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45abe55-26af-492d-9dab-1e7e0b8121ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=febf6fc2e7394d788e55be6abcc5a01d, user_id=4ddd917cf4f74478892d020eb54a4990, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:05.057106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45abe55-26af-492d-9dab-1e7e0b8121ad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:05.073669 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4442/8886] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:18:05 2022] PUT /identity/v3/projects/febf6fc2e7394d788e55be6abcc5a01d/users/4ddd917cf4f74478892d020eb54a4990/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:18:05.079028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc011d1-b8e2-4269-8d34-c76c5e9d78f8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:05.079342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc011d1-b8e2-4269-8d34-c76c5e9d78f8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:05.079670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc011d1-b8e2-4269-8d34-c76c5e9d78f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:05.100602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ddc011d1-b8e2-4269-8d34-c76c5e9d78f8 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:05.101909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ddc011d1-b8e2-4269-8d34-c76c5e9d78f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:05.169207 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4445/8887] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:05.179897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45abe55-26af-492d-9dab-1e7e0b8121ad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:05.182991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c45abe55-26af-492d-9dab-1e7e0b8121ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:05.248928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45abe55-26af-492d-9dab-1e7e0b8121ad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:05.254437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcbdd8-fa1a-400b-a048-e80f56b8c595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:05.255058 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcbdd8-fa1a-400b-a048-e80f56b8c595 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:05.255358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcbdd8-fa1a-400b-a048-e80f56b8c595 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:05.256246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcbdd8-fa1a-400b-a048-e80f56b8c595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:05.268389 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcbdd8-fa1a-400b-a048-e80f56b8c595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:05.269860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcbdd8-fa1a-400b-a048-e80f56b8c595 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:05.279736 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4443/8888] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:18:09.194597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad819af0-8ba5-4ac5-95bb-1a568a6802b7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:09.195177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad819af0-8ba5-4ac5-95bb-1a568a6802b7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:09.195416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad819af0-8ba5-4ac5-95bb-1a568a6802b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:09.229518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ad819af0-8ba5-4ac5-95bb-1a568a6802b7 None None] MFA Rules not processed for user `4ddd917cf4f74478892d020eb54a4990`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:09.231618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ad819af0-8ba5-4ac5-95bb-1a568a6802b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:09.309180 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4446/8889] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:18:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:18:09.324109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcbdd8-fa1a-400b-a048-e80f56b8c595 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:09.325603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-67dcbdd8-fa1a-400b-a048-e80f56b8c595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:09.404599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcbdd8-fa1a-400b-a048-e80f56b8c595 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:09.410672 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8940a17-54f4-4336-8f19-a423657bec4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:09.411246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8940a17-54f4-4336-8f19-a423657bec4f service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:09.411558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8940a17-54f4-4336-8f19-a423657bec4f service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:09.411832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8940a17-54f4-4336-8f19-a423657bec4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:09.420721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8940a17-54f4-4336-8f19-a423657bec4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:09.422385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8940a17-54f4-4336-8f19-a423657bec4f service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:09.432785 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4444/8890] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:18:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:18:10.790788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f970491-6a0e-47b1-8a5f-82cc1f9f89a2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:10.791711 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f970491-6a0e-47b1-8a5f-82cc1f9f89a2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:10.791993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f970491-6a0e-47b1-8a5f-82cc1f9f89a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:10.815610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5f970491-6a0e-47b1-8a5f-82cc1f9f89a2 None None] MFA Rules not processed for user `4ddd917cf4f74478892d020eb54a4990`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:10.816915 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5f970491-6a0e-47b1-8a5f-82cc1f9f89a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:10.824930 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4447/8891] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:19.428259 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=65,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:20.807982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:41.920477 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8940a17-54f4-4336-8f19-a423657bec4f service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:41.922049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f8940a17-54f4-4336-8f19-a423657bec4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:42.002979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8940a17-54f4-4336-8f19-a423657bec4f service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:42.011454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee8543-9200-416d-97cd-110ecf10c436 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:42.012401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee8543-9200-416d-97cd-110ecf10c436 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:42.012736 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee8543-9200-416d-97cd-110ecf10c436 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:42.013070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee8543-9200-416d-97cd-110ecf10c436 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:42.016014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-92ee8543-9200-416d-97cd-110ecf10c436 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:42.031846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee8543-9200-416d-97cd-110ecf10c436 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:42.033463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee8543-9200-416d-97cd-110ecf10c436 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:42.044236 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4445/8892] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:19:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:19:52.039806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=32 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:56.468707 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5aca-9074-44f9-abec-5643e9512131 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.469446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5aca-9074-44f9-abec-5643e9512131 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.469738 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5aca-9074-44f9-abec-5643e9512131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.522838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6dbd5aca-9074-44f9-abec-5643e9512131 None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:56.524127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6dbd5aca-9074-44f9-abec-5643e9512131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:56.541431 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4448/8893] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 19:19:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:56.562368 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee8543-9200-416d-97cd-110ecf10c436 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.576174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee8543-9200-416d-97cd-110ecf10c436 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.582359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fad58-a8d8-43ed-a82f-f12137adf34b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.583630 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fad58-a8d8-43ed-a82f-f12137adf34b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.583963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fad58-a8d8-43ed-a82f-f12137adf34b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.584194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fad58-a8d8-43ed-a82f-f12137adf34b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.594710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fad58-a8d8-43ed-a82f-f12137adf34b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.596753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fad58-a8d8-43ed-a82f-f12137adf34b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.609790 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4446/8894] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:19:57.609344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd5aca-9074-44f9-abec-5643e9512131 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:57.611015 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6dbd5aca-9074-44f9-abec-5643e9512131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:57.626139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd5aca-9074-44f9-abec-5643e9512131 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:57.632468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5b863-b460-403e-9097-ba03814bb721 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:57.633109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5b863-b460-403e-9097-ba03814bb721 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:57.633388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5b863-b460-403e-9097-ba03814bb721 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:57.633660 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5b863-b460-403e-9097-ba03814bb721 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:57.635942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1bb5b863-b460-403e-9097-ba03814bb721 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:57.648152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5b863-b460-403e-9097-ba03814bb721 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:57.649823 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5b863-b460-403e-9097-ba03814bb721 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:57.659789 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4449/8895] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:19:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:20:06.604702 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:07.655625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=21 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:08.767804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166db0e-ce42-4819-bdce-6653e476e9be None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:08.768257 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166db0e-ce42-4819-bdce-6653e476e9be None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:08.768375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166db0e-ce42-4819-bdce-6653e476e9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:08.788341 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a166db0e-ce42-4819-bdce-6653e476e9be None None] MFA Rules not processed for user `4ddd917cf4f74478892d020eb54a4990`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:08.789594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a166db0e-ce42-4819-bdce-6653e476e9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:08.798110 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4447/8896] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:20:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:09.122666 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7e67c-ba6f-453b-a0fd-06c2d1d01397 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:09.123173 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7e67c-ba6f-453b-a0fd-06c2d1d01397 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:09.123343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7e67c-ba6f-453b-a0fd-06c2d1d01397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:09.156813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-28e7e67c-ba6f-453b-a0fd-06c2d1d01397 None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:09.158087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-28e7e67c-ba6f-453b-a0fd-06c2d1d01397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:09.169056 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4450/8897] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 19:20:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:09.181090 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166db0e-ce42-4819-bdce-6653e476e9be None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:09.182559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a166db0e-ce42-4819-bdce-6653e476e9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:09.194906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166db0e-ce42-4819-bdce-6653e476e9be None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:09.198518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3fe2e-8355-4368-8b07-20fe11278eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:09.199132 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3fe2e-8355-4368-8b07-20fe11278eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:09.199608 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3fe2e-8355-4368-8b07-20fe11278eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:09.199879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3fe2e-8355-4368-8b07-20fe11278eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:09.208063 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3fe2e-8355-4368-8b07-20fe11278eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:09.209729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3fe2e-8355-4368-8b07-20fe11278eb4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:09.218647 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4448/8898] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:20:19.153047 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:19.214707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:52.201116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7e67c-ba6f-453b-a0fd-06c2d1d01397 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:52.214547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7e67c-ba6f-453b-a0fd-06c2d1d01397 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:52.221068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16261682-a4a6-45fb-a738-6e2bccea476a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:52.221685 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16261682-a4a6-45fb-a738-6e2bccea476a service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:52.221946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16261682-a4a6-45fb-a738-6e2bccea476a service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:52.222214 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16261682-a4a6-45fb-a738-6e2bccea476a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:52.224291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-16261682-a4a6-45fb-a738-6e2bccea476a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:52.236351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16261682-a4a6-45fb-a738-6e2bccea476a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:52.237940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16261682-a4a6-45fb-a738-6e2bccea476a service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:52.248871 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4451/8899] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:02.244192 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:48.409557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f00cb-fc4e-477b-9c08-38650054e101 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:48.410332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f00cb-fc4e-477b-9c08-38650054e101 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:48.410332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f00cb-fc4e-477b-9c08-38650054e101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:48.434351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-340f00cb-fc4e-477b-9c08-38650054e101 None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:48.435696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-340f00cb-fc4e-477b-9c08-38650054e101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:48.443217 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4449/8900] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 19:21:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:48.454821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16261682-a4a6-45fb-a738-6e2bccea476a service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:48.465547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16261682-a4a6-45fb-a738-6e2bccea476a service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:48.469367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb297c-70fc-4273-8116-9dc9febaa1ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:48.469974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb297c-70fc-4273-8116-9dc9febaa1ec service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:48.470454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb297c-70fc-4273-8116-9dc9febaa1ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:48.470732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb297c-70fc-4273-8116-9dc9febaa1ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:48.479862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb297c-70fc-4273-8116-9dc9febaa1ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:48.481238 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb297c-70fc-4273-8116-9dc9febaa1ec service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:48.491316 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4452/8901] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:48.576009 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f00cb-fc4e-477b-9c08-38650054e101 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:48.588515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f00cb-fc4e-477b-9c08-38650054e101 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:48.594062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5472e-3429-4e29-93e1-709bf3a3f792 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:48.594676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5472e-3429-4e29-93e1-709bf3a3f792 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:48.594958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5472e-3429-4e29-93e1-709bf3a3f792 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:48.595234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5472e-3429-4e29-93e1-709bf3a3f792 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:48.596965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ec5472e-3429-4e29-93e1-709bf3a3f792 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:48.609358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5472e-3429-4e29-93e1-709bf3a3f792 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:48.610918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5472e-3429-4e29-93e1-709bf3a3f792 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:48.621712 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4450/8902] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:48.827246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb297c-70fc-4273-8116-9dc9febaa1ec service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:48.837413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb297c-70fc-4273-8116-9dc9febaa1ec service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:48.841909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e774932-c106-4218-8916-057718bc653e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:48.842567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e774932-c106-4218-8916-057718bc653e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:48.842839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e774932-c106-4218-8916-057718bc653e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:48.843237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e774932-c106-4218-8916-057718bc653e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:48.845257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1e774932-c106-4218-8916-057718bc653e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:48.862641 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e774932-c106-4218-8916-057718bc653e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:48.864066 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e774932-c106-4218-8916-057718bc653e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:48.878091 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4453/8903] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:58.617198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:58.870195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=12 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:59.600765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5472e-3429-4e29-93e1-709bf3a3f792 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:59.614686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5472e-3429-4e29-93e1-709bf3a3f792 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:59.621103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df63b2-6d49-4c32-82ba-6c5ce9a14600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:59.621792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df63b2-6d49-4c32-82ba-6c5ce9a14600 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:59.622317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df63b2-6d49-4c32-82ba-6c5ce9a14600 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:59.622844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df63b2-6d49-4c32-82ba-6c5ce9a14600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:59.625104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-22df63b2-6d49-4c32-82ba-6c5ce9a14600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:59.641284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df63b2-6d49-4c32-82ba-6c5ce9a14600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:59.642745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df63b2-6d49-4c32-82ba-6c5ce9a14600 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:59.655124 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4451/8904] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:01.020367 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e774932-c106-4218-8916-057718bc653e service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:01.030042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e774932-c106-4218-8916-057718bc653e service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:01.034726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ad74a-a3ea-471d-8745-e2ec4a530832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:01.035362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ad74a-a3ea-471d-8745-e2ec4a530832 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:01.035642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ad74a-a3ea-471d-8745-e2ec4a530832 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:01.035909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ad74a-a3ea-471d-8745-e2ec4a530832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:01.037998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6d2ad74a-a3ea-471d-8745-e2ec4a530832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:01.052337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ad74a-a3ea-471d-8745-e2ec4a530832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:01.053721 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ad74a-a3ea-471d-8745-e2ec4a530832 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:01.064905 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4454/8905] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:07.602235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a2976-1666-43ea-bde6-c8fda1ddca7d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:07.602927 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a2976-1666-43ea-bde6-c8fda1ddca7d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:07.603228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a2976-1666-43ea-bde6-c8fda1ddca7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:07.624125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f15a2976-1666-43ea-bde6-c8fda1ddca7d None None] MFA Rules not processed for user `4ddd917cf4f74478892d020eb54a4990`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:07.625324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f15a2976-1666-43ea-bde6-c8fda1ddca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:07.632901 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4452/8906] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:22:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:08.306509 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ad74a-a3ea-471d-8745-e2ec4a530832 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:08.324082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ad74a-a3ea-471d-8745-e2ec4a530832 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:08.329433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c907252-2d4b-4cba-9ae0-08140410dc6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:08.330099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c907252-2d4b-4cba-9ae0-08140410dc6f service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:08.330380 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c907252-2d4b-4cba-9ae0-08140410dc6f service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:08.330655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c907252-2d4b-4cba-9ae0-08140410dc6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:08.332611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3c907252-2d4b-4cba-9ae0-08140410dc6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:08.346565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c907252-2d4b-4cba-9ae0-08140410dc6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:08.348447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c907252-2d4b-4cba-9ae0-08140410dc6f service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:08.359667 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4455/8907] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:17.094337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a2976-1666-43ea-bde6-c8fda1ddca7d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:17.106585 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a2976-1666-43ea-bde6-c8fda1ddca7d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:17.112922 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876ed10-44a6-4072-8979-42f588379b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:17.113587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876ed10-44a6-4072-8979-42f588379b70 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:17.113871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876ed10-44a6-4072-8979-42f588379b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:17.114148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876ed10-44a6-4072-8979-42f588379b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:17.116370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0876ed10-44a6-4072-8979-42f588379b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:17.127488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876ed10-44a6-4072-8979-42f588379b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:17.128963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876ed10-44a6-4072-8979-42f588379b70 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:17.138023 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4453/8908] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:18.354955 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=12 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:27.133955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=15 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:36.057586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c907252-2d4b-4cba-9ae0-08140410dc6f service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:36.073168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c907252-2d4b-4cba-9ae0-08140410dc6f service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:36.080531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e3e20-74ad-452d-b8fd-9f2ba9ca25f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:36.081159 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e3e20-74ad-452d-b8fd-9f2ba9ca25f8 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:36.081436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e3e20-74ad-452d-b8fd-9f2ba9ca25f8 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:36.081708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e3e20-74ad-452d-b8fd-9f2ba9ca25f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:36.090795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e3e20-74ad-452d-b8fd-9f2ba9ca25f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:36.092452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e3e20-74ad-452d-b8fd-9f2ba9ca25f8 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:36.102678 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4456/8909] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:23:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:23:46.098131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:05.949821 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876ed10-44a6-4072-8979-42f588379b70 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:05.959732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876ed10-44a6-4072-8979-42f588379b70 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:05.964528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022f48a-2366-4ce3-963f-50fed716ee36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:05.965168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f48a-2366-4ce3-963f-50fed716ee36 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:05.965444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f48a-2366-4ce3-963f-50fed716ee36 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:05.965720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f48a-2366-4ce3-963f-50fed716ee36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:05.967941 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6022f48a-2366-4ce3-963f-50fed716ee36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:05.978647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022f48a-2366-4ce3-963f-50fed716ee36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:05.980111 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022f48a-2366-4ce3-963f-50fed716ee36 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:05.989195 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4454/8910] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:24:06.504081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e3e20-74ad-452d-b8fd-9f2ba9ca25f8 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:06.505546 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7b5e3e20-74ad-452d-b8fd-9f2ba9ca25f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:06.522534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e3e20-74ad-452d-b8fd-9f2ba9ca25f8 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:06.529278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb685c-ede7-4286-ba3e-4871bdbd3668 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:06.529925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb685c-ede7-4286-ba3e-4871bdbd3668 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:06.530200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb685c-ede7-4286-ba3e-4871bdbd3668 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:06.530470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb685c-ede7-4286-ba3e-4871bdbd3668 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:06.532547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7cfb685c-ede7-4286-ba3e-4871bdbd3668 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:06.546129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb685c-ede7-4286-ba3e-4871bdbd3668 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:06.547929 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb685c-ede7-4286-ba3e-4871bdbd3668 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:06.571762 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4457/8911] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:24:13.206077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022f48a-2366-4ce3-963f-50fed716ee36 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:13.221061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022f48a-2366-4ce3-963f-50fed716ee36 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:13.227681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331702e-78c8-4425-9b7b-ad6990a3bd4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:13.228311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331702e-78c8-4425-9b7b-ad6990a3bd4f service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:13.228625 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331702e-78c8-4425-9b7b-ad6990a3bd4f service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:13.228865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331702e-78c8-4425-9b7b-ad6990a3bd4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:13.230772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4331702e-78c8-4425-9b7b-ad6990a3bd4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:13.246806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331702e-78c8-4425-9b7b-ad6990a3bd4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:13.248444 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331702e-78c8-4425-9b7b-ad6990a3bd4f service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:13.259795 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4455/8912] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:24:16.555055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:23.255523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=12 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:25.482431 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab1e58-2a3d-4611-9e2c-48aad5f4272a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:25.482936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab1e58-2a3d-4611-9e2c-48aad5f4272a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:25.483198 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab1e58-2a3d-4611-9e2c-48aad5f4272a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:25.507907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8fab1e58-2a3d-4611-9e2c-48aad5f4272a None None] MFA Rules not processed for user `4ddd917cf4f74478892d020eb54a4990`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:25.509221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8fab1e58-2a3d-4611-9e2c-48aad5f4272a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:25.517685 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4458/8913] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:24:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:25.893893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddb892-4c3d-45b3-a74d-b8bf94fd41be None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:25.894743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddb892-4c3d-45b3-a74d-b8bf94fd41be None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:25.894743 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddb892-4c3d-45b3-a74d-b8bf94fd41be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:25.916734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f8ddb892-4c3d-45b3-a74d-b8bf94fd41be None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:25.917973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f8ddb892-4c3d-45b3-a74d-b8bf94fd41be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:25.925841 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4456/8914] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 19:24:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:25.938035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab1e58-2a3d-4611-9e2c-48aad5f4272a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:25.948693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab1e58-2a3d-4611-9e2c-48aad5f4272a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:25.952385 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bde35f-db87-4135-add4-14b99a42fbed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:25.952993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bde35f-db87-4135-add4-14b99a42fbed service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:25.953270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bde35f-db87-4135-add4-14b99a42fbed service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:25.953632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bde35f-db87-4135-add4-14b99a42fbed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:25.961044 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bde35f-db87-4135-add4-14b99a42fbed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:25.962517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bde35f-db87-4135-add4-14b99a42fbed service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:25.970828 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4459/8915] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:24:35.910618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:35.967023 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=9 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:45.738496 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddb892-4c3d-45b3-a74d-b8bf94fd41be None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:45.751825 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddb892-4c3d-45b3-a74d-b8bf94fd41be None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:45.758509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1ee86-312b-42d0-a9e1-535a4342c829 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:45.759131 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1ee86-312b-42d0-a9e1-535a4342c829 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:45.759442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1ee86-312b-42d0-a9e1-535a4342c829 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:45.759719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1ee86-312b-42d0-a9e1-535a4342c829 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:45.772438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1ee86-312b-42d0-a9e1-535a4342c829 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:45.774166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1ee86-312b-42d0-a9e1-535a4342c829 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:45.785447 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4457/8916] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:25:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:25:55.259907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bde35f-db87-4135-add4-14b99a42fbed service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:55.274445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bde35f-db87-4135-add4-14b99a42fbed service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:55.281439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8351e-bea2-4e5f-8edc-573aae119b86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:55.282573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8351e-bea2-4e5f-8edc-573aae119b86 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:55.282573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8351e-bea2-4e5f-8edc-573aae119b86 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:55.282573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8351e-bea2-4e5f-8edc-573aae119b86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:55.293170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8351e-bea2-4e5f-8edc-573aae119b86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:55.294603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8351e-bea2-4e5f-8edc-573aae119b86 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:55.305904 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4460/8917] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:25:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:25:55.780572 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:26:04.261275 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1ee86-312b-42d0-a9e1-535a4342c829 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:04.274566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1ee86-312b-42d0-a9e1-535a4342c829 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:04.279809 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3909b43-cff1-4dfe-a927-9adc8c8f5e7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:04.280419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3909b43-cff1-4dfe-a927-9adc8c8f5e7e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:04.280692 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3909b43-cff1-4dfe-a927-9adc8c8f5e7e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:04.280982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3909b43-cff1-4dfe-a927-9adc8c8f5e7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:04.289304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3909b43-cff1-4dfe-a927-9adc8c8f5e7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:04.290771 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3909b43-cff1-4dfe-a927-9adc8c8f5e7e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:04.299190 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4458/8918] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:26:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:26:04.771290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8351e-bea2-4e5f-8edc-573aae119b86 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:04.783522 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8351e-bea2-4e5f-8edc-573aae119b86 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:04.788816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87c733-c760-4d86-9c67-d91797a986e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:04.789421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87c733-c760-4d86-9c67-d91797a986e0 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:04.789702 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87c733-c760-4d86-9c67-d91797a986e0 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:04.789987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87c733-c760-4d86-9c67-d91797a986e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:04.798961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87c733-c760-4d86-9c67-d91797a986e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:04.800600 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87c733-c760-4d86-9c67-d91797a986e0 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:04.811058 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4461/8919] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:26:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:26:14.295591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:26:14.806520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=12 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:26:21.694837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3909b43-cff1-4dfe-a927-9adc8c8f5e7e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:21.709738 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3909b43-cff1-4dfe-a927-9adc8c8f5e7e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:21.715834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b51d00-c724-443e-b976-2cb8c5f498bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:21.716471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b51d00-c724-443e-b976-2cb8c5f498bf service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:21.716833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b51d00-c724-443e-b976-2cb8c5f498bf service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:21.717013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b51d00-c724-443e-b976-2cb8c5f498bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:21.726718 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b51d00-c724-443e-b976-2cb8c5f498bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:21.728836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b51d00-c724-443e-b976-2cb8c5f498bf service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:21.744569 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4459/8920] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:26:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:26:31.739751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:00.389079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87c733-c760-4d86-9c67-d91797a986e0 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:00.400607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87c733-c760-4d86-9c67-d91797a986e0 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:00.405083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202f877-cd1b-4247-9653-a0d25c2bf37d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:00.405696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202f877-cd1b-4247-9653-a0d25c2bf37d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:00.405976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202f877-cd1b-4247-9653-a0d25c2bf37d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:00.406249 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202f877-cd1b-4247-9653-a0d25c2bf37d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:00.418091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202f877-cd1b-4247-9653-a0d25c2bf37d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:00.419659 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202f877-cd1b-4247-9653-a0d25c2bf37d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:00.432398 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4462/8921] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:00.681775 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b51d00-c724-443e-b976-2cb8c5f498bf service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:00.693829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b51d00-c724-443e-b976-2cb8c5f498bf service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:00.698511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbccc6-ea2d-45d0-9362-356dcdbaa397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:00.699133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbccc6-ea2d-45d0-9362-356dcdbaa397 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:00.699460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbccc6-ea2d-45d0-9362-356dcdbaa397 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:00.699732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbccc6-ea2d-45d0-9362-356dcdbaa397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:00.711334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbccc6-ea2d-45d0-9362-356dcdbaa397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:00.712786 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbccc6-ea2d-45d0-9362-356dcdbaa397 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:00.724823 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4460/8922] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:10.426880 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:10.719228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:13.603133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202f877-cd1b-4247-9653-a0d25c2bf37d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:13.614879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202f877-cd1b-4247-9653-a0d25c2bf37d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:13.619336 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ecde4c-0637-4b44-9e43-b19cd5ad73b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:13.619957 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecde4c-0637-4b44-9e43-b19cd5ad73b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:13.620382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecde4c-0637-4b44-9e43-b19cd5ad73b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:13.620651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecde4c-0637-4b44-9e43-b19cd5ad73b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:13.631572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ecde4c-0637-4b44-9e43-b19cd5ad73b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:13.633024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ecde4c-0637-4b44-9e43-b19cd5ad73b0 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:13.666421 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4463/8923] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:17.299243 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34a747-942b-4593-bfa9-2a4a1a757611 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:17.299873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34a747-942b-4593-bfa9-2a4a1a757611 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:17.299873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34a747-942b-4593-bfa9-2a4a1a757611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:17.364303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8e34a747-942b-4593-bfa9-2a4a1a757611 None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:17.365589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8e34a747-942b-4593-bfa9-2a4a1a757611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:17.373731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ecde4c-0637-4b44-9e43-b19cd5ad73b0 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:17.379322 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4461/8924] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 19:27:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:17.391138 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34a747-942b-4593-bfa9-2a4a1a757611 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:17.392252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ecde4c-0637-4b44-9e43-b19cd5ad73b0 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:17.400486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df132a5-e7df-485c-9f38-624ac3b037fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:17.401251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df132a5-e7df-485c-9f38-624ac3b037fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:17.401528 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df132a5-e7df-485c-9f38-624ac3b037fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:17.401835 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df132a5-e7df-485c-9f38-624ac3b037fe admin admin] PATH_INFO: `/v3/users/4ddd917cf4f74478892d020eb54a4990` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:17.403017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df132a5-e7df-485c-9f38-624ac3b037fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ddd917cf4f74478892d020eb54a4990)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:17.405168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df132a5-e7df-485c-9f38-624ac3b037fe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:17.406316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34a747-942b-4593-bfa9-2a4a1a757611 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:17.417559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1f76a-6ee9-4220-991f-c422e18ab679 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:17.418317 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1f76a-6ee9-4220-991f-c422e18ab679 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:17.418467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1f76a-6ee9-4220-991f-c422e18ab679 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:17.418737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1f76a-6ee9-4220-991f-c422e18ab679 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:17.429930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1f76a-6ee9-4220-991f-c422e18ab679 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:17.432304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1f76a-6ee9-4220-991f-c422e18ab679 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:17.444282 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4462/8925] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:27:17.475954 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0df132a5-e7df-485c-9f38-624ac3b037fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ddd917cf4f74478892d020eb54a4990'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:17.491060 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0df132a5-e7df-485c-9f38-624ac3b037fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ddd917cf4f74478892d020eb54a4990'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:17.492910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0df132a5-e7df-485c-9f38-624ac3b037fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ddd917cf4f74478892d020eb54a4990'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:17.493736 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0df132a5-e7df-485c-9f38-624ac3b037fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ddd917cf4f74478892d020eb54a4990'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:17.501479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0df132a5-e7df-485c-9f38-624ac3b037fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ddd917cf4f74478892d020eb54a4990'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:17.515907 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4464/8926] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:27:17 2022] DELETE /identity/v3/users/4ddd917cf4f74478892d020eb54a4990 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:27:17.706816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1f76a-6ee9-4220-991f-c422e18ab679 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:17.719768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1f76a-6ee9-4220-991f-c422e18ab679 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:17.794865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195be43-2040-4b2a-b5b2-a1a8f6a072dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:17.795468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195be43-2040-4b2a-b5b2-a1a8f6a072dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:17.795749 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195be43-2040-4b2a-b5b2-a1a8f6a072dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:17.796025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195be43-2040-4b2a-b5b2-a1a8f6a072dc admin admin] PATH_INFO: `/v3/projects/febf6fc2e7394d788e55be6abcc5a01d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:17.797185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195be43-2040-4b2a-b5b2-a1a8f6a072dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=febf6fc2e7394d788e55be6abcc5a01d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:17.799125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195be43-2040-4b2a-b5b2-a1a8f6a072dc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:17.850930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2195be43-2040-4b2a-b5b2-a1a8f6a072dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'febf6fc2e7394d788e55be6abcc5a01d', 'request_id': 'req-2195be43-2040-4b2a-b5b2-a1a8f6a072dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:17.861148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2195be43-2040-4b2a-b5b2-a1a8f6a072dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'febf6fc2e7394d788e55be6abcc5a01d', 'request_id': 'req-2195be43-2040-4b2a-b5b2-a1a8f6a072dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:17.867552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2195be43-2040-4b2a-b5b2-a1a8f6a072dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'febf6fc2e7394d788e55be6abcc5a01d', 'request_id': 'req-2195be43-2040-4b2a-b5b2-a1a8f6a072dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:17.893489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2195be43-2040-4b2a-b5b2-a1a8f6a072dc admin admin] The token cache is being invalidate because project febf6fc2e7394d788e55be6abcc5a01d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:27:17.893744 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2195be43-2040-4b2a-b5b2-a1a8f6a072dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:17.894425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2195be43-2040-4b2a-b5b2-a1a8f6a072dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:17.896054 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4463/8927] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:27:17 2022] DELETE /identity/v3/projects/febf6fc2e7394d788e55be6abcc5a01d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:27:17.901484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabb7aa-81a5-44b6-a0ea-4fa761159e9f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:17.901883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabb7aa-81a5-44b6-a0ea-4fa761159e9f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:17.902109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabb7aa-81a5-44b6-a0ea-4fa761159e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:17.963708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9eabb7aa-81a5-44b6-a0ea-4fa761159e9f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:17.964935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9eabb7aa-81a5-44b6-a0ea-4fa761159e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:18.036996 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4465/8928] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:18.045851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cca59-e0d4-49aa-886a-27ff3b98d200 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:18.046080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cca59-e0d4-49aa-886a-27ff3b98d200 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:18.046386 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cca59-e0d4-49aa-886a-27ff3b98d200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:18.067829 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5e4cca59-e0d4-49aa-886a-27ff3b98d200 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:18.069064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e4cca59-e0d4-49aa-886a-27ff3b98d200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:18.077495 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4464/8929] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:18.081898 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabb7aa-81a5-44b6-a0ea-4fa761159e9f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:18.091982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabb7aa-81a5-44b6-a0ea-4fa761159e9f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:18.097158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8eb66-0343-4ec2-b1cf-0f375fb93c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:18.097769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8eb66-0343-4ec2-b1cf-0f375fb93c97 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:18.098054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8eb66-0343-4ec2-b1cf-0f375fb93c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:18.098329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8eb66-0343-4ec2-b1cf-0f375fb93c97 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:18.098992 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8eb66-0343-4ec2-b1cf-0f375fb93c97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:27:18.099322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8eb66-0343-4ec2-b1cf-0f375fb93c97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:18.100950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8eb66-0343-4ec2-b1cf-0f375fb93c97 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:18.114061 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4466/8930] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:27:18.118885 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cca59-e0d4-49aa-886a-27ff3b98d200 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:18.128727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cca59-e0d4-49aa-886a-27ff3b98d200 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:18.134903 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63a725-328d-45d0-9ef9-400224221cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:18.135555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63a725-328d-45d0-9ef9-400224221cdf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:18.135833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63a725-328d-45d0-9ef9-400224221cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:18.136104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63a725-328d-45d0-9ef9-400224221cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:18.136753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63a725-328d-45d0-9ef9-400224221cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:18.138683 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63a725-328d-45d0-9ef9-400224221cdf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:18.172717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:18.181588 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4465/8931] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:27:18 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:27:18.185944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8eb66-0343-4ec2-b1cf-0f375fb93c97 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:18.196842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8eb66-0343-4ec2-b1cf-0f375fb93c97 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:18.201900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:18.262845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83157a0-2e1a-49a9-b56e-fea50ccee15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:18.263693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83157a0-2e1a-49a9-b56e-fea50ccee15f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:18.264103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83157a0-2e1a-49a9-b56e-fea50ccee15f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:18.264468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83157a0-2e1a-49a9-b56e-fea50ccee15f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:18.265586 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83157a0-2e1a-49a9-b56e-fea50ccee15f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:18.267596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83157a0-2e1a-49a9-b56e-fea50ccee15f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:18.291893 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4467/8932] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:27:18 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:27:18.297210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63a725-328d-45d0-9ef9-400224221cdf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:18.308774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63a725-328d-45d0-9ef9-400224221cdf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:18.314233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf093dd0-9e2a-4b47-b34a-aba26e4ba8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:18.314861 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf093dd0-9e2a-4b47-b34a-aba26e4ba8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:18.315141 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf093dd0-9e2a-4b47-b34a-aba26e4ba8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:18.315461 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf093dd0-9e2a-4b47-b34a-aba26e4ba8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:18.316142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf093dd0-9e2a-4b47-b34a-aba26e4ba8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:18.317914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf093dd0-9e2a-4b47-b34a-aba26e4ba8e0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:18.329763 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4466/8933] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:27:18.334129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83157a0-2e1a-49a9-b56e-fea50ccee15f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:18.345473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83157a0-2e1a-49a9-b56e-fea50ccee15f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:18.350982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0b45a-6179-4ed3-a87d-998f389d0d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:18.351642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0b45a-6179-4ed3-a87d-998f389d0d54 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:18.351909 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0b45a-6179-4ed3-a87d-998f389d0d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:18.352187 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0b45a-6179-4ed3-a87d-998f389d0d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:18.352837 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0b45a-6179-4ed3-a87d-998f389d0d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:18.354471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0b45a-6179-4ed3-a87d-998f389d0d54 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:18.366975 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4468/8934] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:27:18.372088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf093dd0-9e2a-4b47-b34a-aba26e4ba8e0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:18.385631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf093dd0-9e2a-4b47-b34a-aba26e4ba8e0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:18.391007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089da122-3d97-448e-9283-4f0a2296f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:18.391766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089da122-3d97-448e-9283-4f0a2296f951 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:18.392045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089da122-3d97-448e-9283-4f0a2296f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:18.392320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089da122-3d97-448e-9283-4f0a2296f951 admin admin] PATH_INFO: `/v3/projects/b31fdeee86d443fa807ad786ec75c203/users/ddf8cefb0c6e4679a98d110675f0281d/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:18.408172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089da122-3d97-448e-9283-4f0a2296f951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31fdeee86d443fa807ad786ec75c203, user_id=ddf8cefb0c6e4679a98d110675f0281d, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:18.410857 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089da122-3d97-448e-9283-4f0a2296f951 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:18.426516 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4467/8935] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:27:18 2022] PUT /identity/v3/projects/b31fdeee86d443fa807ad786ec75c203/users/ddf8cefb0c6e4679a98d110675f0281d/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:27:18.431890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f8e56-ed5a-4d2e-8ec7-62bd607f4b55 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:18.432525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f8e56-ed5a-4d2e-8ec7-62bd607f4b55 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:18.432525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f8e56-ed5a-4d2e-8ec7-62bd607f4b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:18.453561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-798f8e56-ed5a-4d2e-8ec7-62bd607f4b55 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:18.454808 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-798f8e56-ed5a-4d2e-8ec7-62bd607f4b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:18.520447 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4469/8936] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:27:18.531232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089da122-3d97-448e-9283-4f0a2296f951 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:18.533144 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-089da122-3d97-448e-9283-4f0a2296f951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:18.597597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089da122-3d97-448e-9283-4f0a2296f951 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:18.601942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f60126-5c13-42d1-a3cc-3e9ad8e16e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:18.602570 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f60126-5c13-42d1-a3cc-3e9ad8e16e6e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:18.602858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f60126-5c13-42d1-a3cc-3e9ad8e16e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:18.603134 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f60126-5c13-42d1-a3cc-3e9ad8e16e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:18.612820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f60126-5c13-42d1-a3cc-3e9ad8e16e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:18.614306 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f60126-5c13-42d1-a3cc-3e9ad8e16e6e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:18.624181 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4468/8937] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:23.503913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a5686-1939-4583-afda-b526fad3195f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:23.504783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a5686-1939-4583-afda-b526fad3195f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:23.505126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a5686-1939-4583-afda-b526fad3195f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:23.543479 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-404a5686-1939-4583-afda-b526fad3195f None None] MFA Rules not processed for user `ddf8cefb0c6e4679a98d110675f0281d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:23.544749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-404a5686-1939-4583-afda-b526fad3195f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:23.623704 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4470/8938] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:27:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:23.633967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e44283-be77-4543-a654-cb620b379050 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:23.634762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e44283-be77-4543-a654-cb620b379050 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:23.634762 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e44283-be77-4543-a654-cb620b379050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:23.663437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d5e44283-be77-4543-a654-cb620b379050 None None] MFA Rules not processed for user `ddf8cefb0c6e4679a98d110675f0281d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:23.664678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5e44283-be77-4543-a654-cb620b379050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:23.672677 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4469/8939] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:27:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:27:23.692074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a5686-1939-4583-afda-b526fad3195f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:23.693853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-404a5686-1939-4583-afda-b526fad3195f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:23.730869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:23.812895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a5686-1939-4583-afda-b526fad3195f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:23.821664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d961b4-dd8c-4a6c-add3-df16da5322ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:23.822642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d961b4-dd8c-4a6c-add3-df16da5322ff service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:23.823086 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d961b4-dd8c-4a6c-add3-df16da5322ff service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:23.823582 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d961b4-dd8c-4a6c-add3-df16da5322ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:23.837463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d961b4-dd8c-4a6c-add3-df16da5322ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:23.840219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d961b4-dd8c-4a6c-add3-df16da5322ff service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:23.850992 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4471/8940] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:24.494495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e44283-be77-4543-a654-cb620b379050 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:24.496061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5e44283-be77-4543-a654-cb620b379050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:24.576207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e44283-be77-4543-a654-cb620b379050 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:24.581200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e6339-9c74-4583-8c14-301b72f3ee04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:24.581832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e6339-9c74-4583-8c14-301b72f3ee04 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:24.582174 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e6339-9c74-4583-8c14-301b72f3ee04 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:24.582456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e6339-9c74-4583-8c14-301b72f3ee04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:24.584208 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-739e6339-9c74-4583-8c14-301b72f3ee04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:24.597271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e6339-9c74-4583-8c14-301b72f3ee04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:24.598897 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e6339-9c74-4583-8c14-301b72f3ee04 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:24.609753 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4470/8941] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:26.612019 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d961b4-dd8c-4a6c-add3-df16da5322ff service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:26.615052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-71d961b4-dd8c-4a6c-add3-df16da5322ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:26.628575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d961b4-dd8c-4a6c-add3-df16da5322ff service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:26.632440 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd875bd-4335-4303-a0f2-6461ed78063b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:26.633302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd875bd-4335-4303-a0f2-6461ed78063b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:26.633788 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd875bd-4335-4303-a0f2-6461ed78063b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:26.634063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd875bd-4335-4303-a0f2-6461ed78063b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:26.636067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2bd875bd-4335-4303-a0f2-6461ed78063b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:26.648985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd875bd-4335-4303-a0f2-6461ed78063b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:26.650642 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd875bd-4335-4303-a0f2-6461ed78063b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:26.665101 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4472/8942] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:34.604792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=76,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:36.465832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a45edd-a3ca-430e-a543-5344f0400189 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:36.466741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a45edd-a3ca-430e-a543-5344f0400189 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:36.466741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a45edd-a3ca-430e-a543-5344f0400189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:36.488069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-48a45edd-a3ca-430e-a543-5344f0400189 None None] MFA Rules not processed for user `ddf8cefb0c6e4679a98d110675f0281d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:36.489435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48a45edd-a3ca-430e-a543-5344f0400189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:36.497407 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4471/8943] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:27:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:36.657553 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=32 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:46.482283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:01.246560 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd875bd-4335-4303-a0f2-6461ed78063b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:01.248387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2bd875bd-4335-4303-a0f2-6461ed78063b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:01.309812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a45edd-a3ca-430e-a543-5344f0400189 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:01.338038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd875bd-4335-4303-a0f2-6461ed78063b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:01.343475 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6a692-cccb-4543-bc38-8db78d036c29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:01.344092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6a692-cccb-4543-bc38-8db78d036c29 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:01.344377 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6a692-cccb-4543-bc38-8db78d036c29 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:01.344654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6a692-cccb-4543-bc38-8db78d036c29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:01.346511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-62f6a692-cccb-4543-bc38-8db78d036c29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:01.354524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a45edd-a3ca-430e-a543-5344f0400189 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:01.359388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57565d04-71fa-4f40-8e53-8ccf10538203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:01.359663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6a692-cccb-4543-bc38-8db78d036c29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:01.360025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57565d04-71fa-4f40-8e53-8ccf10538203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:01.360302 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57565d04-71fa-4f40-8e53-8ccf10538203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:01.360574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57565d04-71fa-4f40-8e53-8ccf10538203 admin admin] PATH_INFO: `/v3/users/ddf8cefb0c6e4679a98d110675f0281d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:01.361277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6a692-cccb-4543-bc38-8db78d036c29 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:01.361707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57565d04-71fa-4f40-8e53-8ccf10538203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf8cefb0c6e4679a98d110675f0281d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:01.363979 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57565d04-71fa-4f40-8e53-8ccf10538203 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:01.371638 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4473/8944] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:28:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:28:01.415695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-57565d04-71fa-4f40-8e53-8ccf10538203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf8cefb0c6e4679a98d110675f0281d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:01.416426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-57565d04-71fa-4f40-8e53-8ccf10538203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf8cefb0c6e4679a98d110675f0281d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:01.423733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-57565d04-71fa-4f40-8e53-8ccf10538203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf8cefb0c6e4679a98d110675f0281d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:01.433026 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-57565d04-71fa-4f40-8e53-8ccf10538203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf8cefb0c6e4679a98d110675f0281d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:01.445068 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-57565d04-71fa-4f40-8e53-8ccf10538203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf8cefb0c6e4679a98d110675f0281d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:01.451138 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4472/8945] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:28:01 2022] DELETE /identity/v3/users/ddf8cefb0c6e4679a98d110675f0281d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:28:01.640551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6a692-cccb-4543-bc38-8db78d036c29 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:01.653351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6a692-cccb-4543-bc38-8db78d036c29 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:01.714519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee286b-39d4-4100-ae74-d06a4edef656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:01.715165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee286b-39d4-4100-ae74-d06a4edef656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:01.715483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee286b-39d4-4100-ae74-d06a4edef656 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:01.715763 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee286b-39d4-4100-ae74-d06a4edef656 admin admin] PATH_INFO: `/v3/projects/b31fdeee86d443fa807ad786ec75c203` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:01.716945 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee286b-39d4-4100-ae74-d06a4edef656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b31fdeee86d443fa807ad786ec75c203)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:01.718849 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee286b-39d4-4100-ae74-d06a4edef656 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:01.769379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3ee286b-39d4-4100-ae74-d06a4edef656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b31fdeee86d443fa807ad786ec75c203', 'request_id': 'req-f3ee286b-39d4-4100-ae74-d06a4edef656'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:01.777680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3ee286b-39d4-4100-ae74-d06a4edef656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b31fdeee86d443fa807ad786ec75c203', 'request_id': 'req-f3ee286b-39d4-4100-ae74-d06a4edef656'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:01.783821 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3ee286b-39d4-4100-ae74-d06a4edef656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b31fdeee86d443fa807ad786ec75c203', 'request_id': 'req-f3ee286b-39d4-4100-ae74-d06a4edef656'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:01.803587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3ee286b-39d4-4100-ae74-d06a4edef656 admin admin] The token cache is being invalidate because project b31fdeee86d443fa807ad786ec75c203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:28:01.803872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3ee286b-39d4-4100-ae74-d06a4edef656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:01.804587 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f3ee286b-39d4-4100-ae74-d06a4edef656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:01.806161 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4474/8946] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:28:01 2022] DELETE /identity/v3/projects/b31fdeee86d443fa807ad786ec75c203 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:01.812573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bedcd9-edb6-4545-8d09-f960edb4b12d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:01.813049 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bedcd9-edb6-4545-8d09-f960edb4b12d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:01.813522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bedcd9-edb6-4545-8d09-f960edb4b12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:01.835025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-50bedcd9-edb6-4545-8d09-f960edb4b12d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:01.836301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-50bedcd9-edb6-4545-8d09-f960edb4b12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:01.899518 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4473/8947] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:01.908155 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4366c-6af7-412e-95d5-941c5814519b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:01.908445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4366c-6af7-412e-95d5-941c5814519b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:01.908720 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4366c-6af7-412e-95d5-941c5814519b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:01.928693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a0e4366c-6af7-412e-95d5-941c5814519b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:01.929907 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a0e4366c-6af7-412e-95d5-941c5814519b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:01.939210 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4475/8948] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:01.944010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bedcd9-edb6-4545-8d09-f960edb4b12d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:01.954349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bedcd9-edb6-4545-8d09-f960edb4b12d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:01.959548 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b89583-9362-4f18-a19b-ee3f5feb878b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:01.960152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b89583-9362-4f18-a19b-ee3f5feb878b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:01.960429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b89583-9362-4f18-a19b-ee3f5feb878b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:01.960699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b89583-9362-4f18-a19b-ee3f5feb878b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:01.961342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b89583-9362-4f18-a19b-ee3f5feb878b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:01.961641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b89583-9362-4f18-a19b-ee3f5feb878b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:01.963273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b89583-9362-4f18-a19b-ee3f5feb878b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:01.975221 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4474/8949] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:01.979783 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4366c-6af7-412e-95d5-941c5814519b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:01.989337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4366c-6af7-412e-95d5-941c5814519b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:01.994372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34ccfa-e457-4467-a274-988b57b5e014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:01.995002 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34ccfa-e457-4467-a274-988b57b5e014 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:01.995281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34ccfa-e457-4467-a274-988b57b5e014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:01.995568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34ccfa-e457-4467-a274-988b57b5e014 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:01.996193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34ccfa-e457-4467-a274-988b57b5e014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:01.998082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34ccfa-e457-4467-a274-988b57b5e014 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:02.023285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:02.034375 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4476/8950] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:28:01 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:02.040312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b89583-9362-4f18-a19b-ee3f5feb878b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:02.050944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b89583-9362-4f18-a19b-ee3f5feb878b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:02.101800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:02.122016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33267bfa-cc2f-498c-b6d2-a40dd1a82eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:02.122632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267bfa-cc2f-498c-b6d2-a40dd1a82eec admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:02.122917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267bfa-cc2f-498c-b6d2-a40dd1a82eec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:02.123200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267bfa-cc2f-498c-b6d2-a40dd1a82eec admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:02.123967 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33267bfa-cc2f-498c-b6d2-a40dd1a82eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:02.125930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33267bfa-cc2f-498c-b6d2-a40dd1a82eec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:02.150019 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4475/8951] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:28:02 2022] POST /identity/v3/users => generated 284 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:28:02.154520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34ccfa-e457-4467-a274-988b57b5e014 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:02.165569 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34ccfa-e457-4467-a274-988b57b5e014 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:02.171717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c206c-bb94-4861-857a-0f46b341cde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:02.172308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c206c-bb94-4861-857a-0f46b341cde5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:02.172581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c206c-bb94-4861-857a-0f46b341cde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:02.172847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c206c-bb94-4861-857a-0f46b341cde5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:02.173489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c206c-bb94-4861-857a-0f46b341cde5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:02.175237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c206c-bb94-4861-857a-0f46b341cde5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:02.186683 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4477/8952] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:28:02.190983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33267bfa-cc2f-498c-b6d2-a40dd1a82eec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:02.202149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33267bfa-cc2f-498c-b6d2-a40dd1a82eec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:02.207573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e919365-d2a7-48d7-b223-da6627b929aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:02.208188 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919365-d2a7-48d7-b223-da6627b929aa admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:02.208467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919365-d2a7-48d7-b223-da6627b929aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:02.208742 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919365-d2a7-48d7-b223-da6627b929aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:02.209392 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e919365-d2a7-48d7-b223-da6627b929aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:02.211007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e919365-d2a7-48d7-b223-da6627b929aa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:02.222727 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4476/8953] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:28:02.227757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c206c-bb94-4861-857a-0f46b341cde5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:02.238531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c206c-bb94-4861-857a-0f46b341cde5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:02.244353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14678c-d976-44bc-99e0-cccd160b1afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:02.245009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14678c-d976-44bc-99e0-cccd160b1afa admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:02.245291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14678c-d976-44bc-99e0-cccd160b1afa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:02.245567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14678c-d976-44bc-99e0-cccd160b1afa admin admin] PATH_INFO: `/v3/projects/6a873c0194b941c899759cbab0130e2b/users/7e4dc3883b3240f58149518ac77682a0/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:02.264032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14678c-d976-44bc-99e0-cccd160b1afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a873c0194b941c899759cbab0130e2b, user_id=7e4dc3883b3240f58149518ac77682a0, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:02.267102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14678c-d976-44bc-99e0-cccd160b1afa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:02.287370 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4478/8954] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:28:02 2022] PUT /identity/v3/projects/6a873c0194b941c899759cbab0130e2b/users/7e4dc3883b3240f58149518ac77682a0/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:02.298262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43284856-4205-4ebf-aea3-152f95866a0a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:02.298573 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43284856-4205-4ebf-aea3-152f95866a0a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:02.298849 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43284856-4205-4ebf-aea3-152f95866a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:02.329445 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-43284856-4205-4ebf-aea3-152f95866a0a None None] MFA Rules not processed for user `7e4dc3883b3240f58149518ac77682a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:02.330678 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-43284856-4205-4ebf-aea3-152f95866a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:02.400678 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4477/8955] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:28:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:02.411830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14678c-d976-44bc-99e0-cccd160b1afa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:02.413673 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c14678c-d976-44bc-99e0-cccd160b1afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:02.487550 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14678c-d976-44bc-99e0-cccd160b1afa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:02.491760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ffb68-1320-4aa2-a7ea-67f6a6a8fb3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:02.492384 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ffb68-1320-4aa2-a7ea-67f6a6a8fb3f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:02.492651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ffb68-1320-4aa2-a7ea-67f6a6a8fb3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:02.492921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ffb68-1320-4aa2-a7ea-67f6a6a8fb3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:02.501607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ffb68-1320-4aa2-a7ea-67f6a6a8fb3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:02.503039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ffb68-1320-4aa2-a7ea-67f6a6a8fb3f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:02.511971 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4479/8956] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:28:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:28:12.397217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=47,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:12.508020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=45,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:14.982784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43284856-4205-4ebf-aea3-152f95866a0a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:15.056964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43284856-4205-4ebf-aea3-152f95866a0a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:15.061981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1028959-1461-44b4-8dc6-e6726f3e6195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:15.062690 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1028959-1461-44b4-8dc6-e6726f3e6195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:15.062954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1028959-1461-44b4-8dc6-e6726f3e6195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:15.063289 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1028959-1461-44b4-8dc6-e6726f3e6195 admin admin] PATH_INFO: `/v3/users/7e4dc3883b3240f58149518ac77682a0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:15.065462 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1028959-1461-44b4-8dc6-e6726f3e6195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e4dc3883b3240f58149518ac77682a0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:15.068304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1028959-1461-44b4-8dc6-e6726f3e6195 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:15.140382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1028959-1461-44b4-8dc6-e6726f3e6195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e4dc3883b3240f58149518ac77682a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:15.141194 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1028959-1461-44b4-8dc6-e6726f3e6195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e4dc3883b3240f58149518ac77682a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:15.155988 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1028959-1461-44b4-8dc6-e6726f3e6195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e4dc3883b3240f58149518ac77682a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:15.168860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1028959-1461-44b4-8dc6-e6726f3e6195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e4dc3883b3240f58149518ac77682a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:15.184425 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1028959-1461-44b4-8dc6-e6726f3e6195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e4dc3883b3240f58149518ac77682a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:15.190987 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4478/8957] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:28:14 2022] DELETE /identity/v3/users/7e4dc3883b3240f58149518ac77682a0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:15.196781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59cc80-6878-45e5-bc7d-2f4d767ccace None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:15.198230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59cc80-6878-45e5-bc7d-2f4d767ccace None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:15.198484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59cc80-6878-45e5-bc7d-2f4d767ccace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:15.220795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ca59cc80-6878-45e5-bc7d-2f4d767ccace None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:15.222364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ca59cc80-6878-45e5-bc7d-2f4d767ccace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:15.292741 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4480/8958] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:15.302956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1028959-1461-44b4-8dc6-e6726f3e6195 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:15.304750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c1028959-1461-44b4-8dc6-e6726f3e6195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:15.369674 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1028959-1461-44b4-8dc6-e6726f3e6195 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:15.374088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e6520-1685-47ed-86a2-6ca05544b79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:15.374634 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e6520-1685-47ed-86a2-6ca05544b79a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:15.374910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e6520-1685-47ed-86a2-6ca05544b79a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:15.375183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e6520-1685-47ed-86a2-6ca05544b79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:15.385867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e6520-1685-47ed-86a2-6ca05544b79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:15.387382 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e6520-1685-47ed-86a2-6ca05544b79a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:15.399101 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4479/8959] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:28:15.610032 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59cc80-6878-45e5-bc7d-2f4d767ccace None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:15.611573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ca59cc80-6878-45e5-bc7d-2f4d767ccace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:15.623804 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59cc80-6878-45e5-bc7d-2f4d767ccace None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:15.628651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ae60b-4b6b-4fde-9cd3-69083c94c429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:15.629286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae60b-4b6b-4fde-9cd3-69083c94c429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:15.629568 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae60b-4b6b-4fde-9cd3-69083c94c429 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:15.629844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae60b-4b6b-4fde-9cd3-69083c94c429 admin admin] PATH_INFO: `/v3/projects/6a873c0194b941c899759cbab0130e2b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:15.636839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ae60b-4b6b-4fde-9cd3-69083c94c429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a873c0194b941c899759cbab0130e2b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:15.639520 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ae60b-4b6b-4fde-9cd3-69083c94c429 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:15.691930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd0ae60b-4b6b-4fde-9cd3-69083c94c429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a873c0194b941c899759cbab0130e2b', 'request_id': 'req-fd0ae60b-4b6b-4fde-9cd3-69083c94c429'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:15.698590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd0ae60b-4b6b-4fde-9cd3-69083c94c429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a873c0194b941c899759cbab0130e2b', 'request_id': 'req-fd0ae60b-4b6b-4fde-9cd3-69083c94c429'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:15.704773 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd0ae60b-4b6b-4fde-9cd3-69083c94c429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a873c0194b941c899759cbab0130e2b', 'request_id': 'req-fd0ae60b-4b6b-4fde-9cd3-69083c94c429'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:15.719069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd0ae60b-4b6b-4fde-9cd3-69083c94c429 admin admin] The token cache is being invalidate because project 6a873c0194b941c899759cbab0130e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:28:15.719411 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd0ae60b-4b6b-4fde-9cd3-69083c94c429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:15.720063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd0ae60b-4b6b-4fde-9cd3-69083c94c429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:15.721785 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4481/8960] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:28:15 2022] DELETE /identity/v3/projects/6a873c0194b941c899759cbab0130e2b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:15.727269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55666a-7e39-4595-b954-9807be19e00d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:15.727564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55666a-7e39-4595-b954-9807be19e00d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:15.727847 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55666a-7e39-4595-b954-9807be19e00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:15.748737 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1c55666a-7e39-4595-b954-9807be19e00d None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:15.750460 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c55666a-7e39-4595-b954-9807be19e00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:15.769607 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:15.818683 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4480/8961] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:15.826394 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7062-c632-4238-a14b-49b5da5b9d0b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:15.826677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7062-c632-4238-a14b-49b5da5b9d0b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:15.826950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7062-c632-4238-a14b-49b5da5b9d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:15.847941 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-011f7062-c632-4238-a14b-49b5da5b9d0b None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:15.849167 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-011f7062-c632-4238-a14b-49b5da5b9d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:15.857638 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4482/8962] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:15.862066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55666a-7e39-4595-b954-9807be19e00d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:15.872366 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55666a-7e39-4595-b954-9807be19e00d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:15.877221 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a797818-4a85-4b27-926f-3f589e8e9f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:15.877792 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a797818-4a85-4b27-926f-3f589e8e9f8f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:15.878070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a797818-4a85-4b27-926f-3f589e8e9f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:15.878340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a797818-4a85-4b27-926f-3f589e8e9f8f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:15.879020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a797818-4a85-4b27-926f-3f589e8e9f8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:15.879376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a797818-4a85-4b27-926f-3f589e8e9f8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:15.881010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a797818-4a85-4b27-926f-3f589e8e9f8f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:15.895245 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4481/8963] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:15.900271 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7062-c632-4238-a14b-49b5da5b9d0b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:15.910518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7062-c632-4238-a14b-49b5da5b9d0b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:15.916126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea3517-5581-4c3f-811a-0a4029208355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:15.916742 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea3517-5581-4c3f-811a-0a4029208355 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:15.917022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea3517-5581-4c3f-811a-0a4029208355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:15.917294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea3517-5581-4c3f-811a-0a4029208355 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:15.917946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea3517-5581-4c3f-811a-0a4029208355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:15.919931 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea3517-5581-4c3f-811a-0a4029208355 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:15.962620 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4483/8964] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:28:15 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:15.966034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a797818-4a85-4b27-926f-3f589e8e9f8f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:15.977410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a797818-4a85-4b27-926f-3f589e8e9f8f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:16.037061 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2bba5-bb43-47c7-ba58-8deb1cc6f8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:16.037842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2bba5-bb43-47c7-ba58-8deb1cc6f8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:16.037944 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2bba5-bb43-47c7-ba58-8deb1cc6f8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:16.038216 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2bba5-bb43-47c7-ba58-8deb1cc6f8d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:16.038871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2bba5-bb43-47c7-ba58-8deb1cc6f8d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:16.040893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2bba5-bb43-47c7-ba58-8deb1cc6f8d4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:16.066116 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4482/8965] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:28:15 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:16.067452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea3517-5581-4c3f-811a-0a4029208355 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:16.078347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea3517-5581-4c3f-811a-0a4029208355 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:16.083365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95257cc-5ec3-402b-a7d4-c0c7252d88c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:16.083982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95257cc-5ec3-402b-a7d4-c0c7252d88c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:16.084262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95257cc-5ec3-402b-a7d4-c0c7252d88c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:16.084540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95257cc-5ec3-402b-a7d4-c0c7252d88c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:16.085193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95257cc-5ec3-402b-a7d4-c0c7252d88c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:16.086845 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95257cc-5ec3-402b-a7d4-c0c7252d88c4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:16.098284 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4484/8966] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:28:16.102408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2bba5-bb43-47c7-ba58-8deb1cc6f8d4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:16.113039 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2bba5-bb43-47c7-ba58-8deb1cc6f8d4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:16.118303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adf94f-277e-46ee-8661-7b8e65030ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:16.118920 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adf94f-277e-46ee-8661-7b8e65030ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:16.119225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adf94f-277e-46ee-8661-7b8e65030ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:16.119626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adf94f-277e-46ee-8661-7b8e65030ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:16.120283 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adf94f-277e-46ee-8661-7b8e65030ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:16.121976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adf94f-277e-46ee-8661-7b8e65030ad3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:16.132467 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4483/8967] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:28:16.136799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95257cc-5ec3-402b-a7d4-c0c7252d88c4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:16.148232 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95257cc-5ec3-402b-a7d4-c0c7252d88c4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:16.154050 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0863ce8-5639-4674-9c8f-344a476870ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:16.154725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0863ce8-5639-4674-9c8f-344a476870ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:16.155004 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0863ce8-5639-4674-9c8f-344a476870ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:16.155293 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0863ce8-5639-4674-9c8f-344a476870ab admin admin] PATH_INFO: `/v3/projects/08cd99d2a64247d2badbf0714bdc0d6b/users/df4754ff713f4075a1b49d2b2bf6eef5/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:16.171630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0863ce8-5639-4674-9c8f-344a476870ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=08cd99d2a64247d2badbf0714bdc0d6b, user_id=df4754ff713f4075a1b49d2b2bf6eef5, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:16.174354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0863ce8-5639-4674-9c8f-344a476870ab admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:16.192409 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4485/8968] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:28:16 2022] PUT /identity/v3/projects/08cd99d2a64247d2badbf0714bdc0d6b/users/df4754ff713f4075a1b49d2b2bf6eef5/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:28:16.205075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e419b7-45ec-46c1-8806-3d060482ae61 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:16.205347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e419b7-45ec-46c1-8806-3d060482ae61 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:16.205687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e419b7-45ec-46c1-8806-3d060482ae61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:16.240450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-80e419b7-45ec-46c1-8806-3d060482ae61 None None] MFA Rules not processed for user `df4754ff713f4075a1b49d2b2bf6eef5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:16.241701 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80e419b7-45ec-46c1-8806-3d060482ae61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:16.318065 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4484/8969] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:28:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:16.328323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0863ce8-5639-4674-9c8f-344a476870ab admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:16.330236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d0863ce8-5639-4674-9c8f-344a476870ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:16.353952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:16.393208 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0863ce8-5639-4674-9c8f-344a476870ab admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:16.397315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f170cfa-9e60-4b09-85c0-08dff891ad02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:16.397952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f170cfa-9e60-4b09-85c0-08dff891ad02 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:16.398229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f170cfa-9e60-4b09-85c0-08dff891ad02 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:16.398501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f170cfa-9e60-4b09-85c0-08dff891ad02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:16.408056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f170cfa-9e60-4b09-85c0-08dff891ad02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:16.409559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f170cfa-9e60-4b09-85c0-08dff891ad02 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:16.419420 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4486/8970] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:28:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:28:20.754168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e419b7-45ec-46c1-8806-3d060482ae61 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:20.782442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:20.831337 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e419b7-45ec-46c1-8806-3d060482ae61 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:20.837463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95200939-224a-494c-a61d-eabffbf1b564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:20.838182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95200939-224a-494c-a61d-eabffbf1b564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:20.838482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95200939-224a-494c-a61d-eabffbf1b564 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:20.838759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95200939-224a-494c-a61d-eabffbf1b564 admin admin] PATH_INFO: `/v3/users/df4754ff713f4075a1b49d2b2bf6eef5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:20.840006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95200939-224a-494c-a61d-eabffbf1b564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df4754ff713f4075a1b49d2b2bf6eef5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:20.842030 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95200939-224a-494c-a61d-eabffbf1b564 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:20.893770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-95200939-224a-494c-a61d-eabffbf1b564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df4754ff713f4075a1b49d2b2bf6eef5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:20.894491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-95200939-224a-494c-a61d-eabffbf1b564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df4754ff713f4075a1b49d2b2bf6eef5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:20.903724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-95200939-224a-494c-a61d-eabffbf1b564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df4754ff713f4075a1b49d2b2bf6eef5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:20.915291 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-95200939-224a-494c-a61d-eabffbf1b564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df4754ff713f4075a1b49d2b2bf6eef5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:20.933124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-95200939-224a-494c-a61d-eabffbf1b564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df4754ff713f4075a1b49d2b2bf6eef5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:20.939890 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4485/8971] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:28:20 2022] DELETE /identity/v3/users/df4754ff713f4075a1b49d2b2bf6eef5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:20.944534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19ca6-f361-49c4-8721-b4b286d6c756 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:20.945038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19ca6-f361-49c4-8721-b4b286d6c756 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:20.945038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19ca6-f361-49c4-8721-b4b286d6c756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:20.966878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b2d19ca6-f361-49c4-8721-b4b286d6c756 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:20.968139 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b2d19ca6-f361-49c4-8721-b4b286d6c756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:21.041348 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4487/8972] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:21.052534 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95200939-224a-494c-a61d-eabffbf1b564 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:21.054146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-95200939-224a-494c-a61d-eabffbf1b564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:21.117383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95200939-224a-494c-a61d-eabffbf1b564 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:21.121387 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433eb80e-be3d-4581-a034-6875fb2cf836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:21.122034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433eb80e-be3d-4581-a034-6875fb2cf836 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:21.122315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433eb80e-be3d-4581-a034-6875fb2cf836 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:21.122592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433eb80e-be3d-4581-a034-6875fb2cf836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:21.133529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433eb80e-be3d-4581-a034-6875fb2cf836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:21.135159 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433eb80e-be3d-4581-a034-6875fb2cf836 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:21.147384 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4486/8973] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:28:21.355224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d19ca6-f361-49c4-8721-b4b286d6c756 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:21.357260 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b2d19ca6-f361-49c4-8721-b4b286d6c756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:21.371351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d19ca6-f361-49c4-8721-b4b286d6c756 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:21.378752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e5dea-c2b8-4475-983b-3407a29278fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:21.379404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e5dea-c2b8-4475-983b-3407a29278fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:21.379688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e5dea-c2b8-4475-983b-3407a29278fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:21.379964 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e5dea-c2b8-4475-983b-3407a29278fa admin admin] PATH_INFO: `/v3/projects/08cd99d2a64247d2badbf0714bdc0d6b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:21.381327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e5dea-c2b8-4475-983b-3407a29278fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=08cd99d2a64247d2badbf0714bdc0d6b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:21.383416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e5dea-c2b8-4475-983b-3407a29278fa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:21.440263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6b9e5dea-c2b8-4475-983b-3407a29278fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08cd99d2a64247d2badbf0714bdc0d6b', 'request_id': 'req-6b9e5dea-c2b8-4475-983b-3407a29278fa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:21.449462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6b9e5dea-c2b8-4475-983b-3407a29278fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08cd99d2a64247d2badbf0714bdc0d6b', 'request_id': 'req-6b9e5dea-c2b8-4475-983b-3407a29278fa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:21.457599 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6b9e5dea-c2b8-4475-983b-3407a29278fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08cd99d2a64247d2badbf0714bdc0d6b', 'request_id': 'req-6b9e5dea-c2b8-4475-983b-3407a29278fa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:21.474839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6b9e5dea-c2b8-4475-983b-3407a29278fa admin admin] The token cache is being invalidate because project 08cd99d2a64247d2badbf0714bdc0d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:28:21.475131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6b9e5dea-c2b8-4475-983b-3407a29278fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:21.475869 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6b9e5dea-c2b8-4475-983b-3407a29278fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:21.477475 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4488/8974] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:28:21 2022] DELETE /identity/v3/projects/08cd99d2a64247d2badbf0714bdc0d6b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:21.483225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab594-58c4-4b19-aa34-96c8411a67fc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:21.483580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab594-58c4-4b19-aa34-96c8411a67fc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:21.483939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab594-58c4-4b19-aa34-96c8411a67fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:21.505408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d5dab594-58c4-4b19-aa34-96c8411a67fc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:21.506646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5dab594-58c4-4b19-aa34-96c8411a67fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:21.550390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:21.584504 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4487/8975] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:21.594423 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a7c39-a0af-4afc-b567-082291034853 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:21.594704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a7c39-a0af-4afc-b567-082291034853 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:21.594986 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a7c39-a0af-4afc-b567-082291034853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:21.617780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-591a7c39-a0af-4afc-b567-082291034853 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:21.619021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-591a7c39-a0af-4afc-b567-082291034853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:21.628754 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4489/8976] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:21.633546 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dab594-58c4-4b19-aa34-96c8411a67fc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:21.645276 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dab594-58c4-4b19-aa34-96c8411a67fc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:21.656687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11738b-fb0d-4aa4-a221-63d834fc00c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:21.657488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11738b-fb0d-4aa4-a221-63d834fc00c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:21.657488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11738b-fb0d-4aa4-a221-63d834fc00c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:21.657906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11738b-fb0d-4aa4-a221-63d834fc00c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:21.658574 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11738b-fb0d-4aa4-a221-63d834fc00c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:21.658962 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11738b-fb0d-4aa4-a221-63d834fc00c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:21.661292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11738b-fb0d-4aa4-a221-63d834fc00c7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:21.674603 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4488/8977] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:21.679525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a7c39-a0af-4afc-b567-082291034853 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:21.690136 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a7c39-a0af-4afc-b567-082291034853 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:21.695910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84440fa8-5fdb-455c-89e6-8b80cb5d98f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:21.696561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84440fa8-5fdb-455c-89e6-8b80cb5d98f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:21.696841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84440fa8-5fdb-455c-89e6-8b80cb5d98f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:21.697111 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84440fa8-5fdb-455c-89e6-8b80cb5d98f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:21.697758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84440fa8-5fdb-455c-89e6-8b80cb5d98f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:21.700323 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84440fa8-5fdb-455c-89e6-8b80cb5d98f5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:21.739064 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4490/8978] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:28:21 2022] POST /identity/v3/projects => generated 389 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:21.743639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11738b-fb0d-4aa4-a221-63d834fc00c7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:21.754779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11738b-fb0d-4aa4-a221-63d834fc00c7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:21.818298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f11ec7-205a-4c91-82ad-8edaeb59118c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:21.818934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f11ec7-205a-4c91-82ad-8edaeb59118c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:21.819212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f11ec7-205a-4c91-82ad-8edaeb59118c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:21.819524 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f11ec7-205a-4c91-82ad-8edaeb59118c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:21.820191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f11ec7-205a-4c91-82ad-8edaeb59118c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:21.822133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f11ec7-205a-4c91-82ad-8edaeb59118c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:21.844962 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4489/8979] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:28:21 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:21.849483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84440fa8-5fdb-455c-89e6-8b80cb5d98f5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:21.860379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84440fa8-5fdb-455c-89e6-8b80cb5d98f5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:21.866236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9c12d-1df6-4a14-aaa5-ee9232acd95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:21.866854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9c12d-1df6-4a14-aaa5-ee9232acd95a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:21.867133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9c12d-1df6-4a14-aaa5-ee9232acd95a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:21.867436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9c12d-1df6-4a14-aaa5-ee9232acd95a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:21.868100 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9c12d-1df6-4a14-aaa5-ee9232acd95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:21.870144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9c12d-1df6-4a14-aaa5-ee9232acd95a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:21.887002 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4491/8980] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:28:21.888299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f11ec7-205a-4c91-82ad-8edaeb59118c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:21.900092 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f11ec7-205a-4c91-82ad-8edaeb59118c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:21.905539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a94be-29a0-4b1a-8b78-11ea54c2add5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:21.906228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a94be-29a0-4b1a-8b78-11ea54c2add5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:21.906504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a94be-29a0-4b1a-8b78-11ea54c2add5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:21.906763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a94be-29a0-4b1a-8b78-11ea54c2add5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:21.907458 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a94be-29a0-4b1a-8b78-11ea54c2add5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:21.909145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a94be-29a0-4b1a-8b78-11ea54c2add5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:21.920903 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4490/8981] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:28:21.926009 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9c12d-1df6-4a14-aaa5-ee9232acd95a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:21.937461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9c12d-1df6-4a14-aaa5-ee9232acd95a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:21.943113 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc27f40-8118-44d5-b73a-c0af1fc19ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:21.943826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc27f40-8118-44d5-b73a-c0af1fc19ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:21.944107 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc27f40-8118-44d5-b73a-c0af1fc19ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:21.944383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc27f40-8118-44d5-b73a-c0af1fc19ddb admin admin] PATH_INFO: `/v3/projects/7acec5978d124e97857adfcbebed1471/users/60bd4ff77a584948930710f0ba78cd66/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:21.946854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:21.963800 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc27f40-8118-44d5-b73a-c0af1fc19ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7acec5978d124e97857adfcbebed1471, user_id=60bd4ff77a584948930710f0ba78cd66, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:21.966443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc27f40-8118-44d5-b73a-c0af1fc19ddb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:21.980969 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4492/8982] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:28:21 2022] PUT /identity/v3/projects/7acec5978d124e97857adfcbebed1471/users/60bd4ff77a584948930710f0ba78cd66/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:21.986303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6bd4-d671-4b03-b220-df3d2867de07 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:21.986593 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6bd4-d671-4b03-b220-df3d2867de07 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:21.986871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6bd4-d671-4b03-b220-df3d2867de07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:22.006555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1dfe6bd4-d671-4b03-b220-df3d2867de07 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:22.007823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1dfe6bd4-d671-4b03-b220-df3d2867de07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:22.074191 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4491/8983] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:22.084358 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc27f40-8118-44d5-b73a-c0af1fc19ddb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:22.086364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5fc27f40-8118-44d5-b73a-c0af1fc19ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:22.147618 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc27f40-8118-44d5-b73a-c0af1fc19ddb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:22.151811 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10f3f5-244c-4b39-b009-b7d42a1843d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:22.152421 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10f3f5-244c-4b39-b009-b7d42a1843d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:22.152699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10f3f5-244c-4b39-b009-b7d42a1843d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:22.152970 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10f3f5-244c-4b39-b009-b7d42a1843d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:22.163722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10f3f5-244c-4b39-b009-b7d42a1843d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:22.165194 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10f3f5-244c-4b39-b009-b7d42a1843d3 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:22.176091 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4493/8984] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:28:27.038942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c33f58-bccf-4b3d-a93f-066f0763d32f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:27.039471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c33f58-bccf-4b3d-a93f-066f0763d32f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:27.039471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c33f58-bccf-4b3d-a93f-066f0763d32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:27.068733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-86c33f58-bccf-4b3d-a93f-066f0763d32f None None] MFA Rules not processed for user `60bd4ff77a584948930710f0ba78cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:27.069891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-86c33f58-bccf-4b3d-a93f-066f0763d32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:27.109114 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:27.150005 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4492/8985] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:28:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:27.156196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10f3f5-244c-4b39-b009-b7d42a1843d3 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:27.167976 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10f3f5-244c-4b39-b009-b7d42a1843d3 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:27.172988 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3929555-4270-4db1-9f95-d3fbf9fa9f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:27.173769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3929555-4270-4db1-9f95-d3fbf9fa9f41 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:27.174110 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3929555-4270-4db1-9f95-d3fbf9fa9f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:27.174445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3929555-4270-4db1-9f95-d3fbf9fa9f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:27.175154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3929555-4270-4db1-9f95-d3fbf9fa9f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:27.177305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3929555-4270-4db1-9f95-d3fbf9fa9f41 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:27.207212 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4494/8986] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:28:27 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:27.211601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c33f58-bccf-4b3d-a93f-066f0763d32f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:27.222890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c33f58-bccf-4b3d-a93f-066f0763d32f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:27.289087 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe846b7-f1cf-4611-b651-c2d5ac619624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:27.289963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe846b7-f1cf-4611-b651-c2d5ac619624 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:27.290249 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe846b7-f1cf-4611-b651-c2d5ac619624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:27.290525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe846b7-f1cf-4611-b651-c2d5ac619624 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:27.291183 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe846b7-f1cf-4611-b651-c2d5ac619624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:27.293201 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe846b7-f1cf-4611-b651-c2d5ac619624 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:27.320297 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4493/8987] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:28:27 2022] POST /identity/v3/users => generated 301 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:27.321731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3929555-4270-4db1-9f95-d3fbf9fa9f41 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:27.333914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3929555-4270-4db1-9f95-d3fbf9fa9f41 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:27.339447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59844305-4585-4b57-9326-b18f35c09c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:27.340174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59844305-4585-4b57-9326-b18f35c09c6e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:27.340456 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59844305-4585-4b57-9326-b18f35c09c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:27.340730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59844305-4585-4b57-9326-b18f35c09c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:27.341396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59844305-4585-4b57-9326-b18f35c09c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:27.343038 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59844305-4585-4b57-9326-b18f35c09c6e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:27.355476 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4495/8988] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:28:27.360016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe846b7-f1cf-4611-b651-c2d5ac619624 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:27.372485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe846b7-f1cf-4611-b651-c2d5ac619624 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:27.377758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062927be-7acd-4532-95bb-5fdd9916dc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:27.378627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062927be-7acd-4532-95bb-5fdd9916dc8d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:27.379028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062927be-7acd-4532-95bb-5fdd9916dc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:27.379447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062927be-7acd-4532-95bb-5fdd9916dc8d admin admin] PATH_INFO: `/v3/projects/6a21d5c8578f4c55b1824f59251adcd3/users/39541b573b72494995932d657f9783e3/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:27.402703 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062927be-7acd-4532-95bb-5fdd9916dc8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a21d5c8578f4c55b1824f59251adcd3, user_id=39541b573b72494995932d657f9783e3, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:27.405732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062927be-7acd-4532-95bb-5fdd9916dc8d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:27.422219 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4494/8989] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:28:27 2022] PUT /identity/v3/projects/6a21d5c8578f4c55b1824f59251adcd3/users/39541b573b72494995932d657f9783e3/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:27.426461 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59844305-4585-4b57-9326-b18f35c09c6e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:27.437298 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59844305-4585-4b57-9326-b18f35c09c6e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:27.500052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1efc48-cbaa-4a83-a070-950503b0942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:27.500694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1efc48-cbaa-4a83-a070-950503b0942c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:27.500968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1efc48-cbaa-4a83-a070-950503b0942c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:27.501253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1efc48-cbaa-4a83-a070-950503b0942c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:27.501902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1efc48-cbaa-4a83-a070-950503b0942c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:27.503680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1efc48-cbaa-4a83-a070-950503b0942c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:27.518842 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4496/8990] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:28:27.520152 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062927be-7acd-4532-95bb-5fdd9916dc8d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:27.532795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062927be-7acd-4532-95bb-5fdd9916dc8d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:27.537911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e00ce-2729-41ec-aa36-222c6a8620cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:27.538715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e00ce-2729-41ec-aa36-222c6a8620cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:27.539069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e00ce-2729-41ec-aa36-222c6a8620cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:27.539463 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e00ce-2729-41ec-aa36-222c6a8620cf admin admin] PATH_INFO: `/v3/projects/6a21d5c8578f4c55b1824f59251adcd3/users/39541b573b72494995932d657f9783e3/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:27.542752 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e00ce-2729-41ec-aa36-222c6a8620cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a21d5c8578f4c55b1824f59251adcd3, user_id=39541b573b72494995932d657f9783e3, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:27.545446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e00ce-2729-41ec-aa36-222c6a8620cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:27.569673 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4495/8991] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:28:27 2022] PUT /identity/v3/projects/6a21d5c8578f4c55b1824f59251adcd3/users/39541b573b72494995932d657f9783e3/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:28:31.773333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1494d-e79d-497e-8673-7ef645adcad4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:31.773850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1494d-e79d-497e-8673-7ef645adcad4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:31.773850 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1494d-e79d-497e-8673-7ef645adcad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:31.809072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-71b1494d-e79d-497e-8673-7ef645adcad4 None None] MFA Rules not processed for user `39541b573b72494995932d657f9783e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:31.810334 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-71b1494d-e79d-497e-8673-7ef645adcad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:31.876481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:31.929968 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4497/8992] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:28:31 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:31.947590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e00ce-2729-41ec-aa36-222c6a8620cf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:31.950848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-711e00ce-2729-41ec-aa36-222c6a8620cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:32.085113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e00ce-2729-41ec-aa36-222c6a8620cf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:32.092086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4fff0-63e1-4bf5-abb5-7a7303e6144e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:32.093484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4fff0-63e1-4bf5-abb5-7a7303e6144e service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:32.093925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4fff0-63e1-4bf5-abb5-7a7303e6144e service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:32.094640 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4fff0-63e1-4bf5-abb5-7a7303e6144e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:32.123626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:32.186725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4fff0-63e1-4bf5-abb5-7a7303e6144e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:32.188696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4fff0-63e1-4bf5-abb5-7a7303e6144e service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:32.203647 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4496/8993] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:28:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:28:32.303877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477ecd4-6d45-4965-a958-ad357932ead8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:32.304480 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477ecd4-6d45-4965-a958-ad357932ead8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:32.306511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477ecd4-6d45-4965-a958-ad357932ead8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:32.331495 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6477ecd4-6d45-4965-a958-ad357932ead8 None None] MFA Rules not processed for user `60bd4ff77a584948930710f0ba78cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:32.333459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6477ecd4-6d45-4965-a958-ad357932ead8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:32.343452 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4498/8994] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:28:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:28:42.197901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=20 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:42.325629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=15 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:42.853960 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5ccf5-c3b8-46f8-bf9b-25423e91e88d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:42.854251 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5ccf5-c3b8-46f8-bf9b-25423e91e88d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:42.854518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5ccf5-c3b8-46f8-bf9b-25423e91e88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:42.911686 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f6d5ccf5-c3b8-46f8-bf9b-25423e91e88d None None] MFA Rules not processed for user `6b06f9395d5841b9aa28227d532964eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:42.912991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f6d5ccf5-c3b8-46f8-bf9b-25423e91e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:42.978752 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4497/8995] 10.222.0.27 () {58 vars in 1061 bytes} [Sun Aug 28 19:28:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:42.985106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477ecd4-6d45-4965-a958-ad357932ead8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:42.995523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477ecd4-6d45-4965-a958-ad357932ead8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:42.999581 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56936c-58a6-4987-8d30-aa229c8a9a9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:43.000191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56936c-58a6-4987-8d30-aa229c8a9a9f service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:43.000468 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56936c-58a6-4987-8d30-aa229c8a9a9f service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:43.000796 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56936c-58a6-4987-8d30-aa229c8a9a9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:43.010408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56936c-58a6-4987-8d30-aa229c8a9a9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:43.011885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56936c-58a6-4987-8d30-aa229c8a9a9f service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:43.022086 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4499/8996] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:28:42 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:28:52.975196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=38 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:53.017648 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:07.214167 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5ccf5-c3b8-46f8-bf9b-25423e91e88d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:07.235335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5ccf5-c3b8-46f8-bf9b-25423e91e88d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:07.242881 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51d51d-c6cd-441b-bedd-f467ace9cca2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:07.243681 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d51d-c6cd-441b-bedd-f467ace9cca2 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:07.244017 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d51d-c6cd-441b-bedd-f467ace9cca2 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:07.244347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d51d-c6cd-441b-bedd-f467ace9cca2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:07.246266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7e51d51d-c6cd-441b-bedd-f467ace9cca2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:07.270154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51d51d-c6cd-441b-bedd-f467ace9cca2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:07.271990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51d51d-c6cd-441b-bedd-f467ace9cca2 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:07.293340 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4498/8997] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:29:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:29:09.572647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e810b-f0c2-45f4-8e93-6ba428606762 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:09.573416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e810b-f0c2-45f4-8e93-6ba428606762 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:09.573416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e810b-f0c2-45f4-8e93-6ba428606762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:09.594744 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3b1e810b-f0c2-45f4-8e93-6ba428606762 None None] MFA Rules not processed for user `60bd4ff77a584948930710f0ba78cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:09.596013 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3b1e810b-f0c2-45f4-8e93-6ba428606762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:09.603738 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4500/8998] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:29:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:29:17.282010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:19.589209 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:21.058679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51d51d-c6cd-441b-bedd-f467ace9cca2 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:21.060846 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7e51d51d-c6cd-441b-bedd-f467ace9cca2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:21.078211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51d51d-c6cd-441b-bedd-f467ace9cca2 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:21.088288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4209853-fc99-4ab3-8f36-12b032903ca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:21.089055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4209853-fc99-4ab3-8f36-12b032903ca0 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:21.089339 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4209853-fc99-4ab3-8f36-12b032903ca0 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:21.089613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4209853-fc99-4ab3-8f36-12b032903ca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:21.091860 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b4209853-fc99-4ab3-8f36-12b032903ca0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:21.128053 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4209853-fc99-4ab3-8f36-12b032903ca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:21.130222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4209853-fc99-4ab3-8f36-12b032903ca0 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:21.143519 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4499/8999] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:29:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:29:31.137800 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:51.489042 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f93e1-784c-4523-a601-470619c26e45 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:51.489624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f93e1-784c-4523-a601-470619c26e45 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:51.489624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f93e1-784c-4523-a601-470619c26e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:51.509856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7f1f93e1-784c-4523-a601-470619c26e45 None None] MFA Rules not processed for user `60bd4ff77a584948930710f0ba78cd66`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:51.511057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7f1f93e1-784c-4523-a601-470619c26e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:51.519281 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4501/9000] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:29:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:29:51.803056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4209853-fc99-4ab3-8f36-12b032903ca0 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:51.869164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4209853-fc99-4ab3-8f36-12b032903ca0 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:51.874649 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99965b-0335-4b74-bf23-45a2fc5ac037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:51.875281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99965b-0335-4b74-bf23-45a2fc5ac037 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:51.875565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99965b-0335-4b74-bf23-45a2fc5ac037 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:51.875839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99965b-0335-4b74-bf23-45a2fc5ac037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:51.878023 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf99965b-0335-4b74-bf23-45a2fc5ac037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:51.888433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99965b-0335-4b74-bf23-45a2fc5ac037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:51.889931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99965b-0335-4b74-bf23-45a2fc5ac037 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:51.898658 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4500/9001] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:29:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:30:01.504296 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:01.895050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=26 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:38.001445 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f93e1-784c-4523-a601-470619c26e45 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:38.072337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f93e1-784c-4523-a601-470619c26e45 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:38.077177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4cdcb-24ff-4789-95f3-647d9e2c0a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:38.077813 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4cdcb-24ff-4789-95f3-647d9e2c0a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:38.078090 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4cdcb-24ff-4789-95f3-647d9e2c0a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:38.078370 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4cdcb-24ff-4789-95f3-647d9e2c0a46 admin admin] PATH_INFO: `/v3/users/60bd4ff77a584948930710f0ba78cd66` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:38.079605 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4cdcb-24ff-4789-95f3-647d9e2c0a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60bd4ff77a584948930710f0ba78cd66)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:38.081538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4cdcb-24ff-4789-95f3-647d9e2c0a46 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:38.131779 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b3d4cdcb-24ff-4789-95f3-647d9e2c0a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60bd4ff77a584948930710f0ba78cd66'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:38.144130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b3d4cdcb-24ff-4789-95f3-647d9e2c0a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60bd4ff77a584948930710f0ba78cd66'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:38.144825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b3d4cdcb-24ff-4789-95f3-647d9e2c0a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60bd4ff77a584948930710f0ba78cd66'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:38.145446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b3d4cdcb-24ff-4789-95f3-647d9e2c0a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60bd4ff77a584948930710f0ba78cd66'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:38.153511 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b3d4cdcb-24ff-4789-95f3-647d9e2c0a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60bd4ff77a584948930710f0ba78cd66'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:38.167297 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4502/9002] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:30:37 2022] DELETE /identity/v3/users/60bd4ff77a584948930710f0ba78cd66 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:30:38.352029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99965b-0335-4b74-bf23-45a2fc5ac037 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:38.365648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99965b-0335-4b74-bf23-45a2fc5ac037 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:38.441164 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:38.441808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:38.442095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:38.442377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503 admin admin] PATH_INFO: `/v3/projects/7acec5978d124e97857adfcbebed1471` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:38.443577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7acec5978d124e97857adfcbebed1471)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:38.445551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:38.497422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7acec5978d124e97857adfcbebed1471', 'request_id': 'req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:38.507837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7acec5978d124e97857adfcbebed1471', 'request_id': 'req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:38.517158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7acec5978d124e97857adfcbebed1471', 'request_id': 'req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:38.531745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503 admin admin] The token cache is being invalidate because project 7acec5978d124e97857adfcbebed1471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:30:38.532035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:38.532958 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:38.534581 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4501/9003] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:30:38 2022] DELETE /identity/v3/projects/7acec5978d124e97857adfcbebed1471 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:30:38.539087 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4cdcb-24ff-4789-95f3-647d9e2c0a46 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:38.540895 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b3d4cdcb-24ff-4789-95f3-647d9e2c0a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:38.554441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4cdcb-24ff-4789-95f3-647d9e2c0a46 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:38.618379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c8785-0dbd-4c86-9ff8-87238e449187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:38.619033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c8785-0dbd-4c86-9ff8-87238e449187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:38.619401 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c8785-0dbd-4c86-9ff8-87238e449187 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:38.619683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c8785-0dbd-4c86-9ff8-87238e449187 admin admin] PATH_INFO: `/v3/users/39541b573b72494995932d657f9783e3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:38.621657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c8785-0dbd-4c86-9ff8-87238e449187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39541b573b72494995932d657f9783e3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:38.623104 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c8785-0dbd-4c86-9ff8-87238e449187 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:38.647502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:38.680745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-900c8785-0dbd-4c86-9ff8-87238e449187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39541b573b72494995932d657f9783e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:38.694127 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-900c8785-0dbd-4c86-9ff8-87238e449187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39541b573b72494995932d657f9783e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:38.694855 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-900c8785-0dbd-4c86-9ff8-87238e449187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39541b573b72494995932d657f9783e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:38.695497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-900c8785-0dbd-4c86-9ff8-87238e449187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39541b573b72494995932d657f9783e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:38.704863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-900c8785-0dbd-4c86-9ff8-87238e449187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39541b573b72494995932d657f9783e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:38.718154 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4503/9004] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:30:38 2022] DELETE /identity/v3/users/39541b573b72494995932d657f9783e3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:30:38.907396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:38.909108 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:38.922100 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8658a-8ccf-4303-b3e2-36dbbb2b9503 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:38.983288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e370d-4af0-4d1e-857d-5218c3142bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:38.983951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e370d-4af0-4d1e-857d-5218c3142bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:38.984231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e370d-4af0-4d1e-857d-5218c3142bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:38.984507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e370d-4af0-4d1e-857d-5218c3142bc1 admin admin] PATH_INFO: `/v3/projects/6a21d5c8578f4c55b1824f59251adcd3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:38.985756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e370d-4af0-4d1e-857d-5218c3142bc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a21d5c8578f4c55b1824f59251adcd3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:38.987731 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e370d-4af0-4d1e-857d-5218c3142bc1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:39.027827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:39.043055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-512e370d-4af0-4d1e-857d-5218c3142bc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a21d5c8578f4c55b1824f59251adcd3', 'request_id': 'req-512e370d-4af0-4d1e-857d-5218c3142bc1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:39.052342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-512e370d-4af0-4d1e-857d-5218c3142bc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a21d5c8578f4c55b1824f59251adcd3', 'request_id': 'req-512e370d-4af0-4d1e-857d-5218c3142bc1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:39.058582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-512e370d-4af0-4d1e-857d-5218c3142bc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a21d5c8578f4c55b1824f59251adcd3', 'request_id': 'req-512e370d-4af0-4d1e-857d-5218c3142bc1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:39.071281 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-512e370d-4af0-4d1e-857d-5218c3142bc1 admin admin] The token cache is being invalidate because project 6a21d5c8578f4c55b1824f59251adcd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:30:39.071568 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-512e370d-4af0-4d1e-857d-5218c3142bc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:39.072320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-512e370d-4af0-4d1e-857d-5218c3142bc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:30:39.074005 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4502/9005] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:30:38 2022] DELETE /identity/v3/projects/6a21d5c8578f4c55b1824f59251adcd3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:30:39.079717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaba54c-0aca-4a6f-aa9f-ee86155bcb7a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:39.080185 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaba54c-0aca-4a6f-aa9f-ee86155bcb7a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:39.080297 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaba54c-0aca-4a6f-aa9f-ee86155bcb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:39.114211 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8aaba54c-0aca-4a6f-aa9f-ee86155bcb7a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:39.115484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8aaba54c-0aca-4a6f-aa9f-ee86155bcb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:39.189756 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4504/9006] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:30:39.197924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b9e0f-0d3a-4f92-b28a-e5b95b7d0328 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:39.198210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b9e0f-0d3a-4f92-b28a-e5b95b7d0328 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:39.198482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b9e0f-0d3a-4f92-b28a-e5b95b7d0328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:39.219119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5a7b9e0f-0d3a-4f92-b28a-e5b95b7d0328 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:39.220478 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a7b9e0f-0d3a-4f92-b28a-e5b95b7d0328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:39.230606 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4503/9007] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:30:39.234930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaba54c-0aca-4a6f-aa9f-ee86155bcb7a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:39.245289 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaba54c-0aca-4a6f-aa9f-ee86155bcb7a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:39.250375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39422790-1132-47a1-bd8a-d985c2b8b247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:39.250980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39422790-1132-47a1-bd8a-d985c2b8b247 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:39.251241 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39422790-1132-47a1-bd8a-d985c2b8b247 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:39.251655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39422790-1132-47a1-bd8a-d985c2b8b247 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:39.252278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39422790-1132-47a1-bd8a-d985c2b8b247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:30:39.252578 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39422790-1132-47a1-bd8a-d985c2b8b247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:39.254184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39422790-1132-47a1-bd8a-d985c2b8b247 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:39.269654 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4505/9008] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:30:39.274225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b9e0f-0d3a-4f92-b28a-e5b95b7d0328 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:39.284549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b9e0f-0d3a-4f92-b28a-e5b95b7d0328 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:39.289459 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14277eb-cfd8-43f3-926a-28e4764b847d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:39.290073 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14277eb-cfd8-43f3-926a-28e4764b847d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:39.290353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14277eb-cfd8-43f3-926a-28e4764b847d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:39.290626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14277eb-cfd8-43f3-926a-28e4764b847d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:39.291351 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14277eb-cfd8-43f3-926a-28e4764b847d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:39.293327 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14277eb-cfd8-43f3-926a-28e4764b847d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:39.324054 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4504/9009] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:30:39 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:30:39.328543 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39422790-1132-47a1-bd8a-d985c2b8b247 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:39.339428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39422790-1132-47a1-bd8a-d985c2b8b247 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:39.397760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684753c-dc86-4bce-a2d5-1bd947b93fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:39.398374 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684753c-dc86-4bce-a2d5-1bd947b93fcb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:39.398653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684753c-dc86-4bce-a2d5-1bd947b93fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:39.398927 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684753c-dc86-4bce-a2d5-1bd947b93fcb admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:39.399595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684753c-dc86-4bce-a2d5-1bd947b93fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:39.401515 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684753c-dc86-4bce-a2d5-1bd947b93fcb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:39.423939 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4506/9010] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:30:39 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:30:39.428717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14277eb-cfd8-43f3-926a-28e4764b847d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:39.440127 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14277eb-cfd8-43f3-926a-28e4764b847d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:39.444963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889694a8-9760-4374-b257-f9eac9278cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:39.445592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889694a8-9760-4374-b257-f9eac9278cfe admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:39.445862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889694a8-9760-4374-b257-f9eac9278cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:39.446182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889694a8-9760-4374-b257-f9eac9278cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:39.446828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889694a8-9760-4374-b257-f9eac9278cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:39.448518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889694a8-9760-4374-b257-f9eac9278cfe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:39.459913 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4505/9011] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:30:39.464470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684753c-dc86-4bce-a2d5-1bd947b93fcb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:39.480447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684753c-dc86-4bce-a2d5-1bd947b93fcb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:39.487803 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b9e9d-91f1-4624-a5b5-31775789dc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:39.488418 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b9e9d-91f1-4624-a5b5-31775789dc0a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:39.488699 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b9e9d-91f1-4624-a5b5-31775789dc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:39.488978 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b9e9d-91f1-4624-a5b5-31775789dc0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:39.489630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b9e9d-91f1-4624-a5b5-31775789dc0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:39.491239 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b9e9d-91f1-4624-a5b5-31775789dc0a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:39.492593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:39.504598 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4507/9012] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:30:39.508449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889694a8-9760-4374-b257-f9eac9278cfe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:39.518956 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889694a8-9760-4374-b257-f9eac9278cfe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:39.523631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4b46b-9571-423c-b407-a422f5c99e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:39.524324 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4b46b-9571-423c-b407-a422f5c99e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:39.524602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4b46b-9571-423c-b407-a422f5c99e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:39.524871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4b46b-9571-423c-b407-a422f5c99e37 admin admin] PATH_INFO: `/v3/projects/8f1d596c2c854a619190e23a247be1f9/users/d95c1e49c9f248cca7cfdf0b1094b57f/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:39.540015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4b46b-9571-423c-b407-a422f5c99e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1d596c2c854a619190e23a247be1f9, user_id=d95c1e49c9f248cca7cfdf0b1094b57f, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:39.542926 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4b46b-9571-423c-b407-a422f5c99e37 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:39.557167 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4506/9013] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:30:39 2022] PUT /identity/v3/projects/8f1d596c2c854a619190e23a247be1f9/users/d95c1e49c9f248cca7cfdf0b1094b57f/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:30:39.562608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3832794-51fd-4f06-8c1f-d8d5567fb02f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:39.562896 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3832794-51fd-4f06-8c1f-d8d5567fb02f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:39.563174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3832794-51fd-4f06-8c1f-d8d5567fb02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:39.588018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c3832794-51fd-4f06-8c1f-d8d5567fb02f None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:39.589250 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c3832794-51fd-4f06-8c1f-d8d5567fb02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:39.655338 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4508/9014] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:30:39.662782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4b46b-9571-423c-b407-a422f5c99e37 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:39.664823 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1dd4b46b-9571-423c-b407-a422f5c99e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:39.737491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4b46b-9571-423c-b407-a422f5c99e37 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:39.741437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071414d2-396b-4bbd-b705-3279684c0673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:39.742081 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071414d2-396b-4bbd-b705-3279684c0673 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:39.742358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071414d2-396b-4bbd-b705-3279684c0673 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:39.742641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071414d2-396b-4bbd-b705-3279684c0673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:39.751985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071414d2-396b-4bbd-b705-3279684c0673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:39.753428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071414d2-396b-4bbd-b705-3279684c0673 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:39.762913 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4507/9015] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:30:44.122051 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0922b5-f98a-4923-bcdd-aaacfaaca727 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:44.122602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0922b5-f98a-4923-bcdd-aaacfaaca727 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:44.122785 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0922b5-f98a-4923-bcdd-aaacfaaca727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:44.157147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ef0922b5-f98a-4923-bcdd-aaacfaaca727 None None] MFA Rules not processed for user `d95c1e49c9f248cca7cfdf0b1094b57f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:44.158481 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ef0922b5-f98a-4923-bcdd-aaacfaaca727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:44.234540 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4509/9016] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:30:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:30:44.239522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071414d2-396b-4bbd-b705-3279684c0673 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:44.256644 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071414d2-396b-4bbd-b705-3279684c0673 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:44.262747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28b146-71f4-4b90-bbca-9eb8fa9edc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:44.263509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28b146-71f4-4b90-bbca-9eb8fa9edc25 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:44.263852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28b146-71f4-4b90-bbca-9eb8fa9edc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:44.264207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28b146-71f4-4b90-bbca-9eb8fa9edc25 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:44.264917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28b146-71f4-4b90-bbca-9eb8fa9edc25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:44.267393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28b146-71f4-4b90-bbca-9eb8fa9edc25 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:44.300078 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4508/9017] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:30:44 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:30:44.304584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0922b5-f98a-4923-bcdd-aaacfaaca727 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:44.316433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0922b5-f98a-4923-bcdd-aaacfaaca727 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:44.379386 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959fd6b-ea90-4c6f-9297-70c1442df259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:44.380026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959fd6b-ea90-4c6f-9297-70c1442df259 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:44.380307 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959fd6b-ea90-4c6f-9297-70c1442df259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:44.380584 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959fd6b-ea90-4c6f-9297-70c1442df259 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:44.381252 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959fd6b-ea90-4c6f-9297-70c1442df259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:44.383304 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959fd6b-ea90-4c6f-9297-70c1442df259 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:44.407799 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4510/9018] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:30:44 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:30:44.413031 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28b146-71f4-4b90-bbca-9eb8fa9edc25 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:44.424767 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28b146-71f4-4b90-bbca-9eb8fa9edc25 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:44.431225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f103e-2c30-449e-b5b4-5673a1546286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:44.431871 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f103e-2c30-449e-b5b4-5673a1546286 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:44.432154 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f103e-2c30-449e-b5b4-5673a1546286 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:44.432429 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f103e-2c30-449e-b5b4-5673a1546286 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:44.433280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f103e-2c30-449e-b5b4-5673a1546286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:44.435619 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f103e-2c30-449e-b5b4-5673a1546286 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:44.448493 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4509/9019] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:30:44.453251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959fd6b-ea90-4c6f-9297-70c1442df259 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:44.464390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959fd6b-ea90-4c6f-9297-70c1442df259 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:44.470215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcdaea-4d90-473e-a770-5abda6038f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:44.470904 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcdaea-4d90-473e-a770-5abda6038f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:44.471186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcdaea-4d90-473e-a770-5abda6038f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:44.471506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcdaea-4d90-473e-a770-5abda6038f80 admin admin] PATH_INFO: `/v3/projects/398f0cd20658462780620b4abd4fdff9/users/174d5d9db8e64423beffdbfb130e24cc/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:44.492413 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:44.495132 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcdaea-4d90-473e-a770-5abda6038f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398f0cd20658462780620b4abd4fdff9, user_id=174d5d9db8e64423beffdbfb130e24cc, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:44.499291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcdaea-4d90-473e-a770-5abda6038f80 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:44.520675 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4511/9020] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:30:44 2022] PUT /identity/v3/projects/398f0cd20658462780620b4abd4fdff9/users/174d5d9db8e64423beffdbfb130e24cc/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:30:44.525130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f103e-2c30-449e-b5b4-5673a1546286 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:44.536015 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f103e-2c30-449e-b5b4-5673a1546286 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:44.548668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:44.607867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325501b-f84b-4aff-83ea-a88dab960404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:44.608485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325501b-f84b-4aff-83ea-a88dab960404 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:44.608759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325501b-f84b-4aff-83ea-a88dab960404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:44.609034 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325501b-f84b-4aff-83ea-a88dab960404 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:44.609679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325501b-f84b-4aff-83ea-a88dab960404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:44.611497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325501b-f84b-4aff-83ea-a88dab960404 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:44.621863 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4510/9021] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:30:44.626366 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcdaea-4d90-473e-a770-5abda6038f80 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:44.637280 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcdaea-4d90-473e-a770-5abda6038f80 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:44.643057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e05164-150a-449d-a63c-38a862ff2d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:44.643775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e05164-150a-449d-a63c-38a862ff2d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:44.644057 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e05164-150a-449d-a63c-38a862ff2d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:44.644359 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e05164-150a-449d-a63c-38a862ff2d3d admin admin] PATH_INFO: `/v3/projects/398f0cd20658462780620b4abd4fdff9/users/174d5d9db8e64423beffdbfb130e24cc/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:44.646460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e05164-150a-449d-a63c-38a862ff2d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=398f0cd20658462780620b4abd4fdff9, user_id=174d5d9db8e64423beffdbfb130e24cc, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:44.649338 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e05164-150a-449d-a63c-38a862ff2d3d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:44.660994 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4512/9022] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:30:44 2022] PUT /identity/v3/projects/398f0cd20658462780620b4abd4fdff9/users/174d5d9db8e64423beffdbfb130e24cc/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:30:49.209407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b9f9c-dd86-4822-9ec3-be57bd6e5786 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:49.209891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b9f9c-dd86-4822-9ec3-be57bd6e5786 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:49.210003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b9f9c-dd86-4822-9ec3-be57bd6e5786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:49.256080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-933b9f9c-dd86-4822-9ec3-be57bd6e5786 None None] MFA Rules not processed for user `174d5d9db8e64423beffdbfb130e24cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:49.257603 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-933b9f9c-dd86-4822-9ec3-be57bd6e5786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:49.368570 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4511/9023] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:30:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:30:49.393459 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e05164-150a-449d-a63c-38a862ff2d3d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:49.395930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-71e05164-150a-449d-a63c-38a862ff2d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:49.512951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e05164-150a-449d-a63c-38a862ff2d3d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:49.517968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f611380-6c7d-4a81-8d83-3ca18188aa16 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:49.518636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f611380-6c7d-4a81-8d83-3ca18188aa16 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:49.518919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f611380-6c7d-4a81-8d83-3ca18188aa16 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:49.519186 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f611380-6c7d-4a81-8d83-3ca18188aa16 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:49.633995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f611380-6c7d-4a81-8d83-3ca18188aa16 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:49.635552 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f611380-6c7d-4a81-8d83-3ca18188aa16 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:49.649934 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4513/9024] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:30:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:30:49.836428 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be8128-d42e-4e63-b312-79fd8a41fcf4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:49.836720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be8128-d42e-4e63-b312-79fd8a41fcf4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:49.837052 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be8128-d42e-4e63-b312-79fd8a41fcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:49.899984 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-78be8128-d42e-4e63-b312-79fd8a41fcf4 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:49.901238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-78be8128-d42e-4e63-b312-79fd8a41fcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:49.986043 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4512/9025] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 19:30:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:30:50.036314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45e8ea-f937-450b-b8a2-9088316a6933 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:50.036635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45e8ea-f937-450b-b8a2-9088316a6933 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:50.036912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45e8ea-f937-450b-b8a2-9088316a6933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:50.090928 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8b45e8ea-f937-450b-b8a2-9088316a6933 None None] MFA Rules not processed for user `d55caefe410444509a1eee4262b76c80`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:50.092202 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8b45e8ea-f937-450b-b8a2-9088316a6933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:50.137484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:50.172407 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4514/9026] 10.222.0.27 () {58 vars in 1040 bytes} [Sun Aug 28 19:30:50 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:30:50.179004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be8128-d42e-4e63-b312-79fd8a41fcf4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:50.185886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:50.193041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be8128-d42e-4e63-b312-79fd8a41fcf4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:50.203322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb997251-4318-4144-8b17-52ec309040b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:50.205088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997251-4318-4144-8b17-52ec309040b9 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:50.205088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997251-4318-4144-8b17-52ec309040b9 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:50.205088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997251-4318-4144-8b17-52ec309040b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:50.215449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb997251-4318-4144-8b17-52ec309040b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:50.217554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb997251-4318-4144-8b17-52ec309040b9 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:50.227390 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4513/9027] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 19:30:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:30:50.732751 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45e8ea-f937-450b-b8a2-9088316a6933 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:50.734306 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8b45e8ea-f937-450b-b8a2-9088316a6933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:50.872798 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45e8ea-f937-450b-b8a2-9088316a6933 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:50.879270 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb406b-4a89-4146-93a7-f6cb5d28e710 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:50.879935 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb406b-4a89-4146-93a7-f6cb5d28e710 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:50.880218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb406b-4a89-4146-93a7-f6cb5d28e710 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:50.880489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb406b-4a89-4146-93a7-f6cb5d28e710 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:50.882834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-01cb406b-4a89-4146-93a7-f6cb5d28e710 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:50.896974 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb406b-4a89-4146-93a7-f6cb5d28e710 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:50.898688 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb406b-4a89-4146-93a7-f6cb5d28e710 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:50.924076 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4515/9028] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:30:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:30:59.169321 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6475373-5b26-4073-88e4-8955966bc4da None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:59.169824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6475373-5b26-4073-88e4-8955966bc4da None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:59.169951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6475373-5b26-4073-88e4-8955966bc4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:59.190853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b6475373-5b26-4073-88e4-8955966bc4da None None] MFA Rules not processed for user `d95c1e49c9f248cca7cfdf0b1094b57f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:59.192107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b6475373-5b26-4073-88e4-8955966bc4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:59.201136 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4514/9029] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:30:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:31:00.225182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb406b-4a89-4146-93a7-f6cb5d28e710 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:00.226777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-01cb406b-4a89-4146-93a7-f6cb5d28e710 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:00.240919 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb406b-4a89-4146-93a7-f6cb5d28e710 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:00.246541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cd69a-8221-4956-9b5e-126cb286ab41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:00.247156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cd69a-8221-4956-9b5e-126cb286ab41 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:00.247463 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cd69a-8221-4956-9b5e-126cb286ab41 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:00.247752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cd69a-8221-4956-9b5e-126cb286ab41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:00.250257 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a60cd69a-8221-4956-9b5e-126cb286ab41 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:00.264253 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cd69a-8221-4956-9b5e-126cb286ab41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:00.266969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cd69a-8221-4956-9b5e-126cb286ab41 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:00.279586 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4516/9030] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:31:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:31:01.358438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320db79-1b0d-4d7a-9ebb-495ebcef33c0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:01.358972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320db79-1b0d-4d7a-9ebb-495ebcef33c0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:01.359072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320db79-1b0d-4d7a-9ebb-495ebcef33c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:01.379659 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b320db79-1b0d-4d7a-9ebb-495ebcef33c0 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:01.380878 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b320db79-1b0d-4d7a-9ebb-495ebcef33c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:01.388787 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4515/9031] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 19:31:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:31:01.401449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cd69a-8221-4956-9b5e-126cb286ab41 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:01.412769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cd69a-8221-4956-9b5e-126cb286ab41 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:01.418020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4980d-979a-4bcb-bc8c-a8f3a9880c8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:01.418620 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4980d-979a-4bcb-bc8c-a8f3a9880c8c service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:01.418899 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4980d-979a-4bcb-bc8c-a8f3a9880c8c service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:01.419165 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4980d-979a-4bcb-bc8c-a8f3a9880c8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:01.428920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4980d-979a-4bcb-bc8c-a8f3a9880c8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:01.430551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4980d-979a-4bcb-bc8c-a8f3a9880c8c service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:01.439781 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4517/9032] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 19:31:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:31:11.374446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=11 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:11.436116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=64 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:39.235204 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320db79-1b0d-4d7a-9ebb-495ebcef33c0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:39.236835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b320db79-1b0d-4d7a-9ebb-495ebcef33c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:39.296541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320db79-1b0d-4d7a-9ebb-495ebcef33c0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:39.300835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a771e-fe99-460c-8602-4e17123ff323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:39.301454 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a771e-fe99-460c-8602-4e17123ff323 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:39.301732 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a771e-fe99-460c-8602-4e17123ff323 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:39.302005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a771e-fe99-460c-8602-4e17123ff323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:39.312407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a771e-fe99-460c-8602-4e17123ff323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:39.313867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a771e-fe99-460c-8602-4e17123ff323 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:39.323973 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4516/9033] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:31:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:31:41.070196 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4980d-979a-4bcb-bc8c-a8f3a9880c8c service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:41.072272 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4af4980d-979a-4bcb-bc8c-a8f3a9880c8c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:41.185910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4980d-979a-4bcb-bc8c-a8f3a9880c8c service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:41.192184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d451927-51a7-428f-a139-14b0d6f9808f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:41.192877 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d451927-51a7-428f-a139-14b0d6f9808f service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:41.193162 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d451927-51a7-428f-a139-14b0d6f9808f service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:41.193437 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d451927-51a7-428f-a139-14b0d6f9808f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:41.195665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8d451927-51a7-428f-a139-14b0d6f9808f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:41.211567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d451927-51a7-428f-a139-14b0d6f9808f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:41.213696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d451927-51a7-428f-a139-14b0d6f9808f service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:41.236983 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4518/9034] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:31:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:31:49.319345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=26 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:51.224814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=39 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:32:50.343851 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a771e-fe99-460c-8602-4e17123ff323 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:50.353773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a771e-fe99-460c-8602-4e17123ff323 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:50.358639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db355a78-4d49-4135-a418-c5431baefdf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:50.359541 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db355a78-4d49-4135-a418-c5431baefdf3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:50.359843 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db355a78-4d49-4135-a418-c5431baefdf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:50.360163 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db355a78-4d49-4135-a418-c5431baefdf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:50.362740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db355a78-4d49-4135-a418-c5431baefdf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:50.378554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db355a78-4d49-4135-a418-c5431baefdf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:50.380468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db355a78-4d49-4135-a418-c5431baefdf3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:50.391485 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4517/9035] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:32:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:00.386741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:05.446952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d451927-51a7-428f-a139-14b0d6f9808f service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:05.456630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d451927-51a7-428f-a139-14b0d6f9808f service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:05.460477 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278fd19-eb20-4222-89c4-6d1510d01fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:05.461073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278fd19-eb20-4222-89c4-6d1510d01fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:05.461347 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278fd19-eb20-4222-89c4-6d1510d01fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:05.461617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278fd19-eb20-4222-89c4-6d1510d01fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:05.463670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f278fd19-eb20-4222-89c4-6d1510d01fc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:05.478129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278fd19-eb20-4222-89c4-6d1510d01fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:05.479621 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278fd19-eb20-4222-89c4-6d1510d01fc9 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:05.491041 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4519/9036] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:06.699966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db355a78-4d49-4135-a418-c5431baefdf3 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:06.713642 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db355a78-4d49-4135-a418-c5431baefdf3 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:06.720711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18a8bc-a6dc-42f7-aed2-b8088f95a79c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:06.721504 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18a8bc-a6dc-42f7-aed2-b8088f95a79c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:06.721705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18a8bc-a6dc-42f7-aed2-b8088f95a79c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:06.722071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18a8bc-a6dc-42f7-aed2-b8088f95a79c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:06.725322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0c18a8bc-a6dc-42f7-aed2-b8088f95a79c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:06.741697 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18a8bc-a6dc-42f7-aed2-b8088f95a79c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:06.743205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18a8bc-a6dc-42f7-aed2-b8088f95a79c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:06.756389 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4518/9037] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:15.486188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:16.749888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:49.793810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278fd19-eb20-4222-89c4-6d1510d01fc9 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:49.805190 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278fd19-eb20-4222-89c4-6d1510d01fc9 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:49.809291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac5434-2635-44c4-a1c0-7b26852c7f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:49.809897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac5434-2635-44c4-a1c0-7b26852c7f08 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:49.810176 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac5434-2635-44c4-a1c0-7b26852c7f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:49.810449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac5434-2635-44c4-a1c0-7b26852c7f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:49.819608 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac5434-2635-44c4-a1c0-7b26852c7f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:49.821128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac5434-2635-44c4-a1c0-7b26852c7f08 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:49.830589 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4520/9038] 10.222.0.27 () {60 vars in 1396 bytes} [Sun Aug 28 19:35:49 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3262 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:35:50.251598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18a8bc-a6dc-42f7-aed2-b8088f95a79c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:50.272647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18a8bc-a6dc-42f7-aed2-b8088f95a79c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:50.280353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cf968-dd4a-4788-a1f5-e1f82d816352 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:50.281303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cf968-dd4a-4788-a1f5-e1f82d816352 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:50.281715 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cf968-dd4a-4788-a1f5-e1f82d816352 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:50.282080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cf968-dd4a-4788-a1f5-e1f82d816352 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:50.284375 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b96cf968-dd4a-4788-a1f5-e1f82d816352 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:50.301032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cf968-dd4a-4788-a1f5-e1f82d816352 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:50.304575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cf968-dd4a-4788-a1f5-e1f82d816352 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:50.318884 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4519/9039] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:35:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:35:54.668012 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac5434-2635-44c4-a1c0-7b26852c7f08 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:54.683277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac5434-2635-44c4-a1c0-7b26852c7f08 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:54.689647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c73f7-69ac-4e99-8a27-57a769599c93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:54.690406 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c73f7-69ac-4e99-8a27-57a769599c93 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:54.690757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c73f7-69ac-4e99-8a27-57a769599c93 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:54.691031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c73f7-69ac-4e99-8a27-57a769599c93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:54.701078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c73f7-69ac-4e99-8a27-57a769599c93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:54.702686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c73f7-69ac-4e99-8a27-57a769599c93 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:54.713157 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4521/9040] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:35:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:00.313250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:04.123733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106258f2-3492-4772-bc57-22c4e42344a0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:04.124332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106258f2-3492-4772-bc57-22c4e42344a0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:04.124484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106258f2-3492-4772-bc57-22c4e42344a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:04.145010 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-106258f2-3492-4772-bc57-22c4e42344a0 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:04.146209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-106258f2-3492-4772-bc57-22c4e42344a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:04.154945 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4520/9041] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 19:36:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:04.199084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c73f7-69ac-4e99-8a27-57a769599c93 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:04.211484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c73f7-69ac-4e99-8a27-57a769599c93 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:04.217889 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22036863-e01d-4757-8900-89acfd4dfdf2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:04.218501 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22036863-e01d-4757-8900-89acfd4dfdf2 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:04.218786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22036863-e01d-4757-8900-89acfd4dfdf2 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:04.219063 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22036863-e01d-4757-8900-89acfd4dfdf2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:04.227517 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22036863-e01d-4757-8900-89acfd4dfdf2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:04.229120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22036863-e01d-4757-8900-89acfd4dfdf2 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:04.237207 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4522/9042] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 19:36:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:36:04.772852 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e13c6-e58a-44f0-b928-60aae0322299 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:04.773137 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e13c6-e58a-44f0-b928-60aae0322299 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:04.773413 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e13c6-e58a-44f0-b928-60aae0322299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:04.794349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d59e13c6-e58a-44f0-b928-60aae0322299 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:04.795627 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d59e13c6-e58a-44f0-b928-60aae0322299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:04.804048 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4521/9043] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 19:36:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:04.817135 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22036863-e01d-4757-8900-89acfd4dfdf2 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:04.827676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22036863-e01d-4757-8900-89acfd4dfdf2 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:04.833671 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff308fcc-c10d-4204-a32d-25a93d401ca6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:04.834266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308fcc-c10d-4204-a32d-25a93d401ca6 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:04.834551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308fcc-c10d-4204-a32d-25a93d401ca6 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:04.834819 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308fcc-c10d-4204-a32d-25a93d401ca6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:04.843191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff308fcc-c10d-4204-a32d-25a93d401ca6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:04.844812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff308fcc-c10d-4204-a32d-25a93d401ca6 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:04.853523 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4523/9044] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 19:36:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:36:07.205886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e13c6-e58a-44f0-b928-60aae0322299 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:07.220334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e13c6-e58a-44f0-b928-60aae0322299 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:07.227910 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115de9c7-4127-4295-9381-d3b7a4313069 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:07.228550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115de9c7-4127-4295-9381-d3b7a4313069 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:07.228835 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115de9c7-4127-4295-9381-d3b7a4313069 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:07.229113 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115de9c7-4127-4295-9381-d3b7a4313069 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:07.238789 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115de9c7-4127-4295-9381-d3b7a4313069 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:07.240323 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115de9c7-4127-4295-9381-d3b7a4313069 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:07.250411 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4522/9045] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:13.020498 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa63816-e494-42fa-a111-4554c65c4687 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:13.020990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa63816-e494-42fa-a111-4554c65c4687 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:13.021156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa63816-e494-42fa-a111-4554c65c4687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:13.041157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-efa63816-e494-42fa-a111-4554c65c4687 None None] MFA Rules not processed for user `d95c1e49c9f248cca7cfdf0b1094b57f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:13.042415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-efa63816-e494-42fa-a111-4554c65c4687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:13.049991 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4524/9046] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:36:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:13.318925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115de9c7-4127-4295-9381-d3b7a4313069 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:13.336748 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115de9c7-4127-4295-9381-d3b7a4313069 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:13.341354 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a36692-da5f-4368-becf-eec8e1c66f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:13.342011 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a36692-da5f-4368-becf-eec8e1c66f07 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:13.342262 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a36692-da5f-4368-becf-eec8e1c66f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:13.342531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a36692-da5f-4368-becf-eec8e1c66f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:13.344591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-99a36692-da5f-4368-becf-eec8e1c66f07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:13.355886 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a36692-da5f-4368-becf-eec8e1c66f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:13.357334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a36692-da5f-4368-becf-eec8e1c66f07 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:13.365723 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4523/9047] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:13.715567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa63816-e494-42fa-a111-4554c65c4687 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:13.728525 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa63816-e494-42fa-a111-4554c65c4687 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:13.733768 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdd22f-4770-4e4d-88a4-0253d83c1fe1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:13.734576 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdd22f-4770-4e4d-88a4-0253d83c1fe1 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:13.734936 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdd22f-4770-4e4d-88a4-0253d83c1fe1 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:13.735309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdd22f-4770-4e4d-88a4-0253d83c1fe1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:13.737436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7bcdd22f-4770-4e4d-88a4-0253d83c1fe1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:13.750218 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdd22f-4770-4e4d-88a4-0253d83c1fe1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:13.751832 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdd22f-4770-4e4d-88a4-0253d83c1fe1 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:13.763295 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4525/9048] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:15.119314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b374f-613b-4b56-ba3a-5653210a8807 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:15.119772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b374f-613b-4b56-ba3a-5653210a8807 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:15.120106 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b374f-613b-4b56-ba3a-5653210a8807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:15.140391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-327b374f-613b-4b56-ba3a-5653210a8807 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:15.141961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-327b374f-613b-4b56-ba3a-5653210a8807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:15.152199 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4524/9049] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 19:36:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:15.164436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdd22f-4770-4e4d-88a4-0253d83c1fe1 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:15.176314 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdd22f-4770-4e4d-88a4-0253d83c1fe1 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:15.181834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff71395-1613-4189-a2a0-88315223237f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:15.181834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff71395-1613-4189-a2a0-88315223237f service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:15.182085 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff71395-1613-4189-a2a0-88315223237f service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:15.182351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff71395-1613-4189-a2a0-88315223237f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:15.191826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff71395-1613-4189-a2a0-88315223237f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:15.193876 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff71395-1613-4189-a2a0-88315223237f service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:15.202850 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4526/9050] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 19:36:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:36:25.135438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=21 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:25.199433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=39 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:25.821961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b374f-613b-4b56-ba3a-5653210a8807 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:25.832491 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b374f-613b-4b56-ba3a-5653210a8807 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:25.837499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631287d-12e8-4b2d-a987-9367939aaf15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:25.838116 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631287d-12e8-4b2d-a987-9367939aaf15 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:25.838536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631287d-12e8-4b2d-a987-9367939aaf15 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:25.838810 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631287d-12e8-4b2d-a987-9367939aaf15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:25.842325 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a631287d-12e8-4b2d-a987-9367939aaf15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:25.853994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631287d-12e8-4b2d-a987-9367939aaf15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:25.855530 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631287d-12e8-4b2d-a987-9367939aaf15 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:25.864196 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4525/9051] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:32.838506 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff71395-1613-4189-a2a0-88315223237f service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:32.853908 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff71395-1613-4189-a2a0-88315223237f service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:32.859820 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7b468-c128-458f-a29f-063c0a5dffd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:32.860441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7b468-c128-458f-a29f-063c0a5dffd0 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:32.860776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7b468-c128-458f-a29f-063c0a5dffd0 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:32.861053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7b468-c128-458f-a29f-063c0a5dffd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:32.863069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bda7b468-c128-458f-a29f-063c0a5dffd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:32.876179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7b468-c128-458f-a29f-063c0a5dffd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:32.877799 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7b468-c128-458f-a29f-063c0a5dffd0 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:32.888912 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4527/9052] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:35.860280 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:42.884365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:48.970088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631287d-12e8-4b2d-a987-9367939aaf15 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:48.980769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631287d-12e8-4b2d-a987-9367939aaf15 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:48.987948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220dc2d-3cf3-4900-a1f8-cd0752e7f0f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:48.988758 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220dc2d-3cf3-4900-a1f8-cd0752e7f0f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:48.989041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220dc2d-3cf3-4900-a1f8-cd0752e7f0f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:48.989338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220dc2d-3cf3-4900-a1f8-cd0752e7f0f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:49.000250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220dc2d-3cf3-4900-a1f8-cd0752e7f0f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:49.001691 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220dc2d-3cf3-4900-a1f8-cd0752e7f0f0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:49.013099 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4526/9053] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:59.007470 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:39:05.858575 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7b468-c128-458f-a29f-063c0a5dffd0 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:05.899732 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7b468-c128-458f-a29f-063c0a5dffd0 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:05.903734 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce34855-9506-4282-b815-2238abdfdd6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:05.904349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce34855-9506-4282-b815-2238abdfdd6b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:05.904643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce34855-9506-4282-b815-2238abdfdd6b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:05.904938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce34855-9506-4282-b815-2238abdfdd6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:05.935944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce34855-9506-4282-b815-2238abdfdd6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:05.937381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce34855-9506-4282-b815-2238abdfdd6b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:05.959396 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4528/9054] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:39:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:39:07.831676 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220dc2d-3cf3-4900-a1f8-cd0752e7f0f0 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:07.889710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220dc2d-3cf3-4900-a1f8-cd0752e7f0f0 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:07.897729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c819b-3515-4988-b073-d5cf76afd80a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:07.898373 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c819b-3515-4988-b073-d5cf76afd80a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:07.898655 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c819b-3515-4988-b073-d5cf76afd80a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:07.898939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c819b-3515-4988-b073-d5cf76afd80a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:07.915523 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c819b-3515-4988-b073-d5cf76afd80a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:07.918516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c819b-3515-4988-b073-d5cf76afd80a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:07.932946 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4527/9055] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:39:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:39:13.510024 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90b2c2-7a77-491b-a43b-3f94994163a2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:13.510494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90b2c2-7a77-491b-a43b-3f94994163a2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:13.510594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90b2c2-7a77-491b-a43b-3f94994163a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:13.588505 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0a90b2c2-7a77-491b-a43b-3f94994163a2 None None] MFA Rules not processed for user `6b06f9395d5841b9aa28227d532964eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:39:13.589715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0a90b2c2-7a77-491b-a43b-3f94994163a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:13.657616 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4529/9056] 10.222.0.27 () {58 vars in 1061 bytes} [Sun Aug 28 19:39:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:39:13.663879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c819b-3515-4988-b073-d5cf76afd80a service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:13.673834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c819b-3515-4988-b073-d5cf76afd80a service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:13.677741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955332f7-24de-4994-81a5-0500ed0369f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b06f9395d5841b9aa28227d532964eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:13.678340 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955332f7-24de-4994-81a5-0500ed0369f0 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:13.678615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955332f7-24de-4994-81a5-0500ed0369f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:13.678883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955332f7-24de-4994-81a5-0500ed0369f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:13.690005 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955332f7-24de-4994-81a5-0500ed0369f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:13.691494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955332f7-24de-4994-81a5-0500ed0369f0 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:13.703110 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4528/9057] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:39:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:39:21.834383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d51eeb-53f8-45c0-a6e9-5c6c3d860454 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:21.834885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d51eeb-53f8-45c0-a6e9-5c6c3d860454 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:21.835020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d51eeb-53f8-45c0-a6e9-5c6c3d860454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:21.856172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a9d51eeb-53f8-45c0-a6e9-5c6c3d860454 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:39:21.857427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a9d51eeb-53f8-45c0-a6e9-5c6c3d860454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:21.865511 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4530/9058] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 19:39:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:39:21.908410 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955332f7-24de-4994-81a5-0500ed0369f0 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:21.919929 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955332f7-24de-4994-81a5-0500ed0369f0 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:21.925348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db96660-f0e3-482c-b462-82294f8944f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:21.925951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db96660-f0e3-482c-b462-82294f8944f9 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:21.926230 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db96660-f0e3-482c-b462-82294f8944f9 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:21.926536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db96660-f0e3-482c-b462-82294f8944f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:21.935269 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db96660-f0e3-482c-b462-82294f8944f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:21.936918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db96660-f0e3-482c-b462-82294f8944f9 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:21.945492 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4529/9059] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 19:39:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:39:22.332151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d51eeb-53f8-45c0-a6e9-5c6c3d860454 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:22.342145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d51eeb-53f8-45c0-a6e9-5c6c3d860454 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:22.346476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65b886-c1a5-423a-bd9b-90486ce15a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:22.347073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65b886-c1a5-423a-bd9b-90486ce15a28 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:22.347541 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65b886-c1a5-423a-bd9b-90486ce15a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:22.347816 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65b886-c1a5-423a-bd9b-90486ce15a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:22.392352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:39:22.424339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65b886-c1a5-423a-bd9b-90486ce15a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:22.425818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65b886-c1a5-423a-bd9b-90486ce15a28 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:22.445964 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4531/9060] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:39:25.519420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db96660-f0e3-482c-b462-82294f8944f9 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:25.532272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db96660-f0e3-482c-b462-82294f8944f9 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:25.538489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780ff5f-609b-4743-9180-013d0ef3af10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:25.539186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780ff5f-609b-4743-9180-013d0ef3af10 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:25.545805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780ff5f-609b-4743-9180-013d0ef3af10 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:25.546166 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780ff5f-609b-4743-9180-013d0ef3af10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:25.548335 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d780ff5f-609b-4743-9180-013d0ef3af10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:25.573923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780ff5f-609b-4743-9180-013d0ef3af10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:25.575586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780ff5f-609b-4743-9180-013d0ef3af10 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:25.594558 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4530/9061] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:39:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:39:28.961950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65b886-c1a5-423a-bd9b-90486ce15a28 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:28.974388 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65b886-c1a5-423a-bd9b-90486ce15a28 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:28.979836 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553aef6-45bf-4f90-a36b-64cb1d528fdc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:28.980482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553aef6-45bf-4f90-a36b-64cb1d528fdc service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:28.980842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553aef6-45bf-4f90-a36b-64cb1d528fdc service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:28.981121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553aef6-45bf-4f90-a36b-64cb1d528fdc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:28.982987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9553aef6-45bf-4f90-a36b-64cb1d528fdc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:28.996762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553aef6-45bf-4f90-a36b-64cb1d528fdc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:28.998676 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553aef6-45bf-4f90-a36b-64cb1d528fdc service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:29.015143 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4532/9062] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:39:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:39:29.027735 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780ff5f-609b-4743-9180-013d0ef3af10 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:29.033189 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=39 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:39:29.040931 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780ff5f-609b-4743-9180-013d0ef3af10 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:29.045955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4248dc-8515-4bf0-af32-de2b5ff5960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:29.046972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4248dc-8515-4bf0-af32-de2b5ff5960a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:29.047124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4248dc-8515-4bf0-af32-de2b5ff5960a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:29.051007 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4248dc-8515-4bf0-af32-de2b5ff5960a admin admin] PATH_INFO: `/v3/users/d95c1e49c9f248cca7cfdf0b1094b57f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:29.051515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4248dc-8515-4bf0-af32-de2b5ff5960a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95c1e49c9f248cca7cfdf0b1094b57f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:29.053584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4248dc-8515-4bf0-af32-de2b5ff5960a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:29.102668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b4248dc-8515-4bf0-af32-de2b5ff5960a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95c1e49c9f248cca7cfdf0b1094b57f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:29.103353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b4248dc-8515-4bf0-af32-de2b5ff5960a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95c1e49c9f248cca7cfdf0b1094b57f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:29.111013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b4248dc-8515-4bf0-af32-de2b5ff5960a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95c1e49c9f248cca7cfdf0b1094b57f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:29.120001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b4248dc-8515-4bf0-af32-de2b5ff5960a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95c1e49c9f248cca7cfdf0b1094b57f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:29.132853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b4248dc-8515-4bf0-af32-de2b5ff5960a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95c1e49c9f248cca7cfdf0b1094b57f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:29.138906 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4531/9063] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:39:29 2022] DELETE /identity/v3/users/d95c1e49c9f248cca7cfdf0b1094b57f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:39:29.358533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553aef6-45bf-4f90-a36b-64cb1d528fdc service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:29.373760 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553aef6-45bf-4f90-a36b-64cb1d528fdc service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:29.442082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1dc89-cde6-4a75-9025-0e9c244dcd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:29.443075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1dc89-cde6-4a75-9025-0e9c244dcd83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:29.443571 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1dc89-cde6-4a75-9025-0e9c244dcd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:29.444049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1dc89-cde6-4a75-9025-0e9c244dcd83 admin admin] PATH_INFO: `/v3/projects/8f1d596c2c854a619190e23a247be1f9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:29.445591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1dc89-cde6-4a75-9025-0e9c244dcd83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f1d596c2c854a619190e23a247be1f9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:29.448704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1dc89-cde6-4a75-9025-0e9c244dcd83 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:29.514687 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-37a1dc89-cde6-4a75-9025-0e9c244dcd83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f1d596c2c854a619190e23a247be1f9', 'request_id': 'req-37a1dc89-cde6-4a75-9025-0e9c244dcd83'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:29.524894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-37a1dc89-cde6-4a75-9025-0e9c244dcd83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f1d596c2c854a619190e23a247be1f9', 'request_id': 'req-37a1dc89-cde6-4a75-9025-0e9c244dcd83'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:29.532826 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-37a1dc89-cde6-4a75-9025-0e9c244dcd83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f1d596c2c854a619190e23a247be1f9', 'request_id': 'req-37a1dc89-cde6-4a75-9025-0e9c244dcd83'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:29.574368 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-37a1dc89-cde6-4a75-9025-0e9c244dcd83 admin admin] The token cache is being invalidate because project 8f1d596c2c854a619190e23a247be1f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:39:29.574843 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-37a1dc89-cde6-4a75-9025-0e9c244dcd83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:29.575968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-37a1dc89-cde6-4a75-9025-0e9c244dcd83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:29.578215 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4533/9064] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:39:29 2022] DELETE /identity/v3/projects/8f1d596c2c854a619190e23a247be1f9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:39:29.582419 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4248dc-8515-4bf0-af32-de2b5ff5960a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:29.584133 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5b4248dc-8515-4bf0-af32-de2b5ff5960a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:29.599509 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4248dc-8515-4bf0-af32-de2b5ff5960a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:29.676583 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322de5a2-8874-4187-b125-5219c5f7d32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:29.677345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322de5a2-8874-4187-b125-5219c5f7d32b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:29.677636 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322de5a2-8874-4187-b125-5219c5f7d32b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:29.677917 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322de5a2-8874-4187-b125-5219c5f7d32b admin admin] PATH_INFO: `/v3/users/174d5d9db8e64423beffdbfb130e24cc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:29.679286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322de5a2-8874-4187-b125-5219c5f7d32b admin admin] RBAC: Authorizing `identity:delete_user(user_id=174d5d9db8e64423beffdbfb130e24cc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:29.681559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322de5a2-8874-4187-b125-5219c5f7d32b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:29.734512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-322de5a2-8874-4187-b125-5219c5f7d32b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '174d5d9db8e64423beffdbfb130e24cc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:29.735273 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-322de5a2-8874-4187-b125-5219c5f7d32b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '174d5d9db8e64423beffdbfb130e24cc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:29.742604 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-322de5a2-8874-4187-b125-5219c5f7d32b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '174d5d9db8e64423beffdbfb130e24cc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:29.751679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-322de5a2-8874-4187-b125-5219c5f7d32b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '174d5d9db8e64423beffdbfb130e24cc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:29.762713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:39:29.765349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-322de5a2-8874-4187-b125-5219c5f7d32b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '174d5d9db8e64423beffdbfb130e24cc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:29.773093 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4532/9065] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:39:29 2022] DELETE /identity/v3/users/174d5d9db8e64423beffdbfb130e24cc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:39:29.988098 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1dc89-cde6-4a75-9025-0e9c244dcd83 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:29.989749 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-37a1dc89-cde6-4a75-9025-0e9c244dcd83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:30.008934 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1dc89-cde6-4a75-9025-0e9c244dcd83 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:30.036285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:39:30.072865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115eba25-befa-43d4-98ed-858e655c1010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:30.073518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115eba25-befa-43d4-98ed-858e655c1010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:30.073805 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115eba25-befa-43d4-98ed-858e655c1010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:30.074081 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115eba25-befa-43d4-98ed-858e655c1010 admin admin] PATH_INFO: `/v3/projects/398f0cd20658462780620b4abd4fdff9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:30.075292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115eba25-befa-43d4-98ed-858e655c1010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=398f0cd20658462780620b4abd4fdff9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:30.077369 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115eba25-befa-43d4-98ed-858e655c1010 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:30.126484 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-115eba25-befa-43d4-98ed-858e655c1010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398f0cd20658462780620b4abd4fdff9', 'request_id': 'req-115eba25-befa-43d4-98ed-858e655c1010'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:30.133133 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-115eba25-befa-43d4-98ed-858e655c1010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398f0cd20658462780620b4abd4fdff9', 'request_id': 'req-115eba25-befa-43d4-98ed-858e655c1010'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:30.139519 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-115eba25-befa-43d4-98ed-858e655c1010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398f0cd20658462780620b4abd4fdff9', 'request_id': 'req-115eba25-befa-43d4-98ed-858e655c1010'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:30.155402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-115eba25-befa-43d4-98ed-858e655c1010 admin admin] The token cache is being invalidate because project 398f0cd20658462780620b4abd4fdff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:39:30.155722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-115eba25-befa-43d4-98ed-858e655c1010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:30.156851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-115eba25-befa-43d4-98ed-858e655c1010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:30.158501 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4534/9066] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:39:29 2022] DELETE /identity/v3/projects/398f0cd20658462780620b4abd4fdff9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:39:30.163985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed233dfa-6900-4bc0-a129-b3cb20a380f2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:30.164601 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed233dfa-6900-4bc0-a129-b3cb20a380f2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:30.164891 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed233dfa-6900-4bc0-a129-b3cb20a380f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:30.216594 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ed233dfa-6900-4bc0-a129-b3cb20a380f2 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:39:30.217911 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ed233dfa-6900-4bc0-a129-b3cb20a380f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:30.278860 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4533/9067] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:39:30.287029 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279b8c2-293c-4b7d-a570-e7cbb4b1f7d6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:30.287353 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279b8c2-293c-4b7d-a570-e7cbb4b1f7d6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:30.287631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279b8c2-293c-4b7d-a570-e7cbb4b1f7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:30.309179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7279b8c2-293c-4b7d-a570-e7cbb4b1f7d6 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:39:30.310425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7279b8c2-293c-4b7d-a570-e7cbb4b1f7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:30.319827 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4535/9068] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:39:30.324529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed233dfa-6900-4bc0-a129-b3cb20a380f2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:30.336966 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed233dfa-6900-4bc0-a129-b3cb20a380f2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:30.342579 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc44ec-cbd1-4d0b-85ba-acc834162098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:30.343191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc44ec-cbd1-4d0b-85ba-acc834162098 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:30.343499 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc44ec-cbd1-4d0b-85ba-acc834162098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:30.343766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc44ec-cbd1-4d0b-85ba-acc834162098 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:30.344418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc44ec-cbd1-4d0b-85ba-acc834162098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:39:30.344716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc44ec-cbd1-4d0b-85ba-acc834162098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:30.346349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc44ec-cbd1-4d0b-85ba-acc834162098 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:30.359490 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4534/9069] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:39:30.364301 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279b8c2-293c-4b7d-a570-e7cbb4b1f7d6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:30.374681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279b8c2-293c-4b7d-a570-e7cbb4b1f7d6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:30.380801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b6739-721a-42f8-b116-a9ee6b133102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:30.381425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b6739-721a-42f8-b116-a9ee6b133102 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:30.381697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b6739-721a-42f8-b116-a9ee6b133102 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:30.381967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b6739-721a-42f8-b116-a9ee6b133102 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:30.382588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b6739-721a-42f8-b116-a9ee6b133102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:30.384564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b6739-721a-42f8-b116-a9ee6b133102 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:30.424972 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4536/9070] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:39:30 2022] POST /identity/v3/projects => generated 391 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:39:30.429494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc44ec-cbd1-4d0b-85ba-acc834162098 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:30.440765 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc44ec-cbd1-4d0b-85ba-acc834162098 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:30.500227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e8df5-22c9-475e-a609-d4f11b401cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:30.500848 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e8df5-22c9-475e-a609-d4f11b401cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:30.501148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e8df5-22c9-475e-a609-d4f11b401cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:30.501420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e8df5-22c9-475e-a609-d4f11b401cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:30.502071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e8df5-22c9-475e-a609-d4f11b401cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:30.504110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e8df5-22c9-475e-a609-d4f11b401cf2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:30.529488 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4535/9071] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:39:30 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:39:30.534075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b6739-721a-42f8-b116-a9ee6b133102 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:30.545465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b6739-721a-42f8-b116-a9ee6b133102 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:30.552465 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66e5f8-b72e-443e-a33b-c6f3d2460f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:30.553096 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66e5f8-b72e-443e-a33b-c6f3d2460f49 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:30.553408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66e5f8-b72e-443e-a33b-c6f3d2460f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:30.553680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66e5f8-b72e-443e-a33b-c6f3d2460f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:30.554337 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66e5f8-b72e-443e-a33b-c6f3d2460f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:30.556030 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66e5f8-b72e-443e-a33b-c6f3d2460f49 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:30.567101 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4537/9072] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:39:30.571555 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e8df5-22c9-475e-a609-d4f11b401cf2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:30.585510 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e8df5-22c9-475e-a609-d4f11b401cf2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:30.591668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba65eeb-4020-4a28-9eb1-47d5eeddc835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:30.592300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba65eeb-4020-4a28-9eb1-47d5eeddc835 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:30.592582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba65eeb-4020-4a28-9eb1-47d5eeddc835 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:30.592853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba65eeb-4020-4a28-9eb1-47d5eeddc835 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:30.594172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba65eeb-4020-4a28-9eb1-47d5eeddc835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:30.595712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba65eeb-4020-4a28-9eb1-47d5eeddc835 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:30.608290 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4536/9073] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:39:30.612886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66e5f8-b72e-443e-a33b-c6f3d2460f49 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:30.623376 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66e5f8-b72e-443e-a33b-c6f3d2460f49 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:30.628333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bfb86-1cd1-4a5d-9cf1-c8810095abd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:30.628967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bfb86-1cd1-4a5d-9cf1-c8810095abd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:30.629246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bfb86-1cd1-4a5d-9cf1-c8810095abd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:30.629523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bfb86-1cd1-4a5d-9cf1-c8810095abd5 admin admin] PATH_INFO: `/v3/projects/0d5b7756fd0a4d8d87177fd5797924e2/users/d152c1bfabc54fa3a5a7779d14659340/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:30.645027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bfb86-1cd1-4a5d-9cf1-c8810095abd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5b7756fd0a4d8d87177fd5797924e2, user_id=d152c1bfabc54fa3a5a7779d14659340, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:30.647764 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bfb86-1cd1-4a5d-9cf1-c8810095abd5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:30.662380 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4538/9074] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:39:30 2022] PUT /identity/v3/projects/0d5b7756fd0a4d8d87177fd5797924e2/users/d152c1bfabc54fa3a5a7779d14659340/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:39:30.672925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c23cad-ceb1-4eb2-bb94-e7ca198c203b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:30.673211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c23cad-ceb1-4eb2-bb94-e7ca198c203b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:30.673515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c23cad-ceb1-4eb2-bb94-e7ca198c203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:30.703830 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b9c23cad-ceb1-4eb2-bb94-e7ca198c203b None None] MFA Rules not processed for user `d152c1bfabc54fa3a5a7779d14659340`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:39:30.705013 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b9c23cad-ceb1-4eb2-bb94-e7ca198c203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:30.731135 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:39:30.773339 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4537/9075] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:39:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:39:30.778175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bfb86-1cd1-4a5d-9cf1-c8810095abd5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:30.826352 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:39:30.845737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bfb86-1cd1-4a5d-9cf1-c8810095abd5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:30.851178 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c06b3-e75a-4eaa-af33-4008ca205f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:30.851827 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c06b3-e75a-4eaa-af33-4008ca205f76 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:30.852147 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c06b3-e75a-4eaa-af33-4008ca205f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:30.852419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c06b3-e75a-4eaa-af33-4008ca205f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:30.853055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c06b3-e75a-4eaa-af33-4008ca205f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:30.854963 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c06b3-e75a-4eaa-af33-4008ca205f76 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:30.889502 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4539/9076] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:39:30 2022] POST /identity/v3/projects => generated 393 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:39:30.895516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c23cad-ceb1-4eb2-bb94-e7ca198c203b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:30.909955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c23cad-ceb1-4eb2-bb94-e7ca198c203b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:30.967774 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f878a-7c1a-4e83-a85e-d8581a586554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:30.968313 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f878a-7c1a-4e83-a85e-d8581a586554 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:30.968589 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f878a-7c1a-4e83-a85e-d8581a586554 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:30.968862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f878a-7c1a-4e83-a85e-d8581a586554 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:30.969488 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f878a-7c1a-4e83-a85e-d8581a586554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:30.971482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f878a-7c1a-4e83-a85e-d8581a586554 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:30.994123 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4538/9077] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:39:30 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:39:30.998462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c06b3-e75a-4eaa-af33-4008ca205f76 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:31.009449 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c06b3-e75a-4eaa-af33-4008ca205f76 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:31.014806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bd10d-82c1-485b-be24-7f51e50c8210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:31.015458 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bd10d-82c1-485b-be24-7f51e50c8210 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:31.015741 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bd10d-82c1-485b-be24-7f51e50c8210 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:31.016018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bd10d-82c1-485b-be24-7f51e50c8210 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:31.016669 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bd10d-82c1-485b-be24-7f51e50c8210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:31.018632 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bd10d-82c1-485b-be24-7f51e50c8210 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:31.029655 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4540/9078] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:39:31.034025 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f878a-7c1a-4e83-a85e-d8581a586554 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:31.044895 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f878a-7c1a-4e83-a85e-d8581a586554 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:31.050115 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a87bd-d04c-4cc3-bce1-f4ff56e510d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:31.050799 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a87bd-d04c-4cc3-bce1-f4ff56e510d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:31.051080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a87bd-d04c-4cc3-bce1-f4ff56e510d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:31.051358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a87bd-d04c-4cc3-bce1-f4ff56e510d9 admin admin] PATH_INFO: `/v3/projects/306c0237571b4cf08e6bb36028be333f/users/a8b33d20bcb040bb8499f8c3f3e3abff/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:31.067890 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a87bd-d04c-4cc3-bce1-f4ff56e510d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306c0237571b4cf08e6bb36028be333f, user_id=a8b33d20bcb040bb8499f8c3f3e3abff, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:31.070598 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a87bd-d04c-4cc3-bce1-f4ff56e510d9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:31.086091 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4539/9079] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:39:31 2022] PUT /identity/v3/projects/306c0237571b4cf08e6bb36028be333f/users/a8b33d20bcb040bb8499f8c3f3e3abff/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:39:31.090327 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bd10d-82c1-485b-be24-7f51e50c8210 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:31.101467 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bd10d-82c1-485b-be24-7f51e50c8210 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:31.160383 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f573d6b-8406-452b-8c88-9664596dd988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:31.161031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f573d6b-8406-452b-8c88-9664596dd988 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:31.161311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f573d6b-8406-452b-8c88-9664596dd988 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:31.161583 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f573d6b-8406-452b-8c88-9664596dd988 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:31.162242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f573d6b-8406-452b-8c88-9664596dd988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:31.163926 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f573d6b-8406-452b-8c88-9664596dd988 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:31.174050 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4541/9080] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:39:31.178729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a87bd-d04c-4cc3-bce1-f4ff56e510d9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:31.190200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a87bd-d04c-4cc3-bce1-f4ff56e510d9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:31.195271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920c9cd-acd1-44e6-85cd-3dc7cf331518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:31.195955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920c9cd-acd1-44e6-85cd-3dc7cf331518 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:31.196232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920c9cd-acd1-44e6-85cd-3dc7cf331518 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:31.196508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920c9cd-acd1-44e6-85cd-3dc7cf331518 admin admin] PATH_INFO: `/v3/projects/306c0237571b4cf08e6bb36028be333f/users/a8b33d20bcb040bb8499f8c3f3e3abff/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:31.198494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920c9cd-acd1-44e6-85cd-3dc7cf331518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306c0237571b4cf08e6bb36028be333f, user_id=a8b33d20bcb040bb8499f8c3f3e3abff, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:31.201334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920c9cd-acd1-44e6-85cd-3dc7cf331518 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:31.212080 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4540/9081] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:39:31 2022] PUT /identity/v3/projects/306c0237571b4cf08e6bb36028be333f/users/a8b33d20bcb040bb8499f8c3f3e3abff/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:39:31.224527 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd151579-817b-4482-a760-054d43c4c966 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:31.224697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd151579-817b-4482-a760-054d43c4c966 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:31.224980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd151579-817b-4482-a760-054d43c4c966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:31.252787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fd151579-817b-4482-a760-054d43c4c966 None None] MFA Rules not processed for user `a8b33d20bcb040bb8499f8c3f3e3abff`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:39:31.254036 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fd151579-817b-4482-a760-054d43c4c966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:31.326669 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4542/9082] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:39:31 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:39:31.349699 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920c9cd-acd1-44e6-85cd-3dc7cf331518 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:31.353992 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f920c9cd-acd1-44e6-85cd-3dc7cf331518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:31.438479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920c9cd-acd1-44e6-85cd-3dc7cf331518 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:31.445606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d9373-9e85-4896-b4ca-27b728a4600c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:31.446228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d9373-9e85-4896-b4ca-27b728a4600c service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:31.446513 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d9373-9e85-4896-b4ca-27b728a4600c service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:31.446837 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d9373-9e85-4896-b4ca-27b728a4600c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:31.461042 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:39:31.508195 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d9373-9e85-4896-b4ca-27b728a4600c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:31.509745 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d9373-9e85-4896-b4ca-27b728a4600c service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:31.519290 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4541/9083] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:39:31 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:39:34.330940 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd151579-817b-4482-a760-054d43c4c966 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:34.332682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fd151579-817b-4482-a760-054d43c4c966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:34.394665 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:39:34.419035 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd151579-817b-4482-a760-054d43c4c966 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:34.423595 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1a7a8-78f0-452b-9c4e-0ca68a32f60b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:34.424263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a7a8-78f0-452b-9c4e-0ca68a32f60b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:34.424677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a7a8-78f0-452b-9c4e-0ca68a32f60b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:34.424960 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a7a8-78f0-452b-9c4e-0ca68a32f60b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:34.435547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1a7a8-78f0-452b-9c4e-0ca68a32f60b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:34.437005 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1a7a8-78f0-452b-9c4e-0ca68a32f60b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:34.446955 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4543/9084] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:39:34 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:39:37.561246 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9082ac-8acc-4c48-9cfe-667c1b577ae1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:37.563352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9082ac-8acc-4c48-9cfe-667c1b577ae1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:37.563352 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9082ac-8acc-4c48-9cfe-667c1b577ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:37.591777 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cd9082ac-8acc-4c48-9cfe-667c1b577ae1 None None] MFA Rules not processed for user `d152c1bfabc54fa3a5a7779d14659340`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:39:37.593271 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cd9082ac-8acc-4c48-9cfe-667c1b577ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:37.604207 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4542/9085] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:39:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:39:38.005089 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1a7a8-78f0-452b-9c4e-0ca68a32f60b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:38.013887 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1a7a8-78f0-452b-9c4e-0ca68a32f60b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:38.018229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cc668-4e28-42d9-aa7f-88b93c4bcff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:38.018846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cc668-4e28-42d9-aa7f-88b93c4bcff8 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:38.019129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cc668-4e28-42d9-aa7f-88b93c4bcff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:38.019447 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cc668-4e28-42d9-aa7f-88b93c4bcff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:38.021913 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b49cc668-4e28-42d9-aa7f-88b93c4bcff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:38.032054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cc668-4e28-42d9-aa7f-88b93c4bcff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:38.033507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cc668-4e28-42d9-aa7f-88b93c4bcff8 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:38.041777 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4544/9086] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:39:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:39:38.697850 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9082ac-8acc-4c48-9cfe-667c1b577ae1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:38.699372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cd9082ac-8acc-4c48-9cfe-667c1b577ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:38.801272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9082ac-8acc-4c48-9cfe-667c1b577ae1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:38.806948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3e969-1278-434d-9a44-f3f6c1d4a890 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:38.807599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3e969-1278-434d-9a44-f3f6c1d4a890 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:38.807875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3e969-1278-434d-9a44-f3f6c1d4a890 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:38.808143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3e969-1278-434d-9a44-f3f6c1d4a890 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:38.810418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-47f3e969-1278-434d-9a44-f3f6c1d4a890 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:38.823416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3e969-1278-434d-9a44-f3f6c1d4a890 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:38.825036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3e969-1278-434d-9a44-f3f6c1d4a890 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:38.837876 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4543/9087] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:39:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:39:40.987076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cc668-4e28-42d9-aa7f-88b93c4bcff8 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:40.989212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b49cc668-4e28-42d9-aa7f-88b93c4bcff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:41.000117 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cc668-4e28-42d9-aa7f-88b93c4bcff8 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:41.004308 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8075bed-1c92-4580-ac7c-ea6ce096df57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:41.005348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8075bed-1c92-4580-ac7c-ea6ce096df57 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:41.005727 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8075bed-1c92-4580-ac7c-ea6ce096df57 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:41.006099 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8075bed-1c92-4580-ac7c-ea6ce096df57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:41.008224 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c8075bed-1c92-4580-ac7c-ea6ce096df57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:41.021179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8075bed-1c92-4580-ac7c-ea6ce096df57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:41.022812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8075bed-1c92-4580-ac7c-ea6ce096df57 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:41.034289 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4545/9088] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:39:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:39:48.833151 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=55 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:39:51.028810 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=20 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:02.699599 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3e969-1278-434d-9a44-f3f6c1d4a890 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:02.701227 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-47f3e969-1278-434d-9a44-f3f6c1d4a890 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:02.738983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3e969-1278-434d-9a44-f3f6c1d4a890 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:02.745544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0a8d8-b3fe-4b09-a1b0-83bc4a1ea998 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:02.746148 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0a8d8-b3fe-4b09-a1b0-83bc4a1ea998 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:02.746417 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0a8d8-b3fe-4b09-a1b0-83bc4a1ea998 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:02.746729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0a8d8-b3fe-4b09-a1b0-83bc4a1ea998 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:02.748812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2bf0a8d8-b3fe-4b09-a1b0-83bc4a1ea998 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:02.760994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0a8d8-b3fe-4b09-a1b0-83bc4a1ea998 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:02.762609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0a8d8-b3fe-4b09-a1b0-83bc4a1ea998 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:02.773317 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4544/9089] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:41:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:41:12.200158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8075bed-1c92-4580-ac7c-ea6ce096df57 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:12.214315 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8075bed-1c92-4580-ac7c-ea6ce096df57 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:12.220689 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8eea1-7c0d-4368-b787-342f817f36a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:12.221318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8eea1-7c0d-4368-b787-342f817f36a9 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:12.221630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8eea1-7c0d-4368-b787-342f817f36a9 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:12.221885 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8eea1-7c0d-4368-b787-342f817f36a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:12.223844 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-add8eea1-7c0d-4368-b787-342f817f36a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:12.237001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8eea1-7c0d-4368-b787-342f817f36a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:12.238614 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8eea1-7c0d-4368-b787-342f817f36a9 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:12.251580 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4546/9090] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:41:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:41:12.769612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=15 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:14.579397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0a8d8-b3fe-4b09-a1b0-83bc4a1ea998 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:14.581587 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2bf0a8d8-b3fe-4b09-a1b0-83bc4a1ea998 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:14.607479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0a8d8-b3fe-4b09-a1b0-83bc4a1ea998 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:14.614091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed573eed-718f-49f9-a173-f8eb6e2042a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:14.614930 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573eed-718f-49f9-a173-f8eb6e2042a1 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:14.615308 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573eed-718f-49f9-a173-f8eb6e2042a1 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:14.615724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573eed-718f-49f9-a173-f8eb6e2042a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:14.618406 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ed573eed-718f-49f9-a173-f8eb6e2042a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:14.631372 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed573eed-718f-49f9-a173-f8eb6e2042a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:14.633176 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed573eed-718f-49f9-a173-f8eb6e2042a1 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:14.647766 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4545/9091] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:41:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:41:22.244884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:24.640618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:28.780769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74577f8-91e8-49cc-829a-c86dc3776ff9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:28.781243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74577f8-91e8-49cc-829a-c86dc3776ff9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:28.781532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74577f8-91e8-49cc-829a-c86dc3776ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:28.802294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e74577f8-91e8-49cc-829a-c86dc3776ff9 None None] MFA Rules not processed for user `d152c1bfabc54fa3a5a7779d14659340`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:28.803561 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e74577f8-91e8-49cc-829a-c86dc3776ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:28.810797 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4547/9092] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:41:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:41:29.626471 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed573eed-718f-49f9-a173-f8eb6e2042a1 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:29.650453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed573eed-718f-49f9-a173-f8eb6e2042a1 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:29.676641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f315a0-15ad-417a-8e02-8e1100b66878 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:29.677621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f315a0-15ad-417a-8e02-8e1100b66878 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:29.677893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f315a0-15ad-417a-8e02-8e1100b66878 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:29.678562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f315a0-15ad-417a-8e02-8e1100b66878 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:29.687520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-99f315a0-15ad-417a-8e02-8e1100b66878 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:29.719987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f315a0-15ad-417a-8e02-8e1100b66878 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:29.722029 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f315a0-15ad-417a-8e02-8e1100b66878 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:29.740798 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4546/9093] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:41:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:41:31.793961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74577f8-91e8-49cc-829a-c86dc3776ff9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:31.817065 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74577f8-91e8-49cc-829a-c86dc3776ff9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:31.822103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200d1b6-a5c3-44f2-bfe6-49e8d5269acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:31.822966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200d1b6-a5c3-44f2-bfe6-49e8d5269acf service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:31.823291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200d1b6-a5c3-44f2-bfe6-49e8d5269acf service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:31.823629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200d1b6-a5c3-44f2-bfe6-49e8d5269acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:31.825729 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7200d1b6-a5c3-44f2-bfe6-49e8d5269acf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:31.859311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200d1b6-a5c3-44f2-bfe6-49e8d5269acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:31.861242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200d1b6-a5c3-44f2-bfe6-49e8d5269acf service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:31.872965 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4548/9094] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:41:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:41:39.731728 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:40.331528 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f315a0-15ad-417a-8e02-8e1100b66878 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:40.346614 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f315a0-15ad-417a-8e02-8e1100b66878 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:40.352443 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6d6d0-76e0-4646-9c4a-fb5253840aca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:40.353118 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6d6d0-76e0-4646-9c4a-fb5253840aca service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:40.353397 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6d6d0-76e0-4646-9c4a-fb5253840aca service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:40.353670 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6d6d0-76e0-4646-9c4a-fb5253840aca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:40.355434 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09c6d6d0-76e0-4646-9c4a-fb5253840aca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:40.367899 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6d6d0-76e0-4646-9c4a-fb5253840aca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:40.369531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6d6d0-76e0-4646-9c4a-fb5253840aca service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:40.380691 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4547/9095] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:41:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:41:41.867695 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=14 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:50.376120 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:06.969053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b62bf-b6c6-4f2e-a98f-6fadf2a681ae None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:06.969686 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b62bf-b6c6-4f2e-a98f-6fadf2a681ae None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:06.969998 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b62bf-b6c6-4f2e-a98f-6fadf2a681ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:06.992782 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-644b62bf-b6c6-4f2e-a98f-6fadf2a681ae None None] MFA Rules not processed for user `d152c1bfabc54fa3a5a7779d14659340`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:06.994026 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-644b62bf-b6c6-4f2e-a98f-6fadf2a681ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:07.004245 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4549/9096] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:44:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:07.391906 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6d6d0-76e0-4646-9c4a-fb5253840aca service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:07.403500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6d6d0-76e0-4646-9c4a-fb5253840aca service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:07.409228 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400822d-ca98-495f-b16d-5f3ce46c2d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:07.410238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400822d-ca98-495f-b16d-5f3ce46c2d03 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:07.411559 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400822d-ca98-495f-b16d-5f3ce46c2d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:07.412070 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400822d-ca98-495f-b16d-5f3ce46c2d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:07.416110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f400822d-ca98-495f-b16d-5f3ce46c2d03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:07.429421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400822d-ca98-495f-b16d-5f3ce46c2d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:07.431121 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400822d-ca98-495f-b16d-5f3ce46c2d03 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:07.440820 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4548/9097] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:07.848902 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b62bf-b6c6-4f2e-a98f-6fadf2a681ae None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:07.859825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b62bf-b6c6-4f2e-a98f-6fadf2a681ae None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:07.863572 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8008cb-3c2e-4ac8-a034-5722d8b604b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:07.864184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8008cb-3c2e-4ac8-a034-5722d8b604b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:07.864462 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8008cb-3c2e-4ac8-a034-5722d8b604b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:07.864728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8008cb-3c2e-4ac8-a034-5722d8b604b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:07.866700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cb8008cb-3c2e-4ac8-a034-5722d8b604b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:07.903780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8008cb-3c2e-4ac8-a034-5722d8b604b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:07.905694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8008cb-3c2e-4ac8-a034-5722d8b604b2 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:07.921068 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4550/9098] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:10.927078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400822d-ca98-495f-b16d-5f3ce46c2d03 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:10.945043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400822d-ca98-495f-b16d-5f3ce46c2d03 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:10.952616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a8209-3148-4a07-9409-b5df27303d48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:10.953277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8209-3148-4a07-9409-b5df27303d48 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:10.953556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8209-3148-4a07-9409-b5df27303d48 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:10.953842 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8209-3148-4a07-9409-b5df27303d48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:10.955713 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-593a8209-3148-4a07-9409-b5df27303d48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:10.968760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a8209-3148-4a07-9409-b5df27303d48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:10.970824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a8209-3148-4a07-9409-b5df27303d48 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:10.984244 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4549/9099] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:15.346016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8008cb-3c2e-4ac8-a034-5722d8b604b2 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:15.357961 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8008cb-3c2e-4ac8-a034-5722d8b604b2 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:15.365021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71653bd-6517-40ca-97dd-5636780990fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:15.365670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71653bd-6517-40ca-97dd-5636780990fb service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:15.365952 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71653bd-6517-40ca-97dd-5636780990fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:15.366201 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71653bd-6517-40ca-97dd-5636780990fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:15.372591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b71653bd-6517-40ca-97dd-5636780990fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:15.388547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71653bd-6517-40ca-97dd-5636780990fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:15.390075 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71653bd-6517-40ca-97dd-5636780990fb service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:15.401874 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4551/9100] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:44:20.979776 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=12 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:25.396833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=20 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:57.846215 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a8209-3148-4a07-9409-b5df27303d48 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:57.858032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a8209-3148-4a07-9409-b5df27303d48 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:57.864597 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723e806-bc6f-4aad-93a6-3cfc2f43b87a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:57.865209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723e806-bc6f-4aad-93a6-3cfc2f43b87a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:57.865494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723e806-bc6f-4aad-93a6-3cfc2f43b87a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:57.865769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723e806-bc6f-4aad-93a6-3cfc2f43b87a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:57.874298 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723e806-bc6f-4aad-93a6-3cfc2f43b87a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:57.875928 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723e806-bc6f-4aad-93a6-3cfc2f43b87a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:57.887761 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4550/9101] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:57 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:45:00.304443 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71653bd-6517-40ca-97dd-5636780990fb service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:00.314497 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71653bd-6517-40ca-97dd-5636780990fb service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:00.318943 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e995ed-5912-4de1-9a67-9a6771fc3ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:00.319590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e995ed-5912-4de1-9a67-9a6771fc3ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:00.319870 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e995ed-5912-4de1-9a67-9a6771fc3ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:00.320143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e995ed-5912-4de1-9a67-9a6771fc3ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:00.327969 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e995ed-5912-4de1-9a67-9a6771fc3ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:00.329400 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e995ed-5912-4de1-9a67-9a6771fc3ff7 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:00.338245 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4552/9102] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:45:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:45:07.881094 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:10.334428 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:28.648882 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a97c09-54b5-49f5-abae-1f6cf4304d1a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:28.650155 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a97c09-54b5-49f5-abae-1f6cf4304d1a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:28.650669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a97c09-54b5-49f5-abae-1f6cf4304d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:28.705482 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-59a97c09-54b5-49f5-abae-1f6cf4304d1a None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:45:28.706635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-59a97c09-54b5-49f5-abae-1f6cf4304d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:28.713865 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4551/9103] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 19:45:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:45:28.725592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e995ed-5912-4de1-9a67-9a6771fc3ff7 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:28.734551 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e995ed-5912-4de1-9a67-9a6771fc3ff7 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:28.738361 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf94901-abd2-4ea4-9938-cd4c70c93a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:28.738966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf94901-abd2-4ea4-9938-cd4c70c93a6c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:28.739246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf94901-abd2-4ea4-9938-cd4c70c93a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:28.739545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf94901-abd2-4ea4-9938-cd4c70c93a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:28.746842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf94901-abd2-4ea4-9938-cd4c70c93a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:28.748329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf94901-abd2-4ea4-9938-cd4c70c93a6c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:28.757650 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4553/9104] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:45:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:45:28.852066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d11617-1751-4718-b596-232e2430e5bb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:28.852332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d11617-1751-4718-b596-232e2430e5bb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:28.852586 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d11617-1751-4718-b596-232e2430e5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:28.896884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c6d11617-1751-4718-b596-232e2430e5bb None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:45:28.898102 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c6d11617-1751-4718-b596-232e2430e5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:28.907971 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4552/9105] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 19:45:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:45:28.922921 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf94901-abd2-4ea4-9938-cd4c70c93a6c service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:28.942329 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf94901-abd2-4ea4-9938-cd4c70c93a6c service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:28.948670 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c797ba7-56fa-4437-b7b6-0c8b7ce104e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:28.949305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c797ba7-56fa-4437-b7b6-0c8b7ce104e2 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:28.949594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c797ba7-56fa-4437-b7b6-0c8b7ce104e2 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:28.949878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c797ba7-56fa-4437-b7b6-0c8b7ce104e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:28.959068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c797ba7-56fa-4437-b7b6-0c8b7ce104e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:28.960637 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c797ba7-56fa-4437-b7b6-0c8b7ce104e2 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:28.971743 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4554/9106] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:45:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:45:29.161388 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d6e32-d18b-4569-adc3-a90699214e00 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:29.161685 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d6e32-d18b-4569-adc3-a90699214e00 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:29.161978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d6e32-d18b-4569-adc3-a90699214e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:29.205784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-614d6e32-d18b-4569-adc3-a90699214e00 None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:45:29.206993 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-614d6e32-d18b-4569-adc3-a90699214e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:29.219397 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4553/9107] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 19:45:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:45:29.228663 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c797ba7-56fa-4437-b7b6-0c8b7ce104e2 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:29.238917 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c797ba7-56fa-4437-b7b6-0c8b7ce104e2 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:29.242650 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728fd3d-fc34-4adb-a153-748035a63a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:29.243290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728fd3d-fc34-4adb-a153-748035a63a7b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:29.243588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728fd3d-fc34-4adb-a153-748035a63a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:29.243861 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728fd3d-fc34-4adb-a153-748035a63a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:29.255082 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728fd3d-fc34-4adb-a153-748035a63a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:29.256594 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728fd3d-fc34-4adb-a153-748035a63a7b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:29.270148 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4555/9108] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:45:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:45:39.202707 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=31 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:39.263951 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=18 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:46:08.642688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d6e32-d18b-4569-adc3-a90699214e00 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:46:08.655531 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d6e32-d18b-4569-adc3-a90699214e00 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:46:08.661212 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db192a-2940-4283-8b83-0a7d29d73f4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:46:08.661888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db192a-2940-4283-8b83-0a7d29d73f4b service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:46:08.662169 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db192a-2940-4283-8b83-0a7d29d73f4b service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:46:08.662448 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db192a-2940-4283-8b83-0a7d29d73f4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:46:08.671187 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db192a-2940-4283-8b83-0a7d29d73f4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:46:08.672875 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db192a-2940-4283-8b83-0a7d29d73f4b service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:46:08.682904 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4554/9109] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:46:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:46:15.202049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728fd3d-fc34-4adb-a153-748035a63a7b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:46:15.215538 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728fd3d-fc34-4adb-a153-748035a63a7b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:46:15.222269 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6428c-2139-41d3-9f56-7d997fca3aab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:46:15.222891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6428c-2139-41d3-9f56-7d997fca3aab service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:46:15.223177 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6428c-2139-41d3-9f56-7d997fca3aab service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:46:15.223486 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6428c-2139-41d3-9f56-7d997fca3aab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:46:15.233215 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6428c-2139-41d3-9f56-7d997fca3aab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:46:15.235725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6428c-2139-41d3-9f56-7d997fca3aab service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:46:15.248757 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4556/9110] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:46:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:46:18.678865 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:46:25.244263 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:46:40.546199 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db192a-2940-4283-8b83-0a7d29d73f4b service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:46:40.570902 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db192a-2940-4283-8b83-0a7d29d73f4b service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:46:40.575402 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e964e6-151a-40a6-a641-1b012befa9a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:46:40.576439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e964e6-151a-40a6-a641-1b012befa9a0 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:46:40.576439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e964e6-151a-40a6-a641-1b012befa9a0 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:46:40.576755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e964e6-151a-40a6-a641-1b012befa9a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:46:40.588185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e964e6-151a-40a6-a641-1b012befa9a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:46:40.589867 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e964e6-151a-40a6-a641-1b012befa9a0 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:46:40.601644 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4555/9111] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:46:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:46:40.699321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6428c-2139-41d3-9f56-7d997fca3aab service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:46:40.711191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6428c-2139-41d3-9f56-7d997fca3aab service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:46:40.715630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21908-b7a2-4140-8244-edee121e42e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:46:40.716277 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21908-b7a2-4140-8244-edee121e42e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:46:40.716555 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21908-b7a2-4140-8244-edee121e42e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:46:40.716834 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21908-b7a2-4140-8244-edee121e42e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:46:40.725629 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad21908-b7a2-4140-8244-edee121e42e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:46:40.727120 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad21908-b7a2-4140-8244-edee121e42e4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:46:40.736195 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4557/9112] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:46:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:46:47.235833 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e964e6-151a-40a6-a641-1b012befa9a0 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:46:47.251424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e964e6-151a-40a6-a641-1b012befa9a0 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:46:47.258518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ecb9e-b88e-4017-bbfe-9670508cc67e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:46:47.259487 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ecb9e-b88e-4017-bbfe-9670508cc67e service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:46:47.259889 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ecb9e-b88e-4017-bbfe-9670508cc67e service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:46:47.260277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ecb9e-b88e-4017-bbfe-9670508cc67e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:46:47.263161 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4c8ecb9e-b88e-4017-bbfe-9670508cc67e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:46:47.276142 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ecb9e-b88e-4017-bbfe-9670508cc67e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:46:47.277756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ecb9e-b88e-4017-bbfe-9670508cc67e service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:46:47.288842 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4556/9113] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:46:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:46:50.565872 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21908-b7a2-4140-8244-edee121e42e4 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:46:50.575483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21908-b7a2-4140-8244-edee121e42e4 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:46:50.580116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb53c74-14ea-4fbf-a5da-9e75aebb835d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:46:50.580847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb53c74-14ea-4fbf-a5da-9e75aebb835d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:46:50.581131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb53c74-14ea-4fbf-a5da-9e75aebb835d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:46:50.581403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb53c74-14ea-4fbf-a5da-9e75aebb835d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:46:50.591657 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb53c74-14ea-4fbf-a5da-9e75aebb835d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:46:50.593387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb53c74-14ea-4fbf-a5da-9e75aebb835d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:46:50.603886 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4558/9114] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:46:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:46:53.547234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfeeda-03c4-4e26-858a-32b431586735 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:46:53.547719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfeeda-03c4-4e26-858a-32b431586735 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:46:53.547950 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfeeda-03c4-4e26-858a-32b431586735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:46:53.569054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e9cfeeda-03c4-4e26-858a-32b431586735 None None] MFA Rules not processed for user `d152c1bfabc54fa3a5a7779d14659340`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:46:53.570539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e9cfeeda-03c4-4e26-858a-32b431586735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:46:53.578613 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4557/9115] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:46:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:46:53.957979 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb53c74-14ea-4fbf-a5da-9e75aebb835d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:46:53.968318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb53c74-14ea-4fbf-a5da-9e75aebb835d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:46:53.972965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbbd65-d813-4b03-a7b7-1eecb1525659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:46:53.974128 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbbd65-d813-4b03-a7b7-1eecb1525659 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:46:53.974514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbbd65-d813-4b03-a7b7-1eecb1525659 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:46:53.974793 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbbd65-d813-4b03-a7b7-1eecb1525659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:46:53.985118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbbd65-d813-4b03-a7b7-1eecb1525659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:46:53.987074 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbbd65-d813-4b03-a7b7-1eecb1525659 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:46:53.999729 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4559/9116] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:46:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:46:54.422342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfeeda-03c4-4e26-858a-32b431586735 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:46:54.444333 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfeeda-03c4-4e26-858a-32b431586735 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:46:54.451424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a89eee-3a16-47bd-9c26-295f43fa04f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:46:54.452497 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a89eee-3a16-47bd-9c26-295f43fa04f4 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:46:54.453346 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a89eee-3a16-47bd-9c26-295f43fa04f4 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:46:54.453994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a89eee-3a16-47bd-9c26-295f43fa04f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:46:54.472250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a89eee-3a16-47bd-9c26-295f43fa04f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:46:54.482380 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a89eee-3a16-47bd-9c26-295f43fa04f4 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:46:54.495561 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4558/9117] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:46:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:47:03.993058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=18 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:47:04.490338 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=21 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:47:04.743330 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbbd65-d813-4b03-a7b7-1eecb1525659 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:47:04.757962 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbbd65-d813-4b03-a7b7-1eecb1525659 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:47:04.763682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd6c23-655f-4413-a0c5-53959052bab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:47:04.764313 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd6c23-655f-4413-a0c5-53959052bab7 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:04.764588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd6c23-655f-4413-a0c5-53959052bab7 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:04.764856 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd6c23-655f-4413-a0c5-53959052bab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:04.774633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd6c23-655f-4413-a0c5-53959052bab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:47:04.776268 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd6c23-655f-4413-a0c5-53959052bab7 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:47:04.787197 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4560/9118] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:47:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:47:14.782920 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:49:39.376518 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a89eee-3a16-47bd-9c26-295f43fa04f4 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:49:39.379043 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-07a89eee-3a16-47bd-9c26-295f43fa04f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:49:39.488489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a89eee-3a16-47bd-9c26-295f43fa04f4 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:49:39.492316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9bd0e-d75f-4b94-b987-6aa4e448dc21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:49:39.492961 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9bd0e-d75f-4b94-b987-6aa4e448dc21 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:39.493222 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9bd0e-d75f-4b94-b987-6aa4e448dc21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:39.493511 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9bd0e-d75f-4b94-b987-6aa4e448dc21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:39.593621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9bd0e-d75f-4b94-b987-6aa4e448dc21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:49:39.595082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9bd0e-d75f-4b94-b987-6aa4e448dc21 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:49:39.615952 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4559/9119] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:49:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:49:40.820879 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd6c23-655f-4413-a0c5-53959052bab7 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:49:40.848700 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd6c23-655f-4413-a0c5-53959052bab7 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:49:40.853983 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3d5cd-125a-4833-957b-4c11f6079ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:49:40.854697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3d5cd-125a-4833-957b-4c11f6079ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:40.854980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3d5cd-125a-4833-957b-4c11f6079ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:40.855281 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3d5cd-125a-4833-957b-4c11f6079ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:40.867651 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3d5cd-125a-4833-957b-4c11f6079ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:49:40.869846 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3d5cd-125a-4833-957b-4c11f6079ab4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:49:40.882650 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4561/9120] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:49:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:49:41.748609 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9bd0e-d75f-4b94-b987-6aa4e448dc21 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:49:41.762982 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9bd0e-d75f-4b94-b987-6aa4e448dc21 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:49:41.770687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df581f-87cc-472c-baed-174ffd937fc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:49:41.771453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df581f-87cc-472c-baed-174ffd937fc1 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:41.771784 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df581f-87cc-472c-baed-174ffd937fc1 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:41.772203 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df581f-87cc-472c-baed-174ffd937fc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:41.784036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df581f-87cc-472c-baed-174ffd937fc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:49:41.785714 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df581f-87cc-472c-baed-174ffd937fc1 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:49:41.796798 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4560/9121] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:49:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:49:46.478375 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3d5cd-125a-4833-957b-4c11f6079ab4 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:49:46.480041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-09b3d5cd-125a-4833-957b-4c11f6079ab4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:49:46.568230 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3d5cd-125a-4833-957b-4c11f6079ab4 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:49:46.576425 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae141a-f98b-4f70-a1c1-53b918f87725 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:49:46.577067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae141a-f98b-4f70-a1c1-53b918f87725 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:46.577349 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae141a-f98b-4f70-a1c1-53b918f87725 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:46.577716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae141a-f98b-4f70-a1c1-53b918f87725 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:46.579562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-28ae141a-f98b-4f70-a1c1-53b918f87725 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:49:46.591867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae141a-f98b-4f70-a1c1-53b918f87725 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:49:46.593696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae141a-f98b-4f70-a1c1-53b918f87725 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:49:46.605580 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4562/9122] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:49:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:49:51.793126 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:49:53.290205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d512f9-ff76-46d3-af07-ec67f23cb55c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:53.290779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d512f9-ff76-46d3-af07-ec67f23cb55c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:53.290779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d512f9-ff76-46d3-af07-ec67f23cb55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:53.354311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-24d512f9-ff76-46d3-af07-ec67f23cb55c None None] MFA Rules not processed for user `d152c1bfabc54fa3a5a7779d14659340`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:49:53.355632 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24d512f9-ff76-46d3-af07-ec67f23cb55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:49:53.431910 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4561/9123] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:49:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:49:53.831233 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae141a-f98b-4f70-a1c1-53b918f87725 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:49:53.844460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae141a-f98b-4f70-a1c1-53b918f87725 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:49:53.848999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f00bd-2752-4e57-979a-9b7482058e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:49:53.849630 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f00bd-2752-4e57-979a-9b7482058e1f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:53.849912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f00bd-2752-4e57-979a-9b7482058e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:53.850191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f00bd-2752-4e57-979a-9b7482058e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:53.861052 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f00bd-2752-4e57-979a-9b7482058e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:49:53.862633 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f00bd-2752-4e57-979a-9b7482058e1f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:49:53.871842 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4563/9124] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:49:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:49:54.564834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d512f9-ff76-46d3-af07-ec67f23cb55c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:49:54.583278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d512f9-ff76-46d3-af07-ec67f23cb55c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:49:54.588512 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09805d27-cf16-4b54-9d28-bea813d793ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:49:54.589345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09805d27-cf16-4b54-9d28-bea813d793ac service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:54.589727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09805d27-cf16-4b54-9d28-bea813d793ac service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:54.590104 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09805d27-cf16-4b54-9d28-bea813d793ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:54.599704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09805d27-cf16-4b54-9d28-bea813d793ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:49:54.601590 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09805d27-cf16-4b54-9d28-bea813d793ac service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:49:54.623394 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4562/9125] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:49:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:49:58.071357 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f00bd-2752-4e57-979a-9b7482058e1f service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:49:58.086730 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f00bd-2752-4e57-979a-9b7482058e1f service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:49:58.093839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885f156-5cd5-4bbc-b118-ae1fe897c897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:49:58.094932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885f156-5cd5-4bbc-b118-ae1fe897c897 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:58.094932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885f156-5cd5-4bbc-b118-ae1fe897c897 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:58.095168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885f156-5cd5-4bbc-b118-ae1fe897c897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:58.097134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e885f156-5cd5-4bbc-b118-ae1fe897c897 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:49:58.109182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885f156-5cd5-4bbc-b118-ae1fe897c897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:49:58.111056 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885f156-5cd5-4bbc-b118-ae1fe897c897 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:49:58.122222 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4564/9126] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:49:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:50:04.608540 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=47 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:50:08.116767 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=55 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:51:11.657716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09805d27-cf16-4b54-9d28-bea813d793ac service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:11.659408 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09805d27-cf16-4b54-9d28-bea813d793ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:11.698145 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09805d27-cf16-4b54-9d28-bea813d793ac service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:11.704303 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2502f3-1ae2-43a4-a0c4-c1e531e6c413 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:11.705078 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2502f3-1ae2-43a4-a0c4-c1e531e6c413 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:11.705353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2502f3-1ae2-43a4-a0c4-c1e531e6c413 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:11.705591 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2502f3-1ae2-43a4-a0c4-c1e531e6c413 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:11.707717 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-df2502f3-1ae2-43a4-a0c4-c1e531e6c413 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:11.720435 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2502f3-1ae2-43a4-a0c4-c1e531e6c413 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:11.722012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2502f3-1ae2-43a4-a0c4-c1e531e6c413 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:11.732873 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4563/9127] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:51:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:51:15.217677 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885f156-5cd5-4bbc-b118-ae1fe897c897 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:15.229822 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885f156-5cd5-4bbc-b118-ae1fe897c897 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:15.236403 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa5079-f47b-4282-bcb2-ac492a3ce0b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:15.237011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa5079-f47b-4282-bcb2-ac492a3ce0b5 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:15.237287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa5079-f47b-4282-bcb2-ac492a3ce0b5 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:15.237564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa5079-f47b-4282-bcb2-ac492a3ce0b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:15.239612 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1dfa5079-f47b-4282-bcb2-ac492a3ce0b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:15.252168 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa5079-f47b-4282-bcb2-ac492a3ce0b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:15.253750 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa5079-f47b-4282-bcb2-ac492a3ce0b5 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:15.264288 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4565/9128] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:51:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:51:21.728107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=15 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:51:25.259881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:51:37.598831 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2502f3-1ae2-43a4-a0c4-c1e531e6c413 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:37.600525 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-df2502f3-1ae2-43a4-a0c4-c1e531e6c413 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:37.712768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2502f3-1ae2-43a4-a0c4-c1e531e6c413 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:37.717995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93ddb9-3e33-46b4-8901-c8babc31427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:37.718633 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93ddb9-3e33-46b4-8901-c8babc31427d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:37.718940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93ddb9-3e33-46b4-8901-c8babc31427d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:37.719217 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93ddb9-3e33-46b4-8901-c8babc31427d admin admin] PATH_INFO: `/v3/users/d152c1bfabc54fa3a5a7779d14659340` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:37.720506 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93ddb9-3e33-46b4-8901-c8babc31427d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d152c1bfabc54fa3a5a7779d14659340)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:37.722501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93ddb9-3e33-46b4-8901-c8babc31427d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:37.780300 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a93ddb9-3e33-46b4-8901-c8babc31427d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd152c1bfabc54fa3a5a7779d14659340'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:37.781322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a93ddb9-3e33-46b4-8901-c8babc31427d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd152c1bfabc54fa3a5a7779d14659340'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:37.788439 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a93ddb9-3e33-46b4-8901-c8babc31427d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd152c1bfabc54fa3a5a7779d14659340'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:37.805110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a93ddb9-3e33-46b4-8901-c8babc31427d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd152c1bfabc54fa3a5a7779d14659340'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:37.818623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a93ddb9-3e33-46b4-8901-c8babc31427d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd152c1bfabc54fa3a5a7779d14659340'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:37.826129 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4564/9129] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:51:37 2022] DELETE /identity/v3/users/d152c1bfabc54fa3a5a7779d14659340 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:51:37.831439 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2d62c-c081-4534-a287-303899473785 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:37.831980 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2d62c-c081-4534-a287-303899473785 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:37.832390 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2d62c-c081-4534-a287-303899473785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:37.862715 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-01f2d62c-c081-4534-a287-303899473785 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:51:37.863991 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-01f2d62c-c081-4534-a287-303899473785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:37.938799 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4566/9130] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:51:37.949050 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93ddb9-3e33-46b4-8901-c8babc31427d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:37.950730 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9a93ddb9-3e33-46b4-8901-c8babc31427d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:38.015219 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:51:38.032539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93ddb9-3e33-46b4-8901-c8babc31427d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:38.036451 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce7210-3390-48b0-8328-1b418d4b4e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:38.037091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce7210-3390-48b0-8328-1b418d4b4e2d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:38.037364 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce7210-3390-48b0-8328-1b418d4b4e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:38.037656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce7210-3390-48b0-8328-1b418d4b4e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:38.048235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce7210-3390-48b0-8328-1b418d4b4e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:38.049971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce7210-3390-48b0-8328-1b418d4b4e2d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:38.060736 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4565/9131] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:51:38.245028 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2d62c-c081-4534-a287-303899473785 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:38.246531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-01f2d62c-c081-4534-a287-303899473785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:38.264126 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2d62c-c081-4534-a287-303899473785 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:38.270496 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07df49-86e8-4dbd-92a4-2f29e828bad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:38.271181 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07df49-86e8-4dbd-92a4-2f29e828bad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:38.271499 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07df49-86e8-4dbd-92a4-2f29e828bad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:38.271770 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07df49-86e8-4dbd-92a4-2f29e828bad3 admin admin] PATH_INFO: `/v3/projects/0d5b7756fd0a4d8d87177fd5797924e2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:38.273093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07df49-86e8-4dbd-92a4-2f29e828bad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5b7756fd0a4d8d87177fd5797924e2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:38.275140 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07df49-86e8-4dbd-92a4-2f29e828bad3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:38.347956 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb07df49-86e8-4dbd-92a4-2f29e828bad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5b7756fd0a4d8d87177fd5797924e2', 'request_id': 'req-bb07df49-86e8-4dbd-92a4-2f29e828bad3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:38.355295 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb07df49-86e8-4dbd-92a4-2f29e828bad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5b7756fd0a4d8d87177fd5797924e2', 'request_id': 'req-bb07df49-86e8-4dbd-92a4-2f29e828bad3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:38.361691 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb07df49-86e8-4dbd-92a4-2f29e828bad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5b7756fd0a4d8d87177fd5797924e2', 'request_id': 'req-bb07df49-86e8-4dbd-92a4-2f29e828bad3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:38.376857 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb07df49-86e8-4dbd-92a4-2f29e828bad3 admin admin] The token cache is being invalidate because project 0d5b7756fd0a4d8d87177fd5797924e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:51:38.377426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb07df49-86e8-4dbd-92a4-2f29e828bad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:38.379153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb07df49-86e8-4dbd-92a4-2f29e828bad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:38.381180 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4567/9132] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:51:38 2022] DELETE /identity/v3/projects/0d5b7756fd0a4d8d87177fd5797924e2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:51:38.386710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce7210-3390-48b0-8328-1b418d4b4e2d service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:38.398315 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce7210-3390-48b0-8328-1b418d4b4e2d service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:38.469855 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68266ac-262f-44b5-94c0-d056592f355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:38.470575 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68266ac-262f-44b5-94c0-d056592f355f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:38.471550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68266ac-262f-44b5-94c0-d056592f355f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:38.471550 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68266ac-262f-44b5-94c0-d056592f355f admin admin] PATH_INFO: `/v3/users/a8b33d20bcb040bb8499f8c3f3e3abff` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:38.485994 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68266ac-262f-44b5-94c0-d056592f355f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8b33d20bcb040bb8499f8c3f3e3abff)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:38.488071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68266ac-262f-44b5-94c0-d056592f355f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:38.545721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a68266ac-262f-44b5-94c0-d056592f355f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8b33d20bcb040bb8499f8c3f3e3abff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:38.546467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a68266ac-262f-44b5-94c0-d056592f355f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8b33d20bcb040bb8499f8c3f3e3abff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:38.555779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a68266ac-262f-44b5-94c0-d056592f355f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8b33d20bcb040bb8499f8c3f3e3abff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:38.566107 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a68266ac-262f-44b5-94c0-d056592f355f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8b33d20bcb040bb8499f8c3f3e3abff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:38.582826 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a68266ac-262f-44b5-94c0-d056592f355f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8b33d20bcb040bb8499f8c3f3e3abff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:38.590022 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4566/9133] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 19:51:38 2022] DELETE /identity/v3/users/a8b33d20bcb040bb8499f8c3f3e3abff => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:51:38.896284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07df49-86e8-4dbd-92a4-2f29e828bad3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:38.897842 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bb07df49-86e8-4dbd-92a4-2f29e828bad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:38.911245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07df49-86e8-4dbd-92a4-2f29e828bad3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:38.972533 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b479c7-1d07-4851-9871-70f4653df3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:38.973197 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b479c7-1d07-4851-9871-70f4653df3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:38.973507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b479c7-1d07-4851-9871-70f4653df3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:38.973777 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b479c7-1d07-4851-9871-70f4653df3b9 admin admin] PATH_INFO: `/v3/projects/306c0237571b4cf08e6bb36028be333f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:38.984851 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b479c7-1d07-4851-9871-70f4653df3b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=306c0237571b4cf08e6bb36028be333f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:38.986774 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b479c7-1d07-4851-9871-70f4653df3b9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:38.997654 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:51:39.034806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-11b479c7-1d07-4851-9871-70f4653df3b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '306c0237571b4cf08e6bb36028be333f', 'request_id': 'req-11b479c7-1d07-4851-9871-70f4653df3b9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:39.041603 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-11b479c7-1d07-4851-9871-70f4653df3b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '306c0237571b4cf08e6bb36028be333f', 'request_id': 'req-11b479c7-1d07-4851-9871-70f4653df3b9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:39.047452 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-11b479c7-1d07-4851-9871-70f4653df3b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '306c0237571b4cf08e6bb36028be333f', 'request_id': 'req-11b479c7-1d07-4851-9871-70f4653df3b9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:39.063031 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-11b479c7-1d07-4851-9871-70f4653df3b9 admin admin] The token cache is being invalidate because project 306c0237571b4cf08e6bb36028be333f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:51:39.063342 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-11b479c7-1d07-4851-9871-70f4653df3b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:39.063985 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-11b479c7-1d07-4851-9871-70f4653df3b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:51:39.065553 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4568/9134] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 19:51:38 2022] DELETE /identity/v3/projects/306c0237571b4cf08e6bb36028be333f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:51:39.071196 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873b29b-d62f-4ef3-a69b-f324c81307ac None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:39.071719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873b29b-d62f-4ef3-a69b-f324c81307ac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:39.071822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873b29b-d62f-4ef3-a69b-f324c81307ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:39.111940 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f873b29b-d62f-4ef3-a69b-f324c81307ac None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:51:39.113140 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f873b29b-d62f-4ef3-a69b-f324c81307ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:39.144095 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:51:39.181011 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4567/9135] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:51:39.191901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9f230-2760-4492-8175-1c8c18648ec7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:39.192193 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9f230-2760-4492-8175-1c8c18648ec7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:39.192470 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9f230-2760-4492-8175-1c8c18648ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:39.214891 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-46c9f230-2760-4492-8175-1c8c18648ec7 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:51:39.216170 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-46c9f230-2760-4492-8175-1c8c18648ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:39.226454 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4569/9136] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:51:39.231770 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873b29b-d62f-4ef3-a69b-f324c81307ac None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:39.248170 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873b29b-d62f-4ef3-a69b-f324c81307ac None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:39.254782 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b66e6c-de0a-4b4a-b8d9-2a56b0feb0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:39.255422 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b66e6c-de0a-4b4a-b8d9-2a56b0feb0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:39.255695 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b66e6c-de0a-4b4a-b8d9-2a56b0feb0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:39.255963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b66e6c-de0a-4b4a-b8d9-2a56b0feb0e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:39.256623 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b66e6c-de0a-4b4a-b8d9-2a56b0feb0e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:51:39.256923 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b66e6c-de0a-4b4a-b8d9-2a56b0feb0e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:39.258549 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b66e6c-de0a-4b4a-b8d9-2a56b0feb0e0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:39.271133 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4568/9137] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 19:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:51:39.275865 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9f230-2760-4492-8175-1c8c18648ec7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:39.286206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9f230-2760-4492-8175-1c8c18648ec7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:39.292248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605d221-a677-499f-b6b9-6b5c0e264c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:39.292867 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605d221-a677-499f-b6b9-6b5c0e264c6e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:39.293145 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605d221-a677-499f-b6b9-6b5c0e264c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:39.293416 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605d221-a677-499f-b6b9-6b5c0e264c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:39.294088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605d221-a677-499f-b6b9-6b5c0e264c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:39.296041 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605d221-a677-499f-b6b9-6b5c0e264c6e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:39.340641 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4570/9138] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:51:39 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:51:39.346225 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b66e6c-de0a-4b4a-b8d9-2a56b0feb0e0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:39.356787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b66e6c-de0a-4b4a-b8d9-2a56b0feb0e0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:39.425522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180bc78-d7b5-4960-af2c-dba98ed1cc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:39.426056 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180bc78-d7b5-4960-af2c-dba98ed1cc22 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:39.426330 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180bc78-d7b5-4960-af2c-dba98ed1cc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:39.426606 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180bc78-d7b5-4960-af2c-dba98ed1cc22 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:39.427245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180bc78-d7b5-4960-af2c-dba98ed1cc22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:39.429211 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180bc78-d7b5-4960-af2c-dba98ed1cc22 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:39.455989 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4569/9139] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:51:39 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:51:39.460567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605d221-a677-499f-b6b9-6b5c0e264c6e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:39.471508 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605d221-a677-499f-b6b9-6b5c0e264c6e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:39.477095 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbed7fd-f7d7-45a0-ba3d-8c2c72d38e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:39.477712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbed7fd-f7d7-45a0-ba3d-8c2c72d38e47 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:39.477990 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbed7fd-f7d7-45a0-ba3d-8c2c72d38e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:39.478322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbed7fd-f7d7-45a0-ba3d-8c2c72d38e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:39.478987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbed7fd-f7d7-45a0-ba3d-8c2c72d38e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:39.480667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbed7fd-f7d7-45a0-ba3d-8c2c72d38e47 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:39.491870 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4571/9140] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:51:39.495862 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180bc78-d7b5-4960-af2c-dba98ed1cc22 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:39.506486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180bc78-d7b5-4960-af2c-dba98ed1cc22 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:39.512064 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd727e6-070a-45da-83a1-639d1db8cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:39.512724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd727e6-070a-45da-83a1-639d1db8cb25 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:39.513002 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd727e6-070a-45da-83a1-639d1db8cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:39.513277 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd727e6-070a-45da-83a1-639d1db8cb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:39.513932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd727e6-070a-45da-83a1-639d1db8cb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:39.515662 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd727e6-070a-45da-83a1-639d1db8cb25 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:39.528556 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4570/9141] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:51:39.533427 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbed7fd-f7d7-45a0-ba3d-8c2c72d38e47 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:39.544305 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbed7fd-f7d7-45a0-ba3d-8c2c72d38e47 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:39.550420 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e76da0-df53-4d0f-b784-051acb92406d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:39.551083 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e76da0-df53-4d0f-b784-051acb92406d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:39.551408 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e76da0-df53-4d0f-b784-051acb92406d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:39.551683 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e76da0-df53-4d0f-b784-051acb92406d admin admin] PATH_INFO: `/v3/projects/24c2644593764fada9cfcafbedd96f98/users/2e4d8d3d3b0647819d66680c6790309e/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:39.569216 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e76da0-df53-4d0f-b784-051acb92406d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c2644593764fada9cfcafbedd96f98, user_id=2e4d8d3d3b0647819d66680c6790309e, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:39.571958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e76da0-df53-4d0f-b784-051acb92406d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:39.588699 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4572/9142] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:51:39 2022] PUT /identity/v3/projects/24c2644593764fada9cfcafbedd96f98/users/2e4d8d3d3b0647819d66680c6790309e/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:51:39.594096 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0506686-01a8-4828-be22-6faac78d4d0a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:39.594390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0506686-01a8-4828-be22-6faac78d4d0a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:39.594667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0506686-01a8-4828-be22-6faac78d4d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:39.615109 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e0506686-01a8-4828-be22-6faac78d4d0a None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:51:39.616398 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e0506686-01a8-4828-be22-6faac78d4d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:39.677613 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4571/9143] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:51:39.687762 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e76da0-df53-4d0f-b784-051acb92406d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:39.690068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a8e76da0-df53-4d0f-b784-051acb92406d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:39.751078 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e76da0-df53-4d0f-b784-051acb92406d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:39.755987 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bedcf-d1c0-4f48-8920-0d67b930ce2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:39.756623 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bedcf-d1c0-4f48-8920-0d67b930ce2b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:39.756901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bedcf-d1c0-4f48-8920-0d67b930ce2b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:39.757312 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bedcf-d1c0-4f48-8920-0d67b930ce2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:39.769103 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548bedcf-d1c0-4f48-8920-0d67b930ce2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:39.770717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548bedcf-d1c0-4f48-8920-0d67b930ce2b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:39.781101 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4573/9144] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:51:44.012103 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a37df-c879-479c-8ba9-35567b4900e5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:44.012613 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a37df-c879-479c-8ba9-35567b4900e5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:44.012828 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a37df-c879-479c-8ba9-35567b4900e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:44.044191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-db7a37df-c879-479c-8ba9-35567b4900e5 None None] MFA Rules not processed for user `2e4d8d3d3b0647819d66680c6790309e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:51:44.045493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db7a37df-c879-479c-8ba9-35567b4900e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:44.080781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:51:44.121732 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4572/9145] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:51:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:51:44.126635 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bedcf-d1c0-4f48-8920-0d67b930ce2b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:44.137631 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bedcf-d1c0-4f48-8920-0d67b930ce2b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:44.144153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b6a2a-d114-4bc9-95f5-84ba2ebc00f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:44.145109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b6a2a-d114-4bc9-95f5-84ba2ebc00f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:44.145602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b6a2a-d114-4bc9-95f5-84ba2ebc00f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:44.146326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b6a2a-d114-4bc9-95f5-84ba2ebc00f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:44.147088 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b6a2a-d114-4bc9-95f5-84ba2ebc00f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:44.149130 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b6a2a-d114-4bc9-95f5-84ba2ebc00f3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:44.186652 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4574/9146] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 19:51:44 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:51:44.191414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a37df-c879-479c-8ba9-35567b4900e5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:44.214234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a37df-c879-479c-8ba9-35567b4900e5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:44.290430 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380d748-f3c8-4f98-8c80-c06aea291963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:44.291816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380d748-f3c8-4f98-8c80-c06aea291963 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:44.292363 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380d748-f3c8-4f98-8c80-c06aea291963 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:44.292934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380d748-f3c8-4f98-8c80-c06aea291963 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:44.294266 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380d748-f3c8-4f98-8c80-c06aea291963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:44.296684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380d748-f3c8-4f98-8c80-c06aea291963 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:44.323619 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4573/9147] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 19:51:44 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:51:44.328362 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b6a2a-d114-4bc9-95f5-84ba2ebc00f3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:44.339728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b6a2a-d114-4bc9-95f5-84ba2ebc00f3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:44.345125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a763afb-6d4e-42fc-acd6-17fc7170183a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:44.345866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a763afb-6d4e-42fc-acd6-17fc7170183a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:44.346219 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a763afb-6d4e-42fc-acd6-17fc7170183a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:44.346567 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a763afb-6d4e-42fc-acd6-17fc7170183a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:44.347348 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a763afb-6d4e-42fc-acd6-17fc7170183a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:44.349068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a763afb-6d4e-42fc-acd6-17fc7170183a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:44.350881 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:51:44.366678 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4575/9148] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:51:44.367948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380d748-f3c8-4f98-8c80-c06aea291963 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:44.379171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380d748-f3c8-4f98-8c80-c06aea291963 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:44.384768 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40c104-7db3-4149-bf02-13bb784e86eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:44.385467 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40c104-7db3-4149-bf02-13bb784e86eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:44.385750 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40c104-7db3-4149-bf02-13bb784e86eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:44.386024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40c104-7db3-4149-bf02-13bb784e86eb admin admin] PATH_INFO: `/v3/projects/86c82856a2054ab982c51f43b36439f1/users/e9ed3f064ed046829e7ac86b2b7106f3/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:44.405484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40c104-7db3-4149-bf02-13bb784e86eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c82856a2054ab982c51f43b36439f1, user_id=e9ed3f064ed046829e7ac86b2b7106f3, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:44.409647 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40c104-7db3-4149-bf02-13bb784e86eb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:44.426281 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4574/9149] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:51:44 2022] PUT /identity/v3/projects/86c82856a2054ab982c51f43b36439f1/users/e9ed3f064ed046829e7ac86b2b7106f3/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:51:44.430441 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a763afb-6d4e-42fc-acd6-17fc7170183a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:44.442573 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a763afb-6d4e-42fc-acd6-17fc7170183a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:44.503682 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651dd8fe-2ba6-4148-ac67-9843d1b56172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:44.504311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dd8fe-2ba6-4148-ac67-9843d1b56172 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:44.504591 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dd8fe-2ba6-4148-ac67-9843d1b56172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:44.504873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dd8fe-2ba6-4148-ac67-9843d1b56172 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:44.505529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651dd8fe-2ba6-4148-ac67-9843d1b56172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:44.507153 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651dd8fe-2ba6-4148-ac67-9843d1b56172 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:44.518915 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4576/9150] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 19:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:51:44.523316 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40c104-7db3-4149-bf02-13bb784e86eb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:44.535426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40c104-7db3-4149-bf02-13bb784e86eb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:44.540620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a13017-e16a-476a-b109-20e08e039b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:44.541336 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a13017-e16a-476a-b109-20e08e039b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:44.541564 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a13017-e16a-476a-b109-20e08e039b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:44.541832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a13017-e16a-476a-b109-20e08e039b86 admin admin] PATH_INFO: `/v3/projects/86c82856a2054ab982c51f43b36439f1/users/e9ed3f064ed046829e7ac86b2b7106f3/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:44.544016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a13017-e16a-476a-b109-20e08e039b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c82856a2054ab982c51f43b36439f1, user_id=e9ed3f064ed046829e7ac86b2b7106f3, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:44.546721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a13017-e16a-476a-b109-20e08e039b86 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:44.558493 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4575/9151] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 19:51:44 2022] PUT /identity/v3/projects/86c82856a2054ab982c51f43b36439f1/users/e9ed3f064ed046829e7ac86b2b7106f3/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:51:49.285402 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd717a-cf2c-497e-8ccf-12ba727fd66e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:49.285923 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd717a-cf2c-497e-8ccf-12ba727fd66e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:49.286018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd717a-cf2c-497e-8ccf-12ba727fd66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:49.315806 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a0cd717a-cf2c-497e-8ccf-12ba727fd66e None None] MFA Rules not processed for user `e9ed3f064ed046829e7ac86b2b7106f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:51:49.317142 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a0cd717a-cf2c-497e-8ccf-12ba727fd66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:49.414052 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4577/9152] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:51:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:51:49.431661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a13017-e16a-476a-b109-20e08e039b86 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:49.433631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a5a13017-e16a-476a-b109-20e08e039b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:49.521320 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a13017-e16a-476a-b109-20e08e039b86 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:49.526816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c586b38-ce11-4ee0-80ec-5d5f75b15958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:49.527474 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c586b38-ce11-4ee0-80ec-5d5f75b15958 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:49.527759 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c586b38-ce11-4ee0-80ec-5d5f75b15958 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:49.528032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c586b38-ce11-4ee0-80ec-5d5f75b15958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:49.541322 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:51:49.593999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c586b38-ce11-4ee0-80ec-5d5f75b15958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:49.595955 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c586b38-ce11-4ee0-80ec-5d5f75b15958 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:49.605915 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4576/9153] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:51:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:51:50.696068 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502bcd-edd1-45c5-83a4-005fccc391d2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:50.696588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502bcd-edd1-45c5-83a4-005fccc391d2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:50.696765 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502bcd-edd1-45c5-83a4-005fccc391d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:50.717975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c0502bcd-edd1-45c5-83a4-005fccc391d2 None None] MFA Rules not processed for user `2e4d8d3d3b0647819d66680c6790309e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:51:50.719542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c0502bcd-edd1-45c5-83a4-005fccc391d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:50.726839 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4578/9154] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:51:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:51:57.447051 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c586b38-ce11-4ee0-80ec-5d5f75b15958 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:57.509072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c586b38-ce11-4ee0-80ec-5d5f75b15958 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:57.512999 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82692ce5-f231-43b4-a0e2-3e9b0c1cc42a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:57.513705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82692ce5-f231-43b4-a0e2-3e9b0c1cc42a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:57.514069 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82692ce5-f231-43b4-a0e2-3e9b0c1cc42a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:57.514433 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82692ce5-f231-43b4-a0e2-3e9b0c1cc42a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:57.516456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-82692ce5-f231-43b4-a0e2-3e9b0c1cc42a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:57.527515 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82692ce5-f231-43b4-a0e2-3e9b0c1cc42a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:57.529014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82692ce5-f231-43b4-a0e2-3e9b0c1cc42a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:57.537199 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4577/9155] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:51:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:00.712460 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=68 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:06.758014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0502bcd-edd1-45c5-83a4-005fccc391d2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:06.760248 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c0502bcd-edd1-45c5-83a4-005fccc391d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:06.777131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0502bcd-edd1-45c5-83a4-005fccc391d2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:06.781622 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add22f1d-f8ab-4e18-90c3-2398d50244a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:06.782234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add22f1d-f8ab-4e18-90c3-2398d50244a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:06.782514 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add22f1d-f8ab-4e18-90c3-2398d50244a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:06.782780 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add22f1d-f8ab-4e18-90c3-2398d50244a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:06.792151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add22f1d-f8ab-4e18-90c3-2398d50244a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:06.793626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add22f1d-f8ab-4e18-90c3-2398d50244a5 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:06.803513 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4579/9156] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:07.533687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=47 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:16.799121 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:40.102798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82692ce5-f231-43b4-a0e2-3e9b0c1cc42a service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:40.113653 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82692ce5-f231-43b4-a0e2-3e9b0c1cc42a service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:40.118557 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3bcf6-0dc4-422c-a3c6-581e59039b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:40.119600 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3bcf6-0dc4-422c-a3c6-581e59039b2c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:40.119976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3bcf6-0dc4-422c-a3c6-581e59039b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:40.120250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3bcf6-0dc4-422c-a3c6-581e59039b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:40.123003 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-21d3bcf6-0dc4-422c-a3c6-581e59039b2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:40.155282 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3bcf6-0dc4-422c-a3c6-581e59039b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:40.156790 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3bcf6-0dc4-422c-a3c6-581e59039b2c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:40.168837 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4578/9157] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:41.356228 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add22f1d-f8ab-4e18-90c3-2398d50244a5 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:41.365627 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add22f1d-f8ab-4e18-90c3-2398d50244a5 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:41.370016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d44f8-eac3-4db6-9f93-d033255df1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:41.370610 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d44f8-eac3-4db6-9f93-d033255df1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:41.370890 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d44f8-eac3-4db6-9f93-d033255df1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:41.371158 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d44f8-eac3-4db6-9f93-d033255df1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:41.373149 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f50d44f8-eac3-4db6-9f93-d033255df1a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:41.387351 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d44f8-eac3-4db6-9f93-d033255df1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:41.388713 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d44f8-eac3-4db6-9f93-d033255df1a9 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:41.400306 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4580/9158] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:50.163716 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=11 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:51.081915 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3bcf6-0dc4-422c-a3c6-581e59039b2c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:51.095062 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3bcf6-0dc4-422c-a3c6-581e59039b2c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:51.100951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d184afd-117d-45a3-8c57-09a0444a47fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:51.101582 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d184afd-117d-45a3-8c57-09a0444a47fa service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:51.101858 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d184afd-117d-45a3-8c57-09a0444a47fa service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:51.102130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d184afd-117d-45a3-8c57-09a0444a47fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:51.103880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d184afd-117d-45a3-8c57-09a0444a47fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:51.117472 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d184afd-117d-45a3-8c57-09a0444a47fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:51.119332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d184afd-117d-45a3-8c57-09a0444a47fa service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:51.130958 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4579/9159] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:51.395290 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:53.712174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816e23d-b532-45a1-b292-83b35dacc535 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:53.712894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816e23d-b532-45a1-b292-83b35dacc535 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:53.712894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816e23d-b532-45a1-b292-83b35dacc535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:53.775191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d816e23d-b532-45a1-b292-83b35dacc535 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:53.776532 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d816e23d-b532-45a1-b292-83b35dacc535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:53.845503 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4581/9160] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 19:54:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:53.898198 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d184afd-117d-45a3-8c57-09a0444a47fa service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:53.899801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d184afd-117d-45a3-8c57-09a0444a47fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:54.001787 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d184afd-117d-45a3-8c57-09a0444a47fa service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:54.007740 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e949f-bdab-447d-be65-c0fd805c652a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:54.008353 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e949f-bdab-447d-be65-c0fd805c652a service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:54.008631 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e949f-bdab-447d-be65-c0fd805c652a service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:54.008913 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e949f-bdab-447d-be65-c0fd805c652a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:54.017602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e949f-bdab-447d-be65-c0fd805c652a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:54.019197 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e949f-bdab-447d-be65-c0fd805c652a service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:54.027634 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4580/9161] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 19:54:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:55:03.842278 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=44 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:04.024172 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=47 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:06.732950 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816e23d-b532-45a1-b292-83b35dacc535 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:06.743946 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816e23d-b532-45a1-b292-83b35dacc535 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:06.748802 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60219e51-1f2d-425c-9134-0e84b7e8c8e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:06.749412 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60219e51-1f2d-425c-9134-0e84b7e8c8e6 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:06.749690 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60219e51-1f2d-425c-9134-0e84b7e8c8e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:06.749993 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60219e51-1f2d-425c-9134-0e84b7e8c8e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:06.751862 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-60219e51-1f2d-425c-9134-0e84b7e8c8e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:06.761415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60219e51-1f2d-425c-9134-0e84b7e8c8e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:06.762839 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60219e51-1f2d-425c-9134-0e84b7e8c8e6 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:06.771181 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4582/9162] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:06.897671 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d923f8-3db1-4ef3-9070-3cb6e4e8fb0f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:06.898250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d923f8-3db1-4ef3-9070-3cb6e4e8fb0f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:06.898250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d923f8-3db1-4ef3-9070-3cb6e4e8fb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:06.918136 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-38d923f8-3db1-4ef3-9070-3cb6e4e8fb0f None None] MFA Rules not processed for user `faef473a2ab84661b09f3ba3dd977058`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:06.919358 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-38d923f8-3db1-4ef3-9070-3cb6e4e8fb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:06.929061 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4581/9163] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 19:55:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:06.940966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60219e51-1f2d-425c-9134-0e84b7e8c8e6 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:06.942539 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-60219e51-1f2d-425c-9134-0e84b7e8c8e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:07.032432 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60219e51-1f2d-425c-9134-0e84b7e8c8e6 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:07.036355 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab069e8-775e-4fce-8853-3353c0997619 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:07.036971 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab069e8-775e-4fce-8853-3353c0997619 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:07.037812 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab069e8-775e-4fce-8853-3353c0997619 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:07.038226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab069e8-775e-4fce-8853-3353c0997619 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:07.051150 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab069e8-775e-4fce-8853-3353c0997619 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:07.052625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab069e8-775e-4fce-8853-3353c0997619 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:07.064450 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4583/9164] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:07.137854 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d923f8-3db1-4ef3-9070-3cb6e4e8fb0f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:07.147863 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d923f8-3db1-4ef3-9070-3cb6e4e8fb0f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:07.151580 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392cd96-45ef-4894-bb6e-17fdcd4cf5d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:07.152207 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392cd96-45ef-4894-bb6e-17fdcd4cf5d9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:07.152485 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392cd96-45ef-4894-bb6e-17fdcd4cf5d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:07.152757 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392cd96-45ef-4894-bb6e-17fdcd4cf5d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:07.154622 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4392cd96-45ef-4894-bb6e-17fdcd4cf5d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:07.164820 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392cd96-45ef-4894-bb6e-17fdcd4cf5d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:07.166424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392cd96-45ef-4894-bb6e-17fdcd4cf5d9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:07.175433 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4582/9165] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:07.252288 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab069e8-775e-4fce-8853-3353c0997619 service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:07.265105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab069e8-775e-4fce-8853-3353c0997619 service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:07.270094 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738b300-3c52-4624-b0a4-d4f21baa87b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:07.270716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738b300-3c52-4624-b0a4-d4f21baa87b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:07.270997 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738b300-3c52-4624-b0a4-d4f21baa87b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:07.271275 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738b300-3c52-4624-b0a4-d4f21baa87b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:07.273531 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4738b300-3c52-4624-b0a4-d4f21baa87b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:07.289419 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738b300-3c52-4624-b0a4-d4f21baa87b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:07.291115 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738b300-3c52-4624-b0a4-d4f21baa87b5 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:07.303235 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4584/9166] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:07.368808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392cd96-45ef-4894-bb6e-17fdcd4cf5d9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:07.370492 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4392cd96-45ef-4894-bb6e-17fdcd4cf5d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:07.452893 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392cd96-45ef-4894-bb6e-17fdcd4cf5d9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:07.458965 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfefe3-a110-4d34-ae21-13c27bd9fce7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:07.459620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfefe3-a110-4d34-ae21-13c27bd9fce7 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:07.459901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfefe3-a110-4d34-ae21-13c27bd9fce7 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:07.460178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfefe3-a110-4d34-ae21-13c27bd9fce7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:07.462147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-30dfefe3-a110-4d34-ae21-13c27bd9fce7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:07.474158 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfefe3-a110-4d34-ae21-13c27bd9fce7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:07.475711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfefe3-a110-4d34-ae21-13c27bd9fce7 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:07.485898 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4583/9167] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:08.586897 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738b300-3c52-4624-b0a4-d4f21baa87b5 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:08.596540 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738b300-3c52-4624-b0a4-d4f21baa87b5 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:08.601076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6721d5-1e52-40f6-a8e0-21b3fabdbdce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:08.601693 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6721d5-1e52-40f6-a8e0-21b3fabdbdce service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:08.601965 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6721d5-1e52-40f6-a8e0-21b3fabdbdce service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:08.602235 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6721d5-1e52-40f6-a8e0-21b3fabdbdce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:08.604320 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bf6721d5-1e52-40f6-a8e0-21b3fabdbdce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:08.614526 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6721d5-1e52-40f6-a8e0-21b3fabdbdce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:08.616020 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6721d5-1e52-40f6-a8e0-21b3fabdbdce service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:08.624451 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4585/9168] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:09.559646 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfefe3-a110-4d34-ae21-13c27bd9fce7 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:09.561947 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-30dfefe3-a110-4d34-ae21-13c27bd9fce7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:09.579853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfefe3-a110-4d34-ae21-13c27bd9fce7 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:09.586584 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb1917-617e-4ee8-ae99-b439ee7d4c73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:09.587508 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb1917-617e-4ee8-ae99-b439ee7d4c73 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:09.587813 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb1917-617e-4ee8-ae99-b439ee7d4c73 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:09.588071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb1917-617e-4ee8-ae99-b439ee7d4c73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:09.590028 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cdbb1917-617e-4ee8-ae99-b439ee7d4c73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:09.602853 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb1917-617e-4ee8-ae99-b439ee7d4c73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:09.604522 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb1917-617e-4ee8-ae99-b439ee7d4c73 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:09.615978 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4584/9169] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:10.322593 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaed051-3e4c-4383-bcbf-b66f5ac413fc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:10.323182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaed051-3e4c-4383-bcbf-b66f5ac413fc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:10.323182 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaed051-3e4c-4383-bcbf-b66f5ac413fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:10.346200 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6eaed051-3e4c-4383-bcbf-b66f5ac413fc None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:10.347643 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6eaed051-3e4c-4383-bcbf-b66f5ac413fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:10.356308 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4586/9170] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 19:55:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:10.368888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb1917-617e-4ee8-ae99-b439ee7d4c73 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:10.380964 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb1917-617e-4ee8-ae99-b439ee7d4c73 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:10.387710 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826bfa3-76a4-42c7-90ac-227255421e8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:10.388400 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826bfa3-76a4-42c7-90ac-227255421e8c service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:10.388684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826bfa3-76a4-42c7-90ac-227255421e8c service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:10.388959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826bfa3-76a4-42c7-90ac-227255421e8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:10.398641 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826bfa3-76a4-42c7-90ac-227255421e8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:10.400292 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826bfa3-76a4-42c7-90ac-227255421e8c service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:10.412578 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4585/9171] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 19:55:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:55:20.338203 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=56 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:20.406286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=53 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:27.563152 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f81ae-dea7-4a23-b161-9d9b087757ee None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:27.563725 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f81ae-dea7-4a23-b161-9d9b087757ee None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:27.563901 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f81ae-dea7-4a23-b161-9d9b087757ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:27.584589 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c43f81ae-dea7-4a23-b161-9d9b087757ee None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:27.585784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c43f81ae-dea7-4a23-b161-9d9b087757ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:27.599465 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4587/9172] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 19:55:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:27.612709 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826bfa3-76a4-42c7-90ac-227255421e8c service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:27.623801 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826bfa3-76a4-42c7-90ac-227255421e8c service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:27.629334 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d30f7d-a0cd-417c-9d65-ceee5a872fc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:27.630071 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d30f7d-a0cd-417c-9d65-ceee5a872fc8 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:27.630407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d30f7d-a0cd-417c-9d65-ceee5a872fc8 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:27.630741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d30f7d-a0cd-417c-9d65-ceee5a872fc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:27.639651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d30f7d-a0cd-417c-9d65-ceee5a872fc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:27.641314 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d30f7d-a0cd-417c-9d65-ceee5a872fc8 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:27.650496 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4586/9173] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 19:55:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:55:37.578814 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:37.647233 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:16.195574 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f81ae-dea7-4a23-b161-9d9b087757ee None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:16.197267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c43f81ae-dea7-4a23-b161-9d9b087757ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:16.213662 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f81ae-dea7-4a23-b161-9d9b087757ee None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:16.219199 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728d057-7a61-4fe0-a71c-dbc4e23d8167 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:16.219886 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728d057-7a61-4fe0-a71c-dbc4e23d8167 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:16.220169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728d057-7a61-4fe0-a71c-dbc4e23d8167 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:16.220448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728d057-7a61-4fe0-a71c-dbc4e23d8167 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:16.222396 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1728d057-7a61-4fe0-a71c-dbc4e23d8167 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:16.235227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728d057-7a61-4fe0-a71c-dbc4e23d8167 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:16.237055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728d057-7a61-4fe0-a71c-dbc4e23d8167 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:16.249331 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4588/9174] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:56:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:56:16.583494 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d30f7d-a0cd-417c-9d65-ceee5a872fc8 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:16.597045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d30f7d-a0cd-417c-9d65-ceee5a872fc8 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:16.603900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c46d36-57d3-454d-95be-d32c4dc25cb1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:16.604521 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46d36-57d3-454d-95be-d32c4dc25cb1 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:16.604798 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46d36-57d3-454d-95be-d32c4dc25cb1 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:16.605072 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46d36-57d3-454d-95be-d32c4dc25cb1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:16.607110 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-63c46d36-57d3-454d-95be-d32c4dc25cb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:16.619696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c46d36-57d3-454d-95be-d32c4dc25cb1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:16.621348 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c46d36-57d3-454d-95be-d32c4dc25cb1 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:16.631376 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4587/9175] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:56:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:56:26.244918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:26.627385 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:06.300723 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728d057-7a61-4fe0-a71c-dbc4e23d8167 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:06.311076 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728d057-7a61-4fe0-a71c-dbc4e23d8167 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:06.315679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73feaa8-aeff-42ec-bad7-02e31820032a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:06.316286 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73feaa8-aeff-42ec-bad7-02e31820032a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:06.316564 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73feaa8-aeff-42ec-bad7-02e31820032a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:06.316838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73feaa8-aeff-42ec-bad7-02e31820032a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:06.328311 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73feaa8-aeff-42ec-bad7-02e31820032a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:06.330483 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73feaa8-aeff-42ec-bad7-02e31820032a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:06.340598 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4589/9176] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:57:07.253000 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c46d36-57d3-454d-95be-d32c4dc25cb1 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:07.272620 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c46d36-57d3-454d-95be-d32c4dc25cb1 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:07.278669 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6fa09-2d4e-48e4-95b5-6cf5b64c7e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:07.279369 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6fa09-2d4e-48e4-95b5-6cf5b64c7e36 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:07.279654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6fa09-2d4e-48e4-95b5-6cf5b64c7e36 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:07.279925 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6fa09-2d4e-48e4-95b5-6cf5b64c7e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:07.281948 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0be6fa09-2d4e-48e4-95b5-6cf5b64c7e36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:07.296074 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6fa09-2d4e-48e4-95b5-6cf5b64c7e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:07.297795 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6fa09-2d4e-48e4-95b5-6cf5b64c7e36 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:07.309922 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4588/9177] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:57:12.311769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb82b8-955c-49cc-b076-b140da2b611b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:12.312285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb82b8-955c-49cc-b076-b140da2b611b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:12.312285 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb82b8-955c-49cc-b076-b140da2b611b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:12.332476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1fdb82b8-955c-49cc-b076-b140da2b611b None None] MFA Rules not processed for user `2e4d8d3d3b0647819d66680c6790309e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:57:12.333752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1fdb82b8-955c-49cc-b076-b140da2b611b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:12.341647 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4590/9178] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 19:57:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:57:17.305696 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:22.327064 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=9 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:29.024218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6fa09-2d4e-48e4-95b5-6cf5b64c7e36 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:29.034223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6fa09-2d4e-48e4-95b5-6cf5b64c7e36 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:29.038077 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c3370-c009-4bbf-8fc0-ef47b2ab3bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:29.038733 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c3370-c009-4bbf-8fc0-ef47b2ab3bee service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:29.038980 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c3370-c009-4bbf-8fc0-ef47b2ab3bee service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:29.039272 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c3370-c009-4bbf-8fc0-ef47b2ab3bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:29.041304 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-995c3370-c009-4bbf-8fc0-ef47b2ab3bee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:29.051981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c3370-c009-4bbf-8fc0-ef47b2ab3bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:29.053484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c3370-c009-4bbf-8fc0-ef47b2ab3bee service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:29.062053 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4589/9179] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:57:29.560809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb82b8-955c-49cc-b076-b140da2b611b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:29.577559 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb82b8-955c-49cc-b076-b140da2b611b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:29.582975 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dc88f-3b29-458b-804e-558a8a6fa88b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:29.583825 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dc88f-3b29-458b-804e-558a8a6fa88b service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:29.584242 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dc88f-3b29-458b-804e-558a8a6fa88b service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:29.584518 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dc88f-3b29-458b-804e-558a8a6fa88b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:29.592473 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-018dc88f-3b29-458b-804e-558a8a6fa88b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:29.605454 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dc88f-3b29-458b-804e-558a8a6fa88b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:29.607175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dc88f-3b29-458b-804e-558a8a6fa88b service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:29.627449 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4591/9180] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:57:33.892976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c3370-c009-4bbf-8fc0-ef47b2ab3bee service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:33.903908 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c3370-c009-4bbf-8fc0-ef47b2ab3bee service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:33.908268 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b47c0-d107-457b-a360-d129a0d5a3df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:33.908894 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b47c0-d107-457b-a360-d129a0d5a3df service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:33.909171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b47c0-d107-457b-a360-d129a0d5a3df service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:33.909420 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b47c0-d107-457b-a360-d129a0d5a3df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:33.919075 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b47c0-d107-457b-a360-d129a0d5a3df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:33.920551 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b47c0-d107-457b-a360-d129a0d5a3df service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:33.930658 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4590/9181] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:57:39.614067 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:43.926972 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=12 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:51.364179 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dc88f-3b29-458b-804e-558a8a6fa88b service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:51.374761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dc88f-3b29-458b-804e-558a8a6fa88b service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:51.379647 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c34d72-4074-42f9-b531-3e8d1cb979d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:51.380261 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c34d72-4074-42f9-b531-3e8d1cb979d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:51.380542 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c34d72-4074-42f9-b531-3e8d1cb979d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:51.380809 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c34d72-4074-42f9-b531-3e8d1cb979d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:51.391221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c34d72-4074-42f9-b531-3e8d1cb979d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:51.394318 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c34d72-4074-42f9-b531-3e8d1cb979d4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:51.411503 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4592/9182] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:58:01.403151 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:59:49.916349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b47c0-d107-457b-a360-d129a0d5a3df service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:49.960834 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b47c0-d107-457b-a360-d129a0d5a3df service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:49.964566 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46964233-6c0b-4301-ad6f-a50870af518e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:49.965235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46964233-6c0b-4301-ad6f-a50870af518e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:49.965516 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46964233-6c0b-4301-ad6f-a50870af518e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:49.965797 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46964233-6c0b-4301-ad6f-a50870af518e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:50.006205 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46964233-6c0b-4301-ad6f-a50870af518e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:50.007723 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46964233-6c0b-4301-ad6f-a50870af518e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:50.033924 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4591/9183] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:59:51.261405 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c34d72-4074-42f9-b531-3e8d1cb979d4 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:59:51.293873 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c34d72-4074-42f9-b531-3e8d1cb979d4 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:59:51.298438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300995d-2ed1-4f95-9bca-f9825e1879db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:59:51.299049 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300995d-2ed1-4f95-9bca-f9825e1879db service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:59:51.299372 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300995d-2ed1-4f95-9bca-f9825e1879db service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:59:51.299639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300995d-2ed1-4f95-9bca-f9825e1879db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:59:51.310698 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300995d-2ed1-4f95-9bca-f9825e1879db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:59:51.312169 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300995d-2ed1-4f95-9bca-f9825e1879db service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:59:51.323951 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4593/9184] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 19:59:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:00.030822 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=31 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:01.318746 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=15 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:04.701968 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46964233-6c0b-4301-ad6f-a50870af518e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:04.713773 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46964233-6c0b-4301-ad6f-a50870af518e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:04.721171 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6b38b-097b-4ba7-9beb-b4a080ae769d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:04.722193 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6b38b-097b-4ba7-9beb-b4a080ae769d service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:04.722475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6b38b-097b-4ba7-9beb-b4a080ae769d service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:04.722747 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6b38b-097b-4ba7-9beb-b4a080ae769d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:04.735879 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6b38b-097b-4ba7-9beb-b4a080ae769d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:04.737959 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6b38b-097b-4ba7-9beb-b4a080ae769d service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:04.750186 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4592/9185] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:14.745592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:21.164339 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300995d-2ed1-4f95-9bca-f9825e1879db service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:21.189900 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300995d-2ed1-4f95-9bca-f9825e1879db service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:21.196332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72796a8-5e05-4b41-99af-21585b8fa97e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:21.196947 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72796a8-5e05-4b41-99af-21585b8fa97e service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:21.197221 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72796a8-5e05-4b41-99af-21585b8fa97e service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:21.197490 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72796a8-5e05-4b41-99af-21585b8fa97e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:21.206664 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72796a8-5e05-4b41-99af-21585b8fa97e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:21.208309 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72796a8-5e05-4b41-99af-21585b8fa97e service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:21.218418 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4594/9186] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:21.582949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6b38b-097b-4ba7-9beb-b4a080ae769d service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:21.595654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6b38b-097b-4ba7-9beb-b4a080ae769d service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:21.601520 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8468a89-8eaa-4754-a430-060492a78277 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:21.602147 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8468a89-8eaa-4754-a430-060492a78277 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:21.602447 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8468a89-8eaa-4754-a430-060492a78277 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:21.602719 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8468a89-8eaa-4754-a430-060492a78277 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:21.612507 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8468a89-8eaa-4754-a430-060492a78277 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:21.614811 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8468a89-8eaa-4754-a430-060492a78277 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:21.625136 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4593/9187] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:31.214521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:31.621033 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:48.339942 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72796a8-5e05-4b41-99af-21585b8fa97e service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:48.340724 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e72796a8-5e05-4b41-99af-21585b8fa97e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:48.380333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72796a8-5e05-4b41-99af-21585b8fa97e service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:48.384625 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220eadf6-3ce8-4d68-abbd-b4aadb4fc4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:48.385245 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eadf6-3ce8-4d68-abbd-b4aadb4fc4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:48.385523 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eadf6-3ce8-4d68-abbd-b4aadb4fc4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:48.385794 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eadf6-3ce8-4d68-abbd-b4aadb4fc4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:48.387704 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-220eadf6-3ce8-4d68-abbd-b4aadb4fc4b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:48.482925 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220eadf6-3ce8-4d68-abbd-b4aadb4fc4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:48.484326 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220eadf6-3ce8-4d68-abbd-b4aadb4fc4b2 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:48.504082 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4595/9188] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:51.840185 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8468a89-8eaa-4754-a430-060492a78277 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:51.851654 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8468a89-8eaa-4754-a430-060492a78277 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:51.860032 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e508348-1805-4fd6-9c25-a7f6fd938770 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:51.860656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e508348-1805-4fd6-9c25-a7f6fd938770 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:51.860935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e508348-1805-4fd6-9c25-a7f6fd938770 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:51.861218 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e508348-1805-4fd6-9c25-a7f6fd938770 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:51.863391 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e508348-1805-4fd6-9c25-a7f6fd938770 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:51.890639 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e508348-1805-4fd6-9c25-a7f6fd938770 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:51.892754 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e508348-1805-4fd6-9c25-a7f6fd938770 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:51.903734 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4594/9189] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:55.290093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220eadf6-3ce8-4d68-abbd-b4aadb4fc4b2 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:55.292053 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-220eadf6-3ce8-4d68-abbd-b4aadb4fc4b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:55.309701 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220eadf6-3ce8-4d68-abbd-b4aadb4fc4b2 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:55.314646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962761b-a1fa-4307-afe8-73ddf8d3a2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:55.315397 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962761b-a1fa-4307-afe8-73ddf8d3a2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:55.315684 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962761b-a1fa-4307-afe8-73ddf8d3a2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:55.315982 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962761b-a1fa-4307-afe8-73ddf8d3a2e2 admin admin] PATH_INFO: `/v3/users/2e4d8d3d3b0647819d66680c6790309e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:55.330697 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962761b-a1fa-4307-afe8-73ddf8d3a2e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4d8d3d3b0647819d66680c6790309e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:55.332717 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962761b-a1fa-4307-afe8-73ddf8d3a2e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:55.386435 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a962761b-a1fa-4307-afe8-73ddf8d3a2e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4d8d3d3b0647819d66680c6790309e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:55.399294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a962761b-a1fa-4307-afe8-73ddf8d3a2e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4d8d3d3b0647819d66680c6790309e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:55.400016 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a962761b-a1fa-4307-afe8-73ddf8d3a2e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4d8d3d3b0647819d66680c6790309e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:55.400615 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a962761b-a1fa-4307-afe8-73ddf8d3a2e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4d8d3d3b0647819d66680c6790309e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:55.416172 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a962761b-a1fa-4307-afe8-73ddf8d3a2e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4d8d3d3b0647819d66680c6790309e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:55.430503 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4596/9190] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 20:01:55 2022] DELETE /identity/v3/users/2e4d8d3d3b0647819d66680c6790309e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:55.614041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e508348-1805-4fd6-9c25-a7f6fd938770 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:55.625124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e508348-1805-4fd6-9c25-a7f6fd938770 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:55.686020 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdcd02-5922-4573-adf2-d3eae1ee8389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:55.686660 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdcd02-5922-4573-adf2-d3eae1ee8389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:55.686942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdcd02-5922-4573-adf2-d3eae1ee8389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:55.687223 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdcd02-5922-4573-adf2-d3eae1ee8389 admin admin] PATH_INFO: `/v3/projects/24c2644593764fada9cfcafbedd96f98` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:55.697812 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdcd02-5922-4573-adf2-d3eae1ee8389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24c2644593764fada9cfcafbedd96f98)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:55.699841 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdcd02-5922-4573-adf2-d3eae1ee8389 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:55.749839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c6cdcd02-5922-4573-adf2-d3eae1ee8389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c2644593764fada9cfcafbedd96f98', 'request_id': 'req-c6cdcd02-5922-4573-adf2-d3eae1ee8389'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:55.759345 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c6cdcd02-5922-4573-adf2-d3eae1ee8389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c2644593764fada9cfcafbedd96f98', 'request_id': 'req-c6cdcd02-5922-4573-adf2-d3eae1ee8389'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:55.764839 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c6cdcd02-5922-4573-adf2-d3eae1ee8389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c2644593764fada9cfcafbedd96f98', 'request_id': 'req-c6cdcd02-5922-4573-adf2-d3eae1ee8389'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:55.776942 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c6cdcd02-5922-4573-adf2-d3eae1ee8389 admin admin] The token cache is being invalidate because project 24c2644593764fada9cfcafbedd96f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:01:55.777231 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c6cdcd02-5922-4573-adf2-d3eae1ee8389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:55.777880 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c6cdcd02-5922-4573-adf2-d3eae1ee8389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:55.779424 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4595/9191] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 20:01:55 2022] DELETE /identity/v3/projects/24c2644593764fada9cfcafbedd96f98 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:55.783619 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962761b-a1fa-4307-afe8-73ddf8d3a2e2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:55.785134 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a962761b-a1fa-4307-afe8-73ddf8d3a2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:55.799175 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962761b-a1fa-4307-afe8-73ddf8d3a2e2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:55.803606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:55.864818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc96010-67b2-4b30-a364-ec83b6ff6d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:55.865471 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc96010-67b2-4b30-a364-ec83b6ff6d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:55.865745 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc96010-67b2-4b30-a364-ec83b6ff6d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:55.866014 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc96010-67b2-4b30-a364-ec83b6ff6d22 admin admin] PATH_INFO: `/v3/users/e9ed3f064ed046829e7ac86b2b7106f3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:55.881093 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc96010-67b2-4b30-a364-ec83b6ff6d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ed3f064ed046829e7ac86b2b7106f3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:55.883072 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc96010-67b2-4b30-a364-ec83b6ff6d22 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:55.939021 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4bc96010-67b2-4b30-a364-ec83b6ff6d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ed3f064ed046829e7ac86b2b7106f3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:55.955346 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4bc96010-67b2-4b30-a364-ec83b6ff6d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ed3f064ed046829e7ac86b2b7106f3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:55.956144 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4bc96010-67b2-4b30-a364-ec83b6ff6d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ed3f064ed046829e7ac86b2b7106f3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:55.956854 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4bc96010-67b2-4b30-a364-ec83b6ff6d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ed3f064ed046829e7ac86b2b7106f3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:55.966847 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4bc96010-67b2-4b30-a364-ec83b6ff6d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ed3f064ed046829e7ac86b2b7106f3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:55.980073 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4597/9192] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 20:01:55 2022] DELETE /identity/v3/users/e9ed3f064ed046829e7ac86b2b7106f3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:56.170149 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdcd02-5922-4573-adf2-d3eae1ee8389 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:56.171866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c6cdcd02-5922-4573-adf2-d3eae1ee8389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:56.185615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdcd02-5922-4573-adf2-d3eae1ee8389 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:56.244414 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:56.251501 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37573bd-d06d-4f4f-8d5a-7fbf8e82d24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:56.252200 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37573bd-d06d-4f4f-8d5a-7fbf8e82d24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:56.252483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37573bd-d06d-4f4f-8d5a-7fbf8e82d24f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:56.252763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37573bd-d06d-4f4f-8d5a-7fbf8e82d24f admin admin] PATH_INFO: `/v3/projects/86c82856a2054ab982c51f43b36439f1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:56.264668 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37573bd-d06d-4f4f-8d5a-7fbf8e82d24f admin admin] RBAC: Authorizing `identity:delete_project(project_id=86c82856a2054ab982c51f43b36439f1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:56.266616 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37573bd-d06d-4f4f-8d5a-7fbf8e82d24f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:56.318347 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d37573bd-d06d-4f4f-8d5a-7fbf8e82d24f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86c82856a2054ab982c51f43b36439f1', 'request_id': 'req-d37573bd-d06d-4f4f-8d5a-7fbf8e82d24f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:56.327763 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d37573bd-d06d-4f4f-8d5a-7fbf8e82d24f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86c82856a2054ab982c51f43b36439f1', 'request_id': 'req-d37573bd-d06d-4f4f-8d5a-7fbf8e82d24f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:56.333805 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d37573bd-d06d-4f4f-8d5a-7fbf8e82d24f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86c82856a2054ab982c51f43b36439f1', 'request_id': 'req-d37573bd-d06d-4f4f-8d5a-7fbf8e82d24f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:56.346729 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d37573bd-d06d-4f4f-8d5a-7fbf8e82d24f admin admin] The token cache is being invalidate because project 86c82856a2054ab982c51f43b36439f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:01:56.347186 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d37573bd-d06d-4f4f-8d5a-7fbf8e82d24f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:56.347935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d37573bd-d06d-4f4f-8d5a-7fbf8e82d24f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:01:56.349819 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4596/9193] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 20:01:56 2022] DELETE /identity/v3/projects/86c82856a2054ab982c51f43b36439f1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:01:56.355332 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ddab1-c859-4f41-aebb-09423a8fb9dc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:56.355841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ddab1-c859-4f41-aebb-09423a8fb9dc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:56.355967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ddab1-c859-4f41-aebb-09423a8fb9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:56.422646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-294ddab1-c859-4f41-aebb-09423a8fb9dc None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:56.423981 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-294ddab1-c859-4f41-aebb-09423a8fb9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:56.474726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:56.495819 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4598/9194] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 20:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:56.505250 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f06bd-41f7-4781-bee2-3e647335accd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:56.505538 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f06bd-41f7-4781-bee2-3e647335accd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:56.505814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f06bd-41f7-4781-bee2-3e647335accd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:56.527684 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2a7f06bd-41f7-4781-bee2-3e647335accd None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:56.528921 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2a7f06bd-41f7-4781-bee2-3e647335accd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:56.538941 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4597/9195] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 20:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:56.544513 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ddab1-c859-4f41-aebb-09423a8fb9dc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:56.556161 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ddab1-c859-4f41-aebb-09423a8fb9dc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:56.561448 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783e22e-3baa-43fa-83b7-ba0bd520d2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:56.562091 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e22e-3baa-43fa-83b7-ba0bd520d2ff admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:56.562438 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e22e-3baa-43fa-83b7-ba0bd520d2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:56.562646 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e22e-3baa-43fa-83b7-ba0bd520d2ff admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:56.563363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783e22e-3baa-43fa-83b7-ba0bd520d2ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:01:56.563709 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783e22e-3baa-43fa-83b7-ba0bd520d2ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:56.565379 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783e22e-3baa-43fa-83b7-ba0bd520d2ff admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:56.577999 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4599/9196] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 20:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:01:56.584483 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f06bd-41f7-4781-bee2-3e647335accd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:56.594577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f06bd-41f7-4781-bee2-3e647335accd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:56.600804 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14585173-815d-49cd-a912-07711af56f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:56.601416 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14585173-815d-49cd-a912-07711af56f65 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:56.601712 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14585173-815d-49cd-a912-07711af56f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:56.601954 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14585173-815d-49cd-a912-07711af56f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:56.602602 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14585173-815d-49cd-a912-07711af56f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:56.604577 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14585173-815d-49cd-a912-07711af56f65 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:56.648290 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4598/9197] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 20:01:56 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:01:56.650565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783e22e-3baa-43fa-83b7-ba0bd520d2ff admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:56.661758 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783e22e-3baa-43fa-83b7-ba0bd520d2ff admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:56.736284 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb645e-d5a9-485f-b511-2295958758f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:56.736932 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb645e-d5a9-485f-b511-2295958758f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:56.737639 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb645e-d5a9-485f-b511-2295958758f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:56.737910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb645e-d5a9-485f-b511-2295958758f8 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:56.738556 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb645e-d5a9-485f-b511-2295958758f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:56.740617 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb645e-d5a9-485f-b511-2295958758f8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:56.763770 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4600/9198] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 20:01:56 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:01:56.768648 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14585173-815d-49cd-a912-07711af56f65 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:56.779949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14585173-815d-49cd-a912-07711af56f65 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:56.786177 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d69811-9aa1-4247-944f-dffaa1aba2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:56.787046 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d69811-9aa1-4247-944f-dffaa1aba2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:56.787490 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d69811-9aa1-4247-944f-dffaa1aba2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:56.787884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d69811-9aa1-4247-944f-dffaa1aba2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:56.788725 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d69811-9aa1-4247-944f-dffaa1aba2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:56.791409 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d69811-9aa1-4247-944f-dffaa1aba2c5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:56.805281 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4599/9199] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 20:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:01:56.809491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb645e-d5a9-485f-b511-2295958758f8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:56.820444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb645e-d5a9-485f-b511-2295958758f8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:56.825597 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93853160-c801-44bf-86f9-6f521e2ebceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:56.826236 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93853160-c801-44bf-86f9-6f521e2ebceb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:56.826507 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93853160-c801-44bf-86f9-6f521e2ebceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:56.826776 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93853160-c801-44bf-86f9-6f521e2ebceb admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:56.827457 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93853160-c801-44bf-86f9-6f521e2ebceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:56.829292 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93853160-c801-44bf-86f9-6f521e2ebceb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:56.840403 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4601/9200] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 20:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:01:56.845210 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d69811-9aa1-4247-944f-dffaa1aba2c5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:56.856048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d69811-9aa1-4247-944f-dffaa1aba2c5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:56.862180 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4080bd-0f74-46a3-b27f-4194e5cef639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:56.863238 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4080bd-0f74-46a3-b27f-4194e5cef639 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:56.863552 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4080bd-0f74-46a3-b27f-4194e5cef639 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:56.863827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4080bd-0f74-46a3-b27f-4194e5cef639 admin admin] PATH_INFO: `/v3/projects/ee4287b7be1f4a658c93ed7146ce4f48/users/f298770eed344a2596e640fcb0aa1627/roles/dcabcc9bd3bf42149eed3abc0d4799c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:56.881527 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4080bd-0f74-46a3-b27f-4194e5cef639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee4287b7be1f4a658c93ed7146ce4f48, user_id=f298770eed344a2596e640fcb0aa1627, role_id=dcabcc9bd3bf42149eed3abc0d4799c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:56.884286 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4080bd-0f74-46a3-b27f-4194e5cef639 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:56.900550 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4600/9201] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 20:01:56 2022] PUT /identity/v3/projects/ee4287b7be1f4a658c93ed7146ce4f48/users/f298770eed344a2596e640fcb0aa1627/roles/dcabcc9bd3bf42149eed3abc0d4799c8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:01:56.906322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1f699-ea0c-43c5-b92a-883b6dc03797 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:56.906322 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1f699-ea0c-43c5-b92a-883b6dc03797 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:56.906562 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1f699-ea0c-43c5-b92a-883b6dc03797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:56.927596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1bc1f699-ea0c-43c5-b92a-883b6dc03797 None None] MFA Rules not processed for user `14ad14eb111e4774a71609d695e07661`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:01:56.928838 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1bc1f699-ea0c-43c5-b92a-883b6dc03797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:56.994176 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4602/9202] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 20:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:01:57.004563 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4080bd-0f74-46a3-b27f-4194e5cef639 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:57.006667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b4080bd-0f74-46a3-b27f-4194e5cef639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:57.066983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4080bd-0f74-46a3-b27f-4194e5cef639 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:57.071814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a5159-27db-4a90-be82-f220d23affbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:57.072595 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a5159-27db-4a90-be82-f220d23affbe service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:57.073184 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a5159-27db-4a90-be82-f220d23affbe service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:57.073618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a5159-27db-4a90-be82-f220d23affbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:57.084621 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a5159-27db-4a90-be82-f220d23affbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:57.086016 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a5159-27db-4a90-be82-f220d23affbe service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:57.096448 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4601/9203] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:01.193653 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ee14d-a898-46ba-b0d8-391b107500e1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:01.194237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ee14d-a898-46ba-b0d8-391b107500e1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:01.194237 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ee14d-a898-46ba-b0d8-391b107500e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:01.252027 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-af8ee14d-a898-46ba-b0d8-391b107500e1 None None] MFA Rules not processed for user `f298770eed344a2596e640fcb0aa1627`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:01.253364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-af8ee14d-a898-46ba-b0d8-391b107500e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:01.300884 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:01.331748 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4603/9204] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 20:02:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:01.337006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a5159-27db-4a90-be82-f220d23affbe service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:01.347554 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a5159-27db-4a90-be82-f220d23affbe service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:01.355983 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0251d2-d80b-408d-8fe5-be97c8042f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:01.356626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0251d2-d80b-408d-8fe5-be97c8042f72 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:01.356914 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0251d2-d80b-408d-8fe5-be97c8042f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:01.357191 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0251d2-d80b-408d-8fe5-be97c8042f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:01.357859 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0251d2-d80b-408d-8fe5-be97c8042f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:01.359898 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0251d2-d80b-408d-8fe5-be97c8042f72 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:01.366734 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:01.396463 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4602/9205] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 20:02:01 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:02:01.397705 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ee14d-a898-46ba-b0d8-391b107500e1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:01.409703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ee14d-a898-46ba-b0d8-391b107500e1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:01.470894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b51e3-9234-46c9-a4bc-664157c34910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:01.471607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b51e3-9234-46c9-a4bc-664157c34910 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:01.472037 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b51e3-9234-46c9-a4bc-664157c34910 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:01.472354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b51e3-9234-46c9-a4bc-664157c34910 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:01.473084 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b51e3-9234-46c9-a4bc-664157c34910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:01.475131 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b51e3-9234-46c9-a4bc-664157c34910 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:01.502319 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4604/9206] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 20:02:01 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:02:01.503816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0251d2-d80b-408d-8fe5-be97c8042f72 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:01.515536 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0251d2-d80b-408d-8fe5-be97c8042f72 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:01.520741 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f1d3b-f434-4fc6-acd8-32f4b97b51b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:01.521376 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f1d3b-f434-4fc6-acd8-32f4b97b51b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:01.521658 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f1d3b-f434-4fc6-acd8-32f4b97b51b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:01.521936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f1d3b-f434-4fc6-acd8-32f4b97b51b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:01.522592 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f1d3b-f434-4fc6-acd8-32f4b97b51b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:01.524279 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f1d3b-f434-4fc6-acd8-32f4b97b51b0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:01.535958 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4603/9207] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:01.540157 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b51e3-9234-46c9-a4bc-664157c34910 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:01.559407 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b51e3-9234-46c9-a4bc-664157c34910 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:01.564754 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948acfe-beba-4f7a-9233-01c3c28c0472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:01.565502 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948acfe-beba-4f7a-9233-01c3c28c0472 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:01.565787 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948acfe-beba-4f7a-9233-01c3c28c0472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:01.566069 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948acfe-beba-4f7a-9233-01c3c28c0472 admin admin] PATH_INFO: `/v3/projects/874d7f908b5d4361aa206daef715cc96/users/6d05873e8ba048efb408c974fa7fe0b0/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:01.583188 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948acfe-beba-4f7a-9233-01c3c28c0472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=874d7f908b5d4361aa206daef715cc96, user_id=6d05873e8ba048efb408c974fa7fe0b0, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:01.585914 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948acfe-beba-4f7a-9233-01c3c28c0472 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:01.602441 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4605/9208] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 20:02:01 2022] PUT /identity/v3/projects/874d7f908b5d4361aa206daef715cc96/users/6d05873e8ba048efb408c974fa7fe0b0/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:01.606493 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f1d3b-f434-4fc6-acd8-32f4b97b51b0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:01.617486 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f1d3b-f434-4fc6-acd8-32f4b97b51b0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:01.679872 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8b5a8-db90-4d01-9d5a-8bb5d3aeb4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:01.680500 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8b5a8-db90-4d01-9d5a-8bb5d3aeb4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:01.680781 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8b5a8-db90-4d01-9d5a-8bb5d3aeb4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:01.681055 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8b5a8-db90-4d01-9d5a-8bb5d3aeb4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:01.681708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8b5a8-db90-4d01-9d5a-8bb5d3aeb4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:01.686991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8b5a8-db90-4d01-9d5a-8bb5d3aeb4c3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:01.703572 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4604/9209] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:01.707001 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948acfe-beba-4f7a-9233-01c3c28c0472 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:01.718255 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948acfe-beba-4f7a-9233-01c3c28c0472 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:01.723106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33dea8-4a32-46dc-ad61-4ad607a56029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:01.723784 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33dea8-4a32-46dc-ad61-4ad607a56029 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:01.724062 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33dea8-4a32-46dc-ad61-4ad607a56029 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:01.724333 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33dea8-4a32-46dc-ad61-4ad607a56029 admin admin] PATH_INFO: `/v3/projects/874d7f908b5d4361aa206daef715cc96/users/6d05873e8ba048efb408c974fa7fe0b0/roles/57de4e6fb8c54c94bbcb10d57ae795e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:01.726279 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33dea8-4a32-46dc-ad61-4ad607a56029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=874d7f908b5d4361aa206daef715cc96, user_id=6d05873e8ba048efb408c974fa7fe0b0, role_id=57de4e6fb8c54c94bbcb10d57ae795e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:01.729055 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33dea8-4a32-46dc-ad61-4ad607a56029 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:01.746538 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4606/9210] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 20:02:01 2022] PUT /identity/v3/projects/874d7f908b5d4361aa206daef715cc96/users/6d05873e8ba048efb408c974fa7fe0b0/roles/57de4e6fb8c54c94bbcb10d57ae795e1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:02:05.928449 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd948e1-a403-44eb-b080-d824248bcd29 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:05.928995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd948e1-a403-44eb-b080-d824248bcd29 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:05.928995 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd948e1-a403-44eb-b080-d824248bcd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:05.960310 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3dd948e1-a403-44eb-b080-d824248bcd29 None None] MFA Rules not processed for user `6d05873e8ba048efb408c974fa7fe0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:05.961437 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3dd948e1-a403-44eb-b080-d824248bcd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:06.036057 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4605/9211] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 20:02:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:06.052102 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33dea8-4a32-46dc-ad61-4ad607a56029 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:06.054226 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3d33dea8-4a32-46dc-ad61-4ad607a56029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:06.139466 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33dea8-4a32-46dc-ad61-4ad607a56029 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:06.150381 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88c476-b758-4315-9b38-dc98316c81e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:06.151017 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c476-b758-4315-9b38-dc98316c81e9 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:06.151321 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c476-b758-4315-9b38-dc98316c81e9 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:06.151602 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c476-b758-4315-9b38-dc98316c81e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:06.173761 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:06.215716 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88c476-b758-4315-9b38-dc98316c81e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:06.217343 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88c476-b758-4315-9b38-dc98316c81e9 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:06.229791 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4607/9212] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:07.379932 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163688b-05e6-4a25-9938-2d19e1a48ea0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:07.380788 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163688b-05e6-4a25-9938-2d19e1a48ea0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:07.381067 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163688b-05e6-4a25-9938-2d19e1a48ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:07.400517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6163688b-05e6-4a25-9938-2d19e1a48ea0 None None] MFA Rules not processed for user `f298770eed344a2596e640fcb0aa1627`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:07.401721 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6163688b-05e6-4a25-9938-2d19e1a48ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:07.409558 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4606/9213] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 20:02:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:07.764011 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88c476-b758-4315-9b38-dc98316c81e9 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:07.824364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88c476-b758-4315-9b38-dc98316c81e9 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:07.828058 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e003e0-5777-49b2-a0dc-de2170061878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:07.828681 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e003e0-5777-49b2-a0dc-de2170061878 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:07.828959 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e003e0-5777-49b2-a0dc-de2170061878 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:07.829234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e003e0-5777-49b2-a0dc-de2170061878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:07.831109 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c1e003e0-5777-49b2-a0dc-de2170061878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:07.841634 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e003e0-5777-49b2-a0dc-de2170061878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:07.843118 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e003e0-5777-49b2-a0dc-de2170061878 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:07.854325 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4608/9214] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:13.175873 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163688b-05e6-4a25-9938-2d19e1a48ea0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:13.177456 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6163688b-05e6-4a25-9938-2d19e1a48ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:13.196066 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163688b-05e6-4a25-9938-2d19e1a48ea0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:13.203150 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cb768-bf15-4831-8222-8b198fd9ce02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:13.204014 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cb768-bf15-4831-8222-8b198fd9ce02 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:13.204293 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cb768-bf15-4831-8222-8b198fd9ce02 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:13.204565 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cb768-bf15-4831-8222-8b198fd9ce02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:13.206383 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-171cb768-bf15-4831-8222-8b198fd9ce02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:13.228301 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171cb768-bf15-4831-8222-8b198fd9ce02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:13.230146 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171cb768-bf15-4831-8222-8b198fd9ce02 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:13.241200 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4607/9215] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:17.848079 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=43 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:22.546737 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e003e0-5777-49b2-a0dc-de2170061878 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:22.556234 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e003e0-5777-49b2-a0dc-de2170061878 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:22.560958 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8af426-6a14-4d9e-9f08-32a57bc2561b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:22.561125 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8af426-6a14-4d9e-9f08-32a57bc2561b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:22.561404 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8af426-6a14-4d9e-9f08-32a57bc2561b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:22.561679 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8af426-6a14-4d9e-9f08-32a57bc2561b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:22.575649 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8af426-6a14-4d9e-9f08-32a57bc2561b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:22.577291 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8af426-6a14-4d9e-9f08-32a57bc2561b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:22.587980 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4609/9216] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:23.236679 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:24.545468 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cb768-bf15-4831-8222-8b198fd9ce02 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:24.558349 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cb768-bf15-4831-8222-8b198fd9ce02 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:24.564936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c77e4-e0fe-4c6b-aeab-eec1373a68f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:24.565567 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c77e4-e0fe-4c6b-aeab-eec1373a68f2 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:24.565840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c77e4-e0fe-4c6b-aeab-eec1373a68f2 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:24.571617 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c77e4-e0fe-4c6b-aeab-eec1373a68f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:24.573618 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-275c77e4-e0fe-4c6b-aeab-eec1373a68f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:24.586766 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c77e4-e0fe-4c6b-aeab-eec1373a68f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:24.588424 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c77e4-e0fe-4c6b-aeab-eec1373a68f2 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:24.600122 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4608/9217] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:32.583243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:34.594976 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:24.027547 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8af426-6a14-4d9e-9f08-32a57bc2561b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:24.029363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bd8af426-6a14-4d9e-9f08-32a57bc2561b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:24.045243 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8af426-6a14-4d9e-9f08-32a57bc2561b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:24.050246 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9edac-a26a-4a0f-81d2-c84396fc0f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:24.050910 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9edac-a26a-4a0f-81d2-c84396fc0f05 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:24.051204 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9edac-a26a-4a0f-81d2-c84396fc0f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:24.051534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9edac-a26a-4a0f-81d2-c84396fc0f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:24.053672 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-02c9edac-a26a-4a0f-81d2-c84396fc0f05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:24.063894 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9edac-a26a-4a0f-81d2-c84396fc0f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:24.065331 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9edac-a26a-4a0f-81d2-c84396fc0f05 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:24.073849 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4610/9218] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:03:34.070364 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:51.861004 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c77e4-e0fe-4c6b-aeab-eec1373a68f2 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:51.862450 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-275c77e4-e0fe-4c6b-aeab-eec1373a68f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:51.924057 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c77e4-e0fe-4c6b-aeab-eec1373a68f2 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:51.927935 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf888ae-bb13-4229-8a7a-6c73ff67293c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed720323bd42329feb7574963f744a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:51.928558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf888ae-bb13-4229-8a7a-6c73ff67293c service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:51.928900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf888ae-bb13-4229-8a7a-6c73ff67293c service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:51.929168 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf888ae-bb13-4229-8a7a-6c73ff67293c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:51.931054 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0cf888ae-bb13-4229-8a7a-6c73ff67293c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:51.957924 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf888ae-bb13-4229-8a7a-6c73ff67293c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:51.959407 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf888ae-bb13-4229-8a7a-6c73ff67293c service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:51.970922 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4609/9219] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:05:01.936680 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4003-3943-42e4-833e-ca258e4b03c0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:01.937227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4003-3943-42e4-833e-ca258e4b03c0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:01.937227 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4003-3943-42e4-833e-ca258e4b03c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:01.966332 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=31 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:02.001206 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e25a4003-3943-42e4-833e-ca258e4b03c0 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:02.002446 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e25a4003-3943-42e4-833e-ca258e4b03c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:02.082831 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4611/9220] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 20:05:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:02.143918 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf888ae-bb13-4229-8a7a-6c73ff67293c service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:02.145560 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0cf888ae-bb13-4229-8a7a-6c73ff67293c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:02.253883 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf888ae-bb13-4229-8a7a-6c73ff67293c service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:02.259153 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc094b6-af86-4ba1-8461-925dc83485e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:02.259808 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc094b6-af86-4ba1-8461-925dc83485e4 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:02.260085 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc094b6-af86-4ba1-8461-925dc83485e4 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:02.260359 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc094b6-af86-4ba1-8461-925dc83485e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:02.269987 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc094b6-af86-4ba1-8461-925dc83485e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:02.271651 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc094b6-af86-4ba1-8461-925dc83485e4 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:02.281638 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4610/9221] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 20:05:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:05:11.902596 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c039d4-0a78-4856-97a3-68f7c3d13bcd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:11.903174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c039d4-0a78-4856-97a3-68f7c3d13bcd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:11.903174 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c039d4-0a78-4856-97a3-68f7c3d13bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:11.925830 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-07c039d4-0a78-4856-97a3-68f7c3d13bcd None None] MFA Rules not processed for user `f298770eed344a2596e640fcb0aa1627`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:11.927092 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-07c039d4-0a78-4856-97a3-68f7c3d13bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:11.935673 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4612/9222] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 20:05:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:12.277041 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=41 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:12.654626 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc094b6-af86-4ba1-8461-925dc83485e4 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:12.656711 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dbc094b6-af86-4ba1-8461-925dc83485e4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:12.670116 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c039d4-0a78-4856-97a3-68f7c3d13bcd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:12.680112 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c039d4-0a78-4856-97a3-68f7c3d13bcd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:12.684061 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf4ae9-4b78-4af1-a5dd-d3fbc3c9ee85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:12.688444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf4ae9-4b78-4af1-a5dd-d3fbc3c9ee85 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:12.688444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf4ae9-4b78-4af1-a5dd-d3fbc3c9ee85 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:12.688444 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf4ae9-4b78-4af1-a5dd-d3fbc3c9ee85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:12.693972 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0ddf4ae9-4b78-4af1-a5dd-d3fbc3c9ee85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:12.718328 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf4ae9-4b78-4af1-a5dd-d3fbc3c9ee85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:12.719757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf4ae9-4b78-4af1-a5dd-d3fbc3c9ee85 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:12.734777 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4613/9223] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:05:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:05:12.743543 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc094b6-af86-4ba1-8461-925dc83485e4 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:12.749661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379115dd-00e8-4a8e-9174-18023f4f4b1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:12.750284 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379115dd-00e8-4a8e-9174-18023f4f4b1c service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:12.750553 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379115dd-00e8-4a8e-9174-18023f4f4b1c service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:12.750824 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379115dd-00e8-4a8e-9174-18023f4f4b1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:12.752957 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-379115dd-00e8-4a8e-9174-18023f4f4b1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:12.766985 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379115dd-00e8-4a8e-9174-18023f4f4b1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:12.768656 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379115dd-00e8-4a8e-9174-18023f4f4b1c service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:12.779689 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4611/9224] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:05:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:05:14.166696 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a088019-a33c-4f0b-a65c-d997a2f14a4c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:14.167212 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a088019-a33c-4f0b-a65c-d997a2f14a4c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:14.167558 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a088019-a33c-4f0b-a65c-d997a2f14a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:14.187655 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6a088019-a33c-4f0b-a65c-d997a2f14a4c None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:14.188892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6a088019-a33c-4f0b-a65c-d997a2f14a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:14.196492 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4614/9225] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 20:05:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:14.209027 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379115dd-00e8-4a8e-9174-18023f4f4b1c service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:14.221130 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379115dd-00e8-4a8e-9174-18023f4f4b1c service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:14.226688 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cde3c2-2432-4a6c-9e27-7227bfd0a806 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:14.227312 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cde3c2-2432-4a6c-9e27-7227bfd0a806 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:14.227615 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cde3c2-2432-4a6c-9e27-7227bfd0a806 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:14.227866 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cde3c2-2432-4a6c-9e27-7227bfd0a806 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:14.237088 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cde3c2-2432-4a6c-9e27-7227bfd0a806 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:14.238722 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cde3c2-2432-4a6c-9e27-7227bfd0a806 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:14.247764 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4612/9226] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 20:05:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:05:16.312054 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a088019-a33c-4f0b-a65c-d997a2f14a4c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:16.354601 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a088019-a33c-4f0b-a65c-d997a2f14a4c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:16.389395 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c9dec-ba27-4bce-90b1-1da5c0d64fa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:16.390287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c9dec-ba27-4bce-90b1-1da5c0d64fa9 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:16.390287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c9dec-ba27-4bce-90b1-1da5c0d64fa9 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:16.390592 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c9dec-ba27-4bce-90b1-1da5c0d64fa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:16.392775 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-371c9dec-ba27-4bce-90b1-1da5c0d64fa9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:16.430609 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c9dec-ba27-4bce-90b1-1da5c0d64fa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:16.432607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c9dec-ba27-4bce-90b1-1da5c0d64fa9 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:16.452429 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4615/9227] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:05:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:05:24.244209 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=38 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:24.586290 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb9622-84eb-4647-83ff-59dc21f79b7d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:24.586556 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb9622-84eb-4647-83ff-59dc21f79b7d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:24.586827 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb9622-84eb-4647-83ff-59dc21f79b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:24.631708 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c2eb9622-84eb-4647-83ff-59dc21f79b7d None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:05:24.632971 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c2eb9622-84eb-4647-83ff-59dc21f79b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:24.640909 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4613/9228] 10.222.0.27 () {58 vars in 1062 bytes} [Sun Aug 28 20:05:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:05:24.648073 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c9dec-ba27-4bce-90b1-1da5c0d64fa9 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:24.652722 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=63 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:24.658944 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c9dec-ba27-4bce-90b1-1da5c0d64fa9 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:24.663294 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8184d8-9c27-43ae-8721-2e07022905e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:24.663996 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8184d8-9c27-43ae-8721-2e07022905e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:24.664266 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8184d8-9c27-43ae-8721-2e07022905e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:24.664535 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8184d8-9c27-43ae-8721-2e07022905e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:24.666299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d8184d8-9c27-43ae-8721-2e07022905e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:24.676491 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8184d8-9c27-43ae-8721-2e07022905e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:24.677938 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8184d8-9c27-43ae-8721-2e07022905e2 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:24.686813 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4616/9229] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:05:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:05:34.628370 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:34.683703 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:23.182638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb9622-84eb-4647-83ff-59dc21f79b7d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:23.195562 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb9622-84eb-4647-83ff-59dc21f79b7d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:23.201235 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048c610-b263-4b59-b2c3-23453ad0d0f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:23.201840 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048c610-b263-4b59-b2c3-23453ad0d0f1 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:23.202119 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048c610-b263-4b59-b2c3-23453ad0d0f1 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:23.202390 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048c610-b263-4b59-b2c3-23453ad0d0f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:23.204245 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6048c610-b263-4b59-b2c3-23453ad0d0f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:23.216091 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048c610-b263-4b59-b2c3-23453ad0d0f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:23.217687 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048c610-b263-4b59-b2c3-23453ad0d0f1 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:23.227706 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4614/9230] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:27.340667 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8184d8-9c27-43ae-8721-2e07022905e2 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:27.342853 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d8184d8-9c27-43ae-8721-2e07022905e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:27.365317 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8184d8-9c27-43ae-8721-2e07022905e2 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:27.373119 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b959d-968b-4698-ba3a-fdf20789b21a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:27.373757 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b959d-968b-4698-ba3a-fdf20789b21a service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:27.374033 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b959d-968b-4698-ba3a-fdf20789b21a service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:27.374302 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b959d-968b-4698-ba3a-fdf20789b21a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:27.376382 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dc8b959d-968b-4698-ba3a-fdf20789b21a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:27.388930 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b959d-968b-4698-ba3a-fdf20789b21a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:27.390534 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b959d-968b-4698-ba3a-fdf20789b21a service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:27.401488 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4617/9231] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:33.223746 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:37.396918 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:35.817446 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048c610-b263-4b59-b2c3-23453ad0d0f1 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:35.830418 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048c610-b263-4b59-b2c3-23453ad0d0f1 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:35.836814 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708807d-0e9b-4d78-8caf-ec97224c59cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:35.837426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708807d-0e9b-4d78-8caf-ec97224c59cf service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:35.837704 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708807d-0e9b-4d78-8caf-ec97224c59cf service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:35.837981 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708807d-0e9b-4d78-8caf-ec97224c59cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:35.846234 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708807d-0e9b-4d78-8caf-ec97224c59cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:35.847900 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708807d-0e9b-4d78-8caf-ec97224c59cf service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:35.857020 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4615/9232] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:43.985708 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee97d40-3a92-4314-92c1-d092e59b8d5d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:43.986262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee97d40-3a92-4314-92c1-d092e59b8d5d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:43.986262 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee97d40-3a92-4314-92c1-d092e59b8d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:44.007636 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9ee97d40-3a92-4314-92c1-d092e59b8d5d None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:44.008905 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9ee97d40-3a92-4314-92c1-d092e59b8d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:44.017953 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4618/9233] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 20:07:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:44.063393 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708807d-0e9b-4d78-8caf-ec97224c59cf service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:44.075836 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708807d-0e9b-4d78-8caf-ec97224c59cf service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:44.081611 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855e289-d303-47ea-a164-f6e4c07e51c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:44.082267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855e289-d303-47ea-a164-f6e4c07e51c5 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:44.082544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855e289-d303-47ea-a164-f6e4c07e51c5 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:44.082817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855e289-d303-47ea-a164-f6e4c07e51c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:44.091299 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855e289-d303-47ea-a164-f6e4c07e51c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:44.092884 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855e289-d303-47ea-a164-f6e4c07e51c5 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:44.101435 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4616/9234] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 20:07:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:07:53.705848 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4f12f-9d24-4b81-a2b6-9689f2baafaf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:53.706436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4f12f-9d24-4b81-a2b6-9689f2baafaf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:53.706436 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4f12f-9d24-4b81-a2b6-9689f2baafaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:53.728105 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4ed4f12f-9d24-4b81-a2b6-9689f2baafaf None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:53.729344 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4ed4f12f-9d24-4b81-a2b6-9689f2baafaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:53.737920 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4619/9235] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 20:07:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:53.750426 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855e289-d303-47ea-a164-f6e4c07e51c5 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:53.761951 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855e289-d303-47ea-a164-f6e4c07e51c5 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:53.769143 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15248cac-bac2-4965-b807-f40aea529fec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:53.769760 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15248cac-bac2-4965-b807-f40aea529fec service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:53.770035 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15248cac-bac2-4965-b807-f40aea529fec service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:53.770309 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15248cac-bac2-4965-b807-f40aea529fec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:53.779936 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15248cac-bac2-4965-b807-f40aea529fec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:53.781517 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15248cac-bac2-4965-b807-f40aea529fec service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:53.790550 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4617/9236] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 20:07:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:07:55.059156 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4f12f-9d24-4b81-a2b6-9689f2baafaf None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:55.084356 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4f12f-9d24-4b81-a2b6-9689f2baafaf None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:55.090482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342e4ad-8f0d-492d-8afe-aa1555334a13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:55.091341 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342e4ad-8f0d-492d-8afe-aa1555334a13 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:55.091606 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342e4ad-8f0d-492d-8afe-aa1555334a13 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:55.091878 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342e4ad-8f0d-492d-8afe-aa1555334a13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:55.103018 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342e4ad-8f0d-492d-8afe-aa1555334a13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:55.104892 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342e4ad-8f0d-492d-8afe-aa1555334a13 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:55.117451 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4620/9237] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:57.686720 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15248cac-bac2-4965-b807-f40aea529fec service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:57.702475 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15248cac-bac2-4965-b807-f40aea529fec service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:57.709182 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f6b79-3db7-4441-b9ab-59465810fed7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faef473a2ab84661b09f3ba3dd977058', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:57.709963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f6b79-3db7-4441-b9ab-59465810fed7 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:57.710479 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f6b79-3db7-4441-b9ab-59465810fed7 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:57.710973 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f6b79-3db7-4441-b9ab-59465810fed7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:57.724288 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f6b79-3db7-4441-b9ab-59465810fed7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:57.726001 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f6b79-3db7-4441-b9ab-59465810fed7 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:57.737287 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4618/9238] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:58.833911 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdebb5-da01-43fb-a64b-7b063386f540 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:58.834426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdebb5-da01-43fb-a64b-7b063386f540 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:58.834426 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdebb5-da01-43fb-a64b-7b063386f540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:58.856354 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e6bdebb5-da01-43fb-a64b-7b063386f540 None None] MFA Rules not processed for user `e63fa755c46b4a2b9e32e720f9fb8413`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:58.857565 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e6bdebb5-da01-43fb-a64b-7b063386f540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:58.867073 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4621/9239] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 20:07:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:58.882919 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f6b79-3db7-4441-b9ab-59465810fed7 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:58.895453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f6b79-3db7-4441-b9ab-59465810fed7 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:58.900856 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e881e0-ad53-4a33-a977-bd6efe95fe00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd55caefe410444509a1eee4262b76c80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:58.901489 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e881e0-ad53-4a33-a977-bd6efe95fe00 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:58.901769 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e881e0-ad53-4a33-a977-bd6efe95fe00 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:58.902045 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e881e0-ad53-4a33-a977-bd6efe95fe00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:58.910963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e881e0-ad53-4a33-a977-bd6efe95fe00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:58.912661 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e881e0-ad53-4a33-a977-bd6efe95fe00 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:58.920926 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4619/9240] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 20:07:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:08:04.161545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c880a-b0c2-4fa4-8cb2-6941df8a419c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:04.162022 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c880a-b0c2-4fa4-8cb2-6941df8a419c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:04.163387 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c880a-b0c2-4fa4-8cb2-6941df8a419c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:04.183731 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-968c880a-b0c2-4fa4-8cb2-6941df8a419c None None] MFA Rules not processed for user `0b58ca64493247c188c4c77ad75e426a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:04.184967 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-968c880a-b0c2-4fa4-8cb2-6941df8a419c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:04.192557 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4622/9241] 10.222.0.27 () {58 vars in 1062 bytes} [Sun Aug 28 20:08:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:08:04.199178 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e881e0-ad53-4a33-a977-bd6efe95fe00 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:04.205689 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=31 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:04.214978 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e881e0-ad53-4a33-a977-bd6efe95fe00 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:04.222048 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd4542-b12b-4206-9994-9d332d2539f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b58ca64493247c188c4c77ad75e426a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:04.223036 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd4542-b12b-4206-9994-9d332d2539f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:04.223401 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd4542-b12b-4206-9994-9d332d2539f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:04.223756 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd4542-b12b-4206-9994-9d332d2539f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:04.293124 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd4542-b12b-4206-9994-9d332d2539f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:04.294635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd4542-b12b-4206-9994-9d332d2539f9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:04.304950 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4620/9242] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:08:07.656324 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c880a-b0c2-4fa4-8cb2-6941df8a419c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:07.666912 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=19 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:07.675841 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c880a-b0c2-4fa4-8cb2-6941df8a419c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:07.681728 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68cf1d-01b6-4ed1-806c-8f622ad9b427 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:07.682476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68cf1d-01b6-4ed1-806c-8f622ad9b427 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:07.682999 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68cf1d-01b6-4ed1-806c-8f622ad9b427 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:07.683415 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68cf1d-01b6-4ed1-806c-8f622ad9b427 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:07.685378 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1a68cf1d-01b6-4ed1-806c-8f622ad9b427 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:07.701287 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68cf1d-01b6-4ed1-806c-8f622ad9b427 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:07.704769 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68cf1d-01b6-4ed1-806c-8f622ad9b427 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:07.725259 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4623/9243] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:08:11.033421 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd4542-b12b-4206-9994-9d332d2539f9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:11.046705 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd4542-b12b-4206-9994-9d332d2539f9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:11.054544 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db44adc-ab50-4eaf-9c0a-f3e8e9fc6c00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:11.055307 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db44adc-ab50-4eaf-9c0a-f3e8e9fc6c00 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:11.055673 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db44adc-ab50-4eaf-9c0a-f3e8e9fc6c00 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:11.056012 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db44adc-ab50-4eaf-9c0a-f3e8e9fc6c00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:11.057806 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2db44adc-ab50-4eaf-9c0a-f3e8e9fc6c00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:11.071832 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db44adc-ab50-4eaf-9c0a-f3e8e9fc6c00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:11.073724 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db44adc-ab50-4eaf-9c0a-f3e8e9fc6c00 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:11.086461 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4621/9244] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:08:11.102786 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68cf1d-01b6-4ed1-806c-8f622ad9b427 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:11.114656 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68cf1d-01b6-4ed1-806c-8f622ad9b427 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:11.124476 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec441a0-aa29-4577-a257-4ff15cf963e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:11.125154 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec441a0-aa29-4577-a257-4ff15cf963e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:11.125429 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec441a0-aa29-4577-a257-4ff15cf963e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:11.125706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec441a0-aa29-4577-a257-4ff15cf963e5 admin admin] PATH_INFO: `/v3/users/f298770eed344a2596e640fcb0aa1627` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:11.126883 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec441a0-aa29-4577-a257-4ff15cf963e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f298770eed344a2596e640fcb0aa1627)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:11.128866 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec441a0-aa29-4577-a257-4ff15cf963e5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:11.178752 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6ec441a0-aa29-4577-a257-4ff15cf963e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f298770eed344a2596e640fcb0aa1627'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.191797 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6ec441a0-aa29-4577-a257-4ff15cf963e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f298770eed344a2596e640fcb0aa1627'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.192611 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6ec441a0-aa29-4577-a257-4ff15cf963e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f298770eed344a2596e640fcb0aa1627'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.193373 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6ec441a0-aa29-4577-a257-4ff15cf963e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f298770eed344a2596e640fcb0aa1627'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.210607 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6ec441a0-aa29-4577-a257-4ff15cf963e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f298770eed344a2596e640fcb0aa1627'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.224036 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4624/9245] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 20:08:11 2022] DELETE /identity/v3/users/f298770eed344a2596e640fcb0aa1627 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:11.417844 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db44adc-ab50-4eaf-9c0a-f3e8e9fc6c00 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:11.429495 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db44adc-ab50-4eaf-9c0a-f3e8e9fc6c00 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:11.488415 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dba0a-f556-4a21-856d-8a41ad317e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:11.489082 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dba0a-f556-4a21-856d-8a41ad317e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:11.489377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dba0a-f556-4a21-856d-8a41ad317e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:11.489635 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dba0a-f556-4a21-856d-8a41ad317e69 admin admin] PATH_INFO: `/v3/projects/ee4287b7be1f4a658c93ed7146ce4f48` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:11.490753 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dba0a-f556-4a21-856d-8a41ad317e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee4287b7be1f4a658c93ed7146ce4f48)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:11.493667 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dba0a-f556-4a21-856d-8a41ad317e69 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:11.545232 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb8dba0a-f556-4a21-856d-8a41ad317e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee4287b7be1f4a658c93ed7146ce4f48', 'request_id': 'req-cb8dba0a-f556-4a21-856d-8a41ad317e69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.555991 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb8dba0a-f556-4a21-856d-8a41ad317e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee4287b7be1f4a658c93ed7146ce4f48', 'request_id': 'req-cb8dba0a-f556-4a21-856d-8a41ad317e69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.562816 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb8dba0a-f556-4a21-856d-8a41ad317e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee4287b7be1f4a658c93ed7146ce4f48', 'request_id': 'req-cb8dba0a-f556-4a21-856d-8a41ad317e69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.577643 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb8dba0a-f556-4a21-856d-8a41ad317e69 admin admin] The token cache is being invalidate because project ee4287b7be1f4a658c93ed7146ce4f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:11.577963 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb8dba0a-f556-4a21-856d-8a41ad317e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.578638 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb8dba0a-f556-4a21-856d-8a41ad317e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.580318 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4622/9246] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 20:08:11 2022] DELETE /identity/v3/projects/ee4287b7be1f4a658c93ed7146ce4f48 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:11.584706 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec441a0-aa29-4577-a257-4ff15cf963e5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:11.586299 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6ec441a0-aa29-4577-a257-4ff15cf963e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:11.599781 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec441a0-aa29-4577-a257-4ff15cf963e5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:11.663626 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ba1da-9934-4e40-b4e7-108036d2d292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:11.664184 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ba1da-9934-4e40-b4e7-108036d2d292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:11.664489 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ba1da-9934-4e40-b4e7-108036d2d292 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:11.664833 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ba1da-9934-4e40-b4e7-108036d2d292 admin admin] PATH_INFO: `/v3/users/6d05873e8ba048efb408c974fa7fe0b0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:11.666129 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ba1da-9934-4e40-b4e7-108036d2d292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d05873e8ba048efb408c974fa7fe0b0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:11.668195 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ba1da-9934-4e40-b4e7-108036d2d292 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:11.719422 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-359ba1da-9934-4e40-b4e7-108036d2d292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d05873e8ba048efb408c974fa7fe0b0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.731694 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:11.733363 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-359ba1da-9934-4e40-b4e7-108036d2d292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d05873e8ba048efb408c974fa7fe0b0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.734205 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-359ba1da-9934-4e40-b4e7-108036d2d292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d05873e8ba048efb408c974fa7fe0b0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.735316 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-359ba1da-9934-4e40-b4e7-108036d2d292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d05873e8ba048efb408c974fa7fe0b0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.745482 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-359ba1da-9934-4e40-b4e7-108036d2d292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d05873e8ba048efb408c974fa7fe0b0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:11.759633 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4625/9247] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 20:08:11 2022] DELETE /identity/v3/users/6d05873e8ba048efb408c974fa7fe0b0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:11.949342 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dba0a-f556-4a21-856d-8a41ad317e69 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:11.950990 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cb8dba0a-f556-4a21-856d-8a41ad317e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:11.964772 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dba0a-f556-4a21-856d-8a41ad317e69 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:11.975431 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:12.032080 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6036c24-3dc0-4f22-955b-accd348d0331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ad14eb111e4774a71609d695e07661', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e232b8348b844fbb8b30d77b02f1872', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:12.032727 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6036c24-3dc0-4f22-955b-accd348d0331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:12.033006 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6036c24-3dc0-4f22-955b-accd348d0331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:12.033278 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6036c24-3dc0-4f22-955b-accd348d0331 admin admin] PATH_INFO: `/v3/projects/874d7f908b5d4361aa206daef715cc96` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:12.034558 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6036c24-3dc0-4f22-955b-accd348d0331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=874d7f908b5d4361aa206daef715cc96)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:12.036539 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6036c24-3dc0-4f22-955b-accd348d0331 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:12.089484 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d6036c24-3dc0-4f22-955b-accd348d0331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874d7f908b5d4361aa206daef715cc96', 'request_id': 'req-d6036c24-3dc0-4f22-955b-accd348d0331'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:12.098329 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d6036c24-3dc0-4f22-955b-accd348d0331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874d7f908b5d4361aa206daef715cc96', 'request_id': 'req-d6036c24-3dc0-4f22-955b-accd348d0331'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:12.104612 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d6036c24-3dc0-4f22-955b-accd348d0331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874d7f908b5d4361aa206daef715cc96', 'request_id': 'req-d6036c24-3dc0-4f22-955b-accd348d0331'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:12.117438 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d6036c24-3dc0-4f22-955b-accd348d0331 admin admin] The token cache is being invalidate because project 874d7f908b5d4361aa206daef715cc96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:08:12.117778 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d6036c24-3dc0-4f22-955b-accd348d0331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:12.118779 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d6036c24-3dc0-4f22-955b-accd348d0331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:08:12.120951 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4623/9248] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 20:08:11 2022] DELETE /identity/v3/projects/874d7f908b5d4361aa206daef715cc96 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:08:21.755624 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:22.113442 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:25.099039 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ba1da-9934-4e40-b4e7-108036d2d292 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:25.100818 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-359ba1da-9934-4e40-b4e7-108036d2d292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:25.240143 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ba1da-9934-4e40-b4e7-108036d2d292 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:25.305588 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf61475-b0da-4875-9ea8-aa551126171a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:25.306229 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf61475-b0da-4875-9ea8-aa551126171a service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:25.306521 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf61475-b0da-4875-9ea8-aa551126171a service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:25.306795 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf61475-b0da-4875-9ea8-aa551126171a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:25.308966 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8bf61475-b0da-4875-9ea8-aa551126171a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:25.321106 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf61475-b0da-4875-9ea8-aa551126171a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:25.322712 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf61475-b0da-4875-9ea8-aa551126171a service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:25.333841 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4626/9249] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:11:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:11:30.609311 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6036c24-3dc0-4f22-955b-accd348d0331 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:11:30.610901 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6036c24-3dc0-4f22-955b-accd348d0331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:30.661949 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6036c24-3dc0-4f22-955b-accd348d0331 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:11:30.667755 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088acc1-d988-4846-bcf3-7576752b7158 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:11:30.668357 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088acc1-d988-4846-bcf3-7576752b7158 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:11:30.668657 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088acc1-d988-4846-bcf3-7576752b7158 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:11:30.668888 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088acc1-d988-4846-bcf3-7576752b7158 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:11:30.670934 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1088acc1-d988-4846-bcf3-7576752b7158 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:11:30.683751 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088acc1-d988-4846-bcf3-7576752b7158 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:11:30.685377 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088acc1-d988-4846-bcf3-7576752b7158 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:11:30.695984 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4624/9250] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:11:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:11:35.328590 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=80 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:11:40.691785 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=17 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:26.158545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f47c02-17af-4d18-accb-c0615001eba2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:26.159494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f47c02-17af-4d18-accb-c0615001eba2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:26.159494 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f47c02-17af-4d18-accb-c0615001eba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:26.233191 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-83f47c02-17af-4d18-accb-c0615001eba2 None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:26.234433 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-83f47c02-17af-4d18-accb-c0615001eba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:26.244242 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4627/9251] 10.222.0.42 () {58 vars in 1015 bytes} [Sun Aug 28 20:13:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:13:26.257939 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80130f-bd09-467a-a09d-f30cc00bf948 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:26.258529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80130f-bd09-467a-a09d-f30cc00bf948 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:26.258529 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80130f-bd09-467a-a09d-f30cc00bf948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:26.279125 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8e80130f-bd09-467a-a09d-f30cc00bf948 None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:26.280396 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8e80130f-bd09-467a-a09d-f30cc00bf948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:26.289272 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4625/9252] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Aug 28 20:13:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:26.295726 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f47c02-17af-4d18-accb-c0615001eba2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:26.306493 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f47c02-17af-4d18-accb-c0615001eba2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:26.312645 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd390d5-a212-4de7-95ce-e186e6decfcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:26.313251 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd390d5-a212-4de7-95ce-e186e6decfcc service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:26.313529 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd390d5-a212-4de7-95ce-e186e6decfcc service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:26.313801 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd390d5-a212-4de7-95ce-e186e6decfcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:26.322661 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd390d5-a212-4de7-95ce-e186e6decfcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:26.324371 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd390d5-a212-4de7-95ce-e186e6decfcc service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:26.334985 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4628/9253] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:33.591453 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f269-6ef0-456e-897d-0a36f4f20b54 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:33.592086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f269-6ef0-456e-897d-0a36f4f20b54 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:33.592086 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f269-6ef0-456e-897d-0a36f4f20b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:33.613817 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7040f269-6ef0-456e-897d-0a36f4f20b54 None None] MFA Rules not processed for user `a124350e5c384907b9d80fbe05d07d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:13:33.615024 n-d-850468-20 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7040f269-6ef0-456e-897d-0a36f4f20b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:33.625851 n-d-850468-20 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4626/9254] 10.222.0.45 () {58 vars in 1015 bytes} [Sun Aug 28 20:13:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:13:33.640512 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd390d5-a212-4de7-95ce-e186e6decfcc service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:33.651616 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd390d5-a212-4de7-95ce-e186e6decfcc service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:33.657399 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6799536-8d52-4019-83c8-a5c5b7c271e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a124350e5c384907b9d80fbe05d07d7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651b8653291a414fba3805312708ce48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:33.657995 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6799536-8d52-4019-83c8-a5c5b7c271e5 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:33.658267 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6799536-8d52-4019-83c8-a5c5b7c271e5 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:33.658545 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6799536-8d52-4019-83c8-a5c5b7c271e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:33.667365 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6799536-8d52-4019-83c8-a5c5b7c271e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:33.668968 n-d-850468-20 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6799536-8d52-4019-83c8-a5c5b7c271e5 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:33.678722 n-d-850468-20 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4629/9255] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:43.608267 n-d-850468-20 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:43.674863 n-d-850468-20 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=34 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}